-- Logs begin at Sat 2022-08-27 01:39:06 UTC, end at Sat 2022-08-27 04:16:15 UTC. -- Aug 27 02:15:22.919715 n-d-852084-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 02:15:22.928474 n-d-852084-5 devstack@n-api.service[106401]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 02:15:22 2022] *** Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: nodename: n-d-852084-5 Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: machine: x86_64 Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: clock source: unix Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: pcre jit disabled Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: detected number of CPU cores: 4 Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: current working directory: / Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: detected binary path: /usr/bin/uwsgi-core Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: your processes number limit is 47680 Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: your memory page size is 4096 bytes Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: detected max file descriptor number: 2048 Aug 27 02:15:22.931683 n-d-852084-5 devstack@n-api.service[106401]: lock engine: pthread robust mutexes Aug 27 02:15:22.933324 n-d-852084-5 devstack@n-api.service[106401]: thunder lock: enabled Aug 27 02:15:22.933324 n-d-852084-5 devstack@n-api.service[106401]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 02:15:22.933324 n-d-852084-5 devstack@n-api.service[106401]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 02:15:22.972022 n-d-852084-5 devstack@n-api.service[106401]: Python main interpreter initialized at 0x55f750f299c0 Aug 27 02:15:22.972022 n-d-852084-5 devstack@n-api.service[106401]: python threads support enabled Aug 27 02:15:22.972022 n-d-852084-5 devstack@n-api.service[106401]: your server socket listen backlog is limited to 100 connections Aug 27 02:15:22.972022 n-d-852084-5 devstack@n-api.service[106401]: your mercy for graceful operations on workers is 90 seconds Aug 27 02:15:22.972639 n-d-852084-5 devstack@n-api.service[106401]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 02:15:22.972639 n-d-852084-5 devstack@n-api.service[106401]: *** Operational MODE: preforking *** Aug 27 02:15:22.973373 n-d-852084-5 devstack@n-api.service[106401]: *** uWSGI is running in multiple interpreter mode *** Aug 27 02:15:22.973373 n-d-852084-5 devstack@n-api.service[106401]: spawned uWSGI master process (pid: 106401) Aug 27 02:15:22.973695 n-d-852084-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 02:15:22.975018 n-d-852084-5 devstack@n-api.service[106401]: spawned uWSGI worker 1 (pid: 106402, cores: 1) Aug 27 02:15:22.975018 n-d-852084-5 devstack@n-api.service[106401]: spawned uWSGI worker 2 (pid: 106403, cores: 1) Aug 27 02:15:22.975018 n-d-852084-5 devstack@n-api.service[106401]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 02:15:23.714998 n-d-852084-5 devstack@n-api.service[106402]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:15:24.158191 n-d-852084-5 devstack@n-api.service[106403]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:15:24.851788 n-d-852084-5 devstack@n-api.service[106402]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:15:24.851788 n-d-852084-5 devstack@n-api.service[106402]: from cryptography.utils import int_from_bytes Aug 27 02:15:24.852753 n-d-852084-5 devstack@n-api.service[106402]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:15:24.852753 n-d-852084-5 devstack@n-api.service[106402]: from cryptography.utils import int_from_bytes Aug 27 02:15:25.246830 n-d-852084-5 devstack@n-api.service[106403]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:15:25.246830 n-d-852084-5 devstack@n-api.service[106403]: from cryptography.utils import int_from_bytes Aug 27 02:15:25.247742 n-d-852084-5 devstack@n-api.service[106403]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:15:25.247742 n-d-852084-5 devstack@n-api.service[106403]: from cryptography.utils import int_from_bytes Aug 27 02:15:27.543118 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:15:27.544056 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:15:27.544056 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:15:27.544413 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:15:27.544825 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:15:27.545314 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.545769 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.546189 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.546575 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.546970 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.547342 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.547740 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.548123 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.548513 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.548833 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.549210 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.549593 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852084-5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.550032 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.550446 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.550941 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.551326 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.551715 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.552103 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.552497 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.553091 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.553786 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.554315 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.554809 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.555347 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.555786 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.556247 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.556680 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.557105 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.557554 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.558022 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.558552 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852084-5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.559036 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.559529 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.559972 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.560546 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.560929 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.561346 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.561784 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.562233 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.562640 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.563064 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.563480 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.563897 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.564341 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.564747 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.565266 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.565810 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.566837 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.567222 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.567659 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.568029 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.568457 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.568911 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.569348 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.569838 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.570232 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.570607 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.571058 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.571505 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.571937 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.572380 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.572815 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.573243 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.573694 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.574101 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.574502 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.574917 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.575348 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.575763 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.576184 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.576606 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.577020 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.577534 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.577923 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.578343 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.578787 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.579207 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.579609 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.580024 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.580441 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.580856 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.581262 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.582294 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.582758 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.583188 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.583655 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.584006 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.584408 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.584812 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.585232 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.585659 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.586107 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.586514 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.586921 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.587323 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.587730 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.588137 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.588537 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.588933 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.589341 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.589793 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.590196 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.590601 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.591023 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.591435 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.591841 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.592239 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.592637 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.593041 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.593453 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.593893 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.594298 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.594721 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.595122 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.595579 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.596020 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.596444 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.596856 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.597296 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.597760 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.598163 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.598575 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.598979 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.599393 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.599792 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.600188 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.600585 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.600990 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.601448 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.601913 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.602308 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.602737 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.603184 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.603586 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.603995 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.604393 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.604814 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.605244 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.606033 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.606470 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.606888 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.607314 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.607739 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.608151 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.608566 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.608979 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.609402 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.609846 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.610251 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.610655 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.611068 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.611492 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.611916 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.612327 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.612738 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.613218 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.613626 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.614109 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.614534 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.614954 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.615416 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.615858 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.616394 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.616836 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.617251 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.617715 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.618139 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.618554 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.618967 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.619380 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.619805 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.620210 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.620624 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.621035 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.621462 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.621919 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.622339 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.622745 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.623150 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.623556 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.624002 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.624417 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.624832 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.625243 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.625655 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.626105 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.626573 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.627008 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.627415 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.627813 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.628212 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.629143 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.629556 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.629992 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.630408 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.630833 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.631238 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.631674 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.632079 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.632485 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.632895 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.633301 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.633724 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.634145 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.634554 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.634952 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.635402 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.635808 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.636206 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.636723 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.637084 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.637484 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.637933 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.638348 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.638753 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.639215 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.639586 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.640028 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.640322 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.640677 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.641057 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.641439 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.641829 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.642221 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.642610 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.642991 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.643358 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.643733 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.644121 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.645136 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.645583 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.646051 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.646428 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.646830 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.647229 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.647595 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.647960 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.648354 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.648814 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.649220 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.649622 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.650060 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.650508 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.650918 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.651358 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.651788 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.652203 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.652619 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.653033 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.653448 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.653897 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.654305 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.654718 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.655129 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.655559 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.655983 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.656370 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.656743 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.657205 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.657591 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.657994 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.658358 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.658738 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.659140 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.659531 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.659951 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.660331 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.660702 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.661078 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.661459 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.661887 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.662267 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.662643 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.663027 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.663402 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.663790 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.664163 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.664555 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.664933 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.665317 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.665726 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.666134 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.666535 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.666945 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.667404 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.667843 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.668286 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.668726 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.669176 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.669624 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.670112 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.670743 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.671841 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.671841 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.674005 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.674005 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.674005 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.674005 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.674005 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.677401 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.677401 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.677401 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.677401 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.677401 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.677401 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.677401 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.678541 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.678541 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.678971 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.679422 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.679829 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.680236 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.680642 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.681106 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.681526 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.681977 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.682395 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.682822 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.683230 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.683676 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.684194 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.684604 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.685030 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.685442 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.685901 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.686324 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.686732 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.687138 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.687543 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.687994 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.688433 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.688844 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.689256 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.689659 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.690086 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.690510 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.691715 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.692150 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.692559 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.692982 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.693425 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.693918 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.694372 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.694807 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.695217 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.695619 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.696023 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.696429 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.696826 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.697240 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.697641 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.698080 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.698516 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.698932 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.699336 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.699748 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.700146 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.700551 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.700972 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.701370 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.701820 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.702236 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.702667 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.703079 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.703485 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.703892 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.704297 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.704746 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.705150 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.705614 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.706134 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.706573 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.707578 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.707978 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.708396 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.708833 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.709234 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.709629 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.710177 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.710582 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.710980 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.711388 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.711793 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.712200 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.712613 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.713018 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.713463 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.713623 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:15:27.714374 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:15:27.714533 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.714681 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:15:27.714829 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.714986 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:15:27.715131 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:15:27.715274 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.715518 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.715672 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.715818 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.716027 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.716174 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.716334 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.716599 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.716768 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.716981 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.717141 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.717301 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.717562 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.717770 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.717920 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.718156 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.718311 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.718528 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.718717 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.718866 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852084-5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.719083 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.719242 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.719398 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.719688 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.719840 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.719984 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.720202 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.720357 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.720602 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.720763 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.720908 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.721185 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.721409 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.721701 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.721877 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.722023 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.722286 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.722442 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.722714 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.722865 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.723035 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.723301 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.723456 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.723602 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.723822 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.723974 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.724236 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.724389 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.724534 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.724822 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.724995 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852084-5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.725210 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.725356 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.725530 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.725846 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.726019 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.726281 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.726431 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.726577 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.726863 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.727028 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.727248 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.727418 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.727570 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.727789 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.727934 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.728112 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.728409 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.728564 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.728773 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.728964 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.729114 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.729327 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.729474 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.729618 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.729959 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.730134 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.730291 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.730747 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.730900 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.731105 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.731252 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.731394 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.731649 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.731812 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.731958 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.732226 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.732379 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.732582 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.732743 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.732890 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.733070 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.733253 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.733403 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.733712 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.733896 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.734043 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.734300 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.734464 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.734607 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.734821 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.735001 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.735187 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.735333 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.735488 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.735787 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.735960 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.736105 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.736576 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.736731 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.736875 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.737028 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.737170 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.737298 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.737541 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.737717 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.738065 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.738222 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.738385 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.738616 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.738785 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.738984 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.739164 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.739356 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.739576 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.739723 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.739895 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.740184 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.740372 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.740532 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.740705 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.740855 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.741099 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.741250 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.741397 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.741559 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.741747 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.742043 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.742214 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.742369 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.742539 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.742686 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.742824 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.742953 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.743128 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.743520 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.743520 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.743953 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.744172 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.744172 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.744576 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.744794 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.744794 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.745153 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.745457 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.745457 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.745915 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.746081 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.746081 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.746372 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.746518 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.746518 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.746797 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.746940 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.746940 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.747220 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.747374 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.747517 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.747720 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.747870 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.748023 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.748170 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.748435 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.748602 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.748748 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.749022 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.749250 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.749411 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.749615 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.749877 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.750023 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.750163 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.750381 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.750541 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.750680 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.750823 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.751121 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.751274 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.751435 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.751653 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.751807 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.752015 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.752189 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.752363 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.752621 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.752772 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.752915 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.753195 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.753349 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.754033 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.754288 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.754460 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.754638 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.754818 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.754969 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.755232 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.755393 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.755551 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.755816 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.755966 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.756143 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.756367 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.756518 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.756764 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.756923 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.757082 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.757355 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.757506 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.757651 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:15:27.757922 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.758073 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.758345 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.758620 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.758764 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.758988 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.759135 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.759333 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.759612 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.759837 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.759997 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.760139 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.760294 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.760537 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.760687 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.760848 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.761135 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.761290 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.761446 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.761707 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.761880 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.762083 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.762232 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.762376 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.762700 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.762856 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.763014 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.763225 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.763376 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.763614 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.763909 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.764064 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.764228 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.764437 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.764590 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.764837 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.764986 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.765128 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.765429 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.765583 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.765827 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.765994 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.766151 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.766447 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.766602 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.766746 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.766972 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.767124 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.767360 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.767522 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.767672 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.767977 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.768206 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.768351 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.768492 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.768649 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.768906 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.769056 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.769836 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.770116 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.770267 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.770425 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.770640 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.770850 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.770999 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.771198 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.771364 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.771609 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.771874 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.772025 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.772250 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.772398 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.772557 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.772862 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.773016 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.773171 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.773482 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.773643 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.773897 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.774137 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.774299 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.774445 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.774667 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.774820 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.775027 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.775221 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.775372 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.775633 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.775782 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.775941 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.776239 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.776392 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.776568 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.776789 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.776944 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.777196 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.777354 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.777481 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.777822 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.777977 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.778122 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.778400 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.778556 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.778702 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.778915 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.779066 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.779313 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.779480 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.779626 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.779913 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.780134 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.780317 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.780474 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.780619 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.780816 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.781020 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.781167 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.781410 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.781581 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.781766 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.782045 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.782200 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.782345 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.782585 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.782757 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.782984 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.783265 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.783427 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.783571 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.783807 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.784035 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.784183 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.784353 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.784486 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.784880 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.785246 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.785398 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.785571 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.785855 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.786006 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.786211 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.786379 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.786526 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.786814 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.786973 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.787116 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.787351 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.787526 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.787681 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.787880 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.788031 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.788270 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.788429 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.788572 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.788860 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.789009 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.789163 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.789376 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.789549 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.789789 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.789953 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.790098 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.790383 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.790592 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.790760 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.790971 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.791108 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.791305 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.791506 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.791668 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.791998 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.792151 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.792295 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.792572 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.792726 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.792983 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.793153 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.793284 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.793554 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.793805 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.793949 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.794152 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.794302 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.794482 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.794706 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.794861 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.795152 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.795417 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.795563 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.795730 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.795863 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.796085 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.796277 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.796441 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.796700 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.796849 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.797051 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.797276 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.797440 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.797718 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.797884 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.798057 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.798325 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.798493 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.798705 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.798918 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.799073 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.799279 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.799426 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.799573 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.799886 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.800037 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.800193 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.800535 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.800762 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.800919 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.801074 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.801230 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.801423 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.801588 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.801761 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.802073 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.802237 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.802396 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.802664 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.802819 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.802960 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.803226 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.803379 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.803582 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.803771 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.803939 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.804213 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.804375 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.804529 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.804777 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.804940 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.805126 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.805308 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.805478 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.805756 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.805924 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.806079 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.806356 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.806509 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.806665 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.806883 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.807035 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.807264 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.807482 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.807650 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.807862 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.808021 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.808166 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.808466 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.808614 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.808772 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.809026 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.809201 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.809343 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.809488 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.809661 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.809975 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.810109 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.810298 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.810441 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.810628 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.810931 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.811102 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.811260 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.811390 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.811548 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.811828 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.812114 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.812114 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.812554 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.812769 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.812769 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.813190 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.813429 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.813429 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.813929 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.814079 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.814079 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.814385 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.814544 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.814544 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.814821 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.814968 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.815124 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.815271 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.815430 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.815666 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.815843 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.816584 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.816736 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.816883 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.817197 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.817349 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.817505 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.817781 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.817938 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.818101 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.818325 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.818478 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.818724 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.818871 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.819069 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.819327 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.819479 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.819634 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.819877 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.820033 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.820225 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.820415 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.820822 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.821002 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.821148 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.821283 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.821462 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.821827 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.822098 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.822098 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.822449 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.822667 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.822834 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.823094 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.823258 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.823465 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.823696 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.823860 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.824005 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.824238 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.824392 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.824580 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.824778 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.824931 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.825181 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.825343 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.825491 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.825803 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.825956 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.826101 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.826328 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.826507 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.826691 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.826870 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.827022 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.827284 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.827433 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.827601 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.827870 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.828024 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.828168 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.828412 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.828685 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.828831 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.828971 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.829129 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.829365 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.829523 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.829732 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.829987 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.830137 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.830333 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.830597 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.830752 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.830970 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.831134 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.831310 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.832200 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.832411 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.832577 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.832776 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.832939 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.833119 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.833376 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.833596 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.833811 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.833953 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.834099 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.834329 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.834476 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.834622 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.834924 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.835076 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.835222 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.835464 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.835617 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.835818 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.836015 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.836177 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.836416 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.836578 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.836723 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.837015 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.837177 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.837358 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.837559 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.837748 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.838030 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.838182 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.838326 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.838590 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.838746 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.838920 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.839156 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.839405 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.839600 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.839759 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.839888 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.840100 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.840249 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.840405 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.840685 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.840854 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.840998 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.841283 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.841474 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.841610 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.841914 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.842078 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.842234 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.842409 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.842565 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.842802 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.843086 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.843306 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.843533 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.843739 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.843739 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.844186 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.844411 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.844635 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.844849 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.844849 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.845248 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.845478 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.845478 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.845811 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.845959 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.846104 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.846261 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.846431 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.846575 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.846720 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.846937 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.847122 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.847312 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.847566 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.847726 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.847872 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.848156 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.848309 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.848466 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.848703 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.848856 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.849059 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.849218 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.849362 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.849736 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.849910 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.850055 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.850295 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.850450 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.850657 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.850817 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.850964 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.851260 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.851434 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.851582 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.851839 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.852037 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.852195 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.852338 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.852468 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.852665 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.852827 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.853180 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.853350 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.853490 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.853640 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.853972 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.854181 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.854355 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.854582 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.854742 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.854887 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.855187 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.855353 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.855748 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.856000 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.856154 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.856367 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.856561 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.856726 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.856960 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.857108 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.857253 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.857554 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.857811 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.857977 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.858118 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.858261 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.858474 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.858646 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.858796 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.859079 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.859229 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.859375 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.859638 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.859794 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.860039 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.860185 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.860328 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.860556 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.860733 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.860874 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.861104 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.861252 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.861464 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.861610 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.861769 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.861899 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.862219 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.862450 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.862668 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.862924 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.863182 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.863613 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.863613 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.863889 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.864037 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.864169 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.864313 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.864473 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.864625 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.864756 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.864966 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.865116 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.865368 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.865565 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.865810 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.866007 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.866154 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.866431 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.866586 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.866752 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.867041 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.867195 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.867339 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.867588 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.867767 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.867940 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.868095 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.868267 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.868598 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.868814 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.868983 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.869133 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.869268 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.869415 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.869573 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.869860 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.870061 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.870228 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.870363 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.870510 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.870875 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.871025 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.871169 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.871370 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.871493 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.871842 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.871970 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.872165 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.872330 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.872457 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.872769 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.872910 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.873088 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.873254 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.873522 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.873698 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.873924 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.874068 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.874199 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.874350 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.874644 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.874782 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.874965 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.875105 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.875277 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.875547 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.875694 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.875876 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.876062 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.876206 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.876507 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.876668 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.876847 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.877133 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.877287 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.877553 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.877888 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.878037 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.878181 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.878321 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.879035 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.879264 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.879425 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.879660 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.879814 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.879955 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.880182 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.880350 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.880552 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.880705 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.880877 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.881167 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.881321 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.881483 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.881640 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.881840 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.882075 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.882242 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.882405 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.882566 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.882709 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.882961 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.883106 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.883260 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.883479 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.883668 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.884041 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.884246 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.884387 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.884539 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.884672 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.884824 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.884962 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.885103 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.885354 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.885511 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.885695 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.885855 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.886009 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.886297 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.886445 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.886586 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.886780 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.886925 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.887225 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.887375 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.887550 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.887697 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.887885 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.888137 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.888290 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.888508 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.888660 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.888842 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.889100 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.889249 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.889482 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.889632 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.889833 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.890126 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.890290 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.890435 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.890575 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.890720 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.890981 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.891151 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.891312 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.891578 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.891738 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.891885 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.892038 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.892205 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.892391 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.892545 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.892769 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.892923 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.893083 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.893333 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.893485 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.893653 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.893866 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.894850 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.895032 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.895180 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.895180 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.895446 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.895593 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.895738 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.895940 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.896095 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.896339 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.896486 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.896667 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.896832 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.896987 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.897287 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.897441 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.897591 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.897768 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.897935 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.898214 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.898383 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.898532 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.898692 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.898843 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.899098 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.899245 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.899400 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.899610 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.899771 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.900008 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.900172 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.900312 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.900626 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.901199 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.901525 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.901743 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.901891 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.902168 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.902329 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.902493 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.902781 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.902954 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.903106 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.903387 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.903544 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.903705 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.903914 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.904107 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.904411 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.904569 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.904702 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.904983 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.905220 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.905472 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.905637 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.905992 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.906227 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.906391 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.906725 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.906902 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.907209 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.907370 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.907640 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.907800 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.908063 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.908223 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.908486 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.908745 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.908907 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.909232 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.909391 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.909766 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.909928 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.910185 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.910343 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.910610 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.910766 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.911029 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.911265 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.911435 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.911812 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.912003 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.912271 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.912446 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.912742 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.912901 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.913183 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.913365 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.913626 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.913815 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.914077 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.914313 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.914719 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.914956 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.915211 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.915362 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.915512 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.915679 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.916264 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.916431 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.916593 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.916855 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.917081 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.917297 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.917541 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.917809 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.917961 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.918209 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.918446 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.918643 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.919045 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.919268 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.919471 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.919767 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.919937 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.920279 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.920438 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.920779 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.920939 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.921207 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.921373 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.921644 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.921920 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.922158 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.922440 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.922669 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.922910 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.923171 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.923331 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.923662 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.923823 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.924141 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.924314 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.924584 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.924782 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.925075 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.925259 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.926050 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.926246 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.926551 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.926713 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.927022 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.927184 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.927475 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.927647 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.927935 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.928106 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.928371 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.928758 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.928932 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.929188 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.929375 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.929622 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.929921 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.930079 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.930421 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.930581 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.930864 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.931032 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.931297 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.931452 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.931732 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.931899 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.932169 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.932402 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.932709 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.932874 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.933338 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.933503 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.933715 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.933875 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.934179 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.934353 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.934607 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.934838 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.935073 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.935396 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.935556 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.935884 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.936053 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.936363 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.936521 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.936797 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.936953 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.937234 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.937389 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.937712 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.937955 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.938200 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.938443 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.938668 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:15:27.938888 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.939277 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.939720 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.940179 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.940744 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.941800 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.942337 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.942841 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.943249 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.943692 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.944186 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.944608 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.945041 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.945526 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.946012 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.946453 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.946867 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.947273 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.947705 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.948117 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.948536 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.948958 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.949372 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.949868 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.950289 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.950976 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.951414 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.951845 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.952282 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.952737 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.953183 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.953588 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.954033 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.954544 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.954955 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.955369 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.955814 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.956233 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.956686 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.957112 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.957525 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.957977 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.958397 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.958812 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.959230 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.959643 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.960052 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.960462 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.960881 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.961338 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.961845 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.962259 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.962673 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.963114 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.963525 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.963931 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.964350 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.964832 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.965255 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.965759 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.966182 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.966601 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.967140 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.967580 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.967988 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.968408 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.968818 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.969365 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.969871 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.970284 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.970705 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.971119 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.971557 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.972008 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.972483 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.972995 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.973401 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.973824 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.974209 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.974600 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.975077 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.975465 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.975882 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.976262 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.976649 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.977053 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.977436 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.977887 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.978271 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.978724 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.979105 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.979496 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.979884 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.980262 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.980892 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.981271 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.981658 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.982080 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.982461 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.982863 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.983352 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.983756 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.984171 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.984646 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.985074 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.985504 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.985971 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.986428 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.986816 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.987212 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.987611 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.988536 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.988922 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.989333 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.989755 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.990149 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.990533 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.990919 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.991315 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.991700 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.992107 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.992505 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.992884 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.993384 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.993901 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.994340 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.994762 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.995212 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.995662 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.996115 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.996537 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.996950 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.997363 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.997832 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.998257 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.998669 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.999100 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.999516 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:27.999937 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.000371 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.000799 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.001223 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.001653 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.002117 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.002574 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.002992 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.003595 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.004546 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.004963 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.005377 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.005861 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:15:28.006230 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:15:28.106549 n-d-852084-5 devstack@n-api.service[106402]: INFO dbcounter [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Registered counter for database nova_api Aug 27 02:15:28.133964 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_db.sqlalchemy.engines [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:15:28.141603 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writer thread running {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:15:28.170399 n-d-852084-5 devstack@n-api.service[106403]: INFO dbcounter [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Registered counter for database nova_api Aug 27 02:15:28.194160 n-d-852084-5 devstack@n-api.service[106403]: DEBUG oslo_db.sqlalchemy.engines [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:15:28.202643 n-d-852084-5 devstack@n-api.service[106403]: DEBUG dbcounter [-] [106403] Writer thread running {{(pid=106403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:15:28.203559 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.context [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) {{(pid=106402) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:15:28.208255 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:15:28.208734 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:15:28.210385 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:15:28.211166 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:15:28.211612 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:15:28.213733 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:15:28.215897 n-d-852084-5 devstack@n-api.service[106402]: INFO dbcounter [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Registered counter for database nova_cell0 Aug 27 02:15:28.220432 n-d-852084-5 devstack@n-api.service[106402]: INFO dbcounter [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Registered counter for database nova_cell1 Aug 27 02:15:28.230784 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_db.sqlalchemy.engines [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:15:28.231778 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_db.sqlalchemy.engines [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:15:28.240484 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writer thread running {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:15:28.242327 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writer thread running {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:15:28.265917 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.context [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) {{(pid=106403) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:15:28.270624 n-d-852084-5 devstack@n-api.service[106403]: DEBUG oslo_concurrency.lockutils [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:15:28.271102 n-d-852084-5 devstack@n-api.service[106403]: DEBUG oslo_concurrency.lockutils [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:15:28.272731 n-d-852084-5 devstack@n-api.service[106403]: DEBUG oslo_concurrency.lockutils [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:15:28.273509 n-d-852084-5 devstack@n-api.service[106403]: DEBUG oslo_concurrency.lockutils [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:15:28.274002 n-d-852084-5 devstack@n-api.service[106403]: DEBUG oslo_concurrency.lockutils [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:15:28.276110 n-d-852084-5 devstack@n-api.service[106403]: DEBUG oslo_concurrency.lockutils [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:15:28.278294 n-d-852084-5 devstack@n-api.service[106403]: INFO dbcounter [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Registered counter for database nova_cell0 Aug 27 02:15:28.282947 n-d-852084-5 devstack@n-api.service[106403]: INFO dbcounter [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Registered counter for database nova_cell1 Aug 27 02:15:28.292815 n-d-852084-5 devstack@n-api.service[106403]: DEBUG oslo_db.sqlalchemy.engines [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:15:28.298183 n-d-852084-5 devstack@n-api.service[106403]: DEBUG dbcounter [-] [106403] Writer thread running {{(pid=106403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:15:28.298872 n-d-852084-5 devstack@n-api.service[106403]: DEBUG oslo_db.sqlalchemy.engines [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:15:28.417962 n-d-852084-5 devstack@n-api.service[106402]: INFO dbcounter [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Registered counter for database nova_cell0 Aug 27 02:15:28.428842 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_db.sqlalchemy.engines [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:15:28.434446 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writer thread running {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:15:28.454829 n-d-852084-5 devstack@n-api.service[106403]: DEBUG dbcounter [-] [106403] Writer thread running {{(pid=106403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:15:28.465616 n-d-852084-5 devstack@n-api.service[106403]: INFO dbcounter [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Registered counter for database nova_cell0 Aug 27 02:15:28.478334 n-d-852084-5 devstack@n-api.service[106403]: DEBUG oslo_db.sqlalchemy.engines [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:15:28.484285 n-d-852084-5 devstack@n-api.service[106403]: DEBUG dbcounter [-] [106403] Writer thread running {{(pid=106403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:15:28.800574 n-d-852084-5 devstack@n-api.service[106402]: WARNING keystonemiddleware.auth_token [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:15:28.809168 n-d-852084-5 devstack@n-api.service[106402]: WARNING keystonemiddleware.auth_token [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:15:28.827373 n-d-852084-5 devstack@n-api.service[106403]: WARNING keystonemiddleware.auth_token [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:15:28.836349 n-d-852084-5 devstack@n-api.service[106403]: WARNING keystonemiddleware.auth_token [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:15:29.165095 n-d-852084-5 devstack@n-api.service[106402]: WARNING keystonemiddleware.auth_token [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:15:29.171957 n-d-852084-5 devstack@n-api.service[106402]: WARNING keystonemiddleware.auth_token [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:15:29.177586 n-d-852084-5 devstack@n-api.service[106402]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f750f299c0 pid: 106402 (default app) Aug 27 02:15:29.180290 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:15:29.181590 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] 10.222.0.99 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002118 Aug 27 02:15:29.182578 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 1/1] 10.222.0.99 () {50 vars in 788 bytes} [Sat Aug 27 02:15:29 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:15:29.204784 n-d-852084-5 devstack@n-api.service[106403]: WARNING keystonemiddleware.auth_token [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:15:29.213434 n-d-852084-5 devstack@n-api.service[106403]: WARNING keystonemiddleware.auth_token [None req-cbf6625b-5812-4ae5-b135-7425992efcc9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:15:29.221565 n-d-852084-5 devstack@n-api.service[106403]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f750f299c0 pid: 106403 (default app) Aug 27 02:17:03.033243 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:03.035161 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002325 Aug 27 02:17:03.036187 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 2/2] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:17:03.054726 n-d-852084-5 devstack@n-api.service[106403]: DEBUG dbcounter [-] [106403] Writing DB stats nova_api:SELECT=3 {{(pid=106403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:03.056994 n-d-852084-5 devstack@n-api.service[106403]: DEBUG dbcounter [-] [106403] Writing DB stats nova_cell0:SELECT=3 {{(pid=106403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:03.058198 n-d-852084-5 devstack@n-api.service[106403]: DEBUG dbcounter [-] [106403] Writing DB stats nova_cell1:SELECT=3 {{(pid=106403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:03.059269 n-d-852084-5 devstack@n-api.service[106403]: DEBUG dbcounter [-] [106403] Writing DB stats nova_cell0:SELECT=3 {{(pid=106403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:04.269777 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-1ff3ce97-7184-40c7-af3c-aeeb2c5e010e admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:04.330704 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-1ff3ce97-7184-40c7-af3c-aeeb2c5e010e admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.285814 Aug 27 02:17:04.342264 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 1/3] 10.222.0.99 () {60 vars in 1292 bytes} [Sat Aug 27 02:17:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:17:07.451547 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:07.453246 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-08c8c462-47d1-4aed-a712-fc885e60cc7f None None] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002916 Aug 27 02:17:07.463477 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 3/4] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:07 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:17:08.366945 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-6922ace3-6f50-49c2-93a9-2030db6d148a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:08.480941 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-6922ace3-6f50-49c2-93a9-2030db6d148a admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 1.014890 Aug 27 02:17:08.486542 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 2/5] 10.222.0.99 () {64 vars in 1283 bytes} [Sat Aug 27 02:17:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:17:08.504333 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writing DB stats nova_api:SELECT=3 {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:08.505552 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writing DB stats nova_cell1:SELECT=3 {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:08.506342 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writing DB stats nova_cell0:SELECT=3 {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:08.507122 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:08.733609 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-d6a6a7cf-efec-4714-82e2-4169a9843c5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:08.808135 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-d6a6a7cf-efec-4714-82e2-4169a9843c5a admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.311481 Aug 27 02:17:08.808613 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 4/6] 10.222.0.99 () {64 vars in 1336 bytes} [Sat Aug 27 02:17:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:17:11.447401 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-6922ace3-6f50-49c2-93a9-2030db6d148a admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:11.449876 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-6922ace3-6f50-49c2-93a9-2030db6d148a admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 27 02:17:11.449876 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 3/7] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:17:12.755933 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-336378d6-d139-472c-836e-1c912150fd33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "disk": 5}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:12.828368 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-336378d6-d139-472c-836e-1c912150fd33 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.371288 Aug 27 02:17:12.829914 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 5/8] 10.222.0.99 () {64 vars in 1283 bytes} [Sat Aug 27 02:17:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:17:12.842790 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-a98e93b4-f2e6-4b61-86f0-e6acb50973c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:12.890864 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-a98e93b4-f2e6-4b61-86f0-e6acb50973c9 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051897 Aug 27 02:17:12.897919 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 4/9] 10.222.0.99 () {64 vars in 1336 bytes} [Sat Aug 27 02:17:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:17:16.686956 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-336378d6-d139-472c-836e-1c912150fd33 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:16.690028 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-336378d6-d139-472c-836e-1c912150fd33 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003693 Aug 27 02:17:16.698260 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 6/10] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:16 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:17:17.753702 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-10d93dc1-2be6-4c0b-9d8c-4774ed76a192 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "d2"}} {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:17.810193 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-10d93dc1-2be6-4c0b-9d8c-4774ed76a192 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.105156 Aug 27 02:17:17.834274 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 5/11] 10.222.0.99 () {64 vars in 1283 bytes} [Sat Aug 27 02:17:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:17:17.849737 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-63a12d7b-9d98-4cd9-9494-244e3db5f20b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:17.972045 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-63a12d7b-9d98-4cd9-9494-244e3db5f20b admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132635 Aug 27 02:17:17.983131 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 7/12] 10.222.0.99 () {64 vars in 1336 bytes} [Sat Aug 27 02:17:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:17:20.997562 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-10d93dc1-2be6-4c0b-9d8c-4774ed76a192 admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:20.999275 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-10d93dc1-2be6-4c0b-9d8c-4774ed76a192 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002652 Aug 27 02:17:20.999856 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 6/13] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:17:21.522323 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-452732aa-8842-431d-9e6b-5020aa9cb345 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "disk": 10, "name": "ds2G"}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:21.548609 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-452732aa-8842-431d-9e6b-5020aa9cb345 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.541622 Aug 27 02:17:21.549286 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 8/14] 10.222.0.99 () {64 vars in 1283 bytes} [Sat Aug 27 02:17:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:17:21.562286 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-9fd6c783-1d26-4c23-b32f-9f936967a3bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:21.593761 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-9fd6c783-1d26-4c23-b32f-9f936967a3bb admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035460 Aug 27 02:17:21.594344 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 7/15] 10.222.0.99 () {64 vars in 1336 bytes} [Sat Aug 27 02:17:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:17:24.315854 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-452732aa-8842-431d-9e6b-5020aa9cb345 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:24.318173 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-452732aa-8842-431d-9e6b-5020aa9cb345 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002644 Aug 27 02:17:24.319904 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 9/16] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:17:25.205999 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-e1e51ac7-9c0a-4e31-951b-f5c1abffd708 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:25.230056 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-e1e51ac7-9c0a-4e31-951b-f5c1abffd708 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.898173 Aug 27 02:17:25.231048 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 8/17] 10.222.0.99 () {64 vars in 1283 bytes} [Sat Aug 27 02:17:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:17:25.255638 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-eb8ad500-2ad8-4ecc-b55a-1799250aaf13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:25.286015 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-eb8ad500-2ad8-4ecc-b55a-1799250aaf13 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039217 Aug 27 02:17:25.287245 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 10/18] 10.222.0.99 () {64 vars in 1336 bytes} [Sat Aug 27 02:17:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:17:28.034730 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-e1e51ac7-9c0a-4e31-951b-f5c1abffd708 admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:28.035894 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-e1e51ac7-9c0a-4e31-951b-f5c1abffd708 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Aug 27 02:17:28.036660 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 9/19] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:17:28.681154 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-adbb8132-e266-4d1a-945b-dcd1c5ba78e4 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:28.712122 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-adbb8132-e266-4d1a-945b-dcd1c5ba78e4 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.667581 Aug 27 02:17:28.734661 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 11/20] 10.222.0.99 () {60 vars in 1292 bytes} [Sat Aug 27 02:17:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:17:31.412359 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-e1e51ac7-9c0a-4e31-951b-f5c1abffd708 admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:31.413983 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-e1e51ac7-9c0a-4e31-951b-f5c1abffd708 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 27 02:17:31.414250 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 10/21] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:17:32.042164 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-cbddeee0-c85f-4db6-8ebf-b60d88ff3fec admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:32.075887 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-cbddeee0-c85f-4db6-8ebf-b60d88ff3fec admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.653431 Aug 27 02:17:32.077711 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 12/22] 10.222.0.99 () {64 vars in 1283 bytes} [Sat Aug 27 02:17:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:17:32.091150 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-59690e39-3033-45df-9822-4abf24f77667 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:32.134078 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-59690e39-3033-45df-9822-4abf24f77667 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047094 Aug 27 02:17:32.135229 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 11/23] 10.222.0.99 () {64 vars in 1333 bytes} [Sat Aug 27 02:17:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:17:35.337277 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-cbddeee0-c85f-4db6-8ebf-b60d88ff3fec admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:35.338272 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-cbddeee0-c85f-4db6-8ebf-b60d88ff3fec admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 27 02:17:35.338779 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 13/24] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:17:36.013396 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-4363dcf4-9c1d-4cbb-911f-8f75bbcd0170 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "disk": 20, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:36.024134 n-d-852084-5 devstack@n-api.service[106403]: DEBUG dbcounter [-] [106403] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:36.052040 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-4363dcf4-9c1d-4cbb-911f-8f75bbcd0170 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.705260 Aug 27 02:17:36.053061 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 12/25] 10.222.0.99 () {64 vars in 1283 bytes} [Sat Aug 27 02:17:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:17:36.066764 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-6f5a0337-eb0d-4eba-95f1-d24e7cbb4cf7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:36.096246 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-6f5a0337-eb0d-4eba-95f1-d24e7cbb4cf7 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033429 Aug 27 02:17:36.097876 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 14/26] 10.222.0.99 () {64 vars in 1333 bytes} [Sat Aug 27 02:17:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:17:38.850425 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-4363dcf4-9c1d-4cbb-911f-8f75bbcd0170 admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:38.851666 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-4363dcf4-9c1d-4cbb-911f-8f75bbcd0170 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Aug 27 02:17:38.852320 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 13/27] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:17:39.484035 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-00b98366-7c83-40d7-aaa1-eb6d38defc06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:39.504337 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-00b98366-7c83-40d7-aaa1-eb6d38defc06 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.644271 Aug 27 02:17:39.504938 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 15/28] 10.222.0.99 () {64 vars in 1283 bytes} [Sat Aug 27 02:17:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:17:39.521315 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-479eece1-80ab-4b21-864e-507538f9721e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:39.559313 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-479eece1-80ab-4b21-864e-507538f9721e admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044063 Aug 27 02:17:39.559992 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 14/29] 10.222.0.99 () {64 vars in 1333 bytes} [Sat Aug 27 02:17:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:17:42.244870 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-00b98366-7c83-40d7-aaa1-eb6d38defc06 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:42.245912 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-00b98366-7c83-40d7-aaa1-eb6d38defc06 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 27 02:17:42.246343 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 16/30] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:17:42.834496 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-92227686-b04b-47f3-acdc-81aaafec640c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "swap": 0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:42.865486 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-92227686-b04b-47f3-acdc-81aaafec640c admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.612076 Aug 27 02:17:42.866359 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 15/31] 10.222.0.99 () {64 vars in 1283 bytes} [Sat Aug 27 02:17:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:17:42.894993 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-ce047380-dcf8-4f61-b1b2-e44486d81345 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:42.911414 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:42.951050 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-ce047380-dcf8-4f61-b1b2-e44486d81345 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062355 Aug 27 02:17:42.953031 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 17/32] 10.222.0.99 () {64 vars in 1333 bytes} [Sat Aug 27 02:17:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:17:45.966963 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-92227686-b04b-47f3-acdc-81aaafec640c admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:17:45.967902 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-92227686-b04b-47f3-acdc-81aaafec640c admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 27 02:17:45.968649 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 16/33] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:17:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:17:46.696317 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-8e8e73ca-e490-45b1-b2ef-461be329f800 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "ram": 16384, "swap": 0}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:46.728758 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-8e8e73ca-e490-45b1-b2ef-461be329f800 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.751290 Aug 27 02:17:46.729989 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 18/34] 10.222.0.99 () {64 vars in 1283 bytes} [Sat Aug 27 02:17:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:17:46.742367 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-851f5857-a015-4ffa-b93c-45a63b2dd8c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:17:46.772517 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-851f5857-a015-4ffa-b93c-45a63b2dd8c6 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033914 Aug 27 02:17:46.781773 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 17/35] 10.222.0.99 () {64 vars in 1333 bytes} [Sat Aug 27 02:17:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:18:11.155794 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-8e8e73ca-e490-45b1-b2ef-461be329f800 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:11.157012 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-8e8e73ca-e490-45b1-b2ef-461be329f800 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Aug 27 02:18:11.157481 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 19/36] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:18:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:18:11.169201 n-d-852084-5 devstack@n-api.service[106403]: DEBUG dbcounter [-] [106403] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=106403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:18:11.702940 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-23ae37bc-8c16-498b-b914-d6dde7f26505 admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:11.722447 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-23ae37bc-8c16-498b-b914-d6dde7f26505 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.557822 Aug 27 02:18:11.723005 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 18/37] 10.222.0.99 () {60 vars in 1292 bytes} [Sat Aug 27 02:18:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:18:12.898813 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-8e8e73ca-e490-45b1-b2ef-461be329f800 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:12.899733 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-8e8e73ca-e490-45b1-b2ef-461be329f800 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Aug 27 02:18:12.900667 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 20/38] 10.222.0.99 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:18:13.558692 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-f38ab5ea-4f31-4bbc-8929-e92b4c22d21d admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:13.565357 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.wsgi [None req-f38ab5ea-4f31-4bbc-8929-e92b4c22d21d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-f38ab5ea-4f31-4bbc-8929-e92b4c22d21d admin admin] Request method failure captured: Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: Accept: application/json Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: Accept-Encoding: gzip, deflate Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: Connection: keep-alive Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: Content-Length: 0 Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: Host: 10.222.0.99 Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: Openstack-Api-Version: compute 2.90 Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: Openstack-System-Scope: None Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: User-Agent: python-novaclient Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Auth-Token: gAAAAABjCX7k1Nik5RKcSKlp0VuLLBWs7SGSrE44mzkID8RRzlELgVMl_DHJTrL3BkswkS6ny_wwb_t5VefNEdeIy8qWChqGZ7HBUjAPP33eyaErUO2h6CXrvkzUJCdkHqFdUj6AB6CEgMAJTWLjQ2mZ80T3w9yvU0tQYTyv_8HSGkpuKdOsiJ8 Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Domain-Id: None Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Domain-Name: None Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Identity-Status: Confirmed Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Is-Admin-Project: True Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Domain-Id: default Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Domain-Name: Default Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Name: admin Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Role: member,admin,reader Aug 27 02:18:13.569049 n-d-852084-5 devstack@n-api.service[106403]: X-Roles: member,admin,reader Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}] Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: X-Tenant: admin Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: X-Tenant-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: X-Tenant-Name: admin Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: X-User: admin Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: X-User-Domain-Id: default Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: X-User-Domain-Name: Default Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: X-User-Id: 250a7bea6d664769b9920449ad5b6fa6 Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: X-User-Name: admin Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: method: > Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: exception: Flavor 42 could not be found. Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: action_args: {'id': '42'} Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:18:13.572461 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:13.574148 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:13.576087 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-f38ab5ea-4f31-4bbc-8929-e92b4c22d21d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:18:13.578335 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-f38ab5ea-4f31-4bbc-8929-e92b4c22d21d admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.510254 Aug 27 02:18:13.578335 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 19/39] 10.222.0.99 () {60 vars in 1190 bytes} [Sat Aug 27 02:18:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 513 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:18:13.587114 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-78588846-3a10-409f-80a2-fcf6b2d7fa2d admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:13.602430 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:18:13.614675 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-78588846-3a10-409f-80a2-fcf6b2d7fa2d admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034024 Aug 27 02:18:13.615505 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 21/40] 10.222.0.99 () {60 vars in 1210 bytes} [Sat Aug 27 02:18:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:18:13.627271 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-b4110a84-2a0d-48f7-8d4b-e710df90121c admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:13.653306 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-b4110a84-2a0d-48f7-8d4b-e710df90121c admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029642 Aug 27 02:18:13.653994 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 20/41] 10.222.0.99 () {60 vars in 1210 bytes} [Sat Aug 27 02:18:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:18:13.664348 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-ba038ec7-1830-4695-b607-22460855e9d6 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:13.672441 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.wsgi [None req-ba038ec7-1830-4695-b607-22460855e9d6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-ba038ec7-1830-4695-b607-22460855e9d6 admin admin] Request method failure captured: Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: Accept: application/json Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: Accept-Encoding: gzip, deflate Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: Connection: keep-alive Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: Content-Length: 0 Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: Host: 10.222.0.99 Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: Openstack-Api-Version: compute 2.90 Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: Openstack-System-Scope: None Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: User-Agent: python-novaclient Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Auth-Token: gAAAAABjCX7k1Nik5RKcSKlp0VuLLBWs7SGSrE44mzkID8RRzlELgVMl_DHJTrL3BkswkS6ny_wwb_t5VefNEdeIy8qWChqGZ7HBUjAPP33eyaErUO2h6CXrvkzUJCdkHqFdUj6AB6CEgMAJTWLjQ2mZ80T3w9yvU0tQYTyv_8HSGkpuKdOsiJ8 Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Domain-Id: None Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Domain-Name: None Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Identity-Status: Confirmed Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Is-Admin-Project: True Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Domain-Id: default Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Domain-Name: Default Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Name: admin Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Role: member,admin,reader Aug 27 02:18:13.675843 n-d-852084-5 devstack@n-api.service[106402]: X-Roles: member,admin,reader Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}] Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: X-Tenant: admin Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: X-Tenant-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: X-Tenant-Name: admin Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: X-User: admin Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: X-User-Domain-Id: default Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: X-User-Domain-Name: Default Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: X-User-Id: 250a7bea6d664769b9920449ad5b6fa6 Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: X-User-Name: admin Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: method: > Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: exception: Flavor 42 could not be found. Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: action_args: {'id': '42'} Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:18:13.678300 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:13.679548 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:13.680924 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-ba038ec7-1830-4695-b607-22460855e9d6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:18:13.683075 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-ba038ec7-1830-4695-b607-22460855e9d6 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017347 Aug 27 02:18:13.683075 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 22/42] 10.222.0.99 () {60 vars in 1190 bytes} [Sat Aug 27 02:18:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:18:14.720015 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-b4110a84-2a0d-48f7-8d4b-e710df90121c admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:14.721066 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-b4110a84-2a0d-48f7-8d4b-e710df90121c admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 27 02:18:14.721513 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 21/43] 10.222.0.99 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:18:15.365789 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-c3e65ac7-a639-4b41-a184-8675eb5e70a0 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:15.372705 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.wsgi [None req-c3e65ac7-a639-4b41-a184-8675eb5e70a0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-c3e65ac7-a639-4b41-a184-8675eb5e70a0 admin admin] Request method failure captured: Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: Accept: application/json Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: Accept-Encoding: gzip, deflate Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: Connection: keep-alive Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: Content-Length: 0 Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: Host: 10.222.0.99 Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: Openstack-Api-Version: compute 2.90 Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: Openstack-System-Scope: None Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: User-Agent: python-novaclient Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Auth-Token: gAAAAABjCX7myPECrpYBYBLAHADye9Dfk069hRP2HZRVVGFFKW-nJZq1A60Z0jcnbXLVl0lFAUGJvYrvlfflVSM27hzcKA1MdVVjO1A9pzMNqIDLEYHNEuU2dgXLxM7xxmKOOOWpXQeTBrEq7KFS1VzfRaGqOrZ-vulqKNTBPEmGbtgOMt-ryAc Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Domain-Id: None Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Domain-Name: None Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Identity-Status: Confirmed Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Is-Admin-Project: True Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Domain-Id: default Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Domain-Name: Default Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Name: admin Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Role: member,admin,reader Aug 27 02:18:15.374324 n-d-852084-5 devstack@n-api.service[106402]: X-Roles: member,admin,reader Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}] Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: X-Tenant: admin Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: X-Tenant-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: X-Tenant-Name: admin Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: X-User: admin Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: X-User-Domain-Id: default Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: X-User-Domain-Name: Default Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: X-User-Id: 250a7bea6d664769b9920449ad5b6fa6 Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: X-User-Name: admin Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: method: > Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: exception: Flavor 84 could not be found. Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: action_args: {'id': '84'} Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:18:15.378017 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:15.378966 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:15.380192 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-c3e65ac7-a639-4b41-a184-8675eb5e70a0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:18:15.381394 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-c3e65ac7-a639-4b41-a184-8675eb5e70a0 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.507386 Aug 27 02:18:15.381394 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 23/44] 10.222.0.99 () {60 vars in 1190 bytes} [Sat Aug 27 02:18:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 509 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:18:15.388672 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-7f9a6ccd-9155-4cf3-b344-0331c79d575c admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:15.404601 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-7f9a6ccd-9155-4cf3-b344-0331c79d575c admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020381 Aug 27 02:18:15.405183 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 22/45] 10.222.0.99 () {60 vars in 1210 bytes} [Sat Aug 27 02:18:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:18:15.419459 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-f6320c77-a30c-4110-9b68-abc24ffa75c1 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:15.446112 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-f6320c77-a30c-4110-9b68-abc24ffa75c1 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033624 Aug 27 02:18:15.447121 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 24/46] 10.222.0.99 () {60 vars in 1210 bytes} [Sat Aug 27 02:18:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:18:15.460366 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-69489e1d-b881-4963-8196-c55bb32e7a55 admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:15.466338 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.wsgi [None req-69489e1d-b881-4963-8196-c55bb32e7a55 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-69489e1d-b881-4963-8196-c55bb32e7a55 admin admin] Request method failure captured: Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: Accept: application/json Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: Accept-Encoding: gzip, deflate Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: Connection: keep-alive Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: Content-Length: 0 Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: Host: 10.222.0.99 Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: Openstack-Api-Version: compute 2.90 Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: Openstack-System-Scope: None Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: User-Agent: python-novaclient Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Auth-Token: gAAAAABjCX7myPECrpYBYBLAHADye9Dfk069hRP2HZRVVGFFKW-nJZq1A60Z0jcnbXLVl0lFAUGJvYrvlfflVSM27hzcKA1MdVVjO1A9pzMNqIDLEYHNEuU2dgXLxM7xxmKOOOWpXQeTBrEq7KFS1VzfRaGqOrZ-vulqKNTBPEmGbtgOMt-ryAc Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Domain-Id: None Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Domain-Name: None Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Identity-Status: Confirmed Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Is-Admin-Project: True Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Domain-Id: default Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Domain-Name: Default Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Name: admin Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Role: member,admin,reader Aug 27 02:18:15.467906 n-d-852084-5 devstack@n-api.service[106403]: X-Roles: member,admin,reader Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}] Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: X-Tenant: admin Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: X-Tenant-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: X-Tenant-Name: admin Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: X-User: admin Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: X-User-Domain-Id: default Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: X-User-Domain-Name: Default Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: X-User-Id: 250a7bea6d664769b9920449ad5b6fa6 Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: X-User-Name: admin Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: method: > Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: exception: Flavor 84 could not be found. Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: action_args: {'id': '84'} Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:18:15.470402 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:15.471917 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:15.474089 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-69489e1d-b881-4963-8196-c55bb32e7a55 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:18:15.476296 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-69489e1d-b881-4963-8196-c55bb32e7a55 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012645 Aug 27 02:18:15.476296 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 23/47] 10.222.0.99 () {60 vars in 1190 bytes} [Sat Aug 27 02:18:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:18:16.551626 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-f6320c77-a30c-4110-9b68-abc24ffa75c1 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:16.552559 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-f6320c77-a30c-4110-9b68-abc24ffa75c1 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 27 02:18:16.552963 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 25/48] 10.222.0.99 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:18:17.178368 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-5d5732a7-4465-4812-a5cb-e83cff7b3c60 admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:17.185209 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.wsgi [None req-5d5732a7-4465-4812-a5cb-e83cff7b3c60 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-5d5732a7-4465-4812-a5cb-e83cff7b3c60 admin admin] Request method failure captured: Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: Accept: application/json Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: Accept-Encoding: gzip, deflate Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: Connection: keep-alive Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: Content-Length: 0 Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: Host: 10.222.0.99 Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: Openstack-Api-Version: compute 2.90 Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: Openstack-System-Scope: None Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: User-Agent: python-novaclient Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Auth-Token: gAAAAABjCX7oO11rNPJGgwmqDbwb9V2K9bEbgjZ_AzBoJeYiPJiDJ5rwt-_lBxNGK1GMK8ncaOrefCHRNI1BZ8tHR4-MDGPArUhHOkVI5egMXHv87MTkTO0-YrJZek0fH6Y-b5hgqN-bMsc3QjTSaMlCNCd2zEAzsvThwpM_lTTfC4sRD1HH7PQ Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Domain-Id: None Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Domain-Name: None Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Identity-Status: Confirmed Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Is-Admin-Project: True Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Domain-Id: default Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Domain-Name: Default Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Project-Name: admin Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Role: member,admin,reader Aug 27 02:18:17.186853 n-d-852084-5 devstack@n-api.service[106403]: X-Roles: member,admin,reader Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}] Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: X-Tenant: admin Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: X-Tenant-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: X-Tenant-Name: admin Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: X-User: admin Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: X-User-Domain-Id: default Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: X-User-Domain-Name: Default Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: X-User-Id: 250a7bea6d664769b9920449ad5b6fa6 Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: X-User-Name: admin Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: method: > Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: exception: Flavor 451 could not be found. Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: action_args: {'id': '451'} Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:18:17.189407 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:17.191117 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: ERROR nova.api.openstack.wsgi Aug 27 02:18:17.193444 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-5d5732a7-4465-4812-a5cb-e83cff7b3c60 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:18:17.195581 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-5d5732a7-4465-4812-a5cb-e83cff7b3c60 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.491988 Aug 27 02:18:17.195581 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 24/49] 10.222.0.99 () {60 vars in 1193 bytes} [Sat Aug 27 02:18:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 496 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:18:17.202274 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-660870d8-4668-4027-8eb9-fe16d5a5fb9e admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:17.219106 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-660870d8-4668-4027-8eb9-fe16d5a5fb9e admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020737 Aug 27 02:18:17.219699 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 26/50] 10.222.0.99 () {60 vars in 1210 bytes} [Sat Aug 27 02:18:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:18:17.230546 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:17.247061 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020454 Aug 27 02:18:17.247642 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 25/51] 10.222.0.99 () {60 vars in 1210 bytes} [Sat Aug 27 02:18:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:18:17.257734 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-d1fdcbc9-290f-477b-8ce1-db03c0c0b613 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:17.264192 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.wsgi [None req-d1fdcbc9-290f-477b-8ce1-db03c0c0b613 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-d1fdcbc9-290f-477b-8ce1-db03c0c0b613 admin admin] Request method failure captured: Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: Accept: application/json Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: Accept-Encoding: gzip, deflate Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: Connection: keep-alive Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: Content-Length: 0 Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: Host: 10.222.0.99 Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: Openstack-Api-Version: compute 2.90 Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: Openstack-System-Scope: None Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: User-Agent: python-novaclient Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Auth-Token: gAAAAABjCX7oO11rNPJGgwmqDbwb9V2K9bEbgjZ_AzBoJeYiPJiDJ5rwt-_lBxNGK1GMK8ncaOrefCHRNI1BZ8tHR4-MDGPArUhHOkVI5egMXHv87MTkTO0-YrJZek0fH6Y-b5hgqN-bMsc3QjTSaMlCNCd2zEAzsvThwpM_lTTfC4sRD1HH7PQ Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Domain-Id: None Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Domain-Name: None Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Identity-Status: Confirmed Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Is-Admin-Project: True Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Openstack-Nova-Api-Version: 2.90 Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Domain-Id: default Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Domain-Name: Default Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Project-Name: admin Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Role: member,admin,reader Aug 27 02:18:17.265790 n-d-852084-5 devstack@n-api.service[106402]: X-Roles: member,admin,reader Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ee795da426df4f1c9d2e1a87d6f2f6c3"}]}] Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: X-Tenant: admin Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: X-Tenant-Id: ee795da426df4f1c9d2e1a87d6f2f6c3 Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: X-Tenant-Name: admin Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: X-User: admin Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: X-User-Domain-Id: default Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: X-User-Domain-Name: Default Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: X-User-Id: 250a7bea6d664769b9920449ad5b6fa6 Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: X-User-Name: admin Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: method: > Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: exception: Flavor 451 could not be found. Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: action_args: {'id': '451'} Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:18:17.268465 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:17.270167 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: ERROR nova.api.openstack.wsgi Aug 27 02:18:17.272344 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-d1fdcbc9-290f-477b-8ce1-db03c0c0b613 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:18:17.274383 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-d1fdcbc9-290f-477b-8ce1-db03c0c0b613 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013205 Aug 27 02:18:17.274383 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 27/52] 10.222.0.99 () {60 vars in 1193 bytes} [Sat Aug 27 02:18:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 27 02:18:18.346398 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:18.347421 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 27 02:18:18.347830 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 26/53] 10.222.0.99 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:18:19.141702 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-4d827e5f-2a0d-43af-927d-4cec1770f164 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:18:19.163993 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-4d827e5f-2a0d-43af-927d-4cec1770f164 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.563832 Aug 27 02:18:19.164554 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 28/54] 10.222.0.99 () {64 vars in 1235 bytes} [Sat Aug 27 02:18:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:18:20.282755 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:20.284101 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001837 Aug 27 02:18:20.284635 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 27/55] 10.222.0.99 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:18:21.031334 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-1856454f-9cfc-4f64-ac4c-b2ff440d2e2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:18:21.064879 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-1856454f-9cfc-4f64-ac4c-b2ff440d2e2c admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.626286 Aug 27 02:18:21.065547 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 29/56] 10.222.0.99 () {64 vars in 1235 bytes} [Sat Aug 27 02:18:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:18:22.227551 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:22.228562 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 27 02:18:22.229013 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 28/57] 10.222.0.99 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:18:22.894657 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-63470648-f566-4807-a6ca-aa7d348914fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:18:22.921023 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-63470648-f566-4807-a6ca-aa7d348914fb admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.537001 Aug 27 02:18:22.921895 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 30/58] 10.222.0.99 () {64 vars in 1235 bytes} [Sat Aug 27 02:18:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:18:24.025794 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:24.026799 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 27 02:18:24.027216 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 29/59] 10.222.0.99 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:18:24.733873 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-e2a01b7a-504f-4896-8e77-5689fa60393a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:18:24.767228 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-e2a01b7a-504f-4896-8e77-5689fa60393a admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.591199 Aug 27 02:18:24.768311 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 31/60] 10.222.0.99 () {64 vars in 1235 bytes} [Sat Aug 27 02:18:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:18:25.858803 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:25.860150 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001794 Aug 27 02:18:25.860633 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 30/61] 10.222.0.99 () {56 vars in 1074 bytes} [Sat Aug 27 02:18:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:18:26.496741 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-7363cfe7-f831-4dd5-a61b-0abd350af45f admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:18:26.520950 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-7363cfe7-f831-4dd5-a61b-0abd350af45f admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.512483 Aug 27 02:18:26.521535 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 32/62] 10.222.0.99 () {60 vars in 1202 bytes} [Sat Aug 27 02:18:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:19:27.362027 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:19:27.363262 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-7a3411a4-fb73-4dab-bb72-8ab4c8f2183c admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001878 Aug 27 02:19:27.363810 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 31/63] 10.222.0.99 () {54 vars in 931 bytes} [Sat Aug 27 02:19:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:19:27.378608 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:19:27.951232 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-9996546f-c7c0-4e36-a923-34c9985f28bb admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:19:27.992139 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-9996546f-c7c0-4e36-a923-34c9985f28bb admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.619756 Aug 27 02:19:27.993090 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 33/64] 10.222.0.99 () {60 vars in 1292 bytes} [Sat Aug 27 02:19:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:19:28.015062 n-d-852084-5 devstack@n-api.service[106403]: DEBUG dbcounter [-] [106403] Writing DB stats nova_api:SELECT=14 {{(pid=106403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:19:28.019453 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-7ba216e6-ed67-497f-a351-c0d7cac574d8 admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:19:28.028844 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-7ba216e6-ed67-497f-a351-c0d7cac574d8 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015229 Aug 27 02:19:28.029406 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 32/65] 10.222.0.99 () {60 vars in 1283 bytes} [Sat Aug 27 02:19:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:19:28.043393 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-6f310c2e-8e22-4b28-900e-1dc98f586790 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:19:28.053573 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-6f310c2e-8e22-4b28-900e-1dc98f586790 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014128 Aug 27 02:19:28.054329 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 34/66] 10.222.0.99 () {60 vars in 1286 bytes} [Sat Aug 27 02:19:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:19:28.068724 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-701948ed-922d-4d97-ae95-1ea4a6e734dc admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:19:28.078319 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-701948ed-922d-4d97-ae95-1ea4a6e734dc admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013914 Aug 27 02:19:28.079180 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 33/67] 10.222.0.99 () {60 vars in 1286 bytes} [Sat Aug 27 02:19:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:19:28.092182 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-d5126581-ffe0-4c2a-8165-0a2d2991bc6b admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:19:28.101731 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-d5126581-ffe0-4c2a-8165-0a2d2991bc6b admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013260 Aug 27 02:19:28.102310 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 35/68] 10.222.0.99 () {60 vars in 1283 bytes} [Sat Aug 27 02:19:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:25:07.935457 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-701948ed-922d-4d97-ae95-1ea4a6e734dc admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:07.936986 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-701948ed-922d-4d97-ae95-1ea4a6e734dc admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Aug 27 02:25:07.937512 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 34/69] 10.222.0.99 () {56 vars in 1074 bytes} [Sat Aug 27 02:25:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:08.094262 n-d-852084-5 devstack@n-api.service[106402]: DEBUG dbcounter [-] [106402] Writing DB stats nova_api:SELECT=6 {{(pid=106402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:08.271979 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-0d0c9068-ace2-42a4-a541-660f5ca5dc42 admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:08.279239 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-0d0c9068-ace2-42a4-a541-660f5ca5dc42 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:08.280116 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-0d0c9068-ace2-42a4-a541-660f5ca5dc42 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:08.280926 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-0d0c9068-ace2-42a4-a541-660f5ca5dc42 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:08.282324 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-0d0c9068-ace2-42a4-a541-660f5ca5dc42 admin admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:08.283159 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-0d0c9068-ace2-42a4-a541-660f5ca5dc42 admin admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:08.283910 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-0d0c9068-ace2-42a4-a541-660f5ca5dc42 admin admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:08.367458 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-0d0c9068-ace2-42a4-a541-660f5ca5dc42 admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.279577 Aug 27 02:25:08.368411 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 36/70] 10.222.0.99 () {60 vars in 1193 bytes} [Sat Aug 27 02:25:08 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:25:09.373941 n-d-852084-5 devstack@n-api.service[106403]: DEBUG nova.api.openstack.wsgi [None req-701948ed-922d-4d97-ae95-1ea4a6e734dc admin admin] Calling method '>' {{(pid=106403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:09.375333 n-d-852084-5 devstack@n-api.service[106403]: INFO nova.api.openstack.requestlog [None req-701948ed-922d-4d97-ae95-1ea4a6e734dc admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Aug 27 02:25:09.375813 n-d-852084-5 devstack@n-api.service[106403]: [pid: 106403|app: 0|req: 35/71] 10.222.0.99 () {56 vars in 1074 bytes} [Sat Aug 27 02:25:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:25:09.593821 n-d-852084-5 devstack@n-api.service[106402]: DEBUG nova.api.openstack.wsgi [None req-298fd0e0-7db3-4794-bf0c-c12312a9234c admin admin] Calling method '>' {{(pid=106402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:25:09.600651 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-298fd0e0-7db3-4794-bf0c-c12312a9234c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:09.601505 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-298fd0e0-7db3-4794-bf0c-c12312a9234c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:09.602332 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-298fd0e0-7db3-4794-bf0c-c12312a9234c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:09.603671 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-298fd0e0-7db3-4794-bf0c-c12312a9234c admin admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:25:09.604498 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-298fd0e0-7db3-4794-bf0c-c12312a9234c admin admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:25:09.605803 n-d-852084-5 devstack@n-api.service[106402]: DEBUG oslo_concurrency.lockutils [None req-298fd0e0-7db3-4794-bf0c-c12312a9234c admin admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:25:09.650144 n-d-852084-5 devstack@n-api.service[106402]: INFO nova.api.openstack.requestlog [None req-298fd0e0-7db3-4794-bf0c-c12312a9234c admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.120176 Aug 27 02:25:09.651141 n-d-852084-5 devstack@n-api.service[106402]: [pid: 106402|app: 0|req: 37/72] 10.222.0.99 () {60 vars in 1193 bytes} [Sat Aug 27 02:25:09 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:25:58.538935 n-d-852084-5 devstack@n-api.service[106401]: Sat Aug 27 02:25:58 2022 - graceful shutdown triggered... Aug 27 02:25:58.539190 n-d-852084-5 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 02:25:58.540517 n-d-852084-5 devstack@n-api.service[106402]: Gracefully killing worker 1 (pid: 106402)... Aug 27 02:25:58.541091 n-d-852084-5 devstack@n-api.service[106403]: Gracefully killing worker 2 (pid: 106403)... Aug 27 02:25:59.540197 n-d-852084-5 devstack@n-api.service[106401]: worker 1 buried after 1 seconds Aug 27 02:25:59.540197 n-d-852084-5 devstack@n-api.service[106401]: worker 2 buried after 1 seconds Aug 27 02:25:59.540197 n-d-852084-5 devstack@n-api.service[106401]: goodbye to uWSGI. Aug 27 02:25:59.541993 n-d-852084-5 systemd[1]: devstack@n-api.service: Succeeded. Aug 27 02:25:59.542821 n-d-852084-5 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 02:25:59.546240 n-d-852084-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 02:25:59.562001 n-d-852084-5 devstack@n-api.service[122477]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 02:25:59 2022] *** Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: nodename: n-d-852084-5 Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: machine: x86_64 Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: clock source: unix Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: pcre jit disabled Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: detected number of CPU cores: 4 Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: current working directory: / Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: detected binary path: /usr/bin/uwsgi-core Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: your processes number limit is 47680 Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: your memory page size is 4096 bytes Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: detected max file descriptor number: 2048 Aug 27 02:25:59.579071 n-d-852084-5 devstack@n-api.service[122477]: lock engine: pthread robust mutexes Aug 27 02:25:59.580870 n-d-852084-5 devstack@n-api.service[122477]: thunder lock: enabled Aug 27 02:25:59.580870 n-d-852084-5 devstack@n-api.service[122477]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 02:25:59.580870 n-d-852084-5 devstack@n-api.service[122477]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 02:25:59.622944 n-d-852084-5 devstack@n-api.service[122477]: Python main interpreter initialized at 0x55e2e9aa99c0 Aug 27 02:25:59.622944 n-d-852084-5 devstack@n-api.service[122477]: python threads support enabled Aug 27 02:25:59.622944 n-d-852084-5 devstack@n-api.service[122477]: your server socket listen backlog is limited to 100 connections Aug 27 02:25:59.622944 n-d-852084-5 devstack@n-api.service[122477]: your mercy for graceful operations on workers is 90 seconds Aug 27 02:25:59.623542 n-d-852084-5 devstack@n-api.service[122477]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 02:25:59.623542 n-d-852084-5 devstack@n-api.service[122477]: *** Operational MODE: preforking *** Aug 27 02:25:59.627566 n-d-852084-5 devstack@n-api.service[122477]: *** uWSGI is running in multiple interpreter mode *** Aug 27 02:25:59.627566 n-d-852084-5 devstack@n-api.service[122477]: spawned uWSGI master process (pid: 122477) Aug 27 02:25:59.627566 n-d-852084-5 devstack@n-api.service[122477]: spawned uWSGI worker 1 (pid: 122487, cores: 1) Aug 27 02:25:59.627566 n-d-852084-5 devstack@n-api.service[122477]: spawned uWSGI worker 2 (pid: 122488, cores: 1) Aug 27 02:25:59.627566 n-d-852084-5 devstack@n-api.service[122477]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 02:25:59.623939 n-d-852084-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 27 02:26:00.439896 n-d-852084-5 devstack@n-api.service[122487]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:26:00.508357 n-d-852084-5 devstack@n-api.service[122488]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 27 02:26:01.648155 n-d-852084-5 devstack@n-api.service[122487]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:26:01.648155 n-d-852084-5 devstack@n-api.service[122487]: from cryptography.utils import int_from_bytes Aug 27 02:26:01.649117 n-d-852084-5 devstack@n-api.service[122487]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:26:01.649117 n-d-852084-5 devstack@n-api.service[122487]: from cryptography.utils import int_from_bytes Aug 27 02:26:02.206450 n-d-852084-5 devstack@n-api.service[122488]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:26:02.206450 n-d-852084-5 devstack@n-api.service[122488]: from cryptography.utils import int_from_bytes Aug 27 02:26:02.207408 n-d-852084-5 devstack@n-api.service[122488]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:26:02.207408 n-d-852084-5 devstack@n-api.service[122488]: from cryptography.utils import int_from_bytes Aug 27 02:26:04.218365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:26:04.219036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:26:04.219185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:26:04.219562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:26:04.219825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:26:04.220227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.220565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.220894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.221220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.221559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.221925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.222259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.222589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.222927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.223199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.223528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.223861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852084-5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.224195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.224518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.224840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.225171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.225484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.225845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.226429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.226947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.227713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.228843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.229995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.230363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.230697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.231034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.231346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.231667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.232008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.232328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.232753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852084-5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.233088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.233411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.233774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.234213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.234728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.235050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.235384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.235720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.236219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.236566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.236902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.237238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.237569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.238397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.238823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.239258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.239662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.240004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.240277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.240553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.240932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.241273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.241730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.242064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.242342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.242665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.243059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.243426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.243771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.244114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.244448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.244810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.245191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.245565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.245920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.246242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.246579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.246912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.247256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.247578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.247972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.248390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.248670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.248990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.249426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.249849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.250174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.250509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.250843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.251164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.251486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.251804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.252133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.252499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.252815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.253074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.253386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.253728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.254063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.254381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.254698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.255013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.255323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.255635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.255949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.256263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.256576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.256889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.257203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.257516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.257858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.258172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.258506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.258835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.259148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.259462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.259773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.260085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.260949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.261263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.261578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.261940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.262257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.262573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.262898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.263216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.263531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.263858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.264171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.264483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.264809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.265121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.265438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.265815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.266110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.266473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.266738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.267046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.267356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.267664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.267994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.268325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.268642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.268959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.269272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.269602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:04.269985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.270328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.270680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.271002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.271344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.271683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.272009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.272331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.272653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.272987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.273305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.273623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.273987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.274313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.274637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.274973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.275295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.275618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.276010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.276827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.277129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.277466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.277820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.278140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.278490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.278844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.279166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.279497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.279830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.280148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.280466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.280792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.281116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.281454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.281842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.282256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.282580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.282913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.283231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.283547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.283864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.284189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.284508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.284860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.285183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.285513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.285868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.286188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.286514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.286835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.287154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.287473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.287784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.288097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.288411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.288731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.289044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.289378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.289783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.290058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.290402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.290719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.291038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.291356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.292215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.292530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.292849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.293169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.293484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.293857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.294181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.294495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.294829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.295142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.295459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.295783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.296105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.296427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.296749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.297071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.297406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.297766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.298078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.298426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.298770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.299087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.299422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.299754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.300078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.300392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.300710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.301023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.301337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.301646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.301994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.302306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.302621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.302934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.303244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.303555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.303889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.304211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.304522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.304834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.305144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.305753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.306075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.306435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.306788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.307121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.308023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.308348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.308676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.309000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.309323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.309646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.309993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.310323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.310643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.310975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.311290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.311628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.311948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.312278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.312591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.312916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.313268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.313614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.313974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.314310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.314629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.314955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.315276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.315596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.315917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.316236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.316566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.316884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.317211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.317531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.317972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.318293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.318621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.318935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.319258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.319602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.319945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.320262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.320582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.320913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.321233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.321552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.321899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.322214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.322529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.322887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.323215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.323534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.323852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.324170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.324492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.324806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.325119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.325433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.325782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.326121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.326442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.326773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.327102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.327418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.327733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.328067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.328386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.328700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.329013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.329326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.329728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.330029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.330346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.330674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.331006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.331327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.331653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.331974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.332294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.332630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.332956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.333276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.333595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.333955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.334276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.334596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.334928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.335248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.335570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.335888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.336201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.336523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.336848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.337453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.337829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.338156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.338531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.338861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.339218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.339562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.339900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.340221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.340536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.340854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.341169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.341482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.341829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.342142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.342455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.342766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.343083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.343393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.343707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.344026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.344338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.344664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.344975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.345294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.345606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.345975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.346295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.346607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.346919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.347230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.347586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.347901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.348252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.348592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.348947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.349263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.349698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.350051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.350365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.350679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.351241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.351574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.352403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.352403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.352715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.352932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.353251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.353569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.353916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.354763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.355078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.355409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.355733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.356047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.356360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.356784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.357113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.357427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.357775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.358091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.358418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.358731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.359043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.359351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.359671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.359989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.360300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.360638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.360960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.361271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.361733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.362059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.362375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.362689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.363010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.363373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.363776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.364090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.364411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.364729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.365043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.365356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.365730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.366010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.366324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.366636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.366950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.367263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.367604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.367922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.368238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.368914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.368914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.369341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.369657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.370573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.370889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.371216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.371548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.371871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.372192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.372517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.372832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.373438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.373655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.373945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.374264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.374584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.374926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.375248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.375569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.375900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.376234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.376569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.376883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.377204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.377524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.378638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.378638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.378638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.379268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.379268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.379583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.379773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.380136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.380453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.380774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.381093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.381408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.381778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.382098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.382410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.382728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.383045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.383367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.383682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.384140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.384466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.384786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.385099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.385462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.385810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.386133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.386462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.386774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.387208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.387528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.387846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.388165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.388478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.388789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.389143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.389477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.389819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.390134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.390447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.390778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.391095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.391428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.391876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.392199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.392512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.392937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.393258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.393575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.393928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.394983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.394983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.394983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.395401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.395548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.395832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.396166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.396490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.396817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.397132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.397463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.397824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.398147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.398478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.398924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.399255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.399575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.399911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.400246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.400559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.400911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.401237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.401552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.401895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.402229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.402542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.402861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.403177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.403494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.403806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.404120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.404449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.404767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.405097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.405421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.405780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.406112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.406427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.406761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.407082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.407394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.407706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.408017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.408375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.408688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.409021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.409363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.409740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.410046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.410389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.410724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.411050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.411377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.411711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.412023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.412335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.412653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.412966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.413277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.413587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.413931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.414239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.414556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.414868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.415202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.415512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.415842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.416159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.416471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.417332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.417647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.418029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.418343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.418684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.419002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.419361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.419713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.420057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.420418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.420763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.421124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.421450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.421802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.422166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.422484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.422832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.423208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.423853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.424192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.424516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.424859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.425208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.425543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.425971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.426293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.426671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.426993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.427316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.427661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.427995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.428332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.428679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.429010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.429335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.429660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.430076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.430384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.430705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.431019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.431344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.431669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.431992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.432872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.433198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.433520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.433878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.434200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.434517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.434839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.435165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.435505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.435850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.436180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.436504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.436852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.437198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.437868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.438190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.438591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.438925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.439259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.439588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.439918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.440259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.440575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.440890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.441210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.441600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.441872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.442208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.442526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.442849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.443168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.443654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.444411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.444945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.445443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.445970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.446479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.446965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.447436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.448019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.448505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.448985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.449469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.449986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.450449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.450930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.451422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.451901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.452371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.452860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.453339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.454735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.455105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.455555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.455813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.456407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.456992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.457287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.457882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.458244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.458615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.458968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.459290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.459616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.459959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.460306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.460635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.461005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.461378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.461719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.462045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.462380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.462715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.463117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.463497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.463884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.464259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.464590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.465207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.465557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.465924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.466458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.467042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.467443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.467838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.468137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.468480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.468809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.469135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.469473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.469808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.470131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.470454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.470773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.471095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.471416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.471737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.472057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.472377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.472696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.473012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.473343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.473728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.474065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.474392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.474718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.475052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.475372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.475691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.476265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.476585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.476913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.477260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.477586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.477929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.478379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.478703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.479564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.479900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.480223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.480558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.480895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.481213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.481544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.481891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.482231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.482585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.482927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.483262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.483576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.483888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.484202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.484521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.484850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.485170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.485484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.485843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.486161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.486473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.486788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.487101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.487413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.487729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.488040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.488350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.488658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.488972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.489282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.489592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.489960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.490273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.490587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.490896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.491210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.491520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.491872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.492215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.492541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.492874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.493196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.493532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.493884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.494219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.494552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.495451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.495776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.496123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.496446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.496768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.497089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.497412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.497768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.498091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.498440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.498777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.499094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.499431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.499757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.500089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.500412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.500731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.501070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.501386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.501726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.502047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.502365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.502683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.503009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.503327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.503645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.503971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.504298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.504637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.504972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.505291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.505631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.505993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.506362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.506683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.507039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.507376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.507701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.508025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.508339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:04.508591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122487) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:26:04.573689 n-d-852084-5 devstack@n-api.service[122487]: INFO dbcounter [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Registered counter for database nova_api Aug 27 02:26:04.597110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_db.sqlalchemy.engines [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:26:04.606465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writer thread running {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:26:04.669011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.context [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) {{(pid=122487) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:26:04.673502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:04.674034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:04.675680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:04.676478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:04.676939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:04.679109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:04.681359 n-d-852084-5 devstack@n-api.service[122487]: INFO dbcounter [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Registered counter for database nova_cell0 Aug 27 02:26:04.687828 n-d-852084-5 devstack@n-api.service[122487]: INFO dbcounter [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Registered counter for database nova_cell1 Aug 27 02:26:04.698602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_db.sqlalchemy.engines [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:26:04.700013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_db.sqlalchemy.engines [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:26:04.707984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writer thread running {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:26:04.709955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writer thread running {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:26:04.965250 n-d-852084-5 devstack@n-api.service[122487]: INFO dbcounter [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Registered counter for database nova_cell0 Aug 27 02:26:04.974258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_db.sqlalchemy.engines [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122487) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:26:04.981220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writer thread running {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:26:05.298989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:26:05.299762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:26:05.299912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:26:05.300246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:26:05.300409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:26:05.300817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.301151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.301478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.301938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.302227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.302525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.302848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.303178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.303519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.303786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.304105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.304440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852084-5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.304774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.305079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.305399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.305750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.306225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.306383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.306697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.307765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.309051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.309051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.309051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.309051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.310079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.310079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.310079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.311100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.311100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.311100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.311803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852084-5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.311803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.312431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.312431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.312910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.313155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.313407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.313758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.314825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.314825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.314825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.315258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.315258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.315523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.316110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.316110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.316438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.316751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.317065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.317385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.317644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.317990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.318326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.318702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.319023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.319301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.319566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.319837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.320168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.320483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.320797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.321109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.321421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.321760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.322074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.322386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.322697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.323621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.323991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.324278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.324592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.324918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.325332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.325593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.325929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.326283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.326605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.326925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.327252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.327582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.327895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.328208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.328518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.328913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.329380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.329623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.329880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.330114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.330417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.330748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.331060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.331393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.331738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.332047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.332403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.332718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.333037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.333348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.333655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.333991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.334308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.334714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.335014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.335334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.335723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.336057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.336353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.336673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.336980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.337319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.337634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.338084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.338288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.339354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.339604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.339792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.340108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.340420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.340745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.341054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.341364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.341708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.342025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.342339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.342724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.343060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.343383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.343733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.344047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.344362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.344666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.344996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.345329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.345649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.345996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.346310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.346641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:26:05.346990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.347335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.347690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.348015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.348352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.348690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.349017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.350516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.350516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.350516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.350516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.351763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.351763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.351763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.352721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.352721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.352721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.387320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.387320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.387320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.387320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.387320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.387320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.387320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.387320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.393927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.393927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.393927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.393927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.393927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.393927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.393927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.393927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.395587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.395587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.395587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.395587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.395587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.395587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.395587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.395587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.397613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.397613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.397613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.397613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.397613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.397613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.397613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.397613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.399455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.399455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.399455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.399455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.399455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.399455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.399455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.399455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.402492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.402492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.402492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.402492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.402492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.402492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.402492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.402492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.404731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.404731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.404731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.404731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.404731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.404731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.404731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.404731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.406049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.406049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.406049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.406049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.406049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.406861 n-d-852084-5 devstack@n-api.service[122487]: WARNING keystonemiddleware.auth_token [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:26:05.407654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.407654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.407654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.407654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.407654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.407654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.407654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.407654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.408528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.408528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.408528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.408528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.408528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.408528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.408528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.408528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.409393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.409393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.409393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.409393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.409393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.409393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.409393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.409393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.410456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.410456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.410456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.410456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.410456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.410456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.410456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.410456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.411418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.411418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.411418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.411418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.411418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.411418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.411418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.411418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.412268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.412268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.412268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.412268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.412268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.412268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.412268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.412268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.413436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.413436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.413810 n-d-852084-5 devstack@n-api.service[122487]: WARNING keystonemiddleware.auth_token [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:26:05.414019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.414019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.414019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.414019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.414019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.414019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.414019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.414019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.415273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.415273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.415273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.415273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.415273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.415273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.415273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.415273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.416177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.416177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.416177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.416177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.416177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.416177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.416177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.416177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.417180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.417180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.417180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.417498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.418013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.418496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.418925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.419407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.419856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.420204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.420684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.421135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.421563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.422093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.422515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.422983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.423440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.423905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.424318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.424816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.425234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.425705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.426161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.426584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.427041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.427459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.427868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.428318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.428745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.429166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.429588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.430064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.430480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.430909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.431345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.433209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.433811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.434373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.434921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.435484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.436044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.436588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.437153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.437806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.439543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.439946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.440473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.441478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.442088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.442635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.443187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.443744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.444335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.444910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.445483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.446059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.446601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.447205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.447680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.448787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.449328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.449878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.450397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.450898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.451436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.451966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.452488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.453024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.453556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.454148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.454682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.455232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.455761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.456339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.456888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.457420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.458000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.458526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.459130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.459661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.460242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.460812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.461421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.462036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.462570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.463138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.463712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.464246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.464785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.465323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.465891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.466432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.466975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.467513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.468066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.468606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.469134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.469690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.470222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.470772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.471323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.471862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.472457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.472940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.473478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.474036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.474582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.475112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.475664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.476447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.476972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.477503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.478077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.478612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.479168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.479738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.480294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.480830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.481366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.481937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.482466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.483005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.483545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.484121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.484833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.485371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.485956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.486494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.487040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.487572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.488105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.488641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.489164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.489721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.490257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.490792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.491365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.491907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.492469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.492991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.493529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.494188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.495258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.495884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.496417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.496969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.497527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.498104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.498653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.499204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.499739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.500312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.500862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.501413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.502174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.502767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.503277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.503820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.504357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.504918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.505482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.506081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.506623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.507175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.507727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.508273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.508802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.509354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.509946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.511065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.511606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.512191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.512741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.513277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.513852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.514398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.514925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.515500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.516064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.516591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.517143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.517742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.518255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.518790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.519546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.520074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.520891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.521146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.521726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.522251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.522808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.523357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.523904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.524648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.525204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.525787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.526859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.527388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.527921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.528465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.529039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.529575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.530147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.530687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.531251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.531779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.532338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.533077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.533635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.534196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.535113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.535445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.536004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.536571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.537133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.537723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.538270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.538818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.539377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.539945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.540510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.541076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.542194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.542734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.543298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.543870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.544427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.544993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.545772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.546341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.547289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.547435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.548002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.548539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.549070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.549609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.550180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.550677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.551220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.551751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.552302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.552837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.553377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.554207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.555002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.555578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.556116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.556679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.557280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.557879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.558442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.558988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.559540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.560097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.560647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.561172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.561735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.562348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.562876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.563450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.564338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.564601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.565353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.566092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.566653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.567222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.567777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.568340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.568882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.569632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.570039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.570537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.571094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.571607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.572184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.572690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.573290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.573887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.574469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.575009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.575568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.576105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.576639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.577172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.577720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.578323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.578856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.579431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.580235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.580811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.581355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.581934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.582488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.583035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.583586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.584149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.584706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.585245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.585833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.586385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.586943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.587880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.588983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.589532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.590130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.590675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.591465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.591864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.592393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.592973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.593507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.594060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.594648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.595201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.595768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.596351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.596892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.597452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.598050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.598607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.599237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.599781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.600315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.600856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.601710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.602292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.602952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.603379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.603937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.605163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.605749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.606290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.606849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.607411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.607976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.608560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.609119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.609705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.610263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.610817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.611781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.612332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.612907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.613480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.614098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.614674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.615242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.615810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.616346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.616876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.617410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.618077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.618622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.619195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.620260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.620795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.621355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.621931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.622936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.623517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.624072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.624644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.625205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.625792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.626332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.626893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.627434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.627962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.628523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.629061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.629605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.630187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.630736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.631283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.631803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.632349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.632884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.633756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.634292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.634828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.635937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.636477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.637008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.637529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.638105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.638646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.639200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.639749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.640276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.640815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.641358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.641931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.642486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.643096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.643673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.644215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.644739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.645309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.645883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.646442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.646987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.647543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.648157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.648725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.649757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.650333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.650934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.651508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.652070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.652606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.653156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.653722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.654297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.654810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.655628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.656122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.656677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.657227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.657846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.658361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.658902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.659481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.660027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.660575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.661119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.661752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.662244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.662805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.663396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.663929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.664481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.665035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.665595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.666180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.666773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.667321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.667865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.668420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.669004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.669539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.670115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.670842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.671405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.671979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.672542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.673085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.673654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.674228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.674747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.675287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.675795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.676341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.676898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.677434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.678009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.678514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.679010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.679517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.680039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.680537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.681047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.681539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.682066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.683112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.683619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.684114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.684617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.685113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.685624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.686149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.686648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.687140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.687633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.688125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.688621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.689127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.690222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.690222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.690850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.691121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.691681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.692086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.692611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.693132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.693625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.694241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.694761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.695255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.695783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.696292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.696803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.697298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.698431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.698930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.699433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.699918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.700405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.700895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.701392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.701960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.702509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.703048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.703609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.704127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.704641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.705153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.705711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.706243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.706732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.707296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.707716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.708221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.708712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.709220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.709756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.710265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.710768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.711283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.711812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.712319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.712807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.713330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.714409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.715020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.715471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.716035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.716569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.717080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.717596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.718124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:26:05.718511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:26:05.904783 n-d-852084-5 devstack@n-api.service[122488]: INFO dbcounter [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Registered counter for database nova_api Aug 27 02:26:05.927793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_db.sqlalchemy.engines [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:26:05.936079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writer thread running {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:26:05.938394 n-d-852084-5 devstack@n-api.service[122487]: WARNING keystonemiddleware.auth_token [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:26:05.944756 n-d-852084-5 devstack@n-api.service[122487]: WARNING keystonemiddleware.auth_token [None req-e98572a5-e1e1-4001-9bc6-e4d85b227b1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:26:05.951212 n-d-852084-5 devstack@n-api.service[122487]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e2e9aa99c0 pid: 122487 (default app) Aug 27 02:26:06.000875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.context [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) {{(pid=122488) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 02:26:06.004921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:06.005417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:06.007104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:06.007916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:06.008376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:06.011070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:06.013231 n-d-852084-5 devstack@n-api.service[122488]: INFO dbcounter [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Registered counter for database nova_cell0 Aug 27 02:26:06.018036 n-d-852084-5 devstack@n-api.service[122488]: INFO dbcounter [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Registered counter for database nova_cell1 Aug 27 02:26:06.029080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_db.sqlalchemy.engines [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:26:06.031252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_db.sqlalchemy.engines [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:26:06.038925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writer thread running {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:26:06.042347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writer thread running {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:26:06.211166 n-d-852084-5 devstack@n-api.service[122488]: INFO dbcounter [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Registered counter for database nova_cell0 Aug 27 02:26:06.219896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_db.sqlalchemy.engines [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:26:06.225801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writer thread running {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:26:06.566507 n-d-852084-5 devstack@n-api.service[122488]: WARNING keystonemiddleware.auth_token [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:26:06.574821 n-d-852084-5 devstack@n-api.service[122488]: WARNING keystonemiddleware.auth_token [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:26:06.934569 n-d-852084-5 devstack@n-api.service[122488]: WARNING keystonemiddleware.auth_token [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 02:26:06.940956 n-d-852084-5 devstack@n-api.service[122488]: WARNING keystonemiddleware.auth_token [None req-df5ea522-f234-4cb0-94e2-051ea2b4a6d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 02:26:06.946681 n-d-852084-5 devstack@n-api.service[122488]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e2e9aa99c0 pid: 122488 (default app) Aug 27 02:26:50.797350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:50.798341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:50.799028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:50.800308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:52.541853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '.version_select at 0x7f4d2bfcca60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:52.551024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) {{(pid=122487) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 02:26:52.552064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:52.552709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:52.553161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:52.593047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:52.593895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:52.594551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:52.615324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:52.616050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:52.617449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:52.628227 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-19c6b752-81e6-41e5-95ed-e8b8a3e232c0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 1.839161 Aug 27 02:26:52.632276 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1/1] 10.222.0.99 () {58 vars in 1167 bytes} [Sat Aug 27 02:26:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:26:53.090173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ef43d7dc-96c9-4578-9045-4649299472ee tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1296492334", "name": "tempest-test_aggregate-1914698042"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:53.156805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.aggregate [None req-ef43d7dc-96c9-4578-9045-4649299472ee tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Generated uuid ac110f2f-45e2-4609-b294-0e670f4d95e0 for aggregate {{(pid=122488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:26:53.172516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:53.174254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:53.176247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:53.178253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:53.331687 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ef43d7dc-96c9-4578-9045-4649299472ee tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.673440 Aug 27 02:26:53.334518 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1/2] 10.222.0.99 () {60 vars in 1165 bytes} [Sat Aug 27 02:26:52 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:53.351345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-10cb3ad4-624c-4645-b1fe-32c2707d0b34 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:53.384980 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-10cb3ad4-624c-4645-b1fe-32c2707d0b34 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.039787 Aug 27 02:26:53.397631 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2/3] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:26:53 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:53.411268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0ae205e2-c3f3-45a4-a21b-99ed8b51fcee tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:53.436476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ae205e2-c3f3-45a4-a21b-99ed8b51fcee tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:53.437074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ae205e2-c3f3-45a4-a21b-99ed8b51fcee tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:53.437735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ae205e2-c3f3-45a4-a21b-99ed8b51fcee tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:55.870662 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0ae205e2-c3f3-45a4-a21b-99ed8b51fcee tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 2.463536 Aug 27 02:26:55.879032 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2/4] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:26:53 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 2473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:56.692044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-94210dff-6876-4ed6-b3e3-1e3bb7875d28 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:56.700674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94210dff-6876-4ed6-b3e3-1e3bb7875d28 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:56.701341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94210dff-6876-4ed6-b3e3-1e3bb7875d28 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:56.710486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94210dff-6876-4ed6-b3e3-1e3bb7875d28 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:56.715910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94210dff-6876-4ed6-b3e3-1e3bb7875d28 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:56.720135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94210dff-6876-4ed6-b3e3-1e3bb7875d28 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:56.721228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94210dff-6876-4ed6-b3e3-1e3bb7875d28 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:56.848649 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-94210dff-6876-4ed6-b3e3-1e3bb7875d28 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.872571 Aug 27 02:26:56.861842 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3/5] 10.222.0.99 () {58 vars in 1176 bytes} [Sat Aug 27 02:26:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:57.228222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-174324592", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:57.675377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1704427451", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "availability_zone": "tempest-test_az-1296492334"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:57.780942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:57.784112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:57.794734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:57.807429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:57.808572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:57.809534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:58.067465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:26:58.359724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:26:58.597877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:26:58.598297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:26:58.598777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:26:58.599188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:26:58.599618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:26:58.616403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:58.617217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:58.617948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:58.619577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:58.620290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:58.620969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:58.668272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Getting quotas for project dc468f7c61aa40d892089c93573ebef1. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:26:58.677251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Getting quotas for user f46309895da04211866ad3bbcb96ff76 and project dc468f7c61aa40d892089c93573ebef1. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:26:58.697740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:26:58.701123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:26:58.794605 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b6aa0c95-447c-42fe-8456-0a08674021c9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.939607 Aug 27 02:26:58.795815 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 4/6] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:26:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:26:58.974775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:26:58.975386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:26:58.975824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:26:58.976370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:26:58.977171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:26:59.001908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:59.002653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:59.003312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:59.004604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:26:59.005327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:26:59.005971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:26:59.014791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a50e9b97-a39d-46fe-bdb7-ce3a05e7b7d1 tempest-AZAdminNegativeTestJSON-614487343 tempest-AZAdminNegativeTestJSON-614487343-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:59.016593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a50e9b97-a39d-46fe-bdb7-ce3a05e7b7d1 tempest-AZAdminNegativeTestJSON-614487343 tempest-AZAdminNegativeTestJSON-614487343-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'de7465528fa141a1ac3f8c710fbc137a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a79e46d861344771b54d9a8130eb59bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a50e9b97-a39d-46fe-bdb7-ce3a05e7b7d1 tempest-AZAdminNegativeTestJSON-614487343 tempest-AZAdminNegativeTestJSON-614487343-project] Request method failure captured: Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDsecnwndMzoaG4prMzQrk7akfjOYSWbG4UX-gU0ZKfAMOndTcltEDh3uYbpWKYouwXvWsiBRU7kxipLDUXpSW7nBhaMdpSIFkqITNQgVvXc619mS7pXkPvWlI52MxTIvtCeqmkuibPaBRA9YdG4IZa06A5Qm0mUwfVx3fWZARh6NA Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: a79e46d861344771b54d9a8130eb59bc Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AZAdminNegativeTestJSON-614487343 Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:26:59.020425 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a79e46d861344771b54d9a8130eb59bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a79e46d861344771b54d9a8130eb59bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a79e46d861344771b54d9a8130eb59bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a79e46d861344771b54d9a8130eb59bc"}]}] Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AZAdminNegativeTestJSON-614487343 Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: a79e46d861344771b54d9a8130eb59bc Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-614487343 Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AZAdminNegativeTestJSON-614487343-project Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: de7465528fa141a1ac3f8c710fbc137a Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AZAdminNegativeTestJSON-614487343-project Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 02:26:59.022809 n-d-852084-5 devstack@n-api.service[122487]: action_args: {} Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:26:59.025108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:26:59.028324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a50e9b97-a39d-46fe-bdb7-ce3a05e7b7d1 tempest-AZAdminNegativeTestJSON-614487343 tempest-AZAdminNegativeTestJSON-614487343-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:26:59.031088 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a50e9b97-a39d-46fe-bdb7-ce3a05e7b7d1 tempest-AZAdminNegativeTestJSON-614487343 tempest-AZAdminNegativeTestJSON-614487343-project] 10.222.0.99 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.229759 Aug 27 02:26:59.041339 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 5/7] 10.222.0.99 () {58 vars in 1185 bytes} [Sat Aug 27 02:26:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 245 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:26:59.043516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Getting quotas for project cf8c9873f5654f1abf00234014d85a77. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:26:59.051307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Getting quotas for user 0be691c6ab4d4aff9c2bda2bb31c54bc and project cf8c9873f5654f1abf00234014d85a77. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:26:59.079702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:26:59.083014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:26:59.221924 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a32d6c9-415e-45de-af2b-a7f295d799a1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.764788 Aug 27 02:26:59.222592 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3/8] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:26:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:26:59.419345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1c28167-d304-4918-a4e7-c66bf3ed011b tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-719101074", "id": 1870227918, "os-flavor-access:is_public": "False"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:59.575095 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1c28167-d304-4918-a4e7-c66bf3ed011b tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.532391 Aug 27 02:26:59.586628 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 6/9] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:26:59 2022] POST /compute/v2.1/flavors => generated 430 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:59.614509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32a4db64-2fd6-4c66-b600-9c1a5d2896d8 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-244833152", "id": 1650987067, "os-flavor-access:is_public": "True"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:26:59.686153 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-32a4db64-2fd6-4c66-b600-9c1a5d2896d8 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.458523 Aug 27 02:26:59.687072 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 4/10] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:26:59 2022] POST /compute/v2.1/flavors => generated 429 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:26:59.692399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a9ca5618-d7a9-4d51-81f6-0699087a8736 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:26:59.703797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a9ca5618-d7a9-4d51-81f6-0699087a8736 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:26:59.989780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a9ca5618-d7a9-4d51-81f6-0699087a8736 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:00.018120 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a9ca5618-d7a9-4d51-81f6-0699087a8736 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1219 microversion: 2.1 time: 0.329494 Aug 27 02:27:00.026261 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 5/11] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:26:59 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1219 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:00.050257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6d9720b2-daee-45c9-b8b6-edf25f340db6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:00.051204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6d9720b2-daee-45c9-b8b6-edf25f340db6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:00.091164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c9f65929-dd7b-4c45-9970-6f1207b30630 tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:00.093276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f65929-dd7b-4c45-9970-6f1207b30630 tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:00.094009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f65929-dd7b-4c45-9970-6f1207b30630 tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:00.094621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f65929-dd7b-4c45-9970-6f1207b30630 tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:00.095541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f65929-dd7b-4c45-9970-6f1207b30630 tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:00.097781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f65929-dd7b-4c45-9970-6f1207b30630 tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:00.099670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f65929-dd7b-4c45-9970-6f1207b30630 tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:00.186875 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c9f65929-dd7b-4c45-9970-6f1207b30630 tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] 10.222.0.99 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.595742 Aug 27 02:27:00.198586 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 7/12] 10.222.0.99 () {58 vars in 1164 bytes} [Sat Aug 27 02:26:59 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:00.216631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bc971200-b667-46dd-8bc5-93ec3d0ad37a tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "84f3160a292c460c8e55746d1c568faa"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:00.413249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6d9720b2-daee-45c9-b8b6-edf25f340db6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:00.424974 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6d9720b2-daee-45c9-b8b6-edf25f340db6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1243 microversion: 2.1 time: 0.397240 Aug 27 02:27:00.427976 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 6/13] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:00 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1243 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:00.443671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-56f87718-95e8-4b24-94be-dc94fa014a6e tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:00.597752 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-56f87718-95e8-4b24-94be-dc94fa014a6e tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1650987067" status: 202 len: 0 microversion: 2.1 time: 0.164801 Aug 27 02:27:00.604245 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 7/14] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 02:27:00 2022] DELETE /compute/v2.1/flavors/1650987067 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:00.622751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a0dfa502-7da3-407e-8ea2-de244ad93c2b tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:00.630583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0dfa502-7da3-407e-8ea2-de244ad93c2b tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:00.635080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0dfa502-7da3-407e-8ea2-de244ad93c2b tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:00.637628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0dfa502-7da3-407e-8ea2-de244ad93c2b tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:00.640538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0dfa502-7da3-407e-8ea2-de244ad93c2b tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:00.643128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0dfa502-7da3-407e-8ea2-de244ad93c2b tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:00.645195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0dfa502-7da3-407e-8ea2-de244ad93c2b tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:00.709442 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bc971200-b667-46dd-8bc5-93ec3d0ad37a tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/1870227918/action" status: 200 len: 97 microversion: 2.1 time: 0.509228 Aug 27 02:27:00.718176 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 8/15] 10.222.0.99 () {60 vars in 1200 bytes} [Sat Aug 27 02:27:00 2022] POST /compute/v2.1/flavors/1870227918/action => generated 97 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:27:00.728643 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a0dfa502-7da3-407e-8ea2-de244ad93c2b tempest-AZAdminV2TestJSON-807738361 tempest-AZAdminV2TestJSON-807738361-project-admin] 10.222.0.99 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.117909 Aug 27 02:27:00.731131 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 8/16] 10.222.0.99 () {58 vars in 1185 bytes} [Sat Aug 27 02:27:00 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:00.748874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ac95eab-956a-4852-8180-e99301b6d96d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:00.826321 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9ac95eab-956a-4852-8180-e99301b6d96d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.114590 Aug 27 02:27:00.826938 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 9/17] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:00.871212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bdfc2b35-94c6-401a-a2f3-3204cc99ae63 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1072993762", "id": 233756823, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:00.941649 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bdfc2b35-94c6-401a-a2f3-3204cc99ae63 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.090608 Aug 27 02:27:00.946002 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 10/18] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:00 2022] POST /compute/v2.1/flavors => generated 414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:00.966836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1542b821-b1d5-42d1-bc99-8042cdac3420 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:01.037928 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1542b821-b1d5-42d1-bc99-8042cdac3420 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.084436 Aug 27 02:27:01.055072 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 11/19] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:00 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:01.067860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-00cd36da-5022-4a81-aeb0-32dece3b86ea tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:01.094713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d1bb2d78-79ae-4e07-9902-d820b32ea2ff tempest-FlavorsAccessTestJSON-1777102427 tempest-FlavorsAccessTestJSON-1777102427-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:01.115645 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-00cd36da-5022-4a81-aeb0-32dece3b86ea tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/233756823" status: 202 len: 0 microversion: 2.1 time: 0.058006 Aug 27 02:27:01.122877 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 12/20] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:27:01 2022] DELETE /compute/v2.1/flavors/233756823 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:01.142291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ff65e28c-c661-4379-ad4b-c8ba3be4d2b3 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:01.145900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ff65e28c-c661-4379-ad4b-c8ba3be4d2b3 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:01.226412 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d1bb2d78-79ae-4e07-9902-d820b32ea2ff tempest-FlavorsAccessTestJSON-1777102427 tempest-FlavorsAccessTestJSON-1777102427-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.494499 Aug 27 02:27:01.247438 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 9/21] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:00 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:01.254387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-433793aa-416e-4daf-8c7f-e6ebc1d7d28d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:01.291905 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-433793aa-416e-4daf-8c7f-e6ebc1d7d28d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042282 Aug 27 02:27:01.308803 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 10/22] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:01.317228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1cdf681-5821-4cb6-ab21-691c2a83e4ae tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "84f3160a292c460c8e55746d1c568faa"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:01.465816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ff65e28c-c661-4379-ad4b-c8ba3be4d2b3 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:01.543909 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ff65e28c-c661-4379-ad4b-c8ba3be4d2b3 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1219 microversion: 2.1 time: 0.417850 Aug 27 02:27:01.551824 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 13/23] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:01 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1219 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:01.600275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5d1a6775-792a-4925-881e-e12fcdc705a4 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1840379806", "id": 1996497721, "os-flavor-access:is_public": "True"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:01.652079 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5d1a6775-792a-4925-881e-e12fcdc705a4 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.056308 Aug 27 02:27:01.660959 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 14/24] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:01 2022] POST /compute/v2.1/flavors => generated 429 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:01.672605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-34ab0e62-d0be-43bb-9637-49b16663fa17 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:01.677635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-34ab0e62-d0be-43bb-9637-49b16663fa17 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:01.694832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34ab0e62-d0be-43bb-9637-49b16663fa17 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:01.696837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34ab0e62-d0be-43bb-9637-49b16663fa17 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:01.699566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34ab0e62-d0be-43bb-9637-49b16663fa17 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:01.701127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34ab0e62-d0be-43bb-9637-49b16663fa17 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:01.702725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34ab0e62-d0be-43bb-9637-49b16663fa17 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:01.703557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34ab0e62-d0be-43bb-9637-49b16663fa17 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:01.972941 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a1cdf681-5821-4cb6-ab21-691c2a83e4ae tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/1870227918/action" status: 200 len: 21 microversion: 2.1 time: 0.659423 Aug 27 02:27:01.974765 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 11/25] 10.222.0.99 () {60 vars in 1200 bytes} [Sat Aug 27 02:27:01 2022] POST /compute/v2.1/flavors/1870227918/action => generated 21 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:27:02.002993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff583770-6b44-44a7-8bea-58fb7a8681e0 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.046157 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff583770-6b44-44a7-8bea-58fb7a8681e0 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1996497721" status: 202 len: 0 microversion: 2.1 time: 0.068370 Aug 27 02:27:02.047182 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 12/26] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 02:27:01 2022] DELETE /compute/v2.1/flavors/1996497721 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:02.060226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-39ea56cd-b860-49dc-9e2b-f4e043720585 tempest-FlavorsAccessTestJSON-1777102427 tempest-FlavorsAccessTestJSON-1777102427-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.162378 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-39ea56cd-b860-49dc-9e2b-f4e043720585 tempest-FlavorsAccessTestJSON-1777102427 tempest-FlavorsAccessTestJSON-1777102427-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.113855 Aug 27 02:27:02.163038 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 13/27] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:02.164496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-34ab0e62-d0be-43bb-9637-49b16663fa17 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:02.176705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ee8f831c-a6ec-4222-aa6d-2022e2e41efc tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.224012 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ee8f831c-a6ec-4222-aa6d-2022e2e41efc tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053534 Aug 27 02:27:02.224873 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 14/28] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:02.231456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-790d1ee1-0440-4bf6-99d5-b64fcc63e4a6 tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.247545 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-34ab0e62-d0be-43bb-9637-49b16663fa17 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1243 microversion: 2.1 time: 0.584317 Aug 27 02:27:02.250346 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 15/29] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:01 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1243 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:02.278487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3212ec9a-80fb-43e8-a89e-6f47085e2e83 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1199065219", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:02.287202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-790d1ee1-0440-4bf6-99d5-b64fcc63e4a6 tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1870227918" status: 202 len: 0 microversion: 2.1 time: 0.060726 Aug 27 02:27:02.288440 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 15/30] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 02:27:02 2022] DELETE /compute/v2.1/flavors/1870227918 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:02.299424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-218468ad-a404-4602-bec6-c1dcb06799b7 tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.319093 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3212ec9a-80fb-43e8-a89e-6f47085e2e83 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.062288 Aug 27 02:27:02.320276 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 16/31] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:02 2022] POST /compute/v2.1/flavors => generated 507 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:02.332709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b9e0d03d-8cd9-4b2e-a6b3-61a7b6ce220f tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.357752 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-218468ad-a404-4602-bec6-c1dcb06799b7 tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5488 microversion: 2.1 time: 0.062763 Aug 27 02:27:02.359144 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 16/32] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/flavors/detail => generated 5488 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:02.381091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6ed3a979-9dde-47c6-9495-054b5f9454ec tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-967651394", "id": 1979433143, "os-flavor-access:is_public": "False"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:02.384660 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b9e0d03d-8cd9-4b2e-a6b3-61a7b6ce220f tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/ff4eaf50-7f8c-4be9-86a7-45bf0744c04d" status: 202 len: 0 microversion: 2.1 time: 0.055505 Aug 27 02:27:02.385798 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 17/33] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:02 2022] DELETE /compute/v2.1/flavors/ff4eaf50-7f8c-4be9-86a7-45bf0744c04d => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:27:02.396123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9607d39f-1109-4700-a6a5-578e01179bb0 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.422575 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6ed3a979-9dde-47c6-9495-054b5f9454ec tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.046153 Aug 27 02:27:02.424609 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 17/34] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:02 2022] POST /compute/v2.1/flavors => generated 430 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:27:02.428528 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9607d39f-1109-4700-a6a5-578e01179bb0 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038594 Aug 27 02:27:02.437148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-019847e8-358f-46fe-9b0c-6a12dc3e6f26 tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.442253 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 18/35] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:02.459897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3b653dc5-73c7-4c1c-a8b9-ffca3e99497a tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-595157737", "id": "53b84f52-4149-445e-89c1-cc4c2a553ffe", "os-flavor-access:is_public": "True"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:02.472334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:DELETE=10 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:02.481458 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-019847e8-358f-46fe-9b0c-6a12dc3e6f26 tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/1979433143/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.046901 Aug 27 02:27:02.484519 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 18/36] 10.222.0.99 () {58 vars in 1209 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/flavors/1979433143/os-flavor-access => generated 21 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:27:02.489550 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3b653dc5-73c7-4c1c-a8b9-ffca3e99497a tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.040630 Aug 27 02:27:02.499678 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 19/37] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:02 2022] POST /compute/v2.1/flavors => generated 506 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:02.503537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a2b7025-fdf6-4fcd-b221-f3ed7f326368 tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.508536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-490209f9-988f-4c7c-819a-9e43d0211017 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.546314 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a2b7025-fdf6-4fcd-b221-f3ed7f326368 tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1979433143" status: 202 len: 0 microversion: 2.1 time: 0.056003 Aug 27 02:27:02.550201 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 19/38] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 02:27:02 2022] DELETE /compute/v2.1/flavors/1979433143 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:02.562379 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-490209f9-988f-4c7c-819a-9e43d0211017 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/53b84f52-4149-445e-89c1-cc4c2a553ffe" status: 202 len: 0 microversion: 2.1 time: 0.056380 Aug 27 02:27:02.564939 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 20/39] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:02 2022] DELETE /compute/v2.1/flavors/53b84f52-4149-445e-89c1-cc4c2a553ffe => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:02.583432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-20ab7288-efab-496f-8aaa-560fb357101c tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.584185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c06f0ef9-f456-4974-9f01-c26a5f4e4343 tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.611462 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c06f0ef9-f456-4974-9f01-c26a5f4e4343 tempest-FlavorsAccessTestJSON-1072572029 tempest-FlavorsAccessTestJSON-1072572029-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032478 Aug 27 02:27:02.612596 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 20/40] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:02.617949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-52e1ed3f-e5c0-433d-b2dc-7c7da5af05f2 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.618638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-52e1ed3f-e5c0-433d-b2dc-7c7da5af05f2 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:02.637264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e1ed3f-e5c0-433d-b2dc-7c7da5af05f2 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.638253 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-20ab7288-efab-496f-8aaa-560fb357101c tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057487 Aug 27 02:27:02.639120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e1ed3f-e5c0-433d-b2dc-7c7da5af05f2 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.639919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e1ed3f-e5c0-433d-b2dc-7c7da5af05f2 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:02.641228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e1ed3f-e5c0-433d-b2dc-7c7da5af05f2 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:02.654163 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 21/41] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:02.658956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e1ed3f-e5c0-433d-b2dc-7c7da5af05f2 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:02.659648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e1ed3f-e5c0-433d-b2dc-7c7da5af05f2 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:02.674503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-754aeaa4-a05a-45e2-a1ae-ff16ff2101ff tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1592156715", "id": 1047102194, "os-flavor-access:is_public": "True"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:02.719030 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-754aeaa4-a05a-45e2-a1ae-ff16ff2101ff tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.054515 Aug 27 02:27:02.727065 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 22/42] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:02 2022] POST /compute/v2.1/flavors => generated 414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:02.737803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-baec226c-4be7-4059-9bc2-3b1ca8b3545d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:02.753725 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-baec226c-4be7-4059-9bc2-3b1ca8b3545d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/1047102194" status: 200 len: 414 microversion: 2.1 time: 0.023945 Aug 27 02:27:02.757085 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 23/43] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/flavors/1047102194 => generated 414 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:02.994181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-52e1ed3f-e5c0-433d-b2dc-7c7da5af05f2 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:03.016103 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-52e1ed3f-e5c0-433d-b2dc-7c7da5af05f2 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1293 microversion: 2.1 time: 0.402311 Aug 27 02:27:03.032941 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 21/44] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1293 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:03.202840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-955cdb4b-1377-4a9c-82ad-8ee913e61664 tempest-FlavorsAdminTestJSON-2141639228 tempest-FlavorsAdminTestJSON-2141639228-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:03.277721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a9fcc27b-78cd-46a8-b9d5-e3412d3ca67d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:03.278525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a9fcc27b-78cd-46a8-b9d5-e3412d3ca67d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:03.287355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10,nova_api:DELETE=9 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:03.311692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9fcc27b-78cd-46a8-b9d5-e3412d3ca67d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:03.313511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9fcc27b-78cd-46a8-b9d5-e3412d3ca67d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:03.313972 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-955cdb4b-1377-4a9c-82ad-8ee913e61664 tempest-FlavorsAdminTestJSON-2141639228 tempest-FlavorsAdminTestJSON-2141639228-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.548009 Aug 27 02:27:03.316315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9fcc27b-78cd-46a8-b9d5-e3412d3ca67d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:03.317946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9fcc27b-78cd-46a8-b9d5-e3412d3ca67d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:03.320811 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 24/45] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:02 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:03.323987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9fcc27b-78cd-46a8-b9d5-e3412d3ca67d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:03.324450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9fcc27b-78cd-46a8-b9d5-e3412d3ca67d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:03.343466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de0c3dfc-dad3-47aa-87e7-9cfb0d4955a1 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:03.393009 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de0c3dfc-dad3-47aa-87e7-9cfb0d4955a1 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1047102194" status: 202 len: 0 microversion: 2.1 time: 0.053586 Aug 27 02:27:03.398885 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 25/46] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 02:27:03 2022] DELETE /compute/v2.1/flavors/1047102194 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:03.404214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8b99d12b-3958-4536-8632-4d7a90baedac tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:03.475427 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8b99d12b-3958-4536-8632-4d7a90baedac tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075267 Aug 27 02:27:03.493321 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 26/47] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:03.498830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-03ba131c-ceed-45bf-9a14-9d157315e9e7 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-988067265", "id": 955007508, "os-flavor-access:is_public": "False"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:03.599681 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-03ba131c-ceed-45bf-9a14-9d157315e9e7 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.104835 Aug 27 02:27:03.607751 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 27/48] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:03 2022] POST /compute/v2.1/flavors => generated 426 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:03.613209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9160809f-f79c-4214-b802-ae05e82ced1c tempest-FlavorsAdminTestJSON-2141639228 tempest-FlavorsAdminTestJSON-2141639228-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "955007508"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:03.704787 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9160809f-f79c-4214-b802-ae05e82ced1c tempest-FlavorsAdminTestJSON-2141639228 tempest-FlavorsAdminTestJSON-2141639228-project] HTTP exception thrown: Flavor 955007508 could not be found. Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9160809f-f79c-4214-b802-ae05e82ced1c tempest-FlavorsAdminTestJSON-2141639228 tempest-FlavorsAdminTestJSON-2141639228-project] Request method failure captured: Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 106 Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDtzkVFZJuO4gN-qPZThYWq_dhmnnERJ6eQU6kAtX5HiuURhKG40k43LM1I9x8BAetOCYsFGqnXIRYIcQhpQHOvTeOKpVl5L3lkCojHJF2zaTfUlo7I-PzsRBJkwR18c96WOWNuootzS8nPltgp9_9-ODKdH7Yf1JZkhCUQXWwF1MA Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 99c4e48eb129495ca942393fbd18e30c Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-FlavorsAdminTestJSON-2141639228 Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:27:03.723597 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_99c4e48eb129495ca942393fbd18e30c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/99c4e48eb129495ca942393fbd18e30c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/99c4e48eb129495ca942393fbd18e30c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/99c4e48eb129495ca942393fbd18e30c"}]}] Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-FlavorsAdminTestJSON-2141639228 Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 99c4e48eb129495ca942393fbd18e30c Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2141639228 Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-FlavorsAdminTestJSON-2141639228-project Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: beb6e9650d7e4828b9c8fec373f01b54 Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-FlavorsAdminTestJSON-2141639228-project Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "test", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "955007508"}} Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:27:03.725848 n-d-852084-5 devstack@n-api.service[122487]: exception: Flavor 955007508 could not be found. Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '955007508'}}} Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 955007508 could not be found. Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:03.727578 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 955007508 could not be found. Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:03.730382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:03.735225 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:03.735225 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:03.735225 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:03.735225 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 955007508 could not be found. Aug 27 02:27:03.735225 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:03.735225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9160809f-f79c-4214-b802-ae05e82ced1c tempest-FlavorsAdminTestJSON-2141639228 tempest-FlavorsAdminTestJSON-2141639228-project] Returning 400 to user: Flavor 955007508 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:03.735225 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9160809f-f79c-4214-b802-ae05e82ced1c tempest-FlavorsAdminTestJSON-2141639228 tempest-FlavorsAdminTestJSON-2141639228-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.120832 Aug 27 02:27:03.737483 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 28/49] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:03 2022] POST /compute/v2.1/servers => generated 80 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:03.756318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0a287f12-5342-4d7d-ab16-4fbcd8fc07c2 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:03.809576 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0a287f12-5342-4d7d-ab16-4fbcd8fc07c2 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/955007508" status: 202 len: 0 microversion: 2.1 time: 0.068176 Aug 27 02:27:03.811489 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 29/50] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:27:03 2022] DELETE /compute/v2.1/flavors/955007508 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:03.833911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5c2e64c0-ad67-460c-a807-5e3920f2453d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:03.931275 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5c2e64c0-ad67-460c-a807-5e3920f2453d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.114449 Aug 27 02:27:03.938809 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 30/51] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:03.991112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c92e695a-b02e-41d4-8c7b-fd991248a378 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1621926975", "id": 980673955, "os-flavor-access:is_public": "False"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:04.102031 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c92e695a-b02e-41d4-8c7b-fd991248a378 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.146365 Aug 27 02:27:04.107989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a9fcc27b-78cd-46a8-b9d5-e3412d3ca67d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:04.123088 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 31/52] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:03 2022] POST /compute/v2.1/flavors => generated 412 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:04.154983 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a9fcc27b-78cd-46a8-b9d5-e3412d3ca67d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1299 microversion: 2.1 time: 0.882244 Aug 27 02:27:04.159367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-96b9bec1-6dc1-4c49-bcc2-12cbd354c45e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.160491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-96b9bec1-6dc1-4c49-bcc2-12cbd354c45e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:04.169250 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 22/53] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:03 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1299 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:04.190243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-80ed613f-c2e9-4a80-912b-d858ed1ab1de tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-910222290", "id": 1302062754, "os-flavor-access:is_public": "True"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:04.200771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96b9bec1-6dc1-4c49-bcc2-12cbd354c45e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:04.202237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96b9bec1-6dc1-4c49-bcc2-12cbd354c45e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:04.203297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96b9bec1-6dc1-4c49-bcc2-12cbd354c45e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:04.205565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96b9bec1-6dc1-4c49-bcc2-12cbd354c45e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:04.210870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96b9bec1-6dc1-4c49-bcc2-12cbd354c45e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:04.212044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96b9bec1-6dc1-4c49-bcc2-12cbd354c45e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:04.285479 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-80ed613f-c2e9-4a80-912b-d858ed1ab1de tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.114133 Aug 27 02:27:04.294170 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 23/54] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:04 2022] POST /compute/v2.1/flavors => generated 413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:04.309919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ea4828e1-ef6c-43eb-a5c4-84a6024e6985 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.381971 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ea4828e1-ef6c-43eb-a5c4-84a6024e6985 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.080489 Aug 27 02:27:04.383630 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 24/55] 10.222.0.99 () {58 vars in 1169 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:27:04.403903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-76dcc952-547f-4cc4-beac-22850fce575e tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.430858 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-76dcc952-547f-4cc4-beac-22850fce575e tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.035297 Aug 27 02:27:04.432969 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 25/56] 10.222.0.99 () {58 vars in 1177 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:04.452990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5711c2c1-6dee-42df-988d-bf490604a18d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.461999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-96b9bec1-6dc1-4c49-bcc2-12cbd354c45e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:04.475573 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-96b9bec1-6dc1-4c49-bcc2-12cbd354c45e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1299 microversion: 2.1 time: 0.355118 Aug 27 02:27:04.480841 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5711c2c1-6dee-42df-988d-bf490604a18d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.038526 Aug 27 02:27:04.482285 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 32/57] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1299 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:04.485972 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 26/58] 10.222.0.99 () {58 vars in 1171 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:04.500475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5490b379-e3ad-4e3a-8b9e-4c85f4c6aa0b tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.546965 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5490b379-e3ad-4e3a-8b9e-4c85f4c6aa0b tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.052360 Aug 27 02:27:04.560504 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 27/59] 10.222.0.99 () {58 vars in 1169 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:04.585036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-febff007-4d17-4348-99c7-9f589c4f5033 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.645135 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-febff007-4d17-4348-99c7-9f589c4f5033 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.076654 Aug 27 02:27:04.646524 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 33/60] 10.222.0.99 () {58 vars in 1169 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:04.674577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2ceb9b5c-877d-4761-8b5a-157202111bb8 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.731154 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2ceb9b5c-877d-4761-8b5a-157202111bb8 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.060700 Aug 27 02:27:04.734285 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 28/61] 10.222.0.99 () {58 vars in 1175 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:04.753596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-39555df9-9fa3-4061-beba-87f03780ed06 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.840510 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-39555df9-9fa3-4061-beba-87f03780ed06 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.091035 Aug 27 02:27:04.844512 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 34/62] 10.222.0.99 () {58 vars in 1173 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:04.874086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aeaba4b9-7211-4b15-b1bf-f74898939de0 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.916550 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aeaba4b9-7211-4b15-b1bf-f74898939de0 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.044080 Aug 27 02:27:04.917493 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 29/63] 10.222.0.99 () {58 vars in 1169 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:04.936249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e954403-c4d4-4485-bbdf-956d126730a4 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:04.982445 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e954403-c4d4-4485-bbdf-956d126730a4 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1302062754" status: 202 len: 0 microversion: 2.1 time: 0.049552 Aug 27 02:27:04.995538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-90acb993-7855-4a7c-8534-35c0de5a4c9e tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.001325 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 35/64] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 02:27:04 2022] DELETE /compute/v2.1/flavors/1302062754 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:05.056998 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-90acb993-7855-4a7c-8534-35c0de5a4c9e tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062773 Aug 27 02:27:05.057788 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 30/65] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:05.082125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-32190b72-055d-4e52-ab06-de68ef3b4dcb tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.127915 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-32190b72-055d-4e52-ab06-de68ef3b4dcb tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/980673955" status: 202 len: 0 microversion: 2.1 time: 0.049744 Aug 27 02:27:05.138797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4b50958a-20cf-4911-967a-fd8a42e1d527 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.144376 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 36/66] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:27:05 2022] DELETE /compute/v2.1/flavors/980673955 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:05.181721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-22e2301a-bb84-45b4-a190-c942ed638568 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.182549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-22e2301a-bb84-45b4-a190-c942ed638568 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:05.190373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e2301a-bb84-45b4-a190-c942ed638568 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.191453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e2301a-bb84-45b4-a190-c942ed638568 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.191678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e2301a-bb84-45b4-a190-c942ed638568 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.192602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e2301a-bb84-45b4-a190-c942ed638568 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.193045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e2301a-bb84-45b4-a190-c942ed638568 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.193550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e2301a-bb84-45b4-a190-c942ed638568 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.199744 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4b50958a-20cf-4911-967a-fd8a42e1d527 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064146 Aug 27 02:27:05.201349 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 31/67] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:05.237654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-acefb972-2479-4e96-b78b-cb2d706ffcd6 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1020160573", "id": 866567668, "os-flavor-access:is_public": "False"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:05.280266 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-acefb972-2479-4e96-b78b-cb2d706ffcd6 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.057464 Aug 27 02:27:05.281183 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 32/68] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:05 2022] POST /compute/v2.1/flavors => generated 412 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:05.323548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d6d8fee6-13fd-4d5e-a9fe-27ee900209e2 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.395067 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d6d8fee6-13fd-4d5e-a9fe-27ee900209e2 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.099011 Aug 27 02:27:05.411199 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 33/69] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:05.427024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-042ab087-8547-4506-b81b-0e7ed28a5f94 tempest-FlavorsAdminTestJSON-2141639228 tempest-FlavorsAdminTestJSON-2141639228-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.484672 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-042ab087-8547-4506-b81b-0e7ed28a5f94 tempest-FlavorsAdminTestJSON-2141639228 tempest-FlavorsAdminTestJSON-2141639228-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065270 Aug 27 02:27:05.491903 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 34/70] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:05.503562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6abefd93-fdcf-4d75-8caf-e2b0dc71f947 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.506229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6abefd93-fdcf-4d75-8caf-e2b0dc71f947 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:05.521106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6abefd93-fdcf-4d75-8caf-e2b0dc71f947 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.522517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6abefd93-fdcf-4d75-8caf-e2b0dc71f947 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.522981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6abefd93-fdcf-4d75-8caf-e2b0dc71f947 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.523743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6abefd93-fdcf-4d75-8caf-e2b0dc71f947 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:05.524219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6abefd93-fdcf-4d75-8caf-e2b0dc71f947 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:05.525364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6abefd93-fdcf-4d75-8caf-e2b0dc71f947 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:05.708355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6abefd93-fdcf-4d75-8caf-e2b0dc71f947 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:05.731584 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6abefd93-fdcf-4d75-8caf-e2b0dc71f947 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1299 microversion: 2.1 time: 0.221313 Aug 27 02:27:05.744718 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 35/71] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:05 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1299 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:05.744718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3aad78f6-c5e6-4f44-9954-7448332747e8 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.803763 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3aad78f6-c5e6-4f44-9954-7448332747e8 tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/866567668" status: 202 len: 0 microversion: 2.1 time: 0.069002 Aug 27 02:27:05.808330 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 36/72] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:27:05 2022] DELETE /compute/v2.1/flavors/866567668 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:05.814721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-22e2301a-bb84-45b4-a190-c942ed638568 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:05.827531 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-22e2301a-bb84-45b4-a190-c942ed638568 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1297 microversion: 2.1 time: 0.651141 Aug 27 02:27:05.841788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-920b1cde-5dcb-42b5-9383-c038fa71d31b tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:05.844645 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 37/73] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:05 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1297 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:05.873148 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-920b1cde-5dcb-42b5-9383-c038fa71d31b tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056851 Aug 27 02:27:05.890982 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 37/74] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:05.903592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-19360d42-dc0d-418e-9edc-08f30dbf3acd tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-340469890", "id": 1305434276, "os-flavor-access:is_public": "True"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:05.974771 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-19360d42-dc0d-418e-9edc-08f30dbf3acd tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.077603 Aug 27 02:27:05.979985 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 38/75] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:05 2022] POST /compute/v2.1/flavors => generated 413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:05.994253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-27bc4be4-f5d5-4fe3-b621-90a337415373 tempest-FlavorsAdminTestJSON-2141639228 tempest-FlavorsAdminTestJSON-2141639228-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:06.054172 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-27bc4be4-f5d5-4fe3-b621-90a337415373 tempest-FlavorsAdminTestJSON-2141639228 tempest-FlavorsAdminTestJSON-2141639228-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.065944 Aug 27 02:27:06.055145 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 38/76] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:05 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:06.081055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea569933-2711-4739-8115-1047ede17e5f tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:06.146429 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ea569933-2711-4739-8115-1047ede17e5f tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1305434276" status: 202 len: 0 microversion: 2.1 time: 0.074081 Aug 27 02:27:06.147524 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 39/77] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 02:27:06 2022] DELETE /compute/v2.1/flavors/1305434276 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:27:06.162402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-19116da3-61ae-45a7-b46b-3e2b894e871d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:06.247328 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-19116da3-61ae-45a7-b46b-3e2b894e871d tempest-FlavorsAdminTestJSON-1720352401 tempest-FlavorsAdminTestJSON-1720352401-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093353 Aug 27 02:27:06.262476 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 39/78] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:06.761542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04907140-62a9-4c5a-811b-cdb20c9a5541 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:06.769541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-04907140-62a9-4c5a-811b-cdb20c9a5541 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:06.826141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04907140-62a9-4c5a-811b-cdb20c9a5541 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:06.831044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04907140-62a9-4c5a-811b-cdb20c9a5541 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:06.843631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04907140-62a9-4c5a-811b-cdb20c9a5541 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:06.856821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04907140-62a9-4c5a-811b-cdb20c9a5541 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:06.860938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-02425e7b-67bc-42c8-92d1-11606e4b1b26 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:06.863726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04907140-62a9-4c5a-811b-cdb20c9a5541 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:06.866650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-02425e7b-67bc-42c8-92d1-11606e4b1b26 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:06.869886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04907140-62a9-4c5a-811b-cdb20c9a5541 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:06.894332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02425e7b-67bc-42c8-92d1-11606e4b1b26 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:06.901628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02425e7b-67bc-42c8-92d1-11606e4b1b26 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:06.902658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02425e7b-67bc-42c8-92d1-11606e4b1b26 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:06.903584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02425e7b-67bc-42c8-92d1-11606e4b1b26 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:06.906430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02425e7b-67bc-42c8-92d1-11606e4b1b26 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:06.907894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02425e7b-67bc-42c8-92d1-11606e4b1b26 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:07.594900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-04907140-62a9-4c5a-811b-cdb20c9a5541 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:07.632229 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-04907140-62a9-4c5a-811b-cdb20c9a5541 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1299 microversion: 2.1 time: 0.879483 Aug 27 02:27:07.653341 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 40/79] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:06 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1299 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:08.686365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b453c8ad-2e3e-4f51-933e-f3879cd05d5a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:08.687512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b453c8ad-2e3e-4f51-933e-f3879cd05d5a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:08.736848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b453c8ad-2e3e-4f51-933e-f3879cd05d5a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:08.737882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b453c8ad-2e3e-4f51-933e-f3879cd05d5a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:08.738691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b453c8ad-2e3e-4f51-933e-f3879cd05d5a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:08.746811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b453c8ad-2e3e-4f51-933e-f3879cd05d5a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:08.751275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b453c8ad-2e3e-4f51-933e-f3879cd05d5a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:08.752205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b453c8ad-2e3e-4f51-933e-f3879cd05d5a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:09.090669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b453c8ad-2e3e-4f51-933e-f3879cd05d5a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:09.100838 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b453c8ad-2e3e-4f51-933e-f3879cd05d5a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1299 microversion: 2.1 time: 0.423113 Aug 27 02:27:09.103531 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 41/80] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:08 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1299 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:09.161642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-02425e7b-67bc-42c8-92d1-11606e4b1b26 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:09.179904 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-02425e7b-67bc-42c8-92d1-11606e4b1b26 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 2.327113 Aug 27 02:27:09.183918 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 40/81] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:06 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:10.141539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e0cc12c2-6319-4386-b82c-7768382182e4 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:10.142421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e0cc12c2-6319-4386-b82c-7768382182e4 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:10.166199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:10.174333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0cc12c2-6319-4386-b82c-7768382182e4 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:10.175007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0cc12c2-6319-4386-b82c-7768382182e4 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:10.175573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0cc12c2-6319-4386-b82c-7768382182e4 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:10.176220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0cc12c2-6319-4386-b82c-7768382182e4 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:10.176689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0cc12c2-6319-4386-b82c-7768382182e4 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:10.177129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0cc12c2-6319-4386-b82c-7768382182e4 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:10.217449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2a2c26c-d0a3-44ac-b091-a9310634c13e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:10.218316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f2a2c26c-d0a3-44ac-b091-a9310634c13e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:10.240377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2a2c26c-d0a3-44ac-b091-a9310634c13e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:10.242796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2a2c26c-d0a3-44ac-b091-a9310634c13e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:10.245542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2a2c26c-d0a3-44ac-b091-a9310634c13e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:10.249935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2a2c26c-d0a3-44ac-b091-a9310634c13e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:10.251322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2a2c26c-d0a3-44ac-b091-a9310634c13e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:10.251776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2a2c26c-d0a3-44ac-b091-a9310634c13e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:10.423209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=10 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:10.670875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:11.541270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:11.693062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e0cc12c2-6319-4386-b82c-7768382182e4 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:11.716935 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e0cc12c2-6319-4386-b82c-7768382182e4 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 1.579833 Aug 27 02:27:11.719712 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 42/82] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:10 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:12.118183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f2a2c26c-d0a3-44ac-b091-a9310634c13e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:12.199329 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f2a2c26c-d0a3-44ac-b091-a9310634c13e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 1.978483 Aug 27 02:27:12.200504 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 41/83] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:10 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:12.474817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0e632302-57ec-4715-9cea-25d20bc63406 tempest-FlavorsV255TestJSON-1422665860 tempest-FlavorsV255TestJSON-1422665860-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1136535732", "id": 642801269, "os-flavor-access:is_public": "True"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:12.530552 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0e632302-57ec-4715-9cea-25d20bc63406 tempest-FlavorsV255TestJSON-1422665860 tempest-FlavorsV255TestJSON-1422665860-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.805530 Aug 27 02:27:12.536238 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 43/84] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:27:11 2022] POST /compute/v2.1/flavors => generated 446 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:27:12.747766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-76108548-2f7e-4090-bc41-a99947b2bfb6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:12.750631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-76108548-2f7e-4090-bc41-a99947b2bfb6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:12.801743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76108548-2f7e-4090-bc41-a99947b2bfb6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:12.808665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76108548-2f7e-4090-bc41-a99947b2bfb6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:12.810392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76108548-2f7e-4090-bc41-a99947b2bfb6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:12.811675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76108548-2f7e-4090-bc41-a99947b2bfb6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:12.816167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76108548-2f7e-4090-bc41-a99947b2bfb6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:12.820067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76108548-2f7e-4090-bc41-a99947b2bfb6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:14.235419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-20d052a9-28bb-4d58-985e-fe8839bcda24 tempest-FlavorsV255TestJSON-1028965158 tempest-FlavorsV255TestJSON-1028965158-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:14.253142 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-20d052a9-28bb-4d58-985e-fe8839bcda24 tempest-FlavorsV255TestJSON-1028965158 tempest-FlavorsV255TestJSON-1028965158-project] 10.222.0.99 "GET /compute/v2.1/flavors/642801269" status: 200 len: 446 microversion: 2.55 time: 1.705530 Aug 27 02:27:14.262177 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 42/85] 10.222.0.99 () {60 vars in 1196 bytes} [Sat Aug 27 02:27:12 2022] GET /compute/v2.1/flavors/642801269 => generated 446 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:27:14.268044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d65be86-0602-4821-90b4-e6042eb623d7 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:14.268686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1d65be86-0602-4821-90b4-e6042eb623d7 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:14.294259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d65be86-0602-4821-90b4-e6042eb623d7 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:14.300911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d65be86-0602-4821-90b4-e6042eb623d7 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:14.307188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d65be86-0602-4821-90b4-e6042eb623d7 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:14.310080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d65be86-0602-4821-90b4-e6042eb623d7 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:14.312136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d65be86-0602-4821-90b4-e6042eb623d7 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:14.312819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d65be86-0602-4821-90b4-e6042eb623d7 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:14.871674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-76108548-2f7e-4090-bc41-a99947b2bfb6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:14.902200 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-76108548-2f7e-4090-bc41-a99947b2bfb6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 2.163383 Aug 27 02:27:14.907352 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 44/86] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:12 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:14.934844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1c37d426-6a66-41a9-aee2-9f6cd2962439 tempest-FlavorsV255TestJSON-1422665860 tempest-FlavorsV255TestJSON-1422665860-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2c3970d0>, body: {"flavor": {"description": "new"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:15.056719 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1c37d426-6a66-41a9-aee2-9f6cd2962439 tempest-FlavorsV255TestJSON-1422665860 tempest-FlavorsV255TestJSON-1422665860-project-admin] 10.222.0.99 "PUT /compute/v2.1/flavors/642801269" status: 200 len: 447 microversion: 2.55 time: 0.137985 Aug 27 02:27:15.057452 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 45/87] 10.222.0.99 () {62 vars in 1216 bytes} [Sat Aug 27 02:27:14 2022] PUT /compute/v2.1/flavors/642801269 => generated 447 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:27:15.436696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-604729e3-90db-4ae2-8c41-161e58b72ebb tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-145793249", "ram": 512, "vcpus": 1, "disk": 10, "id": 875852111, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:15.510053 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-604729e3-90db-4ae2-8c41-161e58b72ebb tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.444340 Aug 27 02:27:15.518368 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 46/88] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:15 2022] POST /compute/v2.1/flavors => generated 412 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:15.537226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1d65be86-0602-4821-90b4-e6042eb623d7 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:15.549309 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1d65be86-0602-4821-90b4-e6042eb623d7 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 1.285859 Aug 27 02:27:15.554061 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 43/89] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:14 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:15.567548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-98982d45-7d89-44b5-9910-8b9079788622 tempest-FlavorsV255TestJSON-1028965158 tempest-FlavorsV255TestJSON-1028965158-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:15.607374 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-98982d45-7d89-44b5-9910-8b9079788622 tempest-FlavorsV255TestJSON-1028965158 tempest-FlavorsV255TestJSON-1028965158-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 6145 microversion: 2.55 time: 0.050028 Aug 27 02:27:15.608653 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 44/90] 10.222.0.99 () {60 vars in 1187 bytes} [Sat Aug 27 02:27:15 2022] GET /compute/v2.1/flavors/detail => generated 6145 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:15.740496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-134311db-cc5e-4854-b744-14df5d49895a req-4291994a-d34e-4627-9b54-f9ad7613c8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fdd496b-91e7-43df-94fc-9f56f3ed9859", "tag": "8967d981-1a96-4eb7-b90f-bc53bae047e0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:15.826326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-134311db-cc5e-4854-b744-14df5d49895a req-4291994a-d34e-4627-9b54-f9ad7613c8d3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.827426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-134311db-cc5e-4854-b744-14df5d49895a req-4291994a-d34e-4627-9b54-f9ad7613c8d3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.828390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-134311db-cc5e-4854-b744-14df5d49895a req-4291994a-d34e-4627-9b54-f9ad7613c8d3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.953746 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-134311db-cc5e-4854-b744-14df5d49895a req-4291994a-d34e-4627-9b54-f9ad7613c8d3 service nova] Creating event network-changed:8967d981-1a96-4eb7-b90f-bc53bae047e0 for instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 on n-h2-852084-5 Aug 27 02:27:15.954803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-134311db-cc5e-4854-b744-14df5d49895a req-4291994a-d34e-4627-9b54-f9ad7613c8d3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:27:15.954803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-134311db-cc5e-4854-b744-14df5d49895a req-4291994a-d34e-4627-9b54-f9ad7613c8d3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:27:15.955802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9be0b6ed-b21e-4a3c-a3ef-83734546b839 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.956272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9be0b6ed-b21e-4a3c-a3ef-83734546b839 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.956721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9be0b6ed-b21e-4a3c-a3ef-83734546b839 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.957466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9be0b6ed-b21e-4a3c-a3ef-83734546b839 None None] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:15.957954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9be0b6ed-b21e-4a3c-a3ef-83734546b839 None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:15.966846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9be0b6ed-b21e-4a3c-a3ef-83734546b839 None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:15.995210 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.compute.rpcapi [None req-9be0b6ed-b21e-4a3c-a3ef-83734546b839 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 02:27:15.995210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9be0b6ed-b21e-4a3c-a3ef-83734546b839 None None] Releasing lock "compute-rpcapi-router" {{(pid=122487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:27:16.029045 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9be0b6ed-b21e-4a3c-a3ef-83734546b839 None None] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.504401 Aug 27 02:27:16.029784 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 47/91] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:16.064401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b5f1969c-1510-485b-b737-e8e9874f01eb req-ae74ba60-fa5c-4ffb-aa89-6498b3c6592c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c964ffb-a951-4b4f-aebd-22f04a2caa23", "tag": "9acaf088-d039-4ce6-b81a-e45c13b411d1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:16.169822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5f1969c-1510-485b-b737-e8e9874f01eb req-ae74ba60-fa5c-4ffb-aa89-6498b3c6592c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.170703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5f1969c-1510-485b-b737-e8e9874f01eb req-ae74ba60-fa5c-4ffb-aa89-6498b3c6592c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.189958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5f1969c-1510-485b-b737-e8e9874f01eb req-ae74ba60-fa5c-4ffb-aa89-6498b3c6592c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.349445 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b5f1969c-1510-485b-b737-e8e9874f01eb req-ae74ba60-fa5c-4ffb-aa89-6498b3c6592c service nova] Creating event network-changed:9acaf088-d039-4ce6-b81a-e45c13b411d1 for instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 on n-h2-852084-5 Aug 27 02:27:16.356282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5f1969c-1510-485b-b737-e8e9874f01eb req-ae74ba60-fa5c-4ffb-aa89-6498b3c6592c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:27:16.356984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5f1969c-1510-485b-b737-e8e9874f01eb req-ae74ba60-fa5c-4ffb-aa89-6498b3c6592c service nova] Acquired lock "compute-rpcapi-router" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:27:16.379674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a898c94a-9703-41af-b6c2-e6269023a6a8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.380741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a898c94a-9703-41af-b6c2-e6269023a6a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.381528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a898c94a-9703-41af-b6c2-e6269023a6a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.397712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a898c94a-9703-41af-b6c2-e6269023a6a8 None None] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.398852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a898c94a-9703-41af-b6c2-e6269023a6a8 None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.404871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a898c94a-9703-41af-b6c2-e6269023a6a8 None None] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.412453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9bb46c4f-fb31-4c4a-aebf-785d150ddb1f tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:16.449029 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9bb46c4f-fb31-4c4a-aebf-785d150ddb1f tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] HTTP exception thrown: Flavor 875852111 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:27:16.458936 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.compute.rpcapi [None req-a898c94a-9703-41af-b6c2-e6269023a6a8 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9bb46c4f-fb31-4c4a-aebf-785d150ddb1f tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Request method failure captured: Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/flavors/875852111/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYD-k75pIclG1nQgGVJ84wJEGELRICz-h5U8ZeOw6Qt2XDKbnmRJryVDib1ym_f2uvkSVAB9NgeyVVI58y7qTMUN4JmBJW41vOzazCi62XAuI21_uFpNwD7i1LiAJsKMe9fkHb321VgqHvqtH3IorIYGSgPVLBdxGUly1WTNbAjWPbE Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 7d50242468e14c37988ca389e8ec10b3 Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:27:16.460184 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:27:16.462401 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7d50242468e14c37988ca389e8ec10b3"}]}] Aug 27 02:27:16.462401 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:16.462401 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 7d50242468e14c37988ca389e8ec10b3 Aug 27 02:27:16.462401 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:16.462401 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project Aug 27 02:27:16.462401 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:27:16.462401 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:27:16.462401 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 8d4b78a7ea404819a478d86051e6979f Aug 27 02:27:16.462401 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project Aug 27 02:27:16.462401 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:27:16.462401 n-d-852084-5 devstack@n-api.service[122487]: exception: Flavor 875852111 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'flavor_id': '875852111', 'id': 'hw:cpu_thread_policy'} Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 875852111 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:16.463500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.468382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:16.468382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:16.468382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:16.468382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:16.468382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:16.468382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 875852111 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:27:16.468382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.468382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9bb46c4f-fb31-4c4a-aebf-785d150ddb1f tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Returning 404 to user: Flavor 875852111 has no extra specs with key hw:cpu_thread_policy. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:16.468382 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9bb46c4f-fb31-4c4a-aebf-785d150ddb1f tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] 10.222.0.99 "GET /compute/v2.1/flavors/875852111/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.432043 Aug 27 02:27:16.468382 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 48/92] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:27:16 2022] GET /compute/v2.1/flavors/875852111/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:16.473520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a898c94a-9703-41af-b6c2-e6269023a6a8 None None] Releasing lock "compute-rpcapi-router" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:27:16.483451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-69c13e4f-715a-4999-944b-302d943cd1af tempest-FlavorsV255TestJSON-1028965158 tempest-FlavorsV255TestJSON-1028965158-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:16.533205 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a898c94a-9703-41af-b6c2-e6269023a6a8 None None] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.918232 Aug 27 02:27:16.535693 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 45/93] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:16.548377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9073f8b5-106a-4375-9f60-fc8a9dc74299 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:16.575340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9073f8b5-106a-4375-9f60-fc8a9dc74299 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:16.590293 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-69c13e4f-715a-4999-944b-302d943cd1af tempest-FlavorsV255TestJSON-1028965158 tempest-FlavorsV255TestJSON-1028965158-project] 10.222.0.99 "GET /compute/v2.1/flavors" status: 200 len: 3403 microversion: 2.55 time: 0.120515 Aug 27 02:27:16.591324 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 49/94] 10.222.0.99 () {60 vars in 1166 bytes} [Sat Aug 27 02:27:16 2022] GET /compute/v2.1/flavors => generated 3403 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:16.602185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b6369182-2051-4384-9b72-0b8144213e5e tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:16.620642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b6369182-2051-4384-9b72-0b8144213e5e tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '8d4b78a7ea404819a478d86051e6979f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d50242468e14c37988ca389e8ec10b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:16.627458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9073f8b5-106a-4375-9f60-fc8a9dc74299 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.635038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9073f8b5-106a-4375-9f60-fc8a9dc74299 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.636335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9073f8b5-106a-4375-9f60-fc8a9dc74299 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b6369182-2051-4384-9b72-0b8144213e5e tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Request method failure captured: Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/flavors/875852111/os-extra_specs HTTP/1.1 Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 66 Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYD-k75pIclG1nQgGVJ84wJEGELRICz-h5U8ZeOw6Qt2XDKbnmRJryVDib1ym_f2uvkSVAB9NgeyVVI58y7qTMUN4JmBJW41vOzazCi62XAuI21_uFpNwD7i1LiAJsKMe9fkHb321VgqHvqtH3IorIYGSgPVLBdxGUly1WTNbAjWPbE Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 7d50242468e14c37988ca389e8ec10b3 Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:27:16.640102 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7d50242468e14c37988ca389e8ec10b3"}]}] Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 7d50242468e14c37988ca389e8ec10b3 Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 8d4b78a7ea404819a478d86051e6979f Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 27 02:27:16.642288 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'flavor_id': '875852111', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:27:16.643793 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 27 02:27:16.646584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:16.649241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b6369182-2051-4384-9b72-0b8144213e5e tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:16.652078 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b6369182-2051-4384-9b72-0b8144213e5e tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] 10.222.0.99 "POST /compute/v2.1/flavors/875852111/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.052528 Aug 27 02:27:16.654475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9073f8b5-106a-4375-9f60-fc8a9dc74299 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.659372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9073f8b5-106a-4375-9f60-fc8a9dc74299 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.660839 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 50/95] 10.222.0.99 () {60 vars in 1221 bytes} [Sat Aug 27 02:27:16 2022] POST /compute/v2.1/flavors/875852111/os-extra_specs => generated 124 bytes in 64 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:16.663205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9073f8b5-106a-4375-9f60-fc8a9dc74299 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.682219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb2e91bf-64fc-4e6a-b0fe-19130b81fcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:16.684755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bb2e91bf-64fc-4e6a-b0fe-19130b81fcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:16.717018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2e91bf-64fc-4e6a-b0fe-19130b81fcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.720389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2e91bf-64fc-4e6a-b0fe-19130b81fcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.721525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2e91bf-64fc-4e6a-b0fe-19130b81fcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:16.723685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2e91bf-64fc-4e6a-b0fe-19130b81fcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:16.725267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2e91bf-64fc-4e6a-b0fe-19130b81fcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:16.728419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2e91bf-64fc-4e6a-b0fe-19130b81fcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:18.018427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9073f8b5-106a-4375-9f60-fc8a9dc74299 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:18.054056 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9073f8b5-106a-4375-9f60-fc8a9dc74299 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 1.513638 Aug 27 02:27:18.077553 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 46/96] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:16 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:18.097734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-15f31589-b7a9-42f9-980b-d133ec193e25 tempest-FlavorsV255TestJSON-1422665860 tempest-FlavorsV255TestJSON-1422665860-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:18.178433 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-15f31589-b7a9-42f9-980b-d133ec193e25 tempest-FlavorsV255TestJSON-1422665860 tempest-FlavorsV255TestJSON-1422665860-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/642801269" status: 202 len: 0 microversion: 2.55 time: 0.098193 Aug 27 02:27:18.179980 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 47/97] 10.222.0.99 () {60 vars in 1199 bytes} [Sat Aug 27 02:27:18 2022] DELETE /compute/v2.1/flavors/642801269 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:27:18.190550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-49aa52b7-30dc-4e8b-9a8e-b5e41f713794 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:18.263481 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-49aa52b7-30dc-4e8b-9a8e-b5e41f713794 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/875852111/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.079655 Aug 27 02:27:18.264793 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 48/98] 10.222.0.99 () {60 vars in 1221 bytes} [Sat Aug 27 02:27:18 2022] POST /compute/v2.1/flavors/875852111/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:27:18.589434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fa5bf912-fb53-49ca-add6-95505c0342d1 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Calling method '.version_select at 0x7f4d2b48fca0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:18.604618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa5bf912-fb53-49ca-add6-95505c0342d1 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:18.606082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa5bf912-fb53-49ca-add6-95505c0342d1 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:18.608221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa5bf912-fb53-49ca-add6-95505c0342d1 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:18.609980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa5bf912-fb53-49ca-add6-95505c0342d1 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:18.610692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa5bf912-fb53-49ca-add6-95505c0342d1 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:18.611868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa5bf912-fb53-49ca-add6-95505c0342d1 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:18.654272 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fa5bf912-fb53-49ca-add6-95505c0342d1 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.387283 Aug 27 02:27:18.655542 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 49/99] 10.222.0.99 () {58 vars in 1128 bytes} [Sat Aug 27 02:27:18 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:18.666474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1bab7c41-4d52-4996-a831-ea5d7d3af049 tempest-FlavorsV255TestJSON-1422665860 tempest-FlavorsV255TestJSON-1422665860-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:18.716792 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1bab7c41-4d52-4996-a831-ea5d7d3af049 tempest-FlavorsV255TestJSON-1422665860 tempest-FlavorsV255TestJSON-1422665860-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5708 microversion: 2.55 time: 0.059902 Aug 27 02:27:18.718594 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 50/100] 10.222.0.99 () {60 vars in 1187 bytes} [Sat Aug 27 02:27:18 2022] GET /compute/v2.1/flavors/detail => generated 5708 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:18.729831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bcbe780b-cd7e-4194-acd5-f235fe51b334 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:18.731726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bcbe780b-cd7e-4194-acd5-f235fe51b334 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '8d4b78a7ea404819a478d86051e6979f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d50242468e14c37988ca389e8ec10b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:18.747659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bb2e91bf-64fc-4e6a-b0fe-19130b81fcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bcbe780b-cd7e-4194-acd5-f235fe51b334 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Request method failure captured: Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYD-k75pIclG1nQgGVJ84wJEGELRICz-h5U8ZeOw6Qt2XDKbnmRJryVDib1ym_f2uvkSVAB9NgeyVVI58y7qTMUN4JmBJW41vOzazCi62XAuI21_uFpNwD7i1LiAJsKMe9fkHb321VgqHvqtH3IorIYGSgPVLBdxGUly1WTNbAjWPbE Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 7d50242468e14c37988ca389e8ec10b3 Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:27:18.783392 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:27:18.785078 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7d50242468e14c37988ca389e8ec10b3"}]}] Aug 27 02:27:18.785078 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:18.785078 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 7d50242468e14c37988ca389e8ec10b3 Aug 27 02:27:18.785078 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:18.785078 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project Aug 27 02:27:18.785078 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:27:18.785078 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:27:18.785078 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 8d4b78a7ea404819a478d86051e6979f Aug 27 02:27:18.785078 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project Aug 27 02:27:18.785078 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:27:18.785078 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'flavor_id': '875852111', 'id': 'hw:numa_nodes'} Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:27:18.785842 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 27 02:27:18.786816 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:18.788842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bcbe780b-cd7e-4194-acd5-f235fe51b334 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:18.790468 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bb2e91bf-64fc-4e6a-b0fe-19130b81fcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 2.114432 Aug 27 02:27:18.791469 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 51/101] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:16 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:18.797325 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bcbe780b-cd7e-4194-acd5-f235fe51b334 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] 10.222.0.99 "DELETE /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.075957 Aug 27 02:27:18.798518 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 51/102] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 02:27:18 2022] DELETE /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes => generated 124 bytes in 79 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:18.817516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-556c4c9a-f2d5-4cb5-84aa-5550088386d4 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Calling method '.version_select at 0x7f4d2b32a790>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:18.818063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ee11fce-61fa-42ff-ae3f-b2959c2e8f41 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:18.826714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-556c4c9a-f2d5-4cb5-84aa-5550088386d4 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:18.828677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-556c4c9a-f2d5-4cb5-84aa-5550088386d4 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:18.840376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-556c4c9a-f2d5-4cb5-84aa-5550088386d4 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:18.842679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-556c4c9a-f2d5-4cb5-84aa-5550088386d4 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:18.844364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-556c4c9a-f2d5-4cb5-84aa-5550088386d4 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:18.845826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-556c4c9a-f2d5-4cb5-84aa-5550088386d4 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:18.861436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=4,nova_api:SAVEPOINT=3,nova_api:RELEASE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:18.908498 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ee11fce-61fa-42ff-ae3f-b2959c2e8f41 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/875852111/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.101614 Aug 27 02:27:18.911265 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 52/103] 10.222.0.99 () {60 vars in 1221 bytes} [Sat Aug 27 02:27:18 2022] POST /compute/v2.1/flavors/875852111/os-extra_specs => generated 66 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:27:18.928384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-350e5e1c-2133-4ae3-a9e3-313077fcb7a7 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:18.946083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-350e5e1c-2133-4ae3-a9e3-313077fcb7a7 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '8d4b78a7ea404819a478d86051e6979f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d50242468e14c37988ca389e8ec10b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-350e5e1c-2133-4ae3-a9e3-313077fcb7a7 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Request method failure captured: Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 22 Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYD-k75pIclG1nQgGVJ84wJEGELRICz-h5U8ZeOw6Qt2XDKbnmRJryVDib1ym_f2uvkSVAB9NgeyVVI58y7qTMUN4JmBJW41vOzazCi62XAuI21_uFpNwD7i1LiAJsKMe9fkHb321VgqHvqtH3IorIYGSgPVLBdxGUly1WTNbAjWPbE Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 7d50242468e14c37988ca389e8ec10b3 Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:27:18.956102 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50242468e14c37988ca389e8ec10b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7d50242468e14c37988ca389e8ec10b3"}]}] Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 7d50242468e14c37988ca389e8ec10b3 Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 8d4b78a7ea404819a478d86051e6979f Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: {"hw:numa_nodes": "1"} Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:27:18.957748 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'flavor_id': '875852111', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:27:18.958523 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 27 02:27:18.959609 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:18.964628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-350e5e1c-2133-4ae3-a9e3-313077fcb7a7 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:18.965479 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-350e5e1c-2133-4ae3-a9e3-313077fcb7a7 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781 tempest-FlavorsExtraSpecsNegativeTestJSON-1236375781-project] 10.222.0.99 "PUT /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.046697 Aug 27 02:27:18.966151 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 53/104] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:27:18 2022] PUT /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes => generated 124 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:18.987198 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-556c4c9a-f2d5-4cb5-84aa-5550088386d4 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.194382 Aug 27 02:27:18.994517 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 52/105] 10.222.0.99 () {58 vars in 1139 bytes} [Sat Aug 27 02:27:18 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:19.003568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f3451b54-2fbb-40c4-a869-0fa3fc0efff2 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.014382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1d8aae56-55d1-4fc2-b354-e5148f5c1069 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Calling method '.version_select at 0x7f4d2b40d700>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.035028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d8aae56-55d1-4fc2-b354-e5148f5c1069 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.035566 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f3451b54-2fbb-40c4-a869-0fa3fc0efff2 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] HTTP exception thrown: Flavor 875852111 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:27:19.036230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d8aae56-55d1-4fc2-b354-e5148f5c1069 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.037151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d8aae56-55d1-4fc2-b354-e5148f5c1069 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f3451b54-2fbb-40c4-a869-0fa3fc0efff2 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Request method failure captured: Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/flavors/875852111/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYECvY7kQep5j2XNmgqmilQmUcHbNVgSYyN0mBaG0W3LCbTJwkSW-pHzjaGw_zutIyhSiRAP61_xb2J0GXh1AM3QhoZx_I68xYLaCqLAXI9GNgrKaP_yyllHxlgi88vL1mHo609DxPziutS7MBW6MoTUvP0tNLpYkKn00ZbrhgFtlp4 Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 5e627ac9db5548f7a30b87356400e0b5 Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:27:19.038123 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:27:19.039693 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5e627ac9db5548f7a30b87356400e0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5e627ac9db5548f7a30b87356400e0b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5e627ac9db5548f7a30b87356400e0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5e627ac9db5548f7a30b87356400e0b5"}]}] Aug 27 02:27:19.039693 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 Aug 27 02:27:19.039693 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 5e627ac9db5548f7a30b87356400e0b5 Aug 27 02:27:19.039693 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 Aug 27 02:27:19.039693 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin Aug 27 02:27:19.039693 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:27:19.039693 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:27:19.039693 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 485d6f9047414f129f12414b86fc61e2 Aug 27 02:27:19.039693 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin Aug 27 02:27:19.039693 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:27:19.039693 n-d-852084-5 devstack@n-api.service[122488]: exception: Flavor 875852111 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'flavor_id': '875852111', 'id': 'hw:cpu_thread_policy'} Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 875852111 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:19.040498 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.041592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.041592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.041592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.041592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:19.041592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:19.041592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 875852111 has no extra specs with key hw:cpu_thread_policy. Aug 27 02:27:19.041592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.042357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d8aae56-55d1-4fc2-b354-e5148f5c1069 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.043402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f3451b54-2fbb-40c4-a869-0fa3fc0efff2 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Returning 404 to user: Flavor 875852111 has no extra specs with key hw:cpu_thread_policy. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:19.044478 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f3451b54-2fbb-40c4-a869-0fa3fc0efff2 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/875852111/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.067657 Aug 27 02:27:19.046308 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 54/106] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:27:18 2022] DELETE /compute/v2.1/flavors/875852111/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:19.046828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d8aae56-55d1-4fc2-b354-e5148f5c1069 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.047875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d8aae56-55d1-4fc2-b354-e5148f5c1069 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.069509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be4abba6-a974-4cc0-b5ad-1242107adc27 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:19.085788 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-be4abba6-a974-4cc0-b5ad-1242107adc27 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be4abba6-a974-4cc0-b5ad-1242107adc27 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Request method failure captured: Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 27 Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYECvY7kQep5j2XNmgqmilQmUcHbNVgSYyN0mBaG0W3LCbTJwkSW-pHzjaGw_zutIyhSiRAP61_xb2J0GXh1AM3QhoZx_I68xYLaCqLAXI9GNgrKaP_yyllHxlgi88vL1mHo609DxPziutS7MBW6MoTUvP0tNLpYkKn00ZbrhgFtlp4 Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 5e627ac9db5548f7a30b87356400e0b5 Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:27:19.087865 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5e627ac9db5548f7a30b87356400e0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5e627ac9db5548f7a30b87356400e0b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5e627ac9db5548f7a30b87356400e0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5e627ac9db5548f7a30b87356400e0b5"}]}] Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 5e627ac9db5548f7a30b87356400e0b5 Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 485d6f9047414f129f12414b86fc61e2 Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: {"hw:cpu_policy": "shared"} Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:27:19.089103 n-d-852084-5 devstack@n-api.service[122488]: exception: Request body and URI mismatch Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'flavor_id': '875852111', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.089835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.090918 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:19.090918 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:19.090918 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 27 02:27:19.090918 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.090918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be4abba6-a974-4cc0-b5ad-1242107adc27 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:19.090918 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-be4abba6-a974-4cc0-b5ad-1242107adc27 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] 10.222.0.99 "PUT /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.035749 Aug 27 02:27:19.098268 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 55/107] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:27:19 2022] PUT /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes => generated 73 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:19.110083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad5270ac-2087-4884-b41f-910610a14ee7 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad5270ac-2087-4884-b41f-910610a14ee7 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Request method failure captured: Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 49 Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYECvY7kQep5j2XNmgqmilQmUcHbNVgSYyN0mBaG0W3LCbTJwkSW-pHzjaGw_zutIyhSiRAP61_xb2J0GXh1AM3QhoZx_I68xYLaCqLAXI9GNgrKaP_yyllHxlgi88vL1mHo609DxPziutS7MBW6MoTUvP0tNLpYkKn00ZbrhgFtlp4 Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 5e627ac9db5548f7a30b87356400e0b5 Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:27:19.135985 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5e627ac9db5548f7a30b87356400e0b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5e627ac9db5548f7a30b87356400e0b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5e627ac9db5548f7a30b87356400e0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5e627ac9db5548f7a30b87356400e0b5"}]}] Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 5e627ac9db5548f7a30b87356400e0b5 Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 485d6f9047414f129f12414b86fc61e2 Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 27 02:27:19.137238 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'flavor_id': '875852111', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance: Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 27 02:27:19.137854 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.138924 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:19.139858 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:19.139858 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:19.139858 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:27:19.139858 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:27:19.139858 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 27 02:27:19.139858 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:19.141096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=15,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:19.141177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad5270ac-2087-4884-b41f-910610a14ee7 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:19.144747 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad5270ac-2087-4884-b41f-910610a14ee7 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] 10.222.0.99 "PUT /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.043201 Aug 27 02:27:19.154021 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 56/108] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:27:19 2022] PUT /compute/v2.1/flavors/875852111/os-extra_specs/hw:numa_nodes => generated 117 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:27:19.178461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d116e82-08ce-4b38-9cb6-940d8a061b26 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.185552 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1d8aae56-55d1-4fc2-b354-e5148f5c1069 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.183295 Aug 27 02:27:19.187528 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 53/109] 10.222.0.99 () {58 vars in 1145 bytes} [Sat Aug 27 02:27:19 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:27:19.189909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d116e82-08ce-4b38-9cb6-940d8a061b26 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:19.196829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2b144cb1-2a2b-4966-a72f-17f85027598e tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.203759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d116e82-08ce-4b38-9cb6-940d8a061b26 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.204725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d116e82-08ce-4b38-9cb6-940d8a061b26 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.205628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d116e82-08ce-4b38-9cb6-940d8a061b26 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.207970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d116e82-08ce-4b38-9cb6-940d8a061b26 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.213506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d116e82-08ce-4b38-9cb6-940d8a061b26 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.214703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d116e82-08ce-4b38-9cb6-940d8a061b26 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.245633 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2b144cb1-2a2b-4966-a72f-17f85027598e tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/875852111" status: 202 len: 0 microversion: 2.1 time: 0.056787 Aug 27 02:27:19.246514 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 54/110] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:27:19 2022] DELETE /compute/v2.1/flavors/875852111 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:27:19.255020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c949b0f-1d04-417d-87ba-623e17fe19d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.293386 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4c949b0f-1d04-417d-87ba-623e17fe19d4 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693 tempest-FlavorsExtraSpecsNegativeTestJSON-1243719693-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042531 Aug 27 02:27:19.304067 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 55/111] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:19.646202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2d116e82-08ce-4b38-9cb6-940d8a061b26 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:19.657274 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2d116e82-08ce-4b38-9cb6-940d8a061b26 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 0.501787 Aug 27 02:27:19.658263 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 57/112] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:19 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:19.830104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-26347d35-5c6b-40a3-97f1-3342caf45f57 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:19.831003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26347d35-5c6b-40a3-97f1-3342caf45f57 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:19.859953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26347d35-5c6b-40a3-97f1-3342caf45f57 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.860466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26347d35-5c6b-40a3-97f1-3342caf45f57 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.860912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26347d35-5c6b-40a3-97f1-3342caf45f57 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:19.868463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26347d35-5c6b-40a3-97f1-3342caf45f57 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:19.869031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26347d35-5c6b-40a3-97f1-3342caf45f57 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:19.869649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26347d35-5c6b-40a3-97f1-3342caf45f57 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:20.507661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-26347d35-5c6b-40a3-97f1-3342caf45f57 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:20.524502 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-26347d35-5c6b-40a3-97f1-3342caf45f57 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 0.696307 Aug 27 02:27:20.539169 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 56/113] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:19 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:20.701979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3b128ca6-5745-4acd-a37d-6e8c9992c5a6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:20.705187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3b128ca6-5745-4acd-a37d-6e8c9992c5a6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:20.732391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b128ca6-5745-4acd-a37d-6e8c9992c5a6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:20.733244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b128ca6-5745-4acd-a37d-6e8c9992c5a6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:20.743923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b128ca6-5745-4acd-a37d-6e8c9992c5a6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:20.745199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b128ca6-5745-4acd-a37d-6e8c9992c5a6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:20.750154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b128ca6-5745-4acd-a37d-6e8c9992c5a6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:20.754354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b128ca6-5745-4acd-a37d-6e8c9992c5a6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.140426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3b128ca6-5745-4acd-a37d-6e8c9992c5a6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:21.162643 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3b128ca6-5745-4acd-a37d-6e8c9992c5a6 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 0.469344 Aug 27 02:27:21.197338 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 58/114] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:20 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:21.554792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1f0914a8-82a6-4372-950a-0b94fd9e8c0a tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:21.556251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1f0914a8-82a6-4372-950a-0b94fd9e8c0a tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:21.587442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f0914a8-82a6-4372-950a-0b94fd9e8c0a tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.588361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f0914a8-82a6-4372-950a-0b94fd9e8c0a tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.588837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f0914a8-82a6-4372-950a-0b94fd9e8c0a tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.589587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f0914a8-82a6-4372-950a-0b94fd9e8c0a tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:21.598845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f0914a8-82a6-4372-950a-0b94fd9e8c0a tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:21.605660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f0914a8-82a6-4372-950a-0b94fd9e8c0a tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:21.626256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=75 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:21.890621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1f0914a8-82a6-4372-950a-0b94fd9e8c0a tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:21.903027 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1f0914a8-82a6-4372-950a-0b94fd9e8c0a tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 0.359570 Aug 27 02:27:21.904408 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 57/115] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:21 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:22.215284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-63a621eb-ae8b-4ede-b11a-3ad935d1e092 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:22.223353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-63a621eb-ae8b-4ede-b11a-3ad935d1e092 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:22.283524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63a621eb-ae8b-4ede-b11a-3ad935d1e092 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:22.289562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63a621eb-ae8b-4ede-b11a-3ad935d1e092 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:22.291205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63a621eb-ae8b-4ede-b11a-3ad935d1e092 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:22.295593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63a621eb-ae8b-4ede-b11a-3ad935d1e092 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:22.297979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63a621eb-ae8b-4ede-b11a-3ad935d1e092 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:22.299064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63a621eb-ae8b-4ede-b11a-3ad935d1e092 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:22.929053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:22.935070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:22.958843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:22.959972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:22.966578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:22.968163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:22.969190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:22.970191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:23.426960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:23.437150 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 0.515862 Aug 27 02:27:23.442651 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 58/116] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:22 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:23.456169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-63a621eb-ae8b-4ede-b11a-3ad935d1e092 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:23.474987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=75 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:23.480387 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-63a621eb-ae8b-4ede-b11a-3ad935d1e092 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 1.275198 Aug 27 02:27:23.484884 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 59/117] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:22 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:24.385837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:24.387614 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5f930cd5-dfa4-4267-b56e-e40ca3fb8d48 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002134 Aug 27 02:27:24.396855 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 59/118] 10.222.0.99 () {56 vars in 886 bytes} [Sat Aug 27 02:27:24 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 02:27:24.479491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-df7cc461-27e3-491f-9dd9-f48b67db7d02 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:24.481245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-df7cc461-27e3-491f-9dd9-f48b67db7d02 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:24.524892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df7cc461-27e3-491f-9dd9-f48b67db7d02 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:24.526827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df7cc461-27e3-491f-9dd9-f48b67db7d02 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:24.527893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df7cc461-27e3-491f-9dd9-f48b67db7d02 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:24.528875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f627e62e-c059-4505-bfb0-66a27536b676 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:24.530328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f627e62e-c059-4505-bfb0-66a27536b676 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:24.530941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df7cc461-27e3-491f-9dd9-f48b67db7d02 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:24.531582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df7cc461-27e3-491f-9dd9-f48b67db7d02 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:24.532194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df7cc461-27e3-491f-9dd9-f48b67db7d02 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:24.569140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f627e62e-c059-4505-bfb0-66a27536b676 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:24.575123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f627e62e-c059-4505-bfb0-66a27536b676 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:24.580618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f627e62e-c059-4505-bfb0-66a27536b676 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:24.582681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f627e62e-c059-4505-bfb0-66a27536b676 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:24.585788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f627e62e-c059-4505-bfb0-66a27536b676 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:24.586783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f627e62e-c059-4505-bfb0-66a27536b676 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:24.909496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-df7cc461-27e3-491f-9dd9-f48b67db7d02 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:24.922138 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-df7cc461-27e3-491f-9dd9-f48b67db7d02 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 0.461632 Aug 27 02:27:24.923797 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 60/119] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:24 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:24.983601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f627e62e-c059-4505-bfb0-66a27536b676 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:24.995426 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f627e62e-c059-4505-bfb0-66a27536b676 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 0.475037 Aug 27 02:27:24.998786 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 60/120] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:24 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:25.961261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a891906-3416-4e7e-b89d-08e74c519576 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:25.968528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a891906-3416-4e7e-b89d-08e74c519576 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:26.000141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a891906-3416-4e7e-b89d-08e74c519576 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:26.001479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a891906-3416-4e7e-b89d-08e74c519576 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:26.004017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a891906-3416-4e7e-b89d-08e74c519576 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:26.014595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a891906-3416-4e7e-b89d-08e74c519576 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:26.015842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a891906-3416-4e7e-b89d-08e74c519576 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:26.019136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a891906-3416-4e7e-b89d-08e74c519576 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:26.020009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7d5ca6d5-2a0d-45b9-84c3-455e8080d274 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:26.020865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7d5ca6d5-2a0d-45b9-84c3-455e8080d274 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:26.034828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d5ca6d5-2a0d-45b9-84c3-455e8080d274 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:26.049590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d5ca6d5-2a0d-45b9-84c3-455e8080d274 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:26.050799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d5ca6d5-2a0d-45b9-84c3-455e8080d274 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:26.054686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d5ca6d5-2a0d-45b9-84c3-455e8080d274 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:26.055373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d5ca6d5-2a0d-45b9-84c3-455e8080d274 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:26.060202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d5ca6d5-2a0d-45b9-84c3-455e8080d274 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:26.405213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7d5ca6d5-2a0d-45b9-84c3-455e8080d274 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:26.418700 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7d5ca6d5-2a0d-45b9-84c3-455e8080d274 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 0.404202 Aug 27 02:27:26.419423 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 61/121] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:26 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:26.602108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7a891906-3416-4e7e-b89d-08e74c519576 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:26.615018 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a891906-3416-4e7e-b89d-08e74c519576 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 0.669861 Aug 27 02:27:26.616677 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 61/122] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:25 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:27.449175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d5aa87a-b7d0-40aa-9c9c-4930f3a546cf tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:27.451582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9d5aa87a-b7d0-40aa-9c9c-4930f3a546cf tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:27.495035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5aa87a-b7d0-40aa-9c9c-4930f3a546cf tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:27.496658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5aa87a-b7d0-40aa-9c9c-4930f3a546cf tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:27.499254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5aa87a-b7d0-40aa-9c9c-4930f3a546cf tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:27.501265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5aa87a-b7d0-40aa-9c9c-4930f3a546cf tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:27.505839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5aa87a-b7d0-40aa-9c9c-4930f3a546cf tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:27.508333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5aa87a-b7d0-40aa-9c9c-4930f3a546cf tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:28.006856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4b6776e-8dd0-4a3b-b26e-ee03719d7a4c tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:28.029131 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c4b6776e-8dd0-4a3b-b26e-ee03719d7a4c tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.871386 Aug 27 02:27:28.030293 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 62/123] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:27:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:27:28.047320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b07f6803-3809-42e1-aadf-7b4cad64a83b tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:28.049267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b07f6803-3809-42e1-aadf-7b4cad64a83b tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:28.060110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b07f6803-3809-42e1-aadf-7b4cad64a83b tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:28.060613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b07f6803-3809-42e1-aadf-7b4cad64a83b tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:28.064860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b07f6803-3809-42e1-aadf-7b4cad64a83b tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:28.067733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b07f6803-3809-42e1-aadf-7b4cad64a83b tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:28.074873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b07f6803-3809-42e1-aadf-7b4cad64a83b tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:28.075651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b07f6803-3809-42e1-aadf-7b4cad64a83b tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:28.076481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9d5aa87a-b7d0-40aa-9c9c-4930f3a546cf tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:28.089492 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9d5aa87a-b7d0-40aa-9c9c-4930f3a546cf tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 0.651959 Aug 27 02:27:28.102117 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 62/124] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:27 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:28.634574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:28.686838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b07f6803-3809-42e1-aadf-7b4cad64a83b tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:28.701060 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b07f6803-3809-42e1-aadf-7b4cad64a83b tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 0.669415 Aug 27 02:27:28.717595 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 63/125] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:28 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:28.907577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-828853bd-996d-41b6-a4e5-1aacb754e855 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1635025859", "id": 1367011820, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:28.947539 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-828853bd-996d-41b6-a4e5-1aacb754e855 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.853039 Aug 27 02:27:28.951717 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 63/126] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:28 2022] POST /compute/v2.1/flavors => generated 425 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:28.965382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-59eb4e9c-6806-43f6-bab6-63a644a8d8d1 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:28.979595 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-59eb4e9c-6806-43f6-bab6-63a644a8d8d1 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019781 Aug 27 02:27:28.980971 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 64/127] 10.222.0.99 () {58 vars in 1182 bytes} [Sat Aug 27 02:27:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:27:28.998025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4708881-53ab-4705-b7c4-b1befe6570d2 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1873627581", "id": 409630287, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:29.031142 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4708881-53ab-4705-b7c4-b1befe6570d2 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.039100 Aug 27 02:27:29.038281 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 65/128] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:28 2022] POST /compute/v2.1/flavors => generated 422 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:29.057555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f8584299-5ef3-4ed4-85b3-371489d750e4 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:29.074777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:29.102802 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f8584299-5ef3-4ed4-85b3-371489d750e4 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.058650 Aug 27 02:27:29.110328 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 66/129] 10.222.0.99 () {58 vars in 1182 bytes} [Sat Aug 27 02:27:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:27:29.130485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-acb042a2-dca4-4234-ac26-bf3439e5f2b5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:29.131852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-acb042a2-dca4-4234-ac26-bf3439e5f2b5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:29.145592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acb042a2-dca4-4234-ac26-bf3439e5f2b5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.146782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acb042a2-dca4-4234-ac26-bf3439e5f2b5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.148189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acb042a2-dca4-4234-ac26-bf3439e5f2b5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.149737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acb042a2-dca4-4234-ac26-bf3439e5f2b5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.151401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acb042a2-dca4-4234-ac26-bf3439e5f2b5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.152376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acb042a2-dca4-4234-ac26-bf3439e5f2b5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.282218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e4c129b2-9657-49ee-9c5c-8af63dc9b74e tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Calling method '.version_select at 0x7f4d2b49b670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:29.286932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4c129b2-9657-49ee-9c5c-8af63dc9b74e tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.288846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4c129b2-9657-49ee-9c5c-8af63dc9b74e tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.290497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4c129b2-9657-49ee-9c5c-8af63dc9b74e tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.337316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4c129b2-9657-49ee-9c5c-8af63dc9b74e tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.339521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4c129b2-9657-49ee-9c5c-8af63dc9b74e tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.340779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4c129b2-9657-49ee-9c5c-8af63dc9b74e tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.373850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4c129b2-9657-49ee-9c5c-8af63dc9b74e tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.374950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4c129b2-9657-49ee-9c5c-8af63dc9b74e tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.375952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4c129b2-9657-49ee-9c5c-8af63dc9b74e tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.401394 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e4c129b2-9657-49ee-9c5c-8af63dc9b74e tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.681216 Aug 27 02:27:29.401541 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 64/130] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:29.418164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ef215c08-112b-4fa5-9b27-0e977c9927d7 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Action: 'create', calling method: .version_select at 0x7f4d2b483040>, body: {"keypair": {"name": "tempest-keypair-1481464958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdMlrgtt8ePPSU41r5oZeG8Nc9q5KyTWhF+ipOwbgrygBVh73FwDk9dCRAgF86fxILanq5MCxKSYmkeIzcPj8aWkGZgmxZkN3ecMr7UM49jhNjuz5q1TCpRrj3ljM4sdg=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:29.451414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ef215c08-112b-4fa5-9b27-0e977c9927d7 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Getting quotas for project e39f8ef6c2bb4281b252ae6827d58655. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:27:29.464903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ef215c08-112b-4fa5-9b27-0e977c9927d7 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Getting quotas for user fcc5a5e997de4edabe7b5883cc998dbf and project e39f8ef6c2bb4281b252ae6827d58655. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:27:29.510091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-acb042a2-dca4-4234-ac26-bf3439e5f2b5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:29.523619 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-acb042a2-dca4-4234-ac26-bf3439e5f2b5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 0.411413 Aug 27 02:27:29.526372 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 67/131] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:29 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:29.537789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Calling method '.version_select at 0x7f4d2b323b80>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:29.551981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) {{(pid=122488) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 27 02:27:29.555832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.558604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.560555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.577980 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ef215c08-112b-4fa5-9b27-0e977c9927d7 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.175157 Aug 27 02:27:29.596879 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 65/132] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:27:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:29.623525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.626532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.628016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.665988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.666828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.666828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.679277 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bbc3b43c-22c9-4b92-9e2a-44fa475a9b24 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.149080 Aug 27 02:27:29.681414 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 68/133] 10.222.0.99 () {58 vars in 1167 bytes} [Sat Aug 27 02:27:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:29.699042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d5f964c8-97f3-45ec-b1cb-8313afc3478d tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Calling method '.version_select at 0x7f4d2b2a9f70>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:29.700949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5f964c8-97f3-45ec-b1cb-8313afc3478d tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.701453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5f964c8-97f3-45ec-b1cb-8313afc3478d tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.701937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5f964c8-97f3-45ec-b1cb-8313afc3478d tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.724677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5dc60d59-2160-4618-b5db-4633f35b2ea1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:29.726123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5dc60d59-2160-4618-b5db-4633f35b2ea1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:29.740778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5f964c8-97f3-45ec-b1cb-8313afc3478d tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.741285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5f964c8-97f3-45ec-b1cb-8313afc3478d tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.741945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5f964c8-97f3-45ec-b1cb-8313afc3478d tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.744657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dc60d59-2160-4618-b5db-4633f35b2ea1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.745192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dc60d59-2160-4618-b5db-4633f35b2ea1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.745720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dc60d59-2160-4618-b5db-4633f35b2ea1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.746494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dc60d59-2160-4618-b5db-4633f35b2ea1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.748499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dc60d59-2160-4618-b5db-4633f35b2ea1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.752175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dc60d59-2160-4618-b5db-4633f35b2ea1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.769413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5f964c8-97f3-45ec-b1cb-8313afc3478d tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.770236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5f964c8-97f3-45ec-b1cb-8313afc3478d tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.770882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5f964c8-97f3-45ec-b1cb-8313afc3478d tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.784725 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d5f964c8-97f3-45ec-b1cb-8313afc3478d tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.089422 Aug 27 02:27:29.794780 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 66/134] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:29.800239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b10ae056-6851-4804-81fc-7459a5981d6c tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Calling method '.version_select at 0x7f4d2b2cadc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:29.810136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b10ae056-6851-4804-81fc-7459a5981d6c tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.814666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b10ae056-6851-4804-81fc-7459a5981d6c tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.815411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b10ae056-6851-4804-81fc-7459a5981d6c tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.862299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b10ae056-6851-4804-81fc-7459a5981d6c tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.864912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b10ae056-6851-4804-81fc-7459a5981d6c tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.869854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b10ae056-6851-4804-81fc-7459a5981d6c tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.902184 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b10ae056-6851-4804-81fc-7459a5981d6c tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.105531 Aug 27 02:27:29.904345 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 67/135] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:29 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:29.937742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d4179cc4-9f40-444a-b1b6-97964b8f28d7 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Calling method '.version_select at 0x7f4d2b3ceb80>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:29.942894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4179cc4-9f40-444a-b1b6-97964b8f28d7 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:29.944002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4179cc4-9f40-444a-b1b6-97964b8f28d7 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:29.945002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4179cc4-9f40-444a-b1b6-97964b8f28d7 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:29.993196 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d4179cc4-9f40-444a-b1b6-97964b8f28d7 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.066946 Aug 27 02:27:29.995082 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 68/136] 10.222.0.99 () {58 vars in 1179 bytes} [Sat Aug 27 02:27:29 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:30.016058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a5852c5-1634-4c8a-8b66-957c36a13c89 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Calling method '.version_select at 0x7f4d2bd9adc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:30.032661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a5852c5-1634-4c8a-8b66-957c36a13c89 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.035510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a5852c5-1634-4c8a-8b66-957c36a13c89 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.036830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a5852c5-1634-4c8a-8b66-957c36a13c89 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.068769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a5852c5-1634-4c8a-8b66-957c36a13c89 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.072556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a5852c5-1634-4c8a-8b66-957c36a13c89 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.073889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a5852c5-1634-4c8a-8b66-957c36a13c89 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.109092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a5852c5-1634-4c8a-8b66-957c36a13c89 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.114863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a5852c5-1634-4c8a-8b66-957c36a13c89 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.116043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a5852c5-1634-4c8a-8b66-957c36a13c89 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.132664 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a5852c5-1634-4c8a-8b66-957c36a13c89 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.126974 Aug 27 02:27:30.135850 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 69/137] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:27:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:30.152452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b47d173c-4c2f-492e-9091-df0969f0ee84 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Calling method '.version_select at 0x7f4d2b2caee0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:30.167306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b47d173c-4c2f-492e-9091-df0969f0ee84 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.168731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b47d173c-4c2f-492e-9091-df0969f0ee84 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.170384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b47d173c-4c2f-492e-9091-df0969f0ee84 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.210089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b47d173c-4c2f-492e-9091-df0969f0ee84 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.210661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b47d173c-4c2f-492e-9091-df0969f0ee84 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.211136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b47d173c-4c2f-492e-9091-df0969f0ee84 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.237240 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b47d173c-4c2f-492e-9091-df0969f0ee84 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.089178 Aug 27 02:27:30.241423 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 70/138] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:30 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:30.261189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7abc540-cb91-4bc3-879b-594607e7f151 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Calling method '.version_select at 0x7f4d2b2caaf0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:30.263898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7abc540-cb91-4bc3-879b-594607e7f151 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.269808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7abc540-cb91-4bc3-879b-594607e7f151 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.270277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7abc540-cb91-4bc3-879b-594607e7f151 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.277049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5dc60d59-2160-4618-b5db-4633f35b2ea1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:30.307707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7abc540-cb91-4bc3-879b-594607e7f151 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.312541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7abc540-cb91-4bc3-879b-594607e7f151 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.313077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7abc540-cb91-4bc3-879b-594607e7f151 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.325902 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c7abc540-cb91-4bc3-879b-594607e7f151 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.073418 Aug 27 02:27:30.326533 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 71/139] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:30 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:30.333381 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5dc60d59-2160-4618-b5db-4633f35b2ea1 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 0.613755 Aug 27 02:27:30.346337 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 69/140] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:29 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:30.346632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-59611faa-14d6-4cc3-95b9-5815bcb8bfe5 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Calling method '.version_select at 0x7f4d2b3b0280>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:30.349864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59611faa-14d6-4cc3-95b9-5815bcb8bfe5 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.354386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59611faa-14d6-4cc3-95b9-5815bcb8bfe5 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.355096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59611faa-14d6-4cc3-95b9-5815bcb8bfe5 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.380826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59611faa-14d6-4cc3-95b9-5815bcb8bfe5 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.381595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59611faa-14d6-4cc3-95b9-5815bcb8bfe5 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.382880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59611faa-14d6-4cc3-95b9-5815bcb8bfe5 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.423623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59611faa-14d6-4cc3-95b9-5815bcb8bfe5 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.424299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59611faa-14d6-4cc3-95b9-5815bcb8bfe5 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.424897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59611faa-14d6-4cc3-95b9-5815bcb8bfe5 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.482834 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-59611faa-14d6-4cc3-95b9-5815bcb8bfe5 tempest-HypervisorAdminTestJSON-516748611 tempest-HypervisorAdminTestJSON-516748611-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.141135 Aug 27 02:27:30.483755 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 72/141] 10.222.0.99 () {58 vars in 1173 bytes} [Sat Aug 27 02:27:30 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:30.547835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4969420c-57a3-4621-9ba8-2ef9db09500a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:30.548923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4969420c-57a3-4621-9ba8-2ef9db09500a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:30.566254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4969420c-57a3-4621-9ba8-2ef9db09500a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.568525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4969420c-57a3-4621-9ba8-2ef9db09500a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.570669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4969420c-57a3-4621-9ba8-2ef9db09500a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:30.574242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4969420c-57a3-4621-9ba8-2ef9db09500a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:30.575444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4969420c-57a3-4621-9ba8-2ef9db09500a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:30.577425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4969420c-57a3-4621-9ba8-2ef9db09500a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:31.133210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4969420c-57a3-4621-9ba8-2ef9db09500a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:31.150133 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4969420c-57a3-4621-9ba8-2ef9db09500a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 0.603532 Aug 27 02:27:31.151017 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 70/142] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:30 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:31.385826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c099964b-10e8-4f4f-81f4-49d706891608 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:31.391529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c099964b-10e8-4f4f-81f4-49d706891608 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:31.414230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c099964b-10e8-4f4f-81f4-49d706891608 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:31.415575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c099964b-10e8-4f4f-81f4-49d706891608 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:31.420588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c099964b-10e8-4f4f-81f4-49d706891608 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:31.421876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c099964b-10e8-4f4f-81f4-49d706891608 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:31.422555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c099964b-10e8-4f4f-81f4-49d706891608 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:31.426236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c099964b-10e8-4f4f-81f4-49d706891608 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:32.044493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-512726280", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:32.122890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c099964b-10e8-4f4f-81f4-49d706891608 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:32.143864 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c099964b-10e8-4f4f-81f4-49d706891608 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 0.775592 Aug 27 02:27:32.157718 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 73/143] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:31 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:32.177068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a1c7f294-88fa-48d1-af7c-5d1269ac9bd8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:32.177908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a1c7f294-88fa-48d1-af7c-5d1269ac9bd8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:32.198479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c7f294-88fa-48d1-af7c-5d1269ac9bd8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:32.198990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c7f294-88fa-48d1-af7c-5d1269ac9bd8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:32.209219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c7f294-88fa-48d1-af7c-5d1269ac9bd8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:32.210844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c7f294-88fa-48d1-af7c-5d1269ac9bd8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:32.215623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c7f294-88fa-48d1-af7c-5d1269ac9bd8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:32.221414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c7f294-88fa-48d1-af7c-5d1269ac9bd8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:32.273339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:27:32.855387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a1c7f294-88fa-48d1-af7c-5d1269ac9bd8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:32.868590 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a1c7f294-88fa-48d1-af7c-5d1269ac9bd8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 0.696258 Aug 27 02:27:32.883421 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 74/144] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:32 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:32.888354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:27:32.889286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:27:32.891405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:27:32.892330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:27:32.898920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:27:32.947241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:32.948069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:32.956078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:32.958001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:32.970715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:32.972219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:33.061603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0972e6f8-3141-4bfd-b69b-ae22f019d7c0 req-11102fbf-1c9f-4119-a8a9-48f940dd037f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c964ffb-a951-4b4f-aebd-22f04a2caa23", "name": "network-vif-plugged", "status": "completed", "tag": "9acaf088-d039-4ce6-b81a-e45c13b411d1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:33.064688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Getting quotas for project 11206a74aa524b8280a190536badcf2d. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:27:33.072194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Getting quotas for user c52668ee6ecd4444a580239578b4e4ab and project 11206a74aa524b8280a190536badcf2d. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:27:33.092794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0972e6f8-3141-4bfd-b69b-ae22f019d7c0 req-11102fbf-1c9f-4119-a8a9-48f940dd037f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:33.093388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0972e6f8-3141-4bfd-b69b-ae22f019d7c0 req-11102fbf-1c9f-4119-a8a9-48f940dd037f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:33.094003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0972e6f8-3141-4bfd-b69b-ae22f019d7c0 req-11102fbf-1c9f-4119-a8a9-48f940dd037f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:33.101704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:27:33.106370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:27:33.126169 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0972e6f8-3141-4bfd-b69b-ae22f019d7c0 req-11102fbf-1c9f-4119-a8a9-48f940dd037f service nova] Creating event network-vif-plugged:9acaf088-d039-4ce6-b81a-e45c13b411d1 for instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 on n-h2-852084-5 Aug 27 02:27:33.144713 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0972e6f8-3141-4bfd-b69b-ae22f019d7c0 req-11102fbf-1c9f-4119-a8a9-48f940dd037f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259453 Aug 27 02:27:33.154030 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 75/145] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:33.182781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1c958210-9322-49e4-a9a8-54c6b365a49f tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:33.186324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1c958210-9322-49e4-a9a8-54c6b365a49f tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:33.202540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c958210-9322-49e4-a9a8-54c6b365a49f tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:33.217916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c958210-9322-49e4-a9a8-54c6b365a49f tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:33.222646 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8d74fdf9-cf8d-43f9-8d8a-fb24745b9c71 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553047 Aug 27 02:27:33.222930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c958210-9322-49e4-a9a8-54c6b365a49f tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:33.224966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c958210-9322-49e4-a9a8-54c6b365a49f tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:33.226619 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 71/146] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:27:33.229548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c958210-9322-49e4-a9a8-54c6b365a49f tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:33.230415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c958210-9322-49e4-a9a8-54c6b365a49f tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:33.251745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ecc9cb20-09eb-4308-b9da-efdf4e11594a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:33.259954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ecc9cb20-09eb-4308-b9da-efdf4e11594a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:33.673812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ecc9cb20-09eb-4308-b9da-efdf4e11594a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:33.702186 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ecc9cb20-09eb-4308-b9da-efdf4e11594a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1218 microversion: 2.1 time: 0.469786 Aug 27 02:27:33.702802 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 72/147] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:33 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1218 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:33.896607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-df9a30a1-c77b-466b-90ad-bf41da8ecd6a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:33.897517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-df9a30a1-c77b-466b-90ad-bf41da8ecd6a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:33.928790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df9a30a1-c77b-466b-90ad-bf41da8ecd6a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:33.929376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df9a30a1-c77b-466b-90ad-bf41da8ecd6a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:33.930079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df9a30a1-c77b-466b-90ad-bf41da8ecd6a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:33.931501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df9a30a1-c77b-466b-90ad-bf41da8ecd6a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:33.932175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df9a30a1-c77b-466b-90ad-bf41da8ecd6a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:33.932754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df9a30a1-c77b-466b-90ad-bf41da8ecd6a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:34.153148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1c958210-9322-49e4-a9a8-54c6b365a49f tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:34.169511 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1c958210-9322-49e4-a9a8-54c6b365a49f tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 1.002163 Aug 27 02:27:34.170143 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 76/148] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:33 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:34.728159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9d571551-c570-4dda-abb9-72cfb31a96f1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:34.732877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9d571551-c570-4dda-abb9-72cfb31a96f1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:34.775260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d571551-c570-4dda-abb9-72cfb31a96f1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:34.787883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d571551-c570-4dda-abb9-72cfb31a96f1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:34.787883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d571551-c570-4dda-abb9-72cfb31a96f1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:34.787883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d571551-c570-4dda-abb9-72cfb31a96f1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:34.787883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d571551-c570-4dda-abb9-72cfb31a96f1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:34.788219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d571551-c570-4dda-abb9-72cfb31a96f1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:34.855280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-df9a30a1-c77b-466b-90ad-bf41da8ecd6a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:34.895938 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-df9a30a1-c77b-466b-90ad-bf41da8ecd6a tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 1.004653 Aug 27 02:27:34.897194 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 73/149] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:33 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:35.002519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9d571551-c570-4dda-abb9-72cfb31a96f1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:35.065517 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9d571551-c570-4dda-abb9-72cfb31a96f1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1214 microversion: 2.1 time: 0.342961 Aug 27 02:27:35.069723 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 77/150] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:34 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1214 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:35.201588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-765745392", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "409630287", "adminPass": "***", "networks": [{"uuid": "7623a25f-aace-4d3d-a290-09343a63df72"}], "security_groups": [{"name": "tempest-securitygroup--143361877"}], "key_name": "tempest-keypair-1481464958", "user_data": "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:35.213005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bf5dc090-2f15-4fc8-9cf2-6502552ce290 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:35.216783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bf5dc090-2f15-4fc8-9cf2-6502552ce290 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:35.261277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf5dc090-2f15-4fc8-9cf2-6502552ce290 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:35.263489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf5dc090-2f15-4fc8-9cf2-6502552ce290 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:35.264442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf5dc090-2f15-4fc8-9cf2-6502552ce290 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:35.265911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf5dc090-2f15-4fc8-9cf2-6502552ce290 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:35.266986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf5dc090-2f15-4fc8-9cf2-6502552ce290 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:35.267973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf5dc090-2f15-4fc8-9cf2-6502552ce290 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:35.848396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] validate_networks() for [('7623a25f-aace-4d3d-a290-09343a63df72', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:27:35.995800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bf5dc090-2f15-4fc8-9cf2-6502552ce290 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:36.035333 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bf5dc090-2f15-4fc8-9cf2-6502552ce290 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1339 microversion: 2.1 time: 0.846106 Aug 27 02:27:36.067123 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 78/151] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:35 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1339 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:36.079055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3531139a-2604-4e61-9243-04fa79ce0d95 req-ac0f63cc-eb19-4319-9e94-0ed4029d2b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fdd496b-91e7-43df-94fc-9f56f3ed9859", "name": "network-vif-plugged", "status": "completed", "tag": "8967d981-1a96-4eb7-b90f-bc53bae047e0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:36.100254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3531139a-2604-4e61-9243-04fa79ce0d95 req-ac0f63cc-eb19-4319-9e94-0ed4029d2b5d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:36.101079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3531139a-2604-4e61-9243-04fa79ce0d95 req-ac0f63cc-eb19-4319-9e94-0ed4029d2b5d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:36.101862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3531139a-2604-4e61-9243-04fa79ce0d95 req-ac0f63cc-eb19-4319-9e94-0ed4029d2b5d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:36.117155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:36.121808 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3531139a-2604-4e61-9243-04fa79ce0d95 req-ac0f63cc-eb19-4319-9e94-0ed4029d2b5d service nova] Creating event network-vif-plugged:8967d981-1a96-4eb7-b90f-bc53bae047e0 for instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 on n-h2-852084-5 Aug 27 02:27:36.131298 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3531139a-2604-4e61-9243-04fa79ce0d95 req-ac0f63cc-eb19-4319-9e94-0ed4029d2b5d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055897 Aug 27 02:27:36.132232 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 79/152] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:36.145610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2d2ca84e-4be7-4f59-b06e-f74641c4dedb tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:36.153097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2d2ca84e-4be7-4f59-b06e-f74641c4dedb tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:36.174109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d2ca84e-4be7-4f59-b06e-f74641c4dedb tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:36.177983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d2ca84e-4be7-4f59-b06e-f74641c4dedb tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:36.179366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d2ca84e-4be7-4f59-b06e-f74641c4dedb tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:36.184288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d2ca84e-4be7-4f59-b06e-f74641c4dedb tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:36.185242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d2ca84e-4be7-4f59-b06e-f74641c4dedb tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:36.186013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d2ca84e-4be7-4f59-b06e-f74641c4dedb tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:37.320254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2d2ca84e-4be7-4f59-b06e-f74641c4dedb tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:37.336649 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2d2ca84e-4be7-4f59-b06e-f74641c4dedb tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1341 microversion: 2.1 time: 1.202724 Aug 27 02:27:37.337654 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 80/153] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:36 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1341 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:37.350616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-61731b75-4ce5-49ed-9e5f-d7a179bbf213 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:37.354678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-61731b75-4ce5-49ed-9e5f-d7a179bbf213 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:37.373435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61731b75-4ce5-49ed-9e5f-d7a179bbf213 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:37.376691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61731b75-4ce5-49ed-9e5f-d7a179bbf213 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:37.377141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61731b75-4ce5-49ed-9e5f-d7a179bbf213 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:37.377935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61731b75-4ce5-49ed-9e5f-d7a179bbf213 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:37.378411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61731b75-4ce5-49ed-9e5f-d7a179bbf213 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:37.378854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61731b75-4ce5-49ed-9e5f-d7a179bbf213 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:37.538117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-61731b75-4ce5-49ed-9e5f-d7a179bbf213 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:37.552396 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-61731b75-4ce5-49ed-9e5f-d7a179bbf213 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1276 microversion: 2.1 time: 0.211441 Aug 27 02:27:37.555451 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 81/154] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:37 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:37.578880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7bd65bac-c0c1-4b3f-9720-c0e95300ea73 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:37.580738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7bd65bac-c0c1-4b3f-9720-c0e95300ea73 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:37.597619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bd65bac-c0c1-4b3f-9720-c0e95300ea73 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:37.599603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bd65bac-c0c1-4b3f-9720-c0e95300ea73 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:37.601338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bd65bac-c0c1-4b3f-9720-c0e95300ea73 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:37.603482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bd65bac-c0c1-4b3f-9720-c0e95300ea73 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:37.604711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bd65bac-c0c1-4b3f-9720-c0e95300ea73 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:37.605714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bd65bac-c0c1-4b3f-9720-c0e95300ea73 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:37.971302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7bd65bac-c0c1-4b3f-9720-c0e95300ea73 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:37.985904 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7bd65bac-c0c1-4b3f-9720-c0e95300ea73 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1488 microversion: 2.1 time: 0.428331 Aug 27 02:27:37.986530 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 82/155] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:37 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1488 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:38.031893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-600060ef-d3a1-4c86-8df4-cfa4552205fd tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:38.033565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-600060ef-d3a1-4c86-8df4-cfa4552205fd tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:38.063243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-600060ef-d3a1-4c86-8df4-cfa4552205fd tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:38.071557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-600060ef-d3a1-4c86-8df4-cfa4552205fd tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:38.073527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-600060ef-d3a1-4c86-8df4-cfa4552205fd tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:38.075073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-600060ef-d3a1-4c86-8df4-cfa4552205fd tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:38.076240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-600060ef-d3a1-4c86-8df4-cfa4552205fd tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:38.077328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-600060ef-d3a1-4c86-8df4-cfa4552205fd tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:38.588574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:27:38.589842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:27:38.591351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:27:38.592059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:27:38.592991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:27:38.626666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:38.628080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:38.628877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:38.629812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:38.630396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:38.631174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:38.686277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Getting quotas for project e39f8ef6c2bb4281b252ae6827d58655. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:27:38.704291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Getting quotas for user fcc5a5e997de4edabe7b5883cc998dbf and project e39f8ef6c2bb4281b252ae6827d58655. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:27:38.749499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:27:38.786460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:27:38.900975 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-22291e28-3872-443b-b04b-8fbe58302b54 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.724268 Aug 27 02:27:38.903659 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 74/156] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 3729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:27:38.912303 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-600060ef-d3a1-4c86-8df4-cfa4552205fd tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1639 microversion: 2.1 time: 0.882972 Aug 27 02:27:38.912303 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 83/157] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:38 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1639 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:38.923572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4d41850f-09f4-4266-ab93-16c49ee8cecc tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:38.924246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4d41850f-09f4-4266-ab93-16c49ee8cecc tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:38.939624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d41850f-09f4-4266-ab93-16c49ee8cecc tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:38.940688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d41850f-09f4-4266-ab93-16c49ee8cecc tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:38.943195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d41850f-09f4-4266-ab93-16c49ee8cecc tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:38.945835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d41850f-09f4-4266-ab93-16c49ee8cecc tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:38.948019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d41850f-09f4-4266-ab93-16c49ee8cecc tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:38.949234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d41850f-09f4-4266-ab93-16c49ee8cecc tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:38.956193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e7b8e246-3956-41b3-95cd-af1139c55eed tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:38.958418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e7b8e246-3956-41b3-95cd-af1139c55eed tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:38.998192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7b8e246-3956-41b3-95cd-af1139c55eed tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:38.999588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7b8e246-3956-41b3-95cd-af1139c55eed tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:39.000727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7b8e246-3956-41b3-95cd-af1139c55eed tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:39.005123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7b8e246-3956-41b3-95cd-af1139c55eed tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:39.005883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7b8e246-3956-41b3-95cd-af1139c55eed tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:39.006715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7b8e246-3956-41b3-95cd-af1139c55eed tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:39.363527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4d41850f-09f4-4266-ab93-16c49ee8cecc tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:39.399343 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4d41850f-09f4-4266-ab93-16c49ee8cecc tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1491 microversion: 2.1 time: 0.478046 Aug 27 02:27:39.409947 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 75/158] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:38 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1491 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:39.414318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e7b8e246-3956-41b3-95cd-af1139c55eed tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:39.437184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-26c1742e-a309-454c-8473-24aaa00c50a6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:39.438396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-26c1742e-a309-454c-8473-24aaa00c50a6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:39.447330 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e7b8e246-3956-41b3-95cd-af1139c55eed tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1276 microversion: 2.1 time: 0.539847 Aug 27 02:27:39.449082 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 84/159] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:38 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1276 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:39.497519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-847c753a-9ddd-4f90-b34f-0eea2784dcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:39.498840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-847c753a-9ddd-4f90-b34f-0eea2784dcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:39.528117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:39.533980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-847c753a-9ddd-4f90-b34f-0eea2784dcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:39.538942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-847c753a-9ddd-4f90-b34f-0eea2784dcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:39.540988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-847c753a-9ddd-4f90-b34f-0eea2784dcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:39.545525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-847c753a-9ddd-4f90-b34f-0eea2784dcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:39.546536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-847c753a-9ddd-4f90-b34f-0eea2784dcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:39.547321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-847c753a-9ddd-4f90-b34f-0eea2784dcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:39.597611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-26c1742e-a309-454c-8473-24aaa00c50a6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:39.622683 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-26c1742e-a309-454c-8473-24aaa00c50a6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1262 microversion: 2.1 time: 0.206524 Aug 27 02:27:39.637736 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 76/160] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:39 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1262 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:39.694681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-847c753a-9ddd-4f90-b34f-0eea2784dcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:27:40.153204 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-847c753a-9ddd-4f90-b34f-0eea2784dcec tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 204 len: 0 microversion: 2.1 time: 0.701938 Aug 27 02:27:40.153962 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 85/161] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:39 2022] DELETE /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:27:40.179230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f12457e7-f3d0-4b0a-a495-7402fbd6aef5 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:40.196347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f12457e7-f3d0-4b0a-a495-7402fbd6aef5 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:40.220109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f12457e7-f3d0-4b0a-a495-7402fbd6aef5 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:40.223116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f12457e7-f3d0-4b0a-a495-7402fbd6aef5 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:40.223619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f12457e7-f3d0-4b0a-a495-7402fbd6aef5 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:40.228877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f12457e7-f3d0-4b0a-a495-7402fbd6aef5 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:40.230996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f12457e7-f3d0-4b0a-a495-7402fbd6aef5 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:40.232435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f12457e7-f3d0-4b0a-a495-7402fbd6aef5 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:40.674776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bc0e6e45-3987-49ce-b4b0-e004e1adb995 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:40.675291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bc0e6e45-3987-49ce-b4b0-e004e1adb995 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:40.698725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc0e6e45-3987-49ce-b4b0-e004e1adb995 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:40.699313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc0e6e45-3987-49ce-b4b0-e004e1adb995 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:40.699826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc0e6e45-3987-49ce-b4b0-e004e1adb995 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:40.707532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc0e6e45-3987-49ce-b4b0-e004e1adb995 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:40.708248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc0e6e45-3987-49ce-b4b0-e004e1adb995 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:40.708899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc0e6e45-3987-49ce-b4b0-e004e1adb995 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:40.846597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bc0e6e45-3987-49ce-b4b0-e004e1adb995 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:27:40.991416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f12457e7-f3d0-4b0a-a495-7402fbd6aef5 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:41.005128 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f12457e7-f3d0-4b0a-a495-7402fbd6aef5 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1494 microversion: 2.1 time: 0.842893 Aug 27 02:27:41.006493 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 86/162] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:40 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1494 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:41.023103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d7850255-1e5d-4935-9793-3a4474a289ef tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:41.023997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d7850255-1e5d-4935-9793-3a4474a289ef tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:41.035391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7850255-1e5d-4935-9793-3a4474a289ef tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:41.036746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7850255-1e5d-4935-9793-3a4474a289ef tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:41.037513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7850255-1e5d-4935-9793-3a4474a289ef tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:41.038949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7850255-1e5d-4935-9793-3a4474a289ef tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:41.040145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7850255-1e5d-4935-9793-3a4474a289ef tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:41.040582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7850255-1e5d-4935-9793-3a4474a289ef tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:41.154915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d7850255-1e5d-4935-9793-3a4474a289ef tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:41.165685 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d7850255-1e5d-4935-9793-3a4474a289ef tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1276 microversion: 2.1 time: 0.156435 Aug 27 02:27:41.180960 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 87/163] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:41 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:41.188899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b71d3c9-ed7c-455f-a586-f395013fd9cc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:41.190561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b71d3c9-ed7c-455f-a586-f395013fd9cc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:41.200191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b71d3c9-ed7c-455f-a586-f395013fd9cc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:41.201248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b71d3c9-ed7c-455f-a586-f395013fd9cc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:41.201932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b71d3c9-ed7c-455f-a586-f395013fd9cc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:41.202885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b71d3c9-ed7c-455f-a586-f395013fd9cc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:41.203549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b71d3c9-ed7c-455f-a586-f395013fd9cc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:41.204154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b71d3c9-ed7c-455f-a586-f395013fd9cc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:41.255673 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bc0e6e45-3987-49ce-b4b0-e004e1adb995 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] 10.222.0.99 "DELETE /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 204 len: 0 microversion: 2.1 time: 1.625512 Aug 27 02:27:41.257795 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 77/164] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:27:39 2022] DELETE /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 0 bytes in 1631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:27:41.320318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b71d3c9-ed7c-455f-a586-f395013fd9cc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:41.336958 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b71d3c9-ed7c-455f-a586-f395013fd9cc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1266 microversion: 2.1 time: 0.153772 Aug 27 02:27:41.337959 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 88/165] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:41 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:41.347164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-96fe778e-f872-49c9-831b-72e96687c4b7 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:41.348297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-96fe778e-f872-49c9-831b-72e96687c4b7 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:41.363534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96fe778e-f872-49c9-831b-72e96687c4b7 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:41.364479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96fe778e-f872-49c9-831b-72e96687c4b7 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:41.365282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96fe778e-f872-49c9-831b-72e96687c4b7 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:41.366729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96fe778e-f872-49c9-831b-72e96687c4b7 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:41.367650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96fe778e-f872-49c9-831b-72e96687c4b7 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:41.368918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96fe778e-f872-49c9-831b-72e96687c4b7 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:41.516593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37856ca6-8c04-41f5-9c76-da9273a45443 tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Calling method '.version_select at 0x7f4d2b2374c0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:41.520835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37856ca6-8c04-41f5-9c76-da9273a45443 tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:41.521745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37856ca6-8c04-41f5-9c76-da9273a45443 tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:41.522540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37856ca6-8c04-41f5-9c76-da9273a45443 tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:41.554819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37856ca6-8c04-41f5-9c76-da9273a45443 tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:41.556243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37856ca6-8c04-41f5-9c76-da9273a45443 tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:41.557831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37856ca6-8c04-41f5-9c76-da9273a45443 tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:41.617370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:RELEASE=2,nova_api:SAVEPOINT=1,nova_api:SELECT=88,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:41.622222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37856ca6-8c04-41f5-9c76-da9273a45443 tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:41.624101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37856ca6-8c04-41f5-9c76-da9273a45443 tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:41.624900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37856ca6-8c04-41f5-9c76-da9273a45443 tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:41.641310 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-37856ca6-8c04-41f5-9c76-da9273a45443 tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.379978 Aug 27 02:27:41.643062 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 78/166] 10.222.0.99 () {60 vars in 1187 bytes} [Sat Aug 27 02:27:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:27:41.661506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5f30c29f-4978-4964-bf0a-696cdc1e081b tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Calling method '.version_select at 0x7f4d2b264a60>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:41.666219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f30c29f-4978-4964-bf0a-696cdc1e081b tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:41.667108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f30c29f-4978-4964-bf0a-696cdc1e081b tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:41.667902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f30c29f-4978-4964-bf0a-696cdc1e081b tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:41.748225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f30c29f-4978-4964-bf0a-696cdc1e081b tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:41.749307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f30c29f-4978-4964-bf0a-696cdc1e081b tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:41.750275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f30c29f-4978-4964-bf0a-696cdc1e081b tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:41.769230 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f30c29f-4978-4964-bf0a-696cdc1e081b tempest-HypervisorAdminV228Test-699861248 tempest-HypervisorAdminV228Test-699861248-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.117119 Aug 27 02:27:41.771244 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 79/167] 10.222.0.99 () {60 vars in 1193 bytes} [Sat Aug 27 02:27:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 02:27:41.930303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-96fe778e-f872-49c9-831b-72e96687c4b7 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:41.943061 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-96fe778e-f872-49c9-831b-72e96687c4b7 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1497 microversion: 2.1 time: 0.603317 Aug 27 02:27:41.958656 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 89/168] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:41 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1497 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:42.046402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6987a94b-275a-4ad3-a346-a75eefaa174e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:42.048104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6987a94b-275a-4ad3-a346-a75eefaa174e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:42.064628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6987a94b-275a-4ad3-a346-a75eefaa174e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:42.068406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6987a94b-275a-4ad3-a346-a75eefaa174e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:42.069341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6987a94b-275a-4ad3-a346-a75eefaa174e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:42.073450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6987a94b-275a-4ad3-a346-a75eefaa174e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:42.075983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6987a94b-275a-4ad3-a346-a75eefaa174e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:42.077813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6987a94b-275a-4ad3-a346-a75eefaa174e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:42.189402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8b393118-3475-4f05-a482-c470518b3170 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:42.190828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8b393118-3475-4f05-a482-c470518b3170 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:42.197707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:42.240107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b393118-3475-4f05-a482-c470518b3170 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:42.243305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b393118-3475-4f05-a482-c470518b3170 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:42.252963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b393118-3475-4f05-a482-c470518b3170 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:42.254781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b393118-3475-4f05-a482-c470518b3170 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:42.257134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b393118-3475-4f05-a482-c470518b3170 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:42.257590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b393118-3475-4f05-a482-c470518b3170 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:42.481523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8b393118-3475-4f05-a482-c470518b3170 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:42.491236 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8b393118-3475-4f05-a482-c470518b3170 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1276 microversion: 2.1 time: 0.306041 Aug 27 02:27:42.498732 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 90/169] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:42 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1276 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:42.525125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1e735092-586a-4e1f-a08a-e71d1c38f51f tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:42.530023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1e735092-586a-4e1f-a08a-e71d1c38f51f tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:42.542283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e735092-586a-4e1f-a08a-e71d1c38f51f tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:42.551040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e735092-586a-4e1f-a08a-e71d1c38f51f tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:42.552310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e735092-586a-4e1f-a08a-e71d1c38f51f tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:42.556520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e735092-586a-4e1f-a08a-e71d1c38f51f tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:42.558783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e735092-586a-4e1f-a08a-e71d1c38f51f tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:42.559662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e735092-586a-4e1f-a08a-e71d1c38f51f tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:42.987381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1e735092-586a-4e1f-a08a-e71d1c38f51f tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:43.013114 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1e735092-586a-4e1f-a08a-e71d1c38f51f tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1258 microversion: 2.1 time: 0.506670 Aug 27 02:27:43.035910 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 91/170] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:42 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1258 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:43.092199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-886b1e26-7cce-4ea0-abcc-7453ceace45f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:43.097152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-886b1e26-7cce-4ea0-abcc-7453ceace45f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:43.135056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-886b1e26-7cce-4ea0-abcc-7453ceace45f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:43.140610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-886b1e26-7cce-4ea0-abcc-7453ceace45f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:43.144559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-886b1e26-7cce-4ea0-abcc-7453ceace45f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:43.148571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-886b1e26-7cce-4ea0-abcc-7453ceace45f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:43.152772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-886b1e26-7cce-4ea0-abcc-7453ceace45f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:43.154287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-886b1e26-7cce-4ea0-abcc-7453ceace45f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:43.156669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6987a94b-275a-4ad3-a346-a75eefaa174e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:43.207270 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6987a94b-275a-4ad3-a346-a75eefaa174e tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1494 microversion: 2.1 time: 1.169420 Aug 27 02:27:43.221712 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 80/171] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:42 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1494 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:43.519770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f77cfa65-79cc-4e5d-99cd-4c98f16cebdd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:43.520652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f77cfa65-79cc-4e5d-99cd-4c98f16cebdd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:43.546818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f77cfa65-79cc-4e5d-99cd-4c98f16cebdd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:43.550653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f77cfa65-79cc-4e5d-99cd-4c98f16cebdd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:43.554703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f77cfa65-79cc-4e5d-99cd-4c98f16cebdd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:43.557477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f77cfa65-79cc-4e5d-99cd-4c98f16cebdd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:43.558440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f77cfa65-79cc-4e5d-99cd-4c98f16cebdd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:43.559311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f77cfa65-79cc-4e5d-99cd-4c98f16cebdd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:43.806551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-886b1e26-7cce-4ea0-abcc-7453ceace45f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:43.846680 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-886b1e26-7cce-4ea0-abcc-7453ceace45f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1497 microversion: 2.1 time: 0.776551 Aug 27 02:27:43.852993 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 92/172] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:43 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1497 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:44.075854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6c97b771-02bf-495c-ac5b-3349292d7b6d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:44.078797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6c97b771-02bf-495c-ac5b-3349292d7b6d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:44.129417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c97b771-02bf-495c-ac5b-3349292d7b6d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:44.137745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c97b771-02bf-495c-ac5b-3349292d7b6d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:44.139373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c97b771-02bf-495c-ac5b-3349292d7b6d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:44.145544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c97b771-02bf-495c-ac5b-3349292d7b6d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:44.148400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c97b771-02bf-495c-ac5b-3349292d7b6d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:44.151707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c97b771-02bf-495c-ac5b-3349292d7b6d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:44.499652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6c97b771-02bf-495c-ac5b-3349292d7b6d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:44.533117 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6c97b771-02bf-495c-ac5b-3349292d7b6d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1332 microversion: 2.1 time: 0.463364 Aug 27 02:27:44.533786 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 93/173] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:44 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1332 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:44.550038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb2868a3-44c3-4be9-ab0a-c65a1d8d1bbe tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:44.558118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bb2868a3-44c3-4be9-ab0a-c65a1d8d1bbe tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:44.610424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2868a3-44c3-4be9-ab0a-c65a1d8d1bbe tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:44.612108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2868a3-44c3-4be9-ab0a-c65a1d8d1bbe tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:44.632814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2868a3-44c3-4be9-ab0a-c65a1d8d1bbe tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:44.637570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2868a3-44c3-4be9-ab0a-c65a1d8d1bbe tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:44.642841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2868a3-44c3-4be9-ab0a-c65a1d8d1bbe tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:44.651440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb2868a3-44c3-4be9-ab0a-c65a1d8d1bbe tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:44.845458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f77cfa65-79cc-4e5d-99cd-4c98f16cebdd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:44.861116 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f77cfa65-79cc-4e5d-99cd-4c98f16cebdd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1318 microversion: 2.1 time: 1.345054 Aug 27 02:27:44.862134 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 81/174] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:43 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1318 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:44.891965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-45417bb3-6cfd-4ff2-96f8-c045b3ee8040 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:44.892952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-45417bb3-6cfd-4ff2-96f8-c045b3ee8040 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:44.910612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45417bb3-6cfd-4ff2-96f8-c045b3ee8040 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:44.911267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45417bb3-6cfd-4ff2-96f8-c045b3ee8040 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:44.913338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45417bb3-6cfd-4ff2-96f8-c045b3ee8040 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:44.915147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45417bb3-6cfd-4ff2-96f8-c045b3ee8040 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:44.918478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45417bb3-6cfd-4ff2-96f8-c045b3ee8040 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:44.921113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45417bb3-6cfd-4ff2-96f8-c045b3ee8040 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:45.354602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:45.503520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-45417bb3-6cfd-4ff2-96f8-c045b3ee8040 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:45.533979 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-45417bb3-6cfd-4ff2-96f8-c045b3ee8040 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 200 len: 1455 microversion: 2.1 time: 0.650818 Aug 27 02:27:45.537234 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 82/175] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:44 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 1455 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:45.559188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-bd0dc750-04fc-449c-a4b0-a283ed9e27af req-c33ae00f-ceec-4532-85a2-8e3c66536508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fdd496b-91e7-43df-94fc-9f56f3ed9859", "name": "network-vif-deleted", "tag": "8967d981-1a96-4eb7-b90f-bc53bae047e0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:45.590890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bd0dc750-04fc-449c-a4b0-a283ed9e27af req-c33ae00f-ceec-4532-85a2-8e3c66536508 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:45.591694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bd0dc750-04fc-449c-a4b0-a283ed9e27af req-c33ae00f-ceec-4532-85a2-8e3c66536508 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:45.592309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bd0dc750-04fc-449c-a4b0-a283ed9e27af req-c33ae00f-ceec-4532-85a2-8e3c66536508 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:45.608098 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-bd0dc750-04fc-449c-a4b0-a283ed9e27af req-c33ae00f-ceec-4532-85a2-8e3c66536508 service nova] Creating event network-vif-deleted:8967d981-1a96-4eb7-b90f-bc53bae047e0 for instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 on n-h2-852084-5 Aug 27 02:27:45.619480 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-bd0dc750-04fc-449c-a4b0-a283ed9e27af req-c33ae00f-ceec-4532-85a2-8e3c66536508 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078808 Aug 27 02:27:45.620390 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 83/176] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:45.629181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-07965f44-3435-4ba1-8e0f-84534c82ffda tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:45.629950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-07965f44-3435-4ba1-8e0f-84534c82ffda tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:45.638166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07965f44-3435-4ba1-8e0f-84534c82ffda tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:45.638655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07965f44-3435-4ba1-8e0f-84534c82ffda tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:45.639221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07965f44-3435-4ba1-8e0f-84534c82ffda tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:45.640010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07965f44-3435-4ba1-8e0f-84534c82ffda tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:45.641408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07965f44-3435-4ba1-8e0f-84534c82ffda tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:45.641900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07965f44-3435-4ba1-8e0f-84534c82ffda tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:45.798603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-07965f44-3435-4ba1-8e0f-84534c82ffda tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:45.835620 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-07965f44-3435-4ba1-8e0f-84534c82ffda tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1320 microversion: 2.1 time: 0.211984 Aug 27 02:27:45.845819 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 84/177] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:45 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:45.908406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-149833e6-07df-46ff-a3e8-49bb9cbc82c7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:45.909326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-149833e6-07df-46ff-a3e8-49bb9cbc82c7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:45.933592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-149833e6-07df-46ff-a3e8-49bb9cbc82c7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:45.935577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-149833e6-07df-46ff-a3e8-49bb9cbc82c7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:45.935577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-149833e6-07df-46ff-a3e8-49bb9cbc82c7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:45.950438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-149833e6-07df-46ff-a3e8-49bb9cbc82c7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:45.951379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-149833e6-07df-46ff-a3e8-49bb9cbc82c7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:45.952234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-149833e6-07df-46ff-a3e8-49bb9cbc82c7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:46.186598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bb2868a3-44c3-4be9-ab0a-c65a1d8d1bbe tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:46.189208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:46.212698 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bb2868a3-44c3-4be9-ab0a-c65a1d8d1bbe tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1494 microversion: 2.1 time: 1.667700 Aug 27 02:27:46.213777 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 94/178] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:44 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1494 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:46.574194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:46.574824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:46.587439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:46.587948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:46.588404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:46.597805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:46.598384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:46.598871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:46.633973 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] HTTP exception thrown: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Request method failure captured: Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 HTTP/1.1 Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDsr6HiDtLrsXRR7oKFPIbGqfyrMeFXOfjkgHwe8zDWjdcE6u5fTv97ks2j6uxDy0X9XHA053hEW4XdCtVDiPRcAutXt58pBkSMyKoaA4SDpkmvmAyfo5Mfgbp8KYW42icDmXaaC9eb95rm_zA6j5a2lBvY3rbO-_7lgMly5coPuOU Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:27:46.662026 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dc468f7c61aa40d892089c93573ebef1"}]}] Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f46309895da04211866ad3bbcb96ff76 Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:27:46.664094 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '4fdd496b-91e7-43df-94fc-9f56f3ed9859'} Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:46.666755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:27:46.672149 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:46.676432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Returning 404 to user: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:46.676432 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1a62d570-fbc0-4b6e-8cce-7ad5be67778d tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 404 len: 111 microversion: 2.1 time: 0.094924 Aug 27 02:27:46.676432 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 95/179] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:46 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:27:46.677342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-149833e6-07df-46ff-a3e8-49bb9cbc82c7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:46.685703 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-149833e6-07df-46ff-a3e8-49bb9cbc82c7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1318 microversion: 2.1 time: 0.784850 Aug 27 02:27:46.690166 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 85/180] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:45 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1318 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:46.864830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-349586399", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:46.894840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1f53d37b-6a4b-4cb5-963f-6d5c2f899a15 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:46.897622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1f53d37b-6a4b-4cb5-963f-6d5c2f899a15 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:46.928835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f53d37b-6a4b-4cb5-963f-6d5c2f899a15 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:46.930533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f53d37b-6a4b-4cb5-963f-6d5c2f899a15 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:46.932489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f53d37b-6a4b-4cb5-963f-6d5c2f899a15 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:46.934287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f53d37b-6a4b-4cb5-963f-6d5c2f899a15 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:46.935294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f53d37b-6a4b-4cb5-963f-6d5c2f899a15 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:46.935946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f53d37b-6a4b-4cb5-963f-6d5c2f899a15 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:47.051861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:27:47.180039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f53d37b-6a4b-4cb5-963f-6d5c2f899a15 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:47.210688 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1f53d37b-6a4b-4cb5-963f-6d5c2f899a15 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1320 microversion: 2.1 time: 0.324524 Aug 27 02:27:47.212235 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 86/181] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:46 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:47.272689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2033ec0d-0f1b-4c79-a2b3-3b8f2b71af0d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:47.274640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2033ec0d-0f1b-4c79-a2b3-3b8f2b71af0d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:47.315215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2033ec0d-0f1b-4c79-a2b3-3b8f2b71af0d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:47.316052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2033ec0d-0f1b-4c79-a2b3-3b8f2b71af0d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:47.316833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2033ec0d-0f1b-4c79-a2b3-3b8f2b71af0d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:47.326402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2033ec0d-0f1b-4c79-a2b3-3b8f2b71af0d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:47.327353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2033ec0d-0f1b-4c79-a2b3-3b8f2b71af0d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:47.328203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2033ec0d-0f1b-4c79-a2b3-3b8f2b71af0d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:47.676146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2033ec0d-0f1b-4c79-a2b3-3b8f2b71af0d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:47.695115 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2033ec0d-0f1b-4c79-a2b3-3b8f2b71af0d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1452 microversion: 2.1 time: 0.432586 Aug 27 02:27:47.695807 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 87/182] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:47 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1452 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:47.714786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ed447de5-69fb-441a-979e-61f48934b175 req-e6726b29-79c9-4f35-97d4-ee7490268bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c964ffb-a951-4b4f-aebd-22f04a2caa23", "name": "network-vif-deleted", "tag": "9acaf088-d039-4ce6-b81a-e45c13b411d1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:47.736249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ed447de5-69fb-441a-979e-61f48934b175 req-e6726b29-79c9-4f35-97d4-ee7490268bd9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:47.736723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ed447de5-69fb-441a-979e-61f48934b175 req-e6726b29-79c9-4f35-97d4-ee7490268bd9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:47.737741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ed447de5-69fb-441a-979e-61f48934b175 req-e6726b29-79c9-4f35-97d4-ee7490268bd9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:47.756079 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ed447de5-69fb-441a-979e-61f48934b175 req-e6726b29-79c9-4f35-97d4-ee7490268bd9 service nova] Creating event network-vif-deleted:9acaf088-d039-4ce6-b81a-e45c13b411d1 for instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 on n-h2-852084-5 Aug 27 02:27:47.763195 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ed447de5-69fb-441a-979e-61f48934b175 req-e6726b29-79c9-4f35-97d4-ee7490268bd9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065778 Aug 27 02:27:47.764376 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 88/183] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:47.770353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-56a30ef4-1f68-4208-9b8b-0965e8374eae tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:47.771784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-56a30ef4-1f68-4208-9b8b-0965e8374eae tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:47.783590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56a30ef4-1f68-4208-9b8b-0965e8374eae tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:47.784249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56a30ef4-1f68-4208-9b8b-0965e8374eae tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:47.785820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56a30ef4-1f68-4208-9b8b-0965e8374eae tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:47.786777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56a30ef4-1f68-4208-9b8b-0965e8374eae tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:47.787263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56a30ef4-1f68-4208-9b8b-0965e8374eae tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:47.791458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56a30ef4-1f68-4208-9b8b-0965e8374eae tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:47.926062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:27:47.927355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:27:47.928876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:27:47.932380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:27:47.938051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:27:47.990628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:47.991209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:47.991829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:48.005141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:48.007548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:48.009061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:48.083774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Getting quotas for project dc468f7c61aa40d892089c93573ebef1. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:27:48.095878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Getting quotas for user f46309895da04211866ad3bbcb96ff76 and project dc468f7c61aa40d892089c93573ebef1. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:27:48.156084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:27:48.167653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:27:48.225714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-56a30ef4-1f68-4208-9b8b-0965e8374eae tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:48.258396 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-56a30ef4-1f68-4208-9b8b-0965e8374eae tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1318 microversion: 2.1 time: 0.488882 Aug 27 02:27:48.263148 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 89/184] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:47 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:48.295875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f37bf9f-eff8-4bb4-88da-3b290a7ecd58 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:48.299073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6f37bf9f-eff8-4bb4-88da-3b290a7ecd58 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:48.324141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f37bf9f-eff8-4bb4-88da-3b290a7ecd58 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:48.327453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f37bf9f-eff8-4bb4-88da-3b290a7ecd58 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:48.329296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f37bf9f-eff8-4bb4-88da-3b290a7ecd58 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:48.334632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f37bf9f-eff8-4bb4-88da-3b290a7ecd58 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:48.337775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f37bf9f-eff8-4bb4-88da-3b290a7ecd58 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:48.339246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f37bf9f-eff8-4bb4-88da-3b290a7ecd58 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:48.500483 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3c7f69e5-473a-4c15-a130-f744315af5fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.641489 Aug 27 02:27:48.516025 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 96/185] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:27:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:27:48.553759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-28545ddd-cc17-4229-b0dd-0cdd0970ac3f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:48.556571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-28545ddd-cc17-4229-b0dd-0cdd0970ac3f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:48.653231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:48.841882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6f37bf9f-eff8-4bb4-88da-3b290a7ecd58 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:48.854463 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6f37bf9f-eff8-4bb4-88da-3b290a7ecd58 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1387 microversion: 2.1 time: 0.588076 Aug 27 02:27:48.856887 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 90/186] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:48 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1387 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:48.873484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:48.874686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:48.916643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:48.925363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:48.926643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:48.931848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:48.933944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:48.937447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:49.001525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:49.002691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:49.003357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:49.004547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lazy-loading 'fault' on Instance uuid 9c964ffb-a951-4b4f-aebd-22f04a2caa23 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:27:49.091323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be691c6ab4d4aff9c2bda2bb31c54bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8c9873f5654f1abf00234014d85a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:49.104641 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b6d1b567-2c25-463b-b4f4-1654096480c6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 200 len: 1329 microversion: 2.1 time: 0.246073 Aug 27 02:27:49.105998 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 91/187] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:48 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 1329 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:49.207272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-28545ddd-cc17-4229-b0dd-0cdd0970ac3f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:49.232411 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-28545ddd-cc17-4229-b0dd-0cdd0970ac3f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1219 microversion: 2.1 time: 0.707043 Aug 27 02:27:49.245986 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 97/188] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:48 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1219 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:49.311759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-abc39b1e-faf6-480b-82cd-01a81de9c619 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:49.312493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-abc39b1e-faf6-480b-82cd-01a81de9c619 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:49.323703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc39b1e-faf6-480b-82cd-01a81de9c619 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:49.324202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc39b1e-faf6-480b-82cd-01a81de9c619 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:49.324655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc39b1e-faf6-480b-82cd-01a81de9c619 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:49.325410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc39b1e-faf6-480b-82cd-01a81de9c619 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:49.325911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc39b1e-faf6-480b-82cd-01a81de9c619 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:49.326345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc39b1e-faf6-480b-82cd-01a81de9c619 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:49.608268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=16 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:49.760354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-abc39b1e-faf6-480b-82cd-01a81de9c619 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:49.780943 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-abc39b1e-faf6-480b-82cd-01a81de9c619 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1318 microversion: 2.1 time: 0.477036 Aug 27 02:27:49.782045 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 92/189] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:49 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:49.823767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-761506ea-12a4-42d0-a3d1-973685504f47 req-8a25b6a7-4810-4fdd-9299-1003bf3dd58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01318003-ad06-4b90-8ffd-e3d8ff4f5d32", "tag": "75ad7624-9152-4c42-8b4a-a46aab3ee07a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:49.845183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-761506ea-12a4-42d0-a3d1-973685504f47 req-8a25b6a7-4810-4fdd-9299-1003bf3dd58e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:49.846618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-761506ea-12a4-42d0-a3d1-973685504f47 req-8a25b6a7-4810-4fdd-9299-1003bf3dd58e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:49.847686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-761506ea-12a4-42d0-a3d1-973685504f47 req-8a25b6a7-4810-4fdd-9299-1003bf3dd58e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:49.904314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e3e72155-43b2-4410-bc2a-bfe6b3148170 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:49.907506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e3e72155-43b2-4410-bc2a-bfe6b3148170 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:49.941019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3e72155-43b2-4410-bc2a-bfe6b3148170 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:49.941936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3e72155-43b2-4410-bc2a-bfe6b3148170 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:49.951178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3e72155-43b2-4410-bc2a-bfe6b3148170 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:49.952812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3e72155-43b2-4410-bc2a-bfe6b3148170 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:49.953739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3e72155-43b2-4410-bc2a-bfe6b3148170 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:49.959163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3e72155-43b2-4410-bc2a-bfe6b3148170 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:50.280550 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-761506ea-12a4-42d0-a3d1-973685504f47 req-8a25b6a7-4810-4fdd-9299-1003bf3dd58e service nova] Creating event network-changed:75ad7624-9152-4c42-8b4a-a46aab3ee07a for instance 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 on n-h1-852084-5 Aug 27 02:27:50.291469 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-761506ea-12a4-42d0-a3d1-973685504f47 req-8a25b6a7-4810-4fdd-9299-1003bf3dd58e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.476669 Aug 27 02:27:50.293471 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 98/190] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:50.354101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:50.355302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:50.397999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:50.400083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:50.402725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:50.404355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:50.406579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:50.408239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:50.437939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e3e72155-43b2-4410-bc2a-bfe6b3148170 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:50.442488 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] HTTP exception thrown: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Request method failure captured: Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 HTTP/1.1 Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDo8la1n1ajYz-D3SsYq26L2E7c9fUfYrKFC0rkFFVBXXUnV0pGct3TkdEsNsFEF7RlGBapUso19jf7GvTK-bJ5nagngsJEZxD44b5ex67HE_pqVHdziHi5XF1CZ21fRI4gHePek5MovogjOPDIl0UTgjgC6ZT4DtpPL0_hCyK-Qug Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cf8c9873f5654f1abf00234014d85a77 Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminTestJSON-1605603608 Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:27:50.446869 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cf8c9873f5654f1abf00234014d85a77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cf8c9873f5654f1abf00234014d85a77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cf8c9873f5654f1abf00234014d85a77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cf8c9873f5654f1abf00234014d85a77"}]}] Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminTestJSON-1605603608 Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cf8c9873f5654f1abf00234014d85a77 Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1605603608 Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminTestJSON-1605603608-project Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0be691c6ab4d4aff9c2bda2bb31c54bc Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminTestJSON-1605603608-project Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:27:50.448283 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '9c964ffb-a951-4b4f-aebd-22f04a2caa23'} Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:50.449069 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:27:50.450389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:50.459507 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e3e72155-43b2-4410-bc2a-bfe6b3148170 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1387 microversion: 2.1 time: 0.563517 Aug 27 02:27:50.466213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Returning 404 to user: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:50.467494 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b61173dd-e8fd-4d02-99ae-fa54297389a6 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 404 len: 111 microversion: 2.1 time: 0.132835 Aug 27 02:27:50.470380 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 99/191] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:50 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:50.483208 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 93/192] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:49 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1387 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:50.485449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0065cbc9-608e-48ad-aca2-10a6cc8c2b6e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:50.488060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0065cbc9-608e-48ad-aca2-10a6cc8c2b6e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:50.500067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0065cbc9-608e-48ad-aca2-10a6cc8c2b6e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:50.500825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0065cbc9-608e-48ad-aca2-10a6cc8c2b6e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:50.501883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0065cbc9-608e-48ad-aca2-10a6cc8c2b6e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:50.503566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0065cbc9-608e-48ad-aca2-10a6cc8c2b6e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:50.504557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0065cbc9-608e-48ad-aca2-10a6cc8c2b6e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:50.505296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0065cbc9-608e-48ad-aca2-10a6cc8c2b6e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:50.527720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c8c7710-6555-463e-993a-46c0777adc93 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:50.569015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c8c7710-6555-463e-993a-46c0777adc93 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:50.569918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c8c7710-6555-463e-993a-46c0777adc93 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:50.571353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c8c7710-6555-463e-993a-46c0777adc93 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:50.636049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0065cbc9-608e-48ad-aca2-10a6cc8c2b6e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:50.663287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0065cbc9-608e-48ad-aca2-10a6cc8c2b6e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1293 microversion: 2.1 time: 0.187948 Aug 27 02:27:50.667147 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 100/193] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:50 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1293 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:50.803618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-76e6af86-dec1-4546-8580-dba89ea4f4cd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:50.804707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-76e6af86-dec1-4546-8580-dba89ea4f4cd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:50.818182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76e6af86-dec1-4546-8580-dba89ea4f4cd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:50.819003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76e6af86-dec1-4546-8580-dba89ea4f4cd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:50.819628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76e6af86-dec1-4546-8580-dba89ea4f4cd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:50.824184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76e6af86-dec1-4546-8580-dba89ea4f4cd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:50.825098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76e6af86-dec1-4546-8580-dba89ea4f4cd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:50.825724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76e6af86-dec1-4546-8580-dba89ea4f4cd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:50.872626 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9c8c7710-6555-463e-993a-46c0777adc93 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.386222 Aug 27 02:27:50.874570 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 94/194] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:50 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:50.902510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6127173-dae1-416f-ae12-f37c79b6ab64 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:50.985698 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6127173-dae1-416f-ae12-f37c79b6ab64 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.095740 Aug 27 02:27:50.990148 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 95/195] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:50 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:27:51.033790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2eb1c26e-faee-4398-93b8-bf51fe44e5f0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-745521522"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:51.044590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.aggregate [None req-2eb1c26e-faee-4398-93b8-bf51fe44e5f0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Generated uuid b7410c3c-e666-4a01-a47c-b3c47a10bd6a for aggregate {{(pid=122488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:27:51.127768 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2eb1c26e-faee-4398-93b8-bf51fe44e5f0 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.117015 Aug 27 02:27:51.129888 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 96/196] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:27:51 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:51.172156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33835866-6885-4a4a-94aa-b6d58e86c4b5 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:51.211740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33835866-6885-4a4a-94aa-b6d58e86c4b5 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:51.212847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33835866-6885-4a4a-94aa-b6d58e86c4b5 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:51.214183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33835866-6885-4a4a-94aa-b6d58e86c4b5 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:51.595935 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-33835866-6885-4a4a-94aa-b6d58e86c4b5 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.451397 Aug 27 02:27:51.597764 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 97/197] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:51 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:51.609801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a8c0f401-6dc4-463c-893c-3461b03b425a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:51.611128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a8c0f401-6dc4-463c-893c-3461b03b425a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:51.636298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8c0f401-6dc4-463c-893c-3461b03b425a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:51.637630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8c0f401-6dc4-463c-893c-3461b03b425a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:51.637875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8c0f401-6dc4-463c-893c-3461b03b425a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:51.639095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8c0f401-6dc4-463c-893c-3461b03b425a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:51.639890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8c0f401-6dc4-463c-893c-3461b03b425a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:51.640653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8c0f401-6dc4-463c-893c-3461b03b425a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:51.702382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-76e6af86-dec1-4546-8580-dba89ea4f4cd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:51.731266 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-76e6af86-dec1-4546-8580-dba89ea4f4cd tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1318 microversion: 2.1 time: 0.932007 Aug 27 02:27:51.732082 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 101/198] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:50 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1318 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:27:51.759197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3d84a14-1345-43c6-8f77-0dd77e06e4e3 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:51.810810 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f3d84a14-1345-43c6-8f77-0dd77e06e4e3 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.058528 Aug 27 02:27:51.813146 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 102/199] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:27:51 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:51.824524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6ac36ae9-8ec8-480d-8608-9faf8e1eeae8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:51.826770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6ac36ae9-8ec8-480d-8608-9faf8e1eeae8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:51.844672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ac36ae9-8ec8-480d-8608-9faf8e1eeae8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:51.846852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ac36ae9-8ec8-480d-8608-9faf8e1eeae8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:51.847885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ac36ae9-8ec8-480d-8608-9faf8e1eeae8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:51.849395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ac36ae9-8ec8-480d-8608-9faf8e1eeae8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:51.851608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ac36ae9-8ec8-480d-8608-9faf8e1eeae8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:51.853393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ac36ae9-8ec8-480d-8608-9faf8e1eeae8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:52.052573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a8c0f401-6dc4-463c-893c-3461b03b425a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:52.071210 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a8c0f401-6dc4-463c-893c-3461b03b425a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1387 microversion: 2.1 time: 0.471804 Aug 27 02:27:52.072611 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 98/200] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:51 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1387 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:52.082320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b5e9d5bf-f0c2-441e-803a-b032d1168270 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:52.107729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5e9d5bf-f0c2-441e-803a-b032d1168270 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:52.109121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5e9d5bf-f0c2-441e-803a-b032d1168270 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:52.110208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5e9d5bf-f0c2-441e-803a-b032d1168270 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:52.374177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6ac36ae9-8ec8-480d-8608-9faf8e1eeae8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:52.403419 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b5e9d5bf-f0c2-441e-803a-b032d1168270 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.328844 Aug 27 02:27:52.416101 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 99/201] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:52 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:52.416393 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6ac36ae9-8ec8-480d-8608-9faf8e1eeae8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1277 microversion: 2.1 time: 0.597615 Aug 27 02:27:52.416393 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 103/202] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:51 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1277 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:52.421501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d53e6310-9424-473a-94b1-754eb196f5cf req-9b5564d0-5915-4024-9ce6-224019e5f432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32472eac-0284-4cff-9e87-1884b0bd6d96", "tag": "50e81101-2512-4821-83a6-6e19294005b3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:52.436877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-989be37a-5640-47be-81b8-e0a4255089af tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:52.456349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d53e6310-9424-473a-94b1-754eb196f5cf req-9b5564d0-5915-4024-9ce6-224019e5f432 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:52.457251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d53e6310-9424-473a-94b1-754eb196f5cf req-9b5564d0-5915-4024-9ce6-224019e5f432 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:52.458410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d53e6310-9424-473a-94b1-754eb196f5cf req-9b5564d0-5915-4024-9ce6-224019e5f432 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:52.495862 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d53e6310-9424-473a-94b1-754eb196f5cf req-9b5564d0-5915-4024-9ce6-224019e5f432 service nova] Creating event network-changed:50e81101-2512-4821-83a6-6e19294005b3 for instance 32472eac-0284-4cff-9e87-1884b0bd6d96 on n-h1-852084-5 Aug 27 02:27:52.511714 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-989be37a-5640-47be-81b8-e0a4255089af tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.082844 Aug 27 02:27:52.517163 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d53e6310-9424-473a-94b1-754eb196f5cf req-9b5564d0-5915-4024-9ce6-224019e5f432 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110052 Aug 27 02:27:52.520743 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 100/203] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:52.524460 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 104/204] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:52 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:27:52.534093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-29089f50-83d6-4057-bb35-60d0eeffcd53 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-87381443"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:52.544525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.aggregate [None req-29089f50-83d6-4057-bb35-60d0eeffcd53 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Generated uuid 0c560a17-ccce-4088-adb4-9666787bb37b for aggregate {{(pid=122488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:27:52.610109 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-29089f50-83d6-4057-bb35-60d0eeffcd53 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.084540 Aug 27 02:27:52.621880 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 101/205] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:27:52 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:52.632138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e3c6e741-e6fd-44c6-a460-4a4cb2e39a39 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:52.656282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3c6e741-e6fd-44c6-a460-4a4cb2e39a39 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:52.659031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3c6e741-e6fd-44c6-a460-4a4cb2e39a39 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:52.659875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3c6e741-e6fd-44c6-a460-4a4cb2e39a39 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:52.787821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2347bf0b-8e83-4784-8b9d-86f6912b56bb tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:52.794933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2347bf0b-8e83-4784-8b9d-86f6912b56bb tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:52.844924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2347bf0b-8e83-4784-8b9d-86f6912b56bb tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:52.845661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2347bf0b-8e83-4784-8b9d-86f6912b56bb tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:52.846395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2347bf0b-8e83-4784-8b9d-86f6912b56bb tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:52.853793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2347bf0b-8e83-4784-8b9d-86f6912b56bb tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:52.855291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2347bf0b-8e83-4784-8b9d-86f6912b56bb tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:52.856520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2347bf0b-8e83-4784-8b9d-86f6912b56bb tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.222227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2347bf0b-8e83-4784-8b9d-86f6912b56bb tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:53.232765 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2347bf0b-8e83-4784-8b9d-86f6912b56bb tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1318 microversion: 2.1 time: 0.467596 Aug 27 02:27:53.239971 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 102/206] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:52 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:53.242500 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e3c6e741-e6fd-44c6-a460-4a4cb2e39a39 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 240 microversion: 2.1 time: 0.617508 Aug 27 02:27:53.245303 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 105/207] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:52 2022] POST /compute/v2.1/os-aggregates/3/action => generated 240 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:53.256897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-81feafca-dcce-4d97-8640-52766a056b7e tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:53.259615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-81feafca-dcce-4d97-8640-52766a056b7e tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:53.273103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81feafca-dcce-4d97-8640-52766a056b7e tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.274623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81feafca-dcce-4d97-8640-52766a056b7e tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.275465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81feafca-dcce-4d97-8640-52766a056b7e tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.279416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81feafca-dcce-4d97-8640-52766a056b7e tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.280284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81feafca-dcce-4d97-8640-52766a056b7e tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.281164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81feafca-dcce-4d97-8640-52766a056b7e tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.476466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Calling method '.version_select at 0x7f4d2b3523a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:53.482358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.482839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.483270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.504929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.505601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.506213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.548580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.549256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.550041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.567918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.568779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.569646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.587621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:53.618132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.619666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.619824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.643496 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-64cbf07f-046a-4eeb-b2b4-af49cb269c26 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1837 microversion: 2.53 time: 0.401188 Aug 27 02:27:53.646250 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 103/208] 10.222.0.99 () {60 vars in 1243 bytes} [Sat Aug 27 02:27:53 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1837 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:27:53.673766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e1ebf70-5a33-48e1-9095-feaa3446ea8f tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:53.712741 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e1ebf70-5a33-48e1-9095-feaa3446ea8f tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates" status: 200 len: 243 microversion: 2.1 time: 0.063116 Aug 27 02:27:53.717731 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 104/209] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:27:53 2022] GET /compute/v2.1/os-aggregates => generated 243 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:53.720270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-91bfd224-1d3e-4f8a-b55c-58b1bded3531 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:53.720898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-91bfd224-1d3e-4f8a-b55c-58b1bded3531 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:53.729752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91bfd224-1d3e-4f8a-b55c-58b1bded3531 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.730316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91bfd224-1d3e-4f8a-b55c-58b1bded3531 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.730803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91bfd224-1d3e-4f8a-b55c-58b1bded3531 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.731544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91bfd224-1d3e-4f8a-b55c-58b1bded3531 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.732010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91bfd224-1d3e-4f8a-b55c-58b1bded3531 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.732599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91bfd224-1d3e-4f8a-b55c-58b1bded3531 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.879552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-91bfd224-1d3e-4f8a-b55c-58b1bded3531 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:53.896928 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-91bfd224-1d3e-4f8a-b55c-58b1bded3531 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1277 microversion: 2.1 time: 0.181248 Aug 27 02:27:53.898541 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 105/210] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:53 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:53.909812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Calling method '.version_select at 0x7f4d2b3230d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:53.917752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.918502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.919754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.952931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.954294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.956039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:53.990353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:53.990848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:53.991285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:54.005938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:54.006654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:54.007247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:54.031370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:54.032144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:54.032779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:54.041086 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bfc8f3e4-2348-4a8b-b0e6-49bbc43844ca tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.140805 Aug 27 02:27:54.041713 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 106/211] 10.222.0.99 () {60 vars in 1222 bytes} [Sat Aug 27 02:27:53 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:27:54.046491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c0397e74-33ae-454c-98ba-3372b90620c8 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:54.054268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:54.064803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0397e74-33ae-454c-98ba-3372b90620c8 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:54.065320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0397e74-33ae-454c-98ba-3372b90620c8 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:54.066305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0397e74-33ae-454c-98ba-3372b90620c8 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:54.356643 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c0397e74-33ae-454c-98ba-3372b90620c8 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 225 microversion: 2.1 time: 0.313343 Aug 27 02:27:54.363973 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 107/212] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:54 2022] POST /compute/v2.1/os-aggregates/3/action => generated 225 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:54.366643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-769a00ee-7caf-443c-be41-6f3f17132133 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Calling method '.version_select at 0x7f4d2b0b4af0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:54.373906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-769a00ee-7caf-443c-be41-6f3f17132133 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:54.374976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-769a00ee-7caf-443c-be41-6f3f17132133 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:54.375839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-769a00ee-7caf-443c-be41-6f3f17132133 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:54.414254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-769a00ee-7caf-443c-be41-6f3f17132133 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:54.415025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-769a00ee-7caf-443c-be41-6f3f17132133 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:54.415818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-769a00ee-7caf-443c-be41-6f3f17132133 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:54.432784 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-769a00ee-7caf-443c-be41-6f3f17132133 tempest-HypervisorAdminV253TestBase-325257688 tempest-HypervisorAdminV253TestBase-325257688-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/b062669b-0a6e-4cf7-90cd-8161d7aa1c54" status: 200 len: 792 microversion: 2.53 time: 0.072578 Aug 27 02:27:54.434081 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 108/213] 10.222.0.99 () {60 vars in 1298 bytes} [Sat Aug 27 02:27:54 2022] GET /compute/v2.1/os-hypervisors/b062669b-0a6e-4cf7-90cd-8161d7aa1c54 => generated 792 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:27:54.453373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e1ad411-763d-4f25-9cee-94265971e9c6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:54.454611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5e1ad411-763d-4f25-9cee-94265971e9c6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:54.469725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e1ad411-763d-4f25-9cee-94265971e9c6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:54.469725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e1ad411-763d-4f25-9cee-94265971e9c6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:54.469725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e1ad411-763d-4f25-9cee-94265971e9c6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:54.470947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e1ad411-763d-4f25-9cee-94265971e9c6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:54.471747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e1ad411-763d-4f25-9cee-94265971e9c6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:54.472477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e1ad411-763d-4f25-9cee-94265971e9c6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:54.672163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-81feafca-dcce-4d97-8640-52766a056b7e tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:54.690718 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-81feafca-dcce-4d97-8640-52766a056b7e tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1387 microversion: 2.1 time: 1.442985 Aug 27 02:27:54.691708 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 106/214] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:53 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1387 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:54.696401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ff36b0e6-d9ea-46ee-9805-442985e9c37b tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:54.755138 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ff36b0e6-d9ea-46ee-9805-442985e9c37b tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.062239 Aug 27 02:27:54.756450 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 107/215] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:54 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:27:54.778719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f951b16e-a6af-4ba1-814d-efabf3ea039e tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1175526542"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:54.786691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.aggregate [None req-f951b16e-a6af-4ba1-814d-efabf3ea039e tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Generated uuid 4e2c707d-f2a5-415b-9468-c85109bbad4e for aggregate {{(pid=122487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:27:54.844919 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f951b16e-a6af-4ba1-814d-efabf3ea039e tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074747 Aug 27 02:27:54.848941 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 108/216] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:27:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:27:54.873281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-50b4d013-4f51-4a4d-a6f5-1ca0af022fe4 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:54.896111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50b4d013-4f51-4a4d-a6f5-1ca0af022fe4 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:54.896844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5e1ad411-763d-4f25-9cee-94265971e9c6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:54.897608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50b4d013-4f51-4a4d-a6f5-1ca0af022fe4 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:54.898187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50b4d013-4f51-4a4d-a6f5-1ca0af022fe4 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:54.918903 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e1ad411-763d-4f25-9cee-94265971e9c6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1318 microversion: 2.1 time: 0.482810 Aug 27 02:27:54.920328 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 109/217] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:54 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:54.929843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-de1cf60c-74d9-4e21-9fef-d6fea20337fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:54.930837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-de1cf60c-74d9-4e21-9fef-d6fea20337fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:54.942740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de1cf60c-74d9-4e21-9fef-d6fea20337fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:54.944137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de1cf60c-74d9-4e21-9fef-d6fea20337fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:54.945427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de1cf60c-74d9-4e21-9fef-d6fea20337fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:54.947282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de1cf60c-74d9-4e21-9fef-d6fea20337fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:54.948438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de1cf60c-74d9-4e21-9fef-d6fea20337fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:54.949403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de1cf60c-74d9-4e21-9fef-d6fea20337fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:55.131744 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-50b4d013-4f51-4a4d-a6f5-1ca0af022fe4 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.266795 Aug 27 02:27:55.135921 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 109/218] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:54 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:27:55.151352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-de1cf60c-74d9-4e21-9fef-d6fea20337fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:55.158199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-290f0ffe-1177-4ee2-b223-1ae870a83459 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:55.181117 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-de1cf60c-74d9-4e21-9fef-d6fea20337fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1277 microversion: 2.1 time: 0.258019 Aug 27 02:27:55.185409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-290f0ffe-1177-4ee2-b223-1ae870a83459 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:55.186863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-290f0ffe-1177-4ee2-b223-1ae870a83459 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:55.188289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-290f0ffe-1177-4ee2-b223-1ae870a83459 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:55.194422 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 110/219] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:54 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1277 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:55.453039 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-290f0ffe-1177-4ee2-b223-1ae870a83459 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.304749 Aug 27 02:27:55.454661 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 110/220] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:55 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:27:55.472938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-abac8164-b0c4-404c-b815-d600888769d5 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:55.534156 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-abac8164-b0c4-404c-b815-d600888769d5 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.065978 Aug 27 02:27:55.537563 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 111/221] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:55 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 02:27:55.552650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c9da813b-3e4a-49bd-b6df-917f227669cb tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-500746707"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:55.559771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.aggregate [None req-c9da813b-3e4a-49bd-b6df-917f227669cb tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Generated uuid 5ad7164b-f0c0-42de-bebb-e6eb2192a0f6 for aggregate {{(pid=122487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:27:55.598475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c08eadf7-c28d-44bb-9213-3bd8496d62e7 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1742916978"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:55.618593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.aggregate [None req-c08eadf7-c28d-44bb-9213-3bd8496d62e7 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Generated uuid 804fd953-80b1-42a3-aaac-7fb0d5f71165 for aggregate {{(pid=122488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:27:55.644868 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c9da813b-3e4a-49bd-b6df-917f227669cb tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.098415 Aug 27 02:27:55.660694 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 111/222] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:27:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:55.673875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-243e4974-86a7-4fbe-90fb-8e7d938b331d tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:55.692713 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c08eadf7-c28d-44bb-9213-3bd8496d62e7 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.101733 Aug 27 02:27:55.694492 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 112/223] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:27:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:55.726039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74a10c79-6e19-4fc1-a3cc-a7c278ce31f1 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:55.744593 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-243e4974-86a7-4fbe-90fb-8e7d938b331d tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.082132 Aug 27 02:27:55.745570 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 112/224] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:55 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:27:55.751064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e4b1ecf0-4a22-4fe4-8a58-09b23b347314 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:55.752305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e4b1ecf0-4a22-4fe4-8a58-09b23b347314 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:55.762198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4b1ecf0-4a22-4fe4-8a58-09b23b347314 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:55.763248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4b1ecf0-4a22-4fe4-8a58-09b23b347314 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:55.764074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4b1ecf0-4a22-4fe4-8a58-09b23b347314 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:55.765154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4b1ecf0-4a22-4fe4-8a58-09b23b347314 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:55.765293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74a10c79-6e19-4fc1-a3cc-a7c278ce31f1 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:55.766198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74a10c79-6e19-4fc1-a3cc-a7c278ce31f1 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:55.766651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4b1ecf0-4a22-4fe4-8a58-09b23b347314 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:55.766924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74a10c79-6e19-4fc1-a3cc-a7c278ce31f1 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:55.767627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4b1ecf0-4a22-4fe4-8a58-09b23b347314 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:56.052745 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-74a10c79-6e19-4fc1-a3cc-a7c278ce31f1 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.346668 Aug 27 02:27:56.068678 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 113/225] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:55 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:56.081063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c481fab-e266-48e3-a1e5-ce65e2cbc765 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:56.110589 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-4c481fab-e266-48e3-a1e5-ce65e2cbc765 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c481fab-e266-48e3-a1e5-ce65e2cbc765 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Request method failure captured: Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYDqocvrjDS-DOypI3HmoePHcRwKGc1QAenlZFLiwFgbDcPX3PXV7FTmQHfP729lC94Xkf6hhb602UCudNMfNbRfapq-52-uak806ZtVQ9iIE02MzFYuz9oHjTFTqpV-n7UBBL9sq7DcqkzvptdrlfLyWB0npvHTcw7lKgl9M3D45Uw Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 524f53b9b0414cd5b6fcf1234b3c753d Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:27:56.144097 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/524f53b9b0414cd5b6fcf1234b3c753d"}]}] Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 524f53b9b0414cd5b6fcf1234b3c753d Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AggregatesAdminTestJSON-1630653721-project-admin Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f334fdc314cc47c6ba6461c24a50bcc9 Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AggregatesAdminTestJSON-1630653721-project-admin Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: exception: Aggregate 5 could not be found. Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '5'} Aug 27 02:27:56.146947 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:56.149283 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 27 02:27:56.152582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.156930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c481fab-e266-48e3-a1e5-ce65e2cbc765 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:56.159083 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4c481fab-e266-48e3-a1e5-ce65e2cbc765 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.088049 Aug 27 02:27:56.160406 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 114/226] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:27:56 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:27:56.171531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d6256f24-7b66-435a-bb35-9a916af0191b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:56.174213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d6256f24-7b66-435a-bb35-9a916af0191b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:56.191370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6256f24-7b66-435a-bb35-9a916af0191b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:56.192756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6256f24-7b66-435a-bb35-9a916af0191b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:56.195190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6256f24-7b66-435a-bb35-9a916af0191b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:56.198250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6256f24-7b66-435a-bb35-9a916af0191b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:56.199326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6256f24-7b66-435a-bb35-9a916af0191b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:56.200386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6256f24-7b66-435a-bb35-9a916af0191b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:56.472958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d6256f24-7b66-435a-bb35-9a916af0191b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:56.493488 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d6256f24-7b66-435a-bb35-9a916af0191b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1318 microversion: 2.1 time: 0.329268 Aug 27 02:27:56.497013 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 115/227] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:56 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:56.511871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fef9246b-7b04-4cb4-b014-e6ef632d3f0f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:56.550487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fef9246b-7b04-4cb4-b014-e6ef632d3f0f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:56.551523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fef9246b-7b04-4cb4-b014-e6ef632d3f0f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:56.552522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fef9246b-7b04-4cb4-b014-e6ef632d3f0f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:56.627239 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-fef9246b-7b04-4cb4-b014-e6ef632d3f0f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h2-852084-5. Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fef9246b-7b04-4cb4-b014-e6ef632d3f0f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Request method failure captured: Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 39 Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYDvRcvgUj2XYCCxmaFIPgLgyq68w6qYU69cGRF50FDAc4NIJUyXA1YGawOyiPJdDPpheIw9OGewiQGDCQIKQbP-I_nPibPtEqC9mgrr-NlB2vjQojd2y8TMBRNfnxffK-PN12r-hjN-HvJd4LlLOVM7xKj62Sz_tCoquP6DBYSUW1g Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:27:56.651280 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/83c81f9675eb4ff59e8207277aa14f46"}]}] Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: c0a8f3f08d6343e2a80310d9608e0a00 Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: {"add_host": {"host": "n-h2-852084-5"}} Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:27:56.653117 n-d-852084-5 devstack@n-api.service[122488]: exception: Aggregate 6 already has host n-h2-852084-5. Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h2-852084-5'}}} Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:27:56.654086 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-852084-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 02:27:56.655469 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 02:27:56.656641 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:27:56.657996 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-852084-5-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 2, 27, 56, 601475), 'updated_at': None, 'host': 'n-h2-852084-5', 'aggregate_id': 6}] Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:56.659145 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h2-852084-5. Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.660308 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h2-852084-5. Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:56.661539 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:56.665722 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h2-852084-5. Aug 27 02:27:56.665722 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.665722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fef9246b-7b04-4cb4-b014-e6ef632d3f0f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Returning 409 to user: Aggregate 6 already has host n-h2-852084-5. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:56.665722 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fef9246b-7b04-4cb4-b014-e6ef632d3f0f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.164224 Aug 27 02:27:56.665722 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 116/228] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:56 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 27 02:27:56.672515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c28f6311-f286-49e1-b9b5-edb1a882a2fa tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:56.689426 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-c28f6311-f286-49e1-b9b5-edb1a882a2fa tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c28f6311-f286-49e1-b9b5-edb1a882a2fa tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Request method failure captured: Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYDqocvrjDS-DOypI3HmoePHcRwKGc1QAenlZFLiwFgbDcPX3PXV7FTmQHfP729lC94Xkf6hhb602UCudNMfNbRfapq-52-uak806ZtVQ9iIE02MzFYuz9oHjTFTqpV-n7UBBL9sq7DcqkzvptdrlfLyWB0npvHTcw7lKgl9M3D45Uw Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 524f53b9b0414cd5b6fcf1234b3c753d Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:27:56.691873 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/524f53b9b0414cd5b6fcf1234b3c753d"}]}] Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 524f53b9b0414cd5b6fcf1234b3c753d Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AggregatesAdminTestJSON-1630653721-project-admin Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f334fdc314cc47c6ba6461c24a50bcc9 Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AggregatesAdminTestJSON-1630653721-project-admin Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: exception: Aggregate 5 could not be found. Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '5'} Aug 27 02:27:56.693377 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:27:56.694256 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:56.696064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:56.697461 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:56.697461 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:56.697461 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:56.697461 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 27 02:27:56.697461 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:27:56.697461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c28f6311-f286-49e1-b9b5-edb1a882a2fa tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:56.697980 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c28f6311-f286-49e1-b9b5-edb1a882a2fa tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.030774 Aug 27 02:27:56.699201 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 117/229] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:56 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:27:56.714641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ccb77c9-e64d-4557-8f83-4809456aa5a1 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:56.717201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ccb77c9-e64d-4557-8f83-4809456aa5a1 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:56.728820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ccb77c9-e64d-4557-8f83-4809456aa5a1 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:56.729553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ccb77c9-e64d-4557-8f83-4809456aa5a1 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:56.730215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ccb77c9-e64d-4557-8f83-4809456aa5a1 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:56.731252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ccb77c9-e64d-4557-8f83-4809456aa5a1 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:56.731889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ccb77c9-e64d-4557-8f83-4809456aa5a1 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:56.732601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ccb77c9-e64d-4557-8f83-4809456aa5a1 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:56.864142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e4b1ecf0-4a22-4fe4-8a58-09b23b347314 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:56.878059 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e4b1ecf0-4a22-4fe4-8a58-09b23b347314 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1387 microversion: 2.1 time: 1.130864 Aug 27 02:27:56.878854 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 113/230] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:55 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1387 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:56.900476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-1b3597e7-1c34-4419-96dd-0b1cfdd4da55 req-4f44a1ae-0589-4ad2-aa88-e3f4d942e00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01318003-ad06-4b90-8ffd-e3d8ff4f5d32", "name": "network-vif-plugged", "status": "completed", "tag": "75ad7624-9152-4c42-8b4a-a46aab3ee07a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:56.918031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1b3597e7-1c34-4419-96dd-0b1cfdd4da55 req-4f44a1ae-0589-4ad2-aa88-e3f4d942e00a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:56.918961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1b3597e7-1c34-4419-96dd-0b1cfdd4da55 req-4f44a1ae-0589-4ad2-aa88-e3f4d942e00a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:56.919561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1b3597e7-1c34-4419-96dd-0b1cfdd4da55 req-4f44a1ae-0589-4ad2-aa88-e3f4d942e00a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:56.930122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ccb77c9-e64d-4557-8f83-4809456aa5a1 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:56.937721 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1b3597e7-1c34-4419-96dd-0b1cfdd4da55 req-4f44a1ae-0589-4ad2-aa88-e3f4d942e00a service nova] Creating event network-vif-plugged:75ad7624-9152-4c42-8b4a-a46aab3ee07a for instance 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 on n-h1-852084-5 Aug 27 02:27:56.941033 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ccb77c9-e64d-4557-8f83-4809456aa5a1 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1319 microversion: 2.1 time: 0.240456 Aug 27 02:27:56.943091 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 118/231] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:56 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:56.946840 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-1b3597e7-1c34-4419-96dd-0b1cfdd4da55 req-4f44a1ae-0589-4ad2-aa88-e3f4d942e00a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063588 Aug 27 02:27:56.948195 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 114/232] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:56.951707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-96a5ed9d-fdf1-42b6-a317-4deb7797d49f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:56.955988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2548184a-6452-4c2f-92cf-2885a242a527 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-427124672", "name": "tempest-test_aggregate-126390532"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:56.966345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96a5ed9d-fdf1-42b6-a317-4deb7797d49f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:56.967005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96a5ed9d-fdf1-42b6-a317-4deb7797d49f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:56.967474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96a5ed9d-fdf1-42b6-a317-4deb7797d49f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:56.982289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.aggregate [None req-2548184a-6452-4c2f-92cf-2885a242a527 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Generated uuid 86301ecc-f0df-4e21-8c65-9c6254b65ccd for aggregate {{(pid=122487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:27:56.999308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:DELETE=7 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:57.069358 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2548184a-6452-4c2f-92cf-2885a242a527 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.117288 Aug 27 02:27:57.071359 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 115/233] 10.222.0.99 () {60 vars in 1165 bytes} [Sat Aug 27 02:27:56 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:57.093628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-60edf598-6fe4-4ce0-8b8d-f6658dc1302c tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:57.151989 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-60edf598-6fe4-4ce0-8b8d-f6658dc1302c tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.066266 Aug 27 02:27:57.157913 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 116/234] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:57 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:27:57.191339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ae6e27d6-3b23-4943-a254-15ee2269ecd7 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:57.205040 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-ae6e27d6-3b23-4943-a254-15ee2269ecd7 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ae6e27d6-3b23-4943-a254-15ee2269ecd7 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Request method failure captured: Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDqocvrjDS-DOypI3HmoePHcRwKGc1QAenlZFLiwFgbDcPX3PXV7FTmQHfP729lC94Xkf6hhb602UCudNMfNbRfapq-52-uak806ZtVQ9iIE02MzFYuz9oHjTFTqpV-n7UBBL9sq7DcqkzvptdrlfLyWB0npvHTcw7lKgl9M3D45Uw Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 524f53b9b0414cd5b6fcf1234b3c753d Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:27:57.210459 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/524f53b9b0414cd5b6fcf1234b3c753d"}]}] Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 524f53b9b0414cd5b6fcf1234b3c753d Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminTestJSON-1630653721-project-admin Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f334fdc314cc47c6ba6461c24a50bcc9 Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminTestJSON-1630653721-project-admin Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: exception: Aggregate 7 could not be found. Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '7'} Aug 27 02:27:57.213013 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:57.214773 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 27 02:27:57.217021 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.219950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ae6e27d6-3b23-4943-a254-15ee2269ecd7 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:57.221114 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ae6e27d6-3b23-4943-a254-15ee2269ecd7 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.055210 Aug 27 02:27:57.222248 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 117/235] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:27:57 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:27:57.233133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7b04fa4-bde7-44cb-af4e-bf9d8e69833f tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:57.237619 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-96a5ed9d-fdf1-42b6-a317-4deb7797d49f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.292947 Aug 27 02:27:57.238572 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 119/236] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:56 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:57.253628 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-b7b04fa4-bde7-44cb-af4e-bf9d8e69833f tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 27 02:27:57.253983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-56767894-a6b3-4327-b8fd-a07a5ef975dc tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7b04fa4-bde7-44cb-af4e-bf9d8e69833f tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Request method failure captured: Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDqocvrjDS-DOypI3HmoePHcRwKGc1QAenlZFLiwFgbDcPX3PXV7FTmQHfP729lC94Xkf6hhb602UCudNMfNbRfapq-52-uak806ZtVQ9iIE02MzFYuz9oHjTFTqpV-n7UBBL9sq7DcqkzvptdrlfLyWB0npvHTcw7lKgl9M3D45Uw Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 524f53b9b0414cd5b6fcf1234b3c753d Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:27:57.257471 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/524f53b9b0414cd5b6fcf1234b3c753d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/524f53b9b0414cd5b6fcf1234b3c753d"}]}] Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 524f53b9b0414cd5b6fcf1234b3c753d Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1630653721 Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminTestJSON-1630653721-project-admin Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f334fdc314cc47c6ba6461c24a50bcc9 Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminTestJSON-1630653721-project-admin Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: exception: Aggregate 7 could not be found. Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '7'} Aug 27 02:27:57.259333 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:27:57.260058 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:57.261129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:57.266336 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:57.266336 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:57.266336 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:57.266336 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 27 02:27:57.266336 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.268375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7b04fa4-bde7-44cb-af4e-bf9d8e69833f tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:57.269628 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7b04fa4-bde7-44cb-af4e-bf9d8e69833f tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.042762 Aug 27 02:27:57.275377 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 118/237] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:57 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:27:57.283909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a2efd24e-8455-4f90-ab6d-5bde6b3647be tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2071916383"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:57.290097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.aggregate [None req-a2efd24e-8455-4f90-ab6d-5bde6b3647be tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Generated uuid 2ca69aad-8729-41b0-aaf0-04502c971860 for aggregate {{(pid=122487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:27:57.290999 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-56767894-a6b3-4327-b8fd-a07a5ef975dc tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.042464 Aug 27 02:27:57.298218 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 120/238] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:57 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:27:57.304209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9267ad8c-f773-4ad4-a286-15af3ca71fa2 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-428784722"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:57.310226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.aggregate [None req-9267ad8c-f773-4ad4-a286-15af3ca71fa2 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Generated uuid 3d5e62db-d120-4789-85fb-eac6ff668524 for aggregate {{(pid=122488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:27:57.344174 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9267ad8c-f773-4ad4-a286-15af3ca71fa2 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.044415 Aug 27 02:27:57.344881 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 121/239] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:27:57 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:57.364961 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a2efd24e-8455-4f90-ab6d-5bde6b3647be tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.086147 Aug 27 02:27:57.367130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0cffa7b9-72db-45c9-b829-6a85ec71a65f tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Calling method '.version_select at 0x7f4d2ad7f550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:57.376898 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 119/240] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:27:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:57.377514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cffa7b9-72db-45c9-b829-6a85ec71a65f tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:57.378661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cffa7b9-72db-45c9-b829-6a85ec71a65f tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:57.379958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cffa7b9-72db-45c9-b829-6a85ec71a65f tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:57.381351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cffa7b9-72db-45c9-b829-6a85ec71a65f tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:57.382190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cffa7b9-72db-45c9-b829-6a85ec71a65f tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:57.383039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cffa7b9-72db-45c9-b829-6a85ec71a65f tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:57.424049 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0cffa7b9-72db-45c9-b829-6a85ec71a65f tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.074720 Aug 27 02:27:57.426251 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 122/241] 10.222.0.99 () {58 vars in 1128 bytes} [Sat Aug 27 02:27:57 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:57.432878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aea3517f-4ca9-4373-b232-bcad351dcd95 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:57.445259 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aea3517f-4ca9-4373-b232-bcad351dcd95 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.017270 Aug 27 02:27:57.447097 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 123/242] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:27:57 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:57.453689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f218b44d-de3e-43f2-8122-25b70da77c28 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Calling method '.version_select at 0x7f4d2ad71160>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:57.458843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f218b44d-de3e-43f2-8122-25b70da77c28 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:57.459691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f218b44d-de3e-43f2-8122-25b70da77c28 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:57.460481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f218b44d-de3e-43f2-8122-25b70da77c28 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:57.462300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f218b44d-de3e-43f2-8122-25b70da77c28 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:57.463013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f218b44d-de3e-43f2-8122-25b70da77c28 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:57.463801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f218b44d-de3e-43f2-8122-25b70da77c28 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:57.502004 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f218b44d-de3e-43f2-8122-25b70da77c28 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.052915 Aug 27 02:27:57.503023 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 124/243] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:27:57 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:57.509115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a5e36c7c-734b-4bf3-84c7-55d233b5b56a tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:57.549741 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a5e36c7c-734b-4bf3-84c7-55d233b5b56a tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.044841 Aug 27 02:27:57.556261 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 125/244] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:57 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:57.571147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9918f9a0-b609-4258-8bf7-3cb66770d75c tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Calling method '.version_select at 0x7f4d2af90f70>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:57.585129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9918f9a0-b609-4258-8bf7-3cb66770d75c tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:57.586594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9918f9a0-b609-4258-8bf7-3cb66770d75c tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:57.588736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9918f9a0-b609-4258-8bf7-3cb66770d75c tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:57.589820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9918f9a0-b609-4258-8bf7-3cb66770d75c tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:57.594450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9918f9a0-b609-4258-8bf7-3cb66770d75c tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:57.596916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9918f9a0-b609-4258-8bf7-3cb66770d75c tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:57.644616 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9918f9a0-b609-4258-8bf7-3cb66770d75c tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.088613 Aug 27 02:27:57.647690 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 126/245] 10.222.0.99 () {58 vars in 1128 bytes} [Sat Aug 27 02:27:57 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:57.656094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50149113-83af-4e1f-ae40-8984a28252ca tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:57.662300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-50149113-83af-4e1f-ae40-8984a28252ca tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:57.679563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50149113-83af-4e1f-ae40-8984a28252ca tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:57.679851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50149113-83af-4e1f-ae40-8984a28252ca tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:57.680456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50149113-83af-4e1f-ae40-8984a28252ca tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:57.681381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50149113-83af-4e1f-ae40-8984a28252ca tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:57.682780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50149113-83af-4e1f-ae40-8984a28252ca tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:57.682780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50149113-83af-4e1f-ae40-8984a28252ca tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:57.937429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-50149113-83af-4e1f-ae40-8984a28252ca tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:57.940486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8f3b9b98-544c-4828-875e-def608eacf59 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:57.965155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8f3b9b98-544c-4828-875e-def608eacf59 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'ac51f2ebf38f422fae17edee2be1cffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b1cef13b6141f0a6ce53c57fc41b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:57.968718 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-50149113-83af-4e1f-ae40-8984a28252ca tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1318 microversion: 2.1 time: 0.318203 Aug 27 02:27:57.969697 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 127/246] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:57 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8f3b9b98-544c-4828-875e-def608eacf59 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Request method failure captured: Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 39 Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDriR2v3Oxl0OhqB1Yotl-D2p2CK0TVYB-nkosdyVEI-ndmRe5dtFzX5jalxxQTj1jmoRYAPX5s3vD_sTY2a3B7VjMbu6sv6z_WEt2lrgVP-TK6gzoEZQWbpBDzYSlB6r5_bXJGlOPXjqx3WjhV9drmCXQh7cUATlT4DE6N446qOu8 Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:27:57.972952 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/19b1cef13b6141f0a6ce53c57fc41b71"}]}] Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ac51f2ebf38f422fae17edee2be1cffc Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: {"add_host": {"host": "n-h2-852084-5"}} Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:27:57.974412 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h2-852084-5'}}} Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:27:57.975172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 27 02:27:57.976163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:57.977467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8f3b9b98-544c-4828-875e-def608eacf59 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:57.977467 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8f3b9b98-544c-4828-875e-def608eacf59 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] 10.222.0.99 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.596957 Aug 27 02:27:57.981660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-539d58b6-7127-4002-9f3b-aa918a2aedea tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:57.984335 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 120/247] 10.222.0.99 () {60 vars in 1191 bytes} [Sat Aug 27 02:27:57 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 606 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:58.001515 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-539d58b6-7127-4002-9f3b-aa918a2aedea tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.027416 Aug 27 02:27:58.005692 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 128/248] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:27:57 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:58.012711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7b3b8e9-1234-49f5-aeef-02a8e28d8c78 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Calling method '.version_select at 0x7f4d2b1b8940>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:58.027826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7b3b8e9-1234-49f5-aeef-02a8e28d8c78 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:58.029904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d544749-8a77-4eeb-969f-708294539335 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:58.031511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9d544749-8a77-4eeb-969f-708294539335 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:58.031744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7b3b8e9-1234-49f5-aeef-02a8e28d8c78 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:58.032976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7b3b8e9-1234-49f5-aeef-02a8e28d8c78 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:58.051995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d544749-8a77-4eeb-969f-708294539335 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:58.052223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:58.052788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d544749-8a77-4eeb-969f-708294539335 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:58.053534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d544749-8a77-4eeb-969f-708294539335 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:58.059109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d544749-8a77-4eeb-969f-708294539335 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:58.061876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d544749-8a77-4eeb-969f-708294539335 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:58.064116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d544749-8a77-4eeb-969f-708294539335 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:58.070680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7b3b8e9-1234-49f5-aeef-02a8e28d8c78 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:58.072855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7b3b8e9-1234-49f5-aeef-02a8e28d8c78 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:58.074941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7b3b8e9-1234-49f5-aeef-02a8e28d8c78 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:58.157192 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7b3b8e9-1234-49f5-aeef-02a8e28d8c78 tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts/n-h2-852084-5" status: 200 len: 467 microversion: 2.1 time: 0.168216 Aug 27 02:27:58.159742 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 121/249] 10.222.0.99 () {58 vars in 1170 bytes} [Sat Aug 27 02:27:57 2022] GET /compute/v2.1/os-hosts/n-h2-852084-5 => generated 467 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:58.175019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-11095dc4-e1f9-4b39-8446-35412076d805 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:58.178816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-11095dc4-e1f9-4b39-8446-35412076d805 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:58.191628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11095dc4-e1f9-4b39-8446-35412076d805 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:58.192807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11095dc4-e1f9-4b39-8446-35412076d805 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:58.193904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11095dc4-e1f9-4b39-8446-35412076d805 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:58.196719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11095dc4-e1f9-4b39-8446-35412076d805 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:58.198886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11095dc4-e1f9-4b39-8446-35412076d805 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:58.200100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11095dc4-e1f9-4b39-8446-35412076d805 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:58.630358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9d544749-8a77-4eeb-969f-708294539335 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:58.652994 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9d544749-8a77-4eeb-969f-708294539335 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1387 microversion: 2.1 time: 0.637191 Aug 27 02:27:58.654486 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 129/250] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:58 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1387 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:58.673274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-72db398a-db71-438c-afe1-23836b5419fc tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:58.745199 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-72db398a-db71-438c-afe1-23836b5419fc tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.086299 Aug 27 02:27:58.746677 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 130/251] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:58 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:27:58.785967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d975a501-a072-4495-9193-1a8e03f86606 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:58.819822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:INSERT=5 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:58.847737 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d975a501-a072-4495-9193-1a8e03f86606 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.097916 Aug 27 02:27:58.850460 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 131/252] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:27:58 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:27:58.863404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a8f2c737-9b56-434d-a24b-41c3fffc15cc tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Calling method '.version_select at 0x7f4d2af90430>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:58.880957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f2c737-9b56-434d-a24b-41c3fffc15cc tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:58.881454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f2c737-9b56-434d-a24b-41c3fffc15cc tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:58.881925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f2c737-9b56-434d-a24b-41c3fffc15cc tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:58.927677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f2c737-9b56-434d-a24b-41c3fffc15cc tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:58.927677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f2c737-9b56-434d-a24b-41c3fffc15cc tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:58.928143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f2c737-9b56-434d-a24b-41c3fffc15cc tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:58.960862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-11095dc4-e1f9-4b39-8446-35412076d805 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:27:58.978668 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-11095dc4-e1f9-4b39-8446-35412076d805 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1319 microversion: 2.1 time: 0.816988 Aug 27 02:27:58.979459 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a8f2c737-9b56-434d-a24b-41c3fffc15cc tempest-HostsAdminTestJSON-113357124 tempest-HostsAdminTestJSON-113357124-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts/n-h1-852084-5" status: 200 len: 598 microversion: 2.1 time: 0.122877 Aug 27 02:27:58.985066 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 122/253] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:58 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1319 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:27:58.988472 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 132/254] 10.222.0.99 () {58 vars in 1170 bytes} [Sat Aug 27 02:27:58 2022] GET /compute/v2.1/os-hosts/n-h1-852084-5 => generated 598 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:58.994997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d0f09f8b-7958-4f99-a373-3d97cc4ceca4 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-657380129", "availability_zone": "tempest-test_az-289578424"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:59.000032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4845c26f-eb36-46ab-9f6d-418189674da5 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1246137573"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:59.008571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.aggregate [None req-d0f09f8b-7958-4f99-a373-3d97cc4ceca4 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Generated uuid f0327b76-98ef-4013-80dc-590be1cb78b6 for aggregate {{(pid=122487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:27:59.009793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.aggregate [None req-4845c26f-eb36-46ab-9f6d-418189674da5 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Generated uuid d2c2e970-684e-424c-bb6c-242a2fc1ff31 for aggregate {{(pid=122488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:27:59.058040 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4845c26f-eb36-46ab-9f6d-418189674da5 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061914 Aug 27 02:27:59.060826 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 133/255] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:27:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:59.098811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e85e0358-7668-446b-b509-9206900535b7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:59.103799 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d0f09f8b-7958-4f99-a373-3d97cc4ceca4 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.106455 Aug 27 02:27:59.107644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e85e0358-7668-446b-b509-9206900535b7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:59.109314 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 123/256] 10.222.0.99 () {60 vars in 1165 bytes} [Sat Aug 27 02:27:58 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:59.122859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-abefafa0-1e2b-4525-8519-de00e0f4e6eb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-575958772"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:59.131256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e85e0358-7668-446b-b509-9206900535b7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:59.132189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e85e0358-7668-446b-b509-9206900535b7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:59.136844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e85e0358-7668-446b-b509-9206900535b7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:59.138067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e85e0358-7668-446b-b509-9206900535b7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:59.138776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e85e0358-7668-446b-b509-9206900535b7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:59.139440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e85e0358-7668-446b-b509-9206900535b7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:59.164724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abefafa0-1e2b-4525-8519-de00e0f4e6eb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:59.165561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abefafa0-1e2b-4525-8519-de00e0f4e6eb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:59.166306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abefafa0-1e2b-4525-8519-de00e0f4e6eb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:59.188323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abefafa0-1e2b-4525-8519-de00e0f4e6eb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:59.189368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abefafa0-1e2b-4525-8519-de00e0f4e6eb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:59.190701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abefafa0-1e2b-4525-8519-de00e0f4e6eb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:59.215505 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-abefafa0-1e2b-4525-8519-de00e0f4e6eb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-575958772 could not be found. Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-abefafa0-1e2b-4525-8519-de00e0f4e6eb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Request method failure captured: Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 57 Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDvRcvgUj2XYCCxmaFIPgLgyq68w6qYU69cGRF50FDAc4NIJUyXA1YGawOyiPJdDPpheIw9OGewiQGDCQIKQbP-I_nPibPtEqC9mgrr-NlB2vjQojd2y8TMBRNfnxffK-PN12r-hjN-HvJd4LlLOVM7xKj62Sz_tCoquP6DBYSUW1g Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:27:59.223085 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/83c81f9675eb4ff59e8207277aa14f46"}]}] Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c0a8f3f08d6343e2a80310d9608e0a00 Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: {"add_host": {"host": "tempest-nonexist_host-575958772"}} Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:27:59.224326 n-d-852084-5 devstack@n-api.service[122487]: exception: Compute host tempest-nonexist_host-575958772 could not be found. Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '10', 'body': {'add_host': {'host': 'tempest-nonexist_host-575958772'}}} Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-575958772' is not mapped to any cell Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:59.225295 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 27 02:27:59.226334 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-575958772 could not be found. Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-575958772 could not be found. Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:59.227960 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.229055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:59.229055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:59.229055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:59.229055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:27:59.229055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:27:59.229055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-575958772 could not be found. Aug 27 02:27:59.229055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.233061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-abefafa0-1e2b-4525-8519-de00e0f4e6eb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-575958772 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:59.235514 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-abefafa0-1e2b-4525-8519-de00e0f4e6eb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 110 microversion: 2.1 time: 0.122661 Aug 27 02:27:59.237596 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 124/257] 10.222.0.99 () {60 vars in 1194 bytes} [Sat Aug 27 02:27:59 2022] POST /compute/v2.1/os-aggregates/10/action => generated 110 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:59.239835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:59.250402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d9989894-249e-4c22-8db8-7cc5fe5aa4de tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-657380129_new", "availability_zone": "tempest-test_az-289578424_new"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:59.505233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9989894-249e-4c22-8db8-7cc5fe5aa4de tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:59.507016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9989894-249e-4c22-8db8-7cc5fe5aa4de tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:59.508773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9989894-249e-4c22-8db8-7cc5fe5aa4de tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:59.564300 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d9989894-249e-4c22-8db8-7cc5fe5aa4de tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 334 microversion: 2.1 time: 0.325017 Aug 27 02:27:59.575180 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 125/258] 10.222.0.99 () {60 vars in 1173 bytes} [Sat Aug 27 02:27:59 2022] PUT /compute/v2.1/os-aggregates/11 => generated 334 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:59.584130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7afea23-859c-43ea-80e4-37dd0db779a3 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:59.642071 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c7afea23-859c-43ea-80e4-37dd0db779a3 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.070759 Aug 27 02:27:59.642875 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 126/259] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:27:59 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:27:59.655765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-fe0bbc3b-4d03-49b8-b82c-4c5f5b4a08d0 req-f8fa890d-5251-4797-a6cc-1cbf6cdc6032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a8413d-9d40-41a6-82da-081f3fa797f7", "tag": "1c922404-5224-45b6-9c6c-82e2c961188a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:59.686342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fe0bbc3b-4d03-49b8-b82c-4c5f5b4a08d0 req-f8fa890d-5251-4797-a6cc-1cbf6cdc6032 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:59.686944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fe0bbc3b-4d03-49b8-b82c-4c5f5b4a08d0 req-f8fa890d-5251-4797-a6cc-1cbf6cdc6032 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:59.687403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fe0bbc3b-4d03-49b8-b82c-4c5f5b4a08d0 req-f8fa890d-5251-4797-a6cc-1cbf6cdc6032 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:59.740430 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-fe0bbc3b-4d03-49b8-b82c-4c5f5b4a08d0 req-f8fa890d-5251-4797-a6cc-1cbf6cdc6032 service nova] Creating event network-changed:1c922404-5224-45b6-9c6c-82e2c961188a for instance 35a8413d-9d40-41a6-82da-081f3fa797f7 on n-h2-852084-5 Aug 27 02:27:59.756625 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-fe0bbc3b-4d03-49b8-b82c-4c5f5b4a08d0 req-f8fa890d-5251-4797-a6cc-1cbf6cdc6032 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112331 Aug 27 02:27:59.758634 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 127/260] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:59.767261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-41e375c2-4615-4961-a36d-5588b8f25c4a tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:59.800126 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-41e375c2-4615-4961-a36d-5588b8f25c4a tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.039957 Aug 27 02:27:59.804011 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 128/261] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:27:59 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:27:59.816007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a2dfe47c-98e8-4b66-9e0b-85158164eefb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a2dfe47c-98e8-4b66-9e0b-85158164eefb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Request method failure captured: Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 283 Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDvRcvgUj2XYCCxmaFIPgLgyq68w6qYU69cGRF50FDAc4NIJUyXA1YGawOyiPJdDPpheIw9OGewiQGDCQIKQbP-I_nPibPtEqC9mgrr-NlB2vjQojd2y8TMBRNfnxffK-PN12r-hjN-HvJd4LlLOVM7xKj62Sz_tCoquP6DBYSUW1g Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:27:59.828561 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:27:59.830200 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/83c81f9675eb4ff59e8207277aa14f46"}]}] Aug 27 02:27:59.830200 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:27:59.830200 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:27:59.830200 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:27:59.830200 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:27:59.830200 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:27:59.830200 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:27:59.830200 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c0a8f3f08d6343e2a80310d9608e0a00 Aug 27 02:27:59.830200 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:27:59.830200 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:27:59.830995 n-d-852084-5 devstack@n-api.service[122487]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 02:27:59.830995 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:27:59.830995 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:27:59.830995 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 02:27:59.830995 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:27:59.830995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:59.830995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:27:59.830995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:27:59.830995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:27:59.830995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:27:59.831616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:27:59.832673 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:27:59.834917 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:27:59.834917 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:27:59.834917 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:27:59.834917 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:27:59.838086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a2dfe47c-98e8-4b66-9e0b-85158164eefb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:27:59.839991 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a2dfe47c-98e8-4b66-9e0b-85158164eefb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.032550 Aug 27 02:27:59.845523 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 129/262] 10.222.0.99 () {60 vars in 1165 bytes} [Sat Aug 27 02:27:59 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:27:59.855855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6fa5953e-4194-46d9-858e-6f0d74b96ad8 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:27:59.860533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6fa5953e-4194-46d9-858e-6f0d74b96ad8 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:27:59.882563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fa5953e-4194-46d9-858e-6f0d74b96ad8 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:59.889187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fa5953e-4194-46d9-858e-6f0d74b96ad8 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:59.891143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fa5953e-4194-46d9-858e-6f0d74b96ad8 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:27:59.902425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fa5953e-4194-46d9-858e-6f0d74b96ad8 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:27:59.903995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fa5953e-4194-46d9-858e-6f0d74b96ad8 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:27:59.908184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fa5953e-4194-46d9-858e-6f0d74b96ad8 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:00.198760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e85e0358-7668-446b-b509-9206900535b7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:00.211108 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e85e0358-7668-446b-b509-9206900535b7 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1318 microversion: 2.1 time: 1.148475 Aug 27 02:28:00.214152 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 134/263] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:59 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1318 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:00.227900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-132f8e7f-1fe0-4d77-85cc-dd379eef19b9 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:00.261961 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-132f8e7f-1fe0-4d77-85cc-dd379eef19b9 tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.046118 Aug 27 02:28:00.263003 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 135/264] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:28:00 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:28:00.272233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3eb909c9-ac23-4d69-8c8d-f4ec91c6331f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3eb909c9-ac23-4d69-8c8d-f4ec91c6331f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Request method failure captured: Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 27 Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYDvRcvgUj2XYCCxmaFIPgLgyq68w6qYU69cGRF50FDAc4NIJUyXA1YGawOyiPJdDPpheIw9OGewiQGDCQIKQbP-I_nPibPtEqC9mgrr-NlB2vjQojd2y8TMBRNfnxffK-PN12r-hjN-HvJd4LlLOVM7xKj62Sz_tCoquP6DBYSUW1g Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:28:00.278163 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/83c81f9675eb4ff59e8207277aa14f46"}]}] Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: c0a8f3f08d6343e2a80310d9608e0a00 Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: {"aggregate": {"name": ""}} Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:00.279996 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi '' Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:00.281115 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:28:00.282886 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:00.286612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3eb909c9-ac23-4d69-8c8d-f4ec91c6331f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:00.288116 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3eb909c9-ac23-4d69-8c8d-f4ec91c6331f tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.023401 Aug 27 02:28:00.290070 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 136/265] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:28:00 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:28:00.301472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5916bdd-670f-4daa-9132-f14baed21fe0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:00.302408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c5916bdd-670f-4daa-9132-f14baed21fe0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:00.311213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5916bdd-670f-4daa-9132-f14baed21fe0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:00.311460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5916bdd-670f-4daa-9132-f14baed21fe0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:00.312277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5916bdd-670f-4daa-9132-f14baed21fe0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:00.313342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5916bdd-670f-4daa-9132-f14baed21fe0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:00.314454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5916bdd-670f-4daa-9132-f14baed21fe0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:00.315039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5916bdd-670f-4daa-9132-f14baed21fe0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:00.619537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c5916bdd-670f-4daa-9132-f14baed21fe0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:00.628962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:00.635007 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c5916bdd-670f-4daa-9132-f14baed21fe0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1319 microversion: 2.1 time: 0.343187 Aug 27 02:28:00.636217 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 137/266] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:00 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:00.642450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-82709c8e-a22d-479f-976e-efded94f8b7d tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1822895595"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:00.646728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.aggregate [None req-82709c8e-a22d-479f-976e-efded94f8b7d tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Generated uuid 1cc7ed2d-4a6f-4b3c-8913-6f9081d70f32 for aggregate {{(pid=122488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:28:00.680540 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-82709c8e-a22d-479f-976e-efded94f8b7d tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041729 Aug 27 02:28:00.682004 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 138/267] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:28:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:00.689500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5cca9540-4e4f-485a-9811-1275651882d4 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-776025852"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:00.697617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5cca9540-4e4f-485a-9811-1275651882d4 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'ac51f2ebf38f422fae17edee2be1cffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b1cef13b6141f0a6ce53c57fc41b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5cca9540-4e4f-485a-9811-1275651882d4 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Request method failure captured: Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 59 Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYDriR2v3Oxl0OhqB1Yotl-D2p2CK0TVYB-nkosdyVEI-ndmRe5dtFzX5jalxxQTj1jmoRYAPX5s3vD_sTY2a3B7VjMbu6sv6z_WEt2lrgVP-TK6gzoEZQWbpBDzYSlB6r5_bXJGlOPXjqx3WjhV9drmCXQh7cUATlT4DE6N446qOu8 Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:00.699984 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/19b1cef13b6141f0a6ce53c57fc41b71"}]}] Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ac51f2ebf38f422fae17edee2be1cffc Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: {"aggregate": {"name": "tempest-test_aggregate-776025852"}} Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:00.701285 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-776025852'}}} Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:00.702667 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:00.703729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 27 02:28:00.704746 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:00.708618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5cca9540-4e4f-485a-9811-1275651882d4 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:00.710731 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5cca9540-4e4f-485a-9811-1275651882d4 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.026577 Aug 27 02:28:00.717025 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 139/268] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:28:00 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:00.730512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4fb3c3a-f492-4725-8342-407188e2028c tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:00.741722 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4fb3c3a-f492-4725-8342-407188e2028c tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.022405 Aug 27 02:28:00.743562 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 140/269] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:28:00 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:00.749563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f3e654cf-a4eb-45c1-8572-2d24cbdd8fec tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-429953034"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:00.756735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.aggregate [None req-f3e654cf-a4eb-45c1-8572-2d24cbdd8fec tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Generated uuid 90823a2d-ffd6-45f6-b1e2-00e29060eb62 for aggregate {{(pid=122488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:28:00.812863 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f3e654cf-a4eb-45c1-8572-2d24cbdd8fec tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067769 Aug 27 02:28:00.824490 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 141/270] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:28:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:00.831214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a92c210c-ed67-439d-a0ad-f3b13a80d2dc tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:00.867770 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a92c210c-ed67-439d-a0ad-f3b13a80d2dc tempest-AggregatesAdminTestJSON-1630653721 tempest-AggregatesAdminTestJSON-1630653721-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.041520 Aug 27 02:28:00.868856 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 142/271] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:28:00 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:28:01.085522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-123f667a-4d8e-457a-9bbf-88efe6e9716b tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Action: 'create', calling method: .version_select at 0x7f4d2af90790>, body: {"keypair": {"name": "tempest-keypair-273046865", "type": "ssh", "user_id": "535ebe039b2646618927b593c9a8efad", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFA8l91rIeJa+fQEnGByIHhePxpK73T/ESTOVQx/jRuYjAtTkve1WQOu+lG/LJZ0M+uUr6U0MwOByGWQeOd7WVVm4udDQXWJwpmpsRBaZIvH5eBnPVoS7wdvXUgGY/g7Cw=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:01.121074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-123f667a-4d8e-457a-9bbf-88efe6e9716b tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Getting quotas for project ab9b3c7d34f148b3ae7064a3e04e1d59. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:28:01.130013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-123f667a-4d8e-457a-9bbf-88efe6e9716b tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Getting quotas for user 6d3fc3b0b00e4cfb8ab6be9a6cc4e7c1 and project ab9b3c7d34f148b3ae7064a3e04e1d59. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:28:01.135543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6fa5953e-4194-46d9-858e-6f0d74b96ad8 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:01.165774 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6fa5953e-4194-46d9-858e-6f0d74b96ad8 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1387 microversion: 2.1 time: 1.317021 Aug 27 02:28:01.166718 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 130/272] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:27:59 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1387 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:01.184630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-21980f8d-6120-4eec-892f-8f5d0c9c05bd tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-429953034"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:01.194477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.aggregate [None req-21980f8d-6120-4eec-892f-8f5d0c9c05bd tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Generated uuid 8b95cb3e-ed27-4705-8c9f-9c8794b86a38 for aggregate {{(pid=122487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:28:01.219645 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-123f667a-4d8e-457a-9bbf-88efe6e9716b tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.349112 Aug 27 02:28:01.221504 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 143/273] 10.222.0.99 () {62 vars in 1200 bytes} [Sat Aug 27 02:28:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 352 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:28:01.236670 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-21980f8d-6120-4eec-892f-8f5d0c9c05bd tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-429953034 already exists. Aug 27 02:28:01.239657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:01.240533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-21980f8d-6120-4eec-892f-8f5d0c9c05bd tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Request method failure captured: Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 59 Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDvRcvgUj2XYCCxmaFIPgLgyq68w6qYU69cGRF50FDAc4NIJUyXA1YGawOyiPJdDPpheIw9OGewiQGDCQIKQbP-I_nPibPtEqC9mgrr-NlB2vjQojd2y8TMBRNfnxffK-PN12r-hjN-HvJd4LlLOVM7xKj62Sz_tCoquP6DBYSUW1g Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:01.242620 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/83c81f9675eb4ff59e8207277aa14f46"}]}] Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c0a8f3f08d6343e2a80310d9608e0a00 Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: {"aggregate": {"name": "tempest-test_aggregate-429953034"}} Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:01.244220 n-d-852084-5 devstack@n-api.service[122487]: exception: Aggregate tempest-test_aggregate-429953034 already exists. Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-429953034'}}} Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 27 02:28:01.244983 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-429953034 already exists. Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:01.246186 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-429953034 already exists. Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-429953034 already exists. Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-21980f8d-6120-4eec-892f-8f5d0c9c05bd tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-429953034 already exists. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:01.247283 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-21980f8d-6120-4eec-892f-8f5d0c9c05bd tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.076961 Aug 27 02:28:01.253869 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 131/274] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:28:01 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:28:01.262083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:01.262956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:01.264175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:01.265187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:01.265977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:01.266638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:01.271817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-06d4b939-ff03-4166-8f14-5fdebe9f062b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:01.272993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-06d4b939-ff03-4166-8f14-5fdebe9f062b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:01.286147 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] HTTP exception thrown: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Request method failure captured: Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 HTTP/1.1 Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYDo8la1n1ajYz-D3SsYq26L2E7c9fUfYrKFC0rkFFVBXXUnV0pGct3TkdEsNsFEF7RlGBapUso19jf7GvTK-bJ5nagngsJEZxD44b5ex67HE_pqVHdziHi5XF1CZ21fRI4gHePek5MovogjOPDIl0UTgjgC6ZT4DtpPL0_hCyK-Qug Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: cf8c9873f5654f1abf00234014d85a77 Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AggregatesAdminTestJSON-1605603608 Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:01.289858 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cf8c9873f5654f1abf00234014d85a77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cf8c9873f5654f1abf00234014d85a77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cf8c9873f5654f1abf00234014d85a77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cf8c9873f5654f1abf00234014d85a77"}]}] Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AggregatesAdminTestJSON-1605603608 Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: cf8c9873f5654f1abf00234014d85a77 Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1605603608 Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AggregatesAdminTestJSON-1605603608-project Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0be691c6ab4d4aff9c2bda2bb31c54bc Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AggregatesAdminTestJSON-1605603608-project Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:28:01.291116 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '9c964ffb-a951-4b4f-aebd-22f04a2caa23'} Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:01.291764 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:28:01.292803 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.307000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Returning 404 to user: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:01.313841 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5992f8d9-1507-49af-b404-9e7597824882 tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 404 len: 111 microversion: 2.1 time: 0.087394 Aug 27 02:28:01.315378 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 144/275] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:28:01 2022] DELETE /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:01.319982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06d4b939-ff03-4166-8f14-5fdebe9f062b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:01.321709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06d4b939-ff03-4166-8f14-5fdebe9f062b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:01.322641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06d4b939-ff03-4166-8f14-5fdebe9f062b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:01.324375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-16cd358f-855c-425e-8a61-f82b24b29c82 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Action: 'create', calling method: .version_select at 0x7f4d2ad71430>, body: {"keypair": {"name": "tempest-keypair-502874886", "type": "ssh", "user_id": "535ebe039b2646618927b593c9a8efad", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5yFoE+T6iSuuz7+kgrfE8X59qg5LL8DzjRHozSqYp8J2wBMje8vm5UaIK8921/shgp/6+PD5d5UvIzEFuIovCciyz7U5uMXvWTCFA2oLmmwLLOWP4LPjBL51nNNTBc5g=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:01.325659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06d4b939-ff03-4166-8f14-5fdebe9f062b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:01.327371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06d4b939-ff03-4166-8f14-5fdebe9f062b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:01.328522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06d4b939-ff03-4166-8f14-5fdebe9f062b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:01.395126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-16cd358f-855c-425e-8a61-f82b24b29c82 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Getting quotas for project ab9b3c7d34f148b3ae7064a3e04e1d59. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:28:01.401805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-16cd358f-855c-425e-8a61-f82b24b29c82 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Getting quotas for user 6d3fc3b0b00e4cfb8ab6be9a6cc4e7c1 and project ab9b3c7d34f148b3ae7064a3e04e1d59. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:28:01.447934 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-16cd358f-855c-425e-8a61-f82b24b29c82 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.129250 Aug 27 02:28:01.455105 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 145/276] 10.222.0.99 () {62 vars in 1200 bytes} [Sat Aug 27 02:28:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:28:01.465706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7671e581-bd22-40ba-b858-ec19e32492c1 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:01.519977 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7671e581-bd22-40ba-b858-ec19e32492c1 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.059614 Aug 27 02:28:01.521219 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 146/277] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:28:01 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:28:01.530405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:01.531612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] [instance: 9c964ffb-a951-4b4f-aebd-22f04a2caa23] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:01.540630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:01.541759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:01.542395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:01.543324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:01.543802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:01.544237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:01.570740 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] HTTP exception thrown: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Request method failure captured: Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 HTTP/1.1 Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYDo8la1n1ajYz-D3SsYq26L2E7c9fUfYrKFC0rkFFVBXXUnV0pGct3TkdEsNsFEF7RlGBapUso19jf7GvTK-bJ5nagngsJEZxD44b5ex67HE_pqVHdziHi5XF1CZ21fRI4gHePek5MovogjOPDIl0UTgjgC6ZT4DtpPL0_hCyK-Qug Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: cf8c9873f5654f1abf00234014d85a77 Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AggregatesAdminTestJSON-1605603608 Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:01.572729 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cf8c9873f5654f1abf00234014d85a77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cf8c9873f5654f1abf00234014d85a77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cf8c9873f5654f1abf00234014d85a77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cf8c9873f5654f1abf00234014d85a77"}]}] Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AggregatesAdminTestJSON-1605603608 Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: cf8c9873f5654f1abf00234014d85a77 Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1605603608 Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AggregatesAdminTestJSON-1605603608-project Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0be691c6ab4d4aff9c2bda2bb31c54bc Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AggregatesAdminTestJSON-1605603608-project Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:28:01.573933 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '9c964ffb-a951-4b4f-aebd-22f04a2caa23'} Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:01.574592 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. Aug 27 02:28:01.575625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.579680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] Returning 404 to user: Instance 9c964ffb-a951-4b4f-aebd-22f04a2caa23 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:01.582103 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-74abc4b4-b961-406c-bbe9-c566e710344d tempest-AggregatesAdminTestJSON-1605603608 tempest-AggregatesAdminTestJSON-1605603608-project] 10.222.0.99 "GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23" status: 404 len: 111 microversion: 2.1 time: 0.058620 Aug 27 02:28:01.584591 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 147/278] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:01 2022] GET /compute/v2.1/servers/9c964ffb-a951-4b4f-aebd-22f04a2caa23 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:01.594767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bae36fee-5eb9-4a42-b341-870701a2b417 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Calling method '.version_select at 0x7f4d2addef70>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:01.608429 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bae36fee-5eb9-4a42-b341-870701a2b417 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] 10.222.0.99 "GET /compute/v2.1/os-keypairs/tempest-keypair-273046865?user_id=535ebe039b2646618927b593c9a8efad" status: 200 len: 511 microversion: 2.10 time: 0.020946 Aug 27 02:28:01.609359 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 148/279] 10.222.0.99 () {60 vars in 1337 bytes} [Sat Aug 27 02:28:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-273046865?user_id=535ebe039b2646618927b593c9a8efad => generated 511 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:01.623049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bae77ef4-5ccc-45d0-abf0-2e79c83068a5 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1187356215"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:01.638839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.aggregate [None req-bae77ef4-5ccc-45d0-abf0-2e79c83068a5 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Generated uuid 7b100cc7-e18e-48c5-987c-0c2087b6eb62 for aggregate {{(pid=122488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:28:01.704145 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bae77ef4-5ccc-45d0-abf0-2e79c83068a5 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.091109 Aug 27 02:28:01.712400 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 149/280] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:28:01 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:01.718319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f938057e-7420-482c-8516-2ec2623af683 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Action: 'create', calling method: .version_select at 0x7f4d2ad52670>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1098374812", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJujCVIubkWZ1GCfC0Lev02XIkPcPfbCP+q7WGTkdfImk+Rao6gGA6KERfWZNfhMQ7CfI+5Xf3f8trV8cux7CXz9OxPHj0+3ClJvbsLOoc78Q+AuG0xmwdjIqWPlGy3czA=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:01.756815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f938057e-7420-482c-8516-2ec2623af683 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Getting quotas for project ab9b3c7d34f148b3ae7064a3e04e1d59. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:28:01.763351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f938057e-7420-482c-8516-2ec2623af683 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Getting quotas for user 6d3fc3b0b00e4cfb8ab6be9a6cc4e7c1 and project ab9b3c7d34f148b3ae7064a3e04e1d59. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:28:01.799544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-06d4b939-ff03-4166-8f14-5fdebe9f062b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:01.802689 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f938057e-7420-482c-8516-2ec2623af683 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.086825 Aug 27 02:28:01.812626 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 150/281] 10.222.0.99 () {62 vars in 1200 bytes} [Sat Aug 27 02:28:01 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:28:01.812830 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-06d4b939-ff03-4166-8f14-5fdebe9f062b tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1468 microversion: 2.1 time: 0.555455 Aug 27 02:28:01.816223 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 132/282] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:01 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1468 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:01.832453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0e461954-f7a1-4d31-ba2a-6a2482ad000c tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:01.837150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-754ff985-9d12-47f0-b7f3-a694fb003491 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:01.837403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-754ff985-9d12-47f0-b7f3-a694fb003491 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:01.840684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0e461954-f7a1-4d31-ba2a-6a2482ad000c tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'ac51f2ebf38f422fae17edee2be1cffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b1cef13b6141f0a6ce53c57fc41b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0e461954-f7a1-4d31-ba2a-6a2482ad000c tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Request method failure captured: Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDriR2v3Oxl0OhqB1Yotl-D2p2CK0TVYB-nkosdyVEI-ndmRe5dtFzX5jalxxQTj1jmoRYAPX5s3vD_sTY2a3B7VjMbu6sv6z_WEt2lrgVP-TK6gzoEZQWbpBDzYSlB6r5_bXJGlOPXjqx3WjhV9drmCXQh7cUATlT4DE6N446qOu8 Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:01.847482 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/19b1cef13b6141f0a6ce53c57fc41b71"}]}] Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ac51f2ebf38f422fae17edee2be1cffc Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 02:28:01.848726 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '14'} Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:01.849371 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 27 02:28:01.850418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:01.854773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0e461954-f7a1-4d31-ba2a-6a2482ad000c tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:01.859298 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0e461954-f7a1-4d31-ba2a-6a2482ad000c tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/14" status: 403 len: 116 microversion: 2.1 time: 0.041770 Aug 27 02:28:01.863862 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 133/283] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:28:01 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 116 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:01.877529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0604542e-e28c-489c-b3b9-65c01b770cf8 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Calling method '.version_select at 0x7f4d2af93a60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:01.881936 n-d-852084-5 devstack@n-api.service[122487]: WARNING oslo_db.sqlalchemy.utils [None req-0604542e-e28c-489c-b3b9-65c01b770cf8 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 02:28:01.903992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-754ff985-9d12-47f0-b7f3-a694fb003491 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:01.905762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-754ff985-9d12-47f0-b7f3-a694fb003491 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:01.908175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-754ff985-9d12-47f0-b7f3-a694fb003491 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:01.910238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-754ff985-9d12-47f0-b7f3-a694fb003491 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:01.911138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-754ff985-9d12-47f0-b7f3-a694fb003491 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:01.912058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-754ff985-9d12-47f0-b7f3-a694fb003491 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:01.920795 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0604542e-e28c-489c-b3b9-65c01b770cf8 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] 10.222.0.99 "GET /compute/v2.1/os-keypairs?user_id=535ebe039b2646618927b593c9a8efad" status: 200 len: 724 microversion: 2.10 time: 0.052030 Aug 27 02:28:01.922767 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 134/284] 10.222.0.99 () {60 vars in 1259 bytes} [Sat Aug 27 02:28:01 2022] GET /compute/v2.1/os-keypairs?user_id=535ebe039b2646618927b593c9a8efad => generated 724 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:02.199101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-889644017", "block_migration": true, "disk_over_commit": false}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:02.202210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:02.217711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:02.218748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:02.221314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:02.222630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:02.225715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:02.228012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:02.750437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-754ff985-9d12-47f0-b7f3-a694fb003491 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:02.785741 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-754ff985-9d12-47f0-b7f3-a694fb003491 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1319 microversion: 2.1 time: 0.976562 Aug 27 02:28:02.786878 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 151/285] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:01 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1319 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:02.839332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-34411de3-5dba-47db-95bf-198138ed4ad8 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:02.921840 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-34411de3-5dba-47db-95bf-198138ed4ad8 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.115242 Aug 27 02:28:02.935581 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 152/286] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:28:02 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:28:02.945611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ca73e4a-f26e-4a60-9d13-8a85d2d77b36 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Calling method '.version_select at 0x7f4d2ad52f70>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:02.978071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:03.012045 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ca73e4a-f26e-4a60-9d13-8a85d2d77b36 tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1098374812" status: 204 len: 0 microversion: 2.10 time: 0.074439 Aug 27 02:28:03.014004 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 153/287] 10.222.0.99 () {60 vars in 1325 bytes} [Sat Aug 27 02:28:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1098374812 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:28:03.024223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b807dc89-7f70-43ac-93b8-d2f26a450360 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:03.025276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b807dc89-7f70-43ac-93b8-d2f26a450360 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:03.062447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b807dc89-7f70-43ac-93b8-d2f26a450360 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:03.063182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b807dc89-7f70-43ac-93b8-d2f26a450360 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:03.063907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b807dc89-7f70-43ac-93b8-d2f26a450360 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:03.065713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b807dc89-7f70-43ac-93b8-d2f26a450360 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:03.071144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b807dc89-7f70-43ac-93b8-d2f26a450360 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:03.073154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b807dc89-7f70-43ac-93b8-d2f26a450360 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:03.247135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lazy-loading 'flavor' on Instance uuid 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:28:03.396558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Going to try to live migrate instance to tempest-host-889644017 {{(pid=122487) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:28:03.416412 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] HTTP exception thrown: Compute host tempest-host-889644017 could not be found. Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Request method failure captured: Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32/action HTTP/1.1 Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 106 Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYETPhk728VVWR-QkBmYzHDGTPy47zyUjnPjKGWut-RldC7WPV0nzh5L3wFWZYxbCAvMQUSFGtVdxlv_dIYeBfSRjaRF5sTf9vFMCqfPz8Q1f5AySnq1buQGyuIa33qkzqLoScA5WCG7It82V7P90Izk7aS5dKrl0VCZmiOSxnC_HJM Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 5d19ae14d02d45028c5e9653f404bd57 Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-LiveMigrationNegativeTest-1176584473 Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:03.435824 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5d19ae14d02d45028c5e9653f404bd57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5d19ae14d02d45028c5e9653f404bd57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5d19ae14d02d45028c5e9653f404bd57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5d19ae14d02d45028c5e9653f404bd57"}]}] Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-LiveMigrationNegativeTest-1176584473 Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 5d19ae14d02d45028c5e9653f404bd57 Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1176584473 Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-LiveMigrationNegativeTest-1176584473-project-admin Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 3d77c58c55c94d4992276c52736aae2b Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-LiveMigrationNegativeTest-1176584473-project-admin Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: {"os-migrateLive": {"host": "tempest-host-889644017", "block_migration": true, "disk_over_commit": false}} Aug 27 02:28:03.437069 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: exception: Compute host tempest-host-889644017 could not be found. Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '01318003-ad06-4b90-8ffd-e3d8ff4f5d32', 'body': {'os-migrateLive': {'host': 'tempest-host-889644017', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:28:03.437795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-889644017 could not be found. Aug 27 02:28:03.438932 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-889644017 could not be found. Aug 27 02:28:03.439945 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:03.443414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:03.443414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:03.443414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:03.443414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:03.443414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:03.443414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:03.443414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:03.443414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-889644017 could not be found. Aug 27 02:28:03.443414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:03.443414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Returning 400 to user: Compute host tempest-host-889644017 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:03.443414 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b088a07e-bad8-44ba-82f3-74faf7163cba tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32/action" status: 400 len: 99 microversion: 2.1 time: 1.509122 Aug 27 02:28:03.446314 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 135/288] 10.222.0.99 () {60 vars in 1279 bytes} [Sat Aug 27 02:28:01 2022] POST /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32/action => generated 99 bytes in 1518 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:03.457310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-1244a1ee-e826-4f60-89e7-b0fc05466891 req-f8e2cf92-3597-4ba2-ba21-f4d0d4270d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32472eac-0284-4cff-9e87-1884b0bd6d96", "name": "network-vif-plugged", "status": "completed", "tag": "50e81101-2512-4821-83a6-6e19294005b3"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:03.491041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1244a1ee-e826-4f60-89e7-b0fc05466891 req-f8e2cf92-3597-4ba2-ba21-f4d0d4270d0b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:03.491587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1244a1ee-e826-4f60-89e7-b0fc05466891 req-f8e2cf92-3597-4ba2-ba21-f4d0d4270d0b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:03.491978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1244a1ee-e826-4f60-89e7-b0fc05466891 req-f8e2cf92-3597-4ba2-ba21-f4d0d4270d0b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:03.528339 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1244a1ee-e826-4f60-89e7-b0fc05466891 req-f8e2cf92-3597-4ba2-ba21-f4d0d4270d0b service nova] Creating event network-vif-plugged:50e81101-2512-4821-83a6-6e19294005b3 for instance 32472eac-0284-4cff-9e87-1884b0bd6d96 on n-h1-852084-5 Aug 27 02:28:03.542649 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-1244a1ee-e826-4f60-89e7-b0fc05466891 req-f8e2cf92-3597-4ba2-ba21-f4d0d4270d0b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094321 Aug 27 02:28:03.546100 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 136/289] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:03.558658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-18e94a62-10f1-4fd1-a36a-b1e9eb53588b tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:03.591310 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-18e94a62-10f1-4fd1-a36a-b1e9eb53588b tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-18e94a62-10f1-4fd1-a36a-b1e9eb53588b tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Request method failure captured: Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDvRcvgUj2XYCCxmaFIPgLgyq68w6qYU69cGRF50FDAc4NIJUyXA1YGawOyiPJdDPpheIw9OGewiQGDCQIKQbP-I_nPibPtEqC9mgrr-NlB2vjQojd2y8TMBRNfnxffK-PN12r-hjN-HvJd4LlLOVM7xKj62Sz_tCoquP6DBYSUW1g Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:03.593424 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/83c81f9675eb4ff59e8207277aa14f46"}]}] Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c0a8f3f08d6343e2a80310d9608e0a00 Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: exception: Aggregate -1 could not be found. Aug 27 02:28:03.594790 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '-1'} Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:28:03.595425 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:03.596662 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:03.600421 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:03.600421 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:03.600421 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:03.600421 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:03.600421 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 02:28:03.600421 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:03.600421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-18e94a62-10f1-4fd1-a36a-b1e9eb53588b tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:03.602605 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-18e94a62-10f1-4fd1-a36a-b1e9eb53588b tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.053500 Aug 27 02:28:03.603552 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 137/290] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:28:03 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:28:03.627203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4f8f23e8-56f6-47aa-ad93-e4c69b33df3f tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Calling method '.version_select at 0x7f4d2aed7f70>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:03.697305 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4f8f23e8-56f6-47aa-ad93-e4c69b33df3f tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-502874886?user_id=535ebe039b2646618927b593c9a8efad" status: 204 len: 0 microversion: 2.10 time: 0.082802 Aug 27 02:28:03.698429 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 138/291] 10.222.0.99 () {60 vars in 1340 bytes} [Sat Aug 27 02:28:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-502874886?user_id=535ebe039b2646618927b593c9a8efad => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:28:03.707167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-934840fa-22b7-4ab1-99a0-c699efd614a6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:03.707927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-934840fa-22b7-4ab1-99a0-c699efd614a6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:03.717948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-934840fa-22b7-4ab1-99a0-c699efd614a6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:03.718537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-934840fa-22b7-4ab1-99a0-c699efd614a6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:03.718992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-934840fa-22b7-4ab1-99a0-c699efd614a6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:03.719872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-934840fa-22b7-4ab1-99a0-c699efd614a6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:03.721026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-934840fa-22b7-4ab1-99a0-c699efd614a6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:03.721026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-934840fa-22b7-4ab1-99a0-c699efd614a6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:03.894419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b807dc89-7f70-43ac-93b8-d2f26a450360 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:03.908340 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b807dc89-7f70-43ac-93b8-d2f26a450360 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1387 microversion: 2.1 time: 0.892545 Aug 27 02:28:03.931608 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 154/292] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:03 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1387 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:03.953876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a298e06c-1a09-44b4-9e80-04427eac8600 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-115675853"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:03.963906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.aggregate [None req-a298e06c-1a09-44b4-9e80-04427eac8600 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Generated uuid 364ecb0b-77d2-4658-8662-66f31c6abf1c for aggregate {{(pid=122488) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:28:04.030344 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a298e06c-1a09-44b4-9e80-04427eac8600 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.095938 Aug 27 02:28:04.032509 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 155/293] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:28:03 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:04.050340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-749ad1d9-e625-4dc2-888f-abcafccd339e tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] Calling method '.version_select at 0x7f4d2ad52a60>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:04.115496 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-749ad1d9-e625-4dc2-888f-abcafccd339e tempest-KeyPairsV210TestJSON-1938902713 tempest-KeyPairsV210TestJSON-1938902713-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-273046865?user_id=535ebe039b2646618927b593c9a8efad" status: 204 len: 0 microversion: 2.10 time: 0.079554 Aug 27 02:28:04.116599 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 156/294] 10.222.0.99 () {60 vars in 1340 bytes} [Sat Aug 27 02:28:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-273046865?user_id=535ebe039b2646618927b593c9a8efad => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:28:04.139326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-689ca54f-7ef5-4b23-bdbe-4ac7a9bc6626 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:04.140856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-689ca54f-7ef5-4b23-bdbe-4ac7a9bc6626 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:04.170552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-689ca54f-7ef5-4b23-bdbe-4ac7a9bc6626 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:04.176909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-689ca54f-7ef5-4b23-bdbe-4ac7a9bc6626 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:04.187137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-689ca54f-7ef5-4b23-bdbe-4ac7a9bc6626 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:04.194255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-689ca54f-7ef5-4b23-bdbe-4ac7a9bc6626 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:04.200559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-689ca54f-7ef5-4b23-bdbe-4ac7a9bc6626 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:04.204465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-689ca54f-7ef5-4b23-bdbe-4ac7a9bc6626 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:04.615310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-934840fa-22b7-4ab1-99a0-c699efd614a6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:04.632097 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-934840fa-22b7-4ab1-99a0-c699efd614a6 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1468 microversion: 2.1 time: 0.928038 Aug 27 02:28:04.634977 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 139/295] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:03 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1468 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:04.650207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-664e3c91-d41d-4161-9e55-5715550c5076 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:04.651812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-664e3c91-d41d-4161-9e55-5715550c5076 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'ac51f2ebf38f422fae17edee2be1cffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b1cef13b6141f0a6ce53c57fc41b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-664e3c91-d41d-4161-9e55-5715550c5076 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Request method failure captured: Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDriR2v3Oxl0OhqB1Yotl-D2p2CK0TVYB-nkosdyVEI-ndmRe5dtFzX5jalxxQTj1jmoRYAPX5s3vD_sTY2a3B7VjMbu6sv6z_WEt2lrgVP-TK6gzoEZQWbpBDzYSlB6r5_bXJGlOPXjqx3WjhV9drmCXQh7cUATlT4DE6N446qOu8 Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:04.656565 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/19b1cef13b6141f0a6ce53c57fc41b71"}]}] Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ac51f2ebf38f422fae17edee2be1cffc Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 02:28:04.659379 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '15'} Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:04.661531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:04.665925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-664e3c91-d41d-4161-9e55-5715550c5076 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:04.670961 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-664e3c91-d41d-4161-9e55-5715550c5076 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] 10.222.0.99 "GET /compute/v2.1/os-aggregates/15" status: 403 len: 114 microversion: 2.1 time: 0.022635 Aug 27 02:28:04.670961 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 140/296] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:28:04 2022] GET /compute/v2.1/os-aggregates/15 => generated 114 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:04.671985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8b314c90-f3c1-4e70-ba79-7c6667165e90 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:04.734629 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8b314c90-f3c1-4e70-ba79-7c6667165e90 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.067565 Aug 27 02:28:04.735617 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 141/297] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:28:04 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:28:04.747143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6add3f47-4fd9-4acf-8037-6d43ff64bd24 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:04.761747 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-6add3f47-4fd9-4acf-8037-6d43ff64bd24 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6add3f47-4fd9-4acf-8037-6d43ff64bd24 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Request method failure captured: Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDvRcvgUj2XYCCxmaFIPgLgyq68w6qYU69cGRF50FDAc4NIJUyXA1YGawOyiPJdDPpheIw9OGewiQGDCQIKQbP-I_nPibPtEqC9mgrr-NlB2vjQojd2y8TMBRNfnxffK-PN12r-hjN-HvJd4LlLOVM7xKj62Sz_tCoquP6DBYSUW1g Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:04.765411 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/83c81f9675eb4ff59e8207277aa14f46"}]}] Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c0a8f3f08d6343e2a80310d9608e0a00 Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: exception: Aggregate -1 could not be found. Aug 27 02:28:04.766771 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '-1'} Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:04.767404 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 27 02:28:04.768433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:04.771584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6add3f47-4fd9-4acf-8037-6d43ff64bd24 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:04.772658 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6add3f47-4fd9-4acf-8037-6d43ff64bd24 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.031788 Aug 27 02:28:04.773953 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 142/298] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:28:04 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:28:04.789800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2180466-3fd2-4fd8-a83b-eef4cf40cc73 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:04.799142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c2180466-3fd2-4fd8-a83b-eef4cf40cc73 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'ac51f2ebf38f422fae17edee2be1cffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b1cef13b6141f0a6ce53c57fc41b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2180466-3fd2-4fd8-a83b-eef4cf40cc73 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Request method failure captured: Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDriR2v3Oxl0OhqB1Yotl-D2p2CK0TVYB-nkosdyVEI-ndmRe5dtFzX5jalxxQTj1jmoRYAPX5s3vD_sTY2a3B7VjMbu6sv6z_WEt2lrgVP-TK6gzoEZQWbpBDzYSlB6r5_bXJGlOPXjqx3WjhV9drmCXQh7cUATlT4DE6N446qOu8 Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:04.803506 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/19b1cef13b6141f0a6ce53c57fc41b71"}]}] Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ac51f2ebf38f422fae17edee2be1cffc Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 02:28:04.805545 n-d-852084-5 devstack@n-api.service[122487]: action_args: {} Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:04.806358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 27 02:28:04.807565 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:04.810377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2180466-3fd2-4fd8-a83b-eef4cf40cc73 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:04.814980 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c2180466-3fd2-4fd8-a83b-eef4cf40cc73 tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] 10.222.0.99 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.034372 Aug 27 02:28:04.819998 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 143/299] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:28:04 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:04.837932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-689ca54f-7ef5-4b23-bdbe-4ac7a9bc6626 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:04.838829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ad775348-4fd3-4419-bbf1-dfd3547196cb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-936898076"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:04.842696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.aggregate [None req-ad775348-4fd3-4419-bbf1-dfd3547196cb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Generated uuid 81f29ffc-303b-408f-9dda-a98cf30bfe60 for aggregate {{(pid=122487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:28:04.863073 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-689ca54f-7ef5-4b23-bdbe-4ac7a9bc6626 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1319 microversion: 2.1 time: 0.734455 Aug 27 02:28:04.865085 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 157/300] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:04 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1319 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:04.918194 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ad775348-4fd3-4419-bbf1-dfd3547196cb tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.090893 Aug 27 02:28:04.925024 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 144/301] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:28:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:28:04.935381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a143ff49-9cd0-4419-a608-9ce583ec046d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:04.936623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a143ff49-9cd0-4419-a608-9ce583ec046d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:04.941284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-44c36c8f-473f-44bb-b4b0-9d243bfcc513 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:04.976972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44c36c8f-473f-44bb-b4b0-9d243bfcc513 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:04.978025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44c36c8f-473f-44bb-b4b0-9d243bfcc513 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:04.978788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44c36c8f-473f-44bb-b4b0-9d243bfcc513 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:04.979851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a143ff49-9cd0-4419-a608-9ce583ec046d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:04.980716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a143ff49-9cd0-4419-a608-9ce583ec046d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:04.981996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:04.996006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a143ff49-9cd0-4419-a608-9ce583ec046d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:05.003366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a143ff49-9cd0-4419-a608-9ce583ec046d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:05.014688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a143ff49-9cd0-4419-a608-9ce583ec046d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:05.016508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a143ff49-9cd0-4419-a608-9ce583ec046d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:05.263279 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-44c36c8f-473f-44bb-b4b0-9d243bfcc513 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 242 microversion: 2.1 time: 0.334567 Aug 27 02:28:05.264233 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 145/302] 10.222.0.99 () {60 vars in 1194 bytes} [Sat Aug 27 02:28:04 2022] POST /compute/v2.1/os-aggregates/16/action => generated 242 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:05.275335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1482705526", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:05.391065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:28:05.466503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a143ff49-9cd0-4419-a608-9ce583ec046d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:05.482293 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a143ff49-9cd0-4419-a608-9ce583ec046d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1387 microversion: 2.1 time: 0.553555 Aug 27 02:28:05.484786 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 158/303] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:04 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1387 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:05.496442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f90bdaf-6e4f-4236-b369-6b0ee4aae64b tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:05.506023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6f90bdaf-6e4f-4236-b369-6b0ee4aae64b tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'ac51f2ebf38f422fae17edee2be1cffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b1cef13b6141f0a6ce53c57fc41b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f90bdaf-6e4f-4236-b369-6b0ee4aae64b tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Request method failure captured: Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 42 Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYDriR2v3Oxl0OhqB1Yotl-D2p2CK0TVYB-nkosdyVEI-ndmRe5dtFzX5jalxxQTj1jmoRYAPX5s3vD_sTY2a3B7VjMbu6sv6z_WEt2lrgVP-TK6gzoEZQWbpBDzYSlB6r5_bXJGlOPXjqx3WjhV9drmCXQh7cUATlT4DE6N446qOu8 Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:05.510302 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/19b1cef13b6141f0a6ce53c57fc41b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/19b1cef13b6141f0a6ce53c57fc41b71"}]}] Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 19b1cef13b6141f0a6ce53c57fc41b71 Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-595744212 Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ac51f2ebf38f422fae17edee2be1cffc Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-595744212-project Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: {"remove_host": {"host": "n-h2-852084-5"}} Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:05.511613 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'n-h2-852084-5'}}} Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:05.512345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 27 02:28:05.513365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:05.516075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f90bdaf-6e4f-4236-b369-6b0ee4aae64b tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:05.517198 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6f90bdaf-6e4f-4236-b369-6b0ee4aae64b tempest-AggregatesAdminNegativeTestJSON-595744212 tempest-AggregatesAdminNegativeTestJSON-595744212-project] 10.222.0.99 "POST /compute/v2.1/os-aggregates/16/action" status: 403 len: 121 microversion: 2.1 time: 0.031183 Aug 27 02:28:05.521840 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 159/304] 10.222.0.99 () {60 vars in 1194 bytes} [Sat Aug 27 02:28:05 2022] POST /compute/v2.1/os-aggregates/16/action => generated 121 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:05.528802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5f6d3103-0054-403e-9563-8bb79d75d935 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:05.545068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f6d3103-0054-403e-9563-8bb79d75d935 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:05.546279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f6d3103-0054-403e-9563-8bb79d75d935 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:05.547214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f6d3103-0054-403e-9563-8bb79d75d935 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:05.798853 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f6d3103-0054-403e-9563-8bb79d75d935 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 227 microversion: 2.1 time: 0.274143 Aug 27 02:28:05.799484 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 160/305] 10.222.0.99 () {60 vars in 1194 bytes} [Sat Aug 27 02:28:05 2022] POST /compute/v2.1/os-aggregates/16/action => generated 227 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:05.819707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8c9dd392-8f08-4799-9987-f28dbe556dcf tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:05.889064 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8c9dd392-8f08-4799-9987-f28dbe556dcf tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.077694 Aug 27 02:28:05.895182 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 161/306] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:28:05 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:28:05.903533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-07b7693e-378b-46ad-8eac-f4003e3ea52e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:05.906645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-07b7693e-378b-46ad-8eac-f4003e3ea52e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:05.930334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07b7693e-378b-46ad-8eac-f4003e3ea52e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:05.935331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07b7693e-378b-46ad-8eac-f4003e3ea52e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:05.936340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07b7693e-378b-46ad-8eac-f4003e3ea52e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:05.938124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07b7693e-378b-46ad-8eac-f4003e3ea52e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:05.938849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07b7693e-378b-46ad-8eac-f4003e3ea52e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:05.939685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07b7693e-378b-46ad-8eac-f4003e3ea52e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:06.418027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:28:06.418485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:28:06.418919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:28:06.419332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:28:06.419761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:28:06.433133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:06.433799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:06.434498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:06.435369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:06.436117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:06.436746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:06.458713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=7,nova_api:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:06.467939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Getting quotas for project 11206a74aa524b8280a190536badcf2d. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:28:06.474161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Getting quotas for user c52668ee6ecd4444a580239578b4e4ab and project 11206a74aa524b8280a190536badcf2d. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:28:06.493172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:28:06.496158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:28:06.569096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-07b7693e-378b-46ad-8eac-f4003e3ea52e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:06.574516 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a67cf636-ea12-4097-b5f0-161807231a1d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.306873 Aug 27 02:28:06.575022 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 146/307] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:28:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:28:06.584022 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-07b7693e-378b-46ad-8eac-f4003e3ea52e tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1319 microversion: 2.1 time: 0.687351 Aug 27 02:28:06.584617 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 162/308] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:05 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1319 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:06.596965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3ac578b-a771-4d79-9059-4eb70c2eacab tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1960574234"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:06.609306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.aggregate [None req-f3ac578b-a771-4d79-9059-4eb70c2eacab tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Generated uuid 941ea6f0-38ed-41e9-b98b-75a123f1f3ed for aggregate {{(pid=122487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:28:06.612845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c0c4802-8aed-4667-8412-24b479906971 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:06.616483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9c0c4802-8aed-4667-8412-24b479906971 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:06.635142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c0c4802-8aed-4667-8412-24b479906971 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:06.636986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c0c4802-8aed-4667-8412-24b479906971 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:06.637609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c0c4802-8aed-4667-8412-24b479906971 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:06.638575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c0c4802-8aed-4667-8412-24b479906971 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:06.639220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c0c4802-8aed-4667-8412-24b479906971 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:06.640109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c0c4802-8aed-4667-8412-24b479906971 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:06.681916 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f3ac578b-a771-4d79-9059-4eb70c2eacab tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.102448 Aug 27 02:28:06.683750 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 147/309] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 02:28:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:06.690436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d2792ffa-faf4-49fd-8b5b-14fb29b55481 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:06.691223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2792ffa-faf4-49fd-8b5b-14fb29b55481 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:06.816431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2792ffa-faf4-49fd-8b5b-14fb29b55481 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:06.831783 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d2792ffa-faf4-49fd-8b5b-14fb29b55481 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1219 microversion: 2.1 time: 0.146498 Aug 27 02:28:06.832975 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 148/310] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:06 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:06.840185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:06.878045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:06.878540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:06.878981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:06.906332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:06.910492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:06.911997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:06.949581 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.compute.aggregates [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 02:28:06.950741 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Request method failure captured: Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 42 Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDvRcvgUj2XYCCxmaFIPgLgyq68w6qYU69cGRF50FDAc4NIJUyXA1YGawOyiPJdDPpheIw9OGewiQGDCQIKQbP-I_nPibPtEqC9mgrr-NlB2vjQojd2y8TMBRNfnxffK-PN12r-hjN-HvJd4LlLOVM7xKj62Sz_tCoquP6DBYSUW1g Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:06.952064 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83c81f9675eb4ff59e8207277aa14f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/83c81f9675eb4ff59e8207277aa14f46"}]}] Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 83c81f9675eb4ff59e8207277aa14f46 Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-817820477 Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c0a8f3f08d6343e2a80310d9608e0a00 Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: {"remove_host": {"host": "nonexist_host"}} Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:06.954339 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot remove host nonexist_host in aggregate 17 Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 27 02:28:06.955710 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 27 02:28:06.959172 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:06.961725 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:06.964233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:06.964233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:06.964233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:06.964233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:06.964233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Aug 27 02:28:06.964233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:06.964233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:06.964233 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a82df06d-5ddc-4c9c-b2b1-f37472cc4351 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.119342 Aug 27 02:28:06.971943 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 149/311] 10.222.0.99 () {60 vars in 1194 bytes} [Sat Aug 27 02:28:06 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:28:06.975684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ee22d931-1d3f-43af-8dec-e31bea2060c1 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:07.083496 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ee22d931-1d3f-43af-8dec-e31bea2060c1 tempest-AggregatesAdminNegativeTestJSON-817820477 tempest-AggregatesAdminNegativeTestJSON-817820477-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.111051 Aug 27 02:28:07.090888 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 150/312] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:28:06 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:28:07.610261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:07.629219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-39a73b63-3582-4980-92f8-83becabc79a5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:07.635265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-39a73b63-3582-4980-92f8-83becabc79a5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:07.681848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39a73b63-3582-4980-92f8-83becabc79a5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:07.683232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39a73b63-3582-4980-92f8-83becabc79a5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:07.686056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39a73b63-3582-4980-92f8-83becabc79a5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:07.689793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39a73b63-3582-4980-92f8-83becabc79a5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:07.694926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39a73b63-3582-4980-92f8-83becabc79a5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:07.699856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39a73b63-3582-4980-92f8-83becabc79a5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:07.722109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9c0c4802-8aed-4667-8412-24b479906971 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:07.756132 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9c0c4802-8aed-4667-8412-24b479906971 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1584 microversion: 2.1 time: 1.169944 Aug 27 02:28:07.758545 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 163/313] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:06 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1584 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:07.805922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50e2ec97-743c-45e8-a5d4-0e1f97eaace3 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:07.807152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-50e2ec97-743c-45e8-a5d4-0e1f97eaace3 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:07.818950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50e2ec97-743c-45e8-a5d4-0e1f97eaace3 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:07.820227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50e2ec97-743c-45e8-a5d4-0e1f97eaace3 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:07.821261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50e2ec97-743c-45e8-a5d4-0e1f97eaace3 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:07.838300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50e2ec97-743c-45e8-a5d4-0e1f97eaace3 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:07.841140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50e2ec97-743c-45e8-a5d4-0e1f97eaace3 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:07.842350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50e2ec97-743c-45e8-a5d4-0e1f97eaace3 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:08.164409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-39a73b63-3582-4980-92f8-83becabc79a5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:08.180563 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-39a73b63-3582-4980-92f8-83becabc79a5 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1319 microversion: 2.1 time: 0.560048 Aug 27 02:28:08.186134 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 151/314] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:07 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:08.216179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b9ab700d-058e-4675-8c1d-8de71959aeb9 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:08.217509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b9ab700d-058e-4675-8c1d-8de71959aeb9 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:08.232773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9ab700d-058e-4675-8c1d-8de71959aeb9 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:08.234625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9ab700d-058e-4675-8c1d-8de71959aeb9 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:08.236827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9ab700d-058e-4675-8c1d-8de71959aeb9 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:08.239266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9ab700d-058e-4675-8c1d-8de71959aeb9 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:08.241218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9ab700d-058e-4675-8c1d-8de71959aeb9 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:08.242992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9ab700d-058e-4675-8c1d-8de71959aeb9 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:08.300025 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-50e2ec97-743c-45e8-a5d4-0e1f97eaace3 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.501309 Aug 27 02:28:08.301377 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 164/315] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:28:07 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96/os-interface => generated 284 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:08.323567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-313d4135-ab69-4179-b26e-661b9d000e35 req-7b4a0393-068b-4811-86bd-ad8e2ba3c851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a8413d-9d40-41a6-82da-081f3fa797f7", "name": "network-vif-plugged", "status": "completed", "tag": "1c922404-5224-45b6-9c6c-82e2c961188a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:08.342778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-313d4135-ab69-4179-b26e-661b9d000e35 req-7b4a0393-068b-4811-86bd-ad8e2ba3c851 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:08.343981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-313d4135-ab69-4179-b26e-661b9d000e35 req-7b4a0393-068b-4811-86bd-ad8e2ba3c851 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:08.344922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-313d4135-ab69-4179-b26e-661b9d000e35 req-7b4a0393-068b-4811-86bd-ad8e2ba3c851 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:08.368675 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-313d4135-ab69-4179-b26e-661b9d000e35 req-7b4a0393-068b-4811-86bd-ad8e2ba3c851 service nova] Creating event network-vif-plugged:1c922404-5224-45b6-9c6c-82e2c961188a for instance 35a8413d-9d40-41a6-82da-081f3fa797f7 on n-h2-852084-5 Aug 27 02:28:08.377506 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-313d4135-ab69-4179-b26e-661b9d000e35 req-7b4a0393-068b-4811-86bd-ad8e2ba3c851 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062167 Aug 27 02:28:08.379468 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 165/316] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:08.704922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b9ab700d-058e-4675-8c1d-8de71959aeb9 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:08.724135 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b9ab700d-058e-4675-8c1d-8de71959aeb9 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1271 microversion: 2.1 time: 0.533914 Aug 27 02:28:08.728977 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 152/317] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:08 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1271 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:09.229707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8bffe89-4adc-4fad-a8d8-aaa5a07d7ef0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:09.232873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c8bffe89-4adc-4fad-a8d8-aaa5a07d7ef0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:09.253472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8bffe89-4adc-4fad-a8d8-aaa5a07d7ef0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:09.254708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8bffe89-4adc-4fad-a8d8-aaa5a07d7ef0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:09.255747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8bffe89-4adc-4fad-a8d8-aaa5a07d7ef0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:09.257614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8bffe89-4adc-4fad-a8d8-aaa5a07d7ef0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:09.261475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8bffe89-4adc-4fad-a8d8-aaa5a07d7ef0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:09.262291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8bffe89-4adc-4fad-a8d8-aaa5a07d7ef0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:09.760060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e748fcfe-0b35-4e34-aef8-96ca3457f734 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:09.764208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e748fcfe-0b35-4e34-aef8-96ca3457f734 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:09.793610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748fcfe-0b35-4e34-aef8-96ca3457f734 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:09.795242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748fcfe-0b35-4e34-aef8-96ca3457f734 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:09.796786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748fcfe-0b35-4e34-aef8-96ca3457f734 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:09.799493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748fcfe-0b35-4e34-aef8-96ca3457f734 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:09.800817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748fcfe-0b35-4e34-aef8-96ca3457f734 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:09.806376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748fcfe-0b35-4e34-aef8-96ca3457f734 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:10.314854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e748fcfe-0b35-4e34-aef8-96ca3457f734 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:10.342932 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e748fcfe-0b35-4e34-aef8-96ca3457f734 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1277 microversion: 2.1 time: 0.594366 Aug 27 02:28:10.346678 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 153/318] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:09 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1277 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:10.576981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c8bffe89-4adc-4fad-a8d8-aaa5a07d7ef0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:10.607793 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c8bffe89-4adc-4fad-a8d8-aaa5a07d7ef0 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1319 microversion: 2.1 time: 1.387918 Aug 27 02:28:10.610536 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 166/319] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:09 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1319 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:11.309291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-21f67397-8d84-4fe6-bfb7-dcc975665dde tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Calling method '.version_select at 0x7f4d2adb04c0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:11.325121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21f67397-8d84-4fe6-bfb7-dcc975665dde tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:11.326614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21f67397-8d84-4fe6-bfb7-dcc975665dde tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:11.327597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21f67397-8d84-4fe6-bfb7-dcc975665dde tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:11.329540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21f67397-8d84-4fe6-bfb7-dcc975665dde tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:11.330595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21f67397-8d84-4fe6-bfb7-dcc975665dde tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:11.331462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21f67397-8d84-4fe6-bfb7-dcc975665dde tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:11.373765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-84e6d672-b865-4ff0-902b-14bc4b808fdf tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:11.377581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-84e6d672-b865-4ff0-902b-14bc4b808fdf tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:11.411758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e6d672-b865-4ff0-902b-14bc4b808fdf tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:11.417020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e6d672-b865-4ff0-902b-14bc4b808fdf tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:11.418440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e6d672-b865-4ff0-902b-14bc4b808fdf tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:11.419876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e6d672-b865-4ff0-902b-14bc4b808fdf tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:11.421397 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-21f67397-8d84-4fe6-bfb7-dcc975665dde tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.028912 Aug 27 02:28:11.422628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e6d672-b865-4ff0-902b-14bc4b808fdf tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:11.422862 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 154/320] 10.222.0.99 () {58 vars in 1128 bytes} [Sat Aug 27 02:28:10 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:28:11.432000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e6d672-b865-4ff0-902b-14bc4b808fdf tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:11.774020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=12 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:11.803480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-84e6d672-b865-4ff0-902b-14bc4b808fdf tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:11.822473 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-84e6d672-b865-4ff0-902b-14bc4b808fdf tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1319 microversion: 2.1 time: 0.456624 Aug 27 02:28:11.824895 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 167/321] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:11 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:28:11.891583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-827851d0-2b0c-4f3b-8171-d561a1fe2e4d tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Calling method '.version_select at 0x7f4d2adb09d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:11.910019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-827851d0-2b0c-4f3b-8171-d561a1fe2e4d tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '635c73e183d942398e3c7a7a0fa06fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe981c3da0b64322be4bba15b65a58a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-827851d0-2b0c-4f3b-8171-d561a1fe2e4d tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Request method failure captured: Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYE3Q3qiZL_CN4RG1-wg0IvsRSfi6pQuGmjs2XEiGbVhbNrNeZmlcxGDaa_n1aCYLokaWULavqpkOm835_obSV5nuqihAX-QxQVo6_eoMpvlTqLb_1KI2hF3D83m5J_xVi-UASsLfE05iK4ODLc_feNJc504SxhleUGJH1EINWgYpoo Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:11.922733 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/fe981c3da0b64322be4bba15b65a58a4"}]}] Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 635c73e183d942398e3c7a7a0fa06fca Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: action_args: {} Aug 27 02:28:11.925489 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:11.927435 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 27 02:28:11.931077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:11.938677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-827851d0-2b0c-4f3b-8171-d561a1fe2e4d tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:11.940974 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-827851d0-2b0c-4f3b-8171-d561a1fe2e4d tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] 10.222.0.99 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.505286 Aug 27 02:28:11.942850 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 155/322] 10.222.0.99 () {58 vars in 1128 bytes} [Sat Aug 27 02:28:11 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 512 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:11.953368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-288fb3a9-e480-41ea-82d7-f6a152107a50 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:11.955137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-288fb3a9-e480-41ea-82d7-f6a152107a50 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:11.973009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-288fb3a9-e480-41ea-82d7-f6a152107a50 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:11.974306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-288fb3a9-e480-41ea-82d7-f6a152107a50 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:11.975427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-288fb3a9-e480-41ea-82d7-f6a152107a50 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:11.977943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-288fb3a9-e480-41ea-82d7-f6a152107a50 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:11.979106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-288fb3a9-e480-41ea-82d7-f6a152107a50 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:11.980883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-288fb3a9-e480-41ea-82d7-f6a152107a50 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:12.345993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-10aefa9c-c964-4fe4-932f-9f3303c9087a tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Calling method '.version_select at 0x7f4d2addef70>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:12.357196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10aefa9c-c964-4fe4-932f-9f3303c9087a tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:12.359170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10aefa9c-c964-4fe4-932f-9f3303c9087a tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:12.363064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10aefa9c-c964-4fe4-932f-9f3303c9087a tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:12.412237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10aefa9c-c964-4fe4-932f-9f3303c9087a tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:12.413763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10aefa9c-c964-4fe4-932f-9f3303c9087a tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:12.414948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10aefa9c-c964-4fe4-932f-9f3303c9087a tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:12.439583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10aefa9c-c964-4fe4-932f-9f3303c9087a tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:12.441543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10aefa9c-c964-4fe4-932f-9f3303c9087a tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:12.442883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10aefa9c-c964-4fe4-932f-9f3303c9087a tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:12.459599 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-10aefa9c-c964-4fe4-932f-9f3303c9087a tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1426 microversion: 2.41 time: 0.632566 Aug 27 02:28:12.469112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-288fb3a9-e480-41ea-82d7-f6a152107a50 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:12.488504 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 168/323] 10.222.0.99 () {60 vars in 1208 bytes} [Sat Aug 27 02:28:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1426 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:28:12.499601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a5142c5-3612-4a60-ae8c-dcf3870fc4fa tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Calling method '.version_select at 0x7f4d2ad71430>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:12.500390 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-288fb3a9-e480-41ea-82d7-f6a152107a50 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1469 microversion: 2.1 time: 0.553152 Aug 27 02:28:12.501586 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 156/324] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:11 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1469 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:12.504564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7a5142c5-3612-4a60-ae8c-dcf3870fc4fa tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '635c73e183d942398e3c7a7a0fa06fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe981c3da0b64322be4bba15b65a58a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a5142c5-3612-4a60-ae8c-dcf3870fc4fa tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Request method failure captured: Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-hosts/n-d-852084-5/reboot HTTP/1.1 Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYE3Q3qiZL_CN4RG1-wg0IvsRSfi6pQuGmjs2XEiGbVhbNrNeZmlcxGDaa_n1aCYLokaWULavqpkOm835_obSV5nuqihAX-QxQVo6_eoMpvlTqLb_1KI2hF3D83m5J_xVi-UASsLfE05iK4ODLc_feNJc504SxhleUGJH1EINWgYpoo Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:12.510496 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/fe981c3da0b64322be4bba15b65a58a4"}]}] Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 635c73e183d942398e3c7a7a0fa06fca Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'n-d-852084-5'} Aug 27 02:28:12.513116 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:12.514750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 27 02:28:12.519995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:12.524407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a5142c5-3612-4a60-ae8c-dcf3870fc4fa tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:12.526253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f68a52b8-baac-4831-9961-3fbaab8d33d8 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1398439751"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:12.527195 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a5142c5-3612-4a60-ae8c-dcf3870fc4fa tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] 10.222.0.99 "GET /compute/v2.1/os-hosts/n-d-852084-5/reboot" status: 403 len: 111 microversion: 2.1 time: 0.036406 Aug 27 02:28:12.530290 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 169/325] 10.222.0.99 () {58 vars in 1188 bytes} [Sat Aug 27 02:28:12 2022] GET /compute/v2.1/os-hosts/n-d-852084-5/reboot => generated 111 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:12.535900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.aggregate [None req-f68a52b8-baac-4831-9961-3fbaab8d33d8 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Generated uuid 25e3bbba-90e6-424c-9819-3eecc837a7e7 for aggregate {{(pid=122487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 02:28:12.575812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb841b83-4bbc-4012-8dfb-5bc06ecfc514 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:12.589002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb841b83-4bbc-4012-8dfb-5bc06ecfc514 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:12.608648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb841b83-4bbc-4012-8dfb-5bc06ecfc514 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:12.621434 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f68a52b8-baac-4831-9961-3fbaab8d33d8 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.114618 Aug 27 02:28:12.622533 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 157/326] 10.222.0.99 () {62 vars in 1205 bytes} [Sat Aug 27 02:28:12 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:12.638938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb841b83-4bbc-4012-8dfb-5bc06ecfc514 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:12.642127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb841b83-4bbc-4012-8dfb-5bc06ecfc514 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:12.644227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb841b83-4bbc-4012-8dfb-5bc06ecfc514 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:12.646643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4b32fc0-abb9-4afb-b83e-47b1f896c616 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Calling method '.version_select at 0x7f4d2aed71f0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:12.648568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb841b83-4bbc-4012-8dfb-5bc06ecfc514 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:12.649890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb841b83-4bbc-4012-8dfb-5bc06ecfc514 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:12.682981 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-c4b32fc0-abb9-4afb-b83e-47b1f896c616 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4b32fc0-abb9-4afb-b83e-47b1f896c616 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Request method failure captured: Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYE6eQ-ZhPArPs217FICnCCzQN57mRY-zTqZ2FSw97gDVosxQaVVzDwamc5XP9mZA5ZX4c6l2gNn4rNsLJo8OFhe9wDpIk3fdjO2k27rzRInCOftXshrIgoVwELYbOq2TGPs07DCb6JEMnZyllf_iNbs8WGobuRsNyI2ukNDV4GMnTM Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:12.691493 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/127cbac2593943e58a0ae2c8f16c7ab5"}]}] Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0190cf0d2b48443ab99da7586164cbbf Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'nonexistent_hostname'} Aug 27 02:28:12.694105 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:28:12.695719 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 02:28:12.698269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4b32fc0-abb9-4afb-b83e-47b1f896c616 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:12.700337 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c4b32fc0-abb9-4afb-b83e-47b1f896c616 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.074951 Aug 27 02:28:12.701872 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 158/327] 10.222.0.99 () {58 vars in 1212 bytes} [Sat Aug 27 02:28:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:28:12.731437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c8d1016e-b9f2-4ef9-80ca-372073296cdc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:12.733086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c8d1016e-b9f2-4ef9-80ca-372073296cdc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:12.748457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8d1016e-b9f2-4ef9-80ca-372073296cdc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:12.750084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8d1016e-b9f2-4ef9-80ca-372073296cdc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:12.752285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8d1016e-b9f2-4ef9-80ca-372073296cdc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:12.753947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8d1016e-b9f2-4ef9-80ca-372073296cdc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:12.755215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8d1016e-b9f2-4ef9-80ca-372073296cdc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:12.756235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8d1016e-b9f2-4ef9-80ca-372073296cdc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:12.902410 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb841b83-4bbc-4012-8dfb-5bc06ecfc514 tempest-DeleteServersAdminTestJSON-1071600374 tempest-DeleteServersAdminTestJSON-1071600374-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7/action" status: 202 len: 0 microversion: 2.1 time: 0.366873 Aug 27 02:28:12.907607 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 170/328] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:28:12 2022] POST /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:28:12.915496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e9983b5d-a125-4574-a4be-9853b3e91535 req-608527e0-ed5c-4577-8944-a7d541121889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32472eac-0284-4cff-9e87-1884b0bd6d96", "tag": "50e81101-2512-4821-83a6-6e19294005b3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:12.927894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e9983b5d-a125-4574-a4be-9853b3e91535 req-608527e0-ed5c-4577-8944-a7d541121889 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:12.928692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e9983b5d-a125-4574-a4be-9853b3e91535 req-608527e0-ed5c-4577-8944-a7d541121889 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:12.929386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e9983b5d-a125-4574-a4be-9853b3e91535 req-608527e0-ed5c-4577-8944-a7d541121889 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:12.943326 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e9983b5d-a125-4574-a4be-9853b3e91535 req-608527e0-ed5c-4577-8944-a7d541121889 service nova] Creating event network-changed:50e81101-2512-4821-83a6-6e19294005b3 for instance 32472eac-0284-4cff-9e87-1884b0bd6d96 on n-h1-852084-5 Aug 27 02:28:12.952260 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e9983b5d-a125-4574-a4be-9853b3e91535 req-608527e0-ed5c-4577-8944-a7d541121889 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042598 Aug 27 02:28:12.958012 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 171/329] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:12.966911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9937adad-332f-48e7-afe9-90878ba5f1fe tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1684754483"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:13.291548 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9937adad-332f-48e7-afe9-90878ba5f1fe tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.331482 Aug 27 02:28:13.301952 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 172/330] 10.222.0.99 () {62 vars in 1213 bytes} [Sat Aug 27 02:28:12 2022] PUT /compute/v2.1/os-aggregates/18 => generated 300 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:13.324793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-809ae66a-a312-4fcf-8d0e-46468a0f55f7 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Calling method '.version_select at 0x7f4d2ad54ee0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:13.329183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-809ae66a-a312-4fcf-8d0e-46468a0f55f7 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '635c73e183d942398e3c7a7a0fa06fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe981c3da0b64322be4bba15b65a58a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-809ae66a-a312-4fcf-8d0e-46468a0f55f7 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Request method failure captured: Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-hosts/n-d-852084-5 HTTP/1.1 Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYE3Q3qiZL_CN4RG1-wg0IvsRSfi6pQuGmjs2XEiGbVhbNrNeZmlcxGDaa_n1aCYLokaWULavqpkOm835_obSV5nuqihAX-QxQVo6_eoMpvlTqLb_1KI2hF3D83m5J_xVi-UASsLfE05iK4ODLc_feNJc504SxhleUGJH1EINWgYpoo Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:13.342462 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/fe981c3da0b64322be4bba15b65a58a4"}]}] Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 635c73e183d942398e3c7a7a0fa06fca Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'n-d-852084-5'} Aug 27 02:28:13.344785 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:13.346586 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 27 02:28:13.349163 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:13.355326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-809ae66a-a312-4fcf-8d0e-46468a0f55f7 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:13.363344 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-809ae66a-a312-4fcf-8d0e-46468a0f55f7 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] 10.222.0.99 "GET /compute/v2.1/os-hosts/n-d-852084-5" status: 403 len: 109 microversion: 2.1 time: 0.058518 Aug 27 02:28:13.373316 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 173/331] 10.222.0.99 () {58 vars in 1167 bytes} [Sat Aug 27 02:28:13 2022] GET /compute/v2.1/os-hosts/n-d-852084-5 => generated 109 bytes in 70 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:13.385725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-17452cee-1246-4fed-a20b-be89c51926b8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:13.394572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-17452cee-1246-4fed-a20b-be89c51926b8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:13.428983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17452cee-1246-4fed-a20b-be89c51926b8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:13.430426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17452cee-1246-4fed-a20b-be89c51926b8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:13.431206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17452cee-1246-4fed-a20b-be89c51926b8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:13.432520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17452cee-1246-4fed-a20b-be89c51926b8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:13.433314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17452cee-1246-4fed-a20b-be89c51926b8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:13.434342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17452cee-1246-4fed-a20b-be89c51926b8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:13.436371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c8d1016e-b9f2-4ef9-80ca-372073296cdc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:13.468409 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c8d1016e-b9f2-4ef9-80ca-372073296cdc tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 200 len: 1584 microversion: 2.1 time: 0.764432 Aug 27 02:28:13.472447 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 159/332] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:12 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 1584 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:13.489008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:13.490639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:13.549862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:13.551186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:13.552372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:13.554096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:13.555822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:13.558817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:13.716977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:13.717856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:13.718655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:13.719487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lazy-loading 'fault' on Instance uuid 35a8413d-9d40-41a6-82da-081f3fa797f7 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:28:14.113331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-17452cee-1246-4fed-a20b-be89c51926b8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:14.136395 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-17452cee-1246-4fed-a20b-be89c51926b8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1319 microversion: 2.1 time: 0.760885 Aug 27 02:28:14.136974 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 174/333] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:13 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1319 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:14.141960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-10f68294-e29c-4681-baba-71cd36b20247 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:14.170137 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-10f68294-e29c-4681-baba-71cd36b20247 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 300 microversion: 2.41 time: 0.031757 Aug 27 02:28:14.170711 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 175/334] 10.222.0.99 () {60 vars in 1193 bytes} [Sat Aug 27 02:28:14 2022] GET /compute/v2.1/os-aggregates/18 => generated 300 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:14.176752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2017118b-eb43-4dfe-a739-02554f4681a0 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Calling method '.version_select at 0x7f4d2ad541f0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:14.192498 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-2017118b-eb43-4dfe-a739-02554f4681a0 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2017118b-eb43-4dfe-a739-02554f4681a0 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Request method failure captured: Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYE6eQ-ZhPArPs217FICnCCzQN57mRY-zTqZ2FSw97gDVosxQaVVzDwamc5XP9mZA5ZX4c6l2gNn4rNsLJo8OFhe9wDpIk3fdjO2k27rzRInCOftXshrIgoVwELYbOq2TGPs07DCb6JEMnZyllf_iNbs8WGobuRsNyI2ukNDV4GMnTM Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:28:14.199527 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/127cbac2593943e58a0ae2c8f16c7ab5"}]}] Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0190cf0d2b48443ab99da7586164cbbf Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'nonexistent_hostname'} Aug 27 02:28:14.201096 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:14.201928 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:14.203595 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.205196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2017118b-eb43-4dfe-a739-02554f4681a0 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:14.205196 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2017118b-eb43-4dfe-a739-02554f4681a0 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.031806 Aug 27 02:28:14.205196 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 176/335] 10.222.0.99 () {58 vars in 1191 bytes} [Sat Aug 27 02:28:14 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:28:14.218140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7a3918bc-09db-4cef-bade-67323e84969a req-3443283e-9029-4970-a7e1-5c4c5b9ad8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757ac8d3-8528-470c-a017-adeb167ed73b", "tag": "508942ce-8030-4c4f-ba87-ef3a2b5d73c8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:14.238881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7a3918bc-09db-4cef-bade-67323e84969a req-3443283e-9029-4970-a7e1-5c4c5b9ad8c8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:14.241134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7a3918bc-09db-4cef-bade-67323e84969a req-3443283e-9029-4970-a7e1-5c4c5b9ad8c8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:14.241605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7a3918bc-09db-4cef-bade-67323e84969a req-3443283e-9029-4970-a7e1-5c4c5b9ad8c8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:14.261142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:14.273007 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fb1f6a85-6609-43b9-9198-5459aa128fa9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1452 microversion: 2.1 time: 0.792825 Aug 27 02:28:14.274782 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 160/336] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:13 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1452 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:14.290908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e830ead-50d5-4d2b-8568-daf5a5eee219 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:14.298065 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7a3918bc-09db-4cef-bade-67323e84969a req-3443283e-9029-4970-a7e1-5c4c5b9ad8c8 service nova] Creating event network-changed:508942ce-8030-4c4f-ba87-ef3a2b5d73c8 for instance 757ac8d3-8528-470c-a017-adeb167ed73b on n-h2-852084-5 Aug 27 02:28:14.319222 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7a3918bc-09db-4cef-bade-67323e84969a req-3443283e-9029-4970-a7e1-5c4c5b9ad8c8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110672 Aug 27 02:28:14.320504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e830ead-50d5-4d2b-8568-daf5a5eee219 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:14.321291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e830ead-50d5-4d2b-8568-daf5a5eee219 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:14.321823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e830ead-50d5-4d2b-8568-daf5a5eee219 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:14.324125 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 177/337] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:14.336667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cdb85261-45be-413b-8926-3dd957b21339 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Calling method '.version_select at 0x7f4d2addef70>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:14.349794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cdb85261-45be-413b-8926-3dd957b21339 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '635c73e183d942398e3c7a7a0fa06fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe981c3da0b64322be4bba15b65a58a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cdb85261-45be-413b-8926-3dd957b21339 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Request method failure captured: Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-hosts/n-d-852084-5/shutdown HTTP/1.1 Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYE3Q3qiZL_CN4RG1-wg0IvsRSfi6pQuGmjs2XEiGbVhbNrNeZmlcxGDaa_n1aCYLokaWULavqpkOm835_obSV5nuqihAX-QxQVo6_eoMpvlTqLb_1KI2hF3D83m5J_xVi-UASsLfE05iK4ODLc_feNJc504SxhleUGJH1EINWgYpoo Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:14.356688 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/fe981c3da0b64322be4bba15b65a58a4"}]}] Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 635c73e183d942398e3c7a7a0fa06fca Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'n-d-852084-5'} Aug 27 02:28:14.359125 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:14.360496 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 27 02:28:14.362566 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.368054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cdb85261-45be-413b-8926-3dd957b21339 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:14.372806 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cdb85261-45be-413b-8926-3dd957b21339 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] 10.222.0.99 "GET /compute/v2.1/os-hosts/n-d-852084-5/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.046201 Aug 27 02:28:14.385990 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 178/338] 10.222.0.99 () {58 vars in 1194 bytes} [Sat Aug 27 02:28:14 2022] GET /compute/v2.1/os-hosts/n-d-852084-5/shutdown => generated 113 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:14.411782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2bb75f50-71dd-4b1c-8d9d-cb7243ee0609 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:14.414091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2bb75f50-71dd-4b1c-8d9d-cb7243ee0609 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:14.428751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bb75f50-71dd-4b1c-8d9d-cb7243ee0609 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:14.430934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bb75f50-71dd-4b1c-8d9d-cb7243ee0609 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:14.444474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bb75f50-71dd-4b1c-8d9d-cb7243ee0609 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:14.445925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bb75f50-71dd-4b1c-8d9d-cb7243ee0609 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:14.446478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bb75f50-71dd-4b1c-8d9d-cb7243ee0609 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:14.446922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bb75f50-71dd-4b1c-8d9d-cb7243ee0609 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:14.599496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2bb75f50-71dd-4b1c-8d9d-cb7243ee0609 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:28:14.612317 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4e830ead-50d5-4d2b-8568-daf5a5eee219 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 315 microversion: 2.41 time: 0.334969 Aug 27 02:28:14.620719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:14.623901 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 161/339] 10.222.0.99 () {62 vars in 1235 bytes} [Sat Aug 27 02:28:14 2022] POST /compute/v2.1/os-aggregates/18/action => generated 315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:14.631968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-17c2c41b-3ae3-4437-8fc2-6435dd3905fe tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Calling method '.version_select at 0x7f4d2adb0c10>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:14.653886 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-17c2c41b-3ae3-4437-8fc2-6435dd3905fe tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-17c2c41b-3ae3-4437-8fc2-6435dd3905fe tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Request method failure captured: Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYE6eQ-ZhPArPs217FICnCCzQN57mRY-zTqZ2FSw97gDVosxQaVVzDwamc5XP9mZA5ZX4c6l2gNn4rNsLJo8OFhe9wDpIk3fdjO2k27rzRInCOftXshrIgoVwELYbOq2TGPs07DCb6JEMnZyllf_iNbs8WGobuRsNyI2ukNDV4GMnTM Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:14.661085 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/127cbac2593943e58a0ae2c8f16c7ab5"}]}] Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0190cf0d2b48443ab99da7586164cbbf Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'nonexistent_hostname'} Aug 27 02:28:14.663341 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:28:14.665253 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 02:28:14.667191 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-17c2c41b-3ae3-4437-8fc2-6435dd3905fe tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-17c2c41b-3ae3-4437-8fc2-6435dd3905fe tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.037843 Aug 27 02:28:14.682414 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 162/340] 10.222.0.99 () {58 vars in 1218 bytes} [Sat Aug 27 02:28:14 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:28:14.686148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-70830e1b-7d56-4a79-8992-5d3668317f99 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:14.722004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70830e1b-7d56-4a79-8992-5d3668317f99 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:14.722744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70830e1b-7d56-4a79-8992-5d3668317f99 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:14.724770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70830e1b-7d56-4a79-8992-5d3668317f99 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:14.858263 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2bb75f50-71dd-4b1c-8d9d-cb7243ee0609 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "DELETE /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 204 len: 0 microversion: 2.1 time: 0.469966 Aug 27 02:28:14.859368 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 179/341] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:28:14 2022] DELETE /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:28:14.870590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33e0b1b5-084e-4103-a7cd-b258befcc3b5 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Calling method '.version_select at 0x7f4d2ad54ca0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:14.883079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-33e0b1b5-084e-4103-a7cd-b258befcc3b5 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '635c73e183d942398e3c7a7a0fa06fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe981c3da0b64322be4bba15b65a58a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33e0b1b5-084e-4103-a7cd-b258befcc3b5 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Request method failure captured: Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-hosts/n-d-852084-5/startup HTTP/1.1 Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYE3Q3qiZL_CN4RG1-wg0IvsRSfi6pQuGmjs2XEiGbVhbNrNeZmlcxGDaa_n1aCYLokaWULavqpkOm835_obSV5nuqihAX-QxQVo6_eoMpvlTqLb_1KI2hF3D83m5J_xVi-UASsLfE05iK4ODLc_feNJc504SxhleUGJH1EINWgYpoo Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:14.885315 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/fe981c3da0b64322be4bba15b65a58a4"}]}] Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 635c73e183d942398e3c7a7a0fa06fca Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'n-d-852084-5'} Aug 27 02:28:14.886833 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:14.887738 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 27 02:28:14.888877 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:14.889787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33e0b1b5-084e-4103-a7cd-b258befcc3b5 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:14.889787 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-33e0b1b5-084e-4103-a7cd-b258befcc3b5 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] 10.222.0.99 "GET /compute/v2.1/os-hosts/n-d-852084-5/startup" status: 403 len: 110 microversion: 2.1 time: 0.027000 Aug 27 02:28:14.889787 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 180/342] 10.222.0.99 () {58 vars in 1191 bytes} [Sat Aug 27 02:28:14 2022] GET /compute/v2.1/os-hosts/n-d-852084-5/startup => generated 110 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:14.902009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:14.902869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:14.917985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:14.921091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:14.921686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:14.923287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:14.923936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:14.924590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:15.001755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:15.002739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:15.003389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:15.004099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lazy-loading 'fault' on Instance uuid 35a8413d-9d40-41a6-82da-081f3fa797f7 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:28:15.019080 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-70830e1b-7d56-4a79-8992-5d3668317f99 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 300 microversion: 2.41 time: 0.345443 Aug 27 02:28:15.021318 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 163/343] 10.222.0.99 () {62 vars in 1235 bytes} [Sat Aug 27 02:28:14 2022] POST /compute/v2.1/os-aggregates/18/action => generated 300 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:15.044403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3765ff69-8a75-4e7b-b089-9302b1f06d84 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Calling method '.version_select at 0x7f4d2adb0f70>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:15.063260 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-3765ff69-8a75-4e7b-b089-9302b1f06d84 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3765ff69-8a75-4e7b-b089-9302b1f06d84 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Request method failure captured: Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYE6eQ-ZhPArPs217FICnCCzQN57mRY-zTqZ2FSw97gDVosxQaVVzDwamc5XP9mZA5ZX4c6l2gNn4rNsLJo8OFhe9wDpIk3fdjO2k27rzRInCOftXshrIgoVwELYbOq2TGPs07DCb6JEMnZyllf_iNbs8WGobuRsNyI2ukNDV4GMnTM Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:15.065322 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/127cbac2593943e58a0ae2c8f16c7ab5"}]}] Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0190cf0d2b48443ab99da7586164cbbf Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'nonexistent_hostname'} Aug 27 02:28:15.067829 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:28:15.069231 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 27 02:28:15.071382 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.073348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3765ff69-8a75-4e7b-b089-9302b1f06d84 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:15.079319 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3765ff69-8a75-4e7b-b089-9302b1f06d84 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.043096 Aug 27 02:28:15.082030 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 164/344] 10.222.0.99 () {58 vars in 1215 bytes} [Sat Aug 27 02:28:15 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:28:15.087036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-747fe164-57ba-4418-b5c2-53c7c74e7694 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:15.120620 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-747fe164-57ba-4418-b5c2-53c7c74e7694 tempest-AggregatesAdminTestV241-255539822 tempest-AggregatesAdminTestV241-255539822-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.037330 Aug 27 02:28:15.122186 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 165/345] 10.222.0.99 () {60 vars in 1196 bytes} [Sat Aug 27 02:28:15 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:15.127522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-06bd62c0-d8c1-4f4f-9028-a741cb5000bc tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2adf19d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-06bd62c0-d8c1-4f4f-9028-a741cb5000bc tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Request method failure captured: Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: request: PUT /compute/v2.1/os-hosts/n-d-852084-5 HTTP/1.1 Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 51 Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYE6eQ-ZhPArPs217FICnCCzQN57mRY-zTqZ2FSw97gDVosxQaVVzDwamc5XP9mZA5ZX4c6l2gNn4rNsLJo8OFhe9wDpIk3fdjO2k27rzRInCOftXshrIgoVwELYbOq2TGPs07DCb6JEMnZyllf_iNbs8WGobuRsNyI2ukNDV4GMnTM Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:15.135672 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/127cbac2593943e58a0ae2c8f16c7ab5"}]}] Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0190cf0d2b48443ab99da7586164cbbf Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: {"status": "enable", "maintenance_mode": "invalid"} Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:15.138025 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'n-d-852084-5', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance: Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.139165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.141340 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.144713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.144713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:28:15.144713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:28:15.144713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:28:15.144713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.144713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-06bd62c0-d8c1-4f4f-9028-a741cb5000bc tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:15.144713 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-06bd62c0-d8c1-4f4f-9028-a741cb5000bc tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-hosts/n-d-852084-5" status: 400 len: 199 microversion: 2.1 time: 0.014146 Aug 27 02:28:15.144713 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 166/346] 10.222.0.99 () {60 vars in 1187 bytes} [Sat Aug 27 02:28:15 2022] PUT /compute/v2.1/os-hosts/n-d-852084-5 => generated 199 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:28:15.151570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fd7d69dd-a747-4066-8d63-d7d6c9fa08d2 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2adef4c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fd7d69dd-a747-4066-8d63-d7d6c9fa08d2 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Request method failure captured: Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: request: PUT /compute/v2.1/os-hosts/n-d-852084-5 HTTP/1.1 Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 51 Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYE6eQ-ZhPArPs217FICnCCzQN57mRY-zTqZ2FSw97gDVosxQaVVzDwamc5XP9mZA5ZX4c6l2gNn4rNsLJo8OFhe9wDpIk3fdjO2k27rzRInCOftXshrIgoVwELYbOq2TGPs07DCb6JEMnZyllf_iNbs8WGobuRsNyI2ukNDV4GMnTM Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:15.162742 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/127cbac2593943e58a0ae2c8f16c7ab5"}]}] Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0190cf0d2b48443ab99da7586164cbbf Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: {"status": "invalid", "maintenance_mode": "enable"} Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:15.165612 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'n-d-852084-5', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance: Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.167555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.170319 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.172483 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.172483 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:28:15.172483 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:28:15.172483 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 27 02:28:15.172483 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.172483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fd7d69dd-a747-4066-8d63-d7d6c9fa08d2 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:15.172483 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fd7d69dd-a747-4066-8d63-d7d6c9fa08d2 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-hosts/n-d-852084-5" status: 400 len: 189 microversion: 2.1 time: 0.020806 Aug 27 02:28:15.172483 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 167/347] 10.222.0.99 () {60 vars in 1187 bytes} [Sat Aug 27 02:28:15 2022] PUT /compute/v2.1/os-hosts/n-d-852084-5 => generated 189 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:28:15.184967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da591b66-eed0-47f3-ae92-337d452a40c1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:15.185602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da591b66-eed0-47f3-ae92-337d452a40c1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:15.193214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da591b66-eed0-47f3-ae92-337d452a40c1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:15.193623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da591b66-eed0-47f3-ae92-337d452a40c1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:15.194157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da591b66-eed0-47f3-ae92-337d452a40c1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:15.195457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da591b66-eed0-47f3-ae92-337d452a40c1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:15.196024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da591b66-eed0-47f3-ae92-337d452a40c1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:15.196513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da591b66-eed0-47f3-ae92-337d452a40c1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:15.516962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-da591b66-eed0-47f3-ae92-337d452a40c1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:15.536537 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da591b66-eed0-47f3-ae92-337d452a40c1 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1319 microversion: 2.1 time: 0.359543 Aug 27 02:28:15.544961 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 168/348] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:15 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:15.561628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8f2fa944-aba4-4367-a4b8-be44574f1b92 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Action: 'update', calling method: .version_select at 0x7f4d2adefb80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:15.572396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8f2fa944-aba4-4367-a4b8-be44574f1b92 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '635c73e183d942398e3c7a7a0fa06fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe981c3da0b64322be4bba15b65a58a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8f2fa944-aba4-4367-a4b8-be44574f1b92 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Request method failure captured: Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: request: PUT /compute/v2.1/os-hosts/n-d-852084-5 HTTP/1.1 Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 50 Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYE3Q3qiZL_CN4RG1-wg0IvsRSfi6pQuGmjs2XEiGbVhbNrNeZmlcxGDaa_n1aCYLokaWULavqpkOm835_obSV5nuqihAX-QxQVo6_eoMpvlTqLb_1KI2hF3D83m5J_xVi-UASsLfE05iK4ODLc_feNJc504SxhleUGJH1EINWgYpoo Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:15.576473 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fe981c3da0b64322be4bba15b65a58a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/fe981c3da0b64322be4bba15b65a58a4"}]}] Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: fe981c3da0b64322be4bba15b65a58a4 Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2016537014 Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 635c73e183d942398e3c7a7a0fa06fca Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2016537014-project Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 02:28:15.579180 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'n-d-852084-5', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:15.580881 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 27 02:28:15.583778 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.589809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8f2fa944-aba4-4367-a4b8-be44574f1b92 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:15.595820 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8f2fa944-aba4-4367-a4b8-be44574f1b92 tempest-HostsAdminNegativeTestJSON-2016537014 tempest-HostsAdminNegativeTestJSON-2016537014-project] 10.222.0.99 "PUT /compute/v2.1/os-hosts/n-d-852084-5" status: 403 len: 111 microversion: 2.1 time: 0.043842 Aug 27 02:28:15.607239 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 169/349] 10.222.0.99 () {60 vars in 1187 bytes} [Sat Aug 27 02:28:15 2022] PUT /compute/v2.1/os-hosts/n-d-852084-5 => generated 111 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:15.624466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-abf2715f-3578-4a75-b69d-f7e0ab7b5f5c tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2adbfee0>, body: {"status": null, "maintenance_mode": null} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-abf2715f-3578-4a75-b69d-f7e0ab7b5f5c tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Request method failure captured: Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: request: PUT /compute/v2.1/os-hosts/n-d-852084-5 HTTP/1.1 Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 42 Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYE6eQ-ZhPArPs217FICnCCzQN57mRY-zTqZ2FSw97gDVosxQaVVzDwamc5XP9mZA5ZX4c6l2gNn4rNsLJo8OFhe9wDpIk3fdjO2k27rzRInCOftXshrIgoVwELYbOq2TGPs07DCb6JEMnZyllf_iNbs8WGobuRsNyI2ukNDV4GMnTM Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:15.634463 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/127cbac2593943e58a0ae2c8f16c7ab5"}]}] Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0190cf0d2b48443ab99da7586164cbbf Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: {"status": null, "maintenance_mode": null} Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 02:28:15.637057 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'n-d-852084-5', 'body': {'status': None, 'maintenance_mode': None}} Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'disable', Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'Enable', Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'Disable', Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance: Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi None Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.638839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.642167 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.644684 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:28:15.644684 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:28:15.644684 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 27 02:28:15.644684 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.645219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:15.670377 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-81fc9269-4a6f-4476-b920-f7b06b7f49e8 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1458 microversion: 2.1 time: 0.760101 Aug 27 02:28:15.670377 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 181/350] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:14 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1458 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:15.673381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-abf2715f-3578-4a75-b69d-f7e0ab7b5f5c tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:15.679419 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-abf2715f-3578-4a75-b69d-f7e0ab7b5f5c tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-hosts/n-d-852084-5" status: 400 len: 127 microversion: 2.1 time: 0.068725 Aug 27 02:28:15.682164 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 170/351] 10.222.0.99 () {60 vars in 1187 bytes} [Sat Aug 27 02:28:15 2022] PUT /compute/v2.1/os-hosts/n-d-852084-5 => generated 127 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:28:15.698596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7694ecf9-b204-4928-9575-7a5ac74a7c40 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2ad541f0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:15.702072 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.hosts [None req-7694ecf9-b204-4928-9575-7a5ac74a7c40 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Enabling host nonexistent_hostname. Aug 27 02:28:15.761253 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-7694ecf9-b204-4928-9575-7a5ac74a7c40 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7694ecf9-b204-4928-9575-7a5ac74a7c40 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Request method failure captured: Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 50 Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYE6eQ-ZhPArPs217FICnCCzQN57mRY-zTqZ2FSw97gDVosxQaVVzDwamc5XP9mZA5ZX4c6l2gNn4rNsLJo8OFhe9wDpIk3fdjO2k27rzRInCOftXshrIgoVwELYbOq2TGPs07DCb6JEMnZyllf_iNbs8WGobuRsNyI2ukNDV4GMnTM Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:28:15.768979 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/127cbac2593943e58a0ae2c8f16c7ab5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/127cbac2593943e58a0ae2c8f16c7ab5"}]}] Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 127cbac2593943e58a0ae2c8f16c7ab5 Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1061820621 Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0190cf0d2b48443ab99da7586164cbbf Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1061820621-project-admin Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: {"status": "enable", "maintenance_mode": "enable"} Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:15.771767 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 27 02:28:15.775626 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:15.782702 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:15.783922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7694ecf9-b204-4928-9575-7a5ac74a7c40 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:15.784764 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7694ecf9-b204-4928-9575-7a5ac74a7c40 tempest-HostsAdminNegativeTestJSON-1061820621 tempest-HostsAdminNegativeTestJSON-1061820621-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.080513 Aug 27 02:28:15.784764 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 182/352] 10.222.0.99 () {60 vars in 1211 bytes} [Sat Aug 27 02:28:15 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:28:16.551025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1141330072", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:16.574370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-25f6e510-adc2-4f33-b855-c38d2b9075a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:16.575869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-25f6e510-adc2-4f33-b855-c38d2b9075a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:16.590880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25f6e510-adc2-4f33-b855-c38d2b9075a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:16.592025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25f6e510-adc2-4f33-b855-c38d2b9075a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:16.593110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25f6e510-adc2-4f33-b855-c38d2b9075a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:16.594655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25f6e510-adc2-4f33-b855-c38d2b9075a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:16.595725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25f6e510-adc2-4f33-b855-c38d2b9075a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:16.596687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25f6e510-adc2-4f33-b855-c38d2b9075a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:16.673867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:28:16.822148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:17.152569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-25f6e510-adc2-4f33-b855-c38d2b9075a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:17.176588 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-25f6e510-adc2-4f33-b855-c38d2b9075a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1319 microversion: 2.1 time: 0.609669 Aug 27 02:28:17.183781 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 183/353] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:16 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1319 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:28:17.205912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:17.207581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:17.235203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:17.236514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:17.237325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:17.238863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:17.239955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:17.241149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:17.287772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:28:17.288371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:28:17.288969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:28:17.289382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:28:17.289918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:28:17.318681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:17.319192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:17.319707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:17.321648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:17.322182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:17.328995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:17.331704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:17.332203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:17.339378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:17.340065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lazy-loading 'fault' on Instance uuid 35a8413d-9d40-41a6-82da-081f3fa797f7 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:28:17.387810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Getting quotas for project fb707d591f214c4bb4af5f94dbe2986e. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:28:17.394437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Getting quotas for user aa2749756d0e47978b5e03c948c64434 and project fb707d591f214c4bb4af5f94dbe2986e. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:28:17.428394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:28:17.431456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:28:17.592381 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da2e778e-453c-4651-989e-e79f07d199b4 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.794506 Aug 27 02:28:17.593792 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 171/354] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:28:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:28:17.618874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b8d090e3-a653-40e8-ab65-c4790ff829bb tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:17.620118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b8d090e3-a653-40e8-ab65-c4790ff829bb tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:17.623777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9,nova_api:DELETE=5 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:17.995169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b8d090e3-a653-40e8-ab65-c4790ff829bb tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:18.015887 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b8d090e3-a653-40e8-ab65-c4790ff829bb tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1223 microversion: 2.1 time: 0.406095 Aug 27 02:28:18.020748 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 172/355] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:17 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1223 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:18.200458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ef5f8321-ec13-44ad-b586-af7153724394 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:18.201818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ef5f8321-ec13-44ad-b586-af7153724394 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:18.250792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef5f8321-ec13-44ad-b586-af7153724394 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:18.253214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef5f8321-ec13-44ad-b586-af7153724394 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:18.258794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef5f8321-ec13-44ad-b586-af7153724394 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:18.264662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef5f8321-ec13-44ad-b586-af7153724394 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:18.271470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef5f8321-ec13-44ad-b586-af7153724394 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:18.272309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef5f8321-ec13-44ad-b586-af7153724394 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:18.619859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:18.649330 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0d34bb1a-4b3b-475c-a6ef-aa36fa8a1e74 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1458 microversion: 2.1 time: 1.463888 Aug 27 02:28:18.658633 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 184/356] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:17 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1458 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:18.784012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ef5f8321-ec13-44ad-b586-af7153724394 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:18.806128 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ef5f8321-ec13-44ad-b586-af7153724394 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1319 microversion: 2.1 time: 0.606004 Aug 27 02:28:18.824934 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 173/357] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:18 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1319 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:19.055368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-81263995-5ecc-48c5-85c4-64e1a1b74640 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:19.055993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-81263995-5ecc-48c5-85c4-64e1a1b74640 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:19.063563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81263995-5ecc-48c5-85c4-64e1a1b74640 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:19.064055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81263995-5ecc-48c5-85c4-64e1a1b74640 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:19.065013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81263995-5ecc-48c5-85c4-64e1a1b74640 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:19.066338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81263995-5ecc-48c5-85c4-64e1a1b74640 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:19.067721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81263995-5ecc-48c5-85c4-64e1a1b74640 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:19.068810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81263995-5ecc-48c5-85c4-64e1a1b74640 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:19.227569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-81263995-5ecc-48c5-85c4-64e1a1b74640 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:19.240588 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-81263995-5ecc-48c5-85c4-64e1a1b74640 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1219 microversion: 2.1 time: 0.188955 Aug 27 02:28:19.250563 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 185/358] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:19 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1219 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:19.547837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c9d05c3b-559f-4a6d-af24-90d2e1fa7e35 req-8f930aef-badf-4c07-8f80-68b51c4e4747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a8413d-9d40-41a6-82da-081f3fa797f7", "name": "network-vif-deleted", "tag": "1c922404-5224-45b6-9c6c-82e2c961188a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:19.598629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c9d05c3b-559f-4a6d-af24-90d2e1fa7e35 req-8f930aef-badf-4c07-8f80-68b51c4e4747 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:19.599529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c9d05c3b-559f-4a6d-af24-90d2e1fa7e35 req-8f930aef-badf-4c07-8f80-68b51c4e4747 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:19.600193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c9d05c3b-559f-4a6d-af24-90d2e1fa7e35 req-8f930aef-badf-4c07-8f80-68b51c4e4747 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:19.630646 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c9d05c3b-559f-4a6d-af24-90d2e1fa7e35 req-8f930aef-badf-4c07-8f80-68b51c4e4747 service nova] Creating event network-vif-deleted:1c922404-5224-45b6-9c6c-82e2c961188a for instance 35a8413d-9d40-41a6-82da-081f3fa797f7 on n-h2-852084-5 Aug 27 02:28:19.644445 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c9d05c3b-559f-4a6d-af24-90d2e1fa7e35 req-8f930aef-badf-4c07-8f80-68b51c4e4747 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098087 Aug 27 02:28:19.645509 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 174/359] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:19.688366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:19.695956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:19.744059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:19.746109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:19.747125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:19.752088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:19.760789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:19.764103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:19.833237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8b539ec4-77d6-4692-ad80-ddfb06f3170e tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:19.834029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8b539ec4-77d6-4692-ad80-ddfb06f3170e tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:19.870976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b539ec4-77d6-4692-ad80-ddfb06f3170e tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:19.872850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b539ec4-77d6-4692-ad80-ddfb06f3170e tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:19.874332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b539ec4-77d6-4692-ad80-ddfb06f3170e tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:19.879790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b539ec4-77d6-4692-ad80-ddfb06f3170e tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:19.881040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b539ec4-77d6-4692-ad80-ddfb06f3170e tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:19.884740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b539ec4-77d6-4692-ad80-ddfb06f3170e tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:20.014574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:20.018563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:20.021867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:20.025013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lazy-loading 'fault' on Instance uuid 35a8413d-9d40-41a6-82da-081f3fa797f7 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:28:20.074704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=5,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:20.389486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46309895da04211866ad3bbcb96ff76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc468f7c61aa40d892089c93573ebef1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:20.403470 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-18e5ae59-24f9-40f7-9f3f-1f4d5a56ba63 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 200 len: 1309 microversion: 2.1 time: 0.724504 Aug 27 02:28:20.405335 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 186/360] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:19 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 1309 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:20.411513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-733b41f6-5c5d-4aae-976f-c7eb92c55930 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:20.412438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-733b41f6-5c5d-4aae-976f-c7eb92c55930 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:20.423370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733b41f6-5c5d-4aae-976f-c7eb92c55930 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:20.424301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733b41f6-5c5d-4aae-976f-c7eb92c55930 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:20.425233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733b41f6-5c5d-4aae-976f-c7eb92c55930 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:20.426221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733b41f6-5c5d-4aae-976f-c7eb92c55930 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:20.427981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733b41f6-5c5d-4aae-976f-c7eb92c55930 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:20.429939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733b41f6-5c5d-4aae-976f-c7eb92c55930 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:20.533145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8b539ec4-77d6-4692-ad80-ddfb06f3170e tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:20.547877 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8b539ec4-77d6-4692-ad80-ddfb06f3170e tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1319 microversion: 2.1 time: 0.717750 Aug 27 02:28:20.551091 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 175/361] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:19 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1319 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:28:20.732894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-733b41f6-5c5d-4aae-976f-c7eb92c55930 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:20.753979 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-733b41f6-5c5d-4aae-976f-c7eb92c55930 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1281 microversion: 2.1 time: 0.347158 Aug 27 02:28:20.758807 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 187/362] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:20 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1281 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:21.447081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:21.448560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:21.466560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:21.468154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:21.468797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:21.472191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:21.474280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:21.480435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:21.532162 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] HTTP exception thrown: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Request method failure captured: Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 HTTP/1.1 Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDsr6HiDtLrsXRR7oKFPIbGqfyrMeFXOfjkgHwe8zDWjdcE6u5fTv97ks2j6uxDy0X9XHA053hEW4XdCtVDiPRcAutXt58pBkSMyKoaA4SDpkmvmAyfo5Mfgbp8KYW42icDmXaaC9eb95rm_zA6j5a2lBvY3rbO-_7lgMly5coPuOU Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:21.542362 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dc468f7c61aa40d892089c93573ebef1"}]}] Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f46309895da04211866ad3bbcb96ff76 Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.545027 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '35a8413d-9d40-41a6-82da-081f3fa797f7'} Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:21.546618 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.549691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.553701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Returning 404 to user: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:21.560877 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c3d1dabf-b20c-48e8-9e86-894ac95b800f tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 404 len: 111 microversion: 2.1 time: 0.119525 Aug 27 02:28:21.564100 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 176/363] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:21 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:28:21.580073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e6c7467-4215-4e5e-a46f-4aeb892b5276 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:21.582707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5e6c7467-4215-4e5e-a46f-4aeb892b5276 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:21.587640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:21.596784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:21.611942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e6c7467-4215-4e5e-a46f-4aeb892b5276 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:21.614393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e6c7467-4215-4e5e-a46f-4aeb892b5276 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:21.618582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e6c7467-4215-4e5e-a46f-4aeb892b5276 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:21.623533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e6c7467-4215-4e5e-a46f-4aeb892b5276 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:21.628732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e6c7467-4215-4e5e-a46f-4aeb892b5276 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:21.631170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:21.631170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:21.632987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e6c7467-4215-4e5e-a46f-4aeb892b5276 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:21.637377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:21.641727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:21.644599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:21.647699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:21.709219 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] HTTP exception thrown: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Request method failure captured: Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 HTTP/1.1 Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDsr6HiDtLrsXRR7oKFPIbGqfyrMeFXOfjkgHwe8zDWjdcE6u5fTv97ks2j6uxDy0X9XHA053hEW4XdCtVDiPRcAutXt58pBkSMyKoaA4SDpkmvmAyfo5Mfgbp8KYW42icDmXaaC9eb95rm_zA6j5a2lBvY3rbO-_7lgMly5coPuOU Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:21.718614 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dc468f7c61aa40d892089c93573ebef1"}]}] Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f46309895da04211866ad3bbcb96ff76 Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.721365 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '35a8413d-9d40-41a6-82da-081f3fa797f7'} Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:21.722683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.726912 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.730226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Returning 404 to user: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:21.738405 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fbc4121b-3b2b-4c85-8c58-9c1984a54996 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "DELETE /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 404 len: 111 microversion: 2.1 time: 0.152465 Aug 27 02:28:21.739414 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 177/364] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:28:21 2022] DELETE /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:21.753545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:21.761063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 35a8413d-9d40-41a6-82da-081f3fa797f7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:21.786759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:21.788442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:21.789031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:21.790390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:21.791783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:21.794530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:21.837230 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] HTTP exception thrown: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Request method failure captured: Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 HTTP/1.1 Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDsr6HiDtLrsXRR7oKFPIbGqfyrMeFXOfjkgHwe8zDWjdcE6u5fTv97ks2j6uxDy0X9XHA053hEW4XdCtVDiPRcAutXt58pBkSMyKoaA4SDpkmvmAyfo5Mfgbp8KYW42icDmXaaC9eb95rm_zA6j5a2lBvY3rbO-_7lgMly5coPuOU Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:21.846154 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dc468f7c61aa40d892089c93573ebef1"}]}] Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f46309895da04211866ad3bbcb96ff76 Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.848382 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '35a8413d-9d40-41a6-82da-081f3fa797f7'} Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:21.850029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. Aug 27 02:28:21.853576 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:21.860384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Returning 404 to user: Instance 35a8413d-9d40-41a6-82da-081f3fa797f7 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:21.865034 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2456ba9d-6808-4a98-bdac-aae990600cab tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7" status: 404 len: 111 microversion: 2.1 time: 0.118615 Aug 27 02:28:21.871219 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 178/365] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:21 2022] GET /compute/v2.1/servers/35a8413d-9d40-41a6-82da-081f3fa797f7 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:21.902545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-335e215e-776b-4c60-8810-29566dbad9cc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:21.903421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-335e215e-776b-4c60-8810-29566dbad9cc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:21.926625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-335e215e-776b-4c60-8810-29566dbad9cc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:21.927079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-335e215e-776b-4c60-8810-29566dbad9cc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:21.933182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-335e215e-776b-4c60-8810-29566dbad9cc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:21.936051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-335e215e-776b-4c60-8810-29566dbad9cc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:21.936562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-335e215e-776b-4c60-8810-29566dbad9cc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:21.942063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-335e215e-776b-4c60-8810-29566dbad9cc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:22.144846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-335e215e-776b-4c60-8810-29566dbad9cc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:22.184482 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-335e215e-776b-4c60-8810-29566dbad9cc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1281 microversion: 2.1 time: 0.303074 Aug 27 02:28:22.189230 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 179/366] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:21 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1281 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:22.215138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:22.226761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:22.251785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:22.252932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:22.255435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:22.258006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:22.259045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:22.260013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:22.307295 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] HTTP exception thrown: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Request method failure captured: Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 HTTP/1.1 Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDsr6HiDtLrsXRR7oKFPIbGqfyrMeFXOfjkgHwe8zDWjdcE6u5fTv97ks2j6uxDy0X9XHA053hEW4XdCtVDiPRcAutXt58pBkSMyKoaA4SDpkmvmAyfo5Mfgbp8KYW42icDmXaaC9eb95rm_zA6j5a2lBvY3rbO-_7lgMly5coPuOU Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:22.311591 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dc468f7c61aa40d892089c93573ebef1"}]}] Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f46309895da04211866ad3bbcb96ff76 Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:28:22.314371 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '4fdd496b-91e7-43df-94fc-9f56f3ed9859'} Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:22.315966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:28:22.320461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:22.325506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Returning 404 to user: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:22.327412 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a1e6b20-cc5e-4ee0-a24e-d53d0f8936fd tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 404 len: 111 microversion: 2.1 time: 0.135125 Aug 27 02:28:22.336912 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 180/367] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:28:22 2022] DELETE /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:22.350137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-88de91f1-103e-4c1e-8794-481186d3dc29 req-c3d7dfd4-554a-4266-a4b6-19f7f3433dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757ac8d3-8528-470c-a017-adeb167ed73b", "name": "network-vif-plugged", "status": "completed", "tag": "508942ce-8030-4c4f-ba87-ef3a2b5d73c8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:22.403919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-88de91f1-103e-4c1e-8794-481186d3dc29 req-c3d7dfd4-554a-4266-a4b6-19f7f3433dc0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:22.405401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-88de91f1-103e-4c1e-8794-481186d3dc29 req-c3d7dfd4-554a-4266-a4b6-19f7f3433dc0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:22.406810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-88de91f1-103e-4c1e-8794-481186d3dc29 req-c3d7dfd4-554a-4266-a4b6-19f7f3433dc0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:22.456579 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-88de91f1-103e-4c1e-8794-481186d3dc29 req-c3d7dfd4-554a-4266-a4b6-19f7f3433dc0 service nova] Creating event network-vif-plugged:508942ce-8030-4c4f-ba87-ef3a2b5d73c8 for instance 757ac8d3-8528-470c-a017-adeb167ed73b on n-h2-852084-5 Aug 27 02:28:22.470955 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-88de91f1-103e-4c1e-8794-481186d3dc29 req-c3d7dfd4-554a-4266-a4b6-19f7f3433dc0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131425 Aug 27 02:28:22.472553 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 181/368] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:22.490808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:22.493162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] [instance: 4fdd496b-91e7-43df-94fc-9f56f3ed9859] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:22.518595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5e6c7467-4215-4e5e-a46f-4aeb892b5276 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:22.551624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:22.554630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:22.556521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:22.558385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:22.559872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:22.563861 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e6c7467-4215-4e5e-a46f-4aeb892b5276 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1319 microversion: 2.1 time: 0.986979 Aug 27 02:28:22.568213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:22.569243 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 188/369] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:21 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1319 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:28:22.663369 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] HTTP exception thrown: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Request method failure captured: Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 HTTP/1.1 Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYDsr6HiDtLrsXRR7oKFPIbGqfyrMeFXOfjkgHwe8zDWjdcE6u5fTv97ks2j6uxDy0X9XHA053hEW4XdCtVDiPRcAutXt58pBkSMyKoaA4SDpkmvmAyfo5Mfgbp8KYW42icDmXaaC9eb95rm_zA6j5a2lBvY3rbO-_7lgMly5coPuOU Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:22.674780 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dc468f7c61aa40d892089c93573ebef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dc468f7c61aa40d892089c93573ebef1"}]}] Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dc468f7c61aa40d892089c93573ebef1 Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1313857300 Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f46309895da04211866ad3bbcb96ff76 Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersAdminTestJSON-1313857300-project Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:28:22.676051 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '4fdd496b-91e7-43df-94fc-9f56f3ed9859'} Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:22.676824 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. Aug 27 02:28:22.678136 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:22.681190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] Returning 404 to user: Instance 4fdd496b-91e7-43df-94fc-9f56f3ed9859 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:22.682688 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2848ca50-7ac3-4bcd-82eb-c4002d3b80b9 tempest-DeleteServersAdminTestJSON-1313857300 tempest-DeleteServersAdminTestJSON-1313857300-project] 10.222.0.99 "GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859" status: 404 len: 111 microversion: 2.1 time: 0.205349 Aug 27 02:28:22.683969 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 182/370] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:22 2022] GET /compute/v2.1/servers/4fdd496b-91e7-43df-94fc-9f56f3ed9859 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:23.247105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4f54bc44-a721-4019-b257-1e5cd5e49498 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:23.254709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4f54bc44-a721-4019-b257-1e5cd5e49498 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:23.280520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f54bc44-a721-4019-b257-1e5cd5e49498 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:23.284013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f54bc44-a721-4019-b257-1e5cd5e49498 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:23.293904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f54bc44-a721-4019-b257-1e5cd5e49498 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:23.295064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f54bc44-a721-4019-b257-1e5cd5e49498 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:23.302504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f54bc44-a721-4019-b257-1e5cd5e49498 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:23.303343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f54bc44-a721-4019-b257-1e5cd5e49498 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:23.595805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eae39f93-5148-4eed-aba1-fd86173e22dd tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-902578639", "id": 340108544, "os-flavor-access:is_public": "False"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:23.685481 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eae39f93-5148-4eed-aba1-fd86173e22dd tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.975920 Aug 27 02:28:23.686234 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 189/371] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:28:22 2022] POST /compute/v2.1/flavors => generated 435 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:23.697889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4f362fea-4043-4c10-aecb-dbc9ff3053a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:23.698522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4f362fea-4043-4c10-aecb-dbc9ff3053a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:23.736516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f362fea-4043-4c10-aecb-dbc9ff3053a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:23.737013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f362fea-4043-4c10-aecb-dbc9ff3053a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:23.737455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f362fea-4043-4c10-aecb-dbc9ff3053a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:23.738909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f362fea-4043-4c10-aecb-dbc9ff3053a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:23.744727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f362fea-4043-4c10-aecb-dbc9ff3053a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:23.745412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f362fea-4043-4c10-aecb-dbc9ff3053a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:23.983156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4f54bc44-a721-4019-b257-1e5cd5e49498 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:23.985719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:24.000121 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4f54bc44-a721-4019-b257-1e5cd5e49498 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1323 microversion: 2.1 time: 0.774868 Aug 27 02:28:24.016906 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 183/372] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:23 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1323 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:24.022321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92a912ed-0561-40ce-82d8-2d1ff5db49ed tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98024d8516f2456e8cdc85f6e458c2f5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:24.313006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f362fea-4043-4c10-aecb-dbc9ff3053a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:24.336200 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4f362fea-4043-4c10-aecb-dbc9ff3053a3 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1319 microversion: 2.1 time: 0.641011 Aug 27 02:28:24.338597 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 190/373] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:23 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1319 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:24.881436 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-92a912ed-0561-40ce-82d8-2d1ff5db49ed tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/340108544/action" status: 200 len: 96 microversion: 2.1 time: 0.862849 Aug 27 02:28:24.888375 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 184/374] 10.222.0.99 () {60 vars in 1197 bytes} [Sat Aug 27 02:28:24 2022] POST /compute/v2.1/flavors/340108544/action => generated 96 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:28:24.894117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-08a6e610-7430-431f-8138-33ba2560b8d0 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98024d8516f2456e8cdc85f6e458c2f5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:24.954733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2b5579d0-f749-484b-a391-d8f16dce9ac4 req-67274d8b-2495-47bb-98a8-90480916a23f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a1e717-f74a-4c2a-86db-de579a1b34a5", "tag": "3949f760-9972-475b-a0df-bcfc787c35ac"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:24.977077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2b5579d0-f749-484b-a391-d8f16dce9ac4 req-67274d8b-2495-47bb-98a8-90480916a23f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:24.981297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2b5579d0-f749-484b-a391-d8f16dce9ac4 req-67274d8b-2495-47bb-98a8-90480916a23f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:24.982843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2b5579d0-f749-484b-a391-d8f16dce9ac4 req-67274d8b-2495-47bb-98a8-90480916a23f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:25.016596 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2b5579d0-f749-484b-a391-d8f16dce9ac4 req-67274d8b-2495-47bb-98a8-90480916a23f service nova] Creating event network-changed:3949f760-9972-475b-a0df-bcfc787c35ac for instance 00a1e717-f74a-4c2a-86db-de579a1b34a5 on n-h1-852084-5 Aug 27 02:28:25.023748 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2b5579d0-f749-484b-a391-d8f16dce9ac4 req-67274d8b-2495-47bb-98a8-90480916a23f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072867 Aug 27 02:28:25.030433 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 185/375] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:25.037533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0a333a5f-c7ab-4052-a831-d6b798bf27dd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:25.040717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0a333a5f-c7ab-4052-a831-d6b798bf27dd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:25.048645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a333a5f-c7ab-4052-a831-d6b798bf27dd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:25.049649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a333a5f-c7ab-4052-a831-d6b798bf27dd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:25.050398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a333a5f-c7ab-4052-a831-d6b798bf27dd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:25.051454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a333a5f-c7ab-4052-a831-d6b798bf27dd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:25.052152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a333a5f-c7ab-4052-a831-d6b798bf27dd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:25.052802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a333a5f-c7ab-4052-a831-d6b798bf27dd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:25.628852 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-08a6e610-7430-431f-8138-33ba2560b8d0 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project 98024d8516f2456e8cdc85f6e458c2f5 combination. Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-08a6e610-7430-431f-8138-33ba2560b8d0 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Request method failure captured: Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/flavors/340108544/action HTTP/1.1 Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 67 Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFEqJoOcNzKP8PgKDqY3UuyFNlxADy7AoDxPRw5roPc8S18UZJQxXCFWBEwrVkLb9qc_M6XKWPR92QyQXMn6i6x55aR3ZGsuRcsyQedfsshkMNbvwRGyhaAA6JKR-eUoVANzZedSAnDZsyHv7GKODDnXY2YQErixET-NCF_LLzf_Is Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 83ccb301510644eba967f8c7ef90fee4 Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1965662978 Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:28:25.654895 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_83ccb301510644eba967f8c7ef90fee4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83ccb301510644eba967f8c7ef90fee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83ccb301510644eba967f8c7ef90fee4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/83ccb301510644eba967f8c7ef90fee4"}]}] Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1965662978 Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 83ccb301510644eba967f8c7ef90fee4 Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1965662978 Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 467a59f540c14c9890d151ba33e3e413 Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: {"addTenantAccess": {"tenant": "98024d8516f2456e8cdc85f6e458c2f5"}} Aug 27 02:28:25.657457 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: exception: Flavor access already exists for flavor 32 and project 98024d8516f2456e8cdc85f6e458c2f5 combination. Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '340108544', 'body': {'addTenantAccess': {'tenant': '98024d8516f2456e8cdc85f6e458c2f5'}}} Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:28:25.658700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-98024d8516f2456e8cdc85f6e458c2f5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 02:28:25.659703 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 02:28:25.662985 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:28:25.666241 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-98024d8516f2456e8cdc85f6e458c2f5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 2, 28, 25, 615649), 'updated_at': None, 'flavor_id': 32, 'project_id': '98024d8516f2456e8cdc85f6e458c2f5'}] Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:25.669653 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project 98024d8516f2456e8cdc85f6e458c2f5 combination. Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:25.670995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project 98024d8516f2456e8cdc85f6e458c2f5 combination. Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:25.673178 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:25.676348 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project 98024d8516f2456e8cdc85f6e458c2f5 combination. Aug 27 02:28:25.676348 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:25.676348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-08a6e610-7430-431f-8138-33ba2560b8d0 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project 98024d8516f2456e8cdc85f6e458c2f5 combination. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:25.676348 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-08a6e610-7430-431f-8138-33ba2560b8d0 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/340108544/action" status: 409 len: 152 microversion: 2.1 time: 0.770209 Aug 27 02:28:25.678094 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 191/376] 10.222.0.99 () {60 vars in 1197 bytes} [Sat Aug 27 02:28:24 2022] POST /compute/v2.1/flavors/340108544/action => generated 152 bytes in 789 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:28:25.691549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ee7db962-7ebe-4dc8-b057-ff886931800d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:25.696645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ee7db962-7ebe-4dc8-b057-ff886931800d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:25.712568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee7db962-7ebe-4dc8-b057-ff886931800d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:25.714015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee7db962-7ebe-4dc8-b057-ff886931800d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:25.717511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee7db962-7ebe-4dc8-b057-ff886931800d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:25.720170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee7db962-7ebe-4dc8-b057-ff886931800d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:25.721614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee7db962-7ebe-4dc8-b057-ff886931800d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:25.722387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee7db962-7ebe-4dc8-b057-ff886931800d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:25.949088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0a333a5f-c7ab-4052-a831-d6b798bf27dd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:25.972662 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0a333a5f-c7ab-4052-a831-d6b798bf27dd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1323 microversion: 2.1 time: 0.940122 Aug 27 02:28:25.998829 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 186/377] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:25 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1323 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:26.012612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7119b0d-608b-4a7b-b2ce-046085b6fd26 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "98024d8516f2456e8cdc85f6e458c2f5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:26.040834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ee7db962-7ebe-4dc8-b057-ff886931800d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:26.054187 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ee7db962-7ebe-4dc8-b057-ff886931800d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1469 microversion: 2.1 time: 0.374077 Aug 27 02:28:26.065952 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 192/378] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:25 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1469 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:26.099418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d2ea3763-1930-41ca-9b78-d2d34c2fdf01 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:26.101117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d2ea3763-1930-41ca-9b78-d2d34c2fdf01 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:26.114889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2ea3763-1930-41ca-9b78-d2d34c2fdf01 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:26.116850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2ea3763-1930-41ca-9b78-d2d34c2fdf01 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:26.118172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2ea3763-1930-41ca-9b78-d2d34c2fdf01 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:26.119822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2ea3763-1930-41ca-9b78-d2d34c2fdf01 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:26.120520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2ea3763-1930-41ca-9b78-d2d34c2fdf01 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:26.121622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2ea3763-1930-41ca-9b78-d2d34c2fdf01 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:26.191049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-d2ea3763-1930-41ca-9b78-d2d34c2fdf01 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lazy-loading 'flavor' on Instance uuid 757ac8d3-8528-470c-a017-adeb167ed73b {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:28:26.481806 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d2ea3763-1930-41ca-9b78-d2d34c2fdf01 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b/action" status: 202 len: 0 microversion: 2.1 time: 0.387371 Aug 27 02:28:26.489947 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 193/379] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:28:26 2022] POST /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:28:26.503258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b6c46d1-6526-40f0-8ed7-1d5dfd292582 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:26.505369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9b6c46d1-6526-40f0-8ed7-1d5dfd292582 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:26.528519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6c46d1-6526-40f0-8ed7-1d5dfd292582 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:26.529906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6c46d1-6526-40f0-8ed7-1d5dfd292582 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:26.531139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6c46d1-6526-40f0-8ed7-1d5dfd292582 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:26.535537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6c46d1-6526-40f0-8ed7-1d5dfd292582 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:26.537417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6c46d1-6526-40f0-8ed7-1d5dfd292582 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:26.539408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6c46d1-6526-40f0-8ed7-1d5dfd292582 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:26.838376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9b6c46d1-6526-40f0-8ed7-1d5dfd292582 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:26.850242 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9b6c46d1-6526-40f0-8ed7-1d5dfd292582 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1477 microversion: 2.1 time: 0.357114 Aug 27 02:28:26.853137 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 194/380] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:26 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1477 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:27.017584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-877ffc65-c9de-4a08-af12-165c5177915a tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:27.018530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-877ffc65-c9de-4a08-af12-165c5177915a tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:27.039671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877ffc65-c9de-4a08-af12-165c5177915a tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:27.040848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877ffc65-c9de-4a08-af12-165c5177915a tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:27.042638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877ffc65-c9de-4a08-af12-165c5177915a tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:27.044497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877ffc65-c9de-4a08-af12-165c5177915a tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:27.045819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877ffc65-c9de-4a08-af12-165c5177915a tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:27.046854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877ffc65-c9de-4a08-af12-165c5177915a tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:27.276130 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c7119b0d-608b-4a7b-b2ce-046085b6fd26 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/340108544/action" status: 200 len: 21 microversion: 2.1 time: 1.264745 Aug 27 02:28:27.292759 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 187/381] 10.222.0.99 () {60 vars in 1197 bytes} [Sat Aug 27 02:28:25 2022] POST /compute/v2.1/flavors/340108544/action => generated 21 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:28:27.302738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1459e70a-1996-47ce-8118-ec14503bb7e7 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:27.321007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-877ffc65-c9de-4a08-af12-165c5177915a tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:27.343965 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-877ffc65-c9de-4a08-af12-165c5177915a tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1323 microversion: 2.1 time: 0.333778 Aug 27 02:28:27.344733 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1459e70a-1996-47ce-8118-ec14503bb7e7 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/340108544" status: 202 len: 0 microversion: 2.1 time: 0.049441 Aug 27 02:28:27.345823 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 195/382] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:27 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1323 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:27.359132 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 188/383] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:28:27 2022] DELETE /compute/v2.1/flavors/340108544 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:28:27.370084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cc58e68d-9726-4638-85fe-52cf4bb3eb57 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:27.408974 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cc58e68d-9726-4638-85fe-52cf4bb3eb57 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.043088 Aug 27 02:28:27.410095 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 196/384] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:28:27 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:27.449654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c58e250c-893d-46bc-9f08-3a864c984aad tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1218543638", "id": 258035855, "os-flavor-access:is_public": "True"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:27.462815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:27.491966 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c58e250c-893d-46bc-9f08-3a864c984aad tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.049265 Aug 27 02:28:27.501729 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 189/385] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:28:27 2022] POST /compute/v2.1/flavors => generated 435 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:27.515354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc70f972-4756-43fb-af6a-bfed7f10d387 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:27.529755 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-fc70f972-4756-43fb-af6a-bfed7f10d387 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc70f972-4756-43fb-af6a-bfed7f10d387 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Request method failure captured: Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/flavors/258035855/os-flavor-access HTTP/1.1 Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFEqJoOcNzKP8PgKDqY3UuyFNlxADy7AoDxPRw5roPc8S18UZJQxXCFWBEwrVkLb9qc_M6XKWPR92QyQXMn6i6x55aR3ZGsuRcsyQedfsshkMNbvwRGyhaAA6JKR-eUoVANzZedSAnDZsyHv7GKODDnXY2YQErixET-NCF_LLzf_Is Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 83ccb301510644eba967f8c7ef90fee4 Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1965662978 Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:28:27.532790 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_83ccb301510644eba967f8c7ef90fee4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83ccb301510644eba967f8c7ef90fee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83ccb301510644eba967f8c7ef90fee4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/83ccb301510644eba967f8c7ef90fee4"}]}] Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1965662978 Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 83ccb301510644eba967f8c7ef90fee4 Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1965662978 Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 467a59f540c14c9890d151ba33e3e413 Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: exception: Access list not available for public flavors. Aug 27 02:28:27.534667 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'flavor_id': '258035855'} Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 27 02:28:27.535511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:27.536885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc70f972-4756-43fb-af6a-bfed7f10d387 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:27.536885 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fc70f972-4756-43fb-af6a-bfed7f10d387 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/258035855/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.026675 Aug 27 02:28:27.542033 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 197/386] 10.222.0.99 () {58 vars in 1206 bytes} [Sat Aug 27 02:28:27 2022] GET /compute/v2.1/flavors/258035855/os-flavor-access => generated 91 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:28:27.552042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ed223701-222b-4bc5-885e-d160a00d8765 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:27.582861 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ed223701-222b-4bc5-885e-d160a00d8765 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/258035855" status: 202 len: 0 microversion: 2.1 time: 0.038187 Aug 27 02:28:27.584096 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 190/387] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:28:27 2022] DELETE /compute/v2.1/flavors/258035855 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:28:27.597641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fe0121b8-4c41-4a2a-83fc-6d859d2b2a3f tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:27.646095 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fe0121b8-4c41-4a2a-83fc-6d859d2b2a3f tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.054550 Aug 27 02:28:27.647701 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 198/388] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:28:27 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:27.683168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-093d7510-7143-4625-a7e7-f1ae390cbfaf tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1364482603", "id": 296178956, "os-flavor-access:is_public": "False"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:27.710737 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-093d7510-7143-4625-a7e7-f1ae390cbfaf tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.030933 Aug 27 02:28:27.711864 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 191/389] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:28:27 2022] POST /compute/v2.1/flavors => generated 436 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:27.892088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a3e92fa1-e326-4fab-b2d9-b83e986c8f69 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:27.893492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a3e92fa1-e326-4fab-b2d9-b83e986c8f69 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:27.906247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3e92fa1-e326-4fab-b2d9-b83e986c8f69 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:27.908467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3e92fa1-e326-4fab-b2d9-b83e986c8f69 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:27.909753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3e92fa1-e326-4fab-b2d9-b83e986c8f69 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:27.912094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3e92fa1-e326-4fab-b2d9-b83e986c8f69 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:27.913225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3e92fa1-e326-4fab-b2d9-b83e986c8f69 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:27.914859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3e92fa1-e326-4fab-b2d9-b83e986c8f69 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:28.002502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:28.265380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a3e92fa1-e326-4fab-b2d9-b83e986c8f69 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:28.283770 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a3e92fa1-e326-4fab-b2d9-b83e986c8f69 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1460 microversion: 2.1 time: 0.397890 Aug 27 02:28:28.290496 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 192/390] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:27 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1460 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:28:28.330051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-98130a17-4663-4ea3-930d-770d2175a994 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:28.331130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-98130a17-4663-4ea3-930d-770d2175a994 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:28.351474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98130a17-4663-4ea3-930d-770d2175a994 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:28.352737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98130a17-4663-4ea3-930d-770d2175a994 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:28.353508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98130a17-4663-4ea3-930d-770d2175a994 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:28.354794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98130a17-4663-4ea3-930d-770d2175a994 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:28.355582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98130a17-4663-4ea3-930d-770d2175a994 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:28.356309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98130a17-4663-4ea3-930d-770d2175a994 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:28.480368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e8fbf3db-e6db-4115-beef-e3e1867a21b9 tempest-FlavorsAccessNegativeTestJSON-758306313 tempest-FlavorsAccessNegativeTestJSON-758306313-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98024d8516f2456e8cdc85f6e458c2f5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:28.483955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e8fbf3db-e6db-4115-beef-e3e1867a21b9 tempest-FlavorsAccessNegativeTestJSON-758306313 tempest-FlavorsAccessNegativeTestJSON-758306313-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '91d41b5e1a4546e38f7205bb7039d4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98024d8516f2456e8cdc85f6e458c2f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e8fbf3db-e6db-4115-beef-e3e1867a21b9 tempest-FlavorsAccessNegativeTestJSON-758306313 tempest-FlavorsAccessNegativeTestJSON-758306313-project] Request method failure captured: Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/flavors/296178956/action HTTP/1.1 Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 67 Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFBvyhVXMYzW5CIiXn3aLrBHIHg6p8c5otKgD4YQKZDnDsE2O5qk4n315ACP7D905c0nNwPOIbtd1zfiNYJ4ZhbHECvh6D8y2NEdbkZP77UXy2H0nfBCgThxqpoBSB5VAB6tIJ0xskkBihb3IYo8lWDJqISTzIfIs0XajlkKmFS06s Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 98024d8516f2456e8cdc85f6e458c2f5 Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-758306313 Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:28.485630 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_98024d8516f2456e8cdc85f6e458c2f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/98024d8516f2456e8cdc85f6e458c2f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/98024d8516f2456e8cdc85f6e458c2f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/98024d8516f2456e8cdc85f6e458c2f5"}]}] Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-758306313 Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 98024d8516f2456e8cdc85f6e458c2f5 Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-758306313 Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FlavorsAccessNegativeTestJSON-758306313-project Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 91d41b5e1a4546e38f7205bb7039d4e3 Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-758306313-project Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: {"addTenantAccess": {"tenant": "98024d8516f2456e8cdc85f6e458c2f5"}} Aug 27 02:28:28.490340 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '296178956', 'body': {'addTenantAccess': {'tenant': '98024d8516f2456e8cdc85f6e458c2f5'}}} Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:28.491209 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 27 02:28:28.493105 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:28.494481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e8fbf3db-e6db-4115-beef-e3e1867a21b9 tempest-FlavorsAccessNegativeTestJSON-758306313 tempest-FlavorsAccessNegativeTestJSON-758306313-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:28.494481 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e8fbf3db-e6db-4115-beef-e3e1867a21b9 tempest-FlavorsAccessNegativeTestJSON-758306313 tempest-FlavorsAccessNegativeTestJSON-758306313-project] 10.222.0.99 "POST /compute/v2.1/flavors/296178956/action" status: 403 len: 130 microversion: 2.1 time: 0.762203 Aug 27 02:28:28.494481 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 199/391] 10.222.0.99 () {60 vars in 1197 bytes} [Sat Aug 27 02:28:27 2022] POST /compute/v2.1/flavors/296178956/action => generated 130 bytes in 763 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:28.498960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7400a199-4191-45c0-8bbe-c470503bee81 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:28.499829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7400a199-4191-45c0-8bbe-c470503bee81 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:28.508099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7400a199-4191-45c0-8bbe-c470503bee81 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:28.508602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7400a199-4191-45c0-8bbe-c470503bee81 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:28.509052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7400a199-4191-45c0-8bbe-c470503bee81 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:28.509924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7400a199-4191-45c0-8bbe-c470503bee81 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:28.510585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7400a199-4191-45c0-8bbe-c470503bee81 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:28.511390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7400a199-4191-45c0-8bbe-c470503bee81 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:28.520481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:28.842724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7400a199-4191-45c0-8bbe-c470503bee81 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:28.858271 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7400a199-4191-45c0-8bbe-c470503bee81 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1323 microversion: 2.1 time: 0.368931 Aug 27 02:28:28.860250 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 200/392] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:28 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:29.057744 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-98130a17-4663-4ea3-930d-770d2175a994 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1611 microversion: 2.1 time: 0.734931 Aug 27 02:28:29.062131 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 193/393] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:28 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1611 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:29.080802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-15794da1-6097-4c24-b0d6-6943267aeb6a tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:29.119162 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-15794da1-6097-4c24-b0d6-6943267aeb6a tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/296178956" status: 202 len: 0 microversion: 2.1 time: 0.055170 Aug 27 02:28:29.126927 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 194/394] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:28:29 2022] DELETE /compute/v2.1/flavors/296178956 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:28:29.137220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd42dbd3-b945-4752-97c8-a6186a716098 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:29.146682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd42dbd3-b945-4752-97c8-a6186a716098 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:29.148052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd42dbd3-b945-4752-97c8-a6186a716098 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:29.149159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd42dbd3-b945-4752-97c8-a6186a716098 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:29.151212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd42dbd3-b945-4752-97c8-a6186a716098 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:29.152646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd42dbd3-b945-4752-97c8-a6186a716098 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:29.153941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd42dbd3-b945-4752-97c8-a6186a716098 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:29.206256 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd42dbd3-b945-4752-97c8-a6186a716098 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.076830 Aug 27 02:28:29.207281 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 195/395] 10.222.0.99 () {58 vars in 1176 bytes} [Sat Aug 27 02:28:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:29.217722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f0d10d6f-8cf6-47cb-a568-32e81ed94df1 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:29.261422 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f0d10d6f-8cf6-47cb-a568-32e81ed94df1 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.051870 Aug 27 02:28:29.262437 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 196/396] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:28:29 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:29.271001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852084-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:29.281275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:29.293287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:29.295528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:29.296726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:29.298072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:29.299151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:29.300212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:29.356536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Lazy-loading 'flavor' on Instance uuid 757ac8d3-8528-470c-a017-adeb167ed73b {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:28:29.381731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-39080d72-56d5-4c6d-b138-9fdee2c3a490 tempest-QuotaClassesAdmin257Test-1853545656 tempest-QuotaClassesAdmin257Test-1853545656-project-admin] Calling method '.version_select at 0x7f4d2acbe0d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:29.383834 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 757ac8d3-8528-470c-a017-adeb167ed73b while it is in vm_state suspended Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Request method failure captured: Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b/action HTTP/1.1 Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 97 Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYETPhk728VVWR-QkBmYzHDGTPy47zyUjnPjKGWut-RldC7WPV0nzh5L3wFWZYxbCAvMQUSFGtVdxlv_dIYeBfSRjaRF5sTf9vFMCqfPz8Q1f5AySnq1buQGyuIa33qkzqLoScA5WCG7It82V7P90Izk7aS5dKrl0VCZmiOSxnC_HJM Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 5d19ae14d02d45028c5e9653f404bd57 Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-LiveMigrationNegativeTest-1176584473 Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:29.388339 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5d19ae14d02d45028c5e9653f404bd57"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5d19ae14d02d45028c5e9653f404bd57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5d19ae14d02d45028c5e9653f404bd57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5d19ae14d02d45028c5e9653f404bd57"}]}] Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-LiveMigrationNegativeTest-1176584473 Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 5d19ae14d02d45028c5e9653f404bd57 Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1176584473 Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-LiveMigrationNegativeTest-1176584473-project-admin Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 3d77c58c55c94d4992276c52736aae2b Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-LiveMigrationNegativeTest-1176584473-project-admin Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: {"os-migrateLive": {"host": "n-h1-852084-5", "block_migration": true, "disk_over_commit": false}} Aug 27 02:28:29.390686 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'os-migrateLive' instance 757ac8d3-8528-470c-a017-adeb167ed73b while it is in vm_state suspended Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '757ac8d3-8528-470c-a017-adeb167ed73b', 'body': {'os-migrateLive': {'host': 'n-h1-852084-5', 'block_migration': True, 'disk_over_commit': False}}} Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 02:28:29.393013 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 757ac8d3-8528-470c-a017-adeb167ed73b in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:29.397147 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 757ac8d3-8528-470c-a017-adeb167ed73b while it is in vm_state suspended Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 757ac8d3-8528-470c-a017-adeb167ed73b while it is in vm_state suspended Aug 27 02:28:29.411333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:29.415804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 757ac8d3-8528-470c-a017-adeb167ed73b while it is in vm_state suspended {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:29.415997 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-39080d72-56d5-4c6d-b138-9fdee2c3a490 tempest-QuotaClassesAdmin257Test-1853545656 tempest-QuotaClassesAdmin257Test-1853545656-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.553169 Aug 27 02:28:29.427564 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 201/397] 10.222.0.99 () {60 vars in 1226 bytes} [Sat Aug 27 02:28:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:29.427843 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9b44aa8d-ad13-4a0a-b241-dc20caa4cb52 tempest-LiveMigrationNegativeTest-1176584473 tempest-LiveMigrationNegativeTest-1176584473-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b/action" status: 409 len: 155 microversion: 2.1 time: 0.157292 Aug 27 02:28:29.428010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8d2c2f67-1c53-40ba-8ce6-1718cd6c50a9 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1706427211", "id": 395477940, "os-flavor-access:is_public": "False"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:29.428171 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 197/398] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:28:29 2022] POST /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b/action => generated 155 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:28:29.448136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7a47f3d6-2882-4dc5-9944-12679e920e0a tempest-QuotaClassesAdmin257Test-1853545656 tempest-QuotaClassesAdmin257Test-1853545656-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2addbaf0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:29.453763 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8d2c2f67-1c53-40ba-8ce6-1718cd6c50a9 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.035862 Aug 27 02:28:29.454739 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 202/399] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:28:29 2022] POST /compute/v2.1/flavors => generated 436 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:29.459607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-81db3d8d-a9cb-48d7-9721-579ef16f65ba tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:29.460018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-81db3d8d-a9cb-48d7-9721-579ef16f65ba tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:29.466750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81db3d8d-a9cb-48d7-9721-579ef16f65ba tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:29.467253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81db3d8d-a9cb-48d7-9721-579ef16f65ba tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:29.467888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81db3d8d-a9cb-48d7-9721-579ef16f65ba tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:29.469090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81db3d8d-a9cb-48d7-9721-579ef16f65ba tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:29.469970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81db3d8d-a9cb-48d7-9721-579ef16f65ba tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:29.470426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81db3d8d-a9cb-48d7-9721-579ef16f65ba tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:29.502902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-81db3d8d-a9cb-48d7-9721-579ef16f65ba tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:28:29.613027 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-81db3d8d-a9cb-48d7-9721-579ef16f65ba tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "DELETE /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 204 len: 0 microversion: 2.1 time: 0.156078 Aug 27 02:28:29.615790 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 203/400] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:28:29 2022] DELETE /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:28:29.627861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-448f765a-e6b7-4925-8e0b-4ca12555d1be tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "98024d8516f2456e8cdc85f6e458c2f5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:29.675292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:DELETE=10,nova_api:UPDATE=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:29.848241 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7a47f3d6-2882-4dc5-9944-12679e920e0a tempest-QuotaClassesAdmin257Test-1853545656 tempest-QuotaClassesAdmin257Test-1853545656-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.406157 Aug 27 02:28:29.850570 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 198/401] 10.222.0.99 () {62 vars in 1247 bytes} [Sat Aug 27 02:28:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:29.865223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b08dba05-d402-4ee7-8660-7d605c59ef24 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:29.866940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b08dba05-d402-4ee7-8660-7d605c59ef24 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:29.882507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b08dba05-d402-4ee7-8660-7d605c59ef24 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:29.890946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b08dba05-d402-4ee7-8660-7d605c59ef24 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:29.890946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b08dba05-d402-4ee7-8660-7d605c59ef24 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:29.891746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b08dba05-d402-4ee7-8660-7d605c59ef24 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:29.892211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b08dba05-d402-4ee7-8660-7d605c59ef24 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:29.894969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b08dba05-d402-4ee7-8660-7d605c59ef24 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:30.310238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b08dba05-d402-4ee7-8660-7d605c59ef24 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:30.327139 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b08dba05-d402-4ee7-8660-7d605c59ef24 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1466 microversion: 2.1 time: 0.472787 Aug 27 02:28:30.343869 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 199/402] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:29 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1466 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:30.364626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c5cfdaa1-00e4-4047-9b85-70cedb054bd9 tempest-QuotaClassesAdmin257Test-1853545656 tempest-QuotaClassesAdmin257Test-1853545656-project-admin] Calling method '.version_select at 0x7f4d2adf1700>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:30.391581 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c5cfdaa1-00e4-4047-9b85-70cedb054bd9 tempest-QuotaClassesAdmin257Test-1853545656 tempest-QuotaClassesAdmin257Test-1853545656-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.043472 Aug 27 02:28:30.406883 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 200/403] 10.222.0.99 () {60 vars in 1226 bytes} [Sat Aug 27 02:28:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:30.418629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ec7e184-600d-4a88-a5da-66d0b6144b4e tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:30.420302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ec7e184-600d-4a88-a5da-66d0b6144b4e tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:30.432598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ec7e184-600d-4a88-a5da-66d0b6144b4e tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:30.434475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ec7e184-600d-4a88-a5da-66d0b6144b4e tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:30.442427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ec7e184-600d-4a88-a5da-66d0b6144b4e tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:30.444182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ec7e184-600d-4a88-a5da-66d0b6144b4e tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:30.446042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ec7e184-600d-4a88-a5da-66d0b6144b4e tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:30.446846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ec7e184-600d-4a88-a5da-66d0b6144b4e tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:30.527000 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-448f765a-e6b7-4925-8e0b-4ca12555d1be tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/395477940/action" status: 200 len: 96 microversion: 2.1 time: 0.908308 Aug 27 02:28:30.547915 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 204/404] 10.222.0.99 () {60 vars in 1197 bytes} [Sat Aug 27 02:28:29 2022] POST /compute/v2.1/flavors/395477940/action => generated 96 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:28:30.563613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5f49ee5-2238-4987-bfda-f6008002d3bd tempest-QuotaClassesAdmin257Test-1853545656 tempest-QuotaClassesAdmin257Test-1853545656-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2acb70d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:30.697528 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e5f49ee5-2238-4987-bfda-f6008002d3bd tempest-QuotaClassesAdmin257Test-1853545656 tempest-QuotaClassesAdmin257Test-1853545656-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.146116 Aug 27 02:28:30.699765 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 205/405] 10.222.0.99 () {62 vars in 1247 bytes} [Sat Aug 27 02:28:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:30.706539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0c241ae-e03d-4c3b-b797-4d35ed106867 tempest-FlavorsAccessNegativeTestJSON-758306313 tempest-FlavorsAccessNegativeTestJSON-758306313-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "98024d8516f2456e8cdc85f6e458c2f5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:30.714480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b0c241ae-e03d-4c3b-b797-4d35ed106867 tempest-FlavorsAccessNegativeTestJSON-758306313 tempest-FlavorsAccessNegativeTestJSON-758306313-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '91d41b5e1a4546e38f7205bb7039d4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98024d8516f2456e8cdc85f6e458c2f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0c241ae-e03d-4c3b-b797-4d35ed106867 tempest-FlavorsAccessNegativeTestJSON-758306313 tempest-FlavorsAccessNegativeTestJSON-758306313-project] Request method failure captured: Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/flavors/395477940/action HTTP/1.1 Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 70 Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFBvyhVXMYzW5CIiXn3aLrBHIHg6p8c5otKgD4YQKZDnDsE2O5qk4n315ACP7D905c0nNwPOIbtd1zfiNYJ4ZhbHECvh6D8y2NEdbkZP77UXy2H0nfBCgThxqpoBSB5VAB6tIJ0xskkBihb3IYo8lWDJqISTzIfIs0XajlkKmFS06s Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 98024d8516f2456e8cdc85f6e458c2f5 Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-758306313 Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:30.716810 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_98024d8516f2456e8cdc85f6e458c2f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/98024d8516f2456e8cdc85f6e458c2f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/98024d8516f2456e8cdc85f6e458c2f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/98024d8516f2456e8cdc85f6e458c2f5"}]}] Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-758306313 Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 98024d8516f2456e8cdc85f6e458c2f5 Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-758306313 Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FlavorsAccessNegativeTestJSON-758306313-project Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 91d41b5e1a4546e38f7205bb7039d4e3 Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-758306313-project Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: {"removeTenantAccess": {"tenant": "98024d8516f2456e8cdc85f6e458c2f5"}} Aug 27 02:28:30.718069 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '395477940', 'body': {'removeTenantAccess': {'tenant': '98024d8516f2456e8cdc85f6e458c2f5'}}} Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can( Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:30.718712 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 27 02:28:30.719753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:30.720770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0c241ae-e03d-4c3b-b797-4d35ed106867 tempest-FlavorsAccessNegativeTestJSON-758306313 tempest-FlavorsAccessNegativeTestJSON-758306313-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:30.720770 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b0c241ae-e03d-4c3b-b797-4d35ed106867 tempest-FlavorsAccessNegativeTestJSON-758306313 tempest-FlavorsAccessNegativeTestJSON-758306313-project] 10.222.0.99 "POST /compute/v2.1/flavors/395477940/action" status: 403 len: 133 microversion: 2.1 time: 0.018476 Aug 27 02:28:30.722019 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 206/406] 10.222.0.99 () {60 vars in 1197 bytes} [Sat Aug 27 02:28:30 2022] POST /compute/v2.1/flavors/395477940/action => generated 133 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:30.737266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33ff18d6-5752-45f9-ae53-59f822317837 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "98024d8516f2456e8cdc85f6e458c2f5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:30.818878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ec7e184-600d-4a88-a5da-66d0b6144b4e tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:30.828034 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ec7e184-600d-4a88-a5da-66d0b6144b4e tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1323 microversion: 2.1 time: 0.419061 Aug 27 02:28:30.842154 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 201/407] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:30 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1323 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:31.370325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-08903ff8-d202-4ff9-81f6-c132130d01c5 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:31.371823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-08903ff8-d202-4ff9-81f6-c132130d01c5 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:31.380249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08903ff8-d202-4ff9-81f6-c132130d01c5 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:31.381334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08903ff8-d202-4ff9-81f6-c132130d01c5 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:31.382036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08903ff8-d202-4ff9-81f6-c132130d01c5 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:31.393315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08903ff8-d202-4ff9-81f6-c132130d01c5 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:31.394396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08903ff8-d202-4ff9-81f6-c132130d01c5 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:31.395028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08903ff8-d202-4ff9-81f6-c132130d01c5 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:31.652970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-08903ff8-d202-4ff9-81f6-c132130d01c5 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:31.667494 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-08903ff8-d202-4ff9-81f6-c132130d01c5 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1466 microversion: 2.1 time: 0.304217 Aug 27 02:28:31.668798 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 202/408] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:31 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1466 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:31.850000 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-33ff18d6-5752-45f9-ae53-59f822317837 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/395477940/action" status: 200 len: 21 microversion: 2.1 time: 1.120858 Aug 27 02:28:31.853601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2a61c486-9173-4882-bddf-49c0d398cc2b tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:31.854555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2a61c486-9173-4882-bddf-49c0d398cc2b tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:31.862853 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 207/409] 10.222.0.99 () {60 vars in 1197 bytes} [Sat Aug 27 02:28:30 2022] POST /compute/v2.1/flavors/395477940/action => generated 21 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:28:31.866955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a61c486-9173-4882-bddf-49c0d398cc2b tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:31.867479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a61c486-9173-4882-bddf-49c0d398cc2b tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:31.867928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a61c486-9173-4882-bddf-49c0d398cc2b tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:31.868702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a61c486-9173-4882-bddf-49c0d398cc2b tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:31.874464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a61c486-9173-4882-bddf-49c0d398cc2b tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:31.875327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a61c486-9173-4882-bddf-49c0d398cc2b tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:31.891011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-86569f09-6c9a-494c-bee9-9df384744ef4 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:31.985142 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-86569f09-6c9a-494c-bee9-9df384744ef4 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/395477940" status: 202 len: 0 microversion: 2.1 time: 0.119477 Aug 27 02:28:31.987179 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 208/410] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:28:31 2022] DELETE /compute/v2.1/flavors/395477940 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:28:32.023787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-17038676-1934-4f85-9dc4-9a44c3f6071a tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:32.145659 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-17038676-1934-4f85-9dc4-9a44c3f6071a tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.149388 Aug 27 02:28:32.152886 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 209/411] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:28:31 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:32.193347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9dd88e99-9a7b-48ec-b967-a6adf4751037 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2108930165", "id": 227367095, "os-flavor-access:is_public": "False"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:32.234949 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9dd88e99-9a7b-48ec-b967-a6adf4751037 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.046808 Aug 27 02:28:32.238258 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 210/412] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:28:32 2022] POST /compute/v2.1/flavors => generated 436 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:28:32.263082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d6b14d45-8e62-4089-a228-ab181812fde2 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9ea718d2ec3c45d4b33e5f319d4809ba"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:32.298536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2a61c486-9173-4882-bddf-49c0d398cc2b tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:32.313791 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2a61c486-9173-4882-bddf-49c0d398cc2b tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1323 microversion: 2.1 time: 0.467734 Aug 27 02:28:32.314477 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 203/413] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:31 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1323 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:28:33.024039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a5755ecc-67c5-4b09-a0ef-8813eeb4809b tempest-NetworksTest-1171335920 tempest-NetworksTest-1171335920-project-admin] Calling method '.version_select at 0x7f4d2ad8f0d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:33.171481 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-d6b14d45-8e62-4089-a228-ab181812fde2 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] HTTP exception thrown: Flavor access not found for 36 / 9ea718d2ec3c45d4b33e5f319d4809ba combination. Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d6b14d45-8e62-4089-a228-ab181812fde2 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Request method failure captured: Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/flavors/227367095/action HTTP/1.1 Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 70 Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFEqJoOcNzKP8PgKDqY3UuyFNlxADy7AoDxPRw5roPc8S18UZJQxXCFWBEwrVkLb9qc_M6XKWPR92QyQXMn6i6x55aR3ZGsuRcsyQedfsshkMNbvwRGyhaAA6JKR-eUoVANzZedSAnDZsyHv7GKODDnXY2YQErixET-NCF_LLzf_Is Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 83ccb301510644eba967f8c7ef90fee4 Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1965662978 Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:28:33.189362 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_83ccb301510644eba967f8c7ef90fee4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83ccb301510644eba967f8c7ef90fee4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/83ccb301510644eba967f8c7ef90fee4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/83ccb301510644eba967f8c7ef90fee4"}]}] Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1965662978 Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 83ccb301510644eba967f8c7ef90fee4 Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1965662978 Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 467a59f540c14c9890d151ba33e3e413 Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: {"removeTenantAccess": {"tenant": "9ea718d2ec3c45d4b33e5f319d4809ba"}} Aug 27 02:28:33.192544 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: exception: Flavor access not found for 36 / 9ea718d2ec3c45d4b33e5f319d4809ba combination. Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '227367095', 'body': {'removeTenantAccess': {'tenant': '9ea718d2ec3c45d4b33e5f319d4809ba'}}} Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 27 02:28:33.195237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / 9ea718d2ec3c45d4b33e5f319d4809ba combination. Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / 9ea718d2ec3c45d4b33e5f319d4809ba combination. Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:33.199146 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:33.201974 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:33.201974 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:33.201974 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:33.201974 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:33.201974 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / 9ea718d2ec3c45d4b33e5f319d4809ba combination. Aug 27 02:28:33.201974 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:33.205355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d6b14d45-8e62-4089-a228-ab181812fde2 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Returning 404 to user: Flavor access not found for 36 / 9ea718d2ec3c45d4b33e5f319d4809ba combination. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:33.206698 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d6b14d45-8e62-4089-a228-ab181812fde2 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/227367095/action" status: 404 len: 124 microversion: 2.1 time: 0.952577 Aug 27 02:28:33.208467 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 211/414] 10.222.0.99 () {60 vars in 1197 bytes} [Sat Aug 27 02:28:32 2022] POST /compute/v2.1/flavors/227367095/action => generated 124 bytes in 960 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:33.223885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-019f982a-8012-41eb-94c2-efba3be70d72 req-1a90871e-b8f4-44c6-b4c6-5a0d23f9fa4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757ac8d3-8528-470c-a017-adeb167ed73b", "name": "network-vif-deleted", "tag": "508942ce-8030-4c4f-ba87-ef3a2b5d73c8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:33.256412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-019f982a-8012-41eb-94c2-efba3be70d72 req-1a90871e-b8f4-44c6-b4c6-5a0d23f9fa4d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:33.258773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-019f982a-8012-41eb-94c2-efba3be70d72 req-1a90871e-b8f4-44c6-b4c6-5a0d23f9fa4d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:33.259579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-019f982a-8012-41eb-94c2-efba3be70d72 req-1a90871e-b8f4-44c6-b4c6-5a0d23f9fa4d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:33.275021 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a5755ecc-67c5-4b09-a0ef-8813eeb4809b tempest-NetworksTest-1171335920 tempest-NetworksTest-1171335920-project-admin] 10.222.0.99 "GET /compute/v2.1/os-networks" status: 200 len: 3326 microversion: 2.1 time: 0.824194 Aug 27 02:28:33.276105 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 204/415] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:28:32 2022] GET /compute/v2.1/os-networks => generated 3326 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:33.288924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:33.289847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:33.292057 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-019f982a-8012-41eb-94c2-efba3be70d72 req-1a90871e-b8f4-44c6-b4c6-5a0d23f9fa4d service nova] Creating event network-vif-deleted:508942ce-8030-4c4f-ba87-ef3a2b5d73c8 for instance 757ac8d3-8528-470c-a017-adeb167ed73b on n-h2-852084-5 Aug 27 02:28:33.300462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:33.302410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:33.304530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:33.305317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:33.305799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:33.306227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:33.322693 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-019f982a-8012-41eb-94c2-efba3be70d72 req-1a90871e-b8f4-44c6-b4c6-5a0d23f9fa4d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111732 Aug 27 02:28:33.325603 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 212/416] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:33.351639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2d137bc7-299b-4154-b5ed-d2e992bba8a9 req-9477442f-b9dd-41a6-a2fc-51951bde2756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a1e717-f74a-4c2a-86db-de579a1b34a5", "name": "network-vif-plugged", "status": "completed", "tag": "3949f760-9972-475b-a0df-bcfc787c35ac"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:33.375957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:33.376391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2d137bc7-299b-4154-b5ed-d2e992bba8a9 req-9477442f-b9dd-41a6-a2fc-51951bde2756 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:33.377023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:33.377206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2d137bc7-299b-4154-b5ed-d2e992bba8a9 req-9477442f-b9dd-41a6-a2fc-51951bde2756 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:33.377792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:33.378409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lazy-loading 'fault' on Instance uuid 757ac8d3-8528-470c-a017-adeb167ed73b {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:28:33.379057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2d137bc7-299b-4154-b5ed-d2e992bba8a9 req-9477442f-b9dd-41a6-a2fc-51951bde2756 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:33.405114 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2d137bc7-299b-4154-b5ed-d2e992bba8a9 req-9477442f-b9dd-41a6-a2fc-51951bde2756 service nova] Creating event network-vif-plugged:3949f760-9972-475b-a0df-bcfc787c35ac for instance 00a1e717-f74a-4c2a-86db-de579a1b34a5 on n-h1-852084-5 Aug 27 02:28:33.419080 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2d137bc7-299b-4154-b5ed-d2e992bba8a9 req-9477442f-b9dd-41a6-a2fc-51951bde2756 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090481 Aug 27 02:28:33.420476 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 213/417] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:33.431811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-88a3876a-0e09-4b19-a204-4d86515fbabd tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:33.452416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:UPDATE=8,nova_api:DELETE=7 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:33.463486 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-88a3876a-0e09-4b19-a204-4d86515fbabd tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/227367095" status: 202 len: 0 microversion: 2.1 time: 0.039733 Aug 27 02:28:33.482669 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 214/418] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:28:33 2022] DELETE /compute/v2.1/flavors/227367095 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:28:33.487971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:33.492310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-48c748c9-4e7d-413c-86dd-f3afff68f19f tempest-NetworksTest-1171335920 tempest-NetworksTest-1171335920-project-admin] Calling method '.version_select at 0x7f4d2ac51160>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:33.502049 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-21c961ca-8e10-4128-92da-72e969b0676d tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 200 len: 1309 microversion: 2.1 time: 0.223981 Aug 27 02:28:33.502698 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 205/419] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:33 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 1309 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:33.510317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba05b86e-4477-4e84-9ba1-eaad6476ae5f tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:33.515538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba05b86e-4477-4e84-9ba1-eaad6476ae5f tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:33.533100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba05b86e-4477-4e84-9ba1-eaad6476ae5f tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:33.533771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba05b86e-4477-4e84-9ba1-eaad6476ae5f tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:33.534173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba05b86e-4477-4e84-9ba1-eaad6476ae5f tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:33.537054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba05b86e-4477-4e84-9ba1-eaad6476ae5f tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:33.537540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba05b86e-4477-4e84-9ba1-eaad6476ae5f tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:33.538062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba05b86e-4477-4e84-9ba1-eaad6476ae5f tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:33.731683 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-48c748c9-4e7d-413c-86dd-f3afff68f19f tempest-NetworksTest-1171335920 tempest-NetworksTest-1171335920-project-admin] 10.222.0.99 "GET /compute/v2.1/os-networks/250718ef-ffb7-4399-a60e-f00282e291cf" status: 200 len: 652 microversion: 2.1 time: 0.247469 Aug 27 02:28:33.732678 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 215/420] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 02:28:33 2022] GET /compute/v2.1/os-networks/250718ef-ffb7-4399-a60e-f00282e291cf => generated 652 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:33.737894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3edc937b-7f84-4fc1-a721-2e35603eb589 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:33.764699 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3edc937b-7f84-4fc1-a721-2e35603eb589 tempest-FlavorsAccessNegativeTestJSON-1965662978 tempest-FlavorsAccessNegativeTestJSON-1965662978-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.030800 Aug 27 02:28:33.766356 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 216/421] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:28:33 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:33.771423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fd1dec58-e5c3-4baf-8213-9d6440dd0969 tempest-NetworksTest-1171335920 tempest-NetworksTest-1171335920-project-admin] Calling method '.version_select at 0x7f4d2ad54b80>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:33.856651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba05b86e-4477-4e84-9ba1-eaad6476ae5f tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:33.865943 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba05b86e-4477-4e84-9ba1-eaad6476ae5f tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1323 microversion: 2.1 time: 0.359916 Aug 27 02:28:33.871826 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 206/422] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:33 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1323 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:34.173779 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fd1dec58-e5c3-4baf-8213-9d6440dd0969 tempest-NetworksTest-1171335920 tempest-NetworksTest-1171335920-project-admin] 10.222.0.99 "GET /compute/v2.1/os-networks" status: 200 len: 3326 microversion: 2.1 time: 0.405649 Aug 27 02:28:34.183612 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 217/423] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:28:33 2022] GET /compute/v2.1/os-networks => generated 3326 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:34.537791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:34.540520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 757ac8d3-8528-470c-a017-adeb167ed73b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:34.558165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:34.559061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:34.559830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:34.561208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:34.562355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:34.563632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:34.599817 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] HTTP exception thrown: Instance 757ac8d3-8528-470c-a017-adeb167ed73b could not be found. Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Request method failure captured: Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b HTTP/1.1 Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYERyriQsEdKyx9t2hEacIAlnZsGgcR6JBwgHRJl7ozGuItaAygcIDEl2gw6gxtkCiErwGVYLFuvCBZt03VrlsPNC8k-ikAax-463nOfeiTBD497G99ZT1SCqlyTbGGnV68MauE0rJjqTRxQVxqhrNZI8q5K09K6V0K2yX2yc9MllEc Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 11206a74aa524b8280a190536badcf2d Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-LiveMigrationNegativeTest-1338907239 Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:34.605005 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_11206a74aa524b8280a190536badcf2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/11206a74aa524b8280a190536badcf2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/11206a74aa524b8280a190536badcf2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/11206a74aa524b8280a190536badcf2d"}]}] Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-LiveMigrationNegativeTest-1338907239 Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 11206a74aa524b8280a190536badcf2d Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1338907239 Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-LiveMigrationNegativeTest-1338907239-project Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: c52668ee6ecd4444a580239578b4e4ab Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-LiveMigrationNegativeTest-1338907239-project Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 757ac8d3-8528-470c-a017-adeb167ed73b could not be found. Aug 27 02:28:34.606545 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '757ac8d3-8528-470c-a017-adeb167ed73b'} Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757ac8d3-8528-470c-a017-adeb167ed73b could not be found. Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:34.607358 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757ac8d3-8528-470c-a017-adeb167ed73b could not be found. Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757ac8d3-8528-470c-a017-adeb167ed73b could not be found. Aug 27 02:28:34.608447 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:34.609449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Returning 404 to user: Instance 757ac8d3-8528-470c-a017-adeb167ed73b could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:34.609449 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-50f90768-71cc-4c64-bf6f-fbe99b23cce8 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b" status: 404 len: 111 microversion: 2.1 time: 0.084519 Aug 27 02:28:34.613867 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 218/424] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:34 2022] GET /compute/v2.1/servers/757ac8d3-8528-470c-a017-adeb167ed73b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:34.630545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ecb1550-352f-47ff-b3c4-f90a6127ceb2 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:34.632890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3ecb1550-352f-47ff-b3c4-f90a6127ceb2 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:34.645155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ecb1550-352f-47ff-b3c4-f90a6127ceb2 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:34.646003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ecb1550-352f-47ff-b3c4-f90a6127ceb2 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:34.647028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ecb1550-352f-47ff-b3c4-f90a6127ceb2 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:34.648800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ecb1550-352f-47ff-b3c4-f90a6127ceb2 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:34.649841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ecb1550-352f-47ff-b3c4-f90a6127ceb2 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:34.650561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ecb1550-352f-47ff-b3c4-f90a6127ceb2 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:34.701722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3ecb1550-352f-47ff-b3c4-f90a6127ceb2 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:28:34.829010 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ecb1550-352f-47ff-b3c4-f90a6127ceb2 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "DELETE /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 204 len: 0 microversion: 2.1 time: 0.211469 Aug 27 02:28:34.829786 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 219/425] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:28:34 2022] DELETE /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:28:34.839495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f0501aa5-8fb0-425a-acb5-01704975ab01 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:34.840194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f0501aa5-8fb0-425a-acb5-01704975ab01 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:34.847161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0501aa5-8fb0-425a-acb5-01704975ab01 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:34.847995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0501aa5-8fb0-425a-acb5-01704975ab01 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:34.848705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0501aa5-8fb0-425a-acb5-01704975ab01 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:34.849633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0501aa5-8fb0-425a-acb5-01704975ab01 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:34.850325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0501aa5-8fb0-425a-acb5-01704975ab01 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:34.850886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0501aa5-8fb0-425a-acb5-01704975ab01 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:34.927280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e33c7f17-c13c-4c8e-85c5-c2b14903ca6b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Calling method '.version_select at 0x7f4d2ad950d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:35.055117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f0501aa5-8fb0-425a-acb5-01704975ab01 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:35.072607 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f0501aa5-8fb0-425a-acb5-01704975ab01 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1474 microversion: 2.1 time: 0.237105 Aug 27 02:28:35.074039 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 220/426] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:34 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1474 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:35.082280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0521e980-14a1-4b69-8348-5fce79e65d28 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:35.083693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0521e980-14a1-4b69-8348-5fce79e65d28 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:35.095092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0521e980-14a1-4b69-8348-5fce79e65d28 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:35.095983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0521e980-14a1-4b69-8348-5fce79e65d28 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:35.096817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0521e980-14a1-4b69-8348-5fce79e65d28 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:35.098268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0521e980-14a1-4b69-8348-5fce79e65d28 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:35.099102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0521e980-14a1-4b69-8348-5fce79e65d28 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:35.099900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0521e980-14a1-4b69-8348-5fce79e65d28 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:35.333863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0521e980-14a1-4b69-8348-5fce79e65d28 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:35.347753 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0521e980-14a1-4b69-8348-5fce79e65d28 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1323 microversion: 2.1 time: 0.272197 Aug 27 02:28:35.358810 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 221/427] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:35 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:35.646732 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e33c7f17-c13c-4c8e-85c5-c2b14903ca6b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/e6aa856c80c24518acee08a69207077b" status: 200 len: 371 microversion: 2.1 time: 1.290939 Aug 27 02:28:35.651910 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 207/428] 10.222.0.99 () {58 vars in 1242 bytes} [Sat Aug 27 02:28:34 2022] GET /compute/v2.1/os-quota-sets/e6aa856c80c24518acee08a69207077b => generated 371 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:35.674816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1e03b95-9b72-47d0-a64a-252dc97ace38 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2ac51e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:36.099781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-25b8b927-870c-4e96-bd07-cabee1038fe4 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:36.100930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-25b8b927-870c-4e96-bd07-cabee1038fe4 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:36.116138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b8b927-870c-4e96-bd07-cabee1038fe4 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:36.117399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b8b927-870c-4e96-bd07-cabee1038fe4 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:36.118572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b8b927-870c-4e96-bd07-cabee1038fe4 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:36.121322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b8b927-870c-4e96-bd07-cabee1038fe4 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:36.123081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b8b927-870c-4e96-bd07-cabee1038fe4 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:36.123994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b8b927-870c-4e96-bd07-cabee1038fe4 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:36.337450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e03b95-9b72-47d0-a64a-252dc97ace38 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:36.339701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e03b95-9b72-47d0-a64a-252dc97ace38 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:36.341358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e03b95-9b72-47d0-a64a-252dc97ace38 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:36.343468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e03b95-9b72-47d0-a64a-252dc97ace38 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:36.344714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e03b95-9b72-47d0-a64a-252dc97ace38 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:36.345955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e03b95-9b72-47d0-a64a-252dc97ace38 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:36.420264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-25b8b927-870c-4e96-bd07-cabee1038fe4 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:36.431984 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-25b8b927-870c-4e96-bd07-cabee1038fe4 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1474 microversion: 2.1 time: 0.340339 Aug 27 02:28:36.433384 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 208/429] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:36 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1474 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:36.439985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a252073-033a-4fb0-9d0f-1257a7f826d5 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:36.441093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a252073-033a-4fb0-9d0f-1257a7f826d5 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:36.448969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a252073-033a-4fb0-9d0f-1257a7f826d5 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:36.450061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a252073-033a-4fb0-9d0f-1257a7f826d5 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:36.460132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a252073-033a-4fb0-9d0f-1257a7f826d5 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:36.467540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a252073-033a-4fb0-9d0f-1257a7f826d5 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:36.468035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a252073-033a-4fb0-9d0f-1257a7f826d5 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:36.470601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a252073-033a-4fb0-9d0f-1257a7f826d5 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:36.526952 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a1e03b95-9b72-47d0-a64a-252dc97ace38 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/e6aa856c80c24518acee08a69207077b" status: 200 len: 328 microversion: 2.1 time: 0.859121 Aug 27 02:28:36.527612 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 222/430] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:28:35 2022] PUT /compute/v2.1/os-quota-sets/e6aa856c80c24518acee08a69207077b => generated 328 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:36.541136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-09ce30af-0f18-4542-a84a-70bf16d6e4d0 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:36.559368 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-09ce30af-0f18-4542-a84a-70bf16d6e4d0 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-quota-sets/e6aa856c80c24518acee08a69207077b" status: 202 len: 0 microversion: 2.1 time: 0.022401 Aug 27 02:28:36.563889 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 223/431] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 02:28:36 2022] DELETE /compute/v2.1/os-quota-sets/e6aa856c80c24518acee08a69207077b => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:28:36.577003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-245324d4-4de6-4764-91dc-db89b4944d64 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Calling method '.version_select at 0x7f4d2acb7e50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:36.782362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a252073-033a-4fb0-9d0f-1257a7f826d5 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:36.800061 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a252073-033a-4fb0-9d0f-1257a7f826d5 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1473 microversion: 2.1 time: 0.364757 Aug 27 02:28:36.801136 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 209/432] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:36 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1473 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:37.293311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7993c2e4-2bf9-462e-8649-9cfd2eabbfd3 tempest-FlavorMetadataValidation-634821182 tempest-FlavorMetadataValidation-634821182-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2089398537", "id": 1722249546, "os-flavor-access:is_public": "True"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:37.355495 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7993c2e4-2bf9-462e-8649-9cfd2eabbfd3 tempest-FlavorMetadataValidation-634821182 tempest-FlavorMetadataValidation-634821182-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.546174 Aug 27 02:28:37.356876 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 210/433] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:28:36 2022] POST /compute/v2.1/flavors => generated 471 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:28:37.367599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:37.369870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:37.392279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:37.394037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:37.395196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:37.397368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:37.398380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:37.399619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:37.461881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Request method failure captured: Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5/diagnostics HTTP/1.1 Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYE9-23x_K6RgQF5B9NlOrGepSxEPzhtbRLQxYvQGV9-LwRroPXKocrI5r_umq8BP0ha3TY8BzB9ftciwZTsFbvZJGwz0rEWNsZFRxZqfWv9YwmqSIonfmOQQ_aOzgzqzeBzSOrUJpJhBQEXTZU1samH6Tg0IJSWgkZifAWyOx_dvhw Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: fb707d591f214c4bb4af5f94dbe2986e Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-369780018 Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:37.470079 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:37.473191 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_fb707d591f214c4bb4af5f94dbe2986e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fb707d591f214c4bb4af5f94dbe2986e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fb707d591f214c4bb4af5f94dbe2986e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/fb707d591f214c4bb4af5f94dbe2986e"}]}] Aug 27 02:28:37.473191 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-369780018 Aug 27 02:28:37.473191 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: fb707d591f214c4bb4af5f94dbe2986e Aug 27 02:28:37.473191 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-369780018 Aug 27 02:28:37.473191 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerDiagnosticsNegativeTest-369780018-project Aug 27 02:28:37.473191 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:37.473191 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:37.473191 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: aa2749756d0e47978b5e03c948c64434 Aug 27 02:28:37.473191 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-369780018-project Aug 27 02:28:37.473191 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:37.473191 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': '00a1e717-f74a-4c2a-86db-de579a1b34a5'} Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:37.476128 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:37.492117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:37.498103 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0eb25c8a-2345-47b2-8b14-8c2d32a184ee tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.119904 Aug 27 02:28:37.498103 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 211/434] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:28:37 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5/diagnostics => generated 117 bytes in 125 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:37.509610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-11fb1dee-1c16-4427-885f-27744dcca16b tempest-FlavorMetadataValidation-634821182 tempest-FlavorMetadataValidation-634821182-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:38.202979 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-11fb1dee-1c16-4427-885f-27744dcca16b tempest-FlavorMetadataValidation-634821182 tempest-FlavorMetadataValidation-634821182-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/1722249546/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.718240 Aug 27 02:28:38.204173 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 212/435] 10.222.0.99 () {62 vars in 1265 bytes} [Sat Aug 27 02:28:37 2022] POST /compute/v2.1/flavors/1722249546/os-extra_specs => generated 62 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:38.215017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:38.220955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:38.238741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:38.239643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:38.240312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:38.241296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:38.244975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:38.246130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:38.310615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:38.311792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:38.311792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:38.314189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lazy-loading 'fault' on Instance uuid 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:28:38.394260 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-245324d4-4de6-4764-91dc-db89b4944d64 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/e6aa856c80c24518acee08a69207077b" status: 200 len: 371 microversion: 2.1 time: 1.828476 Aug 27 02:28:38.396944 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 224/436] 10.222.0.99 () {58 vars in 1242 bytes} [Sat Aug 27 02:28:36 2022] GET /compute/v2.1/os-quota-sets/e6aa856c80c24518acee08a69207077b => generated 371 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:38.424511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cf16398a-6a71-4401-8cf2-613e785f28fd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:38.429853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cf16398a-6a71-4401-8cf2-613e785f28fd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:38.450654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf16398a-6a71-4401-8cf2-613e785f28fd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:38.456729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf16398a-6a71-4401-8cf2-613e785f28fd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:38.467989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf16398a-6a71-4401-8cf2-613e785f28fd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:38.469754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf16398a-6a71-4401-8cf2-613e785f28fd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:38.470924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf16398a-6a71-4401-8cf2-613e785f28fd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:38.471974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf16398a-6a71-4401-8cf2-613e785f28fd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:38.522858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:38.536716 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f088f868-7213-42e4-a36f-0f7aa2a6e228 tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1308 microversion: 2.1 time: 0.330706 Aug 27 02:28:38.540155 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 213/437] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:38 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:38.555750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cf16398a-6a71-4401-8cf2-613e785f28fd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:28:38.558746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-402c9fde-44f1-4492-8992-a11193d2175c req-7901cb44-b783-475c-b9a6-9ba0f158c8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01318003-ad06-4b90-8ffd-e3d8ff4f5d32", "name": "network-vif-deleted", "tag": "75ad7624-9152-4c42-8b4a-a46aab3ee07a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:38.586576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-402c9fde-44f1-4492-8992-a11193d2175c req-7901cb44-b783-475c-b9a6-9ba0f158c8b2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:38.587586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-402c9fde-44f1-4492-8992-a11193d2175c req-7901cb44-b783-475c-b9a6-9ba0f158c8b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:38.588333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-402c9fde-44f1-4492-8992-a11193d2175c req-7901cb44-b783-475c-b9a6-9ba0f158c8b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:38.606089 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-402c9fde-44f1-4492-8992-a11193d2175c req-7901cb44-b783-475c-b9a6-9ba0f158c8b2 service nova] Creating event network-vif-deleted:75ad7624-9152-4c42-8b4a-a46aab3ee07a for instance 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 on n-h1-852084-5 Aug 27 02:28:38.614365 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-402c9fde-44f1-4492-8992-a11193d2175c req-7901cb44-b783-475c-b9a6-9ba0f158c8b2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064632 Aug 27 02:28:38.618010 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 214/438] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:38.628038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bcfc984e-64e8-460c-aabb-30a890495b0a tempest-FlavorMetadataValidation-634821182 tempest-FlavorMetadataValidation-634821182-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:38.689349 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bcfc984e-64e8-460c-aabb-30a890495b0a tempest-FlavorMetadataValidation-634821182 tempest-FlavorMetadataValidation-634821182-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1722249546" status: 202 len: 0 microversion: 2.86 time: 0.068311 Aug 27 02:28:38.696079 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 215/439] 10.222.0.99 () {60 vars in 1202 bytes} [Sat Aug 27 02:28:38 2022] DELETE /compute/v2.1/flavors/1722249546 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:28:38.706439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-22316137-efa4-4406-851c-69f288cef305 tempest-FlavorMetadataValidation-634821182 tempest-FlavorMetadataValidation-634821182-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:38.811915 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-22316137-efa4-4406-851c-69f288cef305 tempest-FlavorMetadataValidation-634821182 tempest-FlavorMetadataValidation-634821182-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 6682 microversion: 2.86 time: 0.095148 Aug 27 02:28:38.824938 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cf16398a-6a71-4401-8cf2-613e785f28fd tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "DELETE /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 204 len: 0 microversion: 2.1 time: 0.422890 Aug 27 02:28:38.824938 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 225/440] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:28:38 2022] DELETE /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:28:38.826066 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 216/441] 10.222.0.99 () {60 vars in 1187 bytes} [Sat Aug 27 02:28:38 2022] GET /compute/v2.1/flavors/detail => generated 6682 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:28:38.836557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7cfd5442-ecd9-48d7-846e-f8af28c33d76 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:38.842797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7cfd5442-ecd9-48d7-846e-f8af28c33d76 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:38.857223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cfd5442-ecd9-48d7-846e-f8af28c33d76 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:38.858390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cfd5442-ecd9-48d7-846e-f8af28c33d76 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:38.859038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cfd5442-ecd9-48d7-846e-f8af28c33d76 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:38.860111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cfd5442-ecd9-48d7-846e-f8af28c33d76 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:38.860741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cfd5442-ecd9-48d7-846e-f8af28c33d76 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:38.861330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cfd5442-ecd9-48d7-846e-f8af28c33d76 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:39.171467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-668b9ffd-a364-4cef-8944-a4f1dc61fe2b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Calling method '.version_select at 0x7f4d2adf19d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:39.185245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:39.328688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7cfd5442-ecd9-48d7-846e-f8af28c33d76 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:39.338226 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7cfd5442-ecd9-48d7-846e-f8af28c33d76 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1479 microversion: 2.1 time: 0.508286 Aug 27 02:28:39.353905 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 226/442] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:38 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1479 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:39.590153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:39.592766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:39.613119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:39.616318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:39.619243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:39.621641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:39.623592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:39.624965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:39.701922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:39.703698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:39.705405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:39.706771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lazy-loading 'fault' on Instance uuid 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:28:39.802523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c52668ee6ecd4444a580239578b4e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11206a74aa524b8280a190536badcf2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:39.818494 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6e92792-f312-4e23-b340-df59d5b07aac tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 200 len: 1308 microversion: 2.1 time: 0.237195 Aug 27 02:28:39.825273 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 227/443] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:39 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:40.366506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a8f393e9-74c7-4dcf-a38c-fac459eda819 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:40.367816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a8f393e9-74c7-4dcf-a38c-fac459eda819 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:40.396804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f393e9-74c7-4dcf-a38c-fac459eda819 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:40.398282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f393e9-74c7-4dcf-a38c-fac459eda819 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:40.399327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f393e9-74c7-4dcf-a38c-fac459eda819 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:40.402025 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-668b9ffd-a364-4cef-8944-a4f1dc61fe2b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/5b55b9d83103463d839c40a5ad054c3f/defaults" status: 200 len: 371 microversion: 2.1 time: 1.235210 Aug 27 02:28:40.403546 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 217/444] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:28:39 2022] GET /compute/v2.1/os-quota-sets/5b55b9d83103463d839c40a5ad054c3f/defaults => generated 371 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:40.404160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f393e9-74c7-4dcf-a38c-fac459eda819 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:40.405179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f393e9-74c7-4dcf-a38c-fac459eda819 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:40.406535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f393e9-74c7-4dcf-a38c-fac459eda819 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:40.719010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a8f393e9-74c7-4dcf-a38c-fac459eda819 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:40.733449 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a8f393e9-74c7-4dcf-a38c-fac459eda819 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1479 microversion: 2.1 time: 0.377197 Aug 27 02:28:40.734980 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 228/445] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:40 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1479 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:28:40.869534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:40.873244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] [instance: 01318003-ad06-4b90-8ffd-e3d8ff4f5d32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:40.893844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:40.903048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:40.906945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:40.908821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:40.912072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:40.913252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:40.988047 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] HTTP exception thrown: Instance 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 could not be found. Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Request method failure captured: Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 HTTP/1.1 Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYERyriQsEdKyx9t2hEacIAlnZsGgcR6JBwgHRJl7ozGuItaAygcIDEl2gw6gxtkCiErwGVYLFuvCBZt03VrlsPNC8k-ikAax-463nOfeiTBD497G99ZT1SCqlyTbGGnV68MauE0rJjqTRxQVxqhrNZI8q5K09K6V0K2yX2yc9MllEc Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 11206a74aa524b8280a190536badcf2d Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-LiveMigrationNegativeTest-1338907239 Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:40.994669 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_11206a74aa524b8280a190536badcf2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/11206a74aa524b8280a190536badcf2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/11206a74aa524b8280a190536badcf2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/11206a74aa524b8280a190536badcf2d"}]}] Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-LiveMigrationNegativeTest-1338907239 Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 11206a74aa524b8280a190536badcf2d Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1338907239 Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-LiveMigrationNegativeTest-1338907239-project Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c52668ee6ecd4444a580239578b4e4ab Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-LiveMigrationNegativeTest-1338907239-project Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 could not be found. Aug 27 02:28:40.996400 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '01318003-ad06-4b90-8ffd-e3d8ff4f5d32'} Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 could not be found. Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:40.997525 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 could not be found. Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 could not be found. Aug 27 02:28:40.999739 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:41.004173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] Returning 404 to user: Instance 01318003-ad06-4b90-8ffd-e3d8ff4f5d32 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:41.008575 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd58c4b6-3c36-47aa-9575-5ec9f632f42a tempest-LiveMigrationNegativeTest-1338907239 tempest-LiveMigrationNegativeTest-1338907239-project] 10.222.0.99 "GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32" status: 404 len: 111 microversion: 2.1 time: 0.142447 Aug 27 02:28:41.010089 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 218/446] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:40 2022] GET /compute/v2.1/servers/01318003-ad06-4b90-8ffd-e3d8ff4f5d32 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:41.778800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d3099142-44b2-4ae7-8a09-91e54636fcdc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:41.782575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d3099142-44b2-4ae7-8a09-91e54636fcdc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:41.824105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3099142-44b2-4ae7-8a09-91e54636fcdc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:41.824442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-eec506bd-54ba-4170-8f6a-1ca0466f9c59 req-edab4c77-b189-4a3a-97c9-328192d8f1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a1e717-f74a-4c2a-86db-de579a1b34a5", "name": "network-vif-deleted", "tag": "3949f760-9972-475b-a0df-bcfc787c35ac"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:41.827719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3099142-44b2-4ae7-8a09-91e54636fcdc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:41.828539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3099142-44b2-4ae7-8a09-91e54636fcdc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:41.829890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3099142-44b2-4ae7-8a09-91e54636fcdc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:41.839262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3099142-44b2-4ae7-8a09-91e54636fcdc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:41.844176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3099142-44b2-4ae7-8a09-91e54636fcdc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:41.855190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-eec506bd-54ba-4170-8f6a-1ca0466f9c59 req-edab4c77-b189-4a3a-97c9-328192d8f1be service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:41.857435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-eec506bd-54ba-4170-8f6a-1ca0466f9c59 req-edab4c77-b189-4a3a-97c9-328192d8f1be service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:41.859419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-eec506bd-54ba-4170-8f6a-1ca0466f9c59 req-edab4c77-b189-4a3a-97c9-328192d8f1be service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:41.909959 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-eec506bd-54ba-4170-8f6a-1ca0466f9c59 req-edab4c77-b189-4a3a-97c9-328192d8f1be service nova] Creating event network-vif-deleted:3949f760-9972-475b-a0df-bcfc787c35ac for instance 00a1e717-f74a-4c2a-86db-de579a1b34a5 on n-h1-852084-5 Aug 27 02:28:41.930056 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-eec506bd-54ba-4170-8f6a-1ca0466f9c59 req-edab4c77-b189-4a3a-97c9-328192d8f1be service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110401 Aug 27 02:28:41.932625 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 219/447] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:28:42.068773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d3099142-44b2-4ae7-8a09-91e54636fcdc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2749756d0e47978b5e03c948c64434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb707d591f214c4bb4af5f94dbe2986e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:42.095801 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d3099142-44b2-4ae7-8a09-91e54636fcdc tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 200 len: 1308 microversion: 2.1 time: 0.326605 Aug 27 02:28:42.101614 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 229/448] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:41 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:42.210519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4ff5e4f4-d554-4144-b0da-808f06d2d359 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2ad959d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:42.719877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-77ba1ad3-8189-468b-ac3c-8f6a4bd36f76 tempest-SecurityGroupsTestAdminJSON-366694662 tempest-SecurityGroupsTestAdminJSON-366694662-project] Action: 'create', calling method: .version_select at 0x7f4d2abaf3a0>, body: {"security_group": {"name": "tempest-securitygroup-901199726", "description": "tempest-description-2061433857"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:43.251134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ff5e4f4-d554-4144-b0da-808f06d2d359 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:43.251952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ff5e4f4-d554-4144-b0da-808f06d2d359 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:43.257860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ff5e4f4-d554-4144-b0da-808f06d2d359 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:43.260674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ff5e4f4-d554-4144-b0da-808f06d2d359 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:43.262427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ff5e4f4-d554-4144-b0da-808f06d2d359 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:43.272933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ff5e4f4-d554-4144-b0da-808f06d2d359 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:43.386992 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-77ba1ad3-8189-468b-ac3c-8f6a4bd36f76 tempest-SecurityGroupsTestAdminJSON-366694662 tempest-SecurityGroupsTestAdminJSON-366694662-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.149249 Aug 27 02:28:43.389065 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 230/449] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:28:42 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:43.410888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:43.414104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] [instance: 00a1e717-f74a-4c2a-86db-de579a1b34a5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:43.426408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:43.427704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:43.429588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:43.431143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:43.432200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:43.433171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:43.465796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:43.469524 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] HTTP exception thrown: Instance 00a1e717-f74a-4c2a-86db-de579a1b34a5 could not be found. Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Request method failure captured: Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 HTTP/1.1 Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYE9-23x_K6RgQF5B9NlOrGepSxEPzhtbRLQxYvQGV9-LwRroPXKocrI5r_umq8BP0ha3TY8BzB9ftciwZTsFbvZJGwz0rEWNsZFRxZqfWv9YwmqSIonfmOQQ_aOzgzqzeBzSOrUJpJhBQEXTZU1samH6Tg0IJSWgkZifAWyOx_dvhw Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: fb707d591f214c4bb4af5f94dbe2986e Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-369780018 Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:43.473947 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_fb707d591f214c4bb4af5f94dbe2986e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fb707d591f214c4bb4af5f94dbe2986e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fb707d591f214c4bb4af5f94dbe2986e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/fb707d591f214c4bb4af5f94dbe2986e"}]}] Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-369780018 Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: fb707d591f214c4bb4af5f94dbe2986e Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-369780018 Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerDiagnosticsNegativeTest-369780018-project Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: aa2749756d0e47978b5e03c948c64434 Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-369780018-project Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 00a1e717-f74a-4c2a-86db-de579a1b34a5 could not be found. Aug 27 02:28:43.476876 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '00a1e717-f74a-4c2a-86db-de579a1b34a5'} Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a1e717-f74a-4c2a-86db-de579a1b34a5 could not be found. Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:43.478646 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a1e717-f74a-4c2a-86db-de579a1b34a5 could not be found. Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a1e717-f74a-4c2a-86db-de579a1b34a5 could not be found. Aug 27 02:28:43.483644 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:43.488768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] Returning 404 to user: Instance 00a1e717-f74a-4c2a-86db-de579a1b34a5 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:43.490895 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f71e8b8-7620-48d3-88b6-ac50234a26d0 tempest-ServerDiagnosticsNegativeTest-369780018 tempest-ServerDiagnosticsNegativeTest-369780018-project] 10.222.0.99 "GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5" status: 404 len: 111 microversion: 2.1 time: 0.098664 Aug 27 02:28:43.494194 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 231/450] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:43 2022] GET /compute/v2.1/servers/00a1e717-f74a-4c2a-86db-de579a1b34a5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:43.504767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dc0daad7-0457-40ae-ae17-55f9abaa4ec5 tempest-SecurityGroupsTestAdminJSON-366694662 tempest-SecurityGroupsTestAdminJSON-366694662-project] Action: 'create', calling method: .version_select at 0x7f4d2ac0e4c0>, body: {"security_group": {"name": "tempest-securitygroup-372154427", "description": "tempest-description-2001614713"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:43.558241 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4ff5e4f4-d554-4144-b0da-808f06d2d359 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/e316b86229974311a5d3a67e6dee0946" status: 200 len: 328 microversion: 2.1 time: 1.375267 Aug 27 02:28:43.571702 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 220/451] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:28:42 2022] PUT /compute/v2.1/os-quota-sets/e316b86229974311a5d3a67e6dee0946 => generated 328 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:43.583806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a1edd51f-1562-462e-8ec6-85e53a830ee4 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Calling method '.version_select at 0x7f4d2ad95ca0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:44.053086 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dc0daad7-0457-40ae-ae17-55f9abaa4ec5 tempest-SecurityGroupsTestAdminJSON-366694662 tempest-SecurityGroupsTestAdminJSON-366694662-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.556329 Aug 27 02:28:44.054777 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 232/452] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:28:43 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:44.296803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1edd51f-1562-462e-8ec6-85e53a830ee4 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:44.297582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1edd51f-1562-462e-8ec6-85e53a830ee4 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:44.298880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1edd51f-1562-462e-8ec6-85e53a830ee4 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:44.302306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1edd51f-1562-462e-8ec6-85e53a830ee4 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:44.304492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1edd51f-1562-462e-8ec6-85e53a830ee4 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:44.305422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1edd51f-1562-462e-8ec6-85e53a830ee4 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:44.316659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:44.326963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:UPDATE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:44.339440 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a1edd51f-1562-462e-8ec6-85e53a830ee4 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/e316b86229974311a5d3a67e6dee0946/detail" status: 200 len: 916 microversion: 2.1 time: 0.765816 Aug 27 02:28:44.340702 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 221/453] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:28:43 2022] GET /compute/v2.1/os-quota-sets/e316b86229974311a5d3a67e6dee0946/detail => generated 916 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:44.686675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-10cee45d-bb07-47fd-8dc8-5bbb47b42134 tempest-SecurityGroupsTestAdminJSON-1835627416 tempest-SecurityGroupsTestAdminJSON-1835627416-project-admin] Action: 'create', calling method: .version_select at 0x7f4d2ac0e430>, body: {"security_group": {"name": "tempest-securitygroup-186842634", "description": "tempest-description-1901976392"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:45.150707 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-10cee45d-bb07-47fd-8dc8-5bbb47b42134 tempest-SecurityGroupsTestAdminJSON-1835627416 tempest-SecurityGroupsTestAdminJSON-1835627416-project-admin] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.078707 Aug 27 02:28:45.152411 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 233/454] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:28:44 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:45.174363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-77f23f8a-2aac-4089-9297-50c6bfb3c132 tempest-SecurityGroupsTestAdminJSON-1835627416 tempest-SecurityGroupsTestAdminJSON-1835627416-project-admin] Action: 'create', calling method: .version_select at 0x7f4d2ad461f0>, body: {"security_group": {"name": "tempest-securitygroup-1419715940", "description": "tempest-description-536738371"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:45.509433 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-77f23f8a-2aac-4089-9297-50c6bfb3c132 tempest-SecurityGroupsTestAdminJSON-1835627416 tempest-SecurityGroupsTestAdminJSON-1835627416-project-admin] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.348123 Aug 27 02:28:45.511553 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 222/455] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:28:45 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:45.528025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2f37b0b-c8a7-49a0-8f4b-ff5734b699b7 tempest-SecurityGroupsTestAdminJSON-1835627416 tempest-SecurityGroupsTestAdminJSON-1835627416-project-admin] Calling method '.version_select at 0x7f4d2ac0e9d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:45.552654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ec286e26-90d4-44f8-a455-4a38c58c5fa0 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:45.554380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ec286e26-90d4-44f8-a455-4a38c58c5fa0 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:45.562833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec286e26-90d4-44f8-a455-4a38c58c5fa0 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:45.563888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec286e26-90d4-44f8-a455-4a38c58c5fa0 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:45.564580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec286e26-90d4-44f8-a455-4a38c58c5fa0 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:45.565793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec286e26-90d4-44f8-a455-4a38c58c5fa0 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:45.566650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec286e26-90d4-44f8-a455-4a38c58c5fa0 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:45.567443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec286e26-90d4-44f8-a455-4a38c58c5fa0 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:45.606486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ec286e26-90d4-44f8-a455-4a38c58c5fa0 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:28:45.797905 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ec286e26-90d4-44f8-a455-4a38c58c5fa0 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "DELETE /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 204 len: 0 microversion: 2.1 time: 0.249067 Aug 27 02:28:45.798538 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 223/456] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:28:45 2022] DELETE /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:28:46.373168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:46.410383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1092652157", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "1367011820", "adminPass": "***", "networks": [{"uuid": "7623a25f-aace-4d3d-a290-09343a63df72"}], "security_groups": [{"name": "tempest-securitygroup--143361877"}], "key_name": "tempest-keypair-1481464958", "user_data": "}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:46.622710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] validate_networks() for [('7623a25f-aace-4d3d-a290-09343a63df72', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:28:47.446318 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2f37b0b-c8a7-49a0-8f4b-ff5734b699b7 tempest-SecurityGroupsTestAdminJSON-1835627416 tempest-SecurityGroupsTestAdminJSON-1835627416-project-admin] 10.222.0.99 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 6252 microversion: 2.1 time: 1.926316 Aug 27 02:28:47.448728 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 234/457] 10.222.0.99 () {58 vars in 1191 bytes} [Sat Aug 27 02:28:45 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 6252 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:47.466343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2ad54790>, body: {"quota_set": {"ram": "2048"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:47.845062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:28:47.845940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:28:47.846475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:28:47.847387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:28:47.848320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:28:47.893515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:47.894383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:47.901653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:47.903246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:47.904120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:47.907480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:47.955269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Getting quotas for project e39f8ef6c2bb4281b252ae6827d58655. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:28:47.966173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Getting quotas for user fcc5a5e997de4edabe7b5883cc998dbf and project e39f8ef6c2bb4281b252ae6827d58655. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:28:47.994550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:28:47.998343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:28:48.075183 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2ba123f6-a5ab-4800-a8e4-143f992c3994 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.675710 Aug 27 02:28:48.077528 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 224/458] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:28:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:28:48.083552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da316391-6cfa-47af-9553-523bf049561a tempest-SecurityGroupsTestAdminJSON-366694662 tempest-SecurityGroupsTestAdminJSON-366694662-project] Calling method '.version_select at 0x7f4d2acba310>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:48.320411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=14 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:48.889596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:48.899363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:48.900522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:48.902205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:48.905409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:48.909357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:49.073146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:49.074078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:49.075729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:49.084518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:49.087014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:49.091304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:49.273777 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70b04625-d714-47f3-9caf-03b5fbea887b tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/e316b86229974311a5d3a67e6dee0946?user_id=070f83b9e704402f9ff69e73b48abb07" status: 200 len: 328 microversion: 2.1 time: 1.822906 Aug 27 02:28:49.274812 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 235/459] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:28:47 2022] PUT /compute/v2.1/os-quota-sets/e316b86229974311a5d3a67e6dee0946?user_id=070f83b9e704402f9ff69e73b48abb07 => generated 328 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:49.280396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-81e5177a-a01e-431c-bd74-5d681583499b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:49.281363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-81e5177a-a01e-431c-bd74-5d681583499b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:49.290760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e5177a-a01e-431c-bd74-5d681583499b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:49.291933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e5177a-a01e-431c-bd74-5d681583499b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:49.292968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e5177a-a01e-431c-bd74-5d681583499b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:49.293945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e5177a-a01e-431c-bd74-5d681583499b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:49.294734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e5177a-a01e-431c-bd74-5d681583499b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:49.295179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e5177a-a01e-431c-bd74-5d681583499b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:49.309164 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da316391-6cfa-47af-9553-523bf049561a tempest-SecurityGroupsTestAdminJSON-366694662 tempest-SecurityGroupsTestAdminJSON-366694662-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 1.229607 Aug 27 02:28:49.312073 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 225/460] 10.222.0.99 () {58 vars in 1191 bytes} [Sat Aug 27 02:28:48 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:49.345642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f2bce68b-ca1c-4f2b-85a4-f5dc44f00422 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Calling method '.version_select at 0x7f4d2ad46d30>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:49.392371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-81e5177a-a01e-431c-bd74-5d681583499b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:49.403382 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-81e5177a-a01e-431c-bd74-5d681583499b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1261 microversion: 2.1 time: 0.127101 Aug 27 02:28:49.404331 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 236/461] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:49 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1261 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:49.409380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-729a0e1d-d9f1-4ca8-bd35-977b93b3e028 tempest-SecurityGroupsTestAdminJSON-1835627416 tempest-SecurityGroupsTestAdminJSON-1835627416-project-admin] Calling method '.version_select at 0x7f4d2ac51ee0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:49.890183 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-729a0e1d-d9f1-4ca8-bd35-977b93b3e028 tempest-SecurityGroupsTestAdminJSON-1835627416 tempest-SecurityGroupsTestAdminJSON-1835627416-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/0bc77903-0090-477e-8883-6c722f181ac4" status: 202 len: 0 microversion: 2.1 time: 0.482517 Aug 27 02:28:49.890183 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 237/462] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:28:49 2022] DELETE /compute/v2.1/os-security-groups/0bc77903-0090-477e-8883-6c722f181ac4 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:28:50.769194 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f2bce68b-ca1c-4f2b-85a4-f5dc44f00422 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/e316b86229974311a5d3a67e6dee0946?user_id=070f83b9e704402f9ff69e73b48abb07" status: 200 len: 370 microversion: 2.1 time: 1.455383 Aug 27 02:28:50.769817 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 226/463] 10.222.0.99 () {58 vars in 1323 bytes} [Sat Aug 27 02:28:49 2022] GET /compute/v2.1/os-quota-sets/e316b86229974311a5d3a67e6dee0946?user_id=070f83b9e704402f9ff69e73b48abb07 => generated 370 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:50.786712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-77e19ec8-4a53-4fa6-b9cc-92826d6c870e tempest-SecurityGroupsTestAdminJSON-1835627416 tempest-SecurityGroupsTestAdminJSON-1835627416-project-admin] Calling method '.version_select at 0x7f4d2acac4c0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:50.882422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4e1c2adf-7c5d-4875-b94f-dbd55257c5f2 tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835 tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:50.886394 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-4e1c2adf-7c5d-4875-b94f-dbd55257c5f2 tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835 tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4e1c2adf-7c5d-4875-b94f-dbd55257c5f2 tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835 tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835-project-admin] Request method failure captured: Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFhHqjfP42bbgm2iL_HXQXjmzdAQOZLY5l-b-YtG8w4A5VHvGFEz5YgpvT3ZJF36hcsmqYNvjj7JyRXSpUrvq54ysH03myvUhIqwkscDkOuxEs8YTW4dzRPcNV3zgbfMr60Lpxw_gzofVUCM1o6AggCEU3mmTrOaYrRSaZzgmuHA3k Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: f86d31584c3d419cad74a9fe90931c6f Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835 Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:28:50.899922 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:28:50.903733 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f86d31584c3d419cad74a9fe90931c6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f86d31584c3d419cad74a9fe90931c6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f86d31584c3d419cad74a9fe90931c6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f86d31584c3d419cad74a9fe90931c6f"}]}] Aug 27 02:28:50.903733 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835 Aug 27 02:28:50.903733 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: f86d31584c3d419cad74a9fe90931c6f Aug 27 02:28:50.903733 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835 Aug 27 02:28:50.903733 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835-project-admin Aug 27 02:28:50.903733 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:50.903733 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:50.903733 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 14ab38405d7745baacae19d56328ea0a Aug 27 02:28:50.903733 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835-project-admin Aug 27 02:28:50.903733 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:28:50.903733 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid timestamp for date invalid_time Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'invalid_time'} Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:50.906064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4e1c2adf-7c5d-4875-b94f-dbd55257c5f2 tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835 tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:50.909007 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4e1c2adf-7c5d-4875-b94f-dbd55257c5f2 tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835 tempest-InstanceUsageAuditLogNegativeTestJSON-1830914835-project-admin] 10.222.0.99 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 1.011252 Aug 27 02:28:50.911170 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 238/464] 10.222.0.99 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 1014 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:50.925884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-407cb792-eca1-4f82-ba59-df3c942699e5 req-4c6d72f9-e8f9-4912-9e3a-08f7cc9a9e5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32472eac-0284-4cff-9e87-1884b0bd6d96", "name": "network-vif-deleted", "tag": "50e81101-2512-4821-83a6-6e19294005b3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:50.973375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-407cb792-eca1-4f82-ba59-df3c942699e5 req-4c6d72f9-e8f9-4912-9e3a-08f7cc9a9e5d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:50.975040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-407cb792-eca1-4f82-ba59-df3c942699e5 req-4c6d72f9-e8f9-4912-9e3a-08f7cc9a9e5d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:50.977907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-407cb792-eca1-4f82-ba59-df3c942699e5 req-4c6d72f9-e8f9-4912-9e3a-08f7cc9a9e5d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:51.012050 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-407cb792-eca1-4f82-ba59-df3c942699e5 req-4c6d72f9-e8f9-4912-9e3a-08f7cc9a9e5d service nova] Creating event network-vif-deleted:50e81101-2512-4821-83a6-6e19294005b3 for instance 32472eac-0284-4cff-9e87-1884b0bd6d96 on n-h1-852084-5 Aug 27 02:28:51.021299 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-407cb792-eca1-4f82-ba59-df3c942699e5 req-4c6d72f9-e8f9-4912-9e3a-08f7cc9a9e5d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114469 Aug 27 02:28:51.023874 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 239/465] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:51.038926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d54d2c06-ab9c-4547-9d4e-f597be7aa35d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:51.053469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d54d2c06-ab9c-4547-9d4e-f597be7aa35d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:51.082117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d54d2c06-ab9c-4547-9d4e-f597be7aa35d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:51.082912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d54d2c06-ab9c-4547-9d4e-f597be7aa35d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:51.083412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d54d2c06-ab9c-4547-9d4e-f597be7aa35d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:51.084323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d54d2c06-ab9c-4547-9d4e-f597be7aa35d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:51.085542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d54d2c06-ab9c-4547-9d4e-f597be7aa35d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:51.086036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d54d2c06-ab9c-4547-9d4e-f597be7aa35d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:51.325073 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-77e19ec8-4a53-4fa6-b9cc-92826d6c870e tempest-SecurityGroupsTestAdminJSON-1835627416 tempest-SecurityGroupsTestAdminJSON-1835627416-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/8cf40359-dfc7-4aaf-9189-9cc354a76514" status: 202 len: 0 microversion: 2.1 time: 0.547774 Aug 27 02:28:51.331269 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 227/466] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:28:50 2022] DELETE /compute/v2.1/os-security-groups/8cf40359-dfc7-4aaf-9189-9cc354a76514 => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:28:51.416761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d54d2c06-ab9c-4547-9d4e-f597be7aa35d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:51.443303 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d54d2c06-ab9c-4547-9d4e-f597be7aa35d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1323 microversion: 2.1 time: 0.411364 Aug 27 02:28:51.446467 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 240/467] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:51 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1323 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:51.466600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ce84b26a-f441-4978-a7ca-2db04bc611b2 tempest-SecurityGroupsTestAdminJSON-366694662 tempest-SecurityGroupsTestAdminJSON-366694662-project] Calling method '.version_select at 0x7f4d2acb70d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:52.054967 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ce84b26a-f441-4978-a7ca-2db04bc611b2 tempest-SecurityGroupsTestAdminJSON-366694662 tempest-SecurityGroupsTestAdminJSON-366694662-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/b45caed5-2b44-45b6-9520-3588c2ef2c41" status: 202 len: 0 microversion: 2.1 time: 0.606509 Aug 27 02:28:52.057498 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 241/468] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:28:51 2022] DELETE /compute/v2.1/os-security-groups/b45caed5-2b44-45b6-9520-3588c2ef2c41 => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:28:52.073100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-08fc4d4a-8adc-4647-a5e7-7d833d505a75 tempest-SecurityGroupsTestAdminJSON-366694662 tempest-SecurityGroupsTestAdminJSON-366694662-project] Calling method '.version_select at 0x7f4d2ac0eb80>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:52.109091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9a5ed36b-0a25-40a5-97c8-192c5c2541fc tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:52.111015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9a5ed36b-0a25-40a5-97c8-192c5c2541fc tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '43308dd7a65240c3937f198dcfd59d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2d2f8a1c8475a89c51da549418f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9a5ed36b-0a25-40a5-97c8-192c5c2541fc tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project] Request method failure captured: Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFdU7bszNAljiFNxb2lEJrlh3dzzx2GZCWyJON2YLj8VbVuTRUJT0681trn0X71un4vpXT6nEukdtw3t_iQvDMK_lywdJ_V6OAWKD9x6OgNQifEU4YDGjgzkxm6MFyrG92W_6FV9HR6mb9E_bmIIX0YoYHk-8s4nqpA1qhEIQ_msD8 Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cef2d2f8a1c8475a89c51da549418f15 Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:52.113172 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:52.116539 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cef2d2f8a1c8475a89c51da549418f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cef2d2f8a1c8475a89c51da549418f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cef2d2f8a1c8475a89c51da549418f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cef2d2f8a1c8475a89c51da549418f15"}]}] Aug 27 02:28:52.116539 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 Aug 27 02:28:52.116539 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cef2d2f8a1c8475a89c51da549418f15 Aug 27 02:28:52.116539 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 Aug 27 02:28:52.116539 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project Aug 27 02:28:52.116539 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:52.116539 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:52.116539 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 43308dd7a65240c3937f198dcfd59d4e Aug 27 02:28:52.116539 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project Aug 27 02:28:52.116539 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: action_args: {} Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:52.118000 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 27 02:28:52.122616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:52.124753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9a5ed36b-0a25-40a5-97c8-192c5c2541fc tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:52.124753 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9a5ed36b-0a25-40a5-97c8-192c5c2541fc tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project] 10.222.0.99 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.779830 Aug 27 02:28:52.124753 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 228/469] 10.222.0.99 () {58 vars in 1185 bytes} [Sat Aug 27 02:28:51 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 781 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:52.129069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e357290-b8cf-48ec-bb73-a0826a43dbf0 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:52.130967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5e357290-b8cf-48ec-bb73-a0826a43dbf0 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '43308dd7a65240c3937f198dcfd59d4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cef2d2f8a1c8475a89c51da549418f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e357290-b8cf-48ec-bb73-a0826a43dbf0 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project] Request method failure captured: Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2002:28:52 HTTP/1.1 Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFdU7bszNAljiFNxb2lEJrlh3dzzx2GZCWyJON2YLj8VbVuTRUJT0681trn0X71un4vpXT6nEukdtw3t_iQvDMK_lywdJ_V6OAWKD9x6OgNQifEU4YDGjgzkxm6MFyrG92W_6FV9HR6mb9E_bmIIX0YoYHk-8s4nqpA1qhEIQ_msD8 Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cef2d2f8a1c8475a89c51da549418f15 Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:52.133224 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:52.136205 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cef2d2f8a1c8475a89c51da549418f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cef2d2f8a1c8475a89c51da549418f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cef2d2f8a1c8475a89c51da549418f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cef2d2f8a1c8475a89c51da549418f15"}]}] Aug 27 02:28:52.136205 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 Aug 27 02:28:52.136205 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cef2d2f8a1c8475a89c51da549418f15 Aug 27 02:28:52.136205 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 Aug 27 02:28:52.136205 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project Aug 27 02:28:52.136205 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:52.136205 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:52.136205 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 43308dd7a65240c3937f198dcfd59d4e Aug 27 02:28:52.136205 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project Aug 27 02:28:52.136205 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '2022-08-27 02:28:52'} Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:52.137579 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 27 02:28:52.141180 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:52.145179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e357290-b8cf-48ec-bb73-a0826a43dbf0 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:52.145179 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5e357290-b8cf-48ec-bb73-a0826a43dbf0 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210 tempest-InstanceUsageAuditLogNegativeTestJSON-1019888210-project] 10.222.0.99 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 02:28:52" status: 403 len: 128 microversion: 2.1 time: 0.012172 Aug 27 02:28:52.145179 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 229/470] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 02:28:52 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2002%3A28%3A52 => generated 128 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:28:52.222169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb0d66e0-53ab-4200-905e-0cfbd1d65070 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Calling method '.version_select at 0x7f4d2ad74430>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:52.921058 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-08fc4d4a-8adc-4647-a5e7-7d833d505a75 tempest-SecurityGroupsTestAdminJSON-366694662 tempest-SecurityGroupsTestAdminJSON-366694662-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/eab2bb1c-bed1-4fa6-80b5-f2485ce5618b" status: 202 len: 0 microversion: 2.1 time: 0.856369 Aug 27 02:28:52.931308 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 242/471] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:28:52 2022] DELETE /compute/v2.1/os-security-groups/eab2bb1c-bed1-4fa6-80b5-f2485ce5618b => generated 0 bytes in 868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:28:52.944433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0e56230f-a39f-4384-975a-83fcbc729e48 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:52.946091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0e56230f-a39f-4384-975a-83fcbc729e48 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:52.957168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e56230f-a39f-4384-975a-83fcbc729e48 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:52.957972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e56230f-a39f-4384-975a-83fcbc729e48 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:52.959232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e56230f-a39f-4384-975a-83fcbc729e48 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:52.960952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e56230f-a39f-4384-975a-83fcbc729e48 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:52.961631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e56230f-a39f-4384-975a-83fcbc729e48 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:52.963236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e56230f-a39f-4384-975a-83fcbc729e48 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:53.328223 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bb0d66e0-53ab-4200-905e-0cfbd1d65070 tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/5b55b9d83103463d839c40a5ad054c3f/defaults" status: 200 len: 371 microversion: 2.1 time: 1.111398 Aug 27 02:28:53.330296 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 230/472] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:28:52 2022] GET /compute/v2.1/os-quota-sets/5b55b9d83103463d839c40a5ad054c3f/defaults => generated 371 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:53.347464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0cf0cd0e-b8f4-44e9-8814-3c766444c59a tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2acbadc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:53.368198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0e56230f-a39f-4384-975a-83fcbc729e48 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:53.393829 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0e56230f-a39f-4384-975a-83fcbc729e48 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1390 microversion: 2.1 time: 0.460268 Aug 27 02:28:53.413459 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 243/473] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:52 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1390 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:54.101876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-eeb9faa7-81a7-4721-a53e-b0a3306d3453 req-fd628783-cd3e-4d2d-8024-68069f89cfcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb", "tag": "1256ac6f-4abb-48e9-9a89-f4484e0188eb"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:54.142489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-eeb9faa7-81a7-4721-a53e-b0a3306d3453 req-fd628783-cd3e-4d2d-8024-68069f89cfcd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:54.144191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-eeb9faa7-81a7-4721-a53e-b0a3306d3453 req-fd628783-cd3e-4d2d-8024-68069f89cfcd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:54.145986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-eeb9faa7-81a7-4721-a53e-b0a3306d3453 req-fd628783-cd3e-4d2d-8024-68069f89cfcd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:54.183928 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-eeb9faa7-81a7-4721-a53e-b0a3306d3453 req-fd628783-cd3e-4d2d-8024-68069f89cfcd service nova] Creating event network-changed:1256ac6f-4abb-48e9-9a89-f4484e0188eb for instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb on n-h2-852084-5 Aug 27 02:28:54.211690 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-eeb9faa7-81a7-4721-a53e-b0a3306d3453 req-fd628783-cd3e-4d2d-8024-68069f89cfcd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130304 Aug 27 02:28:54.213063 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 244/474] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:28:54.559185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cf0cd0e-b8f4-44e9-8814-3c766444c59a tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:54.560057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cf0cd0e-b8f4-44e9-8814-3c766444c59a tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:54.561517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cf0cd0e-b8f4-44e9-8814-3c766444c59a tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:54.562883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cf0cd0e-b8f4-44e9-8814-3c766444c59a tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:54.565993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cf0cd0e-b8f4-44e9-8814-3c766444c59a tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:54.568079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cf0cd0e-b8f4-44e9-8814-3c766444c59a tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:55.124044 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0cf0cd0e-b8f4-44e9-8814-3c766444c59a tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/5b55b9d83103463d839c40a5ad054c3f" status: 200 len: 329 microversion: 2.1 time: 1.784388 Aug 27 02:28:55.126052 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 231/475] 10.222.0.99 () {60 vars in 1263 bytes} [Sat Aug 27 02:28:53 2022] PUT /compute/v2.1/os-quota-sets/5b55b9d83103463d839c40a5ad054c3f => generated 329 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:28:55.136057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58a878f5-27d8-4d8f-8f11-52ebda704372 tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Calling method '.version_select at 0x7f4d2acb7dc0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:55.145882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58a878f5-27d8-4d8f-8f11-52ebda704372 tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '979302b86eb846238a9a07136b84485f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861ae056be8c4460a7e0537bab261c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:55.150555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd4f461a-768b-47eb-aee4-d49aebd22a93 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:55.151200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd4f461a-768b-47eb-aee4-d49aebd22a93 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58a878f5-27d8-4d8f-8f11-52ebda704372 tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Request method failure captured: Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFh_f2D85le0WRzcyqMGgFLczgyd6J96BShpBmAIzkrNqL3GpJ5QjsP2mJw87JwAsftOIlVNYQteWwqB-5N0QhZiqF4vtenkdRcgocVqMCl2H3m005OCpEiKLh0WbEG4aoBq-ukZozfLmVlvF8UwIlVM5SXaGJNx-Cn4oWtzQWNIPY Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 861ae056be8c4460a7e0537bab261c2e Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:55.157184 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/861ae056be8c4460a7e0537bab261c2e"}]}] Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 861ae056be8c4460a7e0537bab261c2e Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HypervisorAdminNegativeTestJSON-856174889-project Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 979302b86eb846238a9a07136b84485f Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-856174889-project Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: action_args: {} Aug 27 02:28:55.159943 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:55.164076 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 27 02:28:55.168394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:55.175628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4f461a-768b-47eb-aee4-d49aebd22a93 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:55.175628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4f461a-768b-47eb-aee4-d49aebd22a93 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:55.175628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4f461a-768b-47eb-aee4-d49aebd22a93 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:55.175628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4f461a-768b-47eb-aee4-d49aebd22a93 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:55.177244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4f461a-768b-47eb-aee4-d49aebd22a93 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:55.177244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4f461a-768b-47eb-aee4-d49aebd22a93 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:55.177815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58a878f5-27d8-4d8f-8f11-52ebda704372 tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:55.177815 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58a878f5-27d8-4d8f-8f11-52ebda704372 tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.960985 Aug 27 02:28:55.177815 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 245/476] 10.222.0.99 () {58 vars in 1167 bytes} [Sat Aug 27 02:28:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 963 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:55.343458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1918137267", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:55.453846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:28:55.459935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd4f461a-768b-47eb-aee4-d49aebd22a93 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:55.472987 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd4f461a-768b-47eb-aee4-d49aebd22a93 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1390 microversion: 2.1 time: 0.344395 Aug 27 02:28:55.472987 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 232/477] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:55 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1390 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:55.493172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-56f5bb84-5d8c-47ff-93e2-553ffcc37d8f tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2adf1790>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:55.842217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:28:55.842710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:28:55.843524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:28:55.843763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:28:55.844548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:28:55.871443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:55.875616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:55.876677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:55.879088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:55.885267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:55.888589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:55.946173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:28:55.960301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:28:55.966018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:55.985826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:28:55.989963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:28:56.076799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f5bb84-5d8c-47ff-93e2-553ffcc37d8f tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:56.077771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f5bb84-5d8c-47ff-93e2-553ffcc37d8f tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:56.078538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f5bb84-5d8c-47ff-93e2-553ffcc37d8f tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:56.079135 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2c24ac0c-6891-4e83-9568-c902fda0bc54 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899279 Aug 27 02:28:56.080067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f5bb84-5d8c-47ff-93e2-553ffcc37d8f tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:56.081816 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 246/478] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:28:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:28:56.088233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f5bb84-5d8c-47ff-93e2-553ffcc37d8f tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:56.089086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f5bb84-5d8c-47ff-93e2-553ffcc37d8f tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:56.089645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-736cf432-9a9c-4c1f-b390-92fbdcaa46fe tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Calling method '.version_select at 0x7f4d2abd9dc0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:56.092580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-736cf432-9a9c-4c1f-b390-92fbdcaa46fe tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '979302b86eb846238a9a07136b84485f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861ae056be8c4460a7e0537bab261c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-736cf432-9a9c-4c1f-b390-92fbdcaa46fe tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Request method failure captured: Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFh_f2D85le0WRzcyqMGgFLczgyd6J96BShpBmAIzkrNqL3GpJ5QjsP2mJw87JwAsftOIlVNYQteWwqB-5N0QhZiqF4vtenkdRcgocVqMCl2H3m005OCpEiKLh0WbEG4aoBq-ukZozfLmVlvF8UwIlVM5SXaGJNx-Cn4oWtzQWNIPY Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 861ae056be8c4460a7e0537bab261c2e Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:56.094888 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/861ae056be8c4460a7e0537bab261c2e"}]}] Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 861ae056be8c4460a7e0537bab261c2e Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HypervisorAdminNegativeTestJSON-856174889-project Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 979302b86eb846238a9a07136b84485f Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-856174889-project Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: action_args: {} Aug 27 02:28:56.096198 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:56.097203 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 27 02:28:56.098384 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:56.101853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-736cf432-9a9c-4c1f-b390-92fbdcaa46fe tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:56.103175 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-736cf432-9a9c-4c1f-b390-92fbdcaa46fe tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.019806 Aug 27 02:28:56.104457 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 247/479] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:28:56 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:56.117589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b8311f6e-952a-4d64-94ec-4d446368687a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:56.118430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b8311f6e-952a-4d64-94ec-4d446368687a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:56.284082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b8311f6e-952a-4d64-94ec-4d446368687a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:56.325998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:56.335281 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b8311f6e-952a-4d64-94ec-4d446368687a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1217 microversion: 2.1 time: 0.228715 Aug 27 02:28:56.336745 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 248/480] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:56 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:56.356214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9e49c7f9-1ebb-4cca-96b2-340f3871c8ca tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Calling method '.version_select at 0x7f4d2ac0e820>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:56.360459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9e49c7f9-1ebb-4cca-96b2-340f3871c8ca tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '979302b86eb846238a9a07136b84485f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861ae056be8c4460a7e0537bab261c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:56.364824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=4,nova_api:INSERT=21 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9e49c7f9-1ebb-4cca-96b2-340f3871c8ca tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Request method failure captured: Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFh_f2D85le0WRzcyqMGgFLczgyd6J96BShpBmAIzkrNqL3GpJ5QjsP2mJw87JwAsftOIlVNYQteWwqB-5N0QhZiqF4vtenkdRcgocVqMCl2H3m005OCpEiKLh0WbEG4aoBq-ukZozfLmVlvF8UwIlVM5SXaGJNx-Cn4oWtzQWNIPY Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 861ae056be8c4460a7e0537bab261c2e Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:28:56.370281 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/861ae056be8c4460a7e0537bab261c2e"}]}] Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 861ae056be8c4460a7e0537bab261c2e Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HypervisorAdminNegativeTestJSON-856174889-project Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 979302b86eb846238a9a07136b84485f Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-856174889-project Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: action_args: {} Aug 27 02:28:56.372660 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:56.374143 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 27 02:28:56.376231 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:28:56.379656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9e49c7f9-1ebb-4cca-96b2-340f3871c8ca tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:56.379656 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9e49c7f9-1ebb-4cca-96b2-340f3871c8ca tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.034190 Aug 27 02:28:56.383181 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 249/481] 10.222.0.99 () {58 vars in 1179 bytes} [Sat Aug 27 02:28:56 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:57.209137 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-56f5bb84-5d8c-47ff-93e2-553ffcc37d8f tempest-QuotasAdminTestJSON-864567218 tempest-QuotasAdminTestJSON-864567218-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/5b55b9d83103463d839c40a5ad054c3f" status: 200 len: 329 microversion: 2.1 time: 1.734654 Aug 27 02:28:57.225633 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 233/482] 10.222.0.99 () {60 vars in 1263 bytes} [Sat Aug 27 02:28:55 2022] PUT /compute/v2.1/os-quota-sets/5b55b9d83103463d839c40a5ad054c3f => generated 329 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:57.240489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f416e9e4-fbce-4791-a28d-521457cfbea9 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:57.242213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f416e9e4-fbce-4791-a28d-521457cfbea9 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:57.276615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e50fce1b-3fbb-48c9-95fc-e99919417a73 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Calling method '.version_select at 0x7f4d2acb7f70>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:57.280425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f416e9e4-fbce-4791-a28d-521457cfbea9 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:57.281468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f416e9e4-fbce-4791-a28d-521457cfbea9 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:57.282677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f416e9e4-fbce-4791-a28d-521457cfbea9 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:57.286045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f416e9e4-fbce-4791-a28d-521457cfbea9 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:57.286307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50fce1b-3fbb-48c9-95fc-e99919417a73 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:57.291282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f416e9e4-fbce-4791-a28d-521457cfbea9 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:57.291611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50fce1b-3fbb-48c9-95fc-e99919417a73 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:57.294366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50fce1b-3fbb-48c9-95fc-e99919417a73 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:57.295153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f416e9e4-fbce-4791-a28d-521457cfbea9 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:57.400073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50fce1b-3fbb-48c9-95fc-e99919417a73 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:57.400972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50fce1b-3fbb-48c9-95fc-e99919417a73 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:57.402904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50fce1b-3fbb-48c9-95fc-e99919417a73 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:57.446465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50fce1b-3fbb-48c9-95fc-e99919417a73 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:57.447520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50fce1b-3fbb-48c9-95fc-e99919417a73 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:57.449771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50fce1b-3fbb-48c9-95fc-e99919417a73 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:57.478859 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e50fce1b-3fbb-48c9-95fc-e99919417a73 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.089979 Aug 27 02:28:57.486159 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 250/483] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:28:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:28:57.968132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f416e9e4-fbce-4791-a28d-521457cfbea9 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:57.980014 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f416e9e4-fbce-4791-a28d-521457cfbea9 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1390 microversion: 2.1 time: 0.752750 Aug 27 02:28:57.987036 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 234/484] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:57 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1390 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:58.002746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93ff7541-43da-4abd-b58b-bb7e1638d140 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:58.003690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93ff7541-43da-4abd-b58b-bb7e1638d140 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:58.018734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93ff7541-43da-4abd-b58b-bb7e1638d140 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:58.024892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93ff7541-43da-4abd-b58b-bb7e1638d140 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:58.025601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93ff7541-43da-4abd-b58b-bb7e1638d140 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:58.026771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93ff7541-43da-4abd-b58b-bb7e1638d140 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:58.027528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93ff7541-43da-4abd-b58b-bb7e1638d140 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:58.028341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93ff7541-43da-4abd-b58b-bb7e1638d140 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:58.210651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-93ff7541-43da-4abd-b58b-bb7e1638d140 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:58.222779 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-93ff7541-43da-4abd-b58b-bb7e1638d140 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1213 microversion: 2.1 time: 0.234241 Aug 27 02:28:58.224741 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 235/485] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:57 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1213 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:58.232263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f5ab2a71-fa1b-4667-8dc1-a55fa06df33b tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Calling method '.version_select at 0x7f4d2ad46040>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:58.234402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f5ab2a71-fa1b-4667-8dc1-a55fa06df33b tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '979302b86eb846238a9a07136b84485f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861ae056be8c4460a7e0537bab261c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f5ab2a71-fa1b-4667-8dc1-a55fa06df33b tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Request method failure captured: Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFh_f2D85le0WRzcyqMGgFLczgyd6J96BShpBmAIzkrNqL3GpJ5QjsP2mJw87JwAsftOIlVNYQteWwqB-5N0QhZiqF4vtenkdRcgocVqMCl2H3m005OCpEiKLh0WbEG4aoBq-ukZozfLmVlvF8UwIlVM5SXaGJNx-Cn4oWtzQWNIPY Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 861ae056be8c4460a7e0537bab261c2e Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:58.236534 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/861ae056be8c4460a7e0537bab261c2e"}]}] Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 861ae056be8c4460a7e0537bab261c2e Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HypervisorAdminNegativeTestJSON-856174889-project Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 979302b86eb846238a9a07136b84485f Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-856174889-project Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '1'} Aug 27 02:28:58.238287 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:58.239242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 27 02:28:58.240346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.247030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f5ab2a71-fa1b-4667-8dc1-a55fa06df33b tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:58.257889 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f5ab2a71-fa1b-4667-8dc1-a55fa06df33b tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.021868 Aug 27 02:28:58.260488 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 236/486] 10.222.0.99 () {58 vars in 1173 bytes} [Sat Aug 27 02:28:58 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:58.274011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b376ce1b-7d6d-45be-b04f-ca1a93637303 tempest-QuotaClassesAdminTestJSON-1547233897 tempest-QuotaClassesAdminTestJSON-1547233897-project-admin] Calling method '.version_select at 0x7f4d2ac0e9d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:58.281188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ba47c2b-5be4-42b4-8f08-f67103780c95 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Calling method '.version_select at 0x7f4d2b0f3310>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:58.291964 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9ba47c2b-5be4-42b4-8f08-f67103780c95 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] HTTP exception thrown: Hypervisor with ID 'cbf867a7-ed16-4f2f-8157-903e41fb8e66' could not be found. Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ba47c2b-5be4-42b4-8f08-f67103780c95 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Request method failure captured: Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-hypervisors/cbf867a7-ed16-4f2f-8157-903e41fb8e66/uptime HTTP/1.1 Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFmU2Qv0pxvKmIuHG4HDPs5rZgb_5kL7_XQMMOJtkkB3MDURKbfNUaUrm0KFv4vWawM4XEHOqvgvXlFWNnfD14-hu03XwzNJtng61OmrOvVPv55i-y3_rsp2lCfyFiF1K7LZMC1AgrD4v7dbABhSAneh9Q1n0F3LUZzicEt1SRqQM4 Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: ca7f59a7c79b42a98673e074d966a4c5 Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-764231515 Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:58.324953 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ca7f59a7c79b42a98673e074d966a4c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ca7f59a7c79b42a98673e074d966a4c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ca7f59a7c79b42a98673e074d966a4c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ca7f59a7c79b42a98673e074d966a4c5"}]}] Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-764231515 Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: ca7f59a7c79b42a98673e074d966a4c5 Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-764231515 Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 58b4024c03aa4bf1afdaac9dc980839d Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: exception: Hypervisor with ID 'cbf867a7-ed16-4f2f-8157-903e41fb8e66' could not be found. Aug 27 02:28:58.326318 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'cbf867a7-ed16-4f2f-8157-903e41fb8e66'} Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'cbf867a7-ed16-4f2f-8157-903e41fb8e66' Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 02:28:58.327067 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'cbf867a7-ed16-4f2f-8157-903e41fb8e66' could not be found. Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:58.328432 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.329646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.329646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:58.329646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:58.329646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:58.329646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:58.329646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'cbf867a7-ed16-4f2f-8157-903e41fb8e66' could not be found. Aug 27 02:28:58.329646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.332263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ba47c2b-5be4-42b4-8f08-f67103780c95 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Returning 404 to user: Hypervisor with ID 'cbf867a7-ed16-4f2f-8157-903e41fb8e66' could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:58.333392 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9ba47c2b-5be4-42b4-8f08-f67103780c95 tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/cbf867a7-ed16-4f2f-8157-903e41fb8e66/uptime" status: 404 len: 123 microversion: 2.1 time: 0.066899 Aug 27 02:28:58.337763 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 237/487] 10.222.0.99 () {58 vars in 1278 bytes} [Sat Aug 27 02:28:58 2022] GET /compute/v2.1/os-hypervisors/cbf867a7-ed16-4f2f-8157-903e41fb8e66/uptime => generated 123 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:58.402483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3c4841e1-41d1-49aa-b2ae-5ddbfcec890f tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Calling method '.version_select at 0x7f4d2ad954c0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:58.407612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4841e1-41d1-49aa-b2ae-5ddbfcec890f tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:58.421469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4841e1-41d1-49aa-b2ae-5ddbfcec890f tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:58.426015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4841e1-41d1-49aa-b2ae-5ddbfcec890f tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:58.431233 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b376ce1b-7d6d-45be-b04f-ca1a93637303 tempest-QuotaClassesAdminTestJSON-1547233897 tempest-QuotaClassesAdminTestJSON-1547233897-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.942792 Aug 27 02:28:58.437086 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 251/488] 10.222.0.99 () {58 vars in 1185 bytes} [Sat Aug 27 02:28:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:58.471281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e3561e4a-56d0-474c-acd8-78cfd1fd650d tempest-QuotaClassesAdminTestJSON-1547233897 tempest-QuotaClassesAdminTestJSON-1547233897-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2ac0e820>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:28:58.509462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4841e1-41d1-49aa-b2ae-5ddbfcec890f tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:58.515228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4841e1-41d1-49aa-b2ae-5ddbfcec890f tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:58.516495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4841e1-41d1-49aa-b2ae-5ddbfcec890f tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:58.609353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4841e1-41d1-49aa-b2ae-5ddbfcec890f tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:58.611508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4841e1-41d1-49aa-b2ae-5ddbfcec890f tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:58.611819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4841e1-41d1-49aa-b2ae-5ddbfcec890f tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:58.648778 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3c4841e1-41d1-49aa-b2ae-5ddbfcec890f tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.303227 Aug 27 02:28:58.654957 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 238/489] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:28:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:58.674546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a6a7744e-b125-4283-8145-4012e9dec06d tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Calling method '.version_select at 0x7f4d2adf1ca0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:58.685278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a6a7744e-b125-4283-8145-4012e9dec06d tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '979302b86eb846238a9a07136b84485f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861ae056be8c4460a7e0537bab261c2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a6a7744e-b125-4283-8145-4012e9dec06d tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Request method failure captured: Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFh_f2D85le0WRzcyqMGgFLczgyd6J96BShpBmAIzkrNqL3GpJ5QjsP2mJw87JwAsftOIlVNYQteWwqB-5N0QhZiqF4vtenkdRcgocVqMCl2H3m005OCpEiKLh0WbEG4aoBq-ukZozfLmVlvF8UwIlVM5SXaGJNx-Cn4oWtzQWNIPY Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 861ae056be8c4460a7e0537bab261c2e Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:28:58.689759 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/861ae056be8c4460a7e0537bab261c2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/861ae056be8c4460a7e0537bab261c2e"}]}] Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 861ae056be8c4460a7e0537bab261c2e Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-856174889 Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HypervisorAdminNegativeTestJSON-856174889-project Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 979302b86eb846238a9a07136b84485f Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-856174889-project Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '1'} Aug 27 02:28:58.692554 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:28:58.694779 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 27 02:28:58.698169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.700621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a6a7744e-b125-4283-8145-4012e9dec06d tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:58.702941 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a6a7744e-b125-4283-8145-4012e9dec06d tempest-HypervisorAdminNegativeTestJSON-856174889 tempest-HypervisorAdminNegativeTestJSON-856174889-project] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.037475 Aug 27 02:28:58.702941 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 239/490] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:28:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:58.723177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ac9c3d2-fde5-40f4-9157-8b9ea4d9a9ea tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Calling method '.version_select at 0x7f4d2acba3a0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:58.732963 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-1ac9c3d2-fde5-40f4-9157-8b9ea4d9a9ea tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] HTTP exception thrown: Hypervisor with ID 'c687d639-77a3-4fd3-9242-829c880d8abb' could not be found. Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ac9c3d2-fde5-40f4-9157-8b9ea4d9a9ea tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Request method failure captured: Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-hypervisors/c687d639-77a3-4fd3-9242-829c880d8abb HTTP/1.1 Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFmU2Qv0pxvKmIuHG4HDPs5rZgb_5kL7_XQMMOJtkkB3MDURKbfNUaUrm0KFv4vWawM4XEHOqvgvXlFWNnfD14-hu03XwzNJtng61OmrOvVPv55i-y3_rsp2lCfyFiF1K7LZMC1AgrD4v7dbABhSAneh9Q1n0F3LUZzicEt1SRqQM4 Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: ca7f59a7c79b42a98673e074d966a4c5 Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-764231515 Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:28:58.749563 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ca7f59a7c79b42a98673e074d966a4c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ca7f59a7c79b42a98673e074d966a4c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ca7f59a7c79b42a98673e074d966a4c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ca7f59a7c79b42a98673e074d966a4c5"}]}] Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-764231515 Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: ca7f59a7c79b42a98673e074d966a4c5 Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-764231515 Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 58b4024c03aa4bf1afdaac9dc980839d Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: exception: Hypervisor with ID 'c687d639-77a3-4fd3-9242-829c880d8abb' could not be found. Aug 27 02:28:58.752622 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'c687d639-77a3-4fd3-9242-829c880d8abb'} Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c687d639-77a3-4fd3-9242-829c880d8abb' Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 27 02:28:58.754112 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:28:58.756971 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c687d639-77a3-4fd3-9242-829c880d8abb' could not be found. Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c687d639-77a3-4fd3-9242-829c880d8abb' could not be found. Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ac9c3d2-fde5-40f4-9157-8b9ea4d9a9ea tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] Returning 404 to user: Hypervisor with ID 'c687d639-77a3-4fd3-9242-829c880d8abb' could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:28:58.762653 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1ac9c3d2-fde5-40f4-9157-8b9ea4d9a9ea tempest-HypervisorAdminNegativeTestJSON-764231515 tempest-HypervisorAdminNegativeTestJSON-764231515-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/c687d639-77a3-4fd3-9242-829c880d8abb" status: 404 len: 123 microversion: 2.1 time: 0.050346 Aug 27 02:28:58.764978 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 240/491] 10.222.0.99 () {58 vars in 1257 bytes} [Sat Aug 27 02:28:58 2022] GET /compute/v2.1/os-hypervisors/c687d639-77a3-4fd3-9242-829c880d8abb => generated 123 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:28:59.017885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0d9c20bb-c258-4cf5-aeec-835c6d52a57d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:59.019272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0d9c20bb-c258-4cf5-aeec-835c6d52a57d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:59.046033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d9c20bb-c258-4cf5-aeec-835c6d52a57d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:59.052116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d9c20bb-c258-4cf5-aeec-835c6d52a57d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:59.054808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d9c20bb-c258-4cf5-aeec-835c6d52a57d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:59.057131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d9c20bb-c258-4cf5-aeec-835c6d52a57d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:59.058453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d9c20bb-c258-4cf5-aeec-835c6d52a57d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:59.061804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d9c20bb-c258-4cf5-aeec-835c6d52a57d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:59.176673 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e3561e4a-56d0-474c-acd8-78cfd1fd650d tempest-QuotaClassesAdminTestJSON-1547233897 tempest-QuotaClassesAdminTestJSON-1547233897-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.730026 Aug 27 02:28:59.182075 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 252/492] 10.222.0.99 () {60 vars in 1206 bytes} [Sat Aug 27 02:28:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:59.205148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3db5e449-a8fb-455f-92df-211fa69bc30f tempest-QuotaClassesAdminTestJSON-1547233897 tempest-QuotaClassesAdminTestJSON-1547233897-project-admin] Calling method '.version_select at 0x7f4d2acb7ca0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:59.284443 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3db5e449-a8fb-455f-92df-211fa69bc30f tempest-QuotaClassesAdminTestJSON-1547233897 tempest-QuotaClassesAdminTestJSON-1547233897-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.084532 Aug 27 02:28:59.285145 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 253/493] 10.222.0.99 () {58 vars in 1185 bytes} [Sat Aug 27 02:28:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:28:59.308150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6d9924aa-190c-485c-93c7-987aaa82afc4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:28:59.312910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6d9924aa-190c-485c-93c7-987aaa82afc4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:28:59.372245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9924aa-190c-485c-93c7-987aaa82afc4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:59.378418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9924aa-190c-485c-93c7-987aaa82afc4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:59.384500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9924aa-190c-485c-93c7-987aaa82afc4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:59.385815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9924aa-190c-485c-93c7-987aaa82afc4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:28:59.386598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9924aa-190c-485c-93c7-987aaa82afc4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:28:59.389735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9924aa-190c-485c-93c7-987aaa82afc4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:28:59.781260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6d9924aa-190c-485c-93c7-987aaa82afc4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:28:59.799611 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6d9924aa-190c-485c-93c7-987aaa82afc4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1277 microversion: 2.1 time: 0.504078 Aug 27 02:28:59.801941 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 254/494] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:59 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1277 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:28:59.813116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cae4a246-755f-4a9a-a511-7de8a3caf963 tempest-QuotaClassesAdminTestJSON-1547233897 tempest-QuotaClassesAdminTestJSON-1547233897-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2aba69d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:00.085714 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cae4a246-755f-4a9a-a511-7de8a3caf963 tempest-QuotaClassesAdminTestJSON-1547233897 tempest-QuotaClassesAdminTestJSON-1547233897-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.282361 Aug 27 02:29:00.098878 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 255/495] 10.222.0.99 () {60 vars in 1206 bytes} [Sat Aug 27 02:28:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:00.857186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f60003e3-61fc-4d7d-a942-575fc811b5ff tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:00.861021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f60003e3-61fc-4d7d-a942-575fc811b5ff tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:00.884465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60003e3-61fc-4d7d-a942-575fc811b5ff tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:00.886609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60003e3-61fc-4d7d-a942-575fc811b5ff tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:00.888274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60003e3-61fc-4d7d-a942-575fc811b5ff tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:00.889948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60003e3-61fc-4d7d-a942-575fc811b5ff tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:00.892843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60003e3-61fc-4d7d-a942-575fc811b5ff tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:00.895590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60003e3-61fc-4d7d-a942-575fc811b5ff tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:01.067217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f60003e3-61fc-4d7d-a942-575fc811b5ff tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:01.085658 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f60003e3-61fc-4d7d-a942-575fc811b5ff tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1275 microversion: 2.1 time: 0.239065 Aug 27 02:29:01.088278 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 256/496] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:00 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1275 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:01.222018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0d9c20bb-c258-4cf5-aeec-835c6d52a57d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:01.240050 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0d9c20bb-c258-4cf5-aeec-835c6d52a57d tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1390 microversion: 2.1 time: 2.228884 Aug 27 02:29:01.251951 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 241/497] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:28:59 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1390 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:29:02.110783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6cddb9bf-2997-4437-8eac-6964b2eaddf0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:02.112286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6cddb9bf-2997-4437-8eac-6964b2eaddf0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:02.127516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cddb9bf-2997-4437-8eac-6964b2eaddf0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:02.127891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cddb9bf-2997-4437-8eac-6964b2eaddf0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:02.132618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cddb9bf-2997-4437-8eac-6964b2eaddf0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:02.133502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cddb9bf-2997-4437-8eac-6964b2eaddf0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:02.135413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cddb9bf-2997-4437-8eac-6964b2eaddf0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:02.135907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cddb9bf-2997-4437-8eac-6964b2eaddf0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:02.375731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6cddb9bf-2997-4437-8eac-6964b2eaddf0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:02.399375 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6cddb9bf-2997-4437-8eac-6964b2eaddf0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1275 microversion: 2.1 time: 0.291337 Aug 27 02:29:02.400295 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 242/498] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:02 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1275 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:02.407724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-345ec062-f201-47e6-8c9e-993f629220f8 req-12177147-2857-4f9a-9b4c-ba413a83149f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb", "name": "network-vif-plugged", "status": "completed", "tag": "1256ac6f-4abb-48e9-9a89-f4484e0188eb"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:02.420317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-345ec062-f201-47e6-8c9e-993f629220f8 req-12177147-2857-4f9a-9b4c-ba413a83149f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:02.420937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-345ec062-f201-47e6-8c9e-993f629220f8 req-12177147-2857-4f9a-9b4c-ba413a83149f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:02.421387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-345ec062-f201-47e6-8c9e-993f629220f8 req-12177147-2857-4f9a-9b4c-ba413a83149f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:02.472509 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-345ec062-f201-47e6-8c9e-993f629220f8 req-12177147-2857-4f9a-9b4c-ba413a83149f service nova] Creating event network-vif-plugged:1256ac6f-4abb-48e9-9a89-f4484e0188eb for instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb on n-h2-852084-5 Aug 27 02:29:02.486505 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-345ec062-f201-47e6-8c9e-993f629220f8 req-12177147-2857-4f9a-9b4c-ba413a83149f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083448 Aug 27 02:29:02.505265 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 243/499] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:02.523492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e04ffe2d-c879-4b7c-b8c6-16e444099281 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:02.526653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e04ffe2d-c879-4b7c-b8c6-16e444099281 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:02.569778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e04ffe2d-c879-4b7c-b8c6-16e444099281 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:02.572389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e04ffe2d-c879-4b7c-b8c6-16e444099281 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:02.574363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e04ffe2d-c879-4b7c-b8c6-16e444099281 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:02.576366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e04ffe2d-c879-4b7c-b8c6-16e444099281 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:02.582230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e04ffe2d-c879-4b7c-b8c6-16e444099281 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:02.582935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e04ffe2d-c879-4b7c-b8c6-16e444099281 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:02.764968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dfe8b9b0-ae80-4a49-b1be-7d6c2e89a52b tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Calling method '.version_select at 0x7f4d2ac513a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:02.813806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfe8b9b0-ae80-4a49-b1be-7d6c2e89a52b tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:02.823268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfe8b9b0-ae80-4a49-b1be-7d6c2e89a52b tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:02.835852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfe8b9b0-ae80-4a49-b1be-7d6c2e89a52b tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:02.842207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfe8b9b0-ae80-4a49-b1be-7d6c2e89a52b tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:02.852582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfe8b9b0-ae80-4a49-b1be-7d6c2e89a52b tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:02.856817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfe8b9b0-ae80-4a49-b1be-7d6c2e89a52b tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:02.899118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=10,nova_api:UPDATE=24 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:02.918797 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dfe8b9b0-ae80-4a49-b1be-7d6c2e89a52b tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] 10.222.0.99 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 1.312676 Aug 27 02:29:02.935242 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 257/500] 10.222.0.99 () {58 vars in 1122 bytes} [Sat Aug 27 02:29:01 2022] GET /compute/v2.1/limits => generated 511 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:03.316912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e04ffe2d-c879-4b7c-b8c6-16e444099281 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:03.341030 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e04ffe2d-c879-4b7c-b8c6-16e444099281 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1390 microversion: 2.1 time: 0.831291 Aug 27 02:29:03.347165 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 244/501] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:02 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1390 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:03.418010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f7e3d1c6-f000-4db9-86b8-3727edc89703 tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-791333641", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:03.434957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aa6b6486-3ad3-4a15-82d3-05a11535acf2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:03.439607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aa6b6486-3ad3-4a15-82d3-05a11535acf2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:03.475218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6b6486-3ad3-4a15-82d3-05a11535acf2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:03.476591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6b6486-3ad3-4a15-82d3-05a11535acf2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:03.482111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6b6486-3ad3-4a15-82d3-05a11535acf2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:03.483457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6b6486-3ad3-4a15-82d3-05a11535acf2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:03.488193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6b6486-3ad3-4a15-82d3-05a11535acf2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:03.489153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6b6486-3ad3-4a15-82d3-05a11535acf2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:03.589926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-f7e3d1c6-f000-4db9-86b8-3727edc89703 tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:29:03.895987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-aa6b6486-3ad3-4a15-82d3-05a11535acf2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:03.961331 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aa6b6486-3ad3-4a15-82d3-05a11535acf2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1275 microversion: 2.1 time: 0.530694 Aug 27 02:29:03.971262 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 245/502] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:03 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1275 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:29:04.256494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f7e3d1c6-f000-4db9-86b8-3727edc89703 tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Getting quotas for project bcd7c6f18fd845579ed94c6ee46ad062. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:04.276201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f7e3d1c6-f000-4db9-86b8-3727edc89703 tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Getting quotas for user 3368f28b207c43148f51e4374451ce98 and project bcd7c6f18fd845579ed94c6ee46ad062. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:04.330005 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f7e3d1c6-f000-4db9-86b8-3727edc89703 tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f7e3d1c6-f000-4db9-86b8-3727edc89703 tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Request method failure captured: Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 1751 Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFtJsSTeJkjFx4bhIdacUuzrF4RgCgkbeHPJVkkHvyrlquA2axvqvmPmo1qxPgHogjEOdPMC9OWcCwfsIoWwSevVfb25vbc9AE4t_5Bx4MobEyJ9NhDOvtr7Eniju1lJAQBseJPm_Z2I8WWTVxyQV5g9GN9W4WuO5cMCdguwne8cZs Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bcd7c6f18fd845579ed94c6ee46ad062 Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1255422026 Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bcd7c6f18fd845579ed94c6ee46ad062"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bcd7c6f18fd845579ed94c6ee46ad062"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bcd7c6f18fd845579ed94c6ee46ad062"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bcd7c6f18fd845579ed94c6ee46ad062"}]}] Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1255422026 Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bcd7c6f18fd845579ed94c6ee46ad062 Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1255422026 Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 3368f28b207c43148f51e4374451ce98 Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-791333641", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:29:04.342829 n-d-852084-5 devstack@n-api.service[122488]: exception: Maximum number of metadata items exceeds 128 Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-791333641', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:29:04.344970 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f7e3d1c6-f000-4db9-86b8-3727edc89703 tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:29:04.350769 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f7e3d1c6-f000-4db9-86b8-3727edc89703 tempest-AbsoluteLimitsNegativeTestJSON-1255422026 tempest-AbsoluteLimitsNegativeTestJSON-1255422026-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.945548 Aug 27 02:29:04.353726 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 258/503] 10.222.0.99 () {60 vars in 1148 bytes} [Sat Aug 27 02:29:03 2022] POST /compute/v2.1/servers => generated 87 bytes in 957 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:29:04.368409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bdbf10a5-62e2-4698-83a8-4cdd12cc91be tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:04.373881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bdbf10a5-62e2-4698-83a8-4cdd12cc91be tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:04.394762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdbf10a5-62e2-4698-83a8-4cdd12cc91be tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:04.399419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdbf10a5-62e2-4698-83a8-4cdd12cc91be tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:04.401606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdbf10a5-62e2-4698-83a8-4cdd12cc91be tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:04.402685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdbf10a5-62e2-4698-83a8-4cdd12cc91be tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:04.406129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdbf10a5-62e2-4698-83a8-4cdd12cc91be tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:04.406911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdbf10a5-62e2-4698-83a8-4cdd12cc91be tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:05.008564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-82fc7bb4-c917-4c31-8283-8b7b2d3324af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:05.012580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-82fc7bb4-c917-4c31-8283-8b7b2d3324af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:05.039622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82fc7bb4-c917-4c31-8283-8b7b2d3324af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:05.046996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82fc7bb4-c917-4c31-8283-8b7b2d3324af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:05.047925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82fc7bb4-c917-4c31-8283-8b7b2d3324af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:05.049261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82fc7bb4-c917-4c31-8283-8b7b2d3324af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:05.051545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82fc7bb4-c917-4c31-8283-8b7b2d3324af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:05.056779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82fc7bb4-c917-4c31-8283-8b7b2d3324af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:05.066717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bdbf10a5-62e2-4698-83a8-4cdd12cc91be tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:05.085509 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bdbf10a5-62e2-4698-83a8-4cdd12cc91be tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1588 microversion: 2.1 time: 0.722502 Aug 27 02:29:05.086430 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 246/504] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:04 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1588 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:29:05.107224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4735a906-c673-4a7f-b1ca-d248acf71689 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:05.108048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4735a906-c673-4a7f-b1ca-d248acf71689 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:05.122123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4735a906-c673-4a7f-b1ca-d248acf71689 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:05.122642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4735a906-c673-4a7f-b1ca-d248acf71689 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:05.123076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4735a906-c673-4a7f-b1ca-d248acf71689 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:05.123814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4735a906-c673-4a7f-b1ca-d248acf71689 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:05.124279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4735a906-c673-4a7f-b1ca-d248acf71689 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:05.124886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4735a906-c673-4a7f-b1ca-d248acf71689 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:05.365062 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4735a906-c673-4a7f-b1ca-d248acf71689 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.262358 Aug 27 02:29:05.366905 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 247/505] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:29:05 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb/os-interface => generated 285 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:05.428887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-82fc7bb4-c917-4c31-8283-8b7b2d3324af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:05.443539 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-82fc7bb4-c917-4c31-8283-8b7b2d3324af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1317 microversion: 2.1 time: 0.446573 Aug 27 02:29:05.444656 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 259/506] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:04 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:06.189367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:06.469216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ce1eda87-e40f-40cf-9f52-208776d17341 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:06.470380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ce1eda87-e40f-40cf-9f52-208776d17341 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:06.500362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1eda87-e40f-40cf-9f52-208776d17341 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:06.502194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1eda87-e40f-40cf-9f52-208776d17341 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:06.503261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1eda87-e40f-40cf-9f52-208776d17341 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:06.504521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1eda87-e40f-40cf-9f52-208776d17341 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:06.505321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1eda87-e40f-40cf-9f52-208776d17341 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:06.511403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1eda87-e40f-40cf-9f52-208776d17341 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:06.874551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ce1eda87-e40f-40cf-9f52-208776d17341 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:06.918311 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ce1eda87-e40f-40cf-9f52-208776d17341 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1317 microversion: 2.1 time: 0.452090 Aug 27 02:29:06.919506 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 260/507] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:06 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:29:07.160044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=22 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:07.177491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2123036172", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:07.341419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:29:07.369407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-93d7fdbf-09c7-4b92-91cd-11e907a94ba4 req-21430450-ea19-48db-bb90-ff091aae8ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6", "tag": "a4410061-b6ff-4b24-84b1-b3697016f31d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:07.429019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-93d7fdbf-09c7-4b92-91cd-11e907a94ba4 req-21430450-ea19-48db-bb90-ff091aae8ac7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:07.429967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-93d7fdbf-09c7-4b92-91cd-11e907a94ba4 req-21430450-ea19-48db-bb90-ff091aae8ac7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:07.430775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-93d7fdbf-09c7-4b92-91cd-11e907a94ba4 req-21430450-ea19-48db-bb90-ff091aae8ac7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:07.515144 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-93d7fdbf-09c7-4b92-91cd-11e907a94ba4 req-21430450-ea19-48db-bb90-ff091aae8ac7 service nova] Creating event network-changed:a4410061-b6ff-4b24-84b1-b3697016f31d for instance 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 on n-h1-852084-5 Aug 27 02:29:07.525877 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-93d7fdbf-09c7-4b92-91cd-11e907a94ba4 req-21430450-ea19-48db-bb90-ff091aae8ac7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169659 Aug 27 02:29:07.527507 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 261/508] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:07.957336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57012fb1-b4e3-491a-ad46-95548e0f4444 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:07.966753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-57012fb1-b4e3-491a-ad46-95548e0f4444 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:07.979449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57012fb1-b4e3-491a-ad46-95548e0f4444 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:07.980328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57012fb1-b4e3-491a-ad46-95548e0f4444 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:07.981180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57012fb1-b4e3-491a-ad46-95548e0f4444 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:07.991312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57012fb1-b4e3-491a-ad46-95548e0f4444 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:07.992195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57012fb1-b4e3-491a-ad46-95548e0f4444 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:07.992978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57012fb1-b4e3-491a-ad46-95548e0f4444 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:08.283300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-57012fb1-b4e3-491a-ad46-95548e0f4444 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:08.298919 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-57012fb1-b4e3-491a-ad46-95548e0f4444 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1317 microversion: 2.1 time: 0.352015 Aug 27 02:29:08.313453 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 262/509] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:07 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:29:08.870917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:29:08.872331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:29:08.873185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:29:08.873937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:29:08.876415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:29:08.924921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:08.927014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:08.928209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:08.929585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:08.930415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:08.931413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:09.011584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:09.038936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for user d1624ef00b144dafbaff7ae5c677e7a3 and project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:09.093614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:29:09.121619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:29:09.244754 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-56a643d1-5bd0-4c18-9a87-ec33d1b71d30 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.057742 Aug 27 02:29:09.266823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0f3f5c02-95a1-4d41-9f53-f60936187b58 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:09.268184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0f3f5c02-95a1-4d41-9f53-f60936187b58 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:09.270202 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 248/510] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:29:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:29:09.327065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-31fce995-4c4d-4319-b023-9c031fc11121 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:09.328231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-31fce995-4c4d-4319-b023-9c031fc11121 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:09.342712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31fce995-4c4d-4319-b023-9c031fc11121 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:09.343224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31fce995-4c4d-4319-b023-9c031fc11121 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:09.343675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31fce995-4c4d-4319-b023-9c031fc11121 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:09.344411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31fce995-4c4d-4319-b023-9c031fc11121 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:09.344877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31fce995-4c4d-4319-b023-9c031fc11121 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:09.345311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31fce995-4c4d-4319-b023-9c031fc11121 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:09.420389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0f3f5c02-95a1-4d41-9f53-f60936187b58 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:09.456227 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0f3f5c02-95a1-4d41-9f53-f60936187b58 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1213 microversion: 2.1 time: 0.196259 Aug 27 02:29:09.467816 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 263/511] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:09 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1213 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:09.974780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-31fce995-4c4d-4319-b023-9c031fc11121 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:09.996777 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-31fce995-4c4d-4319-b023-9c031fc11121 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1317 microversion: 2.1 time: 0.678740 Aug 27 02:29:09.997377 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 249/512] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:09 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:10.091590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fd9b981b-b213-412f-a67a-974a4e5c7c38 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:10.092242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fd9b981b-b213-412f-a67a-974a4e5c7c38 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:10.106075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd9b981b-b213-412f-a67a-974a4e5c7c38 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:10.106955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd9b981b-b213-412f-a67a-974a4e5c7c38 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:10.107629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd9b981b-b213-412f-a67a-974a4e5c7c38 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:10.108612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd9b981b-b213-412f-a67a-974a4e5c7c38 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:10.109289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd9b981b-b213-412f-a67a-974a4e5c7c38 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:10.109988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd9b981b-b213-412f-a67a-974a4e5c7c38 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:10.450449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b7e2755-d4f4-4ffc-9fcc-c093501cbff0 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Calling method '.version_select at 0x7f4d2ab71f70>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:10.453008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b7e2755-d4f4-4ffc-9fcc-c093501cbff0 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:10.453479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b7e2755-d4f4-4ffc-9fcc-c093501cbff0 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:10.455327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b7e2755-d4f4-4ffc-9fcc-c093501cbff0 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:10.492798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b7e2755-d4f4-4ffc-9fcc-c093501cbff0 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:10.494281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b7e2755-d4f4-4ffc-9fcc-c093501cbff0 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:10.496518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b7e2755-d4f4-4ffc-9fcc-c093501cbff0 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:10.526284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b7e2755-d4f4-4ffc-9fcc-c093501cbff0 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:10.527320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b7e2755-d4f4-4ffc-9fcc-c093501cbff0 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:10.528487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b7e2755-d4f4-4ffc-9fcc-c093501cbff0 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:10.539567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9b7e2755-d4f4-4ffc-9fcc-c093501cbff0 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.665562 Aug 27 02:29:10.540965 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 264/513] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:29:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:10.547747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1baa6e25-8787-45dd-ba3a-a63fa0061f1d req-976f9e10-24e2-4ac4-b407-b7d13f0a2ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb", "tag": "1256ac6f-4abb-48e9-9a89-f4484e0188eb"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:10.570688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1baa6e25-8787-45dd-ba3a-a63fa0061f1d req-976f9e10-24e2-4ac4-b407-b7d13f0a2ed7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:10.571845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1baa6e25-8787-45dd-ba3a-a63fa0061f1d req-976f9e10-24e2-4ac4-b407-b7d13f0a2ed7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:10.572597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1baa6e25-8787-45dd-ba3a-a63fa0061f1d req-976f9e10-24e2-4ac4-b407-b7d13f0a2ed7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:10.593193 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1baa6e25-8787-45dd-ba3a-a63fa0061f1d req-976f9e10-24e2-4ac4-b407-b7d13f0a2ed7 service nova] Creating event network-changed:1256ac6f-4abb-48e9-9a89-f4484e0188eb for instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb on n-h2-852084-5 Aug 27 02:29:10.602701 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1baa6e25-8787-45dd-ba3a-a63fa0061f1d req-976f9e10-24e2-4ac4-b407-b7d13f0a2ed7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059596 Aug 27 02:29:10.603905 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 265/514] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:10.613294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ffd6b33-9627-4a7b-bf3e-a8a4f18a5716 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:10.614756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3ffd6b33-9627-4a7b-bf3e-a8a4f18a5716 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:10.635504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ffd6b33-9627-4a7b-bf3e-a8a4f18a5716 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:10.636749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ffd6b33-9627-4a7b-bf3e-a8a4f18a5716 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:10.637478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ffd6b33-9627-4a7b-bf3e-a8a4f18a5716 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:10.638514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ffd6b33-9627-4a7b-bf3e-a8a4f18a5716 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:10.639384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ffd6b33-9627-4a7b-bf3e-a8a4f18a5716 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:10.640662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ffd6b33-9627-4a7b-bf3e-a8a4f18a5716 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:10.662502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fd9b981b-b213-412f-a67a-974a4e5c7c38 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:10.699951 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fd9b981b-b213-412f-a67a-974a4e5c7c38 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1588 microversion: 2.1 time: 0.612029 Aug 27 02:29:10.701443 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 250/515] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:10 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1588 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:10.908645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3ffd6b33-9627-4a7b-bf3e-a8a4f18a5716 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:10.933707 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ffd6b33-9627-4a7b-bf3e-a8a4f18a5716 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1209 microversion: 2.1 time: 0.313570 Aug 27 02:29:10.933707 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 266/516] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:10 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1209 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:11.519806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-527ab4ca-269d-4dc5-9119-80c2d5d25729 tempest-HypervisorAdminNegativeUnderV252Test-255837055 tempest-HypervisorAdminNegativeUnderV252Test-255837055-project] Calling method '.version_select at 0x7f4d2ad953a0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:11.534301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-527ab4ca-269d-4dc5-9119-80c2d5d25729 tempest-HypervisorAdminNegativeUnderV252Test-255837055 tempest-HypervisorAdminNegativeUnderV252Test-255837055-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '8e4266de20ff494fa9c9cc376ea30e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d791e4b14a45bdbde4dab7d12d3f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-527ab4ca-269d-4dc5-9119-80c2d5d25729 tempest-HypervisorAdminNegativeUnderV252Test-255837055 tempest-HypervisorAdminNegativeUnderV252Test-255837055-project] Request method failure captured: Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-hypervisors/n-h2-852084-5/search HTTP/1.1 Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFycy-yMkgfYTDcNzbJmJYuPHlFDbQM63czeX3Y3sJUVTTBNUDdkKPDy6ZrR28Ya-gdp6u2feJPDBMUf5sxnljbcEMHzX0HEldS3b-dkWeitLNpAI_UYoOmbNvELiXUKNDDP3UtgqJcK_kD0xSjUqV6xYqiQO2GNvPvqIbncwtv88c Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 00d791e4b14a45bdbde4dab7d12d3f35 Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-255837055 Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00d791e4b14a45bdbde4dab7d12d3f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00d791e4b14a45bdbde4dab7d12d3f35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00d791e4b14a45bdbde4dab7d12d3f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00d791e4b14a45bdbde4dab7d12d3f35"}]}] Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-255837055 Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 00d791e4b14a45bdbde4dab7d12d3f35 Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-255837055 Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-255837055-project Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 8e4266de20ff494fa9c9cc376ea30e52 Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-255837055-project Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'n-h2-852084-5'} Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:11.540712 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:11.545182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:11.545182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:11.545182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:11.545182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:29:11.545182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:29:11.545182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 27 02:29:11.545182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:11.550732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-527ab4ca-269d-4dc5-9119-80c2d5d25729 tempest-HypervisorAdminNegativeUnderV252Test-255837055 tempest-HypervisorAdminNegativeUnderV252Test-255837055-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:29:11.554520 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-527ab4ca-269d-4dc5-9119-80c2d5d25729 tempest-HypervisorAdminNegativeUnderV252Test-255837055 tempest-HypervisorAdminNegativeUnderV252Test-255837055-project] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/n-h2-852084-5/search" status: 403 len: 117 microversion: 2.1 time: 0.851404 Aug 27 02:29:11.555390 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 251/517] 10.222.0.99 () {58 vars in 1209 bytes} [Sat Aug 27 02:29:10 2022] GET /compute/v2.1/os-hypervisors/n-h2-852084-5/search => generated 117 bytes in 853 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:29:11.586697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e89d7b9-d454-40f3-b3ed-6e572bc93a64 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:11.588929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2e89d7b9-d454-40f3-b3ed-6e572bc93a64 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:11.608136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e89d7b9-d454-40f3-b3ed-6e572bc93a64 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:11.611968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e89d7b9-d454-40f3-b3ed-6e572bc93a64 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:11.612791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e89d7b9-d454-40f3-b3ed-6e572bc93a64 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:11.615830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e89d7b9-d454-40f3-b3ed-6e572bc93a64 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:11.616793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e89d7b9-d454-40f3-b3ed-6e572bc93a64 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:11.628252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e89d7b9-d454-40f3-b3ed-6e572bc93a64 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:11.653377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:11.912959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-27e43dd0-cb8b-4391-b8c3-f09807f09838 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2ab5d5e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:12.158813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e43dd0-cb8b-4391-b8c3-f09807f09838 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:12.159774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e43dd0-cb8b-4391-b8c3-f09807f09838 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:12.163230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e43dd0-cb8b-4391-b8c3-f09807f09838 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:12.166948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e43dd0-cb8b-4391-b8c3-f09807f09838 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:12.168030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e43dd0-cb8b-4391-b8c3-f09807f09838 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:12.170225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e43dd0-cb8b-4391-b8c3-f09807f09838 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:12.312550 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-27e43dd0-cb8b-4391-b8c3-f09807f09838 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/300ee590cdbc4f86be995dcb93ab3034" status: 200 len: 148 microversion: 2.57 time: 1.389699 Aug 27 02:29:12.316892 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 267/518] 10.222.0.99 () {62 vars in 1303 bytes} [Sat Aug 27 02:29:10 2022] PUT /compute/v2.1/os-quota-sets/300ee590cdbc4f86be995dcb93ab3034 => generated 148 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:29:12.328705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-de47c17f-fe21-4421-9729-268535b4924a tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Calling method '.version_select at 0x7f4d2acb7670>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:12.337309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de47c17f-fe21-4421-9729-268535b4924a tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:12.338361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de47c17f-fe21-4421-9729-268535b4924a tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:12.339049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de47c17f-fe21-4421-9729-268535b4924a tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:12.351617 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-de47c17f-fe21-4421-9729-268535b4924a tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-de47c17f-fe21-4421-9729-268535b4924a tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Request method failure captured: Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYF1ODFvTjrHwKcnZVK9rqOEuxOyTRGv8EkPG5eC-MiA9cxRuo4DYPMVt_jzrCmF3GDJbVyhNLkxJvCsHN3EJSF6dcqbCEbOx_sNcbO-NCZPZRoYH47u8FbPfrziea7ZrqIQZ7Tg4LquTkj84GXUdPy6J-jPBaoxR1lVbt_55m1PuQQ Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 69e4e43bf9fa4f6d94359022e04aba36 Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810580730 Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_69e4e43bf9fa4f6d94359022e04aba36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69e4e43bf9fa4f6d94359022e04aba36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69e4e43bf9fa4f6d94359022e04aba36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/69e4e43bf9fa4f6d94359022e04aba36"}]}] Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1810580730 Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 69e4e43bf9fa4f6d94359022e04aba36 Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810580730 Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: c1dc933294ad4ad5b37a3fe7bba54728 Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 27 02:29:12.353908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:12.358946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-de47c17f-fe21-4421-9729-268535b4924a tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:29:12.360060 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-de47c17f-fe21-4421-9729-268535b4924a tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.041260 Aug 27 02:29:12.361160 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 268/519] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 02:29:12 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:29:12.449540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-667210644", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": "none"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:12.582062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:29:12.585857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:29:12.586786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:29:12.592339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2e89d7b9-d454-40f3-b3ed-6e572bc93a64 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:12.601875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:29:12.603097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:29:12.614146 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e89d7b9-d454-40f3-b3ed-6e572bc93a64 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1317 microversion: 2.1 time: 1.038738 Aug 27 02:29:12.616419 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 252/520] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:11 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1317 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:12.624058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:12.625548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:12.626307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74dbf6fa-7a52-45c0-b82a-a34c808b0b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:12.627266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:12.627746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-74dbf6fa-7a52-45c0-b82a-a34c808b0b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:12.630809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:12.631720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:12.632454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:12.648068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74dbf6fa-7a52-45c0-b82a-a34c808b0b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:12.649210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74dbf6fa-7a52-45c0-b82a-a34c808b0b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:12.650324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74dbf6fa-7a52-45c0-b82a-a34c808b0b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:12.651994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74dbf6fa-7a52-45c0-b82a-a34c808b0b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:12.653238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74dbf6fa-7a52-45c0-b82a-a34c808b0b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:12.654494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74dbf6fa-7a52-45c0-b82a-a34c808b0b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:12.656119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Getting quotas for project 8d57afff18784d52bfa6d3d22beef36f. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:12.668568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Getting quotas for user 2e686bfcef314e05b97f79abd9c7bfaa and project 8d57afff18784d52bfa6d3d22beef36f. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:12.694826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:29:12.697442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:29:12.839876 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-00491140-4e51-41f4-aeac-3d643c214469 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.477178 Aug 27 02:29:12.847856 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 269/521] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:29:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:29:13.003393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7c21ce97-f902-45fb-893b-436df66d98d9 tempest-FloatingIPDetailsNegativeTestJSON-267248092 tempest-FloatingIPDetailsNegativeTestJSON-267248092-project] Calling method '.version_select at 0x7f4d2ab711f0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:13.114894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-74dbf6fa-7a52-45c0-b82a-a34c808b0b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:13.169810 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-74dbf6fa-7a52-45c0-b82a-a34c808b0b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1271 microversion: 2.1 time: 0.544821 Aug 27 02:29:13.180962 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 253/522] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:12 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1271 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:13.193478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-303cf527-2254-4356-b4f7-bcb172708e1c tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Calling method '.version_select at 0x7f4d2ac308b0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:13.305443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-303cf527-2254-4356-b4f7-bcb172708e1c tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:13.306214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-303cf527-2254-4356-b4f7-bcb172708e1c tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:13.306850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-303cf527-2254-4356-b4f7-bcb172708e1c tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:13.308007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-303cf527-2254-4356-b4f7-bcb172708e1c tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:13.308854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-303cf527-2254-4356-b4f7-bcb172708e1c tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:13.309482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-303cf527-2254-4356-b4f7-bcb172708e1c tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:13.339431 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-303cf527-2254-4356-b4f7-bcb172708e1c tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/300ee590cdbc4f86be995dcb93ab3034/detail" status: 200 len: 463 microversion: 2.57 time: 0.157066 Aug 27 02:29:13.340831 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 254/523] 10.222.0.99 () {60 vars in 1304 bytes} [Sat Aug 27 02:29:13 2022] GET /compute/v2.1/os-quota-sets/300ee590cdbc4f86be995dcb93ab3034/detail => generated 463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:29:13.346902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8080088f-c1ea-44d6-ba24-27b498dbc5ce tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Calling method '.version_select at 0x7f4d2ad8f550>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:13.349764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8080088f-c1ea-44d6-ba24-27b498dbc5ce tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:13.350655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8080088f-c1ea-44d6-ba24-27b498dbc5ce tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:13.351514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8080088f-c1ea-44d6-ba24-27b498dbc5ce tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:13.377926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=11,nova_api:INSERT=13 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:13.392141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8080088f-c1ea-44d6-ba24-27b498dbc5ce tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:13.395089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8080088f-c1ea-44d6-ba24-27b498dbc5ce tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:13.395805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8080088f-c1ea-44d6-ba24-27b498dbc5ce tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:13.426762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG neutronclient.v2_0.client [None req-7c21ce97-f902-45fb-893b-436df66d98d9 tempest-FloatingIPDetailsNegativeTestJSON-267248092 tempest-FloatingIPDetailsNegativeTestJSON-267248092-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1 could not be found", "detail": ""}} {{(pid=122488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:29:13.427477 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-7c21ce97-f902-45fb-893b-436df66d98d9 tempest-FloatingIPDetailsNegativeTestJSON-267248092 tempest-FloatingIPDetailsNegativeTestJSON-267248092-project] HTTP exception thrown: Floating IP not found for ID 76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1 Aug 27 02:29:13.430198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8080088f-c1ea-44d6-ba24-27b498dbc5ce tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:13.430795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8080088f-c1ea-44d6-ba24-27b498dbc5ce tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:13.431400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8080088f-c1ea-44d6-ba24-27b498dbc5ce tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:13.446979 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8080088f-c1ea-44d6-ba24-27b498dbc5ce tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.104416 Aug 27 02:29:13.448135 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 255/524] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:29:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7c21ce97-f902-45fb-893b-436df66d98d9 tempest-FloatingIPDetailsNegativeTestJSON-267248092 tempest-FloatingIPDetailsNegativeTestJSON-267248092-project] Request method failure captured: Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-floating-ips/76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1 HTTP/1.1 Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYF3wYjY8HwwEYPLnagvScCMl1xJXk1SbnM4WZuwmD7eMJWh0qf592ifQYpoJsMqHaqrDuDmybE11aaKqXQKryWTu-vV1Z2xaVDM7hA_1TjcEkPPRgJn6mVwdleuquwnG3rn2IEXofwvT4w5BJDADk3AsRL1C2IWO7GAhzfmNRX0cIs Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 9dd763a8c757488b834c51296895e470 Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-267248092 Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9dd763a8c757488b834c51296895e470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9dd763a8c757488b834c51296895e470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9dd763a8c757488b834c51296895e470"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9dd763a8c757488b834c51296895e470"}]}] Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-267248092 Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 9dd763a8c757488b834c51296895e470 Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-267248092 Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-267248092-project Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b10e94a0db3f4b0d9e1fcd3da80dee9c Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-267248092-project Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: exception: Floating IP not found for ID 76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1 Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1'} Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1 could not be found Aug 27 02:29:13.459721 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d718348-bcae-4ad7-aa4e-d2a43ed7e52f'] Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1. Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1 Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1 Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7c21ce97-f902-45fb-893b-436df66d98d9 tempest-FloatingIPDetailsNegativeTestJSON-267248092 tempest-FloatingIPDetailsNegativeTestJSON-267248092-project] Returning 404 to user: Floating IP not found for ID 76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1 {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7c21ce97-f902-45fb-893b-436df66d98d9 tempest-FloatingIPDetailsNegativeTestJSON-267248092 tempest-FloatingIPDetailsNegativeTestJSON-267248092-project] 10.222.0.99 "GET /compute/v2.1/os-floating-ips/76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1" status: 404 len: 111 microversion: 2.1 time: 0.612370 Aug 27 02:29:13.463689 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 270/525] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:29:12 2022] GET /compute/v2.1/os-floating-ips/76a72a2e-5c83-4fe9-bd43-a3be2ac1ecc1 => generated 111 bytes in 614 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:29:13.475034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f11480d-d600-49e9-9dc1-93ac237e44ea tempest-HypervisorAdminNegativeUnderV252Test-255837055 tempest-HypervisorAdminNegativeUnderV252Test-255837055-project] Calling method '.version_select at 0x7f4d2ab71820>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:13.476221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ed85dfc3-33c7-42c9-9078-4fcfb2d2d0ca tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:13.477744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9f11480d-d600-49e9-9dc1-93ac237e44ea tempest-HypervisorAdminNegativeUnderV252Test-255837055 tempest-HypervisorAdminNegativeUnderV252Test-255837055-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '8e4266de20ff494fa9c9cc376ea30e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d791e4b14a45bdbde4dab7d12d3f35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f11480d-d600-49e9-9dc1-93ac237e44ea tempest-HypervisorAdminNegativeUnderV252Test-255837055 tempest-HypervisorAdminNegativeUnderV252Test-255837055-project] Request method failure captured: Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFycy-yMkgfYTDcNzbJmJYuPHlFDbQM63czeX3Y3sJUVTTBNUDdkKPDy6ZrR28Ya-gdp6u2feJPDBMUf5sxnljbcEMHzX0HEldS3b-dkWeitLNpAI_UYoOmbNvELiXUKNDDP3UtgqJcK_kD0xSjUqV6xYqiQO2GNvPvqIbncwtv88c Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 00d791e4b14a45bdbde4dab7d12d3f35 Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-255837055 Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00d791e4b14a45bdbde4dab7d12d3f35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00d791e4b14a45bdbde4dab7d12d3f35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00d791e4b14a45bdbde4dab7d12d3f35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00d791e4b14a45bdbde4dab7d12d3f35"}]}] Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-255837055 Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 00d791e4b14a45bdbde4dab7d12d3f35 Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-255837055 Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-255837055-project Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 8e4266de20ff494fa9c9cc376ea30e52 Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-255837055-project Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '1'} Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:13.480944 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.484700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:13.484700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:13.484700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:13.484700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:29:13.484700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:29:13.484700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 27 02:29:13.484700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.484700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f11480d-d600-49e9-9dc1-93ac237e44ea tempest-HypervisorAdminNegativeUnderV252Test-255837055 tempest-HypervisorAdminNegativeUnderV252Test-255837055-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:29:13.484700 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9f11480d-d600-49e9-9dc1-93ac237e44ea tempest-HypervisorAdminNegativeUnderV252Test-255837055 tempest-HypervisorAdminNegativeUnderV252Test-255837055-project] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019199 Aug 27 02:29:13.489763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ed85dfc3-33c7-42c9-9078-4fcfb2d2d0ca tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:13.495955 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 271/526] 10.222.0.99 () {58 vars in 1176 bytes} [Sat Aug 27 02:29:13 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:29:13.503866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-14d17ee8-579e-4a2a-8112-3aa0c071dcc2 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Calling method '.version_select at 0x7f4d2ab5dee0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:13.505779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14d17ee8-579e-4a2a-8112-3aa0c071dcc2 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:13.506279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14d17ee8-579e-4a2a-8112-3aa0c071dcc2 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:13.506721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14d17ee8-579e-4a2a-8112-3aa0c071dcc2 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:13.539154 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-14d17ee8-579e-4a2a-8112-3aa0c071dcc2 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] HTTP exception thrown: No hypervisor matching 'fad0754f-cad9-4cd1-88d5-0031e840f4c2' could be found. Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-14d17ee8-579e-4a2a-8112-3aa0c071dcc2 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Request method failure captured: Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-hypervisors/fad0754f-cad9-4cd1-88d5-0031e840f4c2/servers HTTP/1.1 Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYF1ODFvTjrHwKcnZVK9rqOEuxOyTRGv8EkPG5eC-MiA9cxRuo4DYPMVt_jzrCmF3GDJbVyhNLkxJvCsHN3EJSF6dcqbCEbOx_sNcbO-NCZPZRoYH47u8FbPfrziea7ZrqIQZ7Tg4LquTkj84GXUdPy6J-jPBaoxR1lVbt_55m1PuQQ Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 69e4e43bf9fa4f6d94359022e04aba36 Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810580730 Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_69e4e43bf9fa4f6d94359022e04aba36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69e4e43bf9fa4f6d94359022e04aba36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69e4e43bf9fa4f6d94359022e04aba36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/69e4e43bf9fa4f6d94359022e04aba36"}]}] Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1810580730 Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 69e4e43bf9fa4f6d94359022e04aba36 Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810580730 Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: c1dc933294ad4ad5b37a3fe7bba54728 Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: exception: No hypervisor matching 'fad0754f-cad9-4cd1-88d5-0031e840f4c2' could be found. Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'fad0754f-cad9-4cd1-88d5-0031e840f4c2'} Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'fad0754f-cad9-4cd1-88d5-0031e840f4c2' could be found. Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'fad0754f-cad9-4cd1-88d5-0031e840f4c2' could be found. Aug 27 02:29:13.542642 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:13.549437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-14d17ee8-579e-4a2a-8112-3aa0c071dcc2 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] Returning 404 to user: No hypervisor matching 'fad0754f-cad9-4cd1-88d5-0031e840f4c2' could be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:29:13.549437 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-14d17ee8-579e-4a2a-8112-3aa0c071dcc2 tempest-HypervisorAdminNegativeUnderV252Test-1810580730 tempest-HypervisorAdminNegativeUnderV252Test-1810580730-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/fad0754f-cad9-4cd1-88d5-0031e840f4c2/servers" status: 404 len: 123 microversion: 2.1 time: 0.047391 Aug 27 02:29:13.549437 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 272/527] 10.222.0.99 () {58 vars in 1281 bytes} [Sat Aug 27 02:29:13 2022] GET /compute/v2.1/os-hypervisors/fad0754f-cad9-4cd1-88d5-0031e840f4c2/servers => generated 123 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:29:13.616964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ed85dfc3-33c7-42c9-9078-4fcfb2d2d0ca tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:13.639955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ed85dfc3-33c7-42c9-9078-4fcfb2d2d0ca tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:13.645264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ed85dfc3-33c7-42c9-9078-4fcfb2d2d0ca tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:13.651220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-991866ca-0ee1-4064-85cb-f6153d7a27bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:13.652782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-991866ca-0ee1-4064-85cb-f6153d7a27bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:13.668852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-991866ca-0ee1-4064-85cb-f6153d7a27bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:13.669331 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ed85dfc3-33c7-42c9-9078-4fcfb2d2d0ca tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "PUT /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1358 microversion: 2.75 time: 0.218725 Aug 27 02:29:13.672668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-991866ca-0ee1-4064-85cb-f6153d7a27bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:13.688222 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 256/528] 10.222.0.99 () {62 vars in 1297 bytes} [Sat Aug 27 02:29:13 2022] PUT /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:13.688895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-991866ca-0ee1-4064-85cb-f6153d7a27bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:13.688895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-991866ca-0ee1-4064-85cb-f6153d7a27bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:13.688895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-991866ca-0ee1-4064-85cb-f6153d7a27bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:13.702061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-991866ca-0ee1-4064-85cb-f6153d7a27bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:13.708597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f234c0b3-93be-4b39-afc0-b9110c1c9d99 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:13.710729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f234c0b3-93be-4b39-afc0-b9110c1c9d99 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:13.815811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=92 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:14.060025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f234c0b3-93be-4b39-afc0-b9110c1c9d99 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:14.073798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f234c0b3-93be-4b39-afc0-b9110c1c9d99 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:14.076161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f234c0b3-93be-4b39-afc0-b9110c1c9d99 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:14.094381 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f234c0b3-93be-4b39-afc0-b9110c1c9d99 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1358 microversion: 2.75 time: 0.388998 Aug 27 02:29:14.106171 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 257/529] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:13 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1358 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:29:14.124770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2acac160>, body: {"quota_set": {"ram": "2048"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:14.731150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:14.736006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:14.736895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:14.739943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:14.740948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:14.744128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:14.778887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-991866ca-0ee1-4064-85cb-f6153d7a27bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:14.791881 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-991866ca-0ee1-4064-85cb-f6153d7a27bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1317 microversion: 2.1 time: 1.146929 Aug 27 02:29:14.808566 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 273/530] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:13 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1317 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:14.816479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ef5b0b07-e89f-455e-bf6c-f3be958acb7e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:14.817482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ef5b0b07-e89f-455e-bf6c-f3be958acb7e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:14.839725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5b0b07-e89f-455e-bf6c-f3be958acb7e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:14.840612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5b0b07-e89f-455e-bf6c-f3be958acb7e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:14.841949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5b0b07-e89f-455e-bf6c-f3be958acb7e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:14.843058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5b0b07-e89f-455e-bf6c-f3be958acb7e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:14.843835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5b0b07-e89f-455e-bf6c-f3be958acb7e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:14.844482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5b0b07-e89f-455e-bf6c-f3be958acb7e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:14.850227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:14.851614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:14.852882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:14.855517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:14.858998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:14.860042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:15.057751 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3cfb0c9c-af89-4b8d-9e84-04b93d6fe233 tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/300ee590cdbc4f86be995dcb93ab3034?user_id=f3dd0145953f48beac99887b7bb87b4c" status: 200 len: 148 microversion: 2.57 time: 0.949794 Aug 27 02:29:15.065271 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 258/531] 10.222.0.99 () {62 vars in 1384 bytes} [Sat Aug 27 02:29:14 2022] PUT /compute/v2.1/os-quota-sets/300ee590cdbc4f86be995dcb93ab3034?user_id=f3dd0145953f48beac99887b7bb87b4c => generated 148 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:29:15.077106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-01972a56-97c9-4b3d-b763-73f3145689be tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] Calling method '.version_select at 0x7f4d2ac30040>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:15.116614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef5b0b07-e89f-455e-bf6c-f3be958acb7e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:15.136896 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ef5b0b07-e89f-455e-bf6c-f3be958acb7e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1271 microversion: 2.1 time: 0.326375 Aug 27 02:29:15.137526 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 274/532] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:14 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1271 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:15.151501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:15.151501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:15.164070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:15.164591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:15.165105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:15.165949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:15.167593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:15.168129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:15.315674 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-01972a56-97c9-4b3d-b763-73f3145689be tempest-QuotasAdminTestV257-999594530 tempest-QuotasAdminTestV257-999594530-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/300ee590cdbc4f86be995dcb93ab3034?user_id=f3dd0145953f48beac99887b7bb87b4c" status: 200 len: 190 microversion: 2.57 time: 0.248580 Aug 27 02:29:15.319948 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 259/533] 10.222.0.99 () {60 vars in 1364 bytes} [Sat Aug 27 02:29:15 2022] GET /compute/v2.1/os-quota-sets/300ee590cdbc4f86be995dcb93ab3034?user_id=f3dd0145953f48beac99887b7bb87b4c => generated 190 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:29:15.573988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:15.584494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:15.586036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:15.623431 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-667b3512-fccf-497d-8272-49633504ec19 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1410 microversion: 2.75 time: 0.483997 Aug 27 02:29:15.624050 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 275/534] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:15 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1410 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:15.815470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1d2d8031-168e-48f4-896e-9140c1e42e11 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:15.816313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1d2d8031-168e-48f4-896e-9140c1e42e11 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:15.830848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d2d8031-168e-48f4-896e-9140c1e42e11 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:15.832838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d2d8031-168e-48f4-896e-9140c1e42e11 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:15.834594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d2d8031-168e-48f4-896e-9140c1e42e11 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:15.836726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d2d8031-168e-48f4-896e-9140c1e42e11 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:15.842576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d2d8031-168e-48f4-896e-9140c1e42e11 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:15.843517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d2d8031-168e-48f4-896e-9140c1e42e11 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:16.159596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ca696c92-c438-4a23-95b6-dd6e2d0f579b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:16.160959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ca696c92-c438-4a23-95b6-dd6e2d0f579b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:16.181828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca696c92-c438-4a23-95b6-dd6e2d0f579b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:16.186477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca696c92-c438-4a23-95b6-dd6e2d0f579b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:16.187003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca696c92-c438-4a23-95b6-dd6e2d0f579b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:16.188033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca696c92-c438-4a23-95b6-dd6e2d0f579b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:16.200712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca696c92-c438-4a23-95b6-dd6e2d0f579b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:16.202949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca696c92-c438-4a23-95b6-dd6e2d0f579b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:16.680237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1d2d8031-168e-48f4-896e-9140c1e42e11 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:16.723213 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1d2d8031-168e-48f4-896e-9140c1e42e11 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1317 microversion: 2.1 time: 0.908081 Aug 27 02:29:16.730090 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 260/535] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:15 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1317 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:16.757280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:16.768023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:16.818043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:16.821003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:16.829146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:16.831173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:16.838382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:16.845878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:17.114366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ca696c92-c438-4a23-95b6-dd6e2d0f579b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:17.143337 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ca696c92-c438-4a23-95b6-dd6e2d0f579b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1313 microversion: 2.1 time: 0.981427 Aug 27 02:29:17.158980 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 276/536] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:16 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1313 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:29:17.488077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:17.522001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:17.530127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:17.556717 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e8b285a6-a6a0-4f93-964a-ba8c54b8195c tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1416 microversion: 2.75 time: 0.821676 Aug 27 02:29:17.563462 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 261/537] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:16 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1416 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:17.767733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ca9536d-750a-4aa7-9c70-bd36ab62f220 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:17.767733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ca9536d-750a-4aa7-9c70-bd36ab62f220 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:17.779909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ca9536d-750a-4aa7-9c70-bd36ab62f220 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:17.780458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ca9536d-750a-4aa7-9c70-bd36ab62f220 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:17.781250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ca9536d-750a-4aa7-9c70-bd36ab62f220 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:17.782869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ca9536d-750a-4aa7-9c70-bd36ab62f220 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:17.785714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ca9536d-750a-4aa7-9c70-bd36ab62f220 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:17.786500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ca9536d-750a-4aa7-9c70-bd36ab62f220 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:18.172782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f76ab50f-b148-415b-805c-d40aa6132d3b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:18.177129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f76ab50f-b148-415b-805c-d40aa6132d3b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:18.229693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f76ab50f-b148-415b-805c-d40aa6132d3b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:18.230217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f76ab50f-b148-415b-805c-d40aa6132d3b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:18.231993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f76ab50f-b148-415b-805c-d40aa6132d3b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:18.233333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f76ab50f-b148-415b-805c-d40aa6132d3b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:18.234144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f76ab50f-b148-415b-805c-d40aa6132d3b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:18.234767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f76ab50f-b148-415b-805c-d40aa6132d3b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:18.722179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f76ab50f-b148-415b-805c-d40aa6132d3b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:18.738662 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f76ab50f-b148-415b-805c-d40aa6132d3b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1313 microversion: 2.1 time: 0.577064 Aug 27 02:29:18.747896 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 262/538] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:18 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:18.760736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2fdbaa51-fe62-464b-8ec2-4ffe7443f2fc req-869bd0cb-cb26-4ba8-8827-a0fef137b3bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6596fe05-cc54-4bf2-8180-4a201ebdad1c", "tag": "89e9571f-0605-4282-a2a4-cad646e275d8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:18.794042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2fdbaa51-fe62-464b-8ec2-4ffe7443f2fc req-869bd0cb-cb26-4ba8-8827-a0fef137b3bc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:18.794678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2fdbaa51-fe62-464b-8ec2-4ffe7443f2fc req-869bd0cb-cb26-4ba8-8827-a0fef137b3bc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:18.795489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2fdbaa51-fe62-464b-8ec2-4ffe7443f2fc req-869bd0cb-cb26-4ba8-8827-a0fef137b3bc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:18.824435 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2fdbaa51-fe62-464b-8ec2-4ffe7443f2fc req-869bd0cb-cb26-4ba8-8827-a0fef137b3bc service nova] Creating event network-changed:89e9571f-0605-4282-a2a4-cad646e275d8 for instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c on n-h1-852084-5 Aug 27 02:29:18.833968 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2fdbaa51-fe62-464b-8ec2-4ffe7443f2fc req-869bd0cb-cb26-4ba8-8827-a0fef137b3bc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084041 Aug 27 02:29:18.834987 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 263/539] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:18.841284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:18.842412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:18.859320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:18.859914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:18.860750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:18.861539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:18.862078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:18.863166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:18.931809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ca9536d-750a-4aa7-9c70-bd36ab62f220 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:18.954326 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ca9536d-750a-4aa7-9c70-bd36ab62f220 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1317 microversion: 2.1 time: 1.192298 Aug 27 02:29:18.966616 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 277/540] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:17 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1317 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:18.978164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ff61b370-2faf-4297-a4bb-998176107b69 req-011f63e9-6c93-41aa-a26b-d1a95807f361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6", "name": "network-vif-plugged", "status": "completed", "tag": "a4410061-b6ff-4b24-84b1-b3697016f31d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:18.992084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ff61b370-2faf-4297-a4bb-998176107b69 req-011f63e9-6c93-41aa-a26b-d1a95807f361 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:19.001236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ff61b370-2faf-4297-a4bb-998176107b69 req-011f63e9-6c93-41aa-a26b-d1a95807f361 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:19.002242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ff61b370-2faf-4297-a4bb-998176107b69 req-011f63e9-6c93-41aa-a26b-d1a95807f361 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:19.020653 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ff61b370-2faf-4297-a4bb-998176107b69 req-011f63e9-6c93-41aa-a26b-d1a95807f361 service nova] Creating event network-vif-plugged:a4410061-b6ff-4b24-84b1-b3697016f31d for instance 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 on n-h1-852084-5 Aug 27 02:29:19.034982 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ff61b370-2faf-4297-a4bb-998176107b69 req-011f63e9-6c93-41aa-a26b-d1a95807f361 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062312 Aug 27 02:29:19.037905 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 278/541] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:19.493849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:19.513757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:19.518504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:19.549197 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bb24ab6c-2082-4a85-8329-59a69af149fd tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1437 microversion: 2.75 time: 0.707648 Aug 27 02:29:19.550871 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 264/542] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:18 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1437 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:19.585225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:19.589468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:19.597216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:19.597867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:19.598393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:19.599221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:19.599839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:19.600365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:19.733448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:29:19.734051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:29:19.735666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:29:19.736211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:29:19.736731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:29:19.766599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e607b720-f268-42a5-a0c8-c377029c62fa tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:19.767227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e607b720-f268-42a5-a0c8-c377029c62fa tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:19.780862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e607b720-f268-42a5-a0c8-c377029c62fa tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:19.783701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e607b720-f268-42a5-a0c8-c377029c62fa tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:19.784496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e607b720-f268-42a5-a0c8-c377029c62fa tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:19.789580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e607b720-f268-42a5-a0c8-c377029c62fa tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:19.790552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e607b720-f268-42a5-a0c8-c377029c62fa tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:19.793374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e607b720-f268-42a5-a0c8-c377029c62fa tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:19.864582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:19.878277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:19.878813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:19.879296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:19.880116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:19.881190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:19.881713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:20.130431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e607b720-f268-42a5-a0c8-c377029c62fa tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:20.138995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:20.155050 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e607b720-f268-42a5-a0c8-c377029c62fa tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1313 microversion: 2.1 time: 0.392926 Aug 27 02:29:20.156003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:20.157947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:20.160735 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 265/543] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:19 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:29:20.170879 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-57e79e54-6951-4635-9856-a20416b8997a tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "POST /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3/action" status: 202 len: 1494 microversion: 2.75 time: 0.597389 Aug 27 02:29:20.184389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d99bdd9d-d3f1-4c4f-8293-d6c6e51d4f14 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:20.188207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d99bdd9d-d3f1-4c4f-8293-d6c6e51d4f14 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:20.190281 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 279/544] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:29:19 2022] POST /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3/action => generated 1494 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 02:29:20.200448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:20.201356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:20.210371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:20.211427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:20.212533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:20.213611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:20.214448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:20.215128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:20.261707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d99bdd9d-d3f1-4c4f-8293-d6c6e51d4f14 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:20.266623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d99bdd9d-d3f1-4c4f-8293-d6c6e51d4f14 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:20.276663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d99bdd9d-d3f1-4c4f-8293-d6c6e51d4f14 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:20.277942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d99bdd9d-d3f1-4c4f-8293-d6c6e51d4f14 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:20.287867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d99bdd9d-d3f1-4c4f-8293-d6c6e51d4f14 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:20.288780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d99bdd9d-d3f1-4c4f-8293-d6c6e51d4f14 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:20.635309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d99bdd9d-d3f1-4c4f-8293-d6c6e51d4f14 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:20.654952 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d99bdd9d-d3f1-4c4f-8293-d6c6e51d4f14 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1317 microversion: 2.1 time: 0.491234 Aug 27 02:29:20.659881 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 266/545] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:20 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:20.795744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:20.813623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:20.818401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:20.827717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-20a63ddc-93d7-4981-b8a9-066b9b9d8e48 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.631394 Aug 27 02:29:20.829586 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 280/546] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:20 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:21.183362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7b95bd1-b1b9-4cf8-b2c6-4044812a4735 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:21.184203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7b95bd1-b1b9-4cf8-b2c6-4044812a4735 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:21.208865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b95bd1-b1b9-4cf8-b2c6-4044812a4735 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:21.210418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b95bd1-b1b9-4cf8-b2c6-4044812a4735 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:21.212293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b95bd1-b1b9-4cf8-b2c6-4044812a4735 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:21.213597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b95bd1-b1b9-4cf8-b2c6-4044812a4735 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:21.215511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b95bd1-b1b9-4cf8-b2c6-4044812a4735 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:21.217608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b95bd1-b1b9-4cf8-b2c6-4044812a4735 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:21.532906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7b95bd1-b1b9-4cf8-b2c6-4044812a4735 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:21.543099 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7b95bd1-b1b9-4cf8-b2c6-4044812a4735 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1313 microversion: 2.1 time: 0.365620 Aug 27 02:29:21.547017 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 267/547] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:21 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:21.688547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-07dccf08-8a13-436e-84dd-3f04ef8fc6ee tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:21.704196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-07dccf08-8a13-436e-84dd-3f04ef8fc6ee tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:21.727705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07dccf08-8a13-436e-84dd-3f04ef8fc6ee tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:21.731186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07dccf08-8a13-436e-84dd-3f04ef8fc6ee tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:21.737390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07dccf08-8a13-436e-84dd-3f04ef8fc6ee tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:21.742503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07dccf08-8a13-436e-84dd-3f04ef8fc6ee tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:21.744374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07dccf08-8a13-436e-84dd-3f04ef8fc6ee tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:21.745435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07dccf08-8a13-436e-84dd-3f04ef8fc6ee tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:21.878907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:21.879638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:21.889592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:21.890167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:21.898514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:21.899852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:21.900541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:21.905072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:22.053047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:22.084744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:22.089403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:22.145619 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-81fa0c16-8b59-48c0-8e4b-908468525363 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.264579 Aug 27 02:29:22.149000 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 268/548] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:21 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:29:22.415265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-07dccf08-8a13-436e-84dd-3f04ef8fc6ee tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:22.432544 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-07dccf08-8a13-436e-84dd-3f04ef8fc6ee tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1467 microversion: 2.1 time: 0.754858 Aug 27 02:29:22.433168 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 281/549] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:21 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1467 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:22.571617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a41f7046-65e5-4f0e-93dd-b9cc51531ed5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:22.572321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a41f7046-65e5-4f0e-93dd-b9cc51531ed5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:22.583675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41f7046-65e5-4f0e-93dd-b9cc51531ed5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:22.590349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41f7046-65e5-4f0e-93dd-b9cc51531ed5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:22.591466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41f7046-65e5-4f0e-93dd-b9cc51531ed5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:22.592403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41f7046-65e5-4f0e-93dd-b9cc51531ed5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:22.593076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41f7046-65e5-4f0e-93dd-b9cc51531ed5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:22.595465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41f7046-65e5-4f0e-93dd-b9cc51531ed5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:22.644165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=13 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:22.688591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=71,nova_cell0:UPDATE=7 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:22.987296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd99b8c2-92f8-4345-b1db-072fbc658ae2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:22.992318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bd99b8c2-92f8-4345-b1db-072fbc658ae2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:23.004293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd99b8c2-92f8-4345-b1db-072fbc658ae2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:23.007287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd99b8c2-92f8-4345-b1db-072fbc658ae2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:23.012414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd99b8c2-92f8-4345-b1db-072fbc658ae2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:23.029978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd99b8c2-92f8-4345-b1db-072fbc658ae2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:23.030512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd99b8c2-92f8-4345-b1db-072fbc658ae2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:23.031585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd99b8c2-92f8-4345-b1db-072fbc658ae2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:23.259741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a41f7046-65e5-4f0e-93dd-b9cc51531ed5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:23.312219 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a41f7046-65e5-4f0e-93dd-b9cc51531ed5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1313 microversion: 2.1 time: 0.747115 Aug 27 02:29:23.347240 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 282/550] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:22 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:23.366430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:23.377381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:23.401190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:23.406883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:23.407692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:23.410431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:23.411239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:23.412042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:23.999288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:24.015522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:24.022320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:24.051869 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2771d46-4ccb-4ae9-8389-50d9eeb0c14e tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.702949 Aug 27 02:29:24.072316 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 283/551] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:23 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:24.090018 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd99b8c2-92f8-4345-b1db-072fbc658ae2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1618 microversion: 2.1 time: 1.638044 Aug 27 02:29:24.097962 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 269/552] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:22 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1618 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:24.122929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ff0485c-da63-42ed-8640-41c9b9b8d2c8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Action: 'create', calling method: .version_select at 0x7f4d2aa36f70>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-897598170", "policies": ["affinity"]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:24.150219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:24.171826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3ff0485c-da63-42ed-8640-41c9b9b8d2c8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:24.189636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3ff0485c-da63-42ed-8640-41c9b9b8d2c8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:24.336649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3ff0485c-da63-42ed-8640-41c9b9b8d2c8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:24.343779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3ff0485c-da63-42ed-8640-41c9b9b8d2c8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:24.365081 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ff0485c-da63-42ed-8640-41c9b9b8d2c8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.246233 Aug 27 02:29:24.366519 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 284/553] 10.222.0.99 () {60 vars in 1174 bytes} [Sat Aug 27 02:29:24 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:24.372427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-83349d45-f101-4fe6-bd6f-842315daaeca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:24.381064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-83349d45-f101-4fe6-bd6f-842315daaeca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:24.415737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83349d45-f101-4fe6-bd6f-842315daaeca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:24.416282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83349d45-f101-4fe6-bd6f-842315daaeca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:24.422178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83349d45-f101-4fe6-bd6f-842315daaeca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:24.426346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83349d45-f101-4fe6-bd6f-842315daaeca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:24.432398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83349d45-f101-4fe6-bd6f-842315daaeca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:24.433348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83349d45-f101-4fe6-bd6f-842315daaeca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:24.656658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-167568897", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "742b6e09-f3eb-4047-9fda-820009b703db"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:24.780919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-83349d45-f101-4fe6-bd6f-842315daaeca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:24.793600 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-83349d45-f101-4fe6-bd6f-842315daaeca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1313 microversion: 2.1 time: 0.436525 Aug 27 02:29:24.796158 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 270/554] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:24 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:29:24.881420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:29:25.085521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:25.086494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:25.096662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=9 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:25.103650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:25.104175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:25.110019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:25.110935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:25.111502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:25.112014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:25.252915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=28 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:25.468844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:25.494800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:25.496791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:25.504948 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d6a9373b-d18e-4df6-8b9b-e22d603b3879 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.423957 Aug 27 02:29:25.523228 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 271/555] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:25 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:29:25.821954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b8add90-90c4-4618-8cf4-b66738044791 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:25.823418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0b8add90-90c4-4618-8cf4-b66738044791 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:25.833112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8add90-90c4-4618-8cf4-b66738044791 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:25.836986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8add90-90c4-4618-8cf4-b66738044791 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:25.837769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8add90-90c4-4618-8cf4-b66738044791 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:25.838750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8add90-90c4-4618-8cf4-b66738044791 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:25.840084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8add90-90c4-4618-8cf4-b66738044791 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:25.841454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8add90-90c4-4618-8cf4-b66738044791 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:26.112378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0b8add90-90c4-4618-8cf4-b66738044791 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:26.129229 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0b8add90-90c4-4618-8cf4-b66738044791 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1313 microversion: 2.1 time: 0.311334 Aug 27 02:29:26.169151 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 272/556] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:25 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:26.301412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:29:26.302127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:29:26.302387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:29:26.302980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:29:26.303706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:29:26.362231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:26.365381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:26.366794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:26.367855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:26.369923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:26.371841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:26.430423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:26.442687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:26.468904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Going to run 2 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:29:26.474804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:29:26.524583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122488) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 27 02:29:26.532825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:26.533978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:26.552748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:26.553610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:26.559614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:26.566706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:26.571728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:26.571978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:26.572366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:26.572828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:26.641735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:26.651488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:26.660886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:26.721907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=b5bde1cf-03b1-4f09-9dba-4c532bd1f856,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:29:26.852976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:26.874424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:26.960721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:26.971552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:27.042838 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3f14683b-c3c9-4eb8-9a47-299ee969a802 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.391653 Aug 27 02:29:27.047677 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 285/557] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:29:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 2398 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:29:27.057098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8ce6e382-d1ab-44b3-b550-dc6aa6f1508a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:27.064138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8ce6e382-d1ab-44b3-b550-dc6aa6f1508a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:27.065393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8ce6e382-d1ab-44b3-b550-dc6aa6f1508a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Searching by: {'deleted': False, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:29:27.112229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ce6e382-d1ab-44b3-b550-dc6aa6f1508a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:27.113186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ce6e382-d1ab-44b3-b550-dc6aa6f1508a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:27.114017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ce6e382-d1ab-44b3-b550-dc6aa6f1508a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:27.118534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ce6e382-d1ab-44b3-b550-dc6aa6f1508a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:27.119390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ce6e382-d1ab-44b3-b550-dc6aa6f1508a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:27.121152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ce6e382-d1ab-44b3-b550-dc6aa6f1508a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:27.278731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-8ce6e382-d1ab-44b3-b550-dc6aa6f1508a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:29:27.488038 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8ce6e382-d1ab-44b3-b550-dc6aa6f1508a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.438750 Aug 27 02:29:27.496981 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 286/558] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 02:29:27 2022] GET /compute/v2.1/servers => generated 1002 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:27.504130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d616c165-85d1-4931-a172-e3276e4bcef7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:27.505068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d616c165-85d1-4931-a172-e3276e4bcef7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:27.530817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d616c165-85d1-4931-a172-e3276e4bcef7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:27.532018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d616c165-85d1-4931-a172-e3276e4bcef7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:27.532716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d616c165-85d1-4931-a172-e3276e4bcef7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:27.534011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d616c165-85d1-4931-a172-e3276e4bcef7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:27.534755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d616c165-85d1-4931-a172-e3276e4bcef7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:27.535409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d616c165-85d1-4931-a172-e3276e4bcef7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:27.576246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:27.590907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:27.592472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:27.612056 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2b84b978-2e82-4fbf-96af-ff5372cbc50b tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 1.084015 Aug 27 02:29:27.612997 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 273/559] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:26 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:29:27.634095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fd077d61-5658-4ad0-9abd-87c6f9061806 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:27.634729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fd077d61-5658-4ad0-9abd-87c6f9061806 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:27.796529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fd077d61-5658-4ad0-9abd-87c6f9061806 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:27.809752 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fd077d61-5658-4ad0-9abd-87c6f9061806 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1218 microversion: 2.1 time: 0.195529 Aug 27 02:29:27.810365 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 274/560] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:27 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:28.575613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d616c165-85d1-4931-a172-e3276e4bcef7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:28.592178 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d616c165-85d1-4931-a172-e3276e4bcef7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1313 microversion: 2.1 time: 1.090919 Aug 27 02:29:28.609088 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 287/561] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:27 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1313 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:28.648722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:28.651201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:28.678610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:28.682175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:28.685654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:28.689963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:28.693469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:28.697524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:28.830317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-063ad15c-24da-4684-8ff0-1d7b1974efeb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:28.831513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-063ad15c-24da-4684-8ff0-1d7b1974efeb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:28.845626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:28.851145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063ad15c-24da-4684-8ff0-1d7b1974efeb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:28.854735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063ad15c-24da-4684-8ff0-1d7b1974efeb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:28.855479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063ad15c-24da-4684-8ff0-1d7b1974efeb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:28.856423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063ad15c-24da-4684-8ff0-1d7b1974efeb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:28.858361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063ad15c-24da-4684-8ff0-1d7b1974efeb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:28.859036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063ad15c-24da-4684-8ff0-1d7b1974efeb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:29.143950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:29.183849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:29.195618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:29.214501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-063ad15c-24da-4684-8ff0-1d7b1974efeb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:29.230101 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-063ad15c-24da-4684-8ff0-1d7b1974efeb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1222 microversion: 2.1 time: 0.403518 Aug 27 02:29:29.231084 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 288/562] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:28 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1222 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:29.260360 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-83134b8c-e5c7-419e-a47f-6e9d082dc7db tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.612970 Aug 27 02:29:29.261922 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 275/563] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:28 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:29:29.624236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9e92ce18-235e-4473-ba5e-e4f7d0083d80 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:29.624944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9e92ce18-235e-4473-ba5e-e4f7d0083d80 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:29.638302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e92ce18-235e-4473-ba5e-e4f7d0083d80 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:29.638857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e92ce18-235e-4473-ba5e-e4f7d0083d80 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:29.641228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e92ce18-235e-4473-ba5e-e4f7d0083d80 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:29.649777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e92ce18-235e-4473-ba5e-e4f7d0083d80 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:29.652132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e92ce18-235e-4473-ba5e-e4f7d0083d80 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:29.653603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e92ce18-235e-4473-ba5e-e4f7d0083d80 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:29.833348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:30.081772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-de47f5c3-d1dd-4d0c-9090-27c4b2cb7e42 req-9aceb659-ff83-4d1f-a3a3-3ae288b654cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6596fe05-cc54-4bf2-8180-4a201ebdad1c", "name": "network-vif-plugged", "status": "completed", "tag": "89e9571f-0605-4282-a2a4-cad646e275d8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:30.162864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-de47f5c3-d1dd-4d0c-9090-27c4b2cb7e42 req-9aceb659-ff83-4d1f-a3a3-3ae288b654cc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:30.170952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-de47f5c3-d1dd-4d0c-9090-27c4b2cb7e42 req-9aceb659-ff83-4d1f-a3a3-3ae288b654cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:30.180398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-de47f5c3-d1dd-4d0c-9090-27c4b2cb7e42 req-9aceb659-ff83-4d1f-a3a3-3ae288b654cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:30.241704 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-de47f5c3-d1dd-4d0c-9090-27c4b2cb7e42 req-9aceb659-ff83-4d1f-a3a3-3ae288b654cc service nova] Creating event network-vif-plugged:89e9571f-0605-4282-a2a4-cad646e275d8 for instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c on n-h1-852084-5 Aug 27 02:29:30.308348 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-de47f5c3-d1dd-4d0c-9090-27c4b2cb7e42 req-9aceb659-ff83-4d1f-a3a3-3ae288b654cc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257049 Aug 27 02:29:30.310324 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 276/564] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:30.338486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c30c0fe5-935a-42ce-9c77-1ac3dcb4b424 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:30.339837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c30c0fe5-935a-42ce-9c77-1ac3dcb4b424 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:30.423597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c30c0fe5-935a-42ce-9c77-1ac3dcb4b424 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:30.424387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c30c0fe5-935a-42ce-9c77-1ac3dcb4b424 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:30.425091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c30c0fe5-935a-42ce-9c77-1ac3dcb4b424 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:30.440222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c30c0fe5-935a-42ce-9c77-1ac3dcb4b424 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:30.442114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c30c0fe5-935a-42ce-9c77-1ac3dcb4b424 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:30.450871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c30c0fe5-935a-42ce-9c77-1ac3dcb4b424 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:30.988206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c30c0fe5-935a-42ce-9c77-1ac3dcb4b424 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:31.035163 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c30c0fe5-935a-42ce-9c77-1ac3dcb4b424 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1270 microversion: 2.1 time: 0.713363 Aug 27 02:29:31.042169 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 277/565] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:30 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1270 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:31.089744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:31.092981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:31.111736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:31.113145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:31.117085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:31.119899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:31.126082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:31.127277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:31.546181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:31.552877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9e92ce18-235e-4473-ba5e-e4f7d0083d80 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:31.562465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:31.571705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:31.576082 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9e92ce18-235e-4473-ba5e-e4f7d0083d80 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1313 microversion: 2.1 time: 1.958210 Aug 27 02:29:31.580903 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 289/566] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:29 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1313 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:31.611840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:31.619695 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-975d4a1b-21e9-4986-a2e2-be036a680f92 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.570623 Aug 27 02:29:31.623679 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 278/567] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:31 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:32.076385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42fbd161-8402-4cbc-8ab9-4e22730ca627 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:32.077484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-42fbd161-8402-4cbc-8ab9-4e22730ca627 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:32.091666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42fbd161-8402-4cbc-8ab9-4e22730ca627 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:32.092933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42fbd161-8402-4cbc-8ab9-4e22730ca627 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:32.094557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42fbd161-8402-4cbc-8ab9-4e22730ca627 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:32.095484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42fbd161-8402-4cbc-8ab9-4e22730ca627 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:32.097584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42fbd161-8402-4cbc-8ab9-4e22730ca627 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:32.102232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42fbd161-8402-4cbc-8ab9-4e22730ca627 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:32.190953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da0e9163-21cf-442d-90bd-8ff604dd697b tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2a96b820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2051696162", "description": "tempest-description-1383221037"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:32.436962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-42fbd161-8402-4cbc-8ab9-4e22730ca627 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:32.452322 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42fbd161-8402-4cbc-8ab9-4e22730ca627 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1276 microversion: 2.1 time: 0.377816 Aug 27 02:29:32.453627 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 279/568] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:32 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1276 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:29:32.603347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6d06b3c3-24ea-4b53-a1f5-18d0868e9e8c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:32.604715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6d06b3c3-24ea-4b53-a1f5-18d0868e9e8c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:32.624705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d06b3c3-24ea-4b53-a1f5-18d0868e9e8c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:32.625472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d06b3c3-24ea-4b53-a1f5-18d0868e9e8c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:32.626165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d06b3c3-24ea-4b53-a1f5-18d0868e9e8c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:32.627118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d06b3c3-24ea-4b53-a1f5-18d0868e9e8c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:32.627761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d06b3c3-24ea-4b53-a1f5-18d0868e9e8c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:32.628358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d06b3c3-24ea-4b53-a1f5-18d0868e9e8c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:33.036112 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-da0e9163-21cf-442d-90bd-8ff604dd697b tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.110640 Aug 27 02:29:33.043347 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 290/569] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:29:31 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:33.065837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:33.076228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:33.100188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:33.107363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:33.108519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:33.114544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:33.115830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:33.118228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:33.422326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:33.441131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:33.443659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:33.461586 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eb896bc5-a9c6-4644-a7e3-ec6fc7f1dbd8 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.412413 Aug 27 02:29:33.462227 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 291/570] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:33 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:33.477989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8d0712df-9f5e-4050-bfb0-ad56e6b6c664 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2a90aa60>, body: {"security_group_rule": {"parent_group_id": "5336f97c-78cd-4d81-9661-0918b55d569e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:33.514147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6d06b3c3-24ea-4b53-a1f5-18d0868e9e8c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:33.547936 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6d06b3c3-24ea-4b53-a1f5-18d0868e9e8c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1313 microversion: 2.1 time: 0.945968 Aug 27 02:29:33.559105 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 280/571] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:32 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1313 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:33.587288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd4c6026-0f73-4271-a49d-08f030c34137 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:33.588425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd4c6026-0f73-4271-a49d-08f030c34137 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:33.616636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4c6026-0f73-4271-a49d-08f030c34137 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:33.619737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4c6026-0f73-4271-a49d-08f030c34137 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:33.622181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4c6026-0f73-4271-a49d-08f030c34137 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:33.624453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4c6026-0f73-4271-a49d-08f030c34137 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:33.625903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4c6026-0f73-4271-a49d-08f030c34137 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:33.629496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4c6026-0f73-4271-a49d-08f030c34137 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:34.031225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd4c6026-0f73-4271-a49d-08f030c34137 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:34.045032 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd4c6026-0f73-4271-a49d-08f030c34137 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1276 microversion: 2.1 time: 0.483350 Aug 27 02:29:34.048406 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 281/572] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:33 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1276 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:34.515765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:34.516842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:34.526176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:34.526552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:34.528539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:34.532913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:34.533746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:34.534484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:34.693888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:34.709831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:34.716459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:34.734280 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a771c68e-769c-463f-8c74-339fe050d508 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.221916 Aug 27 02:29:34.735596 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 282/573] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:34 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:29:34.746638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e063637-35f6-4e4d-8ae4-6ddb8e70957a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:34.747629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9e063637-35f6-4e4d-8ae4-6ddb8e70957a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:34.764510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e063637-35f6-4e4d-8ae4-6ddb8e70957a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:34.765311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e063637-35f6-4e4d-8ae4-6ddb8e70957a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:34.766222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e063637-35f6-4e4d-8ae4-6ddb8e70957a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:34.767522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e063637-35f6-4e4d-8ae4-6ddb8e70957a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:34.768232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e063637-35f6-4e4d-8ae4-6ddb8e70957a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:34.775403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e063637-35f6-4e4d-8ae4-6ddb8e70957a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:35.816519 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8d0712df-9f5e-4050-bfb0-ad56e6b6c664 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.353054 Aug 27 02:29:35.831330 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 292/574] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:29:33 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:35.831330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-08598f5b-cdab-4486-9eb3-07c568291b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:35.831330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-08598f5b-cdab-4486-9eb3-07c568291b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:35.846080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08598f5b-cdab-4486-9eb3-07c568291b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:35.846728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08598f5b-cdab-4486-9eb3-07c568291b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:35.847185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08598f5b-cdab-4486-9eb3-07c568291b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:35.847928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08598f5b-cdab-4486-9eb3-07c568291b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:35.850612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08598f5b-cdab-4486-9eb3-07c568291b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:35.851427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08598f5b-cdab-4486-9eb3-07c568291b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:35.907316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9e063637-35f6-4e4d-8ae4-6ddb8e70957a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:35.994725 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9e063637-35f6-4e4d-8ae4-6ddb8e70957a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1463 microversion: 2.1 time: 1.254367 Aug 27 02:29:35.997496 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 283/575] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:34 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1463 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:36.343149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1e2dbe5c-c8f3-4624-9976-85f380e8e423 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Action: 'create', calling method: .version_select at 0x7f4d2ad46f70>, body: {"keypair": {"name": "tempest-keypair-159140529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/NlLodXM4vZAY7KWthXrVQV6CpYgIi5O56S81Iqu9a8UxTqu3BSAZZZv2XfkkZyq59xzDDRJoIoDwfRB+6ycvwxAl31tyAkwCNaykTAcU4TjGZHQHbjYa/2TEr7KYEuA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:36.367694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-1e2dbe5c-c8f3-4624-9976-85f380e8e423 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:36.375733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-1e2dbe5c-c8f3-4624-9976-85f380e8e423 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for user 4aefbc2f180c4db8ba96e56cde133d49 and project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:36.412708 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1e2dbe5c-c8f3-4624-9976-85f380e8e423 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.413032 Aug 27 02:29:36.413812 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 284/576] 10.222.0.99 () {62 vars in 1199 bytes} [Sat Aug 27 02:29:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 415 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:29:36.431572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:36.433003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:36.444234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:36.445181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:36.452645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:36.454173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:36.464963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:36.466011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:36.470583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-08598f5b-cdab-4486-9eb3-07c568291b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:36.488285 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-08598f5b-cdab-4486-9eb3-07c568291b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1318 microversion: 2.1 time: 0.669965 Aug 27 02:29:36.508603 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 293/577] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:35 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:36.529119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-949e1279-9af3-4f19-9100-926b76e311f5 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2aa19c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-9264063", "description": "tempest-description-22176280"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:36.996170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=30 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:37.174563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:37.254717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:37.274511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:37.280632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:37.299808 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-86c493f0-fba4-4422-9090-5acdf69ffce9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.881544 Aug 27 02:29:37.307960 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 285/578] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:36 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:37.350550 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-949e1279-9af3-4f19-9100-926b76e311f5 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.835610 Aug 27 02:29:37.351774 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 294/579] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:29:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:37.357186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-93cbb6af-0c49-4d71-80de-1b7ed2933923 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2a90aee0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:37.380651 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-93cbb6af-0c49-4d71-80de-1b7ed2933923 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "GET /compute/v2.1/os-keypairs/tempest-keypair-159140529" status: 200 len: 511 microversion: 2.2 time: 0.027092 Aug 27 02:29:37.380993 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 295/580] 10.222.0.99 () {60 vars in 1255 bytes} [Sat Aug 27 02:29:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-159140529 => generated 511 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:37.392998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fad7d54a-8804-46b5-825b-a752698d3f48 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2aa67940>, body: {"security_group_rule": {"parent_group_id": "1610fab1-bf2e-4dd1-be8b-c0e49bf53913", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:37.581712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f82d5913-ffae-4b55-88ef-4cb8f8768648 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:37.582632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f82d5913-ffae-4b55-88ef-4cb8f8768648 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:37.603322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f82d5913-ffae-4b55-88ef-4cb8f8768648 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:37.603932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f82d5913-ffae-4b55-88ef-4cb8f8768648 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:37.604460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f82d5913-ffae-4b55-88ef-4cb8f8768648 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:37.605849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f82d5913-ffae-4b55-88ef-4cb8f8768648 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:37.606418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f82d5913-ffae-4b55-88ef-4cb8f8768648 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:37.606939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f82d5913-ffae-4b55-88ef-4cb8f8768648 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:38.484559 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fad7d54a-8804-46b5-825b-a752698d3f48 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.094751 Aug 27 02:29:38.493465 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 296/581] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:29:37 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:38.493820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c19bbec7-1ab9-49a9-95fd-aaa8c373bbf9 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2a874160>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:38.545629 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c19bbec7-1ab9-49a9-95fd-aaa8c373bbf9 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-159140529" status: 204 len: 0 microversion: 2.2 time: 0.058207 Aug 27 02:29:38.556034 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 297/582] 10.222.0.99 () {60 vars in 1258 bytes} [Sat Aug 27 02:29:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-159140529 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:38.560335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-36520e89-220a-4ff9-85b6-118a420bce67 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:38.570807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-36520e89-220a-4ff9-85b6-118a420bce67 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:38.597952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36520e89-220a-4ff9-85b6-118a420bce67 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:38.604147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36520e89-220a-4ff9-85b6-118a420bce67 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:38.609163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36520e89-220a-4ff9-85b6-118a420bce67 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:38.610474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36520e89-220a-4ff9-85b6-118a420bce67 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:38.613952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36520e89-220a-4ff9-85b6-118a420bce67 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:38.615118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36520e89-220a-4ff9-85b6-118a420bce67 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:39.012391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-36520e89-220a-4ff9-85b6-118a420bce67 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:39.023275 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-36520e89-220a-4ff9-85b6-118a420bce67 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1318 microversion: 2.1 time: 0.473288 Aug 27 02:29:39.024668 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 298/583] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:38 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:39.042107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:39.047609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:39.056104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:39.057001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:39.058089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:39.059421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:39.060176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:39.061815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:39.077481 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f82d5913-ffae-4b55-88ef-4cb8f8768648 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1614 microversion: 2.1 time: 1.768240 Aug 27 02:29:39.099528 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 286/584] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:37 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1614 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:39.105825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d29ceded-ed73-4699-9aaa-2bcf725d04d3 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2abece50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1590924524", "description": "tempest-description-741513686"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:39.371405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:39.404215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:39.410216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:39.444002 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec2bfcb9-4b9e-4f58-be0a-058a39cf5c7f tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.418049 Aug 27 02:29:39.444914 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 299/585] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:39 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:39.450904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0643bb45-5274-48fc-b249-ea6a39ad855f tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Action: 'create', calling method: .version_select at 0x7f4d2a90a820>, body: {"keypair": {"name": "tempest-keypair-2057232476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUysEd8bELtYo3XW1fkiD9ccHsQriru7ciNxgZZU2mlWIN3CyHw4ly879+4DEm2s3/5Xwhil2HuZAzzl+UrGSibINyDs61/rq1mFf1mobALuX15JlPNgd59imx2vscAKA=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:39.487119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-0643bb45-5274-48fc-b249-ea6a39ad855f tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:39.495578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-0643bb45-5274-48fc-b249-ea6a39ad855f tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for user 4aefbc2f180c4db8ba96e56cde133d49 and project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:39.546403 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0643bb45-5274-48fc-b249-ea6a39ad855f tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.100087 Aug 27 02:29:39.547797 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 300/586] 10.222.0.99 () {62 vars in 1199 bytes} [Sat Aug 27 02:29:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:29:39.554735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:39.559011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:39.590390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:39.591180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:39.594952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:39.602737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:39.608652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:39.609641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:39.958912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3b495fa3d17c4dfab48a2985eba66e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7c703be30d4f2394eb3b429d960c4a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:39.961846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] flavor_id is None. Assuming migration. {{(pid=122488) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 02:29:39.962516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122488) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 02:29:40.466988 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-851925e9-a9d8-4a8f-98a5-0929974719cd tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c/action" status: 202 len: 0 microversion: 2.1 time: 0.916061 Aug 27 02:29:40.468027 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 301/587] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:29:39 2022] POST /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c/action => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:29:40.481775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b96da83e-ed57-476e-94b6-51f9f9c200c6 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2a87edc0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:40.533501 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b96da83e-ed57-476e-94b6-51f9f9c200c6 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057232476" status: 204 len: 0 microversion: 2.2 time: 0.059674 Aug 27 02:29:40.537863 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 302/588] 10.222.0.99 () {60 vars in 1261 bytes} [Sat Aug 27 02:29:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057232476 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:40.557107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-03c514d6-cad0-4b03-af71-7a023f9d04dd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:40.558875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-03c514d6-cad0-4b03-af71-7a023f9d04dd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:40.587726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03c514d6-cad0-4b03-af71-7a023f9d04dd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:40.588253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03c514d6-cad0-4b03-af71-7a023f9d04dd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:40.588710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03c514d6-cad0-4b03-af71-7a023f9d04dd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:40.589482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03c514d6-cad0-4b03-af71-7a023f9d04dd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:40.606303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03c514d6-cad0-4b03-af71-7a023f9d04dd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:40.607911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03c514d6-cad0-4b03-af71-7a023f9d04dd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:40.943794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-03c514d6-cad0-4b03-af71-7a023f9d04dd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:40.976486 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-03c514d6-cad0-4b03-af71-7a023f9d04dd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1318 microversion: 2.1 time: 0.428535 Aug 27 02:29:40.979018 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 303/589] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:40 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:40.990741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-face80c9-c968-4ead-b9a1-be5426d9a160 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:40.991950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-face80c9-c968-4ead-b9a1-be5426d9a160 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:41.000616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-face80c9-c968-4ead-b9a1-be5426d9a160 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:41.002524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-face80c9-c968-4ead-b9a1-be5426d9a160 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:41.003894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-face80c9-c968-4ead-b9a1-be5426d9a160 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:41.004823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-face80c9-c968-4ead-b9a1-be5426d9a160 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:41.006063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-face80c9-c968-4ead-b9a1-be5426d9a160 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:41.006706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-face80c9-c968-4ead-b9a1-be5426d9a160 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:41.252569 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d29ceded-ed73-4699-9aaa-2bcf725d04d3 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.150951 Aug 27 02:29:41.253738 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 287/590] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:29:39 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:41.259740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:41.260362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:41.269940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-face80c9-c968-4ead-b9a1-be5426d9a160 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:41.275537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:41.276041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:41.276481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:41.277205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:41.281984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:41.282556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:41.284095 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-face80c9-c968-4ead-b9a1-be5426d9a160 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1472 microversion: 2.1 time: 0.303580 Aug 27 02:29:41.285090 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 304/591] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:40 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:41.324472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13ab1d1c-018e-48bf-8b5c-bfcb852740a6 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Action: 'create', calling method: .version_select at 0x7f4d2abaf280>, body: {"keypair": {"name": "tempest-keypair-1521607718", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:41.369272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-13ab1d1c-018e-48bf-8b5c-bfcb852740a6 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:41.382049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-13ab1d1c-018e-48bf-8b5c-bfcb852740a6 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for user 4aefbc2f180c4db8ba96e56cde133d49 and project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:41.443854 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13ab1d1c-018e-48bf-8b5c-bfcb852740a6 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.126835 Aug 27 02:29:41.444510 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 305/592] 10.222.0.99 () {62 vars in 1199 bytes} [Sat Aug 27 02:29:41 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:29:41.555803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:41.601710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:41.605036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:41.611494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1331143645", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "3ec55c3c-afd2-4f05-a860-cb16776212fe"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:41.623859 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-895fe0a6-19d3-452f-9655-4da34132c2f6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.368603 Aug 27 02:29:41.624817 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 288/593] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:41 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:41.642332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-cb2edfc3-3164-4b8d-8d63-e6df3429fb59 req-170bb93b-d8e1-4bf7-9cdc-cc1b952ad3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be54d10-5487-46c1-84a4-2d3fb9ba8df3", "tag": "8f25f23c-a66c-4101-b753-a48b579d6cd2"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:41.686697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cb2edfc3-3164-4b8d-8d63-e6df3429fb59 req-170bb93b-d8e1-4bf7-9cdc-cc1b952ad3ee service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:41.691928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cb2edfc3-3164-4b8d-8d63-e6df3429fb59 req-170bb93b-d8e1-4bf7-9cdc-cc1b952ad3ee service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:41.692715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cb2edfc3-3164-4b8d-8d63-e6df3429fb59 req-170bb93b-d8e1-4bf7-9cdc-cc1b952ad3ee service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:41.718539 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-cb2edfc3-3164-4b8d-8d63-e6df3429fb59 req-170bb93b-d8e1-4bf7-9cdc-cc1b952ad3ee service nova] Creating event network-changed:8f25f23c-a66c-4101-b753-a48b579d6cd2 for instance 0be54d10-5487-46c1-84a4-2d3fb9ba8df3 on n-h1-852084-5 Aug 27 02:29:41.726739 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-cb2edfc3-3164-4b8d-8d63-e6df3429fb59 req-170bb93b-d8e1-4bf7-9cdc-cc1b952ad3ee service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100381 Aug 27 02:29:41.729055 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 289/594] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:41.737773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-812f6f1b-5835-4c8c-93f3-bf6b13ddb395 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2ac4f9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1994725042", "description": "tempest-description-535185749"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:41.776236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] validate_networks() for [('3ec55c3c-afd2-4f05-a860-cb16776212fe', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:29:42.666159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:29:42.667087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:29:42.667267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:29:42.667536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:29:42.668143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:29:42.688634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:42.691745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:42.693248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:42.694522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:42.696489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:42.697119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:42.749527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Getting quotas for project 79f3f9eab5744a87aa391c2a5ced6a49. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:42.762221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Getting quotas for user 39c765a865944064839d4c15de177963 and project 79f3f9eab5744a87aa391c2a5ced6a49. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:42.815329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:29:42.819652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:29:42.976133 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6e02195c-8176-4b7e-ac6f-b22db83fa3a0 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.529899 Aug 27 02:29:42.980485 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 306/595] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:29:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:29:42.997271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f62d7110-5d4f-466b-8542-60d669025fa0 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2a7e5ee0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:43.070784 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f62d7110-5d4f-466b-8542-60d669025fa0 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521607718" status: 204 len: 0 microversion: 2.2 time: 0.085618 Aug 27 02:29:43.075498 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 307/596] 10.222.0.99 () {60 vars in 1261 bytes} [Sat Aug 27 02:29:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521607718 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:43.110819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2af25c84-278c-4b01-9b4b-73ee12b262d5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:43.113426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2af25c84-278c-4b01-9b4b-73ee12b262d5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:43.140707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2af25c84-278c-4b01-9b4b-73ee12b262d5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:43.146297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2af25c84-278c-4b01-9b4b-73ee12b262d5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:43.148811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2af25c84-278c-4b01-9b4b-73ee12b262d5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:43.152034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2af25c84-278c-4b01-9b4b-73ee12b262d5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:43.162033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2af25c84-278c-4b01-9b4b-73ee12b262d5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:43.163429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2af25c84-278c-4b01-9b4b-73ee12b262d5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:43.885814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2af25c84-278c-4b01-9b4b-73ee12b262d5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:43.899196 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2af25c84-278c-4b01-9b4b-73ee12b262d5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1318 microversion: 2.1 time: 0.818300 Aug 27 02:29:43.911970 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-812f6f1b-5835-4c8c-93f3-bf6b13ddb395 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.179608 Aug 27 02:29:43.913338 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 290/597] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:29:41 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:43.914440 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 308/598] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:43 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1318 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:43.926317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:43.927810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-24be0799-c59d-4ddd-9c78-b6bca8315881 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:43.928838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-24be0799-c59d-4ddd-9c78-b6bca8315881 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:43.931152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:43.941608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:43.943250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24be0799-c59d-4ddd-9c78-b6bca8315881 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:43.945998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24be0799-c59d-4ddd-9c78-b6bca8315881 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:43.946381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:43.946521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24be0799-c59d-4ddd-9c78-b6bca8315881 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:43.947112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:43.947244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24be0799-c59d-4ddd-9c78-b6bca8315881 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:43.947728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24be0799-c59d-4ddd-9c78-b6bca8315881 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:43.948173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24be0799-c59d-4ddd-9c78-b6bca8315881 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:43.948780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:43.951601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:43.954507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:44.108662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:44.119454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:44.121406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:44.128468 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-701b8f6d-8a7b-4133-a6a1-6e2f976ea0ed tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.212824 Aug 27 02:29:44.129073 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 309/599] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:43 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:44.170329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-759d77cc-954a-456d-97c1-a74658c6d048 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:44.171847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-759d77cc-954a-456d-97c1-a74658c6d048 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:44.323072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-759d77cc-954a-456d-97c1-a74658c6d048 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:44.335918 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-759d77cc-954a-456d-97c1-a74658c6d048 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1216 microversion: 2.1 time: 0.205213 Aug 27 02:29:44.340658 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 310/600] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:44 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1216 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:44.347482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-877aacc8-f1b5-476e-bc0b-f68fd9ed86c5 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Action: 'create', calling method: .version_select at 0x7f4d2a90ad30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-272955113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWV9ZL4hXkhMvQ3c4h8Vx/KrtUehz/2xjQF8D6NzklTYogSOrZHDd/8pirOlC96l3EVPxscz167evvTj4GdEXyj3s/Jb33H3bBoCOpbukFezn513MtD5o5fwbP/z40vGA=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:44.374947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-877aacc8-f1b5-476e-bc0b-f68fd9ed86c5 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:44.387541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-877aacc8-f1b5-476e-bc0b-f68fd9ed86c5 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for user 4aefbc2f180c4db8ba96e56cde133d49 and project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:44.447006 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-877aacc8-f1b5-476e-bc0b-f68fd9ed86c5 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.101215 Aug 27 02:29:44.459412 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 311/601] 10.222.0.99 () {62 vars in 1199 bytes} [Sat Aug 27 02:29:44 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:29:44.463556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61beda4a-427a-401c-a5a8-f91670b37225 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:44.464111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-61beda4a-427a-401c-a5a8-f91670b37225 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:44.478859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:44.483477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61beda4a-427a-401c-a5a8-f91670b37225 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:44.484291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61beda4a-427a-401c-a5a8-f91670b37225 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:44.484760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61beda4a-427a-401c-a5a8-f91670b37225 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:44.490663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61beda4a-427a-401c-a5a8-f91670b37225 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:44.490940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61beda4a-427a-401c-a5a8-f91670b37225 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:44.491390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61beda4a-427a-401c-a5a8-f91670b37225 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:44.519191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-24be0799-c59d-4ddd-9c78-b6bca8315881 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:44.545702 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-24be0799-c59d-4ddd-9c78-b6bca8315881 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1472 microversion: 2.1 time: 0.630481 Aug 27 02:29:44.552021 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 291/602] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:43 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1472 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:44.563101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-61beda4a-427a-401c-a5a8-f91670b37225 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:29:44.613855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6276c6d4-2e96-4e99-a52a-8361e96faaaf req-6704d18a-3f00-4941-bd7c-5b7c16c50f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5bde1cf-03b1-4f09-9dba-4c532bd1f856", "tag": "650173ad-927c-49b1-b523-46dfd22aa043"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:44.686551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6276c6d4-2e96-4e99-a52a-8361e96faaaf req-6704d18a-3f00-4941-bd7c-5b7c16c50f1c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:44.688978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6276c6d4-2e96-4e99-a52a-8361e96faaaf req-6704d18a-3f00-4941-bd7c-5b7c16c50f1c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:44.690386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6276c6d4-2e96-4e99-a52a-8361e96faaaf req-6704d18a-3f00-4941-bd7c-5b7c16c50f1c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:44.743223 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6276c6d4-2e96-4e99-a52a-8361e96faaaf req-6704d18a-3f00-4941-bd7c-5b7c16c50f1c service nova] Creating event network-changed:650173ad-927c-49b1-b523-46dfd22aa043 for instance b5bde1cf-03b1-4f09-9dba-4c532bd1f856 on n-h1-852084-5 Aug 27 02:29:44.760632 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6276c6d4-2e96-4e99-a52a-8361e96faaaf req-6704d18a-3f00-4941-bd7c-5b7c16c50f1c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200853 Aug 27 02:29:44.765611 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 292/603] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:44.769322 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61beda4a-427a-401c-a5a8-f91670b37225 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 204 len: 0 microversion: 2.1 time: 0.319099 Aug 27 02:29:44.774360 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 312/604] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:29:44 2022] DELETE /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:44.805435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bc375b44-5b28-410b-9d7e-6e45545be30a tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2addb5e0>, body: {"security_group_rule": {"parent_group_id": "a9bc493b-2bee-47dd-9023-7bcaa5db0eb3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "057d7da8-44f8-4d44-8b0a-2714708375d5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:44.812073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5af3f54e-c4eb-45da-8a6f-28a7953db9b5 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Action: 'create', calling method: .version_select at 0x7f4d2a96b670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1555932988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo7h9Is+o1YM844KYoXKctD4P8b0cJx3O6UXRPtxKgqWAwVSkurH/f84rBMPl8+wtYtFriHkqxDNyIACPrVHdBnRtTmSzKBi1YBPQ4nolHFAmusb0g4i1uxRbiXjlp6Fw=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:44.846670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-5af3f54e-c4eb-45da-8a6f-28a7953db9b5 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:44.855280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-5af3f54e-c4eb-45da-8a6f-28a7953db9b5 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for user 4aefbc2f180c4db8ba96e56cde133d49 and project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:44.895646 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5af3f54e-c4eb-45da-8a6f-28a7953db9b5 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.119549 Aug 27 02:29:44.896663 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 313/605] 10.222.0.99 () {62 vars in 1199 bytes} [Sat Aug 27 02:29:44 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:29:44.952345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7f0bf58-0447-4d0b-a257-14225cc5e270 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:44.960265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d7f0bf58-0447-4d0b-a257-14225cc5e270 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:45.010739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7f0bf58-0447-4d0b-a257-14225cc5e270 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:45.012311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7f0bf58-0447-4d0b-a257-14225cc5e270 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:45.013174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7f0bf58-0447-4d0b-a257-14225cc5e270 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:45.014274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7f0bf58-0447-4d0b-a257-14225cc5e270 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:45.015830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7f0bf58-0447-4d0b-a257-14225cc5e270 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:45.016613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7f0bf58-0447-4d0b-a257-14225cc5e270 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:45.582668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d7f0bf58-0447-4d0b-a257-14225cc5e270 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:45.597047 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d7f0bf58-0447-4d0b-a257-14225cc5e270 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1712 microversion: 2.1 time: 0.698249 Aug 27 02:29:45.597661 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 314/606] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:44 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1712 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:45.616376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a63fab9a-7f37-4aa1-ba57-898f88330331 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Action: 'create', calling method: .version_select at 0x7f4d2a87e790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1775559656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEci7RK+L16eJaXqtiQ4iNnJveJp3BYIQGYZZzYFG2CH1PTLOnnKK1X5tz7Fb/xwwqI8vyUbqQkhJjG17SJzCd7pmwIX+X5Algs3PhFJWtpGwzc80xd+QaCti7ZMR4EWw=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:45.655290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-a63fab9a-7f37-4aa1-ba57-898f88330331 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:45.667297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-a63fab9a-7f37-4aa1-ba57-898f88330331 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for user 4aefbc2f180c4db8ba96e56cde133d49 and project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:45.776393 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a63fab9a-7f37-4aa1-ba57-898f88330331 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.177032 Aug 27 02:29:45.778117 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 315/607] 10.222.0.99 () {62 vars in 1199 bytes} [Sat Aug 27 02:29:45 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:29:45.787676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ac9321e-f318-4a89-b422-8d8c6ac14cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:45.788580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3ac9321e-f318-4a89-b422-8d8c6ac14cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:45.796086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac9321e-f318-4a89-b422-8d8c6ac14cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:45.796588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac9321e-f318-4a89-b422-8d8c6ac14cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:45.797201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac9321e-f318-4a89-b422-8d8c6ac14cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:45.798119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac9321e-f318-4a89-b422-8d8c6ac14cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:45.798594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac9321e-f318-4a89-b422-8d8c6ac14cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:45.799027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac9321e-f318-4a89-b422-8d8c6ac14cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:45.926061 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bc375b44-5b28-410b-9d7e-6e45545be30a tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.157307 Aug 27 02:29:45.928070 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 293/608] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:29:44 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:45.941926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:45.949021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:45.968439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:45.968624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:45.969329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:45.975179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:45.983661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:45.984842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:46.205043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:46.235034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:46.238739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:46.272154 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cb57ee6e-a643-4eb4-a697-eb29446087e9 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1446 microversion: 2.75 time: 0.341769 Aug 27 02:29:46.274022 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 294/609] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:45 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1446 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:46.298305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fc0aa887-057b-4a64-8b9f-2cdf384311db tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:46.299859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fc0aa887-057b-4a64-8b9f-2cdf384311db tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:46.330347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc0aa887-057b-4a64-8b9f-2cdf384311db tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:46.332632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc0aa887-057b-4a64-8b9f-2cdf384311db tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:46.342305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc0aa887-057b-4a64-8b9f-2cdf384311db tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:46.345700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc0aa887-057b-4a64-8b9f-2cdf384311db tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:46.346537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc0aa887-057b-4a64-8b9f-2cdf384311db tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:46.350242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc0aa887-057b-4a64-8b9f-2cdf384311db tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:46.444573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:46.465116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3ac9321e-f318-4a89-b422-8d8c6ac14cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:46.482646 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ac9321e-f318-4a89-b422-8d8c6ac14cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1318 microversion: 2.1 time: 0.702560 Aug 27 02:29:46.484629 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 316/610] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:45 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:46.496050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-80d430c2-d3ef-49de-8fb0-456bb1a6c0a0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:46.497635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-80d430c2-d3ef-49de-8fb0-456bb1a6c0a0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:46.512264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80d430c2-d3ef-49de-8fb0-456bb1a6c0a0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:46.513730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80d430c2-d3ef-49de-8fb0-456bb1a6c0a0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:46.515215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80d430c2-d3ef-49de-8fb0-456bb1a6c0a0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:46.517170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80d430c2-d3ef-49de-8fb0-456bb1a6c0a0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:46.518656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80d430c2-d3ef-49de-8fb0-456bb1a6c0a0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:46.519917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80d430c2-d3ef-49de-8fb0-456bb1a6c0a0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:46.565267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fc0aa887-057b-4a64-8b9f-2cdf384311db tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:46.581746 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fc0aa887-057b-4a64-8b9f-2cdf384311db tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1268 microversion: 2.1 time: 0.305288 Aug 27 02:29:46.584263 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 295/611] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:46 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1268 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:46.602765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:46.607478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3e241845-f090-4e16-be6c-b34083bc31eb tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2ab6eee0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:46.626145 n-d-852084-5 devstack@n-api.service[122487]: WARNING oslo_db.sqlalchemy.utils [None req-3e241845-f090-4e16-be6c-b34083bc31eb tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 02:29:46.652130 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3e241845-f090-4e16-be6c-b34083bc31eb tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.065714 Aug 27 02:29:46.653475 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 296/612] 10.222.0.99 () {60 vars in 1177 bytes} [Sat Aug 27 02:29:46 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:46.664315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-53713d62-3d2c-4556-92dd-7a7cd6f40d31 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2ab8d160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-269662712", "description": "tempest-description-160642578"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:46.979483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-80d430c2-d3ef-49de-8fb0-456bb1a6c0a0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:46.995116 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-80d430c2-d3ef-49de-8fb0-456bb1a6c0a0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1472 microversion: 2.1 time: 0.508394 Aug 27 02:29:46.996116 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 317/613] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:46 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1472 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:47.001200 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-53713d62-3d2c-4556-92dd-7a7cd6f40d31 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.345736 Aug 27 02:29:47.011497 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 297/614] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:29:46 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:47.022447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cca36abf-1dcb-4665-8136-3d3f09c1cf54 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2ab81700>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:47.031441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ae819e3-3943-4190-a073-f04e69452e1a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:47.032163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ae819e3-3943-4190-a073-f04e69452e1a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:47.047566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae819e3-3943-4190-a073-f04e69452e1a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:47.049769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae819e3-3943-4190-a073-f04e69452e1a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:47.050701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae819e3-3943-4190-a073-f04e69452e1a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:47.053080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae819e3-3943-4190-a073-f04e69452e1a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:47.053866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae819e3-3943-4190-a073-f04e69452e1a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:47.055676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae819e3-3943-4190-a073-f04e69452e1a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:47.068452 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cca36abf-1dcb-4665-8136-3d3f09c1cf54 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1775559656" status: 204 len: 0 microversion: 2.2 time: 0.051141 Aug 27 02:29:47.069456 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 298/615] 10.222.0.99 () {60 vars in 1321 bytes} [Sat Aug 27 02:29:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1775559656 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:47.084469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8cfd0cc6-388f-4dc6-ba3d-8cc4782d9033 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2ab32160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1980466468", "description": "tempest-description-190194682"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:47.896649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ae819e3-3943-4190-a073-f04e69452e1a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:47.922214 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ae819e3-3943-4190-a073-f04e69452e1a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1712 microversion: 2.1 time: 0.924467 Aug 27 02:29:47.928925 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 318/616] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:46 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1712 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:47.934466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4ac5514-91e5-4780-af25-5730dc34dea7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2a96b280>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:47.984753 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4ac5514-91e5-4780-af25-5730dc34dea7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1555932988" status: 204 len: 0 microversion: 2.2 time: 0.054129 Aug 27 02:29:47.986178 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 319/617] 10.222.0.99 () {60 vars in 1321 bytes} [Sat Aug 27 02:29:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1555932988 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:47.992376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:47.994949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:48.003885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:48.004906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:48.005834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:48.007672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:48.008559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:48.009247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:48.123057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:48.136080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:48.140380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:48.148068 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-19a2bdf8-b543-4b7f-af5e-76e1ecd3d840 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1452 microversion: 2.75 time: 0.160254 Aug 27 02:29:48.149557 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 320/618] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:47 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:48.156312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-65ef2f27-a451-4ddb-ab7d-5ab2ed7e601d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:48.157507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-65ef2f27-a451-4ddb-ab7d-5ab2ed7e601d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:48.176183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65ef2f27-a451-4ddb-ab7d-5ab2ed7e601d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:48.182339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65ef2f27-a451-4ddb-ab7d-5ab2ed7e601d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:48.183269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65ef2f27-a451-4ddb-ab7d-5ab2ed7e601d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:48.184226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65ef2f27-a451-4ddb-ab7d-5ab2ed7e601d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:48.186542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65ef2f27-a451-4ddb-ab7d-5ab2ed7e601d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:48.187302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65ef2f27-a451-4ddb-ab7d-5ab2ed7e601d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:48.930405 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8cfd0cc6-388f-4dc6-ba3d-8cc4782d9033 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.859195 Aug 27 02:29:48.945795 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 299/619] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:29:47 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:48.965767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb32b924-69df-482e-aac9-1fc355364b32 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:48.967804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fb32b924-69df-482e-aac9-1fc355364b32 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:48.992832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb32b924-69df-482e-aac9-1fc355364b32 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:48.998404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb32b924-69df-482e-aac9-1fc355364b32 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:48.999633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb32b924-69df-482e-aac9-1fc355364b32 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:49.006388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb32b924-69df-482e-aac9-1fc355364b32 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:49.013765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb32b924-69df-482e-aac9-1fc355364b32 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:49.014919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb32b924-69df-482e-aac9-1fc355364b32 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:49.283911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-65ef2f27-a451-4ddb-ab7d-5ab2ed7e601d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:49.326215 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-65ef2f27-a451-4ddb-ab7d-5ab2ed7e601d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1318 microversion: 2.1 time: 1.167980 Aug 27 02:29:49.328010 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 321/620] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:48 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1318 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:49.353819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3a691e02-6245-4b53-b21c-a6bec8c054c0 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2aa19670>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:49.426073 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3a691e02-6245-4b53-b21c-a6bec8c054c0 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-272955113" status: 204 len: 0 microversion: 2.2 time: 0.095761 Aug 27 02:29:49.427056 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 322/621] 10.222.0.99 () {60 vars in 1318 bytes} [Sat Aug 27 02:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-272955113 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:49.446004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab7fc65d-b529-4ba9-8da5-54550591ee68 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:49.447748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ab7fc65d-b529-4ba9-8da5-54550591ee68 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:49.459808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7fc65d-b529-4ba9-8da5-54550591ee68 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:49.460951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7fc65d-b529-4ba9-8da5-54550591ee68 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:49.461973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7fc65d-b529-4ba9-8da5-54550591ee68 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:49.463537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7fc65d-b529-4ba9-8da5-54550591ee68 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:49.464725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7fc65d-b529-4ba9-8da5-54550591ee68 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:49.465755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7fc65d-b529-4ba9-8da5-54550591ee68 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:49.678690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fb32b924-69df-482e-aac9-1fc355364b32 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:49.712110 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fb32b924-69df-482e-aac9-1fc355364b32 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1276 microversion: 2.1 time: 0.763133 Aug 27 02:29:49.715248 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 300/622] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:48 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1276 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:49.726719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de183966-f17d-4f94-9f6f-6438d32bce61 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2ab6e5e0>, body: {"security_group_rule": {"parent_group_id": "f26af0d4-e914-410d-8302-b4d7dcc7bd0a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "159f1540-95c0-4972-9bce-7586835f8e99"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:50.129648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ab7fc65d-b529-4ba9-8da5-54550591ee68 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:50.174948 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab7fc65d-b529-4ba9-8da5-54550591ee68 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1472 microversion: 2.1 time: 0.710860 Aug 27 02:29:50.180107 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 323/623] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:49 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1472 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:50.231734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a416d167-eb12-424c-ac67-a5603c3a6a64 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:50.233183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a416d167-eb12-424c-ac67-a5603c3a6a64 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:50.246791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a416d167-eb12-424c-ac67-a5603c3a6a64 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:50.249715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a416d167-eb12-424c-ac67-a5603c3a6a64 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:50.250968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a416d167-eb12-424c-ac67-a5603c3a6a64 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:50.257144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a416d167-eb12-424c-ac67-a5603c3a6a64 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:50.258901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a416d167-eb12-424c-ac67-a5603c3a6a64 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:50.265128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a416d167-eb12-424c-ac67-a5603c3a6a64 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:51.274043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a416d167-eb12-424c-ac67-a5603c3a6a64 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:51.284309 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a416d167-eb12-424c-ac67-a5603c3a6a64 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1712 microversion: 2.1 time: 1.101181 Aug 27 02:29:51.288775 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 324/624] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:50 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1712 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:51.300191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:51.302048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:51.320535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:51.321098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:51.325505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:51.326398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:51.327070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:51.327812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:51.589150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:51.604399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:51.606133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:51.630405 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5eae982a-a0b1-4bf4-b836-ab635ff85480 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1437 microversion: 2.75 time: 0.333373 Aug 27 02:29:51.648208 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 325/625] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:51 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1437 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:51.665333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-55ed4bd6-d800-43ba-b342-ca5ff22f1cec tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Action: 'create', calling method: .version_select at 0x7f4d2a90a940>, body: {"keypair": {"name": "tempest-keypair-2083874269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpcOgi/YO85YodzhYVIksGxeZYTtrz41jUxNn9aameUVyyvN3uYc5UcRZMFtUBjHA77VXVPLEg5Glc3h8wac+NtL128Zr/0pI8K00tx+Nqz0GFCd3F8gkYyF0XSXS0+mQ=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:51.707054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-55ed4bd6-d800-43ba-b342-ca5ff22f1cec tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:51.720772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-55ed4bd6-d800-43ba-b342-ca5ff22f1cec tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for user 4aefbc2f180c4db8ba96e56cde133d49 and project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:51.785161 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-55ed4bd6-d800-43ba-b342-ca5ff22f1cec tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.133822 Aug 27 02:29:51.786440 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 326/626] 10.222.0.99 () {62 vars in 1199 bytes} [Sat Aug 27 02:29:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:29:51.795277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aef04859-89ac-4ca8-a285-c1718045c0c6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:51.795992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aef04859-89ac-4ca8-a285-c1718045c0c6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:51.819302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef04859-89ac-4ca8-a285-c1718045c0c6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:51.819801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef04859-89ac-4ca8-a285-c1718045c0c6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:51.820428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef04859-89ac-4ca8-a285-c1718045c0c6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:51.822378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef04859-89ac-4ca8-a285-c1718045c0c6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:51.822919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef04859-89ac-4ca8-a285-c1718045c0c6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:51.823346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef04859-89ac-4ca8-a285-c1718045c0c6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:52.128205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aef04859-89ac-4ca8-a285-c1718045c0c6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:52.141749 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aef04859-89ac-4ca8-a285-c1718045c0c6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1318 microversion: 2.1 time: 0.351432 Aug 27 02:29:52.143606 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 327/627] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:51 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:52.157487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70df725e-305d-4c86-a9f7-ec03242eda9e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:52.158572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-70df725e-305d-4c86-a9f7-ec03242eda9e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:52.168941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70df725e-305d-4c86-a9f7-ec03242eda9e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:52.172388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70df725e-305d-4c86-a9f7-ec03242eda9e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:52.173069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70df725e-305d-4c86-a9f7-ec03242eda9e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:52.173817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70df725e-305d-4c86-a9f7-ec03242eda9e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:52.174355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70df725e-305d-4c86-a9f7-ec03242eda9e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:52.177233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70df725e-305d-4c86-a9f7-ec03242eda9e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:52.300474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-70df725e-305d-4c86-a9f7-ec03242eda9e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:52.312973 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70df725e-305d-4c86-a9f7-ec03242eda9e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1274 microversion: 2.1 time: 0.167927 Aug 27 02:29:52.313618 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 328/628] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:52 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:52.346395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-96f111a5-186c-49b5-b837-90fbefaae0e8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:52.350855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-96f111a5-186c-49b5-b837-90fbefaae0e8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:52.362786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96f111a5-186c-49b5-b837-90fbefaae0e8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:52.364279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96f111a5-186c-49b5-b837-90fbefaae0e8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:52.365893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96f111a5-186c-49b5-b837-90fbefaae0e8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:52.368336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96f111a5-186c-49b5-b837-90fbefaae0e8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:52.369473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96f111a5-186c-49b5-b837-90fbefaae0e8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:52.370172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96f111a5-186c-49b5-b837-90fbefaae0e8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:52.728759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:52.945276 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de183966-f17d-4f94-9f6f-6438d32bce61 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 3.227399 Aug 27 02:29:52.947313 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 301/629] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:29:49 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 3231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:53.314060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:53.318008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-96f111a5-186c-49b5-b837-90fbefaae0e8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:53.326570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:53.345127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:53.345927 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-96f111a5-186c-49b5-b837-90fbefaae0e8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1477 microversion: 2.1 time: 1.008298 Aug 27 02:29:53.346869 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 329/630] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:52 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1477 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:53.348593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:53.352054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:53.353306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:53.353993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:53.354716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:53.362637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4a81ea0-fc9c-47f3-9e20-ae018198e2f8 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2a72b0d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:53.374259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:53.391558 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b4a81ea0-fc9c-47f3-9e20-ae018198e2f8 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "GET /compute/v2.1/os-keypairs/tempest-keypair-2083874269" status: 200 len: 513 microversion: 2.2 time: 0.043041 Aug 27 02:29:53.395149 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 330/631] 10.222.0.99 () {60 vars in 1258 bytes} [Sat Aug 27 02:29:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2083874269 => generated 513 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:53.407979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f1ae7d21-cb6e-465d-b5f9-bbf3ef20f164 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:53.410681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f1ae7d21-cb6e-465d-b5f9-bbf3ef20f164 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:53.420117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1ae7d21-cb6e-465d-b5f9-bbf3ef20f164 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:53.420966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1ae7d21-cb6e-465d-b5f9-bbf3ef20f164 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:53.421878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1ae7d21-cb6e-465d-b5f9-bbf3ef20f164 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:53.422979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1ae7d21-cb6e-465d-b5f9-bbf3ef20f164 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:53.423671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1ae7d21-cb6e-465d-b5f9-bbf3ef20f164 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:53.424640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1ae7d21-cb6e-465d-b5f9-bbf3ef20f164 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:53.596297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:29:53.597128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:29:53.608708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:29:53.609726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:29:53.610774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:29:53.692391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f1ae7d21-cb6e-465d-b5f9-bbf3ef20f164 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc5a5e997de4edabe7b5883cc998dbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39f8ef6c2bb4281b252ae6827d58655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:53.721813 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f1ae7d21-cb6e-465d-b5f9-bbf3ef20f164 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 200 len: 1645 microversion: 2.1 time: 0.323384 Aug 27 02:29:53.724863 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 331/632] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:53 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 1645 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:53.740982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-defc39e2-06d2-444e-9ab2-b96363cb2512 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Calling method '.version_select at 0x7f4d2abaf160>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:53.903270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:53.925148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:53.928991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:53.932343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:53.939368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:53.941030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:53.944336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:54.248721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:29:54.456981 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f9d88276-ddde-41ca-9995-6acf8d6ae046 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3/action" status: 202 len: 1940 microversion: 2.75 time: 1.506281 Aug 27 02:29:54.458423 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 302/633] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:29:52 2022] POST /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3/action => generated 1940 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 02:29:54.465300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-81c38733-bf69-4de2-aee3-f1fe58df8aa7 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:54.466278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-81c38733-bf69-4de2-aee3-f1fe58df8aa7 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:54.489717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81c38733-bf69-4de2-aee3-f1fe58df8aa7 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:54.490490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81c38733-bf69-4de2-aee3-f1fe58df8aa7 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:54.491056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81c38733-bf69-4de2-aee3-f1fe58df8aa7 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:54.492012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81c38733-bf69-4de2-aee3-f1fe58df8aa7 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:54.497018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81c38733-bf69-4de2-aee3-f1fe58df8aa7 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:54.499304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81c38733-bf69-4de2-aee3-f1fe58df8aa7 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:54.929063 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-defc39e2-06d2-444e-9ab2-b96363cb2512 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/159f1540-95c0-4972-9bce-7586835f8e99" status: 202 len: 0 microversion: 2.1 time: 1.201964 Aug 27 02:29:54.931446 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 332/634] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:29:53 2022] DELETE /compute/v2.1/os-security-groups/159f1540-95c0-4972-9bce-7586835f8e99 => generated 0 bytes in 1205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:29:54.943245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f8fedb5-da64-458b-b7ae-77ceb313fbea tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:54.956014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9f8fedb5-da64-458b-b7ae-77ceb313fbea tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:54.971953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f8fedb5-da64-458b-b7ae-77ceb313fbea tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:54.984766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f8fedb5-da64-458b-b7ae-77ceb313fbea tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:54.985751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f8fedb5-da64-458b-b7ae-77ceb313fbea tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:54.987108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f8fedb5-da64-458b-b7ae-77ceb313fbea tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:54.993908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f8fedb5-da64-458b-b7ae-77ceb313fbea tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:54.994665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f8fedb5-da64-458b-b7ae-77ceb313fbea tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:55.251223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-81c38733-bf69-4de2-aee3-f1fe58df8aa7 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:55.269254 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-81c38733-bf69-4de2-aee3-f1fe58df8aa7 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1318 microversion: 2.1 time: 0.809209 Aug 27 02:29:55.270236 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 303/635] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:54 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1318 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:55.308510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c9abfa8b-9c9c-4b7f-863a-00939987e85e tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2abaf430>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:55.329708 n-d-852084-5 devstack@n-api.service[122487]: WARNING oslo_db.sqlalchemy.utils [None req-c9abfa8b-9c9c-4b7f-863a-00939987e85e tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 02:29:55.350183 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c9abfa8b-9c9c-4b7f-863a-00939987e85e tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.070938 Aug 27 02:29:55.354400 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 304/636] 10.222.0.99 () {60 vars in 1177 bytes} [Sat Aug 27 02:29:55 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:55.371899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0208e4e0-a179-45c2-a354-c316d8689701 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:55.374452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0208e4e0-a179-45c2-a354-c316d8689701 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:55.394142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0208e4e0-a179-45c2-a354-c316d8689701 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:55.396658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0208e4e0-a179-45c2-a354-c316d8689701 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:55.397476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0208e4e0-a179-45c2-a354-c316d8689701 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:55.399792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0208e4e0-a179-45c2-a354-c316d8689701 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:55.401796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0208e4e0-a179-45c2-a354-c316d8689701 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:55.402518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0208e4e0-a179-45c2-a354-c316d8689701 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:55.532737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9f8fedb5-da64-458b-b7ae-77ceb313fbea tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:55.550169 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9f8fedb5-da64-458b-b7ae-77ceb313fbea tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1316 microversion: 2.1 time: 0.616277 Aug 27 02:29:55.554639 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 333/637] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:54 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1316 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:55.573069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2abd6bfd-092b-4fee-89c0-8de8f826fccc tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:55.574491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2abd6bfd-092b-4fee-89c0-8de8f826fccc tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:55.587842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2abd6bfd-092b-4fee-89c0-8de8f826fccc tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:55.591572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2abd6bfd-092b-4fee-89c0-8de8f826fccc tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:55.595434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2abd6bfd-092b-4fee-89c0-8de8f826fccc tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:55.597304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2abd6bfd-092b-4fee-89c0-8de8f826fccc tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:55.599351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2abd6bfd-092b-4fee-89c0-8de8f826fccc tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:55.600772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2abd6bfd-092b-4fee-89c0-8de8f826fccc tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:55.873780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0208e4e0-a179-45c2-a354-c316d8689701 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:55.896287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0208e4e0-a179-45c2-a354-c316d8689701 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1477 microversion: 2.1 time: 0.540003 Aug 27 02:29:55.914001 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 305/638] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:55 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1477 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:55.938888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-aacec527-8ddf-4690-b7eb-a53d77ab3172 req-ab7cb555-ae7f-450e-9a05-0f347c7279c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb", "name": "network-vif-deleted", "tag": "1256ac6f-4abb-48e9-9a89-f4484e0188eb"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:55.966983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-2abd6bfd-092b-4fee-89c0-8de8f826fccc tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:29:55.972994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-aacec527-8ddf-4690-b7eb-a53d77ab3172 req-ab7cb555-ae7f-450e-9a05-0f347c7279c8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:55.977073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-aacec527-8ddf-4690-b7eb-a53d77ab3172 req-ab7cb555-ae7f-450e-9a05-0f347c7279c8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:55.978719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-aacec527-8ddf-4690-b7eb-a53d77ab3172 req-ab7cb555-ae7f-450e-9a05-0f347c7279c8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:56.030547 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-aacec527-8ddf-4690-b7eb-a53d77ab3172 req-ab7cb555-ae7f-450e-9a05-0f347c7279c8 service nova] Creating event network-vif-deleted:1256ac6f-4abb-48e9-9a89-f4484e0188eb for instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb on n-h2-852084-5 Aug 27 02:29:56.043510 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-aacec527-8ddf-4690-b7eb-a53d77ab3172 req-ab7cb555-ae7f-450e-9a05-0f347c7279c8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125718 Aug 27 02:29:56.045009 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 306/639] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:56.064235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:56.065200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:56.084858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:56.085310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:56.092070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:56.093245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:56.094046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:56.094730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:56.149170 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] HTTP exception thrown: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Request method failure captured: Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb HTTP/1.1 Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYD2K2h6ntU4PdBfYyN2zu7XTG-dFv3v_N41Ddwsq2AHguvQj_bSuM5AoNBQbE-vogHRUZ9rLp7mc7lEJGtPJywfkHQFNv6B3Jsub3JdMIaQjP4hda4wSxxmhgAc20PgPubBMA4x__Zyvh6hU_exNS-ZLF9nivyrZj-5Zn_dzIXo1CI Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e39f8ef6c2bb4281b252ae6827d58655"}]}] Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: fcc5a5e997de4edabe7b5883cc998dbf Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'd6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb'} Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:29:56.151039 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:56.155264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:56.155264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:56.155264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:56.155264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:56.155264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:56.155264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:29:56.155264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:29:56.155264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:29:56.155264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:56.155264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Returning 404 to user: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:29:56.155264 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d87f05b7-b738-42a6-812b-75f27f544467 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 404 len: 111 microversion: 2.1 time: 0.108737 Aug 27 02:29:56.162108 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 307/640] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:56 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:29:56.172812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e931f55a-b3f3-4228-8cf3-9da7f7f7db34 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Calling method '.version_select at 0x7f4d2ab320d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:56.237325 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2abd6bfd-092b-4fee-89c0-8de8f826fccc tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.681054 Aug 27 02:29:56.245590 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 334/641] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:55 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:56.256270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5d3645d8-509f-4aa1-9fcb-6d63694c72d9 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2aa19670>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:56.328754 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5d3645d8-509f-4aa1-9fcb-6d63694c72d9 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083874269" status: 204 len: 0 microversion: 2.2 time: 0.081932 Aug 27 02:29:56.329859 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 335/642] 10.222.0.99 () {60 vars in 1261 bytes} [Sat Aug 27 02:29:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083874269 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:56.337510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-545c1649-3bdf-47cb-8bb8-015fb02fb470 req-b2329689-0618-48f9-a4de-63931cc268a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12cf2fef-97c6-4239-b88f-38676c353436", "tag": "75749125-4703-4aed-b9a9-2b580f89bed8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:56.362369 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e931f55a-b3f3-4228-8cf3-9da7f7f7db34 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups/f26af0d4-e914-410d-8302-b4d7dcc7bd0a" status: 200 len: 246 microversion: 2.1 time: 0.198814 Aug 27 02:29:56.363328 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 308/643] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:29:56 2022] GET /compute/v2.1/os-security-groups/f26af0d4-e914-410d-8302-b4d7dcc7bd0a => generated 246 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:56.368739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:56.369243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:56.380742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-545c1649-3bdf-47cb-8bb8-015fb02fb470 req-b2329689-0618-48f9-a4de-63931cc268a9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:56.383390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-545c1649-3bdf-47cb-8bb8-015fb02fb470 req-b2329689-0618-48f9-a4de-63931cc268a9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:56.384912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-545c1649-3bdf-47cb-8bb8-015fb02fb470 req-b2329689-0618-48f9-a4de-63931cc268a9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:56.399046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:56.402927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:56.403388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:56.407764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:56.413727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:56.414593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:56.431264 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-545c1649-3bdf-47cb-8bb8-015fb02fb470 req-b2329689-0618-48f9-a4de-63931cc268a9 service nova] Creating event network-changed:75749125-4703-4aed-b9a9-2b580f89bed8 for instance 12cf2fef-97c6-4239-b88f-38676c353436 on n-h2-852084-5 Aug 27 02:29:56.446824 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-545c1649-3bdf-47cb-8bb8-015fb02fb470 req-b2329689-0618-48f9-a4de-63931cc268a9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115266 Aug 27 02:29:56.455892 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 336/644] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:56.468926 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] HTTP exception thrown: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Request method failure captured: Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 HTTP/1.1 Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYD2K2h6ntU4PdBfYyN2zu7XTG-dFv3v_N41Ddwsq2AHguvQj_bSuM5AoNBQbE-vogHRUZ9rLp7mc7lEJGtPJywfkHQFNv6B3Jsub3JdMIaQjP4hda4wSxxmhgAc20PgPubBMA4x__Zyvh6hU_exNS-ZLF9nivyrZj-5Zn_dzIXo1CI Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e39f8ef6c2bb4281b252ae6827d58655"}]}] Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: fcc5a5e997de4edabe7b5883cc998dbf Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '32472eac-0284-4cff-9e87-1884b0bd6d96'} Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:29:56.470904 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:29:56.476331 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:29:56.476331 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:56.476331 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:56.476331 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:56.476331 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:56.476331 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:56.476331 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:56.476331 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:29:56.476331 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:29:56.476331 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:29:56.476331 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:29:56.479603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Returning 404 to user: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:29:56.480987 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-86bf733f-878d-4d8a-a356-5c78ce0ca4b2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "DELETE /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 404 len: 111 microversion: 2.1 time: 0.116504 Aug 27 02:29:56.482627 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 309/645] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:29:56 2022] DELETE /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:29:56.491649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-6ae1821b-bdd2-40b8-8e53-12083ac00cb2 req-bfad54ac-844e-416f-8d3c-ba45482be5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5bde1cf-03b1-4f09-9dba-4c532bd1f856", "name": "network-vif-plugged", "status": "completed", "tag": "650173ad-927c-49b1-b523-46dfd22aa043"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:56.492646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a5c11cd-2616-4be3-9f27-6de4b06a4b3a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:56.493591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4a5c11cd-2616-4be3-9f27-6de4b06a4b3a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:56.500931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a5c11cd-2616-4be3-9f27-6de4b06a4b3a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:56.501791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a5c11cd-2616-4be3-9f27-6de4b06a4b3a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:56.502433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a5c11cd-2616-4be3-9f27-6de4b06a4b3a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:56.503352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a5c11cd-2616-4be3-9f27-6de4b06a4b3a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:56.503985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a5c11cd-2616-4be3-9f27-6de4b06a4b3a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:56.504574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a5c11cd-2616-4be3-9f27-6de4b06a4b3a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:56.556600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6ae1821b-bdd2-40b8-8e53-12083ac00cb2 req-bfad54ac-844e-416f-8d3c-ba45482be5a5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:56.557458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6ae1821b-bdd2-40b8-8e53-12083ac00cb2 req-bfad54ac-844e-416f-8d3c-ba45482be5a5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:56.562280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6ae1821b-bdd2-40b8-8e53-12083ac00cb2 req-bfad54ac-844e-416f-8d3c-ba45482be5a5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:56.626604 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-6ae1821b-bdd2-40b8-8e53-12083ac00cb2 req-bfad54ac-844e-416f-8d3c-ba45482be5a5 service nova] Creating event network-vif-plugged:650173ad-927c-49b1-b523-46dfd22aa043 for instance b5bde1cf-03b1-4f09-9dba-4c532bd1f856 on n-h1-852084-5 Aug 27 02:29:56.642001 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-6ae1821b-bdd2-40b8-8e53-12083ac00cb2 req-bfad54ac-844e-416f-8d3c-ba45482be5a5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183486 Aug 27 02:29:56.643984 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 337/646] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:56.653537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-952b44d7-2a8e-414e-92fe-f264b1806dc7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Action: 'create', calling method: .version_select at 0x7f4d2a7e5160>, body: {"keypair": {"name": "tempest-keypair-318500818", "type": "x509"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:56.724751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:56.745604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-952b44d7-2a8e-414e-92fe-f264b1806dc7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:56.760196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-952b44d7-2a8e-414e-92fe-f264b1806dc7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for user 4aefbc2f180c4db8ba96e56cde133d49 and project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:56.830629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.processutils [None req-952b44d7-2a8e-414e-92fe-f264b1806dc7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpnl6e1qn0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnl6e1qn0/temp.key -subj /CN=4aefbc2f180c4db8ba96e56cde133d49 -extensions v3_req_client {{(pid=122488) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 02:29:57.115247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.processutils [None req-952b44d7-2a8e-414e-92fe-f264b1806dc7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpnl6e1qn0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnl6e1qn0/temp.key -subj /CN=4aefbc2f180c4db8ba96e56cde133d49 -extensions v3_req_client" returned: 0 in 0.283s {{(pid=122488) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 02:29:57.120057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.processutils [None req-952b44d7-2a8e-414e-92fe-f264b1806dc7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpnl6e1qn0/temp.key -password pass: {{(pid=122488) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 27 02:29:57.178931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.processutils [None req-952b44d7-2a8e-414e-92fe-f264b1806dc7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpnl6e1qn0/temp.key -password pass:" returned: 0 in 0.057s {{(pid=122488) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 27 02:29:57.265413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4a5c11cd-2616-4be3-9f27-6de4b06a4b3a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:57.289531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-952b44d7-2a8e-414e-92fe-f264b1806dc7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:29:57.306177 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4a5c11cd-2616-4be3-9f27-6de4b06a4b3a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1318 microversion: 2.1 time: 0.807393 Aug 27 02:29:57.310750 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 310/647] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:56 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1318 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:57.320381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c0a8c5d8-31a1-43c6-b11f-5457f98ac3c8 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2abaf3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-485824773", "description": "tempest-description-2125303181"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:57.322771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-952b44d7-2a8e-414e-92fe-f264b1806dc7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Getting quotas for user 4aefbc2f180c4db8ba96e56cde133d49 and project d6df5271253747bd8f2cf28535aca1eb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:29:57.351610 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-952b44d7-2a8e-414e-92fe-f264b1806dc7 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.705305 Aug 27 02:29:57.362417 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 338/648] 10.222.0.99 () {62 vars in 1198 bytes} [Sat Aug 27 02:29:56 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 709 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:57.362417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:57.362417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:57.400525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:57.403290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:57.404497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:57.408138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:57.408812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:57.409971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:57.439789 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] HTTP exception thrown: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Request method failure captured: Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 HTTP/1.1 Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYD2K2h6ntU4PdBfYyN2zu7XTG-dFv3v_N41Ddwsq2AHguvQj_bSuM5AoNBQbE-vogHRUZ9rLp7mc7lEJGtPJywfkHQFNv6B3Jsub3JdMIaQjP4hda4wSxxmhgAc20PgPubBMA4x__Zyvh6hU_exNS-ZLF9nivyrZj-5Zn_dzIXo1CI Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e39f8ef6c2bb4281b252ae6827d58655"}]}] Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: fcc5a5e997de4edabe7b5883cc998dbf Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '32472eac-0284-4cff-9e87-1884b0bd6d96'} Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:29:57.442057 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Returning 404 to user: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ecaf50e9-9e98-4dca-a9f2-5beee5f6467b tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 404 len: 111 microversion: 2.1 time: 0.089259 Aug 27 02:29:57.451964 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 339/649] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:57 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:29:57.459538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bb8678ef-6114-4f76-9c81-4175d496e141 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:57.459538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bb8678ef-6114-4f76-9c81-4175d496e141 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:57.470660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8678ef-6114-4f76-9c81-4175d496e141 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:57.471173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8678ef-6114-4f76-9c81-4175d496e141 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:57.471667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8678ef-6114-4f76-9c81-4175d496e141 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:57.472446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8678ef-6114-4f76-9c81-4175d496e141 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:57.472956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8678ef-6114-4f76-9c81-4175d496e141 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:57.473482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8678ef-6114-4f76-9c81-4175d496e141 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:57.797074 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c0a8c5d8-31a1-43c6-b11f-5457f98ac3c8 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.484410 Aug 27 02:29:57.797996 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 311/650] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:29:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:57.802744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b9be556-f6ef-455e-93b4-5ab3f143fe0c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:57.803401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0b9be556-f6ef-455e-93b4-5ab3f143fe0c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:57.814101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9be556-f6ef-455e-93b4-5ab3f143fe0c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:57.815401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9be556-f6ef-455e-93b4-5ab3f143fe0c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:57.817761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9be556-f6ef-455e-93b4-5ab3f143fe0c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:57.819148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9be556-f6ef-455e-93b4-5ab3f143fe0c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:57.820935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9be556-f6ef-455e-93b4-5ab3f143fe0c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:57.822217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9be556-f6ef-455e-93b4-5ab3f143fe0c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:57.829155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb8678ef-6114-4f76-9c81-4175d496e141 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:57.848968 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bb8678ef-6114-4f76-9c81-4175d496e141 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1316 microversion: 2.1 time: 0.397868 Aug 27 02:29:57.857048 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 340/651] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:57 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:57.864788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7e9a5a44-c9c8-4000-a3d4-eaf80dfefb8b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:57.885499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7e9a5a44-c9c8-4000-a3d4-eaf80dfefb8b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:57.912125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e9a5a44-c9c8-4000-a3d4-eaf80dfefb8b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:57.915500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e9a5a44-c9c8-4000-a3d4-eaf80dfefb8b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:57.919146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e9a5a44-c9c8-4000-a3d4-eaf80dfefb8b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:57.922815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e9a5a44-c9c8-4000-a3d4-eaf80dfefb8b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:57.925051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e9a5a44-c9c8-4000-a3d4-eaf80dfefb8b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:57.928069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e9a5a44-c9c8-4000-a3d4-eaf80dfefb8b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:58.106174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-7e9a5a44-c9c8-4000-a3d4-eaf80dfefb8b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:29:58.147401 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7e9a5a44-c9c8-4000-a3d4-eaf80dfefb8b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.288682 Aug 27 02:29:58.150243 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 341/652] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:29:57 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:29:58.159197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2b629e58-4a0b-4dc3-90c9-4aeb9d7a0be3 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2a87e430>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:58.193632 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2b629e58-4a0b-4dc3-90c9-4aeb9d7a0be3 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "GET /compute/v2.1/os-keypairs/tempest-keypair-318500818" status: 200 len: 1533 microversion: 2.2 time: 0.040666 Aug 27 02:29:58.194613 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 342/653] 10.222.0.99 () {60 vars in 1255 bytes} [Sat Aug 27 02:29:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-318500818 => generated 1533 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:58.222855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a565f600-623b-40ce-a166-d83d89d93e25 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '.version_select at 0x7f4d2a72baf0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:58.262708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0b9be556-f6ef-455e-93b4-5ab3f143fe0c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:58.289970 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a565f600-623b-40ce-a166-d83d89d93e25 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1481464958" status: 202 len: 0 microversion: 2.1 time: 0.093878 Aug 27 02:29:58.294766 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 343/654] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:29:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1481464958 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:29:58.298643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0b9be556-f6ef-455e-93b4-5ab3f143fe0c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1477 microversion: 2.1 time: 0.499455 Aug 27 02:29:58.308016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a973d949-1721-460c-a1f6-5b1ce04bcca0 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2a6d89d0>, body: {"security_group_rule": {"parent_group_id": "9dd1ab33-2d2f-4d1e-af87-73eab19fdcea", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:58.309338 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 312/655] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:57 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1477 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:58.330037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ad6edcc-bbf7-45dc-9b84-ee0ebf133ce0 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2ab6ee50>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:58.359423 n-d-852084-5 devstack@n-api.service[122487]: WARNING oslo_db.sqlalchemy.utils [None req-8ad6edcc-bbf7-45dc-9b84-ee0ebf133ce0 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 02:29:58.384641 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ad6edcc-bbf7-45dc-9b84-ee0ebf133ce0 tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.069341 Aug 27 02:29:58.401461 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 313/656] 10.222.0.99 () {60 vars in 1177 bytes} [Sat Aug 27 02:29:58 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:58.419609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-87d3484e-e144-4edb-a1cd-ab20b8f5b15e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:58.421057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-87d3484e-e144-4edb-a1cd-ab20b8f5b15e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:29:58.440877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87d3484e-e144-4edb-a1cd-ab20b8f5b15e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:58.449976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87d3484e-e144-4edb-a1cd-ab20b8f5b15e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:58.451300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87d3484e-e144-4edb-a1cd-ab20b8f5b15e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:58.452744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87d3484e-e144-4edb-a1cd-ab20b8f5b15e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:58.453329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87d3484e-e144-4edb-a1cd-ab20b8f5b15e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:58.454155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87d3484e-e144-4edb-a1cd-ab20b8f5b15e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:58.795047 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a973d949-1721-460c-a1f6-5b1ce04bcca0 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.501062 Aug 27 02:29:58.806380 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 344/657] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:29:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:58.812004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c79fd6e9-f93f-4ac0-8097-c17b0c4f86bb tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] Calling method '.version_select at 0x7f4d2a6af3a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:29:59.029225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-87d3484e-e144-4edb-a1cd-ab20b8f5b15e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:29:59.046634 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-87d3484e-e144-4edb-a1cd-ab20b8f5b15e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1318 microversion: 2.1 time: 0.642511 Aug 27 02:29:59.048817 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 314/658] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:29:58 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:29:59.076001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-bdcd6707-25fe-4a30-91d6-c276adf347d2 req-3d4e81d5-2e65-43d1-bf9c-954ae7916319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be54d10-5487-46c1-84a4-2d3fb9ba8df3", "name": "network-vif-plugged", "status": "completed", "tag": "8f25f23c-a66c-4101-b753-a48b579d6cd2"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:59.089729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bdcd6707-25fe-4a30-91d6-c276adf347d2 req-3d4e81d5-2e65-43d1-bf9c-954ae7916319 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:29:59.091099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bdcd6707-25fe-4a30-91d6-c276adf347d2 req-3d4e81d5-2e65-43d1-bf9c-954ae7916319 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:29:59.091749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bdcd6707-25fe-4a30-91d6-c276adf347d2 req-3d4e81d5-2e65-43d1-bf9c-954ae7916319 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:29:59.115142 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-bdcd6707-25fe-4a30-91d6-c276adf347d2 req-3d4e81d5-2e65-43d1-bf9c-954ae7916319 service nova] Creating event network-vif-plugged:8f25f23c-a66c-4101-b753-a48b579d6cd2 for instance 0be54d10-5487-46c1-84a4-2d3fb9ba8df3 on n-h1-852084-5 Aug 27 02:29:59.122675 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-bdcd6707-25fe-4a30-91d6-c276adf347d2 req-3d4e81d5-2e65-43d1-bf9c-954ae7916319 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071544 Aug 27 02:29:59.127537 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 315/659] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:29:59.190394 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c79fd6e9-f93f-4ac0-8097-c17b0c4f86bb tempest-KeyPairsV22TestJSON-1016001607 tempest-KeyPairsV22TestJSON-1016001607-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-318500818" status: 204 len: 0 microversion: 2.2 time: 0.381691 Aug 27 02:29:59.204264 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 345/660] 10.222.0.99 () {60 vars in 1258 bytes} [Sat Aug 27 02:29:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-318500818 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:29:59.220557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-721651b5-c979-497b-b9c2-309e55436e7d tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Action: 'create', calling method: .version_select at 0x7f4d2a6afe50>, body: {"security_group_rule": {"parent_group_id": "9dd1ab33-2d2f-4d1e-af87-73eab19fdcea", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:59.284647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-416268728", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "2b40c531-a24f-40ba-af07-5f55c2696292"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:29:59.429954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] validate_networks() for [('2b40c531-a24f-40ba-af07-5f55c2696292', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:30:00.058046 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-721651b5-c979-497b-b9c2-309e55436e7d tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.849666 Aug 27 02:30:00.060150 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 346/661] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:29:59 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:00.095119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3e6d5a9a-8534-4b88-b803-bbfcf35a0e3c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:00.102018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3e6d5a9a-8534-4b88-b803-bbfcf35a0e3c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:00.182999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e6d5a9a-8534-4b88-b803-bbfcf35a0e3c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:00.184500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e6d5a9a-8534-4b88-b803-bbfcf35a0e3c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:00.207477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e6d5a9a-8534-4b88-b803-bbfcf35a0e3c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:00.212845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e6d5a9a-8534-4b88-b803-bbfcf35a0e3c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:00.225204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e6d5a9a-8534-4b88-b803-bbfcf35a0e3c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:00.227090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e6d5a9a-8534-4b88-b803-bbfcf35a0e3c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:00.355251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:00.962636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3e6d5a9a-8534-4b88-b803-bbfcf35a0e3c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:01.012573 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3e6d5a9a-8534-4b88-b803-bbfcf35a0e3c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1316 microversion: 2.1 time: 0.950003 Aug 27 02:30:01.014200 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 347/662] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:00 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1316 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:01.028429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c63e3309-391c-4330-ae60-f7757df3baad tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:01.031275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c63e3309-391c-4330-ae60-f7757df3baad tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:01.056958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63e3309-391c-4330-ae60-f7757df3baad tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:01.057897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63e3309-391c-4330-ae60-f7757df3baad tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:01.058732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63e3309-391c-4330-ae60-f7757df3baad tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:01.060083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63e3309-391c-4330-ae60-f7757df3baad tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:01.061602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63e3309-391c-4330-ae60-f7757df3baad tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:01.063780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63e3309-391c-4330-ae60-f7757df3baad tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:01.089774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:30:01.091284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:30:01.093450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:30:01.093450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:30:01.093450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:30:01.120987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:01.121848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:01.125370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:01.126839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:01.127905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:01.128321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:01.185486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Getting quotas for project c2ea38ee044d41d3a6ede6ab4806621d. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:01.199002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Getting quotas for user 6dbc0e90bbe94ce49ae09d2408a382c7 and project c2ea38ee044d41d3a6ede6ab4806621d. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:01.226782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:30:01.232552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:30:01.294014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:01.344557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-c63e3309-391c-4330-ae60-f7757df3baad tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:01.395874 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0b8fb079-1030-42b1-83d4-32457c4d6346 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.265683 Aug 27 02:30:01.399639 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 316/663] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:29:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:30:01.410141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c01e60e-93e1-4071-84e8-b31baaf8744e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:01.411251 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c63e3309-391c-4330-ae60-f7757df3baad tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.388899 Aug 27 02:30:01.413270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4c01e60e-93e1-4071-84e8-b31baaf8744e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:01.416712 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 348/664] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:01 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:01.428355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b18bc403-ac5a-4c76-9c04-e4d1f4563acc tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Calling method '.version_select at 0x7f4d2ab71040>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:01.438807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01e60e-93e1-4071-84e8-b31baaf8744e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:01.439675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01e60e-93e1-4071-84e8-b31baaf8744e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:01.442121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01e60e-93e1-4071-84e8-b31baaf8744e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:01.443299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01e60e-93e1-4071-84e8-b31baaf8744e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:01.444047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01e60e-93e1-4071-84e8-b31baaf8744e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:01.444726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01e60e-93e1-4071-84e8-b31baaf8744e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:01.551916 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b18bc403-ac5a-4c76-9c04-e4d1f4563acc tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups/9dd1ab33-2d2f-4d1e-af87-73eab19fdcea" status: 200 len: 664 microversion: 2.1 time: 0.133685 Aug 27 02:30:01.553567 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 349/665] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:30:01 2022] GET /compute/v2.1/os-security-groups/9dd1ab33-2d2f-4d1e-af87-73eab19fdcea => generated 664 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:01.566129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1940b5ef-a594-4e4d-b670-bb0e62f0d57c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:01.567402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1940b5ef-a594-4e4d-b670-bb0e62f0d57c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:01.586121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1940b5ef-a594-4e4d-b670-bb0e62f0d57c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:01.586608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1940b5ef-a594-4e4d-b670-bb0e62f0d57c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:01.591857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1940b5ef-a594-4e4d-b670-bb0e62f0d57c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:01.594477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1940b5ef-a594-4e4d-b670-bb0e62f0d57c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:01.595600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1940b5ef-a594-4e4d-b670-bb0e62f0d57c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:01.596336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1940b5ef-a594-4e4d-b670-bb0e62f0d57c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:01.836896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1940b5ef-a594-4e4d-b670-bb0e62f0d57c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:01.860029 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1940b5ef-a594-4e4d-b670-bb0e62f0d57c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1468 microversion: 2.1 time: 0.305103 Aug 27 02:30:01.861947 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 350/666] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:01 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1468 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:01.877930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-92168270-d6b7-4027-9214-5bb10ba344aa tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:01.904191 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-92168270-d6b7-4027-9214-5bb10ba344aa tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/409630287" status: 202 len: 0 microversion: 2.1 time: 0.040707 Aug 27 02:30:01.904827 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 351/667] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:30:01 2022] DELETE /compute/v2.1/flavors/409630287 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:30:01.913914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3cb548ae-77bc-48ba-9327-0594304f552d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:01.920717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3cb548ae-77bc-48ba-9327-0594304f552d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:01.961257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4c01e60e-93e1-4071-84e8-b31baaf8744e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:01.985218 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4c01e60e-93e1-4071-84e8-b31baaf8744e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1477 microversion: 2.1 time: 0.583275 Aug 27 02:30:01.994706 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 317/668] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:01 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1477 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:02.013848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-af2fd161-dada-4c0a-93f9-2fb9cab89887 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Calling method '.version_select at 0x7f4d2ab8d670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:02.026064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3cb548ae-77bc-48ba-9327-0594304f552d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:02.039823 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3cb548ae-77bc-48ba-9327-0594304f552d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1210 microversion: 2.1 time: 0.129872 Aug 27 02:30:02.054007 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 352/669] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:01 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1210 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:02.060387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37ec885e-a5d2-4ca9-ba0b-b084c108fa3b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:02.061344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-37ec885e-a5d2-4ca9-ba0b-b084c108fa3b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:02.070373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37ec885e-a5d2-4ca9-ba0b-b084c108fa3b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:02.071217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37ec885e-a5d2-4ca9-ba0b-b084c108fa3b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:02.071878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37ec885e-a5d2-4ca9-ba0b-b084c108fa3b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:02.084302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37ec885e-a5d2-4ca9-ba0b-b084c108fa3b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:02.085978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37ec885e-a5d2-4ca9-ba0b-b084c108fa3b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:02.086764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37ec885e-a5d2-4ca9-ba0b-b084c108fa3b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:02.381488 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-af2fd161-dada-4c0a-93f9-2fb9cab89887 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-group-rules/910d15c9-b7f3-481f-ac05-03c8a42f83e1" status: 202 len: 0 microversion: 2.1 time: 0.383361 Aug 27 02:30:02.382630 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 318/670] 10.222.0.99 () {58 vars in 1287 bytes} [Sat Aug 27 02:30:01 2022] DELETE /compute/v2.1/os-security-group-rules/910d15c9-b7f3-481f-ac05-03c8a42f83e1 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:30:02.406054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9099bd82-4ac5-47d6-bb06-0da3888e09a4 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:02.419617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-37ec885e-a5d2-4ca9-ba0b-b084c108fa3b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:02.444469 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-37ec885e-a5d2-4ca9-ba0b-b084c108fa3b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856" status: 200 len: 1468 microversion: 2.1 time: 0.387818 Aug 27 02:30:02.446041 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 353/671] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:02 2022] GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856 => generated 1468 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:02.457985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-856eff3c-9816-46e9-aeb8-474174e3ca99 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:02.459115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-856eff3c-9816-46e9-aeb8-474174e3ca99 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:02.467345 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9099bd82-4ac5-47d6-bb06-0da3888e09a4 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.082618 Aug 27 02:30:02.468461 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 319/672] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:30:02 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:02.481515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-856eff3c-9816-46e9-aeb8-474174e3ca99 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:02.481515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-856eff3c-9816-46e9-aeb8-474174e3ca99 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:02.481515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-856eff3c-9816-46e9-aeb8-474174e3ca99 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:02.483689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-856eff3c-9816-46e9-aeb8-474174e3ca99 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:02.484381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-856eff3c-9816-46e9-aeb8-474174e3ca99 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:02.485051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-856eff3c-9816-46e9-aeb8-474174e3ca99 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:02.512097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68a30b0f-e511-42d9-846b-7a48c2dcabb9 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Calling method '.version_select at 0x7f4d2addb160>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:02.931306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-856eff3c-9816-46e9-aeb8-474174e3ca99 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:02.972845 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-856eff3c-9816-46e9-aeb8-474174e3ca99 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1316 microversion: 2.1 time: 0.524607 Aug 27 02:30:02.974953 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 354/673] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:02 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:02.997844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8fb8e1ae-7732-4f94-a18a-43353d0abfc9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:02.999330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8fb8e1ae-7732-4f94-a18a-43353d0abfc9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:03.004031 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-68a30b0f-e511-42d9-846b-7a48c2dcabb9 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/9dd1ab33-2d2f-4d1e-af87-73eab19fdcea" status: 202 len: 0 microversion: 2.1 time: 0.519252 Aug 27 02:30:03.009295 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 320/674] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:30:02 2022] DELETE /compute/v2.1/os-security-groups/9dd1ab33-2d2f-4d1e-af87-73eab19fdcea => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:30:03.022993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:03.037150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:03.038694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Searching by: {'reservation_id': 'r-nltuyxw9', 'deleted': False, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:30:03.041818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fb8e1ae-7732-4f94-a18a-43353d0abfc9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:03.042598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fb8e1ae-7732-4f94-a18a-43353d0abfc9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:03.044408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fb8e1ae-7732-4f94-a18a-43353d0abfc9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:03.045967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fb8e1ae-7732-4f94-a18a-43353d0abfc9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:03.046705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fb8e1ae-7732-4f94-a18a-43353d0abfc9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:03.047533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fb8e1ae-7732-4f94-a18a-43353d0abfc9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:03.056224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:03.057528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:03.058849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:03.060766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:03.061948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:03.063673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:03.209782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-8fb8e1ae-7732-4f94-a18a-43353d0abfc9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:03.233081 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8fb8e1ae-7732-4f94-a18a-43353d0abfc9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.256670 Aug 27 02:30:03.246338 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 355/675] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:02 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:03.262167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-84ff8a31-ad31-45b9-bab8-07d0efb7148b tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:03.320212 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-84ff8a31-ad31-45b9-bab8-07d0efb7148b tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1367011820" status: 202 len: 0 microversion: 2.1 time: 0.071541 Aug 27 02:30:03.328644 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 356/676] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 02:30:03 2022] DELETE /compute/v2.1/flavors/1367011820 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:30:03.354894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff2c75c1-23bf-4bbf-a8f4-a90d61a1e911 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:03.357715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ff2c75c1-23bf-4bbf-a8f4-a90d61a1e911 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:03.370675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:30:03.376954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2c75c1-23bf-4bbf-a8f4-a90d61a1e911 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:03.378634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2c75c1-23bf-4bbf-a8f4-a90d61a1e911 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:03.379329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2c75c1-23bf-4bbf-a8f4-a90d61a1e911 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:03.380524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2c75c1-23bf-4bbf-a8f4-a90d61a1e911 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:03.381374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2c75c1-23bf-4bbf-a8f4-a90d61a1e911 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:03.382013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2c75c1-23bf-4bbf-a8f4-a90d61a1e911 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:03.607441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:03.623619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ff2c75c1-23bf-4bbf-a8f4-a90d61a1e911 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:03.631028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:03.631880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:03.632621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:03.638435 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff2c75c1-23bf-4bbf-a8f4-a90d61a1e911 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1477 microversion: 2.1 time: 0.302101 Aug 27 02:30:03.639769 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 357/677] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:03 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1477 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:03.646874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33559376-c73f-4bed-a023-3b7e0fcceff6 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Calling method '.version_select at 0x7f4d2a90aca0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:03.672516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG neutronclient.v2_0.client [None req-33559376-c73f-4bed-a023-3b7e0fcceff6 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 159f1540-95c0-4972-9bce-7586835f8e99 does not exist", "detail": ""}} {{(pid=122488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:30:03.673279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.security_group_api [None req-33559376-c73f-4bed-a023-3b7e0fcceff6 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Neutron security group 159f1540-95c0-4972-9bce-7586835f8e99 not found {{(pid=122488) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:30:03.673985 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-33559376-c73f-4bed-a023-3b7e0fcceff6 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] HTTP exception thrown: Security group 159f1540-95c0-4972-9bce-7586835f8e99 does not exist Aug 27 02:30:03.673985 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-08326e0e-7581-4f4f-b174-41b39ef0e2f1'] Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33559376-c73f-4bed-a023-3b7e0fcceff6 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Request method failure captured: Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/os-security-groups/159f1540-95c0-4972-9bce-7586835f8e99 HTTP/1.1 Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYGLw1aM1nwdarwmXrIejrst8LUMDe5PBcfxbbmeBl1tVDGfLJWV4pMrAdD2ooRf3P5eR4b8m9R8YJRPqWaFIu0skIrFb_CRVd2p5zyt-Zsb_3idyjgaPLjd7hmYbe4Tb_O9bYh_-Iu81Y1312h3Sj1qM3uLqo4UUk4ZQ84JcODMzfs Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a053612be213443086e3d91094cff243 Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1758301055 Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a053612be213443086e3d91094cff243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a053612be213443086e3d91094cff243"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a053612be213443086e3d91094cff243"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a053612be213443086e3d91094cff243"}]}] Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1758301055 Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a053612be213443086e3d91094cff243 Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1758301055 Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-SecurityGroupRulesTestJSON-1758301055-project Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 5d3f27d6e6174495b74bd4060d5949e5 Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1758301055-project Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: exception: Security group 159f1540-95c0-4972-9bce-7586835f8e99 does not exist Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-08326e0e-7581-4f4f-b174-41b39ef0e2f1'] Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '159f1540-95c0-4972-9bce-7586835f8e99'} Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:30:03.682831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 159f1540-95c0-4972-9bce-7586835f8e99 does not exist Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08326e0e-7581-4f4f-b174-41b39ef0e2f1'] Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 159f1540-95c0-4972-9bce-7586835f8e99 does not exist Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08326e0e-7581-4f4f-b174-41b39ef0e2f1'] Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 159f1540-95c0-4972-9bce-7586835f8e99 does not exist Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08326e0e-7581-4f4f-b174-41b39ef0e2f1'] Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 159f1540-95c0-4972-9bce-7586835f8e99 does not exist Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08326e0e-7581-4f4f-b174-41b39ef0e2f1'] Aug 27 02:30:03.687375 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:03.690371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33559376-c73f-4bed-a023-3b7e0fcceff6 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Returning 404 to user: Security group 159f1540-95c0-4972-9bce-7586835f8e99 does not exist Aug 27 02:30:03.690371 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-08326e0e-7581-4f4f-b174-41b39ef0e2f1'] {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:03.692484 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-33559376-c73f-4bed-a023-3b7e0fcceff6 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/159f1540-95c0-4972-9bce-7586835f8e99" status: 404 len: 194 microversion: 2.1 time: 0.050998 Aug 27 02:30:03.703717 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 358/678] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:30:03 2022] DELETE /compute/v2.1/os-security-groups/159f1540-95c0-4972-9bce-7586835f8e99 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:30:03.713549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e9cdd6e-d6eb-4beb-8de1-0b47081f5d31 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:03.714462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5e9cdd6e-d6eb-4beb-8de1-0b47081f5d31 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:03.729731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9cdd6e-d6eb-4beb-8de1-0b47081f5d31 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:03.730802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9cdd6e-d6eb-4beb-8de1-0b47081f5d31 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:03.731806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9cdd6e-d6eb-4beb-8de1-0b47081f5d31 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:03.733132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9cdd6e-d6eb-4beb-8de1-0b47081f5d31 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:03.733757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9cdd6e-d6eb-4beb-8de1-0b47081f5d31 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:03.734295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9cdd6e-d6eb-4beb-8de1-0b47081f5d31 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:03.919530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5e9cdd6e-d6eb-4beb-8de1-0b47081f5d31 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:03.941245 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e9cdd6e-d6eb-4beb-8de1-0b47081f5d31 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1262 microversion: 2.1 time: 0.234882 Aug 27 02:30:03.944208 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 359/679] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:03 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1262 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:03.960953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6525a4fa-4097-49d5-8d5b-242568acdb24 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:03.978179 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-047b366f-c00c-4fe3-ab99-815bea51a0bf tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/detail?reservation_id=r-nltuyxw9" status: 200 len: 2929 microversion: 2.1 time: 0.965839 Aug 27 02:30:03.979168 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 321/680] 10.222.0.99 () {58 vars in 1197 bytes} [Sat Aug 27 02:30:03 2022] GET /compute/v2.1/servers/detail?reservation_id=r-nltuyxw9 => generated 2929 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:04.002596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c6331b52-1667-4f71-84da-43b8f2f11620 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Calling method '.version_select at 0x7f4d2ac3c0d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:04.018342 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6525a4fa-4097-49d5-8d5b-242568acdb24 tempest-ServersWithSpecificFlavorTestJSON-1851528373 tempest-ServersWithSpecificFlavorTestJSON-1851528373-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070495 Aug 27 02:30:04.019627 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 360/681] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:30:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:04.024999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bbe301ae-469e-4355-8527-8ae161f7e278 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:04.085516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.compute.server_groups [None req-bbe301ae-469e-4355-8527-8ae161f7e278 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Querying cell 8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) for 2 instances {{(pid=122488) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 02:30:04.092844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbe301ae-469e-4355-8527-8ae161f7e278 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:04.093850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbe301ae-469e-4355-8527-8ae161f7e278 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:04.094593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbe301ae-469e-4355-8527-8ae161f7e278 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:04.178072 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bbe301ae-469e-4355-8527-8ae161f7e278 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/os-server-groups/742b6e09-f3eb-4047-9fda-820009b703db" status: 200 len: 265 microversion: 2.1 time: 0.156650 Aug 27 02:30:04.179276 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 361/682] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:30:04 2022] GET /compute/v2.1/os-server-groups/742b6e09-f3eb-4047-9fda-820009b703db => generated 265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:04.184417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bcf03aa9-a6ba-4705-b77d-25846bedc9fc tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:04.185060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bcf03aa9-a6ba-4705-b77d-25846bedc9fc tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:04.192415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf03aa9-a6ba-4705-b77d-25846bedc9fc tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:04.193331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf03aa9-a6ba-4705-b77d-25846bedc9fc tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:04.194563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf03aa9-a6ba-4705-b77d-25846bedc9fc tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:04.195824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf03aa9-a6ba-4705-b77d-25846bedc9fc tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:04.197228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf03aa9-a6ba-4705-b77d-25846bedc9fc tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:04.198451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf03aa9-a6ba-4705-b77d-25846bedc9fc tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:04.512746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bcf03aa9-a6ba-4705-b77d-25846bedc9fc tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:04.534924 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bcf03aa9-a6ba-4705-b77d-25846bedc9fc tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1316 microversion: 2.1 time: 0.353968 Aug 27 02:30:04.536275 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 362/683] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:04 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:04.551512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:04.551512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:04.563293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:04.564496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:04.565289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:04.566254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:04.568236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:04.568789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:04.600065 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] HTTP exception thrown: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Request method failure captured: Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb HTTP/1.1 Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYD2K2h6ntU4PdBfYyN2zu7XTG-dFv3v_N41Ddwsq2AHguvQj_bSuM5AoNBQbE-vogHRUZ9rLp7mc7lEJGtPJywfkHQFNv6B3Jsub3JdMIaQjP4hda4wSxxmhgAc20PgPubBMA4x__Zyvh6hU_exNS-ZLF9nivyrZj-5Zn_dzIXo1CI Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e39f8ef6c2bb4281b252ae6827d58655"}]}] Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: fcc5a5e997de4edabe7b5883cc998dbf Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb'} Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:04.603327 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Returning 404 to user: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5c84d456-9ab4-485d-9c16-e3c1ce56215a tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 404 len: 111 microversion: 2.1 time: 0.068589 Aug 27 02:30:04.617967 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 363/684] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:30:04 2022] DELETE /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:30:04.620654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-af2cfc2f-6c8f-4f68-8868-b384b4de6166 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:04.620654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-af2cfc2f-6c8f-4f68-8868-b384b4de6166 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:04.628224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af2cfc2f-6c8f-4f68-8868-b384b4de6166 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:04.629357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af2cfc2f-6c8f-4f68-8868-b384b4de6166 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:04.629357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af2cfc2f-6c8f-4f68-8868-b384b4de6166 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:04.631146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af2cfc2f-6c8f-4f68-8868-b384b4de6166 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:04.631719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af2cfc2f-6c8f-4f68-8868-b384b4de6166 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:04.632238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af2cfc2f-6c8f-4f68-8868-b384b4de6166 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:04.929237 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-af2cfc2f-6c8f-4f68-8868-b384b4de6166 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 200 len: 1619 microversion: 2.1 time: 0.316903 Aug 27 02:30:04.936674 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 364/685] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:04 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 1619 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:04.953649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6df9e842-18de-4dc6-afe2-bffbb567e9c2 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:04.959658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6df9e842-18de-4dc6-afe2-bffbb567e9c2 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:04.987204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df9e842-18de-4dc6-afe2-bffbb567e9c2 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:04.993826 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c6331b52-1667-4f71-84da-43b8f2f11620 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/f26af0d4-e914-410d-8302-b4d7dcc7bd0a" status: 202 len: 0 microversion: 2.1 time: 0.997114 Aug 27 02:30:04.997052 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 322/686] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:30:03 2022] DELETE /compute/v2.1/os-security-groups/f26af0d4-e914-410d-8302-b4d7dcc7bd0a => generated 0 bytes in 1016 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:30:05.005605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df9e842-18de-4dc6-afe2-bffbb567e9c2 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:05.008549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df9e842-18de-4dc6-afe2-bffbb567e9c2 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:05.010803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df9e842-18de-4dc6-afe2-bffbb567e9c2 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:05.012168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df9e842-18de-4dc6-afe2-bffbb567e9c2 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:05.012397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-49cb6222-e95f-4437-9c07-35d94ec2bc6a req-db26377f-fe0e-4424-8e9c-72eb79987739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12cf2fef-97c6-4239-b88f-38676c353436", "name": "network-vif-plugged", "status": "completed", "tag": "75749125-4703-4aed-b9a9-2b580f89bed8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:05.014686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df9e842-18de-4dc6-afe2-bffbb567e9c2 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:05.036173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-49cb6222-e95f-4437-9c07-35d94ec2bc6a req-db26377f-fe0e-4424-8e9c-72eb79987739 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:05.036771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-49cb6222-e95f-4437-9c07-35d94ec2bc6a req-db26377f-fe0e-4424-8e9c-72eb79987739 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:05.039073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-49cb6222-e95f-4437-9c07-35d94ec2bc6a req-db26377f-fe0e-4424-8e9c-72eb79987739 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:05.063777 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-49cb6222-e95f-4437-9c07-35d94ec2bc6a req-db26377f-fe0e-4424-8e9c-72eb79987739 service nova] Creating event network-vif-plugged:75749125-4703-4aed-b9a9-2b580f89bed8 for instance 12cf2fef-97c6-4239-b88f-38676c353436 on n-h2-852084-5 Aug 27 02:30:05.084132 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-49cb6222-e95f-4437-9c07-35d94ec2bc6a req-db26377f-fe0e-4424-8e9c-72eb79987739 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084743 Aug 27 02:30:05.084916 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 323/687] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:05.090680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:05.091775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:05.105995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:05.117619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:05.118287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:05.119169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:05.119754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:05.120296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:05.148714 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] HTTP exception thrown: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Request method failure captured: Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb HTTP/1.1 Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYD2K2h6ntU4PdBfYyN2zu7XTG-dFv3v_N41Ddwsq2AHguvQj_bSuM5AoNBQbE-vogHRUZ9rLp7mc7lEJGtPJywfkHQFNv6B3Jsub3JdMIaQjP4hda4wSxxmhgAc20PgPubBMA4x__Zyvh6hU_exNS-ZLF9nivyrZj-5Zn_dzIXo1CI Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e39f8ef6c2bb4281b252ae6827d58655"}]}] Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: fcc5a5e997de4edabe7b5883cc998dbf Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'd6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb'} Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:30:05.150657 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Returning 404 to user: Instance d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c867d62f-0276-4c15-961d-34a3af7527f2 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb" status: 404 len: 111 microversion: 2.1 time: 0.067444 Aug 27 02:30:05.159101 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 324/688] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:05 2022] GET /compute/v2.1/servers/d6dcf8ac-78b2-4ea0-8e9f-7eebf35d0ccb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:30:05.178260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-60b18f65-753c-496b-ad5d-82de872f7f4f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:05.179078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-60b18f65-753c-496b-ad5d-82de872f7f4f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:05.186002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b18f65-753c-496b-ad5d-82de872f7f4f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:05.186901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b18f65-753c-496b-ad5d-82de872f7f4f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:05.187568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b18f65-753c-496b-ad5d-82de872f7f4f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:05.192335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b18f65-753c-496b-ad5d-82de872f7f4f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:05.193207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b18f65-753c-496b-ad5d-82de872f7f4f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:05.193932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b18f65-753c-496b-ad5d-82de872f7f4f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:05.374199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-6df9e842-18de-4dc6-afe2-bffbb567e9c2 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:05.415683 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6df9e842-18de-4dc6-afe2-bffbb567e9c2 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.476447 Aug 27 02:30:05.440670 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 365/689] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:04 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:05.457353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c66bee91-2db3-4991-aa30-406c97ceeecd tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:05.457353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c66bee91-2db3-4991-aa30-406c97ceeecd tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:05.464231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c66bee91-2db3-4991-aa30-406c97ceeecd tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:05.464231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c66bee91-2db3-4991-aa30-406c97ceeecd tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:05.464709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c66bee91-2db3-4991-aa30-406c97ceeecd tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:05.465970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c66bee91-2db3-4991-aa30-406c97ceeecd tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:05.466190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c66bee91-2db3-4991-aa30-406c97ceeecd tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:05.474143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c66bee91-2db3-4991-aa30-406c97ceeecd tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:05.664313 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c66bee91-2db3-4991-aa30-406c97ceeecd tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856" status: 200 len: 1619 microversion: 2.1 time: 0.219315 Aug 27 02:30:05.666782 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 366/690] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:05 2022] GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856 => generated 1619 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:05.674974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1e95dcd3-478a-4b1a-b2e8-a6c205831fab tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:05.675434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1e95dcd3-478a-4b1a-b2e8-a6c205831fab tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:05.687448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e95dcd3-478a-4b1a-b2e8-a6c205831fab tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:05.688464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e95dcd3-478a-4b1a-b2e8-a6c205831fab tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:05.689294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e95dcd3-478a-4b1a-b2e8-a6c205831fab tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:05.690549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e95dcd3-478a-4b1a-b2e8-a6c205831fab tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:05.691436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e95dcd3-478a-4b1a-b2e8-a6c205831fab tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:05.692391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e95dcd3-478a-4b1a-b2e8-a6c205831fab tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:05.788716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1e95dcd3-478a-4b1a-b2e8-a6c205831fab tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:05.799379 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1e95dcd3-478a-4b1a-b2e8-a6c205831fab tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1268 microversion: 2.1 time: 0.131995 Aug 27 02:30:05.800323 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 367/691] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:05 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1268 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:05.806733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6c19de68-7778-4638-b9eb-0545787620d1 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Calling method '.version_select at 0x7f4d2a76e3a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:06.123717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6c19de68-7778-4638-b9eb-0545787620d1 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/057d7da8-44f8-4d44-8b0a-2714708375d5" status: 202 len: 0 microversion: 2.1 time: 0.322080 Aug 27 02:30:06.124810 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 368/692] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:30:05 2022] DELETE /compute/v2.1/os-security-groups/057d7da8-44f8-4d44-8b0a-2714708375d5 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:30:06.147347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60b18f65-753c-496b-ad5d-82de872f7f4f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:06.186241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:06.190295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:06.206513 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-60b18f65-753c-496b-ad5d-82de872f7f4f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1476 microversion: 2.1 time: 1.044784 Aug 27 02:30:06.218581 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 325/693] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:05 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1476 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:06.233416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:06.234332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb910499-1e57-4800-be30-7253fd911b7e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:06.234969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fb910499-1e57-4800-be30-7253fd911b7e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:06.237253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:06.241129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:06.243067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:06.244313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:06.245764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:06.253416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb910499-1e57-4800-be30-7253fd911b7e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:06.253936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb910499-1e57-4800-be30-7253fd911b7e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:06.254407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb910499-1e57-4800-be30-7253fd911b7e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:06.255125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb910499-1e57-4800-be30-7253fd911b7e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:06.255708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb910499-1e57-4800-be30-7253fd911b7e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:06.255981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb910499-1e57-4800-be30-7253fd911b7e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:06.316065 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] HTTP exception thrown: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Request method failure captured: Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 HTTP/1.1 Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYD2K2h6ntU4PdBfYyN2zu7XTG-dFv3v_N41Ddwsq2AHguvQj_bSuM5AoNBQbE-vogHRUZ9rLp7mc7lEJGtPJywfkHQFNv6B3Jsub3JdMIaQjP4hda4wSxxmhgAc20PgPubBMA4x__Zyvh6hU_exNS-ZLF9nivyrZj-5Zn_dzIXo1CI Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e39f8ef6c2bb4281b252ae6827d58655"}]}] Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: fcc5a5e997de4edabe7b5883cc998dbf Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '32472eac-0284-4cff-9e87-1884b0bd6d96'} Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:06.320360 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Returning 404 to user: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:06.328690 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2d95b363-33d8-43cc-a8a2-1b4612b50920 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "DELETE /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 404 len: 111 microversion: 2.1 time: 0.199713 Aug 27 02:30:06.336813 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 369/694] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:30:06 2022] DELETE /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:30:06.348543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32bde23c-1ca4-415f-9320-16b2e7c209f8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Action: 'create', calling method: .version_select at 0x7f4d2a7e54c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-28328096", "policies": ["anti-affinity"]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:06.365791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1,nova_api:DELETE=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:06.418778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-32bde23c-1ca4-415f-9320-16b2e7c209f8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:06.428525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-32bde23c-1ca4-415f-9320-16b2e7c209f8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:06.534445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-32bde23c-1ca4-415f-9320-16b2e7c209f8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:06.548544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-32bde23c-1ca4-415f-9320-16b2e7c209f8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:06.576611 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-32bde23c-1ca4-415f-9320-16b2e7c209f8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "POST /compute/v2.1/os-server-groups" status: 200 len: 191 microversion: 2.1 time: 0.238048 Aug 27 02:30:06.577399 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 370/695] 10.222.0.99 () {60 vars in 1174 bytes} [Sat Aug 27 02:30:06 2022] POST /compute/v2.1/os-server-groups => generated 191 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:06.583419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-250b64df-e062-4a42-b339-46c40703228b tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Calling method '.version_select at 0x7f4d2a72bb80>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:07.111734 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-250b64df-e062-4a42-b339-46c40703228b tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/a9bc493b-2bee-47dd-9023-7bcaa5db0eb3" status: 202 len: 0 microversion: 2.1 time: 0.533026 Aug 27 02:30:07.112882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fb910499-1e57-4800-be30-7253fd911b7e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:07.113085 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 371/696] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:30:06 2022] DELETE /compute/v2.1/os-security-groups/a9bc493b-2bee-47dd-9023-7bcaa5db0eb3 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:30:07.120242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:07.120908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] [instance: 32472eac-0284-4cff-9e87-1884b0bd6d96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:07.124596 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fb910499-1e57-4800-be30-7253fd911b7e tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1316 microversion: 2.1 time: 0.904685 Aug 27 02:30:07.134180 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 326/697] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:06 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1316 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:07.144578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:07.145547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:07.147053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:07.148110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:07.148403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:07.148861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:07.150530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-52a7ea12-04aa-494c-aa31-c6cc98e7ede9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:07.156331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-52a7ea12-04aa-494c-aa31-c6cc98e7ede9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:07.172598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52a7ea12-04aa-494c-aa31-c6cc98e7ede9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:07.173140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52a7ea12-04aa-494c-aa31-c6cc98e7ede9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:07.176429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52a7ea12-04aa-494c-aa31-c6cc98e7ede9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:07.176429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52a7ea12-04aa-494c-aa31-c6cc98e7ede9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:07.176994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52a7ea12-04aa-494c-aa31-c6cc98e7ede9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:07.177436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52a7ea12-04aa-494c-aa31-c6cc98e7ede9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:07.187907 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] HTTP exception thrown: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Request method failure captured: Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 HTTP/1.1 Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYD2K2h6ntU4PdBfYyN2zu7XTG-dFv3v_N41Ddwsq2AHguvQj_bSuM5AoNBQbE-vogHRUZ9rLp7mc7lEJGtPJywfkHQFNv6B3Jsub3JdMIaQjP4hda4wSxxmhgAc20PgPubBMA4x__Zyvh6hU_exNS-ZLF9nivyrZj-5Zn_dzIXo1CI Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e39f8ef6c2bb4281b252ae6827d58655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e39f8ef6c2bb4281b252ae6827d58655"}]}] Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: e39f8ef6c2bb4281b252ae6827d58655 Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805 Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: fcc5a5e997de4edabe7b5883cc998dbf Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1459034805-project Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '32472eac-0284-4cff-9e87-1884b0bd6d96'} Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:30:07.197632 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:07.201210 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:07.201210 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:07.201210 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:07.201210 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:07.201210 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:07.201210 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:07.201210 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:07.201210 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. Aug 27 02:30:07.201210 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:07.201210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] Returning 404 to user: Instance 32472eac-0284-4cff-9e87-1884b0bd6d96 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:07.201210 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b19d921e-ccc7-40c6-bc13-2d815c93fcd6 tempest-ServersWithSpecificFlavorTestJSON-1459034805 tempest-ServersWithSpecificFlavorTestJSON-1459034805-project] 10.222.0.99 "GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96" status: 404 len: 111 microversion: 2.1 time: 0.085696 Aug 27 02:30:07.203947 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 372/698] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:07 2022] GET /compute/v2.1/servers/32472eac-0284-4cff-9e87-1884b0bd6d96 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:30:07.210010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-192444d5-327f-4aa6-b166-2ceb1d4bd702 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:07.210654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-192444d5-327f-4aa6-b166-2ceb1d4bd702 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:07.248963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-192444d5-327f-4aa6-b166-2ceb1d4bd702 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:07.249772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-192444d5-327f-4aa6-b166-2ceb1d4bd702 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:07.250412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-192444d5-327f-4aa6-b166-2ceb1d4bd702 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:07.251337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-192444d5-327f-4aa6-b166-2ceb1d4bd702 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:07.252649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-192444d5-327f-4aa6-b166-2ceb1d4bd702 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:07.253287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-192444d5-327f-4aa6-b166-2ceb1d4bd702 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:07.414273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-52a7ea12-04aa-494c-aa31-c6cc98e7ede9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:07.424965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:07.484991 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-52a7ea12-04aa-494c-aa31-c6cc98e7ede9 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.348212 Aug 27 02:30:07.489570 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 327/699] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:07 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:07.508147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-664517085", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c9136a8f-16ae-4a04-9612-afce26a32373"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:07.616028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:30:07.896280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-192444d5-327f-4aa6-b166-2ceb1d4bd702 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:07.927242 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-192444d5-327f-4aa6-b166-2ceb1d4bd702 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1310 microversion: 2.1 time: 0.721664 Aug 27 02:30:07.929337 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 373/700] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:07 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1310 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:07.939565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-75d6d6f9-c71e-49b7-bc85-d2012ab35370 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Calling method '.version_select at 0x7f4d2a76e3a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:08.742744 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-75d6d6f9-c71e-49b7-bc85-d2012ab35370 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/1610fab1-bf2e-4dd1-be8b-c0e49bf53913" status: 202 len: 0 microversion: 2.1 time: 0.806354 Aug 27 02:30:08.747335 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 374/701] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:30:07 2022] DELETE /compute/v2.1/os-security-groups/1610fab1-bf2e-4dd1-be8b-c0e49bf53913 => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:30:08.765833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fe49a4c4-a837-4a58-966a-67405a5c1003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:08.768718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fe49a4c4-a837-4a58-966a-67405a5c1003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:08.784913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe49a4c4-a837-4a58-966a-67405a5c1003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:08.786292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe49a4c4-a837-4a58-966a-67405a5c1003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:08.788581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe49a4c4-a837-4a58-966a-67405a5c1003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:08.790911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe49a4c4-a837-4a58-966a-67405a5c1003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:08.794967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe49a4c4-a837-4a58-966a-67405a5c1003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:08.801743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe49a4c4-a837-4a58-966a-67405a5c1003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:08.861093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:08.944999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:30:08.946101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:30:08.947018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:30:08.947640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:30:08.948107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:30:08.990586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:08.991369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:08.991996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:08.992951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:08.993577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:08.994277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:09.018740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:09.031565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:09.070201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Going to run 2 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:30:09.079392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 5fb58870-9a8e-4554-9db9-3324b90798bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:30:09.189333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122487) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 27 02:30:09.250991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:09.265418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:09.341806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe49a4c4-a837-4a58-966a-67405a5c1003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:09.369617 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fe49a4c4-a837-4a58-966a-67405a5c1003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1476 microversion: 2.1 time: 0.619944 Aug 27 02:30:09.385713 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 375/702] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:08 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1476 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:09.406157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d9844967-c815-4987-8bbd-2ffaab5b7867 req-065fa75c-a0dd-4c98-b313-c0df8a4b64cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6596fe05-cc54-4bf2-8180-4a201ebdad1c", "name": "network-vif-unplugged", "status": "completed", "tag": "89e9571f-0605-4282-a2a4-cad646e275d8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:09.458454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d9844967-c815-4987-8bbd-2ffaab5b7867 req-065fa75c-a0dd-4c98-b313-c0df8a4b64cc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:09.459710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d9844967-c815-4987-8bbd-2ffaab5b7867 req-065fa75c-a0dd-4c98-b313-c0df8a4b64cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:09.460738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d9844967-c815-4987-8bbd-2ffaab5b7867 req-065fa75c-a0dd-4c98-b313-c0df8a4b64cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:09.477786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:09.494999 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d9844967-c815-4987-8bbd-2ffaab5b7867 req-065fa75c-a0dd-4c98-b313-c0df8a4b64cc service nova] Creating event network-vif-unplugged:89e9571f-0605-4282-a2a4-cad646e275d8 for instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c on n-h2-852084-5 Aug 27 02:30:09.496295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:09.519188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-d9844967-c815-4987-8bbd-2ffaab5b7867 req-065fa75c-a0dd-4c98-b313-c0df8a4b64cc service nova] Instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:30:09.527435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=5fb58870-9a8e-4554-9db9-3324b90798bd,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:30:09.547841 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d9844967-c815-4987-8bbd-2ffaab5b7867 req-065fa75c-a0dd-4c98-b313-c0df8a4b64cc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164501 Aug 27 02:30:09.549744 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 376/703] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:09.560236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-60ac42a4-a5b3-4a9b-abd2-f1efd9212901 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:09.561827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-60ac42a4-a5b3-4a9b-abd2-f1efd9212901 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:09.576981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ac42a4-a5b3-4a9b-abd2-f1efd9212901 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:09.578154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ac42a4-a5b3-4a9b-abd2-f1efd9212901 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:09.579157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ac42a4-a5b3-4a9b-abd2-f1efd9212901 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:09.581006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ac42a4-a5b3-4a9b-abd2-f1efd9212901 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:09.582069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ac42a4-a5b3-4a9b-abd2-f1efd9212901 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:09.583041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ac42a4-a5b3-4a9b-abd2-f1efd9212901 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:09.641600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:09.656161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:09.752118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:09.770693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'server_group_members'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:09.913311 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cc6fde70-be77-4b9c-8bcd-89baa5ba1974 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.418885 Aug 27 02:30:09.928790 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 328/704] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:30:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 2438 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 02:30:09.937906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-339b10f6-638c-4a0e-81ef-c248dfa93cd7 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:09.939358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-339b10f6-638c-4a0e-81ef-c248dfa93cd7 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:09.953311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339b10f6-638c-4a0e-81ef-c248dfa93cd7 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:09.954245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339b10f6-638c-4a0e-81ef-c248dfa93cd7 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:09.955098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339b10f6-638c-4a0e-81ef-c248dfa93cd7 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:09.956511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339b10f6-638c-4a0e-81ef-c248dfa93cd7 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:09.957911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339b10f6-638c-4a0e-81ef-c248dfa93cd7 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:09.958890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339b10f6-638c-4a0e-81ef-c248dfa93cd7 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:10.133361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-339b10f6-638c-4a0e-81ef-c248dfa93cd7 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:10.196308 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-339b10f6-638c-4a0e-81ef-c248dfa93cd7 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.265670 Aug 27 02:30:10.212251 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 329/705] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:09 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:10.212251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fc93d28d-9384-42cf-8b3c-a8b728ffb7e3 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] Calling method '.version_select at 0x7f4d2ac5bd30>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:10.377428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-60ac42a4-a5b3-4a9b-abd2-f1efd9212901 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:10.417436 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-60ac42a4-a5b3-4a9b-abd2-f1efd9212901 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1503 microversion: 2.1 time: 0.865515 Aug 27 02:30:10.427010 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 377/706] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:09 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1503 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:10.441793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-63ee68e1-e301-498a-b1c7-c08d726e5707 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:10.442435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-63ee68e1-e301-498a-b1c7-c08d726e5707 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:10.473845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63ee68e1-e301-498a-b1c7-c08d726e5707 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:10.474922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63ee68e1-e301-498a-b1c7-c08d726e5707 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:10.475640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63ee68e1-e301-498a-b1c7-c08d726e5707 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:10.476540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63ee68e1-e301-498a-b1c7-c08d726e5707 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:10.477096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63ee68e1-e301-498a-b1c7-c08d726e5707 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:10.478121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63ee68e1-e301-498a-b1c7-c08d726e5707 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:10.768529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-63ee68e1-e301-498a-b1c7-c08d726e5707 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:10.798662 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-63ee68e1-e301-498a-b1c7-c08d726e5707 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1310 microversion: 2.1 time: 0.368515 Aug 27 02:30:10.801130 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 378/707] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:10 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1310 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:10.811480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b6158b04-55aa-46d9-859e-cf9ddb1f1f75 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:10.824936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6158b04-55aa-46d9-859e-cf9ddb1f1f75 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:10.826857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b6158b04-55aa-46d9-859e-cf9ddb1f1f75 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Searching by: {'deleted': False, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:30:10.879598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6158b04-55aa-46d9-859e-cf9ddb1f1f75 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:10.880478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6158b04-55aa-46d9-859e-cf9ddb1f1f75 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:10.881269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6158b04-55aa-46d9-859e-cf9ddb1f1f75 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:10.883615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6158b04-55aa-46d9-859e-cf9ddb1f1f75 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:10.884878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6158b04-55aa-46d9-859e-cf9ddb1f1f75 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:10.885870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6158b04-55aa-46d9-859e-cf9ddb1f1f75 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:10.992863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-b6158b04-55aa-46d9-859e-cf9ddb1f1f75 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:30:11.038424 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b6158b04-55aa-46d9-859e-cf9ddb1f1f75 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.234867 Aug 27 02:30:11.049977 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 379/708] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 02:30:10 2022] GET /compute/v2.1/servers => generated 1662 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:11.056407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6486265-8577-403c-ac8c-2808bcb3705f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:11.057450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a6486265-8577-403c-ac8c-2808bcb3705f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:11.064640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6486265-8577-403c-ac8c-2808bcb3705f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:11.065467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6486265-8577-403c-ac8c-2808bcb3705f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:11.066154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6486265-8577-403c-ac8c-2808bcb3705f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:11.067677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6486265-8577-403c-ac8c-2808bcb3705f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:11.068833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6486265-8577-403c-ac8c-2808bcb3705f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:11.070156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6486265-8577-403c-ac8c-2808bcb3705f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:12.094462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a6486265-8577-403c-ac8c-2808bcb3705f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:12.112009 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6486265-8577-403c-ac8c-2808bcb3705f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1476 microversion: 2.1 time: 1.057333 Aug 27 02:30:12.126495 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 380/709] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:11 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1476 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:12.162411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d0cea921-f598-41d6-b8db-4c321708de0c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:12.162974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d0cea921-f598-41d6-b8db-4c321708de0c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:12.171551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0cea921-f598-41d6-b8db-4c321708de0c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:12.177419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0cea921-f598-41d6-b8db-4c321708de0c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:12.187882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0cea921-f598-41d6-b8db-4c321708de0c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:12.189027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0cea921-f598-41d6-b8db-4c321708de0c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:12.189724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0cea921-f598-41d6-b8db-4c321708de0c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:12.190328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0cea921-f598-41d6-b8db-4c321708de0c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:12.248625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d0cea921-f598-41d6-b8db-4c321708de0c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:30:12.615567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d0cea921-f598-41d6-b8db-4c321708de0c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "DELETE /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 204 len: 0 microversion: 2.1 time: 0.484972 Aug 27 02:30:12.625058 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 381/710] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:30:12 2022] DELETE /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:30:12.654557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-49694568-1e42-4f07-9004-4e3c2def8586 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:12.657106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-49694568-1e42-4f07-9004-4e3c2def8586 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:12.688442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49694568-1e42-4f07-9004-4e3c2def8586 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:12.689330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49694568-1e42-4f07-9004-4e3c2def8586 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:12.693431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49694568-1e42-4f07-9004-4e3c2def8586 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:12.694622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49694568-1e42-4f07-9004-4e3c2def8586 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:12.695326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49694568-1e42-4f07-9004-4e3c2def8586 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:12.697609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49694568-1e42-4f07-9004-4e3c2def8586 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:12.883074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-49694568-1e42-4f07-9004-4e3c2def8586 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:12.891837 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-49694568-1e42-4f07-9004-4e3c2def8586 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1222 microversion: 2.1 time: 0.263171 Aug 27 02:30:12.906516 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 382/711] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:12 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1222 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:12.913735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-891921d5-b7d2-4cc9-baae-4b0f22b0f842 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:12.914627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-891921d5-b7d2-4cc9-baae-4b0f22b0f842 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:12.920881 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fc93d28d-9384-42cf-8b3c-a8b728ffb7e3 tempest-SecurityGroupRulesTestJSON-1758301055 tempest-SecurityGroupRulesTestJSON-1758301055-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/5336f97c-78cd-4d81-9661-0918b55d569e" status: 202 len: 0 microversion: 2.1 time: 2.721564 Aug 27 02:30:12.923576 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 330/712] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:30:10 2022] DELETE /compute/v2.1/os-security-groups/5336f97c-78cd-4d81-9661-0918b55d569e => generated 0 bytes in 2726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:30:12.989062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-eb2ee905-0e5c-4c69-b928-f1f478987bee req-ef98494d-3773-43d0-b64c-2d2380899918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6596fe05-cc54-4bf2-8180-4a201ebdad1c", "tag": "89e9571f-0605-4282-a2a4-cad646e275d8"}, {"name": "network-changed", "server_uuid": "9a0d3c43-6a69-49d1-8e43-494b70e6b635", "tag": "ff877ceb-42f3-4570-8d29-21cefdf8c147"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:13.012806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-891921d5-b7d2-4cc9-baae-4b0f22b0f842 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:13.023254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-891921d5-b7d2-4cc9-baae-4b0f22b0f842 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:13.033991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-891921d5-b7d2-4cc9-baae-4b0f22b0f842 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:13.039292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-891921d5-b7d2-4cc9-baae-4b0f22b0f842 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:13.048514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-891921d5-b7d2-4cc9-baae-4b0f22b0f842 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:13.054286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-891921d5-b7d2-4cc9-baae-4b0f22b0f842 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:13.091815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-eb2ee905-0e5c-4c69-b928-f1f478987bee req-ef98494d-3773-43d0-b64c-2d2380899918 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:13.092299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-eb2ee905-0e5c-4c69-b928-f1f478987bee req-ef98494d-3773-43d0-b64c-2d2380899918 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:13.092730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-eb2ee905-0e5c-4c69-b928-f1f478987bee req-ef98494d-3773-43d0-b64c-2d2380899918 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:13.149329 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-eb2ee905-0e5c-4c69-b928-f1f478987bee req-ef98494d-3773-43d0-b64c-2d2380899918 service nova] Creating event network-changed:89e9571f-0605-4282-a2a4-cad646e275d8 for instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c on n-h2-852084-5 Aug 27 02:30:13.149971 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-eb2ee905-0e5c-4c69-b928-f1f478987bee req-ef98494d-3773-43d0-b64c-2d2380899918 service nova] Creating event network-changed:ff877ceb-42f3-4570-8d29-21cefdf8c147 for instance 9a0d3c43-6a69-49d1-8e43-494b70e6b635 on n-h2-852084-5 Aug 27 02:30:13.198391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-eb2ee905-0e5c-4c69-b928-f1f478987bee req-ef98494d-3773-43d0-b64c-2d2380899918 service nova] Instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:30:13.229747 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-eb2ee905-0e5c-4c69-b928-f1f478987bee req-ef98494d-3773-43d0-b64c-2d2380899918 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.304088 Aug 27 02:30:13.234612 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 331/713] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:13.249436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb73e179-ac5d-42d1-b70a-5938f87929b9 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:13.250180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fb73e179-ac5d-42d1-b70a-5938f87929b9 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:13.252690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:13.269111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb73e179-ac5d-42d1-b70a-5938f87929b9 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:13.270074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb73e179-ac5d-42d1-b70a-5938f87929b9 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:13.270857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb73e179-ac5d-42d1-b70a-5938f87929b9 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:13.272445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb73e179-ac5d-42d1-b70a-5938f87929b9 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:13.275618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb73e179-ac5d-42d1-b70a-5938f87929b9 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:13.276285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb73e179-ac5d-42d1-b70a-5938f87929b9 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:13.337376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-891921d5-b7d2-4cc9-baae-4b0f22b0f842 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:13.472142 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-891921d5-b7d2-4cc9-baae-4b0f22b0f842 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.560306 Aug 27 02:30:13.478540 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 383/714] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:12 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:13.500949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e15953eb-d360-4213-9a68-01f24aeb8cd3 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:13.502146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e15953eb-d360-4213-9a68-01f24aeb8cd3 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:13.524185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e15953eb-d360-4213-9a68-01f24aeb8cd3 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:13.526229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e15953eb-d360-4213-9a68-01f24aeb8cd3 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:13.528108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e15953eb-d360-4213-9a68-01f24aeb8cd3 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:13.530667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e15953eb-d360-4213-9a68-01f24aeb8cd3 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:13.533945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e15953eb-d360-4213-9a68-01f24aeb8cd3 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:13.535805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e15953eb-d360-4213-9a68-01f24aeb8cd3 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:14.317328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e15953eb-d360-4213-9a68-01f24aeb8cd3 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:14.334243 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e15953eb-d360-4213-9a68-01f24aeb8cd3 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1509 microversion: 2.1 time: 0.853118 Aug 27 02:30:14.335030 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 384/715] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:13 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1509 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:14.343073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46806024-f437-4760-a2b9-4a923bed22e5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:14.344102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-46806024-f437-4760-a2b9-4a923bed22e5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:14.372038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46806024-f437-4760-a2b9-4a923bed22e5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:14.372545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46806024-f437-4760-a2b9-4a923bed22e5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:14.372990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46806024-f437-4760-a2b9-4a923bed22e5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:14.374330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46806024-f437-4760-a2b9-4a923bed22e5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:14.374826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46806024-f437-4760-a2b9-4a923bed22e5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:14.376067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46806024-f437-4760-a2b9-4a923bed22e5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:14.531735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fb73e179-ac5d-42d1-b70a-5938f87929b9 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:14.541524 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fb73e179-ac5d-42d1-b70a-5938f87929b9 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1310 microversion: 2.1 time: 1.305178 Aug 27 02:30:14.547194 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 332/716] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:13 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1310 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:14.559895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2c51e20-878a-44c2-bffd-c9decc04eae1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:14.560834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c2c51e20-878a-44c2-bffd-c9decc04eae1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:14.574616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2c51e20-878a-44c2-bffd-c9decc04eae1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:14.582975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2c51e20-878a-44c2-bffd-c9decc04eae1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:14.584031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2c51e20-878a-44c2-bffd-c9decc04eae1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:14.585790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2c51e20-878a-44c2-bffd-c9decc04eae1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:14.586523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2c51e20-878a-44c2-bffd-c9decc04eae1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:14.586817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2c51e20-878a-44c2-bffd-c9decc04eae1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:14.889757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c2c51e20-878a-44c2-bffd-c9decc04eae1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:14.906931 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c2c51e20-878a-44c2-bffd-c9decc04eae1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1270 microversion: 2.1 time: 0.357695 Aug 27 02:30:14.909714 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 333/717] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:14 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1270 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:14.924400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-968a7c18-d906-49e2-a8d8-8183e331b922 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:14.934734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-968a7c18-d906-49e2-a8d8-8183e331b922 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:14.950460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-968a7c18-d906-49e2-a8d8-8183e331b922 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:14.954870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-968a7c18-d906-49e2-a8d8-8183e331b922 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:14.955643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-968a7c18-d906-49e2-a8d8-8183e331b922 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:14.957089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-968a7c18-d906-49e2-a8d8-8183e331b922 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:14.957825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-968a7c18-d906-49e2-a8d8-8183e331b922 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:14.958465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-968a7c18-d906-49e2-a8d8-8183e331b922 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:15.096103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-46806024-f437-4760-a2b9-4a923bed22e5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:15.122172 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-46806024-f437-4760-a2b9-4a923bed22e5 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1474 microversion: 2.1 time: 0.781713 Aug 27 02:30:15.139778 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 385/718] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:14 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1474 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:15.212279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-968a7c18-d906-49e2-a8d8-8183e331b922 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:15.252393 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-968a7c18-d906-49e2-a8d8-8183e331b922 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.340022 Aug 27 02:30:15.253250 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 334/719] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:14 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:15.357222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a0891ee2-ec80-4c67-a5ce-0f334a2eb32c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:15.358333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a0891ee2-ec80-4c67-a5ce-0f334a2eb32c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:15.367169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0891ee2-ec80-4c67-a5ce-0f334a2eb32c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:15.367792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0891ee2-ec80-4c67-a5ce-0f334a2eb32c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:15.368453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0891ee2-ec80-4c67-a5ce-0f334a2eb32c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:15.369235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0891ee2-ec80-4c67-a5ce-0f334a2eb32c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:15.369790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0891ee2-ec80-4c67-a5ce-0f334a2eb32c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:15.370316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0891ee2-ec80-4c67-a5ce-0f334a2eb32c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:15.569226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ce997850-59b4-437b-9133-62138baf4b3a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:15.570679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ce997850-59b4-437b-9133-62138baf4b3a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:15.578794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce997850-59b4-437b-9133-62138baf4b3a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:15.579880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce997850-59b4-437b-9133-62138baf4b3a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:15.580877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce997850-59b4-437b-9133-62138baf4b3a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:15.582822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce997850-59b4-437b-9133-62138baf4b3a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:15.587453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce997850-59b4-437b-9133-62138baf4b3a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:15.590568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce997850-59b4-437b-9133-62138baf4b3a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:16.558905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=50 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:16.700633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a0891ee2-ec80-4c67-a5ce-0f334a2eb32c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:16.715442 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a0891ee2-ec80-4c67-a5ce-0f334a2eb32c tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1509 microversion: 2.1 time: 1.362897 Aug 27 02:30:16.717164 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 386/720] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:15 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1509 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:30:16.724418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-256d65de-6c0b-4975-a8c1-c439b238646a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:16.725384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-256d65de-6c0b-4975-a8c1-c439b238646a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:16.732813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-256d65de-6c0b-4975-a8c1-c439b238646a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:16.733885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-256d65de-6c0b-4975-a8c1-c439b238646a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:16.735877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-256d65de-6c0b-4975-a8c1-c439b238646a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:16.736727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-256d65de-6c0b-4975-a8c1-c439b238646a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:16.737441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-256d65de-6c0b-4975-a8c1-c439b238646a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:16.737971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-256d65de-6c0b-4975-a8c1-c439b238646a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:16.746114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ce997850-59b4-437b-9133-62138baf4b3a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:16.760045 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ce997850-59b4-437b-9133-62138baf4b3a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1310 microversion: 2.1 time: 1.194829 Aug 27 02:30:16.767364 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 335/721] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:15 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1310 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:30:16.778540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a0446611-ddac-46ec-ad16-d3bbc8ce68a9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:16.781414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a0446611-ddac-46ec-ad16-d3bbc8ce68a9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:16.796778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0446611-ddac-46ec-ad16-d3bbc8ce68a9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:16.799227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0446611-ddac-46ec-ad16-d3bbc8ce68a9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:16.800204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0446611-ddac-46ec-ad16-d3bbc8ce68a9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:16.803352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0446611-ddac-46ec-ad16-d3bbc8ce68a9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:16.806437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0446611-ddac-46ec-ad16-d3bbc8ce68a9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:16.807357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0446611-ddac-46ec-ad16-d3bbc8ce68a9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:17.063909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-256d65de-6c0b-4975-a8c1-c439b238646a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:17.075911 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-256d65de-6c0b-4975-a8c1-c439b238646a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1276 microversion: 2.1 time: 0.357234 Aug 27 02:30:17.078443 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 387/722] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:16 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1276 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:17.084285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d714c38f-ccdf-4c3a-b9f6-b76d9535ca6b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:17.084908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d714c38f-ccdf-4c3a-b9f6-b76d9535ca6b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:17.091826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d714c38f-ccdf-4c3a-b9f6-b76d9535ca6b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:17.092332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d714c38f-ccdf-4c3a-b9f6-b76d9535ca6b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:17.092781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d714c38f-ccdf-4c3a-b9f6-b76d9535ca6b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:17.093549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d714c38f-ccdf-4c3a-b9f6-b76d9535ca6b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:17.094012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d714c38f-ccdf-4c3a-b9f6-b76d9535ca6b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:17.094444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d714c38f-ccdf-4c3a-b9f6-b76d9535ca6b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:17.256472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-d714c38f-ccdf-4c3a-b9f6-b76d9535ca6b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:17.276063 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d714c38f-ccdf-4c3a-b9f6-b76d9535ca6b tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.196173 Aug 27 02:30:17.276843 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 388/723] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:17 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:17.411515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a0446611-ddac-46ec-ad16-d3bbc8ce68a9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:17.426659 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a0446611-ddac-46ec-ad16-d3bbc8ce68a9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1471 microversion: 2.1 time: 0.657220 Aug 27 02:30:17.427711 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 336/724] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:16 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1471 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:17.459702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d709b6e4-fb6b-4b97-b75e-6e220f921b9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:17.460657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d709b6e4-fb6b-4b97-b75e-6e220f921b9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:17.468571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d709b6e4-fb6b-4b97-b75e-6e220f921b9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:17.469479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d709b6e4-fb6b-4b97-b75e-6e220f921b9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:17.470261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d709b6e4-fb6b-4b97-b75e-6e220f921b9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:17.471101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d709b6e4-fb6b-4b97-b75e-6e220f921b9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:17.471762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d709b6e4-fb6b-4b97-b75e-6e220f921b9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:17.472382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d709b6e4-fb6b-4b97-b75e-6e220f921b9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:17.522066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:17.584717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d709b6e4-fb6b-4b97-b75e-6e220f921b9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "POST /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c/action" status: 204 len: 0 microversion: 2.1 time: 0.134943 Aug 27 02:30:17.591576 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 389/725] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:30:17 2022] POST /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c/action => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:30:17.597985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1ad0b58-6965-44e5-9c93-7702a9b5de5b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:17.598736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d1ad0b58-6965-44e5-9c93-7702a9b5de5b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:17.609833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ad0b58-6965-44e5-9c93-7702a9b5de5b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:17.614925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ad0b58-6965-44e5-9c93-7702a9b5de5b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:17.615947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ad0b58-6965-44e5-9c93-7702a9b5de5b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:17.619298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ad0b58-6965-44e5-9c93-7702a9b5de5b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:17.620849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ad0b58-6965-44e5-9c93-7702a9b5de5b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:17.623979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ad0b58-6965-44e5-9c93-7702a9b5de5b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:17.753353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-319f3e94-081d-462d-b8aa-43b46329ab1f tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:17.755149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-319f3e94-081d-462d-b8aa-43b46329ab1f tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:17.763475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-319f3e94-081d-462d-b8aa-43b46329ab1f tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:17.764450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-319f3e94-081d-462d-b8aa-43b46329ab1f tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:17.765063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-319f3e94-081d-462d-b8aa-43b46329ab1f tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:17.766008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-319f3e94-081d-462d-b8aa-43b46329ab1f tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:17.766775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-319f3e94-081d-462d-b8aa-43b46329ab1f tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:17.767384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-319f3e94-081d-462d-b8aa-43b46329ab1f tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:18.470460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-319f3e94-081d-462d-b8aa-43b46329ab1f tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c765a865944064839d4c15de177963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f3f9eab5744a87aa391c2a5ced6a49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:18.499789 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-319f3e94-081d-462d-b8aa-43b46329ab1f tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 200 len: 1509 microversion: 2.1 time: 0.750557 Aug 27 02:30:18.514334 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 390/726] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:17 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 1509 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:18.544450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-40d2e8a2-1d6e-46ff-951d-33c70c88238c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:18.555209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-40d2e8a2-1d6e-46ff-951d-33c70c88238c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:18.590914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d2e8a2-1d6e-46ff-951d-33c70c88238c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:18.594852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d2e8a2-1d6e-46ff-951d-33c70c88238c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:18.596792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d2e8a2-1d6e-46ff-951d-33c70c88238c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:18.600485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d2e8a2-1d6e-46ff-951d-33c70c88238c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:18.601516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d2e8a2-1d6e-46ff-951d-33c70c88238c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:18.604234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d2e8a2-1d6e-46ff-951d-33c70c88238c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:18.833432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1ad0b58-6965-44e5-9c93-7702a9b5de5b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:18.880401 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1ad0b58-6965-44e5-9c93-7702a9b5de5b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1471 microversion: 2.1 time: 1.283238 Aug 27 02:30:18.890181 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 337/727] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:17 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1471 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:18.922473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-977bc330-6918-44e2-9e13-681087fda29f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:18.927326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-977bc330-6918-44e2-9e13-681087fda29f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:18.956589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-977bc330-6918-44e2-9e13-681087fda29f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:18.964609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-977bc330-6918-44e2-9e13-681087fda29f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:18.966586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-977bc330-6918-44e2-9e13-681087fda29f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:18.972454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-977bc330-6918-44e2-9e13-681087fda29f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:18.975319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-977bc330-6918-44e2-9e13-681087fda29f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:18.980165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-977bc330-6918-44e2-9e13-681087fda29f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:19.063698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:19.087798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-40d2e8a2-1d6e-46ff-951d-33c70c88238c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:19.116808 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-40d2e8a2-1d6e-46ff-951d-33c70c88238c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1310 microversion: 2.1 time: 0.600597 Aug 27 02:30:19.121262 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 391/728] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:18 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1310 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:19.132274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e73f02ff-4e9d-4c3b-9e7e-7c88a6054f7f req-ca87756a-33d0-4652-8023-e28af0b8e4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6596fe05-cc54-4bf2-8180-4a201ebdad1c", "name": "network-vif-plugged", "status": "completed", "tag": "89e9571f-0605-4282-a2a4-cad646e275d8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:19.170391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e73f02ff-4e9d-4c3b-9e7e-7c88a6054f7f req-ca87756a-33d0-4652-8023-e28af0b8e4c5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:19.170875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e73f02ff-4e9d-4c3b-9e7e-7c88a6054f7f req-ca87756a-33d0-4652-8023-e28af0b8e4c5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:19.171310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e73f02ff-4e9d-4c3b-9e7e-7c88a6054f7f req-ca87756a-33d0-4652-8023-e28af0b8e4c5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:19.204027 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e73f02ff-4e9d-4c3b-9e7e-7c88a6054f7f req-ca87756a-33d0-4652-8023-e28af0b8e4c5 service nova] Creating event network-vif-plugged:89e9571f-0605-4282-a2a4-cad646e275d8 for instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c on n-h2-852084-5 Aug 27 02:30:19.220772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-e73f02ff-4e9d-4c3b-9e7e-7c88a6054f7f req-ca87756a-33d0-4652-8023-e28af0b8e4c5 service nova] Instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:30:19.252820 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e73f02ff-4e9d-4c3b-9e7e-7c88a6054f7f req-ca87756a-33d0-4652-8023-e28af0b8e4c5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129920 Aug 27 02:30:19.255339 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 392/729] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:19.264797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8e6205cc-7b9b-42e3-9579-d4bd0ea215ea tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:19.265607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8e6205cc-7b9b-42e3-9579-d4bd0ea215ea tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:19.279243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e6205cc-7b9b-42e3-9579-d4bd0ea215ea tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:19.280145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e6205cc-7b9b-42e3-9579-d4bd0ea215ea tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:19.281189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e6205cc-7b9b-42e3-9579-d4bd0ea215ea tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:19.282204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e6205cc-7b9b-42e3-9579-d4bd0ea215ea tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:19.282841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e6205cc-7b9b-42e3-9579-d4bd0ea215ea tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:19.283653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e6205cc-7b9b-42e3-9579-d4bd0ea215ea tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:19.635227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-8e6205cc-7b9b-42e3-9579-d4bd0ea215ea tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:19.703326 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8e6205cc-7b9b-42e3-9579-d4bd0ea215ea tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.446312 Aug 27 02:30:19.709609 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 393/730] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:19 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:19.731210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2b5f198d-767f-4392-ae84-bc959ced405b req-9e455fef-4d6e-45a7-b3a1-d16f4c56ab8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12cf2fef-97c6-4239-b88f-38676c353436", "name": "network-vif-deleted", "tag": "75749125-4703-4aed-b9a9-2b580f89bed8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:19.777695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-977bc330-6918-44e2-9e13-681087fda29f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:19.781821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b5f198d-767f-4392-ae84-bc959ced405b req-9e455fef-4d6e-45a7-b3a1-d16f4c56ab8f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:19.788843 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-977bc330-6918-44e2-9e13-681087fda29f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1276 microversion: 2.1 time: 0.888666 Aug 27 02:30:19.805724 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 338/731] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:18 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1276 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:19.807834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b5f198d-767f-4392-ae84-bc959ced405b req-9e455fef-4d6e-45a7-b3a1-d16f4c56ab8f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:19.808282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:19.809091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:19.810239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b5f198d-767f-4392-ae84-bc959ced405b req-9e455fef-4d6e-45a7-b3a1-d16f4c56ab8f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:19.828913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=30 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:19.833118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:19.834236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:19.839014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:19.843569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:19.844447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:19.845178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:19.862958 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2b5f198d-767f-4392-ae84-bc959ced405b req-9e455fef-4d6e-45a7-b3a1-d16f4c56ab8f service nova] Creating event network-vif-deleted:75749125-4703-4aed-b9a9-2b580f89bed8 for instance 12cf2fef-97c6-4239-b88f-38676c353436 on n-h2-852084-5 Aug 27 02:30:19.871963 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2b5f198d-767f-4392-ae84-bc959ced405b req-9e455fef-4d6e-45a7-b3a1-d16f4c56ab8f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160096 Aug 27 02:30:19.878651 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 394/732] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:19.896351 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] HTTP exception thrown: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Request method failure captured: Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 HTTP/1.1 Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYGUmnCgD9--v3WXGu6SPSorhbHefjN9vvRJs_lSCnC-E96CiOMmW0KX03A-hORwcVuIlo8mfj4ln7h9tQbaMLlAlc4swURaTx-nlmHfj3tUQXTCBs2xPrBLUY_b8oig_aOOb3w7vtc9ScUXUBJQYR9swKylNAaLVjgt8rVznaBcZdk Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/79f3f9eab5744a87aa391c2a5ced6a49"}]}] Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 39c765a865944064839d4c15de177963 Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '12cf2fef-97c6-4239-b88f-38676c353436'} Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:19.916254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:19.921615 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:19.921615 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:19.921615 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:19.921615 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:19.921615 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:19.921615 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:19.921615 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:19.923629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Returning 404 to user: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:19.923893 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b5a74ed2-bf64-4480-87a3-a7459b1db316 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 404 len: 111 microversion: 2.1 time: 0.129482 Aug 27 02:30:19.924928 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 339/733] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:19 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:30:19.930438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6003b16-126a-43b6-862c-df6613b8cc8b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:19.931516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a6003b16-126a-43b6-862c-df6613b8cc8b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:19.952243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1061698460", "metadata": {"image_type": "test"}}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:19.956521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:19.959926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6003b16-126a-43b6-862c-df6613b8cc8b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:19.960817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6003b16-126a-43b6-862c-df6613b8cc8b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:19.961602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6003b16-126a-43b6-862c-df6613b8cc8b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:19.962968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6003b16-126a-43b6-862c-df6613b8cc8b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:19.963829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6003b16-126a-43b6-862c-df6613b8cc8b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:19.981840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6003b16-126a-43b6-862c-df6613b8cc8b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:19.990081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:19.990756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:19.991319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:19.992221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:19.992775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:19.993307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:20.012406 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] HTTP exception thrown: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Request method failure captured: Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436/action HTTP/1.1 Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 112 Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYGUmnCgD9--v3WXGu6SPSorhbHefjN9vvRJs_lSCnC-E96CiOMmW0KX03A-hORwcVuIlo8mfj4ln7h9tQbaMLlAlc4swURaTx-nlmHfj3tUQXTCBs2xPrBLUY_b8oig_aOOb3w7vtc9ScUXUBJQYR9swKylNAaLVjgt8rVznaBcZdk Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/79f3f9eab5744a87aa391c2a5ced6a49"}]}] Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 39c765a865944064839d4c15de177963 Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1061698460", "metadata": {"image_type": "test"}}} Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '12cf2fef-97c6-4239-b88f-38676c353436', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1061698460', 'metadata': {'image_type': 'test'}}}} Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 02:30:20.015420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:20.019245 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.023720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Returning 404 to user: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:20.025405 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-821cba10-b778-4536-9fcb-f0d7d608d0b2 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "POST /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436/action" status: 404 len: 111 microversion: 2.1 time: 0.091747 Aug 27 02:30:20.038304 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 340/734] 10.222.0.99 () {60 vars in 1279 bytes} [Sat Aug 27 02:30:19 2022] POST /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436/action => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:30:20.071396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c94a7da9-26fd-4f55-894b-6a0f468e5cfb tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1132774308", "metadata": {"image_type": "test"}}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:20.083403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c94a7da9-26fd-4f55-894b-6a0f468e5cfb tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Failed to fetch instance by id tempest-invalid-799307093 {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 02:30:20.084703 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-c94a7da9-26fd-4f55-894b-6a0f468e5cfb tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] HTTP exception thrown: Instance tempest-invalid-799307093 could not be found. Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c94a7da9-26fd-4f55-894b-6a0f468e5cfb tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Request method failure captured: Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/tempest-invalid-799307093/action HTTP/1.1 Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 112 Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYGUmnCgD9--v3WXGu6SPSorhbHefjN9vvRJs_lSCnC-E96CiOMmW0KX03A-hORwcVuIlo8mfj4ln7h9tQbaMLlAlc4swURaTx-nlmHfj3tUQXTCBs2xPrBLUY_b8oig_aOOb3w7vtc9ScUXUBJQYR9swKylNAaLVjgt8rVznaBcZdk Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/79f3f9eab5744a87aa391c2a5ced6a49"}]}] Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 39c765a865944064839d4c15de177963 Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1132774308", "metadata": {"image_type": "test"}}} Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance tempest-invalid-799307093 could not be found. Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'tempest-invalid-799307093', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1132774308', 'metadata': {'image_type': 'test'}}}} Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-799307093 could not be found. Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:20.090077 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-799307093 could not be found. Aug 27 02:30:20.099345 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.099345 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:20.099345 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.099345 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.099345 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:20.099345 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:20.099345 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:20.099345 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:20.099345 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-799307093 could not be found. Aug 27 02:30:20.099345 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.101013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c94a7da9-26fd-4f55-894b-6a0f468e5cfb tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Returning 404 to user: Instance tempest-invalid-799307093 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:20.101597 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c94a7da9-26fd-4f55-894b-6a0f468e5cfb tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "POST /compute/v2.1/servers/tempest-invalid-799307093/action" status: 404 len: 100 microversion: 2.1 time: 0.061471 Aug 27 02:30:20.110176 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 341/735] 10.222.0.99 () {60 vars in 1246 bytes} [Sat Aug 27 02:30:20 2022] POST /compute/v2.1/servers/tempest-invalid-799307093/action => generated 100 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:30:20.115904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df976024-5f6c-42f6-88e2-0fd011aa11df tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-97605186"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:20.118452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-df976024-5f6c-42f6-88e2-0fd011aa11df tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 02:30:20.118976 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-df976024-5f6c-42f6-88e2-0fd011aa11df tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df976024-5f6c-42f6-88e2-0fd011aa11df tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Request method failure captured: Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 55 Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYGUmnCgD9--v3WXGu6SPSorhbHefjN9vvRJs_lSCnC-E96CiOMmW0KX03A-hORwcVuIlo8mfj4ln7h9tQbaMLlAlc4swURaTx-nlmHfj3tUQXTCBs2xPrBLUY_b8oig_aOOb3w7vtc9ScUXUBJQYR9swKylNAaLVjgt8rVznaBcZdk Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/79f3f9eab5744a87aa391c2a5ced6a49"}]}] Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 39c765a865944064839d4c15de177963 Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: {"createImage": {"name": "tempest-test-snap-97605186"}} Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-97605186'}}} Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:30:20.127515 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.132268 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:20.132268 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.132268 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.132268 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:20.132268 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:20.132268 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:20.132268 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:20.132268 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:30:20.132268 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.138580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df976024-5f6c-42f6-88e2-0fd011aa11df tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:20.139862 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-df976024-5f6c-42f6-88e2-0fd011aa11df tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.028741 Aug 27 02:30:20.140958 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 342/736] 10.222.0.99 () {60 vars in 1275 bytes} [Sat Aug 27 02:30:20 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:30:20.153074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-76ea3ac5-8ed7-4dea-b39c-7d2f85da37d7 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-550616510"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:20.161037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-76ea3ac5-8ed7-4dea-b39c-7d2f85da37d7 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 02:30:20.161946 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-76ea3ac5-8ed7-4dea-b39c-7d2f85da37d7 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-76ea3ac5-8ed7-4dea-b39c-7d2f85da37d7 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Request method failure captured: Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 56 Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYGUmnCgD9--v3WXGu6SPSorhbHefjN9vvRJs_lSCnC-E96CiOMmW0KX03A-hORwcVuIlo8mfj4ln7h9tQbaMLlAlc4swURaTx-nlmHfj3tUQXTCBs2xPrBLUY_b8oig_aOOb3w7vtc9ScUXUBJQYR9swKylNAaLVjgt8rVznaBcZdk Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/79f3f9eab5744a87aa391c2a5ced6a49"}]}] Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 39c765a865944064839d4c15de177963 Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: {"createImage": {"name": "tempest-test-snap-550616510"}} Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-550616510'}}} Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:30:20.163876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.168808 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:20.168808 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.168808 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.168808 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:20.168808 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:20.168808 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:20.168808 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:20.168808 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 27 02:30:20.168808 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.183571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-76ea3ac5-8ed7-4dea-b39c-7d2f85da37d7 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:20.186042 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-76ea3ac5-8ed7-4dea-b39c-7d2f85da37d7 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.035587 Aug 27 02:30:20.187124 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 343/737] 10.222.0.99 () {60 vars in 1281 bytes} [Sat Aug 27 02:30:20 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:30:20.200689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ac294329-750f-48e9-8b7b-1cc3d126890f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:20.202588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac294329-750f-48e9-8b7b-1cc3d126890f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:20.224752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac294329-750f-48e9-8b7b-1cc3d126890f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:20.225649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac294329-750f-48e9-8b7b-1cc3d126890f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:20.226457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac294329-750f-48e9-8b7b-1cc3d126890f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:20.228023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac294329-750f-48e9-8b7b-1cc3d126890f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:20.228869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac294329-750f-48e9-8b7b-1cc3d126890f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:20.229649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac294329-750f-48e9-8b7b-1cc3d126890f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:20.776845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a6003b16-126a-43b6-862c-df6613b8cc8b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:20.797462 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6003b16-126a-43b6-862c-df6613b8cc8b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1471 microversion: 2.1 time: 0.873714 Aug 27 02:30:20.799304 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 395/738] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:19 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1471 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:20.828992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:20.835282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:20.876106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:20.877404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:20.878486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:20.880577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:20.881729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:20.887541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:20.935492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:20.944410 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] HTTP exception thrown: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Request method failure captured: Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 HTTP/1.1 Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYGUmnCgD9--v3WXGu6SPSorhbHefjN9vvRJs_lSCnC-E96CiOMmW0KX03A-hORwcVuIlo8mfj4ln7h9tQbaMLlAlc4swURaTx-nlmHfj3tUQXTCBs2xPrBLUY_b8oig_aOOb3w7vtc9ScUXUBJQYR9swKylNAaLVjgt8rVznaBcZdk Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/79f3f9eab5744a87aa391c2a5ced6a49"}]}] Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 39c765a865944064839d4c15de177963 Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '12cf2fef-97c6-4239-b88f-38676c353436'} Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:20.949956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:20.958134 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:20.958134 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.958134 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:20.958134 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.958134 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:20.958134 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:20.958134 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:20.958134 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:20.958134 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:20.958134 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:20.958134 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:20.969168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Returning 404 to user: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:20.971246 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bcf8b047-2caa-4e4a-badf-9068bffa7764 tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "DELETE /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 404 len: 111 microversion: 2.1 time: 0.169711 Aug 27 02:30:20.973014 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 396/739] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:30:20 2022] DELETE /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:30:20.982712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-993ce22a-e547-430c-ab36-03db060a7647 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:20.984521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-993ce22a-e547-430c-ab36-03db060a7647 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:20.998560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-993ce22a-e547-430c-ab36-03db060a7647 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:21.000018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-993ce22a-e547-430c-ab36-03db060a7647 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:21.001274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-993ce22a-e547-430c-ab36-03db060a7647 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:21.002925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-993ce22a-e547-430c-ab36-03db060a7647 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:21.004579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-993ce22a-e547-430c-ab36-03db060a7647 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:21.005601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-993ce22a-e547-430c-ab36-03db060a7647 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:21.810717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac294329-750f-48e9-8b7b-1cc3d126890f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:21.853932 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ac294329-750f-48e9-8b7b-1cc3d126890f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1310 microversion: 2.1 time: 1.654697 Aug 27 02:30:21.862835 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 344/740] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:20 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1310 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:21.889705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1b09efbb-e184-4ff1-8ce3-bd4cc7cbe0a2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:21.889705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b09efbb-e184-4ff1-8ce3-bd4cc7cbe0a2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:21.901148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b09efbb-e184-4ff1-8ce3-bd4cc7cbe0a2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:21.906153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b09efbb-e184-4ff1-8ce3-bd4cc7cbe0a2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:21.907395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b09efbb-e184-4ff1-8ce3-bd4cc7cbe0a2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:21.908600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b09efbb-e184-4ff1-8ce3-bd4cc7cbe0a2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:21.909348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b09efbb-e184-4ff1-8ce3-bd4cc7cbe0a2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:21.910767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b09efbb-e184-4ff1-8ce3-bd4cc7cbe0a2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:22.033041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-993ce22a-e547-430c-ab36-03db060a7647 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:22.104215 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-993ce22a-e547-430c-ab36-03db060a7647 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 1.128872 Aug 27 02:30:22.107236 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 397/741] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:20 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:22.121098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:22.123211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] [instance: 12cf2fef-97c6-4239-b88f-38676c353436] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:22.140372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:22.141885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:22.144060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:22.147083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:22.148658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:22.150261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:22.199904 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] HTTP exception thrown: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Request method failure captured: Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 HTTP/1.1 Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYGUmnCgD9--v3WXGu6SPSorhbHefjN9vvRJs_lSCnC-E96CiOMmW0KX03A-hORwcVuIlo8mfj4ln7h9tQbaMLlAlc4swURaTx-nlmHfj3tUQXTCBs2xPrBLUY_b8oig_aOOb3w7vtc9ScUXUBJQYR9swKylNAaLVjgt8rVznaBcZdk Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/79f3f9eab5744a87aa391c2a5ced6a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/79f3f9eab5744a87aa391c2a5ced6a49"}]}] Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 79f3f9eab5744a87aa391c2a5ced6a49 Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1233922312 Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 39c765a865944064839d4c15de177963 Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesNegativeTestJSON-1233922312-project Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '12cf2fef-97c6-4239-b88f-38676c353436'} Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:22.205368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:22.219557 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:22.219557 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:22.219557 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:22.219557 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:22.219557 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:22.219557 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. Aug 27 02:30:22.219557 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:22.225648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] Returning 404 to user: Instance 12cf2fef-97c6-4239-b88f-38676c353436 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:22.236055 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-422a696d-1a86-4288-a6ae-5a666de3ef3b tempest-ImagesNegativeTestJSON-1233922312 tempest-ImagesNegativeTestJSON-1233922312-project] 10.222.0.99 "GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436" status: 404 len: 111 microversion: 2.1 time: 0.117265 Aug 27 02:30:22.245624 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 398/742] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:22 2022] GET /compute/v2.1/servers/12cf2fef-97c6-4239-b88f-38676c353436 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:30:22.262255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3b74304b-23f6-45b8-b1b3-be7d743640b6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:22.263963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3b74304b-23f6-45b8-b1b3-be7d743640b6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:22.282201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b74304b-23f6-45b8-b1b3-be7d743640b6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:22.286436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b74304b-23f6-45b8-b1b3-be7d743640b6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:22.289065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b74304b-23f6-45b8-b1b3-be7d743640b6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:22.292127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b74304b-23f6-45b8-b1b3-be7d743640b6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:22.293765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b74304b-23f6-45b8-b1b3-be7d743640b6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:22.294893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b74304b-23f6-45b8-b1b3-be7d743640b6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:23.564177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1b09efbb-e184-4ff1-8ce3-bd4cc7cbe0a2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:23.600221 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1b09efbb-e184-4ff1-8ce3-bd4cc7cbe0a2 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1318 microversion: 2.1 time: 1.729007 Aug 27 02:30:23.614258 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 345/743] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:21 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1318 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:23.630063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ef53a7f-bfeb-4568-b3df-436e6dd9cb26 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:23.638321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1ef53a7f-bfeb-4568-b3df-436e6dd9cb26 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:23.678264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef53a7f-bfeb-4568-b3df-436e6dd9cb26 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:23.680375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef53a7f-bfeb-4568-b3df-436e6dd9cb26 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:23.681449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef53a7f-bfeb-4568-b3df-436e6dd9cb26 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:23.682927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef53a7f-bfeb-4568-b3df-436e6dd9cb26 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:23.683989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef53a7f-bfeb-4568-b3df-436e6dd9cb26 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:23.685002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef53a7f-bfeb-4568-b3df-436e6dd9cb26 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:23.887263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3b74304b-23f6-45b8-b1b3-be7d743640b6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:23.901102 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3b74304b-23f6-45b8-b1b3-be7d743640b6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1471 microversion: 2.1 time: 1.649837 Aug 27 02:30:23.902450 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 399/744] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:22 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1471 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:23.912203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-35713753-fa32-4a40-b211-2f89cf9fa768 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:23.913294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-35713753-fa32-4a40-b211-2f89cf9fa768 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:23.929054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35713753-fa32-4a40-b211-2f89cf9fa768 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:23.929659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35713753-fa32-4a40-b211-2f89cf9fa768 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:23.930230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35713753-fa32-4a40-b211-2f89cf9fa768 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:23.933066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35713753-fa32-4a40-b211-2f89cf9fa768 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:23.933809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35713753-fa32-4a40-b211-2f89cf9fa768 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:23.934497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35713753-fa32-4a40-b211-2f89cf9fa768 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:24.265040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-35713753-fa32-4a40-b211-2f89cf9fa768 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:24.334459 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-35713753-fa32-4a40-b211-2f89cf9fa768 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.430151 Aug 27 02:30:24.335486 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 400/745] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:23 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:24.622386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1ef53a7f-bfeb-4568-b3df-436e6dd9cb26 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:24.628351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b2183f5d-4f4f-4284-84a8-e78e3516f567 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:24.632927 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1ef53a7f-bfeb-4568-b3df-436e6dd9cb26 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1310 microversion: 2.1 time: 1.017086 Aug 27 02:30:24.633201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b2183f5d-4f4f-4284-84a8-e78e3516f567 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:24.638532 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 346/746] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:23 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1310 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:24.668166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2183f5d-4f4f-4284-84a8-e78e3516f567 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:24.669761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2183f5d-4f4f-4284-84a8-e78e3516f567 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:24.670832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2183f5d-4f4f-4284-84a8-e78e3516f567 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:24.673529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2183f5d-4f4f-4284-84a8-e78e3516f567 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:24.675139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2183f5d-4f4f-4284-84a8-e78e3516f567 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:24.677916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2183f5d-4f4f-4284-84a8-e78e3516f567 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:24.942052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-f02bc47e-cfb9-4121-8c44-0a5d600de7bf req-fcad4547-b412-487a-8293-49defc5ba839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0d3c43-6a69-49d1-8e43-494b70e6b635", "name": "network-vif-plugged", "status": "completed", "tag": "ff877ceb-42f3-4570-8d29-21cefdf8c147"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:24.973235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f02bc47e-cfb9-4121-8c44-0a5d600de7bf req-fcad4547-b412-487a-8293-49defc5ba839 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:24.975018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f02bc47e-cfb9-4121-8c44-0a5d600de7bf req-fcad4547-b412-487a-8293-49defc5ba839 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:24.975748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f02bc47e-cfb9-4121-8c44-0a5d600de7bf req-fcad4547-b412-487a-8293-49defc5ba839 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:24.996109 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-f02bc47e-cfb9-4121-8c44-0a5d600de7bf req-fcad4547-b412-487a-8293-49defc5ba839 service nova] Creating event network-vif-plugged:ff877ceb-42f3-4570-8d29-21cefdf8c147 for instance 9a0d3c43-6a69-49d1-8e43-494b70e6b635 on n-h2-852084-5 Aug 27 02:30:25.007513 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-f02bc47e-cfb9-4121-8c44-0a5d600de7bf req-fcad4547-b412-487a-8293-49defc5ba839 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072598 Aug 27 02:30:25.011860 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 347/747] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:30:25.060821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-72f400c9-6287-42fb-9d03-0bac5e33c2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:25.064172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-72f400c9-6287-42fb-9d03-0bac5e33c2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:25.104172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f400c9-6287-42fb-9d03-0bac5e33c2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:25.104960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f400c9-6287-42fb-9d03-0bac5e33c2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:25.105659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f400c9-6287-42fb-9d03-0bac5e33c2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:25.107286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f400c9-6287-42fb-9d03-0bac5e33c2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:25.112782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f400c9-6287-42fb-9d03-0bac5e33c2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:25.112949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f400c9-6287-42fb-9d03-0bac5e33c2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:25.450238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b2183f5d-4f4f-4284-84a8-e78e3516f567 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:25.461712 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b2183f5d-4f4f-4284-84a8-e78e3516f567 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1318 microversion: 2.1 time: 0.842542 Aug 27 02:30:25.478547 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 401/748] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:24 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1318 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:25.492779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-30eba91b-1a54-4009-a7c6-44b9abd4b163 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:25.493498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-30eba91b-1a54-4009-a7c6-44b9abd4b163 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:25.508008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:25.514305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30eba91b-1a54-4009-a7c6-44b9abd4b163 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:25.515054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30eba91b-1a54-4009-a7c6-44b9abd4b163 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:25.517211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30eba91b-1a54-4009-a7c6-44b9abd4b163 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:25.520213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30eba91b-1a54-4009-a7c6-44b9abd4b163 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:25.521015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30eba91b-1a54-4009-a7c6-44b9abd4b163 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:25.522041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30eba91b-1a54-4009-a7c6-44b9abd4b163 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:25.677357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-72f400c9-6287-42fb-9d03-0bac5e33c2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:25.712959 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-72f400c9-6287-42fb-9d03-0bac5e33c2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1471 microversion: 2.1 time: 0.698978 Aug 27 02:30:25.722473 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 348/749] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:25 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1471 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:25.730438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3779c1d-45c5-495c-908f-f35fab668ff0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:25.731381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c3779c1d-45c5-495c-908f-f35fab668ff0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:25.748369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3779c1d-45c5-495c-908f-f35fab668ff0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:25.748872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3779c1d-45c5-495c-908f-f35fab668ff0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:25.749314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3779c1d-45c5-495c-908f-f35fab668ff0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:25.753185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3779c1d-45c5-495c-908f-f35fab668ff0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:25.754294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3779c1d-45c5-495c-908f-f35fab668ff0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:25.754809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3779c1d-45c5-495c-908f-f35fab668ff0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:25.802761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-30eba91b-1a54-4009-a7c6-44b9abd4b163 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:25.865054 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-30eba91b-1a54-4009-a7c6-44b9abd4b163 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1927 microversion: 2.75 time: 0.380705 Aug 27 02:30:25.866128 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 402/750] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:25 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1927 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:26.494911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5f3d31f6-0529-4095-b3d0-e888570cb2da tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:26.498147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5f3d31f6-0529-4095-b3d0-e888570cb2da tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:26.508567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3d31f6-0529-4095-b3d0-e888570cb2da tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:26.510206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3d31f6-0529-4095-b3d0-e888570cb2da tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:26.510949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3d31f6-0529-4095-b3d0-e888570cb2da tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:26.516773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3d31f6-0529-4095-b3d0-e888570cb2da tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:26.518329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3d31f6-0529-4095-b3d0-e888570cb2da tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:26.520052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3d31f6-0529-4095-b3d0-e888570cb2da tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:26.769455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c3779c1d-45c5-495c-908f-f35fab668ff0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:26.798941 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c3779c1d-45c5-495c-908f-f35fab668ff0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1310 microversion: 2.1 time: 1.074501 Aug 27 02:30:26.804010 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 349/751] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:25 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1310 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:26.826745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-bf5ac4ca-a98e-4e6a-add9-1c518e99472b req-74ca1ebc-18c4-4ab8-b066-b573e244b4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a64c1c4e-361d-4e27-93e7-7f3e474f8b77", "tag": "3f4d5112-f091-40ec-9ce1-c24927fb8be5"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:26.863688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf5ac4ca-a98e-4e6a-add9-1c518e99472b req-74ca1ebc-18c4-4ab8-b066-b573e244b4ff service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:26.864873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf5ac4ca-a98e-4e6a-add9-1c518e99472b req-74ca1ebc-18c4-4ab8-b066-b573e244b4ff service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:26.866098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf5ac4ca-a98e-4e6a-add9-1c518e99472b req-74ca1ebc-18c4-4ab8-b066-b573e244b4ff service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:26.907664 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-bf5ac4ca-a98e-4e6a-add9-1c518e99472b req-74ca1ebc-18c4-4ab8-b066-b573e244b4ff service nova] Creating event network-changed:3f4d5112-f091-40ec-9ce1-c24927fb8be5 for instance a64c1c4e-361d-4e27-93e7-7f3e474f8b77 on n-h2-852084-5 Aug 27 02:30:26.924351 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-bf5ac4ca-a98e-4e6a-add9-1c518e99472b req-74ca1ebc-18c4-4ab8-b066-b573e244b4ff service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116598 Aug 27 02:30:26.927760 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 350/752] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:26.943569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-a882dde7-0987-4966-9eb1-fb28fd28d492 req-ec2e8a79-4d5f-44a3-9d7e-6f70ec28f472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb58870-9a8e-4554-9db9-3324b90798bd", "tag": "20a61385-68a9-4de4-a5d6-a37c714f8b9e"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:26.965491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a882dde7-0987-4966-9eb1-fb28fd28d492 req-ec2e8a79-4d5f-44a3-9d7e-6f70ec28f472 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:26.967120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a882dde7-0987-4966-9eb1-fb28fd28d492 req-ec2e8a79-4d5f-44a3-9d7e-6f70ec28f472 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:26.968919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a882dde7-0987-4966-9eb1-fb28fd28d492 req-ec2e8a79-4d5f-44a3-9d7e-6f70ec28f472 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:26.993223 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a882dde7-0987-4966-9eb1-fb28fd28d492 req-ec2e8a79-4d5f-44a3-9d7e-6f70ec28f472 service nova] Creating event network-changed:20a61385-68a9-4de4-a5d6-a37c714f8b9e for instance 5fb58870-9a8e-4554-9db9-3324b90798bd on n-h1-852084-5 Aug 27 02:30:26.999183 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-a882dde7-0987-4966-9eb1-fb28fd28d492 req-ec2e8a79-4d5f-44a3-9d7e-6f70ec28f472 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068881 Aug 27 02:30:27.000361 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 351/753] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:27.007236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-454b7747-689f-4a3d-a2f0-f06472690c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:27.008163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-454b7747-689f-4a3d-a2f0-f06472690c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:27.017236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-454b7747-689f-4a3d-a2f0-f06472690c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:27.018199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-454b7747-689f-4a3d-a2f0-f06472690c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:27.018879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-454b7747-689f-4a3d-a2f0-f06472690c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:27.020440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-454b7747-689f-4a3d-a2f0-f06472690c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:27.021034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-454b7747-689f-4a3d-a2f0-f06472690c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:27.021575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-454b7747-689f-4a3d-a2f0-f06472690c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:27.027107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:27.655329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5f3d31f6-0529-4095-b3d0-e888570cb2da tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:27.699941 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f3d31f6-0529-4095-b3d0-e888570cb2da tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1318 microversion: 2.1 time: 1.213064 Aug 27 02:30:27.705648 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 403/754] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:26 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1318 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:27.714536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5eafd2f8-efdc-40b0-99e2-61a68e14802a tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:27.720630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5eafd2f8-efdc-40b0-99e2-61a68e14802a tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:27.758086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eafd2f8-efdc-40b0-99e2-61a68e14802a tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:27.759662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eafd2f8-efdc-40b0-99e2-61a68e14802a tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:27.760781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eafd2f8-efdc-40b0-99e2-61a68e14802a tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:27.762738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eafd2f8-efdc-40b0-99e2-61a68e14802a tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:27.764228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eafd2f8-efdc-40b0-99e2-61a68e14802a tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:27.770018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eafd2f8-efdc-40b0-99e2-61a68e14802a tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:28.139481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-5eafd2f8-efdc-40b0-99e2-61a68e14802a tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:28.214902 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5eafd2f8-efdc-40b0-99e2-61a68e14802a tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1933 microversion: 2.75 time: 0.506943 Aug 27 02:30:28.230770 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 404/755] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:27 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1933 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:28.274733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-96d547e8-368e-4e9e-854e-2af519d1b927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:28.277129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-96d547e8-368e-4e9e-854e-2af519d1b927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:28.291815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96d547e8-368e-4e9e-854e-2af519d1b927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:28.293022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96d547e8-368e-4e9e-854e-2af519d1b927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:28.297751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96d547e8-368e-4e9e-854e-2af519d1b927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:28.315211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96d547e8-368e-4e9e-854e-2af519d1b927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:28.318601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96d547e8-368e-4e9e-854e-2af519d1b927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:28.321141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96d547e8-368e-4e9e-854e-2af519d1b927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:28.375465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-454b7747-689f-4a3d-a2f0-f06472690c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:28.468564 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-454b7747-689f-4a3d-a2f0-f06472690c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1463 microversion: 2.1 time: 1.466377 Aug 27 02:30:28.469602 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 352/756] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:27 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1463 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:28.525585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cc1ad2b8-973d-4110-b1e9-fb8faf7d04f3 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:28.528267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cc1ad2b8-973d-4110-b1e9-fb8faf7d04f3 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:28.542755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc1ad2b8-973d-4110-b1e9-fb8faf7d04f3 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:28.544199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc1ad2b8-973d-4110-b1e9-fb8faf7d04f3 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:28.545225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc1ad2b8-973d-4110-b1e9-fb8faf7d04f3 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:28.546820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc1ad2b8-973d-4110-b1e9-fb8faf7d04f3 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:28.549048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc1ad2b8-973d-4110-b1e9-fb8faf7d04f3 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:28.550209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc1ad2b8-973d-4110-b1e9-fb8faf7d04f3 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:29.402122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-96d547e8-368e-4e9e-854e-2af519d1b927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:29.406686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:29.416618 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-96d547e8-368e-4e9e-854e-2af519d1b927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1494 microversion: 2.1 time: 1.184120 Aug 27 02:30:29.421040 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 405/757] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:28 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1494 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:29.435467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-406875eb-a98f-4275-b7a3-72598d7dac6a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:29.436657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-406875eb-a98f-4275-b7a3-72598d7dac6a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:29.463376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-406875eb-a98f-4275-b7a3-72598d7dac6a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:29.463376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-406875eb-a98f-4275-b7a3-72598d7dac6a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:29.463939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-406875eb-a98f-4275-b7a3-72598d7dac6a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:29.464989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-406875eb-a98f-4275-b7a3-72598d7dac6a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:29.465937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-406875eb-a98f-4275-b7a3-72598d7dac6a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:29.466635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-406875eb-a98f-4275-b7a3-72598d7dac6a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:29.768813 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cc1ad2b8-973d-4110-b1e9-fb8faf7d04f3 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1614 microversion: 2.1 time: 1.258975 Aug 27 02:30:29.789022 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 353/758] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:28 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1614 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:29.807156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7f7ac462-d62a-4976-92e8-0a6605c98a62 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:29.811258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7f7ac462-d62a-4976-92e8-0a6605c98a62 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:29.831455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f7ac462-d62a-4976-92e8-0a6605c98a62 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:29.832334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f7ac462-d62a-4976-92e8-0a6605c98a62 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:29.834484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f7ac462-d62a-4976-92e8-0a6605c98a62 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:29.837552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f7ac462-d62a-4976-92e8-0a6605c98a62 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:29.839286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f7ac462-d62a-4976-92e8-0a6605c98a62 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:29.841101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f7ac462-d62a-4976-92e8-0a6605c98a62 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:29.924441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-406875eb-a98f-4275-b7a3-72598d7dac6a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:29.952614 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-406875eb-a98f-4275-b7a3-72598d7dac6a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1318 microversion: 2.1 time: 0.530203 Aug 27 02:30:29.953772 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 406/759] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:29 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:30.579193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2cb4376d-ce36-4c04-8cf3-1b972c9e4397 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:30.581440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2cb4376d-ce36-4c04-8cf3-1b972c9e4397 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:30.622425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4376d-ce36-4c04-8cf3-1b972c9e4397 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:30.624096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4376d-ce36-4c04-8cf3-1b972c9e4397 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:30.628863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4376d-ce36-4c04-8cf3-1b972c9e4397 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:30.632314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4376d-ce36-4c04-8cf3-1b972c9e4397 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:30.635261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4376d-ce36-4c04-8cf3-1b972c9e4397 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:30.638805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4376d-ce36-4c04-8cf3-1b972c9e4397 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:31.010469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-7f7ac462-d62a-4976-92e8-0a6605c98a62 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:31.064795 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7f7ac462-d62a-4976-92e8-0a6605c98a62 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1933 microversion: 2.75 time: 1.266449 Aug 27 02:30:31.068870 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 354/760] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:29 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1933 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:31.077927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b87ea138-376d-4d2d-a9b0-0f4e75ee2b75 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '.version_select at 0x7f4d2acac160>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:31.091372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b87ea138-376d-4d2d-a9b0-0f4e75ee2b75 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:31.098233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b87ea138-376d-4d2d-a9b0-0f4e75ee2b75 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:31.102215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b87ea138-376d-4d2d-a9b0-0f4e75ee2b75 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:31.127841 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b87ea138-376d-4d2d-a9b0-0f4e75ee2b75 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.051246 Aug 27 02:30:31.130572 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 355/761] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:30:31 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:31.238672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-51ac0ddc-b415-4919-904b-60fc9d25a101 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Action: 'create', calling method: .version_select at 0x7f4d2ac5b280>, body: {"keypair": {"name": "tempest-keypair-2065841744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpLEStXkZ8acyhFoBxyVXnIlDlj+gL/wDsdh1c91A93wwsu0Lqil0Qp36gln5KqnxDHrXC7VUItm2R/dWfnXQZLDd/3sAKchPjs27l0RnP+yRh7jAetaXzEggiuhLuqvA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:31.263573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-51ac0ddc-b415-4919-904b-60fc9d25a101 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Getting quotas for project a744f5cd3f9d4610bee3c18b9f12a711. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:31.287132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-51ac0ddc-b415-4919-904b-60fc9d25a101 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Getting quotas for user f2a8fa4ffc5b4de6a338c481b275aedb and project a744f5cd3f9d4610bee3c18b9f12a711. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:31.288045 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2cb4376d-ce36-4c04-8cf3-1b972c9e4397 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1645 microversion: 2.1 time: 1.325686 Aug 27 02:30:31.289001 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 407/762] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:29 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1645 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:31.304634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b6cfd9d8-c9af-4034-95fe-b362ae825678 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:31.309350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b6cfd9d8-c9af-4034-95fe-b362ae825678 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:31.327601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6cfd9d8-c9af-4034-95fe-b362ae825678 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:31.328498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6cfd9d8-c9af-4034-95fe-b362ae825678 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:31.329196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6cfd9d8-c9af-4034-95fe-b362ae825678 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:31.330241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6cfd9d8-c9af-4034-95fe-b362ae825678 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:31.345096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6cfd9d8-c9af-4034-95fe-b362ae825678 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:31.345924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6cfd9d8-c9af-4034-95fe-b362ae825678 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:31.422008 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-51ac0ddc-b415-4919-904b-60fc9d25a101 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.257055 Aug 27 02:30:31.429077 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 356/763] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:30:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:31.456216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-426dbb73-6baa-46fb-ac73-0b7f73ef265e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:31.460512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-426dbb73-6baa-46fb-ac73-0b7f73ef265e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:31.512588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-426dbb73-6baa-46fb-ac73-0b7f73ef265e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:31.526110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-426dbb73-6baa-46fb-ac73-0b7f73ef265e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:31.532539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-426dbb73-6baa-46fb-ac73-0b7f73ef265e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:31.543516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-426dbb73-6baa-46fb-ac73-0b7f73ef265e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:31.547140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-426dbb73-6baa-46fb-ac73-0b7f73ef265e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:31.551082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-426dbb73-6baa-46fb-ac73-0b7f73ef265e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:32.698293 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-426dbb73-6baa-46fb-ac73-0b7f73ef265e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1645 microversion: 2.1 time: 1.259282 Aug 27 02:30:32.714788 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 357/764] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:31 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1645 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:32.746002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-515942689", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:32.964684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:30:33.755935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6cfd9d8-c9af-4034-95fe-b362ae825678 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:33.808425 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b6cfd9d8-c9af-4034-95fe-b362ae825678 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1318 microversion: 2.1 time: 2.516002 Aug 27 02:30:33.812771 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 408/765] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:31 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1318 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:33.819078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0eb6108-c113-4589-bee4-fb46f623a711 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:33.820109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b0eb6108-c113-4589-bee4-fb46f623a711 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:33.830585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0eb6108-c113-4589-bee4-fb46f623a711 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:33.831664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0eb6108-c113-4589-bee4-fb46f623a711 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:33.832342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0eb6108-c113-4589-bee4-fb46f623a711 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:33.833898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0eb6108-c113-4589-bee4-fb46f623a711 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:33.834608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0eb6108-c113-4589-bee4-fb46f623a711 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:33.835269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0eb6108-c113-4589-bee4-fb46f623a711 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:34.125865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-b0eb6108-c113-4589-bee4-fb46f623a711 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] Lazy-loading 'services' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:34.151475 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b0eb6108-c113-4589-bee4-fb46f623a711 tempest-ServersAdmin275Test-1516241859 tempest-ServersAdmin275Test-1516241859-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1918 microversion: 2.75 time: 0.336887 Aug 27 02:30:34.152464 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 409/766] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:33 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1918 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:34.162127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ce1d1db1-54af-43a9-b492-cb75c082bbb0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:34.170320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1d1db1-54af-43a9-b492-cb75c082bbb0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:34.171221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1d1db1-54af-43a9-b492-cb75c082bbb0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:34.172447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1d1db1-54af-43a9-b492-cb75c082bbb0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:34.175104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1d1db1-54af-43a9-b492-cb75c082bbb0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:34.176043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1d1db1-54af-43a9-b492-cb75c082bbb0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:34.177118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce1d1db1-54af-43a9-b492-cb75c082bbb0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:34.293201 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ce1d1db1-54af-43a9-b492-cb75c082bbb0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.134553 Aug 27 02:30:34.296861 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 410/767] 10.222.0.99 () {58 vars in 1176 bytes} [Sat Aug 27 02:30:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:34.313620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d9d5b1b4-c86d-4d0a-996d-9649df572313 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:34.320275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d9d5b1b4-c86d-4d0a-996d-9649df572313 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:34.335203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9d5b1b4-c86d-4d0a-996d-9649df572313 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:34.336795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9d5b1b4-c86d-4d0a-996d-9649df572313 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:34.338833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9d5b1b4-c86d-4d0a-996d-9649df572313 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:34.340546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9d5b1b4-c86d-4d0a-996d-9649df572313 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:34.341825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9d5b1b4-c86d-4d0a-996d-9649df572313 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:34.342936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9d5b1b4-c86d-4d0a-996d-9649df572313 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:34.416489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:30:34.424604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:30:34.426827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:30:34.458489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:30:34.459957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:30:34.498628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d9d5b1b4-c86d-4d0a-996d-9649df572313 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:30:34.528575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:34.535739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:34.545450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:34.551727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:34.553093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:34.554021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:34.700954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:34.742118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for user d1624ef00b144dafbaff7ae5c677e7a3 and project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:34.811414 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d9d5b1b4-c86d-4d0a-996d-9649df572313 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "DELETE /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 204 len: 0 microversion: 2.75 time: 0.511098 Aug 27 02:30:34.822916 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 411/768] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:30:34 2022] DELETE /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:30:34.829480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f351c81b-e20b-4f39-b0a0-464027ee04e1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852084-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:34.841025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f351c81b-e20b-4f39-b0a0-464027ee04e1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:34.859637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f351c81b-e20b-4f39-b0a0-464027ee04e1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:34.860319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f351c81b-e20b-4f39-b0a0-464027ee04e1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:34.860787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f351c81b-e20b-4f39-b0a0-464027ee04e1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:34.861509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f351c81b-e20b-4f39-b0a0-464027ee04e1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:34.862099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f351c81b-e20b-4f39-b0a0-464027ee04e1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:34.862546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f351c81b-e20b-4f39-b0a0-464027ee04e1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:34.885498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:30:34.924600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:30:34.950667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-f351c81b-e20b-4f39-b0a0-464027ee04e1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lazy-loading 'flavor' on Instance uuid 9a0d3c43-6a69-49d1-8e43-494b70e6b635 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:34.971718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f351c81b-e20b-4f39-b0a0-464027ee04e1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Going to try to live migrate instance to n-h1-852084-5 {{(pid=122488) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:30:35.256883 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0cc20dd0-7af2-4f18-9610-f5506c3a27c4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.540309 Aug 27 02:30:35.259193 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 358/769] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:30:35.264488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:35.265111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:35.302560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:35.310948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:35.311920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:35.313790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:35.315552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:35.318442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:36.342869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:36.373797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:36.377918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:36.404220 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-941bcb2b-82c7-444d-a1d7-cfc5f8d0c5ec tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1443 microversion: 2.75 time: 1.143685 Aug 27 02:30:36.409031 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 359/770] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:35 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1443 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:36.433953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c6a8756d-4700-41b7-8b27-e0ff9dbf92c4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:36.443386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c6a8756d-4700-41b7-8b27-e0ff9dbf92c4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:36.479756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6a8756d-4700-41b7-8b27-e0ff9dbf92c4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:36.482406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6a8756d-4700-41b7-8b27-e0ff9dbf92c4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:36.485524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6a8756d-4700-41b7-8b27-e0ff9dbf92c4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:36.486957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6a8756d-4700-41b7-8b27-e0ff9dbf92c4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:36.492735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6a8756d-4700-41b7-8b27-e0ff9dbf92c4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:36.493500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6a8756d-4700-41b7-8b27-e0ff9dbf92c4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:37.876290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c6a8756d-4700-41b7-8b27-e0ff9dbf92c4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:37.905456 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c6a8756d-4700-41b7-8b27-e0ff9dbf92c4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1318 microversion: 2.1 time: 1.493420 Aug 27 02:30:37.908004 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 360/771] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:36 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1318 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:37.925853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-86c3bdbc-452f-47b8-b7c8-cd59b5f9f77b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:37.929723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-86c3bdbc-452f-47b8-b7c8-cd59b5f9f77b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:37.961442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c3bdbc-452f-47b8-b7c8-cd59b5f9f77b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:37.962013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c3bdbc-452f-47b8-b7c8-cd59b5f9f77b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:37.962499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c3bdbc-452f-47b8-b7c8-cd59b5f9f77b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:37.963276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c3bdbc-452f-47b8-b7c8-cd59b5f9f77b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:37.963757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c3bdbc-452f-47b8-b7c8-cd59b5f9f77b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:37.964201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86c3bdbc-452f-47b8-b7c8-cd59b5f9f77b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:39.356333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-86c3bdbc-452f-47b8-b7c8-cd59b5f9f77b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:39.380273 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-86c3bdbc-452f-47b8-b7c8-cd59b5f9f77b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1216 microversion: 2.1 time: 1.469576 Aug 27 02:30:39.381604 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 361/772] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:37 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1216 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:39.396127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:39.397292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:39.442432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:39.445608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:39.449913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:39.450916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:39.453364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:39.458880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:39.572331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:39.572839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:39.574283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:39.574981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lazy-loading 'fault' on Instance uuid 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:30:40.017604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:40.032365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:40.047271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e686bfcef314e05b97f79abd9c7bfaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d57afff18784d52bfa6d3d22beef36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:40.073796 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1a4557ed-b9b6-4442-a353-3f8ecda31b90 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 200 len: 1448 microversion: 2.75 time: 0.690270 Aug 27 02:30:40.082328 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 362/773] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:39 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 1448 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:30:40.093146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-32a2f3d7-d112-4891-aeb5-8e85da289ea0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:40.096450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-32a2f3d7-d112-4891-aeb5-8e85da289ea0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:40.115651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32a2f3d7-d112-4891-aeb5-8e85da289ea0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:40.119742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32a2f3d7-d112-4891-aeb5-8e85da289ea0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:40.122022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32a2f3d7-d112-4891-aeb5-8e85da289ea0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:40.125522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32a2f3d7-d112-4891-aeb5-8e85da289ea0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:40.132130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32a2f3d7-d112-4891-aeb5-8e85da289ea0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:40.139764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32a2f3d7-d112-4891-aeb5-8e85da289ea0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:41.042683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-32a2f3d7-d112-4891-aeb5-8e85da289ea0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:41.044082 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f351c81b-e20b-4f39-b0a0-464027ee04e1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635/action" status: 202 len: 0 microversion: 2.1 time: 6.226593 Aug 27 02:30:41.045656 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 412/774] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:30:34 2022] POST /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635/action => generated 0 bytes in 6230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:30:41.051174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd564c89-9d2e-4f63-88aa-c9cff1aa1ef6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:41.053605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd564c89-9d2e-4f63-88aa-c9cff1aa1ef6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:41.061170 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-32a2f3d7-d112-4891-aeb5-8e85da289ea0 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1318 microversion: 2.1 time: 0.975980 Aug 27 02:30:41.067216 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 363/775] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:40 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1318 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:41.086374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-b7867c70-eb8e-4b22-9973-1aedfd3ecf12 req-13906907-5314-4617-be12-ed898173f052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb58870-9a8e-4554-9db9-3324b90798bd", "name": "network-vif-plugged", "status": "completed", "tag": "20a61385-68a9-4de4-a5d6-a37c714f8b9e"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:41.100360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd564c89-9d2e-4f63-88aa-c9cff1aa1ef6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:41.100786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd564c89-9d2e-4f63-88aa-c9cff1aa1ef6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:41.101239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd564c89-9d2e-4f63-88aa-c9cff1aa1ef6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:41.102043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd564c89-9d2e-4f63-88aa-c9cff1aa1ef6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:41.109275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd564c89-9d2e-4f63-88aa-c9cff1aa1ef6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:41.111777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd564c89-9d2e-4f63-88aa-c9cff1aa1ef6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:41.118204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b7867c70-eb8e-4b22-9973-1aedfd3ecf12 req-13906907-5314-4617-be12-ed898173f052 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:41.125329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b7867c70-eb8e-4b22-9973-1aedfd3ecf12 req-13906907-5314-4617-be12-ed898173f052 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:41.126396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b7867c70-eb8e-4b22-9973-1aedfd3ecf12 req-13906907-5314-4617-be12-ed898173f052 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:41.160377 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-b7867c70-eb8e-4b22-9973-1aedfd3ecf12 req-13906907-5314-4617-be12-ed898173f052 service nova] Creating event network-vif-plugged:20a61385-68a9-4de4-a5d6-a37c714f8b9e for instance 5fb58870-9a8e-4554-9db9-3324b90798bd on n-h1-852084-5 Aug 27 02:30:41.180832 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-b7867c70-eb8e-4b22-9973-1aedfd3ecf12 req-13906907-5314-4617-be12-ed898173f052 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110402 Aug 27 02:30:41.182880 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 364/776] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:41.203394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-29121087-ee13-4f37-a295-c21368536953 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:41.208655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-29121087-ee13-4f37-a295-c21368536953 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:41.235866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29121087-ee13-4f37-a295-c21368536953 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:41.241410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29121087-ee13-4f37-a295-c21368536953 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:41.247178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29121087-ee13-4f37-a295-c21368536953 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:41.255104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29121087-ee13-4f37-a295-c21368536953 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:41.279352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29121087-ee13-4f37-a295-c21368536953 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:41.282743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29121087-ee13-4f37-a295-c21368536953 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:41.299042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd564c89-9d2e-4f63-88aa-c9cff1aa1ef6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:41.354353 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd564c89-9d2e-4f63-88aa-c9cff1aa1ef6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1270 microversion: 2.1 time: 0.304257 Aug 27 02:30:41.387814 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 413/777] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:41 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1270 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:41.407353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:41.410488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] [instance: 29c76fd9-ae70-48ab-8f33-11ba75bb45e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:41.425168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:41.426494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:41.427646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:41.429186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:41.430277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:41.432568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:41.467111 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] HTTP exception thrown: Instance 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 could not be found. Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Request method failure captured: Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 HTTP/1.1 Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYF097uFquXozxHINML-MaqIHdIvgmP1Qy-oaOc59L5DrTOLKehDpRlcd6nU4OczrJic0snbHzixg6jEcDxEWRHFu1F49e1uL4-wzl8fIQ8MNsAVrAAk_54BeT2-rD4_R6RPn3TK2tClVS2YwAhDh51Y_Z8e6DzwwyLTQqWOFp1JLfI Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.75 Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 8d57afff18784d52bfa6d3d22beef36f Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdmin275Test-633858940 Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8d57afff18784d52bfa6d3d22beef36f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8d57afff18784d52bfa6d3d22beef36f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8d57afff18784d52bfa6d3d22beef36f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8d57afff18784d52bfa6d3d22beef36f"}]}] Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdmin275Test-633858940 Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 8d57afff18784d52bfa6d3d22beef36f Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdmin275Test-633858940 Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdmin275Test-633858940-project Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 2e686bfcef314e05b97f79abd9c7bfaa Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdmin275Test-633858940-project Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 could not be found. Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '29c76fd9-ae70-48ab-8f33-11ba75bb45e3'} Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 could not be found. Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 could not be found. Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:41.471873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:41.484040 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:41.484040 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:41.484040 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:41.484040 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:41.484040 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:41.484040 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 could not be found. Aug 27 02:30:41.484040 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:41.488152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] Returning 404 to user: Instance 29c76fd9-ae70-48ab-8f33-11ba75bb45e3 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:41.490638 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9c5cd26e-d276-4eeb-9934-e8f2882913b6 tempest-ServersAdmin275Test-633858940 tempest-ServersAdmin275Test-633858940-project] 10.222.0.99 "GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3" status: 404 len: 111 microversion: 2.75 time: 0.097722 Aug 27 02:30:41.492061 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 414/778] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:30:41 2022] GET /compute/v2.1/servers/29c76fd9-ae70-48ab-8f33-11ba75bb45e3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:30:42.091613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d216768f-026f-486c-a14a-507b688947a6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:42.093190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d216768f-026f-486c-a14a-507b688947a6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:42.104996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d216768f-026f-486c-a14a-507b688947a6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:42.118716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d216768f-026f-486c-a14a-507b688947a6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:42.125702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d216768f-026f-486c-a14a-507b688947a6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:42.133016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d216768f-026f-486c-a14a-507b688947a6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:42.138656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d216768f-026f-486c-a14a-507b688947a6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:42.139801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d216768f-026f-486c-a14a-507b688947a6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:42.822216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d216768f-026f-486c-a14a-507b688947a6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:42.834458 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d216768f-026f-486c-a14a-507b688947a6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1318 microversion: 2.1 time: 0.746803 Aug 27 02:30:42.849284 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 415/779] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:42 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1318 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:42.883483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e584d879-a489-4d62-b5eb-37f67c21ad41 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:42.887576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e584d879-a489-4d62-b5eb-37f67c21ad41 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:42.940985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e584d879-a489-4d62-b5eb-37f67c21ad41 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:42.944790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e584d879-a489-4d62-b5eb-37f67c21ad41 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:42.946880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e584d879-a489-4d62-b5eb-37f67c21ad41 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:42.948751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e584d879-a489-4d62-b5eb-37f67c21ad41 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:42.950071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e584d879-a489-4d62-b5eb-37f67c21ad41 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:42.950995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e584d879-a489-4d62-b5eb-37f67c21ad41 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:43.158525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-29121087-ee13-4f37-a295-c21368536953 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:43.209477 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-29121087-ee13-4f37-a295-c21368536953 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1504 microversion: 2.1 time: 2.019739 Aug 27 02:30:43.213065 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 365/780] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:41 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1504 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:43.588700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2b84e1f9-1e28-40c9-8003-de2b2374a0a5 req-a8c1fd49-6730-4d6e-a0d1-2573da7b07c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64c1c4e-361d-4e27-93e7-7f3e474f8b77", "name": "network-vif-plugged", "status": "completed", "tag": "3f4d5112-f091-40ec-9ce1-c24927fb8be5"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:43.687227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:43.698235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2b84e1f9-1e28-40c9-8003-de2b2374a0a5 req-a8c1fd49-6730-4d6e-a0d1-2573da7b07c4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:43.698746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2b84e1f9-1e28-40c9-8003-de2b2374a0a5 req-a8c1fd49-6730-4d6e-a0d1-2573da7b07c4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:43.699199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2b84e1f9-1e28-40c9-8003-de2b2374a0a5 req-a8c1fd49-6730-4d6e-a0d1-2573da7b07c4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:43.751260 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2b84e1f9-1e28-40c9-8003-de2b2374a0a5 req-a8c1fd49-6730-4d6e-a0d1-2573da7b07c4 service nova] Creating event network-vif-plugged:3f4d5112-f091-40ec-9ce1-c24927fb8be5 for instance a64c1c4e-361d-4e27-93e7-7f3e474f8b77 on n-h2-852084-5 Aug 27 02:30:43.816340 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2b84e1f9-1e28-40c9-8003-de2b2374a0a5 req-a8c1fd49-6730-4d6e-a0d1-2573da7b07c4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266551 Aug 27 02:30:43.817623 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 366/781] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:43.861096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-32166b98-8b71-4314-900b-84006a82602f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:43.862110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-32166b98-8b71-4314-900b-84006a82602f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:43.894121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32166b98-8b71-4314-900b-84006a82602f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:43.914519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32166b98-8b71-4314-900b-84006a82602f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:43.917290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32166b98-8b71-4314-900b-84006a82602f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:43.918946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32166b98-8b71-4314-900b-84006a82602f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:43.921190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32166b98-8b71-4314-900b-84006a82602f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:43.923590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32166b98-8b71-4314-900b-84006a82602f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:44.235724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:44.268281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e584d879-a489-4d62-b5eb-37f67c21ad41 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:44.286287 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e584d879-a489-4d62-b5eb-37f67c21ad41 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1312 microversion: 2.1 time: 1.428383 Aug 27 02:30:44.287582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 416/782] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:42 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1312 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:44.305315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f3754b1-ea17-431a-ac03-7056ed9c7fb7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:44.308210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6f3754b1-ea17-431a-ac03-7056ed9c7fb7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:44.337410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f3754b1-ea17-431a-ac03-7056ed9c7fb7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:44.341883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f3754b1-ea17-431a-ac03-7056ed9c7fb7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:44.360470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f3754b1-ea17-431a-ac03-7056ed9c7fb7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:44.363208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f3754b1-ea17-431a-ac03-7056ed9c7fb7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:44.368104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f3754b1-ea17-431a-ac03-7056ed9c7fb7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:44.371758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f3754b1-ea17-431a-ac03-7056ed9c7fb7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:44.603611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:44.836240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:44.879642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6f3754b1-ea17-431a-ac03-7056ed9c7fb7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:44.889391 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6f3754b1-ea17-431a-ac03-7056ed9c7fb7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1504 microversion: 2.1 time: 0.599600 Aug 27 02:30:44.890805 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 417/783] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:44 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1504 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:44.908456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1081466496", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a0adeb22-4562-4820-b2e0-4bf3a90e7cd9"}], "security_groups": [{"name": "tempest-securitygroup--1951018486"}], "key_name": "tempest-keypair-2065841744", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:44.982700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-32166b98-8b71-4314-900b-84006a82602f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:45.038338 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-32166b98-8b71-4314-900b-84006a82602f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1318 microversion: 2.1 time: 1.172908 Aug 27 02:30:45.043582 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 367/784] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:43 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1318 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:45.075319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8617ea3d-4aed-4203-8df0-ff9e4ad977b1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2ad95940>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:45.180490 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8617ea3d-4aed-4203-8df0-ff9e4ad977b1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/69a544ef-6f5e-4a03-afb5-8c49623cdf47" status: 200 len: 662 microversion: 2.1 time: 0.132011 Aug 27 02:30:45.181699 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 368/785] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:30:45 2022] GET /compute/v2.1/images/69a544ef-6f5e-4a03-afb5-8c49623cdf47 => generated 662 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:45.183030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] validate_networks() for [('a0adeb22-4562-4820-b2e0-4bf3a90e7cd9', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:30:45.209148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a78d1dc-5da3-4f07-8224-220f2aeaad26 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a8f3280>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:45.332723 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a78d1dc-5da3-4f07-8224-220f2aeaad26 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/69a544ef-6f5e-4a03-afb5-8c49623cdf47" status: 200 len: 662 microversion: 2.1 time: 0.129472 Aug 27 02:30:45.351081 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 369/786] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:30:45 2022] GET /compute/v2.1/images/69a544ef-6f5e-4a03-afb5-8c49623cdf47 => generated 662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:45.382087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ad6b7ec5-29fb-4bc8-9253-2dc10a2959b3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:45.395354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ad6b7ec5-29fb-4bc8-9253-2dc10a2959b3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:45.467599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad6b7ec5-29fb-4bc8-9253-2dc10a2959b3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:45.490878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad6b7ec5-29fb-4bc8-9253-2dc10a2959b3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:45.491756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad6b7ec5-29fb-4bc8-9253-2dc10a2959b3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:45.494352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad6b7ec5-29fb-4bc8-9253-2dc10a2959b3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:45.496904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad6b7ec5-29fb-4bc8-9253-2dc10a2959b3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:45.514181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad6b7ec5-29fb-4bc8-9253-2dc10a2959b3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:46.866307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ad6b7ec5-29fb-4bc8-9253-2dc10a2959b3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:46.879766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Getting quotas for project a744f5cd3f9d4610bee3c18b9f12a711. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:46.895243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Getting quotas for user f2a8fa4ffc5b4de6a338c481b275aedb and project a744f5cd3f9d4610bee3c18b9f12a711. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:46.913911 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ad6b7ec5-29fb-4bc8-9253-2dc10a2959b3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1312 microversion: 2.1 time: 1.561062 Aug 27 02:30:46.914789 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 370/787] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:45 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1312 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:46.931424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-20197f5a-13d4-48f1-8f59-4573e46328d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:46.932985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-20197f5a-13d4-48f1-8f59-4573e46328d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:46.942053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:30:46.948277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:30:46.949029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:30:46.954275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:30:46.956170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20197f5a-13d4-48f1-8f59-4573e46328d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:46.956936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:30:46.959640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20197f5a-13d4-48f1-8f59-4573e46328d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:46.960989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20197f5a-13d4-48f1-8f59-4573e46328d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:46.966964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20197f5a-13d4-48f1-8f59-4573e46328d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:46.969181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20197f5a-13d4-48f1-8f59-4573e46328d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:46.970235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20197f5a-13d4-48f1-8f59-4573e46328d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:46.989812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:46.990970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:46.999034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:47.005559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:47.013914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:47.014866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:47.082526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Getting quotas for project a744f5cd3f9d4610bee3c18b9f12a711. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:47.091252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Getting quotas for user f2a8fa4ffc5b4de6a338c481b275aedb and project a744f5cd3f9d4610bee3c18b9f12a711. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:47.116993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:30:47.122776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:30:47.301313 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5bded957-c163-453a-b6b6-ec745105f817 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.407520 Aug 27 02:30:47.305844 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 418/788] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:30:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 2414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:30:47.332080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a63a5021-8161-4a9f-b4c1-8618fe4dc408 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:47.333155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a63a5021-8161-4a9f-b4c1-8618fe4dc408 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:47.361914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a63a5021-8161-4a9f-b4c1-8618fe4dc408 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:47.366507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a63a5021-8161-4a9f-b4c1-8618fe4dc408 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:47.367267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a63a5021-8161-4a9f-b4c1-8618fe4dc408 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:47.368695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a63a5021-8161-4a9f-b4c1-8618fe4dc408 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:47.369824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a63a5021-8161-4a9f-b4c1-8618fe4dc408 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:47.370774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a63a5021-8161-4a9f-b4c1-8618fe4dc408 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:47.765472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-20197f5a-13d4-48f1-8f59-4573e46328d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:47.777879 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-20197f5a-13d4-48f1-8f59-4573e46328d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1504 microversion: 2.1 time: 0.861811 Aug 27 02:30:47.781351 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 371/789] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:46 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1504 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:47.791858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb5ffaf6-da94-43da-8c60-0047095a5a48 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:47.799015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fb5ffaf6-da94-43da-8c60-0047095a5a48 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:48.074906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fb5ffaf6-da94-43da-8c60-0047095a5a48 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:48.108604 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fb5ffaf6-da94-43da-8c60-0047095a5a48 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1278 microversion: 2.1 time: 0.322822 Aug 27 02:30:48.115414 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 372/790] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:47 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1278 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:48.129216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8773b467-cc58-4c30-9870-d2cee73357c1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2ac5b1f0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:48.274054 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8773b467-cc58-4c30-9870-d2cee73357c1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/127c2dda-121b-4fd9-bc1e-9cd930ddea53" status: 200 len: 662 microversion: 2.1 time: 0.156909 Aug 27 02:30:48.275439 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 373/791] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:30:48 2022] GET /compute/v2.1/images/127c2dda-121b-4fd9-bc1e-9cd930ddea53 => generated 662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:48.307947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c49e66a8-7c2e-4364-a266-8f8c552875ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:48.316401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c49e66a8-7c2e-4364-a266-8f8c552875ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:48.350834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c49e66a8-7c2e-4364-a266-8f8c552875ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:48.351277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a63a5021-8161-4a9f-b4c1-8618fe4dc408 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:48.354641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c49e66a8-7c2e-4364-a266-8f8c552875ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:48.355752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c49e66a8-7c2e-4364-a266-8f8c552875ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:48.360075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c49e66a8-7c2e-4364-a266-8f8c552875ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:48.361030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c49e66a8-7c2e-4364-a266-8f8c552875ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:48.361996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c49e66a8-7c2e-4364-a266-8f8c552875ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:48.367782 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a63a5021-8161-4a9f-b4c1-8618fe4dc408 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1468 microversion: 2.1 time: 1.058876 Aug 27 02:30:48.368736 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 419/792] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:47 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1468 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:48.373770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1b0fce98-7796-4a49-96ca-92e88a2ec3fb req-5ee2f19d-807a-42d8-8c9a-a1f75d06a10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91d1eeab-d777-433e-b23b-1d6bd540823d", "tag": "8fe72264-a971-4067-8e10-b097ab827266"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:48.413616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1b0fce98-7796-4a49-96ca-92e88a2ec3fb req-5ee2f19d-807a-42d8-8c9a-a1f75d06a10f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:48.421093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1b0fce98-7796-4a49-96ca-92e88a2ec3fb req-5ee2f19d-807a-42d8-8c9a-a1f75d06a10f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:48.425431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1b0fce98-7796-4a49-96ca-92e88a2ec3fb req-5ee2f19d-807a-42d8-8c9a-a1f75d06a10f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:48.497726 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1b0fce98-7796-4a49-96ca-92e88a2ec3fb req-5ee2f19d-807a-42d8-8c9a-a1f75d06a10f service nova] Creating event network-changed:8fe72264-a971-4067-8e10-b097ab827266 for instance 91d1eeab-d777-433e-b23b-1d6bd540823d on n-h2-852084-5 Aug 27 02:30:48.521284 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1b0fce98-7796-4a49-96ca-92e88a2ec3fb req-5ee2f19d-807a-42d8-8c9a-a1f75d06a10f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150660 Aug 27 02:30:48.524865 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 420/793] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:48.581992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0f45fbf6-9f09-44c1-85c2-16e708987cdd tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a76edc0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:48.714036 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0f45fbf6-9f09-44c1-85c2-16e708987cdd tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/127c2dda-121b-4fd9-bc1e-9cd930ddea53" status: 200 len: 662 microversion: 2.1 time: 0.171394 Aug 27 02:30:48.722811 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 421/794] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:30:48 2022] GET /compute/v2.1/images/127c2dda-121b-4fd9-bc1e-9cd930ddea53 => generated 662 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:48.746512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-47eb0faf-a06e-43e7-a0bd-aadae4ec2a53 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:48.751331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-47eb0faf-a06e-43e7-a0bd-aadae4ec2a53 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 5fb58870-9a8e-4554-9db9-3324b90798bd] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:48.778990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47eb0faf-a06e-43e7-a0bd-aadae4ec2a53 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:48.781011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47eb0faf-a06e-43e7-a0bd-aadae4ec2a53 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:48.782254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47eb0faf-a06e-43e7-a0bd-aadae4ec2a53 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:48.783926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47eb0faf-a06e-43e7-a0bd-aadae4ec2a53 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:48.786757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47eb0faf-a06e-43e7-a0bd-aadae4ec2a53 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:48.791864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47eb0faf-a06e-43e7-a0bd-aadae4ec2a53 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:48.809084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:49.450800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-47eb0faf-a06e-43e7-a0bd-aadae4ec2a53 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:49.491899 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-47eb0faf-a06e-43e7-a0bd-aadae4ec2a53 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd" status: 200 len: 1468 microversion: 2.1 time: 0.766706 Aug 27 02:30:49.493479 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 422/795] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:48 2022] GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd => generated 1468 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:49.533181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-58f478c0-27c5-4137-93c6-cbdad16c2f30 req-eb14c631-a3d6-4db4-989f-0c7d74b525b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0d3c43-6a69-49d1-8e43-494b70e6b635", "name": "network-vif-unplugged", "status": "completed", "tag": "ff877ceb-42f3-4570-8d29-21cefdf8c147"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:49.546402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-58f478c0-27c5-4137-93c6-cbdad16c2f30 req-eb14c631-a3d6-4db4-989f-0c7d74b525b5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:49.547166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-58f478c0-27c5-4137-93c6-cbdad16c2f30 req-eb14c631-a3d6-4db4-989f-0c7d74b525b5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:49.547751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-58f478c0-27c5-4137-93c6-cbdad16c2f30 req-eb14c631-a3d6-4db4-989f-0c7d74b525b5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:49.562318 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-58f478c0-27c5-4137-93c6-cbdad16c2f30 req-eb14c631-a3d6-4db4-989f-0c7d74b525b5 service nova] Creating event network-vif-unplugged:ff877ceb-42f3-4570-8d29-21cefdf8c147 for instance 9a0d3c43-6a69-49d1-8e43-494b70e6b635 on n-h2-852084-5 Aug 27 02:30:49.569771 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-58f478c0-27c5-4137-93c6-cbdad16c2f30 req-eb14c631-a3d6-4db4-989f-0c7d74b525b5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046656 Aug 27 02:30:49.570637 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 423/796] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:49.577138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4750465f-82ec-4519-9dda-927432586f21 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:49.578159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4750465f-82ec-4519-9dda-927432586f21 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:49.587878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4750465f-82ec-4519-9dda-927432586f21 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:49.589150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4750465f-82ec-4519-9dda-927432586f21 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:49.590191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4750465f-82ec-4519-9dda-927432586f21 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:49.591108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4750465f-82ec-4519-9dda-927432586f21 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:49.591730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4750465f-82ec-4519-9dda-927432586f21 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:49.592306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4750465f-82ec-4519-9dda-927432586f21 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:49.760199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c49e66a8-7c2e-4364-a266-8f8c552875ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:49.788413 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c49e66a8-7c2e-4364-a266-8f8c552875ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1312 microversion: 2.1 time: 1.503784 Aug 27 02:30:49.789932 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 374/797] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:48 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1312 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:49.813012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-364b9140-d5cb-44c6-80c5-ccd207c8f427 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:49.817580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-364b9140-d5cb-44c6-80c5-ccd207c8f427 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:49.840284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-364b9140-d5cb-44c6-80c5-ccd207c8f427 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:49.841709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-364b9140-d5cb-44c6-80c5-ccd207c8f427 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:49.845109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-364b9140-d5cb-44c6-80c5-ccd207c8f427 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:49.848957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-364b9140-d5cb-44c6-80c5-ccd207c8f427 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:49.850054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-364b9140-d5cb-44c6-80c5-ccd207c8f427 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:49.851723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-364b9140-d5cb-44c6-80c5-ccd207c8f427 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:50.047391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4750465f-82ec-4519-9dda-927432586f21 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:50.105082 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4750465f-82ec-4519-9dda-927432586f21 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1504 microversion: 2.1 time: 0.532788 Aug 27 02:30:50.111516 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 424/798] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:49 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:50.123096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:50.136513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:50.138511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Searching by: {'reservation_id': 'r-24c06hks', 'deleted': False, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:30:50.148946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:50.150148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:50.151037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:50.152568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:50.153429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:50.154267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:50.362929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:30:50.446893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-364b9140-d5cb-44c6-80c5-ccd207c8f427 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:50.464951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:50.478347 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-364b9140-d5cb-44c6-80c5-ccd207c8f427 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1330 microversion: 2.1 time: 0.686239 Aug 27 02:30:50.487820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:50.499022 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 375/799] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:49 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1330 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:50.507072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:50.508433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:50.509507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:50.704471 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-379083f6-8be8-4d5d-98f9-c73fadc97165 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/detail?reservation_id=r-24c06hks" status: 200 len: 2929 microversion: 2.1 time: 0.588128 Aug 27 02:30:50.705570 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 425/800] 10.222.0.99 () {58 vars in 1197 bytes} [Sat Aug 27 02:30:50 2022] GET /compute/v2.1/servers/detail?reservation_id=r-24c06hks => generated 2929 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:50.739832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33a65705-75f1-4a4e-b114-e7895405c970 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:50.819009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.compute.server_groups [None req-33a65705-75f1-4a4e-b114-e7895405c970 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Querying cell 8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) for 2 instances {{(pid=122488) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 02:30:50.820314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33a65705-75f1-4a4e-b114-e7895405c970 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:50.825548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33a65705-75f1-4a4e-b114-e7895405c970 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:50.826502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33a65705-75f1-4a4e-b114-e7895405c970 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:50.894654 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-33a65705-75f1-4a4e-b114-e7895405c970 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/os-server-groups/c9136a8f-16ae-4a04-9612-afce26a32373" status: 200 len: 269 microversion: 2.1 time: 0.166114 Aug 27 02:30:50.897735 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 426/801] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:30:50 2022] GET /compute/v2.1/os-server-groups/c9136a8f-16ae-4a04-9612-afce26a32373 => generated 269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:50.911620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-610fc639-586b-415a-9126-122abbeb9205 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:50.913473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-610fc639-586b-415a-9126-122abbeb9205 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:50.929800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-610fc639-586b-415a-9126-122abbeb9205 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:50.930974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-610fc639-586b-415a-9126-122abbeb9205 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:50.931879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-610fc639-586b-415a-9126-122abbeb9205 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:50.934110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-610fc639-586b-415a-9126-122abbeb9205 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:50.935588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-610fc639-586b-415a-9126-122abbeb9205 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:50.936826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-610fc639-586b-415a-9126-122abbeb9205 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:51.311572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aa008cc2-a152-4a15-9ac9-9e5041d7a109 tempest-FlavorsV2NegativeTest-75312656 tempest-FlavorsV2NegativeTest-75312656-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:51.324643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aa008cc2-a152-4a15-9ac9-9e5041d7a109 tempest-FlavorsV2NegativeTest-75312656 tempest-FlavorsV2NegativeTest-75312656-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.824483 Aug 27 02:30:51.326126 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 376/802] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:30:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:51.332401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-15bb406d-78fd-4b5b-9772-238d570c48e2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:51.333231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-15bb406d-78fd-4b5b-9772-238d570c48e2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] [instance: 5fb58870-9a8e-4554-9db9-3324b90798bd] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:51.340577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15bb406d-78fd-4b5b-9772-238d570c48e2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:51.341304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15bb406d-78fd-4b5b-9772-238d570c48e2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:51.341992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15bb406d-78fd-4b5b-9772-238d570c48e2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:51.342976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15bb406d-78fd-4b5b-9772-238d570c48e2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:51.343612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15bb406d-78fd-4b5b-9772-238d570c48e2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:51.344226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15bb406d-78fd-4b5b-9772-238d570c48e2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:51.722672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-610fc639-586b-415a-9126-122abbeb9205 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:51.743573 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-15bb406d-78fd-4b5b-9772-238d570c48e2 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd" status: 200 len: 1619 microversion: 2.1 time: 0.408076 Aug 27 02:30:51.744373 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 377/803] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:51 2022] GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd => generated 1619 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:51.768218 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-610fc639-586b-415a-9126-122abbeb9205 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1312 microversion: 2.1 time: 0.849470 Aug 27 02:30:51.769774 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 427/804] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:50 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1312 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:51.779845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d7ca4580-a8d7-4d29-bd6d-3487c4bd6cdb tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2acbaca0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:51.802009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d4c9b778-1088-4455-ab59-f96fec0c6746 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:51.802770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d4c9b778-1088-4455-ab59-f96fec0c6746 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:51.827630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4c9b778-1088-4455-ab59-f96fec0c6746 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:51.829160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4c9b778-1088-4455-ab59-f96fec0c6746 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:51.829160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4c9b778-1088-4455-ab59-f96fec0c6746 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:51.829592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4c9b778-1088-4455-ab59-f96fec0c6746 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:51.830024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4c9b778-1088-4455-ab59-f96fec0c6746 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:51.830471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4c9b778-1088-4455-ab59-f96fec0c6746 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:51.894402 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d7ca4580-a8d7-4d29-bd6d-3487c4bd6cdb tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2670088c-64f2-436e-be9a-8bb773c38354" status: 200 len: 662 microversion: 2.1 time: 0.146369 Aug 27 02:30:51.895006 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 378/805] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:30:51 2022] GET /compute/v2.1/images/2670088c-64f2-436e-be9a-8bb773c38354 => generated 662 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:51.920205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-13a7955f-c099-4cca-acb6-28ed3e4ceea4 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:51.920838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-13a7955f-c099-4cca-acb6-28ed3e4ceea4 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:51.952119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13a7955f-c099-4cca-acb6-28ed3e4ceea4 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:51.955025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13a7955f-c099-4cca-acb6-28ed3e4ceea4 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:51.955481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13a7955f-c099-4cca-acb6-28ed3e4ceea4 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:51.956273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13a7955f-c099-4cca-acb6-28ed3e4ceea4 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:51.956742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13a7955f-c099-4cca-acb6-28ed3e4ceea4 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:51.957180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13a7955f-c099-4cca-acb6-28ed3e4ceea4 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:52.239166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-13a7955f-c099-4cca-acb6-28ed3e4ceea4 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:52.266516 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-13a7955f-c099-4cca-acb6-28ed3e4ceea4 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1336 microversion: 2.1 time: 0.357025 Aug 27 02:30:52.293885 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 379/806] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:51 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1336 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:52.303031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-321c3833-279c-4fb1-a18c-37d0420a66f4 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:52.308249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-321c3833-279c-4fb1-a18c-37d0420a66f4 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:52.329701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321c3833-279c-4fb1-a18c-37d0420a66f4 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:52.332003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321c3833-279c-4fb1-a18c-37d0420a66f4 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:52.334503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321c3833-279c-4fb1-a18c-37d0420a66f4 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:52.334503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321c3833-279c-4fb1-a18c-37d0420a66f4 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:52.334932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321c3833-279c-4fb1-a18c-37d0420a66f4 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:52.335547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321c3833-279c-4fb1-a18c-37d0420a66f4 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:52.498526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d4c9b778-1088-4455-ab59-f96fec0c6746 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:52.528623 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d4c9b778-1088-4455-ab59-f96fec0c6746 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1504 microversion: 2.1 time: 0.738456 Aug 27 02:30:52.542606 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 428/807] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:51 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1504 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:52.565760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b5ae461d-f5f4-446e-9abd-6486d1098ff6 req-1947295b-0ecc-4b2d-ad4b-703109c50b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a0d3c43-6a69-49d1-8e43-494b70e6b635", "tag": "ff877ceb-42f3-4570-8d29-21cefdf8c147"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:52.584814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5ae461d-f5f4-446e-9abd-6486d1098ff6 req-1947295b-0ecc-4b2d-ad4b-703109c50b18 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:52.585796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5ae461d-f5f4-446e-9abd-6486d1098ff6 req-1947295b-0ecc-4b2d-ad4b-703109c50b18 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:52.586614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5ae461d-f5f4-446e-9abd-6486d1098ff6 req-1947295b-0ecc-4b2d-ad4b-703109c50b18 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:52.632810 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b5ae461d-f5f4-446e-9abd-6486d1098ff6 req-1947295b-0ecc-4b2d-ad4b-703109c50b18 service nova] Creating event network-changed:ff877ceb-42f3-4570-8d29-21cefdf8c147 for instance 9a0d3c43-6a69-49d1-8e43-494b70e6b635 on n-h2-852084-5 Aug 27 02:30:52.668628 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b5ae461d-f5f4-446e-9abd-6486d1098ff6 req-1947295b-0ecc-4b2d-ad4b-703109c50b18 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106458 Aug 27 02:30:52.669791 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 429/808] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:52.688872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b63e31fb-ca5d-4393-98fa-37444ab5eb2c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a5ef430>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:52.806481 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b63e31fb-ca5d-4393-98fa-37444ab5eb2c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2670088c-64f2-436e-be9a-8bb773c38354" status: 200 len: 662 microversion: 2.1 time: 0.126045 Aug 27 02:30:52.807408 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 430/809] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:30:52 2022] GET /compute/v2.1/images/2670088c-64f2-436e-be9a-8bb773c38354 => generated 662 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:52.809252 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-321c3833-279c-4fb1-a18c-37d0420a66f4 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 200 len: 1619 microversion: 2.1 time: 0.512495 Aug 27 02:30:52.810520 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 380/810] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:52 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 1619 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:52.836590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7969a70-866a-4470-997d-29be1273b9d1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:52.837267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7969a70-866a-4470-997d-29be1273b9d1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:52.882208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7969a70-866a-4470-997d-29be1273b9d1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:52.882208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7969a70-866a-4470-997d-29be1273b9d1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:52.882648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7969a70-866a-4470-997d-29be1273b9d1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:52.891661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7969a70-866a-4470-997d-29be1273b9d1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:52.892227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7969a70-866a-4470-997d-29be1273b9d1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:52.892691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7969a70-866a-4470-997d-29be1273b9d1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:53.127284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0547316f-9eba-4131-a199-e96dee062af8 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1376929945", "ram": 512, "vcpus": 1, "disk": 10, "id": 1844552200, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:53.182722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:30:53.188733 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0547316f-9eba-4131-a199-e96dee062af8 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.376257 Aug 27 02:30:53.192575 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 431/811] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:30:52 2022] POST /compute/v2.1/flavors => generated 416 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:53.205776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13caa609-859f-4e91-b0b2-bec8e24ba3f5 tempest-FlavorsV2NegativeTest-75312656 tempest-FlavorsV2NegativeTest-75312656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-315674487", "imageRef": "019feeff-9f4d-4b31-9472-df4ab22c0f37", "flavorRef": "452"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:53.390747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-13caa609-859f-4e91-b0b2-bec8e24ba3f5 tempest-FlavorsV2NegativeTest-75312656 tempest-FlavorsV2NegativeTest-75312656-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:30:53.605024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7969a70-866a-4470-997d-29be1273b9d1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:53.638529 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7969a70-866a-4470-997d-29be1273b9d1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1312 microversion: 2.1 time: 0.820719 Aug 27 02:30:53.649847 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 381/812] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:52 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1312 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:53.655221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c17a5be1-d97a-4fa3-9a73-a79fe5258f26 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:53.728636 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c17a5be1-d97a-4fa3-9a73-a79fe5258f26 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/1844552200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.086408 Aug 27 02:30:53.729260 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 382/813] 10.222.0.99 () {60 vars in 1224 bytes} [Sat Aug 27 02:30:53 2022] POST /compute/v2.1/flavors/1844552200/os-extra_specs => generated 66 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:30:53.744589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1f6f9543-0ee1-4f66-bffa-4b3e25edd69f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:53.745737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1f6f9543-0ee1-4f66-bffa-4b3e25edd69f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:53.760632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f6f9543-0ee1-4f66-bffa-4b3e25edd69f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:53.761153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f6f9543-0ee1-4f66-bffa-4b3e25edd69f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:53.764219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f6f9543-0ee1-4f66-bffa-4b3e25edd69f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:53.765137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f6f9543-0ee1-4f66-bffa-4b3e25edd69f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:53.765655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f6f9543-0ee1-4f66-bffa-4b3e25edd69f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:53.769929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f6f9543-0ee1-4f66-bffa-4b3e25edd69f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:53.894696 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-13caa609-859f-4e91-b0b2-bec8e24ba3f5 tempest-FlavorsV2NegativeTest-75312656 tempest-FlavorsV2NegativeTest-75312656-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13caa609-859f-4e91-b0b2-bec8e24ba3f5 tempest-FlavorsV2NegativeTest-75312656 tempest-FlavorsV2NegativeTest-75312656-project] Request method failure captured: Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 142 Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYHZBOLq91DRyLdY0ltZfdOb04tqjbYLuRsh7oh8NODAMbeCumLGeRvlkw87CTiEVVHLg-6VXQLlYRi_NoAGhyHNQUHxQYdpYxn_DmW8MJUplxGbS7GhS2KynTJn-aT41e5_2LEQJa0VcszYc9ZTSzhpOzuLa9b1YGUo3E7GuClI1s4 Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bc27180af7ee4c4a8ee551dcbd7c3ec0 Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FlavorsV2NegativeTest-75312656 Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bc27180af7ee4c4a8ee551dcbd7c3ec0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bc27180af7ee4c4a8ee551dcbd7c3ec0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bc27180af7ee4c4a8ee551dcbd7c3ec0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bc27180af7ee4c4a8ee551dcbd7c3ec0"}]}] Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FlavorsV2NegativeTest-75312656 Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bc27180af7ee4c4a8ee551dcbd7c3ec0 Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-75312656 Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FlavorsV2NegativeTest-75312656-project Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 918aabff8e12406493f9a63202c52edb Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FlavorsV2NegativeTest-75312656-project Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-315674487", "imageRef": "019feeff-9f4d-4b31-9472-df4ab22c0f37", "flavorRef": "452"}} Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: exception: Flavor's memory is too small for requested image. Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-315674487', 'imageRef': '019feeff-9f4d-4b31-9472-df4ab22c0f37', 'flavorRef': '452'}}} Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:30:53.897853 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 27 02:30:53.903094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:30:53.906149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13caa609-859f-4e91-b0b2-bec8e24ba3f5 tempest-FlavorsV2NegativeTest-75312656 tempest-FlavorsV2NegativeTest-75312656-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:30:53.907597 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13caa609-859f-4e91-b0b2-bec8e24ba3f5 tempest-FlavorsV2NegativeTest-75312656 tempest-FlavorsV2NegativeTest-75312656-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.712998 Aug 27 02:30:53.910877 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 432/814] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:30:53 2022] POST /compute/v2.1/servers => generated 93 bytes in 717 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:30:53.922636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-798283057", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:53.941646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1f6f9543-0ee1-4f66-bffa-4b3e25edd69f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:53.975305 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1f6f9543-0ee1-4f66-bffa-4b3e25edd69f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1336 microversion: 2.1 time: 0.241158 Aug 27 02:30:53.982349 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 383/815] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:53 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1336 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:54.002927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-311290187", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:54.028359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:30:54.141396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:30:54.803546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:30:54.804653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:30:54.805803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:30:54.806868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:30:54.809649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:30:54.858186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:54.860440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:54.864504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:54.866126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:54.867113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:54.868028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:54.994522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Getting quotas for project 21188dd4400446eda20c20a20dd047d2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:55.015741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Getting quotas for user 9cdd5b13c6384b0283eafe98beaa1988 and project 21188dd4400446eda20c20a20dd047d2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:55.060421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:30:55.065903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:30:55.168613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:30:55.168613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:30:55.168613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:30:55.169899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:30:55.169899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:30:55.199056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:55.199762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:55.200223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:55.202516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:55.204472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:55.207940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:55.285741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:55.305923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:55.306036 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-24ab7e4c-ba6e-4dc9-8571-e55453323268 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.393096 Aug 27 02:30:55.307765 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 433/816] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:30:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:30:55.331107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-97b7d43e-49f4-4812-899c-0b78bb5091dd tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:55.331742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-97b7d43e-49f4-4812-899c-0b78bb5091dd tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:55.359745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:30:55.382614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b7d43e-49f4-4812-899c-0b78bb5091dd tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:55.383197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b7d43e-49f4-4812-899c-0b78bb5091dd tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:55.383668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b7d43e-49f4-4812-899c-0b78bb5091dd tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:55.384442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b7d43e-49f4-4812-899c-0b78bb5091dd tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:55.387119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:30:55.393538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b7d43e-49f4-4812-899c-0b78bb5091dd tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:55.404973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b7d43e-49f4-4812-899c-0b78bb5091dd tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:55.631317 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-51ce9956-a4f9-45b2-940a-ddf67ea72a4a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.646404 Aug 27 02:30:55.644211 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 384/817] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:30:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:30:56.091112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-97b7d43e-49f4-4812-899c-0b78bb5091dd tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:56.108905 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-97b7d43e-49f4-4812-899c-0b78bb5091dd tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1504 microversion: 2.1 time: 0.798330 Aug 27 02:30:56.113401 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 434/818] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:55 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1504 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:56.123116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1ed91cea-1788-4df6-9b99-630643559e27 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:56.127118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1ed91cea-1788-4df6-9b99-630643559e27 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:56.145070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ed91cea-1788-4df6-9b99-630643559e27 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:56.147582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ed91cea-1788-4df6-9b99-630643559e27 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:56.148626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ed91cea-1788-4df6-9b99-630643559e27 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:56.153057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ed91cea-1788-4df6-9b99-630643559e27 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:56.154623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ed91cea-1788-4df6-9b99-630643559e27 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:56.156853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ed91cea-1788-4df6-9b99-630643559e27 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:56.455659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fd18fd0e-d7c7-44f5-9287-454f558a7d4f tempest-FlavorsExtraSpecsTestJSON-184764205 tempest-FlavorsExtraSpecsTestJSON-184764205-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:56.504532 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fd18fd0e-d7c7-44f5-9287-454f558a7d4f tempest-FlavorsExtraSpecsTestJSON-184764205 tempest-FlavorsExtraSpecsTestJSON-184764205-project] 10.222.0.99 "GET /compute/v2.1/flavors/1844552200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.856925 Aug 27 02:30:56.505962 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 385/819] 10.222.0.99 () {58 vars in 1203 bytes} [Sat Aug 27 02:30:55 2022] GET /compute/v2.1/flavors/1844552200/os-extra_specs => generated 66 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:30:56.522646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e28c06fb-70ca-48e4-9f20-61030c4ecb6d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:56.526358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e28c06fb-70ca-48e4-9f20-61030c4ecb6d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:56.562730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e28c06fb-70ca-48e4-9f20-61030c4ecb6d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:56.565654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e28c06fb-70ca-48e4-9f20-61030c4ecb6d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:56.567414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e28c06fb-70ca-48e4-9f20-61030c4ecb6d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:56.569119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e28c06fb-70ca-48e4-9f20-61030c4ecb6d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:56.570387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e28c06fb-70ca-48e4-9f20-61030c4ecb6d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:56.572452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e28c06fb-70ca-48e4-9f20-61030c4ecb6d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:56.641730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1ed91cea-1788-4df6-9b99-630643559e27 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:56.661802 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1ed91cea-1788-4df6-9b99-630643559e27 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1312 microversion: 2.1 time: 0.546950 Aug 27 02:30:56.663098 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 435/820] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:56 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1312 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:56.679960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0df4e18f-7bf2-44c8-885b-bdee8fc39cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:56.685110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0df4e18f-7bf2-44c8-885b-bdee8fc39cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:56.919821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0df4e18f-7bf2-44c8-885b-bdee8fc39cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:56.940564 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0df4e18f-7bf2-44c8-885b-bdee8fc39cc5 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1216 microversion: 2.1 time: 0.274007 Aug 27 02:30:56.942951 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 436/821] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:56 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1216 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:56.957756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2098268726", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:56.983867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e28c06fb-70ca-48e4-9f20-61030c4ecb6d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:56.998848 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e28c06fb-70ca-48e4-9f20-61030c4ecb6d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1404 microversion: 2.1 time: 0.490188 Aug 27 02:30:56.999850 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 386/822] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:56 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:57.006347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e9955905-0059-42f5-a785-05ad4ca33c06 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:57.047570 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e9955905-0059-42f5-a785-05ad4ca33c06 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/1844552200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046306 Aug 27 02:30:57.054583 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 387/823] 10.222.0.99 () {60 vars in 1224 bytes} [Sat Aug 27 02:30:57 2022] POST /compute/v2.1/flavors/1844552200/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:30:57.146054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:30:57.239140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-469275d3-c226-460a-bb40-96fc41135f32 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2abaf4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-389627688", "description": "tempest-description-1387068198"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:57.868610 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-469275d3-c226-460a-bb40-96fc41135f32 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.812393 Aug 27 02:30:57.878290 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 388/824] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:30:57 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:57.884823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bfd5621c-f460-47c6-bc86-4bde7ab72e6a tempest-FlavorsExtraSpecsTestJSON-184764205 tempest-FlavorsExtraSpecsTestJSON-184764205-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:57.935979 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bfd5621c-f460-47c6-bc86-4bde7ab72e6a tempest-FlavorsExtraSpecsTestJSON-184764205 tempest-FlavorsExtraSpecsTestJSON-184764205-project] 10.222.0.99 "GET /compute/v2.1/flavors/1844552200/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.056281 Aug 27 02:30:57.936624 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 389/825] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 02:30:57 2022] GET /compute/v2.1/flavors/1844552200/os-extra_specs/hw:numa_nodes => generated 22 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:30:57.952482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-24e17a22-584f-4777-b71d-9d74495fa4d0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:57.959838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-24e17a22-584f-4777-b71d-9d74495fa4d0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:57.975493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24e17a22-584f-4777-b71d-9d74495fa4d0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:57.976323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24e17a22-584f-4777-b71d-9d74495fa4d0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:57.981030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24e17a22-584f-4777-b71d-9d74495fa4d0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:57.984328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24e17a22-584f-4777-b71d-9d74495fa4d0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:57.984834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24e17a22-584f-4777-b71d-9d74495fa4d0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:57.985290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24e17a22-584f-4777-b71d-9d74495fa4d0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:58.376303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:30:58.378863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:30:58.381492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:30:58.382326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:30:58.384788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:30:58.394599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-24e17a22-584f-4777-b71d-9d74495fa4d0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:58.409417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:58.412214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:58.415372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:58.415941 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-24e17a22-584f-4777-b71d-9d74495fa4d0 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1504 microversion: 2.1 time: 0.476241 Aug 27 02:30:58.416859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:58.417717 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 390/826] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:57 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:58.418139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:58.419021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:58.422688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-14818bde-a63c-45a9-804d-173f9003b258 req-62c251e9-d559-4f88-9d51-67cd2cc4d587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d1eeab-d777-433e-b23b-1d6bd540823d", "name": "network-vif-plugged", "status": "completed", "tag": "8fe72264-a971-4067-8e10-b097ab827266"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:58.452815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-14818bde-a63c-45a9-804d-173f9003b258 req-62c251e9-d559-4f88-9d51-67cd2cc4d587 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:58.454176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-14818bde-a63c-45a9-804d-173f9003b258 req-62c251e9-d559-4f88-9d51-67cd2cc4d587 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:58.458913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-14818bde-a63c-45a9-804d-173f9003b258 req-62c251e9-d559-4f88-9d51-67cd2cc4d587 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:58.467186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Getting quotas for project 21188dd4400446eda20c20a20dd047d2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:30:58.480186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Getting quotas for user 9cdd5b13c6384b0283eafe98beaa1988 and project 21188dd4400446eda20c20a20dd047d2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:30:58.487261 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-14818bde-a63c-45a9-804d-173f9003b258 req-62c251e9-d559-4f88-9d51-67cd2cc4d587 service nova] Creating event network-vif-plugged:8fe72264-a971-4067-8e10-b097ab827266 for instance 91d1eeab-d777-433e-b23b-1d6bd540823d on n-h2-852084-5 Aug 27 02:30:58.501944 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-14818bde-a63c-45a9-804d-173f9003b258 req-62c251e9-d559-4f88-9d51-67cd2cc4d587 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082851 Aug 27 02:30:58.504490 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 391/827] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:30:58.514172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:30:58.516571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:30:58.519847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7bb57513-64ec-45e3-841c-50a3e4339604 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:58.525153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7bb57513-64ec-45e3-841c-50a3e4339604 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:58.544852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb57513-64ec-45e3-841c-50a3e4339604 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:58.545833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb57513-64ec-45e3-841c-50a3e4339604 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:58.546539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb57513-64ec-45e3-841c-50a3e4339604 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:58.547501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb57513-64ec-45e3-841c-50a3e4339604 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:58.548150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb57513-64ec-45e3-841c-50a3e4339604 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:58.548757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb57513-64ec-45e3-841c-50a3e4339604 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:58.575843 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9e067f02-f1a5-45df-99ec-8ee7e7f48ca1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.630254 Aug 27 02:30:58.576893 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 437/828] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:30:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:30:58.583781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e509bf4-0370-4587-9392-44270ab78715 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2a5ef040>, body: {"security_group_rule": {"parent_group_id": "b17b9a89-1684-47ec-b819-b4f37ab2a4fa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:59.214962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7bb57513-64ec-45e3-841c-50a3e4339604 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:59.233352 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7bb57513-64ec-45e3-841c-50a3e4339604 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1312 microversion: 2.1 time: 0.724065 Aug 27 02:30:59.234563 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 392/829] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:58 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1312 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:59.240394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-02664817-4380-48a7-9ae8-3d6c087635a9 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:30:59.364108 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-02664817-4380-48a7-9ae8-3d6c087635a9 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors/1844552200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.123695 Aug 27 02:30:59.367088 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 393/830] 10.222.0.99 () {60 vars in 1224 bytes} [Sat Aug 27 02:30:59 2022] POST /compute/v2.1/flavors/1844552200/os-extra_specs => generated 66 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:30:59.385766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2d57ea65-7991-48da-914e-50f2dc5e1fa6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:59.391115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2d57ea65-7991-48da-914e-50f2dc5e1fa6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:59.406998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d57ea65-7991-48da-914e-50f2dc5e1fa6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:59.408758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d57ea65-7991-48da-914e-50f2dc5e1fa6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:59.411471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d57ea65-7991-48da-914e-50f2dc5e1fa6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:59.415056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d57ea65-7991-48da-914e-50f2dc5e1fa6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:59.416664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d57ea65-7991-48da-914e-50f2dc5e1fa6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:59.418052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d57ea65-7991-48da-914e-50f2dc5e1fa6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:59.711290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2d57ea65-7991-48da-914e-50f2dc5e1fa6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:30:59.728420 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2d57ea65-7991-48da-914e-50f2dc5e1fa6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1274 microversion: 2.1 time: 0.357516 Aug 27 02:30:59.729164 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 394/831] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:59 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1274 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:30:59.758673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dce54d9d-0985-4fa1-83ce-2e9a92d4851a tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:30:59.761580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dce54d9d-0985-4fa1-83ce-2e9a92d4851a tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:30:59.795318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dce54d9d-0985-4fa1-83ce-2e9a92d4851a tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:59.798230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dce54d9d-0985-4fa1-83ce-2e9a92d4851a tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:59.801735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dce54d9d-0985-4fa1-83ce-2e9a92d4851a tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:30:59.807397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dce54d9d-0985-4fa1-83ce-2e9a92d4851a tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:30:59.808279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dce54d9d-0985-4fa1-83ce-2e9a92d4851a tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:30:59.809367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dce54d9d-0985-4fa1-83ce-2e9a92d4851a tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:00.066816 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e509bf4-0370-4587-9392-44270ab78715 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.488434 Aug 27 02:31:00.069991 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 438/832] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:30:58 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:00.076932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f9094962-8f45-4bd5-95af-19a4979b3bfd req-1dee365e-5f6e-412f-be52-e549cc84f8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f739696-df21-46b5-aba3-339d737d3825", "tag": "049c8b21-25a5-4ba8-9d5b-b6ef599a2196"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:00.100717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f9094962-8f45-4bd5-95af-19a4979b3bfd req-1dee365e-5f6e-412f-be52-e549cc84f8b2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:00.101839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f9094962-8f45-4bd5-95af-19a4979b3bfd req-1dee365e-5f6e-412f-be52-e549cc84f8b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:00.103097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f9094962-8f45-4bd5-95af-19a4979b3bfd req-1dee365e-5f6e-412f-be52-e549cc84f8b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:00.150213 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f9094962-8f45-4bd5-95af-19a4979b3bfd req-1dee365e-5f6e-412f-be52-e549cc84f8b2 service nova] Creating event network-changed:049c8b21-25a5-4ba8-9d5b-b6ef599a2196 for instance 1f739696-df21-46b5-aba3-339d737d3825 on n-h2-852084-5 Aug 27 02:31:00.169715 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f9094962-8f45-4bd5-95af-19a4979b3bfd req-1dee365e-5f6e-412f-be52-e549cc84f8b2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097408 Aug 27 02:31:00.170991 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 439/833] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:00.184717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e0890426-c32f-4417-bfe7-254386bc79a2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:00.186664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e0890426-c32f-4417-bfe7-254386bc79a2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:00.212919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0890426-c32f-4417-bfe7-254386bc79a2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:00.212919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0890426-c32f-4417-bfe7-254386bc79a2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:00.213289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0890426-c32f-4417-bfe7-254386bc79a2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:00.214373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0890426-c32f-4417-bfe7-254386bc79a2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:00.215092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0890426-c32f-4417-bfe7-254386bc79a2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:00.215791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0890426-c32f-4417-bfe7-254386bc79a2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:00.348725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dce54d9d-0985-4fa1-83ce-2e9a92d4851a tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:00.378344 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dce54d9d-0985-4fa1-83ce-2e9a92d4851a tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1404 microversion: 2.1 time: 0.634654 Aug 27 02:31:00.379674 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 395/834] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:30:59 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1404 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:00.396279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b23a5a35-42e0-41c0-b7a3-3991bc372e9b tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:00.438922 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b23a5a35-42e0-41c0-b7a3-3991bc372e9b tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/1844552200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056705 Aug 27 02:31:00.440655 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 396/835] 10.222.0.99 () {58 vars in 1203 bytes} [Sat Aug 27 02:31:00 2022] GET /compute/v2.1/flavors/1844552200/os-extra_specs => generated 66 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:31:00.452607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f90ba696-f478-499e-99cf-a2ae7c311927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:00.458216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f90ba696-f478-499e-99cf-a2ae7c311927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:00.469268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90ba696-f478-499e-99cf-a2ae7c311927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:00.471306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90ba696-f478-499e-99cf-a2ae7c311927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:00.472174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90ba696-f478-499e-99cf-a2ae7c311927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:00.473475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90ba696-f478-499e-99cf-a2ae7c311927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:00.474272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90ba696-f478-499e-99cf-a2ae7c311927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:00.474885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90ba696-f478-499e-99cf-a2ae7c311927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:00.522116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e0890426-c32f-4417-bfe7-254386bc79a2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:00.539541 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e0890426-c32f-4417-bfe7-254386bc79a2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1270 microversion: 2.1 time: 0.366665 Aug 27 02:31:00.560028 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 440/836] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:00 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1270 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:00.566170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7a4a8f6-7f01-4cb3-9154-9c8dcbd17c63 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2a5419d0>, body: {"security_group_rule": {"parent_group_id": "b17b9a89-1684-47ec-b819-b4f37ab2a4fa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:00.783248 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-d7a4a8f6-7f01-4cb3-9154-9c8dcbd17c63 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] HTTP exception thrown: This rule already exists in group b17b9a89-1684-47ec-b819-b4f37ab2a4fa Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7a4a8f6-7f01-4cb3-9154-9c8dcbd17c63 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Request method failure captured: Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 138 Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYHgAs6Kw73czQwj_BpcuUVENwHvsQBtmqIa-qco5fR0XjLEcKOuR9FjB4bO21xyva1o_4mmnW-ikOFwVqNLjFG58UcaD11z1kl-6DFSAABkD6okQmuDsBB1K6F8cy8r2Q6SbEF1hl91u8wFzyqkU4Xg2b6a4tDEfW1-WmdyN24iRoQ Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00dc9fd246374c46a105d1be8b2f9892"}]}] Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: cbd591e6a43f425da9a7f5310329ad63 Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: {"security_group_rule": {"parent_group_id": "b17b9a89-1684-47ec-b819-b4f37ab2a4fa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: exception: This rule already exists in group b17b9a89-1684-47ec-b819-b4f37ab2a4fa Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b17b9a89-1684-47ec-b819-b4f37ab2a4fa', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group b17b9a89-1684-47ec-b819-b4f37ab2a4fa Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group b17b9a89-1684-47ec-b819-b4f37ab2a4fa Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:00.789094 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:00.794309 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:00.794309 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:00.794309 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group b17b9a89-1684-47ec-b819-b4f37ab2a4fa Aug 27 02:31:00.794309 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:31:00.798362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7a4a8f6-7f01-4cb3-9154-9c8dcbd17c63 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Returning 400 to user: This rule already exists in group b17b9a89-1684-47ec-b819-b4f37ab2a4fa {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:00.799474 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d7a4a8f6-7f01-4cb3-9154-9c8dcbd17c63 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.238039 Aug 27 02:31:00.804622 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 441/837] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:31:00 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 244 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:31:00.810295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2770301-52ca-4e27-93da-72304baf157b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:00.810838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f2770301-52ca-4e27-93da-72304baf157b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:00.829999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2770301-52ca-4e27-93da-72304baf157b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:00.830500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2770301-52ca-4e27-93da-72304baf157b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:00.831514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2770301-52ca-4e27-93da-72304baf157b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:00.833800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2770301-52ca-4e27-93da-72304baf157b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:00.833800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2770301-52ca-4e27-93da-72304baf157b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:00.836396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2770301-52ca-4e27-93da-72304baf157b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:01.340660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f2770301-52ca-4e27-93da-72304baf157b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:01.376265 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f2770301-52ca-4e27-93da-72304baf157b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1312 microversion: 2.1 time: 0.568216 Aug 27 02:31:01.393710 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 442/838] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:00 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1312 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:01.405785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d612fd1c-e852-4ecd-86a4-c1a942e6282b tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:01.505075 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d612fd1c-e852-4ecd-86a4-c1a942e6282b tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "PUT /compute/v2.1/flavors/1844552200/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.120719 Aug 27 02:31:01.512322 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 443/839] 10.222.0.99 () {60 vars in 1265 bytes} [Sat Aug 27 02:31:01 2022] PUT /compute/v2.1/flavors/1844552200/os-extra_specs/hw:numa_nodes => generated 22 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:31:01.518104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-48a94825-0499-433e-94fb-2b5764543d41 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:01.519270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-48a94825-0499-433e-94fb-2b5764543d41 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:01.528219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48a94825-0499-433e-94fb-2b5764543d41 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:01.529077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48a94825-0499-433e-94fb-2b5764543d41 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:01.529812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48a94825-0499-433e-94fb-2b5764543d41 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:01.530797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48a94825-0499-433e-94fb-2b5764543d41 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:01.531592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48a94825-0499-433e-94fb-2b5764543d41 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:01.532265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48a94825-0499-433e-94fb-2b5764543d41 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:01.687725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-48a94825-0499-433e-94fb-2b5764543d41 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:01.699830 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-48a94825-0499-433e-94fb-2b5764543d41 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1274 microversion: 2.1 time: 0.189327 Aug 27 02:31:01.713838 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 444/840] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:01 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:01.726061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70989d32-d096-4ee8-ba6b-a808ea00b1f5 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Calling method '.version_select at 0x7f4d2a76e820>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:01.844222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f90ba696-f478-499e-99cf-a2ae7c311927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:01.879877 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f90ba696-f478-499e-99cf-a2ae7c311927 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1504 microversion: 2.1 time: 1.437471 Aug 27 02:31:01.898123 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 397/841] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:00 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1504 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:01.922172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e3420ce0-3007-4a91-b7ff-c6367610c8e0 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:01.923781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e3420ce0-3007-4a91-b7ff-c6367610c8e0 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:01.947060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3420ce0-3007-4a91-b7ff-c6367610c8e0 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:01.948724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3420ce0-3007-4a91-b7ff-c6367610c8e0 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:01.961292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3420ce0-3007-4a91-b7ff-c6367610c8e0 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:01.966720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3420ce0-3007-4a91-b7ff-c6367610c8e0 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:01.970455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3420ce0-3007-4a91-b7ff-c6367610c8e0 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:01.976379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3420ce0-3007-4a91-b7ff-c6367610c8e0 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:02.368280 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70989d32-d096-4ee8-ba6b-a808ea00b1f5 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-group-rules/1b2f9b94-d32a-40fd-930a-ae4c729a760a" status: 202 len: 0 microversion: 2.1 time: 0.652812 Aug 27 02:31:02.369538 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 445/842] 10.222.0.99 () {58 vars in 1287 bytes} [Sat Aug 27 02:31:01 2022] DELETE /compute/v2.1/os-security-group-rules/1b2f9b94-d32a-40fd-930a-ae4c729a760a => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:31:02.379161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6295463f-e5ff-4568-951f-d0585917e8f1 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:02.389140 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6295463f-e5ff-4568-951f-d0585917e8f1 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/1844552200/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018159 Aug 27 02:31:02.394717 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 446/843] 10.222.0.99 () {58 vars in 1203 bytes} [Sat Aug 27 02:31:02 2022] GET /compute/v2.1/flavors/1844552200/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:31:02.401256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3053cfb6-d649-4698-8ba0-c9ff1948ed19 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:02.402318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3053cfb6-d649-4698-8ba0-c9ff1948ed19 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:02.412090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3053cfb6-d649-4698-8ba0-c9ff1948ed19 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:02.413035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3053cfb6-d649-4698-8ba0-c9ff1948ed19 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:02.413745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3053cfb6-d649-4698-8ba0-c9ff1948ed19 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:02.416200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3053cfb6-d649-4698-8ba0-c9ff1948ed19 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:02.417029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3053cfb6-d649-4698-8ba0-c9ff1948ed19 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:02.423282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3053cfb6-d649-4698-8ba0-c9ff1948ed19 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:02.629261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3053cfb6-d649-4698-8ba0-c9ff1948ed19 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:02.660960 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3053cfb6-d649-4698-8ba0-c9ff1948ed19 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1276 microversion: 2.1 time: 0.264154 Aug 27 02:31:02.677528 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 447/844] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:02 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1276 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:02.714441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-158d5ac0-629e-4855-9fb1-cefcba5060f0 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2a76edc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-331979398", "description": "tempest-description-1296753710"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:02.763963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e3420ce0-3007-4a91-b7ff-c6367610c8e0 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:02.774513 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e3420ce0-3007-4a91-b7ff-c6367610c8e0 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1404 microversion: 2.1 time: 0.874182 Aug 27 02:31:02.775015 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 398/845] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:01 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1404 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:02.786979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-121db491-aca2-401f-b91c-0d0b6b5b1d7a tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:02.830376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=83,nova_api:SAVEPOINT=6,nova_api:INSERT=5,nova_api:RELEASE=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:02.866408 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-121db491-aca2-401f-b91c-0d0b6b5b1d7a tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1844552200/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.083335 Aug 27 02:31:02.867878 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 399/846] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 02:31:02 2022] DELETE /compute/v2.1/flavors/1844552200/os-extra_specs/hw:numa_nodes => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:31:02.878544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c48a30be-4bce-47cc-8013-90a88c431740 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:02.886535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c48a30be-4bce-47cc-8013-90a88c431740 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:02.907379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48a30be-4bce-47cc-8013-90a88c431740 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:02.909290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48a30be-4bce-47cc-8013-90a88c431740 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:02.913962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48a30be-4bce-47cc-8013-90a88c431740 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:02.917904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48a30be-4bce-47cc-8013-90a88c431740 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:02.918982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48a30be-4bce-47cc-8013-90a88c431740 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:02.919756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48a30be-4bce-47cc-8013-90a88c431740 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:03.662788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c48a30be-4bce-47cc-8013-90a88c431740 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:03.742253 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c48a30be-4bce-47cc-8013-90a88c431740 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1461 microversion: 2.1 time: 0.852413 Aug 27 02:31:03.747977 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 400/847] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:02 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1461 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:03.760998 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-158d5ac0-629e-4855-9fb1-cefcba5060f0 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.078547 Aug 27 02:31:03.763554 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 448/848] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:31:02 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:03.775366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-297b130c-c18a-4b99-83c8-f979c39f7d27 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:03.814949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b78cc979-4dc2-49f9-b58a-c4c421b72e02 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:03.818948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b78cc979-4dc2-49f9-b58a-c4c421b72e02 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:03.848253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b78cc979-4dc2-49f9-b58a-c4c421b72e02 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:03.849203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b78cc979-4dc2-49f9-b58a-c4c421b72e02 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:03.850861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b78cc979-4dc2-49f9-b58a-c4c421b72e02 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:03.863875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b78cc979-4dc2-49f9-b58a-c4c421b72e02 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:03.870028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b78cc979-4dc2-49f9-b58a-c4c421b72e02 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:03.873457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b78cc979-4dc2-49f9-b58a-c4c421b72e02 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:03.882865 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-297b130c-c18a-4b99-83c8-f979c39f7d27 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1844552200/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.117193 Aug 27 02:31:03.892116 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 449/849] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 02:31:03 2022] DELETE /compute/v2.1/flavors/1844552200/os-extra_specs/hw:cpu_policy => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 27 02:31:03.916215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2559cb31-c85c-48a2-8aaf-5fb5e39168c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:03.918762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2559cb31-c85c-48a2-8aaf-5fb5e39168c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:03.949313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2559cb31-c85c-48a2-8aaf-5fb5e39168c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:03.950320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2559cb31-c85c-48a2-8aaf-5fb5e39168c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:03.951154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2559cb31-c85c-48a2-8aaf-5fb5e39168c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:03.952523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2559cb31-c85c-48a2-8aaf-5fb5e39168c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:03.953369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2559cb31-c85c-48a2-8aaf-5fb5e39168c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:03.954208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2559cb31-c85c-48a2-8aaf-5fb5e39168c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:04.416261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b78cc979-4dc2-49f9-b58a-c4c421b72e02 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:04.435542 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b78cc979-4dc2-49f9-b58a-c4c421b72e02 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1316 microversion: 2.1 time: 0.683978 Aug 27 02:31:04.438165 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 401/850] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:03 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:04.449303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a9b7cf16-ff71-49be-a369-964828b870e8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:04.451162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a9b7cf16-ff71-49be-a369-964828b870e8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:04.461983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9b7cf16-ff71-49be-a369-964828b870e8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:04.463531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9b7cf16-ff71-49be-a369-964828b870e8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:04.464644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9b7cf16-ff71-49be-a369-964828b870e8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:04.466161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9b7cf16-ff71-49be-a369-964828b870e8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:04.466732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9b7cf16-ff71-49be-a369-964828b870e8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:04.468561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9b7cf16-ff71-49be-a369-964828b870e8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:05.120158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a9b7cf16-ff71-49be-a369-964828b870e8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:05.159335 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a9b7cf16-ff71-49be-a369-964828b870e8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1318 microversion: 2.1 time: 0.713357 Aug 27 02:31:05.163463 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 402/851] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:04 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1318 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:05.192055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6f4f7ab3-665f-4137-ada0-af95940eed77 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2abaf820>, body: {"security_group_rule": {"parent_group_id": "19c333f5-10f8-4833-8408-722b68ec7a9a", "ip_protocol": "tcp", "from_port": 587194299, "to_port": 22}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:05.230546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:05.265290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2559cb31-c85c-48a2-8aaf-5fb5e39168c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:05.281191 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2559cb31-c85c-48a2-8aaf-5fb5e39168c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1494 microversion: 2.1 time: 1.384547 Aug 27 02:31:05.282294 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 450/852] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:03 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1494 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:05.288193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:05.291849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:05.321749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:05.322052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:05.322484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:05.325121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:05.325536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:05.326596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:05.327977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:05.433334 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-6f4f7ab3-665f-4137-ada0-af95940eed77 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] HTTP exception thrown: Invalid port range 587194299:22. Former value cannot be greater than the later Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6f4f7ab3-665f-4137-ada0-af95940eed77 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Request method failure captured: Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 145 Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYHgAs6Kw73czQwj_BpcuUVENwHvsQBtmqIa-qco5fR0XjLEcKOuR9FjB4bO21xyva1o_4mmnW-ikOFwVqNLjFG58UcaD11z1kl-6DFSAABkD6okQmuDsBB1K6F8cy8r2Q6SbEF1hl91u8wFzyqkU4Xg2b6a4tDEfW1-WmdyN24iRoQ Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00dc9fd246374c46a105d1be8b2f9892"}]}] Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: cbd591e6a43f425da9a7f5310329ad63 Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: {"security_group_rule": {"parent_group_id": "19c333f5-10f8-4833-8408-722b68ec7a9a", "ip_protocol": "tcp", "from_port": 587194299, "to_port": 22}} Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid port range 587194299:22. Former value cannot be greater than the later Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'security_group_rule': {'parent_group_id': '19c333f5-10f8-4833-8408-722b68ec7a9a', 'ip_protocol': 'tcp', 'from_port': 587194299, 'to_port': 22}}} Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 587194299:22. Former value cannot be greater than the later Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 587194299:22. Former value cannot be greater than the later Aug 27 02:31:05.436592 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:05.441257 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:05.441257 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:05.441257 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:05.441257 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:05.441257 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:05.441257 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:05.441257 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:05.441257 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 587194299:22. Former value cannot be greater than the later Aug 27 02:31:05.441257 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:05.443667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6f4f7ab3-665f-4137-ada0-af95940eed77 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Returning 400 to user: Invalid port range 587194299:22. Former value cannot be greater than the later {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:05.444733 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6f4f7ab3-665f-4137-ada0-af95940eed77 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.275065 Aug 27 02:31:05.445494 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 403/853] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:31:05 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:31:05.458374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0647f34d-a9ef-4a2b-b45a-3eaf6e2d782f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:05.462787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0647f34d-a9ef-4a2b-b45a-3eaf6e2d782f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:05.481729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0647f34d-a9ef-4a2b-b45a-3eaf6e2d782f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:05.489059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0647f34d-a9ef-4a2b-b45a-3eaf6e2d782f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:05.489837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0647f34d-a9ef-4a2b-b45a-3eaf6e2d782f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:05.490775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0647f34d-a9ef-4a2b-b45a-3eaf6e2d782f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:05.491450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0647f34d-a9ef-4a2b-b45a-3eaf6e2d782f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:05.492119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0647f34d-a9ef-4a2b-b45a-3eaf6e2d782f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:05.517056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:05.536022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Old instance type m1.heat2, new instance type m1.heat {{(pid=122488) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 02:31:05.560763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:31:05.564301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:31:05.569355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:31:05.570099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:31:05.570692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:31:05.816531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:05.900697 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-27cf522c-00f6-4546-b41e-7bd4725996d2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "POST /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d/action" status: 202 len: 0 microversion: 2.1 time: 0.615201 Aug 27 02:31:05.902242 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 451/854] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:31:05 2022] POST /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:31:05.926542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2ada8d1d-1c8a-4bf8-8d96-23dd779274cd tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:05.963823 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2ada8d1d-1c8a-4bf8-8d96-23dd779274cd tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/1844552200/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.056943 Aug 27 02:31:05.975296 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 452/855] 10.222.0.99 () {58 vars in 1203 bytes} [Sat Aug 27 02:31:05 2022] GET /compute/v2.1/flavors/1844552200/os-extra_specs => generated 19 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:31:05.982052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d03201aa-28a7-413a-97a7-b3f0c678246e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '.version_select at 0x7f4d2a558ca0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:05.986535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d03201aa-28a7-413a-97a7-b3f0c678246e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:05.988096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d03201aa-28a7-413a-97a7-b3f0c678246e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:05.988743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d03201aa-28a7-413a-97a7-b3f0c678246e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:06.007986 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d03201aa-28a7-413a-97a7-b3f0c678246e tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.030819 Aug 27 02:31:06.009199 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 453/856] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:31:05 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:06.024216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-920dca35-0e28-44c6-b7ef-a9a060dcb090 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2a558820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-950234847", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:06.027633 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-920dca35-0e28-44c6-b7ef-a9a060dcb090 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] HTTP exception thrown: Security group id should be uuid Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-920dca35-0e28-44c6-b7ef-a9a060dcb090 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Request method failure captured: Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 130 Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYHgAs6Kw73czQwj_BpcuUVENwHvsQBtmqIa-qco5fR0XjLEcKOuR9FjB4bO21xyva1o_4mmnW-ikOFwVqNLjFG58UcaD11z1kl-6DFSAABkD6okQmuDsBB1K6F8cy8r2Q6SbEF1hl91u8wFzyqkU4Xg2b6a4tDEfW1-WmdyN24iRoQ Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00dc9fd246374c46a105d1be8b2f9892"}]}] Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: cbd591e6a43f425da9a7f5310329ad63 Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-950234847", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: exception: Security group id should be uuid Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-950234847', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:06.030028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:06.034556 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 27 02:31:06.034556 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:31:06.036509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-920dca35-0e28-44c6-b7ef-a9a060dcb090 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Returning 400 to user: Security group id should be uuid {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:06.038617 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-920dca35-0e28-44c6-b7ef-a9a060dcb090 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.018142 Aug 27 02:31:06.040442 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 454/857] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:31:06 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:31:06.046537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c37ff1b2-1b56-4d07-9f2e-7e833308ca12 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:06.047654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c37ff1b2-1b56-4d07-9f2e-7e833308ca12 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:06.053100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0647f34d-a9ef-4a2b-b45a-3eaf6e2d782f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:06.057400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:06.057757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c37ff1b2-1b56-4d07-9f2e-7e833308ca12 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:06.059063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c37ff1b2-1b56-4d07-9f2e-7e833308ca12 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:06.060111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c37ff1b2-1b56-4d07-9f2e-7e833308ca12 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:06.061915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c37ff1b2-1b56-4d07-9f2e-7e833308ca12 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:06.062831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c37ff1b2-1b56-4d07-9f2e-7e833308ca12 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:06.064109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c37ff1b2-1b56-4d07-9f2e-7e833308ca12 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:06.067346 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0647f34d-a9ef-4a2b-b45a-3eaf6e2d782f tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1404 microversion: 2.1 time: 0.620133 Aug 27 02:31:06.070490 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 404/858] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:05 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1404 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:06.103592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf75af1a-00d2-4e6d-8be3-a1f62c0ab003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:06.104762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf75af1a-00d2-4e6d-8be3-a1f62c0ab003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:06.121706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf75af1a-00d2-4e6d-8be3-a1f62c0ab003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:06.122582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf75af1a-00d2-4e6d-8be3-a1f62c0ab003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:06.123475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf75af1a-00d2-4e6d-8be3-a1f62c0ab003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:06.125524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf75af1a-00d2-4e6d-8be3-a1f62c0ab003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:06.130845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf75af1a-00d2-4e6d-8be3-a1f62c0ab003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:06.131443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf75af1a-00d2-4e6d-8be3-a1f62c0ab003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:06.542304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c37ff1b2-1b56-4d07-9f2e-7e833308ca12 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:06.560392 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c37ff1b2-1b56-4d07-9f2e-7e833308ca12 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1316 microversion: 2.1 time: 0.518169 Aug 27 02:31:06.563061 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 455/859] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:06 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:06.573552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c4c7679-dc41-495c-991a-0a4a4a5c9d7f tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:06.649482 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9c4c7679-dc41-495c-991a-0a4a4a5c9d7f tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1844552200" status: 202 len: 0 microversion: 2.1 time: 0.083736 Aug 27 02:31:06.651853 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 456/860] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 02:31:06 2022] DELETE /compute/v2.1/flavors/1844552200 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:31:06.663700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8156b3a-7f8b-422d-8863-d5e9851b9480 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:06.665621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c8156b3a-7f8b-422d-8863-d5e9851b9480 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:06.682121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8156b3a-7f8b-422d-8863-d5e9851b9480 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:06.683647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8156b3a-7f8b-422d-8863-d5e9851b9480 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:06.684773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8156b3a-7f8b-422d-8863-d5e9851b9480 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:06.686712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8156b3a-7f8b-422d-8863-d5e9851b9480 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:06.698557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8156b3a-7f8b-422d-8863-d5e9851b9480 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:06.701558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8156b3a-7f8b-422d-8863-d5e9851b9480 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:07.256798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf75af1a-00d2-4e6d-8be3-a1f62c0ab003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:07.289131 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf75af1a-00d2-4e6d-8be3-a1f62c0ab003 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1470 microversion: 2.1 time: 1.204719 Aug 27 02:31:07.303546 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 405/861] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:06 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1470 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:07.330001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e2fe318-6bee-48ef-848a-ea798dc95a4a tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2abec040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1499632601", "description": "tempest-description-1561681139"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:07.372310 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c8156b3a-7f8b-422d-8863-d5e9851b9480 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1645 microversion: 2.1 time: 0.715806 Aug 27 02:31:07.375961 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 457/862] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:06 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1645 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:07.405290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-48bf1ae3-6834-4a65-915a-865303bc1eb1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:07.405290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-48bf1ae3-6834-4a65-915a-865303bc1eb1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:07.418257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48bf1ae3-6834-4a65-915a-865303bc1eb1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:07.421076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48bf1ae3-6834-4a65-915a-865303bc1eb1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:07.421579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48bf1ae3-6834-4a65-915a-865303bc1eb1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:07.424022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48bf1ae3-6834-4a65-915a-865303bc1eb1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:07.430550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48bf1ae3-6834-4a65-915a-865303bc1eb1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:07.432750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48bf1ae3-6834-4a65-915a-865303bc1eb1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:07.928953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-48bf1ae3-6834-4a65-915a-865303bc1eb1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:07.941772 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-48bf1ae3-6834-4a65-915a-865303bc1eb1 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1318 microversion: 2.1 time: 0.563290 Aug 27 02:31:07.958412 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 458/863] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:07 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:07.958412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-24da86e5-3074-4319-8a78-fb61fd7f624b req-bafaec40-c2cb-4b54-aaf1-dc0f816f9b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0f3c97-a84f-4dfb-b8e9-971677ca6a05", "tag": "12f54338-d142-4e94-a50c-aec96be98412"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:08.012584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-24da86e5-3074-4319-8a78-fb61fd7f624b req-bafaec40-c2cb-4b54-aaf1-dc0f816f9b66 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:08.013087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-24da86e5-3074-4319-8a78-fb61fd7f624b req-bafaec40-c2cb-4b54-aaf1-dc0f816f9b66 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:08.013535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-24da86e5-3074-4319-8a78-fb61fd7f624b req-bafaec40-c2cb-4b54-aaf1-dc0f816f9b66 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:08.041735 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-24da86e5-3074-4319-8a78-fb61fd7f624b req-bafaec40-c2cb-4b54-aaf1-dc0f816f9b66 service nova] Creating event network-changed:12f54338-d142-4e94-a50c-aec96be98412 for instance aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 on n-h2-852084-5 Aug 27 02:31:08.050052 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-24da86e5-3074-4319-8a78-fb61fd7f624b req-bafaec40-c2cb-4b54-aaf1-dc0f816f9b66 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100767 Aug 27 02:31:08.051103 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 459/864] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:08.071560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4251ee44-02a8-496e-9ec7-b1b4d6a0c487 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:08.135033 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4251ee44-02a8-496e-9ec7-b1b4d6a0c487 tempest-FlavorsExtraSpecsTestJSON-999403013 tempest-FlavorsExtraSpecsTestJSON-999403013-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077125 Aug 27 02:31:08.137562 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 460/865] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:31:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:08.151659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ef4b0b10-f42f-444c-a557-e35adf641224 req-9d93f3d8-4e4e-48cf-b2a4-2ebc2a8dc07b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f98f8456-cc9f-4772-97f1-99e056b99f79", "tag": "466460c2-b76b-42d7-9cd5-1eab0a9cd335"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:08.168038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:08.178722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ef4b0b10-f42f-444c-a557-e35adf641224 req-9d93f3d8-4e4e-48cf-b2a4-2ebc2a8dc07b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:08.179917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ef4b0b10-f42f-444c-a557-e35adf641224 req-9d93f3d8-4e4e-48cf-b2a4-2ebc2a8dc07b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:08.181105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ef4b0b10-f42f-444c-a557-e35adf641224 req-9d93f3d8-4e4e-48cf-b2a4-2ebc2a8dc07b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:08.214931 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ef4b0b10-f42f-444c-a557-e35adf641224 req-9d93f3d8-4e4e-48cf-b2a4-2ebc2a8dc07b service nova] Creating event network-changed:466460c2-b76b-42d7-9cd5-1eab0a9cd335 for instance f98f8456-cc9f-4772-97f1-99e056b99f79 on n-h1-852084-5 Aug 27 02:31:08.228210 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ef4b0b10-f42f-444c-a557-e35adf641224 req-9d93f3d8-4e4e-48cf-b2a4-2ebc2a8dc07b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087823 Aug 27 02:31:08.230018 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 461/866] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:08.243916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-488cf299-4e2f-45ba-8c6c-060401d7edbb tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:08.245286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-488cf299-4e2f-45ba-8c6c-060401d7edbb tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:08.261432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488cf299-4e2f-45ba-8c6c-060401d7edbb tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:08.262290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488cf299-4e2f-45ba-8c6c-060401d7edbb tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:08.263202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488cf299-4e2f-45ba-8c6c-060401d7edbb tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:08.264407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488cf299-4e2f-45ba-8c6c-060401d7edbb tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:08.265174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488cf299-4e2f-45ba-8c6c-060401d7edbb tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:08.265918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488cf299-4e2f-45ba-8c6c-060401d7edbb tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:08.436573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:08.501810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=26 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:08.506762 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e2fe318-6bee-48ef-848a-ea798dc95a4a tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.200675 Aug 27 02:31:08.545898 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 406/867] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:31:07 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:08.577743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-93da27e1-bc25-4d12-9ee8-e3839b683015 req-184c28c5-b8ff-49c4-b9c1-bec0c89c130e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f739696-df21-46b5-aba3-339d737d3825", "name": "network-vif-plugged", "status": "completed", "tag": "049c8b21-25a5-4ba8-9d5b-b6ef599a2196"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:08.625481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-93da27e1-bc25-4d12-9ee8-e3839b683015 req-184c28c5-b8ff-49c4-b9c1-bec0c89c130e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:08.630158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-93da27e1-bc25-4d12-9ee8-e3839b683015 req-184c28c5-b8ff-49c4-b9c1-bec0c89c130e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:08.631079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-93da27e1-bc25-4d12-9ee8-e3839b683015 req-184c28c5-b8ff-49c4-b9c1-bec0c89c130e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:08.701965 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-93da27e1-bc25-4d12-9ee8-e3839b683015 req-184c28c5-b8ff-49c4-b9c1-bec0c89c130e service nova] Creating event network-vif-plugged:049c8b21-25a5-4ba8-9d5b-b6ef599a2196 for instance 1f739696-df21-46b5-aba3-339d737d3825 on n-h2-852084-5 Aug 27 02:31:08.731936 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-93da27e1-bc25-4d12-9ee8-e3839b683015 req-184c28c5-b8ff-49c4-b9c1-bec0c89c130e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182383 Aug 27 02:31:08.733381 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 407/868] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:08.748255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8910c894-b2a7-401a-a11d-a60d7a19269e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:08.759356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8910c894-b2a7-401a-a11d-a60d7a19269e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:08.781727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8910c894-b2a7-401a-a11d-a60d7a19269e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:08.790175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8910c894-b2a7-401a-a11d-a60d7a19269e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:08.798800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8910c894-b2a7-401a-a11d-a60d7a19269e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:08.812275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8910c894-b2a7-401a-a11d-a60d7a19269e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:08.813563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8910c894-b2a7-401a-a11d-a60d7a19269e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:08.814859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8910c894-b2a7-401a-a11d-a60d7a19269e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:08.967820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-488cf299-4e2f-45ba-8c6c-060401d7edbb tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:08.989697 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-488cf299-4e2f-45ba-8c6c-060401d7edbb tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1404 microversion: 2.1 time: 0.755440 Aug 27 02:31:08.991789 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 462/869] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:08 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1404 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:09.013483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2068902180", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "2b40c531-a24f-40ba-af07-5f55c2696292"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:09.122786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] validate_networks() for [('2b40c531-a24f-40ba-af07-5f55c2696292', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:31:09.255166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8910c894-b2a7-401a-a11d-a60d7a19269e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:09.292196 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8910c894-b2a7-401a-a11d-a60d7a19269e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1316 microversion: 2.1 time: 0.556255 Aug 27 02:31:09.294350 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 408/870] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:08 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1316 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:09.314403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c385bc8-dd6a-4c09-9077-c71ba4b4cf82 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:09.316560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c385bc8-dd6a-4c09-9077-c71ba4b4cf82 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:09.331570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c385bc8-dd6a-4c09-9077-c71ba4b4cf82 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:09.332928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c385bc8-dd6a-4c09-9077-c71ba4b4cf82 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:09.334422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c385bc8-dd6a-4c09-9077-c71ba4b4cf82 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:09.338582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c385bc8-dd6a-4c09-9077-c71ba4b4cf82 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:09.341185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c385bc8-dd6a-4c09-9077-c71ba4b4cf82 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:09.342769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c385bc8-dd6a-4c09-9077-c71ba4b4cf82 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:09.738193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2c385bc8-dd6a-4c09-9077-c71ba4b4cf82 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:09.761184 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c385bc8-dd6a-4c09-9077-c71ba4b4cf82 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1470 microversion: 2.1 time: 0.460707 Aug 27 02:31:09.762758 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 409/871] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:09 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1470 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:09.793749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e961be0-6e8b-4aa6-8296-99f88acd3c39 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2adb0ee0>, body: {"security_group_rule": {"parent_group_id": "dea3d234-dd07-4dd7-9367-18ef564f0083", "ip_protocol": "tempest-999-1560194144", "from_port": 22, "to_port": 22}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:10.171417 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-4e961be0-6e8b-4aa6-8296-99f88acd3c39 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] HTTP exception thrown: Invalid IP protocol tempest-999-1560194144. Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e961be0-6e8b-4aa6-8296-99f88acd3c39 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Request method failure captured: Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 157 Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYHgAs6Kw73czQwj_BpcuUVENwHvsQBtmqIa-qco5fR0XjLEcKOuR9FjB4bO21xyva1o_4mmnW-ikOFwVqNLjFG58UcaD11z1kl-6DFSAABkD6okQmuDsBB1K6F8cy8r2Q6SbEF1hl91u8wFzyqkU4Xg2b6a4tDEfW1-WmdyN24iRoQ Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00dc9fd246374c46a105d1be8b2f9892"}]}] Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: cbd591e6a43f425da9a7f5310329ad63 Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: {"security_group_rule": {"parent_group_id": "dea3d234-dd07-4dd7-9367-18ef564f0083", "ip_protocol": "tempest-999-1560194144", "from_port": 22, "to_port": 22}} Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid IP protocol tempest-999-1560194144. Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'dea3d234-dd07-4dd7-9367-18ef564f0083', 'ip_protocol': 'tempest-999-1560194144', 'from_port': 22, 'to_port': 22}}} Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1560194144. Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1560194144. Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:10.175834 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:10.189189 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:10.189189 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:10.189189 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:10.189189 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:10.189189 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:10.189189 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:10.189189 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1560194144. Aug 27 02:31:10.189189 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:10.214773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e961be0-6e8b-4aa6-8296-99f88acd3c39 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Returning 400 to user: Invalid IP protocol tempest-999-1560194144. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:10.216952 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4e961be0-6e8b-4aa6-8296-99f88acd3c39 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.451106 Aug 27 02:31:10.224310 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 410/872] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:31:09 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 460 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:31:10.241139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-907c8f23-8914-4a13-850a-f4f263857dda tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:10.242878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-907c8f23-8914-4a13-850a-f4f263857dda tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:10.274172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-907c8f23-8914-4a13-850a-f4f263857dda tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:10.276675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-907c8f23-8914-4a13-850a-f4f263857dda tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:10.277923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-907c8f23-8914-4a13-850a-f4f263857dda tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:10.279540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-907c8f23-8914-4a13-850a-f4f263857dda tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:10.281050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-907c8f23-8914-4a13-850a-f4f263857dda tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:10.282287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-907c8f23-8914-4a13-850a-f4f263857dda tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:10.608398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:31:10.609454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:31:10.610501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:31:10.611662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:31:10.614709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:31:10.639463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:10.641001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:10.642484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:10.645705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:10.646737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:10.647607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:10.682087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Getting quotas for project c2ea38ee044d41d3a6ede6ab4806621d. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:31:10.694546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Getting quotas for user 6dbc0e90bbe94ce49ae09d2408a382c7 and project c2ea38ee044d41d3a6ede6ab4806621d. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:31:10.716782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:31:10.720280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:31:10.832945 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8261aa86-b617-445c-b89d-c557733d1971 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.836492 Aug 27 02:31:10.834064 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 463/873] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:31:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:31:10.840027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-04e8e379-41c3-46d7-bfff-82ad0041c5cd tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:10.841036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-04e8e379-41c3-46d7-bfff-82ad0041c5cd tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:10.858536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04e8e379-41c3-46d7-bfff-82ad0041c5cd tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:10.859483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04e8e379-41c3-46d7-bfff-82ad0041c5cd tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:10.860225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04e8e379-41c3-46d7-bfff-82ad0041c5cd tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:10.861344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04e8e379-41c3-46d7-bfff-82ad0041c5cd tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:10.862672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04e8e379-41c3-46d7-bfff-82ad0041c5cd tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:10.863880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04e8e379-41c3-46d7-bfff-82ad0041c5cd tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:10.990180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-907c8f23-8914-4a13-850a-f4f263857dda tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:11.013102 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-907c8f23-8914-4a13-850a-f4f263857dda tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1318 microversion: 2.1 time: 0.785228 Aug 27 02:31:11.016581 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 411/874] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:10 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1318 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:11.045603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3edf74b4-0a26-4a4b-a636-e435977d0c1e tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2ad6bd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-513117414", "description": "tempest-description-1992013283"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:11.314108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-04e8e379-41c3-46d7-bfff-82ad0041c5cd tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:11.332717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-04e8e379-41c3-46d7-bfff-82ad0041c5cd tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1404 microversion: 2.1 time: 0.497021 Aug 27 02:31:11.333979 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 464/875] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:10 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:11.343959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-63a43a8b-14c6-4235-add8-19b770188f47 req-f57cee9b-5586-491d-891c-ec4f5b27d902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ca656b0-e5d0-4749-87bd-c63080424cd0", "tag": "223e9ede-b571-4dec-8f18-e6f0edf208cc"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:11.379022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-63a43a8b-14c6-4235-add8-19b770188f47 req-f57cee9b-5586-491d-891c-ec4f5b27d902 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:11.379970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-63a43a8b-14c6-4235-add8-19b770188f47 req-f57cee9b-5586-491d-891c-ec4f5b27d902 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:11.380589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-63a43a8b-14c6-4235-add8-19b770188f47 req-f57cee9b-5586-491d-891c-ec4f5b27d902 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:11.403206 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-63a43a8b-14c6-4235-add8-19b770188f47 req-f57cee9b-5586-491d-891c-ec4f5b27d902 service nova] Creating event network-changed:223e9ede-b571-4dec-8f18-e6f0edf208cc for instance 9ca656b0-e5d0-4749-87bd-c63080424cd0 on n-h1-852084-5 Aug 27 02:31:11.411699 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-63a43a8b-14c6-4235-add8-19b770188f47 req-f57cee9b-5586-491d-891c-ec4f5b27d902 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075384 Aug 27 02:31:11.413074 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 465/876] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:11.419733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-05c32757-31db-45e3-a1eb-19e64935786d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:11.420926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-05c32757-31db-45e3-a1eb-19e64935786d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:11.428979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05c32757-31db-45e3-a1eb-19e64935786d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:11.429866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05c32757-31db-45e3-a1eb-19e64935786d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:11.430641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05c32757-31db-45e3-a1eb-19e64935786d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:11.431559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05c32757-31db-45e3-a1eb-19e64935786d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:11.432223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05c32757-31db-45e3-a1eb-19e64935786d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:11.432920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05c32757-31db-45e3-a1eb-19e64935786d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:11.779050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-05c32757-31db-45e3-a1eb-19e64935786d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:11.794722 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-05c32757-31db-45e3-a1eb-19e64935786d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1316 microversion: 2.1 time: 0.378773 Aug 27 02:31:11.795639 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 466/877] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:11 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:11.802441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5173dc51-669c-4f06-909b-1f92ab37df47 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:11.804300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5173dc51-669c-4f06-909b-1f92ab37df47 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:11.811918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5173dc51-669c-4f06-909b-1f92ab37df47 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:11.813504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5173dc51-669c-4f06-909b-1f92ab37df47 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:11.814349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5173dc51-669c-4f06-909b-1f92ab37df47 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:11.815544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5173dc51-669c-4f06-909b-1f92ab37df47 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:11.816483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5173dc51-669c-4f06-909b-1f92ab37df47 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:11.817172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5173dc51-669c-4f06-909b-1f92ab37df47 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:12.013084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5173dc51-669c-4f06-909b-1f92ab37df47 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:12.023076 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5173dc51-669c-4f06-909b-1f92ab37df47 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1470 microversion: 2.1 time: 0.225895 Aug 27 02:31:12.024085 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 467/878] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:11 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:12.030587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-850c463c-5e8e-43e9-95c6-4c93f8c78c6c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:12.031638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-850c463c-5e8e-43e9-95c6-4c93f8c78c6c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:12.041696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-850c463c-5e8e-43e9-95c6-4c93f8c78c6c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:12.043396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-850c463c-5e8e-43e9-95c6-4c93f8c78c6c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:12.044039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-850c463c-5e8e-43e9-95c6-4c93f8c78c6c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:12.046184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-850c463c-5e8e-43e9-95c6-4c93f8c78c6c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:12.047040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-850c463c-5e8e-43e9-95c6-4c93f8c78c6c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:12.047673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-850c463c-5e8e-43e9-95c6-4c93f8c78c6c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:12.224610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-850c463c-5e8e-43e9-95c6-4c93f8c78c6c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:12.238776 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-850c463c-5e8e-43e9-95c6-4c93f8c78c6c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1215 microversion: 2.1 time: 0.213118 Aug 27 02:31:12.240221 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 468/879] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:12 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1215 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:12.246693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-253ae8f3-5426-4292-828a-b54afbe41e90 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:12.248664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-253ae8f3-5426-4292-828a-b54afbe41e90 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:12.257204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-253ae8f3-5426-4292-828a-b54afbe41e90 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:12.257917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-253ae8f3-5426-4292-828a-b54afbe41e90 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:12.259831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-253ae8f3-5426-4292-828a-b54afbe41e90 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:12.260955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-253ae8f3-5426-4292-828a-b54afbe41e90 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:12.261983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-253ae8f3-5426-4292-828a-b54afbe41e90 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:12.263354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-253ae8f3-5426-4292-828a-b54afbe41e90 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:12.537037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-253ae8f3-5426-4292-828a-b54afbe41e90 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:12.557192 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-253ae8f3-5426-4292-828a-b54afbe41e90 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1318 microversion: 2.1 time: 0.314762 Aug 27 02:31:12.559302 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 469/880] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:12 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:12.591163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f4c8210-57a6-48a9-b91b-5e6e82bb1642 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:12.592731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8f4c8210-57a6-48a9-b91b-5e6e82bb1642 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:12.610911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4c8210-57a6-48a9-b91b-5e6e82bb1642 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:12.626529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4c8210-57a6-48a9-b91b-5e6e82bb1642 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:12.627001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4c8210-57a6-48a9-b91b-5e6e82bb1642 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:12.628391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4c8210-57a6-48a9-b91b-5e6e82bb1642 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:12.628882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4c8210-57a6-48a9-b91b-5e6e82bb1642 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:12.629893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4c8210-57a6-48a9-b91b-5e6e82bb1642 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:12.905970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8f4c8210-57a6-48a9-b91b-5e6e82bb1642 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:12.916347 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f4c8210-57a6-48a9-b91b-5e6e82bb1642 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1404 microversion: 2.1 time: 0.355035 Aug 27 02:31:12.916969 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 470/881] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:12 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1404 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:12.931534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-83f21800-d04c-49f4-9bc9-ad430c81bf82 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:12.932857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-83f21800-d04c-49f4-9bc9-ad430c81bf82 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:12.942965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f21800-d04c-49f4-9bc9-ad430c81bf82 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:12.943903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f21800-d04c-49f4-9bc9-ad430c81bf82 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:12.944523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f21800-d04c-49f4-9bc9-ad430c81bf82 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:12.945853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f21800-d04c-49f4-9bc9-ad430c81bf82 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:12.946539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f21800-d04c-49f4-9bc9-ad430c81bf82 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:12.947144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f21800-d04c-49f4-9bc9-ad430c81bf82 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:13.221754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-83f21800-d04c-49f4-9bc9-ad430c81bf82 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:13.273996 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-83f21800-d04c-49f4-9bc9-ad430c81bf82 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1316 microversion: 2.1 time: 0.353754 Aug 27 02:31:13.278182 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 471/882] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:12 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:13.294408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1ab07a95-630f-46cf-ad8a-34ed222578a3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:13.307919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1ab07a95-630f-46cf-ad8a-34ed222578a3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:13.334829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab07a95-630f-46cf-ad8a-34ed222578a3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:13.336697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab07a95-630f-46cf-ad8a-34ed222578a3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:13.338013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab07a95-630f-46cf-ad8a-34ed222578a3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:13.340743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab07a95-630f-46cf-ad8a-34ed222578a3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:13.342638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab07a95-630f-46cf-ad8a-34ed222578a3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:13.343998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab07a95-630f-46cf-ad8a-34ed222578a3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:13.366227 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3edf74b4-0a26-4a4b-a636-e435977d0c1e tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.344561 Aug 27 02:31:13.366947 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 412/883] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:31:11 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:13.381396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-78c147d2-3000-4994-abbe-2d904ed97000 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:13.390639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-78c147d2-3000-4994-abbe-2d904ed97000 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:13.420445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78c147d2-3000-4994-abbe-2d904ed97000 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:13.426455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78c147d2-3000-4994-abbe-2d904ed97000 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:13.426927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78c147d2-3000-4994-abbe-2d904ed97000 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:13.427695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78c147d2-3000-4994-abbe-2d904ed97000 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:13.428177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78c147d2-3000-4994-abbe-2d904ed97000 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:13.428618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78c147d2-3000-4994-abbe-2d904ed97000 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:13.855877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-78c147d2-3000-4994-abbe-2d904ed97000 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:13.876942 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-78c147d2-3000-4994-abbe-2d904ed97000 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1263 microversion: 2.1 time: 0.499340 Aug 27 02:31:13.881993 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 413/884] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:13 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1263 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:13.905453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f1de3acc-2517-4c0b-ae18-68f325bbe77b tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2adb05e0>, body: {"security_group_rule": {"parent_group_id": "23cb3afe-751c-4e67-81c9-4da1977ad60b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:13.951127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1ab07a95-630f-46cf-ad8a-34ed222578a3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:13.979948 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1ab07a95-630f-46cf-ad8a-34ed222578a3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1470 microversion: 2.1 time: 0.699552 Aug 27 02:31:13.980579 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 472/885] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:13 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1470 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:13.997036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c69ef9ee-8e60-41dc-95d5-e452606457ac tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:13.997705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c69ef9ee-8e60-41dc-95d5-e452606457ac tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:14.036082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69ef9ee-8e60-41dc-95d5-e452606457ac tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:14.036804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69ef9ee-8e60-41dc-95d5-e452606457ac tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:14.037038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69ef9ee-8e60-41dc-95d5-e452606457ac tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:14.037839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69ef9ee-8e60-41dc-95d5-e452606457ac tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:14.038313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69ef9ee-8e60-41dc-95d5-e452606457ac tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:14.038754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69ef9ee-8e60-41dc-95d5-e452606457ac tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:14.197424 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-f1de3acc-2517-4c0b-ae18-68f325bbe77b tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f1de3acc-2517-4c0b-ae18-68f325bbe77b tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Request method failure captured: Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 138 Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYHgAs6Kw73czQwj_BpcuUVENwHvsQBtmqIa-qco5fR0XjLEcKOuR9FjB4bO21xyva1o_4mmnW-ikOFwVqNLjFG58UcaD11z1kl-6DFSAABkD6okQmuDsBB1K6F8cy8r2Q6SbEF1hl91u8wFzyqkU4Xg2b6a4tDEfW1-WmdyN24iRoQ Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00dc9fd246374c46a105d1be8b2f9892"}]}] Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: cbd591e6a43f425da9a7f5310329ad63 Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: {"security_group_rule": {"parent_group_id": "23cb3afe-751c-4e67-81c9-4da1977ad60b", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'security_group_rule': {'parent_group_id': '23cb3afe-751c-4e67-81c9-4da1977ad60b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 02:31:14.199646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:14.204169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:14.204169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:14.204169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:14.204169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:14.204169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:14.204169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:14.204169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:14.204169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 27 02:31:14.204169 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:14.205056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f1de3acc-2517-4c0b-ae18-68f325bbe77b tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:14.206808 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f1de3acc-2517-4c0b-ae18-68f325bbe77b tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.318843 Aug 27 02:31:14.207866 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 414/886] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:31:13 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 324 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:31:14.213753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-22e99a4c-7a73-47fb-9913-616c9d903fb1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:14.219963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-22e99a4c-7a73-47fb-9913-616c9d903fb1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:14.238165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e99a4c-7a73-47fb-9913-616c9d903fb1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:14.239648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e99a4c-7a73-47fb-9913-616c9d903fb1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:14.242040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e99a4c-7a73-47fb-9913-616c9d903fb1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:14.244449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e99a4c-7a73-47fb-9913-616c9d903fb1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:14.248425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e99a4c-7a73-47fb-9913-616c9d903fb1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:14.249348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e99a4c-7a73-47fb-9913-616c9d903fb1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:14.607251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c69ef9ee-8e60-41dc-95d5-e452606457ac tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:14.625635 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c69ef9ee-8e60-41dc-95d5-e452606457ac tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1318 microversion: 2.1 time: 0.641656 Aug 27 02:31:14.643558 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 473/887] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:13 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:14.651547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2c6d597d-1f55-4b91-9225-2d9df3f68c9d tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2a455280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1253697060", "description": "tempest-description-1580556985"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:14.973231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-22e99a4c-7a73-47fb-9913-616c9d903fb1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:14.991008 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-22e99a4c-7a73-47fb-9913-616c9d903fb1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1592 microversion: 2.1 time: 0.781816 Aug 27 02:31:14.992619 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 415/888] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:14 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1592 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:15.004796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b1c07b8b-e718-46b3-9914-ed2efa2987cc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:15.005701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b1c07b8b-e718-46b3-9914-ed2efa2987cc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:15.028746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1c07b8b-e718-46b3-9914-ed2efa2987cc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:15.029271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1c07b8b-e718-46b3-9914-ed2efa2987cc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:15.031987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1c07b8b-e718-46b3-9914-ed2efa2987cc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:15.032909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1c07b8b-e718-46b3-9914-ed2efa2987cc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:15.033643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1c07b8b-e718-46b3-9914-ed2efa2987cc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:15.036518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1c07b8b-e718-46b3-9914-ed2efa2987cc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:15.136032 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2c6d597d-1f55-4b91-9225-2d9df3f68c9d tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.490768 Aug 27 02:31:15.147651 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 474/889] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:31:14 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:15.155079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a29c1f0-5c3e-4466-b7d4-567defa86f07 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:15.156052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a29c1f0-5c3e-4466-b7d4-567defa86f07 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:15.166576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a29c1f0-5c3e-4466-b7d4-567defa86f07 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:15.168055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a29c1f0-5c3e-4466-b7d4-567defa86f07 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:15.199699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a29c1f0-5c3e-4466-b7d4-567defa86f07 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:15.200954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a29c1f0-5c3e-4466-b7d4-567defa86f07 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:15.201623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a29c1f0-5c3e-4466-b7d4-567defa86f07 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:15.202261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a29c1f0-5c3e-4466-b7d4-567defa86f07 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:15.327851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7a29c1f0-5c3e-4466-b7d4-567defa86f07 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:15.402263 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a29c1f0-5c3e-4466-b7d4-567defa86f07 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1269 microversion: 2.1 time: 0.248668 Aug 27 02:31:15.408101 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 475/890] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:15 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1269 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:15.419416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-65613bf4-3f4e-4523-a554-b3197584becb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:15.420042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-65613bf4-3f4e-4523-a554-b3197584becb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:15.432453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65613bf4-3f4e-4523-a554-b3197584becb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:15.433037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65613bf4-3f4e-4523-a554-b3197584becb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:15.433542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65613bf4-3f4e-4523-a554-b3197584becb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:15.434545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65613bf4-3f4e-4523-a554-b3197584becb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:15.435226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65613bf4-3f4e-4523-a554-b3197584becb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:15.435860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65613bf4-3f4e-4523-a554-b3197584becb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:15.489036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:15.875584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-65613bf4-3f4e-4523-a554-b3197584becb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:15.895283 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-65613bf4-3f4e-4523-a554-b3197584becb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1475 microversion: 2.1 time: 0.477932 Aug 27 02:31:15.899893 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 476/891] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:15 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1475 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:15.917181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a41adbd8-39b8-4fcb-8199-3fe41b6b493b tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:15.927374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a41adbd8-39b8-4fcb-8199-3fe41b6b493b tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:15.953523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41adbd8-39b8-4fcb-8199-3fe41b6b493b tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:15.957773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41adbd8-39b8-4fcb-8199-3fe41b6b493b tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:15.961991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41adbd8-39b8-4fcb-8199-3fe41b6b493b tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:15.966980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41adbd8-39b8-4fcb-8199-3fe41b6b493b tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:15.971991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41adbd8-39b8-4fcb-8199-3fe41b6b493b tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:15.973428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41adbd8-39b8-4fcb-8199-3fe41b6b493b tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:16.161757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1c07b8b-e718-46b3-9914-ed2efa2987cc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:16.170981 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b1c07b8b-e718-46b3-9914-ed2efa2987cc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1316 microversion: 2.1 time: 1.176753 Aug 27 02:31:16.186010 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 416/892] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:14 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1316 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:16.191333 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a41adbd8-39b8-4fcb-8199-3fe41b6b493b tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.287654 Aug 27 02:31:16.193385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5efe1032-9c61-4acc-b74d-dd418b0f43a3 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2ab6e1f0>, body: {"security_group_rule": {"parent_group_id": "02996fb8-80be-42d3-944a-9a330af07be7", "ip_protocol": "tcp", "from_port": 22, "to_port": 574431087}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:16.194321 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 477/893] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:31:15 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825/os-interface => generated 285 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:16.203742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2abf0146-2628-4ad0-8659-c436b1ebec1c req-6e04bb37-375c-4fc6-9cc7-af105fefc531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98f8456-cc9f-4772-97f1-99e056b99f79", "name": "network-vif-plugged", "status": "completed", "tag": "466460c2-b76b-42d7-9cd5-1eab0a9cd335"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:16.216110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2abf0146-2628-4ad0-8659-c436b1ebec1c req-6e04bb37-375c-4fc6-9cc7-af105fefc531 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:16.216790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2abf0146-2628-4ad0-8659-c436b1ebec1c req-6e04bb37-375c-4fc6-9cc7-af105fefc531 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:16.217465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2abf0146-2628-4ad0-8659-c436b1ebec1c req-6e04bb37-375c-4fc6-9cc7-af105fefc531 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:16.231167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2abf0146-2628-4ad0-8659-c436b1ebec1c req-6e04bb37-375c-4fc6-9cc7-af105fefc531 service nova] Creating event network-vif-plugged:466460c2-b76b-42d7-9cd5-1eab0a9cd335 for instance f98f8456-cc9f-4772-97f1-99e056b99f79 on n-h1-852084-5 Aug 27 02:31:16.237285 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2abf0146-2628-4ad0-8659-c436b1ebec1c req-6e04bb37-375c-4fc6-9cc7-af105fefc531 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040382 Aug 27 02:31:16.238684 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 478/894] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:16.246106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-86cfe239-b03e-4649-8c0b-8dc1c14764e7 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:16.247815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-86cfe239-b03e-4649-8c0b-8dc1c14764e7 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:16.262283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86cfe239-b03e-4649-8c0b-8dc1c14764e7 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:16.262283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86cfe239-b03e-4649-8c0b-8dc1c14764e7 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:16.262283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86cfe239-b03e-4649-8c0b-8dc1c14764e7 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:16.263534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86cfe239-b03e-4649-8c0b-8dc1c14764e7 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:16.264466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86cfe239-b03e-4649-8c0b-8dc1c14764e7 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:16.265532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86cfe239-b03e-4649-8c0b-8dc1c14764e7 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:16.594630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-86cfe239-b03e-4649-8c0b-8dc1c14764e7 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:16.613286 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-86cfe239-b03e-4649-8c0b-8dc1c14764e7 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1318 microversion: 2.1 time: 0.371412 Aug 27 02:31:16.615741 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 479/895] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:16 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:16.637600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ecaf225c-6df6-46b2-bf79-c7e95096555f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:16.638882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ecaf225c-6df6-46b2-bf79-c7e95096555f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:16.651432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf225c-6df6-46b2-bf79-c7e95096555f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:16.654905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf225c-6df6-46b2-bf79-c7e95096555f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:16.655549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf225c-6df6-46b2-bf79-c7e95096555f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:16.656917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf225c-6df6-46b2-bf79-c7e95096555f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:16.659395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf225c-6df6-46b2-bf79-c7e95096555f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:16.659962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecaf225c-6df6-46b2-bf79-c7e95096555f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:16.682108 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-5efe1032-9c61-4acc-b74d-dd418b0f43a3 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] HTTP exception thrown: Invalid port range 22:574431087. Valid TCP ports should be between 1-65535 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5efe1032-9c61-4acc-b74d-dd418b0f43a3 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Request method failure captured: Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 145 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYHgAs6Kw73czQwj_BpcuUVENwHvsQBtmqIa-qco5fR0XjLEcKOuR9FjB4bO21xyva1o_4mmnW-ikOFwVqNLjFG58UcaD11z1kl-6DFSAABkD6okQmuDsBB1K6F8cy8r2Q6SbEF1hl91u8wFzyqkU4Xg2b6a4tDEfW1-WmdyN24iRoQ Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00dc9fd246374c46a105d1be8b2f9892"}]}] Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: cbd591e6a43f425da9a7f5310329ad63 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: {"security_group_rule": {"parent_group_id": "02996fb8-80be-42d3-944a-9a330af07be7", "ip_protocol": "tcp", "from_port": 22, "to_port": 574431087}} Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid port range 22:574431087. Valid TCP ports should be between 1-65535 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'security_group_rule': {'parent_group_id': '02996fb8-80be-42d3-944a-9a330af07be7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 574431087}}} Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:574431087. Valid TCP ports should be between 1-65535 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:574431087. Valid TCP ports should be between 1-65535 Aug 27 02:31:16.683713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:574431087. Valid TCP ports should be between 1-65535 Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5efe1032-9c61-4acc-b74d-dd418b0f43a3 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Returning 400 to user: Invalid port range 22:574431087. Valid TCP ports should be between 1-65535 {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5efe1032-9c61-4acc-b74d-dd418b0f43a3 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.497807 Aug 27 02:31:16.693222 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 417/896] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:31:16 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 499 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:31:16.700698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f10becb3-6fb7-4b4a-8dbe-dcffa7ac6b14 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Action: 'create', calling method: .version_select at 0x7f4d2adf1a60>, body: {"security_group_rule": {"parent_group_id": "48353c97-0835-4e74-b38c-f2f01642e1b6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:16.880996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-f10becb3-6fb7-4b4a-8dbe-dcffa7ac6b14 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 48353c97-0835-4e74-b38c-f2f01642e1b6 does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:31:16.882613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-f10becb3-6fb7-4b4a-8dbe-dcffa7ac6b14 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Neutron security group 48353c97-0835-4e74-b38c-f2f01642e1b6 not found {{(pid=122487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:31:16.883729 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-f10becb3-6fb7-4b4a-8dbe-dcffa7ac6b14 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] HTTP exception thrown: Security group 48353c97-0835-4e74-b38c-f2f01642e1b6 does not exist Aug 27 02:31:16.883729 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-fcac537d-906d-45f7-b63f-a995a50f196f'] Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f10becb3-6fb7-4b4a-8dbe-dcffa7ac6b14 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Request method failure captured: Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 138 Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYHgAs6Kw73czQwj_BpcuUVENwHvsQBtmqIa-qco5fR0XjLEcKOuR9FjB4bO21xyva1o_4mmnW-ikOFwVqNLjFG58UcaD11z1kl-6DFSAABkD6okQmuDsBB1K6F8cy8r2Q6SbEF1hl91u8wFzyqkU4Xg2b6a4tDEfW1-WmdyN24iRoQ Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00dc9fd246374c46a105d1be8b2f9892"}]}] Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: cbd591e6a43f425da9a7f5310329ad63 Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: {"security_group_rule": {"parent_group_id": "48353c97-0835-4e74-b38c-f2f01642e1b6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group 48353c97-0835-4e74-b38c-f2f01642e1b6 does not exist Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-fcac537d-906d-45f7-b63f-a995a50f196f'] Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'security_group_rule': {'parent_group_id': '48353c97-0835-4e74-b38c-f2f01642e1b6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:31:16.889436 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 48353c97-0835-4e74-b38c-f2f01642e1b6 does not exist Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcac537d-906d-45f7-b63f-a995a50f196f'] Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 48353c97-0835-4e74-b38c-f2f01642e1b6 does not exist Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcac537d-906d-45f7-b63f-a995a50f196f'] Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 48353c97-0835-4e74-b38c-f2f01642e1b6 does not exist Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcac537d-906d-45f7-b63f-a995a50f196f'] Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 48353c97-0835-4e74-b38c-f2f01642e1b6 does not exist Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fcac537d-906d-45f7-b63f-a995a50f196f'] Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f10becb3-6fb7-4b4a-8dbe-dcffa7ac6b14 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Returning 404 to user: Security group 48353c97-0835-4e74-b38c-f2f01642e1b6 does not exist Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-fcac537d-906d-45f7-b63f-a995a50f196f'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:16.893287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f10becb3-6fb7-4b4a-8dbe-dcffa7ac6b14 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.195878 Aug 27 02:31:16.895839 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 418/897] 10.222.0.99 () {60 vars in 1195 bytes} [Sat Aug 27 02:31:16 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:31:16.905216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c701ff8-41a2-4c01-a849-21a31fb147fc tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Calling method '.version_select at 0x7f4d2af2a790>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:16.982313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-4c701ff8-41a2-4c01-a849-21a31fb147fc tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 420abafd-4a6d-4e93-b6aa-b93b41b07bb1 does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:31:16.982925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-4c701ff8-41a2-4c01-a849-21a31fb147fc tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Neutron security group rule 420abafd-4a6d-4e93-b6aa-b93b41b07bb1 not found {{(pid=122487) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 27 02:31:16.983455 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-4c701ff8-41a2-4c01-a849-21a31fb147fc tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] HTTP exception thrown: Security group rule 420abafd-4a6d-4e93-b6aa-b93b41b07bb1 does not exist Aug 27 02:31:16.983455 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-39989ac0-586a-4af9-bf8f-f8d41e4ebcba'] Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c701ff8-41a2-4c01-a849-21a31fb147fc tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Request method failure captured: Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-security-group-rules/420abafd-4a6d-4e93-b6aa-b93b41b07bb1 HTTP/1.1 Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYHgAs6Kw73czQwj_BpcuUVENwHvsQBtmqIa-qco5fR0XjLEcKOuR9FjB4bO21xyva1o_4mmnW-ikOFwVqNLjFG58UcaD11z1kl-6DFSAABkD6okQmuDsBB1K6F8cy8r2Q6SbEF1hl91u8wFzyqkU4Xg2b6a4tDEfW1-WmdyN24iRoQ Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00dc9fd246374c46a105d1be8b2f9892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00dc9fd246374c46a105d1be8b2f9892"}]}] Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 00dc9fd246374c46a105d1be8b2f9892 Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000 Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: cbd591e6a43f425da9a7f5310329ad63 Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-349295000-project Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group rule 420abafd-4a6d-4e93-b6aa-b93b41b07bb1 does not exist Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-39989ac0-586a-4af9-bf8f-f8d41e4ebcba'] Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '420abafd-4a6d-4e93-b6aa-b93b41b07bb1'} Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:31:16.985424 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 420abafd-4a6d-4e93-b6aa-b93b41b07bb1 does not exist Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39989ac0-586a-4af9-bf8f-f8d41e4ebcba'] Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 420abafd-4a6d-4e93-b6aa-b93b41b07bb1 does not exist Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39989ac0-586a-4af9-bf8f-f8d41e4ebcba'] Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 420abafd-4a6d-4e93-b6aa-b93b41b07bb1 does not exist Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39989ac0-586a-4af9-bf8f-f8d41e4ebcba'] Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 420abafd-4a6d-4e93-b6aa-b93b41b07bb1 does not exist Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39989ac0-586a-4af9-bf8f-f8d41e4ebcba'] Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c701ff8-41a2-4c01-a849-21a31fb147fc tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Returning 404 to user: Security group rule 420abafd-4a6d-4e93-b6aa-b93b41b07bb1 does not exist Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-39989ac0-586a-4af9-bf8f-f8d41e4ebcba'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4c701ff8-41a2-4c01-a849-21a31fb147fc tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-group-rules/420abafd-4a6d-4e93-b6aa-b93b41b07bb1" status: 404 len: 199 microversion: 2.1 time: 0.086823 Aug 27 02:31:16.989729 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 419/898] 10.222.0.99 () {58 vars in 1287 bytes} [Sat Aug 27 02:31:16 2022] DELETE /compute/v2.1/os-security-group-rules/420abafd-4a6d-4e93-b6aa-b93b41b07bb1 => generated 199 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:31:16.997534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ee2161e0-9663-45eb-b6d5-c7ab682a670f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:17.005445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ee2161e0-9663-45eb-b6d5-c7ab682a670f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:17.022932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2161e0-9663-45eb-b6d5-c7ab682a670f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:17.023443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2161e0-9663-45eb-b6d5-c7ab682a670f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:17.023938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2161e0-9663-45eb-b6d5-c7ab682a670f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:17.024684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2161e0-9663-45eb-b6d5-c7ab682a670f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:17.025159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2161e0-9663-45eb-b6d5-c7ab682a670f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:17.025601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2161e0-9663-45eb-b6d5-c7ab682a670f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:17.238540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ecaf225c-6df6-46b2-bf79-c7e95096555f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:17.257457 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ecaf225c-6df6-46b2-bf79-c7e95096555f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1311 microversion: 2.1 time: 0.638846 Aug 27 02:31:17.258524 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 480/899] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:16 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1311 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:17.264881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e68766c6-854e-4ee2-8ae9-d6a60733b80b tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Calling method '.version_select at 0x7f4d2a4554c0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:17.744446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ee2161e0-9663-45eb-b6d5-c7ab682a670f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:17.753577 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ee2161e0-9663-45eb-b6d5-c7ab682a670f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1475 microversion: 2.1 time: 0.763083 Aug 27 02:31:17.768240 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 420/900] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:16 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1475 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:17.773781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-f550e60e-e866-434f-b1be-7c9ce10f6510 req-2bd4250b-c2cc-45e0-b384-875659296260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25161bd4-cc08-4aae-8a4b-6a501eaa3d7d", "tag": "a7bd8a59-071f-47e1-94ec-019129f9078d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:17.784665 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e68766c6-854e-4ee2-8ae9-d6a60733b80b tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/02996fb8-80be-42d3-944a-9a330af07be7" status: 202 len: 0 microversion: 2.1 time: 0.524603 Aug 27 02:31:17.785788 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 481/901] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:31:17 2022] DELETE /compute/v2.1/os-security-groups/02996fb8-80be-42d3-944a-9a330af07be7 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:31:17.786599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f550e60e-e866-434f-b1be-7c9ce10f6510 req-2bd4250b-c2cc-45e0-b384-875659296260 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:17.787296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f550e60e-e866-434f-b1be-7c9ce10f6510 req-2bd4250b-c2cc-45e0-b384-875659296260 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:17.787965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f550e60e-e866-434f-b1be-7c9ce10f6510 req-2bd4250b-c2cc-45e0-b384-875659296260 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:17.808861 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-f550e60e-e866-434f-b1be-7c9ce10f6510 req-2bd4250b-c2cc-45e0-b384-875659296260 service nova] Creating event network-changed:a7bd8a59-071f-47e1-94ec-019129f9078d for instance 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d on n-h2-852084-5 Aug 27 02:31:17.815134 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-f550e60e-e866-434f-b1be-7c9ce10f6510 req-2bd4250b-c2cc-45e0-b384-875659296260 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044958 Aug 27 02:31:17.816559 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 421/902] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:17.822557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-272e364e-32a7-47e6-b354-65253aee0b86 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:17.823797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-272e364e-32a7-47e6-b354-65253aee0b86 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:17.831154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-272e364e-32a7-47e6-b354-65253aee0b86 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:17.831996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-272e364e-32a7-47e6-b354-65253aee0b86 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:17.832689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-272e364e-32a7-47e6-b354-65253aee0b86 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:17.833941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-272e364e-32a7-47e6-b354-65253aee0b86 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:17.834424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-272e364e-32a7-47e6-b354-65253aee0b86 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:17.834868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-272e364e-32a7-47e6-b354-65253aee0b86 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:17.967356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c8d5fdb-34d5-47c9-b0bc-cf23decb95e7 tempest-FlavorsV261TestJSON-929732582 tempest-FlavorsV261TestJSON-929732582-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-806992064", "id": 1690407692, "os-flavor-access:is_public": "True"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:18.009186 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3c8d5fdb-34d5-47c9-b0bc-cf23decb95e7 tempest-FlavorsV261TestJSON-929732582 tempest-FlavorsV261TestJSON-929732582-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.221854 Aug 27 02:31:18.019639 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 482/903] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:31:17 2022] POST /compute/v2.1/flavors => generated 467 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:31:18.025338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bde61438-1039-4329-8bd1-2c443e7cadf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:18.027053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bde61438-1039-4329-8bd1-2c443e7cadf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:18.036603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bde61438-1039-4329-8bd1-2c443e7cadf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:18.037468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bde61438-1039-4329-8bd1-2c443e7cadf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:18.038205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bde61438-1039-4329-8bd1-2c443e7cadf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:18.039991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bde61438-1039-4329-8bd1-2c443e7cadf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:18.040609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bde61438-1039-4329-8bd1-2c443e7cadf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:18.041868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bde61438-1039-4329-8bd1-2c443e7cadf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:18.241530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bde61438-1039-4329-8bd1-2c443e7cadf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:18.251248 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bde61438-1039-4329-8bd1-2c443e7cadf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1318 microversion: 2.1 time: 0.229538 Aug 27 02:31:18.251911 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 483/904] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:18 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:18.259322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d8b71da3-399c-4775-8b03-e008cafe48ec tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Calling method '.version_select at 0x7f4d2a87e430>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:18.403363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-272e364e-32a7-47e6-b354-65253aee0b86 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:18.414648 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-272e364e-32a7-47e6-b354-65253aee0b86 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1316 microversion: 2.1 time: 0.596466 Aug 27 02:31:18.417728 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 422/905] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:17 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:18.632773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-644ea0ac-b51b-4226-9faf-2c449a191af5 tempest-FlavorsV261TestJSON-1899628176 tempest-FlavorsV261TestJSON-1899628176-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:18.645594 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-644ea0ac-b51b-4226-9faf-2c449a191af5 tempest-FlavorsV261TestJSON-1899628176 tempest-FlavorsV261TestJSON-1899628176-project] 10.222.0.99 "GET /compute/v2.1/flavors/1690407692" status: 200 len: 467 microversion: 2.61 time: 0.226647 Aug 27 02:31:18.646504 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 423/906] 10.222.0.99 () {60 vars in 1199 bytes} [Sat Aug 27 02:31:18 2022] GET /compute/v2.1/flavors/1690407692 => generated 467 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:31:18.651593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-288e2bb1-7e31-4474-846c-dd08c8cf8a28 req-11918d0e-f156-49c4-8e5c-1966dfe3a499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0f3c97-a84f-4dfb-b8e9-971677ca6a05", "name": "network-vif-plugged", "status": "completed", "tag": "12f54338-d142-4e94-a50c-aec96be98412"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:18.663554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-288e2bb1-7e31-4474-846c-dd08c8cf8a28 req-11918d0e-f156-49c4-8e5c-1966dfe3a499 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:18.664307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-288e2bb1-7e31-4474-846c-dd08c8cf8a28 req-11918d0e-f156-49c4-8e5c-1966dfe3a499 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:18.664742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-288e2bb1-7e31-4474-846c-dd08c8cf8a28 req-11918d0e-f156-49c4-8e5c-1966dfe3a499 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:18.677391 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-288e2bb1-7e31-4474-846c-dd08c8cf8a28 req-11918d0e-f156-49c4-8e5c-1966dfe3a499 service nova] Creating event network-vif-plugged:12f54338-d142-4e94-a50c-aec96be98412 for instance aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 on n-h2-852084-5 Aug 27 02:31:18.684546 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-288e2bb1-7e31-4474-846c-dd08c8cf8a28 req-11918d0e-f156-49c4-8e5c-1966dfe3a499 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036387 Aug 27 02:31:18.688593 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 424/907] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:18.695623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-acdc79ae-068a-48e3-ac5a-e93e368e54c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:18.696770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-acdc79ae-068a-48e3-ac5a-e93e368e54c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:18.704493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acdc79ae-068a-48e3-ac5a-e93e368e54c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:18.705891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acdc79ae-068a-48e3-ac5a-e93e368e54c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:18.706532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acdc79ae-068a-48e3-ac5a-e93e368e54c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:18.707441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acdc79ae-068a-48e3-ac5a-e93e368e54c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:18.708068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acdc79ae-068a-48e3-ac5a-e93e368e54c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:18.708654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acdc79ae-068a-48e3-ac5a-e93e368e54c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:18.798085 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d8b71da3-399c-4775-8b03-e008cafe48ec tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/23cb3afe-751c-4e67-81c9-4da1977ad60b" status: 202 len: 0 microversion: 2.1 time: 0.540982 Aug 27 02:31:18.799860 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 484/908] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:31:18 2022] DELETE /compute/v2.1/os-security-groups/23cb3afe-751c-4e67-81c9-4da1977ad60b => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:31:18.888423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1306782794", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "4771c9b0-40a4-4cf7-9f4f-f9b7b6cdc06e"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:18.969416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] validate_networks() for [('4771c9b0-40a4-4cf7-9f4f-f9b7b6cdc06e', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:31:18.979020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-acdc79ae-068a-48e3-ac5a-e93e368e54c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:18.987583 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-acdc79ae-068a-48e3-ac5a-e93e368e54c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1311 microversion: 2.1 time: 0.296848 Aug 27 02:31:18.988286 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 425/909] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:18 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1311 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:18.993257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-937f79e8-2c50-48e4-85c9-e5674870849b tempest-FlavorsV261TestJSON-929732582 tempest-FlavorsV261TestJSON-929732582-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:19.041237 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-937f79e8-2c50-48e4-85c9-e5674870849b tempest-FlavorsV261TestJSON-929732582 tempest-FlavorsV261TestJSON-929732582-project-admin] 10.222.0.99 "PUT /compute/v2.1/flavors/1690407692" status: 200 len: 468 microversion: 2.61 time: 0.051490 Aug 27 02:31:19.042354 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 426/910] 10.222.0.99 () {62 vars in 1219 bytes} [Sat Aug 27 02:31:18 2022] PUT /compute/v2.1/flavors/1690407692 => generated 468 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:31:19.048603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f9fc6105-1cb1-40b4-ac67-0120cc8d35d4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:19.049505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f9fc6105-1cb1-40b4-ac67-0120cc8d35d4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:19.058350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9fc6105-1cb1-40b4-ac67-0120cc8d35d4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:19.059287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9fc6105-1cb1-40b4-ac67-0120cc8d35d4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:19.059968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9fc6105-1cb1-40b4-ac67-0120cc8d35d4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:19.060951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9fc6105-1cb1-40b4-ac67-0120cc8d35d4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:19.061662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9fc6105-1cb1-40b4-ac67-0120cc8d35d4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:19.062345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9fc6105-1cb1-40b4-ac67-0120cc8d35d4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:19.505441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f9fc6105-1cb1-40b4-ac67-0120cc8d35d4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:19.516346 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f9fc6105-1cb1-40b4-ac67-0120cc8d35d4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1475 microversion: 2.1 time: 0.472546 Aug 27 02:31:19.534555 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 427/911] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:19 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1475 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:19.539834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9bf39738-8b5b-4bea-8526-7789c2b800c9 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Calling method '.version_select at 0x7f4d2abdaf70>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:19.831478 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9bf39738-8b5b-4bea-8526-7789c2b800c9 tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/dea3d234-dd07-4dd7-9367-18ef564f0083" status: 202 len: 0 microversion: 2.1 time: 0.295632 Aug 27 02:31:19.832080 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 428/912] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:31:19 2022] DELETE /compute/v2.1/os-security-groups/dea3d234-dd07-4dd7-9367-18ef564f0083 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:31:19.837435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0f760a3c-0c61-430b-9eeb-31d191ba7d33 tempest-FlavorsV261TestJSON-1899628176 tempest-FlavorsV261TestJSON-1899628176-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:19.883665 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0f760a3c-0c61-430b-9eeb-31d191ba7d33 tempest-FlavorsV261TestJSON-1899628176 tempest-FlavorsV261TestJSON-1899628176-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.050440 Aug 27 02:31:19.890573 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 429/913] 10.222.0.99 () {60 vars in 1187 bytes} [Sat Aug 27 02:31:19 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:31:19.900835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-382d002a-6fb7-48e2-92c5-c88bd66d0e0e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:19.901858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-382d002a-6fb7-48e2-92c5-c88bd66d0e0e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:19.912413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-382d002a-6fb7-48e2-92c5-c88bd66d0e0e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:19.914736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-382d002a-6fb7-48e2-92c5-c88bd66d0e0e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:19.915424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-382d002a-6fb7-48e2-92c5-c88bd66d0e0e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:19.916503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-382d002a-6fb7-48e2-92c5-c88bd66d0e0e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:19.917233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-382d002a-6fb7-48e2-92c5-c88bd66d0e0e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:19.920074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-382d002a-6fb7-48e2-92c5-c88bd66d0e0e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:20.147233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:31:20.148054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:31:20.149306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:31:20.150189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:31:20.151059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:31:20.175422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:20.176311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:20.177496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:20.178701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:20.180367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:20.184477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-382d002a-6fb7-48e2-92c5-c88bd66d0e0e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:20.186919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:20.196023 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-382d002a-6fb7-48e2-92c5-c88bd66d0e0e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1318 microversion: 2.1 time: 0.301266 Aug 27 02:31:20.197324 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 430/914] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:19 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:20.206758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3c840cd3-36e4-4aa8-92ab-f1e1e531e160 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:20.207850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3c840cd3-36e4-4aa8-92ab-f1e1e531e160 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:20.219943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c840cd3-36e4-4aa8-92ab-f1e1e531e160 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:20.221464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c840cd3-36e4-4aa8-92ab-f1e1e531e160 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:20.222415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c840cd3-36e4-4aa8-92ab-f1e1e531e160 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:20.223372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c840cd3-36e4-4aa8-92ab-f1e1e531e160 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:20.224028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c840cd3-36e4-4aa8-92ab-f1e1e531e160 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:20.224697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c840cd3-36e4-4aa8-92ab-f1e1e531e160 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:20.239002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Getting quotas for project 7e0bc60394fb46148212d366174c754d. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:31:20.256832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Getting quotas for user deea2ae0666b40f885daf40ad21e7c70 and project 7e0bc60394fb46148212d366174c754d. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:31:20.288002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:31:20.291457 n-d-852084-5 devstack@n-api.service[122488]: WARNING nova.utils [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1306782794 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-130678279 Aug 27 02:31:20.292477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:31:20.410111 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-422dd3ea-10a5-4a03-9a8c-23077bc31e51 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608647 Aug 27 02:31:20.420181 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 485/915] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:31:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:31:20.437046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ec33627f-ae49-4434-8899-0e92148f1015 req-6364dbfb-81e8-4549-816b-570983b996db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f739696-df21-46b5-aba3-339d737d3825", "tag": "049c8b21-25a5-4ba8-9d5b-b6ef599a2196"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:20.479633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ec33627f-ae49-4434-8899-0e92148f1015 req-6364dbfb-81e8-4549-816b-570983b996db service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:20.483733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ec33627f-ae49-4434-8899-0e92148f1015 req-6364dbfb-81e8-4549-816b-570983b996db service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:20.484855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ec33627f-ae49-4434-8899-0e92148f1015 req-6364dbfb-81e8-4549-816b-570983b996db service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:20.528199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3c840cd3-36e4-4aa8-92ab-f1e1e531e160 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:20.541929 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ec33627f-ae49-4434-8899-0e92148f1015 req-6364dbfb-81e8-4549-816b-570983b996db service nova] Creating event network-changed:049c8b21-25a5-4ba8-9d5b-b6ef599a2196 for instance 1f739696-df21-46b5-aba3-339d737d3825 on n-h2-852084-5 Aug 27 02:31:20.556354 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3c840cd3-36e4-4aa8-92ab-f1e1e531e160 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1592 microversion: 2.1 time: 0.353949 Aug 27 02:31:20.557932 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ec33627f-ae49-4434-8899-0e92148f1015 req-6364dbfb-81e8-4549-816b-570983b996db service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135506 Aug 27 02:31:20.561972 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 486/916] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:20.563207 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 431/917] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:20 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1592 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:20.585729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7b28e981-d187-44f6-8569-2faaed4a593c tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Calling method '.version_select at 0x7f4d2adef790>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:20.597156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0a023d1-2ce7-4d10-b268-47c900b7acd3 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:20.599033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b0a023d1-2ce7-4d10-b268-47c900b7acd3 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:20.613729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0a023d1-2ce7-4d10-b268-47c900b7acd3 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:20.615259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0a023d1-2ce7-4d10-b268-47c900b7acd3 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:20.616938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0a023d1-2ce7-4d10-b268-47c900b7acd3 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:20.618637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0a023d1-2ce7-4d10-b268-47c900b7acd3 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:20.620699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0a023d1-2ce7-4d10-b268-47c900b7acd3 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:20.621826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0a023d1-2ce7-4d10-b268-47c900b7acd3 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:21.274464 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7b28e981-d187-44f6-8569-2faaed4a593c tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/19c333f5-10f8-4833-8408-722b68ec7a9a" status: 202 len: 0 microversion: 2.1 time: 0.708540 Aug 27 02:31:21.276011 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 432/918] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:31:20 2022] DELETE /compute/v2.1/os-security-groups/19c333f5-10f8-4833-8408-722b68ec7a9a => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:31:21.304987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92f9a7be-6ffa-43a9-80c8-276a0711bfa7 tempest-FlavorsV261TestJSON-1899628176 tempest-FlavorsV261TestJSON-1899628176-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:21.445849 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-92f9a7be-6ffa-43a9-80c8-276a0711bfa7 tempest-FlavorsV261TestJSON-1899628176 tempest-FlavorsV261TestJSON-1899628176-project] 10.222.0.99 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.157781 Aug 27 02:31:21.465739 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 433/919] 10.222.0.99 () {60 vars in 1166 bytes} [Sat Aug 27 02:31:21 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:31:21.484589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e90774e-e6c7-4201-af9e-c801ea02a4e8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:21.488352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9e90774e-e6c7-4201-af9e-c801ea02a4e8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:21.549917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e90774e-e6c7-4201-af9e-c801ea02a4e8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:21.551831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e90774e-e6c7-4201-af9e-c801ea02a4e8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:21.552775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e90774e-e6c7-4201-af9e-c801ea02a4e8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:21.556546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e90774e-e6c7-4201-af9e-c801ea02a4e8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:21.558019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e90774e-e6c7-4201-af9e-c801ea02a4e8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:21.558953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e90774e-e6c7-4201-af9e-c801ea02a4e8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:21.673519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b0a023d1-2ce7-4d10-b268-47c900b7acd3 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:21.708631 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b0a023d1-2ce7-4d10-b268-47c900b7acd3 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1316 microversion: 2.1 time: 1.131612 Aug 27 02:31:21.731832 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 487/920] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:20 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1316 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:21.748930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aa1d5b6b-429f-4579-be62-782b1d608777 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:21.749991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aa1d5b6b-429f-4579-be62-782b1d608777 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:21.918875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa1d5b6b-429f-4579-be62-782b1d608777 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:21.952856 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aa1d5b6b-429f-4579-be62-782b1d608777 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1232 microversion: 2.1 time: 0.218773 Aug 27 02:31:21.965712 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 488/921] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:21 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1232 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:21.982531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad76638f-5f2d-4dc2-95e9-5681eee4a6ec tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:21.983858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ad76638f-5f2d-4dc2-95e9-5681eee4a6ec tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:22.005253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad76638f-5f2d-4dc2-95e9-5681eee4a6ec tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:22.006178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad76638f-5f2d-4dc2-95e9-5681eee4a6ec tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:22.006915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad76638f-5f2d-4dc2-95e9-5681eee4a6ec tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:22.008287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad76638f-5f2d-4dc2-95e9-5681eee4a6ec tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:22.009155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad76638f-5f2d-4dc2-95e9-5681eee4a6ec tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:22.009875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad76638f-5f2d-4dc2-95e9-5681eee4a6ec tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:22.340038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9e90774e-e6c7-4201-af9e-c801ea02a4e8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:22.372029 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9e90774e-e6c7-4201-af9e-c801ea02a4e8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1311 microversion: 2.1 time: 0.917727 Aug 27 02:31:22.398947 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 434/922] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:21 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1311 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:22.442492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c68d0ca9-d62a-4717-9207-274d5e773256 req-35126850-9169-443b-bec9-696c0ec6fa84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ca656b0-e5d0-4749-87bd-c63080424cd0", "name": "network-vif-plugged", "status": "completed", "tag": "223e9ede-b571-4dec-8f18-e6f0edf208cc"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:22.509258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c68d0ca9-d62a-4717-9207-274d5e773256 req-35126850-9169-443b-bec9-696c0ec6fa84 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:22.513269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c68d0ca9-d62a-4717-9207-274d5e773256 req-35126850-9169-443b-bec9-696c0ec6fa84 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:22.514513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c68d0ca9-d62a-4717-9207-274d5e773256 req-35126850-9169-443b-bec9-696c0ec6fa84 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:22.516442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad76638f-5f2d-4dc2-95e9-5681eee4a6ec tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:22.536101 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad76638f-5f2d-4dc2-95e9-5681eee4a6ec tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1475 microversion: 2.1 time: 0.578895 Aug 27 02:31:22.544692 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 489/923] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:21 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1475 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:22.559487 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c68d0ca9-d62a-4717-9207-274d5e773256 req-35126850-9169-443b-bec9-696c0ec6fa84 service nova] Creating event network-vif-plugged:223e9ede-b571-4dec-8f18-e6f0edf208cc for instance 9ca656b0-e5d0-4749-87bd-c63080424cd0 on n-h1-852084-5 Aug 27 02:31:22.561109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7286f5aa-58b2-4aa0-aad7-b09c52389518 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:22.563666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7286f5aa-58b2-4aa0-aad7-b09c52389518 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:22.571281 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c68d0ca9-d62a-4717-9207-274d5e773256 req-35126850-9169-443b-bec9-696c0ec6fa84 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159016 Aug 27 02:31:22.573190 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 435/924] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:22.584731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7286f5aa-58b2-4aa0-aad7-b09c52389518 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:22.585148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7286f5aa-58b2-4aa0-aad7-b09c52389518 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:22.585599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7286f5aa-58b2-4aa0-aad7-b09c52389518 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:22.586376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7286f5aa-58b2-4aa0-aad7-b09c52389518 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:22.586845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7286f5aa-58b2-4aa0-aad7-b09c52389518 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:22.587287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7286f5aa-58b2-4aa0-aad7-b09c52389518 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:22.592993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cdd98786-63b2-44ce-9166-cf77ac1e92da tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] Calling method '.version_select at 0x7f4d2b10db80>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:23.102824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7286f5aa-58b2-4aa0-aad7-b09c52389518 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:23.126866 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7286f5aa-58b2-4aa0-aad7-b09c52389518 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1318 microversion: 2.1 time: 0.580668 Aug 27 02:31:23.134652 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 490/925] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:22 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:23.150723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c8076be-6eac-4c16-abca-b3f7d0665079 tempest-FlavorsV261TestJSON-929732582 tempest-FlavorsV261TestJSON-929732582-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:23.212684 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5c8076be-6eac-4c16-abca-b3f7d0665079 tempest-FlavorsV261TestJSON-929732582 tempest-FlavorsV261TestJSON-929732582-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1690407692" status: 202 len: 0 microversion: 2.61 time: 0.074508 Aug 27 02:31:23.214543 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 491/926] 10.222.0.99 () {60 vars in 1202 bytes} [Sat Aug 27 02:31:23 2022] DELETE /compute/v2.1/flavors/1690407692 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:31:23.226251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b566727d-a429-4ea9-b561-bd2d9f604cbd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:23.228695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b566727d-a429-4ea9-b561-bd2d9f604cbd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:23.246643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cdd98786-63b2-44ce-9166-cf77ac1e92da tempest-SecurityGroupRulesNegativeTestJSON-349295000 tempest-SecurityGroupRulesNegativeTestJSON-349295000-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/b17b9a89-1684-47ec-b819-b4f37ab2a4fa" status: 202 len: 0 microversion: 2.1 time: 0.670825 Aug 27 02:31:23.248215 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 436/927] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:31:22 2022] DELETE /compute/v2.1/os-security-groups/b17b9a89-1684-47ec-b819-b4f37ab2a4fa => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:31:23.285269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2728a53-4586-4050-afc4-3f388980ec9d tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:23.287502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b566727d-a429-4ea9-b561-bd2d9f604cbd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:23.288733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b566727d-a429-4ea9-b561-bd2d9f604cbd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:23.292108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b566727d-a429-4ea9-b561-bd2d9f604cbd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:23.293094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e2728a53-4586-4050-afc4-3f388980ec9d tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:23.295548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b566727d-a429-4ea9-b561-bd2d9f604cbd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:23.296530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b566727d-a429-4ea9-b561-bd2d9f604cbd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:23.301782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b566727d-a429-4ea9-b561-bd2d9f604cbd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:23.323284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2728a53-4586-4050-afc4-3f388980ec9d tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:23.324499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2728a53-4586-4050-afc4-3f388980ec9d tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:23.325532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2728a53-4586-4050-afc4-3f388980ec9d tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:23.327255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2728a53-4586-4050-afc4-3f388980ec9d tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:23.328298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2728a53-4586-4050-afc4-3f388980ec9d tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:23.329265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2728a53-4586-4050-afc4-3f388980ec9d tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:23.556018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e2728a53-4586-4050-afc4-3f388980ec9d tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:23.587297 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e2728a53-4586-4050-afc4-3f388980ec9d tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1284 microversion: 2.1 time: 0.336349 Aug 27 02:31:23.588921 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 437/928] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:23 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:23.609648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-440258ea-a09c-4d4e-98cd-f3d898e4f4db tempest-FlavorsV261TestJSON-929732582 tempest-FlavorsV261TestJSON-929732582-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:23.698840 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-440258ea-a09c-4d4e-98cd-f3d898e4f4db tempest-FlavorsV261TestJSON-929732582 tempest-FlavorsV261TestJSON-929732582-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.107642 Aug 27 02:31:23.719667 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 438/929] 10.222.0.99 () {60 vars in 1187 bytes} [Sat Aug 27 02:31:23 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:31:23.744314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-db9020d3-240c-41b8-96dc-709cc43d86f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:23.746942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-db9020d3-240c-41b8-96dc-709cc43d86f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:23.759788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9020d3-240c-41b8-96dc-709cc43d86f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:23.761217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9020d3-240c-41b8-96dc-709cc43d86f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:23.762418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9020d3-240c-41b8-96dc-709cc43d86f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:23.764155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9020d3-240c-41b8-96dc-709cc43d86f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:23.765539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9020d3-240c-41b8-96dc-709cc43d86f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:23.766640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9020d3-240c-41b8-96dc-709cc43d86f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:23.779334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:23.850487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b566727d-a429-4ea9-b561-bd2d9f604cbd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:23.873551 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b566727d-a429-4ea9-b561-bd2d9f604cbd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1466 microversion: 2.1 time: 0.656374 Aug 27 02:31:23.882896 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 492/930] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:23 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1466 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:23.892326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f99ec3b3-2dbb-47a8-8eeb-66835bc9df2e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:23.894147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f99ec3b3-2dbb-47a8-8eeb-66835bc9df2e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:23.930894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f99ec3b3-2dbb-47a8-8eeb-66835bc9df2e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:23.940431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f99ec3b3-2dbb-47a8-8eeb-66835bc9df2e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:23.941606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f99ec3b3-2dbb-47a8-8eeb-66835bc9df2e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:23.943274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f99ec3b3-2dbb-47a8-8eeb-66835bc9df2e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:23.945065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f99ec3b3-2dbb-47a8-8eeb-66835bc9df2e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:23.950796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f99ec3b3-2dbb-47a8-8eeb-66835bc9df2e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:24.146873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-db9020d3-240c-41b8-96dc-709cc43d86f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:24.181007 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-db9020d3-240c-41b8-96dc-709cc43d86f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1311 microversion: 2.1 time: 0.457862 Aug 27 02:31:24.183008 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 439/931] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:23 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1311 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:24.193842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4cdf482c-5a7a-49b3-8f8c-5f07a1fb8fb3 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:24.196290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4cdf482c-5a7a-49b3-8f8c-5f07a1fb8fb3 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:24.211021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cdf482c-5a7a-49b3-8f8c-5f07a1fb8fb3 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:24.212540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cdf482c-5a7a-49b3-8f8c-5f07a1fb8fb3 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:24.214282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cdf482c-5a7a-49b3-8f8c-5f07a1fb8fb3 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:24.216280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cdf482c-5a7a-49b3-8f8c-5f07a1fb8fb3 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:24.217549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cdf482c-5a7a-49b3-8f8c-5f07a1fb8fb3 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:24.218645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cdf482c-5a7a-49b3-8f8c-5f07a1fb8fb3 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:24.551222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f99ec3b3-2dbb-47a8-8eeb-66835bc9df2e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:24.562604 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f99ec3b3-2dbb-47a8-8eeb-66835bc9df2e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1475 microversion: 2.1 time: 0.677801 Aug 27 02:31:24.573897 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 493/932] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:23 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1475 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:24.573897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9666b5f5-7207-44d1-adc3-6a11d6f9b198 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:24.573897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9666b5f5-7207-44d1-adc3-6a11d6f9b198 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:24.612184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9666b5f5-7207-44d1-adc3-6a11d6f9b198 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:24.613021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9666b5f5-7207-44d1-adc3-6a11d6f9b198 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:24.613803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9666b5f5-7207-44d1-adc3-6a11d6f9b198 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:24.615060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9666b5f5-7207-44d1-adc3-6a11d6f9b198 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:24.623472 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4cdf482c-5a7a-49b3-8f8c-5f07a1fb8fb3 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1617 microversion: 2.1 time: 0.437591 Aug 27 02:31:24.624736 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 440/933] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:24 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1617 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:24.640120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ead5d68-a6a0-401c-8ff0-888170adfa90 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:24.640772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1ead5d68-a6a0-401c-8ff0-888170adfa90 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:24.650753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ead5d68-a6a0-401c-8ff0-888170adfa90 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:24.651321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ead5d68-a6a0-401c-8ff0-888170adfa90 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:24.651774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ead5d68-a6a0-401c-8ff0-888170adfa90 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:24.652507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ead5d68-a6a0-401c-8ff0-888170adfa90 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:24.652968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ead5d68-a6a0-401c-8ff0-888170adfa90 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:24.653573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ead5d68-a6a0-401c-8ff0-888170adfa90 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:24.666222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9666b5f5-7207-44d1-adc3-6a11d6f9b198 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.051s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:24.679810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9666b5f5-7207-44d1-adc3-6a11d6f9b198 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:24.881100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1ead5d68-a6a0-401c-8ff0-888170adfa90 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:24.899163 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1ead5d68-a6a0-401c-8ff0-888170adfa90 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1292 microversion: 2.1 time: 0.272156 Aug 27 02:31:24.900746 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 441/934] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:24 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1292 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:24.996801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2121098812", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6"]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:25.129276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:31:25.369851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9666b5f5-7207-44d1-adc3-6a11d6f9b198 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:25.379747 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9666b5f5-7207-44d1-adc3-6a11d6f9b198 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1467 microversion: 2.1 time: 0.814880 Aug 27 02:31:25.382831 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 494/935] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:24 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1467 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:25.389636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-403fcb14-37e9-4d91-a296-dbfcd2dcf4f6 req-d60ea8b7-b50c-4d9b-9256-aa60f295f184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25161bd4-cc08-4aae-8a4b-6a501eaa3d7d", "name": "network-vif-plugged", "status": "completed", "tag": "a7bd8a59-071f-47e1-94ec-019129f9078d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:25.402824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-403fcb14-37e9-4d91-a296-dbfcd2dcf4f6 req-d60ea8b7-b50c-4d9b-9256-aa60f295f184 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:25.403728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-403fcb14-37e9-4d91-a296-dbfcd2dcf4f6 req-d60ea8b7-b50c-4d9b-9256-aa60f295f184 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:25.404391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-403fcb14-37e9-4d91-a296-dbfcd2dcf4f6 req-d60ea8b7-b50c-4d9b-9256-aa60f295f184 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:25.423340 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-403fcb14-37e9-4d91-a296-dbfcd2dcf4f6 req-d60ea8b7-b50c-4d9b-9256-aa60f295f184 service nova] Creating event network-vif-plugged:a7bd8a59-071f-47e1-94ec-019129f9078d for instance 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d on n-h2-852084-5 Aug 27 02:31:25.430497 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-403fcb14-37e9-4d91-a296-dbfcd2dcf4f6 req-d60ea8b7-b50c-4d9b-9256-aa60f295f184 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045712 Aug 27 02:31:25.431423 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 495/936] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:25.439992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11cd0630-7cd2-4eea-a873-1c164e6828ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:25.440858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-11cd0630-7cd2-4eea-a873-1c164e6828ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:25.445260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:25.451961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cd0630-7cd2-4eea-a873-1c164e6828ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:25.452609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cd0630-7cd2-4eea-a873-1c164e6828ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:25.453840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cd0630-7cd2-4eea-a873-1c164e6828ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:25.455789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cd0630-7cd2-4eea-a873-1c164e6828ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:25.457571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cd0630-7cd2-4eea-a873-1c164e6828ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:25.458261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cd0630-7cd2-4eea-a873-1c164e6828ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:25.822964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:31:25.823872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:31:25.825139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:31:25.826056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:31:25.827394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:31:25.847478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:25.848634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:25.849585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:25.851698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:25.852924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:25.854203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:25.882941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-11cd0630-7cd2-4eea-a873-1c164e6828ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:25.897323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:31:25.898538 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11cd0630-7cd2-4eea-a873-1c164e6828ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1311 microversion: 2.1 time: 0.464295 Aug 27 02:31:25.910862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:31:25.914274 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 496/937] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:25 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1311 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:25.935348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4e2e3dac-277a-44b2-af10-ebe74f59ee07 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:25.935700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4e2e3dac-277a-44b2-af10-ebe74f59ee07 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:25.939897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:31:25.944824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:31:25.947311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e2e3dac-277a-44b2-af10-ebe74f59ee07 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:25.948341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e2e3dac-277a-44b2-af10-ebe74f59ee07 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:25.949267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e2e3dac-277a-44b2-af10-ebe74f59ee07 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:25.950795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e2e3dac-277a-44b2-af10-ebe74f59ee07 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:25.951819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e2e3dac-277a-44b2-af10-ebe74f59ee07 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:25.952744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e2e3dac-277a-44b2-af10-ebe74f59ee07 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:26.051514 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e185ae8-d60c-4c8e-b291-67c6eb1c1395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061166 Aug 27 02:31:26.053258 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 442/938] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:31:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:31:26.070613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ade879cb-b0ef-4749-8dc8-0833aed546ab tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:26.072241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ade879cb-b0ef-4749-8dc8-0833aed546ab tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:26.091004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade879cb-b0ef-4749-8dc8-0833aed546ab tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:26.092207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade879cb-b0ef-4749-8dc8-0833aed546ab tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:26.093331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade879cb-b0ef-4749-8dc8-0833aed546ab tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:26.095025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade879cb-b0ef-4749-8dc8-0833aed546ab tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:26.096212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade879cb-b0ef-4749-8dc8-0833aed546ab tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:26.097271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade879cb-b0ef-4749-8dc8-0833aed546ab tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:26.263252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4e2e3dac-277a-44b2-af10-ebe74f59ee07 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:26.281038 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4e2e3dac-277a-44b2-af10-ebe74f59ee07 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79" status: 200 len: 1466 microversion: 2.1 time: 0.364114 Aug 27 02:31:26.282104 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 497/939] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:25 2022] GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 1466 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:26.288933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f0fab5d6-2069-4c25-ab76-e0b4a023c03f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:26.289977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f0fab5d6-2069-4c25-ab76-e0b4a023c03f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:26.316168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0fab5d6-2069-4c25-ab76-e0b4a023c03f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:26.317002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0fab5d6-2069-4c25-ab76-e0b4a023c03f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:26.321615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0fab5d6-2069-4c25-ab76-e0b4a023c03f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:26.323247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0fab5d6-2069-4c25-ab76-e0b4a023c03f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:26.323247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0fab5d6-2069-4c25-ab76-e0b4a023c03f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:26.323696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0fab5d6-2069-4c25-ab76-e0b4a023c03f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:26.805927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ade879cb-b0ef-4749-8dc8-0833aed546ab tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:26.864629 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ade879cb-b0ef-4749-8dc8-0833aed546ab tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1475 microversion: 2.1 time: 0.808655 Aug 27 02:31:26.866301 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 443/940] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:26 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1475 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:26.875255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-503537be-23e6-41e9-9504-01601e294ab4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:26.876637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-503537be-23e6-41e9-9504-01601e294ab4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:26.890084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f0fab5d6-2069-4c25-ab76-e0b4a023c03f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:26.903618 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f0fab5d6-2069-4c25-ab76-e0b4a023c03f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1332 microversion: 2.1 time: 0.616067 Aug 27 02:31:26.904405 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 498/941] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:26 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1332 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:26.912812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ea788f90-b2ba-44b7-bd68-f9cf6ccb6146 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1462097344"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:26.920906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ea788f90-b2ba-44b7-bd68-f9cf6ccb6146 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:26.948216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea788f90-b2ba-44b7-bd68-f9cf6ccb6146 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:26.950325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea788f90-b2ba-44b7-bd68-f9cf6ccb6146 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:26.951676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea788f90-b2ba-44b7-bd68-f9cf6ccb6146 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:26.957316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea788f90-b2ba-44b7-bd68-f9cf6ccb6146 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:26.958650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea788f90-b2ba-44b7-bd68-f9cf6ccb6146 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:26.974379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea788f90-b2ba-44b7-bd68-f9cf6ccb6146 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:26.999945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-503537be-23e6-41e9-9504-01601e294ab4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:27.013150 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-503537be-23e6-41e9-9504-01601e294ab4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1217 microversion: 2.1 time: 0.141237 Aug 27 02:31:27.013837 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 444/942] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:26 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:27.046007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-418fe175-8e95-4fe2-b403-9526a5b255f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:27.050934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-418fe175-8e95-4fe2-b403-9526a5b255f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:27.069775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-418fe175-8e95-4fe2-b403-9526a5b255f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:27.071183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-418fe175-8e95-4fe2-b403-9526a5b255f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:27.072009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-418fe175-8e95-4fe2-b403-9526a5b255f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:27.073097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-418fe175-8e95-4fe2-b403-9526a5b255f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:27.074195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-418fe175-8e95-4fe2-b403-9526a5b255f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:27.075846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-418fe175-8e95-4fe2-b403-9526a5b255f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:27.680452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-418fe175-8e95-4fe2-b403-9526a5b255f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:27.695969 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-418fe175-8e95-4fe2-b403-9526a5b255f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1311 microversion: 2.1 time: 0.679043 Aug 27 02:31:27.718053 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 445/943] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:27 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1311 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:27.730716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:27.781302 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ea788f90-b2ba-44b7-bd68-f9cf6ccb6146 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "POST /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79/action" status: 202 len: 0 microversion: 2.1 time: 0.874771 Aug 27 02:31:27.796877 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 499/944] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:31:26 2022] POST /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79/action => generated 0 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:31:27.808586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3dc72bbf-2b29-4f5f-b7db-b39aa5c1f617 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2b15da60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:27.917055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-061b7bd5-8feb-4c3c-8643-33248a0edfc7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:27.918793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-061b7bd5-8feb-4c3c-8643-33248a0edfc7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:27.945266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-061b7bd5-8feb-4c3c-8643-33248a0edfc7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:27.951128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-061b7bd5-8feb-4c3c-8643-33248a0edfc7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:27.952015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-061b7bd5-8feb-4c3c-8643-33248a0edfc7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:27.953382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-061b7bd5-8feb-4c3c-8643-33248a0edfc7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:27.959020 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3dc72bbf-2b29-4f5f-b7db-b39aa5c1f617 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.164083 Aug 27 02:31:27.960666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-061b7bd5-8feb-4c3c-8643-33248a0edfc7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:27.961561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-061b7bd5-8feb-4c3c-8643-33248a0edfc7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:27.978188 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 446/945] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:27 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:31:27.987287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8024e8f9-540e-4043-beee-e31d4d3754d9 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:27.991573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8024e8f9-540e-4043-beee-e31d4d3754d9 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:27.997339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=93,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:28.013856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8024e8f9-540e-4043-beee-e31d4d3754d9 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:28.015283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8024e8f9-540e-4043-beee-e31d4d3754d9 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:28.016438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8024e8f9-540e-4043-beee-e31d4d3754d9 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:28.018737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8024e8f9-540e-4043-beee-e31d4d3754d9 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:28.020200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8024e8f9-540e-4043-beee-e31d4d3754d9 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:28.021359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8024e8f9-540e-4043-beee-e31d4d3754d9 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:28.651898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-061b7bd5-8feb-4c3c-8643-33248a0edfc7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:28.669814 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-061b7bd5-8feb-4c3c-8643-33248a0edfc7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1475 microversion: 2.1 time: 0.765625 Aug 27 02:31:28.670419 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 500/946] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:27 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1475 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:31:28.680741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c7c0823a-a1b4-4c63-8f39-33e56a4ff62f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:28.684374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c7c0823a-a1b4-4c63-8f39-33e56a4ff62f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:28.700530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7c0823a-a1b4-4c63-8f39-33e56a4ff62f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:28.703804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7c0823a-a1b4-4c63-8f39-33e56a4ff62f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:28.705274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7c0823a-a1b4-4c63-8f39-33e56a4ff62f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:28.707712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7c0823a-a1b4-4c63-8f39-33e56a4ff62f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:28.709056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7c0823a-a1b4-4c63-8f39-33e56a4ff62f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:28.711878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7c0823a-a1b4-4c63-8f39-33e56a4ff62f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:28.811666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8024e8f9-540e-4043-beee-e31d4d3754d9 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:28.834628 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8024e8f9-540e-4043-beee-e31d4d3754d9 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1332 microversion: 2.1 time: 0.854343 Aug 27 02:31:28.852700 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 447/947] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:27 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1332 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:28.868781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a64b4fd-1a87-49b7-824d-5b9a43310df6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:28.878498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c7c0823a-a1b4-4c63-8f39-33e56a4ff62f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:28.886034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a64b4fd-1a87-49b7-824d-5b9a43310df6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:28.906363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a64b4fd-1a87-49b7-824d-5b9a43310df6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:28.906877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a64b4fd-1a87-49b7-824d-5b9a43310df6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:28.907334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a64b4fd-1a87-49b7-824d-5b9a43310df6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:28.909477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a64b4fd-1a87-49b7-824d-5b9a43310df6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:28.910255 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c7c0823a-a1b4-4c63-8f39-33e56a4ff62f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1269 microversion: 2.1 time: 0.230745 Aug 27 02:31:28.910489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a64b4fd-1a87-49b7-824d-5b9a43310df6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:28.911138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a64b4fd-1a87-49b7-824d-5b9a43310df6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:28.911835 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 501/948] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:28 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:28.986114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d792434-175f-4d94-aead-23ea8f673e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a455dc0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:29.087512 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9d792434-175f-4d94-aead-23ea8f673e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.105623 Aug 27 02:31:29.088270 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 502/949] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:28 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:31:29.520385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a64b4fd-1a87-49b7-824d-5b9a43310df6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:29.531509 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a64b4fd-1a87-49b7-824d-5b9a43310df6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1494 microversion: 2.1 time: 0.675678 Aug 27 02:31:29.532444 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 448/950] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:28 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1494 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:29.569185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cae4ad8f-385b-4666-8b5b-be7f7b96ed5c tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:29.570698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cae4ad8f-385b-4666-8b5b-be7f7b96ed5c tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:29.582216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cae4ad8f-385b-4666-8b5b-be7f7b96ed5c tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:29.583389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cae4ad8f-385b-4666-8b5b-be7f7b96ed5c tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:29.584091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cae4ad8f-385b-4666-8b5b-be7f7b96ed5c tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:29.585283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cae4ad8f-385b-4666-8b5b-be7f7b96ed5c tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:29.586297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cae4ad8f-385b-4666-8b5b-be7f7b96ed5c tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:29.587209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cae4ad8f-385b-4666-8b5b-be7f7b96ed5c tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:29.708379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cff914c6-4985-4b0e-a0da-e92e407807fb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:29.709526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cff914c6-4985-4b0e-a0da-e92e407807fb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:29.737709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff914c6-4985-4b0e-a0da-e92e407807fb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:29.754028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff914c6-4985-4b0e-a0da-e92e407807fb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:29.755290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff914c6-4985-4b0e-a0da-e92e407807fb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:29.758103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff914c6-4985-4b0e-a0da-e92e407807fb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:29.759361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff914c6-4985-4b0e-a0da-e92e407807fb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:29.760610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff914c6-4985-4b0e-a0da-e92e407807fb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:30.037637 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cae4ad8f-385b-4666-8b5b-be7f7b96ed5c tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1645 microversion: 2.1 time: 0.475462 Aug 27 02:31:30.040701 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 503/951] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:29 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1645 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:31:30.074849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c1460c3c-67fd-40dd-aa88-b8ef95bdeb5a tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:30.082605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c1460c3c-67fd-40dd-aa88-b8ef95bdeb5a tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:30.125777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1460c3c-67fd-40dd-aa88-b8ef95bdeb5a tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:30.129810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1460c3c-67fd-40dd-aa88-b8ef95bdeb5a tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:30.131690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1460c3c-67fd-40dd-aa88-b8ef95bdeb5a tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:30.134037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1460c3c-67fd-40dd-aa88-b8ef95bdeb5a tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:30.135200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1460c3c-67fd-40dd-aa88-b8ef95bdeb5a tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:30.139478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1460c3c-67fd-40dd-aa88-b8ef95bdeb5a tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:30.226798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:30.390096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cff914c6-4985-4b0e-a0da-e92e407807fb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:30.416542 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cff914c6-4985-4b0e-a0da-e92e407807fb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1475 microversion: 2.1 time: 0.723965 Aug 27 02:31:30.421153 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 449/952] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:29 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1475 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:30.428457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d14e648b-6ceb-4cdf-8bdc-d2edb88d41b1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:30.429965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d14e648b-6ceb-4cdf-8bdc-d2edb88d41b1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:30.443564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d14e648b-6ceb-4cdf-8bdc-d2edb88d41b1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:30.444073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d14e648b-6ceb-4cdf-8bdc-d2edb88d41b1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:30.444717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d14e648b-6ceb-4cdf-8bdc-d2edb88d41b1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:30.445753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d14e648b-6ceb-4cdf-8bdc-d2edb88d41b1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:30.448339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d14e648b-6ceb-4cdf-8bdc-d2edb88d41b1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:30.450887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d14e648b-6ceb-4cdf-8bdc-d2edb88d41b1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:30.606384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d14e648b-6ceb-4cdf-8bdc-d2edb88d41b1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:30.647733 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d14e648b-6ceb-4cdf-8bdc-d2edb88d41b1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1275 microversion: 2.1 time: 0.218410 Aug 27 02:31:30.649104 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 450/953] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:30 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1275 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:30.664396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d576b681-f847-4bac-ac4f-37457ea88272 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:30.666892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d576b681-f847-4bac-ac4f-37457ea88272 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:30.682701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d576b681-f847-4bac-ac4f-37457ea88272 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:30.684317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d576b681-f847-4bac-ac4f-37457ea88272 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:30.685206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d576b681-f847-4bac-ac4f-37457ea88272 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:30.686967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d576b681-f847-4bac-ac4f-37457ea88272 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:30.687645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d576b681-f847-4bac-ac4f-37457ea88272 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:30.688293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d576b681-f847-4bac-ac4f-37457ea88272 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:30.881846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c1460c3c-67fd-40dd-aa88-b8ef95bdeb5a tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:30.907674 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c1460c3c-67fd-40dd-aa88-b8ef95bdeb5a tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1332 microversion: 2.1 time: 0.861423 Aug 27 02:31:30.929438 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 504/954] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:30 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1332 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:30.929438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-88ed990b-d373-43fe-a7ff-2ffcb441766f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a4313a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:31.060178 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-88ed990b-d373-43fe-a7ff-2ffcb441766f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.143249 Aug 27 02:31:31.061785 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 505/955] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:30 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:31.074330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2618101c-a338-4e89-9171-9c08b6aa7649 req-3544c3bc-8a60-4976-8522-725a1711651a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f105905c-eb08-4e79-9282-66e543fe5f7c", "tag": "71d54b5e-fa1a-4a54-a257-b96b90b49a4a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:31.099023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2618101c-a338-4e89-9171-9c08b6aa7649 req-3544c3bc-8a60-4976-8522-725a1711651a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:31.100111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2618101c-a338-4e89-9171-9c08b6aa7649 req-3544c3bc-8a60-4976-8522-725a1711651a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:31.100939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2618101c-a338-4e89-9171-9c08b6aa7649 req-3544c3bc-8a60-4976-8522-725a1711651a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:31.116965 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2618101c-a338-4e89-9171-9c08b6aa7649 req-3544c3bc-8a60-4976-8522-725a1711651a service nova] Creating event network-changed:71d54b5e-fa1a-4a54-a257-b96b90b49a4a for instance f105905c-eb08-4e79-9282-66e543fe5f7c on n-h1-852084-5 Aug 27 02:31:31.125414 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2618101c-a338-4e89-9171-9c08b6aa7649 req-3544c3bc-8a60-4976-8522-725a1711651a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059426 Aug 27 02:31:31.127287 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 506/956] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:31.194906 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d576b681-f847-4bac-ac4f-37457ea88272 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1645 microversion: 2.1 time: 0.542594 Aug 27 02:31:31.200704 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 451/957] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:30 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1645 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:31.244866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c25910c0-14be-40c7-8b62-6125d8879acf tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:31.265289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c25910c0-14be-40c7-8b62-6125d8879acf tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:31.266812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c25910c0-14be-40c7-8b62-6125d8879acf tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:31.268275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c25910c0-14be-40c7-8b62-6125d8879acf tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:31.270371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c25910c0-14be-40c7-8b62-6125d8879acf tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:31.275727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c25910c0-14be-40c7-8b62-6125d8879acf tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:31.276706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c25910c0-14be-40c7-8b62-6125d8879acf tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:31.391516 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c25910c0-14be-40c7-8b62-6125d8879acf tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.158349 Aug 27 02:31:31.403893 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 507/958] 10.222.0.99 () {58 vars in 1176 bytes} [Sat Aug 27 02:31:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:31:31.411961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7685cead-1a2b-4ed8-8fe2-4f7d3286471a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:31.413224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7685cead-1a2b-4ed8-8fe2-4f7d3286471a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:31.454370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7685cead-1a2b-4ed8-8fe2-4f7d3286471a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:31.455551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7685cead-1a2b-4ed8-8fe2-4f7d3286471a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:31.456409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7685cead-1a2b-4ed8-8fe2-4f7d3286471a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:31.468385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e81d1e80-1bc9-42ba-bf25-a689345e3ada tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:31.472755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e81d1e80-1bc9-42ba-bf25-a689345e3ada tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:31.476700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7685cead-1a2b-4ed8-8fe2-4f7d3286471a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:31.480883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7685cead-1a2b-4ed8-8fe2-4f7d3286471a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:31.484238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7685cead-1a2b-4ed8-8fe2-4f7d3286471a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:31.499329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e81d1e80-1bc9-42ba-bf25-a689345e3ada tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:31.502121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e81d1e80-1bc9-42ba-bf25-a689345e3ada tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:31.503211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e81d1e80-1bc9-42ba-bf25-a689345e3ada tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:31.505160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e81d1e80-1bc9-42ba-bf25-a689345e3ada tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:31.506274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e81d1e80-1bc9-42ba-bf25-a689345e3ada tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:31.507827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e81d1e80-1bc9-42ba-bf25-a689345e3ada tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:31.750347 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7685cead-1a2b-4ed8-8fe2-4f7d3286471a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d/action" status: 202 len: 0 microversion: 2.1 time: 0.343251 Aug 27 02:31:31.757223 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 452/959] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:31:31 2022] POST /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:31:31.790254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c9ad2e9c-9fff-47b9-85a8-4bf9d54296f6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:31.795430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c9ad2e9c-9fff-47b9-85a8-4bf9d54296f6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:31.827339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ad2e9c-9fff-47b9-85a8-4bf9d54296f6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:31.828668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ad2e9c-9fff-47b9-85a8-4bf9d54296f6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:31.830437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ad2e9c-9fff-47b9-85a8-4bf9d54296f6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:31.832717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ad2e9c-9fff-47b9-85a8-4bf9d54296f6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:31.834514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ad2e9c-9fff-47b9-85a8-4bf9d54296f6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:31.835686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ad2e9c-9fff-47b9-85a8-4bf9d54296f6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:31.926886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=14 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:32.022775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c9ad2e9c-9fff-47b9-85a8-4bf9d54296f6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:32.045307 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c9ad2e9c-9fff-47b9-85a8-4bf9d54296f6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1275 microversion: 2.1 time: 0.290942 Aug 27 02:31:32.046693 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 453/960] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:31 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:32.056771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-24cb5ffc-8d1f-40e7-a44e-1e6ea206a89a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:32.058505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-24cb5ffc-8d1f-40e7-a44e-1e6ea206a89a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:32.086551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24cb5ffc-8d1f-40e7-a44e-1e6ea206a89a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:32.088260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24cb5ffc-8d1f-40e7-a44e-1e6ea206a89a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:32.088902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24cb5ffc-8d1f-40e7-a44e-1e6ea206a89a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:32.089856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24cb5ffc-8d1f-40e7-a44e-1e6ea206a89a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:32.091218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24cb5ffc-8d1f-40e7-a44e-1e6ea206a89a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:32.091844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24cb5ffc-8d1f-40e7-a44e-1e6ea206a89a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:32.416218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e81d1e80-1bc9-42ba-bf25-a689345e3ada tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:32.440257 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e81d1e80-1bc9-42ba-bf25-a689345e3ada tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1475 microversion: 2.1 time: 0.980686 Aug 27 02:31:32.442059 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 508/961] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:31 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1475 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:32.458476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fee93d3c-d0d6-4a75-9164-75d4e1b141f5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:32.459910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fee93d3c-d0d6-4a75-9164-75d4e1b141f5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:32.468748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee93d3c-d0d6-4a75-9164-75d4e1b141f5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:32.468959 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-24cb5ffc-8d1f-40e7-a44e-1e6ea206a89a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1650 microversion: 2.1 time: 0.413139 Aug 27 02:31:32.469883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee93d3c-d0d6-4a75-9164-75d4e1b141f5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:32.471290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee93d3c-d0d6-4a75-9164-75d4e1b141f5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:32.472396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee93d3c-d0d6-4a75-9164-75d4e1b141f5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:32.473238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee93d3c-d0d6-4a75-9164-75d4e1b141f5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:32.473373 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 454/962] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:32 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1650 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:32.474947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee93d3c-d0d6-4a75-9164-75d4e1b141f5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:32.489592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74b9a3d9-e6b5-4512-af9d-79b94a9a0051 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2af2a670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:32.589764 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-74b9a3d9-e6b5-4512-af9d-79b94a9a0051 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.112896 Aug 27 02:31:32.601827 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 455/963] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:32 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:32.835974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fee93d3c-d0d6-4a75-9164-75d4e1b141f5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:32.845974 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fee93d3c-d0d6-4a75-9164-75d4e1b141f5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1332 microversion: 2.1 time: 0.400427 Aug 27 02:31:32.846631 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 509/964] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:32 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1332 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:33.091532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f05bcdb5-16c1-4ca3-be55-b2ee0ae9bbde tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:33.095211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f05bcdb5-16c1-4ca3-be55-b2ee0ae9bbde tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:33.124714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f05bcdb5-16c1-4ca3-be55-b2ee0ae9bbde tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:33.126967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f05bcdb5-16c1-4ca3-be55-b2ee0ae9bbde tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:33.127728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f05bcdb5-16c1-4ca3-be55-b2ee0ae9bbde tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:33.129019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f05bcdb5-16c1-4ca3-be55-b2ee0ae9bbde tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:33.134619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f05bcdb5-16c1-4ca3-be55-b2ee0ae9bbde tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:33.137299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f05bcdb5-16c1-4ca3-be55-b2ee0ae9bbde tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:33.467365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ecce2f03-2ee7-40c6-aec7-1a78da830b6f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:33.469581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ecce2f03-2ee7-40c6-aec7-1a78da830b6f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:33.495189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecce2f03-2ee7-40c6-aec7-1a78da830b6f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:33.496809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecce2f03-2ee7-40c6-aec7-1a78da830b6f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:33.498594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecce2f03-2ee7-40c6-aec7-1a78da830b6f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:33.506885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecce2f03-2ee7-40c6-aec7-1a78da830b6f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:33.508355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecce2f03-2ee7-40c6-aec7-1a78da830b6f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:33.510860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecce2f03-2ee7-40c6-aec7-1a78da830b6f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:34.251405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f05bcdb5-16c1-4ca3-be55-b2ee0ae9bbde tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:34.274153 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f05bcdb5-16c1-4ca3-be55-b2ee0ae9bbde tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1317 microversion: 2.1 time: 1.184759 Aug 27 02:31:34.274962 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 456/965] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:33 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1317 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:34.280384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d5d46447-2977-403d-bcf2-606c737ced28 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:34.281019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d5d46447-2977-403d-bcf2-606c737ced28 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:34.295440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5d46447-2977-403d-bcf2-606c737ced28 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:34.299249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5d46447-2977-403d-bcf2-606c737ced28 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:34.299806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5d46447-2977-403d-bcf2-606c737ced28 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:34.300511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5d46447-2977-403d-bcf2-606c737ced28 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:34.301004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5d46447-2977-403d-bcf2-606c737ced28 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:34.301433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5d46447-2977-403d-bcf2-606c737ced28 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:34.618950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ecce2f03-2ee7-40c6-aec7-1a78da830b6f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:34.644294 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ecce2f03-2ee7-40c6-aec7-1a78da830b6f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1475 microversion: 2.1 time: 1.183567 Aug 27 02:31:34.650776 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 510/966] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:33 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1475 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:31:34.664336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-854420ff-e54b-4ccf-bad6-ceb112c4fb4a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a5415e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:34.851416 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-854420ff-e54b-4ccf-bad6-ceb112c4fb4a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.195533 Aug 27 02:31:34.852685 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 511/967] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:34 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:34.877709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-39232b32-4fa4-4401-bab1-c83b98079833 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:34.879442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-39232b32-4fa4-4401-bab1-c83b98079833 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:34.893551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39232b32-4fa4-4401-bab1-c83b98079833 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:34.895066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39232b32-4fa4-4401-bab1-c83b98079833 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:34.896417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39232b32-4fa4-4401-bab1-c83b98079833 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:34.898120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39232b32-4fa4-4401-bab1-c83b98079833 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:34.900583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39232b32-4fa4-4401-bab1-c83b98079833 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:34.901738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39232b32-4fa4-4401-bab1-c83b98079833 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:35.147387 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d5d46447-2977-403d-bcf2-606c737ced28 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1630 microversion: 2.1 time: 0.866009 Aug 27 02:31:35.161706 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 457/968] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:34 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1630 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:35.449055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-39232b32-4fa4-4401-bab1-c83b98079833 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:35.460582 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-39232b32-4fa4-4401-bab1-c83b98079833 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1332 microversion: 2.1 time: 0.591259 Aug 27 02:31:35.465107 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 512/969] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:34 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1332 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:35.478214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2c35293e-fba5-4c04-8f48-e13d70cc3c9a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852084-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:35.486733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2c35293e-fba5-4c04-8f48-e13d70cc3c9a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:35.507987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c35293e-fba5-4c04-8f48-e13d70cc3c9a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:35.509638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c35293e-fba5-4c04-8f48-e13d70cc3c9a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:35.511095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c35293e-fba5-4c04-8f48-e13d70cc3c9a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:35.512567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c35293e-fba5-4c04-8f48-e13d70cc3c9a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:35.513431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c35293e-fba5-4c04-8f48-e13d70cc3c9a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:35.514607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c35293e-fba5-4c04-8f48-e13d70cc3c9a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:35.596424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-2c35293e-fba5-4c04-8f48-e13d70cc3c9a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lazy-loading 'flavor' on Instance uuid 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:31:35.648647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2c35293e-fba5-4c04-8f48-e13d70cc3c9a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Going to try to live migrate instance to n-h1-852084-5 {{(pid=122488) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:31:35.874937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:35.988611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-80c9a1b6-2c3c-4115-a20c-7425541b3129 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Calling method '.version_select at 0x7f4d2ad950d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:35.998097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80c9a1b6-2c3c-4115-a20c-7425541b3129 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:35.998965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80c9a1b6-2c3c-4115-a20c-7425541b3129 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:35.999738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80c9a1b6-2c3c-4115-a20c-7425541b3129 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:36.028412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80c9a1b6-2c3c-4115-a20c-7425541b3129 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:36.029911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80c9a1b6-2c3c-4115-a20c-7425541b3129 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:36.031017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80c9a1b6-2c3c-4115-a20c-7425541b3129 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:36.038124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:36.071332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80c9a1b6-2c3c-4115-a20c-7425541b3129 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:36.072772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80c9a1b6-2c3c-4115-a20c-7425541b3129 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:36.073876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80c9a1b6-2c3c-4115-a20c-7425541b3129 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:36.099473 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-80c9a1b6-2c3c-4115-a20c-7425541b3129 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.943160 Aug 27 02:31:36.112809 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 458/970] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:31:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:36.123409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bcf22288-5763-4c3a-9e1d-2516c29a055c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:36.125150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bcf22288-5763-4c3a-9e1d-2516c29a055c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:36.140620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf22288-5763-4c3a-9e1d-2516c29a055c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:36.141970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf22288-5763-4c3a-9e1d-2516c29a055c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:36.143761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf22288-5763-4c3a-9e1d-2516c29a055c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:36.145395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf22288-5763-4c3a-9e1d-2516c29a055c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:36.147685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf22288-5763-4c3a-9e1d-2516c29a055c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:36.148948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf22288-5763-4c3a-9e1d-2516c29a055c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:36.572989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bcf22288-5763-4c3a-9e1d-2516c29a055c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:36.620282 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bcf22288-5763-4c3a-9e1d-2516c29a055c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1317 microversion: 2.1 time: 0.505505 Aug 27 02:31:36.643462 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 459/971] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:36 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:36.659130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e986ee28-1467-4627-960b-00eb7add2aa2 req-59668152-ed25-4150-bac2-eb3671029b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b45589e-4cb2-4409-9bcc-44f800e02517", "tag": "5e58378f-a961-4b09-89d3-2349658075c1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:36.697092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e986ee28-1467-4627-960b-00eb7add2aa2 req-59668152-ed25-4150-bac2-eb3671029b50 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:36.698389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e986ee28-1467-4627-960b-00eb7add2aa2 req-59668152-ed25-4150-bac2-eb3671029b50 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:36.699424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e986ee28-1467-4627-960b-00eb7add2aa2 req-59668152-ed25-4150-bac2-eb3671029b50 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:36.736921 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e986ee28-1467-4627-960b-00eb7add2aa2 req-59668152-ed25-4150-bac2-eb3671029b50 service nova] Creating event network-changed:5e58378f-a961-4b09-89d3-2349658075c1 for instance 4b45589e-4cb2-4409-9bcc-44f800e02517 on n-h2-852084-5 Aug 27 02:31:36.769316 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e986ee28-1467-4627-960b-00eb7add2aa2 req-59668152-ed25-4150-bac2-eb3671029b50 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113385 Aug 27 02:31:36.771238 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 460/972] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:36.785750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-321a5a0e-c6c5-4f92-9932-edc444291e51 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:36.786924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-321a5a0e-c6c5-4f92-9932-edc444291e51 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:36.799260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321a5a0e-c6c5-4f92-9932-edc444291e51 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:36.800100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321a5a0e-c6c5-4f92-9932-edc444291e51 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:36.801081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321a5a0e-c6c5-4f92-9932-edc444291e51 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:36.802593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321a5a0e-c6c5-4f92-9932-edc444291e51 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:36.803401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321a5a0e-c6c5-4f92-9932-edc444291e51 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:36.805529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-321a5a0e-c6c5-4f92-9932-edc444291e51 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:37.005578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:37.326367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-321a5a0e-c6c5-4f92-9932-edc444291e51 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:37.355640 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-321a5a0e-c6c5-4f92-9932-edc444291e51 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1475 microversion: 2.1 time: 0.581170 Aug 27 02:31:37.359441 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 461/973] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:36 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1475 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:37.379581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2993f719-b83f-4d67-9497-c3927b303e62 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2b0f31f0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:37.542720 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2993f719-b83f-4d67-9497-c3927b303e62 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.181375 Aug 27 02:31:37.548908 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 462/974] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:37 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:37.571535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e678c0b2-bbb5-46a1-abb9-8ec941dc779c tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Calling method '.version_select at 0x7f4d2adef310>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:37.583667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e678c0b2-bbb5-46a1-abb9-8ec941dc779c tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:37.585906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e678c0b2-bbb5-46a1-abb9-8ec941dc779c tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:37.587979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e678c0b2-bbb5-46a1-abb9-8ec941dc779c tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:37.780956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e678c0b2-bbb5-46a1-abb9-8ec941dc779c tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:37.783293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e678c0b2-bbb5-46a1-abb9-8ec941dc779c tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:37.789176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e678c0b2-bbb5-46a1-abb9-8ec941dc779c tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:38.014586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e678c0b2-bbb5-46a1-abb9-8ec941dc779c tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:38.048177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e678c0b2-bbb5-46a1-abb9-8ec941dc779c tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:38.048885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e678c0b2-bbb5-46a1-abb9-8ec941dc779c tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:38.096961 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e678c0b2-bbb5-46a1-abb9-8ec941dc779c tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/n-h2-852084-5/servers" status: 200 len: 670 microversion: 2.1 time: 0.542078 Aug 27 02:31:38.098013 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 463/975] 10.222.0.99 () {58 vars in 1212 bytes} [Sat Aug 27 02:31:37 2022] GET /compute/v2.1/os-hypervisors/n-h2-852084-5/servers => generated 670 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:38.117445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-dc744349-1819-4e40-8fd1-c02fcefe37d0 req-3c46b264-6e18-4be5-8a08-a650eef36de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98f8456-cc9f-4772-97f1-99e056b99f79", "name": "network-vif-plugged", "status": "completed", "tag": "466460c2-b76b-42d7-9cd5-1eab0a9cd335"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:38.143628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-dc744349-1819-4e40-8fd1-c02fcefe37d0 req-3c46b264-6e18-4be5-8a08-a650eef36de1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:38.145007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-dc744349-1819-4e40-8fd1-c02fcefe37d0 req-3c46b264-6e18-4be5-8a08-a650eef36de1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:38.146108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-dc744349-1819-4e40-8fd1-c02fcefe37d0 req-3c46b264-6e18-4be5-8a08-a650eef36de1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:38.213881 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-dc744349-1819-4e40-8fd1-c02fcefe37d0 req-3c46b264-6e18-4be5-8a08-a650eef36de1 service nova] Creating event network-vif-plugged:466460c2-b76b-42d7-9cd5-1eab0a9cd335 for instance f98f8456-cc9f-4772-97f1-99e056b99f79 on n-h1-852084-5 Aug 27 02:31:38.241625 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-dc744349-1819-4e40-8fd1-c02fcefe37d0 req-3c46b264-6e18-4be5-8a08-a650eef36de1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141432 Aug 27 02:31:38.252463 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 464/976] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:38.287983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1dded8bf-dca9-4a23-92ec-498128a5bec5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:38.293042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1dded8bf-dca9-4a23-92ec-498128a5bec5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:38.311208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dded8bf-dca9-4a23-92ec-498128a5bec5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:38.314100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dded8bf-dca9-4a23-92ec-498128a5bec5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:38.315242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dded8bf-dca9-4a23-92ec-498128a5bec5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:38.316634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dded8bf-dca9-4a23-92ec-498128a5bec5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:38.322499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dded8bf-dca9-4a23-92ec-498128a5bec5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:38.324416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dded8bf-dca9-4a23-92ec-498128a5bec5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:38.809591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1dded8bf-dca9-4a23-92ec-498128a5bec5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:38.824738 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1dded8bf-dca9-4a23-92ec-498128a5bec5 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1332 microversion: 2.1 time: 0.569354 Aug 27 02:31:38.826423 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 465/977] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:38 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1332 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:38.835795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45ab0bd3-6454-40eb-8216-503613de0cb9 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:38.836958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-45ab0bd3-6454-40eb-8216-503613de0cb9 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:38.849195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45ab0bd3-6454-40eb-8216-503613de0cb9 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:38.850195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45ab0bd3-6454-40eb-8216-503613de0cb9 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:38.850819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45ab0bd3-6454-40eb-8216-503613de0cb9 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:38.852826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45ab0bd3-6454-40eb-8216-503613de0cb9 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:38.853822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45ab0bd3-6454-40eb-8216-503613de0cb9 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:38.854598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45ab0bd3-6454-40eb-8216-503613de0cb9 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.094834 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2c35293e-fba5-4c04-8f48-e13d70cc3c9a tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d/action" status: 202 len: 0 microversion: 2.1 time: 3.627947 Aug 27 02:31:39.095856 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 513/978] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:31:35 2022] POST /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d/action => generated 0 bytes in 3629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:31:39.101292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-81e20741-50b8-4de0-bcd7-5cf571bd83bf tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Calling method '.version_select at 0x7f4d2b0b4550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:39.106168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e20741-50b8-4de0-bcd7-5cf571bd83bf tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.106997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e20741-50b8-4de0-bcd7-5cf571bd83bf tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.107646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e20741-50b8-4de0-bcd7-5cf571bd83bf tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.112417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-45ab0bd3-6454-40eb-8216-503613de0cb9 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:39.122525 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-45ab0bd3-6454-40eb-8216-503613de0cb9 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1317 microversion: 2.1 time: 0.294137 Aug 27 02:31:39.129371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e20741-50b8-4de0-bcd7-5cf571bd83bf tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.130339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e20741-50b8-4de0-bcd7-5cf571bd83bf tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.131166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e20741-50b8-4de0-bcd7-5cf571bd83bf tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.138329 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 466/979] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:38 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:39.147755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e20741-50b8-4de0-bcd7-5cf571bd83bf tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.148529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e20741-50b8-4de0-bcd7-5cf571bd83bf tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.149141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81e20741-50b8-4de0-bcd7-5cf571bd83bf tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.150134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7b5bb167-9bc5-4eaf-930a-c63c21296d35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:39.150772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7b5bb167-9bc5-4eaf-930a-c63c21296d35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:39.157457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5bb167-9bc5-4eaf-930a-c63c21296d35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.158086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5bb167-9bc5-4eaf-930a-c63c21296d35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.158656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5bb167-9bc5-4eaf-930a-c63c21296d35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.159201 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-81e20741-50b8-4de0-bcd7-5cf571bd83bf tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.062472 Aug 27 02:31:39.159592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5bb167-9bc5-4eaf-930a-c63c21296d35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.160068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5bb167-9bc5-4eaf-930a-c63c21296d35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.160513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5bb167-9bc5-4eaf-930a-c63c21296d35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.161219 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 514/980] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:31:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:39.167263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37bd1562-700c-4f65-8830-862843abc410 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a41e040>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:39.295085 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-37bd1562-700c-4f65-8830-862843abc410 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.131690 Aug 27 02:31:39.314409 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 515/981] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:39 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:39.441206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7b5bb167-9bc5-4eaf-930a-c63c21296d35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:39.460318 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7b5bb167-9bc5-4eaf-930a-c63c21296d35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1474 microversion: 2.1 time: 0.320659 Aug 27 02:31:39.460967 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 467/982] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:39 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1474 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:39.529733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3ff0ad2c-d1e0-4ba6-a8c8-544c12ca767b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:39.534447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3ff0ad2c-d1e0-4ba6-a8c8-544c12ca767b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:39.587640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ff0ad2c-d1e0-4ba6-a8c8-544c12ca767b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.591127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ff0ad2c-d1e0-4ba6-a8c8-544c12ca767b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.592998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ff0ad2c-d1e0-4ba6-a8c8-544c12ca767b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.597414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ff0ad2c-d1e0-4ba6-a8c8-544c12ca767b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.603064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ff0ad2c-d1e0-4ba6-a8c8-544c12ca767b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.606997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ff0ad2c-d1e0-4ba6-a8c8-544c12ca767b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.654125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e1c0dc94-6789-4bb6-9f84-8988be2f75b4 tempest-AZV2TestJSON-1377766125 tempest-AZV2TestJSON-1377766125-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:39.660545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1c0dc94-6789-4bb6-9f84-8988be2f75b4 tempest-AZV2TestJSON-1377766125 tempest-AZV2TestJSON-1377766125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.662029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1c0dc94-6789-4bb6-9f84-8988be2f75b4 tempest-AZV2TestJSON-1377766125 tempest-AZV2TestJSON-1377766125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.664572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1c0dc94-6789-4bb6-9f84-8988be2f75b4 tempest-AZV2TestJSON-1377766125 tempest-AZV2TestJSON-1377766125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.667467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1c0dc94-6789-4bb6-9f84-8988be2f75b4 tempest-AZV2TestJSON-1377766125 tempest-AZV2TestJSON-1377766125-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.668647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1c0dc94-6789-4bb6-9f84-8988be2f75b4 tempest-AZV2TestJSON-1377766125 tempest-AZV2TestJSON-1377766125-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.671069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1c0dc94-6789-4bb6-9f84-8988be2f75b4 tempest-AZV2TestJSON-1377766125 tempest-AZV2TestJSON-1377766125-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.738876 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e1c0dc94-6789-4bb6-9f84-8988be2f75b4 tempest-AZV2TestJSON-1377766125 tempest-AZV2TestJSON-1377766125-project] 10.222.0.99 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.421646 Aug 27 02:31:39.754035 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 516/983] 10.222.0.99 () {58 vars in 1164 bytes} [Sat Aug 27 02:31:39 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:31:39.764521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8daa3da0-219a-4eb5-95ea-baa6e77c31b6 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Calling method '.version_select at 0x7f4d2a41e160>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:39.768953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8daa3da0-219a-4eb5-95ea-baa6e77c31b6 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.770267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8daa3da0-219a-4eb5-95ea-baa6e77c31b6 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.771371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8daa3da0-219a-4eb5-95ea-baa6e77c31b6 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.804785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8daa3da0-219a-4eb5-95ea-baa6e77c31b6 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.806442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8daa3da0-219a-4eb5-95ea-baa6e77c31b6 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.807586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8daa3da0-219a-4eb5-95ea-baa6e77c31b6 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.822151 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8daa3da0-219a-4eb5-95ea-baa6e77c31b6 tempest-HypervisorAdminUnderV252Test-2026321324 tempest-HypervisorAdminUnderV252Test-2026321324-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors/n-h2-852084-5/search" status: 200 len: 104 microversion: 2.1 time: 0.065665 Aug 27 02:31:39.824513 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 517/984] 10.222.0.99 () {58 vars in 1209 bytes} [Sat Aug 27 02:31:39 2022] GET /compute/v2.1/os-hypervisors/n-h2-852084-5/search => generated 104 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:39.882940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a875ad21-fb37-413a-8884-3179d3f72193 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:39.890264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a875ad21-fb37-413a-8884-3179d3f72193 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:39.918162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a875ad21-fb37-413a-8884-3179d3f72193 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.919971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a875ad21-fb37-413a-8884-3179d3f72193 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.920782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a875ad21-fb37-413a-8884-3179d3f72193 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:39.922174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a875ad21-fb37-413a-8884-3179d3f72193 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:39.923584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a875ad21-fb37-413a-8884-3179d3f72193 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:39.924435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a875ad21-fb37-413a-8884-3179d3f72193 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:40.546573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a875ad21-fb37-413a-8884-3179d3f72193 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:40.560361 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a875ad21-fb37-413a-8884-3179d3f72193 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1332 microversion: 2.1 time: 0.706681 Aug 27 02:31:40.572376 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 518/985] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:39 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1332 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:40.578547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3ff0ad2c-d1e0-4ba6-a8c8-544c12ca767b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:40.586142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-98fddb42-43fd-4073-ac23-151de54b21d8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:40.586763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-98fddb42-43fd-4073-ac23-151de54b21d8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:40.612516 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3ff0ad2c-d1e0-4ba6-a8c8-544c12ca767b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1504 microversion: 2.1 time: 1.145466 Aug 27 02:31:40.622672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98fddb42-43fd-4073-ac23-151de54b21d8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:40.624508 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 468/986] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:39 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1504 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:40.633757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d4261eb8-d1c7-44d7-8675-4d14177b2e22 req-6a5899c4-d035-4dde-8167-99dc43c7568d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f105905c-eb08-4e79-9282-66e543fe5f7c", "name": "network-vif-plugged", "status": "completed", "tag": "71d54b5e-fa1a-4a54-a257-b96b90b49a4a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:40.637594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98fddb42-43fd-4073-ac23-151de54b21d8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:40.638142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98fddb42-43fd-4073-ac23-151de54b21d8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:40.638904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98fddb42-43fd-4073-ac23-151de54b21d8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:40.639380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98fddb42-43fd-4073-ac23-151de54b21d8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:40.639816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98fddb42-43fd-4073-ac23-151de54b21d8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:40.647716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d4261eb8-d1c7-44d7-8675-4d14177b2e22 req-6a5899c4-d035-4dde-8167-99dc43c7568d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:40.653092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d4261eb8-d1c7-44d7-8675-4d14177b2e22 req-6a5899c4-d035-4dde-8167-99dc43c7568d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:40.657420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d4261eb8-d1c7-44d7-8675-4d14177b2e22 req-6a5899c4-d035-4dde-8167-99dc43c7568d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:40.676135 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d4261eb8-d1c7-44d7-8675-4d14177b2e22 req-6a5899c4-d035-4dde-8167-99dc43c7568d service nova] Creating event network-vif-plugged:71d54b5e-fa1a-4a54-a257-b96b90b49a4a for instance f105905c-eb08-4e79-9282-66e543fe5f7c on n-h1-852084-5 Aug 27 02:31:40.682989 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d4261eb8-d1c7-44d7-8675-4d14177b2e22 req-6a5899c4-d035-4dde-8167-99dc43c7568d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056918 Aug 27 02:31:40.684344 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 469/987] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:40.691661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d96fd1f8-6b41-4aab-bbf5-539c4e12e20f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2ac30280>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:40.766638 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d96fd1f8-6b41-4aab-bbf5-539c4e12e20f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.077075 Aug 27 02:31:40.786170 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 470/988] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:40 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:40.805299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ca0b018-6fbd-4f3c-8ea4-4a05167b7737 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:40.809997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0ca0b018-6fbd-4f3c-8ea4-4a05167b7737 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:40.823112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca0b018-6fbd-4f3c-8ea4-4a05167b7737 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:40.824357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca0b018-6fbd-4f3c-8ea4-4a05167b7737 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:40.825148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca0b018-6fbd-4f3c-8ea4-4a05167b7737 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:40.826511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca0b018-6fbd-4f3c-8ea4-4a05167b7737 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:40.827624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca0b018-6fbd-4f3c-8ea4-4a05167b7737 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:40.828674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca0b018-6fbd-4f3c-8ea4-4a05167b7737 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:41.658056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-98fddb42-43fd-4073-ac23-151de54b21d8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:41.685701 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-98fddb42-43fd-4073-ac23-151de54b21d8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1317 microversion: 2.1 time: 1.107535 Aug 27 02:31:41.688569 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 519/989] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:40 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1317 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:41.711624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-249aedec-ac36-4a46-ba48-0df815f90599 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:41.718246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-249aedec-ac36-4a46-ba48-0df815f90599 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:41.748979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-249aedec-ac36-4a46-ba48-0df815f90599 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:41.754235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-249aedec-ac36-4a46-ba48-0df815f90599 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:41.755501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-249aedec-ac36-4a46-ba48-0df815f90599 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:41.762510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-249aedec-ac36-4a46-ba48-0df815f90599 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:41.763736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-249aedec-ac36-4a46-ba48-0df815f90599 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:41.772640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-249aedec-ac36-4a46-ba48-0df815f90599 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:42.328057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-249aedec-ac36-4a46-ba48-0df815f90599 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:42.351176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:42.356204 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-249aedec-ac36-4a46-ba48-0df815f90599 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1332 microversion: 2.1 time: 0.664225 Aug 27 02:31:42.363435 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 520/990] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:41 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1332 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:42.393577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a85ab148-d6f1-4295-a7a9-ca296e797ac5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:42.394267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a85ab148-d6f1-4295-a7a9-ca296e797ac5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:42.401529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a85ab148-d6f1-4295-a7a9-ca296e797ac5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:42.402029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a85ab148-d6f1-4295-a7a9-ca296e797ac5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:42.402390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a85ab148-d6f1-4295-a7a9-ca296e797ac5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:42.403367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a85ab148-d6f1-4295-a7a9-ca296e797ac5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:42.404025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a85ab148-d6f1-4295-a7a9-ca296e797ac5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:42.404646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a85ab148-d6f1-4295-a7a9-ca296e797ac5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:42.783700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0ca0b018-6fbd-4f3c-8ea4-4a05167b7737 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:42.802494 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0ca0b018-6fbd-4f3c-8ea4-4a05167b7737 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1474 microversion: 2.1 time: 2.007337 Aug 27 02:31:42.807775 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 471/991] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:40 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1474 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:42.828503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8cc1fd8-a7b5-44b4-a08d-b04fcf05c177 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2adb0dc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:42.941711 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e8cc1fd8-a7b5-44b4-a08d-b04fcf05c177 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.132293 Aug 27 02:31:42.966731 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 472/992] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:42 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:42.972424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-83767d88-e8a1-447a-977f-1fc8e7367640 req-facc5eaf-3ca5-446c-9354-a05019535dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d1eeab-d777-433e-b23b-1d6bd540823d", "name": "network-vif-unplugged", "status": "completed", "tag": "8fe72264-a971-4067-8e10-b097ab827266"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:43.001841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-83767d88-e8a1-447a-977f-1fc8e7367640 req-facc5eaf-3ca5-446c-9354-a05019535dca service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:43.002542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-83767d88-e8a1-447a-977f-1fc8e7367640 req-facc5eaf-3ca5-446c-9354-a05019535dca service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:43.003292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-83767d88-e8a1-447a-977f-1fc8e7367640 req-facc5eaf-3ca5-446c-9354-a05019535dca service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:43.032939 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-83767d88-e8a1-447a-977f-1fc8e7367640 req-facc5eaf-3ca5-446c-9354-a05019535dca service nova] Creating event network-vif-unplugged:8fe72264-a971-4067-8e10-b097ab827266 for instance 91d1eeab-d777-433e-b23b-1d6bd540823d on n-h2-852084-5 Aug 27 02:31:43.049069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-83767d88-e8a1-447a-977f-1fc8e7367640 req-facc5eaf-3ca5-446c-9354-a05019535dca service nova] Instance 91d1eeab-d777-433e-b23b-1d6bd540823d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:31:43.066205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a85ab148-d6f1-4295-a7a9-ca296e797ac5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:43.074887 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-83767d88-e8a1-447a-977f-1fc8e7367640 req-facc5eaf-3ca5-446c-9354-a05019535dca service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103997 Aug 27 02:31:43.077619 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a85ab148-d6f1-4295-a7a9-ca296e797ac5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1504 microversion: 2.1 time: 0.697333 Aug 27 02:31:43.078588 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 473/993] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:43.088880 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 521/994] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:42 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1504 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:43.096416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6c22cee0-45f3-4a6d-8fa7-63d9bca14655 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:43.097393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6c22cee0-45f3-4a6d-8fa7-63d9bca14655 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:43.107262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c22cee0-45f3-4a6d-8fa7-63d9bca14655 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:43.108066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c22cee0-45f3-4a6d-8fa7-63d9bca14655 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:43.108780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c22cee0-45f3-4a6d-8fa7-63d9bca14655 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:43.109834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c22cee0-45f3-4a6d-8fa7-63d9bca14655 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:43.111059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c22cee0-45f3-4a6d-8fa7-63d9bca14655 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:43.111826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c22cee0-45f3-4a6d-8fa7-63d9bca14655 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:43.412555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-22703a42-a96d-417e-9df5-2e8e252827e3 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:43.414366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-22703a42-a96d-417e-9df5-2e8e252827e3 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:43.438963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22703a42-a96d-417e-9df5-2e8e252827e3 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:43.440872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22703a42-a96d-417e-9df5-2e8e252827e3 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:43.442671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22703a42-a96d-417e-9df5-2e8e252827e3 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:43.444705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22703a42-a96d-417e-9df5-2e8e252827e3 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:43.445909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22703a42-a96d-417e-9df5-2e8e252827e3 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:43.446869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22703a42-a96d-417e-9df5-2e8e252827e3 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:43.825623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-22703a42-a96d-417e-9df5-2e8e252827e3 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:43.839692 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-22703a42-a96d-417e-9df5-2e8e252827e3 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1332 microversion: 2.1 time: 0.444181 Aug 27 02:31:43.840699 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 522/995] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:43 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1332 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:43.872048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-924bb61a-8fde-4187-9deb-bb8c5b32c4a6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:43.875613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-924bb61a-8fde-4187-9deb-bb8c5b32c4a6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:43.896629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-924bb61a-8fde-4187-9deb-bb8c5b32c4a6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:43.897488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-924bb61a-8fde-4187-9deb-bb8c5b32c4a6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:43.898511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-924bb61a-8fde-4187-9deb-bb8c5b32c4a6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:43.903333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-924bb61a-8fde-4187-9deb-bb8c5b32c4a6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:43.904185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-924bb61a-8fde-4187-9deb-bb8c5b32c4a6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:43.904642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-924bb61a-8fde-4187-9deb-bb8c5b32c4a6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:44.245820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6c22cee0-45f3-4a6d-8fa7-63d9bca14655 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:44.263349 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6c22cee0-45f3-4a6d-8fa7-63d9bca14655 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1317 microversion: 2.1 time: 1.179716 Aug 27 02:31:44.267466 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 474/996] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:43 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1317 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:44.275011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e510125d-c39b-4185-9682-625664db3ef6 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a9600d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:44.303650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-924bb61a-8fde-4187-9deb-bb8c5b32c4a6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:44.318651 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-924bb61a-8fde-4187-9deb-bb8c5b32c4a6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1474 microversion: 2.1 time: 0.456760 Aug 27 02:31:44.335248 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 523/997] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:43 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1474 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:44.342084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1de09d65-ac0e-4604-9c2c-b2c9ebd4de32 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:44.342993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1de09d65-ac0e-4604-9c2c-b2c9ebd4de32 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:44.372777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1de09d65-ac0e-4604-9c2c-b2c9ebd4de32 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:44.373593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1de09d65-ac0e-4604-9c2c-b2c9ebd4de32 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:44.374298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1de09d65-ac0e-4604-9c2c-b2c9ebd4de32 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:44.375221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1de09d65-ac0e-4604-9c2c-b2c9ebd4de32 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:44.375855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1de09d65-ac0e-4604-9c2c-b2c9ebd4de32 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:44.376990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1de09d65-ac0e-4604-9c2c-b2c9ebd4de32 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:44.403803 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e510125d-c39b-4185-9682-625664db3ef6 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.134675 Aug 27 02:31:44.407879 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 475/998] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:44 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:44.778355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1de09d65-ac0e-4604-9c2c-b2c9ebd4de32 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:44.821702 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1de09d65-ac0e-4604-9c2c-b2c9ebd4de32 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1504 microversion: 2.1 time: 0.484591 Aug 27 02:31:44.842543 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 524/999] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:44 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:44.893493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-63e9ee77-cccc-4e32-81e9-222976d7c322 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:44.899479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-63e9ee77-cccc-4e32-81e9-222976d7c322 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:44.928104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63e9ee77-cccc-4e32-81e9-222976d7c322 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:44.933581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63e9ee77-cccc-4e32-81e9-222976d7c322 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:44.937183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63e9ee77-cccc-4e32-81e9-222976d7c322 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:44.942561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63e9ee77-cccc-4e32-81e9-222976d7c322 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:44.943707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63e9ee77-cccc-4e32-81e9-222976d7c322 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:44.946988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63e9ee77-cccc-4e32-81e9-222976d7c322 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:45.112317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-20f14bb6-9528-4eee-ac61-53278fdca13a req-93abdcc0-f772-4674-b248-8ddbdad54168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b45589e-4cb2-4409-9bcc-44f800e02517", "name": "network-vif-plugged", "status": "completed", "tag": "5e58378f-a961-4b09-89d3-2349658075c1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:45.144194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-20f14bb6-9528-4eee-ac61-53278fdca13a req-93abdcc0-f772-4674-b248-8ddbdad54168 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:45.145074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-20f14bb6-9528-4eee-ac61-53278fdca13a req-93abdcc0-f772-4674-b248-8ddbdad54168 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:45.148511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-20f14bb6-9528-4eee-ac61-53278fdca13a req-93abdcc0-f772-4674-b248-8ddbdad54168 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:45.200124 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-20f14bb6-9528-4eee-ac61-53278fdca13a req-93abdcc0-f772-4674-b248-8ddbdad54168 service nova] Creating event network-vif-plugged:5e58378f-a961-4b09-89d3-2349658075c1 for instance 4b45589e-4cb2-4409-9bcc-44f800e02517 on n-h2-852084-5 Aug 27 02:31:45.224987 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-20f14bb6-9528-4eee-ac61-53278fdca13a req-93abdcc0-f772-4674-b248-8ddbdad54168 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123614 Aug 27 02:31:45.225719 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 525/1000] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:31:45.291094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-634f6f17-2e7c-4018-a5f9-fcb980b7f17c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:45.291688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-634f6f17-2e7c-4018-a5f9-fcb980b7f17c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:45.300685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-634f6f17-2e7c-4018-a5f9-fcb980b7f17c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:45.301161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-634f6f17-2e7c-4018-a5f9-fcb980b7f17c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:45.308740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-634f6f17-2e7c-4018-a5f9-fcb980b7f17c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:45.312966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-634f6f17-2e7c-4018-a5f9-fcb980b7f17c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:45.315804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-634f6f17-2e7c-4018-a5f9-fcb980b7f17c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:45.317134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-634f6f17-2e7c-4018-a5f9-fcb980b7f17c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:45.902944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-634f6f17-2e7c-4018-a5f9-fcb980b7f17c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:45.939421 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-634f6f17-2e7c-4018-a5f9-fcb980b7f17c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1317 microversion: 2.1 time: 0.652525 Aug 27 02:31:45.941798 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 526/1001] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:45 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:31:45.953479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3b137ac3-55b6-4aa4-87cd-a5de75dea185 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:45.958382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3b137ac3-55b6-4aa4-87cd-a5de75dea185 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:45.973893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b137ac3-55b6-4aa4-87cd-a5de75dea185 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:45.975380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b137ac3-55b6-4aa4-87cd-a5de75dea185 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:45.976584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b137ac3-55b6-4aa4-87cd-a5de75dea185 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:45.979310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b137ac3-55b6-4aa4-87cd-a5de75dea185 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:45.980645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b137ac3-55b6-4aa4-87cd-a5de75dea185 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:45.981824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b137ac3-55b6-4aa4-87cd-a5de75dea185 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:46.019230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-63e9ee77-cccc-4e32-81e9-222976d7c322 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:46.038475 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-63e9ee77-cccc-4e32-81e9-222976d7c322 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1536 microversion: 2.1 time: 1.157146 Aug 27 02:31:46.039890 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 476/1002] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:44 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1536 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:46.047364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-855c6c43-8bc6-4c46-baf7-b618b556e8ec tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2ab8d670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:46.131432 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-855c6c43-8bc6-4c46-baf7-b618b556e8ec tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.089232 Aug 27 02:31:46.132915 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 477/1003] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:46 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:46.156665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4af5d3bd-12d7-4a11-b61f-566f69cad708 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:46.179127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4af5d3bd-12d7-4a11-b61f-566f69cad708 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:46.232434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4af5d3bd-12d7-4a11-b61f-566f69cad708 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:46.236291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4af5d3bd-12d7-4a11-b61f-566f69cad708 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:46.237975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4af5d3bd-12d7-4a11-b61f-566f69cad708 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:46.241991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4af5d3bd-12d7-4a11-b61f-566f69cad708 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:46.245232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4af5d3bd-12d7-4a11-b61f-566f69cad708 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:46.246493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4af5d3bd-12d7-4a11-b61f-566f69cad708 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:46.686981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3b137ac3-55b6-4aa4-87cd-a5de75dea185 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:46.706414 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3b137ac3-55b6-4aa4-87cd-a5de75dea185 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1472 microversion: 2.1 time: 0.761783 Aug 27 02:31:46.708128 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 527/1004] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:45 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1472 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:46.725505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff1e01ee-a8a8-4857-8a5a-9b20e3af4a37 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Action: 'create', calling method: .version_select at 0x7f4d2a431820>, body: {"pool": "250718ef-ffb7-4399-a60e-f00282e291cf"} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:47.153215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4af5d3bd-12d7-4a11-b61f-566f69cad708 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:47.179884 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4af5d3bd-12d7-4a11-b61f-566f69cad708 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1504 microversion: 2.1 time: 1.044839 Aug 27 02:31:47.185549 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 478/1005] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:46 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1504 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:47.207184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e0aa5ccf-16a4-4775-96d4-408a9bae9fa3 req-f89250d6-f2fc-4ce0-8320-1789448b62d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25161bd4-cc08-4aae-8a4b-6a501eaa3d7d", "name": "network-vif-unplugged", "status": "completed", "tag": "a7bd8a59-071f-47e1-94ec-019129f9078d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:47.256367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e0aa5ccf-16a4-4775-96d4-408a9bae9fa3 req-f89250d6-f2fc-4ce0-8320-1789448b62d9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:47.260686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e0aa5ccf-16a4-4775-96d4-408a9bae9fa3 req-f89250d6-f2fc-4ce0-8320-1789448b62d9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:47.268238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e0aa5ccf-16a4-4775-96d4-408a9bae9fa3 req-f89250d6-f2fc-4ce0-8320-1789448b62d9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:47.318139 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e0aa5ccf-16a4-4775-96d4-408a9bae9fa3 req-f89250d6-f2fc-4ce0-8320-1789448b62d9 service nova] Creating event network-vif-unplugged:a7bd8a59-071f-47e1-94ec-019129f9078d for instance 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d on n-h2-852084-5 Aug 27 02:31:47.338310 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e0aa5ccf-16a4-4775-96d4-408a9bae9fa3 req-f89250d6-f2fc-4ce0-8320-1789448b62d9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141888 Aug 27 02:31:47.340085 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 479/1006] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:47.356936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b364d43-b703-4c81-812f-1ecfdd9ea176 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:47.359473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9b364d43-b703-4c81-812f-1ecfdd9ea176 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:47.393255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b364d43-b703-4c81-812f-1ecfdd9ea176 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:47.425840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b364d43-b703-4c81-812f-1ecfdd9ea176 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:47.430967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b364d43-b703-4c81-812f-1ecfdd9ea176 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:47.433851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b364d43-b703-4c81-812f-1ecfdd9ea176 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:47.437590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b364d43-b703-4c81-812f-1ecfdd9ea176 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:47.445141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b364d43-b703-4c81-812f-1ecfdd9ea176 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:48.223153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9b364d43-b703-4c81-812f-1ecfdd9ea176 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:48.238553 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9b364d43-b703-4c81-812f-1ecfdd9ea176 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1317 microversion: 2.1 time: 0.894198 Aug 27 02:31:48.257647 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 480/1007] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:47 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1317 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:48.270497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0f4f29f6-acb0-44e8-b13e-468ebfe47617 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2b40d9d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:48.376699 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0f4f29f6-acb0-44e8-b13e-468ebfe47617 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.110082 Aug 27 02:31:48.377303 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 481/1008] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:48 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:48.383936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-70f8594e-08f4-42c4-beaf-42c03d08b1de tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:48.388970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-70f8594e-08f4-42c4-beaf-42c03d08b1de tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:48.399259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f8594e-08f4-42c4-beaf-42c03d08b1de tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:48.399980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f8594e-08f4-42c4-beaf-42c03d08b1de tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:48.400606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f8594e-08f4-42c4-beaf-42c03d08b1de tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:48.409154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f8594e-08f4-42c4-beaf-42c03d08b1de tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:48.410028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f8594e-08f4-42c4-beaf-42c03d08b1de tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:48.410678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f8594e-08f4-42c4-beaf-42c03d08b1de tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:48.743762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-70f8594e-08f4-42c4-beaf-42c03d08b1de tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:48.753263 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-70f8594e-08f4-42c4-beaf-42c03d08b1de tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1469 microversion: 2.1 time: 0.373511 Aug 27 02:31:48.757567 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 482/1009] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:48 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1469 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:48.776054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-171277f6-11d7-4ec3-9768-6b6d49c689fb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:48.777031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-171277f6-11d7-4ec3-9768-6b6d49c689fb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:48.787661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171277f6-11d7-4ec3-9768-6b6d49c689fb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:48.788841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171277f6-11d7-4ec3-9768-6b6d49c689fb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:48.789254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171277f6-11d7-4ec3-9768-6b6d49c689fb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:48.794965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171277f6-11d7-4ec3-9768-6b6d49c689fb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:48.795901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171277f6-11d7-4ec3-9768-6b6d49c689fb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:48.796540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171277f6-11d7-4ec3-9768-6b6d49c689fb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:49.033101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-171277f6-11d7-4ec3-9768-6b6d49c689fb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:49.042842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:49.046215 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-171277f6-11d7-4ec3-9768-6b6d49c689fb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1504 microversion: 2.1 time: 0.281413 Aug 27 02:31:49.046773 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 483/1010] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:48 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:49.350633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f75f07d8-920f-436a-9421-300824dc9dbe tempest-InstanceUsageAuditLogTestJSON-1551864438 tempest-InstanceUsageAuditLogTestJSON-1551864438-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:49.392378 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f75f07d8-920f-436a-9421-300824dc9dbe tempest-InstanceUsageAuditLogTestJSON-1551864438 tempest-InstanceUsageAuditLogTestJSON-1551864438-project-admin] 10.222.0.99 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27 02:31:48" status: 200 len: 318 microversion: 2.1 time: 0.343939 Aug 27 02:31:49.394854 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 484/1011] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 02:31:49 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-27%2002%3A31%3A48 => generated 318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:49.427262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b2e569fd-7ddc-4b8c-a19e-8fa4cae0089b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:49.428275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b2e569fd-7ddc-4b8c-a19e-8fa4cae0089b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:49.439860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2e569fd-7ddc-4b8c-a19e-8fa4cae0089b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:49.442357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2e569fd-7ddc-4b8c-a19e-8fa4cae0089b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:49.445105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2e569fd-7ddc-4b8c-a19e-8fa4cae0089b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:49.446356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2e569fd-7ddc-4b8c-a19e-8fa4cae0089b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:49.449057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2e569fd-7ddc-4b8c-a19e-8fa4cae0089b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:49.449838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2e569fd-7ddc-4b8c-a19e-8fa4cae0089b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:49.620619 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b2e569fd-7ddc-4b8c-a19e-8fa4cae0089b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "POST /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d/action" status: 204 len: 0 microversion: 2.1 time: 0.223598 Aug 27 02:31:49.621796 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 485/1012] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:31:49 2022] POST /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d/action => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:31:49.635999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8a54d674-be54-46a4-961b-c2d1ca88c0af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:49.643148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8a54d674-be54-46a4-961b-c2d1ca88c0af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:49.668531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a54d674-be54-46a4-961b-c2d1ca88c0af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:49.677583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a54d674-be54-46a4-961b-c2d1ca88c0af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:49.678856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a54d674-be54-46a4-961b-c2d1ca88c0af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:49.680690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a54d674-be54-46a4-961b-c2d1ca88c0af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:49.681753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a54d674-be54-46a4-961b-c2d1ca88c0af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:49.682536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a54d674-be54-46a4-961b-c2d1ca88c0af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:49.690183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:50.306160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8a54d674-be54-46a4-961b-c2d1ca88c0af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:50.319320 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8a54d674-be54-46a4-961b-c2d1ca88c0af tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1466 microversion: 2.1 time: 0.695326 Aug 27 02:31:50.321460 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 486/1013] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:49 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1466 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:50.330808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-34aac8e8-0157-44c2-90a2-4bec7cd24a7e req-b3b6f6d3-fd4c-45a5-a3a6-e85476aa18a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25161bd4-cc08-4aae-8a4b-6a501eaa3d7d", "tag": "a7bd8a59-071f-47e1-94ec-019129f9078d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:50.353985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-34aac8e8-0157-44c2-90a2-4bec7cd24a7e req-b3b6f6d3-fd4c-45a5-a3a6-e85476aa18a7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:50.358371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-34aac8e8-0157-44c2-90a2-4bec7cd24a7e req-b3b6f6d3-fd4c-45a5-a3a6-e85476aa18a7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:50.359089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-34aac8e8-0157-44c2-90a2-4bec7cd24a7e req-b3b6f6d3-fd4c-45a5-a3a6-e85476aa18a7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:50.389323 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-34aac8e8-0157-44c2-90a2-4bec7cd24a7e req-b3b6f6d3-fd4c-45a5-a3a6-e85476aa18a7 service nova] Creating event network-changed:a7bd8a59-071f-47e1-94ec-019129f9078d for instance 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d on n-h2-852084-5 Aug 27 02:31:50.398911 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-34aac8e8-0157-44c2-90a2-4bec7cd24a7e req-b3b6f6d3-fd4c-45a5-a3a6-e85476aa18a7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074491 Aug 27 02:31:50.399986 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 487/1014] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:50.419455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e55b2a76-e39d-48dd-aadc-ad19f1393cae tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2ab320d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:50.530603 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e55b2a76-e39d-48dd-aadc-ad19f1393cae tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.123531 Aug 27 02:31:50.531731 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 488/1015] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:50 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:50.542278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c24e9a46-6931-419e-88db-f4d2c5a676b3 tempest-InstanceUsageAuditLogTestJSON-1551864438 tempest-InstanceUsageAuditLogTestJSON-1551864438-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:50.583914 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c24e9a46-6931-419e-88db-f4d2c5a676b3 tempest-InstanceUsageAuditLogTestJSON-1551864438 tempest-InstanceUsageAuditLogTestJSON-1551864438-project-admin] 10.222.0.99 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.045729 Aug 27 02:31:50.588427 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 489/1016] 10.222.0.99 () {58 vars in 1185 bytes} [Sat Aug 27 02:31:50 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:50.599889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eeabdc8c-792f-425f-9c32-cb1e1a73d41f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:50.606210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eeabdc8c-792f-425f-9c32-cb1e1a73d41f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:50.627631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeabdc8c-792f-425f-9c32-cb1e1a73d41f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:50.628527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeabdc8c-792f-425f-9c32-cb1e1a73d41f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:50.634000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeabdc8c-792f-425f-9c32-cb1e1a73d41f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:50.635218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeabdc8c-792f-425f-9c32-cb1e1a73d41f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:50.635934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeabdc8c-792f-425f-9c32-cb1e1a73d41f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:50.636644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeabdc8c-792f-425f-9c32-cb1e1a73d41f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:51.971419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eeabdc8c-792f-425f-9c32-cb1e1a73d41f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:51.983085 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eeabdc8c-792f-425f-9c32-cb1e1a73d41f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1469 microversion: 2.1 time: 1.393095 Aug 27 02:31:51.983642 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff1e01ee-a8a8-4857-8a5a-9b20e3af4a37 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.271860 Aug 27 02:31:51.984898 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 490/1017] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:50 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1469 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:51.999028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-50fb2513-98d0-4f7a-9a38-21e6fbe92a0c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:51.999912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-50fb2513-98d0-4f7a-9a38-21e6fbe92a0c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:52.007572 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 528/1018] 10.222.0.99 () {60 vars in 1170 bytes} [Sat Aug 27 02:31:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:52.017872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50fb2513-98d0-4f7a-9a38-21e6fbe92a0c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:52.018649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50fb2513-98d0-4f7a-9a38-21e6fbe92a0c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:52.019271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50fb2513-98d0-4f7a-9a38-21e6fbe92a0c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:52.020182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50fb2513-98d0-4f7a-9a38-21e6fbe92a0c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:52.020823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50fb2513-98d0-4f7a-9a38-21e6fbe92a0c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:52.022356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50fb2513-98d0-4f7a-9a38-21e6fbe92a0c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:52.042694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9525a32c-d555-4321-8861-43cd9119b60c tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:52.050133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9525a32c-d555-4321-8861-43cd9119b60c tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:52.093284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9525a32c-d555-4321-8861-43cd9119b60c tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:52.097566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9525a32c-d555-4321-8861-43cd9119b60c tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:52.099696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9525a32c-d555-4321-8861-43cd9119b60c tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:52.107051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9525a32c-d555-4321-8861-43cd9119b60c tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:52.108330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9525a32c-d555-4321-8861-43cd9119b60c tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:52.109828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9525a32c-d555-4321-8861-43cd9119b60c tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:52.412483 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9525a32c-d555-4321-8861-43cd9119b60c tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1617 microversion: 2.1 time: 0.390620 Aug 27 02:31:52.413483 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 529/1019] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:52 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1617 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:52.418349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7f4d5f5f-810e-4f74-8079-9d028d619d12 req-3e380a4f-cb8f-4a70-9d95-a585bd9e8c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d1eeab-d777-433e-b23b-1d6bd540823d", "name": "network-vif-plugged", "status": "completed", "tag": "8fe72264-a971-4067-8e10-b097ab827266"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:52.442634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f4d5f5f-810e-4f74-8079-9d028d619d12 req-3e380a4f-cb8f-4a70-9d95-a585bd9e8c41 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:52.443349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f4d5f5f-810e-4f74-8079-9d028d619d12 req-3e380a4f-cb8f-4a70-9d95-a585bd9e8c41 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:52.443779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f4d5f5f-810e-4f74-8079-9d028d619d12 req-3e380a4f-cb8f-4a70-9d95-a585bd9e8c41 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:52.470267 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7f4d5f5f-810e-4f74-8079-9d028d619d12 req-3e380a4f-cb8f-4a70-9d95-a585bd9e8c41 service nova] Creating event network-vif-plugged:8fe72264-a971-4067-8e10-b097ab827266 for instance 91d1eeab-d777-433e-b23b-1d6bd540823d on n-h2-852084-5 Aug 27 02:31:52.478812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-7f4d5f5f-810e-4f74-8079-9d028d619d12 req-3e380a4f-cb8f-4a70-9d95-a585bd9e8c41 service nova] Instance 91d1eeab-d777-433e-b23b-1d6bd540823d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:31:52.487524 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7f4d5f5f-810e-4f74-8079-9d028d619d12 req-3e380a4f-cb8f-4a70-9d95-a585bd9e8c41 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072632 Aug 27 02:31:52.499944 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 530/1020] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:52.515372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3b8e853f-fb9e-4c0c-b8b7-e28e75d7258a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a431940>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:52.645151 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3b8e853f-fb9e-4c0c-b8b7-e28e75d7258a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.142246 Aug 27 02:31:52.647025 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 531/1021] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:52 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:52.652668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Action: 'action', calling method: .version_select at 0x7f4d2c134430>, body: {"addFloatingIp": {"address": "172.25.9.102"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:52.657654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:52.677190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:52.680471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:52.681940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:52.685181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:52.685911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:52.686949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:52.768086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:31:52.768907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquired lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:31:52.903411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-50fb2513-98d0-4f7a-9a38-21e6fbe92a0c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:52.919667 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-50fb2513-98d0-4f7a-9a38-21e6fbe92a0c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1504 microversion: 2.1 time: 0.932672 Aug 27 02:31:52.920425 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 491/1022] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:51 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1504 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:52.936279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1466812885", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:53.094964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:31:54.547108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:31:54.549066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:31:54.549809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:31:54.550437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:31:54.551799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:31:54.580214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:54.581452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:54.583666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:54.586002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:54.587185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:54.588269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:54.637172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:31:54.659898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Getting quotas for user 71bc8ccc9dc94a01ba39a4559f45ccce and project 2a00d8fd6e3d4ca7a84d3733b108a2d6. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:31:54.693974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:31:54.698309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:31:54.776092 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-267acb1a-af33-43e1-af83-9300eefb9b09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.852938 Aug 27 02:31:54.780393 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 492/1023] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:31:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:31:54.801629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b252235-bfc7-4eab-a0eb-33b82ebde2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:54.810776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b252235-bfc7-4eab-a0eb-33b82ebde2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:54.845582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b252235-bfc7-4eab-a0eb-33b82ebde2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:54.846535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b252235-bfc7-4eab-a0eb-33b82ebde2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:54.849129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b252235-bfc7-4eab-a0eb-33b82ebde2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:54.853209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b252235-bfc7-4eab-a0eb-33b82ebde2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:54.853992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b252235-bfc7-4eab-a0eb-33b82ebde2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:54.854630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b252235-bfc7-4eab-a0eb-33b82ebde2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:55.867712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5b252235-bfc7-4eab-a0eb-33b82ebde2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:55.884033 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5b252235-bfc7-4eab-a0eb-33b82ebde2ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1469 microversion: 2.1 time: 1.100672 Aug 27 02:31:55.886013 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 493/1024] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:54 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1469 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:55.901864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-30f5e2ea-0749-4772-aee6-e998d99dd231 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a960af0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:56.096916 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-30f5e2ea-0749-4772-aee6-e998d99dd231 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1455 microversion: 2.1 time: 0.209077 Aug 27 02:31:56.102365 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 494/1025] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:55 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1455 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:56.109601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a777cbe9-8d19-4ab7-8fff-5749b7c42580 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:56.118143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a777cbe9-8d19-4ab7-8fff-5749b7c42580 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:56.159548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a777cbe9-8d19-4ab7-8fff-5749b7c42580 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:56.160113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a777cbe9-8d19-4ab7-8fff-5749b7c42580 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:56.160577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a777cbe9-8d19-4ab7-8fff-5749b7c42580 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:56.161369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a777cbe9-8d19-4ab7-8fff-5749b7c42580 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:56.164701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a777cbe9-8d19-4ab7-8fff-5749b7c42580 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:56.165534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a777cbe9-8d19-4ab7-8fff-5749b7c42580 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:56.861055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Building network info cache for instance {{(pid=122488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:31:57.226462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a777cbe9-8d19-4ab7-8fff-5749b7c42580 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:57.244877 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a777cbe9-8d19-4ab7-8fff-5749b7c42580 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1504 microversion: 2.1 time: 1.140312 Aug 27 02:31:57.249135 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 495/1026] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:56 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1504 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:57.263311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b3713380-e317-485a-aa26-5d967ae61b7c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:57.275124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b3713380-e317-485a-aa26-5d967ae61b7c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:57.295414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3713380-e317-485a-aa26-5d967ae61b7c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:57.299828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3713380-e317-485a-aa26-5d967ae61b7c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:57.300925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3713380-e317-485a-aa26-5d967ae61b7c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:57.303370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3713380-e317-485a-aa26-5d967ae61b7c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:57.314702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3713380-e317-485a-aa26-5d967ae61b7c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:57.315410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3713380-e317-485a-aa26-5d967ae61b7c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:58.370700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Updating instance_info_cache with network_info: [{"id": "71d54b5e-fa1a-4a54-a257-b96b90b49a4a", "address": "fa:16:3e:35:70:10", "network": {"id": "4771c9b0-40a4-4cf7-9f4f-f9b7b6cdc06e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1641980477-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7e0bc60394fb46148212d366174c754d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap71d54b5e-fa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:31:58.400209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Releasing lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:31:58.401583 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-92666084-b21e-4ef6-be96-6f73a5a35cb1 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action" status: 202 len: 0 microversion: 2.1 time: 5.753134 Aug 27 02:31:58.402250 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 532/1027] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:31:52 2022] POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action => generated 0 bytes in 5754 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:31:58.419012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4d68fd8d-c4b6-4ef7-b191-9c594dc5b5c6 req-e895cf9c-f044-4270-b1c1-89c1eeadaef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f105905c-eb08-4e79-9282-66e543fe5f7c", "tag": "71d54b5e-fa1a-4a54-a257-b96b90b49a4a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:31:58.447754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=70 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:58.454113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4d68fd8d-c4b6-4ef7-b191-9c594dc5b5c6 req-e895cf9c-f044-4270-b1c1-89c1eeadaef6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:58.454859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4d68fd8d-c4b6-4ef7-b191-9c594dc5b5c6 req-e895cf9c-f044-4270-b1c1-89c1eeadaef6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:58.456816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4d68fd8d-c4b6-4ef7-b191-9c594dc5b5c6 req-e895cf9c-f044-4270-b1c1-89c1eeadaef6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:58.500237 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4d68fd8d-c4b6-4ef7-b191-9c594dc5b5c6 req-e895cf9c-f044-4270-b1c1-89c1eeadaef6 service nova] Creating event network-changed:71d54b5e-fa1a-4a54-a257-b96b90b49a4a for instance f105905c-eb08-4e79-9282-66e543fe5f7c on n-h1-852084-5 Aug 27 02:31:58.509260 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4d68fd8d-c4b6-4ef7-b191-9c594dc5b5c6 req-e895cf9c-f044-4270-b1c1-89c1eeadaef6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102337 Aug 27 02:31:58.510491 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 533/1028] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:58.518557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2e3dbb85-4b2b-433d-9f97-8307a0276e66 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:58.519497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2e3dbb85-4b2b-433d-9f97-8307a0276e66 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:58.527922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3dbb85-4b2b-433d-9f97-8307a0276e66 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:58.528830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3dbb85-4b2b-433d-9f97-8307a0276e66 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:58.529454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3dbb85-4b2b-433d-9f97-8307a0276e66 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:58.531004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3dbb85-4b2b-433d-9f97-8307a0276e66 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:58.531632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3dbb85-4b2b-433d-9f97-8307a0276e66 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:58.533551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3dbb85-4b2b-433d-9f97-8307a0276e66 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:59.086451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b3713380-e317-485a-aa26-5d967ae61b7c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:59.114205 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b3713380-e317-485a-aa26-5d967ae61b7c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1269 microversion: 2.1 time: 1.859161 Aug 27 02:31:59.118292 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 496/1029] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:57 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1269 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:59.138114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5631470d-010f-4a43-aeb9-8e0100e8ddf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2ac3cc10>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:59.243873 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5631470d-010f-4a43-aeb9-8e0100e8ddf5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1464 microversion: 2.1 time: 0.123896 Aug 27 02:31:59.258107 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 497/1030] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:31:59 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1464 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:59.259813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f5e257b4-a698-489c-b1f1-50ccf5da05bf tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:59.271453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f5e257b4-a698-489c-b1f1-50ccf5da05bf tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:59.274897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f5e257b4-a698-489c-b1f1-50ccf5da05bf tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Searching by: {'deleted': False, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:31:59.280714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:31:59.298246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5e257b4-a698-489c-b1f1-50ccf5da05bf tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:59.301280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5e257b4-a698-489c-b1f1-50ccf5da05bf tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:59.302191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5e257b4-a698-489c-b1f1-50ccf5da05bf tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:59.304769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5e257b4-a698-489c-b1f1-50ccf5da05bf tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:59.306399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5e257b4-a698-489c-b1f1-50ccf5da05bf tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:59.307910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5e257b4-a698-489c-b1f1-50ccf5da05bf tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:59.505142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2e3dbb85-4b2b-433d-9f97-8307a0276e66 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:31:59.506472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-f5e257b4-a698-489c-b1f1-50ccf5da05bf tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:31:59.521441 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2e3dbb85-4b2b-433d-9f97-8307a0276e66 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1461 microversion: 2.1 time: 1.008995 Aug 27 02:31:59.525587 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 534/1031] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:58 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1461 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:31:59.538124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-90fca363-4267-4e75-b0c9-ff5b2841714c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:31:59.538746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-90fca363-4267-4e75-b0c9-ff5b2841714c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:31:59.553091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90fca363-4267-4e75-b0c9-ff5b2841714c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:59.553611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90fca363-4267-4e75-b0c9-ff5b2841714c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:59.558341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90fca363-4267-4e75-b0c9-ff5b2841714c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:59.559123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90fca363-4267-4e75-b0c9-ff5b2841714c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:31:59.560331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90fca363-4267-4e75-b0c9-ff5b2841714c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:31:59.560779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90fca363-4267-4e75-b0c9-ff5b2841714c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:31:59.620113 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f5e257b4-a698-489c-b1f1-50ccf5da05bf tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.374526 Aug 27 02:31:59.621430 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 498/1032] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 02:31:59 2022] GET /compute/v2.1/servers => generated 340 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:31:59.634117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9bfcb409-e858-49d8-afc7-f51dcf1455de tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Action: 'create', calling method: .version_select at 0x7f4d2ad46670>, body: {"pool": "250718ef-ffb7-4399-a60e-f00282e291cf"} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:00.027008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-90fca363-4267-4e75-b0c9-ff5b2841714c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:00.036029 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-90fca363-4267-4e75-b0c9-ff5b2841714c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1504 microversion: 2.1 time: 0.509212 Aug 27 02:32:00.036628 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 535/1033] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:31:59 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1504 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:00.051272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f352f2cc-20d6-4136-84c2-a993069b942f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a467700>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:00.141045 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f352f2cc-20d6-4136-84c2-a993069b942f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 200 len: 1464 microversion: 2.1 time: 0.099283 Aug 27 02:32:00.142312 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 536/1034] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:00 2022] GET /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 1464 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:00.148012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f5cc97c8-ea90-44da-ae68-045e7797b71b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:00.155457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f5cc97c8-ea90-44da-ae68-045e7797b71b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:00.167710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5cc97c8-ea90-44da-ae68-045e7797b71b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:00.168505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5cc97c8-ea90-44da-ae68-045e7797b71b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:00.169294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5cc97c8-ea90-44da-ae68-045e7797b71b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:00.170206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5cc97c8-ea90-44da-ae68-045e7797b71b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:00.170827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5cc97c8-ea90-44da-ae68-045e7797b71b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:00.171443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5cc97c8-ea90-44da-ae68-045e7797b71b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:00.469001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f5cc97c8-ea90-44da-ae68-045e7797b71b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:00.525269 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f5cc97c8-ea90-44da-ae68-045e7797b71b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1461 microversion: 2.1 time: 0.380690 Aug 27 02:32:00.549984 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 537/1035] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:00 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1461 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:00.558691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:00.573516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:00.574562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Searching by: {'deleted': False, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:32:00.588256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:00.594846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:00.595330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:00.596279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:00.596771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:00.597212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:00.807306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:32:00.978305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:00.991538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:00.992765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:00.993552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:01.250216 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8618bfb2-d619-4d32-86c1-2b3b273a483d tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.698180 Aug 27 02:32:01.251862 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 538/1036] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:32:00 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:01.262835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b627e3f-e09e-46fe-9363-3db450454c0d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:01.264422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9b627e3f-e09e-46fe-9363-3db450454c0d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:01.276722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b627e3f-e09e-46fe-9363-3db450454c0d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:01.277585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b627e3f-e09e-46fe-9363-3db450454c0d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:01.278662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b627e3f-e09e-46fe-9363-3db450454c0d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:01.279966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b627e3f-e09e-46fe-9363-3db450454c0d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:01.280848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b627e3f-e09e-46fe-9363-3db450454c0d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:01.281641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b627e3f-e09e-46fe-9363-3db450454c0d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:01.418396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9b627e3f-e09e-46fe-9363-3db450454c0d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:01.438039 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9b627e3f-e09e-46fe-9363-3db450454c0d tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1275 microversion: 2.1 time: 0.184332 Aug 27 02:32:01.439525 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 539/1037] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:01 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:01.449967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4f0681ab-ed31-497a-9d87-33eb62eedc51 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:01.450610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4f0681ab-ed31-497a-9d87-33eb62eedc51 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:01.476651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f0681ab-ed31-497a-9d87-33eb62eedc51 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:01.477622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f0681ab-ed31-497a-9d87-33eb62eedc51 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:01.478307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f0681ab-ed31-497a-9d87-33eb62eedc51 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:01.479284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f0681ab-ed31-497a-9d87-33eb62eedc51 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:01.486623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f0681ab-ed31-497a-9d87-33eb62eedc51 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:01.487306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f0681ab-ed31-497a-9d87-33eb62eedc51 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:01.762694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f0681ab-ed31-497a-9d87-33eb62eedc51 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:01.770548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:01.783373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4f0681ab-ed31-497a-9d87-33eb62eedc51 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79" status: 200 len: 1466 microversion: 2.1 time: 0.341219 Aug 27 02:32:01.798560 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 540/1038] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:01 2022] GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 1466 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:01.798560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fea0789d-bbc8-49d9-9c01-64f48e3733ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Action: 'create', calling method: .version_select at 0x7f4d2a423af0>, body: {"keypair": {"name": "tempest-keypair-1543107572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmU4vLNIgLYhQcs/BOqVQipnD4bMQv/MqhLkXmEqpttCU3tTugZOtGoeMNEkWErT60QGWOLlGnnliUrZwI2kCMGkxrjGA9zjdc5sHJIV1WOuVXbKwoNtDgss/JRTDWMzA=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:01.826983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-fea0789d-bbc8-49d9-9c01-64f48e3733ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:32:01.840604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-fea0789d-bbc8-49d9-9c01-64f48e3733ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for user d1624ef00b144dafbaff7ae5c677e7a3 and project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:32:01.887633 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fea0789d-bbc8-49d9-9c01-64f48e3733ef tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100717 Aug 27 02:32:01.888689 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 541/1039] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:32:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:01.897427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78ca2190-8b2b-4ede-86b8-ba53a6b415fa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:01.898553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-78ca2190-8b2b-4ede-86b8-ba53a6b415fa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:01.909766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ca2190-8b2b-4ede-86b8-ba53a6b415fa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:01.910559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ca2190-8b2b-4ede-86b8-ba53a6b415fa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:01.911309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ca2190-8b2b-4ede-86b8-ba53a6b415fa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:01.912550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ca2190-8b2b-4ede-86b8-ba53a6b415fa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:01.914250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ca2190-8b2b-4ede-86b8-ba53a6b415fa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:01.915017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ca2190-8b2b-4ede-86b8-ba53a6b415fa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:02.280948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-78ca2190-8b2b-4ede-86b8-ba53a6b415fa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:02.299993 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-78ca2190-8b2b-4ede-86b8-ba53a6b415fa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1504 microversion: 2.1 time: 0.409245 Aug 27 02:32:02.302376 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 542/1040] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:01 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1504 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:02.337257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb60d43c-60e3-4041-b164-1bb1c57fefa1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:02.358013 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fb60d43c-60e3-4041-b164-1bb1c57fefa1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.052560 Aug 27 02:32:02.359071 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 543/1041] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:32:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:02.369221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-18a014e1-f834-46c9-a93e-c4b1f7fdd79c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2028186135"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:02.374158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-18a014e1-f834-46c9-a93e-c4b1f7fdd79c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:02.396388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18a014e1-f834-46c9-a93e-c4b1f7fdd79c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:02.397295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18a014e1-f834-46c9-a93e-c4b1f7fdd79c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:02.398127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18a014e1-f834-46c9-a93e-c4b1f7fdd79c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:02.399497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18a014e1-f834-46c9-a93e-c4b1f7fdd79c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:02.400610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18a014e1-f834-46c9-a93e-c4b1f7fdd79c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:02.401379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18a014e1-f834-46c9-a93e-c4b1f7fdd79c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:02.794327 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-18a014e1-f834-46c9-a93e-c4b1f7fdd79c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "POST /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0/action" status: 202 len: 0 microversion: 2.1 time: 0.431858 Aug 27 02:32:02.800863 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 544/1042] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:32:02 2022] POST /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:32:02.815126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-84e3f132-6d97-45fe-bc6d-7cbd0d826501 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:02.816256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-84e3f132-6d97-45fe-bc6d-7cbd0d826501 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:02.825077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e3f132-6d97-45fe-bc6d-7cbd0d826501 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:02.825999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e3f132-6d97-45fe-bc6d-7cbd0d826501 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:02.826680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e3f132-6d97-45fe-bc6d-7cbd0d826501 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:02.828356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e3f132-6d97-45fe-bc6d-7cbd0d826501 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:02.829139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e3f132-6d97-45fe-bc6d-7cbd0d826501 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:02.829826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84e3f132-6d97-45fe-bc6d-7cbd0d826501 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:02.940545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-84e3f132-6d97-45fe-bc6d-7cbd0d826501 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:02.957069 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-84e3f132-6d97-45fe-bc6d-7cbd0d826501 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1275 microversion: 2.1 time: 0.152593 Aug 27 02:32:02.958630 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 545/1043] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:02 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:02.965302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-945b6f69-b3b5-462f-aa59-c649216ab1d6 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:02.966387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-945b6f69-b3b5-462f-aa59-c649216ab1d6 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:02.979932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-945b6f69-b3b5-462f-aa59-c649216ab1d6 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:02.981662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-945b6f69-b3b5-462f-aa59-c649216ab1d6 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:02.982961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-945b6f69-b3b5-462f-aa59-c649216ab1d6 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:02.984155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-945b6f69-b3b5-462f-aa59-c649216ab1d6 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:02.985517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-945b6f69-b3b5-462f-aa59-c649216ab1d6 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:02.986818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-945b6f69-b3b5-462f-aa59-c649216ab1d6 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:03.062203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-945b6f69-b3b5-462f-aa59-c649216ab1d6 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:32:03.249696 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-945b6f69-b3b5-462f-aa59-c649216ab1d6 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 204 len: 0 microversion: 2.1 time: 0.288720 Aug 27 02:32:03.251835 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 546/1044] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:32:02 2022] DELETE /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:32:03.259191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c3e99147-b622-48e1-a0b3-24a5df096806 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a61d5e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:03.330044 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c3e99147-b622-48e1-a0b3-24a5df096806 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.076430 Aug 27 02:32:03.332864 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 547/1045] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:03 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:03.338380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-83bf66c2-8467-402d-9bc4-4d082ed835c1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:03.339173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-83bf66c2-8467-402d-9bc4-4d082ed835c1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:03.351811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83bf66c2-8467-402d-9bc4-4d082ed835c1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:03.352321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83bf66c2-8467-402d-9bc4-4d082ed835c1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:03.353022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83bf66c2-8467-402d-9bc4-4d082ed835c1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:03.353835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83bf66c2-8467-402d-9bc4-4d082ed835c1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:03.354340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83bf66c2-8467-402d-9bc4-4d082ed835c1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:03.354800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83bf66c2-8467-402d-9bc4-4d082ed835c1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:03.603898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-83bf66c2-8467-402d-9bc4-4d082ed835c1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:03.616352 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-83bf66c2-8467-402d-9bc4-4d082ed835c1 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1716 microversion: 2.1 time: 0.282201 Aug 27 02:32:03.629094 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 548/1046] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:03 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1716 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:03.640233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e62dfc20-2227-4273-ba5a-6db26a4b612c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:03.641829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e62dfc20-2227-4273-ba5a-6db26a4b612c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:03.661742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e62dfc20-2227-4273-ba5a-6db26a4b612c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:03.662255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e62dfc20-2227-4273-ba5a-6db26a4b612c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:03.662704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e62dfc20-2227-4273-ba5a-6db26a4b612c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:03.663446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e62dfc20-2227-4273-ba5a-6db26a4b612c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:03.663918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e62dfc20-2227-4273-ba5a-6db26a4b612c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:03.664907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e62dfc20-2227-4273-ba5a-6db26a4b612c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:03.904683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e62dfc20-2227-4273-ba5a-6db26a4b612c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:03.926310 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e62dfc20-2227-4273-ba5a-6db26a4b612c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1479 microversion: 2.1 time: 0.294646 Aug 27 02:32:03.934047 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 549/1047] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:03 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1479 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:03.959770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d74e712f-6813-4ceb-93a0-534f59ede3bd req-bea99571-73c7-4044-8ebd-7025bddaeff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98f8456-cc9f-4772-97f1-99e056b99f79", "name": "network-vif-unplugged", "status": "completed", "tag": "466460c2-b76b-42d7-9cd5-1eab0a9cd335"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:04.005397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d74e712f-6813-4ceb-93a0-534f59ede3bd req-bea99571-73c7-4044-8ebd-7025bddaeff8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:04.006279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d74e712f-6813-4ceb-93a0-534f59ede3bd req-bea99571-73c7-4044-8ebd-7025bddaeff8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:04.007506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d74e712f-6813-4ceb-93a0-534f59ede3bd req-bea99571-73c7-4044-8ebd-7025bddaeff8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:04.038595 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d74e712f-6813-4ceb-93a0-534f59ede3bd req-bea99571-73c7-4044-8ebd-7025bddaeff8 service nova] Creating event network-vif-unplugged:466460c2-b76b-42d7-9cd5-1eab0a9cd335 for instance f98f8456-cc9f-4772-97f1-99e056b99f79 on n-h1-852084-5 Aug 27 02:32:04.060440 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d74e712f-6813-4ceb-93a0-534f59ede3bd req-bea99571-73c7-4044-8ebd-7025bddaeff8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119156 Aug 27 02:32:04.064308 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 550/1048] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:04.072575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7591a918-5616-4247-9df0-fd47e184e294 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '.version_select at 0x7f4d2a611e50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:04.077584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7591a918-5616-4247-9df0-fd47e184e294 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:04.078706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7591a918-5616-4247-9df0-fd47e184e294 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:04.079434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7591a918-5616-4247-9df0-fd47e184e294 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:04.095480 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7591a918-5616-4247-9df0-fd47e184e294 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.029281 Aug 27 02:32:04.097764 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 551/1049] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:32:04 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:04.117946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dda161ee-0003-4c76-9151-7170b9a1108b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:04.133595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dda161ee-0003-4c76-9151-7170b9a1108b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:04.154841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda161ee-0003-4c76-9151-7170b9a1108b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:04.156277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda161ee-0003-4c76-9151-7170b9a1108b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:04.158053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda161ee-0003-4c76-9151-7170b9a1108b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:04.159623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda161ee-0003-4c76-9151-7170b9a1108b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:04.160791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda161ee-0003-4c76-9151-7170b9a1108b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:04.161774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda161ee-0003-4c76-9151-7170b9a1108b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:04.531499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dda161ee-0003-4c76-9151-7170b9a1108b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:04.545111 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dda161ee-0003-4c76-9151-7170b9a1108b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1317 microversion: 2.1 time: 0.445490 Aug 27 02:32:04.545699 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 552/1050] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:04 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:04.557605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b66bd99f-a485-4ff5-830e-1868eaf21ec0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:04.558284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b66bd99f-a485-4ff5-830e-1868eaf21ec0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:04.573570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b66bd99f-a485-4ff5-830e-1868eaf21ec0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:04.574134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b66bd99f-a485-4ff5-830e-1868eaf21ec0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:04.574574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b66bd99f-a485-4ff5-830e-1868eaf21ec0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:04.575305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b66bd99f-a485-4ff5-830e-1868eaf21ec0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:04.575760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b66bd99f-a485-4ff5-830e-1868eaf21ec0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:04.576192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b66bd99f-a485-4ff5-830e-1868eaf21ec0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:04.685250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=14 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:04.842328 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b66bd99f-a485-4ff5-830e-1868eaf21ec0 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1630 microversion: 2.1 time: 0.295482 Aug 27 02:32:04.843791 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 553/1051] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:04 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1630 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:04.860126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f27c66a5-57d8-4084-8580-54217898890f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a431940>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:04.958311 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f27c66a5-57d8-4084-8580-54217898890f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.110930 Aug 27 02:32:04.959628 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 554/1052] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:04 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:04.965422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b5e8194-9090-4795-abc8-35b8143708c3 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:04.966396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6b5e8194-9090-4795-abc8-35b8143708c3 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:04.975621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b5e8194-9090-4795-abc8-35b8143708c3 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:04.976446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b5e8194-9090-4795-abc8-35b8143708c3 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:04.977085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b5e8194-9090-4795-abc8-35b8143708c3 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:04.978306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b5e8194-9090-4795-abc8-35b8143708c3 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:04.978955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b5e8194-9090-4795-abc8-35b8143708c3 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:04.980349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b5e8194-9090-4795-abc8-35b8143708c3 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:05.527318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6b5e8194-9090-4795-abc8-35b8143708c3 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:05.575909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b5e8194-9090-4795-abc8-35b8143708c3 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1716 microversion: 2.1 time: 0.614112 Aug 27 02:32:05.580005 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 555/1053] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:04 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1716 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:05.603532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff45cf0e-6046-42f8-9249-72f8c0f6d774 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Action: 'create', calling method: .version_select at 0x7f4d2a423160>, body: {"keypair": {"name": "tempest-keypair-2118236691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcVn+X6gYdts+tSO5OVzqYz4oKQK+A1mTH9bYQZdRuPcVEW4mwHLYlaBoamyptv++J6s7NFKIhnjLi2sJtvO7rPiIheNNfMR2+8MBB8kWHtYIq9L3OPS+XUqrR+QYWRAA=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:05.658367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-ff45cf0e-6046-42f8-9249-72f8c0f6d774 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Getting quotas for project c2ea38ee044d41d3a6ede6ab4806621d. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:32:05.687756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-ff45cf0e-6046-42f8-9249-72f8c0f6d774 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Getting quotas for user 6dbc0e90bbe94ce49ae09d2408a382c7 and project c2ea38ee044d41d3a6ede6ab4806621d. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:32:05.790467 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff45cf0e-6046-42f8-9249-72f8c0f6d774 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.204542 Aug 27 02:32:05.794784 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 556/1054] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:32:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:05.815414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6a63bd0c-39e1-49d1-b858-159cec72b721 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '.version_select at 0x7f4d2a400790>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:05.840273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a63bd0c-39e1-49d1-b858-159cec72b721 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:05.841108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a63bd0c-39e1-49d1-b858-159cec72b721 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:05.842004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a63bd0c-39e1-49d1-b858-159cec72b721 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:05.877311 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6a63bd0c-39e1-49d1-b858-159cec72b721 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.078060 Aug 27 02:32:05.878395 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 557/1055] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:32:05 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:05.925805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1499c27c-58b9-49bd-8075-b431b7e05458 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:05.927071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1499c27c-58b9-49bd-8075-b431b7e05458 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:05.939503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1499c27c-58b9-49bd-8075-b431b7e05458 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:05.941155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1499c27c-58b9-49bd-8075-b431b7e05458 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:05.942615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1499c27c-58b9-49bd-8075-b431b7e05458 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:05.944175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1499c27c-58b9-49bd-8075-b431b7e05458 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:05.945214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1499c27c-58b9-49bd-8075-b431b7e05458 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:05.946327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1499c27c-58b9-49bd-8075-b431b7e05458 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:07.008595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1499c27c-58b9-49bd-8075-b431b7e05458 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:07.030110 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1499c27c-58b9-49bd-8075-b431b7e05458 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1317 microversion: 2.1 time: 1.144695 Aug 27 02:32:07.032363 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 558/1056] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:05 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1317 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:07.050537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f1eb92c-5e12-4aa0-8c31-22ab392609f0 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:07.091207 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f1eb92c-5e12-4aa0-8c31-22ab392609f0 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.054330 Aug 27 02:32:07.092818 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 559/1057] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:32:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:07.138118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6a8f175f-be6c-414c-abd3-2a4920b398bf tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a431f70>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:07.241953 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6a8f175f-be6c-414c-abd3-2a4920b398bf tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.144608 Aug 27 02:32:07.256178 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 560/1058] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:07 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:07.801506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc51e93f-7588-4973-9c61-1abac1848ed1 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Action: 'create', calling method: .version_select at 0x7f4d2a2c81f0>, body: {"keypair": {"name": "tempest-keypair-947025529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/TKwNIa1sWyjQKAOU3ThAnY1+NFPTd8i1jd1eVtifcPa8cGaF8/NgS/nD3WoeRAgu87qOJZ+Z934dwLUTWkVL22byQ5p8deyRCEh069+pbszrKWVT6B97pu4gPNvuGKA=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:07.885514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-fc51e93f-7588-4973-9c61-1abac1848ed1 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Getting quotas for project f92e5cff6b734d1f9d0eb5abb9a4a982. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:32:07.897347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-fc51e93f-7588-4973-9c61-1abac1848ed1 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Getting quotas for user 9c8cc51830a148959619a4944c88ad51 and project f92e5cff6b734d1f9d0eb5abb9a4a982. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:32:07.962468 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fc51e93f-7588-4973-9c61-1abac1848ed1 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.701272 Aug 27 02:32:07.974194 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 561/1059] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:32:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:07.983124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5ef46201-d312-4834-a883-1ac20ece2194 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:07.986920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5ef46201-d312-4834-a883-1ac20ece2194 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:08.008026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef46201-d312-4834-a883-1ac20ece2194 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:08.009527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef46201-d312-4834-a883-1ac20ece2194 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:08.011669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef46201-d312-4834-a883-1ac20ece2194 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:08.013968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef46201-d312-4834-a883-1ac20ece2194 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:08.015521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef46201-d312-4834-a883-1ac20ece2194 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:08.018385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef46201-d312-4834-a883-1ac20ece2194 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:08.284453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5ef46201-d312-4834-a883-1ac20ece2194 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:08.322171 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5ef46201-d312-4834-a883-1ac20ece2194 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1648 microversion: 2.1 time: 0.353357 Aug 27 02:32:08.330322 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 562/1060] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:07 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1648 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:08.346042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-325a8088-592b-4d06-a665-35553c061be0 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-990657365", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:08.392808 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-325a8088-592b-4d06-a665-35553c061be0 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.056130 Aug 27 02:32:08.395082 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 563/1061] 10.222.0.99 () {60 vars in 1146 bytes} [Sat Aug 27 02:32:08 2022] POST /compute/v2.1/flavors => generated 498 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:08.427719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-42cf5f49-4a39-40bb-9e4a-63fdea2ca989 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:08.428647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-42cf5f49-4a39-40bb-9e4a-63fdea2ca989 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:08.448317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42cf5f49-4a39-40bb-9e4a-63fdea2ca989 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:08.450909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42cf5f49-4a39-40bb-9e4a-63fdea2ca989 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:08.451441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42cf5f49-4a39-40bb-9e4a-63fdea2ca989 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:08.452330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42cf5f49-4a39-40bb-9e4a-63fdea2ca989 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:08.452824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42cf5f49-4a39-40bb-9e4a-63fdea2ca989 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:08.453312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42cf5f49-4a39-40bb-9e4a-63fdea2ca989 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:08.845298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-42cf5f49-4a39-40bb-9e4a-63fdea2ca989 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:08.855482 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-42cf5f49-4a39-40bb-9e4a-63fdea2ca989 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1317 microversion: 2.1 time: 0.458764 Aug 27 02:32:08.858685 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 564/1062] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:08 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:08.868545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3346fd16-37f2-40b7-b3d7-863cea695f5b tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a431940>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:08.999022 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3346fd16-37f2-40b7-b3d7-863cea695f5b tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.134987 Aug 27 02:32:09.001338 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 565/1063] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:08 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:09.006095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c8b58a9a-5c07-48fd-993f-97ea0a147dea req-cb0fdcc6-158b-402c-8eab-c2aaa5fddd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f739696-df21-46b5-aba3-339d737d3825", "name": "network-vif-deleted", "tag": "049c8b21-25a5-4ba8-9d5b-b6ef599a2196"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:09.064080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c8b58a9a-5c07-48fd-993f-97ea0a147dea req-cb0fdcc6-158b-402c-8eab-c2aaa5fddd51 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:09.065143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c8b58a9a-5c07-48fd-993f-97ea0a147dea req-cb0fdcc6-158b-402c-8eab-c2aaa5fddd51 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:09.065143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c8b58a9a-5c07-48fd-993f-97ea0a147dea req-cb0fdcc6-158b-402c-8eab-c2aaa5fddd51 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:09.118392 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c8b58a9a-5c07-48fd-993f-97ea0a147dea req-cb0fdcc6-158b-402c-8eab-c2aaa5fddd51 service nova] Creating event network-vif-deleted:049c8b21-25a5-4ba8-9d5b-b6ef599a2196 for instance 1f739696-df21-46b5-aba3-339d737d3825 on n-h2-852084-5 Aug 27 02:32:09.136406 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c8b58a9a-5c07-48fd-993f-97ea0a147dea req-cb0fdcc6-158b-402c-8eab-c2aaa5fddd51 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133830 Aug 27 02:32:09.141868 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 566/1064] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:09.153794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6e785f56-0ee5-4378-a764-c98956fbe789 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:09.190269 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6e785f56-0ee5-4378-a764-c98956fbe789 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040772 Aug 27 02:32:09.205748 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 567/1065] 10.222.0.99 () {58 vars in 1182 bytes} [Sat Aug 27 02:32:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:32:09.371457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:09.372226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:09.382436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:09.382808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:09.383266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:09.384016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:09.384491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:09.384932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:09.386883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:09.389808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:09.477653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:09.553258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:09.555073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:09.568411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:09.569074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lazy-loading 'fault' on Instance uuid 1f739696-df21-46b5-aba3-339d737d3825 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:32:09.596801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:09.759924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8fa4ffc5b4de6a338c481b275aedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a744f5cd3f9d4610bee3c18b9f12a711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:09.792592 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a83275f5-e13f-4b2a-a482-df63ff9ab8ea tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 200 len: 1368 microversion: 2.1 time: 0.424984 Aug 27 02:32:09.793098 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 568/1066] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:09 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 1368 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:09.838992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1944722571", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:09.877574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:10.051476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:32:10.696247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:10.814643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9bfcb409-e858-49d8-afc7-f51dcf1455de tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 11.189460 Aug 27 02:32:10.815829 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 499/1067] 10.222.0.99 () {60 vars in 1170 bytes} [Sat Aug 27 02:31:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 11194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:10.842706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6cbe1f55-cc77-4c70-b22f-02668a075ad4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:10.843412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6cbe1f55-cc77-4c70-b22f-02668a075ad4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:10.899735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cbe1f55-cc77-4c70-b22f-02668a075ad4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:10.903774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cbe1f55-cc77-4c70-b22f-02668a075ad4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:10.904964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cbe1f55-cc77-4c70-b22f-02668a075ad4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:10.909110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cbe1f55-cc77-4c70-b22f-02668a075ad4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:10.910645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cbe1f55-cc77-4c70-b22f-02668a075ad4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:10.913384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cbe1f55-cc77-4c70-b22f-02668a075ad4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:11.725971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6cbe1f55-cc77-4c70-b22f-02668a075ad4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:11.736475 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6cbe1f55-cc77-4c70-b22f-02668a075ad4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1317 microversion: 2.1 time: 0.918780 Aug 27 02:32:11.737079 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 500/1068] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:10 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1317 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:11.748360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e81f6e6-9fe6-417c-ba1f-b5fa8841ace5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a7abdc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:11.836773 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e81f6e6-9fe6-417c-ba1f-b5fa8841ace5 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.098464 Aug 27 02:32:11.843209 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 501/1069] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:11 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:11.849639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Action: 'action', calling method: .version_select at 0x7f4d2caed280>, body: {"addFloatingIp": {"address": "172.25.9.156"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:11.856855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:11.877395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:11.885274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:11.885933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:32:11.886425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:11.886613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:32:11.887257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:11.887908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:32:11.888091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:11.888747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:11.889234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:32:11.891789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:32:11.936622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:11.943250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:11.949895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:11.951912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:11.953129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:11.957898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:12.039810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:32:12.065419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for user d1624ef00b144dafbaff7ae5c677e7a3 and project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:32:12.137117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:32:12.149939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:32:12.178074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:32:12.178754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquired lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:32:12.380304 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c6ab6877-f840-4df5-8dd5-3d57785cb867 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.566736 Aug 27 02:32:12.394926 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 569/1070] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:32:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:32:12.439739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:12.441082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] [instance: 1f739696-df21-46b5-aba3-339d737d3825] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:12.474437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:12.476846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:12.487454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:12.495499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:12.497095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:12.501940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:12.580813 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] HTTP exception thrown: Instance 1f739696-df21-46b5-aba3-339d737d3825 could not be found. Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Request method failure captured: Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 HTTP/1.1 Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYHGR34JKQZth96wQVNYHhNyD6Bb74tO8FFgZ1DCNfwnvpUBlSbE9hCCbp_0t5HzavtREQZu-sMCLZXaxsq4eefDIWbr83CxyC-mxLZDiEg9odFsP-rv7_RI71XkExktKHZlJCVHpO6bukGa8gtHmVyjuowpRttN_oEXDNg-IFoMiGM Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a744f5cd3f9d4610bee3c18b9f12a711 Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestManualDisk-888966363 Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a744f5cd3f9d4610bee3c18b9f12a711"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a744f5cd3f9d4610bee3c18b9f12a711"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a744f5cd3f9d4610bee3c18b9f12a711"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a744f5cd3f9d4610bee3c18b9f12a711"}]}] Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestManualDisk-888966363 Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a744f5cd3f9d4610bee3c18b9f12a711 Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestManualDisk-888966363 Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestManualDisk-888966363-project Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f2a8fa4ffc5b4de6a338c481b275aedb Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestManualDisk-888966363-project Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 1f739696-df21-46b5-aba3-339d737d3825 could not be found. Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '1f739696-df21-46b5-aba3-339d737d3825'} Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f739696-df21-46b5-aba3-339d737d3825 could not be found. Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f739696-df21-46b5-aba3-339d737d3825 could not be found. Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:12.607819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:12.620444 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:12.620444 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:12.620444 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:12.620444 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:32:12.620444 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:32:12.620444 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f739696-df21-46b5-aba3-339d737d3825 could not be found. Aug 27 02:32:12.620444 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:12.626741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Returning 404 to user: Instance 1f739696-df21-46b5-aba3-339d737d3825 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:32:12.632192 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-64ae2b5e-f4f8-4329-a365-4c4604f1d484 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825" status: 404 len: 111 microversion: 2.1 time: 0.232541 Aug 27 02:32:12.643768 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 570/1071] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:12 2022] GET /compute/v2.1/servers/1f739696-df21-46b5-aba3-339d737d3825 => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:32:12.668585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4d5f6d31-aad8-44ee-8427-b3b99dc84183 req-f6d4e87c-eabc-4ee7-a458-76f424ae1bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c60b22-adc1-4593-960e-85d2762eecfa", "tag": "f08fa51d-d2bd-44ec-989a-fc29f2422448"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:12.766548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4d5f6d31-aad8-44ee-8427-b3b99dc84183 req-f6d4e87c-eabc-4ee7-a458-76f424ae1bfa service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:12.767825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4d5f6d31-aad8-44ee-8427-b3b99dc84183 req-f6d4e87c-eabc-4ee7-a458-76f424ae1bfa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:12.768917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4d5f6d31-aad8-44ee-8427-b3b99dc84183 req-f6d4e87c-eabc-4ee7-a458-76f424ae1bfa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:12.860973 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4d5f6d31-aad8-44ee-8427-b3b99dc84183 req-f6d4e87c-eabc-4ee7-a458-76f424ae1bfa service nova] Creating event network-changed:f08fa51d-d2bd-44ec-989a-fc29f2422448 for instance 29c60b22-adc1-4593-960e-85d2762eecfa on n-h1-852084-5 Aug 27 02:32:12.893137 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4d5f6d31-aad8-44ee-8427-b3b99dc84183 req-f6d4e87c-eabc-4ee7-a458-76f424ae1bfa service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247252 Aug 27 02:32:12.894183 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 571/1072] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:12.910551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a8013bf0-12ce-4283-9b64-457af5f3ceee tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:12.911308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a8013bf0-12ce-4283-9b64-457af5f3ceee tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:13.118977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a8013bf0-12ce-4283-9b64-457af5f3ceee tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:13.170750 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a8013bf0-12ce-4283-9b64-457af5f3ceee tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1279 microversion: 2.1 time: 0.263899 Aug 27 02:32:13.194872 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 572/1073] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:12 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1279 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:13.220170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b21a4844-f1e6-49e1-9223-78f1f05c3091 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] Calling method '.version_select at 0x7f4d2a279c10>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:13.294610 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b21a4844-f1e6-49e1-9223-78f1f05c3091 tempest-ServersTestManualDisk-888966363 tempest-ServersTestManualDisk-888966363-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065841744" status: 202 len: 0 microversion: 2.1 time: 0.093644 Aug 27 02:32:13.303252 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 573/1074] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:32:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065841744 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:32:13.326615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2a5b5f1b-6643-4884-85ad-596c53e0b496 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:13.331226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2a5b5f1b-6643-4884-85ad-596c53e0b496 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:13.363255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a5b5f1b-6643-4884-85ad-596c53e0b496 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:13.364478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a5b5f1b-6643-4884-85ad-596c53e0b496 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:13.365700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a5b5f1b-6643-4884-85ad-596c53e0b496 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:13.368073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a5b5f1b-6643-4884-85ad-596c53e0b496 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:13.371737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a5b5f1b-6643-4884-85ad-596c53e0b496 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:13.375627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a5b5f1b-6643-4884-85ad-596c53e0b496 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:14.316659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2a5b5f1b-6643-4884-85ad-596c53e0b496 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:14.328289 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2a5b5f1b-6643-4884-85ad-596c53e0b496 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1317 microversion: 2.1 time: 1.020174 Aug 27 02:32:14.336413 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 574/1075] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:13 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1317 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:14.351576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e820dce3-111a-4ca7-ba44-d429cba92649 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a29b3a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:14.452661 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e820dce3-111a-4ca7-ba44-d429cba92649 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.114672 Aug 27 02:32:14.453274 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 575/1076] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:14 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:14.475164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "87bf3595-5957-47e1-8d61-da607b511d38"}], "security_groups": [{"name": "tempest-securitygroup--2072263127"}], "key_name": "tempest-keypair-947025529", "user_data": "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:15.118237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] validate_networks() for [('87bf3595-5957-47e1-8d61-da607b511d38', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:32:16.168648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.156 (689237ce-83e1-4dc2-b3a3-27b89091c9dd) with port 71d54b5e-fa1a-4a54-a257-b96b90b49a4a using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 250718ef-ffb7-4399-a60e-f00282e291cf.", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:32:16.169645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Releasing lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:32:16.170616 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.156 (689237ce-83e1-4dc2-b3a3-27b89091c9dd) with port 71d54b5e-fa1a-4a54-a257-b96b90b49a4a using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 250718ef-ffb7-4399-a60e-f00282e291cf. Aug 27 02:32:16.170616 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-3cfdf5e5-8cc0-479e-9cbb-1a2714739495'] Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Request method failure captured: Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action HTTP/1.1 Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 46 Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYH2kFgCij8T23_cEXxaSwQeyrJGiJSMPB0cpGhQvJtXQA5-qDrgrB66r6UbM3sBBAn8c4rcDbq4hPknVpF7f6C4OVdCKUCt7zlq6eUaD1QSjB_woxzHb69RHRj6YgXe43zGvH-LJdV0tM26N1SCwqcu3epImyzVZ6h8c-jb-UBKP90 Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 7e0bc60394fb46148212d366174c754d Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7e0bc60394fb46148212d366174c754d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7e0bc60394fb46148212d366174c754d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7e0bc60394fb46148212d366174c754d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7e0bc60394fb46148212d366174c754d"}]}] Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 7e0bc60394fb46148212d366174c754d Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: deea2ae0666b40f885daf40ad21e7c70 Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: {"addFloatingIp": {"address": "172.25.9.156"}} Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot associate floating IP 172.25.9.156 (689237ce-83e1-4dc2-b3a3-27b89091c9dd) with port 71d54b5e-fa1a-4a54-a257-b96b90b49a4a using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 250718ef-ffb7-4399-a60e-f00282e291cf. Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-3cfdf5e5-8cc0-479e-9cbb-1a2714739495'] Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f105905c-eb08-4e79-9282-66e543fe5f7c', 'body': {'addFloatingIp': {'address': '172.25.9.156'}}} Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:32:16.177643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.156 (689237ce-83e1-4dc2-b3a3-27b89091c9dd) with port 71d54b5e-fa1a-4a54-a257-b96b90b49a4a using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 250718ef-ffb7-4399-a60e-f00282e291cf. Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3cfdf5e5-8cc0-479e-9cbb-1a2714739495'] Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.156 (689237ce-83e1-4dc2-b3a3-27b89091c9dd) with port 71d54b5e-fa1a-4a54-a257-b96b90b49a4a using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 250718ef-ffb7-4399-a60e-f00282e291cf. Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3cfdf5e5-8cc0-479e-9cbb-1a2714739495'] Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.156 (689237ce-83e1-4dc2-b3a3-27b89091c9dd) with port 71d54b5e-fa1a-4a54-a257-b96b90b49a4a using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 250718ef-ffb7-4399-a60e-f00282e291cf. Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3cfdf5e5-8cc0-479e-9cbb-1a2714739495'] Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.156 (689237ce-83e1-4dc2-b3a3-27b89091c9dd) with port 71d54b5e-fa1a-4a54-a257-b96b90b49a4a using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 250718ef-ffb7-4399-a60e-f00282e291cf. Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3cfdf5e5-8cc0-479e-9cbb-1a2714739495'] Aug 27 02:32:16.186251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:16.198413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Returning 400 to user: Cannot associate floating IP 172.25.9.156 (689237ce-83e1-4dc2-b3a3-27b89091c9dd) with port 71d54b5e-fa1a-4a54-a257-b96b90b49a4a using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 250718ef-ffb7-4399-a60e-f00282e291cf. Aug 27 02:32:16.198413 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-3cfdf5e5-8cc0-479e-9cbb-1a2714739495'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:32:16.198413 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba029942-f70e-491a-9583-25048119c8ad tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action" status: 400 len: 381 microversion: 2.1 time: 4.335110 Aug 27 02:32:16.199748 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 502/1077] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:32:11 2022] POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action => generated 381 bytes in 4356 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:32:16.252893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dcf99201-09a9-4051-bdf0-4ff562e8eded tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:16.253642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dcf99201-09a9-4051-bdf0-4ff562e8eded tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:16.300360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf99201-09a9-4051-bdf0-4ff562e8eded tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:16.309589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf99201-09a9-4051-bdf0-4ff562e8eded tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:16.311005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf99201-09a9-4051-bdf0-4ff562e8eded tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:16.312725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf99201-09a9-4051-bdf0-4ff562e8eded tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:16.318282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf99201-09a9-4051-bdf0-4ff562e8eded tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:16.319564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf99201-09a9-4051-bdf0-4ff562e8eded tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:16.636982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dcf99201-09a9-4051-bdf0-4ff562e8eded tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:16.670151 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dcf99201-09a9-4051-bdf0-4ff562e8eded tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1331 microversion: 2.1 time: 0.454644 Aug 27 02:32:16.678427 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 503/1078] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:16 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1331 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:16.691564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e9334108-0824-481a-92ec-8768ac96f20f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:16.699615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e9334108-0824-481a-92ec-8768ac96f20f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:16.728173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9334108-0824-481a-92ec-8768ac96f20f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:16.729453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9334108-0824-481a-92ec-8768ac96f20f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:16.730584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9334108-0824-481a-92ec-8768ac96f20f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:16.732164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9334108-0824-481a-92ec-8768ac96f20f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:16.733368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9334108-0824-481a-92ec-8768ac96f20f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:16.735051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9334108-0824-481a-92ec-8768ac96f20f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:17.289392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e9334108-0824-481a-92ec-8768ac96f20f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:17.326978 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e9334108-0824-481a-92ec-8768ac96f20f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1317 microversion: 2.1 time: 0.643969 Aug 27 02:32:17.333995 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 504/1079] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:16 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:17.361489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a1ad1486-838b-4eda-a86a-c97ae74cf896 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2b40dd30>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:17.370978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:32:17.371927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:32:17.372648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:32:17.373638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:32:17.375400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:32:17.431035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:17.431560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:17.432003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:17.432795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:17.433259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:17.433993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:17.507048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Getting quotas for project f92e5cff6b734d1f9d0eb5abb9a4a982. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:32:17.520096 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a1ad1486-838b-4eda-a86a-c97ae74cf896 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.182156 Aug 27 02:32:17.522883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Getting quotas for user 9c8cc51830a148959619a4944c88ad51 and project f92e5cff6b734d1f9d0eb5abb9a4a982. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:32:17.544853 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 505/1080] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:17 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:17.571322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:32:17.576245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d9aad316-2da0-4df7-886d-fb205c46cbdb tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '.version_select at 0x7f4d2b492160>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:17.579004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:32:17.760613 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4cc6fd28-d821-4083-8357-389ea73d7d9e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.300392 Aug 27 02:32:17.762906 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 576/1081] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:32:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 3303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:32:17.783045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-3a91cb77-f439-4c6e-9d45-dd340037c350 req-61966195-6ec3-40e9-aaf0-0bb63891a5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ca656b0-e5d0-4749-87bd-c63080424cd0", "name": "network-vif-plugged", "status": "completed", "tag": "223e9ede-b571-4dec-8f18-e6f0edf208cc"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:17.831570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3a91cb77-f439-4c6e-9d45-dd340037c350 req-61966195-6ec3-40e9-aaf0-0bb63891a5c8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:17.832289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3a91cb77-f439-4c6e-9d45-dd340037c350 req-61966195-6ec3-40e9-aaf0-0bb63891a5c8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:17.833057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3a91cb77-f439-4c6e-9d45-dd340037c350 req-61966195-6ec3-40e9-aaf0-0bb63891a5c8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:17.907023 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-3a91cb77-f439-4c6e-9d45-dd340037c350 req-61966195-6ec3-40e9-aaf0-0bb63891a5c8 service nova] Creating event network-vif-plugged:223e9ede-b571-4dec-8f18-e6f0edf208cc for instance 9ca656b0-e5d0-4749-87bd-c63080424cd0 on n-h1-852084-5 Aug 27 02:32:17.940539 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-3a91cb77-f439-4c6e-9d45-dd340037c350 req-61966195-6ec3-40e9-aaf0-0bb63891a5c8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168540 Aug 27 02:32:17.966354 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 577/1082] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:17.979510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b96c022b-df82-45af-947b-9b48fc15eade tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:17.980986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b96c022b-df82-45af-947b-9b48fc15eade tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:17.998599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c022b-df82-45af-947b-9b48fc15eade tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:17.999516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c022b-df82-45af-947b-9b48fc15eade tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:18.001514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c022b-df82-45af-947b-9b48fc15eade tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:18.002350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c022b-df82-45af-947b-9b48fc15eade tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:18.003230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c022b-df82-45af-947b-9b48fc15eade tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:18.004038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c022b-df82-45af-947b-9b48fc15eade tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:18.428059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b96c022b-df82-45af-947b-9b48fc15eade tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:18.477161 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b96c022b-df82-45af-947b-9b48fc15eade tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1337 microversion: 2.1 time: 0.508410 Aug 27 02:32:18.478104 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 578/1083] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:17 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1337 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:18.535517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c9f4215-34e9-4da7-bf93-71fda61231a7 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:18.550118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3c9f4215-34e9-4da7-bf93-71fda61231a7 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:18.905826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3c9f4215-34e9-4da7-bf93-71fda61231a7 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:18.907191 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3c9f4215-34e9-4da7-bf93-71fda61231a7 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1225 microversion: 2.1 time: 0.403138 Aug 27 02:32:18.907191 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 579/1084] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:18 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1225 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:18.917803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-00955f4f-25c2-4769-91e9-929d13a6c80c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:18.942351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-00955f4f-25c2-4769-91e9-929d13a6c80c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:18.970796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00955f4f-25c2-4769-91e9-929d13a6c80c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:18.970796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00955f4f-25c2-4769-91e9-929d13a6c80c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:18.970796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00955f4f-25c2-4769-91e9-929d13a6c80c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:18.970796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00955f4f-25c2-4769-91e9-929d13a6c80c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:18.970796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00955f4f-25c2-4769-91e9-929d13a6c80c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:18.970796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00955f4f-25c2-4769-91e9-929d13a6c80c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:20.071701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-00955f4f-25c2-4769-91e9-929d13a6c80c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:20.097525 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-00955f4f-25c2-4769-91e9-929d13a6c80c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1317 microversion: 2.1 time: 1.181460 Aug 27 02:32:20.102805 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 580/1085] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:18 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1317 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:20.126257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fd24b67d-f991-4257-8b28-31eb0cfdc4fd tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a279700>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:20.276100 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fd24b67d-f991-4257-8b28-31eb0cfdc4fd tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.171110 Aug 27 02:32:20.280238 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 581/1086] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:20 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:20.314826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1358040466", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "2b40c531-a24f-40ba-af07-5f55c2696292"}], "security_groups": [{"name": "tempest-securitygroup--170229861"}], "key_name": "tempest-keypair-2118236691", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:21.011819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] validate_networks() for [('2b40c531-a24f-40ba-af07-5f55c2696292', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:32:22.594874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:32:22.596079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:32:22.596931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:32:22.597542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:32:22.598165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:32:22.628503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=31 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:22.642573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:22.646996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:22.647961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:22.649403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:22.650279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:22.657981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:22.785271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Getting quotas for project c2ea38ee044d41d3a6ede6ab4806621d. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:32:22.821522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Getting quotas for user 6dbc0e90bbe94ce49ae09d2408a382c7 and project c2ea38ee044d41d3a6ede6ab4806621d. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:32:22.864612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:32:22.870308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:32:23.079056 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-29ac80b7-7764-421e-96ff-d077ce4e8234 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.785903 Aug 27 02:32:23.100401 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 582/1087] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:32:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 2810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:32:23.110843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fe936bae-8dd2-487d-aa53-196a156c3384 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:23.111515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fe936bae-8dd2-487d-aa53-196a156c3384 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:23.137217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe936bae-8dd2-487d-aa53-196a156c3384 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:23.138085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe936bae-8dd2-487d-aa53-196a156c3384 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:23.138896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe936bae-8dd2-487d-aa53-196a156c3384 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:23.140184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe936bae-8dd2-487d-aa53-196a156c3384 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:23.141577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe936bae-8dd2-487d-aa53-196a156c3384 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:23.142382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe936bae-8dd2-487d-aa53-196a156c3384 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:24.167777 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d9aad316-2da0-4df7-886d-fb205c46cbdb tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/689237ce-83e1-4dc2-b3a3-27b89091c9dd" status: 202 len: 0 microversion: 2.1 time: 6.620821 Aug 27 02:32:24.170239 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 506/1088] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:32:17 2022] DELETE /compute/v2.1/os-floating-ips/689237ce-83e1-4dc2-b3a3-27b89091c9dd => generated 0 bytes in 6625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:32:24.203575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c67177c6-3145-4f6b-bb61-c3d9c00dc875 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:24.207896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c67177c6-3145-4f6b-bb61-c3d9c00dc875 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:24.228120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c67177c6-3145-4f6b-bb61-c3d9c00dc875 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:24.229426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c67177c6-3145-4f6b-bb61-c3d9c00dc875 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:24.231638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c67177c6-3145-4f6b-bb61-c3d9c00dc875 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:24.233415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c67177c6-3145-4f6b-bb61-c3d9c00dc875 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:24.234699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c67177c6-3145-4f6b-bb61-c3d9c00dc875 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:24.235819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c67177c6-3145-4f6b-bb61-c3d9c00dc875 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:24.459903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c67177c6-3145-4f6b-bb61-c3d9c00dc875 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:24.505713 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c67177c6-3145-4f6b-bb61-c3d9c00dc875 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1283 microversion: 2.1 time: 0.320480 Aug 27 02:32:24.507790 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 507/1089] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:24 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1283 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:24.524878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7d18d4fe-be59-4bf6-9050-1c8c954b60ec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:24.528034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7d18d4fe-be59-4bf6-9050-1c8c954b60ec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:24.574800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d18d4fe-be59-4bf6-9050-1c8c954b60ec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:24.581653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d18d4fe-be59-4bf6-9050-1c8c954b60ec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:24.583104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d18d4fe-be59-4bf6-9050-1c8c954b60ec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:24.584576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d18d4fe-be59-4bf6-9050-1c8c954b60ec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:24.589271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d18d4fe-be59-4bf6-9050-1c8c954b60ec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:24.590302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d18d4fe-be59-4bf6-9050-1c8c954b60ec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:24.639198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe936bae-8dd2-487d-aa53-196a156c3384 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:24.676212 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fe936bae-8dd2-487d-aa53-196a156c3384 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1379 microversion: 2.1 time: 1.574194 Aug 27 02:32:24.678951 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 583/1090] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:23 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1379 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:24.697656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aa599d47-684c-4372-a70f-a45860ee5cf4 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a29b430>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:24.925099 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aa599d47-684c-4372-a70f-a45860ee5cf4 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.243803 Aug 27 02:32:24.927528 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 584/1091] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:24 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:24.940410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-692faa24-fce6-42e0-82c9-a9f7a37d220b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:24.942207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-692faa24-fce6-42e0-82c9-a9f7a37d220b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:24.955530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692faa24-fce6-42e0-82c9-a9f7a37d220b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:24.957078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692faa24-fce6-42e0-82c9-a9f7a37d220b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:24.958434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692faa24-fce6-42e0-82c9-a9f7a37d220b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:24.960732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692faa24-fce6-42e0-82c9-a9f7a37d220b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:24.963060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692faa24-fce6-42e0-82c9-a9f7a37d220b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:24.964775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692faa24-fce6-42e0-82c9-a9f7a37d220b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:25.352649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-692faa24-fce6-42e0-82c9-a9f7a37d220b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:25.372690 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-692faa24-fce6-42e0-82c9-a9f7a37d220b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1231 microversion: 2.1 time: 0.441907 Aug 27 02:32:25.374367 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 585/1092] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:24 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1231 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:25.382368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Action: 'action', calling method: .version_select at 0x7f4d2c1345e0>, body: {"removeFloatingIp": {"address": "172.25.9.102"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:25.815677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7d18d4fe-be59-4bf6-9050-1c8c954b60ec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:25.852047 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7d18d4fe-be59-4bf6-9050-1c8c954b60ec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1317 microversion: 2.1 time: 1.340854 Aug 27 02:32:25.857878 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 508/1093] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:24 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1317 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:25.879440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-dd9c8ae6-d2aa-4b4b-9603-fa133f18b5cd req-c0b655d0-91c5-48f7-a5e4-af9ddaedd5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c60b22-adc1-4593-960e-85d2762eecfa", "name": "network-vif-plugged", "status": "completed", "tag": "f08fa51d-d2bd-44ec-989a-fc29f2422448"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:25.904940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-dd9c8ae6-d2aa-4b4b-9603-fa133f18b5cd req-c0b655d0-91c5-48f7-a5e4-af9ddaedd5e0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:25.911354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-dd9c8ae6-d2aa-4b4b-9603-fa133f18b5cd req-c0b655d0-91c5-48f7-a5e4-af9ddaedd5e0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:25.912378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-dd9c8ae6-d2aa-4b4b-9603-fa133f18b5cd req-c0b655d0-91c5-48f7-a5e4-af9ddaedd5e0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:25.952710 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-dd9c8ae6-d2aa-4b4b-9603-fa133f18b5cd req-c0b655d0-91c5-48f7-a5e4-af9ddaedd5e0 service nova] Creating event network-vif-plugged:f08fa51d-d2bd-44ec-989a-fc29f2422448 for instance 29c60b22-adc1-4593-960e-85d2762eecfa on n-h1-852084-5 Aug 27 02:32:25.978217 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-dd9c8ae6-d2aa-4b4b-9603-fa133f18b5cd req-c0b655d0-91c5-48f7-a5e4-af9ddaedd5e0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115139 Aug 27 02:32:25.979856 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 509/1094] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:25.995150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-97c1fb54-e7ec-4fc3-b9bd-f37fa7bab017 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:26.000462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-97c1fb54-e7ec-4fc3-b9bd-f37fa7bab017 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:26.016958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c1fb54-e7ec-4fc3-b9bd-f37fa7bab017 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:26.019486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c1fb54-e7ec-4fc3-b9bd-f37fa7bab017 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:26.020731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c1fb54-e7ec-4fc3-b9bd-f37fa7bab017 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:26.024445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c1fb54-e7ec-4fc3-b9bd-f37fa7bab017 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:26.026265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c1fb54-e7ec-4fc3-b9bd-f37fa7bab017 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:26.027511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c1fb54-e7ec-4fc3-b9bd-f37fa7bab017 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:26.115194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:26.125541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:26.126626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:26.129831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:26.130875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:26.133938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:26.134995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:26.327262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-97c1fb54-e7ec-4fc3-b9bd-f37fa7bab017 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:26.359094 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-97c1fb54-e7ec-4fc3-b9bd-f37fa7bab017 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1283 microversion: 2.1 time: 0.374874 Aug 27 02:32:26.391252 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 510/1095] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:25 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1283 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:26.411288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ca0bf40b-d025-472e-93b4-26c08f048b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:26.413602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ca0bf40b-d025-472e-93b4-26c08f048b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:26.443294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca0bf40b-d025-472e-93b4-26c08f048b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:26.444156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca0bf40b-d025-472e-93b4-26c08f048b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:26.444930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca0bf40b-d025-472e-93b4-26c08f048b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:26.446286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca0bf40b-d025-472e-93b4-26c08f048b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:26.447100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca0bf40b-d025-472e-93b4-26c08f048b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:26.447887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca0bf40b-d025-472e-93b4-26c08f048b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:27.338385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:32:27.339412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquired lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:32:27.657089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ca0bf40b-d025-472e-93b4-26c08f048b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:27.685592 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ca0bf40b-d025-472e-93b4-26c08f048b35 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1379 microversion: 2.1 time: 1.293407 Aug 27 02:32:27.686956 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 511/1096] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:26 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1379 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:27.707230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8dbccb70-176d-46ef-9ffb-cd3738a953de tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a7b33a0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:27.840045 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8dbccb70-176d-46ef-9ffb-cd3738a953de tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.150037 Aug 27 02:32:27.868988 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 512/1097] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:27 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:27.884842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fd883c6a-6fa0-42bd-a838-2ecafca0bb03 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:27.898026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fd883c6a-6fa0-42bd-a838-2ecafca0bb03 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:27.920643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd883c6a-6fa0-42bd-a838-2ecafca0bb03 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:27.928007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd883c6a-6fa0-42bd-a838-2ecafca0bb03 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:27.929572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd883c6a-6fa0-42bd-a838-2ecafca0bb03 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:27.931380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd883c6a-6fa0-42bd-a838-2ecafca0bb03 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:27.932604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd883c6a-6fa0-42bd-a838-2ecafca0bb03 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:27.939512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd883c6a-6fa0-42bd-a838-2ecafca0bb03 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:28.208965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fd883c6a-6fa0-42bd-a838-2ecafca0bb03 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:28.228137 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fd883c6a-6fa0-42bd-a838-2ecafca0bb03 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1293 microversion: 2.1 time: 0.356347 Aug 27 02:32:28.230244 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 513/1098] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:27 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1293 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:28.240502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2093f55a-1130-43a4-8013-e0d52721083f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:28.256251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2093f55a-1130-43a4-8013-e0d52721083f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:28.280049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2093f55a-1130-43a4-8013-e0d52721083f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:28.282191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2093f55a-1130-43a4-8013-e0d52721083f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:28.292097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2093f55a-1130-43a4-8013-e0d52721083f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:28.294782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2093f55a-1130-43a4-8013-e0d52721083f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:28.316861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2093f55a-1130-43a4-8013-e0d52721083f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:28.317882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2093f55a-1130-43a4-8013-e0d52721083f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:28.755345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2093f55a-1130-43a4-8013-e0d52721083f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:28.772027 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2093f55a-1130-43a4-8013-e0d52721083f tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1317 microversion: 2.1 time: 0.539581 Aug 27 02:32:28.774018 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 514/1099] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:28 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:28.790343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-78438ea4-c2e5-4d12-838f-ca62d0b16256 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:28.791576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-78438ea4-c2e5-4d12-838f-ca62d0b16256 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:28.811859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78438ea4-c2e5-4d12-838f-ca62d0b16256 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:28.813074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78438ea4-c2e5-4d12-838f-ca62d0b16256 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:28.817467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78438ea4-c2e5-4d12-838f-ca62d0b16256 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:28.819269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78438ea4-c2e5-4d12-838f-ca62d0b16256 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:28.823006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78438ea4-c2e5-4d12-838f-ca62d0b16256 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:28.823857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78438ea4-c2e5-4d12-838f-ca62d0b16256 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:30.926595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-78438ea4-c2e5-4d12-838f-ca62d0b16256 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:30.945208 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-78438ea4-c2e5-4d12-838f-ca62d0b16256 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1351 microversion: 2.1 time: 2.169417 Aug 27 02:32:30.946476 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 515/1100] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:28 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1351 bytes in 2172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:31.209848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c9833766-0372-49bf-88e1-b20109f1e227 req-7ac9e120-f2dc-4f40-bb8b-fb417032148d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde6f25d-de52-4758-85c7-ce0b8471e481", "tag": "5250e113-81ca-45c6-a466-ef24aace16e6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:31.228243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c9833766-0372-49bf-88e1-b20109f1e227 req-7ac9e120-f2dc-4f40-bb8b-fb417032148d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:31.231217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c9833766-0372-49bf-88e1-b20109f1e227 req-7ac9e120-f2dc-4f40-bb8b-fb417032148d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:31.234892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c9833766-0372-49bf-88e1-b20109f1e227 req-7ac9e120-f2dc-4f40-bb8b-fb417032148d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:31.265095 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c9833766-0372-49bf-88e1-b20109f1e227 req-7ac9e120-f2dc-4f40-bb8b-fb417032148d service nova] Creating event network-changed:5250e113-81ca-45c6-a466-ef24aace16e6 for instance fde6f25d-de52-4758-85c7-ce0b8471e481 on n-h2-852084-5 Aug 27 02:32:31.281370 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c9833766-0372-49bf-88e1-b20109f1e227 req-7ac9e120-f2dc-4f40-bb8b-fb417032148d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327971 Aug 27 02:32:31.284882 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 516/1101] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:31.298727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e722ca2-a347-4ae3-b982-5ac7de784711 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:31.304306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2e722ca2-a347-4ae3-b982-5ac7de784711 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:31.325404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e722ca2-a347-4ae3-b982-5ac7de784711 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:31.331255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e722ca2-a347-4ae3-b982-5ac7de784711 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:31.332126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e722ca2-a347-4ae3-b982-5ac7de784711 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:31.333440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e722ca2-a347-4ae3-b982-5ac7de784711 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:31.335059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e722ca2-a347-4ae3-b982-5ac7de784711 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:31.338064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e722ca2-a347-4ae3-b982-5ac7de784711 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:32.452212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2e722ca2-a347-4ae3-b982-5ac7de784711 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:32.466931 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e722ca2-a347-4ae3-b982-5ac7de784711 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1379 microversion: 2.1 time: 1.179381 Aug 27 02:32:32.467599 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 517/1102] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:31 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1379 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:32.479298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3f7b169-687b-4fb3-92df-f76f2cce6ca4 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a6fd670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:32.632193 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f3f7b169-687b-4fb3-92df-f76f2cce6ca4 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.157040 Aug 27 02:32:32.632798 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 518/1103] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:32 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:32.650428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-81e8ac9a-91d7-4f33-82b0-591fa4d60573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:32.651271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-81e8ac9a-91d7-4f33-82b0-591fa4d60573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:32.671487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e8ac9a-91d7-4f33-82b0-591fa4d60573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:32.672313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e8ac9a-91d7-4f33-82b0-591fa4d60573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:32.672932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e8ac9a-91d7-4f33-82b0-591fa4d60573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:32.673906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e8ac9a-91d7-4f33-82b0-591fa4d60573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:32.674588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e8ac9a-91d7-4f33-82b0-591fa4d60573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:32.675185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e8ac9a-91d7-4f33-82b0-591fa4d60573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:32.687840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:32.846151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=5 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:33.436226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-81e8ac9a-91d7-4f33-82b0-591fa4d60573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:33.475618 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-81e8ac9a-91d7-4f33-82b0-591fa4d60573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1360 microversion: 2.1 time: 0.841140 Aug 27 02:32:33.478316 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 519/1104] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:32 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1360 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:33.505390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-961b24ef-e95b-4d91-bbf5-a925f75334ae tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:33.514741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-961b24ef-e95b-4d91-bbf5-a925f75334ae tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:33.558264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-961b24ef-e95b-4d91-bbf5-a925f75334ae tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:33.559692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-961b24ef-e95b-4d91-bbf5-a925f75334ae tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:33.566195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-961b24ef-e95b-4d91-bbf5-a925f75334ae tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:33.568586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-961b24ef-e95b-4d91-bbf5-a925f75334ae tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:33.571354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-961b24ef-e95b-4d91-bbf5-a925f75334ae tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:33.580097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-961b24ef-e95b-4d91-bbf5-a925f75334ae tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:33.988343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Building network info cache for instance {{(pid=122488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:32:34.575466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-961b24ef-e95b-4d91-bbf5-a925f75334ae tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:34.624075 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-961b24ef-e95b-4d91-bbf5-a925f75334ae tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1467 microversion: 2.1 time: 1.138701 Aug 27 02:32:34.632322 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 520/1105] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:33 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1467 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:34.663753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b89881bd-5c70-45dc-9cb5-bc25a666c661 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:34.676293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b89881bd-5c70-45dc-9cb5-bc25a666c661 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:34.718754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b89881bd-5c70-45dc-9cb5-bc25a666c661 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:34.723916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b89881bd-5c70-45dc-9cb5-bc25a666c661 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:34.733617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b89881bd-5c70-45dc-9cb5-bc25a666c661 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:34.740471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b89881bd-5c70-45dc-9cb5-bc25a666c661 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:34.742424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b89881bd-5c70-45dc-9cb5-bc25a666c661 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:34.747354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b89881bd-5c70-45dc-9cb5-bc25a666c661 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:36.124075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:36.183154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b89881bd-5c70-45dc-9cb5-bc25a666c661 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:36.223106 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b89881bd-5c70-45dc-9cb5-bc25a666c661 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1351 microversion: 2.1 time: 1.588135 Aug 27 02:32:36.225217 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 521/1106] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:34 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1351 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:36.245768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-923f7e2d-474e-476f-aafa-00900d62bfe0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:36.250668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-923f7e2d-474e-476f-aafa-00900d62bfe0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:36.294979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923f7e2d-474e-476f-aafa-00900d62bfe0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:36.296368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923f7e2d-474e-476f-aafa-00900d62bfe0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:36.298508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923f7e2d-474e-476f-aafa-00900d62bfe0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:36.309192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923f7e2d-474e-476f-aafa-00900d62bfe0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:36.310619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923f7e2d-474e-476f-aafa-00900d62bfe0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:36.312669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923f7e2d-474e-476f-aafa-00900d62bfe0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:38.360016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-923f7e2d-474e-476f-aafa-00900d62bfe0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:38.385741 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-923f7e2d-474e-476f-aafa-00900d62bfe0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1379 microversion: 2.1 time: 2.158119 Aug 27 02:32:38.393102 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 522/1107] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:36 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1379 bytes in 2167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:38.404853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-802d333b-86db-4d39-a3a5-519acca78f78 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a7aba60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:38.563523 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-802d333b-86db-4d39-a3a5-519acca78f78 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1455 microversion: 2.1 time: 0.168261 Aug 27 02:32:38.586296 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 523/1108] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:38 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1455 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:38.731427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Updating instance_info_cache with network_info: [{"id": "71d54b5e-fa1a-4a54-a257-b96b90b49a4a", "address": "fa:16:3e:35:70:10", "network": {"id": "4771c9b0-40a4-4cf7-9f4f-f9b7b6cdc06e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1641980477-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7e0bc60394fb46148212d366174c754d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap71d54b5e-fa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:32:38.763293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Releasing lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:32:38.765620 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a2697088-b964-43cc-982d-96df28e0aa31 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action" status: 202 len: 0 microversion: 2.1 time: 13.387945 Aug 27 02:32:38.777007 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 586/1109] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:32:25 2022] POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action => generated 0 bytes in 13402 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:32:38.800372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b057d855-3964-407a-bddb-87aa68d4e259 req-3cfc6d38-6d28-4319-9cb4-61e0977f280e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f105905c-eb08-4e79-9282-66e543fe5f7c", "tag": "71d54b5e-fa1a-4a54-a257-b96b90b49a4a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:38.848886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b057d855-3964-407a-bddb-87aa68d4e259 req-3cfc6d38-6d28-4319-9cb4-61e0977f280e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:38.849485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b057d855-3964-407a-bddb-87aa68d4e259 req-3cfc6d38-6d28-4319-9cb4-61e0977f280e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:38.849966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b057d855-3964-407a-bddb-87aa68d4e259 req-3cfc6d38-6d28-4319-9cb4-61e0977f280e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:38.924645 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b057d855-3964-407a-bddb-87aa68d4e259 req-3cfc6d38-6d28-4319-9cb4-61e0977f280e service nova] Creating event network-changed:71d54b5e-fa1a-4a54-a257-b96b90b49a4a for instance f105905c-eb08-4e79-9282-66e543fe5f7c on n-h1-852084-5 Aug 27 02:32:38.964550 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b057d855-3964-407a-bddb-87aa68d4e259 req-3cfc6d38-6d28-4319-9cb4-61e0977f280e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178235 Aug 27 02:32:38.967837 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 587/1110] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:38.995490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f1916607-4e40-45aa-a168-8f252774afec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:39.016934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f1916607-4e40-45aa-a168-8f252774afec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:39.045276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1916607-4e40-45aa-a168-8f252774afec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:39.046187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1916607-4e40-45aa-a168-8f252774afec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:39.046835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1916607-4e40-45aa-a168-8f252774afec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:39.048032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1916607-4e40-45aa-a168-8f252774afec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:39.048659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1916607-4e40-45aa-a168-8f252774afec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:39.055363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1916607-4e40-45aa-a168-8f252774afec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:39.291205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c0351d04-4927-42d1-9d02-dd8b1e6182f5 req-39deb2d4-1912-4ef4-9e42-b242e56193c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769febc7-82dc-4fbb-8510-8c2ab56332a1", "tag": "097d06b1-e16f-4708-afe4-4d8903542c41"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:39.342024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c0351d04-4927-42d1-9d02-dd8b1e6182f5 req-39deb2d4-1912-4ef4-9e42-b242e56193c4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:39.343158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c0351d04-4927-42d1-9d02-dd8b1e6182f5 req-39deb2d4-1912-4ef4-9e42-b242e56193c4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:39.344137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c0351d04-4927-42d1-9d02-dd8b1e6182f5 req-39deb2d4-1912-4ef4-9e42-b242e56193c4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:39.376402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:39.383861 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c0351d04-4927-42d1-9d02-dd8b1e6182f5 req-39deb2d4-1912-4ef4-9e42-b242e56193c4 service nova] Creating event network-changed:097d06b1-e16f-4708-afe4-4d8903542c41 for instance 769febc7-82dc-4fbb-8510-8c2ab56332a1 on n-h2-852084-5 Aug 27 02:32:39.394569 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c0351d04-4927-42d1-9d02-dd8b1e6182f5 req-39deb2d4-1912-4ef4-9e42-b242e56193c4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.805317 Aug 27 02:32:39.396672 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 524/1111] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:39.408807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-39e3b748-b6c6-4c85-93c7-bafface0f7e9 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:39.410723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-39e3b748-b6c6-4c85-93c7-bafface0f7e9 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:39.422762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=39 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:39.426522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39e3b748-b6c6-4c85-93c7-bafface0f7e9 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:39.427941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39e3b748-b6c6-4c85-93c7-bafface0f7e9 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:39.429181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39e3b748-b6c6-4c85-93c7-bafface0f7e9 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:39.431042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39e3b748-b6c6-4c85-93c7-bafface0f7e9 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:39.436287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39e3b748-b6c6-4c85-93c7-bafface0f7e9 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:39.437836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39e3b748-b6c6-4c85-93c7-bafface0f7e9 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:39.727020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f1916607-4e40-45aa-a168-8f252774afec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:39.730054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=64,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:39.741124 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f1916607-4e40-45aa-a168-8f252774afec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1360 microversion: 2.1 time: 0.761383 Aug 27 02:32:39.756247 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 588/1112] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:38 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1360 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:39.762457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-71ed07cd-7380-44b1-ad07-5ac86dd8c355 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:39.763569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-71ed07cd-7380-44b1-ad07-5ac86dd8c355 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:39.773138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71ed07cd-7380-44b1-ad07-5ac86dd8c355 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:39.774406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71ed07cd-7380-44b1-ad07-5ac86dd8c355 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:39.775245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71ed07cd-7380-44b1-ad07-5ac86dd8c355 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:39.776691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71ed07cd-7380-44b1-ad07-5ac86dd8c355 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:39.777647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71ed07cd-7380-44b1-ad07-5ac86dd8c355 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:39.778443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71ed07cd-7380-44b1-ad07-5ac86dd8c355 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:40.590193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-71ed07cd-7380-44b1-ad07-5ac86dd8c355 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:40.610618 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-71ed07cd-7380-44b1-ad07-5ac86dd8c355 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1351 microversion: 2.1 time: 0.852294 Aug 27 02:32:40.611400 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 589/1113] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:39 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1351 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:40.616706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-81b0fa03-2528-4f7f-bf23-1cebce2e3267 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '.version_select at 0x7f4d2a258700>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:41.471435 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-39e3b748-b6c6-4c85-93c7-bafface0f7e9 tempest-ServersOnMultiNodesTest-222127135 tempest-ServersOnMultiNodesTest-222127135-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1618 microversion: 2.1 time: 2.066923 Aug 27 02:32:41.472505 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 525/1114] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:39 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1618 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:41.506894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-79806402-c82a-467d-bdc5-94785cc00b8d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:41.510531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-79806402-c82a-467d-bdc5-94785cc00b8d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:41.544854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79806402-c82a-467d-bdc5-94785cc00b8d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:41.549523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79806402-c82a-467d-bdc5-94785cc00b8d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:41.550789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79806402-c82a-467d-bdc5-94785cc00b8d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:41.555459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79806402-c82a-467d-bdc5-94785cc00b8d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:41.558843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79806402-c82a-467d-bdc5-94785cc00b8d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:41.565214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79806402-c82a-467d-bdc5-94785cc00b8d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:42.926386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-79806402-c82a-467d-bdc5-94785cc00b8d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:42.972757 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-79806402-c82a-467d-bdc5-94785cc00b8d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1379 microversion: 2.1 time: 1.491153 Aug 27 02:32:42.974765 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 526/1115] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:41 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1379 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:42.980506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5627dfe1-353c-42b1-a2d4-8d67bda97f24 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a7b3c10>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:43.053962 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5627dfe1-353c-42b1-a2d4-8d67bda97f24 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1464 microversion: 2.1 time: 0.076974 Aug 27 02:32:43.055676 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 527/1116] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:42 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1464 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:43.060849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df62715e-052a-4fdb-ab5b-9fc0a0ee274f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:43.062469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-df62715e-052a-4fdb-ab5b-9fc0a0ee274f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:43.073992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df62715e-052a-4fdb-ab5b-9fc0a0ee274f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:43.080232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df62715e-052a-4fdb-ab5b-9fc0a0ee274f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:43.082424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df62715e-052a-4fdb-ab5b-9fc0a0ee274f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:43.084301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df62715e-052a-4fdb-ab5b-9fc0a0ee274f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:43.085084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df62715e-052a-4fdb-ab5b-9fc0a0ee274f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:43.085748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df62715e-052a-4fdb-ab5b-9fc0a0ee274f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:43.312677 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-81b0fa03-2528-4f7f-bf23-1cebce2e3267 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/e57ac181-2f23-4280-907a-18026acc3875" status: 202 len: 0 microversion: 2.1 time: 2.699325 Aug 27 02:32:43.315102 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 590/1117] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:32:40 2022] DELETE /compute/v2.1/os-floating-ips/e57ac181-2f23-4280-907a-18026acc3875 => generated 0 bytes in 2703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:32:43.361535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70af0276-8c0e-4854-9edb-074365e9db10 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:43.370927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-70af0276-8c0e-4854-9edb-074365e9db10 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:43.411733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70af0276-8c0e-4854-9edb-074365e9db10 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:43.413184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70af0276-8c0e-4854-9edb-074365e9db10 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:43.413856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70af0276-8c0e-4854-9edb-074365e9db10 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:43.415169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70af0276-8c0e-4854-9edb-074365e9db10 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:43.415871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70af0276-8c0e-4854-9edb-074365e9db10 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:43.416480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70af0276-8c0e-4854-9edb-074365e9db10 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:43.480624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-70af0276-8c0e-4854-9edb-074365e9db10 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:32:43.607103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-df62715e-052a-4fdb-ab5b-9fc0a0ee274f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:43.636279 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-df62715e-052a-4fdb-ab5b-9fc0a0ee274f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1360 microversion: 2.1 time: 0.579135 Aug 27 02:32:43.657714 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 528/1118] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:43 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1360 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:43.659900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e0d3ab91-7ded-418f-9536-924b0ffca52a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:43.660890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e0d3ab91-7ded-418f-9536-924b0ffca52a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:43.677462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab91-7ded-418f-9536-924b0ffca52a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:43.681002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab91-7ded-418f-9536-924b0ffca52a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:43.681808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab91-7ded-418f-9536-924b0ffca52a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:43.683590 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70af0276-8c0e-4854-9edb-074365e9db10 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "DELETE /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 204 len: 0 microversion: 2.1 time: 0.365258 Aug 27 02:32:43.684417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab91-7ded-418f-9536-924b0ffca52a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:43.684774 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 591/1119] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:32:43 2022] DELETE /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:32:43.685387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab91-7ded-418f-9536-924b0ffca52a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:43.687983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d3ab91-7ded-418f-9536-924b0ffca52a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:43.696110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c9b16376-08ba-4fd1-bad3-2eb19341acc0 req-eb4e4453-0a3e-499e-aa99-83cdad6b1590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9500d4a-17ee-40b3-bc1c-77026234b7a3", "tag": "aba73b64-257c-4090-8a10-377dba49c897"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:43.742518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9b16376-08ba-4fd1-bad3-2eb19341acc0 req-eb4e4453-0a3e-499e-aa99-83cdad6b1590 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:43.743270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9b16376-08ba-4fd1-bad3-2eb19341acc0 req-eb4e4453-0a3e-499e-aa99-83cdad6b1590 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:43.743732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9b16376-08ba-4fd1-bad3-2eb19341acc0 req-eb4e4453-0a3e-499e-aa99-83cdad6b1590 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:43.777930 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c9b16376-08ba-4fd1-bad3-2eb19341acc0 req-eb4e4453-0a3e-499e-aa99-83cdad6b1590 service nova] Creating event network-changed:aba73b64-257c-4090-8a10-377dba49c897 for instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 on n-h1-852084-5 Aug 27 02:32:43.790855 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c9b16376-08ba-4fd1-bad3-2eb19341acc0 req-eb4e4453-0a3e-499e-aa99-83cdad6b1590 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102686 Aug 27 02:32:43.793160 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 592/1120] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:44.055162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e0d3ab91-7ded-418f-9536-924b0ffca52a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:44.075412 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e0d3ab91-7ded-418f-9536-924b0ffca52a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1351 microversion: 2.1 time: 0.430022 Aug 27 02:32:44.085331 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 529/1121] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:43 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1351 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:44.109721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d13ab7e6-e2ed-4e76-8886-8127840ae91e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2adef790>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:44.199363 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d13ab7e6-e2ed-4e76-8886-8127840ae91e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 200 len: 1464 microversion: 2.1 time: 0.097427 Aug 27 02:32:44.200586 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 530/1122] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:44 2022] GET /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 1464 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:44.210834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b9049ee4-1dcc-4526-a746-866556366f94 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b9049ee4-1dcc-4526-a746-866556366f94 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Request method failure captured: Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action HTTP/1.1 Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 34 Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYH2kFgCij8T23_cEXxaSwQeyrJGiJSMPB0cpGhQvJtXQA5-qDrgrB66r6UbM3sBBAn8c4rcDbq4hPknVpF7f6C4OVdCKUCt7zlq6eUaD1QSjB_woxzHb69RHRj6YgXe43zGvH-LJdV0tM26N1SCwqcu3epImyzVZ6h8c-jb-UBKP90 Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 7e0bc60394fb46148212d366174c754d Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7e0bc60394fb46148212d366174c754d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7e0bc60394fb46148212d366174c754d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7e0bc60394fb46148212d366174c754d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7e0bc60394fb46148212d366174c754d"}]}] Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 7e0bc60394fb46148212d366174c754d Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: deea2ae0666b40f885daf40ad21e7c70 Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: {"addFloatingIp": {"address": ""}} Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f105905c-eb08-4e79-9282-66e543fe5f7c', 'body': {'addFloatingIp': {'address': ''}}} Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi '' Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:32:44.221413 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b9049ee4-1dcc-4526-a746-866556366f94 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:32:44.233511 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b9049ee4-1dcc-4526-a746-866556366f94 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action" status: 400 len: 142 microversion: 2.1 time: 0.028127 Aug 27 02:32:44.238504 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 531/1123] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:32:44 2022] POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action => generated 142 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:32:44.247235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4bdaab6b-9bff-43d6-a23c-d118c050252a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:44.247809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4bdaab6b-9bff-43d6-a23c-d118c050252a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:44.255607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bdaab6b-9bff-43d6-a23c-d118c050252a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:44.256243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bdaab6b-9bff-43d6-a23c-d118c050252a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:44.256824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bdaab6b-9bff-43d6-a23c-d118c050252a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:44.257949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bdaab6b-9bff-43d6-a23c-d118c050252a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:44.258705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bdaab6b-9bff-43d6-a23c-d118c050252a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:44.259064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bdaab6b-9bff-43d6-a23c-d118c050252a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:44.312480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-038eb871-1839-4ea4-ab17-ce967e4accf3 req-ae2fb3d1-0665-462d-b44e-f9107abf82b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde6f25d-de52-4758-85c7-ce0b8471e481", "name": "network-vif-plugged", "status": "completed", "tag": "5250e113-81ca-45c6-a466-ef24aace16e6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:44.325794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-038eb871-1839-4ea4-ab17-ce967e4accf3 req-ae2fb3d1-0665-462d-b44e-f9107abf82b2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:44.327729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-038eb871-1839-4ea4-ab17-ce967e4accf3 req-ae2fb3d1-0665-462d-b44e-f9107abf82b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:44.328375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-038eb871-1839-4ea4-ab17-ce967e4accf3 req-ae2fb3d1-0665-462d-b44e-f9107abf82b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:44.349897 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-038eb871-1839-4ea4-ab17-ce967e4accf3 req-ae2fb3d1-0665-462d-b44e-f9107abf82b2 service nova] Creating event network-vif-plugged:5250e113-81ca-45c6-a466-ef24aace16e6 for instance fde6f25d-de52-4758-85c7-ce0b8471e481 on n-h2-852084-5 Aug 27 02:32:44.357766 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-038eb871-1839-4ea4-ab17-ce967e4accf3 req-ae2fb3d1-0665-462d-b44e-f9107abf82b2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.560267 Aug 27 02:32:44.360138 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 593/1124] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:44.373937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f35de20a-aa85-4f76-b397-fb9a88614c9c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:44.379741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f35de20a-aa85-4f76-b397-fb9a88614c9c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:44.394190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f35de20a-aa85-4f76-b397-fb9a88614c9c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:44.394713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f35de20a-aa85-4f76-b397-fb9a88614c9c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:44.395170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f35de20a-aa85-4f76-b397-fb9a88614c9c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:44.396408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f35de20a-aa85-4f76-b397-fb9a88614c9c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:44.398464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f35de20a-aa85-4f76-b397-fb9a88614c9c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:44.399315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f35de20a-aa85-4f76-b397-fb9a88614c9c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:44.701756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4bdaab6b-9bff-43d6-a23c-d118c050252a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:44.715650 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4bdaab6b-9bff-43d6-a23c-d118c050252a tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1473 microversion: 2.1 time: 0.476701 Aug 27 02:32:44.729713 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 532/1125] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:44 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1473 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:44.745716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4cd7b717-7a3f-4d96-9a97-a0e205770f50 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:44.745716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4cd7b717-7a3f-4d96-9a97-a0e205770f50 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:44.763647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd7b717-7a3f-4d96-9a97-a0e205770f50 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:44.765584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd7b717-7a3f-4d96-9a97-a0e205770f50 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:44.766589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd7b717-7a3f-4d96-9a97-a0e205770f50 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:44.770623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd7b717-7a3f-4d96-9a97-a0e205770f50 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:44.771880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd7b717-7a3f-4d96-9a97-a0e205770f50 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:44.772665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd7b717-7a3f-4d96-9a97-a0e205770f50 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:44.815921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f35de20a-aa85-4f76-b397-fb9a88614c9c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:44.848129 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f35de20a-aa85-4f76-b397-fb9a88614c9c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1379 microversion: 2.1 time: 0.481326 Aug 27 02:32:44.867017 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 594/1126] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:44 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1379 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:44.884862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:44.887676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:44.912651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:44.913380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:44.915995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:44.918444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:44.920417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:44.920915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:44.960889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:32:44.961591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquired lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:32:45.154678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Releasing lock "refresh_cache-f105905c-eb08-4e79-9282-66e543fe5f7c" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:32:45.155424 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] HTTP exception thrown: floating IP not found Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Request method failure captured: Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action HTTP/1.1 Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 41 Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYH2kFgCij8T23_cEXxaSwQeyrJGiJSMPB0cpGhQvJtXQA5-qDrgrB66r6UbM3sBBAn8c4rcDbq4hPknVpF7f6C4OVdCKUCt7zlq6eUaD1QSjB_woxzHb69RHRj6YgXe43zGvH-LJdV0tM26N1SCwqcu3epImyzVZ6h8c-jb-UBKP90 Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 7e0bc60394fb46148212d366174c754d Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7e0bc60394fb46148212d366174c754d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7e0bc60394fb46148212d366174c754d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7e0bc60394fb46148212d366174c754d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7e0bc60394fb46148212d366174c754d"}]}] Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 7e0bc60394fb46148212d366174c754d Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: deea2ae0666b40f885daf40ad21e7c70 Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: exception: floating IP not found Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f105905c-eb08-4e79-9282-66e543fe5f7c', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 27 02:32:45.157819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Returning 404 to user: floating IP not found {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9bb0bdd8-b82b-401c-a190-2ed2cae88726 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action" status: 404 len: 67 microversion: 2.1 time: 0.292348 Aug 27 02:32:45.163233 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 595/1127] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:32:44 2022] POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action => generated 67 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:32:45.172568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d679b67a-2eba-4170-b875-b9a58eeea0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:45.173324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d679b67a-2eba-4170-b875-b9a58eeea0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:45.182330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d679b67a-2eba-4170-b875-b9a58eeea0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:45.182956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d679b67a-2eba-4170-b875-b9a58eeea0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:45.183496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d679b67a-2eba-4170-b875-b9a58eeea0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:45.184913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d679b67a-2eba-4170-b875-b9a58eeea0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:45.185554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d679b67a-2eba-4170-b875-b9a58eeea0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:45.186110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d679b67a-2eba-4170-b875-b9a58eeea0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:45.264221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4cd7b717-7a3f-4d96-9a97-a0e205770f50 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:45.279942 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4cd7b717-7a3f-4d96-9a97-a0e205770f50 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1467 microversion: 2.1 time: 0.559196 Aug 27 02:32:45.280846 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 533/1128] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:44 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1467 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:45.290335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0855402f-5dc3-4fbf-8833-028bbcb2a30e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:45.292446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0855402f-5dc3-4fbf-8833-028bbcb2a30e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:45.313254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0855402f-5dc3-4fbf-8833-028bbcb2a30e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:45.314177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0855402f-5dc3-4fbf-8833-028bbcb2a30e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:45.314795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0855402f-5dc3-4fbf-8833-028bbcb2a30e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:45.315826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0855402f-5dc3-4fbf-8833-028bbcb2a30e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:45.316538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0855402f-5dc3-4fbf-8833-028bbcb2a30e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:45.317126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0855402f-5dc3-4fbf-8833-028bbcb2a30e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:45.462079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d679b67a-2eba-4170-b875-b9a58eeea0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:45.489801 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d679b67a-2eba-4170-b875-b9a58eeea0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1360 microversion: 2.1 time: 0.324428 Aug 27 02:32:45.491743 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 596/1129] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:45 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1360 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:45.510163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8666d134-45e6-45e1-a420-c1fefeae4212 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:45.580955 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-8666d134-45e6-45e1-a420-c1fefeae4212 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8666d134-45e6-45e1-a420-c1fefeae4212 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Request method failure captured: Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action HTTP/1.1 Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 44 Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYH2kFgCij8T23_cEXxaSwQeyrJGiJSMPB0cpGhQvJtXQA5-qDrgrB66r6UbM3sBBAn8c4rcDbq4hPknVpF7f6C4OVdCKUCt7zlq6eUaD1QSjB_woxzHb69RHRj6YgXe43zGvH-LJdV0tM26N1SCwqcu3epImyzVZ6h8c-jb-UBKP90 Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 7e0bc60394fb46148212d366174c754d Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7e0bc60394fb46148212d366174c754d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7e0bc60394fb46148212d366174c754d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7e0bc60394fb46148212d366174c754d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7e0bc60394fb46148212d366174c754d"}]}] Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 7e0bc60394fb46148212d366174c754d Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: deea2ae0666b40f885daf40ad21e7c70 Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: exception: Floating IP not found for address 0.0.0.0. Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f105905c-eb08-4e79-9282-66e543fe5f7c', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 27 02:32:45.582839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:45.588700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8666d134-45e6-45e1-a420-c1fefeae4212 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:32:45.590088 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8666d134-45e6-45e1-a420-c1fefeae4212 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action" status: 404 len: 88 microversion: 2.1 time: 0.095666 Aug 27 02:32:45.591125 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 597/1130] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:32:45 2022] POST /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c/action => generated 88 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:32:45.599495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-08154990-fc51-4adf-ae97-e2a3204fc938 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1397724994"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:45.602829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-08154990-fc51-4adf-ae97-e2a3204fc938 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:45.611677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08154990-fc51-4adf-ae97-e2a3204fc938 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:45.612747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08154990-fc51-4adf-ae97-e2a3204fc938 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:45.613484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08154990-fc51-4adf-ae97-e2a3204fc938 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:45.614593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08154990-fc51-4adf-ae97-e2a3204fc938 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:45.615623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08154990-fc51-4adf-ae97-e2a3204fc938 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:45.616042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08154990-fc51-4adf-ae97-e2a3204fc938 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:45.860316 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-08154990-fc51-4adf-ae97-e2a3204fc938 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "POST /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79/action" status: 202 len: 0 microversion: 2.1 time: 0.267549 Aug 27 02:32:45.870795 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 598/1131] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:32:45 2022] POST /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:32:45.886485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a49e5b84-34cc-4e62-8fa6-c18012943636 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:45.889425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a49e5b84-34cc-4e62-8fa6-c18012943636 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:45.904676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a49e5b84-34cc-4e62-8fa6-c18012943636 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:45.906056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a49e5b84-34cc-4e62-8fa6-c18012943636 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:45.906897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a49e5b84-34cc-4e62-8fa6-c18012943636 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:45.908239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a49e5b84-34cc-4e62-8fa6-c18012943636 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:45.909113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a49e5b84-34cc-4e62-8fa6-c18012943636 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:45.910226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a49e5b84-34cc-4e62-8fa6-c18012943636 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:45.993746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a49e5b84-34cc-4e62-8fa6-c18012943636 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:32:46.132614 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a49e5b84-34cc-4e62-8fa6-c18012943636 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 204 len: 0 microversion: 2.1 time: 0.256701 Aug 27 02:32:46.133261 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 599/1132] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:32:45 2022] DELETE /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:32:46.140034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aff10137-098f-44cd-99c9-2c89a91b5cbe tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:46.141172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aff10137-098f-44cd-99c9-2c89a91b5cbe tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:46.151387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aff10137-098f-44cd-99c9-2c89a91b5cbe tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:46.152050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aff10137-098f-44cd-99c9-2c89a91b5cbe tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:46.152496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aff10137-098f-44cd-99c9-2c89a91b5cbe tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:46.153448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aff10137-098f-44cd-99c9-2c89a91b5cbe tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:46.155025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aff10137-098f-44cd-99c9-2c89a91b5cbe tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:46.156524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aff10137-098f-44cd-99c9-2c89a91b5cbe tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:46.199257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0855402f-5dc3-4fbf-8833-028bbcb2a30e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:46.212207 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0855402f-5dc3-4fbf-8833-028bbcb2a30e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1351 microversion: 2.1 time: 0.929427 Aug 27 02:32:46.212806 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 534/1133] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:45 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1351 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:46.226305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aa8cc604-e750-465a-8939-ffb0a9c06bba tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:46.232740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aa8cc604-e750-465a-8939-ffb0a9c06bba tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:46.239875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8cc604-e750-465a-8939-ffb0a9c06bba tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:46.240664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8cc604-e750-465a-8939-ffb0a9c06bba tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:46.248067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8cc604-e750-465a-8939-ffb0a9c06bba tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:46.249515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8cc604-e750-465a-8939-ffb0a9c06bba tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:46.250502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8cc604-e750-465a-8939-ffb0a9c06bba tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:46.250959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8cc604-e750-465a-8939-ffb0a9c06bba tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:46.532515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aff10137-098f-44cd-99c9-2c89a91b5cbe tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:46.544558 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aff10137-098f-44cd-99c9-2c89a91b5cbe tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1473 microversion: 2.1 time: 0.409759 Aug 27 02:32:46.546511 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 600/1134] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:46 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1473 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:46.564136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc14583b-7161-4ff8-a63f-348a683a3765 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a2d3670>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:46.681204 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fc14583b-7161-4ff8-a63f-348a683a3765 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.132145 Aug 27 02:32:46.691491 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 601/1135] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:46 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:46.697859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c83ac3c0-f4d2-4348-9fe4-4f6889bb8d14 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:46.698835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c83ac3c0-f4d2-4348-9fe4-4f6889bb8d14 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:46.707870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c83ac3c0-f4d2-4348-9fe4-4f6889bb8d14 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:46.708766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c83ac3c0-f4d2-4348-9fe4-4f6889bb8d14 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:46.709386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c83ac3c0-f4d2-4348-9fe4-4f6889bb8d14 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:46.710470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c83ac3c0-f4d2-4348-9fe4-4f6889bb8d14 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:46.711167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c83ac3c0-f4d2-4348-9fe4-4f6889bb8d14 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:46.711770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c83ac3c0-f4d2-4348-9fe4-4f6889bb8d14 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:46.736085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-aa8cc604-e750-465a-8939-ffb0a9c06bba tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:46.782116 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aa8cc604-e750-465a-8939-ffb0a9c06bba tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1529 microversion: 2.1 time: 0.548824 Aug 27 02:32:46.783038 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 535/1136] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:46 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1529 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:46.792129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-18a87429-ee98-492d-afaf-d687e5f1b215 req-945a5b37-c4e2-4100-ae9e-fec0b3755a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769febc7-82dc-4fbb-8510-8c2ab56332a1", "name": "network-vif-plugged", "status": "completed", "tag": "097d06b1-e16f-4708-afe4-4d8903542c41"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:46.821842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-18a87429-ee98-492d-afaf-d687e5f1b215 req-945a5b37-c4e2-4100-ae9e-fec0b3755a23 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:46.823028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-18a87429-ee98-492d-afaf-d687e5f1b215 req-945a5b37-c4e2-4100-ae9e-fec0b3755a23 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:46.823597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-18a87429-ee98-492d-afaf-d687e5f1b215 req-945a5b37-c4e2-4100-ae9e-fec0b3755a23 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:46.848563 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-18a87429-ee98-492d-afaf-d687e5f1b215 req-945a5b37-c4e2-4100-ae9e-fec0b3755a23 service nova] Creating event network-vif-plugged:097d06b1-e16f-4708-afe4-4d8903542c41 for instance 769febc7-82dc-4fbb-8510-8c2ab56332a1 on n-h2-852084-5 Aug 27 02:32:46.861019 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-18a87429-ee98-492d-afaf-d687e5f1b215 req-945a5b37-c4e2-4100-ae9e-fec0b3755a23 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075032 Aug 27 02:32:46.862939 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 536/1137] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:46.886699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-96a6145e-e32a-496d-bf79-b7613da7e9a5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:46.890097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-96a6145e-e32a-496d-bf79-b7613da7e9a5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:46.913459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96a6145e-e32a-496d-bf79-b7613da7e9a5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:46.921604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96a6145e-e32a-496d-bf79-b7613da7e9a5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:46.922926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96a6145e-e32a-496d-bf79-b7613da7e9a5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:46.925761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96a6145e-e32a-496d-bf79-b7613da7e9a5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:46.926934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96a6145e-e32a-496d-bf79-b7613da7e9a5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:46.927952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96a6145e-e32a-496d-bf79-b7613da7e9a5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:47.160613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c83ac3c0-f4d2-4348-9fe4-4f6889bb8d14 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:47.178604 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c83ac3c0-f4d2-4348-9fe4-4f6889bb8d14 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1542 microversion: 2.1 time: 0.486512 Aug 27 02:32:47.180815 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 602/1138] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:46 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1542 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:47.192444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46b646b3-9707-471e-95be-f51aa9c1abf8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:47.193571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-46b646b3-9707-471e-95be-f51aa9c1abf8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:47.240532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46b646b3-9707-471e-95be-f51aa9c1abf8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:47.243593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46b646b3-9707-471e-95be-f51aa9c1abf8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:47.249490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46b646b3-9707-471e-95be-f51aa9c1abf8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:47.254127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46b646b3-9707-471e-95be-f51aa9c1abf8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:47.256163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46b646b3-9707-471e-95be-f51aa9c1abf8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:47.256940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46b646b3-9707-471e-95be-f51aa9c1abf8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:47.615926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-96a6145e-e32a-496d-bf79-b7613da7e9a5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:47.649612 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-96a6145e-e32a-496d-bf79-b7613da7e9a5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1360 microversion: 2.1 time: 0.784107 Aug 27 02:32:47.689502 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 537/1139] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:46 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1360 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:47.710190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-55008bdc-6923-4fb8-afa4-660db6ed5f5e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:47.711468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-55008bdc-6923-4fb8-afa4-660db6ed5f5e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:47.728188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55008bdc-6923-4fb8-afa4-660db6ed5f5e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:47.729267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55008bdc-6923-4fb8-afa4-660db6ed5f5e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:47.730144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55008bdc-6923-4fb8-afa4-660db6ed5f5e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:47.731815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55008bdc-6923-4fb8-afa4-660db6ed5f5e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:47.733182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55008bdc-6923-4fb8-afa4-660db6ed5f5e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:47.734394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55008bdc-6923-4fb8-afa4-660db6ed5f5e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:47.873745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-46b646b3-9707-471e-95be-f51aa9c1abf8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:47.904964 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-46b646b3-9707-471e-95be-f51aa9c1abf8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1529 microversion: 2.1 time: 0.722183 Aug 27 02:32:47.907490 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 603/1140] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:47 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1529 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:47.925336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-47a09e16-7e9d-427e-a678-ac8ed8f53dda req-f5a35741-931a-465d-a78f-30ffd31bfe2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c60b22-adc1-4593-960e-85d2762eecfa", "name": "network-vif-deleted", "tag": "f08fa51d-d2bd-44ec-989a-fc29f2422448"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:47.948149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-47a09e16-7e9d-427e-a678-ac8ed8f53dda req-f5a35741-931a-465d-a78f-30ffd31bfe2c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:47.954149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-47a09e16-7e9d-427e-a678-ac8ed8f53dda req-f5a35741-931a-465d-a78f-30ffd31bfe2c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:47.954873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-47a09e16-7e9d-427e-a678-ac8ed8f53dda req-f5a35741-931a-465d-a78f-30ffd31bfe2c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:47.970315 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-47a09e16-7e9d-427e-a678-ac8ed8f53dda req-f5a35741-931a-465d-a78f-30ffd31bfe2c service nova] Creating event network-vif-deleted:f08fa51d-d2bd-44ec-989a-fc29f2422448 for instance 29c60b22-adc1-4593-960e-85d2762eecfa on n-h1-852084-5 Aug 27 02:32:47.977025 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-47a09e16-7e9d-427e-a678-ac8ed8f53dda req-f5a35741-931a-465d-a78f-30ffd31bfe2c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056884 Aug 27 02:32:47.978529 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 604/1141] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:47.996795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:47.997771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:48.008372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:48.008978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:48.009587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:48.010429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:48.010959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:48.011731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:48.073645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:48.074619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:48.076057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:48.078037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lazy-loading 'fault' on Instance uuid 29c60b22-adc1-4593-960e-85d2762eecfa {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:32:48.409761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-55008bdc-6923-4fb8-afa4-660db6ed5f5e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:48.426770 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-55008bdc-6923-4fb8-afa4-660db6ed5f5e tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1351 microversion: 2.1 time: 0.735508 Aug 27 02:32:48.427882 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 538/1142] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:47 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1351 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:48.442232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68646a4d-5bed-4b74-a0a2-54461dd6ae4a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a6e6160>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:48.579987 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-68646a4d-5bed-4b74-a0a2-54461dd6ae4a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.150369 Aug 27 02:32:48.586317 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 539/1143] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:48 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:48.606207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5cb2f56d-44e9-45ab-9126-4447c4242871 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:48.659651 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5cb2f56d-44e9-45ab-9126-4447c4242871 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1" status: 202 len: 0 microversion: 2.1 time: 0.066568 Aug 27 02:32:48.660649 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 540/1144] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:32:48 2022] DELETE /compute/v2.1/flavors/5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:32:48.666984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d179cf65-bec0-4aff-a68e-5420bfbd91fe tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:48.672645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d179cf65-bec0-4aff-a68e-5420bfbd91fe tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:48.695006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d179cf65-bec0-4aff-a68e-5420bfbd91fe tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:48.695514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d179cf65-bec0-4aff-a68e-5420bfbd91fe tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:48.695951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d179cf65-bec0-4aff-a68e-5420bfbd91fe tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:48.696676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d179cf65-bec0-4aff-a68e-5420bfbd91fe tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:48.697324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d179cf65-bec0-4aff-a68e-5420bfbd91fe tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:48.697952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d179cf65-bec0-4aff-a68e-5420bfbd91fe tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:48.908046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:48.929630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:48.984759 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-636356ab-9878-48c9-af4e-2c3517b887fc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 200 len: 1307 microversion: 2.1 time: 1.004754 Aug 27 02:32:48.991765 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 605/1145] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:47 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 1307 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:49.001520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0eef52fb-078a-4ae6-a1a6-cb341ecbcf40 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:49.036981 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0eef52fb-078a-4ae6-a1a6-cb341ecbcf40 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043943 Aug 27 02:32:49.038960 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 606/1146] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:32:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:49.045762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2b135cad-ede0-479d-8c85-7755b59d0ebf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:49.046999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2b135cad-ede0-479d-8c85-7755b59d0ebf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:49.073232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b135cad-ede0-479d-8c85-7755b59d0ebf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:49.077438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b135cad-ede0-479d-8c85-7755b59d0ebf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:49.078684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b135cad-ede0-479d-8c85-7755b59d0ebf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:49.082112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b135cad-ede0-479d-8c85-7755b59d0ebf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:49.083251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b135cad-ede0-479d-8c85-7755b59d0ebf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:49.084426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b135cad-ede0-479d-8c85-7755b59d0ebf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:49.194459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d179cf65-bec0-4aff-a68e-5420bfbd91fe tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:49.207215 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d179cf65-bec0-4aff-a68e-5420bfbd91fe tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1542 microversion: 2.1 time: 0.544775 Aug 27 02:32:49.224571 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 541/1147] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:48 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1542 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:49.241895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-b179dc8d-2f5c-46f5-881d-d93c6f6f6190 req-c25f76d9-435d-4c4e-871b-ff55b81bf966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9500d4a-17ee-40b3-bc1c-77026234b7a3", "name": "network-vif-plugged", "status": "completed", "tag": "aba73b64-257c-4090-8a10-377dba49c897"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:49.278474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b179dc8d-2f5c-46f5-881d-d93c6f6f6190 req-c25f76d9-435d-4c4e-871b-ff55b81bf966 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:49.282323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b179dc8d-2f5c-46f5-881d-d93c6f6f6190 req-c25f76d9-435d-4c4e-871b-ff55b81bf966 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:49.283026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b179dc8d-2f5c-46f5-881d-d93c6f6f6190 req-c25f76d9-435d-4c4e-871b-ff55b81bf966 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:49.304365 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-b179dc8d-2f5c-46f5-881d-d93c6f6f6190 req-c25f76d9-435d-4c4e-871b-ff55b81bf966 service nova] Creating event network-vif-plugged:aba73b64-257c-4090-8a10-377dba49c897 for instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 on n-h1-852084-5 Aug 27 02:32:49.313758 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-b179dc8d-2f5c-46f5-881d-d93c6f6f6190 req-c25f76d9-435d-4c4e-871b-ff55b81bf966 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087350 Aug 27 02:32:49.320159 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 542/1148] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:49.330560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:49.337045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:49.360245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:49.361115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:49.361800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:49.364230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:49.364739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:49.365568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:49.559105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:49.571047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Old instance type tempest-test_resize_flavor_-990657365, new instance type m1.heat {{(pid=122487) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 02:32:49.599028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:32:49.600755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:32:49.603957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:32:49.604715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:32:49.608133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:32:49.753835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2b135cad-ede0-479d-8c85-7755b59d0ebf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:49.844478 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2b135cad-ede0-479d-8c85-7755b59d0ebf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1360 microversion: 2.1 time: 0.798962 Aug 27 02:32:49.847015 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 607/1149] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:49 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1360 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:49.888726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8d40e922-6459-4eb7-8e1a-019ac694bb85 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:49.888931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8d40e922-6459-4eb7-8e1a-019ac694bb85 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:49.902800 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-233deb49-ff8a-4025-bad6-387754195725 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "POST /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481/action" status: 202 len: 0 microversion: 2.1 time: 0.580932 Aug 27 02:32:49.904359 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 543/1150] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:32:49 2022] POST /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:32:49.911417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ffa10fe9-a4c4-4af4-8a88-b1086b80e036 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a6d0dc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:49.935938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d40e922-6459-4eb7-8e1a-019ac694bb85 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:49.940818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d40e922-6459-4eb7-8e1a-019ac694bb85 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:49.942005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d40e922-6459-4eb7-8e1a-019ac694bb85 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:49.949540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d40e922-6459-4eb7-8e1a-019ac694bb85 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:49.959620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d40e922-6459-4eb7-8e1a-019ac694bb85 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:49.961795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d40e922-6459-4eb7-8e1a-019ac694bb85 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:50.076709 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ffa10fe9-a4c4-4af4-8a88-b1086b80e036 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.170242 Aug 27 02:32:50.081387 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 544/1151] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:49 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:50.119200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de15be49-56ab-44bd-83b9-7e856f8f3733 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:50.121973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de15be49-56ab-44bd-83b9-7e856f8f3733 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:50.159702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de15be49-56ab-44bd-83b9-7e856f8f3733 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:50.166800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de15be49-56ab-44bd-83b9-7e856f8f3733 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:50.167368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de15be49-56ab-44bd-83b9-7e856f8f3733 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:50.173813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de15be49-56ab-44bd-83b9-7e856f8f3733 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:50.178619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de15be49-56ab-44bd-83b9-7e856f8f3733 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:50.179096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de15be49-56ab-44bd-83b9-7e856f8f3733 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:50.646733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8d40e922-6459-4eb7-8e1a-019ac694bb85 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:50.661035 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8d40e922-6459-4eb7-8e1a-019ac694bb85 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1541 microversion: 2.1 time: 0.803773 Aug 27 02:32:50.682073 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 608/1152] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:49 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1541 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:50.687740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:50.688372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 29c60b22-adc1-4593-960e-85d2762eecfa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:50.721949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:50.723114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:50.723573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:50.725353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:50.728816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:50.729445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:50.766738 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] HTTP exception thrown: Instance 29c60b22-adc1-4593-960e-85d2762eecfa could not be found. Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Request method failure captured: Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa HTTP/1.1 Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFiArvb-rYskcF60VDeh9IGe-8fG5nqIDUYRfckRT-johkRp2z_dM5DggVNK5zoDjAQXVpOp36HYdY-OV-xYQOhdWaDrHKYhKly94j0zV2ewhh3lS2z4ZNwVaFWh2Sd6V60UKntl8nEVOEhVKPqUiUHLmt1Ki9j66HyMVaxACQEzaw Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}] Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 71bc8ccc9dc94a01ba39a4559f45ccce Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 29c60b22-adc1-4593-960e-85d2762eecfa could not be found. Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '29c60b22-adc1-4593-960e-85d2762eecfa'} Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29c60b22-adc1-4593-960e-85d2762eecfa could not be found. Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29c60b22-adc1-4593-960e-85d2762eecfa could not be found. Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:50.783363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:50.797038 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:50.797038 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:50.797038 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:50.797038 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:32:50.797038 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:32:50.797038 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29c60b22-adc1-4593-960e-85d2762eecfa could not be found. Aug 27 02:32:50.797038 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:50.799194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Returning 404 to user: Instance 29c60b22-adc1-4593-960e-85d2762eecfa could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:32:50.801406 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-40a67acf-6849-4977-a0fc-d28282fffdc8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa" status: 404 len: 111 microversion: 2.1 time: 0.117654 Aug 27 02:32:50.804885 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 609/1153] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:50 2022] GET /compute/v2.1/servers/29c60b22-adc1-4593-960e-85d2762eecfa => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:32:50.819046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6571dc49-35d5-426d-b765-5d25de58fc8f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:50.820679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6571dc49-35d5-426d-b765-5d25de58fc8f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:50.835513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571dc49-35d5-426d-b765-5d25de58fc8f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:50.837527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571dc49-35d5-426d-b765-5d25de58fc8f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:50.838990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571dc49-35d5-426d-b765-5d25de58fc8f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:50.841151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571dc49-35d5-426d-b765-5d25de58fc8f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:50.843116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571dc49-35d5-426d-b765-5d25de58fc8f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:50.844147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571dc49-35d5-426d-b765-5d25de58fc8f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:51.462310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de15be49-56ab-44bd-83b9-7e856f8f3733 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:51.475962 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de15be49-56ab-44bd-83b9-7e856f8f3733 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1538 microversion: 2.1 time: 1.392582 Aug 27 02:32:51.494769 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 545/1154] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:50 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1538 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:51.525660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5c2d3942-c1ac-45a7-8500-ef5f30f5014a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:51.526484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5c2d3942-c1ac-45a7-8500-ef5f30f5014a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:51.558435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2d3942-c1ac-45a7-8500-ef5f30f5014a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:51.558955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2d3942-c1ac-45a7-8500-ef5f30f5014a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:51.559408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2d3942-c1ac-45a7-8500-ef5f30f5014a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:51.561473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2d3942-c1ac-45a7-8500-ef5f30f5014a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:51.562318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2d3942-c1ac-45a7-8500-ef5f30f5014a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:51.562989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2d3942-c1ac-45a7-8500-ef5f30f5014a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:51.930878 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5c2d3942-c1ac-45a7-8500-ef5f30f5014a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.434604 Aug 27 02:32:51.931736 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 546/1155] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:32:51 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1/os-interface => generated 285 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:51.937376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7d167cd-dd1c-42ac-9514-7f1efe746688 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:51.938278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7d167cd-dd1c-42ac-9514-7f1efe746688 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:51.964334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d167cd-dd1c-42ac-9514-7f1efe746688 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:51.965004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d167cd-dd1c-42ac-9514-7f1efe746688 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:51.965567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d167cd-dd1c-42ac-9514-7f1efe746688 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:51.966507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d167cd-dd1c-42ac-9514-7f1efe746688 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:51.967105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d167cd-dd1c-42ac-9514-7f1efe746688 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:51.967840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d167cd-dd1c-42ac-9514-7f1efe746688 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:52.038234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7d167cd-dd1c-42ac-9514-7f1efe746688 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:32:52.042398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:32:52.229640 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7d167cd-dd1c-42ac-9514-7f1efe746688 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 204 len: 0 microversion: 2.1 time: 0.295772 Aug 27 02:32:52.231644 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 547/1156] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:32:51 2022] DELETE /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:32:52.240599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df9aede5-629a-4e3e-a980-174278249a35 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:52.242300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-df9aede5-629a-4e3e-a980-174278249a35 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:52.256764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df9aede5-629a-4e3e-a980-174278249a35 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:52.257619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df9aede5-629a-4e3e-a980-174278249a35 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:52.258420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df9aede5-629a-4e3e-a980-174278249a35 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:52.259140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df9aede5-629a-4e3e-a980-174278249a35 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:52.259857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df9aede5-629a-4e3e-a980-174278249a35 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:52.260542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df9aede5-629a-4e3e-a980-174278249a35 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:52.439278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6571dc49-35d5-426d-b765-5d25de58fc8f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:52.448876 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6571dc49-35d5-426d-b765-5d25de58fc8f tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1542 microversion: 2.1 time: 1.640532 Aug 27 02:32:52.451533 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 610/1157] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:50 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1542 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:52.459078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b2e97e1f-afcd-4134-8675-59f291eb74bc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a24b160>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:52.678665 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b2e97e1f-afcd-4134-8675-59f291eb74bc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.223601 Aug 27 02:32:52.682097 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 611/1158] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:52 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:52.697559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e94f1b6b-cb41-4ead-b643-6989f68aa666 req-a630f548-7c31-4af4-bad6-5a32b8c07bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ca656b0-e5d0-4749-87bd-c63080424cd0", "name": "network-vif-unplugged", "status": "completed", "tag": "223e9ede-b571-4dec-8f18-e6f0edf208cc"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:52.743071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e94f1b6b-cb41-4ead-b643-6989f68aa666 req-a630f548-7c31-4af4-bad6-5a32b8c07bc0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:52.745684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e94f1b6b-cb41-4ead-b643-6989f68aa666 req-a630f548-7c31-4af4-bad6-5a32b8c07bc0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:52.749322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e94f1b6b-cb41-4ead-b643-6989f68aa666 req-a630f548-7c31-4af4-bad6-5a32b8c07bc0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:52.786808 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e94f1b6b-cb41-4ead-b643-6989f68aa666 req-a630f548-7c31-4af4-bad6-5a32b8c07bc0 service nova] Creating event network-vif-unplugged:223e9ede-b571-4dec-8f18-e6f0edf208cc for instance 9ca656b0-e5d0-4749-87bd-c63080424cd0 on n-h1-852084-5 Aug 27 02:32:52.829632 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e94f1b6b-cb41-4ead-b643-6989f68aa666 req-a630f548-7c31-4af4-bad6-5a32b8c07bc0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145202 Aug 27 02:32:52.840727 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 612/1159] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:52.891677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-6dfed5c3-63d1-4be7-b647-f024a029f976 req-6b4013ba-15a5-4b15-abe2-253d7cfa099d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f105905c-eb08-4e79-9282-66e543fe5f7c", "name": "network-vif-deleted", "tag": "71d54b5e-fa1a-4a54-a257-b96b90b49a4a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:52.956159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6dfed5c3-63d1-4be7-b647-f024a029f976 req-6b4013ba-15a5-4b15-abe2-253d7cfa099d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:52.956651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6dfed5c3-63d1-4be7-b647-f024a029f976 req-6b4013ba-15a5-4b15-abe2-253d7cfa099d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:52.957093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6dfed5c3-63d1-4be7-b647-f024a029f976 req-6b4013ba-15a5-4b15-abe2-253d7cfa099d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:53.011507 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-6dfed5c3-63d1-4be7-b647-f024a029f976 req-6b4013ba-15a5-4b15-abe2-253d7cfa099d service nova] Creating event network-vif-deleted:71d54b5e-fa1a-4a54-a257-b96b90b49a4a for instance f105905c-eb08-4e79-9282-66e543fe5f7c on n-h1-852084-5 Aug 27 02:32:53.032784 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-6dfed5c3-63d1-4be7-b647-f024a029f976 req-6b4013ba-15a5-4b15-abe2-253d7cfa099d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183668 Aug 27 02:32:53.035252 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 613/1160] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:53.040366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-df9aede5-629a-4e3e-a980-174278249a35 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:53.051639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f76f72dd-1590-4926-a403-e73e64e56265 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:53.055052 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-df9aede5-629a-4e3e-a980-174278249a35 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1360 microversion: 2.1 time: 0.820641 Aug 27 02:32:53.055895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f76f72dd-1590-4926-a403-e73e64e56265 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:53.066686 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 548/1161] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:52 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1360 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:53.073640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-99055b3d-0951-46df-908f-b7397bead420 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:53.082671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-99055b3d-0951-46df-908f-b7397bead420 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:53.087177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f76f72dd-1590-4926-a403-e73e64e56265 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:53.087680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f76f72dd-1590-4926-a403-e73e64e56265 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:53.088123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f76f72dd-1590-4926-a403-e73e64e56265 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:53.088847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f76f72dd-1590-4926-a403-e73e64e56265 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:53.089299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f76f72dd-1590-4926-a403-e73e64e56265 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:53.107633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99055b3d-0951-46df-908f-b7397bead420 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:53.116995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f76f72dd-1590-4926-a403-e73e64e56265 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:53.118288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99055b3d-0951-46df-908f-b7397bead420 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:53.119030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99055b3d-0951-46df-908f-b7397bead420 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:53.120021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99055b3d-0951-46df-908f-b7397bead420 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:53.120675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99055b3d-0951-46df-908f-b7397bead420 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:53.121299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99055b3d-0951-46df-908f-b7397bead420 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:53.840390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f76f72dd-1590-4926-a403-e73e64e56265 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:53.865635 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f76f72dd-1590-4926-a403-e73e64e56265 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1472 microversion: 2.1 time: 0.828632 Aug 27 02:32:53.873584 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 614/1162] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:53 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1472 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:53.892215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:53.901855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:53.931923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:53.932513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:53.936977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:53.940365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:53.942518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:53.943209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:54.060997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:54.061539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:54.068416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:54.069092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lazy-loading 'fault' on Instance uuid f105905c-eb08-4e79-9282-66e543fe5f7c {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:32:54.249831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deea2ae0666b40f885daf40ad21e7c70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0bc60394fb46148212d366174c754d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:54.262434 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-63be2dfc-9f9a-462b-8c20-d358584d9d87 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 200 len: 1322 microversion: 2.1 time: 0.386700 Aug 27 02:32:54.263050 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 615/1163] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:53 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:54.276514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-80b9b99e-eaa3-460d-8fc3-273a3d651578 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a2425e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:54.451673 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-80b9b99e-eaa3-460d-8fc3-273a3d651578 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.187501 Aug 27 02:32:54.452328 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 616/1164] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:54 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:54.492022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6b24fa3-96db-4bba-ae1d-4403d0a8ba3d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:54.500281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a6b24fa3-96db-4bba-ae1d-4403d0a8ba3d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:54.537699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6b24fa3-96db-4bba-ae1d-4403d0a8ba3d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:54.538201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6b24fa3-96db-4bba-ae1d-4403d0a8ba3d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:54.538653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6b24fa3-96db-4bba-ae1d-4403d0a8ba3d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:54.563953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6b24fa3-96db-4bba-ae1d-4403d0a8ba3d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:54.564473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6b24fa3-96db-4bba-ae1d-4403d0a8ba3d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:54.564947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6b24fa3-96db-4bba-ae1d-4403d0a8ba3d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:55.141551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-99055b3d-0951-46df-908f-b7397bead420 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:55.169486 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-99055b3d-0951-46df-908f-b7397bead420 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1538 microversion: 2.1 time: 2.089940 Aug 27 02:32:55.187168 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 549/1165] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:53 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1538 bytes in 2119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:55.214632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0416bd1a-0a74-4fd4-a2fa-168bd54451cb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:55.222033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0416bd1a-0a74-4fd4-a2fa-168bd54451cb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:55.250334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0416bd1a-0a74-4fd4-a2fa-168bd54451cb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:55.257264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0416bd1a-0a74-4fd4-a2fa-168bd54451cb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:55.263331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0416bd1a-0a74-4fd4-a2fa-168bd54451cb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:55.267835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0416bd1a-0a74-4fd4-a2fa-168bd54451cb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:55.273445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0416bd1a-0a74-4fd4-a2fa-168bd54451cb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:55.273873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0416bd1a-0a74-4fd4-a2fa-168bd54451cb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:55.356157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a6b24fa3-96db-4bba-ae1d-4403d0a8ba3d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:55.378254 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6b24fa3-96db-4bba-ae1d-4403d0a8ba3d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1543 microversion: 2.1 time: 0.924798 Aug 27 02:32:55.379925 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 617/1166] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:54 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1543 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:55.393076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:55.393996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] [instance: f105905c-eb08-4e79-9282-66e543fe5f7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:55.421501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:55.422055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:55.422518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:55.423269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:55.423751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:55.424187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:55.482324 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] HTTP exception thrown: Instance f105905c-eb08-4e79-9282-66e543fe5f7c could not be found. Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Request method failure captured: Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c HTTP/1.1 Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYH2kFgCij8T23_cEXxaSwQeyrJGiJSMPB0cpGhQvJtXQA5-qDrgrB66r6UbM3sBBAn8c4rcDbq4hPknVpF7f6C4OVdCKUCt7zlq6eUaD1QSjB_woxzHb69RHRj6YgXe43zGvH-LJdV0tM26N1SCwqcu3epImyzVZ6h8c-jb-UBKP90 Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 7e0bc60394fb46148212d366174c754d Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7e0bc60394fb46148212d366174c754d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7e0bc60394fb46148212d366174c754d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7e0bc60394fb46148212d366174c754d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7e0bc60394fb46148212d366174c754d"}]}] Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 7e0bc60394fb46148212d366174c754d Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223 Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: deea2ae0666b40f885daf40ad21e7c70 Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance f105905c-eb08-4e79-9282-66e543fe5f7c could not be found. Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f105905c-eb08-4e79-9282-66e543fe5f7c'} Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f105905c-eb08-4e79-9282-66e543fe5f7c could not be found. Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f105905c-eb08-4e79-9282-66e543fe5f7c could not be found. Aug 27 02:32:55.484964 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:55.489737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:32:55.489737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:55.489737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:32:55.489737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:32:55.489737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:32:55.489737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:32:55.489737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:32:55.489737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f105905c-eb08-4e79-9282-66e543fe5f7c could not be found. Aug 27 02:32:55.489737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:32:55.498000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] Returning 404 to user: Instance f105905c-eb08-4e79-9282-66e543fe5f7c could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:32:55.499232 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-94fa9340-eb4f-426c-a59a-33740a603261 tempest-FloatingIPsAssociationNegativeTestJSON-781130223 tempest-FloatingIPsAssociationNegativeTestJSON-781130223-project] 10.222.0.99 "GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c" status: 404 len: 111 microversion: 2.1 time: 0.118091 Aug 27 02:32:55.500329 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 618/1167] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:55 2022] GET /compute/v2.1/servers/f105905c-eb08-4e79-9282-66e543fe5f7c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:32:55.505729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-861b03e9-90e5-442f-8298-2e42b7f1f4b3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:55.506183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-861b03e9-90e5-442f-8298-2e42b7f1f4b3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:55.533139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-861b03e9-90e5-442f-8298-2e42b7f1f4b3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:55.534095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-861b03e9-90e5-442f-8298-2e42b7f1f4b3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:55.534729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-861b03e9-90e5-442f-8298-2e42b7f1f4b3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:55.535657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-861b03e9-90e5-442f-8298-2e42b7f1f4b3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:55.536297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-861b03e9-90e5-442f-8298-2e42b7f1f4b3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:55.536896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-861b03e9-90e5-442f-8298-2e42b7f1f4b3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:55.961601 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-861b03e9-90e5-442f-8298-2e42b7f1f4b3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.459934 Aug 27 02:32:55.962734 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 619/1168] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:32:55 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-interface => generated 284 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:55.969368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7c297749-e5f8-4a66-afd3-2fe2426e5066 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a24b160>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:56.071789 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7c297749-e5f8-4a66-afd3-2fe2426e5066 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.107352 Aug 27 02:32:56.081172 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 620/1169] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:55 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:56.094987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a423a435-2848-4db3-86ea-8580a026b794 req-d396c2c8-0cd1-4e53-89b6-a33f354e5c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98f8456-cc9f-4772-97f1-99e056b99f79", "name": "network-vif-plugged", "status": "completed", "tag": "466460c2-b76b-42d7-9cd5-1eab0a9cd335"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:56.125662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a423a435-2848-4db3-86ea-8580a026b794 req-d396c2c8-0cd1-4e53-89b6-a33f354e5c1c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:56.126694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a423a435-2848-4db3-86ea-8580a026b794 req-d396c2c8-0cd1-4e53-89b6-a33f354e5c1c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:56.127373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a423a435-2848-4db3-86ea-8580a026b794 req-d396c2c8-0cd1-4e53-89b6-a33f354e5c1c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:56.170503 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a423a435-2848-4db3-86ea-8580a026b794 req-d396c2c8-0cd1-4e53-89b6-a33f354e5c1c service nova] Creating event network-vif-plugged:466460c2-b76b-42d7-9cd5-1eab0a9cd335 for instance f98f8456-cc9f-4772-97f1-99e056b99f79 on n-h1-852084-5 Aug 27 02:32:56.187816 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a423a435-2848-4db3-86ea-8580a026b794 req-d396c2c8-0cd1-4e53-89b6-a33f354e5c1c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104656 Aug 27 02:32:56.190103 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 621/1170] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:56.204584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c094dfcf-51f5-4774-899c-354a5832a723 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:56.206855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c094dfcf-51f5-4774-899c-354a5832a723 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:56.224130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c094dfcf-51f5-4774-899c-354a5832a723 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:56.224991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c094dfcf-51f5-4774-899c-354a5832a723 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:56.225735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c094dfcf-51f5-4774-899c-354a5832a723 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:56.227171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c094dfcf-51f5-4774-899c-354a5832a723 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:56.229483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c094dfcf-51f5-4774-899c-354a5832a723 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:56.231567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c094dfcf-51f5-4774-899c-354a5832a723 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:57.712789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0416bd1a-0a74-4fd4-a2fa-168bd54451cb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:57.735221 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0416bd1a-0a74-4fd4-a2fa-168bd54451cb tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1472 microversion: 2.1 time: 2.546628 Aug 27 02:32:57.735780 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 550/1171] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:55 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1472 bytes in 2548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:57.766043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1aefb6cd-0898-4157-8590-b4aa12240b34 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a60e1f0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:57.888921 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1aefb6cd-0898-4157-8590-b4aa12240b34 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.143457 Aug 27 02:32:57.902088 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 551/1172] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:32:57 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:58.276845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1110318663", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "fb40e9d4-9a6b-4f53-9e40-c59943eeffc8"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:58.477982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] validate_networks() for [('fb40e9d4-9a6b-4f53-9e40-c59943eeffc8', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:32:59.410042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c094dfcf-51f5-4774-899c-354a5832a723 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:32:59.423719 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c094dfcf-51f5-4774-899c-354a5832a723 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1538 microversion: 2.1 time: 3.231851 Aug 27 02:32:59.427659 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 622/1173] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:56 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1538 bytes in 3236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:32:59.443700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-34c2cf56-9142-45ac-a6de-002ebf7f5846 req-7c6b514d-c95e-4494-b6c0-34702d2bad90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769febc7-82dc-4fbb-8510-8c2ab56332a1", "tag": "097d06b1-e16f-4708-afe4-4d8903542c41"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:59.470062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-34c2cf56-9142-45ac-a6de-002ebf7f5846 req-7c6b514d-c95e-4494-b6c0-34702d2bad90 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:59.474519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-34c2cf56-9142-45ac-a6de-002ebf7f5846 req-7c6b514d-c95e-4494-b6c0-34702d2bad90 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:59.475247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-34c2cf56-9142-45ac-a6de-002ebf7f5846 req-7c6b514d-c95e-4494-b6c0-34702d2bad90 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:59.514646 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-34c2cf56-9142-45ac-a6de-002ebf7f5846 req-7c6b514d-c95e-4494-b6c0-34702d2bad90 service nova] Creating event network-changed:097d06b1-e16f-4708-afe4-4d8903542c41 for instance 769febc7-82dc-4fbb-8510-8c2ab56332a1 on n-h2-852084-5 Aug 27 02:32:59.534428 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-34c2cf56-9142-45ac-a6de-002ebf7f5846 req-7c6b514d-c95e-4494-b6c0-34702d2bad90 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104984 Aug 27 02:32:59.535827 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 623/1174] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:59.544391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9bf7ef7a-93ad-4105-99d3-709bd0b733e5 req-5e437dce-4d0c-4fdf-a64d-5bfc97bc0388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b45589e-4cb2-4409-9bcc-44f800e02517", "name": "network-vif-unplugged", "status": "completed", "tag": "5e58378f-a961-4b09-89d3-2349658075c1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:32:59.604927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9bf7ef7a-93ad-4105-99d3-709bd0b733e5 req-5e437dce-4d0c-4fdf-a64d-5bfc97bc0388 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:59.613443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9bf7ef7a-93ad-4105-99d3-709bd0b733e5 req-5e437dce-4d0c-4fdf-a64d-5bfc97bc0388 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:59.614345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9bf7ef7a-93ad-4105-99d3-709bd0b733e5 req-5e437dce-4d0c-4fdf-a64d-5bfc97bc0388 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:59.694717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:32:59.695923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:32:59.696686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:32:59.697292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:32:59.698124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:32:59.728785 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9bf7ef7a-93ad-4105-99d3-709bd0b733e5 req-5e437dce-4d0c-4fdf-a64d-5bfc97bc0388 service nova] Creating event network-vif-unplugged:5e58378f-a961-4b09-89d3-2349658075c1 for instance 4b45589e-4cb2-4409-9bcc-44f800e02517 on n-h2-852084-5 Aug 27 02:32:59.747889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:59.757023 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9bf7ef7a-93ad-4105-99d3-709bd0b733e5 req-5e437dce-4d0c-4fdf-a64d-5bfc97bc0388 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.219618 Aug 27 02:32:59.757342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:59.757713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:59.758372 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 624/1175] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:32:59.765232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:59.768822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:59.769394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:59.773006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:32:59.774115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:32:59.797505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:59.798059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:59.798508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:59.799244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:59.799708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:59.800142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:59.871125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Getting quotas for project 4d2da2e10e53450096a68048f98bd99a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:32:59.879726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:32:59.880228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:32:59.880674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:32:59.881691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lazy-loading 'fault' on Instance uuid 4b45589e-4cb2-4409-9bcc-44f800e02517 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:32:59.894507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Getting quotas for user 4cf03330b076434098eef9230222830e and project 4d2da2e10e53450096a68048f98bd99a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:32:59.936675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:32:59.942245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:33:00.013951 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0429e93f-f712-4ea1-981d-5e4c3a6de684 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.110169 Aug 27 02:33:00.016006 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 552/1176] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:32:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:33:00.032920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-942c40bb-c5ee-4d9c-80ac-6368b6c95e05 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a7ab5e0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:00.257340 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-942c40bb-c5ee-4d9c-80ac-6368b6c95e05 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.239874 Aug 27 02:33:00.269753 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 553/1177] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:00 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:00.284454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-16c755db-5471-43d5-980b-3fb3c1b89cb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:00.287324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-16c755db-5471-43d5-980b-3fb3c1b89cb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:00.490776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16c755db-5471-43d5-980b-3fb3c1b89cb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:00.502605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16c755db-5471-43d5-980b-3fb3c1b89cb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:00.504254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16c755db-5471-43d5-980b-3fb3c1b89cb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:00.505887 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-16c755db-5471-43d5-980b-3fb3c1b89cb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1262 microversion: 2.25 time: 0.232604 Aug 27 02:33:00.510780 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 554/1178] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:00 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1262 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:00.518543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8020ebc6-e512-4088-bd13-3e2d5ac1925d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:00.532266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8020ebc6-e512-4088-bd13-3e2d5ac1925d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:00.561819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8020ebc6-e512-4088-bd13-3e2d5ac1925d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:00.562594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8020ebc6-e512-4088-bd13-3e2d5ac1925d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:00.563052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8020ebc6-e512-4088-bd13-3e2d5ac1925d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:00.563809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8020ebc6-e512-4088-bd13-3e2d5ac1925d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:00.564599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8020ebc6-e512-4088-bd13-3e2d5ac1925d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:00.565053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8020ebc6-e512-4088-bd13-3e2d5ac1925d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:00.986786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8020ebc6-e512-4088-bd13-3e2d5ac1925d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:01.008401 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8020ebc6-e512-4088-bd13-3e2d5ac1925d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1538 microversion: 2.1 time: 0.495471 Aug 27 02:33:01.011528 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 555/1179] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:00 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1538 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:01.278647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-247127f9-f01d-45c9-b626-c63433be779a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2adef790>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:01.318133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:01.346452 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c066d9e2-2841-453c-afaa-a0fce8d44bec tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 200 len: 1307 microversion: 2.1 time: 1.584030 Aug 27 02:33:01.368737 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 625/1180] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:32:59 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 1307 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:01.375609 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-247127f9-f01d-45c9-b626-c63433be779a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.102161 Aug 27 02:33:01.410973 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 556/1181] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:01 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:01.566346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:01.568193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:01.587217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:01.587790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:01.588239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:01.589236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:01.590238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:01.591017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:01.739522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-98d781ac-6821-4202-a950-832313270e28 req-333c78f2-9556-4282-87e2-99543d5ccb98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b45589e-4cb2-4409-9bcc-44f800e02517", "name": "network-vif-deleted", "tag": "5e58378f-a961-4b09-89d3-2349658075c1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:01.802811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-98d781ac-6821-4202-a950-832313270e28 req-333c78f2-9556-4282-87e2-99543d5ccb98 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:01.803665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-98d781ac-6821-4202-a950-832313270e28 req-333c78f2-9556-4282-87e2-99543d5ccb98 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:01.804374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-98d781ac-6821-4202-a950-832313270e28 req-333c78f2-9556-4282-87e2-99543d5ccb98 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:01.828990 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-98d781ac-6821-4202-a950-832313270e28 req-333c78f2-9556-4282-87e2-99543d5ccb98 service nova] Creating event network-vif-deleted:5e58378f-a961-4b09-89d3-2349658075c1 for instance 4b45589e-4cb2-4409-9bcc-44f800e02517 on n-h2-852084-5 Aug 27 02:33:01.850418 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-98d781ac-6821-4202-a950-832313270e28 req-333c78f2-9556-4282-87e2-99543d5ccb98 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120699 Aug 27 02:33:01.851800 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 557/1182] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:02.023367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:02.037562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aba4e3c5-917c-49c4-af65-d6a210077f40 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:02.039467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aba4e3c5-917c-49c4-af65-d6a210077f40 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:02.059326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:02.069270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba4e3c5-917c-49c4-af65-d6a210077f40 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:02.070220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba4e3c5-917c-49c4-af65-d6a210077f40 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:02.071377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba4e3c5-917c-49c4-af65-d6a210077f40 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:02.071870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba4e3c5-917c-49c4-af65-d6a210077f40 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:02.072188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:02.077211 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-74e95d47-7bb8-4c97-b4db-e0c9f1282d5a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1258 microversion: 2.25 time: 0.526078 Aug 27 02:33:02.078322 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 626/1183] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:01 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1258 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:02.079028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba4e3c5-917c-49c4-af65-d6a210077f40 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:02.079888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba4e3c5-917c-49c4-af65-d6a210077f40 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:02.402468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:02.404070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 4b45589e-4cb2-4409-9bcc-44f800e02517] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:02.440729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:02.443342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:02.444317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:02.445341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:02.446241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:02.446911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:02.475233 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] HTTP exception thrown: Instance 4b45589e-4cb2-4409-9bcc-44f800e02517 could not be found. Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Request method failure captured: Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 HTTP/1.1 Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFiArvb-rYskcF60VDeh9IGe-8fG5nqIDUYRfckRT-johkRp2z_dM5DggVNK5zoDjAQXVpOp36HYdY-OV-xYQOhdWaDrHKYhKly94j0zV2ewhh3lS2z4ZNwVaFWh2Sd6V60UKntl8nEVOEhVKPqUiUHLmt1Ki9j66HyMVaxACQEzaw Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}] Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 71bc8ccc9dc94a01ba39a4559f45ccce Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 4b45589e-4cb2-4409-9bcc-44f800e02517 could not be found. Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4b45589e-4cb2-4409-9bcc-44f800e02517'} Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b45589e-4cb2-4409-9bcc-44f800e02517 could not be found. Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b45589e-4cb2-4409-9bcc-44f800e02517 could not be found. Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:02.506247 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:02.512993 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:02.512993 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:02.512993 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:02.512993 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:02.512993 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:02.512993 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b45589e-4cb2-4409-9bcc-44f800e02517 could not be found. Aug 27 02:33:02.512993 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:02.519912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Returning 404 to user: Instance 4b45589e-4cb2-4409-9bcc-44f800e02517 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:02.521390 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2350e36f-8524-444a-833a-9505c739df0c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517" status: 404 len: 111 microversion: 2.1 time: 0.129574 Aug 27 02:33:02.528204 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 627/1184] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:02 2022] GET /compute/v2.1/servers/4b45589e-4cb2-4409-9bcc-44f800e02517 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:33:02.537893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d490d56e-8242-49d4-9236-2ec99c5f82f9 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2b0b4550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:02.607055 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d490d56e-8242-49d4-9236-2ec99c5f82f9 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.076885 Aug 27 02:33:02.609207 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 628/1185] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:02 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:02.614594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fa192cb4-1308-4f61-920f-55c5a709f395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:02.615470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fa192cb4-1308-4f61-920f-55c5a709f395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:02.620644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-aba4e3c5-917c-49c4-af65-d6a210077f40 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:02.630945 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aba4e3c5-917c-49c4-af65-d6a210077f40 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1538 microversion: 2.1 time: 0.598901 Aug 27 02:33:02.634520 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 558/1186] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:02 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1538 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:02.636572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa192cb4-1308-4f61-920f-55c5a709f395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:02.637298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa192cb4-1308-4f61-920f-55c5a709f395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:02.637923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa192cb4-1308-4f61-920f-55c5a709f395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:02.639713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa192cb4-1308-4f61-920f-55c5a709f395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:02.640694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa192cb4-1308-4f61-920f-55c5a709f395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:02.641299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa192cb4-1308-4f61-920f-55c5a709f395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:02.676096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fa192cb4-1308-4f61-920f-55c5a709f395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:33:02.840442 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fa192cb4-1308-4f61-920f-55c5a709f395 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "DELETE /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 204 len: 0 microversion: 2.1 time: 0.229109 Aug 27 02:33:02.858930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-79ef4b6b-58de-45f6-a412-3b3417a91468 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:02.859280 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 629/1187] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:02 2022] DELETE /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:02.860820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-79ef4b6b-58de-45f6-a412-3b3417a91468 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:02.886996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79ef4b6b-58de-45f6-a412-3b3417a91468 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:02.891717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79ef4b6b-58de-45f6-a412-3b3417a91468 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:02.893320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79ef4b6b-58de-45f6-a412-3b3417a91468 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:02.894889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79ef4b6b-58de-45f6-a412-3b3417a91468 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:02.895842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79ef4b6b-58de-45f6-a412-3b3417a91468 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:02.896734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79ef4b6b-58de-45f6-a412-3b3417a91468 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:03.120324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:03.133783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:03.187621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:03.190742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:03.192949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:03.195939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:03.200188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:03.201504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:03.366514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-79ef4b6b-58de-45f6-a412-3b3417a91468 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:03.451841 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-79ef4b6b-58de-45f6-a412-3b3417a91468 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1472 microversion: 2.1 time: 0.602494 Aug 27 02:33:03.455707 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 559/1188] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:02 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1472 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:03.469349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d4db5479-96f7-4724-88fa-a2884efc7d40 req-396d7160-475c-4a62-ba9d-c265ef6812be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9500d4a-17ee-40b3-bc1c-77026234b7a3", "tag": "aba73b64-257c-4090-8a10-377dba49c897"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:03.532647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d4db5479-96f7-4724-88fa-a2884efc7d40 req-396d7160-475c-4a62-ba9d-c265ef6812be service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:03.536415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d4db5479-96f7-4724-88fa-a2884efc7d40 req-396d7160-475c-4a62-ba9d-c265ef6812be service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:03.539338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d4db5479-96f7-4724-88fa-a2884efc7d40 req-396d7160-475c-4a62-ba9d-c265ef6812be service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:03.616670 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d4db5479-96f7-4724-88fa-a2884efc7d40 req-396d7160-475c-4a62-ba9d-c265ef6812be service nova] Creating event network-changed:aba73b64-257c-4090-8a10-377dba49c897 for instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 on n-h1-852084-5 Aug 27 02:33:03.657392 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d4db5479-96f7-4724-88fa-a2884efc7d40 req-396d7160-475c-4a62-ba9d-c265ef6812be service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197232 Aug 27 02:33:03.664072 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 560/1189] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:03.682243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-247aab4f-cff1-4c4d-a6fa-4bc8e88241aa tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a5b6ca0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:03.865565 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-247aab4f-cff1-4c4d-a6fa-4bc8e88241aa tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.200069 Aug 27 02:33:03.866543 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 561/1190] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:03 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:03.902021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0fa92945-1e99-4e0a-90b8-a1af77bd3fe2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:03.903102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0fa92945-1e99-4e0a-90b8-a1af77bd3fe2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:03.913146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fa92945-1e99-4e0a-90b8-a1af77bd3fe2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:03.914055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fa92945-1e99-4e0a-90b8-a1af77bd3fe2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:03.919104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fa92945-1e99-4e0a-90b8-a1af77bd3fe2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:03.920150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fa92945-1e99-4e0a-90b8-a1af77bd3fe2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:03.920883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fa92945-1e99-4e0a-90b8-a1af77bd3fe2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:03.921527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fa92945-1e99-4e0a-90b8-a1af77bd3fe2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:04.089356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:04.095316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:04.126837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:04.137170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:04.145105 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7d4b402f-0fe6-4b8a-b9d0-eb98e48aa624 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1322 microversion: 2.25 time: 1.044472 Aug 27 02:33:04.148223 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 630/1191] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:03 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1322 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:04.493228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2a0294e9-8208-45e2-88ea-f0689e95ed09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:04.494336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2a0294e9-8208-45e2-88ea-f0689e95ed09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:04.516208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:04.526582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a0294e9-8208-45e2-88ea-f0689e95ed09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:04.527263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a0294e9-8208-45e2-88ea-f0689e95ed09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:04.527823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a0294e9-8208-45e2-88ea-f0689e95ed09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:04.529938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a0294e9-8208-45e2-88ea-f0689e95ed09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:04.533953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a0294e9-8208-45e2-88ea-f0689e95ed09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:04.536354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a0294e9-8208-45e2-88ea-f0689e95ed09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:04.925457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0fa92945-1e99-4e0a-90b8-a1af77bd3fe2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:04.943550 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0fa92945-1e99-4e0a-90b8-a1af77bd3fe2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1538 microversion: 2.1 time: 1.070945 Aug 27 02:33:04.944769 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 562/1192] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:03 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1538 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:04.968316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f24e6ece-8b57-4962-97b9-19095dd739c2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a710dc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:05.080406 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f24e6ece-8b57-4962-97b9-19095dd739c2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.133034 Aug 27 02:33:05.093725 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 563/1193] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:04 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:05.175447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:05.175978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:05.189517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:05.194698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:05.196634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:05.199891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:05.203874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:05.204592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:05.416491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2a0294e9-8208-45e2-88ea-f0689e95ed09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:05.429812 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2a0294e9-8208-45e2-88ea-f0689e95ed09 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1472 microversion: 2.1 time: 0.943312 Aug 27 02:33:05.430559 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 631/1194] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:04 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1472 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:05.625853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:05.635605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:05.637305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:05.638541 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-94c0d89c-1088-4823-aa40-dbdce7239fa3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1320 microversion: 2.25 time: 0.467981 Aug 27 02:33:05.664121 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 564/1195] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:05 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:05.971062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33eba3fb-a60c-41f5-b3af-bf34963c06d8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:05.971775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-33eba3fb-a60c-41f5-b3af-bf34963c06d8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:05.999413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33eba3fb-a60c-41f5-b3af-bf34963c06d8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:06.006261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33eba3fb-a60c-41f5-b3af-bf34963c06d8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:06.006739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33eba3fb-a60c-41f5-b3af-bf34963c06d8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:06.007543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33eba3fb-a60c-41f5-b3af-bf34963c06d8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:06.008039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33eba3fb-a60c-41f5-b3af-bf34963c06d8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:06.008478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33eba3fb-a60c-41f5-b3af-bf34963c06d8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:06.104466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb774ce3-a9ba-4114-9499-2db920800029 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a6e6820>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:06.170589 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bb774ce3-a9ba-4114-9499-2db920800029 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.070226 Aug 27 02:33:06.171184 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 565/1196] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:06 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:33:06.456830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b20d2752-ce97-4533-b8ae-bfb4d7090b08 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:06.457835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b20d2752-ce97-4533-b8ae-bfb4d7090b08 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:06.477986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b20d2752-ce97-4533-b8ae-bfb4d7090b08 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:06.486564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b20d2752-ce97-4533-b8ae-bfb4d7090b08 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:06.487523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b20d2752-ce97-4533-b8ae-bfb4d7090b08 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:06.491541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b20d2752-ce97-4533-b8ae-bfb4d7090b08 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:06.492431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b20d2752-ce97-4533-b8ae-bfb4d7090b08 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:06.493106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b20d2752-ce97-4533-b8ae-bfb4d7090b08 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:07.325759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b20d2752-ce97-4533-b8ae-bfb4d7090b08 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:07.375722 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b20d2752-ce97-4533-b8ae-bfb4d7090b08 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1472 microversion: 2.1 time: 0.902948 Aug 27 02:33:07.385274 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 566/1197] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:06 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1472 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:07.434566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:07.434566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:07.477748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:07.480359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:07.483470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:07.487337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:07.520876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:07.522145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:07.870737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-33eba3fb-a60c-41f5-b3af-bf34963c06d8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:07.880433 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-33eba3fb-a60c-41f5-b3af-bf34963c06d8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1543 microversion: 2.1 time: 1.916022 Aug 27 02:33:07.903529 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 632/1198] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:05 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1543 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:07.916187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-01b8ed5b-1cf6-4f87-982a-80bc9445c460 req-b055b9f7-9fd3-4c99-9c90-0025a1e29c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0f3c97-a84f-4dfb-b8e9-971677ca6a05", "name": "network-vif-unplugged", "status": "completed", "tag": "12f54338-d142-4e94-a50c-aec96be98412"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:07.977909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-01b8ed5b-1cf6-4f87-982a-80bc9445c460 req-b055b9f7-9fd3-4c99-9c90-0025a1e29c61 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:07.983755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-01b8ed5b-1cf6-4f87-982a-80bc9445c460 req-b055b9f7-9fd3-4c99-9c90-0025a1e29c61 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:07.993213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-01b8ed5b-1cf6-4f87-982a-80bc9445c460 req-b055b9f7-9fd3-4c99-9c90-0025a1e29c61 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:08.026891 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-01b8ed5b-1cf6-4f87-982a-80bc9445c460 req-b055b9f7-9fd3-4c99-9c90-0025a1e29c61 service nova] Creating event network-vif-unplugged:12f54338-d142-4e94-a50c-aec96be98412 for instance aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 on n-h2-852084-5 Aug 27 02:33:08.044134 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-01b8ed5b-1cf6-4f87-982a-80bc9445c460 req-b055b9f7-9fd3-4c99-9c90-0025a1e29c61 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135399 Aug 27 02:33:08.052482 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 633/1199] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:08.068526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0b1630f6-4c5c-4799-981c-a952fe218e72 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a423940>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:08.239538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:08.251422 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0b1630f6-4c5c-4799-981c-a952fe218e72 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.196642 Aug 27 02:33:08.252043 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 634/1200] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:08 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:08.280268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f8cce29b-288b-46f3-8b75-28da8de75d2e req-faada24e-258f-4204-8240-1611a44d0fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0f3c97-a84f-4dfb-b8e9-971677ca6a05", "name": "network-vif-deleted", "tag": "12f54338-d142-4e94-a50c-aec96be98412"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:08.325456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:08.326113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f8cce29b-288b-46f3-8b75-28da8de75d2e req-faada24e-258f-4204-8240-1611a44d0fc3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:08.335894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f8cce29b-288b-46f3-8b75-28da8de75d2e req-faada24e-258f-4204-8240-1611a44d0fc3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:08.336468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f8cce29b-288b-46f3-8b75-28da8de75d2e req-faada24e-258f-4204-8240-1611a44d0fc3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:08.343395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:08.350282 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f80c7f2e-8bc7-42ad-8755-553da26be108 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1362 microversion: 2.25 time: 0.958364 Aug 27 02:33:08.356824 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 567/1201] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:07 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1362 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:08.391123 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f8cce29b-288b-46f3-8b75-28da8de75d2e req-faada24e-258f-4204-8240-1611a44d0fc3 service nova] Creating event network-vif-deleted:12f54338-d142-4e94-a50c-aec96be98412 for instance aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 on n-h2-852084-5 Aug 27 02:33:08.405838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:08.407323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:08.420798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:08.422058 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f8cce29b-288b-46f3-8b75-28da8de75d2e req-faada24e-258f-4204-8240-1611a44d0fc3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160860 Aug 27 02:33:08.422755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:08.423775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:08.425284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:08.426731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:08.427284 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 635/1202] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:08.428075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:08.498931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:08.500322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:08.501561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:08.502401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lazy-loading 'fault' on Instance uuid aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:33:08.579038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:08.598739 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-385a979c-2252-41cb-8949-e5e25a436993 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 200 len: 1306 microversion: 2.1 time: 0.200936 Aug 27 02:33:08.614550 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 568/1203] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:08 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:08.912749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d5907a53-e5f8-401f-b626-6b108db147c3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:08.914178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d5907a53-e5f8-401f-b626-6b108db147c3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:08.930540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5907a53-e5f8-401f-b626-6b108db147c3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:08.931324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5907a53-e5f8-401f-b626-6b108db147c3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:08.932013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5907a53-e5f8-401f-b626-6b108db147c3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:08.933029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5907a53-e5f8-401f-b626-6b108db147c3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:08.933714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5907a53-e5f8-401f-b626-6b108db147c3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:08.934317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5907a53-e5f8-401f-b626-6b108db147c3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:09.394576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-814626677", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "23353bbf-e842-43a8-bc88-47e11f42520f"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:09.473237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:09.614425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d5907a53-e5f8-401f-b626-6b108db147c3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:09.725865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] validate_networks() for [('23353bbf-e842-43a8-bc88-47e11f42520f', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:33:09.730575 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d5907a53-e5f8-401f-b626-6b108db147c3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1543 microversion: 2.1 time: 0.816243 Aug 27 02:33:09.739724 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 636/1204] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:08 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1543 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:09.771511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-146507c1-f134-4cab-9f1c-6849ceddd702 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a24b5e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:09.822439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:09.908664 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-146507c1-f134-4cab-9f1c-6849ceddd702 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.161065 Aug 27 02:33:09.918439 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 637/1205] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:09 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:09.932971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:09.946717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:09.975491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:09.976364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:09.977534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:09.978588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:09.979290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:09.979928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:10.405521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:10.423479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:10.427604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:10.432967 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b08842d1-e117-4c64-a32b-747335b9eddc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1362 microversion: 2.25 time: 0.512386 Aug 27 02:33:10.436518 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 638/1206] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:09 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1362 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:10.449024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:10.462442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: aa0f3c97-a84f-4dfb-b8e9-971677ca6a05] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:10.494827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:10.507957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:10.507957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:10.507957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:10.507957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:10.507957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:10.508811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:10.543355 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] HTTP exception thrown: Instance aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 could not be found. Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Request method failure captured: Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 HTTP/1.1 Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFiArvb-rYskcF60VDeh9IGe-8fG5nqIDUYRfckRT-johkRp2z_dM5DggVNK5zoDjAQXVpOp36HYdY-OV-xYQOhdWaDrHKYhKly94j0zV2ewhh3lS2z4ZNwVaFWh2Sd6V60UKntl8nEVOEhVKPqUiUHLmt1Ki9j66HyMVaxACQEzaw Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}] Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 71bc8ccc9dc94a01ba39a4559f45ccce Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 could not be found. Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'aa0f3c97-a84f-4dfb-b8e9-971677ca6a05'} Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 could not be found. Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 could not be found. Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:10.548512 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:10.556153 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:10.556153 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:10.556153 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:10.556153 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:10.556153 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:10.556153 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 could not be found. Aug 27 02:33:10.556153 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:10.556153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Returning 404 to user: Instance aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:10.556153 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-26f1c623-894c-404b-a0d1-ae337a48d050 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05" status: 404 len: 111 microversion: 2.1 time: 0.107300 Aug 27 02:33:10.562480 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 639/1207] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:10 2022] GET /compute/v2.1/servers/aa0f3c97-a84f-4dfb-b8e9-971677ca6a05 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:33:10.574244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ab032dcf-507a-4ec5-b1b8-e296f39de6dd req-58d46103-8dfd-4c77-b155-7c472ee410bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93453131-995a-46d6-848d-ec13cb596c67", "tag": "22fd1df6-6d25-4d2d-a30d-bb3482bb2130"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:10.631603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ab032dcf-507a-4ec5-b1b8-e296f39de6dd req-58d46103-8dfd-4c77-b155-7c472ee410bb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:10.633014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ab032dcf-507a-4ec5-b1b8-e296f39de6dd req-58d46103-8dfd-4c77-b155-7c472ee410bb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:10.635350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ab032dcf-507a-4ec5-b1b8-e296f39de6dd req-58d46103-8dfd-4c77-b155-7c472ee410bb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:10.681567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ab032dcf-507a-4ec5-b1b8-e296f39de6dd req-58d46103-8dfd-4c77-b155-7c472ee410bb service nova] Creating event network-changed:22fd1df6-6d25-4d2d-a30d-bb3482bb2130 for instance 93453131-995a-46d6-848d-ec13cb596c67 on n-h1-852084-5 Aug 27 02:33:10.694164 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ab032dcf-507a-4ec5-b1b8-e296f39de6dd req-58d46103-8dfd-4c77-b155-7c472ee410bb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133824 Aug 27 02:33:10.699408 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 640/1208] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:10.723289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cc0f2b3e-d8e2-4a2c-ae56-9b8956ad4c4e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:10.724839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cc0f2b3e-d8e2-4a2c-ae56-9b8956ad4c4e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 5fb58870-9a8e-4554-9db9-3324b90798bd] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:10.752388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc0f2b3e-d8e2-4a2c-ae56-9b8956ad4c4e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:10.755218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc0f2b3e-d8e2-4a2c-ae56-9b8956ad4c4e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:10.755721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc0f2b3e-d8e2-4a2c-ae56-9b8956ad4c4e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:10.756501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc0f2b3e-d8e2-4a2c-ae56-9b8956ad4c4e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:10.757128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc0f2b3e-d8e2-4a2c-ae56-9b8956ad4c4e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:10.757573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc0f2b3e-d8e2-4a2c-ae56-9b8956ad4c4e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:10.827811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cc0f2b3e-d8e2-4a2c-ae56-9b8956ad4c4e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 5fb58870-9a8e-4554-9db9-3324b90798bd] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:33:11.055460 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cc0f2b3e-d8e2-4a2c-ae56-9b8956ad4c4e tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd" status: 204 len: 0 microversion: 2.1 time: 0.353314 Aug 27 02:33:11.056202 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 641/1209] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:10 2022] DELETE /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:11.068962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-41763257-cc88-457d-8b37-1e2a95895b56 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:11.074775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-41763257-cc88-457d-8b37-1e2a95895b56 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:11.090782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41763257-cc88-457d-8b37-1e2a95895b56 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:11.094613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41763257-cc88-457d-8b37-1e2a95895b56 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:11.095382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41763257-cc88-457d-8b37-1e2a95895b56 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:11.096349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41763257-cc88-457d-8b37-1e2a95895b56 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:11.098355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41763257-cc88-457d-8b37-1e2a95895b56 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:11.099143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41763257-cc88-457d-8b37-1e2a95895b56 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:11.556229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-41763257-cc88-457d-8b37-1e2a95895b56 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:11.581998 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-41763257-cc88-457d-8b37-1e2a95895b56 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1543 microversion: 2.1 time: 0.520257 Aug 27 02:33:11.602107 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 642/1210] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:11 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1543 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:11.609089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c127f73b-5c88-4b91-b1b1-fbb110ce026d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a279160>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:11.827372 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c127f73b-5c88-4b91-b1b1-fbb110ce026d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.223218 Aug 27 02:33:11.837721 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 643/1211] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:11 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:11.843642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-64911197-534b-40f9-9e15-4eea4d6aef69 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:11.855512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-64911197-534b-40f9-9e15-4eea4d6aef69 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:11.863240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64911197-534b-40f9-9e15-4eea4d6aef69 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:11.865396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64911197-534b-40f9-9e15-4eea4d6aef69 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:11.868231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64911197-534b-40f9-9e15-4eea4d6aef69 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:11.869440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64911197-534b-40f9-9e15-4eea4d6aef69 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:11.871417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64911197-534b-40f9-9e15-4eea4d6aef69 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:11.872154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64911197-534b-40f9-9e15-4eea4d6aef69 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:12.031899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-64911197-534b-40f9-9e15-4eea4d6aef69 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:33:12.238615 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-64911197-534b-40f9-9e15-4eea4d6aef69 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 204 len: 0 microversion: 2.1 time: 0.398193 Aug 27 02:33:12.242094 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 644/1212] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:11 2022] DELETE /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:12.265092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:12.267145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:12.300006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:12.300831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:12.304154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:12.307044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:12.313177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:12.316918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:12.614521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:33:12.615550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:33:12.616363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:33:12.617269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:33:12.618156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:33:12.650036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:12.650906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:12.651672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:12.653037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:12.655573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:12.664631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:12.726866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Getting quotas for project a71a3b49da754429843aadfc5d96a539. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:12.756433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Getting quotas for user a2e317f0944745418758a9bec7064613 and project a71a3b49da754429843aadfc5d96a539. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:12.816613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:33:12.820744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:33:13.045797 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f0c88029-1c48-4fba-a124-dc212ee25ffe tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.853394 Aug 27 02:33:13.069804 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 569/1213] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:33:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:33:13.093635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:13.096894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a37422d7-5a3b-4305-a560-f2d3085093b4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:13.102582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a37422d7-5a3b-4305-a560-f2d3085093b4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 5fb58870-9a8e-4554-9db9-3324b90798bd] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:13.117399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:13.126953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:13.128374 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dfd95f91-ecfe-4784-b4b6-4cf34c624368 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1362 microversion: 2.25 time: 0.883561 Aug 27 02:33:13.128977 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 645/1214] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:12 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1362 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:13.163705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c6dfcc8f-0a8c-4076-8e8d-a4ee7acefa59 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:13.166527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6dfcc8f-0a8c-4076-8e8d-a4ee7acefa59 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:13.184961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a37422d7-5a3b-4305-a560-f2d3085093b4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:13.185801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a37422d7-5a3b-4305-a560-f2d3085093b4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:13.186569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a37422d7-5a3b-4305-a560-f2d3085093b4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:13.194791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6dfcc8f-0a8c-4076-8e8d-a4ee7acefa59 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:13.195497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6dfcc8f-0a8c-4076-8e8d-a4ee7acefa59 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:13.196340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6dfcc8f-0a8c-4076-8e8d-a4ee7acefa59 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:13.197175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6dfcc8f-0a8c-4076-8e8d-a4ee7acefa59 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:13.198049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6dfcc8f-0a8c-4076-8e8d-a4ee7acefa59 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:13.198660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6dfcc8f-0a8c-4076-8e8d-a4ee7acefa59 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:13.206147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a37422d7-5a3b-4305-a560-f2d3085093b4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:13.207413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a37422d7-5a3b-4305-a560-f2d3085093b4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:13.208426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a37422d7-5a3b-4305-a560-f2d3085093b4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:14.960663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a37422d7-5a3b-4305-a560-f2d3085093b4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:14.975367 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a37422d7-5a3b-4305-a560-f2d3085093b4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd" status: 200 len: 1474 microversion: 2.1 time: 1.899176 Aug 27 02:33:14.979339 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 570/1215] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:13 2022] GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd => generated 1474 bytes in 1909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:15.017765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7bb4d217-8b3b-4488-8d92-5e297260186f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a60e280>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:15.035174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c6dfcc8f-0a8c-4076-8e8d-a4ee7acefa59 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:15.079409 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c6dfcc8f-0a8c-4076-8e8d-a4ee7acefa59 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1542 microversion: 2.1 time: 1.940841 Aug 27 02:33:15.084431 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 646/1216] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:13 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1542 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:15.125137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e0b08dfc-ec02-4c50-ae5f-7c24529e34ae tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:15.130345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e0b08dfc-ec02-4c50-ae5f-7c24529e34ae tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:15.160704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0b08dfc-ec02-4c50-ae5f-7c24529e34ae tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:15.161573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0b08dfc-ec02-4c50-ae5f-7c24529e34ae tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:15.170754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0b08dfc-ec02-4c50-ae5f-7c24529e34ae tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:15.171946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0b08dfc-ec02-4c50-ae5f-7c24529e34ae tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:15.172733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0b08dfc-ec02-4c50-ae5f-7c24529e34ae tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:15.173426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0b08dfc-ec02-4c50-ae5f-7c24529e34ae tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:15.215602 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7bb4d217-8b3b-4488-8d92-5e297260186f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.230221 Aug 27 02:33:15.229931 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 571/1217] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:14 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:15.244741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:15.249132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:15.291192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:15.292297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:15.293974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:15.297026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:15.298531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:15.300558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:16.078504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:16.093607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:16.100980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:16.105172 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b474d0c3-2541-49d3-b66b-bc9470dfb49a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1362 microversion: 2.25 time: 0.872649 Aug 27 02:33:16.106055 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 572/1218] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:15 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1362 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:16.119745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6e773e64-804a-44cc-a52c-c30e7578f4a0 req-85126c0c-4bf8-4adf-8ea3-0683cbe30523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde6f25d-de52-4758-85c7-ce0b8471e481", "name": "network-vif-unplugged", "status": "completed", "tag": "5250e113-81ca-45c6-a466-ef24aace16e6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:16.144025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6e773e64-804a-44cc-a52c-c30e7578f4a0 req-85126c0c-4bf8-4adf-8ea3-0683cbe30523 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:16.144793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6e773e64-804a-44cc-a52c-c30e7578f4a0 req-85126c0c-4bf8-4adf-8ea3-0683cbe30523 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:16.145402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6e773e64-804a-44cc-a52c-c30e7578f4a0 req-85126c0c-4bf8-4adf-8ea3-0683cbe30523 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:16.155232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:16.182850 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6e773e64-804a-44cc-a52c-c30e7578f4a0 req-85126c0c-4bf8-4adf-8ea3-0683cbe30523 service nova] Creating event network-vif-unplugged:5250e113-81ca-45c6-a466-ef24aace16e6 for instance fde6f25d-de52-4758-85c7-ce0b8471e481 on n-h1-852084-5 Aug 27 02:33:16.214384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-6e773e64-804a-44cc-a52c-c30e7578f4a0 req-85126c0c-4bf8-4adf-8ea3-0683cbe30523 service nova] Instance fde6f25d-de52-4758-85c7-ce0b8471e481 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:33:16.242606 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6e773e64-804a-44cc-a52c-c30e7578f4a0 req-85126c0c-4bf8-4adf-8ea3-0683cbe30523 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130546 Aug 27 02:33:16.246639 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 573/1219] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:16.259468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1b8892bf-e566-4454-9c63-cf21224299b8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:16.260232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b8892bf-e566-4454-9c63-cf21224299b8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 5fb58870-9a8e-4554-9db9-3324b90798bd] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:16.282363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8892bf-e566-4454-9c63-cf21224299b8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:16.283347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8892bf-e566-4454-9c63-cf21224299b8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:16.286032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8892bf-e566-4454-9c63-cf21224299b8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:16.287068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8892bf-e566-4454-9c63-cf21224299b8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:16.291830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8892bf-e566-4454-9c63-cf21224299b8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:16.292644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8892bf-e566-4454-9c63-cf21224299b8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:16.454068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1b8892bf-e566-4454-9c63-cf21224299b8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:16.479607 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1b8892bf-e566-4454-9c63-cf21224299b8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd" status: 200 len: 1432 microversion: 2.1 time: 0.231381 Aug 27 02:33:16.480571 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 574/1220] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:16 2022] GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd => generated 1432 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:16.487640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c8991181-035a-407e-9acc-494e83b8bdb2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:16.491923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c8991181-035a-407e-9acc-494e83b8bdb2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:16.503989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8991181-035a-407e-9acc-494e83b8bdb2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:16.514505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8991181-035a-407e-9acc-494e83b8bdb2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:16.515159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8991181-035a-407e-9acc-494e83b8bdb2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:16.517155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8991181-035a-407e-9acc-494e83b8bdb2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:16.517972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8991181-035a-407e-9acc-494e83b8bdb2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:16.518629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8991181-035a-407e-9acc-494e83b8bdb2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:16.825781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e0b08dfc-ec02-4c50-ae5f-7c24529e34ae tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:16.842379 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e0b08dfc-ec02-4c50-ae5f-7c24529e34ae tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1268 microversion: 2.1 time: 1.752014 Aug 27 02:33:16.843229 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 647/1221] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:15 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1268 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:16.861634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e208b9fc-8ed8-4bda-8b2d-f87f6aef7014 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a61d8b0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:17.038850 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e208b9fc-8ed8-4bda-8b2d-f87f6aef7014 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.183717 Aug 27 02:33:17.044684 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 648/1222] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:16 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:17.161647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:17.162443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:17.180009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:17.181038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:17.181912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:17.183195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:17.184409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:17.198492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:17.772924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:17.801433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:17.807059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:17.808298 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-02ca7db8-a93a-497d-8658-23e5cedde1c4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1362 microversion: 2.25 time: 0.654143 Aug 27 02:33:17.813294 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 649/1223] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:17 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1362 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:17.824476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c2291e68-dcbd-4064-98ef-a1fb0016c1a0 req-258b5266-309b-4f97-b52b-d179700829ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64c1c4e-361d-4e27-93e7-7f3e474f8b77", "name": "network-vif-deleted", "tag": "3f4d5112-f091-40ec-9ce1-c24927fb8be5"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:17.856161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c2291e68-dcbd-4064-98ef-a1fb0016c1a0 req-258b5266-309b-4f97-b52b-d179700829ea service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:17.858688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c2291e68-dcbd-4064-98ef-a1fb0016c1a0 req-258b5266-309b-4f97-b52b-d179700829ea service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:17.859677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c2291e68-dcbd-4064-98ef-a1fb0016c1a0 req-258b5266-309b-4f97-b52b-d179700829ea service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:17.889895 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c2291e68-dcbd-4064-98ef-a1fb0016c1a0 req-258b5266-309b-4f97-b52b-d179700829ea service nova] Creating event network-vif-deleted:3f4d5112-f091-40ec-9ce1-c24927fb8be5 for instance a64c1c4e-361d-4e27-93e7-7f3e474f8b77 on n-h2-852084-5 Aug 27 02:33:17.897488 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c2291e68-dcbd-4064-98ef-a1fb0016c1a0 req-258b5266-309b-4f97-b52b-d179700829ea service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082230 Aug 27 02:33:17.903693 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 650/1224] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:17.912232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:17.912955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 5fb58870-9a8e-4554-9db9-3324b90798bd] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:17.933380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:17.933958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:17.937352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:17.937553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c8991181-035a-407e-9acc-494e83b8bdb2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:17.940086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:17.941971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:17.943878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:17.959241 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c8991181-035a-407e-9acc-494e83b8bdb2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1542 microversion: 2.1 time: 1.475583 Aug 27 02:33:17.971384 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 575/1225] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:16 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1542 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:17.993710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:18.002899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-55f26d7d-3737-4392-9924-26d592b0fedb tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:18.003880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-55f26d7d-3737-4392-9924-26d592b0fedb tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:18.020066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f26d7d-3737-4392-9924-26d592b0fedb tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:18.020728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f26d7d-3737-4392-9924-26d592b0fedb tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:18.021182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f26d7d-3737-4392-9924-26d592b0fedb tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:18.032827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f26d7d-3737-4392-9924-26d592b0fedb tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:18.033726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f26d7d-3737-4392-9924-26d592b0fedb tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:18.034378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f26d7d-3737-4392-9924-26d592b0fedb tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:18.081197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:18.082018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:18.082685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:18.103844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lazy-loading 'fault' on Instance uuid 5fb58870-9a8e-4554-9db9-3324b90798bd {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:33:18.338648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:18.362252 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-452da47a-d17f-4f4c-9202-ff212c967b98 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd" status: 200 len: 1308 microversion: 2.1 time: 0.455441 Aug 27 02:33:18.371822 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 651/1226] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:17 2022] GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:18.386700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e7f1207e-990b-4abe-b620-a62195dc2f8a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a1b7c10>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:18.546088 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e7f1207e-990b-4abe-b620-a62195dc2f8a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.171153 Aug 27 02:33:18.546698 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 652/1227] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:18 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:18.558626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d1f03d49-d01c-4103-8eb0-b7d94ddb8cd4 req-a932dc37-f0cd-42b4-aeae-c7304e84e9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb58870-9a8e-4554-9db9-3324b90798bd", "name": "network-vif-deleted", "tag": "20a61385-68a9-4de4-a5d6-a37c714f8b9e"}, {"name": "network-changed", "server_uuid": "fde6f25d-de52-4758-85c7-ce0b8471e481", "tag": "5250e113-81ca-45c6-a466-ef24aace16e6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:18.580726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d1f03d49-d01c-4103-8eb0-b7d94ddb8cd4 req-a932dc37-f0cd-42b4-aeae-c7304e84e9ca service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:18.581956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d1f03d49-d01c-4103-8eb0-b7d94ddb8cd4 req-a932dc37-f0cd-42b4-aeae-c7304e84e9ca service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:18.584432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d1f03d49-d01c-4103-8eb0-b7d94ddb8cd4 req-a932dc37-f0cd-42b4-aeae-c7304e84e9ca service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:18.631411 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d1f03d49-d01c-4103-8eb0-b7d94ddb8cd4 req-a932dc37-f0cd-42b4-aeae-c7304e84e9ca service nova] Creating event network-vif-deleted:20a61385-68a9-4de4-a5d6-a37c714f8b9e for instance 5fb58870-9a8e-4554-9db9-3324b90798bd on n-h1-852084-5 Aug 27 02:33:18.632551 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d1f03d49-d01c-4103-8eb0-b7d94ddb8cd4 req-a932dc37-f0cd-42b4-aeae-c7304e84e9ca service nova] Creating event network-changed:5250e113-81ca-45c6-a466-ef24aace16e6 for instance fde6f25d-de52-4758-85c7-ce0b8471e481 on n-h1-852084-5 Aug 27 02:33:18.656707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-d1f03d49-d01c-4103-8eb0-b7d94ddb8cd4 req-a932dc37-f0cd-42b4-aeae-c7304e84e9ca service nova] Instance fde6f25d-de52-4758-85c7-ce0b8471e481 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:33:18.688139 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d1f03d49-d01c-4103-8eb0-b7d94ddb8cd4 req-a932dc37-f0cd-42b4-aeae-c7304e84e9ca service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.137851 Aug 27 02:33:18.694088 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 653/1228] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:18.792586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-55f26d7d-3737-4392-9924-26d592b0fedb tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:18.801747 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-55f26d7d-3737-4392-9924-26d592b0fedb tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1274 microversion: 2.1 time: 0.829075 Aug 27 02:33:18.802366 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 576/1229] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:17 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1274 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:18.856352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:18.858360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:18.868903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:18.869423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:18.870109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:18.871084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:18.871572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:18.872018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:18.990712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92ee3582-6aaf-436f-971f-ddce40b09ee2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:18.990712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-92ee3582-6aaf-436f-971f-ddce40b09ee2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:19.002671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92ee3582-6aaf-436f-971f-ddce40b09ee2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:19.003203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92ee3582-6aaf-436f-971f-ddce40b09ee2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:19.007821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92ee3582-6aaf-436f-971f-ddce40b09ee2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:19.008651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92ee3582-6aaf-436f-971f-ddce40b09ee2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:19.009160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92ee3582-6aaf-436f-971f-ddce40b09ee2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:19.011270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92ee3582-6aaf-436f-971f-ddce40b09ee2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:19.351995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-92ee3582-6aaf-436f-971f-ddce40b09ee2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:19.389389 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-92ee3582-6aaf-436f-971f-ddce40b09ee2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1542 microversion: 2.1 time: 0.400702 Aug 27 02:33:19.393018 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 577/1230] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:18 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1542 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:19.414075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:19.431027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 5fb58870-9a8e-4554-9db9-3324b90798bd] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:19.441509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:19.442329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:19.443023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:19.444203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:19.445037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:19.445824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:19.502535 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] HTTP exception thrown: Instance 5fb58870-9a8e-4554-9db9-3324b90798bd could not be found. Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Request method failure captured: Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd HTTP/1.1 Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFiArvb-rYskcF60VDeh9IGe-8fG5nqIDUYRfckRT-johkRp2z_dM5DggVNK5zoDjAQXVpOp36HYdY-OV-xYQOhdWaDrHKYhKly94j0zV2ewhh3lS2z4ZNwVaFWh2Sd6V60UKntl8nEVOEhVKPqUiUHLmt1Ki9j66HyMVaxACQEzaw Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}] Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 71bc8ccc9dc94a01ba39a4559f45ccce Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 5fb58870-9a8e-4554-9db9-3324b90798bd could not be found. Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5fb58870-9a8e-4554-9db9-3324b90798bd'} Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb58870-9a8e-4554-9db9-3324b90798bd could not be found. Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb58870-9a8e-4554-9db9-3324b90798bd could not be found. Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:19.519033 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:19.527605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:19.527605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:19.527605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:19.527605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:19.527605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:19.527605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb58870-9a8e-4554-9db9-3324b90798bd could not be found. Aug 27 02:33:19.527605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:19.530003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Returning 404 to user: Instance 5fb58870-9a8e-4554-9db9-3324b90798bd could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:19.536018 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da25e77b-8f70-4663-b641-371695e0b899 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd" status: 404 len: 111 microversion: 2.1 time: 0.138003 Aug 27 02:33:19.539279 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 578/1231] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:19 2022] GET /compute/v2.1/servers/5fb58870-9a8e-4554-9db9-3324b90798bd => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:33:19.565050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:19.574119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:19.575858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: a64c1c4e-361d-4e27-93e7-7f3e474f8b77] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:19.610127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:19.614612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:19.618062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:19.623702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:19.624986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:19.628074 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d145702a-0a22-42cd-9c9d-4504d0035ec3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1362 microversion: 2.25 time: 0.776588 Aug 27 02:33:19.634679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:19.635892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:19.637320 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 654/1232] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:18 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1362 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:19.639267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:19.667998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1f5d439a-acaf-4d96-86ba-5ad6e7015241 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a1c0d30>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:19.741031 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] HTTP exception thrown: Instance a64c1c4e-361d-4e27-93e7-7f3e474f8b77 could not be found. Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Request method failure captured: Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 HTTP/1.1 Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFiArvb-rYskcF60VDeh9IGe-8fG5nqIDUYRfckRT-johkRp2z_dM5DggVNK5zoDjAQXVpOp36HYdY-OV-xYQOhdWaDrHKYhKly94j0zV2ewhh3lS2z4ZNwVaFWh2Sd6V60UKntl8nEVOEhVKPqUiUHLmt1Ki9j66HyMVaxACQEzaw Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}] Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 71bc8ccc9dc94a01ba39a4559f45ccce Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance a64c1c4e-361d-4e27-93e7-7f3e474f8b77 could not be found. Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'a64c1c4e-361d-4e27-93e7-7f3e474f8b77'} Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a64c1c4e-361d-4e27-93e7-7f3e474f8b77 could not be found. Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a64c1c4e-361d-4e27-93e7-7f3e474f8b77 could not be found. Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:19.754088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:19.770775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:19.770775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:19.770775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:19.770775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:19.770775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:19.770775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a64c1c4e-361d-4e27-93e7-7f3e474f8b77 could not be found. Aug 27 02:33:19.770775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:19.770775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Returning 404 to user: Instance a64c1c4e-361d-4e27-93e7-7f3e474f8b77 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:19.770775 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f3d09090-6faf-4711-8a90-270714d33b55 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77" status: 404 len: 111 microversion: 2.1 time: 0.226419 Aug 27 02:33:19.791715 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 579/1233] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:19 2022] GET /compute/v2.1/servers/a64c1c4e-361d-4e27-93e7-7f3e474f8b77 => generated 111 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:33:19.816217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4aedadb5-6aa3-414c-8d00-2d11c24e5d3c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:19.823080 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1f5d439a-acaf-4d96-86ba-5ad6e7015241 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.181664 Aug 27 02:33:19.841417 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 655/1234] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:19 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:19.864462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e0f46667-a009-4036-8a80-50c441c63742 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:19.867044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e0f46667-a009-4036-8a80-50c441c63742 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:19.888909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0f46667-a009-4036-8a80-50c441c63742 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:19.896084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0f46667-a009-4036-8a80-50c441c63742 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:19.897553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0f46667-a009-4036-8a80-50c441c63742 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:19.902807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0f46667-a009-4036-8a80-50c441c63742 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:19.903878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0f46667-a009-4036-8a80-50c441c63742 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:19.905837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0f46667-a009-4036-8a80-50c441c63742 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:19.953191 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4aedadb5-6aa3-414c-8d00-2d11c24e5d3c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/c9136a8f-16ae-4a04-9612-afce26a32373" status: 204 len: 0 microversion: 2.1 time: 0.155911 Aug 27 02:33:19.962513 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 580/1235] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:33:19 2022] DELETE /compute/v2.1/os-server-groups/c9136a8f-16ae-4a04-9612-afce26a32373 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:33:19.993711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7a7a622-124d-4e7b-8125-cd3bbc0a2af1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:19.994756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c7a7a622-124d-4e7b-8125-cd3bbc0a2af1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:20.014053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7a7a622-124d-4e7b-8125-cd3bbc0a2af1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:20.020678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7a7a622-124d-4e7b-8125-cd3bbc0a2af1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:20.021832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7a7a622-124d-4e7b-8125-cd3bbc0a2af1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:20.026143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7a7a622-124d-4e7b-8125-cd3bbc0a2af1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:20.026819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7a7a622-124d-4e7b-8125-cd3bbc0a2af1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:20.031564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7a7a622-124d-4e7b-8125-cd3bbc0a2af1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:20.092450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c7a7a622-124d-4e7b-8125-cd3bbc0a2af1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:33:20.219504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e0f46667-a009-4036-8a80-50c441c63742 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:20.253153 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e0f46667-a009-4036-8a80-50c441c63742 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1274 microversion: 2.1 time: 0.408236 Aug 27 02:33:20.256784 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 656/1236] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:19 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1274 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:20.320234 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c7a7a622-124d-4e7b-8125-cd3bbc0a2af1 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856" status: 204 len: 0 microversion: 2.1 time: 0.350952 Aug 27 02:33:20.324438 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 581/1237] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:19 2022] DELETE /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:20.337354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-20284487-3ccc-477d-94e3-0a62854214d4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:20.338587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-20284487-3ccc-477d-94e3-0a62854214d4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:20.360113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20284487-3ccc-477d-94e3-0a62854214d4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:20.367913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20284487-3ccc-477d-94e3-0a62854214d4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:20.369072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20284487-3ccc-477d-94e3-0a62854214d4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:20.378440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20284487-3ccc-477d-94e3-0a62854214d4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:20.379647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20284487-3ccc-477d-94e3-0a62854214d4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:20.380647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20284487-3ccc-477d-94e3-0a62854214d4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:20.415047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2ec75f2-6c17-4ba7-971a-f07fd3c84d20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:20.416138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c2ec75f2-6c17-4ba7-971a-f07fd3c84d20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:20.432084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ec75f2-6c17-4ba7-971a-f07fd3c84d20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:20.434568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ec75f2-6c17-4ba7-971a-f07fd3c84d20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:20.436591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ec75f2-6c17-4ba7-971a-f07fd3c84d20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:20.440739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ec75f2-6c17-4ba7-971a-f07fd3c84d20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:20.441502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ec75f2-6c17-4ba7-971a-f07fd3c84d20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:20.442169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ec75f2-6c17-4ba7-971a-f07fd3c84d20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:20.449106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-20284487-3ccc-477d-94e3-0a62854214d4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:33:20.634536 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-20284487-3ccc-477d-94e3-0a62854214d4 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "DELETE /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 204 len: 0 microversion: 2.1 time: 0.303569 Aug 27 02:33:20.636458 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 657/1238] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:20 2022] DELETE /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:20.650047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-75b4655c-89cf-4b9b-9372-d82fbf33811b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:20.651953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-75b4655c-89cf-4b9b-9372-d82fbf33811b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:20.662987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75b4655c-89cf-4b9b-9372-d82fbf33811b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:20.663212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75b4655c-89cf-4b9b-9372-d82fbf33811b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:20.664652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75b4655c-89cf-4b9b-9372-d82fbf33811b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:20.665735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75b4655c-89cf-4b9b-9372-d82fbf33811b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:20.666637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75b4655c-89cf-4b9b-9372-d82fbf33811b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:20.667154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75b4655c-89cf-4b9b-9372-d82fbf33811b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:20.986729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-75b4655c-89cf-4b9b-9372-d82fbf33811b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:20.996078 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-75b4655c-89cf-4b9b-9372-d82fbf33811b tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856" status: 200 len: 1474 microversion: 2.1 time: 0.353439 Aug 27 02:33:21.011349 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 658/1239] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:20 2022] GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856 => generated 1474 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:21.017993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:21.018901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:21.026710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:21.027514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:21.028250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:21.029228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:21.029950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:21.030688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:21.163684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c2ec75f2-6c17-4ba7-971a-f07fd3c84d20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:21.179905 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c2ec75f2-6c17-4ba7-971a-f07fd3c84d20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1542 microversion: 2.1 time: 0.769043 Aug 27 02:33:21.198229 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 582/1240] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:20 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1542 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:33:21.211438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e90f2403-8107-4cff-8b88-fbcce1e3cb2f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a5b6700>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:21.265918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:21.296684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:21.299278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:21.308144 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2b24dbc5-36db-4735-8ba9-68c70b7cc3a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1362 microversion: 2.25 time: 0.295555 Aug 27 02:33:21.309526 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 659/1241] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:21 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:21.320976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0057caed-d00a-4159-8e21-8a3913017e30 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:21.322244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0057caed-d00a-4159-8e21-8a3913017e30 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:21.339489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0057caed-d00a-4159-8e21-8a3913017e30 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:21.345903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0057caed-d00a-4159-8e21-8a3913017e30 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:21.345903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0057caed-d00a-4159-8e21-8a3913017e30 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:21.345903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0057caed-d00a-4159-8e21-8a3913017e30 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:21.345903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0057caed-d00a-4159-8e21-8a3913017e30 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:21.348255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0057caed-d00a-4159-8e21-8a3913017e30 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:21.683895 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e90f2403-8107-4cff-8b88-fbcce1e3cb2f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.483812 Aug 27 02:33:21.690777 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 583/1242] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:21 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:21.706614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a6f21b9a-cc85-4dd1-984a-50fd840816ae tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Calling method '.version_select at 0x7f4d2a5cfaf0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:21.776589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0057caed-d00a-4159-8e21-8a3913017e30 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:21.802746 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0057caed-d00a-4159-8e21-8a3913017e30 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1316 microversion: 2.1 time: 0.490588 Aug 27 02:33:21.804636 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 660/1243] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:21 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:21.836583 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a6f21b9a-cc85-4dd1-984a-50fd840816ae tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c" status: 200 len: 636 microversion: 2.1 time: 0.141904 Aug 27 02:33:21.852466 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 584/1244] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:21 2022] GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c => generated 636 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:21.866469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-203b08c9-88ff-4d47-9a6e-f88c9a87e6da tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Action: 'update_all', calling method: .version_select at 0x7f4d2a4313a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:21.969692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-203b08c9-88ff-4d47-9a6e-f88c9a87e6da tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:21.982869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-203b08c9-88ff-4d47-9a6e-f88c9a87e6da tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for user f4871f8ff6a84626abced54caba8d607 and project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:22.025563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a378310b-cd85-44bb-b67e-ec79d44332bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:22.028237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a378310b-cd85-44bb-b67e-ec79d44332bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:22.041736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a378310b-cd85-44bb-b67e-ec79d44332bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:22.043000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a378310b-cd85-44bb-b67e-ec79d44332bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:22.044035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a378310b-cd85-44bb-b67e-ec79d44332bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:22.046207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a378310b-cd85-44bb-b67e-ec79d44332bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:22.047460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a378310b-cd85-44bb-b67e-ec79d44332bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:22.056074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a378310b-cd85-44bb-b67e-ec79d44332bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:22.698203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:22.791920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a378310b-cd85-44bb-b67e-ec79d44332bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:22.824381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:22.829764 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a378310b-cd85-44bb-b67e-ec79d44332bd tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856" status: 200 len: 1474 microversion: 2.1 time: 0.814447 Aug 27 02:33:22.831430 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 585/1245] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:22 2022] GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856 => generated 1474 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:22.846607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7a708425-f407-4380-b1e5-2fb599177ae3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:22.847294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7a708425-f407-4380-b1e5-2fb599177ae3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:22.885366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a708425-f407-4380-b1e5-2fb599177ae3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:22.886243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a708425-f407-4380-b1e5-2fb599177ae3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:22.887015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a708425-f407-4380-b1e5-2fb599177ae3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:22.895301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a708425-f407-4380-b1e5-2fb599177ae3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:22.895926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a708425-f407-4380-b1e5-2fb599177ae3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:22.896377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a708425-f407-4380-b1e5-2fb599177ae3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:22.952472 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-203b08c9-88ff-4d47-9a6e-f88c9a87e6da tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 61 microversion: 2.1 time: 1.091757 Aug 27 02:33:22.957731 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 661/1246] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:33:21 2022] PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 61 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:22.964636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:22.974928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:23.000804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:23.001741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:23.002525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:23.003817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:23.004655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:23.005463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:23.284683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:23.296966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:23.299489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:23.301236 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2f45109-4399-4d01-b26a-14ec17d73df5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1362 microversion: 2.25 time: 0.345769 Aug 27 02:33:23.302159 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 662/1247] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:22 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:23.307838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-399e3e75-c534-475f-bbe2-bb9d30891c3f req-f377856e-1e18-4c88-ac40-fae811946a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93453131-995a-46d6-848d-ec13cb596c67", "name": "network-vif-plugged", "status": "completed", "tag": "22fd1df6-6d25-4d2d-a30d-bb3482bb2130"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:23.321810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-399e3e75-c534-475f-bbe2-bb9d30891c3f req-f377856e-1e18-4c88-ac40-fae811946a9b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:23.322716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-399e3e75-c534-475f-bbe2-bb9d30891c3f req-f377856e-1e18-4c88-ac40-fae811946a9b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:23.336214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-399e3e75-c534-475f-bbe2-bb9d30891c3f req-f377856e-1e18-4c88-ac40-fae811946a9b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:23.353392 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-399e3e75-c534-475f-bbe2-bb9d30891c3f req-f377856e-1e18-4c88-ac40-fae811946a9b service nova] Creating event network-vif-plugged:22fd1df6-6d25-4d2d-a30d-bb3482bb2130 for instance 93453131-995a-46d6-848d-ec13cb596c67 on n-h1-852084-5 Aug 27 02:33:23.359524 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-399e3e75-c534-475f-bbe2-bb9d30891c3f req-f377856e-1e18-4c88-ac40-fae811946a9b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055471 Aug 27 02:33:23.366487 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 663/1248] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:23.373875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e21cebd6-2b9d-475a-a573-a5182dc410d8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a423c10>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:23.445543 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e21cebd6-2b9d-475a-a573-a5182dc410d8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1455 microversion: 2.1 time: 0.077118 Aug 27 02:33:23.453930 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 664/1249] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:23 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:23.461027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f81e6b72-47db-4486-b308-a4cc57d0b39e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:23.462446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f81e6b72-47db-4486-b308-a4cc57d0b39e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:23.471446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81e6b72-47db-4486-b308-a4cc57d0b39e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:23.471942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81e6b72-47db-4486-b308-a4cc57d0b39e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:23.472757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81e6b72-47db-4486-b308-a4cc57d0b39e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:23.473655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81e6b72-47db-4486-b308-a4cc57d0b39e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:23.474167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81e6b72-47db-4486-b308-a4cc57d0b39e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:23.474651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81e6b72-47db-4486-b308-a4cc57d0b39e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:23.534886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7a708425-f407-4380-b1e5-2fb599177ae3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:23.564051 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7a708425-f407-4380-b1e5-2fb599177ae3 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1542 microversion: 2.1 time: 0.730639 Aug 27 02:33:23.565391 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 586/1250] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:22 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1542 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:23.584615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da6c6c19-09a5-4c54-b0a7-5760b3bf9c7c tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Calling method '.version_select at 0x7f4d2a6d0dc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:23.854379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f81e6b72-47db-4486-b308-a4cc57d0b39e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:23.867482 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f81e6b72-47db-4486-b308-a4cc57d0b39e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1316 microversion: 2.1 time: 0.411605 Aug 27 02:33:23.882272 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 665/1251] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:23 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:23.889856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7b203872-3e03-446d-bc02-60e3340ac634 req-f684e107-a0b5-4338-8906-bd35e06f9d4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f011f2b-bbd2-4dfb-8dda-1942eec66691", "tag": "338e8e88-1a8d-4cd1-bcf2-aaa6ac3816e8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:23.904280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7b203872-3e03-446d-bc02-60e3340ac634 req-f684e107-a0b5-4338-8906-bd35e06f9d4e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:23.914118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7b203872-3e03-446d-bc02-60e3340ac634 req-f684e107-a0b5-4338-8906-bd35e06f9d4e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:23.914842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7b203872-3e03-446d-bc02-60e3340ac634 req-f684e107-a0b5-4338-8906-bd35e06f9d4e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:23.931756 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7b203872-3e03-446d-bc02-60e3340ac634 req-f684e107-a0b5-4338-8906-bd35e06f9d4e service nova] Creating event network-changed:338e8e88-1a8d-4cd1-bcf2-aaa6ac3816e8 for instance 4f011f2b-bbd2-4dfb-8dda-1942eec66691 on n-h2-852084-5 Aug 27 02:33:23.938668 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7b203872-3e03-446d-bc02-60e3340ac634 req-f684e107-a0b5-4338-8906-bd35e06f9d4e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054627 Aug 27 02:33:23.940106 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 666/1252] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:23.946200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd702da0-1a56-4f6a-adb5-7622f8528ac6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:23.947349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd702da0-1a56-4f6a-adb5-7622f8528ac6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:23.956960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd702da0-1a56-4f6a-adb5-7622f8528ac6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:23.958196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd702da0-1a56-4f6a-adb5-7622f8528ac6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:23.959040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd702da0-1a56-4f6a-adb5-7622f8528ac6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:23.960033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd702da0-1a56-4f6a-adb5-7622f8528ac6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:23.960772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd702da0-1a56-4f6a-adb5-7622f8528ac6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:23.961462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd702da0-1a56-4f6a-adb5-7622f8528ac6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:24.219044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd702da0-1a56-4f6a-adb5-7622f8528ac6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:24.231724 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd702da0-1a56-4f6a-adb5-7622f8528ac6 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856" status: 200 len: 1474 microversion: 2.1 time: 0.290098 Aug 27 02:33:24.235297 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da6c6c19-09a5-4c54-b0a7-5760b3bf9c7c tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "DELETE /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.660133 Aug 27 02:33:24.236308 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 587/1253] 10.222.0.99 () {58 vars in 1296 bytes} [Sat Aug 27 02:33:23 2022] DELETE /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata/os_version => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:24.247226 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 667/1254] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:23 2022] GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856 => generated 1474 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:24.250018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92c053ca-a8cf-4842-976d-9fa7ac2e4f48 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Calling method '.version_select at 0x7f4d2a5c61f0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:24.302707 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-92c053ca-a8cf-4842-976d-9fa7ac2e4f48 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.060290 Aug 27 02:33:24.303671 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 588/1255] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:33:24 2022] GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 37 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:24.318025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad7551d6-c319-49f7-a434-d29f45b39310 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Action: 'update_all', calling method: .version_select at 0x7f4d2a1d24c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:24.326187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:24.327174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:24.338476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:24.339011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:24.339655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:24.340567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:24.341210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:24.341894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:24.399077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-ad7551d6-c319-49f7-a434-d29f45b39310 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:24.406688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-ad7551d6-c319-49f7-a434-d29f45b39310 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for user f4871f8ff6a84626abced54caba8d607 and project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:24.539665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:24.550977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:24.552457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:24.553618 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0d1f2f13-e2f1-4ea9-a26b-f53def8a0d87 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1362 microversion: 2.25 time: 0.232457 Aug 27 02:33:24.554223 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 589/1256] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:24 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:33:24.561858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d36b07a5-14d8-4205-a9cf-b88a64fd7562 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a60e280>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:24.639402 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d36b07a5-14d8-4205-a9cf-b88a64fd7562 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1464 microversion: 2.1 time: 0.083448 Aug 27 02:33:24.640114 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 590/1257] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:24 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1464 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:24.646037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bbefcb7f-1959-4a78-af89-719f4eb3491b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:24.647835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bbefcb7f-1959-4a78-af89-719f4eb3491b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:24.655208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbefcb7f-1959-4a78-af89-719f4eb3491b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:24.655704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbefcb7f-1959-4a78-af89-719f4eb3491b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:24.656156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbefcb7f-1959-4a78-af89-719f4eb3491b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:24.657049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbefcb7f-1959-4a78-af89-719f4eb3491b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:24.657922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbefcb7f-1959-4a78-af89-719f4eb3491b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:24.658644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbefcb7f-1959-4a78-af89-719f4eb3491b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:24.773337 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad7551d6-c319-49f7-a434-d29f45b39310 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.460651 Aug 27 02:33:24.773979 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 668/1258] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:33:24 2022] PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 61 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:24.779830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ba4b90b-be3e-4864-8f5a-c196dff1e8d6 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a23c9d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:24.829570 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ba4b90b-be3e-4864-8f5a-c196dff1e8d6 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 200 len: 1464 microversion: 2.1 time: 0.054491 Aug 27 02:33:24.830237 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 669/1259] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:24 2022] GET /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 1464 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:24.835108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-60b93932-104b-4658-828f-8b44c7e8b0c8 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Calling method '.version_select at 0x7f4d2a2425e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:24.854830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bbefcb7f-1959-4a78-af89-719f4eb3491b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:24.864249 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bbefcb7f-1959-4a78-af89-719f4eb3491b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1474 microversion: 2.1 time: 0.222724 Aug 27 02:33:24.864846 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 591/1260] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:24 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1474 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:24.869763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bdd17257-3d76-4416-bd4e-050c519bcc14 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:24.870375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bdd17257-3d76-4416-bd4e-050c519bcc14 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:24.877490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdd17257-3d76-4416-bd4e-050c519bcc14 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:24.878238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdd17257-3d76-4416-bd4e-050c519bcc14 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:24.878663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdd17257-3d76-4416-bd4e-050c519bcc14 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:24.879579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdd17257-3d76-4416-bd4e-050c519bcc14 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:24.880043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdd17257-3d76-4416-bd4e-050c519bcc14 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:24.880468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bdd17257-3d76-4416-bd4e-050c519bcc14 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:24.890427 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-60b93932-104b-4658-828f-8b44c7e8b0c8 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.058975 Aug 27 02:33:24.891047 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 670/1261] 10.222.0.99 () {58 vars in 1290 bytes} [Sat Aug 27 02:33:24 2022] GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata/os_distro => generated 33 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:24.897514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-40d1323d-9cc0-402d-8ff7-023c99e2020c tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:24.897514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-40d1323d-9cc0-402d-8ff7-023c99e2020c tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:24.902971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d1323d-9cc0-402d-8ff7-023c99e2020c tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:24.903512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d1323d-9cc0-402d-8ff7-023c99e2020c tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:24.904181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d1323d-9cc0-402d-8ff7-023c99e2020c tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:24.904908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d1323d-9cc0-402d-8ff7-023c99e2020c tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:24.905367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d1323d-9cc0-402d-8ff7-023c99e2020c tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:24.905843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40d1323d-9cc0-402d-8ff7-023c99e2020c tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:25.043978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bdd17257-3d76-4416-bd4e-050c519bcc14 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:25.052879 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bdd17257-3d76-4416-bd4e-050c519bcc14 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79" status: 200 len: 1479 microversion: 2.1 time: 0.186959 Aug 27 02:33:25.053602 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 592/1262] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:24 2022] GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 1479 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:25.070518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-934aeb67-3f6a-4c70-823e-bfcf140eac4e tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Action: 'update_all', calling method: .version_select at 0x7f4d2a6e6b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:25.071897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-40d1323d-9cc0-402d-8ff7-023c99e2020c tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:25.085843 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-40d1323d-9cc0-402d-8ff7-023c99e2020c tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1316 microversion: 2.1 time: 0.193625 Aug 27 02:33:25.086554 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 671/1263] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:24 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:25.139435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-934aeb67-3f6a-4c70-823e-bfcf140eac4e tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:25.145316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-934aeb67-3f6a-4c70-823e-bfcf140eac4e tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for user f4871f8ff6a84626abced54caba8d607 and project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:25.264525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1270e352-e361-4dbc-ac38-6d5c93e3c225 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:25.268818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1270e352-e361-4dbc-ac38-6d5c93e3c225 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:25.298122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1270e352-e361-4dbc-ac38-6d5c93e3c225 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:25.299368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1270e352-e361-4dbc-ac38-6d5c93e3c225 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:25.303504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1270e352-e361-4dbc-ac38-6d5c93e3c225 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:25.305589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1270e352-e361-4dbc-ac38-6d5c93e3c225 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:25.315499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1270e352-e361-4dbc-ac38-6d5c93e3c225 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:25.316299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1270e352-e361-4dbc-ac38-6d5c93e3c225 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:25.334922 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-934aeb67-3f6a-4c70-823e-bfcf140eac4e tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.270030 Aug 27 02:33:25.341951 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 593/1264] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:33:25 2022] PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 61 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:25.347420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b5daa666-3771-41af-81dc-b1bedb746e8e tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Calling method '.version_select at 0x7f4d2a6e6820>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:25.423122 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b5daa666-3771-41af-81dc-b1bedb746e8e tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.079459 Aug 27 02:33:25.424717 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 594/1265] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:33:25 2022] GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 61 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:25.436806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2061a384-95d3-47d9-bbfa-2236e8af65df tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Action: 'update_all', calling method: .version_select at 0x7f4d2a71f9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:25.503267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2061a384-95d3-47d9-bbfa-2236e8af65df tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:25.511041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2061a384-95d3-47d9-bbfa-2236e8af65df tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for user f4871f8ff6a84626abced54caba8d607 and project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:25.565845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1270e352-e361-4dbc-ac38-6d5c93e3c225 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:25.575234 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1270e352-e361-4dbc-ac38-6d5c93e3c225 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856" status: 200 len: 1474 microversion: 2.1 time: 0.322513 Aug 27 02:33:25.581582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 672/1266] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:25 2022] GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856 => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:25.601095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:25.602720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:25.614719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:25.615649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:25.616692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:25.618126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:25.618968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:25.619735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:25.758488 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2061a384-95d3-47d9-bbfa-2236e8af65df tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.325780 Aug 27 02:33:25.761738 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 595/1267] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:33:25 2022] PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 61 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:25.770878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c14fb2b-1b87-4d34-937e-945d901ef60a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Action: 'update_all', calling method: .version_select at 0x7f4d2a6e6f70>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:25.880812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4c14fb2b-1b87-4d34-937e-945d901ef60a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:25.891067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4c14fb2b-1b87-4d34-937e-945d901ef60a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for user f4871f8ff6a84626abced54caba8d607 and project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:25.897577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:25.921475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:25.925617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:25.929391 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1e2930ae-3d48-488b-bc23-ba5574f783b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1362 microversion: 2.25 time: 0.342903 Aug 27 02:33:25.931178 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 673/1268] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:25 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:25.943856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5ef80be-9d1c-4c83-b99b-bc84fd0f0705 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:25.947477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e5ef80be-9d1c-4c83-b99b-bc84fd0f0705 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:25.954300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:25.963685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5ef80be-9d1c-4c83-b99b-bc84fd0f0705 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:25.965107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5ef80be-9d1c-4c83-b99b-bc84fd0f0705 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:25.966196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5ef80be-9d1c-4c83-b99b-bc84fd0f0705 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:25.969122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5ef80be-9d1c-4c83-b99b-bc84fd0f0705 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:25.970528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5ef80be-9d1c-4c83-b99b-bc84fd0f0705 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:25.971906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5ef80be-9d1c-4c83-b99b-bc84fd0f0705 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:26.304220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e5ef80be-9d1c-4c83-b99b-bc84fd0f0705 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:26.307411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:26.320355 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e5ef80be-9d1c-4c83-b99b-bc84fd0f0705 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1474 microversion: 2.1 time: 0.386140 Aug 27 02:33:26.321407 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 674/1269] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:25 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1474 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:26.327016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-004e0dfe-51ca-4f6f-aa66-0d6f85301e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:26.329078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-004e0dfe-51ca-4f6f-aa66-0d6f85301e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:26.342569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-004e0dfe-51ca-4f6f-aa66-0d6f85301e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:26.343852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-004e0dfe-51ca-4f6f-aa66-0d6f85301e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:26.351974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-004e0dfe-51ca-4f6f-aa66-0d6f85301e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:26.353576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-004e0dfe-51ca-4f6f-aa66-0d6f85301e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:26.354509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-004e0dfe-51ca-4f6f-aa66-0d6f85301e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:26.356341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-004e0dfe-51ca-4f6f-aa66-0d6f85301e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:26.398272 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4c14fb2b-1b87-4d34-937e-945d901ef60a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.631901 Aug 27 02:33:26.400257 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 596/1270] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:33:25 2022] PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 64 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:26.409969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b3bfc95-43c8-4d42-ad80-db1da513ef39 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:26.411712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b3bfc95-43c8-4d42-ad80-db1da513ef39 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:26.423852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b3bfc95-43c8-4d42-ad80-db1da513ef39 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:26.425882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b3bfc95-43c8-4d42-ad80-db1da513ef39 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:26.427106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b3bfc95-43c8-4d42-ad80-db1da513ef39 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:26.428527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b3bfc95-43c8-4d42-ad80-db1da513ef39 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:26.429611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b3bfc95-43c8-4d42-ad80-db1da513ef39 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:26.430598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b3bfc95-43c8-4d42-ad80-db1da513ef39 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:26.557724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-004e0dfe-51ca-4f6f-aa66-0d6f85301e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:26.582433 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-004e0dfe-51ca-4f6f-aa66-0d6f85301e25 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79" status: 200 len: 1466 microversion: 2.1 time: 0.259224 Aug 27 02:33:26.583671 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 675/1271] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:26 2022] GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 1466 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:26.594800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d84dca91-d55c-4a39-bc93-5902121cf0b9 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Calling method '.version_select at 0x7f4d2a1d2040>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:26.689973 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d84dca91-d55c-4a39-bc93-5902121cf0b9 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.103948 Aug 27 02:33:26.691055 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 676/1272] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:33:26 2022] GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 64 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:26.708309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c7548577-cadc-4b10-a1c0-9f1d671bec99 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a1d2a60>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:26.970689 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c7548577-cadc-4b10-a1c0-9f1d671bec99 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images?changes-since=2022-08-27T02%3A30%3A49Z" status: 200 len: 1904 microversion: 2.1 time: 0.273075 Aug 27 02:33:26.971883 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 677/1273] 10.222.0.99 () {58 vars in 1199 bytes} [Sat Aug 27 02:33:26 2022] GET /compute/v2.1/images?changes-since=2022-08-27T02%3A30%3A49Z => generated 1904 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:26.981943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e9f0754-3585-430a-b667-da4d79cccf68 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:26.983058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5e9f0754-3585-430a-b667-da4d79cccf68 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:26.994233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9f0754-3585-430a-b667-da4d79cccf68 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:26.995644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9f0754-3585-430a-b667-da4d79cccf68 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:26.997007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9f0754-3585-430a-b667-da4d79cccf68 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:27.000392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9f0754-3585-430a-b667-da4d79cccf68 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:27.001923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9f0754-3585-430a-b667-da4d79cccf68 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:27.002711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e9f0754-3585-430a-b667-da4d79cccf68 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:27.306742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b3bfc95-43c8-4d42-ad80-db1da513ef39 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:27.317631 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b3bfc95-43c8-4d42-ad80-db1da513ef39 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1316 microversion: 2.1 time: 0.915645 Aug 27 02:33:27.318536 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 597/1274] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:26 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1316 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:27.330036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5e9f0754-3585-430a-b667-da4d79cccf68 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:27.339747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9cafe21e-c601-4e3c-a23a-ac4565042c9a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Action: 'update_all', calling method: .version_select at 0x7f4d2a5cfb80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:27.363429 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e9f0754-3585-430a-b667-da4d79cccf68 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856" status: 200 len: 1474 microversion: 2.1 time: 0.389844 Aug 27 02:33:27.364707 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 678/1275] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:26 2022] GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856 => generated 1474 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:27.377382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:27.379194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:27.422457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:27.423768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:27.424831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:27.427483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:27.428582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:27.429548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:27.447601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-9cafe21e-c601-4e3c-a23a-ac4565042c9a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:27.457807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-9cafe21e-c601-4e3c-a23a-ac4565042c9a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for user f4871f8ff6a84626abced54caba8d607 and project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:27.806260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:27.823058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:27.842060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:27.844286 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fe99f930-fe0a-49b4-97f4-aeef1882ce6b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1559 microversion: 2.25 time: 0.477993 Aug 27 02:33:27.865709 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 679/1276] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:27 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1559 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:27.865709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b23e8f9e-6d28-4007-89d5-ffc2fe349c78 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a423dc0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:28.025197 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b23e8f9e-6d28-4007-89d5-ffc2fe349c78 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1433371039" status: 200 len: 485 microversion: 2.1 time: 0.176480 Aug 27 02:33:28.033165 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 680/1277] 10.222.0.99 () {58 vars in 1231 bytes} [Sat Aug 27 02:33:27 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1433371039 => generated 485 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:28.050378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cdfcf9f3-048e-4622-a43c-30139a5ff233 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:28.055784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cdfcf9f3-048e-4622-a43c-30139a5ff233 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:28.093147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdfcf9f3-048e-4622-a43c-30139a5ff233 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:28.095242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdfcf9f3-048e-4622-a43c-30139a5ff233 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:28.096762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdfcf9f3-048e-4622-a43c-30139a5ff233 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:28.101904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdfcf9f3-048e-4622-a43c-30139a5ff233 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:28.109396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdfcf9f3-048e-4622-a43c-30139a5ff233 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:28.117241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdfcf9f3-048e-4622-a43c-30139a5ff233 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:28.155222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9cafe21e-c601-4e3c-a23a-ac4565042c9a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.823044 Aug 27 02:33:28.155824 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 598/1278] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:33:27 2022] PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 61 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:28.460754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cdfcf9f3-048e-4622-a43c-30139a5ff233 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:28.483427 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cdfcf9f3-048e-4622-a43c-30139a5ff233 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1471 microversion: 2.1 time: 0.447336 Aug 27 02:33:28.484946 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 681/1279] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:28 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1471 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:28.502956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eb884111-49e9-4fe4-82e7-d3699900b755 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a423ca0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:28.572631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-72ab8299-8406-4190-a439-aece7f2c1b9f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:28.579850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-72ab8299-8406-4190-a439-aece7f2c1b9f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:28.613649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72ab8299-8406-4190-a439-aece7f2c1b9f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:28.614820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72ab8299-8406-4190-a439-aece7f2c1b9f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:28.618268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72ab8299-8406-4190-a439-aece7f2c1b9f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:28.619871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72ab8299-8406-4190-a439-aece7f2c1b9f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:28.620991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72ab8299-8406-4190-a439-aece7f2c1b9f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:28.622230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72ab8299-8406-4190-a439-aece7f2c1b9f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:28.804429 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eb884111-49e9-4fe4-82e7-d3699900b755 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images?server=f98f8456-cc9f-4772-97f1-99e056b99f79" status: 200 len: 958 microversion: 2.1 time: 0.316890 Aug 27 02:33:28.806110 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 682/1280] 10.222.0.99 () {58 vars in 1209 bytes} [Sat Aug 27 02:33:28 2022] GET /compute/v2.1/images?server=f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 958 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:28.848839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6744aae8-2025-49ec-a5ca-4d2763b99f10 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Action: 'update', calling method: .version_select at 0x7f4d2a29bca0>, body: {"meta": {"os_version": "alt"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:28.890961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-72ab8299-8406-4190-a439-aece7f2c1b9f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid 93453131-995a-46d6-848d-ec13cb596c67 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:33:28.916545 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-72ab8299-8406-4190-a439-aece7f2c1b9f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 2052 microversion: 2.25 time: 0.759527 Aug 27 02:33:28.925788 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 599/1281] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:28 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 2052 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:28.932178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f1fe8db1-9d70-46a8-b774-9ac7c408502e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:28.932178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f1fe8db1-9d70-46a8-b774-9ac7c408502e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:28.944551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1fe8db1-9d70-46a8-b774-9ac7c408502e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:28.945454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1fe8db1-9d70-46a8-b774-9ac7c408502e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:28.946281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1fe8db1-9d70-46a8-b774-9ac7c408502e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:28.947589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1fe8db1-9d70-46a8-b774-9ac7c408502e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:28.948443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1fe8db1-9d70-46a8-b774-9ac7c408502e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:28.949221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1fe8db1-9d70-46a8-b774-9ac7c408502e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:28.963149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-6744aae8-2025-49ec-a5ca-4d2763b99f10 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:28.974256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-6744aae8-2025-49ec-a5ca-4d2763b99f10 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for user f4871f8ff6a84626abced54caba8d607 and project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:28.993632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:29.354471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f1fe8db1-9d70-46a8-b774-9ac7c408502e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:29.397742 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f1fe8db1-9d70-46a8-b774-9ac7c408502e tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1316 microversion: 2.1 time: 0.477539 Aug 27 02:33:29.401555 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 600/1282] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:28 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:29.423742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:29.426581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:29.451383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:29.471160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:29.473080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:29.473080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:29.473472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:29.473721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:29.476055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:29.559443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:29.561626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:29.563150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:29.566651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lazy-loading 'fault' on Instance uuid b5bde1cf-03b1-4f09-9dba-4c532bd1f856 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:33:29.668136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:29.687314 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e97c5658-21a1-4115-a84c-96c939808e52 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856" status: 200 len: 1308 microversion: 2.1 time: 0.280963 Aug 27 02:33:29.688308 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 601/1283] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:29 2022] GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856 => generated 1308 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:29.697786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6f6a7fa0-066d-4ca4-98db-115e1297e0d2 req-a4916d83-788a-4222-8b14-22119232383f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5bde1cf-03b1-4f09-9dba-4c532bd1f856", "name": "network-vif-deleted", "tag": "650173ad-927c-49b1-b523-46dfd22aa043"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:29.719957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6f6a7fa0-066d-4ca4-98db-115e1297e0d2 req-a4916d83-788a-4222-8b14-22119232383f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:29.720747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6f6a7fa0-066d-4ca4-98db-115e1297e0d2 req-a4916d83-788a-4222-8b14-22119232383f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:29.721776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6f6a7fa0-066d-4ca4-98db-115e1297e0d2 req-a4916d83-788a-4222-8b14-22119232383f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:29.746034 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6f6a7fa0-066d-4ca4-98db-115e1297e0d2 req-a4916d83-788a-4222-8b14-22119232383f service nova] Creating event network-vif-deleted:650173ad-927c-49b1-b523-46dfd22aa043 for instance b5bde1cf-03b1-4f09-9dba-4c532bd1f856 on n-h1-852084-5 Aug 27 02:33:29.759020 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6f6a7fa0-066d-4ca4-98db-115e1297e0d2 req-a4916d83-788a-4222-8b14-22119232383f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068584 Aug 27 02:33:29.760237 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 602/1284] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:29.760689 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6744aae8-2025-49ec-a5ca-4d2763b99f10 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.924615 Aug 27 02:33:29.765803 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 683/1285] 10.222.0.99 () {60 vars in 1313 bytes} [Sat Aug 27 02:33:28 2022] PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata/os_version => generated 31 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:29.770923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:29.771481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c6a59d4c-149c-4fae-b277-6949b00d0f95 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a1c08b0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:29.771989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:29.783724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:29.784574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:29.785347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:29.786658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:29.787485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:29.788245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:29.860770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:29.861619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:29.862442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:29.864532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:29.865378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:29.866143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:29.872199 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c6a59d4c-149c-4fae-b277-6949b00d0f95 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.99%2Fcompute%2Fv2.1%2Fservers%2F9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 485 microversion: 2.1 time: 0.107558 Aug 27 02:33:29.874245 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 684/1286] 10.222.0.99 () {58 vars in 1317 bytes} [Sat Aug 27 02:33:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.99%2Fcompute%2Fv2.1%2Fservers%2F9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 485 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:29.889169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-034c02a6-922d-40f2-af74-d1040740e26b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:29.890209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-034c02a6-922d-40f2-af74-d1040740e26b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:29.899794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-034c02a6-922d-40f2-af74-d1040740e26b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:29.900294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-034c02a6-922d-40f2-af74-d1040740e26b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:29.900853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-034c02a6-922d-40f2-af74-d1040740e26b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:29.901833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-034c02a6-922d-40f2-af74-d1040740e26b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:29.902311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-034c02a6-922d-40f2-af74-d1040740e26b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:29.902747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-034c02a6-922d-40f2-af74-d1040740e26b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:29.912820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'cores', 'ram'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:29.923447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for user d1624ef00b144dafbaff7ae5c677e7a3 and project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'cores', 'ram'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:30.072447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-034c02a6-922d-40f2-af74-d1040740e26b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid 93453131-995a-46d6-848d-ec13cb596c67 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:33:30.090779 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-034c02a6-922d-40f2-af74-d1040740e26b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 2052 microversion: 2.25 time: 0.211428 Aug 27 02:33:30.092045 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 685/1287] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:29 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 2052 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:30.097091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2a4ff084-d758-4bf3-89f0-aa42290838e9 req-5c398910-3059-4e81-8479-52b1f2f06143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f011f2b-bbd2-4dfb-8dda-1942eec66691", "name": "network-vif-plugged", "status": "completed", "tag": "338e8e88-1a8d-4cd1-bcf2-aaa6ac3816e8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:30.106911 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b45f4a25-fb27-4d11-b449-b1a70b8f53f1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "POST /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481/action" status: 202 len: 0 microversion: 2.1 time: 0.344309 Aug 27 02:33:30.107928 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 603/1288] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:33:29 2022] POST /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:33:30.111035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2a4ff084-d758-4bf3-89f0-aa42290838e9 req-5c398910-3059-4e81-8479-52b1f2f06143 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:30.111637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2a4ff084-d758-4bf3-89f0-aa42290838e9 req-5c398910-3059-4e81-8479-52b1f2f06143 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:30.112357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2a4ff084-d758-4bf3-89f0-aa42290838e9 req-5c398910-3059-4e81-8479-52b1f2f06143 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:30.115098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-033c00e7-f436-4ca5-961a-9ac104c4ab37 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:30.116170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-033c00e7-f436-4ca5-961a-9ac104c4ab37 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:30.132428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-033c00e7-f436-4ca5-961a-9ac104c4ab37 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:30.132978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-033c00e7-f436-4ca5-961a-9ac104c4ab37 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:30.134221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-033c00e7-f436-4ca5-961a-9ac104c4ab37 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:30.135493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-033c00e7-f436-4ca5-961a-9ac104c4ab37 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:30.136388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-033c00e7-f436-4ca5-961a-9ac104c4ab37 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:30.137011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-033c00e7-f436-4ca5-961a-9ac104c4ab37 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:30.149003 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2a4ff084-d758-4bf3-89f0-aa42290838e9 req-5c398910-3059-4e81-8479-52b1f2f06143 service nova] Creating event network-vif-plugged:338e8e88-1a8d-4cd1-bcf2-aaa6ac3816e8 for instance 4f011f2b-bbd2-4dfb-8dda-1942eec66691 on n-h2-852084-5 Aug 27 02:33:30.155023 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2a4ff084-d758-4bf3-89f0-aa42290838e9 req-5c398910-3059-4e81-8479-52b1f2f06143 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061408 Aug 27 02:33:30.157125 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 686/1289] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:30.166377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5d7626e5-86bf-4df6-9a19-71a34c24e3c4 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Calling method '.version_select at 0x7f4d2a242700>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:30.195800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-033c00e7-f436-4ca5-961a-9ac104c4ab37 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:33:30.288573 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5d7626e5-86bf-4df6-9a19-71a34c24e3c4 tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.129346 Aug 27 02:33:30.300266 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 687/1290] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:33:30 2022] GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 58 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:30.315341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d68d0d48-ee19-4f76-aeba-fb565e1f7b6e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a23c1f0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:30.351215 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-033c00e7-f436-4ca5-961a-9ac104c4ab37 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "DELETE /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 204 len: 0 microversion: 2.1 time: 0.241162 Aug 27 02:33:30.364022 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 604/1291] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:30 2022] DELETE /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:30.374547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a214fc9a-eda7-4ba7-9d14-75d5be727f02 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:30.375774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a214fc9a-eda7-4ba7-9d14-75d5be727f02 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:30.387685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a214fc9a-eda7-4ba7-9d14-75d5be727f02 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:30.389127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a214fc9a-eda7-4ba7-9d14-75d5be727f02 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:30.389962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a214fc9a-eda7-4ba7-9d14-75d5be727f02 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:30.391289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a214fc9a-eda7-4ba7-9d14-75d5be727f02 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:30.392000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a214fc9a-eda7-4ba7-9d14-75d5be727f02 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:30.392626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a214fc9a-eda7-4ba7-9d14-75d5be727f02 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:30.432027 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d68d0d48-ee19-4f76-aeba-fb565e1f7b6e tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.99%2Fcompute%2Fservers%2F9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 485 microversion: 2.1 time: 0.129667 Aug 27 02:33:30.433110 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 688/1292] 10.222.0.99 () {58 vars in 1303 bytes} [Sat Aug 27 02:33:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.99%2Fcompute%2Fservers%2F9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 485 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:30.441486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d644d4ce-a224-41cd-ba4d-a8fa6ae1e0d9 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:30.449410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d644d4ce-a224-41cd-ba4d-a8fa6ae1e0d9 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:30.451420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d644d4ce-a224-41cd-ba4d-a8fa6ae1e0d9 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:30.452460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d644d4ce-a224-41cd-ba4d-a8fa6ae1e0d9 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:30.454320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d644d4ce-a224-41cd-ba4d-a8fa6ae1e0d9 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:30.455428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d644d4ce-a224-41cd-ba4d-a8fa6ae1e0d9 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:30.456417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d644d4ce-a224-41cd-ba4d-a8fa6ae1e0d9 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:30.507894 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d644d4ce-a224-41cd-ba4d-a8fa6ae1e0d9 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.072933 Aug 27 02:33:30.509373 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 689/1293] 10.222.0.99 () {60 vars in 1217 bytes} [Sat Aug 27 02:33:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:33:30.519427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-667157eb-ab05-4ae4-a1bd-96113706bddd tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Action: 'update_all', calling method: .version_select at 0x7f4d2a242a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:30.605598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-667157eb-ab05-4ae4-a1bd-96113706bddd tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:30.617646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-667157eb-ab05-4ae4-a1bd-96113706bddd tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for user f4871f8ff6a84626abced54caba8d607 and project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:30.697711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a214fc9a-eda7-4ba7-9d14-75d5be727f02 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:30.714733 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a214fc9a-eda7-4ba7-9d14-75d5be727f02 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1470 microversion: 2.1 time: 0.348338 Aug 27 02:33:30.716443 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 605/1294] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:30 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1470 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:30.726198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1b3115a1-41c8-4758-bc3a-2726611bcd3a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:30.727681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b3115a1-41c8-4758-bc3a-2726611bcd3a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:30.738212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b3115a1-41c8-4758-bc3a-2726611bcd3a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:30.740091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b3115a1-41c8-4758-bc3a-2726611bcd3a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:30.740932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b3115a1-41c8-4758-bc3a-2726611bcd3a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:30.742362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b3115a1-41c8-4758-bc3a-2726611bcd3a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:30.743489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b3115a1-41c8-4758-bc3a-2726611bcd3a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:30.745151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b3115a1-41c8-4758-bc3a-2726611bcd3a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:31.004928 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-667157eb-ab05-4ae4-a1bd-96113706bddd tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.493527 Aug 27 02:33:31.006279 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 690/1295] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:33:30 2022] PUT /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 61 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:31.016101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-53dc1007-3063-462c-8ac4-beeeef88aae6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:31.017102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-53dc1007-3063-462c-8ac4-beeeef88aae6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:31.025360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53dc1007-3063-462c-8ac4-beeeef88aae6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:31.026013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53dc1007-3063-462c-8ac4-beeeef88aae6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:31.026715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53dc1007-3063-462c-8ac4-beeeef88aae6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:31.027605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53dc1007-3063-462c-8ac4-beeeef88aae6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:31.028419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53dc1007-3063-462c-8ac4-beeeef88aae6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:31.029716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53dc1007-3063-462c-8ac4-beeeef88aae6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:31.042242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1b3115a1-41c8-4758-bc3a-2726611bcd3a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:31.057972 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1b3115a1-41c8-4758-bc3a-2726611bcd3a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1665 microversion: 2.1 time: 0.339260 Aug 27 02:33:31.059488 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 606/1296] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:30 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1665 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:31.068616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-71951844-caf2-42e4-a968-2e4191a0e5c0 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2af2a160>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:31.225368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-53dc1007-3063-462c-8ac4-beeeef88aae6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:31.242202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-53dc1007-3063-462c-8ac4-beeeef88aae6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1316 microversion: 2.1 time: 0.234102 Aug 27 02:33:31.243466 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 691/1297] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:31 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:31.253407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8ffbac60-7896-4e4d-930b-3b0c890ab921 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852084-5", "block_migration": "auto"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:31.258397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8ffbac60-7896-4e4d-930b-3b0c890ab921 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:31.267453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ffbac60-7896-4e4d-930b-3b0c890ab921 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:31.268050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ffbac60-7896-4e4d-930b-3b0c890ab921 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:31.268586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ffbac60-7896-4e4d-930b-3b0c890ab921 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:31.269525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ffbac60-7896-4e4d-930b-3b0c890ab921 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:31.270046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ffbac60-7896-4e4d-930b-3b0c890ab921 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:31.270636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ffbac60-7896-4e4d-930b-3b0c890ab921 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:31.275325 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-71951844-caf2-42e4-a968-2e4191a0e5c0 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3283 microversion: 2.1 time: 0.213580 Aug 27 02:33:31.276281 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 607/1298] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:33:31 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3283 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:31.290243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:31.290243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: b5bde1cf-03b1-4f09-9dba-4c532bd1f856] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:31.308549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:31.310224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:31.312612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:31.314222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:31.315218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:31.315448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-8ffbac60-7896-4e4d-930b-3b0c890ab921 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'flavor' on Instance uuid 93453131-995a-46d6-848d-ec13cb596c67 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:33:31.316232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:31.330989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8ffbac60-7896-4e4d-930b-3b0c890ab921 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Going to try to live migrate instance to n-h2-852084-5 {{(pid=122488) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:33:31.345320 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] HTTP exception thrown: Instance b5bde1cf-03b1-4f09-9dba-4c532bd1f856 could not be found. Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Request method failure captured: Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856 HTTP/1.1 Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFiArvb-rYskcF60VDeh9IGe-8fG5nqIDUYRfckRT-johkRp2z_dM5DggVNK5zoDjAQXVpOp36HYdY-OV-xYQOhdWaDrHKYhKly94j0zV2ewhh3lS2z4ZNwVaFWh2Sd6V60UKntl8nEVOEhVKPqUiUHLmt1Ki9j66HyMVaxACQEzaw Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}] Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 71bc8ccc9dc94a01ba39a4559f45ccce Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance b5bde1cf-03b1-4f09-9dba-4c532bd1f856 could not be found. Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'b5bde1cf-03b1-4f09-9dba-4c532bd1f856'} Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5bde1cf-03b1-4f09-9dba-4c532bd1f856 could not be found. Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5bde1cf-03b1-4f09-9dba-4c532bd1f856 could not be found. Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:31.348689 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:31.360702 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:31.360702 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:31.360702 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:31.360702 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:31.360702 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:31.360702 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5bde1cf-03b1-4f09-9dba-4c532bd1f856 could not be found. Aug 27 02:33:31.360702 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:31.360702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Returning 404 to user: Instance b5bde1cf-03b1-4f09-9dba-4c532bd1f856 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:31.360702 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-11435ce6-5656-4d4c-93ed-e9641c3099ce tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856" status: 404 len: 111 microversion: 2.1 time: 0.078588 Aug 27 02:33:31.360702 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 608/1299] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:31 2022] GET /compute/v2.1/servers/b5bde1cf-03b1-4f09-9dba-4c532bd1f856 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:33:31.369554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b86452ef-a2f6-4289-b0f5-73b68ab83f6a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Action: 'create', calling method: .version_select at 0x7f4d2a60e820>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:31.470562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-b86452ef-a2f6-4289-b0f5-73b68ab83f6a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:31.482403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-b86452ef-a2f6-4289-b0f5-73b68ab83f6a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Getting quotas for user f4871f8ff6a84626abced54caba8d607 and project 7f9e503c79794c2680fc3dc6f59b45e9. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:31.896544 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b86452ef-a2f6-4289-b0f5-73b68ab83f6a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "POST /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.534418 Aug 27 02:33:31.897850 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 609/1300] 10.222.0.99 () {60 vars in 1281 bytes} [Sat Aug 27 02:33:31 2022] POST /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 85 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:31.908393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3771b05b-ee7a-45e7-bac9-f81564fb0e16 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2e8c9280>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:32.003580 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3771b05b-ee7a-45e7-bac9-f81564fb0e16 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.104065 Aug 27 02:33:32.004294 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 610/1301] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:33:31 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:32.010747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:32.012108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 0be54d10-5487-46c1-84a4-2d3fb9ba8df3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:32.021200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:32.021737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:32.022176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:32.022896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:32.023353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:32.023783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:32.039039 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] HTTP exception thrown: Instance 0be54d10-5487-46c1-84a4-2d3fb9ba8df3 could not be found. Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Request method failure captured: Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 HTTP/1.1 Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFiArvb-rYskcF60VDeh9IGe-8fG5nqIDUYRfckRT-johkRp2z_dM5DggVNK5zoDjAQXVpOp36HYdY-OV-xYQOhdWaDrHKYhKly94j0zV2ewhh3lS2z4ZNwVaFWh2Sd6V60UKntl8nEVOEhVKPqUiUHLmt1Ki9j66HyMVaxACQEzaw Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}] Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 71bc8ccc9dc94a01ba39a4559f45ccce Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 0be54d10-5487-46c1-84a4-2d3fb9ba8df3 could not be found. Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '0be54d10-5487-46c1-84a4-2d3fb9ba8df3'} Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be54d10-5487-46c1-84a4-2d3fb9ba8df3 could not be found. Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be54d10-5487-46c1-84a4-2d3fb9ba8df3 could not be found. Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:32.040644 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be54d10-5487-46c1-84a4-2d3fb9ba8df3 could not be found. Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Returning 404 to user: Instance 0be54d10-5487-46c1-84a4-2d3fb9ba8df3 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d4dada5f-f888-44cd-91c1-4a62f8cf195c tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3" status: 404 len: 111 microversion: 2.1 time: 0.036603 Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 611/1302] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:32 2022] GET /compute/v2.1/servers/0be54d10-5487-46c1-84a4-2d3fb9ba8df3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-80d12411-20a9-4ca4-b34d-108cd2671043 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:32.048612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-80d12411-20a9-4ca4-b34d-108cd2671043 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:32.054948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d12411-20a9-4ca4-b34d-108cd2671043 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:32.055445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d12411-20a9-4ca4-b34d-108cd2671043 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:32.055929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d12411-20a9-4ca4-b34d-108cd2671043 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:32.056701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d12411-20a9-4ca4-b34d-108cd2671043 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:32.057156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d12411-20a9-4ca4-b34d-108cd2671043 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:32.057591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d12411-20a9-4ca4-b34d-108cd2671043 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:32.230831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-80d12411-20a9-4ca4-b34d-108cd2671043 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:32.240185 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-80d12411-20a9-4ca4-b34d-108cd2671043 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1470 microversion: 2.1 time: 0.196369 Aug 27 02:33:32.241018 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 612/1303] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:32 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:32.247394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c825ed95-dda6-44ba-9fa8-21d48f3d49f9 req-0573726c-a35d-482e-9ac7-d112f8984c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be54d10-5487-46c1-84a4-2d3fb9ba8df3", "name": "network-vif-deleted", "tag": "8f25f23c-a66c-4101-b753-a48b579d6cd2"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:32.258779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c825ed95-dda6-44ba-9fa8-21d48f3d49f9 req-0573726c-a35d-482e-9ac7-d112f8984c97 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:32.259474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c825ed95-dda6-44ba-9fa8-21d48f3d49f9 req-0573726c-a35d-482e-9ac7-d112f8984c97 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:32.260039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c825ed95-dda6-44ba-9fa8-21d48f3d49f9 req-0573726c-a35d-482e-9ac7-d112f8984c97 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:32.272826 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c825ed95-dda6-44ba-9fa8-21d48f3d49f9 req-0573726c-a35d-482e-9ac7-d112f8984c97 service nova] Creating event network-vif-deleted:8f25f23c-a66c-4101-b753-a48b579d6cd2 for instance 0be54d10-5487-46c1-84a4-2d3fb9ba8df3 on n-h1-852084-5 Aug 27 02:33:32.278549 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c825ed95-dda6-44ba-9fa8-21d48f3d49f9 req-0573726c-a35d-482e-9ac7-d112f8984c97 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035925 Aug 27 02:33:32.279708 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 613/1304] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:32.285513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c52e8195-cd5e-4f25-98b1-b9bc2ecea15a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] Calling method '.version_select at 0x7f4d2a5a7280>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:32.343702 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c52e8195-cd5e-4f25-98b1-b9bc2ecea15a tempest-ImagesMetadataTestJSON-307013349 tempest-ImagesMetadataTestJSON-307013349-project] 10.222.0.99 "GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.062698 Aug 27 02:33:32.344263 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 614/1305] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:33:32 2022] GET /compute/v2.1/images/faa4ae60-159b-45ad-abaa-6b455a4d325c/metadata => generated 85 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:32.349287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6ac26960-19b8-4170-b2c3-151ace34a50a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2e8c9820>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:32.480045 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6ac26960-19b8-4170-b2c3-151ace34a50a tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.134609 Aug 27 02:33:32.480824 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 615/1306] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:33:32 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:32.495337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e144459f-2af6-4983-a3eb-cf6b21b4f824 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:32.567436 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e144459f-2af6-4983-a3eb-cf6b21b4f824 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/742b6e09-f3eb-4047-9fda-820009b703db" status: 204 len: 0 microversion: 2.1 time: 0.081661 Aug 27 02:33:32.574520 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 616/1307] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:33:32 2022] DELETE /compute/v2.1/os-server-groups/742b6e09-f3eb-4047-9fda-820009b703db => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:32.583878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42c0b8d0-01e8-4a3e-a6ce-2ec6cd9e4e50 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:32.586366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-42c0b8d0-01e8-4a3e-a6ce-2ec6cd9e4e50 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:32.601534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42c0b8d0-01e8-4a3e-a6ce-2ec6cd9e4e50 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:32.603820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42c0b8d0-01e8-4a3e-a6ce-2ec6cd9e4e50 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:32.605378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42c0b8d0-01e8-4a3e-a6ce-2ec6cd9e4e50 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:32.606602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42c0b8d0-01e8-4a3e-a6ce-2ec6cd9e4e50 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:32.608290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42c0b8d0-01e8-4a3e-a6ce-2ec6cd9e4e50 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:32.609448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42c0b8d0-01e8-4a3e-a6ce-2ec6cd9e4e50 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:33.084808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-42c0b8d0-01e8-4a3e-a6ce-2ec6cd9e4e50 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:33.104091 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42c0b8d0-01e8-4a3e-a6ce-2ec6cd9e4e50 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1665 microversion: 2.1 time: 0.527628 Aug 27 02:33:33.110569 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 617/1308] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:32 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1665 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:33.117787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-971988d8-7e9d-4790-a5b9-74aeeec2b3ce req-3751d999-267f-4a6c-a9ff-61a700f365df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde6f25d-de52-4758-85c7-ce0b8471e481", "name": "network-vif-plugged", "status": "completed", "tag": "5250e113-81ca-45c6-a466-ef24aace16e6"}, {"server_uuid": "f98f8456-cc9f-4772-97f1-99e056b99f79", "name": "network-vif-unplugged", "status": "completed", "tag": "466460c2-b76b-42d7-9cd5-1eab0a9cd335"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:33.167744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-971988d8-7e9d-4790-a5b9-74aeeec2b3ce req-3751d999-267f-4a6c-a9ff-61a700f365df service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:33.168349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-971988d8-7e9d-4790-a5b9-74aeeec2b3ce req-3751d999-267f-4a6c-a9ff-61a700f365df service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:33.168930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-971988d8-7e9d-4790-a5b9-74aeeec2b3ce req-3751d999-267f-4a6c-a9ff-61a700f365df service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:33.220920 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-971988d8-7e9d-4790-a5b9-74aeeec2b3ce req-3751d999-267f-4a6c-a9ff-61a700f365df service nova] Creating event network-vif-plugged:5250e113-81ca-45c6-a466-ef24aace16e6 for instance fde6f25d-de52-4758-85c7-ce0b8471e481 on n-h1-852084-5 Aug 27 02:33:33.221480 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-971988d8-7e9d-4790-a5b9-74aeeec2b3ce req-3751d999-267f-4a6c-a9ff-61a700f365df service nova] Creating event network-vif-unplugged:466460c2-b76b-42d7-9cd5-1eab0a9cd335 for instance f98f8456-cc9f-4772-97f1-99e056b99f79 on n-h1-852084-5 Aug 27 02:33:33.236274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-971988d8-7e9d-4790-a5b9-74aeeec2b3ce req-3751d999-267f-4a6c-a9ff-61a700f365df service nova] Instance fde6f25d-de52-4758-85c7-ce0b8471e481 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:33:33.268363 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-971988d8-7e9d-4790-a5b9-74aeeec2b3ce req-3751d999-267f-4a6c-a9ff-61a700f365df service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.155558 Aug 27 02:33:33.270507 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 618/1309] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:33.286886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d3f2904c-d12f-43a2-b24d-d0f090067e07 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:33.289572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d3f2904c-d12f-43a2-b24d-d0f090067e07 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:33.304614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3f2904c-d12f-43a2-b24d-d0f090067e07 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:33.305574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3f2904c-d12f-43a2-b24d-d0f090067e07 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:33.306475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3f2904c-d12f-43a2-b24d-d0f090067e07 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:33.308077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3f2904c-d12f-43a2-b24d-d0f090067e07 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:33.308996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3f2904c-d12f-43a2-b24d-d0f090067e07 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:33.309799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3f2904c-d12f-43a2-b24d-d0f090067e07 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:33.952112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d3f2904c-d12f-43a2-b24d-d0f090067e07 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:33.981072 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d3f2904c-d12f-43a2-b24d-d0f090067e07 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1505 microversion: 2.1 time: 0.707403 Aug 27 02:33:33.982335 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 619/1310] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:33 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1505 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:33.989226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6300bc00-93c7-49be-9ce8-fadc8925171f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a5b6dc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:34.268622 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6300bc00-93c7-49be-9ce8-fadc8925171f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/detail?changes-since=2022-08-27T02%3A30%3A43Z" status: 200 len: 6336 microversion: 2.1 time: 0.283809 Aug 27 02:33:34.270186 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 620/1311] 10.222.0.99 () {58 vars in 1220 bytes} [Sat Aug 27 02:33:33 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-27T02%3A30%3A43Z => generated 6336 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:34.275403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b8f189c0-e069-4c03-894e-e52eaab09dcc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:34.276303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b8f189c0-e069-4c03-894e-e52eaab09dcc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:34.288254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8f189c0-e069-4c03-894e-e52eaab09dcc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:34.292140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8f189c0-e069-4c03-894e-e52eaab09dcc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:34.293334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8f189c0-e069-4c03-894e-e52eaab09dcc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:34.295792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8f189c0-e069-4c03-894e-e52eaab09dcc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:34.298732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8f189c0-e069-4c03-894e-e52eaab09dcc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:34.300044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8f189c0-e069-4c03-894e-e52eaab09dcc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:34.366928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b8f189c0-e069-4c03-894e-e52eaab09dcc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:33:34.464546 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8ffbac60-7896-4e4d-930b-3b0c890ab921 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67/action" status: 202 len: 0 microversion: 2.25 time: 3.218138 Aug 27 02:33:34.470357 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 692/1312] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:33:31 2022] POST /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67/action => generated 0 bytes in 3226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:34.483799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e32c1b9c-bd76-4803-a597-493e1a2a427c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:34.484932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e32c1b9c-bd76-4803-a597-493e1a2a427c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:34.500818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:34.510034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e32c1b9c-bd76-4803-a597-493e1a2a427c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:34.511990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e32c1b9c-bd76-4803-a597-493e1a2a427c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:34.513441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e32c1b9c-bd76-4803-a597-493e1a2a427c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:34.515183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e32c1b9c-bd76-4803-a597-493e1a2a427c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:34.516306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e32c1b9c-bd76-4803-a597-493e1a2a427c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:34.517793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e32c1b9c-bd76-4803-a597-493e1a2a427c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:34.663996 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b8f189c0-e069-4c03-894e-e52eaab09dcc tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 204 len: 0 microversion: 2.1 time: 0.391486 Aug 27 02:33:34.665287 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 621/1313] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:34 2022] DELETE /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:34.673722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-259a5ee1-07c0-4177-9a94-3b4fd0ae3135 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:34.675342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-259a5ee1-07c0-4177-9a94-3b4fd0ae3135 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:34.684318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-259a5ee1-07c0-4177-9a94-3b4fd0ae3135 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:34.685967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-259a5ee1-07c0-4177-9a94-3b4fd0ae3135 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:34.686666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-259a5ee1-07c0-4177-9a94-3b4fd0ae3135 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:34.688011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-259a5ee1-07c0-4177-9a94-3b4fd0ae3135 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:34.688714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-259a5ee1-07c0-4177-9a94-3b4fd0ae3135 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:34.689503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-259a5ee1-07c0-4177-9a94-3b4fd0ae3135 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.015372 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-259a5ee1-07c0-4177-9a94-3b4fd0ae3135 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1813 microversion: 2.1 time: 0.341405 Aug 27 02:33:35.016047 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 622/1314] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:34 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1813 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:35.029167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e423152-8905-46d7-b0ba-11e762a4a15a tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:35.030345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2e423152-8905-46d7-b0ba-11e762a4a15a tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:35.050317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e423152-8905-46d7-b0ba-11e762a4a15a tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.051135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e423152-8905-46d7-b0ba-11e762a4a15a tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.058773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e423152-8905-46d7-b0ba-11e762a4a15a tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.060596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e423152-8905-46d7-b0ba-11e762a4a15a tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.061376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e423152-8905-46d7-b0ba-11e762a4a15a tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.062099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e423152-8905-46d7-b0ba-11e762a4a15a tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.107931 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e423152-8905-46d7-b0ba-11e762a4a15a tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691/ips" status: 200 len: 109 microversion: 2.1 time: 0.090464 Aug 27 02:33:35.117153 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 623/1315] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 02:33:35 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691/ips => generated 109 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:35.123975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e4e684a-bca7-4296-b5ea-55eb3c41dbd2 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:35.124992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e4e684a-bca7-4296-b5ea-55eb3c41dbd2 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:35.148726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4e684a-bca7-4296-b5ea-55eb3c41dbd2 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.149735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4e684a-bca7-4296-b5ea-55eb3c41dbd2 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.150518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4e684a-bca7-4296-b5ea-55eb3c41dbd2 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.151581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4e684a-bca7-4296-b5ea-55eb3c41dbd2 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.152437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4e684a-bca7-4296-b5ea-55eb3c41dbd2 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.153117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4e684a-bca7-4296-b5ea-55eb3c41dbd2 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.203489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e32c1b9c-bd76-4803-a597-493e1a2a427c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:35.227762 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e32c1b9c-bd76-4803-a597-493e1a2a427c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1536 microversion: 2.1 time: 0.751382 Aug 27 02:33:35.231005 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 693/1316] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:34 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1536 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:35.258610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d18b2ed3-e31d-4b5e-b359-64b0ac0829b2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a227a60>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:35.263252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6e4e684a-bca7-4296-b5ea-55eb3c41dbd2 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c8cc51830a148959619a4944c88ad51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92e5cff6b734d1f9d0eb5abb9a4a982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:35.279473 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e4e684a-bca7-4296-b5ea-55eb3c41dbd2 tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 200 len: 1310 microversion: 2.1 time: 0.160249 Aug 27 02:33:35.280993 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 624/1317] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:35 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 1310 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:35.308987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:35.309854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:35.327634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.328199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.328934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.330373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.331110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.331771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.448209 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d18b2ed3-e31d-4b5e-b359-64b0ac0829b2 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1433371039" status: 200 len: 665 microversion: 2.1 time: 0.213490 Aug 27 02:33:35.461738 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 694/1318] 10.222.0.99 () {58 vars in 1252 bytes} [Sat Aug 27 02:33:35 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1433371039 => generated 665 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:35.468578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7e68c223-af2e-4a51-9336-a8d97a9ff191 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:35.470629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7e68c223-af2e-4a51-9336-a8d97a9ff191 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:35.481178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e68c223-af2e-4a51-9336-a8d97a9ff191 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.482626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e68c223-af2e-4a51-9336-a8d97a9ff191 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.483316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e68c223-af2e-4a51-9336-a8d97a9ff191 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.484344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e68c223-af2e-4a51-9336-a8d97a9ff191 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.485037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e68c223-af2e-4a51-9336-a8d97a9ff191 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.485645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e68c223-af2e-4a51-9336-a8d97a9ff191 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.618191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:35.644331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:35.650113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:35.653203 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-485067e0-1f91-4652-98a9-4f574daf6543 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1569 microversion: 2.25 time: 0.355450 Aug 27 02:33:35.671766 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 625/1319] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:35 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1569 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:35.687157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a30ea6f-1e87-46e7-9f88-88c449d3bab2 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:35.693976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a30ea6f-1e87-46e7-9f88-88c449d3bab2 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.695231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a30ea6f-1e87-46e7-9f88-88c449d3bab2 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.696572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a30ea6f-1e87-46e7-9f88-88c449d3bab2 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.697596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a30ea6f-1e87-46e7-9f88-88c449d3bab2 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.698384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a30ea6f-1e87-46e7-9f88-88c449d3bab2 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.699027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a30ea6f-1e87-46e7-9f88-88c449d3bab2 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.734859 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a30ea6f-1e87-46e7-9f88-88c449d3bab2 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061085 Aug 27 02:33:35.744745 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 626/1320] 10.222.0.99 () {58 vars in 1176 bytes} [Sat Aug 27 02:33:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:35.744745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-391e976a-9791-4807-a643-690d98fc6cda req-982f383f-d90a-45f7-85d9-6a03fa0a6832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769febc7-82dc-4fbb-8510-8c2ab56332a1", "name": "network-vif-deleted", "tag": "097d06b1-e16f-4708-afe4-4d8903542c41"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:35.753523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-391e976a-9791-4807-a643-690d98fc6cda req-982f383f-d90a-45f7-85d9-6a03fa0a6832 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.753523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-391e976a-9791-4807-a643-690d98fc6cda req-982f383f-d90a-45f7-85d9-6a03fa0a6832 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.753990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-391e976a-9791-4807-a643-690d98fc6cda req-982f383f-d90a-45f7-85d9-6a03fa0a6832 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.766912 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-391e976a-9791-4807-a643-690d98fc6cda req-982f383f-d90a-45f7-85d9-6a03fa0a6832 service nova] Creating event network-vif-deleted:097d06b1-e16f-4708-afe4-4d8903542c41 for instance 769febc7-82dc-4fbb-8510-8c2ab56332a1 on n-h2-852084-5 Aug 27 02:33:35.772468 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-391e976a-9791-4807-a643-690d98fc6cda req-982f383f-d90a-45f7-85d9-6a03fa0a6832 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035236 Aug 27 02:33:35.777049 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 627/1321] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:35.783992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a94a6139-1108-4983-8d5a-e71faf89f0e6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:35.785710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a94a6139-1108-4983-8d5a-e71faf89f0e6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:35.797247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a94a6139-1108-4983-8d5a-e71faf89f0e6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.798636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a94a6139-1108-4983-8d5a-e71faf89f0e6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.800476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a94a6139-1108-4983-8d5a-e71faf89f0e6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.802010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a94a6139-1108-4983-8d5a-e71faf89f0e6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:35.803238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a94a6139-1108-4983-8d5a-e71faf89f0e6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:35.804728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a94a6139-1108-4983-8d5a-e71faf89f0e6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:35.839664 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a94a6139-1108-4983-8d5a-e71faf89f0e6 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691/ips" status: 200 len: 109 microversion: 2.1 time: 0.060269 Aug 27 02:33:35.841875 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 628/1322] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 02:33:35 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691/ips => generated 109 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:35.848808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-73819246-3446-49b6-8a96-1c7163cb8eeb tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a60e8b0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:35.966523 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-73819246-3446-49b6-8a96-1c7163cb8eeb tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.99%2Fcompute%2Fv2.1%2Fservers%2F9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1467 microversion: 2.1 time: 0.122250 Aug 27 02:33:35.969135 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 629/1323] 10.222.0.99 () {58 vars in 1338 bytes} [Sat Aug 27 02:33:35 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.99%2Fcompute%2Fv2.1%2Fservers%2F9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1467 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:36.242395 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d3cce85c-01a6-465b-8bea-1600465e0585 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] 10.222.0.99 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.271291 Aug 27 02:33:36.250836 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 630/1324] 10.222.0.99 () {58 vars in 1128 bytes} [Sat Aug 27 02:33:35 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 02:33:36.257484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7e68c223-af2e-4a51-9336-a8d97a9ff191 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:36.279210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-47f313da-4dcd-4f9c-88fd-1f76077b66f9 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:36.284720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-47f313da-4dcd-4f9c-88fd-1f76077b66f9 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:36.289049 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7e68c223-af2e-4a51-9336-a8d97a9ff191 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1473 microversion: 2.1 time: 0.828674 Aug 27 02:33:36.290511 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 695/1325] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:35 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1473 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:36.300504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47f313da-4dcd-4f9c-88fd-1f76077b66f9 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:36.301089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47f313da-4dcd-4f9c-88fd-1f76077b66f9 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:36.301604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47f313da-4dcd-4f9c-88fd-1f76077b66f9 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:36.302685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47f313da-4dcd-4f9c-88fd-1f76077b66f9 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:36.303281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47f313da-4dcd-4f9c-88fd-1f76077b66f9 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:36.303919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47f313da-4dcd-4f9c-88fd-1f76077b66f9 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:36.316061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e773f735-2dcc-4f3a-9294-c4117aaf279f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a23c040>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:36.382717 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-47f313da-4dcd-4f9c-88fd-1f76077b66f9 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691/ips/tempest-ServerAddressesTestJSON-1629949557-network" status: 200 len: 94 microversion: 2.1 time: 0.119606 Aug 27 02:33:36.394703 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 631/1326] 10.222.0.99 () {58 vars in 1401 bytes} [Sat Aug 27 02:33:36 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691/ips/tempest-ServerAddressesTestJSON-1629949557-network => generated 94 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:33:36.414877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f8bf5b56-e665-4772-97ab-6006660c43b8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:36.415808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f8bf5b56-e665-4772-97ab-6006660c43b8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:36.428980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8bf5b56-e665-4772-97ab-6006660c43b8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:36.432431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8bf5b56-e665-4772-97ab-6006660c43b8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:36.433961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8bf5b56-e665-4772-97ab-6006660c43b8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:36.436036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8bf5b56-e665-4772-97ab-6006660c43b8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:36.437978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8bf5b56-e665-4772-97ab-6006660c43b8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:36.438545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8bf5b56-e665-4772-97ab-6006660c43b8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:36.467159 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e773f735-2dcc-4f3a-9294-c4117aaf279f tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.99%2Fcompute%2Fservers%2F9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1467 microversion: 2.1 time: 0.162257 Aug 27 02:33:36.471429 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 696/1327] 10.222.0.99 () {58 vars in 1324 bytes} [Sat Aug 27 02:33:36 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.99%2Fcompute%2Fservers%2F9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1467 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:36.504655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-db6da536-0655-487f-804c-0866b12a630a tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Calling method '.version_select at 0x7f4d2a227af0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:36.619598 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-db6da536-0655-487f-804c-0866b12a630a tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] HTTP exception thrown: Image not found. Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-db6da536-0655-487f-804c-0866b12a630a tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Request method failure captured: Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYJ_Su3OmmRjPzMsZOpIipd44AzyXzAh5KmBHYG0iQptAvmMiiGCSLGddcz_EoN1Qxlc7pKIK9EX-Py5FGFoaRFXD84xgU96PgIusT5D8eH5pdH-oZcmqKzTSl48Lcm3Eo6e6-gbES16qPv3D3GsBcqm6VIUOHap21zbK3NKTadt7sI Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: e5694cde3e244fbaacbb7c625efdfecb Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e5694cde3e244fbaacbb7c625efdfecb"}]}] Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: e5694cde3e244fbaacbb7c625efdfecb Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesDeleteNegativeTestJSON-449643653-project Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f09308227f3c49b78fa4aed658a0fc2b Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-449643653-project Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '-1'} Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.690377 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:33:36.694718 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.699128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-db6da536-0655-487f-804c-0866b12a630a tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:36.701394 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-db6da536-0655-487f-804c-0866b12a630a tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] 10.222.0.99 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.226828 Aug 27 02:33:36.702716 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 697/1328] 10.222.0.99 () {58 vars in 1134 bytes} [Sat Aug 27 02:33:36 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:33:36.713812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:36.714846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] [instance: 769febc7-82dc-4fbb-8510-8c2ab56332a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:36.735054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:36.736066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:36.736751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:36.740446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:36.741502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:36.742244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:36.792583 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] HTTP exception thrown: Instance 769febc7-82dc-4fbb-8510-8c2ab56332a1 could not be found. Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Request method failure captured: Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 HTTP/1.1 Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYImIKT3KjMBf9KwFK6uNmFqjN2qFK-AwTtR5axhjaJ0JjUBID6t1yajZwCvLMgUvjdy8F6ZxHmsM6jWkgzbwC1UL2uP4kfdLgRIjN1tedVmEikaZ9MyZcBH3dIBBj67J6HDnGkPzg2YhkX-HqGMioYXZs4xitugjsag7c2BVJctJMs Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: f92e5cff6b734d1f9d0eb5abb9a4a982 Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestFqdnHostnames-402831250 Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f92e5cff6b734d1f9d0eb5abb9a4a982"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f92e5cff6b734d1f9d0eb5abb9a4a982"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f92e5cff6b734d1f9d0eb5abb9a4a982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f92e5cff6b734d1f9d0eb5abb9a4a982"}]}] Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestFqdnHostnames-402831250 Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: f92e5cff6b734d1f9d0eb5abb9a4a982 Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-402831250 Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestFqdnHostnames-402831250-project Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9c8cc51830a148959619a4944c88ad51 Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestFqdnHostnames-402831250-project Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 769febc7-82dc-4fbb-8510-8c2ab56332a1 could not be found. Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '769febc7-82dc-4fbb-8510-8c2ab56332a1'} Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769febc7-82dc-4fbb-8510-8c2ab56332a1 could not be found. Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769febc7-82dc-4fbb-8510-8c2ab56332a1 could not be found. Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:36.796850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.801068 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:36.801068 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:36.801068 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:36.801068 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:36.801068 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:36.801068 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769febc7-82dc-4fbb-8510-8c2ab56332a1 could not be found. Aug 27 02:33:36.801068 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:36.801068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Returning 404 to user: Instance 769febc7-82dc-4fbb-8510-8c2ab56332a1 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:36.801068 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3bffe38f-8f0f-4d29-9ab7-6c0da0e0b36a tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1" status: 404 len: 111 microversion: 2.1 time: 0.095217 Aug 27 02:33:36.820443 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 698/1329] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:36 2022] GET /compute/v2.1/servers/769febc7-82dc-4fbb-8510-8c2ab56332a1 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:33:36.835711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-400e86c4-0e2f-44dd-ac1b-6d2e0b2a8a38 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:36.836372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-400e86c4-0e2f-44dd-ac1b-6d2e0b2a8a38 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:36.868230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-400e86c4-0e2f-44dd-ac1b-6d2e0b2a8a38 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:36.868230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-400e86c4-0e2f-44dd-ac1b-6d2e0b2a8a38 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:36.868230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-400e86c4-0e2f-44dd-ac1b-6d2e0b2a8a38 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:36.868230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-400e86c4-0e2f-44dd-ac1b-6d2e0b2a8a38 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:36.868230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-400e86c4-0e2f-44dd-ac1b-6d2e0b2a8a38 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:36.868230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-400e86c4-0e2f-44dd-ac1b-6d2e0b2a8a38 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:36.932985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-400e86c4-0e2f-44dd-ac1b-6d2e0b2a8a38 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:33:37.056590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f8bf5b56-e665-4772-97ab-6006660c43b8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:37.086567 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f8bf5b56-e665-4772-97ab-6006660c43b8 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1536 microversion: 2.1 time: 0.690468 Aug 27 02:33:37.103456 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 632/1330] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:36 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1536 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:37.110833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1bd34e34-89a0-4728-a5a7-87f7dfa42d69 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a5a7040>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:37.114699 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-400e86c4-0e2f-44dd-ac1b-6d2e0b2a8a38 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 204 len: 0 microversion: 2.1 time: 0.292367 Aug 27 02:33:37.116218 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 699/1331] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:36 2022] DELETE /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:37.132180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bfa7e183-87b2-4044-826b-f717fe878ea3 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Calling method '.version_select at 0x7f4d2a2275e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:37.172302 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-bfa7e183-87b2-4044-826b-f717fe878ea3 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] HTTP exception thrown: Image not found. Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bfa7e183-87b2-4044-826b-f717fe878ea3 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Request method failure captured: Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/images/d656dd84-46cb-45c8-ac11-9139ce07f20j HTTP/1.1 Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYJ_Su3OmmRjPzMsZOpIipd44AzyXzAh5KmBHYG0iQptAvmMiiGCSLGddcz_EoN1Qxlc7pKIK9EX-Py5FGFoaRFXD84xgU96PgIusT5D8eH5pdH-oZcmqKzTSl48Lcm3Eo6e6-gbES16qPv3D3GsBcqm6VIUOHap21zbK3NKTadt7sI Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: e5694cde3e244fbaacbb7c625efdfecb Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e5694cde3e244fbaacbb7c625efdfecb"}]}] Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: e5694cde3e244fbaacbb7c625efdfecb Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesDeleteNegativeTestJSON-449643653-project Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f09308227f3c49b78fa4aed658a0fc2b Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-449643653-project Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd656dd84-46cb-45c8-ac11-9139ce07f20j'} Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d656dd84-46cb-45c8-ac11-9139ce07f20j to delete Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d656dd84-46cb-45c8-ac11-9139ce07f20j could not be found. Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:37.174466 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bfa7e183-87b2-4044-826b-f717fe878ea3 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bfa7e183-87b2-4044-826b-f717fe878ea3 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] 10.222.0.99 "DELETE /compute/v2.1/images/d656dd84-46cb-45c8-ac11-9139ce07f20j" status: 404 len: 62 microversion: 2.1 time: 0.056754 Aug 27 02:33:37.179482 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 700/1332] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:37 2022] DELETE /compute/v2.1/images/d656dd84-46cb-45c8-ac11-9139ce07f20j => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:33:37.188984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:37.190684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:37.213892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:37.214758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:37.220493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:37.222129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:37.223291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:37.224010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:37.461964 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1bd34e34-89a0-4728-a5a7-87f7dfa42d69 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7111 microversion: 2.1 time: 0.356823 Aug 27 02:33:37.467905 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 633/1333] 10.222.0.99 () {58 vars in 1170 bytes} [Sat Aug 27 02:33:37 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7111 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:37.478210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5d4ab86d-67c4-4063-8984-2c6d3c298faa tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] Calling method '.version_select at 0x7f4d2b260700>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:37.520446 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5d4ab86d-67c4-4063-8984-2c6d3c298faa tempest-ServersTestFqdnHostnames-402831250 tempest-ServersTestFqdnHostnames-402831250-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-947025529" status: 202 len: 0 microversion: 2.1 time: 0.050841 Aug 27 02:33:37.521260 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 634/1334] 10.222.0.99 () {58 vars in 1218 bytes} [Sat Aug 27 02:33:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-947025529 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:33:37.538291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1478abcc-2d90-4cb1-94db-d187a82f49b1 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:37.539128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1478abcc-2d90-4cb1-94db-d187a82f49b1 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:37.565690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1478abcc-2d90-4cb1-94db-d187a82f49b1 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:37.566517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1478abcc-2d90-4cb1-94db-d187a82f49b1 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:37.568060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1478abcc-2d90-4cb1-94db-d187a82f49b1 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:37.569220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1478abcc-2d90-4cb1-94db-d187a82f49b1 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:37.569998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1478abcc-2d90-4cb1-94db-d187a82f49b1 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:37.570667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1478abcc-2d90-4cb1-94db-d187a82f49b1 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:38.088620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:38.101806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:38.110264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:38.113634 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0621f2c2-cb72-4be6-b399-7a155f4ef788 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1569 microversion: 2.25 time: 0.934477 Aug 27 02:33:38.122906 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 701/1335] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:37 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1569 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:38.127990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-30acc8f7-9175-4bf0-915b-dad20a7ecd2b tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Calling method '.version_select at 0x7f4d2a14b280>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:38.151916 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-30acc8f7-9175-4bf0-915b-dad20a7ecd2b tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] HTTP exception thrown: Image not found. Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-30acc8f7-9175-4bf0-915b-dad20a7ecd2b tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Request method failure captured: Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/images/112939e7-e32d-43b7-bf6d-628b0a1724c91 HTTP/1.1 Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYJ_Su3OmmRjPzMsZOpIipd44AzyXzAh5KmBHYG0iQptAvmMiiGCSLGddcz_EoN1Qxlc7pKIK9EX-Py5FGFoaRFXD84xgU96PgIusT5D8eH5pdH-oZcmqKzTSl48Lcm3Eo6e6-gbES16qPv3D3GsBcqm6VIUOHap21zbK3NKTadt7sI Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: e5694cde3e244fbaacbb7c625efdfecb Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e5694cde3e244fbaacbb7c625efdfecb"}]}] Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: e5694cde3e244fbaacbb7c625efdfecb Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesDeleteNegativeTestJSON-449643653-project Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f09308227f3c49b78fa4aed658a0fc2b Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-449643653-project Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '112939e7-e32d-43b7-bf6d-628b0a1724c91'} Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 112939e7-e32d-43b7-bf6d-628b0a1724c91 to delete Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 112939e7-e32d-43b7-bf6d-628b0a1724c91 could not be found. Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:38.154352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-30acc8f7-9175-4bf0-915b-dad20a7ecd2b tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-30acc8f7-9175-4bf0-915b-dad20a7ecd2b tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] 10.222.0.99 "DELETE /compute/v2.1/images/112939e7-e32d-43b7-bf6d-628b0a1724c91" status: 404 len: 62 microversion: 2.1 time: 0.032110 Aug 27 02:33:38.159298 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 702/1336] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:38 2022] DELETE /compute/v2.1/images/112939e7-e32d-43b7-bf6d-628b0a1724c91 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:33:38.167782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:38.169945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:38.189586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:38.190142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:38.190565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:38.191646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:38.192134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:38.192574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:38.218420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:38.246088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:38.246838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:38.247476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:38.248138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lazy-loading 'fault' on Instance uuid 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:33:38.314467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1478abcc-2d90-4cb1-94db-d187a82f49b1 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:38.342880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc8ccc9dc94a01ba39a4559f45ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a00d8fd6e3d4ca7a84d3733b108a2d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:38.368517 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b4b59427-1c74-4b60-9ff6-1ad1cfa4ddd8 tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 200 len: 1307 microversion: 2.1 time: 0.210409 Aug 27 02:33:38.369227 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 703/1337] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:38 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 1307 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:38.374660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f37dffca-e920-410b-bc45-b9cba3b3d78a req-80c4e563-e643-4690-80da-8f1ff6d4b48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde6f25d-de52-4758-85c7-ce0b8471e481", "name": "network-vif-unplugged", "status": "completed", "tag": "5250e113-81ca-45c6-a466-ef24aace16e6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:38.390097 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1478abcc-2d90-4cb1-94db-d187a82f49b1 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1511 microversion: 2.1 time: 0.855904 Aug 27 02:33:38.402990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f37dffca-e920-410b-bc45-b9cba3b3d78a req-80c4e563-e643-4690-80da-8f1ff6d4b48c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:38.403862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f37dffca-e920-410b-bc45-b9cba3b3d78a req-80c4e563-e643-4690-80da-8f1ff6d4b48c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:38.404987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f37dffca-e920-410b-bc45-b9cba3b3d78a req-80c4e563-e643-4690-80da-8f1ff6d4b48c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:38.415752 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 635/1338] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:37 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1511 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:38.429075 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f37dffca-e920-410b-bc45-b9cba3b3d78a req-80c4e563-e643-4690-80da-8f1ff6d4b48c service nova] Creating event network-vif-unplugged:5250e113-81ca-45c6-a466-ef24aace16e6 for instance fde6f25d-de52-4758-85c7-ce0b8471e481 on n-h2-852084-5 Aug 27 02:33:38.445272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-f37dffca-e920-410b-bc45-b9cba3b3d78a req-80c4e563-e643-4690-80da-8f1ff6d4b48c service nova] Instance fde6f25d-de52-4758-85c7-ce0b8471e481 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:33:38.451358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-90b641a6-8a3c-4fb4-84b9-09d9b0646925 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2e8c9280>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:38.474909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f37dffca-e920-410b-bc45-b9cba3b3d78a req-80c4e563-e643-4690-80da-8f1ff6d4b48c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104494 Aug 27 02:33:38.479778 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 704/1339] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:38.517722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-29a7fdf9-0b8e-43a6-887f-e92894db2b1d req-d763af27-132d-48e6-a49b-63aad24ebaf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6", "name": "network-vif-deleted", "tag": "a4410061-b6ff-4b24-84b1-b3697016f31d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:38.548436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-29a7fdf9-0b8e-43a6-887f-e92894db2b1d req-d763af27-132d-48e6-a49b-63aad24ebaf1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:38.549622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-29a7fdf9-0b8e-43a6-887f-e92894db2b1d req-d763af27-132d-48e6-a49b-63aad24ebaf1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:38.551055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-29a7fdf9-0b8e-43a6-887f-e92894db2b1d req-d763af27-132d-48e6-a49b-63aad24ebaf1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:38.609104 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-90b641a6-8a3c-4fb4-84b9-09d9b0646925 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.187824 Aug 27 02:33:38.610167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-29a7fdf9-0b8e-43a6-887f-e92894db2b1d req-d763af27-132d-48e6-a49b-63aad24ebaf1 service nova] Creating event network-vif-deleted:a4410061-b6ff-4b24-84b1-b3697016f31d for instance 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 on n-h1-852084-5 Aug 27 02:33:38.633705 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 636/1340] 10.222.0.99 () {58 vars in 1170 bytes} [Sat Aug 27 02:33:38 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:38.633705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f1d0f0f7-efaf-49fe-90c3-697caa991118 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:38.633705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f1d0f0f7-efaf-49fe-90c3-697caa991118 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:38.634685 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-29a7fdf9-0b8e-43a6-887f-e92894db2b1d req-d763af27-132d-48e6-a49b-63aad24ebaf1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136584 Aug 27 02:33:38.644143 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 705/1341] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:38.644565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d0f0f7-efaf-49fe-90c3-697caa991118 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:38.644565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d0f0f7-efaf-49fe-90c3-697caa991118 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:38.644565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d0f0f7-efaf-49fe-90c3-697caa991118 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:38.644565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d0f0f7-efaf-49fe-90c3-697caa991118 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:38.644565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d0f0f7-efaf-49fe-90c3-697caa991118 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:38.645356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d0f0f7-efaf-49fe-90c3-697caa991118 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:38.664363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b96ee0c-3f1a-4521-8417-317042dc73b7 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Calling method '.version_select at 0x7f4d2a14b4c0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:38.714841 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9b96ee0c-3f1a-4521-8417-317042dc73b7 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] HTTP exception thrown: Image not found. Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b96ee0c-3f1a-4521-8417-317042dc73b7 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Request method failure captured: Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/images/tempest-invalid-1452133990 HTTP/1.1 Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYJ_Su3OmmRjPzMsZOpIipd44AzyXzAh5KmBHYG0iQptAvmMiiGCSLGddcz_EoN1Qxlc7pKIK9EX-Py5FGFoaRFXD84xgU96PgIusT5D8eH5pdH-oZcmqKzTSl48Lcm3Eo6e6-gbES16qPv3D3GsBcqm6VIUOHap21zbK3NKTadt7sI Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: e5694cde3e244fbaacbb7c625efdfecb Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e5694cde3e244fbaacbb7c625efdfecb"}]}] Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: e5694cde3e244fbaacbb7c625efdfecb Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesDeleteNegativeTestJSON-449643653-project Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f09308227f3c49b78fa4aed658a0fc2b Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-449643653-project Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'tempest-invalid-1452133990'} Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1452133990 to delete Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1452133990 could not be found. Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.719878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b96ee0c-3f1a-4521-8417-317042dc73b7 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9b96ee0c-3f1a-4521-8417-317042dc73b7 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] 10.222.0.99 "DELETE /compute/v2.1/images/tempest-invalid-1452133990" status: 404 len: 62 microversion: 2.1 time: 0.083181 Aug 27 02:33:38.724859 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 706/1342] 10.222.0.99 () {58 vars in 1206 bytes} [Sat Aug 27 02:33:38 2022] DELETE /compute/v2.1/images/tempest-invalid-1452133990 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:33:38.739450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a2d4cedb-34de-4860-9f8d-86c462afdf6b tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a227ee0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:38.831784 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a2d4cedb-34de-4860-9f8d-86c462afdf6b tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/6230fa40-aadc-49b6-823d-ddde81ab4f89" status: 200 len: 784 microversion: 2.1 time: 0.098992 Aug 27 02:33:38.832392 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 707/1343] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:33:38 2022] GET /compute/v2.1/images/6230fa40-aadc-49b6-823d-ddde81ab4f89 => generated 784 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:38.849903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d956674e-1a8c-4b3f-9430-914642e7d544 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Calling method '.version_select at 0x7f4d2a14b5e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:38.898674 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-d956674e-1a8c-4b3f-9430-914642e7d544 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] HTTP exception thrown: Image not found. Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d956674e-1a8c-4b3f-9430-914642e7d544 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Request method failure captured: Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/images/b4f604e0-a289-4969-b7dc-aee0ae263293 HTTP/1.1 Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYJ_Su3OmmRjPzMsZOpIipd44AzyXzAh5KmBHYG0iQptAvmMiiGCSLGddcz_EoN1Qxlc7pKIK9EX-Py5FGFoaRFXD84xgU96PgIusT5D8eH5pdH-oZcmqKzTSl48Lcm3Eo6e6-gbES16qPv3D3GsBcqm6VIUOHap21zbK3NKTadt7sI Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: e5694cde3e244fbaacbb7c625efdfecb Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e5694cde3e244fbaacbb7c625efdfecb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e5694cde3e244fbaacbb7c625efdfecb"}]}] Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: e5694cde3e244fbaacbb7c625efdfecb Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-449643653 Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesDeleteNegativeTestJSON-449643653-project Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f09308227f3c49b78fa4aed658a0fc2b Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-449643653-project Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'b4f604e0-a289-4969-b7dc-aee0ae263293'} Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b4f604e0-a289-4969-b7dc-aee0ae263293 to delete Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b4f604e0-a289-4969-b7dc-aee0ae263293 could not be found. Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:38.900472 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d956674e-1a8c-4b3f-9430-914642e7d544 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d956674e-1a8c-4b3f-9430-914642e7d544 tempest-ImagesDeleteNegativeTestJSON-449643653 tempest-ImagesDeleteNegativeTestJSON-449643653-project] 10.222.0.99 "DELETE /compute/v2.1/images/b4f604e0-a289-4969-b7dc-aee0ae263293" status: 404 len: 62 microversion: 2.1 time: 0.068587 Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 708/1344] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:38 2022] DELETE /compute/v2.1/images/b4f604e0-a289-4969-b7dc-aee0ae263293 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:33:38.909421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ce88bf6a-82ce-408a-8963-1d5ea7b860c3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a2278b0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:39.030780 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ce88bf6a-82ce-408a-8963-1d5ea7b860c3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.126853 Aug 27 02:33:39.053548 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 709/1345] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:33:38 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:39.072791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0255022e-0256-4c0a-9e08-161cc1871ef6 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a279820>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:39.619961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f1d0f0f7-efaf-49fe-90c3-697caa991118 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:39.656206 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f1d0f0f7-efaf-49fe-90c3-697caa991118 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1536 microversion: 2.1 time: 1.028003 Aug 27 02:33:39.657225 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 637/1346] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:38 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1536 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:39.670857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:39.671768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:39.686909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:39.705216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:39.707078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:39.707583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:39.708361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:39.711146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:39.712049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:40.468343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:40.577072 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0255022e-0256-4c0a-9e08-161cc1871ef6 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "DELETE /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438" status: 204 len: 0 microversion: 2.1 time: 1.508261 Aug 27 02:33:40.577905 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 710/1347] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:39 2022] DELETE /compute/v2.1/images/22000a00-a2a3-4c56-98c7-f72a260eb438 => generated 0 bytes in 1510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:40.583699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:40.584968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] [instance: 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:40.594692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:40.595622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:40.596240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:40.597166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:40.598420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:40.599450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:40.621659 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] HTTP exception thrown: Instance 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 could not be found. Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Request method failure captured: Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 HTTP/1.1 Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFiArvb-rYskcF60VDeh9IGe-8fG5nqIDUYRfckRT-johkRp2z_dM5DggVNK5zoDjAQXVpOp36HYdY-OV-xYQOhdWaDrHKYhKly94j0zV2ewhh3lS2z4ZNwVaFWh2Sd6V60UKntl8nEVOEhVKPqUiUHLmt1Ki9j66HyMVaxACQEzaw Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a00d8fd6e3d4ca7a84d3733b108a2d6"}]}] Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2a00d8fd6e3d4ca7a84d3733b108a2d6 Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1230407175 Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 71bc8ccc9dc94a01ba39a4559f45ccce Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersOnMultiNodesTest-1230407175-project Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 could not be found. Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6'} Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 could not be found. Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 could not be found. Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:40.623365 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:40.629577 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:40.629577 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:40.629577 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:40.629577 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:40.629577 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:40.629577 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 could not be found. Aug 27 02:33:40.629577 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:40.629577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] Returning 404 to user: Instance 3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:40.629577 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f29a55e5-f130-40ab-836a-8ab288e129ef tempest-ServersOnMultiNodesTest-1230407175 tempest-ServersOnMultiNodesTest-1230407175-project] 10.222.0.99 "GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6" status: 404 len: 111 microversion: 2.1 time: 0.045864 Aug 27 02:33:40.629577 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 711/1348] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:40 2022] GET /compute/v2.1/servers/3eb3476c-14f3-42e9-a4f3-4ce1ff6fc3a6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:33:40.633226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9365f21f-852a-42f9-8589-848a99464be5 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:40.633898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9365f21f-852a-42f9-8589-848a99464be5 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:40.640930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=16 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:40.645465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9365f21f-852a-42f9-8589-848a99464be5 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:40.645997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9365f21f-852a-42f9-8589-848a99464be5 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:40.646438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9365f21f-852a-42f9-8589-848a99464be5 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:40.647166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9365f21f-852a-42f9-8589-848a99464be5 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:40.647627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9365f21f-852a-42f9-8589-848a99464be5 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:40.648055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9365f21f-852a-42f9-8589-848a99464be5 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:40.787864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9365f21f-852a-42f9-8589-848a99464be5 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e317f0944745418758a9bec7064613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71a3b49da754429843aadfc5d96a539', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:40.802826 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9365f21f-852a-42f9-8589-848a99464be5 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 200 len: 1469 microversion: 2.1 time: 0.173758 Aug 27 02:33:40.809302 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 712/1349] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:40 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:40.819247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cc54a953-aea9-47f9-9627-187fbb906963 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbba3bdc-ad6e-489f-9951-637af640c5c4", "device": "/dev/xvdb"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:40.824230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cc54a953-aea9-47f9-9627-187fbb906963 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:40.832108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc54a953-aea9-47f9-9627-187fbb906963 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:40.832999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc54a953-aea9-47f9-9627-187fbb906963 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:40.833606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc54a953-aea9-47f9-9627-187fbb906963 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:40.834594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc54a953-aea9-47f9-9627-187fbb906963 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:40.835394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc54a953-aea9-47f9-9627-187fbb906963 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:40.836000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc54a953-aea9-47f9-9627-187fbb906963 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:41.288464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:41.298737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:41.312079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:41.314373 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c99a9b92-16f4-4974-8977-e05d8940c8a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1569 microversion: 2.25 time: 1.654611 Aug 27 02:33:41.330703 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 638/1350] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:39 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1569 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:41.342258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-40dc7103-e76c-49f0-8594-e288cbb6a583 req-0561aeea-75e3-4bf0-8925-20f278e260d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde6f25d-de52-4758-85c7-ce0b8471e481", "tag": "5250e113-81ca-45c6-a466-ef24aace16e6"}, {"server_uuid": "93453131-995a-46d6-848d-ec13cb596c67", "name": "network-vif-unplugged", "status": "completed", "tag": "22fd1df6-6d25-4d2d-a30d-bb3482bb2130"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:41.355288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-40dc7103-e76c-49f0-8594-e288cbb6a583 req-0561aeea-75e3-4bf0-8925-20f278e260d7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:41.356159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-40dc7103-e76c-49f0-8594-e288cbb6a583 req-0561aeea-75e3-4bf0-8925-20f278e260d7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:41.357394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-40dc7103-e76c-49f0-8594-e288cbb6a583 req-0561aeea-75e3-4bf0-8925-20f278e260d7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:41.373322 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-40dc7103-e76c-49f0-8594-e288cbb6a583 req-0561aeea-75e3-4bf0-8925-20f278e260d7 service nova] Creating event network-changed:5250e113-81ca-45c6-a466-ef24aace16e6 for instance fde6f25d-de52-4758-85c7-ce0b8471e481 on n-h2-852084-5 Aug 27 02:33:41.374165 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-40dc7103-e76c-49f0-8594-e288cbb6a583 req-0561aeea-75e3-4bf0-8925-20f278e260d7 service nova] Creating event network-vif-unplugged:22fd1df6-6d25-4d2d-a30d-bb3482bb2130 for instance 93453131-995a-46d6-848d-ec13cb596c67 on n-h1-852084-5 Aug 27 02:33:41.381701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-40dc7103-e76c-49f0-8594-e288cbb6a583 req-0561aeea-75e3-4bf0-8925-20f278e260d7 service nova] Instance fde6f25d-de52-4758-85c7-ce0b8471e481 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:33:41.400663 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-40dc7103-e76c-49f0-8594-e288cbb6a583 req-0561aeea-75e3-4bf0-8925-20f278e260d7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.068117 Aug 27 02:33:41.401839 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 639/1351] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:41.409245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-857eb116-5dd5-409a-b632-82d038f66bb0 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a5c6c10>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:41.495038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=20 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:42.156688 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cc54a953-aea9-47f9-9627-187fbb906963 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "POST /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.344319 Aug 27 02:33:42.160022 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 713/1352] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 02:33:40 2022] POST /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments => generated 194 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:42.166847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fbeba782-9aed-46c5-bb69-273f91b236b0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:42.167978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fbeba782-9aed-46c5-bb69-273f91b236b0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:42.205182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbeba782-9aed-46c5-bb69-273f91b236b0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:42.206332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbeba782-9aed-46c5-bb69-273f91b236b0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:42.206805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbeba782-9aed-46c5-bb69-273f91b236b0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:42.207777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbeba782-9aed-46c5-bb69-273f91b236b0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:42.209406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbeba782-9aed-46c5-bb69-273f91b236b0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:42.210097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbeba782-9aed-46c5-bb69-273f91b236b0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:42.525472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fbeba782-9aed-46c5-bb69-273f91b236b0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:42.537855 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fbeba782-9aed-46c5-bb69-273f91b236b0 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1536 microversion: 2.1 time: 0.376406 Aug 27 02:33:42.539251 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 714/1353] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:42 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1536 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:42.548144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:42.549577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] [instance: 4f011f2b-bbd2-4dfb-8dda-1942eec66691] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:42.557867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:42.558660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:42.560295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:42.561863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:42.562840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:42.564129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:42.589110 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] HTTP exception thrown: Instance 4f011f2b-bbd2-4dfb-8dda-1942eec66691 could not be found. Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Request method failure captured: Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 HTTP/1.1 Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYJkwdOjwdtYLh-ArlkVBG5oueB-GW-O1Km2Y8orbXQ6Lruff4NSPNzyGM9840-zmQb1YQ_JB7YhZUpUChopbeu4qLN5z50LxcKhBP-jnTTYuNLHF9OLuHMcguVWDUuQmmQBWzpUYFvvKGDM5vAqChCzilKlaO4iaKN4iK2-a26huGk Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a71a3b49da754429843aadfc5d96a539 Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerAddressesTestJSON-67687474 Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a71a3b49da754429843aadfc5d96a539"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a71a3b49da754429843aadfc5d96a539"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a71a3b49da754429843aadfc5d96a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a71a3b49da754429843aadfc5d96a539"}]}] Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerAddressesTestJSON-67687474 Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a71a3b49da754429843aadfc5d96a539 Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerAddressesTestJSON-67687474 Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerAddressesTestJSON-67687474-project Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: a2e317f0944745418758a9bec7064613 Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerAddressesTestJSON-67687474-project Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 4f011f2b-bbd2-4dfb-8dda-1942eec66691 could not be found. Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4f011f2b-bbd2-4dfb-8dda-1942eec66691'} Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f011f2b-bbd2-4dfb-8dda-1942eec66691 could not be found. Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f011f2b-bbd2-4dfb-8dda-1942eec66691 could not be found. Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:42.591402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:42.596370 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:42.596370 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:42.596370 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:42.596370 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:42.596370 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:42.596370 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f011f2b-bbd2-4dfb-8dda-1942eec66691 could not be found. Aug 27 02:33:42.596370 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:42.598286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] Returning 404 to user: Instance 4f011f2b-bbd2-4dfb-8dda-1942eec66691 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:42.599392 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec4fd454-51b0-4476-a419-328feb281761 tempest-ServerAddressesTestJSON-67687474 tempest-ServerAddressesTestJSON-67687474-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691" status: 404 len: 111 microversion: 2.1 time: 0.058832 Aug 27 02:33:42.601331 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 715/1354] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:42 2022] GET /compute/v2.1/servers/4f011f2b-bbd2-4dfb-8dda-1942eec66691 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:33:42.612247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:42.613550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:42.621461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:42.622845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:42.623492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:42.624525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:42.625214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:42.627835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:42.664129 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-857eb116-5dd5-409a-b632-82d038f66bb0 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "DELETE /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2" status: 204 len: 0 microversion: 2.1 time: 1.260833 Aug 27 02:33:42.669312 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 640/1355] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:41 2022] DELETE /compute/v2.1/images/2424b056-a67f-4518-b73e-363e11e41ce2 => generated 0 bytes in 1262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:42.677502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a6b37b7-69ca-4433-81ed-e805da3bea9c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2e902700>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:43.143755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:43.163096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:43.164602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:43.178327 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ba2d96ea-0ca6-4fca-b59a-f3c2a5c38268 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1569 microversion: 2.25 time: 0.561866 Aug 27 02:33:43.188423 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 716/1356] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:42 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1569 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:43.442712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9b6bcec1-b3a3-4045-96ce-99cbc263a197 req-2a837bf4-541e-4cc7-a06d-e9ca1ca7a933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f011f2b-bbd2-4dfb-8dda-1942eec66691", "name": "network-vif-deleted", "tag": "338e8e88-1a8d-4cd1-bcf2-aaa6ac3816e8"}, {"name": "network-changed", "server_uuid": "93453131-995a-46d6-848d-ec13cb596c67", "tag": "22fd1df6-6d25-4d2d-a30d-bb3482bb2130"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:43.503382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b6bcec1-b3a3-4045-96ce-99cbc263a197 req-2a837bf4-541e-4cc7-a06d-e9ca1ca7a933 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:43.504251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b6bcec1-b3a3-4045-96ce-99cbc263a197 req-2a837bf4-541e-4cc7-a06d-e9ca1ca7a933 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:43.505029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b6bcec1-b3a3-4045-96ce-99cbc263a197 req-2a837bf4-541e-4cc7-a06d-e9ca1ca7a933 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:43.584192 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9b6bcec1-b3a3-4045-96ce-99cbc263a197 req-2a837bf4-541e-4cc7-a06d-e9ca1ca7a933 service nova] Creating event network-vif-deleted:338e8e88-1a8d-4cd1-bcf2-aaa6ac3816e8 for instance 4f011f2b-bbd2-4dfb-8dda-1942eec66691 on n-h2-852084-5 Aug 27 02:33:43.585128 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9b6bcec1-b3a3-4045-96ce-99cbc263a197 req-2a837bf4-541e-4cc7-a06d-e9ca1ca7a933 service nova] Creating event network-changed:22fd1df6-6d25-4d2d-a30d-bb3482bb2130 for instance 93453131-995a-46d6-848d-ec13cb596c67 on n-h1-852084-5 Aug 27 02:33:43.636626 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9b6bcec1-b3a3-4045-96ce-99cbc263a197 req-2a837bf4-541e-4cc7-a06d-e9ca1ca7a933 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.208412 Aug 27 02:33:43.643993 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 717/1357] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:33:43.679563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b3011848-9780-4ec1-a039-0891c5faf760 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:43.688932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b3011848-9780-4ec1-a039-0891c5faf760 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:43.729862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3011848-9780-4ec1-a039-0891c5faf760 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:43.730669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3011848-9780-4ec1-a039-0891c5faf760 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:43.731855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3011848-9780-4ec1-a039-0891c5faf760 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:43.752095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3011848-9780-4ec1-a039-0891c5faf760 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:43.752939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3011848-9780-4ec1-a039-0891c5faf760 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:43.761050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3011848-9780-4ec1-a039-0891c5faf760 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:44.935656 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4a6b37b7-69ca-4433-81ed-e805da3bea9c tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "DELETE /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2" status: 204 len: 0 microversion: 2.1 time: 2.264376 Aug 27 02:33:44.939780 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 641/1358] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:42 2022] DELETE /compute/v2.1/images/2fdb03c5-0487-4909-9487-d0dac78570c2 => generated 0 bytes in 2268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:44.952105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:44.953776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:44.957108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b3011848-9780-4ec1-a039-0891c5faf760 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:44.987520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:44.988220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:44.988508 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b3011848-9780-4ec1-a039-0891c5faf760 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1536 microversion: 2.1 time: 1.337959 Aug 27 02:33:44.988884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:44.990483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:44.991866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:44.996449 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 718/1359] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:43 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1536 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:44.997306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:45.024264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74a06f34-7f81-44f1-8134-3ad6f1c91add tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:45.035078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-74a06f34-7f81-44f1-8134-3ad6f1c91add tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:45.072740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74a06f34-7f81-44f1-8134-3ad6f1c91add tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:45.073898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74a06f34-7f81-44f1-8134-3ad6f1c91add tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:45.077196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74a06f34-7f81-44f1-8134-3ad6f1c91add tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:45.079922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74a06f34-7f81-44f1-8134-3ad6f1c91add tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:45.081478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74a06f34-7f81-44f1-8134-3ad6f1c91add tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:45.084533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74a06f34-7f81-44f1-8134-3ad6f1c91add tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:45.146802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-74a06f34-7f81-44f1-8134-3ad6f1c91add tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:33:45.358819 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-74a06f34-7f81-44f1-8134-3ad6f1c91add tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 204 len: 0 microversion: 2.1 time: 0.355574 Aug 27 02:33:45.359954 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 719/1360] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:44 2022] DELETE /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:45.371699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bbf2ad4e-fed1-4a22-b6ed-1e33f8503353 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:45.374999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bbf2ad4e-fed1-4a22-b6ed-1e33f8503353 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:45.385369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad4e-fed1-4a22-b6ed-1e33f8503353 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:45.386365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad4e-fed1-4a22-b6ed-1e33f8503353 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:45.386993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad4e-fed1-4a22-b6ed-1e33f8503353 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:45.389285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad4e-fed1-4a22-b6ed-1e33f8503353 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:45.390287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad4e-fed1-4a22-b6ed-1e33f8503353 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:45.391588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbf2ad4e-fed1-4a22-b6ed-1e33f8503353 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:45.709822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=5 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:45.902113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bbf2ad4e-fed1-4a22-b6ed-1e33f8503353 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:45.912227 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bbf2ad4e-fed1-4a22-b6ed-1e33f8503353 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1473 microversion: 2.1 time: 0.547674 Aug 27 02:33:45.926473 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 720/1361] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:45 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1473 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:33:46.035873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eac749e1-4783-4329-ad0c-f5aee84b3ecf tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:46.040774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eac749e1-4783-4329-ad0c-f5aee84b3ecf tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:46.068573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eac749e1-4783-4329-ad0c-f5aee84b3ecf tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:46.086073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eac749e1-4783-4329-ad0c-f5aee84b3ecf tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:46.087171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eac749e1-4783-4329-ad0c-f5aee84b3ecf tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:46.092181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eac749e1-4783-4329-ad0c-f5aee84b3ecf tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:46.093243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eac749e1-4783-4329-ad0c-f5aee84b3ecf tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:46.094177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eac749e1-4783-4329-ad0c-f5aee84b3ecf tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:46.210745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:46.222944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:46.231093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:46.233079 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6a41db87-9594-44c3-9a59-2603f3019f05 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1569 microversion: 2.25 time: 1.291907 Aug 27 02:33:46.235410 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 642/1362] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:44 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1569 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:46.514802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eac749e1-4783-4329-ad0c-f5aee84b3ecf tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:46.527748 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eac749e1-4783-4329-ad0c-f5aee84b3ecf tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1529 microversion: 2.1 time: 0.500942 Aug 27 02:33:46.529083 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 721/1363] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:46 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1529 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:33:46.567175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c8914f15-a16d-41de-8f3b-48483244d8e9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:46.568293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c8914f15-a16d-41de-8f3b-48483244d8e9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:46.592675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8914f15-a16d-41de-8f3b-48483244d8e9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:46.593518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8914f15-a16d-41de-8f3b-48483244d8e9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:46.594300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8914f15-a16d-41de-8f3b-48483244d8e9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:46.595528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8914f15-a16d-41de-8f3b-48483244d8e9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:46.596255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8914f15-a16d-41de-8f3b-48483244d8e9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:46.596981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8914f15-a16d-41de-8f3b-48483244d8e9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:46.945031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-681b1454-68b0-497e-a17d-39aa875ceb66 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:46.946366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-681b1454-68b0-497e-a17d-39aa875ceb66 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:46.988879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-681b1454-68b0-497e-a17d-39aa875ceb66 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:46.992420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-681b1454-68b0-497e-a17d-39aa875ceb66 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:46.992420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-681b1454-68b0-497e-a17d-39aa875ceb66 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:46.997501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-681b1454-68b0-497e-a17d-39aa875ceb66 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:47.004848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-681b1454-68b0-497e-a17d-39aa875ceb66 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:47.010506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-681b1454-68b0-497e-a17d-39aa875ceb66 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:47.711695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-681b1454-68b0-497e-a17d-39aa875ceb66 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:47.736717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-681b1454-68b0-497e-a17d-39aa875ceb66 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1473 microversion: 2.1 time: 0.798285 Aug 27 02:33:47.738536 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 722/1364] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:46 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1473 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:47.746380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:47.748381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:47.759585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:47.760848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:47.761965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:47.764110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:47.765199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:47.766216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:48.243549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c8914f15-a16d-41de-8f3b-48483244d8e9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:48.266108 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c8914f15-a16d-41de-8f3b-48483244d8e9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1529 microversion: 2.1 time: 1.707797 Aug 27 02:33:48.267983 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 643/1365] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:46 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1529 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:48.269224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:48.287747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-659927dd-0202-4876-bc9f-f64d049707f6 req-dcc30585-1d68-42b8-9a3b-23acffdb15b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde6f25d-de52-4758-85c7-ce0b8471e481", "name": "network-vif-plugged", "status": "completed", "tag": "5250e113-81ca-45c6-a466-ef24aace16e6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:48.302444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:48.304631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:48.312760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-659927dd-0202-4876-bc9f-f64d049707f6 req-dcc30585-1d68-42b8-9a3b-23acffdb15b0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:48.314464 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9060b0bd-5e55-4166-94e4-0fe720b89949 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1569 microversion: 2.25 time: 0.574091 Aug 27 02:33:48.316905 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 723/1366] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:47 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1569 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:48.317598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-659927dd-0202-4876-bc9f-f64d049707f6 req-dcc30585-1d68-42b8-9a3b-23acffdb15b0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:48.319657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-659927dd-0202-4876-bc9f-f64d049707f6 req-dcc30585-1d68-42b8-9a3b-23acffdb15b0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:48.363079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-15feeee2-3d90-4cff-aec7-aa3344e927ca tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:48.374573 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-659927dd-0202-4876-bc9f-f64d049707f6 req-dcc30585-1d68-42b8-9a3b-23acffdb15b0 service nova] Creating event network-vif-plugged:5250e113-81ca-45c6-a466-ef24aace16e6 for instance fde6f25d-de52-4758-85c7-ce0b8471e481 on n-h2-852084-5 Aug 27 02:33:48.378079 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-15feeee2-3d90-4cff-aec7-aa3344e927ca tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] HTTP exception thrown: Flavor 5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1 could not be found. Aug 27 02:33:48.385534 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-659927dd-0202-4876-bc9f-f64d049707f6 req-dcc30585-1d68-42b8-9a3b-23acffdb15b0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115183 Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-15feeee2-3d90-4cff-aec7-aa3344e927ca tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Request method failure captured: Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/flavors/5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1 HTTP/1.1 Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFxBj6VNXraqmm8RjoKAImV8_SEcMPet7yHRvbc5aX5GgTsVM_zKQs67oQHMCpGM1pLbtIctg-NtzhPuj5Y_7f2ZIGY6hwShYF8Ks-1D4Pn8wXHqAkyZ1QD_dYyf1BhPRHniYGEgC4W0pNMXq0Q5tzT_cye7z7ASyqI9OXgIt9YlbY Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 9a7c703be30d4f2394eb3b429d960c4a Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-MigrationsAdminTest-1435903248 Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9a7c703be30d4f2394eb3b429d960c4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9a7c703be30d4f2394eb3b429d960c4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9a7c703be30d4f2394eb3b429d960c4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9a7c703be30d4f2394eb3b429d960c4a"}]}] Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-MigrationsAdminTest-1435903248 Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 9a7c703be30d4f2394eb3b429d960c4a Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-MigrationsAdminTest-1435903248 Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-MigrationsAdminTest-1435903248-project-admin Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 3b495fa3d17c4dfab48a2985eba66e5b Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-MigrationsAdminTest-1435903248-project-admin Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: exception: Flavor 5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1 could not be found. Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1'} Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1 could not be found. Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1 could not be found. Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:48.393631 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:48.400870 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:48.400870 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:48.400870 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:48.400870 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:48.400870 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:48.400870 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:48.400870 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1 could not be found. Aug 27 02:33:48.400870 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:48.410549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-15feeee2-3d90-4cff-aec7-aa3344e927ca tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Returning 404 to user: Flavor 5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:48.413349 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-15feeee2-3d90-4cff-aec7-aa3344e927ca tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1" status: 404 len: 109 microversion: 2.1 time: 0.092640 Aug 27 02:33:48.416216 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 724/1367] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:48 2022] DELETE /compute/v2.1/flavors/5c1fc7bd-0029-4a1e-ab80-de4ec63f96b1 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:33:48.416841 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 644/1368] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:48.652161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-780578687", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:48.764253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65fbe0cb-af81-4400-aad5-aa45db934d3d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:48.766373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65fbe0cb-af81-4400-aad5-aa45db934d3d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:48.823216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:33:48.828094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65fbe0cb-af81-4400-aad5-aa45db934d3d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:48.830168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65fbe0cb-af81-4400-aad5-aa45db934d3d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:48.833043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65fbe0cb-af81-4400-aad5-aa45db934d3d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:48.839442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65fbe0cb-af81-4400-aad5-aa45db934d3d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:48.847695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65fbe0cb-af81-4400-aad5-aa45db934d3d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:48.850579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65fbe0cb-af81-4400-aad5-aa45db934d3d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:49.877381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-65fbe0cb-af81-4400-aad5-aa45db934d3d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:49.896318 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65fbe0cb-af81-4400-aad5-aa45db934d3d tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1473 microversion: 2.1 time: 1.140851 Aug 27 02:33:49.897163 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 645/1369] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:48 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1473 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:33:49.902276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:49.903749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:49.922490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:49.923265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:49.923952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:49.924937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:49.925696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:49.926321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:50.482827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:50.502518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:50.504354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:50.505045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:33:50.505832 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d6d415aa-6329-4bda-8269-8eee5e47681f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1569 microversion: 2.25 time: 0.607455 Aug 27 02:33:50.506568 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 646/1370] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:49 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1569 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:50.521540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:33:50.521540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:33:50.521540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:33:50.521540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:33:50.521540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:50.555461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:50.563256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:50.564303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:50.568243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:50.572661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:50.575114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:50.663623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-cf81799e-277d-44c1-93c4-ba758e0c5e40 req-93dff69a-fd52-412d-8eb3-6f7c9741e225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ca656b0-e5d0-4749-87bd-c63080424cd0", "name": "network-vif-deleted", "tag": "223e9ede-b571-4dec-8f18-e6f0edf208cc"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:50.671466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:33:50.684860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cf81799e-277d-44c1-93c4-ba758e0c5e40 req-93dff69a-fd52-412d-8eb3-6f7c9741e225 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:50.686949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cf81799e-277d-44c1-93c4-ba758e0c5e40 req-93dff69a-fd52-412d-8eb3-6f7c9741e225 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:50.698085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cf81799e-277d-44c1-93c4-ba758e0c5e40 req-93dff69a-fd52-412d-8eb3-6f7c9741e225 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:50.711941 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-cf81799e-277d-44c1-93c4-ba758e0c5e40 req-93dff69a-fd52-412d-8eb3-6f7c9741e225 service nova] Creating event network-vif-deleted:223e9ede-b571-4dec-8f18-e6f0edf208cc for instance 9ca656b0-e5d0-4749-87bd-c63080424cd0 on n-h1-852084-5 Aug 27 02:33:50.712615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Getting quotas for user d1624ef00b144dafbaff7ae5c677e7a3 and project a547cdcaa55b41f8865fac16ef8fd99c. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:33:50.727707 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-cf81799e-277d-44c1-93c4-ba758e0c5e40 req-93dff69a-fd52-412d-8eb3-6f7c9741e225 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067736 Aug 27 02:33:50.729066 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 647/1371] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:33:50.777144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:33:50.782160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:33:50.925988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:50.928050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:50.941418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:50.946057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:50.947625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:50.948706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:50.952325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:50.953084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:50.964138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:50.979286 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-62cb7427-087a-4bdb-9218-217eab326ba6 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.335655 Aug 27 02:33:50.985640 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 725/1372] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:33:51.014962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e6075613-86df-45fb-b034-adec84de994e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:51.018499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e6075613-86df-45fb-b034-adec84de994e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:51.100703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:51.101515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:51.102541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:51.103333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lazy-loading 'fault' on Instance uuid 9ca656b0-e5d0-4749-87bd-c63080424cd0 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:33:51.482261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:51.513912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e6075613-86df-45fb-b034-adec84de994e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:51.514755 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9e7c4ba8-d36e-48e7-8329-490556a13f88 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 200 len: 1308 microversion: 2.1 time: 0.594677 Aug 27 02:33:51.516287 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 648/1373] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:50 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 1308 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:51.532815 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e6075613-86df-45fb-b034-adec84de994e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1212 microversion: 2.1 time: 0.540385 Aug 27 02:33:51.535276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:51.536559 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 726/1374] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:50 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1212 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:51.544845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:51.584252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:51.585066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:51.585811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:51.595183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:51.595962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:51.596664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:52.042721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:52.057900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:52.060069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:52.066185 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7a09ba6-437c-4365-b25a-a152c27a5eff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1569 microversion: 2.25 time: 0.540071 Aug 27 02:33:52.068846 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 649/1375] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:51 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1569 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:52.545923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:52.546761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: 9ca656b0-e5d0-4749-87bd-c63080424cd0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:52.569405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:52.569985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-792c0530-ce06-4056-9cef-50de0d07b37e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:52.570195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:52.570949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-792c0530-ce06-4056-9cef-50de0d07b37e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:52.571081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:52.572282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:52.573157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:52.580650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-792c0530-ce06-4056-9cef-50de0d07b37e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:52.581156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-792c0530-ce06-4056-9cef-50de0d07b37e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:52.581594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-792c0530-ce06-4056-9cef-50de0d07b37e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:52.582354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-792c0530-ce06-4056-9cef-50de0d07b37e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:52.582765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:52.582966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-792c0530-ce06-4056-9cef-50de0d07b37e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:52.583230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-792c0530-ce06-4056-9cef-50de0d07b37e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:52.636706 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] HTTP exception thrown: Instance 9ca656b0-e5d0-4749-87bd-c63080424cd0 could not be found. Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Request method failure captured: Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 HTTP/1.1 Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYHS5HJI_JFsz-Uq4G5CehjDmw4SydbaBv_weU-gXYb52kiwPzTBkgBBJDrou5JE6VoTPBbQ2fB7it8n2sPcXV3fcymSqk5QHKRst2mdUuax3rQGmMFZX9h8goifLAdJavfTpxEZDOSwFtU7PHFDgASbTOT9UEfaHZWZwvsHcOtma8M Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 21188dd4400446eda20c20a20dd047d2 Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ListImageFiltersTestJSON-1940734028 Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_21188dd4400446eda20c20a20dd047d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/21188dd4400446eda20c20a20dd047d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/21188dd4400446eda20c20a20dd047d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/21188dd4400446eda20c20a20dd047d2"}]}] Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ListImageFiltersTestJSON-1940734028 Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 21188dd4400446eda20c20a20dd047d2 Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1940734028 Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ListImageFiltersTestJSON-1940734028-project Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9cdd5b13c6384b0283eafe98beaa1988 Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ListImageFiltersTestJSON-1940734028-project Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 9ca656b0-e5d0-4749-87bd-c63080424cd0 could not be found. Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '9ca656b0-e5d0-4749-87bd-c63080424cd0'} Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ca656b0-e5d0-4749-87bd-c63080424cd0 could not be found. Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ca656b0-e5d0-4749-87bd-c63080424cd0 could not be found. Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:33:52.645294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:52.653648 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:33:52.653648 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:33:52.653648 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:33:52.653648 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:33:52.653648 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:33:52.653648 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ca656b0-e5d0-4749-87bd-c63080424cd0 could not be found. Aug 27 02:33:52.653648 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:33:52.658609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Returning 404 to user: Instance 9ca656b0-e5d0-4749-87bd-c63080424cd0 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:33:52.658609 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9584df29-3535-4c78-ae78-b4f86ead76f3 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0" status: 404 len: 111 microversion: 2.1 time: 0.117448 Aug 27 02:33:52.666531 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 727/1376] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:52 2022] GET /compute/v2.1/servers/9ca656b0-e5d0-4749-87bd-c63080424cd0 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:33:52.679984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-62421020-0ae6-4113-a178-74dc9a515ff8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:52.690964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-62421020-0ae6-4113-a178-74dc9a515ff8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:52.706767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62421020-0ae6-4113-a178-74dc9a515ff8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:52.709205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62421020-0ae6-4113-a178-74dc9a515ff8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:52.709871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62421020-0ae6-4113-a178-74dc9a515ff8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:52.710793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62421020-0ae6-4113-a178-74dc9a515ff8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:52.714457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62421020-0ae6-4113-a178-74dc9a515ff8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:52.715177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62421020-0ae6-4113-a178-74dc9a515ff8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:52.719147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:33:52.851064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-62421020-0ae6-4113-a178-74dc9a515ff8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:33:52.931777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-792c0530-ce06-4056-9cef-50de0d07b37e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:52.947847 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-792c0530-ce06-4056-9cef-50de0d07b37e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1216 microversion: 2.1 time: 0.383191 Aug 27 02:33:52.956589 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 650/1377] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:52 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1216 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:33:53.120278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:53.121355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:53.158868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:53.159754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:53.160560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:53.161943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:53.162923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:53.163679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:53.206910 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-62421020-0ae6-4113-a178-74dc9a515ff8 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79" status: 204 len: 0 microversion: 2.1 time: 0.533441 Aug 27 02:33:53.207465 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 728/1378] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:33:52 2022] DELETE /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:33:53.222844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fee1c9fa-1e9c-4b54-ac6e-aecaf97e7667 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:53.225722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fee1c9fa-1e9c-4b54-ac6e-aecaf97e7667 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:53.244180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee1c9fa-1e9c-4b54-ac6e-aecaf97e7667 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:53.244690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee1c9fa-1e9c-4b54-ac6e-aecaf97e7667 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:53.245141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee1c9fa-1e9c-4b54-ac6e-aecaf97e7667 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:53.251087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee1c9fa-1e9c-4b54-ac6e-aecaf97e7667 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:53.253949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee1c9fa-1e9c-4b54-ac6e-aecaf97e7667 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:53.254494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fee1c9fa-1e9c-4b54-ac6e-aecaf97e7667 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:54.127926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:54.158363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:54.170063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:54.174710 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1ea67948-f271-4100-846f-7c88d7103eab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1569 microversion: 2.25 time: 1.066518 Aug 27 02:33:54.175765 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 651/1379] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:53 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1569 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:33:54.190617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-944e5971-1d0d-4a57-80c5-83bf4c98895d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:54.191323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-944e5971-1d0d-4a57-80c5-83bf4c98895d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:54.208111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-944e5971-1d0d-4a57-80c5-83bf4c98895d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:54.211785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-944e5971-1d0d-4a57-80c5-83bf4c98895d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:54.212733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-944e5971-1d0d-4a57-80c5-83bf4c98895d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:54.213779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-944e5971-1d0d-4a57-80c5-83bf4c98895d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:54.217623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-944e5971-1d0d-4a57-80c5-83bf4c98895d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:54.218409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-944e5971-1d0d-4a57-80c5-83bf4c98895d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:54.769144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fee1c9fa-1e9c-4b54-ac6e-aecaf97e7667 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:54.779953 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fee1c9fa-1e9c-4b54-ac6e-aecaf97e7667 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79" status: 200 len: 1472 microversion: 2.1 time: 1.567379 Aug 27 02:33:54.783034 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 729/1380] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:53 2022] GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 1472 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:54.920628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-944e5971-1d0d-4a57-80c5-83bf4c98895d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:54.935917 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-944e5971-1d0d-4a57-80c5-83bf4c98895d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1270 microversion: 2.1 time: 0.755246 Aug 27 02:33:54.939275 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 652/1381] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:54 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1270 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:55.228949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:55.230074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:55.248016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:55.248649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:55.258960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:55.260272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:55.261025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:55.272795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:55.825004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-20b0c4e6-7032-47e5-9a73-f575b511b5ce tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:55.826434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-20b0c4e6-7032-47e5-9a73-f575b511b5ce tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:55.853881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b0c4e6-7032-47e5-9a73-f575b511b5ce tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:55.858689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b0c4e6-7032-47e5-9a73-f575b511b5ce tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:55.859899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b0c4e6-7032-47e5-9a73-f575b511b5ce tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:55.861167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b0c4e6-7032-47e5-9a73-f575b511b5ce tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:55.861934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b0c4e6-7032-47e5-9a73-f575b511b5ce tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:55.862608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b0c4e6-7032-47e5-9a73-f575b511b5ce tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:56.813886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:56.829200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:56.833246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:56.838226 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ddb3525e-a6df-4253-a073-2ca0985e74a6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1569 microversion: 2.25 time: 1.610706 Aug 27 02:33:56.838891 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 730/1382] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:55 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1569 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:56.851951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f81023a5-a542-4f5c-bb27-eec71162998c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:56.852814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f81023a5-a542-4f5c-bb27-eec71162998c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:56.878739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81023a5-a542-4f5c-bb27-eec71162998c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:56.880985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81023a5-a542-4f5c-bb27-eec71162998c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:56.881788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81023a5-a542-4f5c-bb27-eec71162998c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:56.882577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81023a5-a542-4f5c-bb27-eec71162998c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:56.883070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81023a5-a542-4f5c-bb27-eec71162998c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:56.883485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f81023a5-a542-4f5c-bb27-eec71162998c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:57.118960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-20b0c4e6-7032-47e5-9a73-f575b511b5ce tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:57.124427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f81023a5-a542-4f5c-bb27-eec71162998c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:57.148068 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-20b0c4e6-7032-47e5-9a73-f575b511b5ce tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79" status: 200 len: 1472 microversion: 2.1 time: 1.329651 Aug 27 02:33:57.164526 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f81023a5-a542-4f5c-bb27-eec71162998c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1270 microversion: 2.1 time: 0.312503 Aug 27 02:33:57.165527 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 731/1383] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:56 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1270 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:57.185401 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 653/1384] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:55 2022] GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 1472 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:57.881214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:57.884503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:57.899068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:57.900385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:57.901542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:57.903256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:57.904517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:57.905534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:58.190402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ecf42011-7a58-4cc8-ab89-9d6fde8903ea tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:58.191513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ecf42011-7a58-4cc8-ab89-9d6fde8903ea tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:58.219771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf42011-7a58-4cc8-ab89-9d6fde8903ea tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:58.220544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf42011-7a58-4cc8-ab89-9d6fde8903ea tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:58.221220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf42011-7a58-4cc8-ab89-9d6fde8903ea tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:58.222392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf42011-7a58-4cc8-ab89-9d6fde8903ea tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:58.223105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf42011-7a58-4cc8-ab89-9d6fde8903ea tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:58.223723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf42011-7a58-4cc8-ab89-9d6fde8903ea tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:58.631692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:58.658723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:58.665721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:58.669278 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2492d533-46a3-498e-868f-4bd7f9e9742c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1559 microversion: 2.25 time: 0.795809 Aug 27 02:33:58.673114 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 732/1385] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:57 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1559 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:33:58.681134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-20c6c6aa-ea59-4792-92b3-ba7e370b0e85 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:58.683192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-20c6c6aa-ea59-4792-92b3-ba7e370b0e85 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:58.693897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20c6c6aa-ea59-4792-92b3-ba7e370b0e85 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:58.694871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20c6c6aa-ea59-4792-92b3-ba7e370b0e85 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:58.695880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20c6c6aa-ea59-4792-92b3-ba7e370b0e85 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:58.697006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20c6c6aa-ea59-4792-92b3-ba7e370b0e85 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:58.698405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20c6c6aa-ea59-4792-92b3-ba7e370b0e85 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:58.701073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20c6c6aa-ea59-4792-92b3-ba7e370b0e85 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:58.868849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ecf42011-7a58-4cc8-ab89-9d6fde8903ea tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:58.891636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-20c6c6aa-ea59-4792-92b3-ba7e370b0e85 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:33:58.898333 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ecf42011-7a58-4cc8-ab89-9d6fde8903ea tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79" status: 200 len: 1430 microversion: 2.1 time: 0.715123 Aug 27 02:33:58.917719 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 654/1386] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:58 2022] GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 1430 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:58.917719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-86e175fc-3804-4cb6-8c25-74a32a36d834 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '.version_select at 0x7f4d2af2a3a0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:58.930612 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-20c6c6aa-ea59-4792-92b3-ba7e370b0e85 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1270 microversion: 2.1 time: 0.255841 Aug 27 02:33:58.932825 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 733/1387] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:58 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1270 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:33:58.937834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86e175fc-3804-4cb6-8c25-74a32a36d834 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:58.950829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86e175fc-3804-4cb6-8c25-74a32a36d834 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:58.952199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86e175fc-3804-4cb6-8c25-74a32a36d834 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:58.987827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9092ff68-ca37-470e-95ce-9a31fbc58b29 req-5837b4e2-1ac1-4371-ba43-b9a3730c8f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f98f8456-cc9f-4772-97f1-99e056b99f79", "name": "network-vif-deleted", "tag": "466460c2-b76b-42d7-9cd5-1eab0a9cd335"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:33:58.989392 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-86e175fc-3804-4cb6-8c25-74a32a36d834 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-migrations" status: 200 len: 2786 microversion: 2.25 time: 0.080862 Aug 27 02:33:58.991329 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 655/1388] 10.222.0.99 () {60 vars in 1184 bytes} [Sat Aug 27 02:33:58 2022] GET /compute/v2.1/os-migrations => generated 2786 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:33:59.023592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f76fa3e-ccf1-4a53-bae3-ffb28b77fc32 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:59.030419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9092ff68-ca37-470e-95ce-9a31fbc58b29 req-5837b4e2-1ac1-4371-ba43-b9a3730c8f48 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:59.030745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5f76fa3e-ccf1-4a53-bae3-ffb28b77fc32 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:59.031466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9092ff68-ca37-470e-95ce-9a31fbc58b29 req-5837b4e2-1ac1-4371-ba43-b9a3730c8f48 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:59.036847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9092ff68-ca37-470e-95ce-9a31fbc58b29 req-5837b4e2-1ac1-4371-ba43-b9a3730c8f48 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:59.050748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f76fa3e-ccf1-4a53-bae3-ffb28b77fc32 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:59.051956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f76fa3e-ccf1-4a53-bae3-ffb28b77fc32 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:59.055048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f76fa3e-ccf1-4a53-bae3-ffb28b77fc32 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:59.059332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f76fa3e-ccf1-4a53-bae3-ffb28b77fc32 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:59.060751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f76fa3e-ccf1-4a53-bae3-ffb28b77fc32 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:59.062609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f76fa3e-ccf1-4a53-bae3-ffb28b77fc32 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:59.062868 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9092ff68-ca37-470e-95ce-9a31fbc58b29 req-5837b4e2-1ac1-4371-ba43-b9a3730c8f48 service nova] Creating event network-vif-deleted:466460c2-b76b-42d7-9cd5-1eab0a9cd335 for instance f98f8456-cc9f-4772-97f1-99e056b99f79 on n-h1-852084-5 Aug 27 02:33:59.083865 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9092ff68-ca37-470e-95ce-9a31fbc58b29 req-5837b4e2-1ac1-4371-ba43-b9a3730c8f48 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116305 Aug 27 02:33:59.085481 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 734/1389] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:33:59.951088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:33:59.954945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:33:59.979626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:59.984261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:59.986219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:33:59.989967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:33:59.991271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:33:59.992478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:00.080267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:00.088202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:00.092671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:00.094072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lazy-loading 'fault' on Instance uuid f98f8456-cc9f-4772-97f1-99e056b99f79 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:34:00.267359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:00.294929 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec2c03b7-6bf2-4173-9e94-8525a389b2dc tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79" status: 200 len: 1307 microversion: 2.1 time: 0.349541 Aug 27 02:34:00.329884 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 735/1390] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:33:59 2022] GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 1307 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:34:00.343832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-daeeffa9-79d3-437a-9b07-8a1802f505bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:00.353067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-daeeffa9-79d3-437a-9b07-8a1802f505bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:00.407653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-daeeffa9-79d3-437a-9b07-8a1802f505bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:00.411377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-daeeffa9-79d3-437a-9b07-8a1802f505bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:00.412077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-daeeffa9-79d3-437a-9b07-8a1802f505bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:00.415903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-daeeffa9-79d3-437a-9b07-8a1802f505bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:00.416747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-daeeffa9-79d3-437a-9b07-8a1802f505bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:00.417371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-daeeffa9-79d3-437a-9b07-8a1802f505bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:00.458462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-5f76fa3e-ccf1-4a53-bae3-ffb28b77fc32 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid 93453131-995a-46d6-848d-ec13cb596c67 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:34:00.482924 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5f76fa3e-ccf1-4a53-bae3-ffb28b77fc32 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 2052 microversion: 2.25 time: 1.471535 Aug 27 02:34:00.498277 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 656/1391] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:33:59 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 2052 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:00.630269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:00.694778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1794123284", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "fb40e9d4-9a6b-4f53-9e40-c59943eeffc8"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:00.803651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] validate_networks() for [('fb40e9d4-9a6b-4f53-9e40-c59943eeffc8', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:34:00.904328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-daeeffa9-79d3-437a-9b07-8a1802f505bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:00.920087 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-daeeffa9-79d3-437a-9b07-8a1802f505bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1312 microversion: 2.1 time: 0.585125 Aug 27 02:34:00.921331 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 736/1392] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:00 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1312 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:01.358225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:01.359515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:01.378078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:01.378920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:01.379707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:01.381020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:01.381873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:01.382576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:01.506470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:01.507949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:01.508779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:01.509781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lazy-loading 'fault' on Instance uuid f98f8456-cc9f-4772-97f1-99e056b99f79 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:34:01.526234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:01.741310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdd5b13c6384b0283eafe98beaa1988', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21188dd4400446eda20c20a20dd047d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:01.766261 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ee4add5-1039-46cf-a6b5-3f852878a669 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79" status: 200 len: 1307 microversion: 2.1 time: 0.423409 Aug 27 02:34:01.798293 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 737/1393] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:01 2022] GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 1307 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:34:01.955532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dfea936d-beca-4f8c-a201-3184d956e3af tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:01.958969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dfea936d-beca-4f8c-a201-3184d956e3af tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:01.988680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfea936d-beca-4f8c-a201-3184d956e3af tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:01.989589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfea936d-beca-4f8c-a201-3184d956e3af tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:01.992149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfea936d-beca-4f8c-a201-3184d956e3af tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:01.994708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfea936d-beca-4f8c-a201-3184d956e3af tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:01.999237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfea936d-beca-4f8c-a201-3184d956e3af tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:02.001928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfea936d-beca-4f8c-a201-3184d956e3af tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:02.967327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:34:02.968087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:34:02.969040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:34:02.974479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:34:02.986676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:34:03.025895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:03.026811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:03.058711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:03.061012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:03.061946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:03.063299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:03.154622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Getting quotas for project 4d2da2e10e53450096a68048f98bd99a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:34:03.176527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Getting quotas for user 4cf03330b076434098eef9230222830e and project 4d2da2e10e53450096a68048f98bd99a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:34:03.218151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:34:03.222178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:34:03.313243 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f6768405-7849-46ee-a024-67d6dc094c9c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.622020 Aug 27 02:34:03.331811 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 657/1394] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:34:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 02:34:03.370625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-060a52d2-6a67-4ea9-bb2b-6ae3ee8ccefb tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:03.372620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-060a52d2-6a67-4ea9-bb2b-6ae3ee8ccefb tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:03.400715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060a52d2-6a67-4ea9-bb2b-6ae3ee8ccefb tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:03.404977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060a52d2-6a67-4ea9-bb2b-6ae3ee8ccefb tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:03.408131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060a52d2-6a67-4ea9-bb2b-6ae3ee8ccefb tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:03.409466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060a52d2-6a67-4ea9-bb2b-6ae3ee8ccefb tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:03.410483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060a52d2-6a67-4ea9-bb2b-6ae3ee8ccefb tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:03.411120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060a52d2-6a67-4ea9-bb2b-6ae3ee8ccefb tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:03.485856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dfea936d-beca-4f8c-a201-3184d956e3af tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:03.546819 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dfea936d-beca-4f8c-a201-3184d956e3af tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1312 microversion: 2.1 time: 1.575475 Aug 27 02:34:03.548326 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 738/1395] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:01 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1312 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:34:03.560867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-91e3eb96-07b4-426a-b74f-c082f654232e req-970b2499-3ffb-4a94-baf3-993a13acf316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e52df0-ca95-4f33-beb8-660817c63658", "tag": "dba12d2f-f390-4730-9f01-553471e2b87a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:03.630834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-91e3eb96-07b4-426a-b74f-c082f654232e req-970b2499-3ffb-4a94-baf3-993a13acf316 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:03.631344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-91e3eb96-07b4-426a-b74f-c082f654232e req-970b2499-3ffb-4a94-baf3-993a13acf316 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:03.631797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-91e3eb96-07b4-426a-b74f-c082f654232e req-970b2499-3ffb-4a94-baf3-993a13acf316 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:03.674051 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-91e3eb96-07b4-426a-b74f-c082f654232e req-970b2499-3ffb-4a94-baf3-993a13acf316 service nova] Creating event network-changed:dba12d2f-f390-4730-9f01-553471e2b87a for instance 28e52df0-ca95-4f33-beb8-660817c63658 on n-h2-852084-5 Aug 27 02:34:03.686040 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-91e3eb96-07b4-426a-b74f-c082f654232e req-970b2499-3ffb-4a94-baf3-993a13acf316 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132427 Aug 27 02:34:03.687582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 739/1396] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:03.700003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:03.701870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] [instance: f98f8456-cc9f-4772-97f1-99e056b99f79] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:03.717024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:03.718731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:03.720017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:03.721615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:03.722816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:03.723855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:03.756577 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] HTTP exception thrown: Instance f98f8456-cc9f-4772-97f1-99e056b99f79 could not be found. Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Request method failure captured: Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 HTTP/1.1 Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYHS5HJI_JFsz-Uq4G5CehjDmw4SydbaBv_weU-gXYb52kiwPzTBkgBBJDrou5JE6VoTPBbQ2fB7it8n2sPcXV3fcymSqk5QHKRst2mdUuax3rQGmMFZX9h8goifLAdJavfTpxEZDOSwFtU7PHFDgASbTOT9UEfaHZWZwvsHcOtma8M Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 21188dd4400446eda20c20a20dd047d2 Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ListImageFiltersTestJSON-1940734028 Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_21188dd4400446eda20c20a20dd047d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/21188dd4400446eda20c20a20dd047d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/21188dd4400446eda20c20a20dd047d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/21188dd4400446eda20c20a20dd047d2"}]}] Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ListImageFiltersTestJSON-1940734028 Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 21188dd4400446eda20c20a20dd047d2 Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1940734028 Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ListImageFiltersTestJSON-1940734028-project Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9cdd5b13c6384b0283eafe98beaa1988 Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ListImageFiltersTestJSON-1940734028-project Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance f98f8456-cc9f-4772-97f1-99e056b99f79 could not be found. Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f98f8456-cc9f-4772-97f1-99e056b99f79'} Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f98f8456-cc9f-4772-97f1-99e056b99f79 could not be found. Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f98f8456-cc9f-4772-97f1-99e056b99f79 could not be found. Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:34:03.760857 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:34:03.775990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:34:03.775990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:34:03.775990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:34:03.775990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:34:03.775990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:34:03.775990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f98f8456-cc9f-4772-97f1-99e056b99f79 could not be found. Aug 27 02:34:03.775990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:34:03.775990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Returning 404 to user: Instance f98f8456-cc9f-4772-97f1-99e056b99f79 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:34:03.781426 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3d015d51-eb84-442a-82e0-7009da4ebd12 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79" status: 404 len: 111 microversion: 2.1 time: 0.085639 Aug 27 02:34:03.783607 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 740/1397] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:03 2022] GET /compute/v2.1/servers/f98f8456-cc9f-4772-97f1-99e056b99f79 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:34:03.802290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b7460d92-5e66-43ad-a651-51b21495e502 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:03.804099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b7460d92-5e66-43ad-a651-51b21495e502 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:03.906940 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-060a52d2-6a67-4ea9-bb2b-6ae3ee8ccefb tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1859 microversion: 2.1 time: 0.567921 Aug 27 02:34:03.923102 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 658/1398] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:03 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1859 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:03.929705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7989533-923e-43a8-96df-bb4427b550b0 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2e902430>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:04.181875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b7460d92-5e66-43ad-a651-51b21495e502 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:04.208081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b7460d92-5e66-43ad-a651-51b21495e502 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:04.211720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b7460d92-5e66-43ad-a651-51b21495e502 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:04.214576 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b7460d92-5e66-43ad-a651-51b21495e502 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1262 microversion: 2.25 time: 0.428462 Aug 27 02:34:04.222252 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 741/1399] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:03 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1262 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:04.645139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-983851015", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": "none"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:04.663881 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7989533-923e-43a8-96df-bb4427b550b0 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "DELETE /compute/v2.1/images/2670088c-64f2-436e-be9a-8bb773c38354" status: 204 len: 0 microversion: 2.1 time: 0.739334 Aug 27 02:34:04.664605 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 659/1400] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:03 2022] DELETE /compute/v2.1/images/2670088c-64f2-436e-be9a-8bb773c38354 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:34:04.671383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f139ec02-e6ef-4610-971f-bf330aa26e58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852084-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:04.692888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f139ec02-e6ef-4610-971f-bf330aa26e58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:04.705233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f139ec02-e6ef-4610-971f-bf330aa26e58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:04.705776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f139ec02-e6ef-4610-971f-bf330aa26e58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:04.710397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f139ec02-e6ef-4610-971f-bf330aa26e58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:04.711345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f139ec02-e6ef-4610-971f-bf330aa26e58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:04.711961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f139ec02-e6ef-4610-971f-bf330aa26e58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:04.712425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f139ec02-e6ef-4610-971f-bf330aa26e58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:04.780822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-f139ec02-e6ef-4610-971f-bf330aa26e58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lazy-loading 'flavor' on Instance uuid d9500d4a-17ee-40b3-bc1c-77026234b7a3 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:34:04.807492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f139ec02-e6ef-4610-971f-bf330aa26e58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Going to try to live migrate instance to n-h2-852084-5 {{(pid=122487) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:34:04.828360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:34:04.830320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:34:04.830983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:34:04.832257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:34:04.834282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:34:04.878743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:04.884940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:04.886392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:04.888641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:04.893770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:04.894744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:04.986709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Getting quotas for project 6e6f27fe052b45309c6937a5af8e3220. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:34:05.004950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Getting quotas for user 78e37d7005074d3bb78ad2469ac4b413 and project 6e6f27fe052b45309c6937a5af8e3220. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:34:05.038650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:34:05.049029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:34:05.323735 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0dee7943-504d-403f-943b-c7288e76a2dd tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.096886 Aug 27 02:34:05.324996 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 742/1401] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:34:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:34:05.359076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-339137ae-282c-4c16-b748-8c04d2850c69 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:05.360108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-339137ae-282c-4c16-b748-8c04d2850c69 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:05.415990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339137ae-282c-4c16-b748-8c04d2850c69 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:05.416929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339137ae-282c-4c16-b748-8c04d2850c69 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:05.417540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339137ae-282c-4c16-b748-8c04d2850c69 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:05.428082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339137ae-282c-4c16-b748-8c04d2850c69 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:05.432279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339137ae-282c-4c16-b748-8c04d2850c69 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:05.436605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339137ae-282c-4c16-b748-8c04d2850c69 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:06.324894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-339137ae-282c-4c16-b748-8c04d2850c69 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:06.343788 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-339137ae-282c-4c16-b748-8c04d2850c69 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1312 microversion: 2.1 time: 0.986183 Aug 27 02:34:06.356066 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 743/1402] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:05 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1312 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:06.373868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ef50dbaf-ac4d-4b65-809e-a0b5a2e14707 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a270820>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:07.537993 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ef50dbaf-ac4d-4b65-809e-a0b5a2e14707 tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "DELETE /compute/v2.1/images/127c2dda-121b-4fd9-bc1e-9cd930ddea53" status: 204 len: 0 microversion: 2.1 time: 1.180052 Aug 27 02:34:07.541758 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 744/1403] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:06 2022] DELETE /compute/v2.1/images/127c2dda-121b-4fd9-bc1e-9cd930ddea53 => generated 0 bytes in 1182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:34:07.550991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:07.552958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:07.576459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:07.576968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:07.577414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:07.578183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:07.594272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:07.606244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:08.187761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:08.197944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:08.208272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:08.209799 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-44d2b986-bf38-4224-a7d1-ce5b8523abe6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1320 microversion: 2.25 time: 0.666653 Aug 27 02:34:08.210460 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 745/1404] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:07 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1320 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:08.240125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:08.240125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:08.240125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:08.248765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:08.250129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:08.251233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:08.256362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:08.257276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:08.620495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:08.647775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:08.655155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:08.664624 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a87aa4d1-d4ea-49e5-bc52-00c8794afe5e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1329 microversion: 2.57 time: 0.452921 Aug 27 02:34:08.665274 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 746/1405] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:08 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1329 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:09.070363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-475e257a-5097-433f-82e3-105da0805600 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:09.071118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-475e257a-5097-433f-82e3-105da0805600 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:09.095741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475e257a-5097-433f-82e3-105da0805600 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:09.101180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475e257a-5097-433f-82e3-105da0805600 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:09.102870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475e257a-5097-433f-82e3-105da0805600 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:09.103936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475e257a-5097-433f-82e3-105da0805600 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:09.105056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475e257a-5097-433f-82e3-105da0805600 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:09.105849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475e257a-5097-433f-82e3-105da0805600 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:09.194344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:09.985974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-475e257a-5097-433f-82e3-105da0805600 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:09.995786 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-475e257a-5097-433f-82e3-105da0805600 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1312 microversion: 2.1 time: 1.308074 Aug 27 02:34:09.997007 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 747/1406] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:08 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1312 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:10.003245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4dd386b6-63a3-4bc0-aa10-477663d4ca5b tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] Calling method '.version_select at 0x7f4d2a2c8af0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:10.341737 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f139ec02-e6ef-4610-971f-bf330aa26e58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/action" status: 202 len: 0 microversion: 2.1 time: 5.675013 Aug 27 02:34:10.345367 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 660/1407] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:34:04 2022] POST /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/action => generated 0 bytes in 5680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:34:10.358545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:10.361496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:10.377804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:10.382741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:10.384655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:10.386234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:10.388211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:10.391591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:10.393028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:10.615621 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4dd386b6-63a3-4bc0-aa10-477663d4ca5b tempest-ListImageFiltersTestJSON-1940734028 tempest-ListImageFiltersTestJSON-1940734028-project] 10.222.0.99 "DELETE /compute/v2.1/images/69a544ef-6f5e-4a03-afb5-8c49623cdf47" status: 204 len: 0 microversion: 2.1 time: 0.617187 Aug 27 02:34:10.620161 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 748/1408] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:09 2022] DELETE /compute/v2.1/images/69a544ef-6f5e-4a03-afb5-8c49623cdf47 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:34:10.627049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:10.628131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:10.639438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:10.640336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:10.641005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:10.642105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:10.643500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:10.644184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:10.826497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:10.859154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:10.864946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:10.867972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:10.875029 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-55df344c-1a21-46a8-bcc5-dbef33683a2d tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1335 microversion: 2.57 time: 0.253232 Aug 27 02:34:10.876391 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 749/1409] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:10 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1335 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:10.879816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:10.884009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4506ebab-3539-4fc1-883b-3bad171d6d27 req-87271bb1-f989-4d19-bc42-2c95a05d5025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ade60c1-89d3-4f5d-94e0-42f8b573f14b", "tag": "0541fb29-89c6-4ee0-96d0-f5319ae94bf3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:10.886755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:10.892930 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5b2826c1-5a9b-4be3-9478-afaa07c7398a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1362 microversion: 2.25 time: 0.545577 Aug 27 02:34:10.904871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4506ebab-3539-4fc1-883b-3bad171d6d27 req-87271bb1-f989-4d19-bc42-2c95a05d5025 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:10.909585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4506ebab-3539-4fc1-883b-3bad171d6d27 req-87271bb1-f989-4d19-bc42-2c95a05d5025 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:10.911385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4506ebab-3539-4fc1-883b-3bad171d6d27 req-87271bb1-f989-4d19-bc42-2c95a05d5025 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:10.911670 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 661/1410] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:10 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1362 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:10.938531 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4506ebab-3539-4fc1-883b-3bad171d6d27 req-87271bb1-f989-4d19-bc42-2c95a05d5025 service nova] Creating event network-changed:0541fb29-89c6-4ee0-96d0-f5319ae94bf3 for instance 1ade60c1-89d3-4f5d-94e0-42f8b573f14b on n-h1-852084-5 Aug 27 02:34:10.940797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df4cde98-53ca-49f3-b62d-202266e67b1f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:10.941931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-df4cde98-53ca-49f3-b62d-202266e67b1f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:10.944824 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4506ebab-3539-4fc1-883b-3bad171d6d27 req-87271bb1-f989-4d19-bc42-2c95a05d5025 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066841 Aug 27 02:34:10.946317 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 750/1411] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:10.954820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df4cde98-53ca-49f3-b62d-202266e67b1f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:10.956038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df4cde98-53ca-49f3-b62d-202266e67b1f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:10.957018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df4cde98-53ca-49f3-b62d-202266e67b1f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:10.958815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df4cde98-53ca-49f3-b62d-202266e67b1f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:10.959989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df4cde98-53ca-49f3-b62d-202266e67b1f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:10.961073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df4cde98-53ca-49f3-b62d-202266e67b1f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:11.021645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-726de362-b92b-42d3-924f-74facf476a9a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:11.023253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-726de362-b92b-42d3-924f-74facf476a9a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:11.046621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-726de362-b92b-42d3-924f-74facf476a9a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:11.048687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-726de362-b92b-42d3-924f-74facf476a9a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:11.050377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-726de362-b92b-42d3-924f-74facf476a9a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:11.052344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-726de362-b92b-42d3-924f-74facf476a9a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:11.052974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-726de362-b92b-42d3-924f-74facf476a9a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:11.053546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-726de362-b92b-42d3-924f-74facf476a9a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:11.258579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-df4cde98-53ca-49f3-b62d-202266e67b1f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:11.269261 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-df4cde98-53ca-49f3-b62d-202266e67b1f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.355700 Aug 27 02:34:11.270347 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 662/1412] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:10 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:11.511420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0b9623dc-95dd-443f-a306-1d49f19ac3d2 req-b95085c0-148b-4a4d-96d9-7512c46d764c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e52df0-ca95-4f33-beb8-660817c63658", "name": "network-vif-plugged", "status": "completed", "tag": "dba12d2f-f390-4730-9f01-553471e2b87a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:11.542063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0b9623dc-95dd-443f-a306-1d49f19ac3d2 req-b95085c0-148b-4a4d-96d9-7512c46d764c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:11.543341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0b9623dc-95dd-443f-a306-1d49f19ac3d2 req-b95085c0-148b-4a4d-96d9-7512c46d764c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:11.544173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0b9623dc-95dd-443f-a306-1d49f19ac3d2 req-b95085c0-148b-4a4d-96d9-7512c46d764c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:11.560876 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0b9623dc-95dd-443f-a306-1d49f19ac3d2 req-b95085c0-148b-4a4d-96d9-7512c46d764c service nova] Creating event network-vif-plugged:dba12d2f-f390-4730-9f01-553471e2b87a for instance 28e52df0-ca95-4f33-beb8-660817c63658 on n-h2-852084-5 Aug 27 02:34:11.568705 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0b9623dc-95dd-443f-a306-1d49f19ac3d2 req-b95085c0-148b-4a4d-96d9-7512c46d764c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065171 Aug 27 02:34:11.570042 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 663/1413] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:11.907160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:11.908378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:11.919492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-726de362-b92b-42d3-924f-74facf476a9a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:11.935244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:11.939558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:11.940498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:11.941846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:11.942638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:11.943395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:11.955736 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-726de362-b92b-42d3-924f-74facf476a9a tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1312 microversion: 2.1 time: 0.941505 Aug 27 02:34:11.976143 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 751/1414] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:11 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1312 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:12.003045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:12.004985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:12.020096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:12.021908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:12.024347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:12.025978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:12.027044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:12.028609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:12.394086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:12.426568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:12.446526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:12.448887 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-662f49d9-3191-4b42-952f-470655d5c4a7 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1356 microversion: 2.57 time: 0.550308 Aug 27 02:34:12.475461 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 664/1415] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:11 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1356 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:12.502797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:12.511758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-af935539-3dd1-4e6c-9fcc-85d6d5b97d34 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:12.513053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:12.522125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-af935539-3dd1-4e6c-9fcc-85d6d5b97d34 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:12.522881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:12.524111 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0450a609-726e-4809-9c39-1cca0930d34d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1362 microversion: 2.25 time: 0.541384 Aug 27 02:34:12.524710 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 752/1416] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:11 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1362 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:12.547746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af935539-3dd1-4e6c-9fcc-85d6d5b97d34 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:12.549138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af935539-3dd1-4e6c-9fcc-85d6d5b97d34 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:12.550326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af935539-3dd1-4e6c-9fcc-85d6d5b97d34 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:12.552201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af935539-3dd1-4e6c-9fcc-85d6d5b97d34 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:12.553445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af935539-3dd1-4e6c-9fcc-85d6d5b97d34 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:12.554533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af935539-3dd1-4e6c-9fcc-85d6d5b97d34 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:12.557449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:12.568811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:12.589545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:12.590639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:12.591107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:12.591901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:12.592351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:12.592828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:12.654607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:12.756204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:34:12.760353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:34:12.761144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:34:12.761834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:34:12.762431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:34:12.860555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:12.879800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:12.884343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:12.885093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:12.886206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:12.887421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:12.888948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:12.968408 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d39eec56-815e-4aa0-9686-b1426e7e0b8f tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "POST /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9/action" status: 202 len: 1137 microversion: 2.57 time: 0.422794 Aug 27 02:34:12.970005 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 753/1417] 10.222.0.99 () {62 vars in 1320 bytes} [Sat Aug 27 02:34:12 2022] POST /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9/action => generated 1137 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 02:34:13.003403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-08311a7e-8803-43ca-8529-54f3069e87db tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:13.004542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-08311a7e-8803-43ca-8529-54f3069e87db tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:13.018558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08311a7e-8803-43ca-8529-54f3069e87db tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:13.021837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08311a7e-8803-43ca-8529-54f3069e87db tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:13.022644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08311a7e-8803-43ca-8529-54f3069e87db tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:13.028726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08311a7e-8803-43ca-8529-54f3069e87db tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:13.029537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08311a7e-8803-43ca-8529-54f3069e87db tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:13.030185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08311a7e-8803-43ca-8529-54f3069e87db tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:13.114349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:13.205404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:13.825750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-af935539-3dd1-4e6c-9fcc-85d6d5b97d34 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:13.850979 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-af935539-3dd1-4e6c-9fcc-85d6d5b97d34 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 1.371620 Aug 27 02:34:13.852280 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 665/1418] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:12 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:13.864228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:13.865176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:13.893821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:13.895420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:13.897170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:13.899459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:13.900861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:13.903064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:14.426052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:14.493817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:14.500973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:14.508593 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2606ae48-5ca3-438e-8c1b-ac4e1bd76765 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.654535 Aug 27 02:34:14.520650 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 666/1419] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:13 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:14.561954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:14.566167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:14.598250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:14.602536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:14.607847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:14.610301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:14.613781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:14.617124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:14.937471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-08311a7e-8803-43ca-8529-54f3069e87db tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:14.940757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:14.952056 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-08311a7e-8803-43ca-8529-54f3069e87db tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1312 microversion: 2.1 time: 1.953155 Aug 27 02:34:14.962540 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 754/1420] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:12 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1312 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:34:14.968953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9407982a-c92c-4b1a-81bd-a34c809757ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:14.969958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9407982a-c92c-4b1a-81bd-a34c809757ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:14.984742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:14.986816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9407982a-c92c-4b1a-81bd-a34c809757ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:14.987560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9407982a-c92c-4b1a-81bd-a34c809757ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:14.988243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9407982a-c92c-4b1a-81bd-a34c809757ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:14.989254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9407982a-c92c-4b1a-81bd-a34c809757ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:15.003075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9407982a-c92c-4b1a-81bd-a34c809757ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:15.003961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9407982a-c92c-4b1a-81bd-a34c809757ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:15.038486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:15.229646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:15.251111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:15.253215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:15.254836 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bc67bf5d-cc94-49ea-b78a-75d87c4fb02f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1362 microversion: 2.25 time: 0.730094 Aug 27 02:34:15.271776 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 667/1421] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:14 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1362 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:15.597170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9407982a-c92c-4b1a-81bd-a34c809757ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:15.616756 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9407982a-c92c-4b1a-81bd-a34c809757ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.652717 Aug 27 02:34:15.625003 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 755/1422] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:14 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:15.937954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-20b37bcb-430d-4cf8-8469-f87053dfb8d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'create', calling method: .version_select at 0x7f4d2af2a160>, body: {"keypair": {"name": "tempest-keypair-206560499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI5fPOMhM+fPgi9mNgIApbvcejMQiLXbV0PIskQcrGevfktmdbGlbt0+uBN/HjEkVDSe9yDs6OT7llwh97MmVxQpkNDda+Ky2bZ7jAIMAURluAhzxJzXMBbWXpwJ1YYpA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:15.965512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b9e6b760-86dd-4722-8aa1-bb42f03e5d14 tempest-ListImagesTestJSON-1893950824 tempest-ListImagesTestJSON-1893950824-project] Calling method '.version_select at 0x7f4d2a0f6550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:15.979910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-20b37bcb-430d-4cf8-8469-f87053dfb8d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for project 69945a768314456fae9bf75e854510c2. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:34:15.992464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-20b37bcb-430d-4cf8-8469-f87053dfb8d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for user 281834367cf24a809448bdeea36a9c97 and project 69945a768314456fae9bf75e854510c2. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:34:16.042620 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-20b37bcb-430d-4cf8-8469-f87053dfb8d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.768945 Aug 27 02:34:16.044630 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 668/1423] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:34:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:16.049970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:16.050953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:16.081898 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b9e6b760-86dd-4722-8aa1-bb42f03e5d14 tempest-ListImagesTestJSON-1893950824 tempest-ListImagesTestJSON-1893950824-project] 10.222.0.99 "GET /compute/v2.1/images/6230fa40-aadc-49b6-823d-ddde81ab4f89" status: 200 len: 784 microversion: 2.1 time: 0.444904 Aug 27 02:34:16.085530 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 756/1424] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:34:15 2022] GET /compute/v2.1/images/6230fa40-aadc-49b6-823d-ddde81ab4f89 => generated 784 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:16.097729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:16.100523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:16.103208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:16.104540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f4522d4-57eb-43ee-a1ec-a854336a1263 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:16.106566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8f4522d4-57eb-43ee-a1ec-a854336a1263 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:16.107384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:16.109579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:16.113147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:16.137633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4522d4-57eb-43ee-a1ec-a854336a1263 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:16.142116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4522d4-57eb-43ee-a1ec-a854336a1263 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:16.142811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4522d4-57eb-43ee-a1ec-a854336a1263 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:16.143802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4522d4-57eb-43ee-a1ec-a854336a1263 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:16.144523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4522d4-57eb-43ee-a1ec-a854336a1263 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:16.147940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f4522d4-57eb-43ee-a1ec-a854336a1263 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:16.277590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:16.291765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:16.295933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:16.306110 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1ef68757-ed01-44e3-b1ee-b32b31b603e2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.259916 Aug 27 02:34:16.307236 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 669/1425] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:16 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:16.312595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e0bcdab-d395-4af5-aefc-e9288fc152d2 tempest-ListImagesTestJSON-1893950824 tempest-ListImagesTestJSON-1893950824-project] Calling method '.version_select at 0x7f4d2a5b60d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:16.389986 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5e0bcdab-d395-4af5-aefc-e9288fc152d2 tempest-ListImagesTestJSON-1893950824 tempest-ListImagesTestJSON-1893950824-project] 10.222.0.99 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.074001 Aug 27 02:34:16.392052 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 670/1426] 10.222.0.99 () {58 vars in 1122 bytes} [Sat Aug 27 02:34:16 2022] GET /compute/v2.1/images => generated 445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:16.397350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:16.398411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:16.415727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:16.420636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:16.421462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:16.422479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:16.423162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:16.423813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:17.051605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8f4522d4-57eb-43ee-a1ec-a854336a1263 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:17.081710 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f4522d4-57eb-43ee-a1ec-a854336a1263 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1460 microversion: 2.1 time: 0.994251 Aug 27 02:34:17.083903 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 757/1427] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:16 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1460 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:17.128068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dbb5bfa3-488e-4997-a061-d99638717d8c tempest-ListImagesTestJSON-1893950824 tempest-ListImagesTestJSON-1893950824-project] Calling method '.version_select at 0x7f4d2a100d30>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:17.180244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:17.192833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:17.210840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:17.212208 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f85a224a-7031-4728-befd-f6006d16298e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1362 microversion: 2.25 time: 0.818814 Aug 27 02:34:17.224223 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 671/1428] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:16 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1362 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:17.243810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3e4a7ae9-581c-42eb-a36d-fd8895533228 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:17.252416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3e4a7ae9-581c-42eb-a36d-fd8895533228 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:17.263914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e4a7ae9-581c-42eb-a36d-fd8895533228 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:17.271326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e4a7ae9-581c-42eb-a36d-fd8895533228 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:17.271654 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dbb5bfa3-488e-4997-a061-d99638717d8c tempest-ListImagesTestJSON-1893950824 tempest-ListImagesTestJSON-1893950824-project] 10.222.0.99 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.184006 Aug 27 02:34:17.272010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e4a7ae9-581c-42eb-a36d-fd8895533228 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:17.272964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e4a7ae9-581c-42eb-a36d-fd8895533228 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:17.274360 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 758/1429] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:34:17 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:17.275024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e4a7ae9-581c-42eb-a36d-fd8895533228 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:17.282473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e4a7ae9-581c-42eb-a36d-fd8895533228 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:17.295467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95f14fcc-ba46-4eeb-a5fb-1fdf54c4bb82 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:17.300556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-95f14fcc-ba46-4eeb-a5fb-1fdf54c4bb82 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:17.330529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95f14fcc-ba46-4eeb-a5fb-1fdf54c4bb82 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:17.331200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95f14fcc-ba46-4eeb-a5fb-1fdf54c4bb82 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:17.332188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95f14fcc-ba46-4eeb-a5fb-1fdf54c4bb82 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:17.335115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95f14fcc-ba46-4eeb-a5fb-1fdf54c4bb82 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:17.344607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95f14fcc-ba46-4eeb-a5fb-1fdf54c4bb82 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:17.346414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95f14fcc-ba46-4eeb-a5fb-1fdf54c4bb82 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:18.044842 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-95f14fcc-ba46-4eeb-a5fb-1fdf54c4bb82 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1611 microversion: 2.1 time: 0.762916 Aug 27 02:34:18.063337 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 759/1430] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:17 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1611 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:18.098827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:18.100504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:18.113716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:18.114563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:18.115368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:18.116706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:18.117560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:18.118383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:18.516414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3e4a7ae9-581c-42eb-a36d-fd8895533228 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:18.547444 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3e4a7ae9-581c-42eb-a36d-fd8895533228 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 1.321522 Aug 27 02:34:18.553025 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 672/1431] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:17 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:18.579234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:18.593106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:18.593397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:18.611785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:18.620056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:18.630402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:18.632601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:18.635874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:18.640030 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2167b6b9-23d2-405a-95c6-39012e3921ee tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.557721 Aug 27 02:34:18.640963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:18.642868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:18.643400 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 760/1432] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:18 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:18.673331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:18.679409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:18.680564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:18.708412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:18.709872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:18.713504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:18.719265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:18.721103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:18.722720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:18.968338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3b495fa3d17c4dfab48a2985eba66e5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7c703be30d4f2394eb3b429d960c4a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:18.979597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] flavor_id is None. Assuming migration. {{(pid=122487) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 02:34:18.981200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122487) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 02:34:20.077551 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1b12abc4-b886-43bd-85f6-d9d71381c923 tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658/action" status: 202 len: 0 microversion: 2.1 time: 1.517634 Aug 27 02:34:20.081335 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 673/1433] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:34:18 2022] POST /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658/action => generated 0 bytes in 1527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:34:20.096781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1a14b65-5b3e-4d00-b463-e2b142432eb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:20.107354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:20.113397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d1a14b65-5b3e-4d00-b463-e2b142432eb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:20.142753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:20.147953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a14b65-5b3e-4d00-b463-e2b142432eb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:20.148813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a14b65-5b3e-4d00-b463-e2b142432eb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:20.149590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a14b65-5b3e-4d00-b463-e2b142432eb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:20.150805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a14b65-5b3e-4d00-b463-e2b142432eb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:20.151551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a14b65-5b3e-4d00-b463-e2b142432eb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:20.152793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a14b65-5b3e-4d00-b463-e2b142432eb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:20.166298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:20.167451 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a5065e66-5268-49d8-bf78-3310f30ad677 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1362 microversion: 2.25 time: 1.515780 Aug 27 02:34:20.204615 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 761/1434] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:18 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1362 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:20.232297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:20.235260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:20.273587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:20.282625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:20.283809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:20.285396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:20.286536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:20.294892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:20.561312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:20.595771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:20.607195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:20.614901 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-92e15bf8-b16b-4d49-9c80-1d2ce6965323 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.405086 Aug 27 02:34:20.618429 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 762/1435] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:20 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:20.658095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b3f4584-c3d9-4e05-9a88-bc811cb907b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:20.660252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6b3f4584-c3d9-4e05-9a88-bc811cb907b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:20.708501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3f4584-c3d9-4e05-9a88-bc811cb907b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:20.715995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3f4584-c3d9-4e05-9a88-bc811cb907b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:20.721713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3f4584-c3d9-4e05-9a88-bc811cb907b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:20.729658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3f4584-c3d9-4e05-9a88-bc811cb907b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:20.732650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3f4584-c3d9-4e05-9a88-bc811cb907b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:20.736225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3f4584-c3d9-4e05-9a88-bc811cb907b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:21.402540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1a14b65-5b3e-4d00-b463-e2b142432eb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:21.415826 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1a14b65-5b3e-4d00-b463-e2b142432eb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 1.332451 Aug 27 02:34:21.424802 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 674/1436] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:20 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:21.430345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:21.431287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:21.447154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:21.448005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:21.448704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:21.449753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:21.463613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:21.464447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:21.626058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6b3f4584-c3d9-4e05-9a88-bc811cb907b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:21.638965 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b3f4584-c3d9-4e05-9a88-bc811cb907b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1469 microversion: 2.1 time: 1.015911 Aug 27 02:34:21.639701 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 763/1437] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:20 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1469 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:21.650030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:21.662699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:21.685834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:21.694458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:21.695018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:21.695963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:21.696528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:21.697048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:21.913875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:21.938680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:21.942493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:21.946589 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-08994297-919b-4e26-adaf-017cd4689fe6 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.305660 Aug 27 02:34:21.951714 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 764/1438] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:21 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:22.318766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:22.342715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:22.348046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:22.349474 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-abaaf6b0-b037-49f5-903d-ac68beb96235 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1362 microversion: 2.25 time: 0.923171 Aug 27 02:34:22.369706 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 675/1439] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:21 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1362 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:22.470090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ecc94208-61c6-4945-acd2-516182749731 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:22.471814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ecc94208-61c6-4945-acd2-516182749731 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:22.486656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc94208-61c6-4945-acd2-516182749731 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:22.490532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc94208-61c6-4945-acd2-516182749731 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:22.491310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc94208-61c6-4945-acd2-516182749731 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:22.502417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc94208-61c6-4945-acd2-516182749731 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:22.505347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc94208-61c6-4945-acd2-516182749731 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:22.506151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc94208-61c6-4945-acd2-516182749731 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:22.540996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:22.676272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fa080759-4919-4eb9-a513-fd8c594c2620 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:22.677077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fa080759-4919-4eb9-a513-fd8c594c2620 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:22.699531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa080759-4919-4eb9-a513-fd8c594c2620 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:22.700321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa080759-4919-4eb9-a513-fd8c594c2620 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:22.707430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa080759-4919-4eb9-a513-fd8c594c2620 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:22.714695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa080759-4919-4eb9-a513-fd8c594c2620 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:22.718648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa080759-4919-4eb9-a513-fd8c594c2620 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:22.719359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa080759-4919-4eb9-a513-fd8c594c2620 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:23.617475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ecc94208-61c6-4945-acd2-516182749731 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:23.696427 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ecc94208-61c6-4945-acd2-516182749731 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 1.231408 Aug 27 02:34:23.706794 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 765/1440] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:22 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:23.754329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:23.759289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:23.786745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:23.801321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:23.806074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:23.807216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:23.814141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:23.814919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:24.343100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fa080759-4919-4eb9-a513-fd8c594c2620 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:24.373563 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fa080759-4919-4eb9-a513-fd8c594c2620 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1469 microversion: 2.1 time: 1.702378 Aug 27 02:34:24.380926 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 676/1441] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:22 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1469 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:24.411747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:24.423395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:24.443528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:24.447736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:24.448437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:24.450418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:24.452681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:24.455688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:24.979402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:24.997706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:24.999550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:25.000928 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0096eb88-92c5-438c-b3cc-f239aa362abf tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 1.285316 Aug 27 02:34:25.009852 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 766/1442] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:23 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:25.017038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-078e3ba4-f720-4033-8038-b6356e58fb09 req-a4a05f58-9642-452a-a402-6a4071dd558a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade60c1-89d3-4f5d-94e0-42f8b573f14b", "name": "network-vif-plugged", "status": "completed", "tag": "0541fb29-89c6-4ee0-96d0-f5319ae94bf3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:25.035007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-078e3ba4-f720-4033-8038-b6356e58fb09 req-a4a05f58-9642-452a-a402-6a4071dd558a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:25.035519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-078e3ba4-f720-4033-8038-b6356e58fb09 req-a4a05f58-9642-452a-a402-6a4071dd558a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:25.036105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-078e3ba4-f720-4033-8038-b6356e58fb09 req-a4a05f58-9642-452a-a402-6a4071dd558a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:25.066034 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-078e3ba4-f720-4033-8038-b6356e58fb09 req-a4a05f58-9642-452a-a402-6a4071dd558a service nova] Creating event network-vif-plugged:0541fb29-89c6-4ee0-96d0-f5319ae94bf3 for instance 1ade60c1-89d3-4f5d-94e0-42f8b573f14b on n-h1-852084-5 Aug 27 02:34:25.078264 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-078e3ba4-f720-4033-8038-b6356e58fb09 req-a4a05f58-9642-452a-a402-6a4071dd558a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066772 Aug 27 02:34:25.079252 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 767/1443] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:25.085003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a41a2744-eebc-4ea1-84a8-bf93461fd526 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:25.085779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a41a2744-eebc-4ea1-84a8-bf93461fd526 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:25.093577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41a2744-eebc-4ea1-84a8-bf93461fd526 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:25.094487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41a2744-eebc-4ea1-84a8-bf93461fd526 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:25.095143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41a2744-eebc-4ea1-84a8-bf93461fd526 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:25.096122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41a2744-eebc-4ea1-84a8-bf93461fd526 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:25.096783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41a2744-eebc-4ea1-84a8-bf93461fd526 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:25.097471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a41a2744-eebc-4ea1-84a8-bf93461fd526 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:25.496182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:25.513630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:25.535652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:25.542291 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cb7f31b9-9476-4b70-80bd-2d745722154e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1362 microversion: 2.25 time: 1.154219 Aug 27 02:34:25.543926 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 677/1444] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:24 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1362 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:25.553078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3c01e2bd-679d-409b-a1b7-ab2d67877892 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:25.576455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3c01e2bd-679d-409b-a1b7-ab2d67877892 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:25.619183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c01e2bd-679d-409b-a1b7-ab2d67877892 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:25.619946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c01e2bd-679d-409b-a1b7-ab2d67877892 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:25.625725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c01e2bd-679d-409b-a1b7-ab2d67877892 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:25.626844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c01e2bd-679d-409b-a1b7-ab2d67877892 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:25.627538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c01e2bd-679d-409b-a1b7-ab2d67877892 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:25.628624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c01e2bd-679d-409b-a1b7-ab2d67877892 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:26.006212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:26.239445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3c01e2bd-679d-409b-a1b7-ab2d67877892 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:26.264191 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3c01e2bd-679d-409b-a1b7-ab2d67877892 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1469 microversion: 2.1 time: 0.717474 Aug 27 02:34:26.270054 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 678/1445] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:25 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1469 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:26.275580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:26.286143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:26.302311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:26.302311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:26.302311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:26.307378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:26.308124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:26.308703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:26.491441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a41a2744-eebc-4ea1-84a8-bf93461fd526 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:26.506611 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a41a2744-eebc-4ea1-84a8-bf93461fd526 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 1.423649 Aug 27 02:34:26.524729 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 768/1446] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:25 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:26.541062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:26.560791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:26.567855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:26.574292 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ca533761-25e3-43df-a0cc-88d6197b58ff tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.300236 Aug 27 02:34:26.582084 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 679/1447] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:26 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:26.592870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:26.593510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:26.604662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:26.608951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:26.609516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:26.612467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:26.613054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:26.613518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:27.291447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ccf2e04-39aa-4f32-b4ff-8a7f8eca605f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:27.292231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9ccf2e04-39aa-4f32-b4ff-8a7f8eca605f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:27.308570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e04-39aa-4f32-b4ff-8a7f8eca605f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:27.310587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e04-39aa-4f32-b4ff-8a7f8eca605f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:27.311144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e04-39aa-4f32-b4ff-8a7f8eca605f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:27.315286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e04-39aa-4f32-b4ff-8a7f8eca605f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:27.315914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e04-39aa-4f32-b4ff-8a7f8eca605f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:27.316384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ccf2e04-39aa-4f32-b4ff-8a7f8eca605f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:27.821363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9ccf2e04-39aa-4f32-b4ff-8a7f8eca605f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:27.839047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:27.846642 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9ccf2e04-39aa-4f32-b4ff-8a7f8eca605f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1469 microversion: 2.1 time: 0.561646 Aug 27 02:34:27.847298 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 680/1448] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:27 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1469 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:27.873183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-82e7b156-226d-4801-908c-2f9c61fb1355 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:27.873864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-82e7b156-226d-4801-908c-2f9c61fb1355 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:27.875030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:27.879076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:27.881007 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7c3fc69c-710b-4450-8e66-7bd40e98bfbb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1362 microversion: 2.25 time: 1.291718 Aug 27 02:34:27.882048 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 769/1449] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:26 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1362 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:27.888959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-599422867", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5df9b9c-03e6-4d14-a511-7974335d0f10"}], "security_groups": [{"name": "tempest-securitygroup--1396423300"}], "key_name": "tempest-keypair-206560499", "user_data": "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:27.899045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e7b156-226d-4801-908c-2f9c61fb1355 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:27.899560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e7b156-226d-4801-908c-2f9c61fb1355 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:27.900017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e7b156-226d-4801-908c-2f9c61fb1355 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:27.900750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e7b156-226d-4801-908c-2f9c61fb1355 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:27.901212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e7b156-226d-4801-908c-2f9c61fb1355 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:27.907854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e7b156-226d-4801-908c-2f9c61fb1355 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:28.450702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-82e7b156-226d-4801-908c-2f9c61fb1355 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:28.473610 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-82e7b156-226d-4801-908c-2f9c61fb1355 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.615631 Aug 27 02:34:28.474635 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 681/1450] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:27 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:28.505283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:28.507758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:28.524195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:28.524750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:28.525199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:28.525982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:28.526461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:28.527452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:28.543860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:28.738721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:28.752253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:28.753820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:28.755059 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd9e0179-3519-41a3-b0f5-a8de8d6220b0 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.276193 Aug 27 02:34:28.765714 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 682/1451] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:28 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:28.873445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de32f886-e499-42b2-ab85-57fc5d10e744 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:28.874944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de32f886-e499-42b2-ab85-57fc5d10e744 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:28.885430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de32f886-e499-42b2-ab85-57fc5d10e744 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:28.886314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de32f886-e499-42b2-ab85-57fc5d10e744 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:28.887149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de32f886-e499-42b2-ab85-57fc5d10e744 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:28.888378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de32f886-e499-42b2-ab85-57fc5d10e744 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:28.889039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de32f886-e499-42b2-ab85-57fc5d10e744 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:28.889697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de32f886-e499-42b2-ab85-57fc5d10e744 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:29.003042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] validate_networks() for [('a5df9b9c-03e6-4d14-a511-7974335d0f10', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:34:29.216971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de32f886-e499-42b2-ab85-57fc5d10e744 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:29.232109 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de32f886-e499-42b2-ab85-57fc5d10e744 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1474 microversion: 2.1 time: 0.363056 Aug 27 02:34:29.232829 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 683/1452] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:28 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1474 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:29.245204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:29.246317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:29.256204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:29.257158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:29.257885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:29.258857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:29.259788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:29.261229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:29.572136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:29.590112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:29.592187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:29.596571 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-60ef2028-848e-4993-81bc-007163242057 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1559 microversion: 2.25 time: 0.362240 Aug 27 02:34:29.598890 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 684/1453] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:29 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1559 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:29.830541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1855753536", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "f3c602f1-b039-40d5-b003-ed089a414033"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:29.904030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] validate_networks() for [('f3c602f1-b039-40d5-b003-ed089a414033', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:34:30.471453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:34:30.472530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:34:30.473124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:34:30.473889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:34:30.474613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:34:30.485989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:30.487128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:30.487842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:30.489073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:30.489639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:30.490202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:30.509980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Getting quotas for project daba795eed3640ea87380940f0b2c15b. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:34:30.517254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Getting quotas for user ccd079579c3c4cfa99a14a5c5a720dd3 and project daba795eed3640ea87380940f0b2c15b. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:34:30.533000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:34:30.537342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:34:30.624709 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023668 Aug 27 02:34:30.626205 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 685/1454] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:34:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:34:30.632065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a920505e-2347-4fed-a6f5-ba7a4382e8ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:30.633420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a920505e-2347-4fed-a6f5-ba7a4382e8ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:30.648457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a920505e-2347-4fed-a6f5-ba7a4382e8ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:30.649524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a920505e-2347-4fed-a6f5-ba7a4382e8ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:30.650179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a920505e-2347-4fed-a6f5-ba7a4382e8ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:30.653295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a920505e-2347-4fed-a6f5-ba7a4382e8ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:30.654302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a920505e-2347-4fed-a6f5-ba7a4382e8ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:30.655172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a920505e-2347-4fed-a6f5-ba7a4382e8ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:30.860464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a920505e-2347-4fed-a6f5-ba7a4382e8ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:30.884589 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a920505e-2347-4fed-a6f5-ba7a4382e8ae tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.256658 Aug 27 02:34:30.899527 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 686/1455] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:30 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:30.907811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ccc8fdd1-ad77-40f5-9fc3-7a2c7dab12ae tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:30.910051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ccc8fdd1-ad77-40f5-9fc3-7a2c7dab12ae tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:30.920131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccc8fdd1-ad77-40f5-9fc3-7a2c7dab12ae tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:30.920928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccc8fdd1-ad77-40f5-9fc3-7a2c7dab12ae tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:30.921613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccc8fdd1-ad77-40f5-9fc3-7a2c7dab12ae tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:30.923370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccc8fdd1-ad77-40f5-9fc3-7a2c7dab12ae tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:30.924308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccc8fdd1-ad77-40f5-9fc3-7a2c7dab12ae tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:30.924916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccc8fdd1-ad77-40f5-9fc3-7a2c7dab12ae tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:31.094859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:34:31.095628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:34:31.097962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:34:31.098767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:34:31.099532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:34:31.164644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:31.166627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:31.168760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:31.176389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:31.177573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:31.178647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:31.308362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for project 69945a768314456fae9bf75e854510c2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:34:31.334989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for user 281834367cf24a809448bdeea36a9c97 and project 69945a768314456fae9bf75e854510c2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:34:31.418398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:34:31.426881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:34:31.524372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-ccc8fdd1-ad77-40f5-9fc3-7a2c7dab12ae tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid 1ade60c1-89d3-4f5d-94e0-42f8b573f14b {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:34:31.599193 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ccc8fdd1-ad77-40f5-9fc3-7a2c7dab12ae tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 2052 microversion: 2.25 time: 0.697841 Aug 27 02:34:31.604036 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 687/1456] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:30 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 2052 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:31.613067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:31.625062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:31.648406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:31.649299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:31.650141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:31.651437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:31.660295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:31.661060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:31.664040 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-67a7bf47-7a36-4cf0-a489-0b006e9db22f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.779059 Aug 27 02:34:31.668987 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 770/1457] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:34:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 3786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:34:31.686308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cd8498bb-92d7-427b-987f-7074a1347722 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:31.687255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cd8498bb-92d7-427b-987f-7074a1347722 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:31.727522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd8498bb-92d7-427b-987f-7074a1347722 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:31.728216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd8498bb-92d7-427b-987f-7074a1347722 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:31.728866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd8498bb-92d7-427b-987f-7074a1347722 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:31.731601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd8498bb-92d7-427b-987f-7074a1347722 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:31.733142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd8498bb-92d7-427b-987f-7074a1347722 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:31.735376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd8498bb-92d7-427b-987f-7074a1347722 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:31.895051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:31.913693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:31.920480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:31.925003 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42d2c1d7-508b-40fc-ab07-86af9ab96b3b tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.318992 Aug 27 02:34:31.926980 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 688/1458] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:31 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:31.948704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-818d3c21-ba24-4de0-9fda-f4031b22dfd9 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:31.949046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-818d3c21-ba24-4de0-9fda-f4031b22dfd9 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:32.156763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-818d3c21-ba24-4de0-9fda-f4031b22dfd9 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:32.184446 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-818d3c21-ba24-4de0-9fda-f4031b22dfd9 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1217 microversion: 2.1 time: 0.255033 Aug 27 02:34:32.185502 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 689/1459] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:31 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1217 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:32.223415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-afadd5ba-93ec-440e-b61f-38e572a8bb3e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:32.224072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-afadd5ba-93ec-440e-b61f-38e572a8bb3e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:32.233621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afadd5ba-93ec-440e-b61f-38e572a8bb3e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:32.238873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afadd5ba-93ec-440e-b61f-38e572a8bb3e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:32.238873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afadd5ba-93ec-440e-b61f-38e572a8bb3e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:32.238873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afadd5ba-93ec-440e-b61f-38e572a8bb3e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:32.238873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afadd5ba-93ec-440e-b61f-38e572a8bb3e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:32.242216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afadd5ba-93ec-440e-b61f-38e572a8bb3e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:32.383116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cd8498bb-92d7-427b-987f-7074a1347722 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:32.396666 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cd8498bb-92d7-427b-987f-7074a1347722 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1474 microversion: 2.1 time: 0.726079 Aug 27 02:34:32.404120 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 771/1460] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:31 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1474 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:32.422319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5aedc7c-1d91-484f-b262-1721de2f2d5e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:32.428212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c5aedc7c-1d91-484f-b262-1721de2f2d5e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:32.913119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c5aedc7c-1d91-484f-b262-1721de2f2d5e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:32.946693 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c5aedc7c-1d91-484f-b262-1721de2f2d5e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1237 microversion: 2.1 time: 0.531933 Aug 27 02:34:32.950277 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 772/1461] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:32 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1237 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:32.982203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d076cd39-84bc-4d7c-9327-d92d45c9b393 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:32.984677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d076cd39-84bc-4d7c-9327-d92d45c9b393 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:33.027448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d076cd39-84bc-4d7c-9327-d92d45c9b393 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:33.027968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d076cd39-84bc-4d7c-9327-d92d45c9b393 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:33.029614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d076cd39-84bc-4d7c-9327-d92d45c9b393 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:33.030499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d076cd39-84bc-4d7c-9327-d92d45c9b393 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:33.030996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d076cd39-84bc-4d7c-9327-d92d45c9b393 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:33.031448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d076cd39-84bc-4d7c-9327-d92d45c9b393 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:33.169090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-afadd5ba-93ec-440e-b61f-38e572a8bb3e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid 1ade60c1-89d3-4f5d-94e0-42f8b573f14b {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:34:33.232412 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-afadd5ba-93ec-440e-b61f-38e572a8bb3e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 2052 microversion: 2.25 time: 1.009687 Aug 27 02:34:33.234187 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 690/1462] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:32 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 2052 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:33.254297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:33.259874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:33.274962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:33.277614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:33.278819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:33.280578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:33.281799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:33.282926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:33.417609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:33.444848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:33.454785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:33.457042 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d0030c60-852f-4e5f-a080-668c38f6dd07 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.220876 Aug 27 02:34:33.461875 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 691/1463] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:33 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:33.476567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a8769e47-492c-4a1e-bc70-83acff2ac9df tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:33.491143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a8769e47-492c-4a1e-bc70-83acff2ac9df tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:33.529255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8769e47-492c-4a1e-bc70-83acff2ac9df tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:33.530851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8769e47-492c-4a1e-bc70-83acff2ac9df tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:33.531999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8769e47-492c-4a1e-bc70-83acff2ac9df tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:33.533649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8769e47-492c-4a1e-bc70-83acff2ac9df tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:33.539476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8769e47-492c-4a1e-bc70-83acff2ac9df tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:33.540875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8769e47-492c-4a1e-bc70-83acff2ac9df tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:33.834869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d076cd39-84bc-4d7c-9327-d92d45c9b393 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:33.847738 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d076cd39-84bc-4d7c-9327-d92d45c9b393 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.895399 Aug 27 02:34:33.851249 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 773/1464] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:32 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:33.863199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dc6e2745-7760-4528-9e8a-ad79fbf92beb tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:33.867623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc6e2745-7760-4528-9e8a-ad79fbf92beb tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:33.883181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc6e2745-7760-4528-9e8a-ad79fbf92beb tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:33.884273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc6e2745-7760-4528-9e8a-ad79fbf92beb tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:33.885486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a8769e47-492c-4a1e-bc70-83acff2ac9df tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:33.885740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc6e2745-7760-4528-9e8a-ad79fbf92beb tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:33.887240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc6e2745-7760-4528-9e8a-ad79fbf92beb tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:33.889268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc6e2745-7760-4528-9e8a-ad79fbf92beb tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:33.916294 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a8769e47-492c-4a1e-bc70-83acff2ac9df tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1269 microversion: 2.1 time: 0.447289 Aug 27 02:34:33.921555 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 692/1465] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:33 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1269 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:33.940657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1735ea53-892f-4049-b2ac-30ce45892b2d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:33.942667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1735ea53-892f-4049-b2ac-30ce45892b2d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:33.961067 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dc6e2745-7760-4528-9e8a-ad79fbf92beb tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.104981 Aug 27 02:34:33.961805 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 774/1466] 10.222.0.99 () {60 vars in 1217 bytes} [Sat Aug 27 02:34:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:34:33.970742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1735ea53-892f-4049-b2ac-30ce45892b2d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:33.972267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1735ea53-892f-4049-b2ac-30ce45892b2d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:33.974662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1735ea53-892f-4049-b2ac-30ce45892b2d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:33.983730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1735ea53-892f-4049-b2ac-30ce45892b2d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:33.986866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1735ea53-892f-4049-b2ac-30ce45892b2d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:33.987141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ca5dc038-04e2-46df-bfa4-6a00973dd21c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:33.988364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1735ea53-892f-4049-b2ac-30ce45892b2d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:33.989278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ca5dc038-04e2-46df-bfa4-6a00973dd21c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:34.027725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca5dc038-04e2-46df-bfa4-6a00973dd21c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:34.032972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca5dc038-04e2-46df-bfa4-6a00973dd21c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:34.036417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca5dc038-04e2-46df-bfa4-6a00973dd21c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:34.040763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca5dc038-04e2-46df-bfa4-6a00973dd21c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:34.041291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca5dc038-04e2-46df-bfa4-6a00973dd21c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:34.045036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca5dc038-04e2-46df-bfa4-6a00973dd21c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:34.500914 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ca5dc038-04e2-46df-bfa4-6a00973dd21c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b/action" status: 202 len: 0 microversion: 2.25 time: 0.516778 Aug 27 02:34:34.510708 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 775/1467] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:34:33 2022] POST /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:34:34.540991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7d6ad509-37da-490c-9e84-1495409e5579 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:34.546115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d6ad509-37da-490c-9e84-1495409e5579 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:34.581795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d6ad509-37da-490c-9e84-1495409e5579 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:34.582313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d6ad509-37da-490c-9e84-1495409e5579 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:34.582789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d6ad509-37da-490c-9e84-1495409e5579 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:34.583564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d6ad509-37da-490c-9e84-1495409e5579 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:34.584057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d6ad509-37da-490c-9e84-1495409e5579 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:34.585382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d6ad509-37da-490c-9e84-1495409e5579 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:35.019289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d6ad509-37da-490c-9e84-1495409e5579 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:35.042122 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7d6ad509-37da-490c-9e84-1495409e5579 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1289 microversion: 2.1 time: 0.525606 Aug 27 02:34:35.043516 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 776/1468] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:34 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1289 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:35.058902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:35.061023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:35.085575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:35.094665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:35.095397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:35.096770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:35.097718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:35.098826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:35.211565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1735ea53-892f-4049-b2ac-30ce45892b2d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:35.265173 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1735ea53-892f-4049-b2ac-30ce45892b2d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1474 microversion: 2.1 time: 1.341119 Aug 27 02:34:35.280248 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 693/1469] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:33 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1474 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:35.280248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fe346bae-0839-46bf-8f53-d2c593bab23b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:35.280248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fe346bae-0839-46bf-8f53-d2c593bab23b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:35.298997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe346bae-0839-46bf-8f53-d2c593bab23b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:35.299912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe346bae-0839-46bf-8f53-d2c593bab23b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:35.300703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe346bae-0839-46bf-8f53-d2c593bab23b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:35.302112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe346bae-0839-46bf-8f53-d2c593bab23b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:35.319149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe346bae-0839-46bf-8f53-d2c593bab23b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:35.320179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe346bae-0839-46bf-8f53-d2c593bab23b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:35.529062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:35.579151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:35.582295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:35.584143 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d91d625c-1e43-41c1-ac84-34ebee514991 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.537997 Aug 27 02:34:35.585240 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 777/1470] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:35 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:35.594814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-285c929b-2583-439c-808f-dab20e969c27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:35.596285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-285c929b-2583-439c-808f-dab20e969c27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:35.631417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285c929b-2583-439c-808f-dab20e969c27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:35.638207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285c929b-2583-439c-808f-dab20e969c27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:35.641841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285c929b-2583-439c-808f-dab20e969c27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:35.643914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285c929b-2583-439c-808f-dab20e969c27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:35.652901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285c929b-2583-439c-808f-dab20e969c27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:35.654106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285c929b-2583-439c-808f-dab20e969c27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:36.405285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-fe346bae-0839-46bf-8f53-d2c593bab23b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid 1ade60c1-89d3-4f5d-94e0-42f8b573f14b {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:34:36.443150 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fe346bae-0839-46bf-8f53-d2c593bab23b tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 2037 microversion: 2.25 time: 1.161623 Aug 27 02:34:36.448006 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 694/1471] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:35 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 2037 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:36.453542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0d83735a-ab9c-4226-b5e7-4964643373a7 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:36.466748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0d83735a-ab9c-4226-b5e7-4964643373a7 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:36.474102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d83735a-ab9c-4226-b5e7-4964643373a7 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:36.474916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d83735a-ab9c-4226-b5e7-4964643373a7 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:36.475543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d83735a-ab9c-4226-b5e7-4964643373a7 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:36.476460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d83735a-ab9c-4226-b5e7-4964643373a7 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:36.482578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d83735a-ab9c-4226-b5e7-4964643373a7 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:36.483043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d83735a-ab9c-4226-b5e7-4964643373a7 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:36.714155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-285c929b-2583-439c-808f-dab20e969c27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:36.785566 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-285c929b-2583-439c-808f-dab20e969c27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 1.198380 Aug 27 02:34:36.787442 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 778/1472] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:35 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:36.809939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4233b81f-9456-43c9-8521-7b60a84a96bd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:36.819671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4233b81f-9456-43c9-8521-7b60a84a96bd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:36.856508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4233b81f-9456-43c9-8521-7b60a84a96bd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:36.857388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4233b81f-9456-43c9-8521-7b60a84a96bd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:36.874107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4233b81f-9456-43c9-8521-7b60a84a96bd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:36.887414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4233b81f-9456-43c9-8521-7b60a84a96bd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:36.888929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4233b81f-9456-43c9-8521-7b60a84a96bd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:36.893473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4233b81f-9456-43c9-8521-7b60a84a96bd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:37.258946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4233b81f-9456-43c9-8521-7b60a84a96bd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:37.288811 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4233b81f-9456-43c9-8521-7b60a84a96bd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1295 microversion: 2.1 time: 0.498308 Aug 27 02:34:37.295941 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 779/1473] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:36 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1295 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:37.324952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1970da98-9225-47ff-8a56-df7e4883dabd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:37.324952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1970da98-9225-47ff-8a56-df7e4883dabd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:37.334590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0d83735a-ab9c-4226-b5e7-4964643373a7 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:37.350295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1970da98-9225-47ff-8a56-df7e4883dabd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:37.350809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1970da98-9225-47ff-8a56-df7e4883dabd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:37.351852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1970da98-9225-47ff-8a56-df7e4883dabd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:37.352353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1970da98-9225-47ff-8a56-df7e4883dabd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:37.352848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1970da98-9225-47ff-8a56-df7e4883dabd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:37.353285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1970da98-9225-47ff-8a56-df7e4883dabd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:37.361544 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0d83735a-ab9c-4226-b5e7-4964643373a7 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1275 microversion: 2.1 time: 0.911825 Aug 27 02:34:37.362180 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 695/1474] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:36 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1275 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:37.389624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1b921667-a7a6-4869-ba29-c0392d14a7e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852084-5", "block_migration": "auto"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:37.413130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b921667-a7a6-4869-ba29-c0392d14a7e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:37.462577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b921667-a7a6-4869-ba29-c0392d14a7e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:37.463089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b921667-a7a6-4869-ba29-c0392d14a7e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:37.463535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b921667-a7a6-4869-ba29-c0392d14a7e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:37.464834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b921667-a7a6-4869-ba29-c0392d14a7e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:37.465282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b921667-a7a6-4869-ba29-c0392d14a7e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:37.488071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b921667-a7a6-4869-ba29-c0392d14a7e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:37.597987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-1b921667-a7a6-4869-ba29-c0392d14a7e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'flavor' on Instance uuid 1ade60c1-89d3-4f5d-94e0-42f8b573f14b {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:34:37.666643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b921667-a7a6-4869-ba29-c0392d14a7e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Going to try to live migrate instance to n-h2-852084-5 {{(pid=122487) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:34:39.029224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1970da98-9225-47ff-8a56-df7e4883dabd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:39.074581 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1970da98-9225-47ff-8a56-df7e4883dabd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1474 microversion: 2.1 time: 1.776409 Aug 27 02:34:39.080274 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 780/1475] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:37 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1474 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:39.113381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:39.116135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:39.175834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:39.176626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:39.177426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:39.184763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:39.185985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:39.187499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:39.490742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:39.511176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:39.514943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:39.516954 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-022b40c5-ee18-4bf2-9ba9-7b826ba0059a tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.433732 Aug 27 02:34:39.517774 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 781/1476] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:39 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:39.524940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f563546-6c75-4d8a-8994-704985847615 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:39.526181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6f563546-6c75-4d8a-8994-704985847615 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:39.536943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f563546-6c75-4d8a-8994-704985847615 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:39.537873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f563546-6c75-4d8a-8994-704985847615 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:39.538794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f563546-6c75-4d8a-8994-704985847615 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:39.540082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f563546-6c75-4d8a-8994-704985847615 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:39.540820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f563546-6c75-4d8a-8994-704985847615 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:39.541447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f563546-6c75-4d8a-8994-704985847615 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:40.068741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6f563546-6c75-4d8a-8994-704985847615 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:40.079036 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6f563546-6c75-4d8a-8994-704985847615 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.559440 Aug 27 02:34:40.080566 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 782/1477] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:39 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:40.086028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-06fca1d6-1683-46e2-bae9-a248cb4395e9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:40.086922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-06fca1d6-1683-46e2-bae9-a248cb4395e9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:40.097343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06fca1d6-1683-46e2-bae9-a248cb4395e9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:40.100241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06fca1d6-1683-46e2-bae9-a248cb4395e9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:40.101350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06fca1d6-1683-46e2-bae9-a248cb4395e9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:40.102654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06fca1d6-1683-46e2-bae9-a248cb4395e9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:40.103333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06fca1d6-1683-46e2-bae9-a248cb4395e9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:40.103965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06fca1d6-1683-46e2-bae9-a248cb4395e9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:40.499070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:41.123505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-06fca1d6-1683-46e2-bae9-a248cb4395e9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:41.142941 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-06fca1d6-1683-46e2-bae9-a248cb4395e9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1363 microversion: 2.1 time: 1.060598 Aug 27 02:34:41.144254 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 783/1478] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:40 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1363 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:41.164248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f0f1a4d-8cfb-4959-8ac8-c05d4ba61dd2 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:41.168297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9f0f1a4d-8cfb-4959-8ac8-c05d4ba61dd2 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:41.191787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f0f1a4d-8cfb-4959-8ac8-c05d4ba61dd2 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:41.196338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f0f1a4d-8cfb-4959-8ac8-c05d4ba61dd2 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:41.197478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f0f1a4d-8cfb-4959-8ac8-c05d4ba61dd2 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:41.200549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f0f1a4d-8cfb-4959-8ac8-c05d4ba61dd2 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:41.202009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f0f1a4d-8cfb-4959-8ac8-c05d4ba61dd2 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:41.203401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f0f1a4d-8cfb-4959-8ac8-c05d4ba61dd2 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:41.224041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:41.802039 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1b921667-a7a6-4869-ba29-c0392d14a7e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b/action" status: 202 len: 0 microversion: 2.25 time: 4.428155 Aug 27 02:34:41.805482 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 696/1479] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:34:37 2022] POST /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b/action => generated 0 bytes in 4433 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:34:41.877350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-960415d6-2a5b-44cc-b512-82889bba6e9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:41.878709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-960415d6-2a5b-44cc-b512-82889bba6e9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:41.883589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9f0f1a4d-8cfb-4959-8ac8-c05d4ba61dd2 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:41.901010 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9f0f1a4d-8cfb-4959-8ac8-c05d4ba61dd2 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1317 microversion: 2.1 time: 0.754806 Aug 27 02:34:41.901704 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 784/1480] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:41 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1317 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:41.918253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7921b6de-e27a-4ea6-977f-971edf277320 req-451f646b-a8af-43fa-b683-85ab72397712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9500d4a-17ee-40b3-bc1c-77026234b7a3", "name": "network-vif-unplugged", "status": "completed", "tag": "aba73b64-257c-4090-8a10-377dba49c897"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:41.942223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:41.945126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7921b6de-e27a-4ea6-977f-971edf277320 req-451f646b-a8af-43fa-b683-85ab72397712 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:41.945612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7921b6de-e27a-4ea6-977f-971edf277320 req-451f646b-a8af-43fa-b683-85ab72397712 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:41.946265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7921b6de-e27a-4ea6-977f-971edf277320 req-451f646b-a8af-43fa-b683-85ab72397712 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:41.946398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-960415d6-2a5b-44cc-b512-82889bba6e9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:41.947184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-960415d6-2a5b-44cc-b512-82889bba6e9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:41.948672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-960415d6-2a5b-44cc-b512-82889bba6e9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:41.950424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-960415d6-2a5b-44cc-b512-82889bba6e9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:41.951218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-960415d6-2a5b-44cc-b512-82889bba6e9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:41.952954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-960415d6-2a5b-44cc-b512-82889bba6e9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:41.974174 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7921b6de-e27a-4ea6-977f-971edf277320 req-451f646b-a8af-43fa-b683-85ab72397712 service nova] Creating event network-vif-unplugged:aba73b64-257c-4090-8a10-377dba49c897 for instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 on n-h1-852084-5 Aug 27 02:34:41.980342 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7921b6de-e27a-4ea6-977f-971edf277320 req-451f646b-a8af-43fa-b683-85ab72397712 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077356 Aug 27 02:34:41.981370 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 785/1481] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:41.987444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:41.988480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:41.992689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:41.999926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:42.000955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:42.001615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:42.003530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:42.006517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:42.007243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:42.182228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:42.557650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:42.572933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:42.580948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:42.583510 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2713d858-8599-4153-b5c4-333893ea54f2 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.600656 Aug 27 02:34:42.591081 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 786/1482] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:41 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:42.601559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5fc9e0dd-e2e0-4c67-b9ec-c74b7d865fec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:42.602920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5fc9e0dd-e2e0-4c67-b9ec-c74b7d865fec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:42.617864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fc9e0dd-e2e0-4c67-b9ec-c74b7d865fec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:42.624806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fc9e0dd-e2e0-4c67-b9ec-c74b7d865fec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:42.626843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fc9e0dd-e2e0-4c67-b9ec-c74b7d865fec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:42.629282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fc9e0dd-e2e0-4c67-b9ec-c74b7d865fec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:42.637143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fc9e0dd-e2e0-4c67-b9ec-c74b7d865fec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:42.638857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fc9e0dd-e2e0-4c67-b9ec-c74b7d865fec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:42.929377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:43.079320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5fc9e0dd-e2e0-4c67-b9ec-c74b7d865fec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:43.106151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-960415d6-2a5b-44cc-b512-82889bba6e9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:43.117988 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5fc9e0dd-e2e0-4c67-b9ec-c74b7d865fec tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.525172 Aug 27 02:34:43.120498 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 787/1483] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:42 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:43.153550 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-960415d6-2a5b-44cc-b512-82889bba6e9d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1474 microversion: 2.1 time: 1.345845 Aug 27 02:34:43.158576 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 697/1484] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:41 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1474 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:43.177910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-0dc23916-9dc1-4531-9f61-3e7a870a1922 req-7ef25387-435b-4c98-841a-d7560d7eda4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239", "tag": "6cfc7b59-1842-432b-a4c1-9de0b889e674"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:43.195684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:43.198976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:43.221923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0dc23916-9dc1-4531-9f61-3e7a870a1922 req-7ef25387-435b-4c98-841a-d7560d7eda4e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:43.222711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:43.224072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0dc23916-9dc1-4531-9f61-3e7a870a1922 req-7ef25387-435b-4c98-841a-d7560d7eda4e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:43.224748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0dc23916-9dc1-4531-9f61-3e7a870a1922 req-7ef25387-435b-4c98-841a-d7560d7eda4e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:43.225459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:43.226275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:43.233199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:43.234796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:43.235743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:43.264647 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-0dc23916-9dc1-4531-9f61-3e7a870a1922 req-7ef25387-435b-4c98-841a-d7560d7eda4e service nova] Creating event network-changed:6cfc7b59-1842-432b-a4c1-9de0b889e674 for instance 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 on n-h1-852084-5 Aug 27 02:34:43.273302 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-0dc23916-9dc1-4531-9f61-3e7a870a1922 req-7ef25387-435b-4c98-841a-d7560d7eda4e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150125 Aug 27 02:34:43.274963 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 788/1485] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:43.284588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5cf166f-8a64-4629-9f70-d0059d68aede tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:43.285769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e5cf166f-8a64-4629-9f70-d0059d68aede tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:43.308844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5cf166f-8a64-4629-9f70-d0059d68aede tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:43.311780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5cf166f-8a64-4629-9f70-d0059d68aede tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:43.312321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5cf166f-8a64-4629-9f70-d0059d68aede tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:43.318123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5cf166f-8a64-4629-9f70-d0059d68aede tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:43.318725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5cf166f-8a64-4629-9f70-d0059d68aede tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:43.325567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5cf166f-8a64-4629-9f70-d0059d68aede tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:43.770080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e5cf166f-8a64-4629-9f70-d0059d68aede tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:43.799215 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e5cf166f-8a64-4629-9f70-d0059d68aede tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1363 microversion: 2.1 time: 0.521323 Aug 27 02:34:43.800410 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 789/1486] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:43 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:43.919052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:44.053726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:44.105870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:44.128176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:44.139446 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b1eb90d7-8bac-41cd-8587-98db1adf4dd7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.961524 Aug 27 02:34:44.144053 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 698/1487] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:43 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:44.176348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c1243e1-198b-475b-a7bc-cc19aff8f754 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:44.178357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4c1243e1-198b-475b-a7bc-cc19aff8f754 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:44.234205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c1243e1-198b-475b-a7bc-cc19aff8f754 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:44.236378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c1243e1-198b-475b-a7bc-cc19aff8f754 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:44.237151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c1243e1-198b-475b-a7bc-cc19aff8f754 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:44.242916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c1243e1-198b-475b-a7bc-cc19aff8f754 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:44.246729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c1243e1-198b-475b-a7bc-cc19aff8f754 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:44.247509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c1243e1-198b-475b-a7bc-cc19aff8f754 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:44.389380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4d189242-e010-4256-8ccd-fabc393e7313 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Action: 'create', calling method: .version_select at 0x7f4d2a26dee0>, body: {"keypair": {"name": "tempest-keypair-1400954367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPssEZqvXixPzLYbY407meQOqgWgaXfR5tRr7vf8bxcaNhYcZZwMp9giNZm+sFUAPa5Xp0wyqu87XkRAgSvw0A2vo16YxvDUPLfveieDgGInUX45AEh8n9lcCvj6MvTeQ=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:44.444131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4d189242-e010-4256-8ccd-fabc393e7313 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Getting quotas for project c45b216feebc4d898843009e9eb608ca. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:34:44.459870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4d189242-e010-4256-8ccd-fabc393e7313 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Getting quotas for user 49945341feee4fd4b40ea30f385fc9f0 and project c45b216feebc4d898843009e9eb608ca. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:34:44.522995 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4d189242-e010-4256-8ccd-fabc393e7313 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.703335 Aug 27 02:34:44.530957 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 790/1488] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:34:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:44.539156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:44.541079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:44.552022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:44.562259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:44.563035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:44.563996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:44.564814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:44.565461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:44.736301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:44.750913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:44.755155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:44.760216 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f859ae83-53d9-46c3-8393-dfa3ef17ec95 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1365 microversion: 2.57 time: 0.227677 Aug 27 02:34:44.764622 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 791/1489] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:44 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:44.771462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8076782d-78da-4d7a-99ac-00034fe4b889 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:44.772493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8076782d-78da-4d7a-99ac-00034fe4b889 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:44.778984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:44.780994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8076782d-78da-4d7a-99ac-00034fe4b889 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:44.781507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8076782d-78da-4d7a-99ac-00034fe4b889 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:44.782046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8076782d-78da-4d7a-99ac-00034fe4b889 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:44.782735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8076782d-78da-4d7a-99ac-00034fe4b889 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:44.783204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8076782d-78da-4d7a-99ac-00034fe4b889 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:44.783641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8076782d-78da-4d7a-99ac-00034fe4b889 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:44.794284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4c1243e1-198b-475b-a7bc-cc19aff8f754 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:44.821724 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4c1243e1-198b-475b-a7bc-cc19aff8f754 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1317 microversion: 2.1 time: 0.670219 Aug 27 02:34:44.822817 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 699/1490] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:44 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1317 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:44.850161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-99c72c53-2f1b-451c-94d0-2ba90f85e07e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:44.851239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-99c72c53-2f1b-451c-94d0-2ba90f85e07e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:44.877293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99c72c53-2f1b-451c-94d0-2ba90f85e07e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:44.880305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99c72c53-2f1b-451c-94d0-2ba90f85e07e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:44.881212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99c72c53-2f1b-451c-94d0-2ba90f85e07e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:44.887157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99c72c53-2f1b-451c-94d0-2ba90f85e07e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:44.888122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99c72c53-2f1b-451c-94d0-2ba90f85e07e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:44.888958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99c72c53-2f1b-451c-94d0-2ba90f85e07e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:45.418766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8076782d-78da-4d7a-99ac-00034fe4b889 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:45.436007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-99c72c53-2f1b-451c-94d0-2ba90f85e07e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:45.473914 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8076782d-78da-4d7a-99ac-00034fe4b889 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.707996 Aug 27 02:34:45.482334 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 792/1491] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:44 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:45.484270 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-99c72c53-2f1b-451c-94d0-2ba90f85e07e tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1474 microversion: 2.1 time: 0.642509 Aug 27 02:34:45.487938 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 700/1492] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:44 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1474 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:45.511612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-10ecb259-f15d-4ae7-9a1d-4966bc8fd47e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:45.513062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-10ecb259-f15d-4ae7-9a1d-4966bc8fd47e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:45.516980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-535c86d8-7d60-4a2d-81d8-8bfd2ac2f1b0 req-75104172-d6e8-451e-b562-b51003878c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9500d4a-17ee-40b3-bc1c-77026234b7a3", "tag": "aba73b64-257c-4090-8a10-377dba49c897"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:45.530506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10ecb259-f15d-4ae7-9a1d-4966bc8fd47e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:45.547999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10ecb259-f15d-4ae7-9a1d-4966bc8fd47e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:45.549514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-535c86d8-7d60-4a2d-81d8-8bfd2ac2f1b0 req-75104172-d6e8-451e-b562-b51003878c15 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:45.550186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-535c86d8-7d60-4a2d-81d8-8bfd2ac2f1b0 req-75104172-d6e8-451e-b562-b51003878c15 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:45.554336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10ecb259-f15d-4ae7-9a1d-4966bc8fd47e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:45.554696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-535c86d8-7d60-4a2d-81d8-8bfd2ac2f1b0 req-75104172-d6e8-451e-b562-b51003878c15 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:45.555130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10ecb259-f15d-4ae7-9a1d-4966bc8fd47e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:45.555623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10ecb259-f15d-4ae7-9a1d-4966bc8fd47e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:45.556072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10ecb259-f15d-4ae7-9a1d-4966bc8fd47e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:45.579337 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-535c86d8-7d60-4a2d-81d8-8bfd2ac2f1b0 req-75104172-d6e8-451e-b562-b51003878c15 service nova] Creating event network-changed:aba73b64-257c-4090-8a10-377dba49c897 for instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 on n-h1-852084-5 Aug 27 02:34:45.593301 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-535c86d8-7d60-4a2d-81d8-8bfd2ac2f1b0 req-75104172-d6e8-451e-b562-b51003878c15 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107600 Aug 27 02:34:45.595800 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 793/1493] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:45.602807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:45.604165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:45.615218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:45.616431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:45.617690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:45.618636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:45.621967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:45.623157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:46.141513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:46.184123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:46.198966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:46.201735 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a7c0952-ab70-420c-821d-e825c880b5f7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.603713 Aug 27 02:34:46.205006 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 794/1494] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:45 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:46.218280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-5d425d06-a94e-44e6-8427-8f9707edbd1f req-fdcea6b6-010a-4b61-82cb-4c2dbcfd69f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59462ca6-1830-4fae-a141-ffade28879f6", "tag": "b9a18ca7-1e41-4aa3-9c64-1d916f180dce"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:46.243420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5d425d06-a94e-44e6-8427-8f9707edbd1f req-fdcea6b6-010a-4b61-82cb-4c2dbcfd69f3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:46.245979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5d425d06-a94e-44e6-8427-8f9707edbd1f req-fdcea6b6-010a-4b61-82cb-4c2dbcfd69f3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:46.247404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5d425d06-a94e-44e6-8427-8f9707edbd1f req-fdcea6b6-010a-4b61-82cb-4c2dbcfd69f3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:46.271103 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-5d425d06-a94e-44e6-8427-8f9707edbd1f req-fdcea6b6-010a-4b61-82cb-4c2dbcfd69f3 service nova] Creating event network-changed:b9a18ca7-1e41-4aa3-9c64-1d916f180dce for instance 59462ca6-1830-4fae-a141-ffade28879f6 on n-h1-852084-5 Aug 27 02:34:46.281552 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-5d425d06-a94e-44e6-8427-8f9707edbd1f req-fdcea6b6-010a-4b61-82cb-4c2dbcfd69f3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073923 Aug 27 02:34:46.283659 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 795/1495] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:46.298706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:46.301489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:46.313423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:46.314420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:46.315732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:46.317638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:46.319572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:46.321018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:46.449036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:46.459836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:46.461628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:46.464717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a35eeb62-269f-4379-a823-3a21cd798bea tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1371 microversion: 2.57 time: 0.177163 Aug 27 02:34:46.465807 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 796/1496] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:46 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:46.490096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a8b2d91d-cf7a-41a3-9ecb-d6ef090f5712 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:46.491445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a8b2d91d-cf7a-41a3-9ecb-d6ef090f5712 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:46.503566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8b2d91d-cf7a-41a3-9ecb-d6ef090f5712 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:46.505947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8b2d91d-cf7a-41a3-9ecb-d6ef090f5712 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:46.506478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8b2d91d-cf7a-41a3-9ecb-d6ef090f5712 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:46.507312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8b2d91d-cf7a-41a3-9ecb-d6ef090f5712 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:46.508016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8b2d91d-cf7a-41a3-9ecb-d6ef090f5712 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:46.508657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8b2d91d-cf7a-41a3-9ecb-d6ef090f5712 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:46.598368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-10ecb259-f15d-4ae7-9a1d-4966bc8fd47e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:46.619996 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-10ecb259-f15d-4ae7-9a1d-4966bc8fd47e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1363 microversion: 2.1 time: 1.129155 Aug 27 02:34:46.626807 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 701/1497] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:45 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1363 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:46.752746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45542407-c5da-493e-872b-33b02bc1d66d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Action: 'create', calling method: .version_select at 0x7f4d2e89aee0>, body: {"keypair": {"name": "tempest-keypair-353218416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLF5yoqs9Z3F0X/EWVPG2Jh2cXz08KgzGkHa7Kk8qdDF+bLwDcW/p2Ho+o+JGToBv+pHs473yBzn3ndTZCMysnogzpPSvd8A4zkkJvIqJDR+VX6xaGX1Y+L0cDg6HAVq8g=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:46.841350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-45542407-c5da-493e-872b-33b02bc1d66d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Getting quotas for project 757f05228f774702ac1a58772faf4393. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:34:46.862865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-45542407-c5da-493e-872b-33b02bc1d66d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Getting quotas for user 630df349c316497c82b100427e2da818 and project 757f05228f774702ac1a58772faf4393. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:34:46.898046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a8b2d91d-cf7a-41a3-9ecb-d6ef090f5712 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:46.909907 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a8b2d91d-cf7a-41a3-9ecb-d6ef090f5712 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1317 microversion: 2.1 time: 0.429254 Aug 27 02:34:46.930260 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 797/1498] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:46 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:46.938772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e8f903a2-e3e6-420d-a5cf-16b62bc15fff tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:46.939704 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-45542407-c5da-493e-872b-33b02bc1d66d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.310383 Aug 27 02:34:46.940078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e8f903a2-e3e6-420d-a5cf-16b62bc15fff tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:46.940757 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 702/1499] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:34:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:46.954337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68ee4727-0d6f-442b-9f0f-ea9e352305c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:46.955745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-68ee4727-0d6f-442b-9f0f-ea9e352305c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:46.969228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68ee4727-0d6f-442b-9f0f-ea9e352305c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:46.970172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68ee4727-0d6f-442b-9f0f-ea9e352305c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:46.971101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68ee4727-0d6f-442b-9f0f-ea9e352305c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:46.972880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68ee4727-0d6f-442b-9f0f-ea9e352305c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:46.973586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8f903a2-e3e6-420d-a5cf-16b62bc15fff tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:46.973911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68ee4727-0d6f-442b-9f0f-ea9e352305c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:46.974855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8f903a2-e3e6-420d-a5cf-16b62bc15fff tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:46.975132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68ee4727-0d6f-442b-9f0f-ea9e352305c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:46.978757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8f903a2-e3e6-420d-a5cf-16b62bc15fff tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:46.981627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8f903a2-e3e6-420d-a5cf-16b62bc15fff tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:46.982230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8f903a2-e3e6-420d-a5cf-16b62bc15fff tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:46.984855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8f903a2-e3e6-420d-a5cf-16b62bc15fff tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:47.524349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e8f903a2-e3e6-420d-a5cf-16b62bc15fff tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:47.541371 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e8f903a2-e3e6-420d-a5cf-16b62bc15fff tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1474 microversion: 2.1 time: 0.607740 Aug 27 02:34:47.545431 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 798/1500] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:46 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1474 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:47.562693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:47.563840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:47.573147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:47.573650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:47.574627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:47.575585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:47.576233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:47.576841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:47.932653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-68ee4727-0d6f-442b-9f0f-ea9e352305c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:47.963725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:47.975000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:47.987873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:47.989399 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad07c95f-9c54-4b47-be77-7cbe32d7190b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.442098 Aug 27 02:34:47.990216 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 799/1501] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:47 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:47.997648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:48.001166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:48.016836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:48.021432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:48.022120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:48.023091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:48.023753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:48.024422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:48.060175 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-68ee4727-0d6f-442b-9f0f-ea9e352305c5 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 1.117037 Aug 27 02:34:48.066626 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 703/1502] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:46 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:48.081803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-10014edb-c0d5-4180-8188-28f0435890bc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:48.084715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-10014edb-c0d5-4180-8188-28f0435890bc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:48.100586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10014edb-c0d5-4180-8188-28f0435890bc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:48.101547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10014edb-c0d5-4180-8188-28f0435890bc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:48.102673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10014edb-c0d5-4180-8188-28f0435890bc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:48.104936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10014edb-c0d5-4180-8188-28f0435890bc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:48.106348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10014edb-c0d5-4180-8188-28f0435890bc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:48.107688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10014edb-c0d5-4180-8188-28f0435890bc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:48.270617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:48.283442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:48.285474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:48.286988 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-895d7427-5702-4f1d-a217-cfda899f06de tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1371 microversion: 2.57 time: 0.295602 Aug 27 02:34:48.287782 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 800/1503] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:47 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:48.293943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-47e9a8de-bca1-437c-90eb-ea7a389b7532 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:48.294908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-47e9a8de-bca1-437c-90eb-ea7a389b7532 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:48.313213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47e9a8de-bca1-437c-90eb-ea7a389b7532 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:48.313892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47e9a8de-bca1-437c-90eb-ea7a389b7532 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:48.315225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47e9a8de-bca1-437c-90eb-ea7a389b7532 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:48.315225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47e9a8de-bca1-437c-90eb-ea7a389b7532 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:48.318908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47e9a8de-bca1-437c-90eb-ea7a389b7532 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:48.320627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47e9a8de-bca1-437c-90eb-ea7a389b7532 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:48.646222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-10014edb-c0d5-4180-8188-28f0435890bc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:48.654127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-47e9a8de-bca1-437c-90eb-ea7a389b7532 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:48.661319 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-10014edb-c0d5-4180-8188-28f0435890bc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1363 microversion: 2.1 time: 0.591352 Aug 27 02:34:48.670562 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 704/1504] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:48 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1363 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:48.675712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-beb7d930-2f68-484f-9f42-e121f512941f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:48.685053 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-47e9a8de-bca1-437c-90eb-ea7a389b7532 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1317 microversion: 2.1 time: 0.395994 Aug 27 02:34:48.690676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-beb7d930-2f68-484f-9f42-e121f512941f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:48.698363 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 801/1505] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:48 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:48.699818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-beb7d930-2f68-484f-9f42-e121f512941f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:48.700363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-beb7d930-2f68-484f-9f42-e121f512941f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:48.700798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-beb7d930-2f68-484f-9f42-e121f512941f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:48.701532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-beb7d930-2f68-484f-9f42-e121f512941f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:48.706704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-beb7d930-2f68-484f-9f42-e121f512941f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:48.707521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-beb7d930-2f68-484f-9f42-e121f512941f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:49.017851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:49.024400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:49.041096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:49.046831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:49.047775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:49.048888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:49.050628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:49.051510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:49.434291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:49.448455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:49.450207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:49.451422 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-04d530a7-9810-4579-a0aa-5061fcc35856 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.441608 Aug 27 02:34:49.454088 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 802/1506] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:49 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:49.460747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b5dca8b9-1543-4936-a67a-a24cefff7310 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:49.461871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b5dca8b9-1543-4936-a67a-a24cefff7310 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:49.470823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5dca8b9-1543-4936-a67a-a24cefff7310 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:49.471725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5dca8b9-1543-4936-a67a-a24cefff7310 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:49.472574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5dca8b9-1543-4936-a67a-a24cefff7310 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:49.473995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5dca8b9-1543-4936-a67a-a24cefff7310 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:49.476009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5dca8b9-1543-4936-a67a-a24cefff7310 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:49.477559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5dca8b9-1543-4936-a67a-a24cefff7310 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:49.533394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-beb7d930-2f68-484f-9f42-e121f512941f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:49.548207 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-beb7d930-2f68-484f-9f42-e121f512941f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1474 microversion: 2.1 time: 0.876217 Aug 27 02:34:49.548815 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 705/1507] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:48 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1474 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:49.561591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:49.563150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:49.577325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:49.578402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:49.579126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:49.580445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:49.581408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:49.582177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:49.691798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:49.704423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:49.707751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:49.710132 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0085f620-6bfb-4b9d-8d3d-3204f14ed769 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1356 microversion: 2.57 time: 0.160030 Aug 27 02:34:49.712140 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 706/1508] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:49 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:49.732410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-359e6b47-de7b-4949-a9e3-c6376dc5e1d3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:49.738555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-359e6b47-de7b-4949-a9e3-c6376dc5e1d3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:49.754027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b5dca8b9-1543-4936-a67a-a24cefff7310 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:49.756704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-359e6b47-de7b-4949-a9e3-c6376dc5e1d3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:49.761181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-359e6b47-de7b-4949-a9e3-c6376dc5e1d3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:49.761724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-359e6b47-de7b-4949-a9e3-c6376dc5e1d3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:49.764166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-359e6b47-de7b-4949-a9e3-c6376dc5e1d3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:49.764761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-359e6b47-de7b-4949-a9e3-c6376dc5e1d3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:49.766514 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b5dca8b9-1543-4936-a67a-a24cefff7310 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.310894 Aug 27 02:34:49.767163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-359e6b47-de7b-4949-a9e3-c6376dc5e1d3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:49.778284 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 803/1509] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:49 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:49.786411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d3f235e-891b-4d15-97ae-fbd704474335 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:49.787044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d3f235e-891b-4d15-97ae-fbd704474335 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:49.819953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d3f235e-891b-4d15-97ae-fbd704474335 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:49.820520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d3f235e-891b-4d15-97ae-fbd704474335 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:49.820994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d3f235e-891b-4d15-97ae-fbd704474335 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:49.823442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d3f235e-891b-4d15-97ae-fbd704474335 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:49.825644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d3f235e-891b-4d15-97ae-fbd704474335 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:49.834539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d3f235e-891b-4d15-97ae-fbd704474335 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:49.874185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:50.391472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2d3f235e-891b-4d15-97ae-fbd704474335 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:50.417411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-359e6b47-de7b-4949-a9e3-c6376dc5e1d3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:50.429762 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-359e6b47-de7b-4949-a9e3-c6376dc5e1d3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1363 microversion: 2.1 time: 0.715832 Aug 27 02:34:50.430980 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 707/1510] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:49 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1363 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:50.432418 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2d3f235e-891b-4d15-97ae-fbd704474335 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1317 microversion: 2.1 time: 0.639418 Aug 27 02:34:50.438578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b1aba83e-5761-4da6-81e2-0a68cf6cc56e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:50.446041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b1aba83e-5761-4da6-81e2-0a68cf6cc56e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:50.452259 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 804/1511] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:49 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:50.457861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1aba83e-5761-4da6-81e2-0a68cf6cc56e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:50.465179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1aba83e-5761-4da6-81e2-0a68cf6cc56e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:50.466301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1aba83e-5761-4da6-81e2-0a68cf6cc56e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:50.471169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1aba83e-5761-4da6-81e2-0a68cf6cc56e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:50.472217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1aba83e-5761-4da6-81e2-0a68cf6cc56e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:50.473256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1aba83e-5761-4da6-81e2-0a68cf6cc56e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:50.473422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1972746307", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "2304660c-5860-427d-ae1e-255b094fa94a"}], "security_groups": [{"name": "tempest-securitygroup--1076204429"}], "key_name": "tempest-keypair-1400954367", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:50.570029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b1aba83e-5761-4da6-81e2-0a68cf6cc56e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:34:50.717201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] validate_networks() for [('2304660c-5860-427d-ae1e-255b094fa94a', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:34:50.852994 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b1aba83e-5761-4da6-81e2-0a68cf6cc56e tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 204 len: 0 microversion: 2.57 time: 0.417824 Aug 27 02:34:50.857699 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 708/1512] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:34:50 2022] DELETE /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:34:50.872128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:50.873001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:50.889990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:50.890916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:50.893098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:50.894891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:50.895570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:50.896769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:51.231162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:51.251933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:51.254958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:51.260198 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8be33d96-fd1b-41b6-8f79-1a8008363928 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.400383 Aug 27 02:34:51.261115 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 709/1513] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:50 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:51.277200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-16a8a0f9-6438-4b81-a2fc-025e51c8472f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:51.280756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-16a8a0f9-6438-4b81-a2fc-025e51c8472f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:51.292977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a8a0f9-6438-4b81-a2fc-025e51c8472f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:51.297524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a8a0f9-6438-4b81-a2fc-025e51c8472f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:51.298408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a8a0f9-6438-4b81-a2fc-025e51c8472f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:51.299504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a8a0f9-6438-4b81-a2fc-025e51c8472f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:51.300254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a8a0f9-6438-4b81-a2fc-025e51c8472f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:51.300961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a8a0f9-6438-4b81-a2fc-025e51c8472f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:52.005845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16a8a0f9-6438-4b81-a2fc-025e51c8472f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:52.021520 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-16a8a0f9-6438-4b81-a2fc-025e51c8472f tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1473 microversion: 2.1 time: 0.756135 Aug 27 02:34:52.022588 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 710/1514] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:51 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1473 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:52.037973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-082a0bab-b1d7-4fb5-bfdf-b2598f137a1c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:52.039325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-082a0bab-b1d7-4fb5-bfdf-b2598f137a1c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:52.047810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-082a0bab-b1d7-4fb5-bfdf-b2598f137a1c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:52.048736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-082a0bab-b1d7-4fb5-bfdf-b2598f137a1c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:52.049446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-082a0bab-b1d7-4fb5-bfdf-b2598f137a1c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:52.050542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-082a0bab-b1d7-4fb5-bfdf-b2598f137a1c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:52.051420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-082a0bab-b1d7-4fb5-bfdf-b2598f137a1c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:52.052146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-082a0bab-b1d7-4fb5-bfdf-b2598f137a1c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:52.428520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-082a0bab-b1d7-4fb5-bfdf-b2598f137a1c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:52.443117 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-082a0bab-b1d7-4fb5-bfdf-b2598f137a1c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.419132 Aug 27 02:34:52.444074 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 711/1515] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:52 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:52.449300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:52.454654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:52.467449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:52.470502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:52.470956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:52.471726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:52.472199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:52.472629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:52.521181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:34:52.522255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:34:52.522953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:34:52.523379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:34:52.523791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:34:52.535342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:52.536125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:52.536747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:52.537779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:52.538488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:52.539095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:52.563369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Getting quotas for project c45b216feebc4d898843009e9eb608ca. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:34:52.570357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Getting quotas for user 49945341feee4fd4b40ea30f385fc9f0 and project c45b216feebc4d898843009e9eb608ca. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:34:52.591311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:34:52.594979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:34:52.599208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:52.611895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:52.614605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:52.617345 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8e0db4ce-0a53-4889-8c63-b5b211e02d42 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1362 microversion: 2.57 time: 0.171691 Aug 27 02:34:52.618759 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 712/1516] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:52 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:52.626052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fd58a89b-9ae5-4e6f-be25-424b4f1ed415 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:52.627123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fd58a89b-9ae5-4e6f-be25-424b4f1ed415 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:52.638322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd58a89b-9ae5-4e6f-be25-424b4f1ed415 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:52.639830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd58a89b-9ae5-4e6f-be25-424b4f1ed415 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:52.641599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd58a89b-9ae5-4e6f-be25-424b4f1ed415 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:52.643995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd58a89b-9ae5-4e6f-be25-424b4f1ed415 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:52.644764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd58a89b-9ae5-4e6f-be25-424b4f1ed415 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:52.647055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd58a89b-9ae5-4e6f-be25-424b4f1ed415 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:52.685373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:52.698663 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-48732c63-f706-415d-afeb-67a8d127d5ce tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.243409 Aug 27 02:34:52.700131 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 805/1517] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:34:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:34:52.710146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4816b4fa-bff2-4da9-959b-1e4d7e998de3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:52.718226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4816b4fa-bff2-4da9-959b-1e4d7e998de3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:52.725882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4816b4fa-bff2-4da9-959b-1e4d7e998de3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:52.726635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4816b4fa-bff2-4da9-959b-1e4d7e998de3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:52.727378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4816b4fa-bff2-4da9-959b-1e4d7e998de3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:52.728137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4816b4fa-bff2-4da9-959b-1e4d7e998de3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:52.728714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4816b4fa-bff2-4da9-959b-1e4d7e998de3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:52.729184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4816b4fa-bff2-4da9-959b-1e4d7e998de3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:53.117895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4816b4fa-bff2-4da9-959b-1e4d7e998de3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:53.127090 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4816b4fa-bff2-4da9-959b-1e4d7e998de3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1363 microversion: 2.1 time: 0.425591 Aug 27 02:34:53.129091 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 806/1518] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:52 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1363 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:53.134938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-356713db-3682-4f80-8b62-d988237d5375 req-d5e40ce3-fd2c-42f8-964b-5ddc4c3cff54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239", "name": "network-vif-plugged", "status": "completed", "tag": "6cfc7b59-1842-432b-a4c1-9de0b889e674"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:53.151332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-356713db-3682-4f80-8b62-d988237d5375 req-d5e40ce3-fd2c-42f8-964b-5ddc4c3cff54 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:53.152130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-356713db-3682-4f80-8b62-d988237d5375 req-d5e40ce3-fd2c-42f8-964b-5ddc4c3cff54 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:53.152770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-356713db-3682-4f80-8b62-d988237d5375 req-d5e40ce3-fd2c-42f8-964b-5ddc4c3cff54 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:53.201930 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-356713db-3682-4f80-8b62-d988237d5375 req-d5e40ce3-fd2c-42f8-964b-5ddc4c3cff54 service nova] Creating event network-vif-plugged:6cfc7b59-1842-432b-a4c1-9de0b889e674 for instance 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 on n-h1-852084-5 Aug 27 02:34:53.213509 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-356713db-3682-4f80-8b62-d988237d5375 req-d5e40ce3-fd2c-42f8-964b-5ddc4c3cff54 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082038 Aug 27 02:34:53.230784 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 807/1519] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:53.247478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:53.252759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:53.285931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:53.289101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:53.290609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:53.302523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:53.302523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:53.302523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:53.302999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fd58a89b-9ae5-4e6f-be25-424b4f1ed415 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:53.337370 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fd58a89b-9ae5-4e6f-be25-424b4f1ed415 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1317 microversion: 2.1 time: 0.716359 Aug 27 02:34:53.349948 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 713/1520] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:52 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:53.366273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-da19716c-c1e1-4a1c-b3df-4499bf61442d req-12a7a21d-6896-474e-a90f-43d3959360f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e52df0-ca95-4f33-beb8-660817c63658", "name": "network-vif-unplugged", "status": "completed", "tag": "dba12d2f-f390-4730-9f01-553471e2b87a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:53.419923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-da19716c-c1e1-4a1c-b3df-4499bf61442d req-12a7a21d-6896-474e-a90f-43d3959360f6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:53.420794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-da19716c-c1e1-4a1c-b3df-4499bf61442d req-12a7a21d-6896-474e-a90f-43d3959360f6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:53.421812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-da19716c-c1e1-4a1c-b3df-4499bf61442d req-12a7a21d-6896-474e-a90f-43d3959360f6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:53.555258 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-da19716c-c1e1-4a1c-b3df-4499bf61442d req-12a7a21d-6896-474e-a90f-43d3959360f6 service nova] Creating event network-vif-unplugged:dba12d2f-f390-4730-9f01-553471e2b87a for instance 28e52df0-ca95-4f33-beb8-660817c63658 on n-h1-852084-5 Aug 27 02:34:53.592609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-da19716c-c1e1-4a1c-b3df-4499bf61442d req-12a7a21d-6896-474e-a90f-43d3959360f6 service nova] Instance 28e52df0-ca95-4f33-beb8-660817c63658 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:34:53.669444 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-da19716c-c1e1-4a1c-b3df-4499bf61442d req-12a7a21d-6896-474e-a90f-43d3959360f6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.318783 Aug 27 02:34:53.679485 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 714/1521] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:53.714090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ace8b03d-e55d-4c63-960d-01b2abbc556b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:53.715391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ace8b03d-e55d-4c63-960d-01b2abbc556b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:53.817034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:53.827595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:53.829985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:53.843516 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-88e24012-08f1-43aa-b5b0-751aba532012 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.610548 Aug 27 02:34:53.860811 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 808/1522] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:53 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:53.874478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1362aeb7-b981-4251-956a-9a1d7ab092ca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:53.875933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1362aeb7-b981-4251-956a-9a1d7ab092ca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:53.890498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1362aeb7-b981-4251-956a-9a1d7ab092ca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:53.891513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1362aeb7-b981-4251-956a-9a1d7ab092ca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:53.892235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1362aeb7-b981-4251-956a-9a1d7ab092ca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:53.893477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1362aeb7-b981-4251-956a-9a1d7ab092ca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:53.894459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1362aeb7-b981-4251-956a-9a1d7ab092ca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:53.895173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1362aeb7-b981-4251-956a-9a1d7ab092ca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:54.021986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ace8b03d-e55d-4c63-960d-01b2abbc556b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:54.038207 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ace8b03d-e55d-4c63-960d-01b2abbc556b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1242 microversion: 2.1 time: 0.352770 Aug 27 02:34:54.039134 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 715/1523] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:53 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1242 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:54.051502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2038596231", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c87daf01-f249-4628-afaa-d035d2c6d82c"}], "security_groups": [{"name": "tempest-securitygroup--380003538"}], "key_name": "tempest-keypair-353218416", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:54.155535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1362aeb7-b981-4251-956a-9a1d7ab092ca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:54.168175 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1362aeb7-b981-4251-956a-9a1d7ab092ca tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1473 microversion: 2.1 time: 0.300059 Aug 27 02:34:54.169411 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 809/1524] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:53 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1473 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:54.175556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-500e3ff3-0e50-4a68-8440-39b530620cea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:54.176483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-500e3ff3-0e50-4a68-8440-39b530620cea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:54.185500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-500e3ff3-0e50-4a68-8440-39b530620cea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:54.186194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-500e3ff3-0e50-4a68-8440-39b530620cea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:54.186698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-500e3ff3-0e50-4a68-8440-39b530620cea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:54.187533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-500e3ff3-0e50-4a68-8440-39b530620cea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:54.188003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-500e3ff3-0e50-4a68-8440-39b530620cea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:54.188449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-500e3ff3-0e50-4a68-8440-39b530620cea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:54.422653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-500e3ff3-0e50-4a68-8440-39b530620cea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:54.433382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] validate_networks() for [('c87daf01-f249-4628-afaa-d035d2c6d82c', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:34:54.434315 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-500e3ff3-0e50-4a68-8440-39b530620cea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.263104 Aug 27 02:34:54.435269 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 810/1525] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:54 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:54.442030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:54.443002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:54.452338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:54.453080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:54.453519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:54.454281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:54.454737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:54.455161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:54.499067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:54.499990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:54.500621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:54.501328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lazy-loading 'fault' on Instance uuid b54cb5ac-87d2-447b-874d-867e27020ba9 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:34:54.558686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:54.577324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:54.580436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78e37d7005074d3bb78ad2469ac4b413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6f27fe052b45309c6937a5af8e3220', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:54.582487 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7d9db8cc-1c7b-4e25-91ca-b0aeb0a0c613 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 200 len: 1367 microversion: 2.57 time: 0.145959 Aug 27 02:34:54.583410 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 811/1526] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:54 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:54.583410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c7254409-ae96-41a7-9e15-1c3ae741647b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:54.595256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c7254409-ae96-41a7-9e15-1c3ae741647b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:54.607568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7254409-ae96-41a7-9e15-1c3ae741647b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:54.609659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7254409-ae96-41a7-9e15-1c3ae741647b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:54.609659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7254409-ae96-41a7-9e15-1c3ae741647b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:54.610508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7254409-ae96-41a7-9e15-1c3ae741647b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:54.611387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7254409-ae96-41a7-9e15-1c3ae741647b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:54.612189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7254409-ae96-41a7-9e15-1c3ae741647b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:54.848995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c7254409-ae96-41a7-9e15-1c3ae741647b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:54.865139 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c7254409-ae96-41a7-9e15-1c3ae741647b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1363 microversion: 2.1 time: 0.279468 Aug 27 02:34:54.866419 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 812/1527] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:54 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:54.886601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c75173ed-6550-4a61-b49b-dff1d57ec879 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:54.887792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c75173ed-6550-4a61-b49b-dff1d57ec879 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:54.895045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c75173ed-6550-4a61-b49b-dff1d57ec879 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:54.895728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c75173ed-6550-4a61-b49b-dff1d57ec879 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:54.896420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c75173ed-6550-4a61-b49b-dff1d57ec879 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:54.897345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c75173ed-6550-4a61-b49b-dff1d57ec879 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:54.898012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c75173ed-6550-4a61-b49b-dff1d57ec879 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:54.898843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c75173ed-6550-4a61-b49b-dff1d57ec879 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:55.071769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c75173ed-6550-4a61-b49b-dff1d57ec879 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:55.083557 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c75173ed-6550-4a61-b49b-dff1d57ec879 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1317 microversion: 2.1 time: 0.204073 Aug 27 02:34:55.084252 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 813/1528] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:54 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:55.095651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:55.096780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:55.106739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:55.108138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:55.108760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:55.110029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:55.110778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:55.111389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:55.331159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:55.348672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:55.352962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:55.355642 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-59c3e85a-68d2-4845-b142-ca0f2efde742 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.269776 Aug 27 02:34:55.357517 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 814/1529] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:55 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:55.384325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a8233fa2-00a6-4716-832a-3e4910cd3039 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:55.386710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a8233fa2-00a6-4716-832a-3e4910cd3039 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:55.402172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8233fa2-00a6-4716-832a-3e4910cd3039 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:55.402983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8233fa2-00a6-4716-832a-3e4910cd3039 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:55.403552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8233fa2-00a6-4716-832a-3e4910cd3039 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:55.404422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8233fa2-00a6-4716-832a-3e4910cd3039 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:55.405060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8233fa2-00a6-4716-832a-3e4910cd3039 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:55.405980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8233fa2-00a6-4716-832a-3e4910cd3039 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:55.601444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a8233fa2-00a6-4716-832a-3e4910cd3039 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:55.626964 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a8233fa2-00a6-4716-832a-3e4910cd3039 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1302 microversion: 2.1 time: 0.267278 Aug 27 02:34:55.629910 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 815/1530] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:55 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1302 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:55.659464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5da0ab79-9ecc-4304-8697-b2432a400993 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:55.661805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5da0ab79-9ecc-4304-8697-b2432a400993 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:55.671780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da0ab79-9ecc-4304-8697-b2432a400993 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:55.672738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da0ab79-9ecc-4304-8697-b2432a400993 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:55.674534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da0ab79-9ecc-4304-8697-b2432a400993 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:55.676017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da0ab79-9ecc-4304-8697-b2432a400993 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:55.676772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da0ab79-9ecc-4304-8697-b2432a400993 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:55.678226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da0ab79-9ecc-4304-8697-b2432a400993 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.077640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5da0ab79-9ecc-4304-8697-b2432a400993 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:56.089169 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5da0ab79-9ecc-4304-8697-b2432a400993 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1473 microversion: 2.1 time: 0.456956 Aug 27 02:34:56.094720 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 816/1531] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:55 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1473 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:56.112544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2ac55591-8ebe-46f4-be53-5d9020d09312 req-b3fc46aa-8a69-492b-94a8-1ff1d7bb992e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59462ca6-1830-4fae-a141-ffade28879f6", "name": "network-vif-plugged", "status": "completed", "tag": "b9a18ca7-1e41-4aa3-9c64-1d916f180dce"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:56.132230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2ac55591-8ebe-46f4-be53-5d9020d09312 req-b3fc46aa-8a69-492b-94a8-1ff1d7bb992e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.133098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2ac55591-8ebe-46f4-be53-5d9020d09312 req-b3fc46aa-8a69-492b-94a8-1ff1d7bb992e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.133922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2ac55591-8ebe-46f4-be53-5d9020d09312 req-b3fc46aa-8a69-492b-94a8-1ff1d7bb992e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.161617 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2ac55591-8ebe-46f4-be53-5d9020d09312 req-b3fc46aa-8a69-492b-94a8-1ff1d7bb992e service nova] Creating event network-vif-plugged:b9a18ca7-1e41-4aa3-9c64-1d916f180dce for instance 59462ca6-1830-4fae-a141-ffade28879f6 on n-h1-852084-5 Aug 27 02:34:56.170854 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2ac55591-8ebe-46f4-be53-5d9020d09312 req-b3fc46aa-8a69-492b-94a8-1ff1d7bb992e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069690 Aug 27 02:34:56.172198 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 817/1532] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:56.182919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11623827-86ed-4dd3-8fb0-5e20180e6a9d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:56.184094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-11623827-86ed-4dd3-8fb0-5e20180e6a9d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:56.195559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11623827-86ed-4dd3-8fb0-5e20180e6a9d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.196576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11623827-86ed-4dd3-8fb0-5e20180e6a9d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.197470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11623827-86ed-4dd3-8fb0-5e20180e6a9d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.199726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11623827-86ed-4dd3-8fb0-5e20180e6a9d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.200675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11623827-86ed-4dd3-8fb0-5e20180e6a9d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.202508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11623827-86ed-4dd3-8fb0-5e20180e6a9d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.243299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Getting quotas for project 757f05228f774702ac1a58772faf4393. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:34:56.258376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Getting quotas for user 630df349c316497c82b100427e2da818 and project 757f05228f774702ac1a58772faf4393. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:34:56.293819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:34:56.294909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:34:56.296643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:34:56.297745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:34:56.299744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:34:56.332876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.334426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.335530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.337481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.338869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.340119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.380286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Getting quotas for project 757f05228f774702ac1a58772faf4393. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:34:56.396124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Getting quotas for user 630df349c316497c82b100427e2da818 and project 757f05228f774702ac1a58772faf4393. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:34:56.427908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:34:56.434019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:34:56.547821 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ec79d554-6d5b-4141-92a3-bf8dbd9bda23 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.506577 Aug 27 02:34:56.548165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-11623827-86ed-4dd3-8fb0-5e20180e6a9d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:56.550199 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 716/1533] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:34:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 2510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:34:56.566084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:56.567900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] [instance: b54cb5ac-87d2-447b-874d-867e27020ba9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:56.586156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.587648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.589389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.591426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.593407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.594265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.611022 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11623827-86ed-4dd3-8fb0-5e20180e6a9d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 0.436512 Aug 27 02:34:56.616819 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 818/1534] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:56 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:56.628433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f107021c-b94e-4c0e-923a-e15b5d1d8eea req-a355bfd5-7104-40ac-b6c5-ae4637c0fd60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e52df0-ca95-4f33-beb8-660817c63658", "tag": "dba12d2f-f390-4730-9f01-553471e2b87a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:56.652414 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] HTTP exception thrown: Instance b54cb5ac-87d2-447b-874d-867e27020ba9 could not be found. Aug 27 02:34:56.656832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f107021c-b94e-4c0e-923a-e15b5d1d8eea req-a355bfd5-7104-40ac-b6c5-ae4637c0fd60 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.658219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f107021c-b94e-4c0e-923a-e15b5d1d8eea req-a355bfd5-7104-40ac-b6c5-ae4637c0fd60 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.659111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f107021c-b94e-4c0e-923a-e15b5d1d8eea req-a355bfd5-7104-40ac-b6c5-ae4637c0fd60 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Request method failure captured: Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 HTTP/1.1 Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYKbpsyhizACtrde46C308UNKayl1KYVzdwkQ6MVE1_GxQ1iaBimevbnLKtHnYdflT03hebO4ulpi5YcPWRxXpj1ikHmYO3ph_3xHfZDSN0vf2YJURF45ZntMjsM0AjeQqm1s5DvbhnWp-hz84P_LPTQEQka1ZjshUEPsNGca2BtUCU Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Openstack-Nova-Api-Version: 2.57 Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 6e6f27fe052b45309c6937a5af8e3220 Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerShowV257Test-975510223 Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_6e6f27fe052b45309c6937a5af8e3220"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/6e6f27fe052b45309c6937a5af8e3220"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/6e6f27fe052b45309c6937a5af8e3220"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/6e6f27fe052b45309c6937a5af8e3220"}]}] Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerShowV257Test-975510223 Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 6e6f27fe052b45309c6937a5af8e3220 Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerShowV257Test-975510223 Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerShowV257Test-975510223-project Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 78e37d7005074d3bb78ad2469ac4b413 Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerShowV257Test-975510223-project Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance b54cb5ac-87d2-447b-874d-867e27020ba9 could not be found. Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'b54cb5ac-87d2-447b-874d-867e27020ba9'} Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54cb5ac-87d2-447b-874d-867e27020ba9 could not be found. Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54cb5ac-87d2-447b-874d-867e27020ba9 could not be found. Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:34:56.666414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:34:56.676993 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:34:56.676993 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:34:56.676993 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:34:56.676993 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:34:56.676993 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:34:56.676993 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54cb5ac-87d2-447b-874d-867e27020ba9 could not be found. Aug 27 02:34:56.676993 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:34:56.686912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] Returning 404 to user: Instance b54cb5ac-87d2-447b-874d-867e27020ba9 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:34:56.691690 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f107021c-b94e-4c0e-923a-e15b5d1d8eea req-a355bfd5-7104-40ac-b6c5-ae4637c0fd60 service nova] Creating event network-changed:dba12d2f-f390-4730-9f01-553471e2b87a for instance 28e52df0-ca95-4f33-beb8-660817c63658 on n-h1-852084-5 Aug 27 02:34:56.705399 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e86c15e6-3bc3-40f2-99b7-389f9da2a267 tempest-ServerShowV257Test-975510223 tempest-ServerShowV257Test-975510223-project] 10.222.0.99 "GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9" status: 404 len: 111 microversion: 2.57 time: 0.151675 Aug 27 02:34:56.706601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-f107021c-b94e-4c0e-923a-e15b5d1d8eea req-a355bfd5-7104-40ac-b6c5-ae4637c0fd60 service nova] Instance 28e52df0-ca95-4f33-beb8-660817c63658 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:34:56.734219 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 717/1535] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:56 2022] GET /compute/v2.1/servers/b54cb5ac-87d2-447b-874d-867e27020ba9 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:34:56.737009 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f107021c-b94e-4c0e-923a-e15b5d1d8eea req-a355bfd5-7104-40ac-b6c5-ae4637c0fd60 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117796 Aug 27 02:34:56.746758 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 819/1536] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:56.767241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-402babe5-50cc-4f9a-8c6f-e9e8b9b286b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:56.768145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-402babe5-50cc-4f9a-8c6f-e9e8b9b286b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:56.785484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8cea3d98-d8cf-4460-bca7-e268d7ab6487 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:56.804219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8cea3d98-d8cf-4460-bca7-e268d7ab6487 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:56.834970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-402babe5-50cc-4f9a-8c6f-e9e8b9b286b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.837298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-402babe5-50cc-4f9a-8c6f-e9e8b9b286b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.841528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-402babe5-50cc-4f9a-8c6f-e9e8b9b286b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.843260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-402babe5-50cc-4f9a-8c6f-e9e8b9b286b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.844750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-402babe5-50cc-4f9a-8c6f-e9e8b9b286b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.845629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-402babe5-50cc-4f9a-8c6f-e9e8b9b286b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.848708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cea3d98-d8cf-4460-bca7-e268d7ab6487 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.850626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cea3d98-d8cf-4460-bca7-e268d7ab6487 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.856995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cea3d98-d8cf-4460-bca7-e268d7ab6487 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:56.861559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cea3d98-d8cf-4460-bca7-e268d7ab6487 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:56.863688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cea3d98-d8cf-4460-bca7-e268d7ab6487 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:56.867577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cea3d98-d8cf-4460-bca7-e268d7ab6487 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:57.301265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-402babe5-50cc-4f9a-8c6f-e9e8b9b286b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:57.313931 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-402babe5-50cc-4f9a-8c6f-e9e8b9b286b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1363 microversion: 2.1 time: 0.574862 Aug 27 02:34:57.314550 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 718/1537] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:56 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:57.327523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:57.328765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:57.366554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:57.368542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:57.370608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:57.372792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:57.374026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:57.376161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:57.618904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8cea3d98-d8cf-4460-bca7-e268d7ab6487 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:57.638118 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8cea3d98-d8cf-4460-bca7-e268d7ab6487 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1506 microversion: 2.1 time: 0.886545 Aug 27 02:34:57.665836 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 820/1538] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:56 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1506 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:57.672716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7b4e35e7-1d7b-485f-a25e-63e14b41bee6 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:57.677534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7b4e35e7-1d7b-485f-a25e-63e14b41bee6 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:57.758139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:57.787959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:57.792232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:57.794870 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-271f1ed0-6cad-4d5a-abd8-62a66fe493c6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.479003 Aug 27 02:34:57.796759 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 719/1539] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:57 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:57.816627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42e8c5b6-838f-4b33-888f-2474e669d106 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:57.818335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-42e8c5b6-838f-4b33-888f-2474e669d106 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:57.850019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42e8c5b6-838f-4b33-888f-2474e669d106 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:57.850912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42e8c5b6-838f-4b33-888f-2474e669d106 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:57.851706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42e8c5b6-838f-4b33-888f-2474e669d106 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:57.853028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42e8c5b6-838f-4b33-888f-2474e669d106 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:57.854448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42e8c5b6-838f-4b33-888f-2474e669d106 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:57.855236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42e8c5b6-838f-4b33-888f-2474e669d106 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:57.892309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7b4e35e7-1d7b-485f-a25e-63e14b41bee6 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:57.906006 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7b4e35e7-1d7b-485f-a25e-63e14b41bee6 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1269 microversion: 2.1 time: 0.237723 Aug 27 02:34:57.919701 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 821/1540] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:57 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1269 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:57.926087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-362cf3d8-d2a0-40af-9c43-167a60e0d9bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:57.927082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-362cf3d8-d2a0-40af-9c43-167a60e0d9bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:57.934916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-362cf3d8-d2a0-40af-9c43-167a60e0d9bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:57.935936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-362cf3d8-d2a0-40af-9c43-167a60e0d9bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:57.936649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-362cf3d8-d2a0-40af-9c43-167a60e0d9bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:57.937853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-362cf3d8-d2a0-40af-9c43-167a60e0d9bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:57.938711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-362cf3d8-d2a0-40af-9c43-167a60e0d9bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:57.939398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-362cf3d8-d2a0-40af-9c43-167a60e0d9bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:58.411869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-42e8c5b6-838f-4b33-888f-2474e669d106 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:58.427259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-362cf3d8-d2a0-40af-9c43-167a60e0d9bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:58.436906 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-362cf3d8-d2a0-40af-9c43-167a60e0d9bd tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1471 microversion: 2.1 time: 0.515621 Aug 27 02:34:58.441747 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42e8c5b6-838f-4b33-888f-2474e669d106 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1368 microversion: 2.1 time: 0.642597 Aug 27 02:34:58.443877 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 720/1541] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:57 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1368 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:58.447459 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 822/1542] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:57 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1471 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:58.481901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aeddd8ad-71b3-4031-83a9-09d15d9f45c1 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:58.482466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aeddd8ad-71b3-4031-83a9-09d15d9f45c1 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:58.489651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeddd8ad-71b3-4031-83a9-09d15d9f45c1 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:58.490186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeddd8ad-71b3-4031-83a9-09d15d9f45c1 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:58.490849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeddd8ad-71b3-4031-83a9-09d15d9f45c1 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:58.491771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeddd8ad-71b3-4031-83a9-09d15d9f45c1 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:58.492470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeddd8ad-71b3-4031-83a9-09d15d9f45c1 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:58.492911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeddd8ad-71b3-4031-83a9-09d15d9f45c1 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:58.547633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aeddd8ad-71b3-4031-83a9-09d15d9f45c1 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:58.550883 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aeddd8ad-71b3-4031-83a9-09d15d9f45c1 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239/os-instance-actions/req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b" status: 200 len: 313 microversion: 2.1 time: 0.098747 Aug 27 02:34:58.569704 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 823/1543] 10.222.0.99 () {58 vars in 1419 bytes} [Sat Aug 27 02:34:58 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239/os-instance-actions/req-4a602f1f-afa5-4fb2-afcf-adb7cbd4121b => generated 313 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:34:58.582340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0763f197-a05d-4768-81a6-43a841e6d7cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:58.584837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0763f197-a05d-4768-81a6-43a841e6d7cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:58.598152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0763f197-a05d-4768-81a6-43a841e6d7cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:58.599284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0763f197-a05d-4768-81a6-43a841e6d7cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:58.600598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0763f197-a05d-4768-81a6-43a841e6d7cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:58.602489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0763f197-a05d-4768-81a6-43a841e6d7cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:58.603666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0763f197-a05d-4768-81a6-43a841e6d7cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:58.604640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0763f197-a05d-4768-81a6-43a841e6d7cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:58.613407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:34:59.092099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-001db764-64de-4898-bee2-c89651d8c053 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:59.092099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-001db764-64de-4898-bee2-c89651d8c053 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:59.099594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0763f197-a05d-4768-81a6-43a841e6d7cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:59.105411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001db764-64de-4898-bee2-c89651d8c053 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:59.105977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001db764-64de-4898-bee2-c89651d8c053 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:59.106433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001db764-64de-4898-bee2-c89651d8c053 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:59.107426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001db764-64de-4898-bee2-c89651d8c053 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:59.108094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001db764-64de-4898-bee2-c89651d8c053 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:59.108729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001db764-64de-4898-bee2-c89651d8c053 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:59.115447 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0763f197-a05d-4768-81a6-43a841e6d7cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1363 microversion: 2.1 time: 0.544150 Aug 27 02:34:59.129396 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 824/1544] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:58 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1363 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:59.134731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-22c72438-5420-4cec-9cdb-d82d3e8a4268 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:34:59.137265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-22c72438-5420-4cec-9cdb-d82d3e8a4268 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:59.162051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22c72438-5420-4cec-9cdb-d82d3e8a4268 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:59.162560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22c72438-5420-4cec-9cdb-d82d3e8a4268 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:59.165024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22c72438-5420-4cec-9cdb-d82d3e8a4268 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:59.168732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22c72438-5420-4cec-9cdb-d82d3e8a4268 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:59.170162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22c72438-5420-4cec-9cdb-d82d3e8a4268 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:59.172287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22c72438-5420-4cec-9cdb-d82d3e8a4268 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:59.302732 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-22c72438-5420-4cec-9cdb-d82d3e8a4268 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "POST /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239/action" status: 202 len: 0 microversion: 2.1 time: 0.171812 Aug 27 02:34:59.304057 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 825/1545] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:34:59 2022] POST /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:34:59.311113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:59.312361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:59.321872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:59.323189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:59.323994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:59.325743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:59.326659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:59.327359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:59.695772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-001db764-64de-4898-bee2-c89651d8c053 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:59.741817 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-001db764-64de-4898-bee2-c89651d8c053 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1718 microversion: 2.1 time: 1.276650 Aug 27 02:34:59.743759 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 721/1546] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:58 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1718 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:34:59.753630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-692293ae-31e1-4ac2-9781-2dbf71903e8e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:59.755187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-692293ae-31e1-4ac2-9781-2dbf71903e8e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:59.782727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-692293ae-31e1-4ac2-9781-2dbf71903e8e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:59.784085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-692293ae-31e1-4ac2-9781-2dbf71903e8e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:59.784892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-692293ae-31e1-4ac2-9781-2dbf71903e8e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:59.786275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-692293ae-31e1-4ac2-9781-2dbf71903e8e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:59.787157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-692293ae-31e1-4ac2-9781-2dbf71903e8e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:34:59.787888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-692293ae-31e1-4ac2-9781-2dbf71903e8e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:34:59.905352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:59.921360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:59.924654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:34:59.939350 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-839e6afa-0ef2-48b2-af69-d8712a75d65a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.633094 Aug 27 02:34:59.940378 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 826/1547] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:34:59 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:34:59.959237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cd9d1a8f-7231-4df6-a414-e961b61acfc3 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:34:59.960768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cd9d1a8f-7231-4df6-a414-e961b61acfc3 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:34:59.998932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd9d1a8f-7231-4df6-a414-e961b61acfc3 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:34:59.999865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd9d1a8f-7231-4df6-a414-e961b61acfc3 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:00.000625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd9d1a8f-7231-4df6-a414-e961b61acfc3 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:00.002332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd9d1a8f-7231-4df6-a414-e961b61acfc3 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:00.003450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd9d1a8f-7231-4df6-a414-e961b61acfc3 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:00.004444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd9d1a8f-7231-4df6-a414-e961b61acfc3 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:00.023237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-692293ae-31e1-4ac2-9781-2dbf71903e8e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:00.049752 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-692293ae-31e1-4ac2-9781-2dbf71903e8e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1327 microversion: 2.1 time: 0.303281 Aug 27 02:35:00.050729 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 722/1548] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:59 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1327 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:00.073812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-557df3c2-d4d2-4ab9-9849-1bf263d6e0b4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:00.075196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-557df3c2-d4d2-4ab9-9849-1bf263d6e0b4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:00.094735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-557df3c2-d4d2-4ab9-9849-1bf263d6e0b4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:00.096055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-557df3c2-d4d2-4ab9-9849-1bf263d6e0b4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:00.096853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-557df3c2-d4d2-4ab9-9849-1bf263d6e0b4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:00.098568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-557df3c2-d4d2-4ab9-9849-1bf263d6e0b4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:00.099613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-557df3c2-d4d2-4ab9-9849-1bf263d6e0b4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:00.100361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-557df3c2-d4d2-4ab9-9849-1bf263d6e0b4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:00.663458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-557df3c2-d4d2-4ab9-9849-1bf263d6e0b4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:00.678731 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-557df3c2-d4d2-4ab9-9849-1bf263d6e0b4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1368 microversion: 2.1 time: 0.626284 Aug 27 02:35:00.694157 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 723/1549] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:00 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1368 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:00.707655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-efa07df6-c180-447e-b0fc-49ab3115ce21 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:00.710209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-efa07df6-c180-447e-b0fc-49ab3115ce21 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:00.721942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efa07df6-c180-447e-b0fc-49ab3115ce21 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:00.722989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efa07df6-c180-447e-b0fc-49ab3115ce21 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:00.723872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efa07df6-c180-447e-b0fc-49ab3115ce21 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:00.725187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efa07df6-c180-447e-b0fc-49ab3115ce21 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:00.726122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efa07df6-c180-447e-b0fc-49ab3115ce21 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:00.727153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efa07df6-c180-447e-b0fc-49ab3115ce21 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:00.916119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cd9d1a8f-7231-4df6-a414-e961b61acfc3 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:00.936359 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cd9d1a8f-7231-4df6-a414-e961b61acfc3 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1508 microversion: 2.1 time: 0.993628 Aug 27 02:35:00.937956 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 827/1550] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:34:59 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1508 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:00.950040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-6e264b5d-9001-46d1-a978-47f5bd412278 req-793f04cc-ee5b-4622-8c91-2fc015bb091d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb357c66-d559-4bb9-a7f4-3ce3f6f09904", "tag": "b93676cc-2eb8-4e67-8a15-41712593277b"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:00.974664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6e264b5d-9001-46d1-a978-47f5bd412278 req-793f04cc-ee5b-4622-8c91-2fc015bb091d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:00.975735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6e264b5d-9001-46d1-a978-47f5bd412278 req-793f04cc-ee5b-4622-8c91-2fc015bb091d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:00.977062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6e264b5d-9001-46d1-a978-47f5bd412278 req-793f04cc-ee5b-4622-8c91-2fc015bb091d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:01.002818 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-6e264b5d-9001-46d1-a978-47f5bd412278 req-793f04cc-ee5b-4622-8c91-2fc015bb091d service nova] Creating event network-changed:b93676cc-2eb8-4e67-8a15-41712593277b for instance bb357c66-d559-4bb9-a7f4-3ce3f6f09904 on n-h2-852084-5 Aug 27 02:35:01.018416 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-6e264b5d-9001-46d1-a978-47f5bd412278 req-793f04cc-ee5b-4622-8c91-2fc015bb091d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075746 Aug 27 02:35:01.019836 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 828/1551] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:01.038982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-affb8e43-1797-41d4-b006-72618020e1b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:01.040699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-affb8e43-1797-41d4-b006-72618020e1b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:01.056904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affb8e43-1797-41d4-b006-72618020e1b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:01.058087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affb8e43-1797-41d4-b006-72618020e1b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:01.060310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affb8e43-1797-41d4-b006-72618020e1b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:01.061644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affb8e43-1797-41d4-b006-72618020e1b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:01.062854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affb8e43-1797-41d4-b006-72618020e1b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:01.063857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affb8e43-1797-41d4-b006-72618020e1b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:01.189932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-efa07df6-c180-447e-b0fc-49ab3115ce21 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:01.216317 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-efa07df6-c180-447e-b0fc-49ab3115ce21 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1468 microversion: 2.1 time: 0.520071 Aug 27 02:35:01.233179 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 724/1552] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:00 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1468 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:01.254313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c05d4230-a912-494c-ba98-31947e4eb887 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:01.256779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c05d4230-a912-494c-ba98-31947e4eb887 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:01.269983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c05d4230-a912-494c-ba98-31947e4eb887 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:01.271811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c05d4230-a912-494c-ba98-31947e4eb887 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:01.273563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c05d4230-a912-494c-ba98-31947e4eb887 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:01.277027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c05d4230-a912-494c-ba98-31947e4eb887 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:01.278511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c05d4230-a912-494c-ba98-31947e4eb887 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:01.279900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c05d4230-a912-494c-ba98-31947e4eb887 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:01.808220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-affb8e43-1797-41d4-b006-72618020e1b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:01.820390 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-affb8e43-1797-41d4-b006-72618020e1b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1550 microversion: 2.1 time: 0.796322 Aug 27 02:35:01.821546 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 829/1553] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:01 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1550 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:01.829221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:01.830170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:01.837062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:01.838035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:01.839259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:01.841323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:01.842507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:01.843222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:02.129484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c05d4230-a912-494c-ba98-31947e4eb887 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:02.172906 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c05d4230-a912-494c-ba98-31947e4eb887 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1708 microversion: 2.1 time: 0.937026 Aug 27 02:35:02.187592 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 725/1554] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:01 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1708 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:02.216715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:02.220848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a786e40-0724-4ade-8093-8105e13c0739 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:02.222761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a786e40-0724-4ade-8093-8105e13c0739 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:02.227576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:02.240803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a786e40-0724-4ade-8093-8105e13c0739 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:02.241945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a786e40-0724-4ade-8093-8105e13c0739 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:02.242889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a786e40-0724-4ade-8093-8105e13c0739 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:02.244441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a786e40-0724-4ade-8093-8105e13c0739 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:02.246067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a786e40-0724-4ade-8093-8105e13c0739 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:02.247063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a786e40-0724-4ade-8093-8105e13c0739 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:02.300743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:02.319313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:02.331233 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f3c2c74e-10ed-4ee5-98c5-0a3c0edb6dcd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.503834 Aug 27 02:35:02.333917 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 830/1555] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:01 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:02.363725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f8d1e747-0857-486e-8bdc-a5885c888268 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:02.366424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f8d1e747-0857-486e-8bdc-a5885c888268 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:02.394002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8d1e747-0857-486e-8bdc-a5885c888268 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:02.402586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8d1e747-0857-486e-8bdc-a5885c888268 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:02.403812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8d1e747-0857-486e-8bdc-a5885c888268 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:02.407149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8d1e747-0857-486e-8bdc-a5885c888268 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:02.409860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8d1e747-0857-486e-8bdc-a5885c888268 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:02.413010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8d1e747-0857-486e-8bdc-a5885c888268 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:02.528552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:02.557318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:02.706241 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f8d1e747-0857-486e-8bdc-a5885c888268 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "POST /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658/action" status: 202 len: 0 microversion: 2.1 time: 0.367640 Aug 27 02:35:02.708408 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 831/1556] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:35:02 2022] POST /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:35:02.716879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a786e40-0724-4ade-8093-8105e13c0739 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:02.721964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f83d1b59-3eb3-4534-a811-e603072b16dd tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:02.723684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f83d1b59-3eb3-4534-a811-e603072b16dd tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:02.733419 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a786e40-0724-4ade-8093-8105e13c0739 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1394 microversion: 2.1 time: 0.536850 Aug 27 02:35:02.734697 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 726/1557] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:02 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1394 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:02.741764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f83d1b59-3eb3-4534-a811-e603072b16dd tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:02.744049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f83d1b59-3eb3-4534-a811-e603072b16dd tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:02.747189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f83d1b59-3eb3-4534-a811-e603072b16dd tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:02.749294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f83d1b59-3eb3-4534-a811-e603072b16dd tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:02.750702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f83d1b59-3eb3-4534-a811-e603072b16dd tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:02.751139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-49cc1f87-08b2-4174-860a-7dd2861fae82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:02.751429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-49cc1f87-08b2-4174-860a-7dd2861fae82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:02.753841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f83d1b59-3eb3-4534-a811-e603072b16dd tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:02.778959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49cc1f87-08b2-4174-860a-7dd2861fae82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:02.779467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49cc1f87-08b2-4174-860a-7dd2861fae82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:02.779919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49cc1f87-08b2-4174-860a-7dd2861fae82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:02.780736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49cc1f87-08b2-4174-860a-7dd2861fae82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:02.781121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49cc1f87-08b2-4174-860a-7dd2861fae82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:02.781555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49cc1f87-08b2-4174-860a-7dd2861fae82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:03.124618 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-49cc1f87-08b2-4174-860a-7dd2861fae82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.377192 Aug 27 02:35:03.125635 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 727/1558] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:35:02 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/os-interface => generated 285 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:03.147484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9d975920-3ffb-4c42-88ce-eceac12408be tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:03.159893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9d975920-3ffb-4c42-88ce-eceac12408be tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:03.183471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d975920-3ffb-4c42-88ce-eceac12408be tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:03.187242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d975920-3ffb-4c42-88ce-eceac12408be tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:03.198927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d975920-3ffb-4c42-88ce-eceac12408be tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:03.200664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d975920-3ffb-4c42-88ce-eceac12408be tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:03.201814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d975920-3ffb-4c42-88ce-eceac12408be tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:03.202857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d975920-3ffb-4c42-88ce-eceac12408be tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:03.393278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f83d1b59-3eb3-4534-a811-e603072b16dd tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:03.422629 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f83d1b59-3eb3-4534-a811-e603072b16dd tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1368 microversion: 2.1 time: 0.711335 Aug 27 02:35:03.425762 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 832/1559] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:02 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1368 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:03.448082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f5eef27d-b9aa-4d1f-b348-fb3c96d57a58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '.version_select at 0x7f4d2e8bce50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:03.466403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5eef27d-b9aa-4d1f-b348-fb3c96d57a58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:03.470163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5eef27d-b9aa-4d1f-b348-fb3c96d57a58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:03.471384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5eef27d-b9aa-4d1f-b348-fb3c96d57a58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:03.563818 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f5eef27d-b9aa-4d1f-b348-fb3c96d57a58 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-migrations" status: 200 len: 3504 microversion: 2.1 time: 0.135670 Aug 27 02:35:03.577117 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 833/1560] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:35:03 2022] GET /compute/v2.1/os-migrations => generated 3504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:03.602012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-96b2449e-cec1-43be-a27b-1dc80db0549d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:03.604441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-96b2449e-cec1-43be-a27b-1dc80db0549d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:03.615831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96b2449e-cec1-43be-a27b-1dc80db0549d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:03.617052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96b2449e-cec1-43be-a27b-1dc80db0549d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:03.618068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96b2449e-cec1-43be-a27b-1dc80db0549d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:03.623108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96b2449e-cec1-43be-a27b-1dc80db0549d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:03.624191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96b2449e-cec1-43be-a27b-1dc80db0549d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:03.625906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96b2449e-cec1-43be-a27b-1dc80db0549d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:04.314063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9d975920-3ffb-4c42-88ce-eceac12408be tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:04.352348 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9d975920-3ffb-4c42-88ce-eceac12408be tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1513 microversion: 2.1 time: 1.211632 Aug 27 02:35:04.357891 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 728/1561] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:03 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1513 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:04.373323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:04.375297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-96b2449e-cec1-43be-a27b-1dc80db0549d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:04.375991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:04.388105 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-96b2449e-cec1-43be-a27b-1dc80db0549d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1467 microversion: 2.1 time: 0.804207 Aug 27 02:35:04.389015 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 834/1562] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:03 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1467 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:04.400082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:04.401429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:04.402070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:04.410466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff14e34a-14f9-4cc7-b2ae-f93c947eafd5 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:04.412058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:04.413001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ff14e34a-14f9-4cc7-b2ae-f93c947eafd5 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:04.413751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:04.418095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:04.435100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff14e34a-14f9-4cc7-b2ae-f93c947eafd5 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:04.435865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff14e34a-14f9-4cc7-b2ae-f93c947eafd5 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:04.436475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff14e34a-14f9-4cc7-b2ae-f93c947eafd5 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:04.437418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff14e34a-14f9-4cc7-b2ae-f93c947eafd5 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:04.438109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff14e34a-14f9-4cc7-b2ae-f93c947eafd5 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:04.438704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff14e34a-14f9-4cc7-b2ae-f93c947eafd5 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:04.896953 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff14e34a-14f9-4cc7-b2ae-f93c947eafd5 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1859 microversion: 2.1 time: 0.506553 Aug 27 02:35:04.904636 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 835/1563] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:04 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1859 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:04.926312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9184216f-9094-45f8-a6d3-abc0861e2003 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:04.927244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9184216f-9094-45f8-a6d3-abc0861e2003 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:04.942813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9184216f-9094-45f8-a6d3-abc0861e2003 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:04.946868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9184216f-9094-45f8-a6d3-abc0861e2003 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:04.951387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9184216f-9094-45f8-a6d3-abc0861e2003 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:04.957813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9184216f-9094-45f8-a6d3-abc0861e2003 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:04.966325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9184216f-9094-45f8-a6d3-abc0861e2003 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:04.969032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9184216f-9094-45f8-a6d3-abc0861e2003 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:05.157940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:05.194121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:05.200616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:05.209935 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5bafa42e-b2bb-4a12-864a-05709043890d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.848999 Aug 27 02:35:05.214525 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 729/1564] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:04 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:05.240467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e56e4365-c553-47b6-a18f-2cf446d6a930 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:05.243767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e56e4365-c553-47b6-a18f-2cf446d6a930 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:05.265088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e56e4365-c553-47b6-a18f-2cf446d6a930 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:05.267280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e56e4365-c553-47b6-a18f-2cf446d6a930 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:05.269949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e56e4365-c553-47b6-a18f-2cf446d6a930 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:05.271880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e56e4365-c553-47b6-a18f-2cf446d6a930 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:05.278412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e56e4365-c553-47b6-a18f-2cf446d6a930 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:05.296780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e56e4365-c553-47b6-a18f-2cf446d6a930 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:05.777015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9184216f-9094-45f8-a6d3-abc0861e2003 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:05.805122 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9184216f-9094-45f8-a6d3-abc0861e2003 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1394 microversion: 2.1 time: 0.884663 Aug 27 02:35:05.808420 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 836/1565] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:04 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1394 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:05.836704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c785965c-66aa-4442-a12c-068b99ee6299 req-a6172b2c-4b0d-4a93-a11c-d29ac7319308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e52df0-ca95-4f33-beb8-660817c63658", "name": "network-vif-plugged", "status": "completed", "tag": "dba12d2f-f390-4730-9f01-553471e2b87a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:05.870467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c785965c-66aa-4442-a12c-068b99ee6299 req-a6172b2c-4b0d-4a93-a11c-d29ac7319308 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:05.872486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c785965c-66aa-4442-a12c-068b99ee6299 req-a6172b2c-4b0d-4a93-a11c-d29ac7319308 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:05.877399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c785965c-66aa-4442-a12c-068b99ee6299 req-a6172b2c-4b0d-4a93-a11c-d29ac7319308 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:05.917527 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c785965c-66aa-4442-a12c-068b99ee6299 req-a6172b2c-4b0d-4a93-a11c-d29ac7319308 service nova] Creating event network-vif-plugged:dba12d2f-f390-4730-9f01-553471e2b87a for instance 28e52df0-ca95-4f33-beb8-660817c63658 on n-h1-852084-5 Aug 27 02:35:05.944175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-c785965c-66aa-4442-a12c-068b99ee6299 req-a6172b2c-4b0d-4a93-a11c-d29ac7319308 service nova] Instance 28e52df0-ca95-4f33-beb8-660817c63658 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:35:05.973505 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c785965c-66aa-4442-a12c-068b99ee6299 req-a6172b2c-4b0d-4a93-a11c-d29ac7319308 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160673 Aug 27 02:35:05.981122 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 837/1566] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:05.993257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-488ee836-fe49-4b13-84ed-5c2f1da472a6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:05.994939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-488ee836-fe49-4b13-84ed-5c2f1da472a6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:06.065587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488ee836-fe49-4b13-84ed-5c2f1da472a6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:06.066642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488ee836-fe49-4b13-84ed-5c2f1da472a6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:06.067326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488ee836-fe49-4b13-84ed-5c2f1da472a6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:06.068684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488ee836-fe49-4b13-84ed-5c2f1da472a6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:06.069445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488ee836-fe49-4b13-84ed-5c2f1da472a6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:06.070156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-488ee836-fe49-4b13-84ed-5c2f1da472a6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:06.361042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:06.413980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=16 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:06.520617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e56e4365-c553-47b6-a18f-2cf446d6a930 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:06.536903 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e56e4365-c553-47b6-a18f-2cf446d6a930 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1368 microversion: 2.1 time: 1.318892 Aug 27 02:35:06.538247 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 730/1567] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:05 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1368 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:06.553151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-588a8375-6b93-4886-a6f1-b7235d7efbde tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:06.556860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-588a8375-6b93-4886-a6f1-b7235d7efbde tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:06.569126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-588a8375-6b93-4886-a6f1-b7235d7efbde tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:06.570381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-588a8375-6b93-4886-a6f1-b7235d7efbde tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:06.571316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-588a8375-6b93-4886-a6f1-b7235d7efbde tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:06.572821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-588a8375-6b93-4886-a6f1-b7235d7efbde tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:06.573921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-588a8375-6b93-4886-a6f1-b7235d7efbde tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:06.574815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-588a8375-6b93-4886-a6f1-b7235d7efbde tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:07.071971 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-488ee836-fe49-4b13-84ed-5c2f1da472a6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1859 microversion: 2.1 time: 1.087908 Aug 27 02:35:07.086374 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 838/1568] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:05 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1859 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:07.094148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a4a28f87-864b-41e6-a2b1-4031ef09e66c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:07.096323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a4a28f87-864b-41e6-a2b1-4031ef09e66c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:07.125525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4a28f87-864b-41e6-a2b1-4031ef09e66c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:07.131866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4a28f87-864b-41e6-a2b1-4031ef09e66c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:07.133064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4a28f87-864b-41e6-a2b1-4031ef09e66c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:07.134539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4a28f87-864b-41e6-a2b1-4031ef09e66c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:07.136157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4a28f87-864b-41e6-a2b1-4031ef09e66c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:07.138861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4a28f87-864b-41e6-a2b1-4031ef09e66c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:07.222135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:07.593055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-588a8375-6b93-4886-a6f1-b7235d7efbde tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:07.619554 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-588a8375-6b93-4886-a6f1-b7235d7efbde tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1506 microversion: 2.1 time: 1.078538 Aug 27 02:35:07.638412 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 731/1569] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:06 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1506 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:07.688764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:07.693897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:07.722244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:07.723121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:07.723907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:07.729555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:07.731028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:07.732119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:07.898706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=12 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:07.932233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a4a28f87-864b-41e6-a2b1-4031ef09e66c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:07.948021 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a4a28f87-864b-41e6-a2b1-4031ef09e66c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1467 microversion: 2.1 time: 0.871592 Aug 27 02:35:07.950060 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 839/1570] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:07 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1467 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:07.959116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-cd47014b-f7fb-4cdf-bd27-8e71672f2a9a req-190985e5-6771-4aaa-b541-c6cd2433d0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e838b7-9173-4fe2-b467-73f543889366", "tag": "b4c9e241-4c66-4b06-954a-f77a9405754d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:07.988066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cd47014b-f7fb-4cdf-bd27-8e71672f2a9a req-190985e5-6771-4aaa-b541-c6cd2433d0c7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:07.989639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cd47014b-f7fb-4cdf-bd27-8e71672f2a9a req-190985e5-6771-4aaa-b541-c6cd2433d0c7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:07.990813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cd47014b-f7fb-4cdf-bd27-8e71672f2a9a req-190985e5-6771-4aaa-b541-c6cd2433d0c7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:08.015795 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-cd47014b-f7fb-4cdf-bd27-8e71672f2a9a req-190985e5-6771-4aaa-b541-c6cd2433d0c7 service nova] Creating event network-changed:b4c9e241-4c66-4b06-954a-f77a9405754d for instance 43e838b7-9173-4fe2-b467-73f543889366 on n-h2-852084-5 Aug 27 02:35:08.024671 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-cd47014b-f7fb-4cdf-bd27-8e71672f2a9a req-190985e5-6771-4aaa-b541-c6cd2433d0c7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071578 Aug 27 02:35:08.026900 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 840/1571] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:08.034821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58f39202-ee39-4f11-898b-597d5a8c4783 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:08.036747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-58f39202-ee39-4f11-898b-597d5a8c4783 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:08.047397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58f39202-ee39-4f11-898b-597d5a8c4783 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:08.048900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58f39202-ee39-4f11-898b-597d5a8c4783 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:08.050274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58f39202-ee39-4f11-898b-597d5a8c4783 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:08.053060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58f39202-ee39-4f11-898b-597d5a8c4783 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:08.054486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58f39202-ee39-4f11-898b-597d5a8c4783 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:08.057487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58f39202-ee39-4f11-898b-597d5a8c4783 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:08.392819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:08.418350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:08.420616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:08.421926 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9150d678-4eda-4061-a722-044daf4da413 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.778786 Aug 27 02:35:08.438205 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 732/1572] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:07 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:08.443943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6514849f-b9cd-4041-8ce6-7930758a4492 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:08.445511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6514849f-b9cd-4041-8ce6-7930758a4492 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:08.453630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6514849f-b9cd-4041-8ce6-7930758a4492 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:08.454494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6514849f-b9cd-4041-8ce6-7930758a4492 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:08.455715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6514849f-b9cd-4041-8ce6-7930758a4492 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:08.457055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6514849f-b9cd-4041-8ce6-7930758a4492 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:08.457851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6514849f-b9cd-4041-8ce6-7930758a4492 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:08.459620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6514849f-b9cd-4041-8ce6-7930758a4492 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:08.490859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:08.894385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58f39202-ee39-4f11-898b-597d5a8c4783 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:08.932617 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58f39202-ee39-4f11-898b-597d5a8c4783 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1394 microversion: 2.1 time: 0.903713 Aug 27 02:35:08.953722 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 841/1573] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:08 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1394 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:08.958982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-289efa6c-5174-4613-a453-1263642453a1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:08.959956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6514849f-b9cd-4041-8ce6-7930758a4492 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:08.966278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-289efa6c-5174-4613-a453-1263642453a1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:08.984298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289efa6c-5174-4613-a453-1263642453a1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:08.985606 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6514849f-b9cd-4041-8ce6-7930758a4492 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1368 microversion: 2.1 time: 0.544956 Aug 27 02:35:08.986370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289efa6c-5174-4613-a453-1263642453a1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:08.986978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289efa6c-5174-4613-a453-1263642453a1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:08.989511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289efa6c-5174-4613-a453-1263642453a1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:08.992599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289efa6c-5174-4613-a453-1263642453a1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:08.999001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289efa6c-5174-4613-a453-1263642453a1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:09.008554 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 733/1574] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:08 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1368 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:09.027553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a13c507-6290-4d7a-a198-66d3cc9f756c tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '.version_select at 0x7f4d2a5c6550>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:09.028930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4a13c507-6290-4d7a-a198-66d3cc9f756c tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:09.041857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a13c507-6290-4d7a-a198-66d3cc9f756c tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:09.042793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a13c507-6290-4d7a-a198-66d3cc9f756c tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:09.043874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a13c507-6290-4d7a-a198-66d3cc9f756c tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:09.045396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a13c507-6290-4d7a-a198-66d3cc9f756c tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:09.046553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a13c507-6290-4d7a-a198-66d3cc9f756c tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:09.047616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a13c507-6290-4d7a-a198-66d3cc9f756c tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:09.200474 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4a13c507-6290-4d7a-a198-66d3cc9f756c tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.189085 Aug 27 02:35:09.221048 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 734/1575] 10.222.0.99 () {58 vars in 1296 bytes} [Sat Aug 27 02:35:09 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239/os-instance-actions => generated 611 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:09.242529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-205dc271-5e69-4484-9ef4-408620a39fdb req-0eedc75a-23e2-46c4-a24b-eb06819539cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb357c66-d559-4bb9-a7f4-3ce3f6f09904", "name": "network-vif-plugged", "status": "completed", "tag": "b93676cc-2eb8-4e67-8a15-41712593277b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:09.264759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-205dc271-5e69-4484-9ef4-408620a39fdb req-0eedc75a-23e2-46c4-a24b-eb06819539cd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:09.265655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-205dc271-5e69-4484-9ef4-408620a39fdb req-0eedc75a-23e2-46c4-a24b-eb06819539cd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:09.267264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-205dc271-5e69-4484-9ef4-408620a39fdb req-0eedc75a-23e2-46c4-a24b-eb06819539cd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:09.298149 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-205dc271-5e69-4484-9ef4-408620a39fdb req-0eedc75a-23e2-46c4-a24b-eb06819539cd service nova] Creating event network-vif-plugged:b93676cc-2eb8-4e67-8a15-41712593277b for instance bb357c66-d559-4bb9-a7f4-3ce3f6f09904 on n-h2-852084-5 Aug 27 02:35:09.306624 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-205dc271-5e69-4484-9ef4-408620a39fdb req-0eedc75a-23e2-46c4-a24b-eb06819539cd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083020 Aug 27 02:35:09.313036 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 735/1576] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:09.324483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7928fadb-232a-4785-a54f-e4a796cf5130 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:09.326139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7928fadb-232a-4785-a54f-e4a796cf5130 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:09.340637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7928fadb-232a-4785-a54f-e4a796cf5130 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:09.341547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7928fadb-232a-4785-a54f-e4a796cf5130 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:09.343265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7928fadb-232a-4785-a54f-e4a796cf5130 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:09.344819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7928fadb-232a-4785-a54f-e4a796cf5130 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:09.345936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7928fadb-232a-4785-a54f-e4a796cf5130 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:09.347818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7928fadb-232a-4785-a54f-e4a796cf5130 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:09.365606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-289efa6c-5174-4613-a453-1263642453a1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lazy-loading 'services' on Instance uuid d9500d4a-17ee-40b3-bc1c-77026234b7a3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:35:09.630979 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-289efa6c-5174-4613-a453-1263642453a1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments/cbba3bdc-ad6e-489f-9951-637af640c5c4" status: 202 len: 0 microversion: 2.1 time: 0.675262 Aug 27 02:35:09.632001 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 842/1577] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 02:35:08 2022] DELETE /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments/cbba3bdc-ad6e-489f-9951-637af640c5c4 => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:35:09.646681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a7772239-8b81-4c4c-86f0-48eac14e8fff req-bc3d4aad-df34-46dc-b62a-927c39e07102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade60c1-89d3-4f5d-94e0-42f8b573f14b", "name": "network-vif-unplugged", "status": "completed", "tag": "0541fb29-89c6-4ee0-96d0-f5319ae94bf3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:09.672278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7928fadb-232a-4785-a54f-e4a796cf5130 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:09.688887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a7772239-8b81-4c4c-86f0-48eac14e8fff req-bc3d4aad-df34-46dc-b62a-927c39e07102 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:09.689522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a7772239-8b81-4c4c-86f0-48eac14e8fff req-bc3d4aad-df34-46dc-b62a-927c39e07102 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:09.692464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a7772239-8b81-4c4c-86f0-48eac14e8fff req-bc3d4aad-df34-46dc-b62a-927c39e07102 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:09.696572 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7928fadb-232a-4785-a54f-e4a796cf5130 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1467 microversion: 2.1 time: 0.379615 Aug 27 02:35:09.698387 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 736/1578] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:09 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1467 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:09.724980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-db9a9d27-7cde-43e8-b448-7778db336950 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:09.727153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-db9a9d27-7cde-43e8-b448-7778db336950 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:09.745173 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a7772239-8b81-4c4c-86f0-48eac14e8fff req-bc3d4aad-df34-46dc-b62a-927c39e07102 service nova] Creating event network-vif-unplugged:0541fb29-89c6-4ee0-96d0-f5319ae94bf3 for instance 1ade60c1-89d3-4f5d-94e0-42f8b573f14b on n-h1-852084-5 Aug 27 02:35:09.747428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9a9d27-7cde-43e8-b448-7778db336950 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:09.748350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9a9d27-7cde-43e8-b448-7778db336950 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:09.749172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9a9d27-7cde-43e8-b448-7778db336950 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:09.750544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9a9d27-7cde-43e8-b448-7778db336950 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:09.751415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9a9d27-7cde-43e8-b448-7778db336950 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:09.752209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db9a9d27-7cde-43e8-b448-7778db336950 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:09.769077 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a7772239-8b81-4c4c-86f0-48eac14e8fff req-bc3d4aad-df34-46dc-b62a-927c39e07102 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134417 Aug 27 02:35:09.770496 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 843/1579] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:09.788099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:09.788825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:09.798244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:09.799037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:09.799735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:09.800693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:09.801328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:09.801957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:09.898054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-db9a9d27-7cde-43e8-b448-7778db336950 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:35:10.296963 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-db9a9d27-7cde-43e8-b448-7778db336950 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 204 len: 0 microversion: 2.1 time: 0.595515 Aug 27 02:35:10.305039 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 737/1580] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:35:09 2022] DELETE /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:35:10.329652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a6b9045a-ce47-4fc6-9f5b-18f5367cd658 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:10.334564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a6b9045a-ce47-4fc6-9f5b-18f5367cd658 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:10.351483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6b9045a-ce47-4fc6-9f5b-18f5367cd658 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:10.352656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6b9045a-ce47-4fc6-9f5b-18f5367cd658 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:10.354028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6b9045a-ce47-4fc6-9f5b-18f5367cd658 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:10.358772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6b9045a-ce47-4fc6-9f5b-18f5367cd658 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:10.359813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6b9045a-ce47-4fc6-9f5b-18f5367cd658 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:10.360624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6b9045a-ce47-4fc6-9f5b-18f5367cd658 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:10.498600 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a6b9045a-ce47-4fc6-9f5b-18f5367cd658 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185839 Aug 27 02:35:10.500062 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 738/1581] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:35:10 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:10.521523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7bfed96d-5898-446f-92a4-6e9e09abbf28 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:10.522716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7bfed96d-5898-446f-92a4-6e9e09abbf28 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:10.549351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bfed96d-5898-446f-92a4-6e9e09abbf28 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:10.550610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bfed96d-5898-446f-92a4-6e9e09abbf28 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:10.551653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bfed96d-5898-446f-92a4-6e9e09abbf28 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:10.553244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bfed96d-5898-446f-92a4-6e9e09abbf28 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:10.554449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bfed96d-5898-446f-92a4-6e9e09abbf28 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:10.555511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bfed96d-5898-446f-92a4-6e9e09abbf28 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:10.630496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:10.648445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:10.652165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:10.654653 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-89162e5e-43a2-42c7-8551-ecda80d6b85b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.883002 Aug 27 02:35:10.656190 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 844/1582] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:09 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:10.665045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a12daeef-84f0-40a3-a4fc-1931d08e4fbb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:10.667405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a12daeef-84f0-40a3-a4fc-1931d08e4fbb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:10.680862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12daeef-84f0-40a3-a4fc-1931d08e4fbb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:10.682704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12daeef-84f0-40a3-a4fc-1931d08e4fbb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:10.683797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12daeef-84f0-40a3-a4fc-1931d08e4fbb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:10.686110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12daeef-84f0-40a3-a4fc-1931d08e4fbb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:10.687309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12daeef-84f0-40a3-a4fc-1931d08e4fbb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:10.688326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12daeef-84f0-40a3-a4fc-1931d08e4fbb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:10.940706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a12daeef-84f0-40a3-a4fc-1931d08e4fbb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:10.952798 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a12daeef-84f0-40a3-a4fc-1931d08e4fbb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1368 microversion: 2.1 time: 0.294713 Aug 27 02:35:10.954502 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 845/1583] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:10 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:10.971596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-63847ab5-6075-4252-a002-0111fe483b99 req-e733da2a-2e45-4199-9f25-417c2d1f44d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59462ca6-1830-4fae-a141-ffade28879f6", "tag": "b9a18ca7-1e41-4aa3-9c64-1d916f180dce"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:10.995256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-63847ab5-6075-4252-a002-0111fe483b99 req-e733da2a-2e45-4199-9f25-417c2d1f44d0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:10.996102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-63847ab5-6075-4252-a002-0111fe483b99 req-e733da2a-2e45-4199-9f25-417c2d1f44d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:10.996794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-63847ab5-6075-4252-a002-0111fe483b99 req-e733da2a-2e45-4199-9f25-417c2d1f44d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:11.024414 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-63847ab5-6075-4252-a002-0111fe483b99 req-e733da2a-2e45-4199-9f25-417c2d1f44d0 service nova] Creating event network-changed:b9a18ca7-1e41-4aa3-9c64-1d916f180dce for instance 59462ca6-1830-4fae-a141-ffade28879f6 on n-h1-852084-5 Aug 27 02:35:11.040136 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-63847ab5-6075-4252-a002-0111fe483b99 req-e733da2a-2e45-4199-9f25-417c2d1f44d0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084011 Aug 27 02:35:11.042946 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 846/1584] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:11.050884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb49cf3e-8677-4afc-88f5-37955675747f tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:11.051994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb49cf3e-8677-4afc-88f5-37955675747f tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:11.060954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb49cf3e-8677-4afc-88f5-37955675747f tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:11.061574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb49cf3e-8677-4afc-88f5-37955675747f tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:11.062281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb49cf3e-8677-4afc-88f5-37955675747f tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:11.064023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb49cf3e-8677-4afc-88f5-37955675747f tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:11.064624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb49cf3e-8677-4afc-88f5-37955675747f tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:11.065075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb49cf3e-8677-4afc-88f5-37955675747f tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:11.070056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7bfed96d-5898-446f-92a4-6e9e09abbf28 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:11.100665 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7bfed96d-5898-446f-92a4-6e9e09abbf28 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1394 microversion: 2.1 time: 0.598688 Aug 27 02:35:11.102128 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 739/1585] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:10 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1394 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:11.137350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-703816f3-611f-4b23-9655-7201515982f2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:11.138461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-703816f3-611f-4b23-9655-7201515982f2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:11.150915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-703816f3-611f-4b23-9655-7201515982f2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:11.151919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-703816f3-611f-4b23-9655-7201515982f2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:11.152747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-703816f3-611f-4b23-9655-7201515982f2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:11.154202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-703816f3-611f-4b23-9655-7201515982f2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:11.155007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-703816f3-611f-4b23-9655-7201515982f2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:11.155717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-703816f3-611f-4b23-9655-7201515982f2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:11.449539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cb49cf3e-8677-4afc-88f5-37955675747f tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:11.466008 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb49cf3e-8677-4afc-88f5-37955675747f tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1512 microversion: 2.1 time: 0.421217 Aug 27 02:35:11.467838 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 847/1586] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:11 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1512 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:11.514083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cde4e275-14cb-4822-b3fe-ce191309590b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:11.514340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-703816f3-611f-4b23-9655-7201515982f2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:11.516619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cde4e275-14cb-4822-b3fe-ce191309590b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:11.529307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cde4e275-14cb-4822-b3fe-ce191309590b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:11.530266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cde4e275-14cb-4822-b3fe-ce191309590b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:11.531065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cde4e275-14cb-4822-b3fe-ce191309590b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:11.532456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cde4e275-14cb-4822-b3fe-ce191309590b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:11.537728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cde4e275-14cb-4822-b3fe-ce191309590b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:11.538833 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-703816f3-611f-4b23-9655-7201515982f2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1467 microversion: 2.1 time: 0.422334 Aug 27 02:35:11.542150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cde4e275-14cb-4822-b3fe-ce191309590b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:11.544945 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 740/1587] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:11 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1467 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:11.646548 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cde4e275-14cb-4822-b3fe-ce191309590b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136836 Aug 27 02:35:11.648613 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 848/1588] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:35:11 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:11.686449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:11.688190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:11.706821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:11.708147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:11.709169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:11.711031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:11.712172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:11.713775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:11.801813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c4d5755c-578f-418a-badb-11f394668ae9 req-f4c91e3a-e690-43ca-8936-98ff4bac9004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ade60c1-89d3-4f5d-94e0-42f8b573f14b", "tag": "0541fb29-89c6-4ee0-96d0-f5319ae94bf3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:11.823775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c4d5755c-578f-418a-badb-11f394668ae9 req-f4c91e3a-e690-43ca-8936-98ff4bac9004 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:11.824530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c4d5755c-578f-418a-badb-11f394668ae9 req-f4c91e3a-e690-43ca-8936-98ff4bac9004 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:11.825001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c4d5755c-578f-418a-badb-11f394668ae9 req-f4c91e3a-e690-43ca-8936-98ff4bac9004 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:11.842044 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c4d5755c-578f-418a-badb-11f394668ae9 req-f4c91e3a-e690-43ca-8936-98ff4bac9004 service nova] Creating event network-changed:0541fb29-89c6-4ee0-96d0-f5319ae94bf3 for instance 1ade60c1-89d3-4f5d-94e0-42f8b573f14b on n-h1-852084-5 Aug 27 02:35:11.848637 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c4d5755c-578f-418a-badb-11f394668ae9 req-f4c91e3a-e690-43ca-8936-98ff4bac9004 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057560 Aug 27 02:35:11.852919 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 849/1589] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:35:11.993733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ce177db9-a48f-45ac-9bfc-7e43c37ec0f8 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:11.995218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ce177db9-a48f-45ac-9bfc-7e43c37ec0f8 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:12.016252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce177db9-a48f-45ac-9bfc-7e43c37ec0f8 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:12.017567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce177db9-a48f-45ac-9bfc-7e43c37ec0f8 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:12.020307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce177db9-a48f-45ac-9bfc-7e43c37ec0f8 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:12.022529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce177db9-a48f-45ac-9bfc-7e43c37ec0f8 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:12.023915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce177db9-a48f-45ac-9bfc-7e43c37ec0f8 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:12.024964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce177db9-a48f-45ac-9bfc-7e43c37ec0f8 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:12.460320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ce177db9-a48f-45ac-9bfc-7e43c37ec0f8 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:12.487531 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ce177db9-a48f-45ac-9bfc-7e43c37ec0f8 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1368 microversion: 2.1 time: 0.498595 Aug 27 02:35:12.509360 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 850/1590] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:11 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1368 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:35:12.539695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3fa26201-cde2-4a7b-9863-1e5598b78e5b tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:12.541602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3fa26201-cde2-4a7b-9863-1e5598b78e5b tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:12.562636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa26201-cde2-4a7b-9863-1e5598b78e5b tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:12.564395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa26201-cde2-4a7b-9863-1e5598b78e5b tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:12.565995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa26201-cde2-4a7b-9863-1e5598b78e5b tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:12.568357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa26201-cde2-4a7b-9863-1e5598b78e5b tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:12.569865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa26201-cde2-4a7b-9863-1e5598b78e5b tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:12.573043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa26201-cde2-4a7b-9863-1e5598b78e5b tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:12.936018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3fa26201-cde2-4a7b-9863-1e5598b78e5b tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:12.974745 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3fa26201-cde2-4a7b-9863-1e5598b78e5b tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1394 microversion: 2.1 time: 0.455843 Aug 27 02:35:12.977984 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 851/1591] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:12 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1394 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:13.011435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-244a4e02-e936-4891-bf49-fa443a78f900 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:13.017789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-244a4e02-e936-4891-bf49-fa443a78f900 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:13.052346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244a4e02-e936-4891-bf49-fa443a78f900 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:13.054128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244a4e02-e936-4891-bf49-fa443a78f900 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:13.057982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244a4e02-e936-4891-bf49-fa443a78f900 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:13.059409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244a4e02-e936-4891-bf49-fa443a78f900 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:13.060197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244a4e02-e936-4891-bf49-fa443a78f900 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:13.060975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244a4e02-e936-4891-bf49-fa443a78f900 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:13.648959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-244a4e02-e936-4891-bf49-fa443a78f900 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:13.672454 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-244a4e02-e936-4891-bf49-fa443a78f900 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1512 microversion: 2.1 time: 0.674656 Aug 27 02:35:13.673124 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 852/1592] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:12 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1512 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:13.680492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e9fb8978-788f-4d21-8382-3da0befc8183 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:13.681136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e9fb8978-788f-4d21-8382-3da0befc8183 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:13.711849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9fb8978-788f-4d21-8382-3da0befc8183 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:13.712434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9fb8978-788f-4d21-8382-3da0befc8183 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:13.712979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9fb8978-788f-4d21-8382-3da0befc8183 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:13.713894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9fb8978-788f-4d21-8382-3da0befc8183 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:13.714384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9fb8978-788f-4d21-8382-3da0befc8183 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:13.714814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9fb8978-788f-4d21-8382-3da0befc8183 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:14.183266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e9fb8978-788f-4d21-8382-3da0befc8183 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:14.196765 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e9fb8978-788f-4d21-8382-3da0befc8183 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1467 microversion: 2.1 time: 0.522352 Aug 27 02:35:14.204350 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 853/1593] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:13 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1467 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:14.218434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c77390ae-149c-4a1e-a422-71a3ac4b88a6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:14.222540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c77390ae-149c-4a1e-a422-71a3ac4b88a6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:14.225149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:14.261632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:14.270901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:14.271185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c77390ae-149c-4a1e-a422-71a3ac4b88a6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:14.271770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c77390ae-149c-4a1e-a422-71a3ac4b88a6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:14.273734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c77390ae-149c-4a1e-a422-71a3ac4b88a6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:14.276084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c77390ae-149c-4a1e-a422-71a3ac4b88a6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:14.279782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c77390ae-149c-4a1e-a422-71a3ac4b88a6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:14.280070 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-13daf3a0-1c76-412d-942b-f2a750461d1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 2.600625 Aug 27 02:35:14.281223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c77390ae-149c-4a1e-a422-71a3ac4b88a6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:14.285629 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 741/1594] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:11 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:14.304247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ceb8abed-db9f-463c-9afa-94249b59e74c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:14.316918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ceb8abed-db9f-463c-9afa-94249b59e74c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:14.345806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ceb8abed-db9f-463c-9afa-94249b59e74c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:14.347140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ceb8abed-db9f-463c-9afa-94249b59e74c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:14.351612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ceb8abed-db9f-463c-9afa-94249b59e74c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:14.356774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ceb8abed-db9f-463c-9afa-94249b59e74c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:14.357986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ceb8abed-db9f-463c-9afa-94249b59e74c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:14.362777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ceb8abed-db9f-463c-9afa-94249b59e74c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:14.437369 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c77390ae-149c-4a1e-a422-71a3ac4b88a6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227560 Aug 27 02:35:14.439661 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 854/1595] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:35:14 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:14.454299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-639c5551-693f-47c7-a0d3-fc235756fa64 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:14.456055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-639c5551-693f-47c7-a0d3-fc235756fa64 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:14.472876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639c5551-693f-47c7-a0d3-fc235756fa64 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:14.476222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639c5551-693f-47c7-a0d3-fc235756fa64 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:14.480905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639c5551-693f-47c7-a0d3-fc235756fa64 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:14.482471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639c5551-693f-47c7-a0d3-fc235756fa64 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:14.484531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639c5551-693f-47c7-a0d3-fc235756fa64 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:14.488328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639c5551-693f-47c7-a0d3-fc235756fa64 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:15.138475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-639c5551-693f-47c7-a0d3-fc235756fa64 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:15.180833 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-639c5551-693f-47c7-a0d3-fc235756fa64 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1394 microversion: 2.1 time: 0.737190 Aug 27 02:35:15.184580 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 855/1596] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:14 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1394 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:15.208853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-0b45259e-b39c-43b5-bbf2-b644a6aed2ba req-98927c5f-c5e6-4d36-826c-85652da00d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e52df0-ca95-4f33-beb8-660817c63658", "name": "network-vif-unplugged", "status": "completed", "tag": "dba12d2f-f390-4730-9f01-553471e2b87a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:15.257586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0b45259e-b39c-43b5-bbf2-b644a6aed2ba req-98927c5f-c5e6-4d36-826c-85652da00d0e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:15.258113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0b45259e-b39c-43b5-bbf2-b644a6aed2ba req-98927c5f-c5e6-4d36-826c-85652da00d0e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:15.262749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0b45259e-b39c-43b5-bbf2-b644a6aed2ba req-98927c5f-c5e6-4d36-826c-85652da00d0e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:15.297952 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-0b45259e-b39c-43b5-bbf2-b644a6aed2ba req-98927c5f-c5e6-4d36-826c-85652da00d0e service nova] Creating event network-vif-unplugged:dba12d2f-f390-4730-9f01-553471e2b87a for instance 28e52df0-ca95-4f33-beb8-660817c63658 on n-h2-852084-5 Aug 27 02:35:15.311648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-0b45259e-b39c-43b5-bbf2-b644a6aed2ba req-98927c5f-c5e6-4d36-826c-85652da00d0e service nova] Instance 28e52df0-ca95-4f33-beb8-660817c63658 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:35:15.370025 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-0b45259e-b39c-43b5-bbf2-b644a6aed2ba req-98927c5f-c5e6-4d36-826c-85652da00d0e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180481 Aug 27 02:35:15.383830 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 856/1597] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:15.399538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:15.401384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:15.413970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:15.414216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:15.415033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:15.416948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:15.418514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:15.419378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:15.520215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:15.521111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:15.521881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:15.522692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lazy-loading 'fault' on Instance uuid 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:35:15.672423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd079579c3c4cfa99a14a5c5a720dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daba795eed3640ea87380940f0b2c15b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:15.715609 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21b60759-1de1-45d2-93eb-e2fe692f1345 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 200 len: 1307 microversion: 2.1 time: 0.324092 Aug 27 02:35:15.720685 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 857/1598] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:15 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:15.742056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-358882cc-97f4-4f1e-be88-368111416d9c req-6fc4adc0-0869-471c-a455-1e8e058a1bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239", "name": "network-vif-deleted", "tag": "6cfc7b59-1842-432b-a4c1-9de0b889e674"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:15.792313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-358882cc-97f4-4f1e-be88-368111416d9c req-6fc4adc0-0869-471c-a455-1e8e058a1bbc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:15.794972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-358882cc-97f4-4f1e-be88-368111416d9c req-6fc4adc0-0869-471c-a455-1e8e058a1bbc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:15.795546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-358882cc-97f4-4f1e-be88-368111416d9c req-6fc4adc0-0869-471c-a455-1e8e058a1bbc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:15.809047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:15.850604 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-358882cc-97f4-4f1e-be88-368111416d9c req-6fc4adc0-0869-471c-a455-1e8e058a1bbc service nova] Creating event network-vif-deleted:6cfc7b59-1842-432b-a4c1-9de0b889e674 for instance 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 on n-h1-852084-5 Aug 27 02:35:15.862507 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-358882cc-97f4-4f1e-be88-368111416d9c req-6fc4adc0-0869-471c-a455-1e8e058a1bbc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139547 Aug 27 02:35:15.867761 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 858/1599] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:15.895124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b6c0f21e-4b7e-4121-9da3-fdabf40d36e1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:15.901892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b6c0f21e-4b7e-4121-9da3-fdabf40d36e1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:15.927473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6c0f21e-4b7e-4121-9da3-fdabf40d36e1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:15.928261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6c0f21e-4b7e-4121-9da3-fdabf40d36e1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:15.928837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6c0f21e-4b7e-4121-9da3-fdabf40d36e1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:15.930142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6c0f21e-4b7e-4121-9da3-fdabf40d36e1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:15.936616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6c0f21e-4b7e-4121-9da3-fdabf40d36e1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:15.937701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6c0f21e-4b7e-4121-9da3-fdabf40d36e1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:16.304730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6c0f21e-4b7e-4121-9da3-fdabf40d36e1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:16.320990 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b6c0f21e-4b7e-4121-9da3-fdabf40d36e1 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1467 microversion: 2.1 time: 0.451615 Aug 27 02:35:16.322287 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 859/1600] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:15 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1467 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:16.334962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:16.339644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:16.358423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:16.359298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:16.360990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:16.363050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:16.365462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:16.366790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:16.549857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ceb8abed-db9f-463c-9afa-94249b59e74c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:16.561380 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ceb8abed-db9f-463c-9afa-94249b59e74c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1559 microversion: 2.1 time: 2.274062 Aug 27 02:35:16.563399 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 742/1601] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:14 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1559 bytes in 2277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:16.569213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0675c089-c636-4cb3-bef4-028c5344a159 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:16.573266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0675c089-c636-4cb3-bef4-028c5344a159 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:16.589809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0675c089-c636-4cb3-bef4-028c5344a159 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:16.591239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0675c089-c636-4cb3-bef4-028c5344a159 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:16.592343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0675c089-c636-4cb3-bef4-028c5344a159 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:16.593694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0675c089-c636-4cb3-bef4-028c5344a159 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:16.600404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0675c089-c636-4cb3-bef4-028c5344a159 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:16.602072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0675c089-c636-4cb3-bef4-028c5344a159 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:16.661400 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0675c089-c636-4cb3-bef4-028c5344a159 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096379 Aug 27 02:35:16.670386 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 743/1602] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:35:16 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:16.678439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f373d92b-11dc-46b9-9f89-ee74b143f57d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:16.679654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f373d92b-11dc-46b9-9f89-ee74b143f57d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:16.687910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f373d92b-11dc-46b9-9f89-ee74b143f57d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:16.689090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f373d92b-11dc-46b9-9f89-ee74b143f57d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:16.691062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f373d92b-11dc-46b9-9f89-ee74b143f57d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:16.692196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f373d92b-11dc-46b9-9f89-ee74b143f57d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:16.692919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f373d92b-11dc-46b9-9f89-ee74b143f57d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:16.693549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f373d92b-11dc-46b9-9f89-ee74b143f57d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:16.938732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:16.961277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:16.964348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:16.965879 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ef224a87-49a8-4975-bd16-9a07f698eb7f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.639067 Aug 27 02:35:16.966966 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 860/1603] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:16 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:16.980471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-cd11b5a9-c8fb-44e3-af5e-fc2d2492728c req-723a7284-08ad-408b-9836-d040a7efd832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e838b7-9173-4fe2-b467-73f543889366", "name": "network-vif-plugged", "status": "completed", "tag": "b4c9e241-4c66-4b06-954a-f77a9405754d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:17.006249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cd11b5a9-c8fb-44e3-af5e-fc2d2492728c req-723a7284-08ad-408b-9836-d040a7efd832 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:17.006815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cd11b5a9-c8fb-44e3-af5e-fc2d2492728c req-723a7284-08ad-408b-9836-d040a7efd832 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:17.008853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cd11b5a9-c8fb-44e3-af5e-fc2d2492728c req-723a7284-08ad-408b-9836-d040a7efd832 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:17.047922 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-cd11b5a9-c8fb-44e3-af5e-fc2d2492728c req-723a7284-08ad-408b-9836-d040a7efd832 service nova] Creating event network-vif-plugged:b4c9e241-4c66-4b06-954a-f77a9405754d for instance 43e838b7-9173-4fe2-b467-73f543889366 on n-h2-852084-5 Aug 27 02:35:17.068135 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-cd11b5a9-c8fb-44e3-af5e-fc2d2492728c req-723a7284-08ad-408b-9836-d040a7efd832 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098498 Aug 27 02:35:17.085078 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 861/1604] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:17.107041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7604cf7d-e753-4db3-a040-cd71446552ad tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:17.113493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7604cf7d-e753-4db3-a040-cd71446552ad tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:17.123747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7604cf7d-e753-4db3-a040-cd71446552ad tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:17.124259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7604cf7d-e753-4db3-a040-cd71446552ad tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:17.124712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7604cf7d-e753-4db3-a040-cd71446552ad tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:17.125527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7604cf7d-e753-4db3-a040-cd71446552ad tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:17.126029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7604cf7d-e753-4db3-a040-cd71446552ad tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:17.126641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7604cf7d-e753-4db3-a040-cd71446552ad tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:17.306115 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7604cf7d-e753-4db3-a040-cd71446552ad tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.218629 Aug 27 02:35:17.307987 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 862/1605] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:35:17 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:17.313087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:17.314072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] [instance: 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:17.321138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:17.322090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:17.322778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:17.323952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:17.325003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:17.325707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:17.345521 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] HTTP exception thrown: Instance 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 could not be found. Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Request method failure captured: Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 HTTP/1.1 Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYK0DNpkz-feWqSRsKq-al4QIJkB7u5R59OZwc3lsWVdIYdj0Noh0I76mgy8hwqIc9CDumEC0xx1EkN6oQLg0ubvRaOWX_wmUbxHBMJ4NjMwxUBhAWz4yp6p-zblDMChuCmVkVq-_ExPbW4IX_cUeAZKOAsUpCYvncUkgf7CTuSPQs0 Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: daba795eed3640ea87380940f0b2c15b Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-InstanceActionsTestJSON-186027994 Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_daba795eed3640ea87380940f0b2c15b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/daba795eed3640ea87380940f0b2c15b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/daba795eed3640ea87380940f0b2c15b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/daba795eed3640ea87380940f0b2c15b"}]}] Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-InstanceActionsTestJSON-186027994 Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: daba795eed3640ea87380940f0b2c15b Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-InstanceActionsTestJSON-186027994 Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-InstanceActionsTestJSON-186027994-project Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ccd079579c3c4cfa99a14a5c5a720dd3 Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-InstanceActionsTestJSON-186027994-project Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 could not be found. Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239'} Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 could not be found. Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 could not be found. Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:35:17.347781 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:17.352889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:17.352889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:35:17.352889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:35:17.352889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:35:17.352889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:35:17.352889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 could not be found. Aug 27 02:35:17.352889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:17.355791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] Returning 404 to user: Instance 9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:35:17.356996 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1ce568ba-84e4-4a13-856b-a44ec7bfb608 tempest-InstanceActionsTestJSON-186027994 tempest-InstanceActionsTestJSON-186027994-project] 10.222.0.99 "GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239" status: 404 len: 111 microversion: 2.1 time: 0.047805 Aug 27 02:35:17.361834 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 863/1606] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:17 2022] GET /compute/v2.1/servers/9ec2c5b4-7bb3-406d-8ea5-c5d3bd237239 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:35:17.371202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c5d2cc6-e31c-461b-9d2a-3aaf89e2d2f4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:17.372379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c5d2cc6-e31c-461b-9d2a-3aaf89e2d2f4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:17.380052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5d2cc6-e31c-461b-9d2a-3aaf89e2d2f4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:17.380980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5d2cc6-e31c-461b-9d2a-3aaf89e2d2f4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:17.381723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5d2cc6-e31c-461b-9d2a-3aaf89e2d2f4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:17.382790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5d2cc6-e31c-461b-9d2a-3aaf89e2d2f4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:17.383565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5d2cc6-e31c-461b-9d2a-3aaf89e2d2f4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:17.385007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5d2cc6-e31c-461b-9d2a-3aaf89e2d2f4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:17.638072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f373d92b-11dc-46b9-9f89-ee74b143f57d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:17.666426 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f373d92b-11dc-46b9-9f89-ee74b143f57d tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1394 microversion: 2.1 time: 0.994313 Aug 27 02:35:17.667791 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 744/1607] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:16 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1394 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:17.688625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2d6d5f2a-4623-4053-9079-7f79ebc90626 req-3f6aae61-1ccc-47e8-a0b1-89c397bad1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e52df0-ca95-4f33-beb8-660817c63658", "tag": "dba12d2f-f390-4730-9f01-553471e2b87a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:17.735375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d6d5f2a-4623-4053-9079-7f79ebc90626 req-3f6aae61-1ccc-47e8-a0b1-89c397bad1c3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:17.736844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d6d5f2a-4623-4053-9079-7f79ebc90626 req-3f6aae61-1ccc-47e8-a0b1-89c397bad1c3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:17.741964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d6d5f2a-4623-4053-9079-7f79ebc90626 req-3f6aae61-1ccc-47e8-a0b1-89c397bad1c3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:17.786481 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2d6d5f2a-4623-4053-9079-7f79ebc90626 req-3f6aae61-1ccc-47e8-a0b1-89c397bad1c3 service nova] Creating event network-changed:dba12d2f-f390-4730-9f01-553471e2b87a for instance 28e52df0-ca95-4f33-beb8-660817c63658 on n-h2-852084-5 Aug 27 02:35:17.804464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-2d6d5f2a-4623-4053-9079-7f79ebc90626 req-3f6aae61-1ccc-47e8-a0b1-89c397bad1c3 service nova] Instance 28e52df0-ca95-4f33-beb8-660817c63658 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 02:35:17.846067 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2d6d5f2a-4623-4053-9079-7f79ebc90626 req-3f6aae61-1ccc-47e8-a0b1-89c397bad1c3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168838 Aug 27 02:35:17.847010 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 745/1608] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:17.853959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1c5d2cc6-e31c-461b-9d2a-3aaf89e2d2f4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:17.868249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb0bc6de-2ca7-482e-9aeb-eaa5781fcb82 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:17.868780 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c5d2cc6-e31c-461b-9d2a-3aaf89e2d2f4 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1467 microversion: 2.1 time: 0.498791 Aug 27 02:35:17.870033 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 864/1609] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:17 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1467 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:17.872985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fb0bc6de-2ca7-482e-9aeb-eaa5781fcb82 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:17.880397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb0bc6de-2ca7-482e-9aeb-eaa5781fcb82 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:17.881269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb0bc6de-2ca7-482e-9aeb-eaa5781fcb82 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:17.882045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb0bc6de-2ca7-482e-9aeb-eaa5781fcb82 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:17.883337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb0bc6de-2ca7-482e-9aeb-eaa5781fcb82 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:17.884132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb0bc6de-2ca7-482e-9aeb-eaa5781fcb82 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:17.884889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb0bc6de-2ca7-482e-9aeb-eaa5781fcb82 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:17.926104 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fb0bc6de-2ca7-482e-9aeb-eaa5781fcb82 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077514 Aug 27 02:35:17.927454 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 746/1610] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:35:17 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:17.994814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:17.995883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:18.003140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:18.004186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:18.005049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:18.006382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:18.007132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:18.008033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:18.691303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42ecc1fb-6c5a-4e75-a3bb-5c9ad58aec0c tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:18.695968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-42ecc1fb-6c5a-4e75-a3bb-5c9ad58aec0c tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:18.712877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42ecc1fb-6c5a-4e75-a3bb-5c9ad58aec0c tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:18.715556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42ecc1fb-6c5a-4e75-a3bb-5c9ad58aec0c tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:18.721003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:18.731064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42ecc1fb-6c5a-4e75-a3bb-5c9ad58aec0c tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:18.732018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42ecc1fb-6c5a-4e75-a3bb-5c9ad58aec0c tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:18.732395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42ecc1fb-6c5a-4e75-a3bb-5c9ad58aec0c tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:18.733125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42ecc1fb-6c5a-4e75-a3bb-5c9ad58aec0c tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:18.740549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:18.755841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:18.761453 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ae4d33cb-18f9-446f-b314-10915dce7e0b tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.768787 Aug 27 02:35:18.764623 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 865/1611] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:17 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:35:18.894350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2568bc4a-4f6b-44ea-9922-4227e1c31094 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:18.895964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2568bc4a-4f6b-44ea-9922-4227e1c31094 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:18.905920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2568bc4a-4f6b-44ea-9922-4227e1c31094 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:18.910809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2568bc4a-4f6b-44ea-9922-4227e1c31094 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:18.913189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2568bc4a-4f6b-44ea-9922-4227e1c31094 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:18.919205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2568bc4a-4f6b-44ea-9922-4227e1c31094 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:18.919914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2568bc4a-4f6b-44ea-9922-4227e1c31094 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:18.922934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2568bc4a-4f6b-44ea-9922-4227e1c31094 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:19.498349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2568bc4a-4f6b-44ea-9922-4227e1c31094 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:19.508786 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2568bc4a-4f6b-44ea-9922-4227e1c31094 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1467 microversion: 2.1 time: 0.618693 Aug 27 02:35:19.513294 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 866/1612] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:18 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1467 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:19.521107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2a615499-39e4-470a-83f5-ee29134216de tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:19.527636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-42ecc1fb-6c5a-4e75-a3bb-5c9ad58aec0c tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:19.541384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2a615499-39e4-470a-83f5-ee29134216de tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:19.551519 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42ecc1fb-6c5a-4e75-a3bb-5c9ad58aec0c tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1394 microversion: 2.1 time: 0.865414 Aug 27 02:35:19.566762 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 747/1613] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:18 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1394 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:19.571279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a615499-39e4-470a-83f5-ee29134216de tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:19.572624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a615499-39e4-470a-83f5-ee29134216de tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:19.573250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a615499-39e4-470a-83f5-ee29134216de tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:19.574229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a615499-39e4-470a-83f5-ee29134216de tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:19.574908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a615499-39e4-470a-83f5-ee29134216de tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:19.575545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2a615499-39e4-470a-83f5-ee29134216de tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:19.675873 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2a615499-39e4-470a-83f5-ee29134216de tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160829 Aug 27 02:35:19.684230 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 867/1614] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:35:19 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:19.788920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:19.789922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:19.800956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:19.803189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:19.805963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:19.808782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:19.810606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:19.812350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:20.524205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:20.539973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:20.546112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ddda316e-e489-48e8-a240-1bcba470b9f7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:20.546752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:20.547614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ddda316e-e489-48e8-a240-1bcba470b9f7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:20.548017 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4d66ec80-ca20-4b4e-84d5-1eb58d1f1d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.764173 Aug 27 02:35:20.548894 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 748/1615] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:19 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:20.574471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-50810253-8d80-49ef-a941-23496655821e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:20.575107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-50810253-8d80-49ef-a941-23496655821e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:20.575923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddda316e-e489-48e8-a240-1bcba470b9f7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:20.576415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddda316e-e489-48e8-a240-1bcba470b9f7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:20.576850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddda316e-e489-48e8-a240-1bcba470b9f7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:20.577928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddda316e-e489-48e8-a240-1bcba470b9f7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:20.578616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddda316e-e489-48e8-a240-1bcba470b9f7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:20.579251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddda316e-e489-48e8-a240-1bcba470b9f7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:20.589135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50810253-8d80-49ef-a941-23496655821e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:20.589681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50810253-8d80-49ef-a941-23496655821e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:20.590134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50810253-8d80-49ef-a941-23496655821e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:20.590884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50810253-8d80-49ef-a941-23496655821e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:20.591352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50810253-8d80-49ef-a941-23496655821e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:20.591791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50810253-8d80-49ef-a941-23496655821e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:20.602496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:20.992350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ddda316e-e489-48e8-a240-1bcba470b9f7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:21.013968 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ddda316e-e489-48e8-a240-1bcba470b9f7 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1460 microversion: 2.1 time: 0.471767 Aug 27 02:35:21.015226 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 868/1616] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:20 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1460 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:21.023052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-0406206d-f0f2-43c5-908b-f969af1ca2b9 req-c64d95f1-d4be-4035-b914-1d948c46d518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb357c66-d559-4bb9-a7f4-3ce3f6f09904", "tag": "b93676cc-2eb8-4e67-8a15-41712593277b"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:21.035503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0406206d-f0f2-43c5-908b-f969af1ca2b9 req-c64d95f1-d4be-4035-b914-1d948c46d518 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:21.036315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0406206d-f0f2-43c5-908b-f969af1ca2b9 req-c64d95f1-d4be-4035-b914-1d948c46d518 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:21.036951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0406206d-f0f2-43c5-908b-f969af1ca2b9 req-c64d95f1-d4be-4035-b914-1d948c46d518 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:21.057102 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-0406206d-f0f2-43c5-908b-f969af1ca2b9 req-c64d95f1-d4be-4035-b914-1d948c46d518 service nova] Creating event network-changed:b93676cc-2eb8-4e67-8a15-41712593277b for instance bb357c66-d559-4bb9-a7f4-3ce3f6f09904 on n-h2-852084-5 Aug 27 02:35:21.064393 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-0406206d-f0f2-43c5-908b-f969af1ca2b9 req-c64d95f1-d4be-4035-b914-1d948c46d518 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047694 Aug 27 02:35:21.065650 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 869/1617] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:21.074110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f148d716-cd40-4f50-af54-88c9f478aa47 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:21.077556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f148d716-cd40-4f50-af54-88c9f478aa47 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:21.088404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f148d716-cd40-4f50-af54-88c9f478aa47 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:21.089343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f148d716-cd40-4f50-af54-88c9f478aa47 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:21.090412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f148d716-cd40-4f50-af54-88c9f478aa47 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:21.091654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f148d716-cd40-4f50-af54-88c9f478aa47 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:21.092343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f148d716-cd40-4f50-af54-88c9f478aa47 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:21.094223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f148d716-cd40-4f50-af54-88c9f478aa47 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:21.153604 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f148d716-cd40-4f50-af54-88c9f478aa47 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086322 Aug 27 02:35:21.155255 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 870/1618] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:35:21 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:35:21.258360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-50810253-8d80-49ef-a941-23496655821e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:21.270266 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-50810253-8d80-49ef-a941-23496655821e tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1394 microversion: 2.1 time: 0.700149 Aug 27 02:35:21.273827 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 749/1619] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:20 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1394 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:35:21.577129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:21.578208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:21.587303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:21.594139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:21.594820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:21.595791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:21.596450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:21.597161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:21.878669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9eada19d-6a14-44fa-bf8b-a666fc491fae tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:21.879314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9eada19d-6a14-44fa-bf8b-a666fc491fae tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:21.893230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eada19d-6a14-44fa-bf8b-a666fc491fae tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:21.896240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eada19d-6a14-44fa-bf8b-a666fc491fae tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:21.896764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eada19d-6a14-44fa-bf8b-a666fc491fae tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:21.897540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eada19d-6a14-44fa-bf8b-a666fc491fae tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:21.910473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eada19d-6a14-44fa-bf8b-a666fc491fae tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:21.910932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eada19d-6a14-44fa-bf8b-a666fc491fae tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:22.368359 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9eada19d-6a14-44fa-bf8b-a666fc491fae tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1611 microversion: 2.1 time: 1.211265 Aug 27 02:35:22.371251 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 871/1620] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:21 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1611 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:22.372611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9eada19d-6a14-44fa-bf8b-a666fc491fae tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:22.374716 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9eada19d-6a14-44fa-bf8b-a666fc491fae tempest-MigrationsAdminTest-1435903248 tempest-MigrationsAdminTest-1435903248-project-admin] 10.222.0.99 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002369 Aug 27 02:35:22.377691 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 872/1621] 10.222.0.99 () {56 vars in 886 bytes} [Sat Aug 27 02:35:22 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 02:35:22.391447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c53b1b57-6261-474c-a432-f76d70d28ba9 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:22.392391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c53b1b57-6261-474c-a432-f76d70d28ba9 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:22.422237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c53b1b57-6261-474c-a432-f76d70d28ba9 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:22.423167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c53b1b57-6261-474c-a432-f76d70d28ba9 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:22.425786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c53b1b57-6261-474c-a432-f76d70d28ba9 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:22.426861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c53b1b57-6261-474c-a432-f76d70d28ba9 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:22.428024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c53b1b57-6261-474c-a432-f76d70d28ba9 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:22.430163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c53b1b57-6261-474c-a432-f76d70d28ba9 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:23.170189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:23.188251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:23.205787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:23.211824 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-522742aa-74ee-4955-b054-e8cced355250 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 1.634139 Aug 27 02:35:23.213295 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 750/1622] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:21 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:35:23.226570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb6b1b50-a823-44eb-904f-a84a7eaa4d63 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:23.228751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb6b1b50-a823-44eb-904f-a84a7eaa4d63 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:23.280881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb6b1b50-a823-44eb-904f-a84a7eaa4d63 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:23.284691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb6b1b50-a823-44eb-904f-a84a7eaa4d63 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:23.299522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb6b1b50-a823-44eb-904f-a84a7eaa4d63 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:23.303350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb6b1b50-a823-44eb-904f-a84a7eaa4d63 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:23.314867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb6b1b50-a823-44eb-904f-a84a7eaa4d63 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:23.316040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb6b1b50-a823-44eb-904f-a84a7eaa4d63 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:23.518889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb6b1b50-a823-44eb-904f-a84a7eaa4d63 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:35:23.604026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c53b1b57-6261-474c-a432-f76d70d28ba9 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:23.623713 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c53b1b57-6261-474c-a432-f76d70d28ba9 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1574 microversion: 2.1 time: 1.244385 Aug 27 02:35:23.626445 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 873/1623] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:22 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1574 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:23.646293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab208e28-4e45-4327-8b23-70f2d8a51eae tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:23.647150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ab208e28-4e45-4327-8b23-70f2d8a51eae tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:23.663870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab208e28-4e45-4327-8b23-70f2d8a51eae tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:23.664668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab208e28-4e45-4327-8b23-70f2d8a51eae tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:23.666131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab208e28-4e45-4327-8b23-70f2d8a51eae tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:23.667207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab208e28-4e45-4327-8b23-70f2d8a51eae tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:23.668011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab208e28-4e45-4327-8b23-70f2d8a51eae tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:23.668776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab208e28-4e45-4327-8b23-70f2d8a51eae tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:23.835652 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb6b1b50-a823-44eb-904f-a84a7eaa4d63 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "DELETE /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 204 len: 0 microversion: 2.1 time: 0.618816 Aug 27 02:35:23.836400 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 751/1624] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:35:23 2022] DELETE /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:35:23.859727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fd79e0ff-0f85-459f-8b7b-d82225538077 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:23.860651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fd79e0ff-0f85-459f-8b7b-d82225538077 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:23.877462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd79e0ff-0f85-459f-8b7b-d82225538077 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:23.878743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd79e0ff-0f85-459f-8b7b-d82225538077 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:23.879487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd79e0ff-0f85-459f-8b7b-d82225538077 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:23.880551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd79e0ff-0f85-459f-8b7b-d82225538077 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:23.881310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd79e0ff-0f85-459f-8b7b-d82225538077 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:23.882036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd79e0ff-0f85-459f-8b7b-d82225538077 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:24.291058 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab208e28-4e45-4327-8b23-70f2d8a51eae tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.648012 Aug 27 02:35:24.292124 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 874/1625] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:35:23 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366/os-interface => generated 284 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:35:24.310133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:24.315803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:24.347002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:24.358506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:24.360404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:24.365277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:24.372131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:24.383564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:24.913500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fd79e0ff-0f85-459f-8b7b-d82225538077 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:24.928426 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fd79e0ff-0f85-459f-8b7b-d82225538077 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1466 microversion: 2.1 time: 1.083965 Aug 27 02:35:24.929364 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 752/1626] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:23 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1466 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:24.943803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:24.952447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c7fb4e71-945e-4bc3-8462-c0d59f0d489e req-7fb786cd-1403-494b-9299-cfdc3b4128bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e52df0-ca95-4f33-beb8-660817c63658", "name": "network-vif-plugged", "status": "completed", "tag": "dba12d2f-f390-4730-9f01-553471e2b87a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:24.991494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7fb4e71-945e-4bc3-8462-c0d59f0d489e req-7fb786cd-1403-494b-9299-cfdc3b4128bc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:24.991724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:24.996702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7fb4e71-945e-4bc3-8462-c0d59f0d489e req-7fb786cd-1403-494b-9299-cfdc3b4128bc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:25.000321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7fb4e71-945e-4bc3-8462-c0d59f0d489e req-7fb786cd-1403-494b-9299-cfdc3b4128bc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:25.003833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:25.014252 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f53e379-417b-4b67-bebd-77ea42365d12 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1569 microversion: 2.25 time: 0.719243 Aug 27 02:35:25.019451 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 875/1627] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:24 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1569 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:25.080186 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c7fb4e71-945e-4bc3-8462-c0d59f0d489e req-7fb786cd-1403-494b-9299-cfdc3b4128bc service nova] Creating event network-vif-plugged:dba12d2f-f390-4730-9f01-553471e2b87a for instance 28e52df0-ca95-4f33-beb8-660817c63658 on n-h2-852084-5 Aug 27 02:35:25.132684 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c7fb4e71-945e-4bc3-8462-c0d59f0d489e req-7fb786cd-1403-494b-9299-cfdc3b4128bc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197681 Aug 27 02:35:25.140262 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 753/1628] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:25.970480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a3e0a4dd-9e08-447d-bb3b-5403ec3b23b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:25.972880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a3e0a4dd-9e08-447d-bb3b-5403ec3b23b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:26.014840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3e0a4dd-9e08-447d-bb3b-5403ec3b23b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:26.016213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3e0a4dd-9e08-447d-bb3b-5403ec3b23b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:26.017255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3e0a4dd-9e08-447d-bb3b-5403ec3b23b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:26.018900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3e0a4dd-9e08-447d-bb3b-5403ec3b23b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:26.019766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3e0a4dd-9e08-447d-bb3b-5403ec3b23b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:26.020549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3e0a4dd-9e08-447d-bb3b-5403ec3b23b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:26.063631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:26.065332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:26.078670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:26.079622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:26.080470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:26.086119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:26.087643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:26.088578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:27.290910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:27.342949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:27.352427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:27.357177 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba01edbb-7530-4ef1-8c1e-c38562e94b5c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1544 microversion: 2.25 time: 1.299882 Aug 27 02:35:27.363317 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 754/1629] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:26 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1544 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:35:27.417476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-226117eb-8774-474a-a708-bdad1b7077dd tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '.version_select at 0x7f4d2a60e3a0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:27.437718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-226117eb-8774-474a-a708-bdad1b7077dd tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:27.440877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-226117eb-8774-474a-a708-bdad1b7077dd tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:27.448748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-226117eb-8774-474a-a708-bdad1b7077dd tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:27.530167 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-226117eb-8774-474a-a708-bdad1b7077dd tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-migrations" status: 200 len: 4050 microversion: 2.25 time: 0.125516 Aug 27 02:35:27.533419 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 755/1630] 10.222.0.99 () {60 vars in 1184 bytes} [Sat Aug 27 02:35:27 2022] GET /compute/v2.1/os-migrations => generated 4050 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:27.576633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a06b59c3-7f9b-4e2f-a361-023103dc3d9c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:27.578912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a06b59c3-7f9b-4e2f-a361-023103dc3d9c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:27.591754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a06b59c3-7f9b-4e2f-a361-023103dc3d9c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:27.592606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a06b59c3-7f9b-4e2f-a361-023103dc3d9c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:27.593350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a06b59c3-7f9b-4e2f-a361-023103dc3d9c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:27.595299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a06b59c3-7f9b-4e2f-a361-023103dc3d9c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:27.595990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a06b59c3-7f9b-4e2f-a361-023103dc3d9c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:27.596660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a06b59c3-7f9b-4e2f-a361-023103dc3d9c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:27.918846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-a06b59c3-7f9b-4e2f-a361-023103dc3d9c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid 1ade60c1-89d3-4f5d-94e0-42f8b573f14b {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:35:28.010787 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a06b59c3-7f9b-4e2f-a361-023103dc3d9c tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 2037 microversion: 2.25 time: 0.426111 Aug 27 02:35:28.011909 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 756/1631] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:27 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 2037 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:28.059456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-81ef0c53-5f8a-4712-97f8-313741125374 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Action: 'create', calling method: .version_select at 0x7f4d2e8c9b80>, body: {"keypair": {"name": "tempest-keypair-1492035077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA851WKRO3KlBExHnW1FMaODNw6U5s86LKRPrFYlZR9wtE1555QtMc5+jXq+PL4L3WE513fLe9p6JkncbikULzNq9B7vV3NRp8DU5p3I5hu8RWpaE74kywZzMHbzK8NpcQ=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:28.099750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-81ef0c53-5f8a-4712-97f8-313741125374 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Getting quotas for project 4d2da2e10e53450096a68048f98bd99a. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:35:28.125086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-81ef0c53-5f8a-4712-97f8-313741125374 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Getting quotas for user 4cf03330b076434098eef9230222830e and project 4d2da2e10e53450096a68048f98bd99a. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:35:28.193032 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-81ef0c53-5f8a-4712-97f8-313741125374 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.147489 Aug 27 02:35:28.202548 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 757/1632] 10.222.0.99 () {62 vars in 1200 bytes} [Sat Aug 27 02:35:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 27 02:35:28.481308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a3e0a4dd-9e08-447d-bb3b-5403ec3b23b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:28.541422 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a3e0a4dd-9e08-447d-bb3b-5403ec3b23b9 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1466 microversion: 2.1 time: 2.577371 Aug 27 02:35:28.551737 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 876/1633] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:25 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1466 bytes in 2590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:28.655772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42704ff4-89a4-4492-872f-608aec0885bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:28.659495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-42704ff4-89a4-4492-872f-608aec0885bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:28.674554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42704ff4-89a4-4492-872f-608aec0885bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:28.675184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42704ff4-89a4-4492-872f-608aec0885bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:28.675819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42704ff4-89a4-4492-872f-608aec0885bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:28.676807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42704ff4-89a4-4492-872f-608aec0885bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:28.677269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f580de8a-c9b8-4d73-a443-a7fa2650c37a req-03d97d4f-ef20-4eb5-bdaf-6b67ead053dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e838b7-9173-4fe2-b467-73f543889366", "tag": "b4c9e241-4c66-4b06-954a-f77a9405754d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:28.678131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42704ff4-89a4-4492-872f-608aec0885bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:28.694991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42704ff4-89a4-4492-872f-608aec0885bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:28.722429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f580de8a-c9b8-4d73-a443-a7fa2650c37a req-03d97d4f-ef20-4eb5-bdaf-6b67ead053dd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:28.723748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f580de8a-c9b8-4d73-a443-a7fa2650c37a req-03d97d4f-ef20-4eb5-bdaf-6b67ead053dd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:28.725144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f580de8a-c9b8-4d73-a443-a7fa2650c37a req-03d97d4f-ef20-4eb5-bdaf-6b67ead053dd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:28.762772 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f580de8a-c9b8-4d73-a443-a7fa2650c37a req-03d97d4f-ef20-4eb5-bdaf-6b67ead053dd service nova] Creating event network-changed:b4c9e241-4c66-4b06-954a-f77a9405754d for instance 43e838b7-9173-4fe2-b467-73f543889366 on n-h2-852084-5 Aug 27 02:35:28.798047 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f580de8a-c9b8-4d73-a443-a7fa2650c37a req-03d97d4f-ef20-4eb5-bdaf-6b67ead053dd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136242 Aug 27 02:35:28.832290 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 877/1634] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:35:29.528473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-42704ff4-89a4-4492-872f-608aec0885bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:29.545404 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42704ff4-89a4-4492-872f-608aec0885bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1574 microversion: 2.1 time: 0.894284 Aug 27 02:35:29.548342 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 758/1635] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:28 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1574 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:29.609782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-199e17d9-3e99-4e52-b7b4-5fd4dcc5e994 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:29.613956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-199e17d9-3e99-4e52-b7b4-5fd4dcc5e994 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:29.642613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-199e17d9-3e99-4e52-b7b4-5fd4dcc5e994 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:29.648724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-199e17d9-3e99-4e52-b7b4-5fd4dcc5e994 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:29.650841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-199e17d9-3e99-4e52-b7b4-5fd4dcc5e994 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:29.652810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-199e17d9-3e99-4e52-b7b4-5fd4dcc5e994 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:29.654276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-199e17d9-3e99-4e52-b7b4-5fd4dcc5e994 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:29.655734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-199e17d9-3e99-4e52-b7b4-5fd4dcc5e994 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:30.158143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-199e17d9-3e99-4e52-b7b4-5fd4dcc5e994 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:30.197375 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-199e17d9-3e99-4e52-b7b4-5fd4dcc5e994 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1424 microversion: 2.1 time: 0.606349 Aug 27 02:35:30.201767 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 878/1636] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:29 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1424 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:30.501245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-b8375a03-7aff-451a-95e6-b76404012815 req-340c323e-955a-4053-8a47-3f67c406391d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e52df0-ca95-4f33-beb8-660817c63658", "name": "network-vif-deleted", "tag": "dba12d2f-f390-4730-9f01-553471e2b87a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:30.586596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b8375a03-7aff-451a-95e6-b76404012815 req-340c323e-955a-4053-8a47-3f67c406391d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:30.589556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b8375a03-7aff-451a-95e6-b76404012815 req-340c323e-955a-4053-8a47-3f67c406391d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:30.592872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b8375a03-7aff-451a-95e6-b76404012815 req-340c323e-955a-4053-8a47-3f67c406391d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:30.668528 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-b8375a03-7aff-451a-95e6-b76404012815 req-340c323e-955a-4053-8a47-3f67c406391d service nova] Creating event network-vif-deleted:dba12d2f-f390-4730-9f01-553471e2b87a for instance 28e52df0-ca95-4f33-beb8-660817c63658 on n-h2-852084-5 Aug 27 02:35:30.686017 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-b8375a03-7aff-451a-95e6-b76404012815 req-340c323e-955a-4053-8a47-3f67c406391d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208390 Aug 27 02:35:30.700923 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 759/1637] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:31.240509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:31.241429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:31.258721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:31.261384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:31.263791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:31.264783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:31.265468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:31.266130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:31.374849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:31.378800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:31.380305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:31.383255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lazy-loading 'fault' on Instance uuid 28e52df0-ca95-4f33-beb8-660817c63658 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:35:31.388029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:31.670051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:31.696785 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9fc204ee-cbe7-47f2-bacc-f1a103bb1c20 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 200 len: 1302 microversion: 2.1 time: 0.461408 Aug 27 02:35:31.698370 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 879/1638] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:31 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 1302 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:32.726280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:32.727770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 28e52df0-ca95-4f33-beb8-660817c63658] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:32.779410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:32.804362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:32.805501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:32.806383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:32.811963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:32.812907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:32.814848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:32.856182 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] HTTP exception thrown: Instance 28e52df0-ca95-4f33-beb8-660817c63658 could not be found. Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Request method failure captured: Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 HTTP/1.1 Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFtDBmGq83eNu1qqEhAPqwq-xcey7d4jWftjR0_efTYRY6I2GEMLeT4SahTzZjj4gE-g8SlhSKONok7wQazsgC2-2lg0Qm1eOO8ZvVcPz9NouTWJ5O44htsOt8k-h61R6ZH4TETHbfOHsJs8K-LfhvS6OAjBAzEzNhynP8kjulEeW0 Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: a547cdcaa55b41f8865fac16ef8fd99c Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a547cdcaa55b41f8865fac16ef8fd99c"}]}] Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: a547cdcaa55b41f8865fac16ef8fd99c Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-MigrationsAdminTest-1693558053-project Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d1624ef00b144dafbaff7ae5c677e7a3 Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-MigrationsAdminTest-1693558053-project Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 28e52df0-ca95-4f33-beb8-660817c63658 could not be found. Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '28e52df0-ca95-4f33-beb8-660817c63658'} Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28e52df0-ca95-4f33-beb8-660817c63658 could not be found. Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28e52df0-ca95-4f33-beb8-660817c63658 could not be found. Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:35:32.863571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:35:32.869693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:32.869693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:35:32.869693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:35:32.869693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:35:32.869693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:35:32.869693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28e52df0-ca95-4f33-beb8-660817c63658 could not be found. Aug 27 02:35:32.869693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:35:32.883707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Returning 404 to user: Instance 28e52df0-ca95-4f33-beb8-660817c63658 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:35:32.885116 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7727fb9e-3956-46b2-89bd-be36bebc489d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658" status: 404 len: 111 microversion: 2.1 time: 0.168300 Aug 27 02:35:32.890127 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 760/1639] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:32 2022] GET /compute/v2.1/servers/28e52df0-ca95-4f33-beb8-660817c63658 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:35:32.900031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5f890249-0f41-47c6-b2b5-fe56be772a14 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:32.900849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5f890249-0f41-47c6-b2b5-fe56be772a14 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:32.920414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=99 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:32.955362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f890249-0f41-47c6-b2b5-fe56be772a14 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:32.956065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f890249-0f41-47c6-b2b5-fe56be772a14 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:32.957091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f890249-0f41-47c6-b2b5-fe56be772a14 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:32.958092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f890249-0f41-47c6-b2b5-fe56be772a14 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:32.958734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f890249-0f41-47c6-b2b5-fe56be772a14 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:32.959433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f890249-0f41-47c6-b2b5-fe56be772a14 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:33.000846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5f890249-0f41-47c6-b2b5-fe56be772a14 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:35:33.199422 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f890249-0f41-47c6-b2b5-fe56be772a14 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "DELETE /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 204 len: 0 microversion: 2.1 time: 0.307730 Aug 27 02:35:33.212313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ae99f9c8-acbf-43ca-b7a3-618bad792e6c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:33.213371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ae99f9c8-acbf-43ca-b7a3-618bad792e6c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:33.216934 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 880/1640] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:35:32 2022] DELETE /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:35:33.238013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae99f9c8-acbf-43ca-b7a3-618bad792e6c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:33.238987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae99f9c8-acbf-43ca-b7a3-618bad792e6c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:33.239849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae99f9c8-acbf-43ca-b7a3-618bad792e6c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:33.241170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae99f9c8-acbf-43ca-b7a3-618bad792e6c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:33.242293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae99f9c8-acbf-43ca-b7a3-618bad792e6c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:33.243040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae99f9c8-acbf-43ca-b7a3-618bad792e6c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:33.858384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ae99f9c8-acbf-43ca-b7a3-618bad792e6c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:33.878137 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ae99f9c8-acbf-43ca-b7a3-618bad792e6c tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1535 microversion: 2.1 time: 0.671716 Aug 27 02:35:33.889903 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 761/1641] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:33 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1535 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:34.276361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2063309917", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "fb40e9d4-9a6b-4f53-9e40-c59943eeffc8"}], "security_groups": [{"name": "tempest-securitygroup--3738263"}], "key_name": "tempest-keypair-1492035077", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:34.905235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-80862ca7-3eb1-475d-81d5-defbfe21d819 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:34.906226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-80862ca7-3eb1-475d-81d5-defbfe21d819 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:34.918180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80862ca7-3eb1-475d-81d5-defbfe21d819 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:34.918531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80862ca7-3eb1-475d-81d5-defbfe21d819 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:34.918901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80862ca7-3eb1-475d-81d5-defbfe21d819 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:34.920851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80862ca7-3eb1-475d-81d5-defbfe21d819 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:34.920851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80862ca7-3eb1-475d-81d5-defbfe21d819 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:34.920851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80862ca7-3eb1-475d-81d5-defbfe21d819 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:34.982421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] validate_networks() for [('fb40e9d4-9a6b-4f53-9e40-c59943eeffc8', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:35:35.396155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-80862ca7-3eb1-475d-81d5-defbfe21d819 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:35.426658 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-80862ca7-3eb1-475d-81d5-defbfe21d819 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1535 microversion: 2.1 time: 0.521718 Aug 27 02:35:35.428118 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 762/1642] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:34 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1535 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:36.176255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c7eb2c79-3f99-48d8-8791-f01d20494876 req-37b5c9d9-3a82-4a61-8b79-8a0086d65118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde6f25d-de52-4758-85c7-ce0b8471e481", "name": "network-vif-deleted", "tag": "5250e113-81ca-45c6-a466-ef24aace16e6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:36.221777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7eb2c79-3f99-48d8-8791-f01d20494876 req-37b5c9d9-3a82-4a61-8b79-8a0086d65118 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:36.222689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7eb2c79-3f99-48d8-8791-f01d20494876 req-37b5c9d9-3a82-4a61-8b79-8a0086d65118 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:36.223507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7eb2c79-3f99-48d8-8791-f01d20494876 req-37b5c9d9-3a82-4a61-8b79-8a0086d65118 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:36.271309 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c7eb2c79-3f99-48d8-8791-f01d20494876 req-37b5c9d9-3a82-4a61-8b79-8a0086d65118 service nova] Creating event network-vif-deleted:5250e113-81ca-45c6-a466-ef24aace16e6 for instance fde6f25d-de52-4758-85c7-ce0b8471e481 on n-h2-852084-5 Aug 27 02:35:36.284763 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c7eb2c79-3f99-48d8-8791-f01d20494876 req-37b5c9d9-3a82-4a61-8b79-8a0086d65118 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113477 Aug 27 02:35:36.286410 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 763/1643] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:35:36.465440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:36.469449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:36.514648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:36.522998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:36.523792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:36.525713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:36.541333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:36.544368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:36.723802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:36.725910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:36.730050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:36.730843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lazy-loading 'fault' on Instance uuid fde6f25d-de52-4758-85c7-ce0b8471e481 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:35:36.976958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:37.012093 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-92b4f595-d205-42fb-bbbd-31a2c79a663b tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1369 microversion: 2.1 time: 0.566527 Aug 27 02:35:37.022341 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 764/1644] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:36 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1369 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:35:37.124102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:35:37.126817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:35:37.128064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:35:37.129658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:35:37.130821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:35:37.151460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:37.152656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:37.153637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:37.156196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:37.157505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:37.161530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:37.208783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Getting quotas for project 4d2da2e10e53450096a68048f98bd99a. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:35:37.216657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Getting quotas for user 4cf03330b076434098eef9230222830e and project 4d2da2e10e53450096a68048f98bd99a. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:35:37.234067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:35:37.240356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:35:37.359448 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bab1a3fb-7f43-4040-be3d-a60728af5ed5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.25 time: 3.081957 Aug 27 02:35:37.365250 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 881/1645] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:35:34 2022] POST /compute/v2.1/servers => generated 403 bytes in 3096 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 02:35:37.380225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-76071cc7-2bed-4baf-8fb8-702a1c5fd536 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:37.417310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-76071cc7-2bed-4baf-8fb8-702a1c5fd536 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:37.571972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-76071cc7-2bed-4baf-8fb8-702a1c5fd536 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:37.589243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-76071cc7-2bed-4baf-8fb8-702a1c5fd536 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:37.609380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-76071cc7-2bed-4baf-8fb8-702a1c5fd536 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:37.609380 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-76071cc7-2bed-4baf-8fb8-702a1c5fd536 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1286 microversion: 2.25 time: 0.233171 Aug 27 02:35:37.618980 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 765/1646] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:37 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1286 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:35:38.069110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:38.069793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:38.097265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:38.097883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:38.098347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:38.110162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:38.110683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:38.111136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:38.295464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:38.297637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:38.299193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:38.300298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lazy-loading 'fault' on Instance uuid fde6f25d-de52-4758-85c7-ce0b8471e481 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:35:38.414257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:38.458974 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e1a454d2-c75a-49e7-ab5c-47c6bb3f84a2 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 200 len: 1369 microversion: 2.1 time: 0.397223 Aug 27 02:35:38.462752 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 882/1647] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:38 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 1369 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:38.647888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74bafd82-3d38-40d8-b778-391523c4bc6f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:38.649066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-74bafd82-3d38-40d8-b778-391523c4bc6f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:38.861225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-74bafd82-3d38-40d8-b778-391523c4bc6f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:38.877448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-74bafd82-3d38-40d8-b778-391523c4bc6f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:38.882650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-74bafd82-3d38-40d8-b778-391523c4bc6f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:38.885487 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-74bafd82-3d38-40d8-b778-391523c4bc6f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1286 microversion: 2.25 time: 0.243368 Aug 27 02:35:38.886860 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 766/1648] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:38 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1286 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:39.490970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:39.491950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: fde6f25d-de52-4758-85c7-ce0b8471e481] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:39.508572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:39.510403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:39.512215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:39.514904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:39.516156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:39.518643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:39.578474 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] HTTP exception thrown: Instance fde6f25d-de52-4758-85c7-ce0b8471e481 could not be found. Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Request method failure captured: Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 HTTP/1.1 Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFtDBmGq83eNu1qqEhAPqwq-xcey7d4jWftjR0_efTYRY6I2GEMLeT4SahTzZjj4gE-g8SlhSKONok7wQazsgC2-2lg0Qm1eOO8ZvVcPz9NouTWJ5O44htsOt8k-h61R6ZH4TETHbfOHsJs8K-LfhvS6OAjBAzEzNhynP8kjulEeW0 Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a547cdcaa55b41f8865fac16ef8fd99c Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a547cdcaa55b41f8865fac16ef8fd99c"}]}] Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a547cdcaa55b41f8865fac16ef8fd99c Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-MigrationsAdminTest-1693558053-project Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: d1624ef00b144dafbaff7ae5c677e7a3 Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-MigrationsAdminTest-1693558053-project Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance fde6f25d-de52-4758-85c7-ce0b8471e481 could not be found. Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'fde6f25d-de52-4758-85c7-ce0b8471e481'} Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde6f25d-de52-4758-85c7-ce0b8471e481 could not be found. Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde6f25d-de52-4758-85c7-ce0b8471e481 could not be found. Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:35:39.584198 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:39.598162 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:39.598162 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:35:39.598162 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:35:39.598162 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:35:39.598162 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:35:39.598162 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde6f25d-de52-4758-85c7-ce0b8471e481 could not be found. Aug 27 02:35:39.598162 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:39.602964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Returning 404 to user: Instance fde6f25d-de52-4758-85c7-ce0b8471e481 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:35:39.604894 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e8145c73-5b0b-4519-8f40-f6567b12753d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481" status: 404 len: 111 microversion: 2.1 time: 0.123435 Aug 27 02:35:39.606752 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 883/1649] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:39 2022] GET /compute/v2.1/servers/fde6f25d-de52-4758-85c7-ce0b8471e481 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:35:39.618842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a5363a9-6766-42fa-8520-b1c379f7618d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '.version_select at 0x7f4d2a5c6b80>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:39.648183 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a5363a9-6766-42fa-8520-b1c379f7618d tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1543107572" status: 202 len: 0 microversion: 2.1 time: 0.032572 Aug 27 02:35:39.650989 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 767/1650] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:35:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1543107572 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:35:39.937552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:39.938769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:39.967202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:39.968106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:39.968922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:39.970289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:39.971126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:39.971893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:40.159639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:40.196517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:40.217712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:40.220812 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7c5149bf-a3dc-4953-a67b-7afbf3aec0e8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1346 microversion: 2.25 time: 0.294991 Aug 27 02:35:40.223795 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 884/1651] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:39 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1346 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:40.755495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a3d275d1-a1ee-4f4e-add4-05cda2de9776 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:40.760633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a3d275d1-a1ee-4f4e-add4-05cda2de9776 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:40.776953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d275d1-a1ee-4f4e-add4-05cda2de9776 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:40.778097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d275d1-a1ee-4f4e-add4-05cda2de9776 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:40.778714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d275d1-a1ee-4f4e-add4-05cda2de9776 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:40.779686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d275d1-a1ee-4f4e-add4-05cda2de9776 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:40.780556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d275d1-a1ee-4f4e-add4-05cda2de9776 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:40.781166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d275d1-a1ee-4f4e-add4-05cda2de9776 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:41.248681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:41.250621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:41.267225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:41.268039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:41.268769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:41.270807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:41.271818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:41.272488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:41.325492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a3d275d1-a1ee-4f4e-add4-05cda2de9776 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:41.369712 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a3d275d1-a1ee-4f4e-add4-05cda2de9776 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.630611 Aug 27 02:35:41.372282 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 768/1652] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:40 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:41.418502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bc9aa32e-6245-4143-95d4-a66f9943d3ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:41.421029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bc9aa32e-6245-4143-95d4-a66f9943d3ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:41.433915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc9aa32e-6245-4143-95d4-a66f9943d3ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:41.434427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc9aa32e-6245-4143-95d4-a66f9943d3ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:41.434881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc9aa32e-6245-4143-95d4-a66f9943d3ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:41.436606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc9aa32e-6245-4143-95d4-a66f9943d3ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:41.437939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc9aa32e-6245-4143-95d4-a66f9943d3ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:41.439133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc9aa32e-6245-4143-95d4-a66f9943d3ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:41.455863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:41.484022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:41.488110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:41.492013 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f90f6c11-8400-4877-a314-198d2603d5a3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1344 microversion: 2.25 time: 0.246860 Aug 27 02:35:41.497918 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 885/1653] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:41 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1344 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:41.590000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bfed16b7-9c54-4863-8b96-00d34dedf0ed tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:41.590862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bfed16b7-9c54-4863-8b96-00d34dedf0ed tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:41.614562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfed16b7-9c54-4863-8b96-00d34dedf0ed tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:41.617309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfed16b7-9c54-4863-8b96-00d34dedf0ed tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:41.618640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfed16b7-9c54-4863-8b96-00d34dedf0ed tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:41.619576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfed16b7-9c54-4863-8b96-00d34dedf0ed tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:41.620083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfed16b7-9c54-4863-8b96-00d34dedf0ed tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:41.620506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfed16b7-9c54-4863-8b96-00d34dedf0ed tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:41.656466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bfed16b7-9c54-4863-8b96-00d34dedf0ed tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:35:41.805272 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bfed16b7-9c54-4863-8b96-00d34dedf0ed tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "DELETE /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 204 len: 0 microversion: 2.1 time: 0.222666 Aug 27 02:35:41.809023 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 886/1654] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:35:41 2022] DELETE /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:35:41.832886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cf9de0f9-2341-4007-ad2d-ad53c3954764 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:41.833740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cf9de0f9-2341-4007-ad2d-ad53c3954764 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:41.854932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf9de0f9-2341-4007-ad2d-ad53c3954764 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:41.855444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf9de0f9-2341-4007-ad2d-ad53c3954764 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:41.858760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf9de0f9-2341-4007-ad2d-ad53c3954764 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:41.859813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf9de0f9-2341-4007-ad2d-ad53c3954764 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:41.860315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf9de0f9-2341-4007-ad2d-ad53c3954764 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:41.860765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf9de0f9-2341-4007-ad2d-ad53c3954764 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:41.979668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bc9aa32e-6245-4143-95d4-a66f9943d3ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:41.994426 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bc9aa32e-6245-4143-95d4-a66f9943d3ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.581128 Aug 27 02:35:41.997190 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 769/1655] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:41 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:42.035219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-853e01b1-c312-4e07-b85c-b6cc9b3edfe1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:42.035998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-853e01b1-c312-4e07-b85c-b6cc9b3edfe1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:42.070126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-853e01b1-c312-4e07-b85c-b6cc9b3edfe1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:42.070647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-853e01b1-c312-4e07-b85c-b6cc9b3edfe1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:42.077331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-853e01b1-c312-4e07-b85c-b6cc9b3edfe1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:42.079298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-853e01b1-c312-4e07-b85c-b6cc9b3edfe1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:42.080116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-853e01b1-c312-4e07-b85c-b6cc9b3edfe1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:42.080581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-853e01b1-c312-4e07-b85c-b6cc9b3edfe1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:42.238833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cf9de0f9-2341-4007-ad2d-ad53c3954764 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:42.257950 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cf9de0f9-2341-4007-ad2d-ad53c3954764 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1467 microversion: 2.1 time: 0.440650 Aug 27 02:35:42.260390 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 887/1656] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:41 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1467 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:42.623178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-846876441", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a026c8e1-de2c-4626-b12f-fbb665b2a19a"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:42.663751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-853e01b1-c312-4e07-b85c-b6cc9b3edfe1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:42.675405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:42.710446 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-853e01b1-c312-4e07-b85c-b6cc9b3edfe1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.681191 Aug 27 02:35:42.718006 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 770/1657] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:42 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:42.766755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:42.767808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:42.802627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:42.808680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:42.809820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:42.813974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:42.815594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:42.816300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:42.854087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] validate_networks() for [('a026c8e1-de2c-4626-b12f-fbb665b2a19a', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:35:43.365205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:43.382287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:43.386324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:43.388880 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-378a2a29-5637-49d5-8b0e-c7797ba1981a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1409 microversion: 2.25 time: 0.668714 Aug 27 02:35:43.390419 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 771/1658] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:42 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1409 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:43.400530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-500c714c-eeb7-45c2-b797-692edeb3ea53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1882401011"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:43.405128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-500c714c-eeb7-45c2-b797-692edeb3ea53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:43.416872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-500c714c-eeb7-45c2-b797-692edeb3ea53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:43.418089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-500c714c-eeb7-45c2-b797-692edeb3ea53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:43.419130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-500c714c-eeb7-45c2-b797-692edeb3ea53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:43.420634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-500c714c-eeb7-45c2-b797-692edeb3ea53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:43.421698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-500c714c-eeb7-45c2-b797-692edeb3ea53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:43.422687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-500c714c-eeb7-45c2-b797-692edeb3ea53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:43.936318 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-500c714c-eeb7-45c2-b797-692edeb3ea53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.543028 Aug 27 02:35:43.963883 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 772/1659] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:35:43 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 02:35:44.045706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fc684ac6-41ec-4d62-bb6b-7a373bc00e48 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:44.053872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fc684ac6-41ec-4d62-bb6b-7a373bc00e48 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:44.098120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc684ac6-41ec-4d62-bb6b-7a373bc00e48 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:44.099632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc684ac6-41ec-4d62-bb6b-7a373bc00e48 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:44.105468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc684ac6-41ec-4d62-bb6b-7a373bc00e48 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:44.110232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc684ac6-41ec-4d62-bb6b-7a373bc00e48 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:44.112622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc684ac6-41ec-4d62-bb6b-7a373bc00e48 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:44.118720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc684ac6-41ec-4d62-bb6b-7a373bc00e48 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:44.337582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:35:44.338261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:35:44.338714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:35:44.339451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:35:44.339872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:35:44.358833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:44.359971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:44.360657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:44.361927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:44.363101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:44.363875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:44.411524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Getting quotas for project b94125c73a7244d498e0665504bbfd27. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:35:44.421706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Getting quotas for user 523a44993f39483698de40b10984c854 and project b94125c73a7244d498e0665504bbfd27. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:35:44.440150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:35:44.443436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:35:44.559785 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-95ff274f-9f5e-4232-a65f-286774608e57 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.296962 Aug 27 02:35:44.562096 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 888/1660] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:35:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:35:44.580251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-74dbff23-d34a-45e8-b4be-f7574579e9ef req-5254133b-cb7b-4672-be5f-20927e1c88fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099723a4-8d6a-4f11-9e89-cde00fbdbdf6", "tag": "d0e84c9b-db44-407d-9fe2-65f84a836cbb"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:44.604987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-74dbff23-d34a-45e8-b4be-f7574579e9ef req-5254133b-cb7b-4672-be5f-20927e1c88fd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:44.605891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-74dbff23-d34a-45e8-b4be-f7574579e9ef req-5254133b-cb7b-4672-be5f-20927e1c88fd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:44.606677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-74dbff23-d34a-45e8-b4be-f7574579e9ef req-5254133b-cb7b-4672-be5f-20927e1c88fd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:44.641989 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-74dbff23-d34a-45e8-b4be-f7574579e9ef req-5254133b-cb7b-4672-be5f-20927e1c88fd service nova] Creating event network-changed:d0e84c9b-db44-407d-9fe2-65f84a836cbb for instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 on n-h1-852084-5 Aug 27 02:35:44.652481 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-74dbff23-d34a-45e8-b4be-f7574579e9ef req-5254133b-cb7b-4672-be5f-20927e1c88fd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087676 Aug 27 02:35:44.654076 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 889/1661] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:44.666277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:44.668364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:44.692706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:44.696312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:44.697176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:44.715084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:44.727095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:44.729153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:44.918337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fc684ac6-41ec-4d62-bb6b-7a373bc00e48 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:44.955898 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fc684ac6-41ec-4d62-bb6b-7a373bc00e48 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1467 microversion: 2.1 time: 0.985220 Aug 27 02:35:44.957199 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 773/1662] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:43 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1467 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:44.983389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1319285070", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a026c8e1-de2c-4626-b12f-fbb665b2a19a"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:45.234578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] validate_networks() for [('a026c8e1-de2c-4626-b12f-fbb665b2a19a', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:35:45.693137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:45.721876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:45.727100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:45.731265 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0cde8233-12bb-4dca-8da4-485d0448c04f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1409 microversion: 2.25 time: 1.075074 Aug 27 02:35:45.747088 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 890/1663] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:44 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1409 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:45.990728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8b7f9669-9590-4850-9ada-c0f089f62240 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:45.997423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8b7f9669-9590-4850-9ada-c0f089f62240 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:46.022614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b7f9669-9590-4850-9ada-c0f089f62240 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:46.027404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b7f9669-9590-4850-9ada-c0f089f62240 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:46.033098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b7f9669-9590-4850-9ada-c0f089f62240 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:46.037729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b7f9669-9590-4850-9ada-c0f089f62240 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:46.041183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b7f9669-9590-4850-9ada-c0f089f62240 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:46.043918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b7f9669-9590-4850-9ada-c0f089f62240 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:46.416474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:35:46.417105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:35:46.418725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:35:46.419194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:35:46.419622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:35:46.461553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:46.466739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:46.467392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:46.468383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:46.469031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:46.469709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:46.513844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Getting quotas for project b94125c73a7244d498e0665504bbfd27. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:35:46.520811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Getting quotas for user 523a44993f39483698de40b10984c854 and project b94125c73a7244d498e0665504bbfd27. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:35:46.536332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:35:46.539002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: cd064beb-dd01-45e4-ba62-4bc863fd9ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:35:46.548856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8b7f9669-9590-4850-9ada-c0f089f62240 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:46.598007 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8b7f9669-9590-4850-9ada-c0f089f62240 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1425 microversion: 2.1 time: 0.621327 Aug 27 02:35:46.626412 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 891/1664] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:45 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1425 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:46.640054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b14d377c-1806-4216-b65e-768d9a49b276 req-b04419c7-b381-4a86-87ef-7e3a36ebc7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d1eeab-d777-433e-b23b-1d6bd540823d", "name": "network-vif-deleted", "tag": "8fe72264-a971-4067-8e10-b097ab827266"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:46.661925 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6253c122-5d0a-42b0-98cf-a29e1df79cb6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.694182 Aug 27 02:35:46.663208 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 774/1665] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:35:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:35:46.707422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b14d377c-1806-4216-b65e-768d9a49b276 req-b04419c7-b381-4a86-87ef-7e3a36ebc7c6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:46.708277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b14d377c-1806-4216-b65e-768d9a49b276 req-b04419c7-b381-4a86-87ef-7e3a36ebc7c6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:46.708486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b14d377c-1806-4216-b65e-768d9a49b276 req-b04419c7-b381-4a86-87ef-7e3a36ebc7c6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:46.755129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:46.755777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:46.777864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:46.781541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:46.782031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:46.782802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:46.783275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:46.783713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:46.792274 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b14d377c-1806-4216-b65e-768d9a49b276 req-b04419c7-b381-4a86-87ef-7e3a36ebc7c6 service nova] Creating event network-vif-deleted:8fe72264-a971-4067-8e10-b097ab827266 for instance 91d1eeab-d777-433e-b23b-1d6bd540823d on n-h2-852084-5 Aug 27 02:35:46.807486 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b14d377c-1806-4216-b65e-768d9a49b276 req-b04419c7-b381-4a86-87ef-7e3a36ebc7c6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175933 Aug 27 02:35:46.809513 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 892/1666] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:46.829144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-101679733", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "451", "networks": [{"uuid": "a026c8e1-de2c-4626-b12f-fbb665b2a19a"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:46.984375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] validate_networks() for [('a026c8e1-de2c-4626-b12f-fbb665b2a19a', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:35:47.237365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:47.255583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:47.257359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:47.269487 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a468c49c-13a0-4606-b80f-eafaa48e006d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1409 microversion: 2.25 time: 0.507715 Aug 27 02:35:47.271772 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 775/1667] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:46 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1409 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:47.640213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:47.640835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:47.659666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:47.660284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:47.662348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:47.681360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:47.682397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:47.682872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:47.817545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:47.822505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:47.823650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:47.826190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lazy-loading 'fault' on Instance uuid 91d1eeab-d777-433e-b23b-1d6bd540823d {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:35:47.986746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:48.022009 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a0e246a0-d930-4c8e-a1f8-fd34179b9a53 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 200 len: 1302 microversion: 2.1 time: 0.386743 Aug 27 02:35:48.025182 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 776/1668] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:47 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 1302 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:48.222741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:35:48.225489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:35:48.226473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:35:48.227677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:35:48.229314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:35:48.326848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:48.328201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:48.331089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:48.338558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:48.345465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:48.346413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:48.349818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:48.353009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:48.353904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:48.357098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:48.360406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:48.385545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:48.388137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:48.396631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:48.542752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Getting quotas for project b94125c73a7244d498e0665504bbfd27. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:35:48.587008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Getting quotas for user 523a44993f39483698de40b10984c854 and project b94125c73a7244d498e0665504bbfd27. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:35:48.638362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:35:48.641003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:35:48.874036 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2b5fda42-ad5e-4165-a59d-5fb693aba32a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.048224 Aug 27 02:35:48.875810 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 893/1669] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:35:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:35:48.912351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-31bf00b6-9885-40b1-850e-fa0dba44eba6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:48.922586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-31bf00b6-9885-40b1-850e-fa0dba44eba6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:49.161444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:49.193002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:49.205435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:49.206801 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a067c1cc-a21b-43c6-9828-fd376052ae2f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1409 microversion: 2.25 time: 0.886756 Aug 27 02:35:49.214540 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 777/1670] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:48 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1409 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:49.232973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:49.234071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 91d1eeab-d777-433e-b23b-1d6bd540823d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:49.278887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:49.280576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:49.282176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:49.284862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:49.287188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:49.287695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:49.337304 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] HTTP exception thrown: Instance 91d1eeab-d777-433e-b23b-1d6bd540823d could not be found. Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Request method failure captured: Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d HTTP/1.1 Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYFtDBmGq83eNu1qqEhAPqwq-xcey7d4jWftjR0_efTYRY6I2GEMLeT4SahTzZjj4gE-g8SlhSKONok7wQazsgC2-2lg0Qm1eOO8ZvVcPz9NouTWJ5O44htsOt8k-h61R6ZH4TETHbfOHsJs8K-LfhvS6OAjBAzEzNhynP8kjulEeW0 Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: a547cdcaa55b41f8865fac16ef8fd99c Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a547cdcaa55b41f8865fac16ef8fd99c"}]}] Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: a547cdcaa55b41f8865fac16ef8fd99c Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-MigrationsAdminTest-1693558053-project Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d1624ef00b144dafbaff7ae5c677e7a3 Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-MigrationsAdminTest-1693558053-project Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 91d1eeab-d777-433e-b23b-1d6bd540823d could not be found. Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '91d1eeab-d777-433e-b23b-1d6bd540823d'} Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d1eeab-d777-433e-b23b-1d6bd540823d could not be found. Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d1eeab-d777-433e-b23b-1d6bd540823d could not be found. Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:35:49.339375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:35:49.349454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:49.349454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:35:49.349454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:35:49.349454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:35:49.349454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:35:49.349454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d1eeab-d777-433e-b23b-1d6bd540823d could not be found. Aug 27 02:35:49.349454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:35:49.349454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Returning 404 to user: Instance 91d1eeab-d777-433e-b23b-1d6bd540823d could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:35:49.349454 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-876a23e7-7050-477d-b41a-4cf227476fae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d" status: 404 len: 111 microversion: 2.1 time: 0.130109 Aug 27 02:35:49.349454 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 778/1671] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:49 2022] GET /compute/v2.1/servers/91d1eeab-d777-433e-b23b-1d6bd540823d => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:35:49.375528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-923a1037-2239-4df3-9b59-2c85c08908ae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:49.376041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-923a1037-2239-4df3-9b59-2c85c08908ae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:49.399777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923a1037-2239-4df3-9b59-2c85c08908ae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:49.400327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923a1037-2239-4df3-9b59-2c85c08908ae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:49.404066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923a1037-2239-4df3-9b59-2c85c08908ae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:49.408848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923a1037-2239-4df3-9b59-2c85c08908ae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:49.409360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923a1037-2239-4df3-9b59-2c85c08908ae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:49.409848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-923a1037-2239-4df3-9b59-2c85c08908ae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:49.492739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-923a1037-2239-4df3-9b59-2c85c08908ae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:35:49.695222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-923a1037-2239-4df3-9b59-2c85c08908ae tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 204 len: 0 microversion: 2.1 time: 0.333535 Aug 27 02:35:49.703024 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 779/1672] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:35:49 2022] DELETE /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:35:49.711574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-894505ee-2745-4125-9123-c1af76ac7dcb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:49.715497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-894505ee-2745-4125-9123-c1af76ac7dcb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:49.739294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-894505ee-2745-4125-9123-c1af76ac7dcb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:49.741612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-894505ee-2745-4125-9123-c1af76ac7dcb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:49.746596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-894505ee-2745-4125-9123-c1af76ac7dcb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:49.749041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-894505ee-2745-4125-9123-c1af76ac7dcb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:49.750429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-894505ee-2745-4125-9123-c1af76ac7dcb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:49.751337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-894505ee-2745-4125-9123-c1af76ac7dcb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:50.000303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-31bf00b6-9885-40b1-850e-fa0dba44eba6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:50.047135 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-31bf00b6-9885-40b1-850e-fa0dba44eba6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1220 microversion: 2.1 time: 1.138149 Aug 27 02:35:50.047135 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 894/1673] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:48 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1220 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:50.202456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-894505ee-2745-4125-9123-c1af76ac7dcb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:50.230429 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-894505ee-2745-4125-9123-c1af76ac7dcb tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1469 microversion: 2.1 time: 0.522388 Aug 27 02:35:50.231105 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 780/1674] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:49 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1469 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:50.261887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:50.269386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:50.294915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:50.296027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:50.297009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:50.303439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:50.304849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:50.306191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:51.094701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-59f9e873-7b28-492b-99c9-c1805f0df5a1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:51.096218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-59f9e873-7b28-492b-99c9-c1805f0df5a1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:51.122553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59f9e873-7b28-492b-99c9-c1805f0df5a1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:51.123778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59f9e873-7b28-492b-99c9-c1805f0df5a1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:51.128370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59f9e873-7b28-492b-99c9-c1805f0df5a1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:51.129428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59f9e873-7b28-492b-99c9-c1805f0df5a1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:51.143844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59f9e873-7b28-492b-99c9-c1805f0df5a1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:51.145357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59f9e873-7b28-492b-99c9-c1805f0df5a1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:51.380002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:51.418989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:51.427945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:51.433861 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ef1a84a3-eccb-4699-926b-8ef67015e5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1409 microversion: 2.25 time: 1.177433 Aug 27 02:35:51.452417 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 895/1675] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:50 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1409 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:51.467023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b5bf83d9-6e8e-4463-8510-2480ed454136 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:51.467737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b5bf83d9-6e8e-4463-8510-2480ed454136 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:51.486821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bf83d9-6e8e-4463-8510-2480ed454136 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:51.487314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bf83d9-6e8e-4463-8510-2480ed454136 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:51.490929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bf83d9-6e8e-4463-8510-2480ed454136 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:51.494984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bf83d9-6e8e-4463-8510-2480ed454136 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:51.502170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bf83d9-6e8e-4463-8510-2480ed454136 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:51.503806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bf83d9-6e8e-4463-8510-2480ed454136 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:51.815395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-59f9e873-7b28-492b-99c9-c1805f0df5a1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:51.833540 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-59f9e873-7b28-492b-99c9-c1805f0df5a1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1216 microversion: 2.1 time: 0.742973 Aug 27 02:35:51.851793 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 781/1676] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:51 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1216 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:52.356008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b5bf83d9-6e8e-4463-8510-2480ed454136 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:52.386003 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b5bf83d9-6e8e-4463-8510-2480ed454136 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1469 microversion: 2.1 time: 0.932061 Aug 27 02:35:52.396987 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 896/1677] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:51 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1469 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:52.465463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:52.466548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:52.507539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:52.511842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:52.517845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:52.524669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:52.525729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:52.529035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:52.888625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7931ad5a-23c4-42df-a328-ca76bf39bc96 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:52.895327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7931ad5a-23c4-42df-a328-ca76bf39bc96 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:52.942742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7931ad5a-23c4-42df-a328-ca76bf39bc96 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:52.943697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7931ad5a-23c4-42df-a328-ca76bf39bc96 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:52.944354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7931ad5a-23c4-42df-a328-ca76bf39bc96 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:52.951177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7931ad5a-23c4-42df-a328-ca76bf39bc96 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:52.969487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7931ad5a-23c4-42df-a328-ca76bf39bc96 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:52.978991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7931ad5a-23c4-42df-a328-ca76bf39bc96 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:53.072207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:53.436387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:53.456438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:53.472895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:53.477814 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b1a16d2b-9cbb-4816-9467-2b010133606e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1409 microversion: 2.25 time: 1.019096 Aug 27 02:35:53.489813 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 782/1678] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:52 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1409 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:53.489813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3eba0967-175c-49fd-8f05-a7de5ef7f0df req-258b4da8-9451-4a1d-9d8b-c69aac17e04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59462ca6-1830-4fae-a141-ffade28879f6", "name": "network-vif-plugged", "status": "completed", "tag": "b9a18ca7-1e41-4aa3-9c64-1d916f180dce"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:53.531336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3eba0967-175c-49fd-8f05-a7de5ef7f0df req-258b4da8-9451-4a1d-9d8b-c69aac17e04d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:53.532200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3eba0967-175c-49fd-8f05-a7de5ef7f0df req-258b4da8-9451-4a1d-9d8b-c69aac17e04d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:53.532754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3eba0967-175c-49fd-8f05-a7de5ef7f0df req-258b4da8-9451-4a1d-9d8b-c69aac17e04d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:53.554416 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3eba0967-175c-49fd-8f05-a7de5ef7f0df req-258b4da8-9451-4a1d-9d8b-c69aac17e04d service nova] Creating event network-vif-plugged:b9a18ca7-1e41-4aa3-9c64-1d916f180dce for instance 59462ca6-1830-4fae-a141-ffade28879f6 on n-h1-852084-5 Aug 27 02:35:53.572367 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3eba0967-175c-49fd-8f05-a7de5ef7f0df req-258b4da8-9451-4a1d-9d8b-c69aac17e04d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080278 Aug 27 02:35:53.574419 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 783/1679] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:53.581558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7931ad5a-23c4-42df-a328-ca76bf39bc96 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:53.598647 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7931ad5a-23c4-42df-a328-ca76bf39bc96 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1278 microversion: 2.1 time: 0.745789 Aug 27 02:35:53.599318 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 897/1680] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:52 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1278 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:53.620531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e86dc4d9-1241-4278-8ba8-9cfa66187976 req-09eb2f04-62b0-4d7d-b8a8-027ed42ddcea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6596fe05-cc54-4bf2-8180-4a201ebdad1c", "name": "network-vif-deleted", "tag": "89e9571f-0605-4282-a2a4-cad646e275d8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:53.640268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:53.642604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:53.666634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:53.671312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:53.672479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e86dc4d9-1241-4278-8ba8-9cfa66187976 req-09eb2f04-62b0-4d7d-b8a8-027ed42ddcea service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:53.673627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:53.674363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e86dc4d9-1241-4278-8ba8-9cfa66187976 req-09eb2f04-62b0-4d7d-b8a8-027ed42ddcea service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:53.676382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:53.677231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e86dc4d9-1241-4278-8ba8-9cfa66187976 req-09eb2f04-62b0-4d7d-b8a8-027ed42ddcea service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:53.679850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:53.684808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:53.710367 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e86dc4d9-1241-4278-8ba8-9cfa66187976 req-09eb2f04-62b0-4d7d-b8a8-027ed42ddcea service nova] Creating event network-vif-deleted:89e9571f-0605-4282-a2a4-cad646e275d8 for instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c on n-h2-852084-5 Aug 27 02:35:53.734282 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e86dc4d9-1241-4278-8ba8-9cfa66187976 req-09eb2f04-62b0-4d7d-b8a8-027ed42ddcea service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142663 Aug 27 02:35:53.736068 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 784/1681] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:35:53.774184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:53.775819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:53.776944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:53.778136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lazy-loading 'fault' on Instance uuid 6596fe05-cc54-4bf2-8180-4a201ebdad1c {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:35:54.383935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1624ef00b144dafbaff7ae5c677e7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a547cdcaa55b41f8865fac16ef8fd99c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:54.423471 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e9247025-c377-4e3c-97b6-65ea7f0ee745 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 200 len: 1303 microversion: 2.1 time: 0.792844 Aug 27 02:35:54.443512 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 898/1682] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:53 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 1303 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:54.526286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:54.527845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:54.555543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:54.560227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:54.575958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:54.582198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:54.583422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:54.586778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:54.621110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5069e666-b664-4f33-ab71-8de5fae9311e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:54.622597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5069e666-b664-4f33-ab71-8de5fae9311e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:54.626207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:54.643459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5069e666-b664-4f33-ab71-8de5fae9311e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:54.647298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5069e666-b664-4f33-ab71-8de5fae9311e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:54.647896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5069e666-b664-4f33-ab71-8de5fae9311e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:54.650876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5069e666-b664-4f33-ab71-8de5fae9311e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:54.651604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5069e666-b664-4f33-ab71-8de5fae9311e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:54.666115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5069e666-b664-4f33-ab71-8de5fae9311e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:55.118229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5069e666-b664-4f33-ab71-8de5fae9311e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:55.141502 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5069e666-b664-4f33-ab71-8de5fae9311e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1278 microversion: 2.1 time: 0.524226 Aug 27 02:35:55.143624 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 899/1683] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:54 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1278 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:55.451725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:55.452815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] [instance: 6596fe05-cc54-4bf2-8180-4a201ebdad1c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:55.464423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:55.464939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:55.465432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:55.491275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:55.492234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:55.492927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:55.540547 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] HTTP exception thrown: Instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c could not be found. Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Request method failure captured: Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c HTTP/1.1 Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYFtDBmGq83eNu1qqEhAPqwq-xcey7d4jWftjR0_efTYRY6I2GEMLeT4SahTzZjj4gE-g8SlhSKONok7wQazsgC2-2lg0Qm1eOO8ZvVcPz9NouTWJ5O44htsOt8k-h61R6ZH4TETHbfOHsJs8K-LfhvS6OAjBAzEzNhynP8kjulEeW0 Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a547cdcaa55b41f8865fac16ef8fd99c Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a547cdcaa55b41f8865fac16ef8fd99c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a547cdcaa55b41f8865fac16ef8fd99c"}]}] Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a547cdcaa55b41f8865fac16ef8fd99c Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-MigrationsAdminTest-1693558053 Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-MigrationsAdminTest-1693558053-project Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: d1624ef00b144dafbaff7ae5c677e7a3 Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-MigrationsAdminTest-1693558053-project Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c could not be found. Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '6596fe05-cc54-4bf2-8180-4a201ebdad1c'} Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c could not be found. Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c could not be found. Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:35:55.543553 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:55.549338 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:35:55.549338 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:35:55.549338 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:35:55.549338 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:35:55.549338 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:35:55.549338 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c could not be found. Aug 27 02:35:55.549338 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:35:55.558062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] Returning 404 to user: Instance 6596fe05-cc54-4bf2-8180-4a201ebdad1c could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:35:55.559693 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bc1aac94-093e-4948-b2a3-55bf5af02439 tempest-MigrationsAdminTest-1693558053 tempest-MigrationsAdminTest-1693558053-project] 10.222.0.99 "GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c" status: 404 len: 111 microversion: 2.1 time: 0.112564 Aug 27 02:35:55.560827 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 900/1684] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:55 2022] GET /compute/v2.1/servers/6596fe05-cc54-4bf2-8180-4a201ebdad1c => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:35:55.699502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:55.713163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:55.722228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:55.723947 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d16daf5b-35d3-4fa0-a990-c05d811a40e0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1409 microversion: 2.25 time: 1.219922 Aug 27 02:35:55.744579 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 785/1685] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:54 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1409 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:55.882099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-0f498fc7-7ce3-4fdd-ad30-a4732eaba294 req-24bbc2c4-83f0-4ec3-a8fe-2eaf7c6bcc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "099723a4-8d6a-4f11-9e89-cde00fbdbdf6", "name": "network-vif-plugged", "status": "completed", "tag": "d0e84c9b-db44-407d-9fe2-65f84a836cbb"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:55.925444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0f498fc7-7ce3-4fdd-ad30-a4732eaba294 req-24bbc2c4-83f0-4ec3-a8fe-2eaf7c6bcc0b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:55.926647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0f498fc7-7ce3-4fdd-ad30-a4732eaba294 req-24bbc2c4-83f0-4ec3-a8fe-2eaf7c6bcc0b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:55.927599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0f498fc7-7ce3-4fdd-ad30-a4732eaba294 req-24bbc2c4-83f0-4ec3-a8fe-2eaf7c6bcc0b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:55.973601 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-0f498fc7-7ce3-4fdd-ad30-a4732eaba294 req-24bbc2c4-83f0-4ec3-a8fe-2eaf7c6bcc0b service nova] Creating event network-vif-plugged:d0e84c9b-db44-407d-9fe2-65f84a836cbb for instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 on n-h1-852084-5 Aug 27 02:35:56.003578 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-0f498fc7-7ce3-4fdd-ad30-a4732eaba294 req-24bbc2c4-83f0-4ec3-a8fe-2eaf7c6bcc0b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122382 Aug 27 02:35:56.005315 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 901/1686] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 02:35:56.196523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b59d0347-b40c-40e4-95d8-5a89de96fa72 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:56.202212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b59d0347-b40c-40e4-95d8-5a89de96fa72 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:56.245525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b59d0347-b40c-40e4-95d8-5a89de96fa72 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:56.252367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b59d0347-b40c-40e4-95d8-5a89de96fa72 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:56.255930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b59d0347-b40c-40e4-95d8-5a89de96fa72 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:56.260565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b59d0347-b40c-40e4-95d8-5a89de96fa72 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:56.264962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b59d0347-b40c-40e4-95d8-5a89de96fa72 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:56.266359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b59d0347-b40c-40e4-95d8-5a89de96fa72 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:56.500437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:56.532372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=14 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:56.545027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b59d0347-b40c-40e4-95d8-5a89de96fa72 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:56.572871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:56.595763 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b59d0347-b40c-40e4-95d8-5a89de96fa72 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1278 microversion: 2.1 time: 0.430549 Aug 27 02:35:56.597227 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 786/1687] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:56 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1278 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:35:56.767072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:56.768718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:56.803585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:56.805322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:56.806639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:56.808262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:56.809353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:56.810341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:57.291249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:57.314345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:57.328361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:57.330666 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1996b8b5-5e54-41d7-8639-3d766b67c149 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1409 microversion: 2.25 time: 0.582818 Aug 27 02:35:57.334581 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 902/1688] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:56 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1409 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:57.621029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb605a5c-0834-4e6d-8320-ea43f8bacce2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:57.621922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb605a5c-0834-4e6d-8320-ea43f8bacce2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:57.642022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb605a5c-0834-4e6d-8320-ea43f8bacce2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:57.642530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb605a5c-0834-4e6d-8320-ea43f8bacce2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:57.642975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb605a5c-0834-4e6d-8320-ea43f8bacce2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:57.643701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb605a5c-0834-4e6d-8320-ea43f8bacce2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:57.644164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb605a5c-0834-4e6d-8320-ea43f8bacce2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:57.651827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb605a5c-0834-4e6d-8320-ea43f8bacce2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:58.281627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb605a5c-0834-4e6d-8320-ea43f8bacce2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:58.301506 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb605a5c-0834-4e6d-8320-ea43f8bacce2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1320 microversion: 2.1 time: 0.681809 Aug 27 02:35:58.315518 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 787/1689] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:57 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1320 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:35:58.379355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:58.381719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:58.413437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:58.415728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:58.418944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:58.420847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:58.422110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:58.423487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:58.501236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:35:59.121363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-1c8fa792-cf91-434e-94ea-76ac953e1832 req-898d50bf-5d7c-4a10-a62b-0fd64b21e0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd064beb-dd01-45e4-ba62-4bc863fd9ca9", "tag": "02f0cf52-1193-4bd8-b086-2cb4a4bd27a3"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:35:59.144067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1c8fa792-cf91-434e-94ea-76ac953e1832 req-898d50bf-5d7c-4a10-a62b-0fd64b21e0d0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:59.150105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1c8fa792-cf91-434e-94ea-76ac953e1832 req-898d50bf-5d7c-4a10-a62b-0fd64b21e0d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:59.151000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1c8fa792-cf91-434e-94ea-76ac953e1832 req-898d50bf-5d7c-4a10-a62b-0fd64b21e0d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:59.181806 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1c8fa792-cf91-434e-94ea-76ac953e1832 req-898d50bf-5d7c-4a10-a62b-0fd64b21e0d0 service nova] Creating event network-changed:02f0cf52-1193-4bd8-b086-2cb4a4bd27a3 for instance cd064beb-dd01-45e4-ba62-4bc863fd9ca9 on n-h1-852084-5 Aug 27 02:35:59.201969 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-1c8fa792-cf91-434e-94ea-76ac953e1832 req-898d50bf-5d7c-4a10-a62b-0fd64b21e0d0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085194 Aug 27 02:35:59.202774 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 788/1690] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:35:59.327860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88ff7d61-8461-4e53-9743-54c256e8184a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:59.327860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-88ff7d61-8461-4e53-9743-54c256e8184a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:59.358500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ff7d61-8461-4e53-9743-54c256e8184a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:59.359625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ff7d61-8461-4e53-9743-54c256e8184a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:59.362269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ff7d61-8461-4e53-9743-54c256e8184a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:59.369360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ff7d61-8461-4e53-9743-54c256e8184a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:59.371880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ff7d61-8461-4e53-9743-54c256e8184a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:59.372933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ff7d61-8461-4e53-9743-54c256e8184a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:59.481938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:59.495794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:59.497413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:35:59.503711 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aa5237d1-7b9e-4dfe-8d04-7606bfdc2151 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1606 microversion: 2.25 time: 1.128959 Aug 27 02:35:59.506542 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 903/1691] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:35:58 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1606 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:35:59.540052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-486d4a8f-c7d1-4591-a5fc-2465bbfa17e1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:35:59.540880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-486d4a8f-c7d1-4591-a5fc-2465bbfa17e1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:35:59.552711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-486d4a8f-c7d1-4591-a5fc-2465bbfa17e1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:59.560518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-486d4a8f-c7d1-4591-a5fc-2465bbfa17e1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:59.561473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-486d4a8f-c7d1-4591-a5fc-2465bbfa17e1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:35:59.564016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-486d4a8f-c7d1-4591-a5fc-2465bbfa17e1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:35:59.565377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-486d4a8f-c7d1-4591-a5fc-2465bbfa17e1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:35:59.568762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-486d4a8f-c7d1-4591-a5fc-2465bbfa17e1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:00.024966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=20 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:00.112479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-88ff7d61-8461-4e53-9743-54c256e8184a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:00.146313 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-486d4a8f-c7d1-4591-a5fc-2465bbfa17e1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.610560 Aug 27 02:36:00.155605 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 904/1692] 10.222.0.99 () {60 vars in 1316 bytes} [Sat Aug 27 02:35:59 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-interface => generated 285 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:36:00.164288 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-88ff7d61-8461-4e53-9743-54c256e8184a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1320 microversion: 2.1 time: 0.818584 Aug 27 02:36:00.182642 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 789/1693] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:35:59 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1320 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:36:01.195709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-339df253-c41d-4afc-ac7d-629b0a3cd92a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:01.196843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-339df253-c41d-4afc-ac7d-629b0a3cd92a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:01.252761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339df253-c41d-4afc-ac7d-629b0a3cd92a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:01.253737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339df253-c41d-4afc-ac7d-629b0a3cd92a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:01.254380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339df253-c41d-4afc-ac7d-629b0a3cd92a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:01.255432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339df253-c41d-4afc-ac7d-629b0a3cd92a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:01.256082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339df253-c41d-4afc-ac7d-629b0a3cd92a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:01.256693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-339df253-c41d-4afc-ac7d-629b0a3cd92a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:03.547116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-339df253-c41d-4afc-ac7d-629b0a3cd92a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:03.589127 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-339df253-c41d-4afc-ac7d-629b0a3cd92a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1320 microversion: 2.1 time: 2.402951 Aug 27 02:36:03.591401 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 905/1694] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:01 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1320 bytes in 2410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:03.729237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-30a38847-fccb-4bbf-b517-bd09308df09f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2addbf70>, body: {"quota_set": {"ram": "5120"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:04.115379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:04.129155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30a38847-fccb-4bbf-b517-bd09308df09f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:04.132390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30a38847-fccb-4bbf-b517-bd09308df09f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:04.133219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30a38847-fccb-4bbf-b517-bd09308df09f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:04.136424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30a38847-fccb-4bbf-b517-bd09308df09f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:04.137166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30a38847-fccb-4bbf-b517-bd09308df09f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:04.141536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30a38847-fccb-4bbf-b517-bd09308df09f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:04.336998 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-30a38847-fccb-4bbf-b517-bd09308df09f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/4705ab1d016641cb9d0dad7173a3acd1" status: 200 len: 240 microversion: 2.36 time: 0.918560 Aug 27 02:36:04.339719 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 790/1695] 10.222.0.99 () {62 vars in 1303 bytes} [Sat Aug 27 02:36:03 2022] PUT /compute/v2.1/os-quota-sets/4705ab1d016641cb9d0dad7173a3acd1 => generated 240 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:36:04.379950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-737501ed-dc49-40f7-9573-9bab42cc3c1f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Calling method '.version_select at 0x7f4d2e7ba1f0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:04.641128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9d5b19bf-4855-4880-ab85-15213af0ebce tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:04.648224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9d5b19bf-4855-4880-ab85-15213af0ebce tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:04.707899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d5b19bf-4855-4880-ab85-15213af0ebce tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:04.715885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d5b19bf-4855-4880-ab85-15213af0ebce tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:04.716655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d5b19bf-4855-4880-ab85-15213af0ebce tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:04.722347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d5b19bf-4855-4880-ab85-15213af0ebce tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:04.732365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d5b19bf-4855-4880-ab85-15213af0ebce tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:04.733533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d5b19bf-4855-4880-ab85-15213af0ebce tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:04.793006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737501ed-dc49-40f7-9573-9bab42cc3c1f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:04.795658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737501ed-dc49-40f7-9573-9bab42cc3c1f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:04.797029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737501ed-dc49-40f7-9573-9bab42cc3c1f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:04.799215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737501ed-dc49-40f7-9573-9bab42cc3c1f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:04.801360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737501ed-dc49-40f7-9573-9bab42cc3c1f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:04.803064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737501ed-dc49-40f7-9573-9bab42cc3c1f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:04.887726 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-737501ed-dc49-40f7-9573-9bab42cc3c1f tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/4705ab1d016641cb9d0dad7173a3acd1/detail" status: 200 len: 672 microversion: 2.36 time: 0.522816 Aug 27 02:36:04.905116 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 906/1696] 10.222.0.99 () {60 vars in 1304 bytes} [Sat Aug 27 02:36:04 2022] GET /compute/v2.1/os-quota-sets/4705ab1d016641cb9d0dad7173a3acd1/detail => generated 672 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:36:05.181049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9d5b19bf-4855-4880-ab85-15213af0ebce tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:05.200296 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9d5b19bf-4855-4880-ab85-15213af0ebce tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1320 microversion: 2.1 time: 0.587405 Aug 27 02:36:05.200716 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 791/1697] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:04 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1320 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:05.279583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2e761ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:05.330606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2d0c085-c15f-458b-835a-6c963c219030 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:05.337508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c2d0c085-c15f-458b-835a-6c963c219030 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:05.347949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c2d0c085-c15f-458b-835a-6c963c219030 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Searching by: {'deleted': False, 'project_id': '757f05228f774702ac1a58772faf4393'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:05.379915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2d0c085-c15f-458b-835a-6c963c219030 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:05.380412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2d0c085-c15f-458b-835a-6c963c219030 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:05.380858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2d0c085-c15f-458b-835a-6c963c219030 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:05.381616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2d0c085-c15f-458b-835a-6c963c219030 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:05.398612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2d0c085-c15f-458b-835a-6c963c219030 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:05.403160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2d0c085-c15f-458b-835a-6c963c219030 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:05.520459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-c2d0c085-c15f-458b-835a-6c963c219030 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:36:05.577413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:05.581410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:05.589809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:05.592031 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c2d0c085-c15f-458b-835a-6c963c219030 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.266037 Aug 27 02:36:05.593887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:05.594936 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 792/1698] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 02:36:05 2022] GET /compute/v2.1/servers => generated 334 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:05.596260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:05.598883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:05.613438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-18568669-9070-44e4-a708-69cc8e2d77f6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b92b286e-4cbe-404f-83c1-24fd5340fd15"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:05.616441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-18568669-9070-44e4-a708-69cc8e2d77f6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:05.647472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18568669-9070-44e4-a708-69cc8e2d77f6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:05.649446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18568669-9070-44e4-a708-69cc8e2d77f6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:05.650069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18568669-9070-44e4-a708-69cc8e2d77f6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:05.651139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18568669-9070-44e4-a708-69cc8e2d77f6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:05.662394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18568669-9070-44e4-a708-69cc8e2d77f6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:05.663378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18568669-9070-44e4-a708-69cc8e2d77f6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:05.713113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:05.714171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:05.715343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:05.717325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:05.718669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:05.720034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:05.954148 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a7161c25-a6e4-4ffa-9fa4-e4d5ae6a03c3 tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/4705ab1d016641cb9d0dad7173a3acd1?user_id=2f0b121d83454b9ab4d3d068bd99cf6d" status: 200 len: 240 microversion: 2.36 time: 0.669408 Aug 27 02:36:05.958304 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 907/1699] 10.222.0.99 () {62 vars in 1384 bytes} [Sat Aug 27 02:36:05 2022] PUT /compute/v2.1/os-quota-sets/4705ab1d016641cb9d0dad7173a3acd1?user_id=2f0b121d83454b9ab4d3d068bd99cf6d => generated 240 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:36:05.991360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:06.025194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:06.031417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Searching by: {'deleted': False, 'project_id': '757f05228f774702ac1a58772faf4393'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:06.053090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:06.057730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:06.059010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:06.060907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:06.062206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:06.067085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:06.131255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:36:06.316884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:06.368240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:06.373163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:06.373884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:06.524393 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-18568669-9070-44e4-a708-69cc8e2d77f6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "POST /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.925248 Aug 27 02:36:06.532549 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 793/1700] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 02:36:05 2022] POST /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments => generated 194 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:06.547119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-be2a3b6d-3df9-43b1-9182-9dbb8e2a930c tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] Calling method '.version_select at 0x7f4d2e730790>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:06.752347 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-be2a3b6d-3df9-43b1-9182-9dbb8e2a930c tempest-QuotasAdminTestV236-72132584 tempest-QuotasAdminTestV236-72132584-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/4705ab1d016641cb9d0dad7173a3acd1?user_id=2f0b121d83454b9ab4d3d068bd99cf6d" status: 200 len: 282 microversion: 2.36 time: 0.218388 Aug 27 02:36:06.767722 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 794/1701] 10.222.0.99 () {60 vars in 1364 bytes} [Sat Aug 27 02:36:06 2022] GET /compute/v2.1/os-quota-sets/4705ab1d016641cb9d0dad7173a3acd1?user_id=2f0b121d83454b9ab4d3d068bd99cf6d => generated 282 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:36:06.814766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da335639-0d7e-4b88-808f-1d41ffe0109b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:06.823358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da335639-0d7e-4b88-808f-1d41ffe0109b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:06.857302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da335639-0d7e-4b88-808f-1d41ffe0109b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:06.858202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da335639-0d7e-4b88-808f-1d41ffe0109b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:06.858786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da335639-0d7e-4b88-808f-1d41ffe0109b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:06.859572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da335639-0d7e-4b88-808f-1d41ffe0109b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:06.860046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da335639-0d7e-4b88-808f-1d41ffe0109b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:06.860481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da335639-0d7e-4b88-808f-1d41ffe0109b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:07.148696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-da335639-0d7e-4b88-808f-1d41ffe0109b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:07.159962 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da335639-0d7e-4b88-808f-1d41ffe0109b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1320 microversion: 2.1 time: 0.381328 Aug 27 02:36:07.174577 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 795/1702] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:06 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1320 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:07.181407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-16241ff3-436e-4ad2-959a-b665fdd34638 req-4d230b37-caeb-4ea5-a574-7ad228183bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e32324-b1c4-40b3-85c0-51072ffde4e2", "tag": "ca89f90a-990c-446c-ae33-f1581137b16d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:07.198729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-16241ff3-436e-4ad2-959a-b665fdd34638 req-4d230b37-caeb-4ea5-a574-7ad228183bc2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:07.199478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-16241ff3-436e-4ad2-959a-b665fdd34638 req-4d230b37-caeb-4ea5-a574-7ad228183bc2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:07.200299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-16241ff3-436e-4ad2-959a-b665fdd34638 req-4d230b37-caeb-4ea5-a574-7ad228183bc2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:07.241492 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-16241ff3-436e-4ad2-959a-b665fdd34638 req-4d230b37-caeb-4ea5-a574-7ad228183bc2 service nova] Creating event network-changed:ca89f90a-990c-446c-ae33-f1581137b16d for instance 48e32324-b1c4-40b3-85c0-51072ffde4e2 on n-h2-852084-5 Aug 27 02:36:07.254785 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-16241ff3-436e-4ad2-959a-b665fdd34638 req-4d230b37-caeb-4ea5-a574-7ad228183bc2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077287 Aug 27 02:36:07.257055 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 796/1703] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:07.770555 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2e87435e-a6c4-4df6-99c5-6c4914bf5ec1 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 1.808441 Aug 27 02:36:07.772027 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 908/1704] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:36:05 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:07.832181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-747ee758-2101-4220-856a-12deecc5e711 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:07.857846 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-747ee758-2101-4220-856a-12deecc5e711 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027963 Aug 27 02:36:07.861743 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 797/1705] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:36:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:08.191108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7e07adae-d310-4e75-9b03-5bfdec4965e4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:08.191847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-27722ab4-cd8a-4a6f-8162-917fd359d2a0 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:08.192828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7e07adae-d310-4e75-9b03-5bfdec4965e4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:08.193537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-27722ab4-cd8a-4a6f-8162-917fd359d2a0 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:08.215177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27722ab4-cd8a-4a6f-8162-917fd359d2a0 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:08.217434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e07adae-d310-4e75-9b03-5bfdec4965e4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:08.218354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27722ab4-cd8a-4a6f-8162-917fd359d2a0 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:08.218999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27722ab4-cd8a-4a6f-8162-917fd359d2a0 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:08.219703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e07adae-d310-4e75-9b03-5bfdec4965e4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:08.220632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27722ab4-cd8a-4a6f-8162-917fd359d2a0 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:08.221237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e07adae-d310-4e75-9b03-5bfdec4965e4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:08.222155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e07adae-d310-4e75-9b03-5bfdec4965e4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:08.222830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27722ab4-cd8a-4a6f-8162-917fd359d2a0 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:08.223432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27722ab4-cd8a-4a6f-8162-917fd359d2a0 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:08.224079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e07adae-d310-4e75-9b03-5bfdec4965e4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:08.228963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e07adae-d310-4e75-9b03-5bfdec4965e4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:08.303491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-27722ab4-cd8a-4a6f-8162-917fd359d2a0 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:36:08.452832 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-27722ab4-cd8a-4a6f-8162-917fd359d2a0 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "DELETE /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 204 len: 0 microversion: 2.1 time: 0.266284 Aug 27 02:36:08.457686 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 909/1706] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:36:08 2022] DELETE /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:36:08.464722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-daeaebf1-0653-44ff-ae3e-f82f5fdad989 req-9a2628f8-5c4d-4dae-9475-1e650db2440b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd064beb-dd01-45e4-ba62-4bc863fd9ca9", "name": "network-vif-plugged", "status": "completed", "tag": "02f0cf52-1193-4bd8-b086-2cb4a4bd27a3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:08.496359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-daeaebf1-0653-44ff-ae3e-f82f5fdad989 req-9a2628f8-5c4d-4dae-9475-1e650db2440b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:08.497126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-daeaebf1-0653-44ff-ae3e-f82f5fdad989 req-9a2628f8-5c4d-4dae-9475-1e650db2440b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:08.497723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-daeaebf1-0653-44ff-ae3e-f82f5fdad989 req-9a2628f8-5c4d-4dae-9475-1e650db2440b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:08.532733 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-daeaebf1-0653-44ff-ae3e-f82f5fdad989 req-9a2628f8-5c4d-4dae-9475-1e650db2440b service nova] Creating event network-vif-plugged:02f0cf52-1193-4bd8-b086-2cb4a4bd27a3 for instance cd064beb-dd01-45e4-ba62-4bc863fd9ca9 on n-h1-852084-5 Aug 27 02:36:08.541175 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-daeaebf1-0653-44ff-ae3e-f82f5fdad989 req-9a2628f8-5c4d-4dae-9475-1e650db2440b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081541 Aug 27 02:36:08.544706 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 910/1707] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:08.564904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-12f15b4f-d2ec-48bd-ab57-0c8812636f85 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:08.570595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-12f15b4f-d2ec-48bd-ab57-0c8812636f85 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:08.587446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f15b4f-d2ec-48bd-ab57-0c8812636f85 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:08.588191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f15b4f-d2ec-48bd-ab57-0c8812636f85 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:08.588820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f15b4f-d2ec-48bd-ab57-0c8812636f85 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:08.589776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f15b4f-d2ec-48bd-ab57-0c8812636f85 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:08.590515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f15b4f-d2ec-48bd-ab57-0c8812636f85 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:08.591154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f15b4f-d2ec-48bd-ab57-0c8812636f85 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:08.597794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7e07adae-d310-4e75-9b03-5bfdec4965e4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:08.618623 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7e07adae-d310-4e75-9b03-5bfdec4965e4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1320 microversion: 2.1 time: 0.435555 Aug 27 02:36:08.621762 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 798/1708] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:08 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1320 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:08.772522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-339228325", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2b40c531-a24f-40ba-af07-5f55c2696292"}], "block_device_mapping_v2": [{"uuid": "9eec57ad-1d1b-40c3-a641-ad7d7ddf0d1e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:08.909479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] validate_networks() for [('2b40c531-a24f-40ba-af07-5f55c2696292', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:36:10.157484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:36:10.158228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:36:10.158663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:36:10.160246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:36:10.161005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:36:10.192336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:10.194175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:10.194945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:10.198421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:10.202208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:10.208070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:10.331236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Getting quotas for project c2ea38ee044d41d3a6ede6ab4806621d. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:36:10.349972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Getting quotas for user 6dbc0e90bbe94ce49ae09d2408a382c7 and project c2ea38ee044d41d3a6ede6ab4806621d. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:36:10.455720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-12f15b4f-d2ec-48bd-ab57-0c8812636f85 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:10.474776 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-12f15b4f-d2ec-48bd-ab57-0c8812636f85 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1699 microversion: 2.1 time: 1.928217 Aug 27 02:36:10.475225 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 911/1709] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:08 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1699 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:10.492012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c2c7e4ac-65ca-4628-b8fc-19d96e2b9ce1 req-92b5aaf1-a6f7-4a43-99a6-9eab30288ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b9c5ef8-086d-43da-8f95-67d5be4015ec", "tag": "18b71e37-350d-4218-8008-d9a7fb55178b"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:10.516471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c2c7e4ac-65ca-4628-b8fc-19d96e2b9ce1 req-92b5aaf1-a6f7-4a43-99a6-9eab30288ed2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:10.516956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c2c7e4ac-65ca-4628-b8fc-19d96e2b9ce1 req-92b5aaf1-a6f7-4a43-99a6-9eab30288ed2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:10.517426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c2c7e4ac-65ca-4628-b8fc-19d96e2b9ce1 req-92b5aaf1-a6f7-4a43-99a6-9eab30288ed2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:10.566239 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c2c7e4ac-65ca-4628-b8fc-19d96e2b9ce1 req-92b5aaf1-a6f7-4a43-99a6-9eab30288ed2 service nova] Creating event network-changed:18b71e37-350d-4218-8008-d9a7fb55178b for instance 5b9c5ef8-086d-43da-8f95-67d5be4015ec on n-h2-852084-5 Aug 27 02:36:10.577191 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c2c7e4ac-65ca-4628-b8fc-19d96e2b9ce1 req-92b5aaf1-a6f7-4a43-99a6-9eab30288ed2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097321 Aug 27 02:36:10.578234 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 912/1710] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:10.585071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c45a893-230c-4070-8808-f70795eaba4a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:10.592839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3c45a893-230c-4070-8808-f70795eaba4a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:10.603212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c45a893-230c-4070-8808-f70795eaba4a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:10.604015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c45a893-230c-4070-8808-f70795eaba4a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:10.604631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c45a893-230c-4070-8808-f70795eaba4a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:10.605566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c45a893-230c-4070-8808-f70795eaba4a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:10.606321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c45a893-230c-4070-8808-f70795eaba4a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:10.607074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c45a893-230c-4070-8808-f70795eaba4a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:10.614439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:36:10.617380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9eec57ad-1d1b-40c3-a641-ad7d7ddf0d1e',volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:36:10.989023 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1b14e6fd-0e44-459e-b993-7c80aad95258 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.222597 Aug 27 02:36:10.990651 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 799/1711] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:36:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:36:11.006190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6cbff0a6-673d-4fb9-85a7-cb8aee527bba tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:11.006825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6cbff0a6-673d-4fb9-85a7-cb8aee527bba tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:11.159865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6cbff0a6-673d-4fb9-85a7-cb8aee527bba tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:11.174410 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6cbff0a6-673d-4fb9-85a7-cb8aee527bba tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1052 microversion: 2.1 time: 0.173314 Aug 27 02:36:11.175345 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 800/1712] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:10 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1052 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:11.498879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bc8e7090-9244-4ddc-a8d8-5d87666fa571 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:11.499849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bc8e7090-9244-4ddc-a8d8-5d87666fa571 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:11.511422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc8e7090-9244-4ddc-a8d8-5d87666fa571 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:11.525021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc8e7090-9244-4ddc-a8d8-5d87666fa571 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:11.526071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc8e7090-9244-4ddc-a8d8-5d87666fa571 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:11.526864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc8e7090-9244-4ddc-a8d8-5d87666fa571 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:11.527352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc8e7090-9244-4ddc-a8d8-5d87666fa571 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:11.527797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc8e7090-9244-4ddc-a8d8-5d87666fa571 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:11.777365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bc8e7090-9244-4ddc-a8d8-5d87666fa571 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:11.787084 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bc8e7090-9244-4ddc-a8d8-5d87666fa571 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1632 microversion: 2.1 time: 0.293718 Aug 27 02:36:11.806666 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 801/1713] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:11 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1632 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:12.198326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f9241a57-a042-488d-9f72-63d360b2a672 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:12.199333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f9241a57-a042-488d-9f72-63d360b2a672 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:12.215266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9241a57-a042-488d-9f72-63d360b2a672 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:12.218311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9241a57-a042-488d-9f72-63d360b2a672 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:12.219121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9241a57-a042-488d-9f72-63d360b2a672 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:12.227152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9241a57-a042-488d-9f72-63d360b2a672 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:12.229393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9241a57-a042-488d-9f72-63d360b2a672 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:12.231663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9241a57-a042-488d-9f72-63d360b2a672 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:12.627464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f9241a57-a042-488d-9f72-63d360b2a672 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:12.636149 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f9241a57-a042-488d-9f72-63d360b2a672 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1102 microversion: 2.1 time: 0.442715 Aug 27 02:36:12.645768 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 802/1714] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:12 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1102 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:12.814058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4169c739-de00-477c-be11-9421513f1dbe tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:12.815154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4169c739-de00-477c-be11-9421513f1dbe tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:12.828425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4169c739-de00-477c-be11-9421513f1dbe tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:12.830701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4169c739-de00-477c-be11-9421513f1dbe tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:12.831412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4169c739-de00-477c-be11-9421513f1dbe tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:12.832420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4169c739-de00-477c-be11-9421513f1dbe tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:12.834625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4169c739-de00-477c-be11-9421513f1dbe tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:12.842148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4169c739-de00-477c-be11-9421513f1dbe tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:13.322556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4169c739-de00-477c-be11-9421513f1dbe tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:13.337132 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4169c739-de00-477c-be11-9421513f1dbe tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1632 microversion: 2.1 time: 0.528348 Aug 27 02:36:13.345546 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 803/1715] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:12 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1632 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:36:13.548496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e24250a6-da7d-462d-a251-e83b72ec45cc req-71f6779e-d475-4d8b-991f-1a73da05e91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e838b7-9173-4fe2-b467-73f543889366", "name": "network-vif-deleted", "tag": "b4c9e241-4c66-4b06-954a-f77a9405754d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:13.582886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e24250a6-da7d-462d-a251-e83b72ec45cc req-71f6779e-d475-4d8b-991f-1a73da05e91c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:13.587944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e24250a6-da7d-462d-a251-e83b72ec45cc req-71f6779e-d475-4d8b-991f-1a73da05e91c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:13.589031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e24250a6-da7d-462d-a251-e83b72ec45cc req-71f6779e-d475-4d8b-991f-1a73da05e91c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:13.693545 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e24250a6-da7d-462d-a251-e83b72ec45cc req-71f6779e-d475-4d8b-991f-1a73da05e91c service nova] Creating event network-vif-deleted:b4c9e241-4c66-4b06-954a-f77a9405754d for instance 43e838b7-9173-4fe2-b467-73f543889366 on n-h2-852084-5 Aug 27 02:36:13.713115 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e24250a6-da7d-462d-a251-e83b72ec45cc req-71f6779e-d475-4d8b-991f-1a73da05e91c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168190 Aug 27 02:36:13.721596 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 804/1716] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:13.762704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8a9d7f2a-c63b-4b4c-a8a5-e48ad363ec0e req-ed59e71d-39f7-4b0d-9b05-d00f0a363134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099723a4-8d6a-4f11-9e89-cde00fbdbdf6", "tag": "d0e84c9b-db44-407d-9fe2-65f84a836cbb"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:13.807417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8a9d7f2a-c63b-4b4c-a8a5-e48ad363ec0e req-ed59e71d-39f7-4b0d-9b05-d00f0a363134 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:13.808260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8a9d7f2a-c63b-4b4c-a8a5-e48ad363ec0e req-ed59e71d-39f7-4b0d-9b05-d00f0a363134 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:13.808932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8a9d7f2a-c63b-4b4c-a8a5-e48ad363ec0e req-ed59e71d-39f7-4b0d-9b05-d00f0a363134 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:13.849359 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8a9d7f2a-c63b-4b4c-a8a5-e48ad363ec0e req-ed59e71d-39f7-4b0d-9b05-d00f0a363134 service nova] Creating event network-changed:d0e84c9b-db44-407d-9fe2-65f84a836cbb for instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 on n-h1-852084-5 Aug 27 02:36:13.865299 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8a9d7f2a-c63b-4b4c-a8a5-e48ad363ec0e req-ed59e71d-39f7-4b0d-9b05-d00f0a363134 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141921 Aug 27 02:36:13.869227 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 805/1717] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:13.891997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e9f1e2af-2adf-4948-9ae8-392703efcdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:13.899312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e9f1e2af-2adf-4948-9ae8-392703efcdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:13.910470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3c45a893-230c-4070-8808-f70795eaba4a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:13.922159 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3c45a893-230c-4070-8808-f70795eaba4a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1320 microversion: 2.1 time: 3.342430 Aug 27 02:36:13.922779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9f1e2af-2adf-4948-9ae8-392703efcdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:13.922926 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 913/1718] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:10 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1320 bytes in 3344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:13.924858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9f1e2af-2adf-4948-9ae8-392703efcdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:13.925662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9f1e2af-2adf-4948-9ae8-392703efcdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:13.926686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9f1e2af-2adf-4948-9ae8-392703efcdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:13.928495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9f1e2af-2adf-4948-9ae8-392703efcdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:13.930708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9f1e2af-2adf-4948-9ae8-392703efcdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:14.081166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e9f1e2af-2adf-4948-9ae8-392703efcdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:14.096127 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e9f1e2af-2adf-4948-9ae8-392703efcdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1150 microversion: 2.1 time: 0.225237 Aug 27 02:36:14.114093 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 806/1719] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:13 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1150 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:14.374437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:14.378205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:14.431052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:14.432162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:14.432988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:14.434307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:14.435138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:14.435915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:14.699256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:14.701025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:14.701834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:14.705237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lazy-loading 'fault' on Instance uuid 43e838b7-9173-4fe2-b467-73f543889366 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:36:14.958368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-069c76bb-4a24-4f0f-80bf-3757e574e8e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:14.960070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-069c76bb-4a24-4f0f-80bf-3757e574e8e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:15.007455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-069c76bb-4a24-4f0f-80bf-3757e574e8e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:15.009301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-069c76bb-4a24-4f0f-80bf-3757e574e8e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:15.024950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-069c76bb-4a24-4f0f-80bf-3757e574e8e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:15.031582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-069c76bb-4a24-4f0f-80bf-3757e574e8e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:15.035149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-069c76bb-4a24-4f0f-80bf-3757e574e8e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:15.041611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-069c76bb-4a24-4f0f-80bf-3757e574e8e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:15.174912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '630df349c316497c82b100427e2da818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757f05228f774702ac1a58772faf4393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:15.189205 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e50371e0-718e-421e-b13d-f785080f27bc tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 200 len: 1359 microversion: 2.1 time: 0.826799 Aug 27 02:36:15.205096 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 914/1720] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:14 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 1359 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:15.221543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-16cc007a-f9e1-47af-86ee-b03e62f887c8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:15.222152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-16cc007a-f9e1-47af-86ee-b03e62f887c8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:15.272001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16cc007a-f9e1-47af-86ee-b03e62f887c8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:15.272517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16cc007a-f9e1-47af-86ee-b03e62f887c8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:15.273615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16cc007a-f9e1-47af-86ee-b03e62f887c8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:15.274409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16cc007a-f9e1-47af-86ee-b03e62f887c8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:15.274887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16cc007a-f9e1-47af-86ee-b03e62f887c8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:15.275321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16cc007a-f9e1-47af-86ee-b03e62f887c8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:15.329405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:15.861717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-16cc007a-f9e1-47af-86ee-b03e62f887c8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:15.875663 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-16cc007a-f9e1-47af-86ee-b03e62f887c8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1168 microversion: 2.1 time: 0.678166 Aug 27 02:36:15.881871 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 915/1721] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:15 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1168 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:16.213002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:16.214682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] [instance: 43e838b7-9173-4fe2-b467-73f543889366] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:16.217085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=9 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:16.231409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:16.232892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:16.233577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:16.237118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:16.237890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:16.239796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:16.285159 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] HTTP exception thrown: Instance 43e838b7-9173-4fe2-b467-73f543889366 could not be found. Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Request method failure captured: Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 HTTP/1.1 Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYLF1EWqCR9eLRBR5CD3Ef8K6qo6kmMwPr6CjNdPyXBDojPy99Xs3TaZc-kWHuSwNDkKIUgJ8XibTIzFwT4twPC6vxn29yhlyqH2nUFLJ7_fmDbu1Jpij2Khp0GrbMOGUMjAtxolfYEg6NCVDrclG6ewOfWMQIGRUQXwJH5QvD_e9Rk Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 757f05228f774702ac1a58772faf4393 Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-246596840 Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_757f05228f774702ac1a58772faf4393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/757f05228f774702ac1a58772faf4393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/757f05228f774702ac1a58772faf4393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/757f05228f774702ac1a58772faf4393"}]}] Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-246596840 Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 757f05228f774702ac1a58772faf4393 Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-246596840 Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-246596840-project Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 630df349c316497c82b100427e2da818 Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-246596840-project Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 43e838b7-9173-4fe2-b467-73f543889366 could not be found. Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '43e838b7-9173-4fe2-b467-73f543889366'} Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e838b7-9173-4fe2-b467-73f543889366 could not be found. Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e838b7-9173-4fe2-b467-73f543889366 could not be found. Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:16.293616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:16.300190 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:16.300190 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:16.300190 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:36:16.300190 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:36:16.300190 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e838b7-9173-4fe2-b467-73f543889366 could not be found. Aug 27 02:36:16.300190 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:16.310473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Returning 404 to user: Instance 43e838b7-9173-4fe2-b467-73f543889366 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:36:16.315350 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c72f65da-4b4a-424a-a375-b78ca9e431f3 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366" status: 404 len: 111 microversion: 2.1 time: 0.106652 Aug 27 02:36:16.319893 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 916/1722] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:16 2022] GET /compute/v2.1/servers/43e838b7-9173-4fe2-b467-73f543889366 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:36:16.325820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=16 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:16.340816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d0ff46a7-23db-4c5d-a8f7-d0fd254e2089 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] Calling method '.version_select at 0x7f4d2e7b25e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:16.439876 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d0ff46a7-23db-4c5d-a8f7-d0fd254e2089 tempest-ServersTestJSON-246596840 tempest-ServersTestJSON-246596840-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-353218416" status: 202 len: 0 microversion: 2.1 time: 0.118416 Aug 27 02:36:16.440827 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 917/1723] 10.222.0.99 () {58 vars in 1218 bytes} [Sat Aug 27 02:36:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-353218416 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:36:16.917383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bed67cb9-91f4-4f98-a726-434196713822 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:16.923789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bed67cb9-91f4-4f98-a726-434196713822 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:17.004950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bed67cb9-91f4-4f98-a726-434196713822 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:17.007869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bed67cb9-91f4-4f98-a726-434196713822 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:17.017954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bed67cb9-91f4-4f98-a726-434196713822 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:17.026056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bed67cb9-91f4-4f98-a726-434196713822 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:17.032949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bed67cb9-91f4-4f98-a726-434196713822 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:17.044049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bed67cb9-91f4-4f98-a726-434196713822 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:17.060708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-069c76bb-4a24-4f0f-80bf-3757e574e8e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:17.079222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-069c76bb-4a24-4f0f-80bf-3757e574e8e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1320 microversion: 2.1 time: 2.128332 Aug 27 02:36:17.083758 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 807/1724] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:14 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1320 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:17.691116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bed67cb9-91f4-4f98-a726-434196713822 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:17.748465 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bed67cb9-91f4-4f98-a726-434196713822 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1168 microversion: 2.1 time: 0.844542 Aug 27 02:36:17.749515 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 918/1725] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:16 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1168 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:18.114013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-60b60574-3650-4b5c-912a-2978d907330e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:18.118410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-60b60574-3650-4b5c-912a-2978d907330e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:18.166870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b60574-3650-4b5c-912a-2978d907330e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:18.168251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b60574-3650-4b5c-912a-2978d907330e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:18.173591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b60574-3650-4b5c-912a-2978d907330e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:18.175882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b60574-3650-4b5c-912a-2978d907330e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:18.181354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b60574-3650-4b5c-912a-2978d907330e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:18.185272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60b60574-3650-4b5c-912a-2978d907330e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:18.780550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5fafa73b-6e3d-42d9-ba92-981719a544be tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:18.781212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5fafa73b-6e3d-42d9-ba92-981719a544be tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:18.807014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fafa73b-6e3d-42d9-ba92-981719a544be tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:18.834298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fafa73b-6e3d-42d9-ba92-981719a544be tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:18.835299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fafa73b-6e3d-42d9-ba92-981719a544be tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:18.843421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fafa73b-6e3d-42d9-ba92-981719a544be tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:18.844665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fafa73b-6e3d-42d9-ba92-981719a544be tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:18.845799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fafa73b-6e3d-42d9-ba92-981719a544be tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:19.776456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60b60574-3650-4b5c-912a-2978d907330e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:19.795738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:19.842506 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-60b60574-3650-4b5c-912a-2978d907330e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1320 microversion: 2.1 time: 1.734442 Aug 27 02:36:19.852479 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 808/1726] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:18 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1320 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:19.883472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-74044d6a-3ebf-4d4a-90ca-d400fef9a077 req-9e45593e-e8f9-4cef-8790-43ac46bd281f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9c5ef8-086d-43da-8f95-67d5be4015ec", "name": "network-vif-plugged", "status": "completed", "tag": "18b71e37-350d-4218-8008-d9a7fb55178b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:19.896693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74044d6a-3ebf-4d4a-90ca-d400fef9a077 req-9e45593e-e8f9-4cef-8790-43ac46bd281f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:19.898893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74044d6a-3ebf-4d4a-90ca-d400fef9a077 req-9e45593e-e8f9-4cef-8790-43ac46bd281f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:19.899668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74044d6a-3ebf-4d4a-90ca-d400fef9a077 req-9e45593e-e8f9-4cef-8790-43ac46bd281f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:19.919489 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-74044d6a-3ebf-4d4a-90ca-d400fef9a077 req-9e45593e-e8f9-4cef-8790-43ac46bd281f service nova] Creating event network-vif-plugged:18b71e37-350d-4218-8008-d9a7fb55178b for instance 5b9c5ef8-086d-43da-8f95-67d5be4015ec on n-h2-852084-5 Aug 27 02:36:19.930722 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-74044d6a-3ebf-4d4a-90ca-d400fef9a077 req-9e45593e-e8f9-4cef-8790-43ac46bd281f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076338 Aug 27 02:36:19.932075 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 809/1727] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:20.199208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5fafa73b-6e3d-42d9-ba92-981719a544be tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:20.236300 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5fafa73b-6e3d-42d9-ba92-981719a544be tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1210 microversion: 2.1 time: 1.461016 Aug 27 02:36:20.237389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:20.238610 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 919/1728] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:18 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1210 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:20.648535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-87feef51-0899-4190-a0f4-9c606e836e92 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Calling method '.version_select at 0x7f4d2ac5b820>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:20.825156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a062216c-b8a4-4eea-ad82-193ac35d8756 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Action: 'create', calling method: .version_select at 0x7f4d2e7b2dc0>, body: {"keypair": {"name": "tempest-keypair-46522345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXykz6ACYq0OPfXIeH3mpbklRJLr8mOW7B8qMkIuad0O4EmyrgzSVyohyFx7Dqm+JOaxKQ5f+rmG/MiSPhP5cihpT8NgaEkBRnjNgGR79ekZYtkHJ+4z5SH7tg22k/cXA=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:20.866978 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-87feef51-0899-4190-a0f4-9c606e836e92 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df" status: 200 len: 371 microversion: 2.1 time: 0.932729 Aug 27 02:36:20.868413 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 810/1729] 10.222.0.99 () {58 vars in 1242 bytes} [Sat Aug 27 02:36:19 2022] GET /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df => generated 371 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:20.872826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-a062216c-b8a4-4eea-ad82-193ac35d8756 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Getting quotas for project 195d9a2cd949478ebc0c53dae45f6501. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:36:20.880431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4f9e85fa-ed9f-4475-b8e5-d9a3b1dc5d94 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:20.881494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4f9e85fa-ed9f-4475-b8e5-d9a3b1dc5d94 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:20.887439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-a062216c-b8a4-4eea-ad82-193ac35d8756 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Getting quotas for user 61a386e483ae4ab3a33f3a40d5bf41cf and project 195d9a2cd949478ebc0c53dae45f6501. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:36:20.898913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f9e85fa-ed9f-4475-b8e5-d9a3b1dc5d94 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:20.899738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f9e85fa-ed9f-4475-b8e5-d9a3b1dc5d94 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:20.900834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f9e85fa-ed9f-4475-b8e5-d9a3b1dc5d94 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:20.903735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f9e85fa-ed9f-4475-b8e5-d9a3b1dc5d94 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:20.907286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f9e85fa-ed9f-4475-b8e5-d9a3b1dc5d94 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:20.908011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f9e85fa-ed9f-4475-b8e5-d9a3b1dc5d94 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:20.956302 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a062216c-b8a4-4eea-ad82-193ac35d8756 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.447294 Aug 27 02:36:20.977726 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 920/1730] 10.222.0.99 () {62 vars in 1200 bytes} [Sat Aug 27 02:36:20 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 473 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 27 02:36:21.042849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4617c4c5-aad1-42b6-bee6-a57d546341f6 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2e7cd040>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:21.232571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4617c4c5-aad1-42b6-bee6-a57d546341f6 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:21.238503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4617c4c5-aad1-42b6-bee6-a57d546341f6 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:21.239349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4617c4c5-aad1-42b6-bee6-a57d546341f6 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:21.241215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4617c4c5-aad1-42b6-bee6-a57d546341f6 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:21.242019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4617c4c5-aad1-42b6-bee6-a57d546341f6 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:21.245018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4617c4c5-aad1-42b6-bee6-a57d546341f6 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:21.346604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:21.412038 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4617c4c5-aad1-42b6-bee6-a57d546341f6 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df" status: 200 len: 328 microversion: 2.1 time: 0.427143 Aug 27 02:36:21.418364 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 921/1731] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:36:20 2022] PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df => generated 328 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:21.425538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1a434e41-897e-4040-b806-5117866c5283 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:21.430571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1a434e41-897e-4040-b806-5117866c5283 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:21.459256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a434e41-897e-4040-b806-5117866c5283 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:21.460922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a434e41-897e-4040-b806-5117866c5283 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:21.464814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a434e41-897e-4040-b806-5117866c5283 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:21.474110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a434e41-897e-4040-b806-5117866c5283 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:21.478450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a434e41-897e-4040-b806-5117866c5283 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:21.484201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a434e41-897e-4040-b806-5117866c5283 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:21.787973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4f9e85fa-ed9f-4475-b8e5-d9a3b1dc5d94 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:21.806686 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4f9e85fa-ed9f-4475-b8e5-d9a3b1dc5d94 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1320 microversion: 2.1 time: 0.925217 Aug 27 02:36:21.812106 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 811/1732] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:20 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1320 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:36:22.000921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1a434e41-897e-4040-b806-5117866c5283 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:22.011481 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1a434e41-897e-4040-b806-5117866c5283 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1210 microversion: 2.1 time: 0.591440 Aug 27 02:36:22.013756 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 922/1733] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:21 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1210 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:22.069155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-471913650", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:22.203021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:36:22.685796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-eca404f8-679c-4bf4-a44e-566336e8c39c req-bfb303cd-8e61-49cc-837a-b9b61e4a95b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e32324-b1c4-40b3-85c0-51072ffde4e2", "name": "network-vif-plugged", "status": "completed", "tag": "ca89f90a-990c-446c-ae33-f1581137b16d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:22.726369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-eca404f8-679c-4bf4-a44e-566336e8c39c req-bfb303cd-8e61-49cc-837a-b9b61e4a95b2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:22.727132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-eca404f8-679c-4bf4-a44e-566336e8c39c req-bfb303cd-8e61-49cc-837a-b9b61e4a95b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:22.727588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-eca404f8-679c-4bf4-a44e-566336e8c39c req-bfb303cd-8e61-49cc-837a-b9b61e4a95b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:22.780454 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-eca404f8-679c-4bf4-a44e-566336e8c39c req-bfb303cd-8e61-49cc-837a-b9b61e4a95b2 service nova] Creating event network-vif-plugged:ca89f90a-990c-446c-ae33-f1581137b16d for instance 48e32324-b1c4-40b3-85c0-51072ffde4e2 on n-h2-852084-5 Aug 27 02:36:22.799320 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-eca404f8-679c-4bf4-a44e-566336e8c39c req-bfb303cd-8e61-49cc-837a-b9b61e4a95b2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117424 Aug 27 02:36:22.805736 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 923/1734] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:22.830364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dcbdd891-f606-4636-b16e-a61c9379d2f3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:22.831111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dcbdd891-f606-4636-b16e-a61c9379d2f3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:22.859428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcbdd891-f606-4636-b16e-a61c9379d2f3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:22.859942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcbdd891-f606-4636-b16e-a61c9379d2f3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:22.860409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcbdd891-f606-4636-b16e-a61c9379d2f3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:22.867722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcbdd891-f606-4636-b16e-a61c9379d2f3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:22.868339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcbdd891-f606-4636-b16e-a61c9379d2f3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:22.868811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcbdd891-f606-4636-b16e-a61c9379d2f3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:24.328696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:36:24.329419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:36:24.329593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:36:24.330192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:36:24.330451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:36:24.369270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:24.369800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:24.370586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:24.374517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:24.375319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:24.375955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:24.420163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Getting quotas for project cae14cef7ebc402ea33301f9018b97df. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:36:24.439638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Getting quotas for user 77c841a899c04616a1ee3353ddd446c5 and project cae14cef7ebc402ea33301f9018b97df. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:36:24.486384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.utils [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] cores quota exceeded for cae14cef7ebc402ea33301f9018b97df, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122487) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 02:36:24.487607 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Request method failure captured: Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 144 Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYMg_ZIZGl25SlLbIC33abYyZwHBLydf23RPRLfobvFhrxyM8m_9Awz_FEH25DyUkk0t92Az7ir-lhf40vJeCmS-RvGMH7mqcWVSYITRP41FrwYxhd8qCe-uIbDH9s7IEIwBdrG26QFt35RBihvXQJbRpqBd1EJ4OSPQXNU2vwyeo6s Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cae14cef7ebc402ea33301f9018b97df Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cae14cef7ebc402ea33301f9018b97df"}]}] Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cae14cef7ebc402ea33301f9018b97df Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-QuotasAdminNegativeTest-1113567349-project Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 77c841a899c04616a1ee3353ddd446c5 Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-QuotasAdminNegativeTest-1113567349-project Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-471913650", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-471913650', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452'}}} Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:36:24.507068 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 27 02:36:24.512454 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:24.519526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:36:24.522021 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7a2e1309-0fe3-4047-a84f-efa9947acfe1 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.682781 Aug 27 02:36:24.524456 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 812/1735] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:36:21 2022] POST /compute/v2.1/servers => generated 111 bytes in 2686 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:36:24.532163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-241f3818-2018-495d-b3fa-292a77125573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:24.534667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-241f3818-2018-495d-b3fa-292a77125573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:24.545959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241f3818-2018-495d-b3fa-292a77125573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:24.546788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241f3818-2018-495d-b3fa-292a77125573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:24.547456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241f3818-2018-495d-b3fa-292a77125573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:24.548612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241f3818-2018-495d-b3fa-292a77125573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:24.549289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241f3818-2018-495d-b3fa-292a77125573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:24.549938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241f3818-2018-495d-b3fa-292a77125573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:24.784858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dcbdd891-f606-4636-b16e-a61c9379d2f3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:24.799950 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dcbdd891-f606-4636-b16e-a61c9379d2f3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1512 microversion: 2.1 time: 1.974952 Aug 27 02:36:24.816239 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 924/1736] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:22 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1512 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:24.836422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aca2a4d7-2135-4c21-8f3f-68d649deefe5 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2e7ccc10>, body: {"quota_set": {"cores": 20}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:24.975475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aca2a4d7-2135-4c21-8f3f-68d649deefe5 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:24.976119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aca2a4d7-2135-4c21-8f3f-68d649deefe5 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:24.976841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aca2a4d7-2135-4c21-8f3f-68d649deefe5 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:24.985213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aca2a4d7-2135-4c21-8f3f-68d649deefe5 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:24.986060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aca2a4d7-2135-4c21-8f3f-68d649deefe5 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:24.986468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aca2a4d7-2135-4c21-8f3f-68d649deefe5 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:25.358716 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aca2a4d7-2135-4c21-8f3f-68d649deefe5 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df" status: 200 len: 329 microversion: 2.1 time: 0.519051 Aug 27 02:36:25.377198 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 925/1737] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:36:24 2022] PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df => generated 329 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:25.425384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e9602e78-a060-4a3f-932e-a9b4a3361633 req-d759224a-4143-4620-ab87-fa120dddbed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cd0655-58b7-4731-84ce-199edeea0cac", "tag": "a95780ce-8687-4bd3-a6a0-0a05511992af"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:25.506936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e9602e78-a060-4a3f-932e-a9b4a3361633 req-d759224a-4143-4620-ab87-fa120dddbed3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:25.508205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e9602e78-a060-4a3f-932e-a9b4a3361633 req-d759224a-4143-4620-ab87-fa120dddbed3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:25.509901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e9602e78-a060-4a3f-932e-a9b4a3361633 req-d759224a-4143-4620-ab87-fa120dddbed3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:25.568840 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e9602e78-a060-4a3f-932e-a9b4a3361633 req-d759224a-4143-4620-ab87-fa120dddbed3 service nova] Creating event network-changed:a95780ce-8687-4bd3-a6a0-0a05511992af for instance b8cd0655-58b7-4731-84ce-199edeea0cac on n-h1-852084-5 Aug 27 02:36:25.599163 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e9602e78-a060-4a3f-932e-a9b4a3361633 req-d759224a-4143-4620-ab87-fa120dddbed3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213201 Aug 27 02:36:25.605001 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 926/1738] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:25.622772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a62092fc-22b4-40cc-b5f0-95f8d5295de9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:25.635692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a62092fc-22b4-40cc-b5f0-95f8d5295de9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:25.658892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a62092fc-22b4-40cc-b5f0-95f8d5295de9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:25.659691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a62092fc-22b4-40cc-b5f0-95f8d5295de9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:25.667090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a62092fc-22b4-40cc-b5f0-95f8d5295de9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:25.669909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a62092fc-22b4-40cc-b5f0-95f8d5295de9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:25.673973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a62092fc-22b4-40cc-b5f0-95f8d5295de9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:25.675940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a62092fc-22b4-40cc-b5f0-95f8d5295de9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:25.890773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-241f3818-2018-495d-b3fa-292a77125573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:25.916199 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-241f3818-2018-495d-b3fa-292a77125573 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1210 microversion: 2.1 time: 1.389506 Aug 27 02:36:25.920629 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 813/1739] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:24 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1210 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:25.951163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-036bd232-ce88-4da3-932c-8980386e424a tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Calling method '.version_select at 0x7f4d2b02de50>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:26.112723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a62092fc-22b4-40cc-b5f0-95f8d5295de9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:26.130299 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a62092fc-22b4-40cc-b5f0-95f8d5295de9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1511 microversion: 2.1 time: 0.520496 Aug 27 02:36:26.136954 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 927/1740] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:25 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1511 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:26.175751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-adc0a7fe-3ce6-4d54-9937-21c2173c19a7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:26.176592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-adc0a7fe-3ce6-4d54-9937-21c2173c19a7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: cd064beb-dd01-45e4-ba62-4bc863fd9ca9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:26.200274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adc0a7fe-3ce6-4d54-9937-21c2173c19a7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:26.205571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adc0a7fe-3ce6-4d54-9937-21c2173c19a7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:26.208093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adc0a7fe-3ce6-4d54-9937-21c2173c19a7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:26.209336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adc0a7fe-3ce6-4d54-9937-21c2173c19a7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:26.212013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adc0a7fe-3ce6-4d54-9937-21c2173c19a7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:26.212733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adc0a7fe-3ce6-4d54-9937-21c2173c19a7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:26.261314 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-036bd232-ce88-4da3-932c-8980386e424a tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df" status: 200 len: 371 microversion: 2.1 time: 0.338231 Aug 27 02:36:26.272146 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 814/1741] 10.222.0.99 () {58 vars in 1242 bytes} [Sat Aug 27 02:36:25 2022] GET /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df => generated 371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:26.292835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9602b370-fd4a-4d0e-8e26-62a97a65288c tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2acba4c0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:26.528032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9602b370-fd4a-4d0e-8e26-62a97a65288c tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:26.529260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9602b370-fd4a-4d0e-8e26-62a97a65288c tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:26.530196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9602b370-fd4a-4d0e-8e26-62a97a65288c tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:26.531452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9602b370-fd4a-4d0e-8e26-62a97a65288c tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:26.535629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9602b370-fd4a-4d0e-8e26-62a97a65288c tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:26.536605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9602b370-fd4a-4d0e-8e26-62a97a65288c tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:26.609247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:26.631648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=33 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:26.701502 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9602b370-fd4a-4d0e-8e26-62a97a65288c tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df" status: 200 len: 328 microversion: 2.1 time: 0.418164 Aug 27 02:36:26.717807 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 815/1742] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:36:26 2022] PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df => generated 328 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:26.717807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-32730bf7-4011-4103-9cfa-e05609a2a7b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:26.717807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-32730bf7-4011-4103-9cfa-e05609a2a7b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:26.717807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32730bf7-4011-4103-9cfa-e05609a2a7b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:26.719352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32730bf7-4011-4103-9cfa-e05609a2a7b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:26.720627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32730bf7-4011-4103-9cfa-e05609a2a7b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:26.726966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32730bf7-4011-4103-9cfa-e05609a2a7b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:26.727561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32730bf7-4011-4103-9cfa-e05609a2a7b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:26.731094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32730bf7-4011-4103-9cfa-e05609a2a7b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:26.944810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-adc0a7fe-3ce6-4d54-9937-21c2173c19a7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:26.977859 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-adc0a7fe-3ce6-4d54-9937-21c2173c19a7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9" status: 200 len: 1513 microversion: 2.1 time: 0.798479 Aug 27 02:36:26.979880 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 928/1743] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:26 2022] GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9 => generated 1513 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:26.988385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1916305010", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:27.167604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:36:27.906512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:36:27.907456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:36:27.908222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:36:27.908889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:36:27.909506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:36:27.928696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:27.931066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:27.936276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:27.936821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:27.937377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-32730bf7-4011-4103-9cfa-e05609a2a7b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:27.938134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:27.938134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:27.950962 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-32730bf7-4011-4103-9cfa-e05609a2a7b4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 1.247160 Aug 27 02:36:27.956117 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 816/1744] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:26 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:27.967957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d09c72c6-2b10-4e12-9b0b-57ece7af892a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:27.972276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d09c72c6-2b10-4e12-9b0b-57ece7af892a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:27.984772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c72c6-2b10-4e12-9b0b-57ece7af892a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:27.990488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c72c6-2b10-4e12-9b0b-57ece7af892a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:27.991300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c72c6-2b10-4e12-9b0b-57ece7af892a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:27.992238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c72c6-2b10-4e12-9b0b-57ece7af892a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:27.992950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c72c6-2b10-4e12-9b0b-57ece7af892a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:27.993586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c72c6-2b10-4e12-9b0b-57ece7af892a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:28.003511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Getting quotas for project cae14cef7ebc402ea33301f9018b97df. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:36:28.017966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Getting quotas for user 77c841a899c04616a1ee3353ddd446c5 and project cae14cef7ebc402ea33301f9018b97df. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:36:28.055321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.utils [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] instances quota exceeded for cae14cef7ebc402ea33301f9018b97df, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122488) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 02:36:28.056973 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Request method failure captured: Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 145 Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYMg_ZIZGl25SlLbIC33abYyZwHBLydf23RPRLfobvFhrxyM8m_9Awz_FEH25DyUkk0t92Az7ir-lhf40vJeCmS-RvGMH7mqcWVSYITRP41FrwYxhd8qCe-uIbDH9s7IEIwBdrG26QFt35RBihvXQJbRpqBd1EJ4OSPQXNU2vwyeo6s Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: cae14cef7ebc402ea33301f9018b97df Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cae14cef7ebc402ea33301f9018b97df"}]}] Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: cae14cef7ebc402ea33301f9018b97df Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-QuotasAdminNegativeTest-1113567349-project Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 77c841a899c04616a1ee3353ddd446c5 Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-QuotasAdminNegativeTest-1113567349-project Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1916305010", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1916305010', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452'}}} Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:36:28.062471 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 27 02:36:28.067208 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:28.075282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:36:28.076571 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4feab163-bab2-4010-9fd8-4dc387e36950 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.095015 Aug 27 02:36:28.078872 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 929/1745] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:36:26 2022] POST /compute/v2.1/servers => generated 119 bytes in 1098 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:36:28.089150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:28.105787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:28.110278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:28.131563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:28.133230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:28.133888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:28.134908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:28.135617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:28.136311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:28.350023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:36:28.550481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:28.565590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:28.566538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:28.567340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:28.877693 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9d531063-2d24-47f2-b3dd-36a5ebeb0d1a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.797150 Aug 27 02:36:28.879156 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 930/1746] 10.222.0.99 () {58 vars in 1167 bytes} [Sat Aug 27 02:36:28 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:29.062291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "dcab35b5-bf18-41fd-a22d-6ff35964834a"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:29.067253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:29.080708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:29.082263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:29.083067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:29.085531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:29.086661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:29.087529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:29.215987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d09c72c6-2b10-4e12-9b0b-57ece7af892a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:29.239675 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d09c72c6-2b10-4e12-9b0b-57ece7af892a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1210 microversion: 2.1 time: 1.281478 Aug 27 02:36:29.252930 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 817/1747] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:27 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1210 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:29.279687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-37cc9b58-550a-4fe5-b26b-d93cb68797b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1900495795"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:29.282978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-37cc9b58-550a-4fe5-b26b-d93cb68797b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:29.315532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37cc9b58-550a-4fe5-b26b-d93cb68797b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:29.321936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37cc9b58-550a-4fe5-b26b-d93cb68797b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:29.322986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37cc9b58-550a-4fe5-b26b-d93cb68797b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:29.324774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37cc9b58-550a-4fe5-b26b-d93cb68797b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:29.325627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37cc9b58-550a-4fe5-b26b-d93cb68797b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:29.327984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37cc9b58-550a-4fe5-b26b-d93cb68797b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:29.339115 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] HTTP exception thrown: Volume dcab35b5-bf18-41fd-a22d-6ff35964834a could not be found. Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Request method failure captured: Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments/b92b286e-4cbe-404f-83c1-24fd5340fd15 HTTP/1.1 Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 74 Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYLC2CiJA1XoJSn-YTGTOhFsVu4fZ-W64Jw9gaG5tU_VLMsr2KZL6isni9gfsgha7SINBWzvCTjoTNWTezJ63xaLvZfpapsn1VInGL7kf_6_5PI-xgf7nOECGORBI4BlyfM6lCjS_oj-V5VexSKFOtST9efC4M_DlW85wKC4IiAYZpY Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 7d50ecc97f984390ab69fa547833764b Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-VolumesAdminNegativeTest-2102873376 Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7d50ecc97f984390ab69fa547833764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50ecc97f984390ab69fa547833764b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50ecc97f984390ab69fa547833764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7d50ecc97f984390ab69fa547833764b"}]}] Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-VolumesAdminNegativeTest-2102873376 Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 7d50ecc97f984390ab69fa547833764b Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2102873376 Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-VolumesAdminNegativeTest-2102873376-project-admin Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 8236502a6d9240b2bf335950b675d062 Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-VolumesAdminNegativeTest-2102873376-project-admin Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: {"volumeAttachment": {"volumeId": "dcab35b5-bf18-41fd-a22d-6ff35964834a"}} Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: exception: Volume dcab35b5-bf18-41fd-a22d-6ff35964834a could not be found. Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'server_id': 'bb357c66-d559-4bb9-a7f4-3ce3f6f09904', 'id': 'b92b286e-4cbe-404f-83c1-24fd5340fd15', 'body': {'volumeAttachment': {'volumeId': 'dcab35b5-bf18-41fd-a22d-6ff35964834a'}}} Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dcab35b5-bf18-41fd-a22d-6ff35964834a could not be found. (HTTP 404) (Request-ID: req-9fdb2980-a6b6-49bc-8b46-e7b8dc1a1f19) Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:36:29.387511 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dcab35b5-bf18-41fd-a22d-6ff35964834a could not be found. Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume dcab35b5-bf18-41fd-a22d-6ff35964834a could not be found. Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dcab35b5-bf18-41fd-a22d-6ff35964834a could not be found. Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Returning 400 to user: Volume dcab35b5-bf18-41fd-a22d-6ff35964834a could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f7fb563b-d9a0-412c-be00-235b14ab67b1 tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] 10.222.0.99 "PUT /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments/b92b286e-4cbe-404f-83c1-24fd5340fd15" status: 400 len: 107 microversion: 2.1 time: 0.505559 Aug 27 02:36:29.416373 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 931/1748] 10.222.0.99 () {60 vars in 1433 bytes} [Sat Aug 27 02:36:28 2022] PUT /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments/b92b286e-4cbe-404f-83c1-24fd5340fd15 => generated 107 bytes in 524 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:36:29.437964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ff2b8b5-5433-41ca-937d-dec16eeb2234 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2e803af0>, body: {"quota_set": {"instances": 10}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:29.637441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ff2b8b5-5433-41ca-937d-dec16eeb2234 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:29.638261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ff2b8b5-5433-41ca-937d-dec16eeb2234 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:29.639047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ff2b8b5-5433-41ca-937d-dec16eeb2234 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:29.640039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ff2b8b5-5433-41ca-937d-dec16eeb2234 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:29.640677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ff2b8b5-5433-41ca-937d-dec16eeb2234 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:29.641275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ff2b8b5-5433-41ca-937d-dec16eeb2234 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:29.767611 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ff2b8b5-5433-41ca-937d-dec16eeb2234 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df" status: 200 len: 329 microversion: 2.1 time: 0.361768 Aug 27 02:36:29.769483 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 932/1749] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:36:29 2022] PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df => generated 329 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:29.783072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:29.790346 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-37cc9b58-550a-4fe5-b26b-d93cb68797b3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.534569 Aug 27 02:36:29.795948 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 818/1750] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:36:29 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 02:36:29.796196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:29.796196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-846876441', 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:29.811221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5eb4720d-f91b-4e20-9095-d1c6bf8c11fe tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:29.812390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5eb4720d-f91b-4e20-9095-d1c6bf8c11fe tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:29.821415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:29.823415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eb4720d-f91b-4e20-9095-d1c6bf8c11fe tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:29.824804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eb4720d-f91b-4e20-9095-d1c6bf8c11fe tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:29.830507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:29.831026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:29.832022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:29.832609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:29.832946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:29.842379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eb4720d-f91b-4e20-9095-d1c6bf8c11fe tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:29.843966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eb4720d-f91b-4e20-9095-d1c6bf8c11fe tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:29.844978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eb4720d-f91b-4e20-9095-d1c6bf8c11fe tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:29.846082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eb4720d-f91b-4e20-9095-d1c6bf8c11fe tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:30.098488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:36:30.150942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-5eb4720d-f91b-4e20-9095-d1c6bf8c11fe tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lazy-loading 'services' on Instance uuid bb357c66-d559-4bb9-a7f4-3ce3f6f09904 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:36:30.397178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:30.435167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:30.436269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:30.437721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:30.463821 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5eb4720d-f91b-4e20-9095-d1c6bf8c11fe tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "DELETE /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments/b92b286e-4cbe-404f-83c1-24fd5340fd15" status: 202 len: 0 microversion: 2.1 time: 0.661911 Aug 27 02:36:30.470646 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 819/1751] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 02:36:29 2022] DELETE /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments/b92b286e-4cbe-404f-83c1-24fd5340fd15 => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:36:30.481847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-687ac21a-2de0-4acf-92af-8a7d02a7d11f tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Calling method '.version_select at 0x7f4d2e6c01f0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:30.626399 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-687ac21a-2de0-4acf-92af-8a7d02a7d11f tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df" status: 200 len: 371 microversion: 2.1 time: 0.153410 Aug 27 02:36:30.628581 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 820/1752] 10.222.0.99 () {58 vars in 1242 bytes} [Sat Aug 27 02:36:30 2022] GET /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df => generated 371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:30.642361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-364311399", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbe38f30-5c1c-448e-a343-52aede3a0292"}], "security_groups": [{"name": "tempest-securitygroup--1073305868"}], "key_name": "tempest-keypair-46522345", "user_data": "}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:30.722054 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-89503ab2-e493-4cc5-9acf-12c2ffa03c32 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-846876441" status: 200 len: 1514 microversion: 2.1 time: 0.950583 Aug 27 02:36:30.723398 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 933/1753] 10.222.0.99 () {58 vars in 1261 bytes} [Sat Aug 27 02:36:29 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-846876441 => generated 1514 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:30.747503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6586e85-2590-4a61-9fd8-806bc31c89f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:30.749073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a6586e85-2590-4a61-9fd8-806bc31c89f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:30.781585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6586e85-2590-4a61-9fd8-806bc31c89f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:30.783309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6586e85-2590-4a61-9fd8-806bc31c89f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:30.784504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6586e85-2590-4a61-9fd8-806bc31c89f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:30.786303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6586e85-2590-4a61-9fd8-806bc31c89f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:30.787477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6586e85-2590-4a61-9fd8-806bc31c89f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:30.793990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6586e85-2590-4a61-9fd8-806bc31c89f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:31.027250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] validate_networks() for [('bbe38f30-5c1c-448e-a343-52aede3a0292', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:36:31.082470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a6586e85-2590-4a61-9fd8-806bc31c89f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:31.095858 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6586e85-2590-4a61-9fd8-806bc31c89f2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1210 microversion: 2.1 time: 0.370513 Aug 27 02:36:31.096796 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 934/1754] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:30 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1210 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:31.102415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-49e97648-ea11-4093-88cb-6b0a78d38028 req-db37802c-23a3-4bc7-8360-0bb4c24eac5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59462ca6-1830-4fae-a141-ffade28879f6", "name": "network-vif-unplugged", "status": "completed", "tag": "b9a18ca7-1e41-4aa3-9c64-1d916f180dce"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:31.152918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-49e97648-ea11-4093-88cb-6b0a78d38028 req-db37802c-23a3-4bc7-8360-0bb4c24eac5f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:31.153528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-49e97648-ea11-4093-88cb-6b0a78d38028 req-db37802c-23a3-4bc7-8360-0bb4c24eac5f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:31.156080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-49e97648-ea11-4093-88cb-6b0a78d38028 req-db37802c-23a3-4bc7-8360-0bb4c24eac5f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:31.180827 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-49e97648-ea11-4093-88cb-6b0a78d38028 req-db37802c-23a3-4bc7-8360-0bb4c24eac5f service nova] Creating event network-vif-unplugged:b9a18ca7-1e41-4aa3-9c64-1d916f180dce for instance 59462ca6-1830-4fae-a141-ffade28879f6 on n-h1-852084-5 Aug 27 02:36:31.191045 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-49e97648-ea11-4093-88cb-6b0a78d38028 req-db37802c-23a3-4bc7-8360-0bb4c24eac5f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092748 Aug 27 02:36:31.192597 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 935/1755] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:31.202843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8272d110-6645-4140-bf88-ed88527010cb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:31.206308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8272d110-6645-4140-bf88-ed88527010cb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:31.221053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8272d110-6645-4140-bf88-ed88527010cb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:31.221714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8272d110-6645-4140-bf88-ed88527010cb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:31.222189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8272d110-6645-4140-bf88-ed88527010cb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:31.223182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8272d110-6645-4140-bf88-ed88527010cb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:31.223861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8272d110-6645-4140-bf88-ed88527010cb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:31.224353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8272d110-6645-4140-bf88-ed88527010cb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:31.278422 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8272d110-6645-4140-bf88-ed88527010cb tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082786 Aug 27 02:36:31.284549 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 936/1756] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:36:31 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:31.298160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-953ef63b-4654-4fee-ae58-9e6b15ae5768 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Action: 'update', calling method: .version_select at 0x7f4d29af3820>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:31.475495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-953ef63b-4654-4fee-ae58-9e6b15ae5768 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:31.478692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-953ef63b-4654-4fee-ae58-9e6b15ae5768 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:31.479161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-953ef63b-4654-4fee-ae58-9e6b15ae5768 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:31.479974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-953ef63b-4654-4fee-ae58-9e6b15ae5768 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:31.480446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-953ef63b-4654-4fee-ae58-9e6b15ae5768 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:31.480881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-953ef63b-4654-4fee-ae58-9e6b15ae5768 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:31.595075 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-953ef63b-4654-4fee-ae58-9e6b15ae5768 tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df" status: 200 len: 325 microversion: 2.1 time: 0.314443 Aug 27 02:36:31.596295 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 937/1757] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:36:31 2022] PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df => generated 325 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:31.603892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:31.610625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:31.612118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:31.630250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:31.631187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:31.632975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:31.635029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:31.637193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:31.638777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:31.723085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:36:31.724514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:36:31.725222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:36:31.726019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:36:31.727011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:36:31.741125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:31.742130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:31.742869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:31.744306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:31.745337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:31.746060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:31.768575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Getting quotas for project 195d9a2cd949478ebc0c53dae45f6501. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:36:31.775916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Getting quotas for user 61a386e483ae4ab3a33f3a40d5bf41cf and project 195d9a2cd949478ebc0c53dae45f6501. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:36:31.786984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:36:31.798897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:36:31.802448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:31.805926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:36:31.916044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:31.920884 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-610b6b33-231c-4a9c-9ad8-c9355fe645ae tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.289784 Aug 27 02:36:31.922678 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 821/1758] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:36:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:36:31.933433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:31.934002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:31.934449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:31.935045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1909008537", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:32.006977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:36:32.186314 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4582350b-3974-4318-8429-c3771e77a91c tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.587675 Aug 27 02:36:32.187692 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 938/1759] 10.222.0.99 () {58 vars in 1173 bytes} [Sat Aug 27 02:36:31 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:32.205931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0232c1e8-fd9a-436a-9bc4-78938b980d61 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:32.214353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0232c1e8-fd9a-436a-9bc4-78938b980d61 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:32.234938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:32.309206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0232c1e8-fd9a-436a-9bc4-78938b980d61 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:32.320380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0232c1e8-fd9a-436a-9bc4-78938b980d61 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:32.322574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0232c1e8-fd9a-436a-9bc4-78938b980d61 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:32.323830 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0232c1e8-fd9a-436a-9bc4-78938b980d61 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1279 microversion: 2.20 time: 0.134497 Aug 27 02:36:32.324582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 939/1760] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:32 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1279 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:36:32.335859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-87fcd253-b285-4a25-988c-8d7014681eca tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:32.337402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-87fcd253-b285-4a25-988c-8d7014681eca tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:32.348029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87fcd253-b285-4a25-988c-8d7014681eca tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:32.349056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87fcd253-b285-4a25-988c-8d7014681eca tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:32.351081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87fcd253-b285-4a25-988c-8d7014681eca tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:32.352749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87fcd253-b285-4a25-988c-8d7014681eca tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:32.353577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87fcd253-b285-4a25-988c-8d7014681eca tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:32.354591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87fcd253-b285-4a25-988c-8d7014681eca tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:32.417367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:36:32.417936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:36:32.418479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:36:32.418940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:36:32.419587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:36:32.435517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:32.436387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:32.436959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:32.438628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:32.439829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:32.440484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:32.506381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Getting quotas for project cae14cef7ebc402ea33301f9018b97df. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:36:32.522481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Getting quotas for user 77c841a899c04616a1ee3353ddd446c5 and project cae14cef7ebc402ea33301f9018b97df. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:36:32.567981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.utils [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] ram quota exceeded for cae14cef7ebc402ea33301f9018b97df, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122487) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 27 02:36:32.569406 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Request method failure captured: Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 145 Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYMg_ZIZGl25SlLbIC33abYyZwHBLydf23RPRLfobvFhrxyM8m_9Awz_FEH25DyUkk0t92Az7ir-lhf40vJeCmS-RvGMH7mqcWVSYITRP41FrwYxhd8qCe-uIbDH9s7IEIwBdrG26QFt35RBihvXQJbRpqBd1EJ4OSPQXNU2vwyeo6s Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cae14cef7ebc402ea33301f9018b97df Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cae14cef7ebc402ea33301f9018b97df"}]}] Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cae14cef7ebc402ea33301f9018b97df Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-QuotasAdminNegativeTest-1113567349-project Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 77c841a899c04616a1ee3353ddd446c5 Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-QuotasAdminNegativeTest-1113567349-project Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1909008537", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1909008537', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452'}}} Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:36:32.575088 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:36:32.590022 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-38f6f0ae-8385-49e6-9c91-e073f7909a3d tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.663675 Aug 27 02:36:32.597813 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 822/1761] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:36:31 2022] POST /compute/v2.1/servers => generated 110 bytes in 671 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:36:32.603196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:32.610018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:32.610635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.compute.servers [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Removing options 'limit' from query {{(pid=122487) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 02:36:32.611648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:32.625441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:32.626295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:32.628007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:32.629414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:32.631196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:32.632529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:32.734626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-87fcd253-b285-4a25-988c-8d7014681eca tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:32.751290 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-87fcd253-b285-4a25-988c-8d7014681eca tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1198 microversion: 2.1 time: 0.423476 Aug 27 02:36:32.766549 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 940/1762] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:32 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1198 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:32.787861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8b77f46c-e236-4110-8a58-733ed85ccb12 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:32.792342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8b77f46c-e236-4110-8a58-733ed85ccb12 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:32.800822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:32.806804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b77f46c-e236-4110-8a58-733ed85ccb12 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:32.808009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b77f46c-e236-4110-8a58-733ed85ccb12 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:32.808958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b77f46c-e236-4110-8a58-733ed85ccb12 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:32.810634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b77f46c-e236-4110-8a58-733ed85ccb12 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:32.811006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:32.811610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b77f46c-e236-4110-8a58-733ed85ccb12 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:32.812273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:32.812684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b77f46c-e236-4110-8a58-733ed85ccb12 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:32.813477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:32.918319 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8b77f46c-e236-4110-8a58-733ed85ccb12 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146990 Aug 27 02:36:32.919442 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 941/1763] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:36:32 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:32.935249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5fa11b24-e7f4-49b1-83b6-6f52739944be tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2e7cd310>, body: {"quota_set": {"ram": 51200}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:33.078974 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-46a36027-4a86-4514-bcc6-48352a5d7af1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.480480 Aug 27 02:36:33.080341 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 823/1764] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 02:36:32 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:33.106078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ac87d76-7def-4d4a-96d3-a81cc35f4016 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:33.112297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9ac87d76-7def-4d4a-96d3-a81cc35f4016 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:33.113293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9ac87d76-7def-4d4a-96d3-a81cc35f4016 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:33.120714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ac87d76-7def-4d4a-96d3-a81cc35f4016 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.121739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ac87d76-7def-4d4a-96d3-a81cc35f4016 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.122376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ac87d76-7def-4d4a-96d3-a81cc35f4016 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.123849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ac87d76-7def-4d4a-96d3-a81cc35f4016 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.124561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ac87d76-7def-4d4a-96d3-a81cc35f4016 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.125316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ac87d76-7def-4d4a-96d3-a81cc35f4016 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.237652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-9ac87d76-7def-4d4a-96d3-a81cc35f4016 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:36:33.399800 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9ac87d76-7def-4d4a-96d3-a81cc35f4016 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.297417 Aug 27 02:36:33.400732 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 824/1765] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:36:33 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:36:33.406987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:33.408121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:33.418880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.419709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.420407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.421730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.422434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.424064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.450481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa11b24-e7f4-49b1-83b6-6f52739944be tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.450981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa11b24-e7f4-49b1-83b6-6f52739944be tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.451427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa11b24-e7f4-49b1-83b6-6f52739944be tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.454894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa11b24-e7f4-49b1-83b6-6f52739944be tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.455488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa11b24-e7f4-49b1-83b6-6f52739944be tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.455933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa11b24-e7f4-49b1-83b6-6f52739944be tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.518609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:33.530783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:33.548921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:33.555536 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a2dd0c1c-82fe-426b-882a-fd8335d6e1ac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1331 microversion: 2.20 time: 0.148481 Aug 27 02:36:33.557994 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 825/1766] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:33 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1331 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:36:33.569752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:33.578831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:33.579321 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5fa11b24-e7f4-49b1-83b6-6f52739944be tempest-QuotasAdminNegativeTest-2106743963 tempest-QuotasAdminNegativeTest-2106743963-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df" status: 200 len: 329 microversion: 2.1 time: 0.658087 Aug 27 02:36:33.580377 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 942/1767] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:36:32 2022] PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df => generated 329 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:33.586974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.compute.servers [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Removing options 'limit' from query {{(pid=122487) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 02:36:33.588992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:33.595329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.596090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.596531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.597501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.597862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70b73d25-ea96-4b8e-9f29-9792308376e4 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Action: 'update', calling method: .version_select at 0x7f4d29a3e3a0>, body: {"quota_set": {"ram": 0}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:33.598119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.599075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.604057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-70b73d25-ea96-4b8e-9f29-9792308376e4 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '77c841a899c04616a1ee3353ddd446c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae14cef7ebc402ea33301f9018b97df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70b73d25-ea96-4b8e-9f29-9792308376e4 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Request method failure captured: Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df HTTP/1.1 Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 25 Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYMg_ZIZGl25SlLbIC33abYyZwHBLydf23RPRLfobvFhrxyM8m_9Awz_FEH25DyUkk0t92Az7ir-lhf40vJeCmS-RvGMH7mqcWVSYITRP41FrwYxhd8qCe-uIbDH9s7IEIwBdrG26QFt35RBihvXQJbRpqBd1EJ4OSPQXNU2vwyeo6s Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: cae14cef7ebc402ea33301f9018b97df Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cae14cef7ebc402ea33301f9018b97df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cae14cef7ebc402ea33301f9018b97df"}]}] Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: cae14cef7ebc402ea33301f9018b97df Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1113567349 Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-QuotasAdminNegativeTest-1113567349-project Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 77c841a899c04616a1ee3353ddd446c5 Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-QuotasAdminNegativeTest-1113567349-project Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: {"quota_set": {"ram": 0}} Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'cae14cef7ebc402ea33301f9018b97df', 'body': {'quota_set': {'ram': 0}}} Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:36:33.620293 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70b73d25-ea96-4b8e-9f29-9792308376e4 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70b73d25-ea96-4b8e-9f29-9792308376e4 tempest-QuotasAdminNegativeTest-1113567349 tempest-QuotasAdminNegativeTest-1113567349-project] 10.222.0.99 "PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df" status: 403 len: 116 microversion: 2.1 time: 0.029071 Aug 27 02:36:33.626990 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 943/1768] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:36:33 2022] PUT /compute/v2.1/os-quota-sets/cae14cef7ebc402ea33301f9018b97df => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:36:33.649050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:36:33.744014 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1bfe3999-539f-4bf5-955d-4c298d5230e7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.184621 Aug 27 02:36:33.744745 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 826/1769] 10.222.0.99 () {58 vars in 1150 bytes} [Sat Aug 27 02:36:33 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:33.758198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff047347-74b8-4c7c-9fa1-af2ee8f7ede4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:33.768247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ff047347-74b8-4c7c-9fa1-af2ee8f7ede4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:33.769083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ff047347-74b8-4c7c-9fa1-af2ee8f7ede4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:33.776339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff047347-74b8-4c7c-9fa1-af2ee8f7ede4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.776933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff047347-74b8-4c7c-9fa1-af2ee8f7ede4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.777487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff047347-74b8-4c7c-9fa1-af2ee8f7ede4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.778378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff047347-74b8-4c7c-9fa1-af2ee8f7ede4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.778934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff047347-74b8-4c7c-9fa1-af2ee8f7ede4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.779498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff047347-74b8-4c7c-9fa1-af2ee8f7ede4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.790112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-172b9284-aeb8-450a-8441-68a83a6d6dfb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:33.790851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-172b9284-aeb8-450a-8441-68a83a6d6dfb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:33.798507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-172b9284-aeb8-450a-8441-68a83a6d6dfb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.799434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-172b9284-aeb8-450a-8441-68a83a6d6dfb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.799625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-172b9284-aeb8-450a-8441-68a83a6d6dfb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.800391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-172b9284-aeb8-450a-8441-68a83a6d6dfb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.800955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-172b9284-aeb8-450a-8441-68a83a6d6dfb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.802135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-172b9284-aeb8-450a-8441-68a83a6d6dfb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.835372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-ff047347-74b8-4c7c-9fa1-af2ee8f7ede4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:36:33.908871 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff047347-74b8-4c7c-9fa1-af2ee8f7ede4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.154459 Aug 27 02:36:33.910473 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 944/1770] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 02:36:33 2022] GET /compute/v2.1/servers => generated 1010 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:33.925726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-55aca081-93a2-475a-911d-546550bbb6bc tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:33.937856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-55aca081-93a2-475a-911d-546550bbb6bc tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:33.937856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-55aca081-93a2-475a-911d-546550bbb6bc tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:33.951759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55aca081-93a2-475a-911d-546550bbb6bc tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.952294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55aca081-93a2-475a-911d-546550bbb6bc tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.953431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55aca081-93a2-475a-911d-546550bbb6bc tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:33.954390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55aca081-93a2-475a-911d-546550bbb6bc tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:33.954918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55aca081-93a2-475a-911d-546550bbb6bc tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:33.956052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55aca081-93a2-475a-911d-546550bbb6bc tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:34.242226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-55aca081-93a2-475a-911d-546550bbb6bc tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:36:34.483834 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-55aca081-93a2-475a-911d-546550bbb6bc tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.562659 Aug 27 02:36:34.484871 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 945/1771] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:36:33 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:34.510179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8943be98-6632-4c2a-8507-9c8d8c1d1232 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:34.517287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8943be98-6632-4c2a-8507-9c8d8c1d1232 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:34.530766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8943be98-6632-4c2a-8507-9c8d8c1d1232 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:34.532019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8943be98-6632-4c2a-8507-9c8d8c1d1232 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:34.533208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8943be98-6632-4c2a-8507-9c8d8c1d1232 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:34.534718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8943be98-6632-4c2a-8507-9c8d8c1d1232 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:34.535833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8943be98-6632-4c2a-8507-9c8d8c1d1232 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:34.538573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8943be98-6632-4c2a-8507-9c8d8c1d1232 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:34.628851 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8943be98-6632-4c2a-8507-9c8d8c1d1232 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136741 Aug 27 02:36:34.630665 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 946/1772] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:36:34 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:34.643927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c78f5d5-876d-4ac3-a8d4-a757ef090577 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:34.674281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4c78f5d5-876d-4ac3-a8d4-a757ef090577 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:34.675784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.compute.servers [None req-4c78f5d5-876d-4ac3-a8d4-a757ef090577 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Removing options 'limit' from query {{(pid=122488) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 02:36:34.677502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4c78f5d5-876d-4ac3-a8d4-a757ef090577 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:34.689695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c78f5d5-876d-4ac3-a8d4-a757ef090577 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:34.690568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c78f5d5-876d-4ac3-a8d4-a757ef090577 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:34.691238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c78f5d5-876d-4ac3-a8d4-a757ef090577 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:34.692402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c78f5d5-876d-4ac3-a8d4-a757ef090577 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:34.693126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c78f5d5-876d-4ac3-a8d4-a757ef090577 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:34.693843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c78f5d5-876d-4ac3-a8d4-a757ef090577 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:34.764474 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4c78f5d5-876d-4ac3-a8d4-a757ef090577 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.129550 Aug 27 02:36:34.766896 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 947/1773] 10.222.0.99 () {58 vars in 1140 bytes} [Sat Aug 27 02:36:34 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:34.773066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:34.774081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:34.786783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:34.788357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:34.789173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:34.791114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:34.791815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:34.792478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:34.874547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-172b9284-aeb8-450a-8441-68a83a6d6dfb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:34.891287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-172b9284-aeb8-450a-8441-68a83a6d6dfb tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1198 microversion: 2.1 time: 1.105639 Aug 27 02:36:34.892020 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 827/1774] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:33 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1198 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:34.899941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c8774549-8924-46b9-a4ab-ad43acd5916d tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:34.912288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:34.919557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c8774549-8924-46b9-a4ab-ad43acd5916d tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:34.920407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c8774549-8924-46b9-a4ab-ad43acd5916d tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-846876441', 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:36:34.924027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:34.925551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:34.926422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8774549-8924-46b9-a4ab-ad43acd5916d tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:34.926908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8774549-8924-46b9-a4ab-ad43acd5916d tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:34.927039 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5c465d91-64fc-434e-9a00-61f6425ebbb8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1337 microversion: 2.20 time: 0.158820 Aug 27 02:36:34.927385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8774549-8924-46b9-a4ab-ad43acd5916d tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:34.931770 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 948/1775] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:34 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1337 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:36:34.932833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8774549-8924-46b9-a4ab-ad43acd5916d tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:34.933458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8774549-8924-46b9-a4ab-ad43acd5916d tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:34.933966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8774549-8924-46b9-a4ab-ad43acd5916d tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:35.053919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-c8774549-8924-46b9-a4ab-ad43acd5916d tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:36:35.149586 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c8774549-8924-46b9-a4ab-ad43acd5916d tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-846876441" status: 200 len: 345 microversion: 2.1 time: 0.256369 Aug 27 02:36:35.151287 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 828/1776] 10.222.0.99 () {58 vars in 1240 bytes} [Sat Aug 27 02:36:34 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-846876441 => generated 345 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:35.168926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0bb7eab7-13f6-4118-b226-c003a983d42b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:35.182024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bb7eab7-13f6-4118-b226-c003a983d42b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:35.182913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bb7eab7-13f6-4118-b226-c003a983d42b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:35.183717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bb7eab7-13f6-4118-b226-c003a983d42b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:35.333903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0bb7eab7-13f6-4118-b226-c003a983d42b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Going to try to stop instance {{(pid=122488) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:36:35.438781 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0bb7eab7-13f6-4118-b226-c003a983d42b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "POST /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2/action" status: 202 len: 0 microversion: 2.1 time: 0.278996 Aug 27 02:36:35.441841 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 949/1777] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:36:35 2022] POST /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:36:35.453755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b4aa9a72-d130-4d7f-9b92-982b262adba4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:35.454823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b4aa9a72-d130-4d7f-9b92-982b262adba4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:35.469795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4aa9a72-d130-4d7f-9b92-982b262adba4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:35.473071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4aa9a72-d130-4d7f-9b92-982b262adba4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:35.473994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4aa9a72-d130-4d7f-9b92-982b262adba4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:35.477730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4aa9a72-d130-4d7f-9b92-982b262adba4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:35.478882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4aa9a72-d130-4d7f-9b92-982b262adba4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:35.479727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4aa9a72-d130-4d7f-9b92-982b262adba4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:35.514161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:35.649128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9619835f-7180-487d-8150-0636532c1040 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:35.651642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9619835f-7180-487d-8150-0636532c1040 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:35.659522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9619835f-7180-487d-8150-0636532c1040 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:35.660024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9619835f-7180-487d-8150-0636532c1040 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:35.660467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9619835f-7180-487d-8150-0636532c1040 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:35.661377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9619835f-7180-487d-8150-0636532c1040 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:35.661898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9619835f-7180-487d-8150-0636532c1040 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:35.662329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9619835f-7180-487d-8150-0636532c1040 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:35.705839 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9619835f-7180-487d-8150-0636532c1040 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061496 Aug 27 02:36:35.707119 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 950/1778] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:36:35 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:36:35.852074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b4aa9a72-d130-4d7f-9b92-982b262adba4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:35.892974 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b4aa9a72-d130-4d7f-9b92-982b262adba4 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1521 microversion: 2.1 time: 0.442147 Aug 27 02:36:35.896403 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 829/1779] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:35 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:35.915875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dbf8304c-8417-4736-ab67-5edbee96816e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:35.916741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dbf8304c-8417-4736-ab67-5edbee96816e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:35.925906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbf8304c-8417-4736-ab67-5edbee96816e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:35.926626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbf8304c-8417-4736-ab67-5edbee96816e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:35.927080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbf8304c-8417-4736-ab67-5edbee96816e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:35.927909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbf8304c-8417-4736-ab67-5edbee96816e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:35.929020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbf8304c-8417-4736-ab67-5edbee96816e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:35.929582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbf8304c-8417-4736-ab67-5edbee96816e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:35.958674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:35.963096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:35.989882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:35.998905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:36.000363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:36.001815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:36.002930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:36.003906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:36.231108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dbf8304c-8417-4736-ab67-5edbee96816e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:36.257219 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dbf8304c-8417-4736-ab67-5edbee96816e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1198 microversion: 2.1 time: 0.347755 Aug 27 02:36:36.260729 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 951/1780] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:35 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1198 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:36:36.295322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:36.313254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:36.315309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:36.316801 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c3718628-f7dc-45f7-b73b-80dfbc2aba81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1337 microversion: 2.20 time: 0.365624 Aug 27 02:36:36.331892 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 830/1781] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:35 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1337 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:36:36.723054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6ab9b6c7-c8e9-485e-8d79-b14074291267 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:36.732884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6ab9b6c7-c8e9-485e-8d79-b14074291267 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:36.751727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ab9b6c7-c8e9-485e-8d79-b14074291267 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:36.753175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ab9b6c7-c8e9-485e-8d79-b14074291267 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:36.756057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ab9b6c7-c8e9-485e-8d79-b14074291267 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:36.759440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ab9b6c7-c8e9-485e-8d79-b14074291267 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:36.760382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ab9b6c7-c8e9-485e-8d79-b14074291267 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:36.761049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ab9b6c7-c8e9-485e-8d79-b14074291267 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:36.847617 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6ab9b6c7-c8e9-485e-8d79-b14074291267 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129485 Aug 27 02:36:36.848721 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 952/1782] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:36:36 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:36.928890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3269535f-ee8e-4883-93de-361193e36845 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:36.931867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3269535f-ee8e-4883-93de-361193e36845 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:36.959421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3269535f-ee8e-4883-93de-361193e36845 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:36.961405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3269535f-ee8e-4883-93de-361193e36845 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:36.962489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3269535f-ee8e-4883-93de-361193e36845 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:36.967522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3269535f-ee8e-4883-93de-361193e36845 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:36.968567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3269535f-ee8e-4883-93de-361193e36845 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:36.969475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3269535f-ee8e-4883-93de-361193e36845 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:37.036415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cccc8f01-997b-4923-a362-3516223447f8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:37.037637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cccc8f01-997b-4923-a362-3516223447f8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:37.088504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cccc8f01-997b-4923-a362-3516223447f8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:37.089446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cccc8f01-997b-4923-a362-3516223447f8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:37.093221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cccc8f01-997b-4923-a362-3516223447f8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:37.094785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cccc8f01-997b-4923-a362-3516223447f8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:37.095671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cccc8f01-997b-4923-a362-3516223447f8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:37.096523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cccc8f01-997b-4923-a362-3516223447f8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:37.607850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3269535f-ee8e-4883-93de-361193e36845 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:37.635066 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3269535f-ee8e-4883-93de-361193e36845 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1521 microversion: 2.1 time: 0.714028 Aug 27 02:36:37.651521 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 831/1783] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:36 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1521 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:37.659072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-cccc8f01-997b-4923-a362-3516223447f8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:36:37.660063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-278927fd-cd79-45f7-9e28-b6a9aa25fa96 req-52e5a5ed-75e0-4f5d-a15f-762f75d87b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59462ca6-1830-4fae-a141-ffade28879f6", "name": "network-vif-plugged", "status": "completed", "tag": "b9a18ca7-1e41-4aa3-9c64-1d916f180dce"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:37.690525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-278927fd-cd79-45f7-9e28-b6a9aa25fa96 req-52e5a5ed-75e0-4f5d-a15f-762f75d87b13 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:37.691261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-278927fd-cd79-45f7-9e28-b6a9aa25fa96 req-52e5a5ed-75e0-4f5d-a15f-762f75d87b13 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:37.692262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-278927fd-cd79-45f7-9e28-b6a9aa25fa96 req-52e5a5ed-75e0-4f5d-a15f-762f75d87b13 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:37.695930 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cccc8f01-997b-4923-a362-3516223447f8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 2344 microversion: 2.25 time: 0.667123 Aug 27 02:36:37.710109 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 953/1784] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:37 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 2344 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:36:37.714722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd22a409-1eac-479e-975c-f580ff25c2f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:37.726959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd22a409-1eac-479e-975c-f580ff25c2f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:37.726959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd22a409-1eac-479e-975c-f580ff25c2f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:37.726959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd22a409-1eac-479e-975c-f580ff25c2f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:37.726959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd22a409-1eac-479e-975c-f580ff25c2f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:37.726959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd22a409-1eac-479e-975c-f580ff25c2f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:37.726959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd22a409-1eac-479e-975c-f580ff25c2f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:37.726959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd22a409-1eac-479e-975c-f580ff25c2f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:37.817090 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-278927fd-cd79-45f7-9e28-b6a9aa25fa96 req-52e5a5ed-75e0-4f5d-a15f-762f75d87b13 service nova] Creating event network-vif-plugged:b9a18ca7-1e41-4aa3-9c64-1d916f180dce for instance 59462ca6-1830-4fae-a141-ffade28879f6 on n-h1-852084-5 Aug 27 02:36:37.833013 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-278927fd-cd79-45f7-9e28-b6a9aa25fa96 req-52e5a5ed-75e0-4f5d-a15f-762f75d87b13 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179190 Aug 27 02:36:37.839712 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 832/1785] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:37.865407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:37.867235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:37.922396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:37.923409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:37.924321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:37.925506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:37.927275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:37.929119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:38.219165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd22a409-1eac-479e-975c-f580ff25c2f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:38.233105 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd22a409-1eac-479e-975c-f580ff25c2f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1198 microversion: 2.1 time: 0.534717 Aug 27 02:36:38.235453 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 954/1786] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:37 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1198 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:38.250057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-36e78e3a-b6b7-4a91-b00b-7ef64ef089e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:38.259982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36e78e3a-b6b7-4a91-b00b-7ef64ef089e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:38.260645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36e78e3a-b6b7-4a91-b00b-7ef64ef089e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:38.262194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36e78e3a-b6b7-4a91-b00b-7ef64ef089e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:38.263131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36e78e3a-b6b7-4a91-b00b-7ef64ef089e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:38.264262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36e78e3a-b6b7-4a91-b00b-7ef64ef089e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:38.264911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36e78e3a-b6b7-4a91-b00b-7ef64ef089e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:38.436664 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-36e78e3a-b6b7-4a91-b00b-7ef64ef089e8 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.199881 Aug 27 02:36:38.437847 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 955/1787] 10.222.0.99 () {60 vars in 1217 bytes} [Sat Aug 27 02:36:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:36:38.460657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5de9e0b7-8dd1-40e2-beb1-45dc76dc4af3 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:38.476261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5de9e0b7-8dd1-40e2-beb1-45dc76dc4af3 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:38.501449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de9e0b7-8dd1-40e2-beb1-45dc76dc4af3 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:38.504029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de9e0b7-8dd1-40e2-beb1-45dc76dc4af3 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:38.504767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de9e0b7-8dd1-40e2-beb1-45dc76dc4af3 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:38.514670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de9e0b7-8dd1-40e2-beb1-45dc76dc4af3 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:38.523020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de9e0b7-8dd1-40e2-beb1-45dc76dc4af3 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:38.524064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de9e0b7-8dd1-40e2-beb1-45dc76dc4af3 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:38.563580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:38.607640 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5de9e0b7-8dd1-40e2-beb1-45dc76dc4af3 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166400 Aug 27 02:36:38.612199 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 956/1788] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:36:38 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:38.661021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-053c9da5-ee01-4930-b19c-0b6ae34bdd07 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:38.662283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-053c9da5-ee01-4930-b19c-0b6ae34bdd07 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:38.679341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053c9da5-ee01-4930-b19c-0b6ae34bdd07 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:38.684834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053c9da5-ee01-4930-b19c-0b6ae34bdd07 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:38.688151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053c9da5-ee01-4930-b19c-0b6ae34bdd07 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:38.702324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053c9da5-ee01-4930-b19c-0b6ae34bdd07 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:38.703208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053c9da5-ee01-4930-b19c-0b6ae34bdd07 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:38.703947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053c9da5-ee01-4930-b19c-0b6ae34bdd07 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:38.946689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:38.964828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:38.977338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:38.981382 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1a1cab1e-62a8-44ae-8735-5c7ecac567d3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1405 microversion: 2.20 time: 1.124195 Aug 27 02:36:38.985592 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 833/1789] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:37 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1405 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:36:39.279976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cd0347b4-4c41-4515-a3f9-27ce563a3911 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:39.280983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cd0347b4-4c41-4515-a3f9-27ce563a3911 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:39.289425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd0347b4-4c41-4515-a3f9-27ce563a3911 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:39.308079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd0347b4-4c41-4515-a3f9-27ce563a3911 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:39.308684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd0347b4-4c41-4515-a3f9-27ce563a3911 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:39.309451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd0347b4-4c41-4515-a3f9-27ce563a3911 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:39.310014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd0347b4-4c41-4515-a3f9-27ce563a3911 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:39.310464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd0347b4-4c41-4515-a3f9-27ce563a3911 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:39.496923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-053c9da5-ee01-4930-b19c-0b6ae34bdd07 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:39.520827 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-053c9da5-ee01-4930-b19c-0b6ae34bdd07 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1521 microversion: 2.1 time: 0.859418 Aug 27 02:36:39.521699 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 957/1790] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:38 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1521 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:39.628315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-907dc584-b401-46a7-bd05-a2b45c8fb13b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:39.631042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-907dc584-b401-46a7-bd05-a2b45c8fb13b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:39.650808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-907dc584-b401-46a7-bd05-a2b45c8fb13b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:39.657322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-907dc584-b401-46a7-bd05-a2b45c8fb13b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:39.660736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-907dc584-b401-46a7-bd05-a2b45c8fb13b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:39.663394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-907dc584-b401-46a7-bd05-a2b45c8fb13b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:39.663898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-907dc584-b401-46a7-bd05-a2b45c8fb13b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:39.664411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-907dc584-b401-46a7-bd05-a2b45c8fb13b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:39.807226 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-907dc584-b401-46a7-bd05-a2b45c8fb13b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182965 Aug 27 02:36:39.818847 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 958/1791] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:36:39 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:40.013903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cd0347b4-4c41-4515-a3f9-27ce563a3911 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:40.020600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:40.022980 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cd0347b4-4c41-4515-a3f9-27ce563a3911 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1198 microversion: 2.1 time: 0.748882 Aug 27 02:36:40.030789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:40.031973 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 834/1792] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:39 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1198 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:40.063801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:40.065026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:40.066364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:40.068329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:40.073403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:40.074725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:40.425638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0277307d-4789-4ad5-b7b1-07c7e793c861 req-20aeb68e-0de2-4819-a4ca-00ec7bb1ab7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893e335c-913a-479a-9ee8-f61fc9a3b36f", "tag": "e392649a-1f13-4247-832b-e0b1080e8799"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:40.471949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0277307d-4789-4ad5-b7b1-07c7e793c861 req-20aeb68e-0de2-4819-a4ca-00ec7bb1ab7b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:40.472586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0277307d-4789-4ad5-b7b1-07c7e793c861 req-20aeb68e-0de2-4819-a4ca-00ec7bb1ab7b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:40.473049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0277307d-4789-4ad5-b7b1-07c7e793c861 req-20aeb68e-0de2-4819-a4ca-00ec7bb1ab7b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:40.519389 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0277307d-4789-4ad5-b7b1-07c7e793c861 req-20aeb68e-0de2-4819-a4ca-00ec7bb1ab7b service nova] Creating event network-changed:e392649a-1f13-4247-832b-e0b1080e8799 for instance 893e335c-913a-479a-9ee8-f61fc9a3b36f on n-h2-852084-5 Aug 27 02:36:40.578223 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0277307d-4789-4ad5-b7b1-07c7e793c861 req-20aeb68e-0de2-4819-a4ca-00ec7bb1ab7b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157417 Aug 27 02:36:40.592005 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 835/1793] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:40.634585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a8c26408-e2fc-4bcc-9bc8-e93768665bb2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:40.638226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a8c26408-e2fc-4bcc-9bc8-e93768665bb2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:40.668229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c26408-e2fc-4bcc-9bc8-e93768665bb2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:40.668725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c26408-e2fc-4bcc-9bc8-e93768665bb2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:40.686057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c26408-e2fc-4bcc-9bc8-e93768665bb2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:40.690851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c26408-e2fc-4bcc-9bc8-e93768665bb2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:40.691411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c26408-e2fc-4bcc-9bc8-e93768665bb2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:40.691873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c26408-e2fc-4bcc-9bc8-e93768665bb2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:41.397470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a8c26408-e2fc-4bcc-9bc8-e93768665bb2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:41.422994 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a8c26408-e2fc-4bcc-9bc8-e93768665bb2 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1521 microversion: 2.1 time: 0.829527 Aug 27 02:36:41.424404 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 836/1794] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:40 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1521 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:41.451817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1bb76a84-e00f-41c3-8d3c-ad65d9cd0545 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:41.454161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1bb76a84-e00f-41c3-8d3c-ad65d9cd0545 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:41.468871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bb76a84-e00f-41c3-8d3c-ad65d9cd0545 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:41.469382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bb76a84-e00f-41c3-8d3c-ad65d9cd0545 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:41.469862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bb76a84-e00f-41c3-8d3c-ad65d9cd0545 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:41.473131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bb76a84-e00f-41c3-8d3c-ad65d9cd0545 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:41.475729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bb76a84-e00f-41c3-8d3c-ad65d9cd0545 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:41.476941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bb76a84-e00f-41c3-8d3c-ad65d9cd0545 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:41.551551 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1bb76a84-e00f-41c3-8d3c-ad65d9cd0545 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111813 Aug 27 02:36:41.565766 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 837/1795] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:36:41 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:36:41.581100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-66aa20e6-fe6e-4fe6-83cd-0f11c12fdce8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:41.584171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-66aa20e6-fe6e-4fe6-83cd-0f11c12fdce8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:41.610278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66aa20e6-fe6e-4fe6-83cd-0f11c12fdce8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:41.616487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66aa20e6-fe6e-4fe6-83cd-0f11c12fdce8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:41.617738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66aa20e6-fe6e-4fe6-83cd-0f11c12fdce8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:41.619458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66aa20e6-fe6e-4fe6-83cd-0f11c12fdce8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:41.625115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66aa20e6-fe6e-4fe6-83cd-0f11c12fdce8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:41.630764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66aa20e6-fe6e-4fe6-83cd-0f11c12fdce8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:42.715899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-66aa20e6-fe6e-4fe6-83cd-0f11c12fdce8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:42.734146 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-66aa20e6-fe6e-4fe6-83cd-0f11c12fdce8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1198 microversion: 2.1 time: 1.166715 Aug 27 02:36:42.745943 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 838/1796] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:41 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1198 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:42.762040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-190059976", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "2304660c-5860-427d-ae1e-255b094fa94a"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:42.811354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=21 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:43.068089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] validate_networks() for [('2304660c-5860-427d-ae1e-255b094fa94a', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:36:43.434752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:43.458748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:43.461571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:43.463250 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0b17ed54-f0a1-4920-8b0d-7f167ac759d4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1405 microversion: 2.20 time: 3.450658 Aug 27 02:36:43.464225 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 959/1797] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:40 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1405 bytes in 3453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:36:43.487738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-42656ae9-1a68-40d7-b9be-b5ba1613248e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:43.496665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-42656ae9-1a68-40d7-b9be-b5ba1613248e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:43.511087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42656ae9-1a68-40d7-b9be-b5ba1613248e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:43.511925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42656ae9-1a68-40d7-b9be-b5ba1613248e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:43.512578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42656ae9-1a68-40d7-b9be-b5ba1613248e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:43.513590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42656ae9-1a68-40d7-b9be-b5ba1613248e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:43.514387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42656ae9-1a68-40d7-b9be-b5ba1613248e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:43.515069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42656ae9-1a68-40d7-b9be-b5ba1613248e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:43.945404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=58 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:44.758563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-42656ae9-1a68-40d7-b9be-b5ba1613248e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:44.772763 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-42656ae9-1a68-40d7-b9be-b5ba1613248e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1521 microversion: 2.1 time: 1.292005 Aug 27 02:36:44.773401 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 960/1798] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:43 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1521 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:44.793556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1bfd3ab9-00dc-484e-8ae5-5dbdd2142a80 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:44.798610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1bfd3ab9-00dc-484e-8ae5-5dbdd2142a80 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:44.842930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ab9-00dc-484e-8ae5-5dbdd2142a80 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:44.852410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ab9-00dc-484e-8ae5-5dbdd2142a80 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:44.853810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ab9-00dc-484e-8ae5-5dbdd2142a80 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:44.858688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ab9-00dc-484e-8ae5-5dbdd2142a80 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:44.871919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ab9-00dc-484e-8ae5-5dbdd2142a80 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:44.873319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd3ab9-00dc-484e-8ae5-5dbdd2142a80 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:44.967663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=16 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:45.319369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:36:45.320595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:36:45.322458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:36:45.323611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:36:45.324916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:36:45.431407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:45.432044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:45.432952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:45.433175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1bfd3ab9-00dc-484e-8ae5-5dbdd2142a80 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:45.445113 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1bfd3ab9-00dc-484e-8ae5-5dbdd2142a80 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1198 microversion: 2.1 time: 0.670564 Aug 27 02:36:45.446899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:45.458004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:45.459472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:45.462984 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 961/1799] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:44 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1198 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:45.475769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:45.476960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:45.493907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:45.494917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:45.495648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:45.498850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:45.499706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:45.500421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:45.572085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Getting quotas for project c45b216feebc4d898843009e9eb608ca. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:36:45.615582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Getting quotas for user 49945341feee4fd4b40ea30f385fc9f0 and project c45b216feebc4d898843009e9eb608ca. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:36:45.679078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:36:45.681578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:36:45.751241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:45.782164 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da6f9485-0376-498d-ae16-71a550f15042 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.036403 Aug 27 02:36:45.783506 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 839/1800] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:36:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:36:45.790845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7aba4a9-eb1a-4adb-8ae4-5d4deb897632 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54678e77-ca24-4d36-aa3f-3b052ce88a3b", "device": "/dev/xvdb"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:45.796220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b7aba4a9-eb1a-4adb-8ae4-5d4deb897632 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:45.809749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7aba4a9-eb1a-4adb-8ae4-5d4deb897632 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:45.810672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7aba4a9-eb1a-4adb-8ae4-5d4deb897632 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:45.811775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7aba4a9-eb1a-4adb-8ae4-5d4deb897632 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:45.813067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7aba4a9-eb1a-4adb-8ae4-5d4deb897632 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:45.813810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7aba4a9-eb1a-4adb-8ae4-5d4deb897632 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:45.814505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7aba4a9-eb1a-4adb-8ae4-5d4deb897632 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:46.311940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:46.332531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:46.339578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:46.340823 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-79413bbc-7c25-497f-9bc7-b79dd77f084d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1405 microversion: 2.20 time: 0.876410 Aug 27 02:36:46.348081 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 962/1801] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:45 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1405 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:36:46.375157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-30d27150-f5f0-4fd2-90ba-7603c09bb6f2 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:46.375799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-30d27150-f5f0-4fd2-90ba-7603c09bb6f2 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:46.562041 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7aba4a9-eb1a-4adb-8ae4-5d4deb897632 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "POST /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.776615 Aug 27 02:36:46.563726 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 840/1802] 10.222.0.99 () {62 vars in 1364 bytes} [Sat Aug 27 02:36:45 2022] POST /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments => generated 194 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:36:46.581489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f04783ac-17ac-46b9-b5ac-7935d514f428 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:46.589909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f04783ac-17ac-46b9-b5ac-7935d514f428 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:46.616326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f04783ac-17ac-46b9-b5ac-7935d514f428 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:46.624201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f04783ac-17ac-46b9-b5ac-7935d514f428 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:46.624851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f04783ac-17ac-46b9-b5ac-7935d514f428 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:46.625646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f04783ac-17ac-46b9-b5ac-7935d514f428 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:46.630173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f04783ac-17ac-46b9-b5ac-7935d514f428 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:46.630769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f04783ac-17ac-46b9-b5ac-7935d514f428 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:46.666528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-30d27150-f5f0-4fd2-90ba-7603c09bb6f2 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:46.684867 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-30d27150-f5f0-4fd2-90ba-7603c09bb6f2 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1217 microversion: 2.1 time: 0.326195 Aug 27 02:36:46.701283 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 963/1803] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:46 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1217 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:46.726672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-47a63b60-f55b-4649-8808-57c728b72266 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:46.733431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-47a63b60-f55b-4649-8808-57c728b72266 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:46.760903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47a63b60-f55b-4649-8808-57c728b72266 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:46.766596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47a63b60-f55b-4649-8808-57c728b72266 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:46.767198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47a63b60-f55b-4649-8808-57c728b72266 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:46.767992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47a63b60-f55b-4649-8808-57c728b72266 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:46.768499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47a63b60-f55b-4649-8808-57c728b72266 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:46.769179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47a63b60-f55b-4649-8808-57c728b72266 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:47.441469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f04783ac-17ac-46b9-b5ac-7935d514f428 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:47.457534 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f04783ac-17ac-46b9-b5ac-7935d514f428 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1521 microversion: 2.1 time: 0.892144 Aug 27 02:36:47.462806 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 841/1804] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:46 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1521 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:47.480768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:47.482735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:47.504504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:47.511375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:47.512196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:47.513179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:47.517334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:47.518095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:47.701368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-47a63b60-f55b-4649-8808-57c728b72266 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:47.733458 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-47a63b60-f55b-4649-8808-57c728b72266 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1198 microversion: 2.1 time: 1.030695 Aug 27 02:36:47.737973 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 964/1805] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:46 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1198 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:47.754651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f32cd8f-2235-4a91-a615-663794c7e583 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:47.755645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9f32cd8f-2235-4a91-a615-663794c7e583 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:47.779766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f32cd8f-2235-4a91-a615-663794c7e583 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:47.780844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f32cd8f-2235-4a91-a615-663794c7e583 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:47.784693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f32cd8f-2235-4a91-a615-663794c7e583 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:47.785747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f32cd8f-2235-4a91-a615-663794c7e583 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:47.788594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f32cd8f-2235-4a91-a615-663794c7e583 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:47.789262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f32cd8f-2235-4a91-a615-663794c7e583 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:48.127544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9f32cd8f-2235-4a91-a615-663794c7e583 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:48.146398 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9f32cd8f-2235-4a91-a615-663794c7e583 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1269 microversion: 2.1 time: 0.406981 Aug 27 02:36:48.148707 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 965/1806] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:47 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1269 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:48.165874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ba161227-181d-4923-953f-def9c31107a5 req-b16cf7ba-868f-47eb-b262-21c08c83ef97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cd0655-58b7-4731-84ce-199edeea0cac", "name": "network-vif-plugged", "status": "completed", "tag": "a95780ce-8687-4bd3-a6a0-0a05511992af"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:48.228283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ba161227-181d-4923-953f-def9c31107a5 req-b16cf7ba-868f-47eb-b262-21c08c83ef97 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:48.228779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ba161227-181d-4923-953f-def9c31107a5 req-b16cf7ba-868f-47eb-b262-21c08c83ef97 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:48.233568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ba161227-181d-4923-953f-def9c31107a5 req-b16cf7ba-868f-47eb-b262-21c08c83ef97 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:48.265270 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ba161227-181d-4923-953f-def9c31107a5 req-b16cf7ba-868f-47eb-b262-21c08c83ef97 service nova] Creating event network-vif-plugged:a95780ce-8687-4bd3-a6a0-0a05511992af for instance b8cd0655-58b7-4731-84ce-199edeea0cac on n-h1-852084-5 Aug 27 02:36:48.277852 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ba161227-181d-4923-953f-def9c31107a5 req-b16cf7ba-868f-47eb-b262-21c08c83ef97 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121220 Aug 27 02:36:48.284819 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 966/1807] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:48.355016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:48.370839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:48.373051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:48.379923 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-acac9792-47c1-4c5a-8dea-c3070c35c66d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1405 microversion: 2.20 time: 0.914852 Aug 27 02:36:48.398374 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 842/1808] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:47 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1405 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:36:48.487177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1f01f4d2-11c4-4b53-8079-c3d78858a625 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:48.488082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1f01f4d2-11c4-4b53-8079-c3d78858a625 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:48.491091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=26 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:48.527171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f01f4d2-11c4-4b53-8079-c3d78858a625 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:48.528052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f01f4d2-11c4-4b53-8079-c3d78858a625 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:48.528521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f01f4d2-11c4-4b53-8079-c3d78858a625 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:48.529299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f01f4d2-11c4-4b53-8079-c3d78858a625 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:48.531076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f01f4d2-11c4-4b53-8079-c3d78858a625 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:48.532391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f01f4d2-11c4-4b53-8079-c3d78858a625 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:48.783385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-116ca24c-1244-45b5-948c-9ed1f74513d4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:48.784414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-116ca24c-1244-45b5-948c-9ed1f74513d4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:48.800124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-116ca24c-1244-45b5-948c-9ed1f74513d4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:48.805220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-116ca24c-1244-45b5-948c-9ed1f74513d4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:48.806119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-116ca24c-1244-45b5-948c-9ed1f74513d4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:48.812831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-116ca24c-1244-45b5-948c-9ed1f74513d4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:48.813814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-116ca24c-1244-45b5-948c-9ed1f74513d4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:48.814465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-116ca24c-1244-45b5-948c-9ed1f74513d4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:49.155739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f01f4d2-11c4-4b53-8079-c3d78858a625 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:49.170458 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1f01f4d2-11c4-4b53-8079-c3d78858a625 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1521 microversion: 2.1 time: 0.688996 Aug 27 02:36:49.175320 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 967/1809] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:48 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1521 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:49.194512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-77afecae-0766-4c91-9016-ba195fe5535e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:49.195151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-77afecae-0766-4c91-9016-ba195fe5535e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:49.216130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77afecae-0766-4c91-9016-ba195fe5535e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:49.217093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77afecae-0766-4c91-9016-ba195fe5535e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:49.218829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77afecae-0766-4c91-9016-ba195fe5535e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:49.220011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77afecae-0766-4c91-9016-ba195fe5535e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:49.220775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77afecae-0766-4c91-9016-ba195fe5535e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:49.221460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77afecae-0766-4c91-9016-ba195fe5535e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:49.371988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-77afecae-0766-4c91-9016-ba195fe5535e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:49.384858 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-77afecae-0766-4c91-9016-ba195fe5535e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1275 microversion: 2.1 time: 0.194677 Aug 27 02:36:49.389029 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 968/1810] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:49 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:49.415528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:49.416612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:49.436159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:49.440897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:49.446134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:49.447381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:49.451672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:49.453413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:49.580535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-116ca24c-1244-45b5-948c-9ed1f74513d4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:49.592210 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-116ca24c-1244-45b5-948c-9ed1f74513d4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1198 microversion: 2.1 time: 0.815825 Aug 27 02:36:49.613724 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 843/1811] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:48 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1198 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:36:50.056741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:50.094141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:50.097417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:50.117887 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ade1096-f1bb-4e49-966e-1e6c3028e82a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1405 microversion: 2.20 time: 0.690597 Aug 27 02:36:50.119050 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 969/1812] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:49 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1405 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:36:50.205532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-11b781ae-e57a-487b-8cc6-9a31978ef191 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:50.211651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-11b781ae-e57a-487b-8cc6-9a31978ef191 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:50.258053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11b781ae-e57a-487b-8cc6-9a31978ef191 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:50.292434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11b781ae-e57a-487b-8cc6-9a31978ef191 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:50.293823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11b781ae-e57a-487b-8cc6-9a31978ef191 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:50.300232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11b781ae-e57a-487b-8cc6-9a31978ef191 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:50.301508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11b781ae-e57a-487b-8cc6-9a31978ef191 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:50.305965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11b781ae-e57a-487b-8cc6-9a31978ef191 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:50.419577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-587a995c-4c1b-419b-ad09-835a82026839 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:50.420965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-587a995c-4c1b-419b-ad09-835a82026839 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:50.452802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587a995c-4c1b-419b-ad09-835a82026839 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:50.453293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587a995c-4c1b-419b-ad09-835a82026839 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:50.462504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587a995c-4c1b-419b-ad09-835a82026839 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:50.464149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587a995c-4c1b-419b-ad09-835a82026839 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:50.466711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587a995c-4c1b-419b-ad09-835a82026839 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:50.467516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587a995c-4c1b-419b-ad09-835a82026839 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:50.727780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-11b781ae-e57a-487b-8cc6-9a31978ef191 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:50.739629 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-11b781ae-e57a-487b-8cc6-9a31978ef191 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1521 microversion: 2.1 time: 0.542285 Aug 27 02:36:50.743655 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 844/1813] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:50 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1521 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:50.750409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4cb9a580-cbbc-41d7-a468-23250047788a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:50.751471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4cb9a580-cbbc-41d7-a468-23250047788a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:50.786877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cb9a580-cbbc-41d7-a468-23250047788a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:50.788425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cb9a580-cbbc-41d7-a468-23250047788a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:50.789440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cb9a580-cbbc-41d7-a468-23250047788a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:50.790728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cb9a580-cbbc-41d7-a468-23250047788a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:50.791486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cb9a580-cbbc-41d7-a468-23250047788a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:50.792182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cb9a580-cbbc-41d7-a468-23250047788a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:50.859913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-587a995c-4c1b-419b-ad09-835a82026839 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:50.888445 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-587a995c-4c1b-419b-ad09-835a82026839 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1275 microversion: 2.1 time: 0.480392 Aug 27 02:36:50.903056 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 970/1814] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:50 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1275 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:51.146126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:51.149278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:51.180739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:51.181646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:51.188392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:51.189802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:51.190498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:51.196475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:51.744303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4cb9a580-cbbc-41d7-a468-23250047788a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:51.788604 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4cb9a580-cbbc-41d7-a468-23250047788a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1198 microversion: 2.1 time: 1.043127 Aug 27 02:36:51.803859 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 845/1815] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:50 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1198 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:51.819641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-17e75d61-6b1e-4239-9622-4ad43704b99a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:51.820591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-17e75d61-6b1e-4239-9622-4ad43704b99a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:51.828764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17e75d61-6b1e-4239-9622-4ad43704b99a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:51.829613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17e75d61-6b1e-4239-9622-4ad43704b99a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:51.830294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17e75d61-6b1e-4239-9622-4ad43704b99a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:51.832707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17e75d61-6b1e-4239-9622-4ad43704b99a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:51.833501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17e75d61-6b1e-4239-9622-4ad43704b99a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:51.834822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17e75d61-6b1e-4239-9622-4ad43704b99a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:51.875884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:51.908848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:51.939359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:51.954376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:51.955910 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7f69dd04-c9d5-4666-98d4-342df7111aa7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1405 microversion: 2.20 time: 0.818607 Aug 27 02:36:51.963381 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 971/1816] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:51 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1405 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:36:51.986282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d7da0ef-592b-46ca-8e4b-335f9906d9a7 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:51.995985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1d7da0ef-592b-46ca-8e4b-335f9906d9a7 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:52.052712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7da0ef-592b-46ca-8e4b-335f9906d9a7 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:52.059673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7da0ef-592b-46ca-8e4b-335f9906d9a7 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:52.064911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7da0ef-592b-46ca-8e4b-335f9906d9a7 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:52.070333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7da0ef-592b-46ca-8e4b-335f9906d9a7 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:52.072075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7da0ef-592b-46ca-8e4b-335f9906d9a7 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:52.075377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7da0ef-592b-46ca-8e4b-335f9906d9a7 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:52.626199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1d7da0ef-592b-46ca-8e4b-335f9906d9a7 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:52.645351 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1d7da0ef-592b-46ca-8e4b-335f9906d9a7 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1317 microversion: 2.1 time: 0.679415 Aug 27 02:36:52.646180 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 972/1817] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:51 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:52.663149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-dbd6536b-2b8d-4acd-b50a-94d85490b893 req-f910ba1c-c62e-4580-b054-92534f9abb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893e335c-913a-479a-9ee8-f61fc9a3b36f", "name": "network-vif-plugged", "status": "completed", "tag": "e392649a-1f13-4247-832b-e0b1080e8799"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:52.698520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dbd6536b-2b8d-4acd-b50a-94d85490b893 req-f910ba1c-c62e-4580-b054-92534f9abb51 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:52.699793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dbd6536b-2b8d-4acd-b50a-94d85490b893 req-f910ba1c-c62e-4580-b054-92534f9abb51 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:52.700910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dbd6536b-2b8d-4acd-b50a-94d85490b893 req-f910ba1c-c62e-4580-b054-92534f9abb51 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:52.751430 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-dbd6536b-2b8d-4acd-b50a-94d85490b893 req-f910ba1c-c62e-4580-b054-92534f9abb51 service nova] Creating event network-vif-plugged:e392649a-1f13-4247-832b-e0b1080e8799 for instance 893e335c-913a-479a-9ee8-f61fc9a3b36f on n-h2-852084-5 Aug 27 02:36:52.764843 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-dbd6536b-2b8d-4acd-b50a-94d85490b893 req-f910ba1c-c62e-4580-b054-92534f9abb51 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116581 Aug 27 02:36:52.772225 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 973/1818] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:36:52.841305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7f5f9508-74da-4691-a7db-27bf5d8339c7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:52.858115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7f5f9508-74da-4691-a7db-27bf5d8339c7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:52.895676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f5f9508-74da-4691-a7db-27bf5d8339c7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:52.900498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f5f9508-74da-4691-a7db-27bf5d8339c7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:52.910350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f5f9508-74da-4691-a7db-27bf5d8339c7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:52.912796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f5f9508-74da-4691-a7db-27bf5d8339c7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:52.918873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f5f9508-74da-4691-a7db-27bf5d8339c7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:52.919829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f5f9508-74da-4691-a7db-27bf5d8339c7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:52.995302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-17e75d61-6b1e-4239-9622-4ad43704b99a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:53.059703 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-17e75d61-6b1e-4239-9622-4ad43704b99a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1521 microversion: 2.1 time: 1.254200 Aug 27 02:36:53.087832 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 846/1819] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:51 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1521 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:53.119983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:53.123469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:53.160900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:53.164493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:53.166284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:53.177537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:53.179178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:53.180391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:53.525229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7f5f9508-74da-4691-a7db-27bf5d8339c7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:53.570266 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7f5f9508-74da-4691-a7db-27bf5d8339c7 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1382 microversion: 2.1 time: 0.737872 Aug 27 02:36:53.574321 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 974/1820] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:52 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1382 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:36:54.275218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8844243a-a1f4-4515-8cb1-8a6ef1354cc4 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:54.275993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8844243a-a1f4-4515-8cb1-8a6ef1354cc4 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:54.293404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8844243a-a1f4-4515-8cb1-8a6ef1354cc4 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:54.295474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8844243a-a1f4-4515-8cb1-8a6ef1354cc4 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:54.298302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8844243a-a1f4-4515-8cb1-8a6ef1354cc4 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:54.306497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8844243a-a1f4-4515-8cb1-8a6ef1354cc4 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:54.309111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8844243a-a1f4-4515-8cb1-8a6ef1354cc4 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:54.309732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8844243a-a1f4-4515-8cb1-8a6ef1354cc4 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:54.387404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:54.429134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:54.443899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:54.450768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:54.452288 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f68dc466-efad-433f-85a0-e98f4c01956c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1405 microversion: 2.20 time: 1.361972 Aug 27 02:36:54.471021 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 847/1821] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:53 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1405 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:36:54.491332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de2c86b0-35c6-4cc7-a980-90483f81385b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:54.496669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de2c86b0-35c6-4cc7-a980-90483f81385b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:54.513487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de2c86b0-35c6-4cc7-a980-90483f81385b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:54.514407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de2c86b0-35c6-4cc7-a980-90483f81385b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:54.515847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de2c86b0-35c6-4cc7-a980-90483f81385b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:54.518237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de2c86b0-35c6-4cc7-a980-90483f81385b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:54.519747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de2c86b0-35c6-4cc7-a980-90483f81385b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:54.521138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de2c86b0-35c6-4cc7-a980-90483f81385b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:55.022562 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8844243a-a1f4-4515-8cb1-8a6ef1354cc4 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1533 microversion: 2.1 time: 1.404981 Aug 27 02:36:55.023192 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 975/1822] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:53 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1533 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:55.049477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5969868-2641-492a-9211-03d923b4c799 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:55.062064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e5969868-2641-492a-9211-03d923b4c799 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:55.094394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5969868-2641-492a-9211-03d923b4c799 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:55.095334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5969868-2641-492a-9211-03d923b4c799 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:55.096154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5969868-2641-492a-9211-03d923b4c799 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:55.097567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5969868-2641-492a-9211-03d923b4c799 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:55.118467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5969868-2641-492a-9211-03d923b4c799 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:55.118929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5969868-2641-492a-9211-03d923b4c799 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:55.504909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:55.643986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:55.661706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e5969868-2641-492a-9211-03d923b4c799 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:55.694921 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e5969868-2641-492a-9211-03d923b4c799 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1521 microversion: 2.1 time: 0.670204 Aug 27 02:36:55.704479 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 976/1823] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:55 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1521 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:55.733561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-512e447e-3fbc-4782-a71e-63adfffe6ca1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:55.735164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-512e447e-3fbc-4782-a71e-63adfffe6ca1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:55.753922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-512e447e-3fbc-4782-a71e-63adfffe6ca1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:55.755636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-512e447e-3fbc-4782-a71e-63adfffe6ca1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:55.756911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-512e447e-3fbc-4782-a71e-63adfffe6ca1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:55.759142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-512e447e-3fbc-4782-a71e-63adfffe6ca1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:55.760342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-512e447e-3fbc-4782-a71e-63adfffe6ca1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:55.766005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-512e447e-3fbc-4782-a71e-63adfffe6ca1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:55.954318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de2c86b0-35c6-4cc7-a980-90483f81385b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:55.987929 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de2c86b0-35c6-4cc7-a980-90483f81385b tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1317 microversion: 2.1 time: 1.512846 Aug 27 02:36:55.994259 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 848/1824] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:54 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1317 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:56.007870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:56.013067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:56.037047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:56.038435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:56.047902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:56.050591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:56.055166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:56.057083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:56.308940 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-512e447e-3fbc-4782-a71e-63adfffe6ca1 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1533 microversion: 2.1 time: 0.597282 Aug 27 02:36:56.324759 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 977/1825] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:55 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1533 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:56.356612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-18cf72a5-cc43-42d3-b41a-09416a93a160 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:56.380581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18cf72a5-cc43-42d3-b41a-09416a93a160 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:56.380581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18cf72a5-cc43-42d3-b41a-09416a93a160 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:56.388509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18cf72a5-cc43-42d3-b41a-09416a93a160 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:56.390859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18cf72a5-cc43-42d3-b41a-09416a93a160 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:56.402844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18cf72a5-cc43-42d3-b41a-09416a93a160 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:56.405571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18cf72a5-cc43-42d3-b41a-09416a93a160 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:56.518948 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-18cf72a5-cc43-42d3-b41a-09416a93a160 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.167279 Aug 27 02:36:56.522151 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 978/1826] 10.222.0.99 () {58 vars in 1176 bytes} [Sat Aug 27 02:36:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:36:56.536545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9cfaa306-a6be-45d6-9d8c-d337ed0b8545 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852084-5", "block_migration": false, "disk_over_commit": false}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:36:56.545602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9cfaa306-a6be-45d6-9d8c-d337ed0b8545 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:56.569533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:56.579473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cfaa306-a6be-45d6-9d8c-d337ed0b8545 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:56.582311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cfaa306-a6be-45d6-9d8c-d337ed0b8545 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:56.587330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cfaa306-a6be-45d6-9d8c-d337ed0b8545 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:56.589181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cfaa306-a6be-45d6-9d8c-d337ed0b8545 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:56.590786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cfaa306-a6be-45d6-9d8c-d337ed0b8545 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:56.598204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cfaa306-a6be-45d6-9d8c-d337ed0b8545 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:56.700026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:36:56.712410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-9cfaa306-a6be-45d6-9d8c-d337ed0b8545 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lazy-loading 'flavor' on Instance uuid b8cd0655-58b7-4731-84ce-199edeea0cac {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:36:56.772120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9cfaa306-a6be-45d6-9d8c-d337ed0b8545 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Going to try to live migrate instance to n-h2-852084-5 {{(pid=122488) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:36:57.287165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:57.325000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:57.343119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:57.350768 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-43bc8eb4-4c57-4c42-9c4e-5c54bdd0387a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1596 microversion: 2.20 time: 1.351021 Aug 27 02:36:57.354073 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 849/1827] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:36:55 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1596 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:36:57.384928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eff40783-dbd3-4d5d-a31b-7de83ffeb970 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:57.390371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eff40783-dbd3-4d5d-a31b-7de83ffeb970 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:57.422343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eff40783-dbd3-4d5d-a31b-7de83ffeb970 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:57.430635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eff40783-dbd3-4d5d-a31b-7de83ffeb970 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:57.435343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eff40783-dbd3-4d5d-a31b-7de83ffeb970 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:57.438993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eff40783-dbd3-4d5d-a31b-7de83ffeb970 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:57.443474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eff40783-dbd3-4d5d-a31b-7de83ffeb970 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:57.448520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eff40783-dbd3-4d5d-a31b-7de83ffeb970 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:59.667077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eff40783-dbd3-4d5d-a31b-7de83ffeb970 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:36:59.694524 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eff40783-dbd3-4d5d-a31b-7de83ffeb970 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1498 microversion: 2.1 time: 2.338632 Aug 27 02:36:59.696067 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 850/1828] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:57 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1498 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:36:59.713622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e1be05bd-3378-458e-8f31-f3186fac40a9 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:36:59.720247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e1be05bd-3378-458e-8f31-f3186fac40a9 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:36:59.743433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1be05bd-3378-458e-8f31-f3186fac40a9 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:59.757892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1be05bd-3378-458e-8f31-f3186fac40a9 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:59.758791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1be05bd-3378-458e-8f31-f3186fac40a9 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:36:59.773030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1be05bd-3378-458e-8f31-f3186fac40a9 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:36:59.774855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1be05bd-3378-458e-8f31-f3186fac40a9 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:36:59.784788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1be05bd-3378-458e-8f31-f3186fac40a9 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:00.454072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e1be05bd-3378-458e-8f31-f3186fac40a9 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:00.472243 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e1be05bd-3378-458e-8f31-f3186fac40a9 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1317 microversion: 2.1 time: 0.770675 Aug 27 02:37:00.473658 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 851/1829] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:36:59 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1317 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:00.492024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-f2437ff1-9915-42e9-b50f-3cc8df6f6fcc req-22a3504e-2982-4461-b37a-24bff003b7af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb53d1e-63f2-4506-97fd-353b5d7f4156", "tag": "bad964c1-20ba-4d8e-a6a2-21fae1298e94"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:00.507678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f2437ff1-9915-42e9-b50f-3cc8df6f6fcc req-22a3504e-2982-4461-b37a-24bff003b7af service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:00.508510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f2437ff1-9915-42e9-b50f-3cc8df6f6fcc req-22a3504e-2982-4461-b37a-24bff003b7af service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:00.509153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f2437ff1-9915-42e9-b50f-3cc8df6f6fcc req-22a3504e-2982-4461-b37a-24bff003b7af service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:00.541447 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-f2437ff1-9915-42e9-b50f-3cc8df6f6fcc req-22a3504e-2982-4461-b37a-24bff003b7af service nova] Creating event network-changed:bad964c1-20ba-4d8e-a6a2-21fae1298e94 for instance 1eb53d1e-63f2-4506-97fd-353b5d7f4156 on n-h2-852084-5 Aug 27 02:37:00.561022 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-f2437ff1-9915-42e9-b50f-3cc8df6f6fcc req-22a3504e-2982-4461-b37a-24bff003b7af service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075304 Aug 27 02:37:00.561846 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 852/1830] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:00.700645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1894014967", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:01.097429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:37:02.073400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:37:02.075080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:37:02.075899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:37:02.076732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:37:02.077331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:37:02.105360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:02.106355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:02.107018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:02.108163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:02.108835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:02.109477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:02.146916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Getting quotas for project 880503f29a6140d689df06229a0c81d9. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:37:02.155746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Getting quotas for user 316c412ee28c4faba94ff0d8c2484bae and project 880503f29a6140d689df06229a0c81d9. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:37:02.175369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:37:02.179990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:37:02.313601 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7aff4f0b-13b2-4133-8383-4e91257b86c7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.745688 Aug 27 02:37:02.324680 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 853/1831] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:37:02.350307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-319009f1-fa44-4fa5-a5b3-6e38445265b5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:02.354757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-319009f1-fa44-4fa5-a5b3-6e38445265b5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:02.394729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-319009f1-fa44-4fa5-a5b3-6e38445265b5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:02.398044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-319009f1-fa44-4fa5-a5b3-6e38445265b5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:02.400237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-319009f1-fa44-4fa5-a5b3-6e38445265b5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:02.403813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-319009f1-fa44-4fa5-a5b3-6e38445265b5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:02.408445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-319009f1-fa44-4fa5-a5b3-6e38445265b5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:02.437308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-319009f1-fa44-4fa5-a5b3-6e38445265b5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:02.666518 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9cfaa306-a6be-45d6-9d8c-d337ed0b8545 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac/action" status: 202 len: 0 microversion: 2.1 time: 6.137152 Aug 27 02:37:02.670437 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 979/1832] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:36:56 2022] POST /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac/action => generated 0 bytes in 6139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:37:02.672972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eb1fed79-2089-47d0-9730-114a01ec8ce1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:02.703335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eb1fed79-2089-47d0-9730-114a01ec8ce1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:02.704273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eb1fed79-2089-47d0-9730-114a01ec8ce1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:37:02.753823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb1fed79-2089-47d0-9730-114a01ec8ce1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:02.762421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb1fed79-2089-47d0-9730-114a01ec8ce1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:02.762944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb1fed79-2089-47d0-9730-114a01ec8ce1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:02.772844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb1fed79-2089-47d0-9730-114a01ec8ce1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:02.773596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb1fed79-2089-47d0-9730-114a01ec8ce1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:02.774114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb1fed79-2089-47d0-9730-114a01ec8ce1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:02.969383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-eb1fed79-2089-47d0-9730-114a01ec8ce1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:37:03.052412 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-319009f1-fa44-4fa5-a5b3-6e38445265b5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.725404 Aug 27 02:37:03.052843 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eb1fed79-2089-47d0-9730-114a01ec8ce1 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.383517 Aug 27 02:37:03.061364 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 980/1833] 10.222.0.99 () {58 vars in 1154 bytes} [Sat Aug 27 02:37:02 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:03.064110 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 854/1834] 10.222.0.99 () {60 vars in 1316 bytes} [Sat Aug 27 02:37:02 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-interface => generated 285 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:37:03.078215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4932a026-d614-4e10-a293-6a85da8b90d6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:03.079263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4932a026-d614-4e10-a293-6a85da8b90d6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:03.085433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-db99eb0d-9629-4766-86ac-e06ace1bbd52 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:03.086106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-db99eb0d-9629-4766-86ac-e06ace1bbd52 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:03.114058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db99eb0d-9629-4766-86ac-e06ace1bbd52 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:03.116400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db99eb0d-9629-4766-86ac-e06ace1bbd52 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:03.121050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db99eb0d-9629-4766-86ac-e06ace1bbd52 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:03.124348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db99eb0d-9629-4766-86ac-e06ace1bbd52 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:03.126802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db99eb0d-9629-4766-86ac-e06ace1bbd52 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:03.126802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db99eb0d-9629-4766-86ac-e06ace1bbd52 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:03.494339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4932a026-d614-4e10-a293-6a85da8b90d6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:03.509357 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4932a026-d614-4e10-a293-6a85da8b90d6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1222 microversion: 2.1 time: 0.443323 Aug 27 02:37:03.511519 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 855/1835] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:03 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1222 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:03.529316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e1b1702b-faea-4883-a876-09726c7a3316 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:03.534599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e1b1702b-faea-4883-a876-09726c7a3316 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:03.564171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1b1702b-faea-4883-a876-09726c7a3316 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:03.565279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1b1702b-faea-4883-a876-09726c7a3316 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:03.568018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1b1702b-faea-4883-a876-09726c7a3316 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:03.573043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1b1702b-faea-4883-a876-09726c7a3316 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:03.575934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1b1702b-faea-4883-a876-09726c7a3316 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:03.578146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1b1702b-faea-4883-a876-09726c7a3316 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:04.288968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e1b1702b-faea-4883-a876-09726c7a3316 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:04.303092 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e1b1702b-faea-4883-a876-09726c7a3316 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.789503 Aug 27 02:37:04.305770 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 856/1836] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:03 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:04.323225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7130242f-78d5-4c16-8426-36e81fb20088 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:04.342584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7130242f-78d5-4c16-8426-36e81fb20088 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:04.343095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7130242f-78d5-4c16-8426-36e81fb20088 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:04.343538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7130242f-78d5-4c16-8426-36e81fb20088 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:04.548306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7130242f-78d5-4c16-8426-36e81fb20088 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Going to try to start instance {{(pid=122487) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 02:37:04.673499 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7130242f-78d5-4c16-8426-36e81fb20088 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "POST /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2/action" status: 202 len: 0 microversion: 2.1 time: 0.361740 Aug 27 02:37:04.676475 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 857/1837] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:37:04 2022] POST /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:37:04.704575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f059adc1-997f-4498-ad52-61bc5e5812b3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:04.708566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f059adc1-997f-4498-ad52-61bc5e5812b3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:04.740836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f059adc1-997f-4498-ad52-61bc5e5812b3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:04.752544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f059adc1-997f-4498-ad52-61bc5e5812b3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:04.753596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f059adc1-997f-4498-ad52-61bc5e5812b3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:04.755210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f059adc1-997f-4498-ad52-61bc5e5812b3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:04.756287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f059adc1-997f-4498-ad52-61bc5e5812b3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:04.757203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f059adc1-997f-4498-ad52-61bc5e5812b3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:05.026285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f059adc1-997f-4498-ad52-61bc5e5812b3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:05.038805 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f059adc1-997f-4498-ad52-61bc5e5812b3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1274 microversion: 2.1 time: 0.358904 Aug 27 02:37:05.045613 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 858/1838] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:04 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1274 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:05.051507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a377c597-b56e-403f-b253-9b0a319d34fd tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:05.058857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a377c597-b56e-403f-b253-9b0a319d34fd tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:05.093035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a377c597-b56e-403f-b253-9b0a319d34fd tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:05.096203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a377c597-b56e-403f-b253-9b0a319d34fd tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:05.102503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a377c597-b56e-403f-b253-9b0a319d34fd tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:05.109582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a377c597-b56e-403f-b253-9b0a319d34fd tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:05.112819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a377c597-b56e-403f-b253-9b0a319d34fd tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:05.122730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a377c597-b56e-403f-b253-9b0a319d34fd tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:05.213699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-db99eb0d-9629-4766-86ac-e06ace1bbd52 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:05.229095 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-db99eb0d-9629-4766-86ac-e06ace1bbd52 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1317 microversion: 2.1 time: 2.166119 Aug 27 02:37:05.232149 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 981/1839] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:03 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1317 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:05.331214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c545254-f845-4a24-8ce6-6c7a63aee818 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:05.331871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c545254-f845-4a24-8ce6-6c7a63aee818 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:05.359904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c545254-f845-4a24-8ce6-6c7a63aee818 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:05.360536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c545254-f845-4a24-8ce6-6c7a63aee818 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:05.360966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c545254-f845-4a24-8ce6-6c7a63aee818 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:05.361792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c545254-f845-4a24-8ce6-6c7a63aee818 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:05.362291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c545254-f845-4a24-8ce6-6c7a63aee818 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:05.362740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c545254-f845-4a24-8ce6-6c7a63aee818 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:06.159292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a377c597-b56e-403f-b253-9b0a319d34fd tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:06.191644 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a377c597-b56e-403f-b253-9b0a319d34fd tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1507 microversion: 2.1 time: 1.144398 Aug 27 02:37:06.192903 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 859/1840] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:05 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1507 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:06.211165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b808c5bf-5850-4bd4-b536-822c290d4ae6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:06.212263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b808c5bf-5850-4bd4-b536-822c290d4ae6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:06.219568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b808c5bf-5850-4bd4-b536-822c290d4ae6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:06.220520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b808c5bf-5850-4bd4-b536-822c290d4ae6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:06.221242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b808c5bf-5850-4bd4-b536-822c290d4ae6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:06.222298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b808c5bf-5850-4bd4-b536-822c290d4ae6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:06.223330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b808c5bf-5850-4bd4-b536-822c290d4ae6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:06.224012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b808c5bf-5850-4bd4-b536-822c290d4ae6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:06.299295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1c545254-f845-4a24-8ce6-6c7a63aee818 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:06.311140 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c545254-f845-4a24-8ce6-6c7a63aee818 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.988727 Aug 27 02:37:06.323596 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 982/1841] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:05 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:37:06.331925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ae1cd660-6a1c-4588-b896-ad60c36b991d tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:06.360620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ae1cd660-6a1c-4588-b896-ad60c36b991d tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:06.373155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae1cd660-6a1c-4588-b896-ad60c36b991d tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:06.373611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae1cd660-6a1c-4588-b896-ad60c36b991d tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:06.374228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae1cd660-6a1c-4588-b896-ad60c36b991d tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:06.375017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae1cd660-6a1c-4588-b896-ad60c36b991d tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:06.375511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae1cd660-6a1c-4588-b896-ad60c36b991d tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:06.376069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae1cd660-6a1c-4588-b896-ad60c36b991d tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:06.487001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b808c5bf-5850-4bd4-b536-822c290d4ae6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:06.510680 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b808c5bf-5850-4bd4-b536-822c290d4ae6 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1292 microversion: 2.1 time: 0.316323 Aug 27 02:37:06.512059 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 860/1842] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:06 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1292 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:06.835672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ae1cd660-6a1c-4588-b896-ad60c36b991d tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:06.862499 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ae1cd660-6a1c-4588-b896-ad60c36b991d tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1317 microversion: 2.1 time: 0.537454 Aug 27 02:37:06.865332 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 983/1843] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:06 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:07.215246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-114ac094-47fd-4ca7-8ba0-9d7fb47132bf tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:07.216763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-114ac094-47fd-4ca7-8ba0-9d7fb47132bf tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:07.234979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-114ac094-47fd-4ca7-8ba0-9d7fb47132bf tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:07.235870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-114ac094-47fd-4ca7-8ba0-9d7fb47132bf tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:07.236705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-114ac094-47fd-4ca7-8ba0-9d7fb47132bf tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:07.237720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-114ac094-47fd-4ca7-8ba0-9d7fb47132bf tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:07.238405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-114ac094-47fd-4ca7-8ba0-9d7fb47132bf tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:07.239039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-114ac094-47fd-4ca7-8ba0-9d7fb47132bf tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:07.361963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-44bbfa8c-9909-4491-8d98-c832710601c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:07.362704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-44bbfa8c-9909-4491-8d98-c832710601c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:07.373493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44bbfa8c-9909-4491-8d98-c832710601c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:07.379133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44bbfa8c-9909-4491-8d98-c832710601c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:07.380924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44bbfa8c-9909-4491-8d98-c832710601c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:07.384710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44bbfa8c-9909-4491-8d98-c832710601c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:07.385630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44bbfa8c-9909-4491-8d98-c832710601c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:07.389104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44bbfa8c-9909-4491-8d98-c832710601c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:07.686842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-44bbfa8c-9909-4491-8d98-c832710601c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:07.714929 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-44bbfa8c-9909-4491-8d98-c832710601c4 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.356933 Aug 27 02:37:07.726425 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 984/1844] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:07 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:37:07.745333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4ec2b115-a03a-49b8-a62a-6f25beb90ebd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:07.750178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4ec2b115-a03a-49b8-a62a-6f25beb90ebd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:07.776566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec2b115-a03a-49b8-a62a-6f25beb90ebd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:07.781170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec2b115-a03a-49b8-a62a-6f25beb90ebd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:07.783983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec2b115-a03a-49b8-a62a-6f25beb90ebd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:07.787486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec2b115-a03a-49b8-a62a-6f25beb90ebd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:07.791348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec2b115-a03a-49b8-a62a-6f25beb90ebd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:07.798212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec2b115-a03a-49b8-a62a-6f25beb90ebd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:08.120144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4ec2b115-a03a-49b8-a62a-6f25beb90ebd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:08.164372 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4ec2b115-a03a-49b8-a62a-6f25beb90ebd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1280 microversion: 2.1 time: 0.435132 Aug 27 02:37:08.182259 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 985/1845] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:07 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1280 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:08.191352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ea70de13-1847-4b3f-b150-a6c510625f84 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:08.192488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ea70de13-1847-4b3f-b150-a6c510625f84 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:08.236658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea70de13-1847-4b3f-b150-a6c510625f84 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:08.237560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea70de13-1847-4b3f-b150-a6c510625f84 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:08.248382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea70de13-1847-4b3f-b150-a6c510625f84 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:08.250206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea70de13-1847-4b3f-b150-a6c510625f84 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:08.256027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea70de13-1847-4b3f-b150-a6c510625f84 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:08.262547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea70de13-1847-4b3f-b150-a6c510625f84 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:08.682119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-114ac094-47fd-4ca7-8ba0-9d7fb47132bf tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:08.711667 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-114ac094-47fd-4ca7-8ba0-9d7fb47132bf tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1507 microversion: 2.1 time: 1.480952 Aug 27 02:37:08.712464 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 861/1846] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:07 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1507 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:08.727653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-a4f51d2f-3725-4ee4-b286-724aed90e8a6 req-379144a2-59fd-4da9-9b15-c9dc97b4246e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb53d1e-63f2-4506-97fd-353b5d7f4156", "name": "network-vif-plugged", "status": "completed", "tag": "bad964c1-20ba-4d8e-a6a2-21fae1298e94"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:08.790467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a4f51d2f-3725-4ee4-b286-724aed90e8a6 req-379144a2-59fd-4da9-9b15-c9dc97b4246e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:08.793849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a4f51d2f-3725-4ee4-b286-724aed90e8a6 req-379144a2-59fd-4da9-9b15-c9dc97b4246e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:08.795040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a4f51d2f-3725-4ee4-b286-724aed90e8a6 req-379144a2-59fd-4da9-9b15-c9dc97b4246e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:08.855402 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a4f51d2f-3725-4ee4-b286-724aed90e8a6 req-379144a2-59fd-4da9-9b15-c9dc97b4246e service nova] Creating event network-vif-plugged:bad964c1-20ba-4d8e-a6a2-21fae1298e94 for instance 1eb53d1e-63f2-4506-97fd-353b5d7f4156 on n-h2-852084-5 Aug 27 02:37:08.881743 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-a4f51d2f-3725-4ee4-b286-724aed90e8a6 req-379144a2-59fd-4da9-9b15-c9dc97b4246e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167083 Aug 27 02:37:08.886116 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 862/1847] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:08.909347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d8d921b9-3683-4e20-bb80-01d6fd87be22 req-d63c0532-7ba6-49c4-90ef-c5ff8dd7c310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893e335c-913a-479a-9ee8-f61fc9a3b36f", "tag": "e392649a-1f13-4247-832b-e0b1080e8799"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:08.952272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d8d921b9-3683-4e20-bb80-01d6fd87be22 req-d63c0532-7ba6-49c4-90ef-c5ff8dd7c310 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:08.959670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d8d921b9-3683-4e20-bb80-01d6fd87be22 req-d63c0532-7ba6-49c4-90ef-c5ff8dd7c310 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:08.960969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d8d921b9-3683-4e20-bb80-01d6fd87be22 req-d63c0532-7ba6-49c4-90ef-c5ff8dd7c310 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:09.039102 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d8d921b9-3683-4e20-bb80-01d6fd87be22 req-d63c0532-7ba6-49c4-90ef-c5ff8dd7c310 service nova] Creating event network-changed:e392649a-1f13-4247-832b-e0b1080e8799 for instance 893e335c-913a-479a-9ee8-f61fc9a3b36f on n-h2-852084-5 Aug 27 02:37:09.061985 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d8d921b9-3683-4e20-bb80-01d6fd87be22 req-d63c0532-7ba6-49c4-90ef-c5ff8dd7c310 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172318 Aug 27 02:37:09.066439 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 863/1848] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:09.113419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-acd80cad-988c-49b3-825e-0b77cea4e7ed tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:09.126276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-acd80cad-988c-49b3-825e-0b77cea4e7ed tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:09.161543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd80cad-988c-49b3-825e-0b77cea4e7ed tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:09.162384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd80cad-988c-49b3-825e-0b77cea4e7ed tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:09.163193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd80cad-988c-49b3-825e-0b77cea4e7ed tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:09.164571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd80cad-988c-49b3-825e-0b77cea4e7ed tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:09.165443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd80cad-988c-49b3-825e-0b77cea4e7ed tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:09.200107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd80cad-988c-49b3-825e-0b77cea4e7ed tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:10.051905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-acd80cad-988c-49b3-825e-0b77cea4e7ed tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:10.082421 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-acd80cad-988c-49b3-825e-0b77cea4e7ed tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 1.007595 Aug 27 02:37:10.089377 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 864/1849] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:09 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:10.107370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c98b8126-a58c-488f-9834-5f9a78cccdd0 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:10.116255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c98b8126-a58c-488f-9834-5f9a78cccdd0 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:10.143978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c98b8126-a58c-488f-9834-5f9a78cccdd0 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:10.145463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c98b8126-a58c-488f-9834-5f9a78cccdd0 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:10.147430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c98b8126-a58c-488f-9834-5f9a78cccdd0 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:10.152117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c98b8126-a58c-488f-9834-5f9a78cccdd0 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:10.153473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c98b8126-a58c-488f-9834-5f9a78cccdd0 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:10.157730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c98b8126-a58c-488f-9834-5f9a78cccdd0 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:10.254936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ea70de13-1847-4b3f-b150-a6c510625f84 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:10.289704 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ea70de13-1847-4b3f-b150-a6c510625f84 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1317 microversion: 2.1 time: 2.105375 Aug 27 02:37:10.295221 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 986/1850] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:08 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1317 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:10.313283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-59bb6eae-cd6b-48ab-8d92-1090a4859063 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:10.315210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-59bb6eae-cd6b-48ab-8d92-1090a4859063 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:10.344188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59bb6eae-cd6b-48ab-8d92-1090a4859063 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:10.350541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59bb6eae-cd6b-48ab-8d92-1090a4859063 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:10.352082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59bb6eae-cd6b-48ab-8d92-1090a4859063 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:10.357149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59bb6eae-cd6b-48ab-8d92-1090a4859063 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:10.358794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59bb6eae-cd6b-48ab-8d92-1090a4859063 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:10.364195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59bb6eae-cd6b-48ab-8d92-1090a4859063 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:10.516055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c98b8126-a58c-488f-9834-5f9a78cccdd0 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:10.572930 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c98b8126-a58c-488f-9834-5f9a78cccdd0 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1280 microversion: 2.1 time: 0.481059 Aug 27 02:37:10.584053 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 865/1851] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:10 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1280 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:10.614425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-279ca8e5-6430-41c2-becd-605f1ccac6d7 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:10.616502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-279ca8e5-6430-41c2-becd-605f1ccac6d7 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:10.647626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-279ca8e5-6430-41c2-becd-605f1ccac6d7 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:10.648931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-279ca8e5-6430-41c2-becd-605f1ccac6d7 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:10.650090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-279ca8e5-6430-41c2-becd-605f1ccac6d7 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:10.651729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-279ca8e5-6430-41c2-becd-605f1ccac6d7 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:10.664489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-279ca8e5-6430-41c2-becd-605f1ccac6d7 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:10.666857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-279ca8e5-6430-41c2-becd-605f1ccac6d7 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:10.690793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:11.226507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-279ca8e5-6430-41c2-becd-605f1ccac6d7 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:37:11.280287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-279ca8e5-6430-41c2-becd-605f1ccac6d7 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 2422 microversion: 2.25 time: 0.694051 Aug 27 02:37:11.283991 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 866/1852] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:10 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 2422 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:11.297990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7047eb9f-7633-4fa6-99c6-898f4ebf0535 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:11.301467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7047eb9f-7633-4fa6-99c6-898f4ebf0535 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:11.328310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7047eb9f-7633-4fa6-99c6-898f4ebf0535 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:11.330585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7047eb9f-7633-4fa6-99c6-898f4ebf0535 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:11.331983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7047eb9f-7633-4fa6-99c6-898f4ebf0535 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:11.334674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7047eb9f-7633-4fa6-99c6-898f4ebf0535 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:11.337828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7047eb9f-7633-4fa6-99c6-898f4ebf0535 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:11.338563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7047eb9f-7633-4fa6-99c6-898f4ebf0535 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:11.641535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-59bb6eae-cd6b-48ab-8d92-1090a4859063 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:11.657532 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-59bb6eae-cd6b-48ab-8d92-1090a4859063 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1511 microversion: 2.1 time: 1.360265 Aug 27 02:37:11.663677 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 987/1853] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:10 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1511 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:11.674691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-31b7248e-479a-48c7-af66-e9893a80eb22 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:11.678798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-31b7248e-479a-48c7-af66-e9893a80eb22 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:11.723400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31b7248e-479a-48c7-af66-e9893a80eb22 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:11.729683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31b7248e-479a-48c7-af66-e9893a80eb22 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:11.730610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31b7248e-479a-48c7-af66-e9893a80eb22 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:11.732857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31b7248e-479a-48c7-af66-e9893a80eb22 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:11.734338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31b7248e-479a-48c7-af66-e9893a80eb22 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:11.737098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31b7248e-479a-48c7-af66-e9893a80eb22 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:12.125084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:12.188849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7047eb9f-7633-4fa6-99c6-898f4ebf0535 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:12.211610 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7047eb9f-7633-4fa6-99c6-898f4ebf0535 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.925981 Aug 27 02:37:12.223282 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 867/1854] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:11 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:12.227132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4588c921-a872-4121-b934-b7d0b3acdfea tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852084-5", "block_migration": "auto"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:12.236691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4588c921-a872-4121-b934-b7d0b3acdfea tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:12.263597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4588c921-a872-4121-b934-b7d0b3acdfea tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:12.274152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4588c921-a872-4121-b934-b7d0b3acdfea tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:12.279945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4588c921-a872-4121-b934-b7d0b3acdfea tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:12.283099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4588c921-a872-4121-b934-b7d0b3acdfea tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:12.289521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4588c921-a872-4121-b934-b7d0b3acdfea tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:12.290860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4588c921-a872-4121-b934-b7d0b3acdfea tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:12.338061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-4588c921-a872-4121-b934-b7d0b3acdfea tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'flavor' on Instance uuid 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:37:12.379830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4588c921-a872-4121-b934-b7d0b3acdfea tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Going to try to live migrate instance to n-h2-852084-5 {{(pid=122487) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:37:12.592086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-31b7248e-479a-48c7-af66-e9893a80eb22 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:12.617133 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-31b7248e-479a-48c7-af66-e9893a80eb22 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1507 microversion: 2.1 time: 0.951285 Aug 27 02:37:12.620465 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 988/1855] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:11 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1507 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:12.639565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d8f5e058-2c50-4a48-8763-d6cd019d2bf1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:12.646529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d8f5e058-2c50-4a48-8763-d6cd019d2bf1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:12.683299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8f5e058-2c50-4a48-8763-d6cd019d2bf1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:12.685177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8f5e058-2c50-4a48-8763-d6cd019d2bf1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:12.686030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8f5e058-2c50-4a48-8763-d6cd019d2bf1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:12.687197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8f5e058-2c50-4a48-8763-d6cd019d2bf1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:12.688337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8f5e058-2c50-4a48-8763-d6cd019d2bf1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:12.689351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8f5e058-2c50-4a48-8763-d6cd019d2bf1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:12.901741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:13.499174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:14.449915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d8f5e058-2c50-4a48-8763-d6cd019d2bf1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:14.486900 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d8f5e058-2c50-4a48-8763-d6cd019d2bf1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1322 microversion: 2.1 time: 1.856336 Aug 27 02:37:14.490938 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 989/1856] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:12 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1322 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:14.498195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b81e7594-0598-4207-95e4-72b22f7d8000 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:14.528402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b81e7594-0598-4207-95e4-72b22f7d8000 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:14.529007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.compute.servers [None req-b81e7594-0598-4207-95e4-72b22f7d8000 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Removing options 'limit' from query {{(pid=122488) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 02:37:14.532445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b81e7594-0598-4207-95e4-72b22f7d8000 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:37:14.533783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b81e7594-0598-4207-95e4-72b22f7d8000 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:14.534299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b81e7594-0598-4207-95e4-72b22f7d8000 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:14.541490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b81e7594-0598-4207-95e4-72b22f7d8000 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:14.544988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b81e7594-0598-4207-95e4-72b22f7d8000 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:14.545625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b81e7594-0598-4207-95e4-72b22f7d8000 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:14.546128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b81e7594-0598-4207-95e4-72b22f7d8000 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:14.553992 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b81e7594-0598-4207-95e4-72b22f7d8000 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.061393 Aug 27 02:37:14.554895 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 990/1857] 10.222.0.99 () {58 vars in 1140 bytes} [Sat Aug 27 02:37:14 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:37:14.577284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c8e13ec-1ff5-4691-be8c-6653ef015b6a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:14.577961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5c8e13ec-1ff5-4691-be8c-6653ef015b6a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:14.602006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c8e13ec-1ff5-4691-be8c-6653ef015b6a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:14.602538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c8e13ec-1ff5-4691-be8c-6653ef015b6a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:14.603001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c8e13ec-1ff5-4691-be8c-6653ef015b6a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:14.603779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c8e13ec-1ff5-4691-be8c-6653ef015b6a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:14.604258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c8e13ec-1ff5-4691-be8c-6653ef015b6a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:14.604702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c8e13ec-1ff5-4691-be8c-6653ef015b6a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:14.665941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:15.219591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5c8e13ec-1ff5-4691-be8c-6653ef015b6a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:15.229419 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5c8e13ec-1ff5-4691-be8c-6653ef015b6a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.665617 Aug 27 02:37:15.234840 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 991/1858] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:14 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:15.242885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-5c44597f-da92-4635-9996-9e86bf8f66de req-c93155e7-21f1-46c5-a1f2-f23dc3d7be46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f011ba5-d22c-4c98-82f1-5ce036446009", "tag": "08cc6d4b-6ce1-4406-8658-f319c7cbf479"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:15.268599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5c44597f-da92-4635-9996-9e86bf8f66de req-c93155e7-21f1-46c5-a1f2-f23dc3d7be46 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:15.269388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5c44597f-da92-4635-9996-9e86bf8f66de req-c93155e7-21f1-46c5-a1f2-f23dc3d7be46 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:15.270098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5c44597f-da92-4635-9996-9e86bf8f66de req-c93155e7-21f1-46c5-a1f2-f23dc3d7be46 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:15.298235 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-5c44597f-da92-4635-9996-9e86bf8f66de req-c93155e7-21f1-46c5-a1f2-f23dc3d7be46 service nova] Creating event network-changed:08cc6d4b-6ce1-4406-8658-f319c7cbf479 for instance 4f011ba5-d22c-4c98-82f1-5ce036446009 on n-h1-852084-5 Aug 27 02:37:15.310369 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-5c44597f-da92-4635-9996-9e86bf8f66de req-c93155e7-21f1-46c5-a1f2-f23dc3d7be46 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071174 Aug 27 02:37:15.312760 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 992/1859] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:15.332197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-444e5f63-9500-4bc7-be76-f4acb69a8e30 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:15.333936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-444e5f63-9500-4bc7-be76-f4acb69a8e30 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:15.341611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-444e5f63-9500-4bc7-be76-f4acb69a8e30 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:15.346545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-444e5f63-9500-4bc7-be76-f4acb69a8e30 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:15.347365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-444e5f63-9500-4bc7-be76-f4acb69a8e30 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:15.348341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-444e5f63-9500-4bc7-be76-f4acb69a8e30 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:15.354641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-444e5f63-9500-4bc7-be76-f4acb69a8e30 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:15.355389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-444e5f63-9500-4bc7-be76-f4acb69a8e30 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:15.691038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-444e5f63-9500-4bc7-be76-f4acb69a8e30 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:15.711040 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-444e5f63-9500-4bc7-be76-f4acb69a8e30 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.396271 Aug 27 02:37:15.711786 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 993/1860] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:15 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:15.719873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e7ee07bb-f9fa-4fff-a739-934877df525b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:15.720507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e7ee07bb-f9fa-4fff-a739-934877df525b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:15.728783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7ee07bb-f9fa-4fff-a739-934877df525b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:15.729591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7ee07bb-f9fa-4fff-a739-934877df525b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:15.730235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7ee07bb-f9fa-4fff-a739-934877df525b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:15.731177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7ee07bb-f9fa-4fff-a739-934877df525b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:15.731907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7ee07bb-f9fa-4fff-a739-934877df525b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:15.732544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7ee07bb-f9fa-4fff-a739-934877df525b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:16.037217 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4588c921-a872-4121-b934-b7d0b3acdfea tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/action" status: 202 len: 0 microversion: 2.25 time: 3.818570 Aug 27 02:37:16.040823 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 868/1861] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:37:12 2022] POST /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/action => generated 0 bytes in 3825 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:37:16.103312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88dcbe72-1544-4dda-bbfe-ccf8097170f7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:16.105084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-88dcbe72-1544-4dda-bbfe-ccf8097170f7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:16.131083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=74 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:16.147500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88dcbe72-1544-4dda-bbfe-ccf8097170f7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:16.154755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88dcbe72-1544-4dda-bbfe-ccf8097170f7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:16.155507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88dcbe72-1544-4dda-bbfe-ccf8097170f7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:16.156524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88dcbe72-1544-4dda-bbfe-ccf8097170f7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:16.157624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88dcbe72-1544-4dda-bbfe-ccf8097170f7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:16.158176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88dcbe72-1544-4dda-bbfe-ccf8097170f7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:16.176246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e7ee07bb-f9fa-4fff-a739-934877df525b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:16.221407 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e7ee07bb-f9fa-4fff-a739-934877df525b tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1511 microversion: 2.1 time: 0.503174 Aug 27 02:37:16.226535 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 994/1862] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:15 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1511 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:16.248396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6a412a0e-e8a6-4a0b-87a2-70f78d7e21e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-398494068"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:16.265170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6a412a0e-e8a6-4a0b-87a2-70f78d7e21e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:16.289927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a412a0e-e8a6-4a0b-87a2-70f78d7e21e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:16.290941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a412a0e-e8a6-4a0b-87a2-70f78d7e21e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:16.291704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a412a0e-e8a6-4a0b-87a2-70f78d7e21e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:16.293076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a412a0e-e8a6-4a0b-87a2-70f78d7e21e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:16.300689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a412a0e-e8a6-4a0b-87a2-70f78d7e21e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:16.301661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a412a0e-e8a6-4a0b-87a2-70f78d7e21e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:16.817451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-88dcbe72-1544-4dda-bbfe-ccf8097170f7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:16.831594 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6a412a0e-e8a6-4a0b-87a2-70f78d7e21e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.601458 Aug 27 02:37:16.832179 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 995/1863] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:37:16 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 27 02:37:16.836780 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-88dcbe72-1544-4dda-bbfe-ccf8097170f7 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1322 microversion: 2.1 time: 0.786337 Aug 27 02:37:16.846153 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 869/1864] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:16 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1322 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:16.850386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:16.853994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:16.870010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f94fe688-5f33-41a1-8984-b6c0367adcb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:16.872322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:16.873530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:16.874862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:16.876507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:16.878072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:16.879208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f94fe688-5f33-41a1-8984-b6c0367adcb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:16.881159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:16.904757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f94fe688-5f33-41a1-8984-b6c0367adcb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:16.905296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f94fe688-5f33-41a1-8984-b6c0367adcb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:16.905781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f94fe688-5f33-41a1-8984-b6c0367adcb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:16.919223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f94fe688-5f33-41a1-8984-b6c0367adcb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:16.920023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f94fe688-5f33-41a1-8984-b6c0367adcb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:16.920694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f94fe688-5f33-41a1-8984-b6c0367adcb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:17.209528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:17.225490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:17.227393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:17.229885 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3cd767d0-1145-42fc-98b1-a245bae93443 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.396821 Aug 27 02:37:17.230763 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 996/1865] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:16 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:17.236180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bab62844-e509-4c3a-8bb2-8888aa355066 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:17.236814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bab62844-e509-4c3a-8bb2-8888aa355066 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: cd064beb-dd01-45e4-ba62-4bc863fd9ca9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:17.251349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab62844-e509-4c3a-8bb2-8888aa355066 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:17.251854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab62844-e509-4c3a-8bb2-8888aa355066 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:17.252422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab62844-e509-4c3a-8bb2-8888aa355066 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:17.253366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab62844-e509-4c3a-8bb2-8888aa355066 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:17.254058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab62844-e509-4c3a-8bb2-8888aa355066 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:17.254501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab62844-e509-4c3a-8bb2-8888aa355066 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:17.293396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f94fe688-5f33-41a1-8984-b6c0367adcb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:17.313096 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f94fe688-5f33-41a1-8984-b6c0367adcb8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.465134 Aug 27 02:37:17.329219 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 870/1866] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:16 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:17.340539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d9bbc943-5f18-41d3-a7f9-30a3e8e25820"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:17.348165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:17.364556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:17.366430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:17.369935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:17.371160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:17.371930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:17.374513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:17.570567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bab62844-e509-4c3a-8bb2-8888aa355066 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:17.587178 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bab62844-e509-4c3a-8bb2-8888aa355066 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9" status: 200 len: 1513 microversion: 2.1 time: 0.355106 Aug 27 02:37:17.589486 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 997/1867] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:17 2022] GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9 => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:17.598262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9a6f0ca3-02c5-40b1-9b48-49843d5e8ea4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:17.599943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9a6f0ca3-02c5-40b1-9b48-49843d5e8ea4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:17.611424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a6f0ca3-02c5-40b1-9b48-49843d5e8ea4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:17.612331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a6f0ca3-02c5-40b1-9b48-49843d5e8ea4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:17.613154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a6f0ca3-02c5-40b1-9b48-49843d5e8ea4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:17.614864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a6f0ca3-02c5-40b1-9b48-49843d5e8ea4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:17.615372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a6f0ca3-02c5-40b1-9b48-49843d5e8ea4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:17.616146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a6f0ca3-02c5-40b1-9b48-49843d5e8ea4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:17.776973 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] HTTP exception thrown: Volume 15d86b73-55e4-4461-9da0-c2a590c9f2fc could not be found. Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Request method failure captured: Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: request: PUT /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156/os-volume_attachments/15d86b73-55e4-4461-9da0-c2a590c9f2fc HTTP/1.1 Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 74 Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYLC2CiJA1XoJSn-YTGTOhFsVu4fZ-W64Jw9gaG5tU_VLMsr2KZL6isni9gfsgha7SINBWzvCTjoTNWTezJ63xaLvZfpapsn1VInGL7kf_6_5PI-xgf7nOECGORBI4BlyfM6lCjS_oj-V5VexSKFOtST9efC4M_DlW85wKC4IiAYZpY Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 7d50ecc97f984390ab69fa547833764b Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-VolumesAdminNegativeTest-2102873376 Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7d50ecc97f984390ab69fa547833764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50ecc97f984390ab69fa547833764b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7d50ecc97f984390ab69fa547833764b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7d50ecc97f984390ab69fa547833764b"}]}] Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-VolumesAdminNegativeTest-2102873376 Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 7d50ecc97f984390ab69fa547833764b Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2102873376 Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-VolumesAdminNegativeTest-2102873376-project-admin Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 8236502a6d9240b2bf335950b675d062 Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-VolumesAdminNegativeTest-2102873376-project-admin Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: {"volumeAttachment": {"volumeId": "d9bbc943-5f18-41d3-a7f9-30a3e8e25820"}} Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: exception: Volume 15d86b73-55e4-4461-9da0-c2a590c9f2fc could not be found. Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': '1eb53d1e-63f2-4506-97fd-353b5d7f4156', 'id': '15d86b73-55e4-4461-9da0-c2a590c9f2fc', 'body': {'volumeAttachment': {'volumeId': 'd9bbc943-5f18-41d3-a7f9-30a3e8e25820'}}} Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15d86b73-55e4-4461-9da0-c2a590c9f2fc could not be found. (HTTP 404) (Request-ID: req-35861420-d407-42d4-9beb-4653dd4fbcb2) Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:37:17.783548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15d86b73-55e4-4461-9da0-c2a590c9f2fc could not be found. Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15d86b73-55e4-4461-9da0-c2a590c9f2fc could not be found. Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15d86b73-55e4-4461-9da0-c2a590c9f2fc could not be found. Aug 27 02:37:17.791104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:37:17.798568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] Returning 404 to user: Volume 15d86b73-55e4-4461-9da0-c2a590c9f2fc could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:37:17.799659 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd4111a3-8493-4a0a-912a-48ea2842229f tempest-VolumesAdminNegativeTest-2102873376 tempest-VolumesAdminNegativeTest-2102873376-project-admin] 10.222.0.99 "PUT /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156/os-volume_attachments/15d86b73-55e4-4461-9da0-c2a590c9f2fc" status: 404 len: 109 microversion: 2.1 time: 0.468523 Aug 27 02:37:17.802660 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 871/1868] 10.222.0.99 () {60 vars in 1433 bytes} [Sat Aug 27 02:37:17 2022] PUT /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156/os-volume_attachments/15d86b73-55e4-4461-9da0-c2a590c9f2fc => generated 109 bytes in 472 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:37:17.822855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e91fafac-888f-4b87-bcb2-28b78327e2af tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:17.826292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e91fafac-888f-4b87-bcb2-28b78327e2af tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:17.845356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e91fafac-888f-4b87-bcb2-28b78327e2af tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:17.848591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e91fafac-888f-4b87-bcb2-28b78327e2af tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:17.851509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e91fafac-888f-4b87-bcb2-28b78327e2af tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:17.853585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e91fafac-888f-4b87-bcb2-28b78327e2af tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:17.859489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e91fafac-888f-4b87-bcb2-28b78327e2af tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:17.861079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e91fafac-888f-4b87-bcb2-28b78327e2af tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:18.046520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9a6f0ca3-02c5-40b1-9b48-49843d5e8ea4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:18.073705 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9a6f0ca3-02c5-40b1-9b48-49843d5e8ea4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1678 microversion: 2.1 time: 0.481917 Aug 27 02:37:18.075475 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 998/1869] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:17 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1678 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:18.088092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-59d602e9-3d26-4b13-b550-e0e87ea3e815 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:18.091948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-59d602e9-3d26-4b13-b550-e0e87ea3e815 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:18.105627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d602e9-3d26-4b13-b550-e0e87ea3e815 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:18.109120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d602e9-3d26-4b13-b550-e0e87ea3e815 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:18.110889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d602e9-3d26-4b13-b550-e0e87ea3e815 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:18.112870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d602e9-3d26-4b13-b550-e0e87ea3e815 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:18.114104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d602e9-3d26-4b13-b550-e0e87ea3e815 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:18.118099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d602e9-3d26-4b13-b550-e0e87ea3e815 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:18.433527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e91fafac-888f-4b87-bcb2-28b78327e2af tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:18.448889 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e91fafac-888f-4b87-bcb2-28b78327e2af tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1512 microversion: 2.1 time: 0.644656 Aug 27 02:37:18.453214 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 872/1870] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:17 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1512 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:18.464546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:18.466683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:18.483725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:18.484473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:18.485090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:18.486009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:18.486899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:18.487421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:18.510111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-59d602e9-3d26-4b13-b550-e0e87ea3e815 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:18.542399 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-59d602e9-3d26-4b13-b550-e0e87ea3e815 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1322 microversion: 2.1 time: 0.462229 Aug 27 02:37:18.562470 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 999/1871] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:18 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:18.600599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bdf39800-6237-4195-8fcd-e51b085d95ee tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:18.601693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bdf39800-6237-4195-8fcd-e51b085d95ee tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:18.629661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bdf39800-6237-4195-8fcd-e51b085d95ee tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:18.631311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bdf39800-6237-4195-8fcd-e51b085d95ee tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:18.632345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bdf39800-6237-4195-8fcd-e51b085d95ee tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:18.633816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bdf39800-6237-4195-8fcd-e51b085d95ee tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:18.635250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bdf39800-6237-4195-8fcd-e51b085d95ee tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:18.648913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bdf39800-6237-4195-8fcd-e51b085d95ee tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:18.964892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:19.006053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:19.026755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:19.041612 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-350e0715-e6aa-4a70-9380-bcf6a4bc9b1e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.578516 Aug 27 02:37:19.045436 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 873/1872] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:18 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:19.072909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e516cec-c0f9-488b-beaa-8b8215ae8884 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:19.093152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5e516cec-c0f9-488b-beaa-8b8215ae8884 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:19.094147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5e516cec-c0f9-488b-beaa-8b8215ae8884 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:37:19.153514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bdf39800-6237-4195-8fcd-e51b085d95ee tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:19.169106 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bdf39800-6237-4195-8fcd-e51b085d95ee tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.602869 Aug 27 02:37:19.172898 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1000/1873] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:18 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:19.179452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-37ade759-7bc1-465d-9e0d-a55eb5c9706a req-1c3ed02d-8ae8-44d1-ae63-2eac8bfa6e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59462ca6-1830-4fae-a141-ffade28879f6", "name": "network-vif-unplugged", "status": "completed", "tag": "b9a18ca7-1e41-4aa3-9c64-1d916f180dce"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:19.191996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-37ade759-7bc1-465d-9e0d-a55eb5c9706a req-1c3ed02d-8ae8-44d1-ae63-2eac8bfa6e71 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:19.193789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-37ade759-7bc1-465d-9e0d-a55eb5c9706a req-1c3ed02d-8ae8-44d1-ae63-2eac8bfa6e71 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:19.194503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-37ade759-7bc1-465d-9e0d-a55eb5c9706a req-1c3ed02d-8ae8-44d1-ae63-2eac8bfa6e71 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:19.213134 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-37ade759-7bc1-465d-9e0d-a55eb5c9706a req-1c3ed02d-8ae8-44d1-ae63-2eac8bfa6e71 service nova] Creating event network-vif-unplugged:b9a18ca7-1e41-4aa3-9c64-1d916f180dce for instance 59462ca6-1830-4fae-a141-ffade28879f6 on n-h1-852084-5 Aug 27 02:37:19.220982 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-37ade759-7bc1-465d-9e0d-a55eb5c9706a req-1c3ed02d-8ae8-44d1-ae63-2eac8bfa6e71 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045749 Aug 27 02:37:19.222904 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1001/1874] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:19.233057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6571afd7-a11d-4ac4-85d6-adb9cb4fe093 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:19.234295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6571afd7-a11d-4ac4-85d6-adb9cb4fe093 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:19.243330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571afd7-a11d-4ac4-85d6-adb9cb4fe093 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:19.244437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571afd7-a11d-4ac4-85d6-adb9cb4fe093 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:19.245324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571afd7-a11d-4ac4-85d6-adb9cb4fe093 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:19.246466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571afd7-a11d-4ac4-85d6-adb9cb4fe093 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:19.247218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571afd7-a11d-4ac4-85d6-adb9cb4fe093 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:19.247942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6571afd7-a11d-4ac4-85d6-adb9cb4fe093 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:19.426817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e516cec-c0f9-488b-beaa-8b8215ae8884 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:19.427906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e516cec-c0f9-488b-beaa-8b8215ae8884 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:19.428741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e516cec-c0f9-488b-beaa-8b8215ae8884 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:19.430824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e516cec-c0f9-488b-beaa-8b8215ae8884 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:19.432400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e516cec-c0f9-488b-beaa-8b8215ae8884 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:19.433463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e516cec-c0f9-488b-beaa-8b8215ae8884 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:19.654350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6571afd7-a11d-4ac4-85d6-adb9cb4fe093 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:19.685791 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6571afd7-a11d-4ac4-85d6-adb9cb4fe093 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1686 microversion: 2.1 time: 0.460192 Aug 27 02:37:19.693142 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1002/1875] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:19 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1686 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:19.699196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-5e516cec-c0f9-488b-beaa-8b8215ae8884 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:37:19.715069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-614bbb17-0d88-4593-aac2-0d73aeee1c44 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:19.716719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-614bbb17-0d88-4593-aac2-0d73aeee1c44 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:19.730746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-614bbb17-0d88-4593-aac2-0d73aeee1c44 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:19.732580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-614bbb17-0d88-4593-aac2-0d73aeee1c44 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:19.734007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-614bbb17-0d88-4593-aac2-0d73aeee1c44 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:19.735681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-614bbb17-0d88-4593-aac2-0d73aeee1c44 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:19.736961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-614bbb17-0d88-4593-aac2-0d73aeee1c44 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:19.738189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-614bbb17-0d88-4593-aac2-0d73aeee1c44 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:19.856131 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5e516cec-c0f9-488b-beaa-8b8215ae8884 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.804822 Aug 27 02:37:19.859578 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 874/1876] 10.222.0.99 () {58 vars in 1154 bytes} [Sat Aug 27 02:37:19 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:19.882569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb3f94f0-942b-4662-b97b-09a9c890f132 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:19.883874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb3f94f0-942b-4662-b97b-09a9c890f132 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:19.899315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3f94f0-942b-4662-b97b-09a9c890f132 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:19.903090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3f94f0-942b-4662-b97b-09a9c890f132 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:19.904840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3f94f0-942b-4662-b97b-09a9c890f132 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:19.905920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3f94f0-942b-4662-b97b-09a9c890f132 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:19.906611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3f94f0-942b-4662-b97b-09a9c890f132 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:19.907232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3f94f0-942b-4662-b97b-09a9c890f132 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:20.138897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-614bbb17-0d88-4593-aac2-0d73aeee1c44 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:20.214026 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-614bbb17-0d88-4593-aac2-0d73aeee1c44 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1322 microversion: 2.1 time: 0.517080 Aug 27 02:37:20.221545 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1003/1877] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:19 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:20.241137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:20.242202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:20.259959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:20.260750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:20.261736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:20.264145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:20.265073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:20.265860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:20.280975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb3f94f0-942b-4662-b97b-09a9c890f132 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:20.306419 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb3f94f0-942b-4662-b97b-09a9c890f132 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1511 microversion: 2.1 time: 0.428229 Aug 27 02:37:20.320785 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 875/1878] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:19 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:20.341761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-54eea51c-fd05-4f78-aabc-722ac42c8a52 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:20.342895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-54eea51c-fd05-4f78-aabc-722ac42c8a52 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:20.363332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54eea51c-fd05-4f78-aabc-722ac42c8a52 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:20.363875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54eea51c-fd05-4f78-aabc-722ac42c8a52 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:20.364873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54eea51c-fd05-4f78-aabc-722ac42c8a52 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:20.365729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54eea51c-fd05-4f78-aabc-722ac42c8a52 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:20.366245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54eea51c-fd05-4f78-aabc-722ac42c8a52 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:20.366691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54eea51c-fd05-4f78-aabc-722ac42c8a52 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:20.564381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:20.578736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:20.580348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:20.582111 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b9206a4e-a99d-4f95-9e30-e8ac544d86ee tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.356611 Aug 27 02:37:20.588818 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1004/1879] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:20 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:20.604392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-43070adb-c7e9-4f16-a421-af3b75cf943f tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:20.605049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-43070adb-c7e9-4f16-a421-af3b75cf943f tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: cd064beb-dd01-45e4-ba62-4bc863fd9ca9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:20.625414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43070adb-c7e9-4f16-a421-af3b75cf943f tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:20.630264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43070adb-c7e9-4f16-a421-af3b75cf943f tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:20.630861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43070adb-c7e9-4f16-a421-af3b75cf943f tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:20.631673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43070adb-c7e9-4f16-a421-af3b75cf943f tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:20.632171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43070adb-c7e9-4f16-a421-af3b75cf943f tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:20.632628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43070adb-c7e9-4f16-a421-af3b75cf943f tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:20.952346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-54eea51c-fd05-4f78-aabc-722ac42c8a52 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:20.968274 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-54eea51c-fd05-4f78-aabc-722ac42c8a52 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.645070 Aug 27 02:37:20.970200 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 876/1880] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:20 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:21.000200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-23a4b00c-6db8-49f7-9194-65f65acf298f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:21.001645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-23a4b00c-6db8-49f7-9194-65f65acf298f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:21.012095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a4b00c-6db8-49f7-9194-65f65acf298f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:21.012605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a4b00c-6db8-49f7-9194-65f65acf298f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:21.013104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a4b00c-6db8-49f7-9194-65f65acf298f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:21.014940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a4b00c-6db8-49f7-9194-65f65acf298f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:21.015438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a4b00c-6db8-49f7-9194-65f65acf298f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:21.015875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a4b00c-6db8-49f7-9194-65f65acf298f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:21.027835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-43070adb-c7e9-4f16-a421-af3b75cf943f tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:21.040898 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-43070adb-c7e9-4f16-a421-af3b75cf943f tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9" status: 200 len: 1513 microversion: 2.1 time: 0.449254 Aug 27 02:37:21.042896 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1005/1881] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:20 2022] GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9 => generated 1513 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:21.063793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6c91b50b-7cce-4aab-a1d4-1d6f0f8e4619 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:21.065384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6c91b50b-7cce-4aab-a1d4-1d6f0f8e4619 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:21.073544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c91b50b-7cce-4aab-a1d4-1d6f0f8e4619 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:21.074824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c91b50b-7cce-4aab-a1d4-1d6f0f8e4619 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:21.075860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c91b50b-7cce-4aab-a1d4-1d6f0f8e4619 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:21.076883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c91b50b-7cce-4aab-a1d4-1d6f0f8e4619 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:21.078019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c91b50b-7cce-4aab-a1d4-1d6f0f8e4619 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:21.078776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c91b50b-7cce-4aab-a1d4-1d6f0f8e4619 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:21.308354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-23a4b00c-6db8-49f7-9194-65f65acf298f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:21.330575 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-23a4b00c-6db8-49f7-9194-65f65acf298f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.358412 Aug 27 02:37:21.345748 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 877/1882] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:20 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:21.356429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2b5cbcc8-607e-4753-8e27-e806190b7521 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:21.357069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2b5cbcc8-607e-4753-8e27-e806190b7521 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:21.400741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b5cbcc8-607e-4753-8e27-e806190b7521 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:21.402039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b5cbcc8-607e-4753-8e27-e806190b7521 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:21.402652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b5cbcc8-607e-4753-8e27-e806190b7521 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:21.404681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b5cbcc8-607e-4753-8e27-e806190b7521 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:21.406751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b5cbcc8-607e-4753-8e27-e806190b7521 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:21.412359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b5cbcc8-607e-4753-8e27-e806190b7521 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:21.542425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6c91b50b-7cce-4aab-a1d4-1d6f0f8e4619 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:21.555877 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6c91b50b-7cce-4aab-a1d4-1d6f0f8e4619 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1512 microversion: 2.1 time: 0.496488 Aug 27 02:37:21.565791 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1006/1883] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:21 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1512 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:21.579646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:21.585905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:21.587229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:37:21.594253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:21.595164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:21.595887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:21.597031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:21.598078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:21.599361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:21.637052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:37:21.676468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:21.692269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:21.705170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:21.706126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:21.706847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:21.791281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2b5cbcc8-607e-4753-8e27-e806190b7521 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:21.804250 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2b5cbcc8-607e-4753-8e27-e806190b7521 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1322 microversion: 2.1 time: 0.458413 Aug 27 02:37:21.804845 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 878/1884] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:21 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:21.815217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:21.820223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:21.831245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:21.835115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:21.840186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:21.842965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:21.845905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:21.846640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:22.091482 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dd4da404-b7f9-4504-a0e6-318a726a0796 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.515901 Aug 27 02:37:22.092661 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1007/1885] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:37:21 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:22.098854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-54940d54-8137-46a5-a4c3-d86307e56a6e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:22.099659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-54940d54-8137-46a5-a4c3-d86307e56a6e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:22.117363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54940d54-8137-46a5-a4c3-d86307e56a6e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:22.119246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54940d54-8137-46a5-a4c3-d86307e56a6e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:22.120256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54940d54-8137-46a5-a4c3-d86307e56a6e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:22.122067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54940d54-8137-46a5-a4c3-d86307e56a6e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:22.130626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54940d54-8137-46a5-a4c3-d86307e56a6e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:22.134790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54940d54-8137-46a5-a4c3-d86307e56a6e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:22.304592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:22.338116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:22.340580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:22.350093 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a1382aff-868d-42f0-887d-f7cd32ec6e06 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.539272 Aug 27 02:37:22.374597 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 879/1886] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:21 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:22.388214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a84640b-380e-435e-bb42-03414bb8c42a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:22.416513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a84640b-380e-435e-bb42-03414bb8c42a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:22.420825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6a84640b-380e-435e-bb42-03414bb8c42a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:37:22.606814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-54940d54-8137-46a5-a4c3-d86307e56a6e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:22.640805 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-54940d54-8137-46a5-a4c3-d86307e56a6e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.541241 Aug 27 02:37:22.643828 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1008/1887] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:22 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:22.663325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3e56e48f-bf7d-412c-9770-dfff1a04f467 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:22.664464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3e56e48f-bf7d-412c-9770-dfff1a04f467 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:22.696505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e56e48f-bf7d-412c-9770-dfff1a04f467 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:22.697393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e56e48f-bf7d-412c-9770-dfff1a04f467 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:22.702512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e56e48f-bf7d-412c-9770-dfff1a04f467 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:22.706938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e56e48f-bf7d-412c-9770-dfff1a04f467 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:22.709133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e56e48f-bf7d-412c-9770-dfff1a04f467 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:22.713172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e56e48f-bf7d-412c-9770-dfff1a04f467 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:22.741467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a84640b-380e-435e-bb42-03414bb8c42a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:22.747534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a84640b-380e-435e-bb42-03414bb8c42a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:22.749199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a84640b-380e-435e-bb42-03414bb8c42a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:22.753908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a84640b-380e-435e-bb42-03414bb8c42a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:22.755793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a84640b-380e-435e-bb42-03414bb8c42a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:22.759296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a84640b-380e-435e-bb42-03414bb8c42a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:22.996272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:23.013543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-6a84640b-380e-435e-bb42-03414bb8c42a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:37:23.170832 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6a84640b-380e-435e-bb42-03414bb8c42a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.791353 Aug 27 02:37:23.186333 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 880/1888] 10.222.0.99 () {58 vars in 1150 bytes} [Sat Aug 27 02:37:22 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:23.201371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b2cc2bc0-0aa0-4341-aace-8eabc24b0b68 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:23.204830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b2cc2bc0-0aa0-4341-aace-8eabc24b0b68 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:23.220830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2cc2bc0-0aa0-4341-aace-8eabc24b0b68 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:23.222247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2cc2bc0-0aa0-4341-aace-8eabc24b0b68 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:23.223349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2cc2bc0-0aa0-4341-aace-8eabc24b0b68 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:23.225504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2cc2bc0-0aa0-4341-aace-8eabc24b0b68 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:23.227093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2cc2bc0-0aa0-4341-aace-8eabc24b0b68 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:23.228168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2cc2bc0-0aa0-4341-aace-8eabc24b0b68 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:23.508598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3e56e48f-bf7d-412c-9770-dfff1a04f467 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:23.533194 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3e56e48f-bf7d-412c-9770-dfff1a04f467 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.889438 Aug 27 02:37:23.536696 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1009/1889] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:22 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:23.547750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8b11ee1a-6961-410d-92f6-8190b78f6008 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:23.574485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8b11ee1a-6961-410d-92f6-8190b78f6008 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:23.581724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8b11ee1a-6961-410d-92f6-8190b78f6008 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:37:23.610976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b11ee1a-6961-410d-92f6-8190b78f6008 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:23.613231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b11ee1a-6961-410d-92f6-8190b78f6008 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:23.614642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b11ee1a-6961-410d-92f6-8190b78f6008 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:23.616354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b11ee1a-6961-410d-92f6-8190b78f6008 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:23.617507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b11ee1a-6961-410d-92f6-8190b78f6008 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:23.618629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b11ee1a-6961-410d-92f6-8190b78f6008 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:23.709656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b2cc2bc0-0aa0-4341-aace-8eabc24b0b68 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:23.731985 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b2cc2bc0-0aa0-4341-aace-8eabc24b0b68 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1322 microversion: 2.1 time: 0.542803 Aug 27 02:37:23.736522 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 881/1890] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:23 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:23.795996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:23.797200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:23.810625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:23.811959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:23.814020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:23.817077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:23.819048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:23.820296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:24.259767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-8b11ee1a-6961-410d-92f6-8190b78f6008 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:37:24.350417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:24.405315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:24.417756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:24.424357 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-39bf673c-0709-4c1e-972e-1aac1b4aeca0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.639655 Aug 27 02:37:24.437957 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 882/1891] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:23 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:24.452786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-380535a1-5747-40f0-9341-370c76e74d9a req-f77b8e95-1edd-455e-a954-2bf6b1b25260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f011ba5-d22c-4c98-82f1-5ce036446009", "name": "network-vif-plugged", "status": "completed", "tag": "08cc6d4b-6ce1-4406-8658-f319c7cbf479"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:24.507439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-380535a1-5747-40f0-9341-370c76e74d9a req-f77b8e95-1edd-455e-a954-2bf6b1b25260 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:24.509213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-380535a1-5747-40f0-9341-370c76e74d9a req-f77b8e95-1edd-455e-a954-2bf6b1b25260 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:24.512844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-380535a1-5747-40f0-9341-370c76e74d9a req-f77b8e95-1edd-455e-a954-2bf6b1b25260 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:24.576139 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-380535a1-5747-40f0-9341-370c76e74d9a req-f77b8e95-1edd-455e-a954-2bf6b1b25260 service nova] Creating event network-vif-plugged:08cc6d4b-6ce1-4406-8658-f319c7cbf479 for instance 4f011ba5-d22c-4c98-82f1-5ce036446009 on n-h1-852084-5 Aug 27 02:37:24.583943 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8b11ee1a-6961-410d-92f6-8190b78f6008 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 1.043519 Aug 27 02:37:24.586497 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1010/1892] 10.222.0.99 () {58 vars in 1212 bytes} [Sat Aug 27 02:37:23 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:24.600247 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-380535a1-5747-40f0-9341-370c76e74d9a req-f77b8e95-1edd-455e-a954-2bf6b1b25260 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166959 Aug 27 02:37:24.600961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3e775daa-8423-406c-80dd-9a792b3ebdf2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:24.609756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3e775daa-8423-406c-80dd-9a792b3ebdf2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:24.614677 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 883/1893] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:24.624928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e775daa-8423-406c-80dd-9a792b3ebdf2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:24.626426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e775daa-8423-406c-80dd-9a792b3ebdf2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:24.627635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e775daa-8423-406c-80dd-9a792b3ebdf2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:24.628448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e775daa-8423-406c-80dd-9a792b3ebdf2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:24.628940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e775daa-8423-406c-80dd-9a792b3ebdf2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:24.629385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e775daa-8423-406c-80dd-9a792b3ebdf2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:24.648138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b62385a0-7827-4d21-9184-ec0d07bf4da6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:24.653430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b62385a0-7827-4d21-9184-ec0d07bf4da6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:24.668882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b62385a0-7827-4d21-9184-ec0d07bf4da6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:24.670145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b62385a0-7827-4d21-9184-ec0d07bf4da6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:24.671346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b62385a0-7827-4d21-9184-ec0d07bf4da6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:24.673290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b62385a0-7827-4d21-9184-ec0d07bf4da6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:24.674970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b62385a0-7827-4d21-9184-ec0d07bf4da6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:24.676298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b62385a0-7827-4d21-9184-ec0d07bf4da6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:25.012379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3e775daa-8423-406c-80dd-9a792b3ebdf2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:25.027422 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3e775daa-8423-406c-80dd-9a792b3ebdf2 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.439152 Aug 27 02:37:25.042864 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1011/1894] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:24 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:25.063618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1898969a-0662-40a4-8671-e5fb61af5009 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:25.109388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1898969a-0662-40a4-8671-e5fb61af5009 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:25.113899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1898969a-0662-40a4-8671-e5fb61af5009 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:37:25.136099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b62385a0-7827-4d21-9184-ec0d07bf4da6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:25.147060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1898969a-0662-40a4-8671-e5fb61af5009 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:25.150485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1898969a-0662-40a4-8671-e5fb61af5009 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:25.150874 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b62385a0-7827-4d21-9184-ec0d07bf4da6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.529960 Aug 27 02:37:25.153307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1898969a-0662-40a4-8671-e5fb61af5009 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:25.153534 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 884/1895] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:24 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:25.157632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1898969a-0662-40a4-8671-e5fb61af5009 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:25.159215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1898969a-0662-40a4-8671-e5fb61af5009 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:25.164104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a4e48c6b-ac17-4679-9725-82ee147a589a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:25.167644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1898969a-0662-40a4-8671-e5fb61af5009 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:25.168000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a4e48c6b-ac17-4679-9725-82ee147a589a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:25.186809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e48c6b-ac17-4679-9725-82ee147a589a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:25.187327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e48c6b-ac17-4679-9725-82ee147a589a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:25.188252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e48c6b-ac17-4679-9725-82ee147a589a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:25.191729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e48c6b-ac17-4679-9725-82ee147a589a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:25.193072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e48c6b-ac17-4679-9725-82ee147a589a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:25.194335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e48c6b-ac17-4679-9725-82ee147a589a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:25.425514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-1898969a-0662-40a4-8671-e5fb61af5009 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:37:25.567068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a4e48c6b-ac17-4679-9725-82ee147a589a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:25.572109 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1898969a-0662-40a4-8671-e5fb61af5009 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.525768 Aug 27 02:37:25.573412 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1012/1896] 10.222.0.99 () {58 vars in 1196 bytes} [Sat Aug 27 02:37:25 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:25.584303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1400e901-ed74-4b9b-b82c-8b7f542eb397 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:25.585705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1400e901-ed74-4b9b-b82c-8b7f542eb397 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:25.590890 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a4e48c6b-ac17-4679-9725-82ee147a589a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1322 microversion: 2.1 time: 0.430765 Aug 27 02:37:25.592310 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 885/1897] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:25 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:25.611061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:25.614627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1400e901-ed74-4b9b-b82c-8b7f542eb397 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:25.615218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1400e901-ed74-4b9b-b82c-8b7f542eb397 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:25.615709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1400e901-ed74-4b9b-b82c-8b7f542eb397 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:25.616524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1400e901-ed74-4b9b-b82c-8b7f542eb397 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:25.617044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:25.623084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1400e901-ed74-4b9b-b82c-8b7f542eb397 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:25.623605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1400e901-ed74-4b9b-b82c-8b7f542eb397 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:25.635304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:25.635304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:25.637624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:25.641018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:25.641570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:25.642503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:25.690672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1400e901-ed74-4b9b-b82c-8b7f542eb397 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:37:25.980725 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1400e901-ed74-4b9b-b82c-8b7f542eb397 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 204 len: 0 microversion: 2.1 time: 0.403545 Aug 27 02:37:25.982804 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1013/1898] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:37:25 2022] DELETE /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:37:25.990962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f7f475a5-24c6-409e-a705-c5686d5f415e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:26.006629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f7f475a5-24c6-409e-a705-c5686d5f415e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:26.008199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f7f475a5-24c6-409e-a705-c5686d5f415e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'name': '-846876441', 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:37:26.028558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7f475a5-24c6-409e-a705-c5686d5f415e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:26.029474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7f475a5-24c6-409e-a705-c5686d5f415e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:26.030324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7f475a5-24c6-409e-a705-c5686d5f415e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:26.032613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7f475a5-24c6-409e-a705-c5686d5f415e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:26.032613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7f475a5-24c6-409e-a705-c5686d5f415e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:26.034942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7f475a5-24c6-409e-a705-c5686d5f415e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:26.070404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:26.089285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:26.098771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:26.104097 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0bc87553-51c1-491d-9f1e-54c8740da18f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.510245 Aug 27 02:37:26.111474 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 886/1899] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:25 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:26.116672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-338ad562-b804-45da-ac92-43371893371f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:26.131860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-338ad562-b804-45da-ac92-43371893371f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:26.153321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-338ad562-b804-45da-ac92-43371893371f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:26.156049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-338ad562-b804-45da-ac92-43371893371f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:26.157229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-338ad562-b804-45da-ac92-43371893371f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:26.159427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-338ad562-b804-45da-ac92-43371893371f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:26.161877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-338ad562-b804-45da-ac92-43371893371f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:26.163745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-338ad562-b804-45da-ac92-43371893371f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:26.495394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-f7f475a5-24c6-409e-a705-c5686d5f415e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:37:26.653633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-338ad562-b804-45da-ac92-43371893371f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:26.669550 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-338ad562-b804-45da-ac92-43371893371f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1513 microversion: 2.1 time: 0.556354 Aug 27 02:37:26.688461 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 887/1900] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:26 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1513 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:26.697124 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f7f475a5-24c6-409e-a705-c5686d5f415e tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?name=-846876441" status: 200 len: 345 microversion: 2.1 time: 0.708683 Aug 27 02:37:26.702734 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1014/1901] 10.222.0.99 () {58 vars in 1156 bytes} [Sat Aug 27 02:37:25 2022] GET /compute/v2.1/servers?name=-846876441 => generated 345 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:26.728316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a636308-090e-4ac6-887e-e9859e64d199 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:26.729403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5a636308-090e-4ac6-887e-e9859e64d199 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:26.735635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61fbebb1-6eb2-45a2-9605-fbaabbe1341f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:26.740738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-61fbebb1-6eb2-45a2-9605-fbaabbe1341f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:26.742233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a636308-090e-4ac6-887e-e9859e64d199 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:26.743148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a636308-090e-4ac6-887e-e9859e64d199 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:26.744108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a636308-090e-4ac6-887e-e9859e64d199 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:26.745498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a636308-090e-4ac6-887e-e9859e64d199 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:26.746071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a636308-090e-4ac6-887e-e9859e64d199 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:26.746879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a636308-090e-4ac6-887e-e9859e64d199 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:26.781069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61fbebb1-6eb2-45a2-9605-fbaabbe1341f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:26.784637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61fbebb1-6eb2-45a2-9605-fbaabbe1341f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:26.790033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61fbebb1-6eb2-45a2-9605-fbaabbe1341f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:26.794464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61fbebb1-6eb2-45a2-9605-fbaabbe1341f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:26.801403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61fbebb1-6eb2-45a2-9605-fbaabbe1341f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:26.805278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61fbebb1-6eb2-45a2-9605-fbaabbe1341f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:27.273126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5a636308-090e-4ac6-887e-e9859e64d199 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:27.286359 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a636308-090e-4ac6-887e-e9859e64d199 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.595664 Aug 27 02:37:27.287213 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 888/1902] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:26 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:27.292378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-71ad7c07-bee4-4641-8e3d-d943ffbf0ab2 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:27.293292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-71ad7c07-bee4-4641-8e3d-d943ffbf0ab2 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:27.316716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ad7c07-bee4-4641-8e3d-d943ffbf0ab2 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:27.319423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ad7c07-bee4-4641-8e3d-d943ffbf0ab2 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:27.320260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ad7c07-bee4-4641-8e3d-d943ffbf0ab2 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:27.321447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ad7c07-bee4-4641-8e3d-d943ffbf0ab2 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:27.322137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ad7c07-bee4-4641-8e3d-d943ffbf0ab2 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:27.322750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ad7c07-bee4-4641-8e3d-d943ffbf0ab2 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:27.326983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-61fbebb1-6eb2-45a2-9605-fbaabbe1341f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:27.346011 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61fbebb1-6eb2-45a2-9605-fbaabbe1341f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.639577 Aug 27 02:37:27.362926 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1015/1903] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:26 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:27.400188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2ba04798-e938-461d-bcba-0066472196d4 req-ff9280a0-444d-4238-8a29-8030396123b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59462ca6-1830-4fae-a141-ffade28879f6", "name": "network-vif-plugged", "status": "completed", "tag": "b9a18ca7-1e41-4aa3-9c64-1d916f180dce"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:27.462522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:27.476672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2ba04798-e938-461d-bcba-0066472196d4 req-ff9280a0-444d-4238-8a29-8030396123b1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:27.477925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2ba04798-e938-461d-bcba-0066472196d4 req-ff9280a0-444d-4238-8a29-8030396123b1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:27.479041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2ba04798-e938-461d-bcba-0066472196d4 req-ff9280a0-444d-4238-8a29-8030396123b1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:27.540581 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2ba04798-e938-461d-bcba-0066472196d4 req-ff9280a0-444d-4238-8a29-8030396123b1 service nova] Creating event network-vif-plugged:b9a18ca7-1e41-4aa3-9c64-1d916f180dce for instance 59462ca6-1830-4fae-a141-ffade28879f6 on n-h1-852084-5 Aug 27 02:37:27.559165 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2ba04798-e938-461d-bcba-0066472196d4 req-ff9280a0-444d-4238-8a29-8030396123b1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188057 Aug 27 02:37:27.561155 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1016/1904] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:27.581066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b052e18f-f86b-41c1-b81b-19ab15bf5687 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:27.633801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b052e18f-f86b-41c1-b81b-19ab15bf5687 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:27.635801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b052e18f-f86b-41c1-b81b-19ab15bf5687 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:37:27.674329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b052e18f-f86b-41c1-b81b-19ab15bf5687 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:27.678119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b052e18f-f86b-41c1-b81b-19ab15bf5687 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:27.679271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b052e18f-f86b-41c1-b81b-19ab15bf5687 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:27.691413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b052e18f-f86b-41c1-b81b-19ab15bf5687 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:27.694467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b052e18f-f86b-41c1-b81b-19ab15bf5687 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:27.696301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b052e18f-f86b-41c1-b81b-19ab15bf5687 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:27.767683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-71ad7c07-bee4-4641-8e3d-d943ffbf0ab2 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:27.800925 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-71ad7c07-bee4-4641-8e3d-d943ffbf0ab2 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1472 microversion: 2.1 time: 0.511966 Aug 27 02:37:27.813867 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 889/1905] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:27 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1472 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:27.822175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:27.824273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:27.833116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:27.834264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:27.835155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:27.837636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:27.838692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:27.839579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:28.147395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:28.161114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-b052e18f-f86b-41c1-b81b-19ab15bf5687 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:37:28.176150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:28.180951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:28.184593 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-41113558-d715-4522-be6f-21c15546ddc4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.368839 Aug 27 02:37:28.186499 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 890/1906] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:27 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:28.202936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-277f8c28-8d94-47fe-89aa-596be86f0320 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:28.202936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-277f8c28-8d94-47fe-89aa-596be86f0320 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:28.205105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-277f8c28-8d94-47fe-89aa-596be86f0320 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:28.206531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-277f8c28-8d94-47fe-89aa-596be86f0320 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:28.207419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-277f8c28-8d94-47fe-89aa-596be86f0320 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:28.208977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-277f8c28-8d94-47fe-89aa-596be86f0320 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:28.209630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-277f8c28-8d94-47fe-89aa-596be86f0320 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:28.210895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-277f8c28-8d94-47fe-89aa-596be86f0320 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:28.376500 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b052e18f-f86b-41c1-b81b-19ab15bf5687 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.809216 Aug 27 02:37:28.377369 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1017/1907] 10.222.0.99 () {58 vars in 1154 bytes} [Sat Aug 27 02:37:27 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:28.506706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7753c893-4040-408c-915d-9714442133e7 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:28.507437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7753c893-4040-408c-915d-9714442133e7 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] [instance: 57106a7f-e35f-4360-a05b-ea6d035dcea8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:28.511638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-277f8c28-8d94-47fe-89aa-596be86f0320 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-7753c893-4040-408c-915d-9714442133e7 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] HTTP exception thrown: Instance 57106a7f-e35f-4360-a05b-ea6d035dcea8 could not be found. Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7753c893-4040-408c-915d-9714442133e7 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Request method failure captured: Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/57106a7f-e35f-4360-a05b-ea6d035dcea8/action HTTP/1.1 Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 15 Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYNIznS0rhC77VgUSbLMXgHG9UXZEuVWkQsO6zernVX2rSm_xfYDLlRYG50fRwILb8MWG2wIbJfS25WLXUL1LgG612aiikGpawrcPydoQzncVWx8kn75bEJ54HxKIIRA0Lrq4mX9bNWFblXqi5HNxHvF4Ibr4W4ozTLIY1W5uutEkoo Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 8329ff444ffa450db59e926a09a4d9e9 Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8329ff444ffa450db59e926a09a4d9e9"}]}] Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 8329ff444ffa450db59e926a09a4d9e9 Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdminNegativeTestJSON-1971866285-project-admin Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 777565270ff34c41ad73a3b0c9ab021a Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1971866285-project-admin Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: {"migrate": {}} Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 57106a7f-e35f-4360-a05b-ea6d035dcea8 could not be found. Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '57106a7f-e35f-4360-a05b-ea6d035dcea8', 'body': {'migrate': {}}} Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57106a7f-e35f-4360-a05b-ea6d035dcea8 could not be found. Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:37:28.530831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:37:28.540892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57106a7f-e35f-4360-a05b-ea6d035dcea8 could not be found. Aug 27 02:37:28.540892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:28.540892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:28.540892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:28.540892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:28.540892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:28.540892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:28.540892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:37:28.540892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:37:28.540892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57106a7f-e35f-4360-a05b-ea6d035dcea8 could not be found. Aug 27 02:37:28.540892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:28.542579 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-277f8c28-8d94-47fe-89aa-596be86f0320 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1513 microversion: 2.1 time: 0.341742 Aug 27 02:37:28.542786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7753c893-4040-408c-915d-9714442133e7 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Returning 404 to user: Instance 57106a7f-e35f-4360-a05b-ea6d035dcea8 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:37:28.542975 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 891/1908] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:28 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1513 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:28.551270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fec90383-af4b-4c81-b904-b0c04adf1a7c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:28.552217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fec90383-af4b-4c81-b904-b0c04adf1a7c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:28.563692 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7753c893-4040-408c-915d-9714442133e7 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/57106a7f-e35f-4360-a05b-ea6d035dcea8/action" status: 404 len: 111 microversion: 2.1 time: 0.145311 Aug 27 02:37:28.568472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fec90383-af4b-4c81-b904-b0c04adf1a7c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:28.570124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fec90383-af4b-4c81-b904-b0c04adf1a7c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:28.572555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fec90383-af4b-4c81-b904-b0c04adf1a7c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:28.574178 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1018/1909] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:37:28 2022] POST /compute/v2.1/servers/57106a7f-e35f-4360-a05b-ea6d035dcea8/action => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:37:28.574440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fec90383-af4b-4c81-b904-b0c04adf1a7c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:28.575083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fec90383-af4b-4c81-b904-b0c04adf1a7c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:28.577694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fec90383-af4b-4c81-b904-b0c04adf1a7c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:28.579526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9727ef27-96cc-4e90-8452-e67d67d46ff9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:28.585559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9727ef27-96cc-4e90-8452-e67d67d46ff9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:28.589854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9727ef27-96cc-4e90-8452-e67d67d46ff9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-84687644', 'deleted': False, 'project_id': 'b94125c73a7244d498e0665504bbfd27'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:37:28.603095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9727ef27-96cc-4e90-8452-e67d67d46ff9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:28.603556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9727ef27-96cc-4e90-8452-e67d67d46ff9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:28.604370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9727ef27-96cc-4e90-8452-e67d67d46ff9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:28.605198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9727ef27-96cc-4e90-8452-e67d67d46ff9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:28.605805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9727ef27-96cc-4e90-8452-e67d67d46ff9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:28.606123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9727ef27-96cc-4e90-8452-e67d67d46ff9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:28.946128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-9727ef27-96cc-4e90-8452-e67d67d46ff9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:37:29.124175 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9727ef27-96cc-4e90-8452-e67d67d46ff9 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-84687644" status: 200 len: 345 microversion: 2.1 time: 0.548445 Aug 27 02:37:29.125852 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1019/1910] 10.222.0.99 () {58 vars in 1226 bytes} [Sat Aug 27 02:37:28 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-84687644 => generated 345 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:29.131815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4df05b0d-1b12-44cf-b941-7f0bf0db8a24 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:29.133106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4df05b0d-1b12-44cf-b941-7f0bf0db8a24 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:29.141825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4df05b0d-1b12-44cf-b941-7f0bf0db8a24 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:29.142752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4df05b0d-1b12-44cf-b941-7f0bf0db8a24 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:29.143462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4df05b0d-1b12-44cf-b941-7f0bf0db8a24 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:29.144702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4df05b0d-1b12-44cf-b941-7f0bf0db8a24 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:29.146231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4df05b0d-1b12-44cf-b941-7f0bf0db8a24 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:29.147118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4df05b0d-1b12-44cf-b941-7f0bf0db8a24 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:29.171745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fec90383-af4b-4c81-b904-b0c04adf1a7c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:29.190402 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fec90383-af4b-4c81-b904-b0c04adf1a7c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.656919 Aug 27 02:37:29.191491 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 892/1911] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:28 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:29.201353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1708458635", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:29.752118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4df05b0d-1b12-44cf-b941-7f0bf0db8a24 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:29.783391 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4df05b0d-1b12-44cf-b941-7f0bf0db8a24 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.653202 Aug 27 02:37:29.794154 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1020/1912] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:29 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:29.811029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3f287836-8cad-4e40-b8b0-b3cbe43027e6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:29.812588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3f287836-8cad-4e40-b8b0-b3cbe43027e6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:29.866086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f287836-8cad-4e40-b8b0-b3cbe43027e6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:29.866438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f287836-8cad-4e40-b8b0-b3cbe43027e6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:29.868088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f287836-8cad-4e40-b8b0-b3cbe43027e6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:29.871528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f287836-8cad-4e40-b8b0-b3cbe43027e6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:29.872986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f287836-8cad-4e40-b8b0-b3cbe43027e6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:29.874188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f287836-8cad-4e40-b8b0-b3cbe43027e6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:30.018033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3f287836-8cad-4e40-b8b0-b3cbe43027e6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:37:30.086658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:30.227955 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3f287836-8cad-4e40-b8b0-b3cbe43027e6 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 204 len: 0 microversion: 2.1 time: 0.424489 Aug 27 02:37:30.227955 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1021/1913] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:37:29 2022] DELETE /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:37:30.239895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:30.242311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:30.258088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:30.262569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:30.262903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:30.265894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:30.267734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:30.268545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:30.530440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:30.547383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:30.549481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:30.551213 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e757f7bc-27c4-4c0d-bd9f-09aa8d4a7dfd tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.324924 Aug 27 02:37:30.566780 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1022/1914] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:30 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:30.583303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:30.584197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:30.595708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:30.596431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:30.596889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:30.598986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:30.599512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:30.599959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:30.670966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:30.672377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:30.672962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:30.673920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lazy-loading 'fault' on Instance uuid 1eb53d1e-63f2-4506-97fd-353b5d7f4156 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:37:30.777214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:30.793402 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bf5cdac4-4009-4c9c-9732-4c1dd7a21b0a tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1307 microversion: 2.1 time: 0.223519 Aug 27 02:37:30.794398 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1023/1915] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:30 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1307 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:30.809017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7b94acd6-e77d-43f2-baac-21a71ab69432 req-5ddd7c33-2056-4ac1-8326-4df14b080f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb53d1e-63f2-4506-97fd-353b5d7f4156", "name": "network-vif-deleted", "tag": "bad964c1-20ba-4d8e-a6a2-21fae1298e94"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:30.830341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7b94acd6-e77d-43f2-baac-21a71ab69432 req-5ddd7c33-2056-4ac1-8326-4df14b080f42 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:30.831711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7b94acd6-e77d-43f2-baac-21a71ab69432 req-5ddd7c33-2056-4ac1-8326-4df14b080f42 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:30.832494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7b94acd6-e77d-43f2-baac-21a71ab69432 req-5ddd7c33-2056-4ac1-8326-4df14b080f42 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:30.855263 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7b94acd6-e77d-43f2-baac-21a71ab69432 req-5ddd7c33-2056-4ac1-8326-4df14b080f42 service nova] Creating event network-vif-deleted:bad964c1-20ba-4d8e-a6a2-21fae1298e94 for instance 1eb53d1e-63f2-4506-97fd-353b5d7f4156 on n-h2-852084-5 Aug 27 02:37:30.863851 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7b94acd6-e77d-43f2-baac-21a71ab69432 req-5ddd7c33-2056-4ac1-8326-4df14b080f42 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066830 Aug 27 02:37:30.869659 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1024/1916] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:30.880295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a3a7f3b7-c48f-415b-9e40-29b6e7c35627 req-2c91a16f-94d5-4514-9a1b-fa0a62981879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cd0655-58b7-4731-84ce-199edeea0cac", "name": "network-vif-unplugged", "status": "completed", "tag": "a95780ce-8687-4bd3-a6a0-0a05511992af"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:30.909044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a3a7f3b7-c48f-415b-9e40-29b6e7c35627 req-2c91a16f-94d5-4514-9a1b-fa0a62981879 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:30.910061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a3a7f3b7-c48f-415b-9e40-29b6e7c35627 req-2c91a16f-94d5-4514-9a1b-fa0a62981879 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:30.911466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a3a7f3b7-c48f-415b-9e40-29b6e7c35627 req-2c91a16f-94d5-4514-9a1b-fa0a62981879 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:30.948562 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a3a7f3b7-c48f-415b-9e40-29b6e7c35627 req-2c91a16f-94d5-4514-9a1b-fa0a62981879 service nova] Creating event network-vif-unplugged:a95780ce-8687-4bd3-a6a0-0a05511992af for instance b8cd0655-58b7-4731-84ce-199edeea0cac on n-h1-852084-5 Aug 27 02:37:30.958690 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a3a7f3b7-c48f-415b-9e40-29b6e7c35627 req-2c91a16f-94d5-4514-9a1b-fa0a62981879 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085913 Aug 27 02:37:30.968812 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1025/1917] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:30.980527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3bcd20e5-be32-4892-bd8a-3a49e99dc9f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:30.981773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3bcd20e5-be32-4892-bd8a-3a49e99dc9f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:31.028061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bcd20e5-be32-4892-bd8a-3a49e99dc9f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:31.030724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bcd20e5-be32-4892-bd8a-3a49e99dc9f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:31.033760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bcd20e5-be32-4892-bd8a-3a49e99dc9f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:31.035446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bcd20e5-be32-4892-bd8a-3a49e99dc9f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:31.036305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bcd20e5-be32-4892-bd8a-3a49e99dc9f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:31.039678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3bcd20e5-be32-4892-bd8a-3a49e99dc9f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:31.403413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3bcd20e5-be32-4892-bd8a-3a49e99dc9f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:31.413014 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3bcd20e5-be32-4892-bd8a-3a49e99dc9f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.445304 Aug 27 02:37:31.413624 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1026/1918] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:30 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:31.418596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-176eeb92-0f61-4d93-ac7c-03571cd49fa0 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:31.419225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-176eeb92-0f61-4d93-ac7c-03571cd49fa0 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:31.426110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-176eeb92-0f61-4d93-ac7c-03571cd49fa0 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:31.426789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-176eeb92-0f61-4d93-ac7c-03571cd49fa0 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:31.427227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-176eeb92-0f61-4d93-ac7c-03571cd49fa0 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:31.427968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-176eeb92-0f61-4d93-ac7c-03571cd49fa0 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:31.428437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-176eeb92-0f61-4d93-ac7c-03571cd49fa0 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:31.428849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-176eeb92-0f61-4d93-ac7c-03571cd49fa0 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:31.665467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-176eeb92-0f61-4d93-ac7c-03571cd49fa0 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:31.674485 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-176eeb92-0f61-4d93-ac7c-03571cd49fa0 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1518 microversion: 2.1 time: 0.259748 Aug 27 02:37:31.688850 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1027/1919] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:31 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1518 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:31.703080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4737cc0c-0c3c-49e2-80da-7e4758053be5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:31.703080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4737cc0c-0c3c-49e2-80da-7e4758053be5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:31.703080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:31.713338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4737cc0c-0c3c-49e2-80da-7e4758053be5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:31.713338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4737cc0c-0c3c-49e2-80da-7e4758053be5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:31.713338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4737cc0c-0c3c-49e2-80da-7e4758053be5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:31.713338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4737cc0c-0c3c-49e2-80da-7e4758053be5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:31.713338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4737cc0c-0c3c-49e2-80da-7e4758053be5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:31.713338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4737cc0c-0c3c-49e2-80da-7e4758053be5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:32.109645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4737cc0c-0c3c-49e2-80da-7e4758053be5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:32.122794 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4737cc0c-0c3c-49e2-80da-7e4758053be5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.432638 Aug 27 02:37:32.123399 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1028/1920] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:31 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:32.137364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:32.160290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:32.182545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:32.186625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:32.189425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:32.191075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:32.193818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:32.204884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:32.484678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:32.512913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:32.515843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:32.519747 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad98afe2-8777-43db-a10d-47aef126eaf8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.386144 Aug 27 02:37:32.522189 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1029/1921] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:32 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:32.530891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:32.532362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:32.547690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:32.549327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:32.550548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:32.552156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:32.553079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:32.553835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:32.698163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:32.703721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:32.703721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:32.703721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lazy-loading 'fault' on Instance uuid 1eb53d1e-63f2-4506-97fd-353b5d7f4156 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:37:32.879343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:32.919940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:32.939099 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c17a794a-2812-4644-95b4-24aa41021df6 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 200 len: 1307 microversion: 2.1 time: 0.414981 Aug 27 02:37:32.941632 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1030/1922] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:32 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 1307 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:32.948958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-386066eb-497b-4b2d-981f-a0a5ee9a829a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:32.950039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-386066eb-497b-4b2d-981f-a0a5ee9a829a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:32.963066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386066eb-497b-4b2d-981f-a0a5ee9a829a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:32.964281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386066eb-497b-4b2d-981f-a0a5ee9a829a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:32.965006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386066eb-497b-4b2d-981f-a0a5ee9a829a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:32.966708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386066eb-497b-4b2d-981f-a0a5ee9a829a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:32.967509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386066eb-497b-4b2d-981f-a0a5ee9a829a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:32.968198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386066eb-497b-4b2d-981f-a0a5ee9a829a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:33.311436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-386066eb-497b-4b2d-981f-a0a5ee9a829a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:33.327429 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-386066eb-497b-4b2d-981f-a0a5ee9a829a tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.383681 Aug 27 02:37:33.328039 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1031/1923] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:32 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:33.374753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:33.376558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:33.393509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:33.394503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:33.397091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:33.398919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:33.401306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:33.403968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:33.482338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:33.482935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:33.483534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:33.484006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lazy-loading 'fault' on Instance uuid 5b9c5ef8-086d-43da-8f95-67d5be4015ec {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:37:33.561759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:33.572709 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-03776cde-8981-43c7-968a-9567a85022ef tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 200 len: 1310 microversion: 2.1 time: 0.243570 Aug 27 02:37:33.595117 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1032/1924] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:33 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 1310 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:33.611437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-da391518-48e0-45f2-9017-369561619c54 req-a02f6885-6730-45e7-86d2-f7a110b1482a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cd0655-58b7-4731-84ce-199edeea0cac", "tag": "a95780ce-8687-4bd3-a6a0-0a05511992af"}, {"server_uuid": "5b9c5ef8-086d-43da-8f95-67d5be4015ec", "name": "network-vif-deleted", "tag": "18b71e37-350d-4218-8008-d9a7fb55178b"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:33.636690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-da391518-48e0-45f2-9017-369561619c54 req-a02f6885-6730-45e7-86d2-f7a110b1482a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:33.638938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-da391518-48e0-45f2-9017-369561619c54 req-a02f6885-6730-45e7-86d2-f7a110b1482a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:33.640517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-da391518-48e0-45f2-9017-369561619c54 req-a02f6885-6730-45e7-86d2-f7a110b1482a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:33.678886 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-da391518-48e0-45f2-9017-369561619c54 req-a02f6885-6730-45e7-86d2-f7a110b1482a service nova] Creating event network-changed:a95780ce-8687-4bd3-a6a0-0a05511992af for instance b8cd0655-58b7-4731-84ce-199edeea0cac on n-h1-852084-5 Aug 27 02:37:33.681698 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-da391518-48e0-45f2-9017-369561619c54 req-a02f6885-6730-45e7-86d2-f7a110b1482a service nova] Creating event network-vif-deleted:18b71e37-350d-4218-8008-d9a7fb55178b for instance 5b9c5ef8-086d-43da-8f95-67d5be4015ec on n-h2-852084-5 Aug 27 02:37:33.704001 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-da391518-48e0-45f2-9017-369561619c54 req-a02f6885-6730-45e7-86d2-f7a110b1482a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.106972 Aug 27 02:37:33.705228 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1033/1925] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:33.721980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cbfdf036-a2e2-4a36-862d-b987557db04e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:33.723553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cbfdf036-a2e2-4a36-862d-b987557db04e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:33.744828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfdf036-a2e2-4a36-862d-b987557db04e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:33.745762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfdf036-a2e2-4a36-862d-b987557db04e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:33.746609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfdf036-a2e2-4a36-862d-b987557db04e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:33.748138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfdf036-a2e2-4a36-862d-b987557db04e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:33.749111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfdf036-a2e2-4a36-862d-b987557db04e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:33.749922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfdf036-a2e2-4a36-862d-b987557db04e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:34.093546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cbfdf036-a2e2-4a36-862d-b987557db04e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:34.103602 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cbfdf036-a2e2-4a36-862d-b987557db04e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.391169 Aug 27 02:37:34.104554 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1034/1926] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:33 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:34.109864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:34.110866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:34.117798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:34.118727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:34.119422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:34.120459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:34.121289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:34.122753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:34.421508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:34.462848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:34.469371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:34.472525 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-475472b0-2260-41ed-a8cd-74c34f4a3da0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.366127 Aug 27 02:37:34.490331 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1035/1927] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:34 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:34.507842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:34.513655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: 1eb53d1e-63f2-4506-97fd-353b5d7f4156] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:34.558331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:34.561115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:34.569556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:34.571705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:34.572827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:34.574065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:34.646873 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] HTTP exception thrown: Instance 1eb53d1e-63f2-4506-97fd-353b5d7f4156 could not be found. Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Request method failure captured: Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 HTTP/1.1 Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYKnfVHfkHH9WuC2wx9m7EcxyvmB3Ol3cRAhVQ8u7hGncamdaO7AXvmgBjURrZ60xI0mTNtsp9pMUxr8udnQ1ech7DB3AXIkc2EnZfTcCSDKJd3zcZiBe-ZEZgRfs-aHu9V7dnPyZtu5tysjfmf3dME4SQEa6klgx0Mz1bF_SKg9fw4 Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c45b216feebc4d898843009e9eb608ca Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-VolumesAdminNegativeTest-1918275541 Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c45b216feebc4d898843009e9eb608ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c45b216feebc4d898843009e9eb608ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c45b216feebc4d898843009e9eb608ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c45b216feebc4d898843009e9eb608ca"}]}] Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-VolumesAdminNegativeTest-1918275541 Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c45b216feebc4d898843009e9eb608ca Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1918275541 Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-VolumesAdminNegativeTest-1918275541-project Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 49945341feee4fd4b40ea30f385fc9f0 Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-VolumesAdminNegativeTest-1918275541-project Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 1eb53d1e-63f2-4506-97fd-353b5d7f4156 could not be found. Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '1eb53d1e-63f2-4506-97fd-353b5d7f4156'} Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb53d1e-63f2-4506-97fd-353b5d7f4156 could not be found. Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb53d1e-63f2-4506-97fd-353b5d7f4156 could not be found. Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:34.650174 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:34.662917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:34.662917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:34.662917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:34.662917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:37:34.662917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:37:34.662917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb53d1e-63f2-4506-97fd-353b5d7f4156 could not be found. Aug 27 02:37:34.662917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:34.662917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Returning 404 to user: Instance 1eb53d1e-63f2-4506-97fd-353b5d7f4156 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:37:34.662917 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5da41ca0-bbd3-477c-8a70-e4f007fa5bc4 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156" status: 404 len: 111 microversion: 2.1 time: 0.160168 Aug 27 02:37:34.665227 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1036/1928] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:34 2022] GET /compute/v2.1/servers/1eb53d1e-63f2-4506-97fd-353b5d7f4156 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:37:34.679764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f47a5eb3-caa2-4ea2-877c-34c06bcea9b1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:34.680807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f47a5eb3-caa2-4ea2-877c-34c06bcea9b1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:34.708547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f47a5eb3-caa2-4ea2-877c-34c06bcea9b1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:34.709344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f47a5eb3-caa2-4ea2-877c-34c06bcea9b1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:34.710090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f47a5eb3-caa2-4ea2-877c-34c06bcea9b1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:34.711337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f47a5eb3-caa2-4ea2-877c-34c06bcea9b1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:34.712065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f47a5eb3-caa2-4ea2-877c-34c06bcea9b1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:34.712775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f47a5eb3-caa2-4ea2-877c-34c06bcea9b1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:35.188404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f47a5eb3-caa2-4ea2-877c-34c06bcea9b1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:35.213800 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f47a5eb3-caa2-4ea2-877c-34c06bcea9b1 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.537480 Aug 27 02:37:35.214530 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1037/1929] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:34 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:35.219479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:35.220286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 5b9c5ef8-086d-43da-8f95-67d5be4015ec] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:35.235879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:35.236397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:35.236869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:35.237693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:35.238131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:35.239524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:35.258325 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] HTTP exception thrown: Instance 5b9c5ef8-086d-43da-8f95-67d5be4015ec could not be found. Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Request method failure captured: Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec HTTP/1.1 Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYL9Yay3HzZZm4mpmlcXZhl_9kgVKarmDBvi5XTtAnFMyf7mj4m_PhbrVACiW0DHnb6lGVCaqDIqb4fEd8CmAPLQZNnpgNFF59sNVbPowZyHQNqNbk9bY6aBp3TkTRzuFvT4ZPVeHvHUhK3VzfnZtE1TSmEfElycPgcjXJJ9NDHzKcA Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: b94125c73a7244d498e0665504bbfd27 Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ListServerFiltersTestJSON-151568494 Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b94125c73a7244d498e0665504bbfd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b94125c73a7244d498e0665504bbfd27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b94125c73a7244d498e0665504bbfd27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b94125c73a7244d498e0665504bbfd27"}]}] Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ListServerFiltersTestJSON-151568494 Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: b94125c73a7244d498e0665504bbfd27 Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-151568494 Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ListServerFiltersTestJSON-151568494-project Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 523a44993f39483698de40b10984c854 Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ListServerFiltersTestJSON-151568494-project Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 5b9c5ef8-086d-43da-8f95-67d5be4015ec could not be found. Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '5b9c5ef8-086d-43da-8f95-67d5be4015ec'} Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9c5ef8-086d-43da-8f95-67d5be4015ec could not be found. Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9c5ef8-086d-43da-8f95-67d5be4015ec could not be found. Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:35.260669 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:35.265878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:35.265878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:35.265878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:35.265878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:37:35.265878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:37:35.265878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9c5ef8-086d-43da-8f95-67d5be4015ec could not be found. Aug 27 02:37:35.265878 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:35.268143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Returning 404 to user: Instance 5b9c5ef8-086d-43da-8f95-67d5be4015ec could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:37:35.269498 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-002c0c38-76d8-4e1d-8819-77591c8e3f70 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec" status: 404 len: 111 microversion: 2.1 time: 0.053960 Aug 27 02:37:35.270533 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1038/1930] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:35 2022] GET /compute/v2.1/servers/5b9c5ef8-086d-43da-8f95-67d5be4015ec => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:37:35.275585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-05119cae-f1f6-4fab-93b9-eb7857274aa6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:35.276584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-05119cae-f1f6-4fab-93b9-eb7857274aa6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:35.284013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05119cae-f1f6-4fab-93b9-eb7857274aa6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:35.284873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05119cae-f1f6-4fab-93b9-eb7857274aa6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:35.285605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05119cae-f1f6-4fab-93b9-eb7857274aa6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:35.286635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05119cae-f1f6-4fab-93b9-eb7857274aa6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:35.287327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05119cae-f1f6-4fab-93b9-eb7857274aa6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:35.287975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05119cae-f1f6-4fab-93b9-eb7857274aa6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:35.671364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-05119cae-f1f6-4fab-93b9-eb7857274aa6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:35.676797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:35.689872 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-05119cae-f1f6-4fab-93b9-eb7857274aa6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.417553 Aug 27 02:37:35.690656 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1039/1931] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:35 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:35.701612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-761881fc-be29-4e44-ad06-f0218cdf1bdb tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:35.702559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-761881fc-be29-4e44-ad06-f0218cdf1bdb tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: cd064beb-dd01-45e4-ba62-4bc863fd9ca9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:35.715721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-761881fc-be29-4e44-ad06-f0218cdf1bdb tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:35.717057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-761881fc-be29-4e44-ad06-f0218cdf1bdb tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:35.718485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-761881fc-be29-4e44-ad06-f0218cdf1bdb tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:35.720090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-761881fc-be29-4e44-ad06-f0218cdf1bdb tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:35.721353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-761881fc-be29-4e44-ad06-f0218cdf1bdb tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:35.722556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-761881fc-be29-4e44-ad06-f0218cdf1bdb tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:35.775243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-761881fc-be29-4e44-ad06-f0218cdf1bdb tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: cd064beb-dd01-45e4-ba62-4bc863fd9ca9] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:37:35.971677 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-761881fc-be29-4e44-ad06-f0218cdf1bdb tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "DELETE /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9" status: 204 len: 0 microversion: 2.1 time: 0.278855 Aug 27 02:37:35.996355 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1040/1932] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:37:35 2022] DELETE /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:37:36.023967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:36.025227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:36.047907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:36.049968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:36.053224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:36.054950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:36.058929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:36.063594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:36.439670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:36.491185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:36.494818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:36.511468 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-624ead2a-6e17-4f8f-8374-d5543e724acc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.499516 Aug 27 02:37:36.564978 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1041/1933] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:35 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:36.578696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-868e8950-403b-4211-8963-897d39261a42 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:36.587170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-868e8950-403b-4211-8963-897d39261a42 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: cd064beb-dd01-45e4-ba62-4bc863fd9ca9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:36.608997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e8950-403b-4211-8963-897d39261a42 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:36.611594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e8950-403b-4211-8963-897d39261a42 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:36.612691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e8950-403b-4211-8963-897d39261a42 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:36.614569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e8950-403b-4211-8963-897d39261a42 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:36.615830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e8950-403b-4211-8963-897d39261a42 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:36.617011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e8950-403b-4211-8963-897d39261a42 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:37.011253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-868e8950-403b-4211-8963-897d39261a42 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:37.034983 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-868e8950-403b-4211-8963-897d39261a42 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9" status: 200 len: 1519 microversion: 2.1 time: 0.467691 Aug 27 02:37:37.053752 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1042/1934] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:36 2022] GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9 => generated 1519 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:37.053752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ffba5535-d4d9-4436-9e02-1c06437d25ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:37.053752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ffba5535-d4d9-4436-9e02-1c06437d25ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:37.075089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffba5535-d4d9-4436-9e02-1c06437d25ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:37.075603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffba5535-d4d9-4436-9e02-1c06437d25ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:37.076056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffba5535-d4d9-4436-9e02-1c06437d25ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:37.076801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffba5535-d4d9-4436-9e02-1c06437d25ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:37.077278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffba5535-d4d9-4436-9e02-1c06437d25ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:37.077738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffba5535-d4d9-4436-9e02-1c06437d25ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:37.492134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ffba5535-d4d9-4436-9e02-1c06437d25ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:37.513277 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ffba5535-d4d9-4436-9e02-1c06437d25ea tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.467591 Aug 27 02:37:37.540829 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1043/1935] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:37 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:37.545840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-764d861f-562d-4c79-a1d8-2cd2e5b36a21 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:37.546786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-764d861f-562d-4c79-a1d8-2cd2e5b36a21 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:37.555221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-764d861f-562d-4c79-a1d8-2cd2e5b36a21 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:37.556004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-764d861f-562d-4c79-a1d8-2cd2e5b36a21 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:37.556675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-764d861f-562d-4c79-a1d8-2cd2e5b36a21 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:37.557642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-764d861f-562d-4c79-a1d8-2cd2e5b36a21 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:37.558351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-764d861f-562d-4c79-a1d8-2cd2e5b36a21 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:37.559024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-764d861f-562d-4c79-a1d8-2cd2e5b36a21 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:37.953017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-764d861f-562d-4c79-a1d8-2cd2e5b36a21 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:37.968574 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-764d861f-562d-4c79-a1d8-2cd2e5b36a21 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.426471 Aug 27 02:37:37.976460 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1044/1936] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:37 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:37.995164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:37.998004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:38.027585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:38.029369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:38.030154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:38.031141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:38.031791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:38.032409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:38.417658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:38.438402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:38.443070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:38.446429 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-97ac6ebf-74a2-4351-9cb9-ac8fe8cb3a44 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.464283 Aug 27 02:37:38.447640 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1045/1937] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:37 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:38.456947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0e59742c-6c2e-4235-870e-2059a622ed7a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:38.459300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0e59742c-6c2e-4235-870e-2059a622ed7a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: cd064beb-dd01-45e4-ba62-4bc863fd9ca9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:38.470522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e59742c-6c2e-4235-870e-2059a622ed7a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:38.471360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e59742c-6c2e-4235-870e-2059a622ed7a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:38.472194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e59742c-6c2e-4235-870e-2059a622ed7a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:38.473402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e59742c-6c2e-4235-870e-2059a622ed7a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:38.474272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e59742c-6c2e-4235-870e-2059a622ed7a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:38.475100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e59742c-6c2e-4235-870e-2059a622ed7a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:38.673249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=12 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:38.863136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0e59742c-6c2e-4235-870e-2059a622ed7a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:38.889861 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0e59742c-6c2e-4235-870e-2059a622ed7a tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9" status: 200 len: 1519 microversion: 2.1 time: 0.439087 Aug 27 02:37:38.912183 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1046/1938] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:38 2022] GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9 => generated 1519 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:38.942041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-89c2da39-8d8a-439b-8552-c00f1daeb320 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:38.942041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-89c2da39-8d8a-439b-8552-c00f1daeb320 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:38.951158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89c2da39-8d8a-439b-8552-c00f1daeb320 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:38.964112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89c2da39-8d8a-439b-8552-c00f1daeb320 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:38.964112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89c2da39-8d8a-439b-8552-c00f1daeb320 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:38.964112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89c2da39-8d8a-439b-8552-c00f1daeb320 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:38.964112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89c2da39-8d8a-439b-8552-c00f1daeb320 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:38.964112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89c2da39-8d8a-439b-8552-c00f1daeb320 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:39.067624 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-89c2da39-8d8a-439b-8552-c00f1daeb320 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/ips" status: 200 len: 150 microversion: 2.20 time: 0.151603 Aug 27 02:37:39.070830 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1047/1939] 10.222.0.99 () {60 vars in 1289 bytes} [Sat Aug 27 02:37:38 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/ips => generated 150 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:37:39.080488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9aca5c4f-1055-48c6-9a40-c94f26d6af04 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:39.081144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9aca5c4f-1055-48c6-9a40-c94f26d6af04 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:39.103856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aca5c4f-1055-48c6-9a40-c94f26d6af04 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:39.104446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aca5c4f-1055-48c6-9a40-c94f26d6af04 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:39.104944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aca5c4f-1055-48c6-9a40-c94f26d6af04 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:39.105743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aca5c4f-1055-48c6-9a40-c94f26d6af04 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:39.106231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aca5c4f-1055-48c6-9a40-c94f26d6af04 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:39.106906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aca5c4f-1055-48c6-9a40-c94f26d6af04 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:39.179434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=73 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:39.217147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=45 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:39.482721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9aca5c4f-1055-48c6-9a40-c94f26d6af04 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:39.499273 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9aca5c4f-1055-48c6-9a40-c94f26d6af04 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.425853 Aug 27 02:37:39.502549 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1048/1940] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:39 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:39.514423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d4104afa-4b17-46a9-afeb-e7357e442017 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:39.529022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d4104afa-4b17-46a9-afeb-e7357e442017 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:39.553211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4104afa-4b17-46a9-afeb-e7357e442017 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:39.557355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4104afa-4b17-46a9-afeb-e7357e442017 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:39.558087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4104afa-4b17-46a9-afeb-e7357e442017 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:39.572059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4104afa-4b17-46a9-afeb-e7357e442017 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:39.576510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4104afa-4b17-46a9-afeb-e7357e442017 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:39.579083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4104afa-4b17-46a9-afeb-e7357e442017 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:39.874928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d4104afa-4b17-46a9-afeb-e7357e442017 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:39.905530 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d4104afa-4b17-46a9-afeb-e7357e442017 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.399056 Aug 27 02:37:39.925782 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1049/1941] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:39 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:39.927628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:39.931650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:39.955051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:39.956818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:39.959693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:39.960772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:39.961817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:39.980020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:40.656539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:40.700112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:40.703364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:40.705507 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-441bd152-3733-4f1f-a3d3-bbd127c27697 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.794816 Aug 27 02:37:40.722203 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1050/1942] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:39 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:40.868366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4b5f12a6-4497-47d2-bea2-81f0e48ed301 req-0e17bc1e-45d7-4e1c-8a9c-1dbb645769ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd064beb-dd01-45e4-ba62-4bc863fd9ca9", "name": "network-vif-deleted", "tag": "02f0cf52-1193-4bd8-b086-2cb4a4bd27a3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:40.889217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4b5f12a6-4497-47d2-bea2-81f0e48ed301 req-0e17bc1e-45d7-4e1c-8a9c-1dbb645769ed service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:40.890120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4b5f12a6-4497-47d2-bea2-81f0e48ed301 req-0e17bc1e-45d7-4e1c-8a9c-1dbb645769ed service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:40.890764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4b5f12a6-4497-47d2-bea2-81f0e48ed301 req-0e17bc1e-45d7-4e1c-8a9c-1dbb645769ed service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:40.906909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4b5f12a6-4497-47d2-bea2-81f0e48ed301 req-0e17bc1e-45d7-4e1c-8a9c-1dbb645769ed service nova] Creating event network-vif-deleted:02f0cf52-1193-4bd8-b086-2cb4a4bd27a3 for instance cd064beb-dd01-45e4-ba62-4bc863fd9ca9 on n-h1-852084-5 Aug 27 02:37:40.915080 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4b5f12a6-4497-47d2-bea2-81f0e48ed301 req-0e17bc1e-45d7-4e1c-8a9c-1dbb645769ed service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183126 Aug 27 02:37:40.916519 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1051/1943] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:40.926819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:40.928422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: cd064beb-dd01-45e4-ba62-4bc863fd9ca9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:40.938852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:40.940319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:40.940998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:40.942577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:40.943499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:40.944263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:40.992236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:40.993023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:40.993700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:40.995629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lazy-loading 'fault' on Instance uuid cd064beb-dd01-45e4-ba62-4bc863fd9ca9 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:37:41.842022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:41.863190 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7299918c-d86a-4be5-9568-46ed2109b4b7 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9" status: 200 len: 1311 microversion: 2.1 time: 0.936238 Aug 27 02:37:41.877723 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1052/1944] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:40 2022] GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9 => generated 1311 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:41.881207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-51c89769-11af-4476-9882-f05a16384c9b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:41.882420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-51c89769-11af-4476-9882-f05a16384c9b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:41.931581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c89769-11af-4476-9882-f05a16384c9b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:41.933042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c89769-11af-4476-9882-f05a16384c9b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:41.933891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c89769-11af-4476-9882-f05a16384c9b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:41.935208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c89769-11af-4476-9882-f05a16384c9b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:41.936080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c89769-11af-4476-9882-f05a16384c9b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:41.936891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c89769-11af-4476-9882-f05a16384c9b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:42.372000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-51c89769-11af-4476-9882-f05a16384c9b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:42.406637 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-51c89769-11af-4476-9882-f05a16384c9b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.537160 Aug 27 02:37:42.409941 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1053/1945] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:41 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:42.434102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d2fc953e-506c-44f2-9ff7-d6b4415c7b16 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:42.435979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d2fc953e-506c-44f2-9ff7-d6b4415c7b16 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:42.450819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2fc953e-506c-44f2-9ff7-d6b4415c7b16 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:42.463110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2fc953e-506c-44f2-9ff7-d6b4415c7b16 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:42.464500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2fc953e-506c-44f2-9ff7-d6b4415c7b16 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:42.466287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2fc953e-506c-44f2-9ff7-d6b4415c7b16 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:42.467396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2fc953e-506c-44f2-9ff7-d6b4415c7b16 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:42.468359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2fc953e-506c-44f2-9ff7-d6b4415c7b16 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:43.164855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d2fc953e-506c-44f2-9ff7-d6b4415c7b16 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:43.208190 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d2fc953e-506c-44f2-9ff7-d6b4415c7b16 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.792191 Aug 27 02:37:43.214287 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1054/1946] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:42 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:43.240328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:43.241381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:43.253620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:43.255375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:43.256395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:43.257856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:43.258862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:43.259814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:43.316140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:43.695653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:43.729367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:43.774440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:43.779428 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4e54604b-c753-42ce-950e-2aab7ae07967 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.563239 Aug 27 02:37:43.806561 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1055/1947] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:43 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:43.859651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:43.868834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: cd064beb-dd01-45e4-ba62-4bc863fd9ca9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:43.904381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:43.907590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:43.909659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:43.911434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:43.914285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:43.915452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:43.916393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:43.958982 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] HTTP exception thrown: Instance cd064beb-dd01-45e4-ba62-4bc863fd9ca9 could not be found. Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Request method failure captured: Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9 HTTP/1.1 Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYL9Yay3HzZZm4mpmlcXZhl_9kgVKarmDBvi5XTtAnFMyf7mj4m_PhbrVACiW0DHnb6lGVCaqDIqb4fEd8CmAPLQZNnpgNFF59sNVbPowZyHQNqNbk9bY6aBp3TkTRzuFvT4ZPVeHvHUhK3VzfnZtE1TSmEfElycPgcjXJJ9NDHzKcA Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: b94125c73a7244d498e0665504bbfd27 Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ListServerFiltersTestJSON-151568494 Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b94125c73a7244d498e0665504bbfd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b94125c73a7244d498e0665504bbfd27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b94125c73a7244d498e0665504bbfd27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b94125c73a7244d498e0665504bbfd27"}]}] Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ListServerFiltersTestJSON-151568494 Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: b94125c73a7244d498e0665504bbfd27 Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-151568494 Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ListServerFiltersTestJSON-151568494-project Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 523a44993f39483698de40b10984c854 Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ListServerFiltersTestJSON-151568494-project Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance cd064beb-dd01-45e4-ba62-4bc863fd9ca9 could not be found. Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'cd064beb-dd01-45e4-ba62-4bc863fd9ca9'} Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd064beb-dd01-45e4-ba62-4bc863fd9ca9 could not be found. Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd064beb-dd01-45e4-ba62-4bc863fd9ca9 could not be found. Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:43.964220 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:43.974773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:43.974773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:43.974773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:43.974773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:37:43.974773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:37:43.974773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd064beb-dd01-45e4-ba62-4bc863fd9ca9 could not be found. Aug 27 02:37:43.974773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:43.977933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Returning 404 to user: Instance cd064beb-dd01-45e4-ba62-4bc863fd9ca9 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:37:43.981286 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-73752f60-dad3-4e1f-ba6a-729988b17065 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9" status: 404 len: 111 microversion: 2.1 time: 0.171213 Aug 27 02:37:43.982795 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1056/1948] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:43 2022] GET /compute/v2.1/servers/cd064beb-dd01-45e4-ba62-4bc863fd9ca9 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:37:43.993231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d2cf55c-236c-4938-a557-83815588201c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:43.995077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1d2cf55c-236c-4938-a557-83815588201c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:44.008226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d2cf55c-236c-4938-a557-83815588201c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:44.009732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d2cf55c-236c-4938-a557-83815588201c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:44.010886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d2cf55c-236c-4938-a557-83815588201c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:44.012638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d2cf55c-236c-4938-a557-83815588201c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:44.014068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d2cf55c-236c-4938-a557-83815588201c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:44.015216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d2cf55c-236c-4938-a557-83815588201c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:44.478606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1d2cf55c-236c-4938-a557-83815588201c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:44.503252 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1d2cf55c-236c-4938-a557-83815588201c tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 0.518308 Aug 27 02:37:44.505111 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1057/1949] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:43 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:44.515793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-111c6549-5a7c-4101-bdbd-a6161700615f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:44.516434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-111c6549-5a7c-4101-bdbd-a6161700615f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:44.547919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111c6549-5a7c-4101-bdbd-a6161700615f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:44.548738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111c6549-5a7c-4101-bdbd-a6161700615f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:44.549531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111c6549-5a7c-4101-bdbd-a6161700615f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:44.551384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111c6549-5a7c-4101-bdbd-a6161700615f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:44.562915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111c6549-5a7c-4101-bdbd-a6161700615f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:44.564080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111c6549-5a7c-4101-bdbd-a6161700615f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:44.673545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-111c6549-5a7c-4101-bdbd-a6161700615f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:37:44.947836 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-111c6549-5a7c-4101-bdbd-a6161700615f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "DELETE /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 204 len: 0 microversion: 2.1 time: 0.440154 Aug 27 02:37:44.956602 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1058/1950] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:37:44 2022] DELETE /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:37:44.963778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd588bdf-8441-4a54-b49e-40cfd5466b97 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:44.964579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd588bdf-8441-4a54-b49e-40cfd5466b97 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:44.989386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd588bdf-8441-4a54-b49e-40cfd5466b97 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:44.990469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd588bdf-8441-4a54-b49e-40cfd5466b97 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:44.991047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd588bdf-8441-4a54-b49e-40cfd5466b97 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:44.992317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd588bdf-8441-4a54-b49e-40cfd5466b97 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:44.996912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd588bdf-8441-4a54-b49e-40cfd5466b97 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:44.996912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd588bdf-8441-4a54-b49e-40cfd5466b97 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:45.070546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd588bdf-8441-4a54-b49e-40cfd5466b97 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:37:45.231528 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd588bdf-8441-4a54-b49e-40cfd5466b97 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "DELETE /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 204 len: 0 microversion: 2.1 time: 0.276862 Aug 27 02:37:45.232786 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1059/1951] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:37:44 2022] DELETE /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:37:45.247921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-605015ef-2364-4d10-8ec3-03228cba558d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:45.249347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-605015ef-2364-4d10-8ec3-03228cba558d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:45.262188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605015ef-2364-4d10-8ec3-03228cba558d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:45.262946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605015ef-2364-4d10-8ec3-03228cba558d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:45.263715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605015ef-2364-4d10-8ec3-03228cba558d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:45.265137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605015ef-2364-4d10-8ec3-03228cba558d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:45.266034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605015ef-2364-4d10-8ec3-03228cba558d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:45.266737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605015ef-2364-4d10-8ec3-03228cba558d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:45.561390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-605015ef-2364-4d10-8ec3-03228cba558d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:45.577933 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-605015ef-2364-4d10-8ec3-03228cba558d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.337379 Aug 27 02:37:45.579280 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1060/1952] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:45 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:45.588976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b3e1c5c2-00f9-47c5-9882-671c29f7af51 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:45.590298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b3e1c5c2-00f9-47c5-9882-671c29f7af51 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:45.604101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3e1c5c2-00f9-47c5-9882-671c29f7af51 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:45.605385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3e1c5c2-00f9-47c5-9882-671c29f7af51 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:45.606453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3e1c5c2-00f9-47c5-9882-671c29f7af51 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:45.607922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3e1c5c2-00f9-47c5-9882-671c29f7af51 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:45.608991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3e1c5c2-00f9-47c5-9882-671c29f7af51 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:45.610011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3e1c5c2-00f9-47c5-9882-671c29f7af51 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:45.655949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-b3e1c5c2-00f9-47c5-9882-671c29f7af51 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lazy-loading 'flavor' on Instance uuid 893e335c-913a-479a-9ee8-f61fc9a3b36f {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:37:47.079420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:37:47.272307 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b3e1c5c2-00f9-47c5-9882-671c29f7af51 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "POST /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/action" status: 202 len: 0 microversion: 2.20 time: 1.691219 Aug 27 02:37:47.273801 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1061/1953] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:37:45 2022] POST /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/action => generated 0 bytes in 1694 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:37:47.280735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:47.281858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:47.292198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:47.293061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:47.293805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:47.294799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:47.295489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:47.296136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:47.617644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:37:47.618983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:37:47.620145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:37:47.624120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:37:47.625103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:37:47.718254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:47.725601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:47.729545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:47.731906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:47.736780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:47.739828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:47.752367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:47.765345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:47.767228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:47.768844 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ea365a1a-3f1d-466a-9dbc-3ac5d1e8bfa1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.492923 Aug 27 02:37:47.785797 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1062/1954] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:47 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:47.785797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aa7375fd-d203-448a-a715-dfceae373475 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:47.785797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aa7375fd-d203-448a-a715-dfceae373475 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:47.792760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa7375fd-d203-448a-a715-dfceae373475 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:47.793629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa7375fd-d203-448a-a715-dfceae373475 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:47.795880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Getting quotas for project 880503f29a6140d689df06229a0c81d9. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:37:47.796708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa7375fd-d203-448a-a715-dfceae373475 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:47.797716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa7375fd-d203-448a-a715-dfceae373475 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:47.799620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa7375fd-d203-448a-a715-dfceae373475 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:47.800253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa7375fd-d203-448a-a715-dfceae373475 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:47.812076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Getting quotas for user 316c412ee28c4faba94ff0d8c2484bae and project 880503f29a6140d689df06229a0c81d9. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:37:47.846783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:37:47.850286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:37:47.933631 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f93c1348-ae4f-418a-8bd8-a8560a521b1e tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 18.737301 Aug 27 02:37:47.935838 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 893/1955] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:37:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 18744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:37:47.942005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-adb6c84a-d3b3-4f35-92c6-e75193fd4bd3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:47.943221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-adb6c84a-d3b3-4f35-92c6-e75193fd4bd3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:47.951864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb6c84a-d3b3-4f35-92c6-e75193fd4bd3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:47.953283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb6c84a-d3b3-4f35-92c6-e75193fd4bd3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:47.953983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb6c84a-d3b3-4f35-92c6-e75193fd4bd3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:47.955189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb6c84a-d3b3-4f35-92c6-e75193fd4bd3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:47.955951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb6c84a-d3b3-4f35-92c6-e75193fd4bd3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:47.956564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb6c84a-d3b3-4f35-92c6-e75193fd4bd3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:48.234741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa7375fd-d203-448a-a715-dfceae373475 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:48.250986 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aa7375fd-d203-448a-a715-dfceae373475 tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1683 microversion: 2.1 time: 0.478950 Aug 27 02:37:48.252220 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1063/1956] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:47 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1683 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:48.267357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a082b68-3f15-49d8-b751-9089bee7bc20 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:48.268363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a082b68-3f15-49d8-b751-9089bee7bc20 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:48.283879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a082b68-3f15-49d8-b751-9089bee7bc20 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:48.285317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a082b68-3f15-49d8-b751-9089bee7bc20 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:48.287596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a082b68-3f15-49d8-b751-9089bee7bc20 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:48.290828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a082b68-3f15-49d8-b751-9089bee7bc20 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:48.291784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a082b68-3f15-49d8-b751-9089bee7bc20 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:48.297602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a082b68-3f15-49d8-b751-9089bee7bc20 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:48.585885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-adb6c84a-d3b3-4f35-92c6-e75193fd4bd3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:48.601448 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-adb6c84a-d3b3-4f35-92c6-e75193fd4bd3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1517 microversion: 2.1 time: 0.659642 Aug 27 02:37:48.614686 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 894/1957] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:47 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1517 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:48.629789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d38695d8-db3f-4b3d-9051-9c6939a06cbd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:48.632080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d38695d8-db3f-4b3d-9051-9c6939a06cbd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:48.649867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d38695d8-db3f-4b3d-9051-9c6939a06cbd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:48.652086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d38695d8-db3f-4b3d-9051-9c6939a06cbd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:48.653779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d38695d8-db3f-4b3d-9051-9c6939a06cbd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:48.656610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d38695d8-db3f-4b3d-9051-9c6939a06cbd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:48.659884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d38695d8-db3f-4b3d-9051-9c6939a06cbd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:48.660745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d38695d8-db3f-4b3d-9051-9c6939a06cbd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:49.148181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d38695d8-db3f-4b3d-9051-9c6939a06cbd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:49.161583 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d38695d8-db3f-4b3d-9051-9c6939a06cbd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.545212 Aug 27 02:37:49.178500 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 895/1958] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:48 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:49.185136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:49.186174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:49.193657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:49.194612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:49.195400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:49.196432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:49.197646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:49.198392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:49.483262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7a082b68-3f15-49d8-b751-9089bee7bc20 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:49.502353 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a082b68-3f15-49d8-b751-9089bee7bc20 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1392 microversion: 2.1 time: 1.248496 Aug 27 02:37:49.509267 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1064/1959] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:48 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1392 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:49.530599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b9e6785d-f486-4146-ab90-e3ae47181e4d tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:49.538671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b9e6785d-f486-4146-ab90-e3ae47181e4d tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:49.555788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:49.569071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:49.572518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:49.573026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9e6785d-f486-4146-ab90-e3ae47181e4d tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:49.574115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9e6785d-f486-4146-ab90-e3ae47181e4d tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:49.577952 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5c534626-5e72-486a-9a5f-ba4628819d00 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1720 microversion: 2.20 time: 0.397725 Aug 27 02:37:49.580356 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 896/1960] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:49 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1720 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:49.596663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9e6785d-f486-4146-ab90-e3ae47181e4d tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:49.597389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:49.602746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9e6785d-f486-4146-ab90-e3ae47181e4d tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:49.603371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9e6785d-f486-4146-ab90-e3ae47181e4d tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:49.604121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:49.604400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9e6785d-f486-4146-ab90-e3ae47181e4d tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:49.624250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:49.627852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:49.634848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:49.636056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:49.637766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:49.638345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:49.901287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:49.913899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:49.919488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:49.926898 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-72b25e9c-1fec-43d5-8b61-a06bc164705c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.343289 Aug 27 02:37:49.929518 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 897/1961] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:49 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:49.965825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3e0ee441-33c7-46e3-9200-227dd76ff57e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:49.967660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3e0ee441-33c7-46e3-9200-227dd76ff57e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:49.986422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b9e6785d-f486-4146-ab90-e3ae47181e4d tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:49.995012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0ee441-33c7-46e3-9200-227dd76ff57e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:50.000501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0ee441-33c7-46e3-9200-227dd76ff57e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:50.003728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0ee441-33c7-46e3-9200-227dd76ff57e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:50.004869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0ee441-33c7-46e3-9200-227dd76ff57e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:50.013992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0ee441-33c7-46e3-9200-227dd76ff57e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:50.015633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0ee441-33c7-46e3-9200-227dd76ff57e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:50.024023 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b9e6785d-f486-4146-ab90-e3ae47181e4d tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1274 microversion: 2.1 time: 0.511186 Aug 27 02:37:50.029264 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1065/1962] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:49 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1274 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:50.048651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-706761a4-fea3-4352-9e68-1faff3ae7991 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:50.049810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-706761a4-fea3-4352-9e68-1faff3ae7991 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:50.057253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-706761a4-fea3-4352-9e68-1faff3ae7991 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:50.058113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-706761a4-fea3-4352-9e68-1faff3ae7991 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:50.058768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-706761a4-fea3-4352-9e68-1faff3ae7991 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:50.059773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-706761a4-fea3-4352-9e68-1faff3ae7991 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:50.060453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-706761a4-fea3-4352-9e68-1faff3ae7991 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:50.061263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-706761a4-fea3-4352-9e68-1faff3ae7991 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:50.391100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-706761a4-fea3-4352-9e68-1faff3ae7991 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:50.415873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3e0ee441-33c7-46e3-9200-227dd76ff57e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:50.424186 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-706761a4-fea3-4352-9e68-1faff3ae7991 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1475 microversion: 2.1 time: 0.388520 Aug 27 02:37:50.425036 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3e0ee441-33c7-46e3-9200-227dd76ff57e tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1683 microversion: 2.1 time: 0.486467 Aug 27 02:37:50.430619 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1066/1963] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:50 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1475 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:50.442075 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 898/1964] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:49 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1683 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:50.442868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-290fbcb5-4e2e-4ffe-aef1-f1b88e2e5a92 req-bdaf274a-0844-4049-9dc3-04f3ca6f724e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e32324-b1c4-40b3-85c0-51072ffde4e2", "name": "network-vif-deleted", "tag": "ca89f90a-990c-446c-ae33-f1581137b16d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:50.471208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-290fbcb5-4e2e-4ffe-aef1-f1b88e2e5a92 req-bdaf274a-0844-4049-9dc3-04f3ca6f724e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:50.471771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-290fbcb5-4e2e-4ffe-aef1-f1b88e2e5a92 req-bdaf274a-0844-4049-9dc3-04f3ca6f724e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:50.472945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7e6f9fac-0109-42bd-877a-0a97687678ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:50.473324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-290fbcb5-4e2e-4ffe-aef1-f1b88e2e5a92 req-bdaf274a-0844-4049-9dc3-04f3ca6f724e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:50.475170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7e6f9fac-0109-42bd-877a-0a97687678ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:50.487002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e6f9fac-0109-42bd-877a-0a97687678ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:50.487673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e6f9fac-0109-42bd-877a-0a97687678ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:50.487990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e6f9fac-0109-42bd-877a-0a97687678ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:50.495292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e6f9fac-0109-42bd-877a-0a97687678ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:50.496538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e6f9fac-0109-42bd-877a-0a97687678ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:50.499152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e6f9fac-0109-42bd-877a-0a97687678ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:50.501131 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-290fbcb5-4e2e-4ffe-aef1-f1b88e2e5a92 req-bdaf274a-0844-4049-9dc3-04f3ca6f724e service nova] Creating event network-vif-deleted:ca89f90a-990c-446c-ae33-f1581137b16d for instance 48e32324-b1c4-40b3-85c0-51072ffde4e2 on n-h2-852084-5 Aug 27 02:37:50.507582 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-290fbcb5-4e2e-4ffe-aef1-f1b88e2e5a92 req-bdaf274a-0844-4049-9dc3-04f3ca6f724e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073215 Aug 27 02:37:50.514729 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1067/1965] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:50.538261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e03079ad-ad0c-44f3-8084-4118933125f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:50.540117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e03079ad-ad0c-44f3-8084-4118933125f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:50.572157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e03079ad-ad0c-44f3-8084-4118933125f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:50.575991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e03079ad-ad0c-44f3-8084-4118933125f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:50.576467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e03079ad-ad0c-44f3-8084-4118933125f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:50.577237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e03079ad-ad0c-44f3-8084-4118933125f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:50.577739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e03079ad-ad0c-44f3-8084-4118933125f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:50.578180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e03079ad-ad0c-44f3-8084-4118933125f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:50.647940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:51.164981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7e6f9fac-0109-42bd-877a-0a97687678ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:51.204002 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7e6f9fac-0109-42bd-877a-0a97687678ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1681 microversion: 2.1 time: 0.737035 Aug 27 02:37:51.206335 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 899/1966] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:50 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1681 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:51.240075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:51.258526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:51.280727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:51.283074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:51.284176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:51.286246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:51.287466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:51.290525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:51.513130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e03079ad-ad0c-44f3-8084-4118933125f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:51.547368 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e03079ad-ad0c-44f3-8084-4118933125f6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1382 microversion: 2.1 time: 1.019528 Aug 27 02:37:51.569630 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1068/1967] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:50 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1382 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:37:51.599141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:51.607053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:51.621013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:51.621989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:51.623010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:51.624383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:51.625987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:51.627147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:51.909487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:51.973507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:51.990713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:51.998086 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-28e79735-abfe-45cd-bac1-cfcf2a334a4c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1720 microversion: 2.20 time: 0.783479 Aug 27 02:37:52.005708 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 900/1968] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:51 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1720 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:52.043838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-215055e7-0170-4ce9-9557-6faaade38cec tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:52.064082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-215055e7-0170-4ce9-9557-6faaade38cec tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:52.126238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-215055e7-0170-4ce9-9557-6faaade38cec tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:52.132147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-215055e7-0170-4ce9-9557-6faaade38cec tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:52.133207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-215055e7-0170-4ce9-9557-6faaade38cec tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:52.136554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-215055e7-0170-4ce9-9557-6faaade38cec tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:52.140261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-215055e7-0170-4ce9-9557-6faaade38cec tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:52.143105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-215055e7-0170-4ce9-9557-6faaade38cec tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:52.184454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:52.225853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:52.229236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:52.231550 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d863f636-1eaa-4317-89a5-95d5a169ea77 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.659729 Aug 27 02:37:52.232572 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1069/1969] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:51 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:52.256570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:52.261764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:52.290492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:52.291769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:52.292931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:52.294682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:52.295496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:52.301468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:52.481713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:52.486355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:52.487650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:52.489311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lazy-loading 'fault' on Instance uuid 48e32324-b1c4-40b3-85c0-51072ffde4e2 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:37:52.552354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-215055e7-0170-4ce9-9557-6faaade38cec tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:52.566008 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-215055e7-0170-4ce9-9557-6faaade38cec tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1280 microversion: 2.1 time: 0.557394 Aug 27 02:37:52.569457 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 901/1970] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:52 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1280 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:52.576633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:52.577602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:52.607710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:52.612748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:52.613547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:52.614588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:52.615277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:52.615884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:52.704556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:52.705093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:52.705534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:52.707723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lazy-loading 'fault' on Instance uuid bb357c66-d559-4bb9-a7f4-3ce3f6f09904 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:37:52.709697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '523a44993f39483698de40b10984c854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94125c73a7244d498e0665504bbfd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:52.745548 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f5268fbb-f3ca-4664-b61b-0d25842f08b3 tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 200 len: 1310 microversion: 2.1 time: 0.511162 Aug 27 02:37:52.764850 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1070/1971] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:52 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 1310 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:52.816756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be0773db-d248-4d4a-a6ec-37aae60520b6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '.version_select at 0x7f4d2a0fb940>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:52.830797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49945341feee4fd4b40ea30f385fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45b216feebc4d898843009e9eb608ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:52.840212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be0773db-d248-4d4a-a6ec-37aae60520b6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:52.843591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be0773db-d248-4d4a-a6ec-37aae60520b6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:52.845636 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-37610e11-b144-484d-9730-b3f3fecf54da tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 200 len: 1332 microversion: 2.1 time: 0.274697 Aug 27 02:37:52.846729 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 902/1972] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:52 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 1332 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:52.848005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be0773db-d248-4d4a-a6ec-37aae60520b6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:52.913868 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-be0773db-d248-4d4a-a6ec-37aae60520b6 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-migrations" status: 200 len: 2703 microversion: 2.1 time: 0.144529 Aug 27 02:37:52.931500 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1071/1973] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 02:37:52 2022] GET /compute/v2.1/os-migrations => generated 2703 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:52.953486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-668164d4-7691-41af-9900-6b721d18101e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:52.956027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-668164d4-7691-41af-9900-6b721d18101e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:52.971063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-668164d4-7691-41af-9900-6b721d18101e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:52.972493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-668164d4-7691-41af-9900-6b721d18101e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:52.975611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-668164d4-7691-41af-9900-6b721d18101e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:52.977996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-668164d4-7691-41af-9900-6b721d18101e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:52.979142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-668164d4-7691-41af-9900-6b721d18101e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:52.980366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-668164d4-7691-41af-9900-6b721d18101e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:53.080383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-4e438bbe-f29c-4c7f-9e97-09114e8688b9 req-23e4cc96-cdca-436a-87f3-9bcda859e8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb357c66-d559-4bb9-a7f4-3ce3f6f09904", "name": "network-vif-deleted", "tag": "b93676cc-2eb8-4e67-8a15-41712593277b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:53.116962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4e438bbe-f29c-4c7f-9e97-09114e8688b9 req-23e4cc96-cdca-436a-87f3-9bcda859e8dd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:53.126145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4e438bbe-f29c-4c7f-9e97-09114e8688b9 req-23e4cc96-cdca-436a-87f3-9bcda859e8dd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:53.128495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4e438bbe-f29c-4c7f-9e97-09114e8688b9 req-23e4cc96-cdca-436a-87f3-9bcda859e8dd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:53.169526 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-4e438bbe-f29c-4c7f-9e97-09114e8688b9 req-23e4cc96-cdca-436a-87f3-9bcda859e8dd service nova] Creating event network-vif-deleted:b93676cc-2eb8-4e67-8a15-41712593277b for instance bb357c66-d559-4bb9-a7f4-3ce3f6f09904 on n-h2-852084-5 Aug 27 02:37:53.180448 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-4e438bbe-f29c-4c7f-9e97-09114e8688b9 req-23e4cc96-cdca-436a-87f3-9bcda859e8dd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.332289 Aug 27 02:37:53.189222 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 903/1974] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:53.202134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd25bf65-4853-4879-ac62-1959c473b292 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:53.203564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd25bf65-4853-4879-ac62-1959c473b292 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:53.234933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd25bf65-4853-4879-ac62-1959c473b292 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:53.235960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd25bf65-4853-4879-ac62-1959c473b292 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:53.238014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd25bf65-4853-4879-ac62-1959c473b292 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:53.239308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd25bf65-4853-4879-ac62-1959c473b292 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:53.240150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd25bf65-4853-4879-ac62-1959c473b292 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:53.240927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd25bf65-4853-4879-ac62-1959c473b292 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:53.492167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-668164d4-7691-41af-9900-6b721d18101e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:53.504654 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-668164d4-7691-41af-9900-6b721d18101e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.570495 Aug 27 02:37:53.508677 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1072/1975] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:52 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:53.517874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:53.519124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:53.537766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:53.540290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:53.541215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:53.544830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:53.547007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:53.550510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.017064 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd25bf65-4853-4879-ac62-1959c473b292 tempest-LiveMigrationTest-298914258 tempest-LiveMigrationTest-298914258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1533 microversion: 2.1 time: 0.826352 Aug 27 02:37:54.017821 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 904/1976] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:53 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1533 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:54.031875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:54.032509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:54.077305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.077898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.078370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.079145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.079612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.080077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.288623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:54.335089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:54.340678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:54.343996 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-76d44018-a341-495f-9df6-e5382e3d5eec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1720 microversion: 2.20 time: 0.833664 Aug 27 02:37:54.346371 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1073/1977] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:53 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1720 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:54.380437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c966bf1-5141-4ea8-a736-d862ba9bc4c3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:54.383108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9c966bf1-5141-4ea8-a736-d862ba9bc4c3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:54.398159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c966bf1-5141-4ea8-a736-d862ba9bc4c3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.399602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c966bf1-5141-4ea8-a736-d862ba9bc4c3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.400946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c966bf1-5141-4ea8-a736-d862ba9bc4c3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.402935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c966bf1-5141-4ea8-a736-d862ba9bc4c3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.404826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c966bf1-5141-4ea8-a736-d862ba9bc4c3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.405779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c966bf1-5141-4ea8-a736-d862ba9bc4c3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.517753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:54.531681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:54.537367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:54.538953 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5906726e-5c4d-4a69-9ee9-40b58c9d8119 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.517171 Aug 27 02:37:54.554462 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 905/1978] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:54 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:54.562201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c13d783d-04ba-435a-91a0-fd074d45f1b1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:54.563161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c13d783d-04ba-435a-91a0-fd074d45f1b1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:54.571223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c13d783d-04ba-435a-91a0-fd074d45f1b1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.572007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c13d783d-04ba-435a-91a0-fd074d45f1b1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.572642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c13d783d-04ba-435a-91a0-fd074d45f1b1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.573614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c13d783d-04ba-435a-91a0-fd074d45f1b1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.574733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c13d783d-04ba-435a-91a0-fd074d45f1b1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.575387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c13d783d-04ba-435a-91a0-fd074d45f1b1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.807629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9c966bf1-5141-4ea8-a736-d862ba9bc4c3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:54.821611 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9c966bf1-5141-4ea8-a736-d862ba9bc4c3 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1322 microversion: 2.1 time: 0.464129 Aug 27 02:37:54.837738 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1074/1979] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:54 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:54.837738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:54.837738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] [instance: 48e32324-b1c4-40b3-85c0-51072ffde4e2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:54.852102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.852102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.852102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.852102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.852102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.852102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.870806 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] HTTP exception thrown: Instance 48e32324-b1c4-40b3-85c0-51072ffde4e2 could not be found. Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Request method failure captured: Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 HTTP/1.1 Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYL9Yay3HzZZm4mpmlcXZhl_9kgVKarmDBvi5XTtAnFMyf7mj4m_PhbrVACiW0DHnb6lGVCaqDIqb4fEd8CmAPLQZNnpgNFF59sNVbPowZyHQNqNbk9bY6aBp3TkTRzuFvT4ZPVeHvHUhK3VzfnZtE1TSmEfElycPgcjXJJ9NDHzKcA Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: b94125c73a7244d498e0665504bbfd27 Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ListServerFiltersTestJSON-151568494 Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b94125c73a7244d498e0665504bbfd27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b94125c73a7244d498e0665504bbfd27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b94125c73a7244d498e0665504bbfd27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b94125c73a7244d498e0665504bbfd27"}]}] Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ListServerFiltersTestJSON-151568494 Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: b94125c73a7244d498e0665504bbfd27 Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-151568494 Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ListServerFiltersTestJSON-151568494-project Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 523a44993f39483698de40b10984c854 Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ListServerFiltersTestJSON-151568494-project Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 48e32324-b1c4-40b3-85c0-51072ffde4e2 could not be found. Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '48e32324-b1c4-40b3-85c0-51072ffde4e2'} Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e32324-b1c4-40b3-85c0-51072ffde4e2 could not be found. Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e32324-b1c4-40b3-85c0-51072ffde4e2 could not be found. Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:54.873352 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:54.880713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:54.880713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:54.880713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:54.880713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:37:54.880713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:37:54.880713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e32324-b1c4-40b3-85c0-51072ffde4e2 could not be found. Aug 27 02:37:54.880713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:54.880713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] Returning 404 to user: Instance 48e32324-b1c4-40b3-85c0-51072ffde4e2 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:37:54.882800 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-742698bc-2e30-4696-90f3-15cc631222ae tempest-ListServerFiltersTestJSON-151568494 tempest-ListServerFiltersTestJSON-151568494-project] 10.222.0.99 "GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2" status: 404 len: 111 microversion: 2.1 time: 0.056618 Aug 27 02:37:54.886867 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1075/1980] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:54 2022] GET /compute/v2.1/servers/48e32324-b1c4-40b3-85c0-51072ffde4e2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:37:54.893154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:54.893997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] [instance: bb357c66-d559-4bb9-a7f4-3ce3f6f09904] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:54.907856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.913561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.914269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.915216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.918279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.918279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.945492 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] HTTP exception thrown: Instance bb357c66-d559-4bb9-a7f4-3ce3f6f09904 could not be found. Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Request method failure captured: Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 HTTP/1.1 Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYKnfVHfkHH9WuC2wx9m7EcxyvmB3Ol3cRAhVQ8u7hGncamdaO7AXvmgBjURrZ60xI0mTNtsp9pMUxr8udnQ1ech7DB3AXIkc2EnZfTcCSDKJd3zcZiBe-ZEZgRfs-aHu9V7dnPyZtu5tysjfmf3dME4SQEa6klgx0Mz1bF_SKg9fw4 Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c45b216feebc4d898843009e9eb608ca Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-VolumesAdminNegativeTest-1918275541 Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c45b216feebc4d898843009e9eb608ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c45b216feebc4d898843009e9eb608ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c45b216feebc4d898843009e9eb608ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c45b216feebc4d898843009e9eb608ca"}]}] Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-VolumesAdminNegativeTest-1918275541 Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c45b216feebc4d898843009e9eb608ca Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1918275541 Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-VolumesAdminNegativeTest-1918275541-project Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 49945341feee4fd4b40ea30f385fc9f0 Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-VolumesAdminNegativeTest-1918275541-project Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance bb357c66-d559-4bb9-a7f4-3ce3f6f09904 could not be found. Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'bb357c66-d559-4bb9-a7f4-3ce3f6f09904'} Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb357c66-d559-4bb9-a7f4-3ce3f6f09904 could not be found. Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb357c66-d559-4bb9-a7f4-3ce3f6f09904 could not be found. Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:37:54.948956 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:54.956265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:37:54.956265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:37:54.956265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:37:54.956265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:37:54.956265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:37:54.956265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb357c66-d559-4bb9-a7f4-3ce3f6f09904 could not be found. Aug 27 02:37:54.956265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:37:54.956265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Returning 404 to user: Instance bb357c66-d559-4bb9-a7f4-3ce3f6f09904 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:37:54.956265 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4b7bca5d-811d-43c2-bdc9-4498c460e53c tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904" status: 404 len: 111 microversion: 2.1 time: 0.062646 Aug 27 02:37:54.961305 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1076/1981] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:54 2022] GET /compute/v2.1/servers/bb357c66-d559-4bb9-a7f4-3ce3f6f09904 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:37:54.968727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d39fe884-f42c-4b2b-9312-5a434dab06d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:54.969370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d39fe884-f42c-4b2b-9312-5a434dab06d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:54.978832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39fe884-f42c-4b2b-9312-5a434dab06d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.979453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39fe884-f42c-4b2b-9312-5a434dab06d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.979985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39fe884-f42c-4b2b-9312-5a434dab06d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:54.980801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39fe884-f42c-4b2b-9312-5a434dab06d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:54.982057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39fe884-f42c-4b2b-9312-5a434dab06d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:54.983274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39fe884-f42c-4b2b-9312-5a434dab06d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:55.021384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d39fe884-f42c-4b2b-9312-5a434dab06d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:37:55.226425 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d39fe884-f42c-4b2b-9312-5a434dab06d8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 204 len: 0 microversion: 2.1 time: 0.263062 Aug 27 02:37:55.232330 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1077/1982] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:37:54 2022] DELETE /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:37:55.243941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ecc1f0f3-2642-4a25-bc52-5773e96d907f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] Calling method '.version_select at 0x7f4d2a72b1f0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:55.291959 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ecc1f0f3-2642-4a25-bc52-5773e96d907f tempest-VolumesAdminNegativeTest-1918275541 tempest-VolumesAdminNegativeTest-1918275541-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400954367" status: 202 len: 0 microversion: 2.1 time: 0.057313 Aug 27 02:37:55.292893 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1078/1983] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:37:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400954367 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:37:55.413430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-22d39e3e-2311-4528-984b-ec0676931080 req-8d84fc49-a01a-43e0-ad48-2e7a04acd3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59462ca6-1830-4fae-a141-ffade28879f6", "name": "network-vif-unplugged", "status": "completed", "tag": "b9a18ca7-1e41-4aa3-9c64-1d916f180dce"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:55.429505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-22d39e3e-2311-4528-984b-ec0676931080 req-8d84fc49-a01a-43e0-ad48-2e7a04acd3b3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:55.430954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-22d39e3e-2311-4528-984b-ec0676931080 req-8d84fc49-a01a-43e0-ad48-2e7a04acd3b3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:55.431893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-22d39e3e-2311-4528-984b-ec0676931080 req-8d84fc49-a01a-43e0-ad48-2e7a04acd3b3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:55.453167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-22d39e3e-2311-4528-984b-ec0676931080 req-8d84fc49-a01a-43e0-ad48-2e7a04acd3b3 service nova] Creating event network-vif-unplugged:b9a18ca7-1e41-4aa3-9c64-1d916f180dce for instance 59462ca6-1830-4fae-a141-ffade28879f6 on n-h1-852084-5 Aug 27 02:37:55.460837 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-22d39e3e-2311-4528-984b-ec0676931080 req-8d84fc49-a01a-43e0-ad48-2e7a04acd3b3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162139 Aug 27 02:37:55.462404 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1079/1984] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:55.470982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78b8bcbe-a129-4cfa-a1a1-a97dcdbb9ded tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:55.472926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-78b8bcbe-a129-4cfa-a1a1-a97dcdbb9ded tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:55.482303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b8bcbe-a129-4cfa-a1a1-a97dcdbb9ded tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:55.483143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b8bcbe-a129-4cfa-a1a1-a97dcdbb9ded tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:55.483802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b8bcbe-a129-4cfa-a1a1-a97dcdbb9ded tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:55.484793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b8bcbe-a129-4cfa-a1a1-a97dcdbb9ded tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:55.485492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b8bcbe-a129-4cfa-a1a1-a97dcdbb9ded tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:55.486181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b8bcbe-a129-4cfa-a1a1-a97dcdbb9ded tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:55.858574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c13d783d-04ba-435a-91a0-fd074d45f1b1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:55.928240 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c13d783d-04ba-435a-91a0-fd074d45f1b1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 1.365389 Aug 27 02:37:55.943293 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 906/1985] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:54 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:56.006660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:56.011747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:56.053873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:56.055955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:56.058249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:56.062245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:56.072591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:56.074648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:56.706662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-78b8bcbe-a129-4cfa-a1a1-a97dcdbb9ded tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:56.740591 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-78b8bcbe-a129-4cfa-a1a1-a97dcdbb9ded tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1388 microversion: 2.1 time: 1.275867 Aug 27 02:37:56.748911 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1080/1986] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:55 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1388 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:56.768598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:56.770886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:56.835858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:56.845542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:56.853723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:56.855553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:56.859115 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-97f7b06a-7729-4a3b-8b0a-e6d04cd6eaa4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1720 microversion: 2.20 time: 0.876093 Aug 27 02:37:56.861260 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 907/1987] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:55 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1720 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:56.865949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9c47c487-b748-48f1-8976-70290fa048e1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:56.866578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9c47c487-b748-48f1-8976-70290fa048e1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:56.876017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:56.881460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:56.895500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c47c487-b748-48f1-8976-70290fa048e1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:56.896005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c47c487-b748-48f1-8976-70290fa048e1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:56.896449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c47c487-b748-48f1-8976-70290fa048e1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:56.897191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c47c487-b748-48f1-8976-70290fa048e1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:56.897657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c47c487-b748-48f1-8976-70290fa048e1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:56.898117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c47c487-b748-48f1-8976-70290fa048e1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:56.902394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:56.914339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:56.915164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:57.757965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:57.834689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:58.089806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:58.137796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:58.165206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:58.172967 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-af6eb24c-7ee9-432e-b2e8-1d9e09d2e8ae tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 1.421704 Aug 27 02:37:58.174571 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1081/1988] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:56 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:58.217834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9b258b25-b6e6-47a4-8c24-6f2a0ff8322b req-539b323b-3afd-4bbd-b435-06876570e41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cd0655-58b7-4731-84ce-199edeea0cac", "name": "network-vif-deleted", "tag": "a95780ce-8687-4bd3-a6a0-0a05511992af"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:58.255431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b258b25-b6e6-47a4-8c24-6f2a0ff8322b req-539b323b-3afd-4bbd-b435-06876570e41e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:58.256130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b258b25-b6e6-47a4-8c24-6f2a0ff8322b req-539b323b-3afd-4bbd-b435-06876570e41e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:58.256788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b258b25-b6e6-47a4-8c24-6f2a0ff8322b req-539b323b-3afd-4bbd-b435-06876570e41e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:58.296086 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9b258b25-b6e6-47a4-8c24-6f2a0ff8322b req-539b323b-3afd-4bbd-b435-06876570e41e service nova] Creating event network-vif-deleted:a95780ce-8687-4bd3-a6a0-0a05511992af for instance b8cd0655-58b7-4731-84ce-199edeea0cac on n-h2-852084-5 Aug 27 02:37:58.310967 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9b258b25-b6e6-47a4-8c24-6f2a0ff8322b req-539b323b-3afd-4bbd-b435-06876570e41e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133784 Aug 27 02:37:58.322819 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1082/1989] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:58.328754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fccb4f0a-1177-48b2-bf5c-b20566216932 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:58.329870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fccb4f0a-1177-48b2-bf5c-b20566216932 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:58.342788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fccb4f0a-1177-48b2-bf5c-b20566216932 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:58.343501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fccb4f0a-1177-48b2-bf5c-b20566216932 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:58.344176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fccb4f0a-1177-48b2-bf5c-b20566216932 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:58.345089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fccb4f0a-1177-48b2-bf5c-b20566216932 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:58.345747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fccb4f0a-1177-48b2-bf5c-b20566216932 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:58.346367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fccb4f0a-1177-48b2-bf5c-b20566216932 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:58.583088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9c47c487-b748-48f1-8976-70290fa048e1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:58.610584 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9c47c487-b748-48f1-8976-70290fa048e1 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1322 microversion: 2.1 time: 1.747956 Aug 27 02:37:58.612497 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 908/1990] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:56 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1322 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:58.622276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:58.635241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:58.658466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:58.666357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:58.668772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:58.670902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:58.672051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:58.673172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:58.720912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fccb4f0a-1177-48b2-bf5c-b20566216932 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:58.763408 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fccb4f0a-1177-48b2-bf5c-b20566216932 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1183 microversion: 2.1 time: 0.438622 Aug 27 02:37:58.774029 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1083/1991] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:58 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:58.795423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7f24ac14-8f71-4ea6-84be-e6b8c8f403f0 req-c6370523-b526-433f-b602-083a6af11066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c", "tag": "696ce108-07e7-466e-b02e-474f3e054231"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:37:58.832709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f24ac14-8f71-4ea6-84be-e6b8c8f403f0 req-c6370523-b526-433f-b602-083a6af11066 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:58.835617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f24ac14-8f71-4ea6-84be-e6b8c8f403f0 req-c6370523-b526-433f-b602-083a6af11066 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:58.836895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f24ac14-8f71-4ea6-84be-e6b8c8f403f0 req-c6370523-b526-433f-b602-083a6af11066 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:58.862609 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7f24ac14-8f71-4ea6-84be-e6b8c8f403f0 req-c6370523-b526-433f-b602-083a6af11066 service nova] Creating event network-changed:696ce108-07e7-466e-b02e-474f3e054231 for instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c on n-h2-852084-5 Aug 27 02:37:58.876628 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7f24ac14-8f71-4ea6-84be-e6b8c8f403f0 req-c6370523-b526-433f-b602-083a6af11066 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097338 Aug 27 02:37:58.878886 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1084/1992] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:37:58.888931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-159af147-491b-47b8-85d5-8092307aaf93 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:58.890632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-159af147-491b-47b8-85d5-8092307aaf93 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:58.903753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-159af147-491b-47b8-85d5-8092307aaf93 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:58.904965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-159af147-491b-47b8-85d5-8092307aaf93 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:58.906085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-159af147-491b-47b8-85d5-8092307aaf93 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:58.907679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-159af147-491b-47b8-85d5-8092307aaf93 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:58.908951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-159af147-491b-47b8-85d5-8092307aaf93 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:58.909993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-159af147-491b-47b8-85d5-8092307aaf93 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:59.229635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-159af147-491b-47b8-85d5-8092307aaf93 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:59.251610 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-159af147-491b-47b8-85d5-8092307aaf93 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.370240 Aug 27 02:37:59.254193 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1085/1993] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:58 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:37:59.520112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:59.539868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:59.559639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:37:59.561807 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-07bece0d-a555-4a59-95f9-1bfa9610a130 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1720 microversion: 2.20 time: 0.946705 Aug 27 02:37:59.567343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:59.569037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:59.574190 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 909/1994] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:58 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1720 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:37:59.582953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b108b86-3cbc-4ab6-b4d0-3aca3d5a806d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:37:59.584065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b108b86-3cbc-4ab6-b4d0-3aca3d5a806d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:37:59.601452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:59.606464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b108b86-3cbc-4ab6-b4d0-3aca3d5a806d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:59.607284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b108b86-3cbc-4ab6-b4d0-3aca3d5a806d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:59.607894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:59.608062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b108b86-3cbc-4ab6-b4d0-3aca3d5a806d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:59.609215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:59.609394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b108b86-3cbc-4ab6-b4d0-3aca3d5a806d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:59.611061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:37:59.618704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:59.622261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b108b86-3cbc-4ab6-b4d0-3aca3d5a806d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:37:59.623030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:59.623202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b108b86-3cbc-4ab6-b4d0-3aca3d5a806d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:37:59.693537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:37:59.986926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:00.051075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:00.055071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:00.058703 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-331cf9dd-ae23-46e6-9d8e-ccaf371da8d4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.801334 Aug 27 02:38:00.061391 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1086/1995] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:37:59 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:00.083739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-55d373f7-3c77-4a00-8798-b82e285464cd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:00.089420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-55d373f7-3c77-4a00-8798-b82e285464cd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:00.120436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55d373f7-3c77-4a00-8798-b82e285464cd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:00.121488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55d373f7-3c77-4a00-8798-b82e285464cd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:00.127229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55d373f7-3c77-4a00-8798-b82e285464cd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:00.129741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55d373f7-3c77-4a00-8798-b82e285464cd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:00.130537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55d373f7-3c77-4a00-8798-b82e285464cd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:00.131329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55d373f7-3c77-4a00-8798-b82e285464cd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:00.474920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-55d373f7-3c77-4a00-8798-b82e285464cd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:00.491638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:00.511382 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-55d373f7-3c77-4a00-8798-b82e285464cd tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1322 microversion: 2.1 time: 0.446323 Aug 27 02:38:00.515166 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1087/1996] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:00 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:00.521190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-002c78cd-ef76-42ca-8bac-1e03ca077e5d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:00.522006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-002c78cd-ef76-42ca-8bac-1e03ca077e5d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:00.552030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b108b86-3cbc-4ab6-b4d0-3aca3d5a806d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:00.553013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c78cd-ef76-42ca-8bac-1e03ca077e5d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:00.553401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c78cd-ef76-42ca-8bac-1e03ca077e5d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:00.553895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c78cd-ef76-42ca-8bac-1e03ca077e5d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:00.554810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c78cd-ef76-42ca-8bac-1e03ca077e5d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:00.555058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c78cd-ef76-42ca-8bac-1e03ca077e5d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:00.555537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-002c78cd-ef76-42ca-8bac-1e03ca077e5d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:00.574362 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b108b86-3cbc-4ab6-b4d0-3aca3d5a806d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.998455 Aug 27 02:38:00.575653 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 910/1997] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:37:59 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:00.597958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:00.600447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:00.621697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:00.630752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:00.632428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:00.634202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:00.635957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:00.637277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:00.709269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-002c78cd-ef76-42ca-8bac-1e03ca077e5d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:00.719198 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-002c78cd-ef76-42ca-8bac-1e03ca077e5d tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1183 microversion: 2.1 time: 0.202488 Aug 27 02:38:00.720252 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1088/1998] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:00 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:00.725328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8077e97a-6aa8-420d-a7fb-70e1597a2290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:00.726347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8077e97a-6aa8-420d-a7fb-70e1597a2290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:00.744206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8077e97a-6aa8-420d-a7fb-70e1597a2290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:00.744850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8077e97a-6aa8-420d-a7fb-70e1597a2290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:00.745384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8077e97a-6aa8-420d-a7fb-70e1597a2290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:00.746265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8077e97a-6aa8-420d-a7fb-70e1597a2290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:00.746813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8077e97a-6aa8-420d-a7fb-70e1597a2290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:00.747344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8077e97a-6aa8-420d-a7fb-70e1597a2290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:01.083235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8077e97a-6aa8-420d-a7fb-70e1597a2290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:01.103316 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8077e97a-6aa8-420d-a7fb-70e1597a2290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.381464 Aug 27 02:38:01.105810 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1089/1999] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:00 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:01.126526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:01.128922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:01.147816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:01.148331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:01.148797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:01.149925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:01.150437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:01.150884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:01.253325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:01.285862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:01.293613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:01.295003 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-782fd3f9-7d82-4db0-9e1e-929c2c8d70f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1720 microversion: 2.20 time: 0.702875 Aug 27 02:38:01.327507 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 911/2000] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:00 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1720 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:38:01.337608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b811a71f-0501-4e57-a955-6e48a2c8924a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:01.344627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b811a71f-0501-4e57-a955-6e48a2c8924a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:01.372770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b811a71f-0501-4e57-a955-6e48a2c8924a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:01.373285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b811a71f-0501-4e57-a955-6e48a2c8924a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:01.373825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b811a71f-0501-4e57-a955-6e48a2c8924a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:01.374651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b811a71f-0501-4e57-a955-6e48a2c8924a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:01.375231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b811a71f-0501-4e57-a955-6e48a2c8924a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:01.375714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b811a71f-0501-4e57-a955-6e48a2c8924a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:01.488765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:01.510972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:01.514860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:01.519480 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0bcb0244-cfea-4fbf-903a-ae21476bc994 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.410222 Aug 27 02:38:01.521397 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1090/2001] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:01 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:01.542108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f4f0a99d-d8ae-4340-acc9-9ae979b7c728 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:01.549505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f4f0a99d-d8ae-4340-acc9-9ae979b7c728 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:01.586362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f0a99d-d8ae-4340-acc9-9ae979b7c728 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:01.592075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f0a99d-d8ae-4340-acc9-9ae979b7c728 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:01.594820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f0a99d-d8ae-4340-acc9-9ae979b7c728 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:01.597302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f0a99d-d8ae-4340-acc9-9ae979b7c728 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:01.598812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f0a99d-d8ae-4340-acc9-9ae979b7c728 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:01.600156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f0a99d-d8ae-4340-acc9-9ae979b7c728 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:01.631570 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b811a71f-0501-4e57-a955-6e48a2c8924a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.295060 Aug 27 02:38:01.634121 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 912/2002] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:38:01 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:38:01.665630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2eeaf169-a6f0-4838-81da-017f05a2f650 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:01.673123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2eeaf169-a6f0-4838-81da-017f05a2f650 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:01.730818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2eeaf169-a6f0-4838-81da-017f05a2f650 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:01.732115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2eeaf169-a6f0-4838-81da-017f05a2f650 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:01.733077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2eeaf169-a6f0-4838-81da-017f05a2f650 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:01.735178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2eeaf169-a6f0-4838-81da-017f05a2f650 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:01.736588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2eeaf169-a6f0-4838-81da-017f05a2f650 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:01.737653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2eeaf169-a6f0-4838-81da-017f05a2f650 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:02.122949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f4f0a99d-d8ae-4340-acc9-9ae979b7c728 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:02.145575 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f4f0a99d-d8ae-4340-acc9-9ae979b7c728 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1322 microversion: 2.1 time: 0.611406 Aug 27 02:38:02.146982 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1091/2003] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:01 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1322 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:02.158134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d5799161-0aa0-417c-b2e1-21ffc21f6e00 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:02.160479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d5799161-0aa0-417c-b2e1-21ffc21f6e00 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:02.180426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5799161-0aa0-417c-b2e1-21ffc21f6e00 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:02.181279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5799161-0aa0-417c-b2e1-21ffc21f6e00 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:02.182649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5799161-0aa0-417c-b2e1-21ffc21f6e00 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:02.184072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5799161-0aa0-417c-b2e1-21ffc21f6e00 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:02.184921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5799161-0aa0-417c-b2e1-21ffc21f6e00 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:02.185751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5799161-0aa0-417c-b2e1-21ffc21f6e00 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:02.365426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d5799161-0aa0-417c-b2e1-21ffc21f6e00 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:02.385691 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d5799161-0aa0-417c-b2e1-21ffc21f6e00 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1183 microversion: 2.1 time: 0.236342 Aug 27 02:38:02.401058 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1092/2004] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:02 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:02.577598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6fb2cede-eb1e-42a9-9a29-3444f24cee1e tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1593199658", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:02.585932 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-6fb2cede-eb1e-42a9-9a29-3444f24cee1e tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] HTTP exception thrown: min_count must be <= max_count Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6fb2cede-eb1e-42a9-9a29-3444f24cee1e tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Request method failure captured: Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 184 Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYOJD5_vylu_CDL8K1KQadDhec0I7xeq_oCB5IPoytmwL1qx-w7i5Ijkc48t3XpZq3be0kyd_tlXUYD3kOhu9tuqHt_AK4YxONvVxPaIg97ewRuvV8vD1bhT4Rzr77w58TqZNDvAJFRjy_xmP2sopu6_rrWseb6hU5tmOTzGte6KsIc Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 7eaa64f428b64df490714229aacd2331 Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7eaa64f428b64df490714229aacd2331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7eaa64f428b64df490714229aacd2331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7eaa64f428b64df490714229aacd2331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7eaa64f428b64df490714229aacd2331"}]}] Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 7eaa64f428b64df490714229aacd2331 Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-MultipleCreateNegativeTestJSON-582071418-project Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f44b0482acc94d32b722aa68044031c5 Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-582071418-project Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1593199658", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: exception: min_count must be <= max_count Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1593199658', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 27 02:38:02.589382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:02.592715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6fb2cede-eb1e-42a9-9a29-3444f24cee1e tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Returning 400 to user: min_count must be <= max_count {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:02.592715 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6fb2cede-eb1e-42a9-9a29-3444f24cee1e tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.202210 Aug 27 02:38:02.593521 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1093/2005] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:38:02 2022] POST /compute/v2.1/servers => generated 74 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:38:02.608967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:02.610394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:02.623896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:02.624797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:02.626054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:02.627674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:02.629081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:02.629961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:02.836486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:02.849500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:02.851578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:02.853263 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a5d8d56d-779a-4e48-b9d7-bb6571dcb741 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1720 microversion: 2.20 time: 0.258118 Aug 27 02:38:02.853989 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1094/2006] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:02 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1720 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:02.887642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:02.888751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:02.901728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:02.902709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:02.903646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:02.905016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:02.905913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:02.906654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:03.007315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2eeaf169-a6f0-4838-81da-017f05a2f650 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:03.040241 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2eeaf169-a6f0-4838-81da-017f05a2f650 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1670 microversion: 2.1 time: 1.396327 Aug 27 02:38:03.041374 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 913/2007] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:01 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1670 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:03.067763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-01c45b77-49a4-4177-944b-0516d95dc9bc tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1196005360", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "max_count": 0}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-01c45b77-49a4-4177-944b-0516d95dc9bc tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Request method failure captured: Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 168 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYOJD5_vylu_CDL8K1KQadDhec0I7xeq_oCB5IPoytmwL1qx-w7i5Ijkc48t3XpZq3be0kyd_tlXUYD3kOhu9tuqHt_AK4YxONvVxPaIg97ewRuvV8vD1bhT4Rzr77w58TqZNDvAJFRjy_xmP2sopu6_rrWseb6hU5tmOTzGte6KsIc Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 7eaa64f428b64df490714229aacd2331 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7eaa64f428b64df490714229aacd2331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7eaa64f428b64df490714229aacd2331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7eaa64f428b64df490714229aacd2331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7eaa64f428b64df490714229aacd2331"}]}] Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 7eaa64f428b64df490714229aacd2331 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-MultipleCreateNegativeTestJSON-582071418-project Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f44b0482acc94d32b722aa68044031c5 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-582071418-project Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1196005360", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "max_count": 0}} Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1196005360', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'max_count': 0}}} Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 0 Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:38:03.084670 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 27 02:38:03.087895 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.090872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-01c45b77-49a4-4177-944b-0516d95dc9bc tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:03.091971 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-01c45b77-49a4-4177-944b-0516d95dc9bc tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.049187 Aug 27 02:38:03.095302 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 914/2008] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:38:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:38:03.183298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8de1083-377e-4158-959b-d903564037de tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2093732130", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "max_count": 2.5}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8de1083-377e-4158-959b-d903564037de tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Request method failure captured: Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 170 Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYOJD5_vylu_CDL8K1KQadDhec0I7xeq_oCB5IPoytmwL1qx-w7i5Ijkc48t3XpZq3be0kyd_tlXUYD3kOhu9tuqHt_AK4YxONvVxPaIg97ewRuvV8vD1bhT4Rzr77w58TqZNDvAJFRjy_xmP2sopu6_rrWseb6hU5tmOTzGte6KsIc Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 7eaa64f428b64df490714229aacd2331 Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7eaa64f428b64df490714229aacd2331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7eaa64f428b64df490714229aacd2331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7eaa64f428b64df490714229aacd2331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7eaa64f428b64df490714229aacd2331"}]}] Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 7eaa64f428b64df490714229aacd2331 Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-MultipleCreateNegativeTestJSON-582071418-project Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f44b0482acc94d32b722aa68044031c5 Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-582071418-project Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2093732130", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "max_count": 2.5}} Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2093732130', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'max_count': 2.5}}} Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:38:03.192651 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.200052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8de1083-377e-4158-959b-d903564037de tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:03.203598 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e8de1083-377e-4158-959b-d903564037de tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022642 Aug 27 02:38:03.217717 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 915/2009] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:38:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:38:03.217717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-964b74db-8e65-44c1-a74a-9bec45a38f4f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:03.224905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-964b74db-8e65-44c1-a74a-9bec45a38f4f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:03.226901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:03.238996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-964b74db-8e65-44c1-a74a-9bec45a38f4f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:03.239606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-964b74db-8e65-44c1-a74a-9bec45a38f4f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:03.240888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-964b74db-8e65-44c1-a74a-9bec45a38f4f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:03.241922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-964b74db-8e65-44c1-a74a-9bec45a38f4f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:03.243063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-964b74db-8e65-44c1-a74a-9bec45a38f4f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:03.243973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-964b74db-8e65-44c1-a74a-9bec45a38f4f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:03.269096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:03.281128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:03.285965 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d0d4cbd3-4a6a-4258-b62a-7dcb372bdb25 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.412350 Aug 27 02:38:03.287086 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1095/2010] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:02 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:03.337346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-618373be-8adf-435b-ac36-af6bf76c8c66 tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2041975479", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "min_count": 0}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-618373be-8adf-435b-ac36-af6bf76c8c66 tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Request method failure captured: Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 168 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYOJD5_vylu_CDL8K1KQadDhec0I7xeq_oCB5IPoytmwL1qx-w7i5Ijkc48t3XpZq3be0kyd_tlXUYD3kOhu9tuqHt_AK4YxONvVxPaIg97ewRuvV8vD1bhT4Rzr77w58TqZNDvAJFRjy_xmP2sopu6_rrWseb6hU5tmOTzGte6KsIc Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 7eaa64f428b64df490714229aacd2331 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7eaa64f428b64df490714229aacd2331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7eaa64f428b64df490714229aacd2331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7eaa64f428b64df490714229aacd2331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7eaa64f428b64df490714229aacd2331"}]}] Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 7eaa64f428b64df490714229aacd2331 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-MultipleCreateNegativeTestJSON-582071418-project Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f44b0482acc94d32b722aa68044031c5 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-582071418-project Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2041975479", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "min_count": 0}} Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2041975479', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'min_count': 0}}} Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 0 Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:38:03.346395 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-618373be-8adf-435b-ac36-af6bf76c8c66 tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:03.356361 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-618373be-8adf-435b-ac36-af6bf76c8c66 tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021037 Aug 27 02:38:03.364536 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1096/2011] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:38:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:38:03.428381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7df63f60-40e1-4cbf-80ec-9166b2ef4587 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:03.429822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7df63f60-40e1-4cbf-80ec-9166b2ef4587 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:03.447724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7df63f60-40e1-4cbf-80ec-9166b2ef4587 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:03.449007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7df63f60-40e1-4cbf-80ec-9166b2ef4587 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:03.450084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7df63f60-40e1-4cbf-80ec-9166b2ef4587 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:03.451716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7df63f60-40e1-4cbf-80ec-9166b2ef4587 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:03.452864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7df63f60-40e1-4cbf-80ec-9166b2ef4587 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:03.453933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7df63f60-40e1-4cbf-80ec-9166b2ef4587 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:03.580790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7df63f60-40e1-4cbf-80ec-9166b2ef4587 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:03.604194 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7df63f60-40e1-4cbf-80ec-9166b2ef4587 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1183 microversion: 2.1 time: 0.186012 Aug 27 02:38:03.613959 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1097/2012] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:03 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:03.627917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b38e2775-126b-4eda-9dbf-7a1a597e3a35 tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-989264804", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "min_count": 2.5}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b38e2775-126b-4eda-9dbf-7a1a597e3a35 tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Request method failure captured: Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 169 Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYOJD5_vylu_CDL8K1KQadDhec0I7xeq_oCB5IPoytmwL1qx-w7i5Ijkc48t3XpZq3be0kyd_tlXUYD3kOhu9tuqHt_AK4YxONvVxPaIg97ewRuvV8vD1bhT4Rzr77w58TqZNDvAJFRjy_xmP2sopu6_rrWseb6hU5tmOTzGte6KsIc Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 7eaa64f428b64df490714229aacd2331 Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7eaa64f428b64df490714229aacd2331"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7eaa64f428b64df490714229aacd2331"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7eaa64f428b64df490714229aacd2331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7eaa64f428b64df490714229aacd2331"}]}] Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 7eaa64f428b64df490714229aacd2331 Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-582071418 Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-MultipleCreateNegativeTestJSON-582071418-project Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f44b0482acc94d32b722aa68044031c5 Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-582071418-project Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-989264804", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "min_count": 2.5}} Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-989264804', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'min_count': 2.5}}} Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 2.5 Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:38:03.637800 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b38e2775-126b-4eda-9dbf-7a1a597e3a35 tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:03.645506 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b38e2775-126b-4eda-9dbf-7a1a597e3a35 tempest-MultipleCreateNegativeTestJSON-582071418 tempest-MultipleCreateNegativeTestJSON-582071418-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.027367 Aug 27 02:38:03.649053 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1098/2013] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:38:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:38:03.841689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-964b74db-8e65-44c1-a74a-9bec45a38f4f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:03.852757 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-964b74db-8e65-44c1-a74a-9bec45a38f4f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1322 microversion: 2.1 time: 0.647263 Aug 27 02:38:03.853946 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 916/2014] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:03 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1322 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:03.881195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:03.881854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:03.888571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:03.890135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:03.890642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:03.891138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:03.891871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:03.892299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:03.892733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:04.077388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d293d50c-f9e0-45b3-a568-f928b029a91c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:04.078909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d293d50c-f9e0-45b3-a568-f928b029a91c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:04.090524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d293d50c-f9e0-45b3-a568-f928b029a91c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:04.094330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d293d50c-f9e0-45b3-a568-f928b029a91c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:04.096790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d293d50c-f9e0-45b3-a568-f928b029a91c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:04.107411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d293d50c-f9e0-45b3-a568-f928b029a91c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:04.109018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d293d50c-f9e0-45b3-a568-f928b029a91c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:04.109521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d293d50c-f9e0-45b3-a568-f928b029a91c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:04.157377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:04.185961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:04.189887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:04.193243 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8ad352a4-667a-44ed-8699-0e512abece30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1741 microversion: 2.20 time: 0.317662 Aug 27 02:38:04.195404 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1099/2015] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:03 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1741 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:04.331444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:04.337077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:04.354521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:04.357014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:04.358638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:04.361115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:04.362326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:04.363896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:04.936378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:04.950116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:04.952204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:04.953990 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-be88d2c4-de49-430a-95f3-3df3147ce058 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.645213 Aug 27 02:38:04.969418 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1100/2016] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:04 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:04.972415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ef66338c-49da-4540-a066-7781df36ed27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:04.973062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ef66338c-49da-4540-a066-7781df36ed27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:04.988628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef66338c-49da-4540-a066-7781df36ed27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:04.988975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef66338c-49da-4540-a066-7781df36ed27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:04.989483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef66338c-49da-4540-a066-7781df36ed27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:04.990366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef66338c-49da-4540-a066-7781df36ed27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:04.991098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef66338c-49da-4540-a066-7781df36ed27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:04.991307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef66338c-49da-4540-a066-7781df36ed27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:05.025646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d293d50c-f9e0-45b3-a568-f928b029a91c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:05.068487 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d293d50c-f9e0-45b3-a568-f928b029a91c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1675 microversion: 2.1 time: 0.993276 Aug 27 02:38:05.070551 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 917/2017] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:04 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1675 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:38:05.103978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-15330014-2b76-40de-bb0f-4220753ef13b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:05.108295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-15330014-2b76-40de-bb0f-4220753ef13b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:05.142439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15330014-2b76-40de-bb0f-4220753ef13b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:05.143697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15330014-2b76-40de-bb0f-4220753ef13b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:05.145275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15330014-2b76-40de-bb0f-4220753ef13b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:05.146998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15330014-2b76-40de-bb0f-4220753ef13b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:05.148080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15330014-2b76-40de-bb0f-4220753ef13b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:05.148978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15330014-2b76-40de-bb0f-4220753ef13b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:05.205360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef66338c-49da-4540-a066-7781df36ed27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:05.228666 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ef66338c-49da-4540-a066-7781df36ed27 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1183 microversion: 2.1 time: 0.265641 Aug 27 02:38:05.245923 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1101/2018] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:04 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:05.268346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:05.270433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:05.285226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:05.286726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:05.288052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:05.290166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:05.292164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:05.293143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:05.621031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-15330014-2b76-40de-bb0f-4220753ef13b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:05.650309 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-15330014-2b76-40de-bb0f-4220753ef13b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1322 microversion: 2.1 time: 0.574983 Aug 27 02:38:05.650917 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 918/2019] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:05 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:05.845261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:05.881240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:05.888219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:05.890659 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f862992b-77f3-47d4-a720-5b216a2d4e33 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1741 microversion: 2.20 time: 0.642668 Aug 27 02:38:05.895728 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1102/2020] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:05 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1741 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:05.994640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:05.995935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:06.008384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.008889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.009425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:06.010069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.010524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.010951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:06.099500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c9e8c12-b660-4b94-901f-0b24a46ed046 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:06.102973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5c9e8c12-b660-4b94-901f-0b24a46ed046 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:06.131023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c9e8c12-b660-4b94-901f-0b24a46ed046 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.132647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c9e8c12-b660-4b94-901f-0b24a46ed046 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.140147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c9e8c12-b660-4b94-901f-0b24a46ed046 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:06.143959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c9e8c12-b660-4b94-901f-0b24a46ed046 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.144843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c9e8c12-b660-4b94-901f-0b24a46ed046 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.145840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c9e8c12-b660-4b94-901f-0b24a46ed046 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:06.540907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5c9e8c12-b660-4b94-901f-0b24a46ed046 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:06.552769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:06.567007 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5c9e8c12-b660-4b94-901f-0b24a46ed046 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.469197 Aug 27 02:38:06.577719 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1103/2021] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:06 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:38:06.595328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-14abfdbd-8482-4ef3-aee0-e449741cb172 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:06.598099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-14abfdbd-8482-4ef3-aee0-e449741cb172 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:06.615726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:06.620460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:06.623479 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-331961ad-5c5c-401c-b24f-32ed1c8ba57c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.635754 Aug 27 02:38:06.625211 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 919/2022] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:05 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:06.640502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0d681650-90d9-4004-a4ec-a2688e95c02a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:06.641804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14abfdbd-8482-4ef3-aee0-e449741cb172 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.642228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14abfdbd-8482-4ef3-aee0-e449741cb172 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.642678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14abfdbd-8482-4ef3-aee0-e449741cb172 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:06.643454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14abfdbd-8482-4ef3-aee0-e449741cb172 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.644436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14abfdbd-8482-4ef3-aee0-e449741cb172 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.644868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14abfdbd-8482-4ef3-aee0-e449741cb172 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:06.649731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0d681650-90d9-4004-a4ec-a2688e95c02a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:06.673392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d681650-90d9-4004-a4ec-a2688e95c02a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.685485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d681650-90d9-4004-a4ec-a2688e95c02a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.689476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d681650-90d9-4004-a4ec-a2688e95c02a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:06.694680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d681650-90d9-4004-a4ec-a2688e95c02a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.697080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d681650-90d9-4004-a4ec-a2688e95c02a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.698563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d681650-90d9-4004-a4ec-a2688e95c02a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:06.804202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-14abfdbd-8482-4ef3-aee0-e449741cb172 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:06.813242 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-14abfdbd-8482-4ef3-aee0-e449741cb172 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1183 microversion: 2.1 time: 0.244038 Aug 27 02:38:06.832315 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1104/2023] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:06 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:06.838350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4863792-8368-42fb-bad3-fb621ba6e741 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:06.838984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4863792-8368-42fb-bad3-fb621ba6e741 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:06.846058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4863792-8368-42fb-bad3-fb621ba6e741 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.846778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4863792-8368-42fb-bad3-fb621ba6e741 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.847514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4863792-8368-42fb-bad3-fb621ba6e741 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:06.848455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4863792-8368-42fb-bad3-fb621ba6e741 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.849106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4863792-8368-42fb-bad3-fb621ba6e741 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.849545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4863792-8368-42fb-bad3-fb621ba6e741 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:06.865403 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0d681650-90d9-4004-a4ec-a2688e95c02a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 200 len: 322 microversion: 2.1 time: 0.237574 Aug 27 02:38:06.869290 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 920/2024] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:38:06 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:06.893844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-311534da-2a27-4c8c-bbb7-fecd8ddd8a8a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:06.899802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-311534da-2a27-4c8c-bbb7-fecd8ddd8a8a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:06.936528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-311534da-2a27-4c8c-bbb7-fecd8ddd8a8a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.941402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-311534da-2a27-4c8c-bbb7-fecd8ddd8a8a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.942534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-311534da-2a27-4c8c-bbb7-fecd8ddd8a8a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:06.946419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-311534da-2a27-4c8c-bbb7-fecd8ddd8a8a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:06.948559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-311534da-2a27-4c8c-bbb7-fecd8ddd8a8a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:06.952391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-311534da-2a27-4c8c-bbb7-fecd8ddd8a8a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:07.368536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4863792-8368-42fb-bad3-fb621ba6e741 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:07.415233 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4863792-8368-42fb-bad3-fb621ba6e741 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1322 microversion: 2.1 time: 0.577060 Aug 27 02:38:07.429496 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1105/2025] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:06 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1322 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:07.436592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:07.437652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:07.466927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:07.471590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:07.472756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:07.476162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:07.479207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:07.481534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:07.618497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-311534da-2a27-4c8c-bbb7-fecd8ddd8a8a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:07.633550 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-311534da-2a27-4c8c-bbb7-fecd8ddd8a8a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.757768 Aug 27 02:38:07.646249 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 921/2026] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:06 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:07.686805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:07.688085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:07.735025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:07.736102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:07.736922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:07.738526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:07.741025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:07.742647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:08.106239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:08.150772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:08.168560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:08.176526 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-77e3ef96-d78f-4030-a74b-5d7a9ca1e623 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 0.749085 Aug 27 02:38:08.179517 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1106/2027] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:07 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:08.208995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5059e25-ca62-4301-98fc-f7fb8e6cea99 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:08.212318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c5059e25-ca62-4301-98fc-f7fb8e6cea99 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:08.246651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5059e25-ca62-4301-98fc-f7fb8e6cea99 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:08.247630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5059e25-ca62-4301-98fc-f7fb8e6cea99 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:08.248423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5059e25-ca62-4301-98fc-f7fb8e6cea99 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:08.249813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5059e25-ca62-4301-98fc-f7fb8e6cea99 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:08.250677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5059e25-ca62-4301-98fc-f7fb8e6cea99 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:08.251600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5059e25-ca62-4301-98fc-f7fb8e6cea99 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:08.377417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:08.599124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:08.615262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:08.621292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:08.626206 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6d5e7078-2714-49c2-98cd-ae22238fd5f6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.967067 Aug 27 02:38:08.647185 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 922/2028] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:07 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:08.655274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8829bc7d-3383-4f1c-8b8d-bdee3be5688e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:08.660179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8829bc7d-3383-4f1c-8b8d-bdee3be5688e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:08.679132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8829bc7d-3383-4f1c-8b8d-bdee3be5688e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:08.682353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8829bc7d-3383-4f1c-8b8d-bdee3be5688e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:08.684699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8829bc7d-3383-4f1c-8b8d-bdee3be5688e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:08.691226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8829bc7d-3383-4f1c-8b8d-bdee3be5688e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:08.692240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8829bc7d-3383-4f1c-8b8d-bdee3be5688e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:08.693170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8829bc7d-3383-4f1c-8b8d-bdee3be5688e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:09.005014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8829bc7d-3383-4f1c-8b8d-bdee3be5688e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:09.050634 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8829bc7d-3383-4f1c-8b8d-bdee3be5688e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1183 microversion: 2.1 time: 0.401340 Aug 27 02:38:09.051888 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 923/2029] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:08 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:09.061905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-261fea4b-4dfb-4a9b-b3de-58d099bef7c2 req-6851ef64-1dfb-4db4-924d-cbf2014253a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c", "name": "network-vif-plugged", "status": "completed", "tag": "696ce108-07e7-466e-b02e-474f3e054231"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:09.091531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-261fea4b-4dfb-4a9b-b3de-58d099bef7c2 req-6851ef64-1dfb-4db4-924d-cbf2014253a8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:09.094556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-261fea4b-4dfb-4a9b-b3de-58d099bef7c2 req-6851ef64-1dfb-4db4-924d-cbf2014253a8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:09.097451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-261fea4b-4dfb-4a9b-b3de-58d099bef7c2 req-6851ef64-1dfb-4db4-924d-cbf2014253a8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:09.172522 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-261fea4b-4dfb-4a9b-b3de-58d099bef7c2 req-6851ef64-1dfb-4db4-924d-cbf2014253a8 service nova] Creating event network-vif-plugged:696ce108-07e7-466e-b02e-474f3e054231 for instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c on n-h2-852084-5 Aug 27 02:38:09.195539 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-261fea4b-4dfb-4a9b-b3de-58d099bef7c2 req-6851ef64-1dfb-4db4-924d-cbf2014253a8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141619 Aug 27 02:38:09.201824 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 924/2030] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:09.230524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-420e3ad1-ea3e-440e-a42a-3f08877e0999 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:09.235076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-420e3ad1-ea3e-440e-a42a-3f08877e0999 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:09.241413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:09.273407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-420e3ad1-ea3e-440e-a42a-3f08877e0999 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:09.274165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-420e3ad1-ea3e-440e-a42a-3f08877e0999 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:09.274631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-420e3ad1-ea3e-440e-a42a-3f08877e0999 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:09.275413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-420e3ad1-ea3e-440e-a42a-3f08877e0999 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:09.275884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-420e3ad1-ea3e-440e-a42a-3f08877e0999 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:09.276318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-420e3ad1-ea3e-440e-a42a-3f08877e0999 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:09.283143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c5059e25-ca62-4301-98fc-f7fb8e6cea99 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:09.304189 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c5059e25-ca62-4301-98fc-f7fb8e6cea99 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 1.120163 Aug 27 02:38:09.306107 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1107/2031] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:08 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:09.338242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:09.342278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:09.362076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:09.364231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:09.365252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:09.366872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:09.368136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:09.369504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:09.923502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:09.962188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:09.986700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:09.993518 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7fb87b34-bf23-44a9-95de-42fb4d117542 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 0.685530 Aug 27 02:38:09.997172 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1108/2032] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:09 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:10.021462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61528e55-aac1-46cb-b39c-a54f2cda0689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:10.022296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-61528e55-aac1-46cb-b39c-a54f2cda0689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:10.032218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61528e55-aac1-46cb-b39c-a54f2cda0689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:10.032906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61528e55-aac1-46cb-b39c-a54f2cda0689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:10.033468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61528e55-aac1-46cb-b39c-a54f2cda0689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:10.034527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61528e55-aac1-46cb-b39c-a54f2cda0689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:10.036462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61528e55-aac1-46cb-b39c-a54f2cda0689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:10.036462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61528e55-aac1-46cb-b39c-a54f2cda0689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:10.085772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-420e3ad1-ea3e-440e-a42a-3f08877e0999 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:10.116037 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-420e3ad1-ea3e-440e-a42a-3f08877e0999 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1322 microversion: 2.1 time: 0.910057 Aug 27 02:38:10.124227 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 925/2033] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:09 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1322 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:10.148431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:10.148966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:10.168603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:10.169139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:10.169738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:10.170504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:10.170974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:10.171419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:10.462940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-61528e55-aac1-46cb-b39c-a54f2cda0689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:10.493318 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61528e55-aac1-46cb-b39c-a54f2cda0689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.476640 Aug 27 02:38:10.509716 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1109/2034] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:09 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:10.509716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b3f9486d-8220-480f-817d-54252dc2f0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:10.509716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b3f9486d-8220-480f-817d-54252dc2f0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:10.519057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3f9486d-8220-480f-817d-54252dc2f0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:10.522063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3f9486d-8220-480f-817d-54252dc2f0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:10.522581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3f9486d-8220-480f-817d-54252dc2f0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:10.523360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3f9486d-8220-480f-817d-54252dc2f0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:10.523947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3f9486d-8220-480f-817d-54252dc2f0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:10.524654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3f9486d-8220-480f-817d-54252dc2f0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:10.682247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b3f9486d-8220-480f-817d-54252dc2f0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:10.699025 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b3f9486d-8220-480f-817d-54252dc2f0cf tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1183 microversion: 2.1 time: 0.199185 Aug 27 02:38:10.700354 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1110/2035] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:10 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:10.709589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1a7944d0-3576-4e8a-b3d7-dd89b27e1429 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:10.714479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1a7944d0-3576-4e8a-b3d7-dd89b27e1429 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:10.731086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a7944d0-3576-4e8a-b3d7-dd89b27e1429 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:10.731815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a7944d0-3576-4e8a-b3d7-dd89b27e1429 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:10.734513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a7944d0-3576-4e8a-b3d7-dd89b27e1429 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:10.735648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a7944d0-3576-4e8a-b3d7-dd89b27e1429 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:10.737244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a7944d0-3576-4e8a-b3d7-dd89b27e1429 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:10.737962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a7944d0-3576-4e8a-b3d7-dd89b27e1429 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:10.919217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:10.932037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:10.938909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:10.943259 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a22de7d3-d70e-4ae7-a377-4ecd3a0083ba tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.817784 Aug 27 02:38:10.944794 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 926/2036] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:10 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:11.021136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:11.022939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:11.034964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:11.036087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:11.036687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:11.037605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:11.038311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:11.038877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:11.128714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1a7944d0-3576-4e8a-b3d7-dd89b27e1429 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:11.152337 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1a7944d0-3576-4e8a-b3d7-dd89b27e1429 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.450176 Aug 27 02:38:11.154358 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1111/2037] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:10 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:11.164230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-77f4ff8a-4982-4a0a-833f-ae55ac0ac3fb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:11.165983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-77f4ff8a-4982-4a0a-833f-ae55ac0ac3fb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:11.189446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77f4ff8a-4982-4a0a-833f-ae55ac0ac3fb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:11.191260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77f4ff8a-4982-4a0a-833f-ae55ac0ac3fb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:11.192576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77f4ff8a-4982-4a0a-833f-ae55ac0ac3fb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:11.194682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77f4ff8a-4982-4a0a-833f-ae55ac0ac3fb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:11.195978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77f4ff8a-4982-4a0a-833f-ae55ac0ac3fb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:11.196909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77f4ff8a-4982-4a0a-833f-ae55ac0ac3fb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:11.637716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-77f4ff8a-4982-4a0a-833f-ae55ac0ac3fb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:11.654160 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-77f4ff8a-4982-4a0a-833f-ae55ac0ac3fb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1322 microversion: 2.1 time: 0.497779 Aug 27 02:38:11.664425 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1112/2038] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:11 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:11.665722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f4da2705-367c-4505-a7da-eb3ca1e6d049 req-17f34f93-69cf-46fb-8a8c-0ed0a3d81685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893e335c-913a-479a-9ee8-f61fc9a3b36f", "name": "network-vif-plugged", "status": "completed", "tag": "e392649a-1f13-4247-832b-e0b1080e8799"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:11.681849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f4da2705-367c-4505-a7da-eb3ca1e6d049 req-17f34f93-69cf-46fb-8a8c-0ed0a3d81685 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:11.682320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f4da2705-367c-4505-a7da-eb3ca1e6d049 req-17f34f93-69cf-46fb-8a8c-0ed0a3d81685 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:11.682830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f4da2705-367c-4505-a7da-eb3ca1e6d049 req-17f34f93-69cf-46fb-8a8c-0ed0a3d81685 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:11.712887 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f4da2705-367c-4505-a7da-eb3ca1e6d049 req-17f34f93-69cf-46fb-8a8c-0ed0a3d81685 service nova] Creating event network-vif-plugged:e392649a-1f13-4247-832b-e0b1080e8799 for instance 893e335c-913a-479a-9ee8-f61fc9a3b36f on n-h2-852084-5 Aug 27 02:38:11.721041 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f4da2705-367c-4505-a7da-eb3ca1e6d049 req-17f34f93-69cf-46fb-8a8c-0ed0a3d81685 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064633 Aug 27 02:38:11.727990 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1113/2039] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:11.750631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1912293586", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a5df9b9c-03e6-4d14-a511-7974335d0f10"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:11.794914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:11.843261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:11.874485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:11.901013 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-58975b3f-a9ac-48e6-af81-fd1b78efabe4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 0.882882 Aug 27 02:38:11.903408 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 927/2040] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:11 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:38:11.908380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-75390fe4-32fc-4b95-b720-8e4365854f11 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:11.909007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-75390fe4-32fc-4b95-b720-8e4365854f11 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:11.939772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] validate_networks() for [('a5df9b9c-03e6-4d14-a511-7974335d0f10', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:38:11.940006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75390fe4-32fc-4b95-b720-8e4365854f11 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:11.940973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75390fe4-32fc-4b95-b720-8e4365854f11 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:11.941469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75390fe4-32fc-4b95-b720-8e4365854f11 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:11.948241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75390fe4-32fc-4b95-b720-8e4365854f11 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:11.948748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75390fe4-32fc-4b95-b720-8e4365854f11 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:11.949207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75390fe4-32fc-4b95-b720-8e4365854f11 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:12.093024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-75390fe4-32fc-4b95-b720-8e4365854f11 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:12.104332 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-75390fe4-32fc-4b95-b720-8e4365854f11 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 200 len: 1183 microversion: 2.1 time: 0.199732 Aug 27 02:38:12.105137 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 928/2041] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:11 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 1183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:12.131893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:12.132536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:12.167864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:12.172542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:12.173068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:12.173883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:12.174368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:12.175063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:12.192023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:13.021073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:13.062622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:13.066083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:13.076570 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7b7e1e13-48c8-4679-b652-d08468ec0ef9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.968552 Aug 27 02:38:13.107402 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 929/2042] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:12 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:13.138028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5cf353ab-9180-4d23-b255-e006eadd6856 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:13.142470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5cf353ab-9180-4d23-b255-e006eadd6856 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:13.171888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cf353ab-9180-4d23-b255-e006eadd6856 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:13.173024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cf353ab-9180-4d23-b255-e006eadd6856 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:13.174021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cf353ab-9180-4d23-b255-e006eadd6856 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:13.176114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cf353ab-9180-4d23-b255-e006eadd6856 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:13.183400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cf353ab-9180-4d23-b255-e006eadd6856 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:13.184543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cf353ab-9180-4d23-b255-e006eadd6856 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:13.839311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5cf353ab-9180-4d23-b255-e006eadd6856 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:13.877260 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5cf353ab-9180-4d23-b255-e006eadd6856 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1472 microversion: 2.1 time: 0.748692 Aug 27 02:38:13.880380 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 930/2043] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:13 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1472 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:13.913196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:13.916241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:13.952567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:13.953376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:13.954211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:13.955495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:13.957755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:13.959197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:14.564191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:14.582811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:14.587683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:14.591535 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b8a34974-f59b-48ac-a34b-5f758a800bf7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 0.706204 Aug 27 02:38:14.595487 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 931/2044] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:13 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:14.626441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:14.629113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: b8cd0655-58b7-4731-84ce-199edeea0cac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:14.651221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:14.653256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:14.654334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:14.655432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:14.657972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:14.661620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:14.726155 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] HTTP exception thrown: Instance b8cd0655-58b7-4731-84ce-199edeea0cac could not be found. Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Request method failure captured: Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac HTTP/1.1 Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYGW4il2K9idfy6FW7Qr0Eh1KIt0CCEoaOXQJtmj-oYJ_UX6GqXdVm96pYEaMgxFTMcTSTYpbnUDaAV_ZUi1ge6yInSdWgfsuWHHABkfx-9e56RVG0EfLBptAWCajqyGi_q6VefbBbsTuYpy61Fo5bP9OsFivNIZYuNr5EayLx4B01Y Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c2ea38ee044d41d3a6ede6ab4806621d Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-LiveMigrationTest-164122363 Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c2ea38ee044d41d3a6ede6ab4806621d"}]}] Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-LiveMigrationTest-164122363 Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c2ea38ee044d41d3a6ede6ab4806621d Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-LiveMigrationTest-164122363 Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-LiveMigrationTest-164122363-project Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 6dbc0e90bbe94ce49ae09d2408a382c7 Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-LiveMigrationTest-164122363-project Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance b8cd0655-58b7-4731-84ce-199edeea0cac could not be found. Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'b8cd0655-58b7-4731-84ce-199edeea0cac'} Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cd0655-58b7-4731-84ce-199edeea0cac could not be found. Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cd0655-58b7-4731-84ce-199edeea0cac could not be found. Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:14.732685 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:14.736495 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:14.736495 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:14.736495 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:14.736495 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:38:14.736495 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:38:14.736495 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cd0655-58b7-4731-84ce-199edeea0cac could not be found. Aug 27 02:38:14.736495 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:14.743357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Returning 404 to user: Instance b8cd0655-58b7-4731-84ce-199edeea0cac could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:14.746790 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7f775443-2931-4774-9720-f0e39567f6f3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac" status: 404 len: 111 microversion: 2.1 time: 0.132325 Aug 27 02:38:14.750408 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 932/2045] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:14 2022] GET /compute/v2.1/servers/b8cd0655-58b7-4731-84ce-199edeea0cac => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:38:14.767666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e52cb002-01c5-4fa3-8786-26d7d965abb6 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:14.774874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e52cb002-01c5-4fa3-8786-26d7d965abb6 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:14.805885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e52cb002-01c5-4fa3-8786-26d7d965abb6 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:14.807676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e52cb002-01c5-4fa3-8786-26d7d965abb6 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:14.809430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e52cb002-01c5-4fa3-8786-26d7d965abb6 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:14.813930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e52cb002-01c5-4fa3-8786-26d7d965abb6 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:14.821771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e52cb002-01c5-4fa3-8786-26d7d965abb6 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:14.822832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e52cb002-01c5-4fa3-8786-26d7d965abb6 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:14.919963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-e52cb002-01c5-4fa3-8786-26d7d965abb6 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lazy-loading 'flavor' on Instance uuid 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:38:14.950913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:38:14.952184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:38:14.953204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:38:14.954954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:38:14.955794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:38:14.999987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:15.009309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:15.012246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:15.030214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:15.035606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:15.037959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:15.135320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for project 69945a768314456fae9bf75e854510c2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:38:15.165691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for user 281834367cf24a809448bdeea36a9c97 and project 69945a768314456fae9bf75e854510c2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:38:15.243216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:38:15.261239 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e52cb002-01c5-4fa3-8786-26d7d965abb6 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c/action" status: 202 len: 0 microversion: 2.1 time: 0.503567 Aug 27 02:38:15.285167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:38:15.285511 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 933/2046] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:38:14 2022] POST /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:38:15.322317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:15.327532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:15.374090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:15.376944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:15.378680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:15.387249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:15.392693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:15.397381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:15.614278 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bedf5a4c-fa88-434e-8e3e-f03c9fa65794 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.871598 Aug 27 02:38:15.615609 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1114/2047] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:38:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:38:15.651173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-14aac130-864b-4c3b-bd19-dab4a6848a84 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:15.653096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-14aac130-864b-4c3b-bd19-dab4a6848a84 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:15.737057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14aac130-864b-4c3b-bd19-dab4a6848a84 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:15.739226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14aac130-864b-4c3b-bd19-dab4a6848a84 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:15.740266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14aac130-864b-4c3b-bd19-dab4a6848a84 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:15.741628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14aac130-864b-4c3b-bd19-dab4a6848a84 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:15.756335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14aac130-864b-4c3b-bd19-dab4a6848a84 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:15.757158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14aac130-864b-4c3b-bd19-dab4a6848a84 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:16.361251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:16.377549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:16.380109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:16.381778 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-867ad9c3-d2f5-4aa1-938d-a0c922925499 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 1.089248 Aug 27 02:38:16.393056 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 934/2048] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:15 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:16.423814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-98a3f93e-2fa8-48b4-a3df-7c6af6a70af3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:16.425996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-98a3f93e-2fa8-48b4-a3df-7c6af6a70af3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:16.770979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-98a3f93e-2fa8-48b4-a3df-7c6af6a70af3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:16.824138 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-98a3f93e-2fa8-48b4-a3df-7c6af6a70af3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1215 microversion: 2.1 time: 0.411046 Aug 27 02:38:16.839028 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 935/2049] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:16 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1215 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:16.863232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:16.870850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:16.894216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:16.904400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:16.905523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:16.912201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:16.913019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:16.913689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:17.495912 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-14aac130-864b-4c3b-bd19-dab4a6848a84 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1631 microversion: 2.1 time: 1.871270 Aug 27 02:38:17.514166 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1115/2050] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:15 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1631 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:17.566465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:17.567158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:17.617570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:17.621051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:17.623183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:17.624825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:17.626037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:17.630444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:18.353925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:18.380145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:18.394725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:18.401963 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6d01b87f-fd1f-4e57-8f22-0c6a96cd930f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.871081 Aug 27 02:38:18.402905 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1116/2051] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:17 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:18.415211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58c8488c-d9e6-4185-9b31-0107dbed92d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:18.417506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-58c8488c-d9e6-4185-9b31-0107dbed92d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:18.448924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58c8488c-d9e6-4185-9b31-0107dbed92d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:18.454435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58c8488c-d9e6-4185-9b31-0107dbed92d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:18.455480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58c8488c-d9e6-4185-9b31-0107dbed92d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:18.459042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58c8488c-d9e6-4185-9b31-0107dbed92d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:18.462500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58c8488c-d9e6-4185-9b31-0107dbed92d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:18.463533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58c8488c-d9e6-4185-9b31-0107dbed92d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:18.744742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58c8488c-d9e6-4185-9b31-0107dbed92d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:18.771236 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58c8488c-d9e6-4185-9b31-0107dbed92d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1267 microversion: 2.1 time: 0.366872 Aug 27 02:38:18.771873 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1117/2052] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:18 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1267 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:18.793940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f4dd71b3-c088-4095-a30b-514b73b7d72a tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:18.794596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f4dd71b3-c088-4095-a30b-514b73b7d72a tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:18.848319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4dd71b3-c088-4095-a30b-514b73b7d72a tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:18.848939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4dd71b3-c088-4095-a30b-514b73b7d72a tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:18.849399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4dd71b3-c088-4095-a30b-514b73b7d72a tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:18.850194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4dd71b3-c088-4095-a30b-514b73b7d72a tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:18.850665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4dd71b3-c088-4095-a30b-514b73b7d72a tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:18.851360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4dd71b3-c088-4095-a30b-514b73b7d72a tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:19.270678 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f4dd71b3-c088-4095-a30b-514b73b7d72a tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1614 microversion: 2.1 time: 0.496996 Aug 27 02:38:19.274599 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1118/2053] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:18 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1614 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:19.333982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:19.340364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:19.429327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:19.435649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:19.443129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:19.451009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:19.456868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:19.461312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:19.633021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:19.640839 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] HTTP exception thrown: Cannot 'migrate' instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c while it is in vm_state suspended Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Request method failure captured: Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c/action HTTP/1.1 Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 15 Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYNIznS0rhC77VgUSbLMXgHG9UXZEuVWkQsO6zernVX2rSm_xfYDLlRYG50fRwILb8MWG2wIbJfS25WLXUL1LgG612aiikGpawrcPydoQzncVWx8kn75bEJ54HxKIIRA0Lrq4mX9bNWFblXqi5HNxHvF4Ibr4W4ozTLIY1W5uutEkoo Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 8329ff444ffa450db59e926a09a4d9e9 Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8329ff444ffa450db59e926a09a4d9e9"}]}] Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 8329ff444ffa450db59e926a09a4d9e9 Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdminNegativeTestJSON-1971866285-project-admin Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 777565270ff34c41ad73a3b0c9ab021a Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1971866285-project-admin Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: {"migrate": {}} Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: exception: Cannot 'migrate' instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c while it is in vm_state suspended Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c', 'body': {'migrate': {}}} Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c in vm_state suspended. Cannot resize while the instance is in this state. Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:38:19.657139 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c while it is in vm_state suspended Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c while it is in vm_state suspended Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.660904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Returning 409 to user: Cannot 'migrate' instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c while it is in vm_state suspended {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:19.663645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:19.665470 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0d9547b2-a439-4b82-a752-7bbbead6fd8d tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c/action" status: 409 len: 148 microversion: 2.1 time: 0.348333 Aug 27 02:38:19.666433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:19.668753 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-01d3cea2-f74b-4034-bce5-3af901684a46 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 2.838350 Aug 27 02:38:19.669712 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 936/2054] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:16 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 2840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:19.675781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:19.677567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:19.685846 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1119/2055] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:38:19 2022] POST /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c/action => generated 148 bytes in 365 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:38:19.705039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:19.707453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:19.711849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:19.713297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:19.714478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:19.715163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:19.734883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-028f78ee-259e-4151-83b8-c50a0bf3fa1b tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-028f78ee-259e-4151-83b8-c50a0bf3fa1b tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Request method failure captured: Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009/action HTTP/1.1 Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 39 Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYNIznS0rhC77VgUSbLMXgHG9UXZEuVWkQsO6zernVX2rSm_xfYDLlRYG50fRwILb8MWG2wIbJfS25WLXUL1LgG612aiikGpawrcPydoQzncVWx8kn75bEJ54HxKIIRA0Lrq4mX9bNWFblXqi5HNxHvF4Ibr4W4ozTLIY1W5uutEkoo Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 8329ff444ffa450db59e926a09a4d9e9 Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8329ff444ffa450db59e926a09a4d9e9"}]}] Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 8329ff444ffa450db59e926a09a4d9e9 Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdminNegativeTestJSON-1971866285-project-admin Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 777565270ff34c41ad73a3b0c9ab021a Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1971866285-project-admin Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: {"os-resetState": {"state": "invalid"}} Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4f011ba5-d22c-4c98-82f1-5ce036446009', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:38:19.749869 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:38:19.758034 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 02:38:19.758034 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.758034 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:19.758034 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.758034 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.758034 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:19.758034 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:19.758034 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:38:19.758034 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:38:19.758034 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 27 02:38:19.758034 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.771035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-028f78ee-259e-4151-83b8-c50a0bf3fa1b tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:19.776621 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-028f78ee-259e-4151-83b8-c50a0bf3fa1b tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009/action" status: 400 len: 144 microversion: 2.1 time: 0.087259 Aug 27 02:38:19.777773 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1120/2056] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:38:19 2022] POST /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009/action => generated 144 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:38:19.791898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-65ff88a0-c773-45cb-86c0-b8c30be9dc5f tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-65ff88a0-c773-45cb-86c0-b8c30be9dc5f tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Request method failure captured: Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009/action HTTP/1.1 Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 31 Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYNIznS0rhC77VgUSbLMXgHG9UXZEuVWkQsO6zernVX2rSm_xfYDLlRYG50fRwILb8MWG2wIbJfS25WLXUL1LgG612aiikGpawrcPydoQzncVWx8kn75bEJ54HxKIIRA0Lrq4mX9bNWFblXqi5HNxHvF4Ibr4W4ozTLIY1W5uutEkoo Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 8329ff444ffa450db59e926a09a4d9e9 Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8329ff444ffa450db59e926a09a4d9e9"}]}] Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 8329ff444ffa450db59e926a09a4d9e9 Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdminNegativeTestJSON-1971866285-project-admin Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 777565270ff34c41ad73a3b0c9ab021a Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1971866285-project-admin Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: {"os-resetState": {"state": 1}} Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4f011ba5-d22c-4c98-82f1-5ce036446009', 'body': {'os-resetState': {'state': 1}}} Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 1 Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 02:38:19.796294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-65ff88a0-c773-45cb-86c0-b8c30be9dc5f tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-65ff88a0-c773-45cb-86c0-b8c30be9dc5f tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009/action" status: 400 len: 120 microversion: 2.1 time: 0.013812 Aug 27 02:38:19.804797 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1121/2057] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:38:19 2022] POST /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009/action => generated 120 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:38:19.813955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4e351be-17a3-40c7-9ce4-dd7881640317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:19.815156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b4e351be-17a3-40c7-9ce4-dd7881640317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:19.822868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4e351be-17a3-40c7-9ce4-dd7881640317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:19.823621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4e351be-17a3-40c7-9ce4-dd7881640317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:19.824293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4e351be-17a3-40c7-9ce4-dd7881640317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:19.825241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4e351be-17a3-40c7-9ce4-dd7881640317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:19.826177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4e351be-17a3-40c7-9ce4-dd7881640317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:19.826791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4e351be-17a3-40c7-9ce4-dd7881640317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:19.922828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b4e351be-17a3-40c7-9ce4-dd7881640317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:19.933541 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b4e351be-17a3-40c7-9ce4-dd7881640317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1273 microversion: 2.1 time: 0.123813 Aug 27 02:38:19.945992 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1122/2058] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:19 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:19.953118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-14c7dac4-c3a3-41d0-8f63-1e607725ff55 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:19.955589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-14c7dac4-c3a3-41d0-8f63-1e607725ff55 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Failed to fetch instance by id 999 {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 02:38:19.957128 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-14c7dac4-c3a3-41d0-8f63-1e607725ff55 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-14c7dac4-c3a3-41d0-8f63-1e607725ff55 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Request method failure captured: Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 37 Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYNIznS0rhC77VgUSbLMXgHG9UXZEuVWkQsO6zernVX2rSm_xfYDLlRYG50fRwILb8MWG2wIbJfS25WLXUL1LgG612aiikGpawrcPydoQzncVWx8kn75bEJ54HxKIIRA0Lrq4mX9bNWFblXqi5HNxHvF4Ibr4W4ozTLIY1W5uutEkoo Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 8329ff444ffa450db59e926a09a4d9e9 Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8329ff444ffa450db59e926a09a4d9e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8329ff444ffa450db59e926a09a4d9e9"}]}] Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 8329ff444ffa450db59e926a09a4d9e9 Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1971866285 Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdminNegativeTestJSON-1971866285-project-admin Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 777565270ff34c41ad73a3b0c9ab021a Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1971866285-project-admin Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: {"os-resetState": {"state": "error"}} Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 999 could not be found. Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:19.968927 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:38:19.972875 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:38:19.972875 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 02:38:19.972875 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:19.976711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-14c7dac4-c3a3-41d0-8f63-1e607725ff55 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:19.977904 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-14c7dac4-c3a3-41d0-8f63-1e607725ff55 tempest-ServersAdminNegativeTestJSON-1971866285 tempest-ServersAdminNegativeTestJSON-1971866285-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.030525 Aug 27 02:38:19.978742 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1123/2059] 10.222.0.99 () {60 vars in 1179 bytes} [Sat Aug 27 02:38:19 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:38:19.990741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5aebaddb-0565-4db5-a99f-5ce1c607b3e9 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:19.991611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5aebaddb-0565-4db5-a99f-5ce1c607b3e9 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:20.004178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5aebaddb-0565-4db5-a99f-5ce1c607b3e9 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:20.007247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5aebaddb-0565-4db5-a99f-5ce1c607b3e9 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:20.008769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5aebaddb-0565-4db5-a99f-5ce1c607b3e9 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:20.012329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5aebaddb-0565-4db5-a99f-5ce1c607b3e9 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:20.013234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5aebaddb-0565-4db5-a99f-5ce1c607b3e9 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:20.017602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5aebaddb-0565-4db5-a99f-5ce1c607b3e9 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:20.084344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5aebaddb-0565-4db5-a99f-5ce1c607b3e9 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:38:20.305176 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5aebaddb-0565-4db5-a99f-5ce1c607b3e9 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 204 len: 0 microversion: 2.1 time: 0.318876 Aug 27 02:38:20.316570 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1124/2060] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:38:19 2022] DELETE /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:38:20.335225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eb35e98a-5843-4b38-8b2a-f1dea300630a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:20.335962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eb35e98a-5843-4b38-8b2a-f1dea300630a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:20.353877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb35e98a-5843-4b38-8b2a-f1dea300630a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:20.354652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb35e98a-5843-4b38-8b2a-f1dea300630a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:20.356046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb35e98a-5843-4b38-8b2a-f1dea300630a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:20.357167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb35e98a-5843-4b38-8b2a-f1dea300630a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:20.358085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb35e98a-5843-4b38-8b2a-f1dea300630a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:20.358724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb35e98a-5843-4b38-8b2a-f1dea300630a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:20.839759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eb35e98a-5843-4b38-8b2a-f1dea300630a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:20.861432 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eb35e98a-5843-4b38-8b2a-f1dea300630a tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1469 microversion: 2.1 time: 0.541035 Aug 27 02:38:20.863059 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1125/2061] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:20 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1469 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:20.874073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:20.875713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:20.890533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:20.891669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:20.892685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:20.897223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:20.898542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:20.900206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:21.276700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:21.309418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:21.312693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:21.315529 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3b7ce30f-8be2-46f6-89fc-f0215f0ad4cd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 0.449867 Aug 27 02:38:21.316529 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1126/2062] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:20 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:21.346699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c6e5de3b-5d98-4966-a6e4-5723d28aa317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:21.359451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6e5de3b-5d98-4966-a6e4-5723d28aa317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:21.379846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e5de3b-5d98-4966-a6e4-5723d28aa317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:21.380725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e5de3b-5d98-4966-a6e4-5723d28aa317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:21.386064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e5de3b-5d98-4966-a6e4-5723d28aa317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:21.387303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e5de3b-5d98-4966-a6e4-5723d28aa317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:21.388133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e5de3b-5d98-4966-a6e4-5723d28aa317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:21.392282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e5de3b-5d98-4966-a6e4-5723d28aa317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:21.412668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:21.715767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c6e5de3b-5d98-4966-a6e4-5723d28aa317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:21.716552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:21.730552 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c6e5de3b-5d98-4966-a6e4-5723d28aa317 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1273 microversion: 2.1 time: 0.402661 Aug 27 02:38:21.733281 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1127/2063] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:21 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1273 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:21.754820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:21.766123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:21.769101 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd223895-036c-44d0-a950-2c13d9da2eac tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 2.097254 Aug 27 02:38:21.770132 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 937/2064] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:19 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:21.906462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0a997250-03f9-4c1e-a50d-6c3fc22ac665 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:21.907501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0a997250-03f9-4c1e-a50d-6c3fc22ac665 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:21.925366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a997250-03f9-4c1e-a50d-6c3fc22ac665 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:21.925922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a997250-03f9-4c1e-a50d-6c3fc22ac665 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:21.926397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a997250-03f9-4c1e-a50d-6c3fc22ac665 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:21.942411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a997250-03f9-4c1e-a50d-6c3fc22ac665 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:21.943130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a997250-03f9-4c1e-a50d-6c3fc22ac665 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:21.943658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a997250-03f9-4c1e-a50d-6c3fc22ac665 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:22.342045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:22.342611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:22.356485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:22.356983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:22.357430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:22.358207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:22.358667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:22.359095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:22.442659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0a997250-03f9-4c1e-a50d-6c3fc22ac665 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:22.456781 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0a997250-03f9-4c1e-a50d-6c3fc22ac665 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1469 microversion: 2.1 time: 0.554209 Aug 27 02:38:22.457455 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1128/2065] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:21 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1469 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:22.772953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d7b5ff0-004a-4399-ac4f-5148156c03e8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:22.786497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1d7b5ff0-004a-4399-ac4f-5148156c03e8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:22.821997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7b5ff0-004a-4399-ac4f-5148156c03e8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:22.822489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7b5ff0-004a-4399-ac4f-5148156c03e8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:22.823341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7b5ff0-004a-4399-ac4f-5148156c03e8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:22.824587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7b5ff0-004a-4399-ac4f-5148156c03e8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:22.825399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7b5ff0-004a-4399-ac4f-5148156c03e8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:22.850245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d7b5ff0-004a-4399-ac4f-5148156c03e8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:23.185196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1d7b5ff0-004a-4399-ac4f-5148156c03e8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:23.220269 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1d7b5ff0-004a-4399-ac4f-5148156c03e8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1273 microversion: 2.1 time: 0.460948 Aug 27 02:38:23.223479 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1129/2066] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:22 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1273 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:38:23.243503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:23.246075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:23.288037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:23.301543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:23.301543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:23.302714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:23.303553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:23.304313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:23.714330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:23.740179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:23.748778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:23.754155 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9547aa4a-9d27-42a8-9e73-45b4faf7f22a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.523600 Aug 27 02:38:23.773764 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1130/2067] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:23 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:23.798157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e68e2267-aea6-4f85-b654-cdad88c91e69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:23.807290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e68e2267-aea6-4f85-b654-cdad88c91e69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:23.861947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e68e2267-aea6-4f85-b654-cdad88c91e69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:23.865258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e68e2267-aea6-4f85-b654-cdad88c91e69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:23.866046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e68e2267-aea6-4f85-b654-cdad88c91e69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:23.868647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e68e2267-aea6-4f85-b654-cdad88c91e69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:23.876182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e68e2267-aea6-4f85-b654-cdad88c91e69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:23.876950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e68e2267-aea6-4f85-b654-cdad88c91e69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:24.188206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:24.237006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:24.252876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:24.269612 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd4f87e4-3d89-45f0-ab81-d24f5d8a4c90 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 1.931353 Aug 27 02:38:24.279445 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 938/2068] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:22 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:24.304732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bf6a5727-31d8-4fbe-a5a5-895b68b25656 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:24.324105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bf6a5727-31d8-4fbe-a5a5-895b68b25656 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:24.371190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf6a5727-31d8-4fbe-a5a5-895b68b25656 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:24.380505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf6a5727-31d8-4fbe-a5a5-895b68b25656 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:24.384172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf6a5727-31d8-4fbe-a5a5-895b68b25656 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:24.390087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e68e2267-aea6-4f85-b654-cdad88c91e69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:24.403152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf6a5727-31d8-4fbe-a5a5-895b68b25656 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:24.403693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf6a5727-31d8-4fbe-a5a5-895b68b25656 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:24.404153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf6a5727-31d8-4fbe-a5a5-895b68b25656 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:24.410071 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e68e2267-aea6-4f85-b654-cdad88c91e69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1469 microversion: 2.1 time: 0.640259 Aug 27 02:38:24.410938 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1131/2069] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:23 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1469 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:24.788939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:24.796077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:24.799027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:24.800075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:24.800532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:24.807684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:24.808193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:24.808653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:25.077322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:25.200437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:25.339641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bf6a5727-31d8-4fbe-a5a5-895b68b25656 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:25.370093 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bf6a5727-31d8-4fbe-a5a5-895b68b25656 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1273 microversion: 2.1 time: 1.083449 Aug 27 02:38:25.380480 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 939/2070] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:24 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1273 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:25.395842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:25.405316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:25.417641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:25.439676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:25.451576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:25.453820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:25.467200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:25.468714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:25.470962 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b5fd41ee-89d3-4335-8c85-8e42b097fcb8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.680809 Aug 27 02:38:25.472162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:25.473055 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1132/2071] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:24 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:38:25.477805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:25.482806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:25.499627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b00a9683-cd81-428c-be89-c6c4302c2452 req-0f2a0208-332d-43aa-824c-7a03a8f513a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c", "name": "network-vif-deleted", "tag": "696ce108-07e7-466e-b02e-474f3e054231"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:25.616122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b00a9683-cd81-428c-be89-c6c4302c2452 req-0f2a0208-332d-43aa-824c-7a03a8f513a6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:25.630642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b00a9683-cd81-428c-be89-c6c4302c2452 req-0f2a0208-332d-43aa-824c-7a03a8f513a6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:25.640975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b00a9683-cd81-428c-be89-c6c4302c2452 req-0f2a0208-332d-43aa-824c-7a03a8f513a6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:25.781809 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b00a9683-cd81-428c-be89-c6c4302c2452 req-0f2a0208-332d-43aa-824c-7a03a8f513a6 service nova] Creating event network-vif-deleted:696ce108-07e7-466e-b02e-474f3e054231 for instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c on n-h2-852084-5 Aug 27 02:38:25.818042 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b00a9683-cd81-428c-be89-c6c4302c2452 req-0f2a0208-332d-43aa-824c-7a03a8f513a6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.336639 Aug 27 02:38:25.825880 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1133/2072] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:25.863425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:25.876756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:25.927072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:25.931515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:25.938208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:25.947260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:25.949235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:25.959715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:26.117594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:26.118182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:26.118657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:26.119141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lazy-loading 'fault' on Instance uuid 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:38:26.570636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:26.589419 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-432a2661-977a-4a4a-a259-ac6fc51bc2ed tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 200 len: 1312 microversion: 2.1 time: 0.757162 Aug 27 02:38:26.597595 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1134/2073] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:25 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 1312 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:26.639692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-140643ba-34af-4333-8efd-174bc3ea3363 req-7d5007f5-1664-4d72-b3af-db151f328882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "099723a4-8d6a-4f11-9e89-cde00fbdbdf6", "name": "network-vif-unplugged", "status": "completed", "tag": "d0e84c9b-db44-407d-9fe2-65f84a836cbb"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:26.711770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-140643ba-34af-4333-8efd-174bc3ea3363 req-7d5007f5-1664-4d72-b3af-db151f328882 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:26.718545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-140643ba-34af-4333-8efd-174bc3ea3363 req-7d5007f5-1664-4d72-b3af-db151f328882 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:26.719262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-140643ba-34af-4333-8efd-174bc3ea3363 req-7d5007f5-1664-4d72-b3af-db151f328882 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:26.750894 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-140643ba-34af-4333-8efd-174bc3ea3363 req-7d5007f5-1664-4d72-b3af-db151f328882 service nova] Creating event network-vif-unplugged:d0e84c9b-db44-407d-9fe2-65f84a836cbb for instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 on n-h1-852084-5 Aug 27 02:38:26.765711 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-140643ba-34af-4333-8efd-174bc3ea3363 req-7d5007f5-1664-4d72-b3af-db151f328882 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163143 Aug 27 02:38:26.769980 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1135/2074] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:26.781008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:26.782361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a2afd34-8edc-4c69-997c-3d7e5ea917af tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:26.786239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4a2afd34-8edc-4c69-997c-3d7e5ea917af tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:26.809315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a2afd34-8edc-4c69-997c-3d7e5ea917af tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:26.813471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a2afd34-8edc-4c69-997c-3d7e5ea917af tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:26.815081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a2afd34-8edc-4c69-997c-3d7e5ea917af tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:26.818910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a2afd34-8edc-4c69-997c-3d7e5ea917af tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:26.821525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a2afd34-8edc-4c69-997c-3d7e5ea917af tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:26.825416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a2afd34-8edc-4c69-997c-3d7e5ea917af tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:27.030696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4a2afd34-8edc-4c69-997c-3d7e5ea917af tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:27.041435 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a2afd34-8edc-4c69-997c-3d7e5ea917af tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1273 microversion: 2.1 time: 0.268809 Aug 27 02:38:27.050380 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1136/2075] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:26 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:27.094229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:27.096188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:27.139623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:27.142330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:27.143342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:27.148336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:27.150316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:27.153523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:27.875968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:27.902106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:27.921266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:27.931041 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-10a25dff-f902-47ce-b11a-bf955990ba3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.879419 Aug 27 02:38:27.954082 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1137/2076] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:27 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:27.974210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-83502ac4-a54a-4653-be85-6754a7212968 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:27.977577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-83502ac4-a54a-4653-be85-6754a7212968 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:27.992672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83502ac4-a54a-4653-be85-6754a7212968 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:27.997920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83502ac4-a54a-4653-be85-6754a7212968 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:27.998486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83502ac4-a54a-4653-be85-6754a7212968 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:28.001460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83502ac4-a54a-4653-be85-6754a7212968 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:28.001460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83502ac4-a54a-4653-be85-6754a7212968 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:28.001460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83502ac4-a54a-4653-be85-6754a7212968 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:28.132576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-83502ac4-a54a-4653-be85-6754a7212968 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:38:28.407694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:28.434456 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-83502ac4-a54a-4653-be85-6754a7212968 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 204 len: 0 microversion: 2.1 time: 0.477110 Aug 27 02:38:28.435768 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1138/2077] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:38:27 2022] DELETE /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:38:28.451107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:28.452205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:28.471815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:28.475984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:28.478623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:28.482332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:28.486246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:28.489891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:28.545135 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] HTTP exception thrown: Instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c could not be found. Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Request method failure captured: Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c HTTP/1.1 Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYNG6a3t98iWtgK56tFk4f4TgHBsY8g_Q9tfCydibbrFqJdWfNkFpSHGSWT0hgiK3_XKD5LBX7u3__k8rcU9DHrXUv9WzsAe7vhV64iLaZ1dkeuX8gQdfbQvK4eA43gw0P8QpPNtnO6vRiIrqSzMfxog2oaPt7_o7B6xOVYQsxuHFMQ Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 880503f29a6140d689df06229a0c81d9 Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1584134768 Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_880503f29a6140d689df06229a0c81d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/880503f29a6140d689df06229a0c81d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/880503f29a6140d689df06229a0c81d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/880503f29a6140d689df06229a0c81d9"}]}] Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1584134768 Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 880503f29a6140d689df06229a0c81d9 Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1584134768 Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdminNegativeTestJSON-1584134768-project Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 316c412ee28c4faba94ff0d8c2484bae Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1584134768-project Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c could not be found. Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c'} Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c could not be found. Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c could not be found. Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:28.551723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:28.560968 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:28.560968 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:28.560968 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:28.560968 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:28.560968 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:38:28.560968 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:38:28.560968 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c could not be found. Aug 27 02:38:28.560968 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:28.560968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Returning 404 to user: Instance 3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:28.560968 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6e0f5d1-d00b-4985-90e5-72485ef89cfb tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c" status: 404 len: 111 microversion: 2.1 time: 0.115528 Aug 27 02:38:28.560968 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1139/2078] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:28 2022] GET /compute/v2.1/servers/3d78db8a-b338-4b9b-b2fc-fb5e6e512d0c => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:38:28.567870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ebd76d24-deb8-4af5-8116-b24d21605c3e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:28.568502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ebd76d24-deb8-4af5-8116-b24d21605c3e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:28.586812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebd76d24-deb8-4af5-8116-b24d21605c3e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:28.587344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebd76d24-deb8-4af5-8116-b24d21605c3e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:28.587806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebd76d24-deb8-4af5-8116-b24d21605c3e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:28.588618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebd76d24-deb8-4af5-8116-b24d21605c3e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:28.589089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebd76d24-deb8-4af5-8116-b24d21605c3e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:28.589522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebd76d24-deb8-4af5-8116-b24d21605c3e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:28.946311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ebd76d24-deb8-4af5-8116-b24d21605c3e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:28.962625 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ebd76d24-deb8-4af5-8116-b24d21605c3e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 0.405962 Aug 27 02:38:28.965989 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1140/2079] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:28 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:28.984749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b18dc772-cde5-45ba-928d-fca97c7ba1aa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:28.991033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b18dc772-cde5-45ba-928d-fca97c7ba1aa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:29.013290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b18dc772-cde5-45ba-928d-fca97c7ba1aa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:29.014201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b18dc772-cde5-45ba-928d-fca97c7ba1aa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:29.014915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b18dc772-cde5-45ba-928d-fca97c7ba1aa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:29.016019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b18dc772-cde5-45ba-928d-fca97c7ba1aa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:29.016709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b18dc772-cde5-45ba-928d-fca97c7ba1aa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:29.020469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b18dc772-cde5-45ba-928d-fca97c7ba1aa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:29.793782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b18dc772-cde5-45ba-928d-fca97c7ba1aa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:29.839138 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b18dc772-cde5-45ba-928d-fca97c7ba1aa tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1668 microversion: 2.1 time: 0.867683 Aug 27 02:38:29.844471 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1141/2080] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:28 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1668 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:29.881089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58088e71-5741-4952-9318-839b06322485 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:29.881614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-58088e71-5741-4952-9318-839b06322485 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:29.911946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58088e71-5741-4952-9318-839b06322485 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:29.912468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58088e71-5741-4952-9318-839b06322485 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:29.912929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58088e71-5741-4952-9318-839b06322485 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:29.913747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58088e71-5741-4952-9318-839b06322485 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:29.914810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58088e71-5741-4952-9318-839b06322485 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:29.916844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:29.927700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58088e71-5741-4952-9318-839b06322485 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:29.936010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:29.946656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:29.956936 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5e4a5228-50c2-45d1-a957-d08d880846f1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 4.584435 Aug 27 02:38:29.980615 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 940/2081] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:25 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 4608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:30.010026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6935ab92-a90b-4dfc-8763-e2437e5b061c req-a62aaab1-c273-4e5c-9bc8-d1d6904da090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "099723a4-8d6a-4f11-9e89-cde00fbdbdf6", "tag": "d0e84c9b-db44-407d-9fe2-65f84a836cbb"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:30.062133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6935ab92-a90b-4dfc-8763-e2437e5b061c req-a62aaab1-c273-4e5c-9bc8-d1d6904da090 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:30.066507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6935ab92-a90b-4dfc-8763-e2437e5b061c req-a62aaab1-c273-4e5c-9bc8-d1d6904da090 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:30.067082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6935ab92-a90b-4dfc-8763-e2437e5b061c req-a62aaab1-c273-4e5c-9bc8-d1d6904da090 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:30.068492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-58088e71-5741-4952-9318-839b06322485 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:38:30.131872 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6935ab92-a90b-4dfc-8763-e2437e5b061c req-a62aaab1-c273-4e5c-9bc8-d1d6904da090 service nova] Creating event network-changed:d0e84c9b-db44-407d-9fe2-65f84a836cbb for instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 on n-h1-852084-5 Aug 27 02:38:30.195592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:30.227233 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6935ab92-a90b-4dfc-8763-e2437e5b061c req-a62aaab1-c273-4e5c-9bc8-d1d6904da090 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238847 Aug 27 02:38:30.227961 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 941/2082] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:30.288243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:30.291108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:30.323100 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58088e71-5741-4952-9318-839b06322485 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 204 len: 0 microversion: 2.1 time: 0.474861 Aug 27 02:38:30.324861 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1142/2083] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:38:29 2022] DELETE /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:38:30.327591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:30.329637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:30.331555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:30.332608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:30.333438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:30.334239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:30.335741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f741c249-810c-4744-b098-c1f36f28b568 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:30.336923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f741c249-810c-4744-b098-c1f36f28b568 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:30.348531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f741c249-810c-4744-b098-c1f36f28b568 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:30.350368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f741c249-810c-4744-b098-c1f36f28b568 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:30.351334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f741c249-810c-4744-b098-c1f36f28b568 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:30.352786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f741c249-810c-4744-b098-c1f36f28b568 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:30.353478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f741c249-810c-4744-b098-c1f36f28b568 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:30.354449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f741c249-810c-4744-b098-c1f36f28b568 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:30.845935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f741c249-810c-4744-b098-c1f36f28b568 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:30.860510 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f741c249-810c-4744-b098-c1f36f28b568 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 0.534320 Aug 27 02:38:30.861170 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1143/2084] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:30 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:30.891842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-60802f0b-3ee4-4874-92d3-71758bef607b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:30.892464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-60802f0b-3ee4-4874-92d3-71758bef607b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:30.904268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60802f0b-3ee4-4874-92d3-71758bef607b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:30.904717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60802f0b-3ee4-4874-92d3-71758bef607b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:30.905093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60802f0b-3ee4-4874-92d3-71758bef607b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:30.905869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60802f0b-3ee4-4874-92d3-71758bef607b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:30.909878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60802f0b-3ee4-4874-92d3-71758bef607b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:30.909878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60802f0b-3ee4-4874-92d3-71758bef607b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:31.244810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:31.258238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:31.267099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:31.269404 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b26cfc96-69e4-40b3-97a0-01dc0081ff1d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 1.032697 Aug 27 02:38:31.297975 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 942/2085] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:30 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:31.308613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-342fea46-0335-4eda-855e-bf53db15f4f8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:31.308945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-342fea46-0335-4eda-855e-bf53db15f4f8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:31.327695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342fea46-0335-4eda-855e-bf53db15f4f8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:31.331600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342fea46-0335-4eda-855e-bf53db15f4f8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:31.332341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342fea46-0335-4eda-855e-bf53db15f4f8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:31.333273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342fea46-0335-4eda-855e-bf53db15f4f8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:31.339209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342fea46-0335-4eda-855e-bf53db15f4f8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:31.345034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342fea46-0335-4eda-855e-bf53db15f4f8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:31.538814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-60802f0b-3ee4-4874-92d3-71758bef607b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:31.550976 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-60802f0b-3ee4-4874-92d3-71758bef607b tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1478 microversion: 2.1 time: 0.675723 Aug 27 02:38:31.554830 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1144/2086] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:30 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1478 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:31.581599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:31.586891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:31.599192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:31.600264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:31.601719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:31.604656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:31.607365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:31.608230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:32.046334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:32.060622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:32.065540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:32.070085 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-51cedd46-3148-4688-ba8d-929c17c6353b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 0.500889 Aug 27 02:38:32.085732 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1145/2087] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:31 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:32.086309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d1adc593-f5ff-4d08-8efe-751bdfb3dba1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:32.088734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d1adc593-f5ff-4d08-8efe-751bdfb3dba1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:32.109319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1adc593-f5ff-4d08-8efe-751bdfb3dba1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:32.110058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1adc593-f5ff-4d08-8efe-751bdfb3dba1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:32.110524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1adc593-f5ff-4d08-8efe-751bdfb3dba1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:32.111300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1adc593-f5ff-4d08-8efe-751bdfb3dba1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:32.111816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1adc593-f5ff-4d08-8efe-751bdfb3dba1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:32.115707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1adc593-f5ff-4d08-8efe-751bdfb3dba1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:32.338281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-342fea46-0335-4eda-855e-bf53db15f4f8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:32.349832 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-342fea46-0335-4eda-855e-bf53db15f4f8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1668 microversion: 2.1 time: 1.050021 Aug 27 02:38:32.351323 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 943/2088] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:31 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1668 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:32.356510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:32.358477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:32.366625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:32.367685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:32.370352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:32.372893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:32.374220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:32.374950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:32.519511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d1adc593-f5ff-4d08-8efe-751bdfb3dba1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:32.529277 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d1adc593-f5ff-4d08-8efe-751bdfb3dba1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 0.453796 Aug 27 02:38:32.530149 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1146/2089] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:32 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:32.552919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9fcb2a71-24c9-4255-8a55-63203b863c13 req-45d9d370-2dbe-46b6-8ac2-4c52ee3cca4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9500d4a-17ee-40b3-bc1c-77026234b7a3", "name": "network-vif-deleted", "tag": "aba73b64-257c-4090-8a10-377dba49c897"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:32.574275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9fcb2a71-24c9-4255-8a55-63203b863c13 req-45d9d370-2dbe-46b6-8ac2-4c52ee3cca4c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:32.575072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9fcb2a71-24c9-4255-8a55-63203b863c13 req-45d9d370-2dbe-46b6-8ac2-4c52ee3cca4c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:32.576846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9fcb2a71-24c9-4255-8a55-63203b863c13 req-45d9d370-2dbe-46b6-8ac2-4c52ee3cca4c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:32.608925 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9fcb2a71-24c9-4255-8a55-63203b863c13 req-45d9d370-2dbe-46b6-8ac2-4c52ee3cca4c service nova] Creating event network-vif-deleted:aba73b64-257c-4090-8a10-377dba49c897 for instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 on n-h2-852084-5 Aug 27 02:38:32.630469 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9fcb2a71-24c9-4255-8a55-63203b863c13 req-45d9d370-2dbe-46b6-8ac2-4c52ee3cca4c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075623 Aug 27 02:38:32.635732 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1147/2090] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:38:32.642270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d1c638a1-5f1c-47b4-8672-b74c6f99b808 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:32.643331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d1c638a1-5f1c-47b4-8672-b74c6f99b808 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:32.654602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1c638a1-5f1c-47b4-8672-b74c6f99b808 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:32.657289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1c638a1-5f1c-47b4-8672-b74c6f99b808 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:32.660006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1c638a1-5f1c-47b4-8672-b74c6f99b808 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:32.661035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1c638a1-5f1c-47b4-8672-b74c6f99b808 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:32.664511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1c638a1-5f1c-47b4-8672-b74c6f99b808 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:32.665265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1c638a1-5f1c-47b4-8672-b74c6f99b808 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:32.752007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:32.768500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:32.775275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:32.778803 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5ce33d41-5aaf-49c7-b928-e2510e7c554d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.426147 Aug 27 02:38:32.781307 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 944/2091] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:32 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:33.044208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d1c638a1-5f1c-47b4-8672-b74c6f99b808 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:33.059206 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d1c638a1-5f1c-47b4-8672-b74c6f99b808 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1478 microversion: 2.1 time: 0.421618 Aug 27 02:38:33.060735 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1148/2092] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:32 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1478 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:33.103030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:33.103921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:33.112059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:33.112557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:33.112995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:33.113745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:33.114203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:33.114627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:33.372816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:33.373457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:33.389698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:33.390254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:33.390717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:33.391580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:33.391955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:33.393210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:33.447886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:33.448387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:33.451406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:33.453060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lazy-loading 'fault' on Instance uuid d9500d4a-17ee-40b3-bc1c-77026234b7a3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:38:33.554836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:33.568593 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c146ec19-7900-4770-9b6e-3b565510cac6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 200 len: 1325 microversion: 2.1 time: 0.200053 Aug 27 02:38:33.591005 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1149/2093] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:33 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 1325 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:33.611466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-210afa4a-f8d7-45d0-ae67-e73d6075bc11 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:33.613579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-210afa4a-f8d7-45d0-ae67-e73d6075bc11 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:33.629210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210afa4a-f8d7-45d0-ae67-e73d6075bc11 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:33.651278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210afa4a-f8d7-45d0-ae67-e73d6075bc11 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:33.653165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210afa4a-f8d7-45d0-ae67-e73d6075bc11 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:33.659943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210afa4a-f8d7-45d0-ae67-e73d6075bc11 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:33.666102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210afa4a-f8d7-45d0-ae67-e73d6075bc11 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:33.668396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210afa4a-f8d7-45d0-ae67-e73d6075bc11 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:34.527677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-210afa4a-f8d7-45d0-ae67-e73d6075bc11 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:34.554080 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-210afa4a-f8d7-45d0-ae67-e73d6075bc11 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 0.960605 Aug 27 02:38:34.575477 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1150/2094] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:33 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:34.584818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:34.591284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:34.613461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:34.618411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:34.619512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:34.630581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:34.631799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:34.632884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:36.018509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:36.051431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:36.060397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:36.062170 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-83f20d86-0be4-4435-a4fb-60f9c6a2f61f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 1.484539 Aug 27 02:38:36.068008 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1151/2095] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:34 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:36.082170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-609911ca-4883-4ab2-bd05-e85bb0332942 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:36.093262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-609911ca-4883-4ab2-bd05-e85bb0332942 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:36.114682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-609911ca-4883-4ab2-bd05-e85bb0332942 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:36.119677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-609911ca-4883-4ab2-bd05-e85bb0332942 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:36.120546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-609911ca-4883-4ab2-bd05-e85bb0332942 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:36.121702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-609911ca-4883-4ab2-bd05-e85bb0332942 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:36.122476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-609911ca-4883-4ab2-bd05-e85bb0332942 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:36.123164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-609911ca-4883-4ab2-bd05-e85bb0332942 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:36.406280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:36.499555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:36.504015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:36.505514 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d2a7aa69-ff28-43b0-b221-94a5a78e8e25 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 3.409724 Aug 27 02:38:36.522557 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 945/2096] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:33 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 3425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:36.537496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:36.547554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: d9500d4a-17ee-40b3-bc1c-77026234b7a3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:36.575906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:36.579172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:36.583132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:36.587844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:36.593228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:36.594477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:36.650400 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] HTTP exception thrown: Instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 could not be found. Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Request method failure captured: Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 HTTP/1.1 Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYGW4il2K9idfy6FW7Qr0Eh1KIt0CCEoaOXQJtmj-oYJ_UX6GqXdVm96pYEaMgxFTMcTSTYpbnUDaAV_ZUi1ge6yInSdWgfsuWHHABkfx-9e56RVG0EfLBptAWCajqyGi_q6VefbBbsTuYpy61Fo5bP9OsFivNIZYuNr5EayLx4B01Y Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c2ea38ee044d41d3a6ede6ab4806621d Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-LiveMigrationTest-164122363 Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c2ea38ee044d41d3a6ede6ab4806621d"}]}] Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-LiveMigrationTest-164122363 Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c2ea38ee044d41d3a6ede6ab4806621d Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-LiveMigrationTest-164122363 Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-LiveMigrationTest-164122363-project Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 6dbc0e90bbe94ce49ae09d2408a382c7 Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-LiveMigrationTest-164122363-project Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 could not be found. Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'd9500d4a-17ee-40b3-bc1c-77026234b7a3'} Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 could not be found. Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 could not be found. Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:36.652281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:36.660609 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:36.660609 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:36.660609 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:36.660609 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:38:36.660609 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:38:36.660609 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 could not be found. Aug 27 02:38:36.660609 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:36.660609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Returning 404 to user: Instance d9500d4a-17ee-40b3-bc1c-77026234b7a3 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:36.665430 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d650cfcc-00ea-4a0e-ade3-05bc8708563b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3" status: 404 len: 111 microversion: 2.1 time: 0.142291 Aug 27 02:38:36.674885 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 946/2097] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:36 2022] GET /compute/v2.1/servers/d9500d4a-17ee-40b3-bc1c-77026234b7a3 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:38:36.686429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ad94bed3-e452-40a4-9626-ae7887b9da38 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:36.687711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ad94bed3-e452-40a4-9626-ae7887b9da38 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:36.704473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad94bed3-e452-40a4-9626-ae7887b9da38 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:36.706620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad94bed3-e452-40a4-9626-ae7887b9da38 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:36.708563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad94bed3-e452-40a4-9626-ae7887b9da38 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:36.710434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad94bed3-e452-40a4-9626-ae7887b9da38 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:36.711039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad94bed3-e452-40a4-9626-ae7887b9da38 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:36.712130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad94bed3-e452-40a4-9626-ae7887b9da38 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:36.724244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:37.277738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-609911ca-4883-4ab2-bd05-e85bb0332942 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:37.288811 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-609911ca-4883-4ab2-bd05-e85bb0332942 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1478 microversion: 2.1 time: 1.219374 Aug 27 02:38:37.298313 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1152/2098] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:36 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1478 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:37.322728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8bcc54d3-79cb-4a40-b3b5-3e455edbe758 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '.version_select at 0x7f4d2e761550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:37.415746 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8bcc54d3-79cb-4a40-b3b5-3e455edbe758 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118236691" status: 202 len: 0 microversion: 2.1 time: 0.111030 Aug 27 02:38:37.421318 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1153/2099] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:38:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118236691 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:38:37.471644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:37.480656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:37.566177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:37.570009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:37.572847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:37.583771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:37.585997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:37.590173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:38.153088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ad94bed3-e452-40a4-9626-ae7887b9da38 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:38.170473 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ad94bed3-e452-40a4-9626-ae7887b9da38 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 1.490391 Aug 27 02:38:38.182302 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 947/2100] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:36 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:38.199332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:38.210380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:38.256211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:38.257127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:38.257987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:38.265128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:38.268775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:38.269492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:39.005363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:39.024798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:39.029230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:39.038094 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1f5209e5-9dea-4bda-8e4a-759c5413cb59 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 1.610828 Aug 27 02:38:39.038906 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1154/2101] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:37 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:39.055172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-3c39a824-9c1e-49a7-a5b8-063dfc9802f5 req-ec9ea093-1035-45ba-9c9b-8c103d6dfb91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f011ba5-d22c-4c98-82f1-5ce036446009", "name": "network-vif-unplugged", "status": "completed", "tag": "08cc6d4b-6ce1-4406-8658-f319c7cbf479"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:39.113653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c39a824-9c1e-49a7-a5b8-063dfc9802f5 req-ec9ea093-1035-45ba-9c9b-8c103d6dfb91 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:39.132278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c39a824-9c1e-49a7-a5b8-063dfc9802f5 req-ec9ea093-1035-45ba-9c9b-8c103d6dfb91 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:39.133034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c39a824-9c1e-49a7-a5b8-063dfc9802f5 req-ec9ea093-1035-45ba-9c9b-8c103d6dfb91 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:39.172665 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-3c39a824-9c1e-49a7-a5b8-063dfc9802f5 req-ec9ea093-1035-45ba-9c9b-8c103d6dfb91 service nova] Creating event network-vif-unplugged:08cc6d4b-6ce1-4406-8658-f319c7cbf479 for instance 4f011ba5-d22c-4c98-82f1-5ce036446009 on n-h1-852084-5 Aug 27 02:38:39.196993 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-3c39a824-9c1e-49a7-a5b8-063dfc9802f5 req-ec9ea093-1035-45ba-9c9b-8c103d6dfb91 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155330 Aug 27 02:38:39.201854 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1155/2102] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:39.212082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bac203b5-5d32-4efa-bf29-f698613f5f69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:39.214964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bac203b5-5d32-4efa-bf29-f698613f5f69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:39.240725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bac203b5-5d32-4efa-bf29-f698613f5f69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:39.248316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bac203b5-5d32-4efa-bf29-f698613f5f69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:39.249155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bac203b5-5d32-4efa-bf29-f698613f5f69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:39.250187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bac203b5-5d32-4efa-bf29-f698613f5f69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:39.257494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bac203b5-5d32-4efa-bf29-f698613f5f69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:39.258236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bac203b5-5d32-4efa-bf29-f698613f5f69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:39.603910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bac203b5-5d32-4efa-bf29-f698613f5f69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316c412ee28c4faba94ff0d8c2484bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880503f29a6140d689df06229a0c81d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:39.618924 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bac203b5-5d32-4efa-bf29-f698613f5f69 tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 200 len: 1436 microversion: 2.1 time: 0.412337 Aug 27 02:38:39.620175 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1156/2103] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:39 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 1436 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:39.628487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ee19323e-8154-4ebb-9633-9d06d61af8e1 req-cfcd5930-db68-47eb-bb9e-206d51bc8e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "443b356d-208a-4c5d-8456-b483041b9e8d", "tag": "345eeb5c-ae6d-40de-8f6e-9fb948322417"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:39.657082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee19323e-8154-4ebb-9633-9d06d61af8e1 req-cfcd5930-db68-47eb-bb9e-206d51bc8e2d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:39.659638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee19323e-8154-4ebb-9633-9d06d61af8e1 req-cfcd5930-db68-47eb-bb9e-206d51bc8e2d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:39.660393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee19323e-8154-4ebb-9633-9d06d61af8e1 req-cfcd5930-db68-47eb-bb9e-206d51bc8e2d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:39.722015 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ee19323e-8154-4ebb-9633-9d06d61af8e1 req-cfcd5930-db68-47eb-bb9e-206d51bc8e2d service nova] Creating event network-changed:345eeb5c-ae6d-40de-8f6e-9fb948322417 for instance 443b356d-208a-4c5d-8456-b483041b9e8d on n-h1-852084-5 Aug 27 02:38:39.737603 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ee19323e-8154-4ebb-9633-9d06d61af8e1 req-cfcd5930-db68-47eb-bb9e-206d51bc8e2d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114924 Aug 27 02:38:39.739657 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1157/2104] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:39.748629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0f61aeea-c370-47ec-ab12-2179fdb5f7a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:39.781897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0f61aeea-c370-47ec-ab12-2179fdb5f7a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:39.805261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f61aeea-c370-47ec-ab12-2179fdb5f7a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:39.806049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f61aeea-c370-47ec-ab12-2179fdb5f7a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:39.806687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f61aeea-c370-47ec-ab12-2179fdb5f7a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:39.807652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f61aeea-c370-47ec-ab12-2179fdb5f7a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:39.808492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f61aeea-c370-47ec-ab12-2179fdb5f7a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:39.809108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f61aeea-c370-47ec-ab12-2179fdb5f7a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:40.115254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:40.146170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:40.152147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:40.153482 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e88c0911-75c5-4e53-ac44-7029ad1f596e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 1.969550 Aug 27 02:38:40.173168 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 948/2105] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:38 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:40.178875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:40.205533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:40.232891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=50 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:40.236828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:40.244673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:40.248210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:40.251879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:40.256563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:40.260021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:40.998029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0f61aeea-c370-47ec-ab12-2179fdb5f7a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:41.036729 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0f61aeea-c370-47ec-ab12-2179fdb5f7a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 1.293849 Aug 27 02:38:41.051701 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1158/2106] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:39 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:41.051701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:41.052280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] [instance: 4f011ba5-d22c-4c98-82f1-5ce036446009] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:41.071132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:41.078727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:41.079409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:41.081112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:41.081840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:41.083633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:41.123973 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] HTTP exception thrown: Instance 4f011ba5-d22c-4c98-82f1-5ce036446009 could not be found. Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Request method failure captured: Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 HTTP/1.1 Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYNG6a3t98iWtgK56tFk4f4TgHBsY8g_Q9tfCydibbrFqJdWfNkFpSHGSWT0hgiK3_XKD5LBX7u3__k8rcU9DHrXUv9WzsAe7vhV64iLaZ1dkeuX8gQdfbQvK4eA43gw0P8QpPNtnO6vRiIrqSzMfxog2oaPt7_o7B6xOVYQsxuHFMQ Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 880503f29a6140d689df06229a0c81d9 Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1584134768 Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_880503f29a6140d689df06229a0c81d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/880503f29a6140d689df06229a0c81d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/880503f29a6140d689df06229a0c81d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/880503f29a6140d689df06229a0c81d9"}]}] Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1584134768 Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 880503f29a6140d689df06229a0c81d9 Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1584134768 Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdminNegativeTestJSON-1584134768-project Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 316c412ee28c4faba94ff0d8c2484bae Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1584134768-project Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 4f011ba5-d22c-4c98-82f1-5ce036446009 could not be found. Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4f011ba5-d22c-4c98-82f1-5ce036446009'} Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f011ba5-d22c-4c98-82f1-5ce036446009 could not be found. Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f011ba5-d22c-4c98-82f1-5ce036446009 could not be found. Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:41.126359 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:41.129921 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:41.129921 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:41.129921 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:41.129921 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:41.129921 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:38:41.129921 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:38:41.129921 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f011ba5-d22c-4c98-82f1-5ce036446009 could not be found. Aug 27 02:38:41.129921 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:41.131317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] Returning 404 to user: Instance 4f011ba5-d22c-4c98-82f1-5ce036446009 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:41.134919 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-feda8587-cb88-4556-a686-0f069aa89b5f tempest-ServersAdminNegativeTestJSON-1584134768 tempest-ServersAdminNegativeTestJSON-1584134768-project] 10.222.0.99 "GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009" status: 404 len: 111 microversion: 2.1 time: 0.093500 Aug 27 02:38:41.138302 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1159/2107] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:41 2022] GET /compute/v2.1/servers/4f011ba5-d22c-4c98-82f1-5ce036446009 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:38:41.149821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:41.193409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:41.197420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:41.201447 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-52332e08-de91-493e-b058-36cfe1b3074e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 1.026230 Aug 27 02:38:41.218421 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 949/2108] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:40 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:41.230912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:41.230912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:41.246922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:41.247445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:41.247905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:41.248682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:41.249170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:41.249607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:42.066717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-79997b02-13e7-42df-8be5-027292f859c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:42.069877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-79997b02-13e7-42df-8be5-027292f859c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:42.106594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79997b02-13e7-42df-8be5-027292f859c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:42.113876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79997b02-13e7-42df-8be5-027292f859c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:42.120699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79997b02-13e7-42df-8be5-027292f859c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:42.125821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79997b02-13e7-42df-8be5-027292f859c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:42.127702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79997b02-13e7-42df-8be5-027292f859c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:42.129488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79997b02-13e7-42df-8be5-027292f859c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:42.735281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:42.762774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:42.765632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:42.767083 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fe8c565f-dd01-469e-947f-13c20dedf40d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1736 microversion: 2.20 time: 1.548304 Aug 27 02:38:42.768741 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1160/2109] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:41 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1736 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:38:42.776108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e3565824-8e26-4552-95cc-5ec18c066c11 req-973b3bde-9a9d-4cc1-8eb8-8037fc5f2535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f011ba5-d22c-4c98-82f1-5ce036446009", "name": "network-vif-deleted", "tag": "08cc6d4b-6ce1-4406-8658-f319c7cbf479"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:42.801547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e3565824-8e26-4552-95cc-5ec18c066c11 req-973b3bde-9a9d-4cc1-8eb8-8037fc5f2535 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:42.802355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e3565824-8e26-4552-95cc-5ec18c066c11 req-973b3bde-9a9d-4cc1-8eb8-8037fc5f2535 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:42.803148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e3565824-8e26-4552-95cc-5ec18c066c11 req-973b3bde-9a9d-4cc1-8eb8-8037fc5f2535 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:42.821321 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e3565824-8e26-4552-95cc-5ec18c066c11 req-973b3bde-9a9d-4cc1-8eb8-8037fc5f2535 service nova] Creating event network-vif-deleted:08cc6d4b-6ce1-4406-8658-f319c7cbf479 for instance 4f011ba5-d22c-4c98-82f1-5ce036446009 on n-h1-852084-5 Aug 27 02:38:42.830652 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e3565824-8e26-4552-95cc-5ec18c066c11 req-973b3bde-9a9d-4cc1-8eb8-8037fc5f2535 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059574 Aug 27 02:38:42.832636 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1161/2110] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:42.839869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:42.840595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:42.852687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:42.853418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:42.854717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:42.855630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:42.857065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:42.857803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:43.540949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:43.547564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:43.558531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:43.560547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:43.563616 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0990a282-ce2d-43c4-a91f-45d91af510a2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 0.729268 Aug 27 02:38:43.566294 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1162/2111] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:42 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:43.574567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-42dfc16e-c4c0-474b-b1d8-ae1202dac233 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:43.575403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-42dfc16e-c4c0-474b-b1d8-ae1202dac233 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:43.589277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42dfc16e-c4c0-474b-b1d8-ae1202dac233 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:43.590180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42dfc16e-c4c0-474b-b1d8-ae1202dac233 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:43.591635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42dfc16e-c4c0-474b-b1d8-ae1202dac233 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:43.593289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42dfc16e-c4c0-474b-b1d8-ae1202dac233 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:43.604782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-79997b02-13e7-42df-8be5-027292f859c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:43.606308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42dfc16e-c4c0-474b-b1d8-ae1202dac233 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:43.606308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42dfc16e-c4c0-474b-b1d8-ae1202dac233 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:43.625571 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-79997b02-13e7-42df-8be5-027292f859c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 1.567669 Aug 27 02:38:43.629073 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 950/2112] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:42 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:43.653509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-42dfc16e-c4c0-474b-b1d8-ae1202dac233 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:38:43.792027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:43.793039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:43.813714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:43.816470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:43.818072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:43.820649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:43.821325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:43.823236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:43.850538 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-42dfc16e-c4c0-474b-b1d8-ae1202dac233 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "DELETE /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 204 len: 0 microversion: 2.1 time: 0.281334 Aug 27 02:38:43.856560 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1163/2113] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:38:43 2022] DELETE /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:38:43.874219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9747d1d7-0125-401a-a081-fc25aee9580b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:43.875148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9747d1d7-0125-401a-a081-fc25aee9580b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:43.897370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9747d1d7-0125-401a-a081-fc25aee9580b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:43.898550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9747d1d7-0125-401a-a081-fc25aee9580b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:43.899230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9747d1d7-0125-401a-a081-fc25aee9580b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:43.909086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9747d1d7-0125-401a-a081-fc25aee9580b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:43.913762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9747d1d7-0125-401a-a081-fc25aee9580b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:43.915221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9747d1d7-0125-401a-a081-fc25aee9580b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:44.317610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:44.330784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:44.337187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:44.338541 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e80bdb05-c8ef-454f-86c8-ac37b0708cf9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1718 microversion: 2.20 time: 0.551656 Aug 27 02:38:44.345950 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 951/2114] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:43 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1718 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:38:44.417465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9747d1d7-0125-401a-a081-fc25aee9580b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:44.441413 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9747d1d7-0125-401a-a081-fc25aee9580b tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1485 microversion: 2.1 time: 0.582744 Aug 27 02:38:44.443198 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1164/2115] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:43 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1485 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:44.634801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:44.635882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:44.654678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aba2c12e-7527-4c80-96e8-3cab3cd16b31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:44.655927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aba2c12e-7527-4c80-96e8-3cab3cd16b31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:44.658878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:44.660009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:44.661081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:44.662322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:44.663078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:44.663754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:44.674639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aba2c12e-7527-4c80-96e8-3cab3cd16b31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:44.676485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aba2c12e-7527-4c80-96e8-3cab3cd16b31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:44.677361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aba2c12e-7527-4c80-96e8-3cab3cd16b31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:44.680160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aba2c12e-7527-4c80-96e8-3cab3cd16b31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:44.680955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aba2c12e-7527-4c80-96e8-3cab3cd16b31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:44.681690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aba2c12e-7527-4c80-96e8-3cab3cd16b31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:45.305661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aba2c12e-7527-4c80-96e8-3cab3cd16b31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:45.327837 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aba2c12e-7527-4c80-96e8-3cab3cd16b31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 0.676439 Aug 27 02:38:45.336351 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1165/2116] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:44 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:45.411315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:45.417870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:45.448477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:45.450098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:45.451517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:45.453841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:45.455562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:45.457126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:45.743029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:45.783620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:45.788428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:45.794088 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-525c36fa-59ff-4176-8e31-52b8dc1faace tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 1.180018 Aug 27 02:38:45.794747 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 952/2117] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:44 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:45.801818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7ebc6c0-2d77-471a-8bd1-203f6effd57e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:45.810516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b7ebc6c0-2d77-471a-8bd1-203f6effd57e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:45.823691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ebc6c0-2d77-471a-8bd1-203f6effd57e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:45.824475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ebc6c0-2d77-471a-8bd1-203f6effd57e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:45.825080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ebc6c0-2d77-471a-8bd1-203f6effd57e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:45.826016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ebc6c0-2d77-471a-8bd1-203f6effd57e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:45.829061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ebc6c0-2d77-471a-8bd1-203f6effd57e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:45.829992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ebc6c0-2d77-471a-8bd1-203f6effd57e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:46.187395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:46.201865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:46.203513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:46.212809 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f2939f66-1efd-4e43-b1e7-4f2192716808 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1718 microversion: 2.20 time: 0.826619 Aug 27 02:38:46.213504 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1166/2118] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:45 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1718 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:38:46.557644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7ebc6c0-2d77-471a-8bd1-203f6effd57e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:46.586846 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7ebc6c0-2d77-471a-8bd1-203f6effd57e tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1485 microversion: 2.1 time: 0.780579 Aug 27 02:38:46.596834 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 953/2119] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:45 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1485 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:46.621517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e4a4fbd-26cb-473d-a08f-049ef0bec50b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:46.623883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e4a4fbd-26cb-473d-a08f-049ef0bec50b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:46.633326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4a4fbd-26cb-473d-a08f-049ef0bec50b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:46.634178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4a4fbd-26cb-473d-a08f-049ef0bec50b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:46.634898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4a4fbd-26cb-473d-a08f-049ef0bec50b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:46.635925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4a4fbd-26cb-473d-a08f-049ef0bec50b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:46.638708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4a4fbd-26cb-473d-a08f-049ef0bec50b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:46.639538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e4a4fbd-26cb-473d-a08f-049ef0bec50b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:46.804906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1063244088", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:46.956144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] validate_networks() for [('c124adb8-f4b7-493d-8ee4-35c76bbd1a0a', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:38:47.128083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6e4a4fbd-26cb-473d-a08f-049ef0bec50b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:47.141868 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e4a4fbd-26cb-473d-a08f-049ef0bec50b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 0.527968 Aug 27 02:38:47.146206 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 954/2120] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:46 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:47.166925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:47.170399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:47.195438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:47.197397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:47.198299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:47.201536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:47.204322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:47.208213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:48.623651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:48.646017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:48.658661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:48.659955 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-80f88b03-260d-4bb2-9693-1612b327475c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1813 microversion: 2.25 time: 1.509958 Aug 27 02:38:48.660578 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 955/2121] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:47 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1813 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:48.695013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:48.701750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:48.733528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:48.740239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:48.747440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:48.754414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:48.756795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:48.760132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:49.242634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:38:49.243188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:38:49.243530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:38:49.243949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:38:49.244377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:38:49.285884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:49.286515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:49.286983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:49.287824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:49.288303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:49.293302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:49.379193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Getting quotas for project 956a66be18bb4f9e996c8e16bcf23bab. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:38:49.410795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Getting quotas for user 51b3d953421c409c9edd54287dcd11db and project 956a66be18bb4f9e996c8e16bcf23bab. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:38:49.478188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:38:49.480660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:38:49.524056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:49.533712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:49.553838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:49.555222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fb131b17-eb8a-4a38-b22a-5a9724ce56cb tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1661 microversion: 2.20 time: 0.887243 Aug 27 02:38:49.555812 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 956/2122] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:48 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1661 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:49.571092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-99646aaf-4a81-42a0-a0ed-3a22edaf3cd5 req-faf7311a-656f-458f-84c2-2789bd21861e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893e335c-913a-479a-9ee8-f61fc9a3b36f", "name": "network-vif-unplugged", "status": "completed", "tag": "e392649a-1f13-4247-832b-e0b1080e8799"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:49.611917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99646aaf-4a81-42a0-a0ed-3a22edaf3cd5 req-faf7311a-656f-458f-84c2-2789bd21861e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:49.612676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99646aaf-4a81-42a0-a0ed-3a22edaf3cd5 req-faf7311a-656f-458f-84c2-2789bd21861e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:49.613192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99646aaf-4a81-42a0-a0ed-3a22edaf3cd5 req-faf7311a-656f-458f-84c2-2789bd21861e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:49.649465 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-32865fb6-d31e-4297-a84e-cbc577603d8d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.434309 Aug 27 02:38:49.656694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.compute.server_external_events [req-99646aaf-4a81-42a0-a0ed-3a22edaf3cd5 req-faf7311a-656f-458f-84c2-2789bd21861e service nova] Unable to find a host for instance 893e335c-913a-479a-9ee8-f61fc9a3b36f. Dropping event network-vif-unplugged {{(pid=122487) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 02:38:49.658497 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1167/2123] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:38:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 3444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:38:49.673446 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-99646aaf-4a81-42a0-a0ed-3a22edaf3cd5 req-faf7311a-656f-458f-84c2-2789bd21861e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.116471 Aug 27 02:38:49.679429 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 957/2124] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 123 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 02:38:49.689823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:49.690508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:49.696348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4b168f3-664e-425d-8cf4-78b8e49dc22d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:49.696975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c4b168f3-664e-425d-8cf4-78b8e49dc22d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:49.719141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:49.719667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:49.720137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:49.721600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:49.722113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:49.722551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:49.732631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4b168f3-664e-425d-8cf4-78b8e49dc22d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:49.733135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4b168f3-664e-425d-8cf4-78b8e49dc22d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:49.733704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4b168f3-664e-425d-8cf4-78b8e49dc22d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:49.734539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4b168f3-664e-425d-8cf4-78b8e49dc22d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:49.734846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4b168f3-664e-425d-8cf4-78b8e49dc22d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:49.735282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4b168f3-664e-425d-8cf4-78b8e49dc22d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:49.881940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:49.882700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:49.883330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:49.884043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lazy-loading 'fault' on Instance uuid 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:38:50.022779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:50.038620 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-abd185c1-7450-439e-9483-50772b5b9f28 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 200 len: 1301 microversion: 2.1 time: 0.378818 Aug 27 02:38:50.039384 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1168/2125] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:49 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 1301 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:50.051469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d2a0490f-0dae-4d44-bf5a-10fd4309b7ac req-ea0993f1-40ee-44ba-bcee-24818dd54ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25161bd4-cc08-4aae-8a4b-6a501eaa3d7d", "name": "network-vif-deleted", "tag": "a7bd8a59-071f-47e1-94ec-019129f9078d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:50.087232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d2a0490f-0dae-4d44-bf5a-10fd4309b7ac req-ea0993f1-40ee-44ba-bcee-24818dd54ef2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:50.091097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d2a0490f-0dae-4d44-bf5a-10fd4309b7ac req-ea0993f1-40ee-44ba-bcee-24818dd54ef2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:50.092814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d2a0490f-0dae-4d44-bf5a-10fd4309b7ac req-ea0993f1-40ee-44ba-bcee-24818dd54ef2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:50.124334 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d2a0490f-0dae-4d44-bf5a-10fd4309b7ac req-ea0993f1-40ee-44ba-bcee-24818dd54ef2 service nova] Creating event network-vif-deleted:a7bd8a59-071f-47e1-94ec-019129f9078d for instance 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d on n-h1-852084-5 Aug 27 02:38:50.135613 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d2a0490f-0dae-4d44-bf5a-10fd4309b7ac req-ea0993f1-40ee-44ba-bcee-24818dd54ef2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094704 Aug 27 02:38:50.136340 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1169/2126] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:50.162005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-23c75d46-8343-4d39-ae4f-0cded043711d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Action: 'create', calling method: .version_select at 0x7f4d294c7f70>, body: {"keypair": {"name": "tempest-keypair-572989349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW1if1nSPqV4inTaDlFyqyuekpvhaeHWaeWU+QLmb0Q08nI7H1wShoqS8p4nLsUPwd5NDJCMHD2UCNNYftify/tcjsw+zzw0hvlQXYFakXxQ/OzXGQdJ0v6zdaz4VI+ig=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:50.202702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-23c75d46-8343-4d39-ae4f-0cded043711d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Getting quotas for project 38241ddbb3324f4db5a3c6bbdd46cc5f. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:38:50.204593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:50.212090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-23c75d46-8343-4d39-ae4f-0cded043711d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Getting quotas for user 6cf1a7e187724affa4066f06ad8a908f and project 38241ddbb3324f4db5a3c6bbdd46cc5f. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:38:50.256284 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-23c75d46-8343-4d39-ae4f-0cded043711d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.118562 Aug 27 02:38:50.257887 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1170/2127] 10.222.0.99 () {62 vars in 1200 bytes} [Sat Aug 27 02:38:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:38:50.271584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8335cf7f-96d3-452a-9c7a-fde2fd654f63 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de19cc58-a912-4bf3-91ff-364538d94f47"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:50.276476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8335cf7f-96d3-452a-9c7a-fde2fd654f63 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:50.296120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8335cf7f-96d3-452a-9c7a-fde2fd654f63 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:50.297021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8335cf7f-96d3-452a-9c7a-fde2fd654f63 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:50.297872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8335cf7f-96d3-452a-9c7a-fde2fd654f63 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:50.299656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8335cf7f-96d3-452a-9c7a-fde2fd654f63 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:50.300984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8335cf7f-96d3-452a-9c7a-fde2fd654f63 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:50.302430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8335cf7f-96d3-452a-9c7a-fde2fd654f63 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:50.369411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c4b168f3-664e-425d-8cf4-78b8e49dc22d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:50.394734 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c4b168f3-664e-425d-8cf4-78b8e49dc22d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 0.710820 Aug 27 02:38:50.396273 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 958/2128] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:49 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:50.404748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f94987c9-8ea4-4bff-a6fc-5c53f6d78912 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:50.405871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f94987c9-8ea4-4bff-a6fc-5c53f6d78912 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:50.707914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f94987c9-8ea4-4bff-a6fc-5c53f6d78912 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:50.742886 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f94987c9-8ea4-4bff-a6fc-5c53f6d78912 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1222 microversion: 2.1 time: 0.344474 Aug 27 02:38:50.791887 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 959/2129] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:50 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1222 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:50.813193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:50.817376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:50.832711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:50.833219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:50.833732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:50.836301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:50.837042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:50.837870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:51.184527 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8335cf7f-96d3-452a-9c7a-fde2fd654f63 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "POST /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.921294 Aug 27 02:38:51.185203 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1171/2130] 10.222.0.99 () {62 vars in 1364 bytes} [Sat Aug 27 02:38:50 2022] POST /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments => generated 188 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:38:51.589902 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f7356c0-2eab-4434-9e2e-a5edc162ff1f tempest-TenantUsagesNegativeTestJSON-262084650 tempest-TenantUsagesNegativeTestJSON-262084650-project-admin] 10.222.0.99 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T02%3A38%3A49.810642&end=2022-08-28T02%3A38%3A49.810642" status: 404 len: 112 microversion: - time: 0.403392 Aug 27 02:38:51.600115 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1172/2131] 10.222.0.99 () {58 vars in 1316 bytes} [Sat Aug 27 02:38:51 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-26T02%3A38%3A49.810642&end=2022-08-28T02%3A38%3A49.810642 => generated 112 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 02:38:51.616344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:51.617617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:51.628940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:51.629771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:51.630755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:51.631815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:51.632653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:51.633324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:51.652874 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] HTTP exception thrown: Instance 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d could not be found. Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Request method failure captured: Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d HTTP/1.1 Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYGW4il2K9idfy6FW7Qr0Eh1KIt0CCEoaOXQJtmj-oYJ_UX6GqXdVm96pYEaMgxFTMcTSTYpbnUDaAV_ZUi1ge6yInSdWgfsuWHHABkfx-9e56RVG0EfLBptAWCajqyGi_q6VefbBbsTuYpy61Fo5bP9OsFivNIZYuNr5EayLx4B01Y Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c2ea38ee044d41d3a6ede6ab4806621d Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-LiveMigrationTest-164122363 Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c2ea38ee044d41d3a6ede6ab4806621d"}]}] Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-LiveMigrationTest-164122363 Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c2ea38ee044d41d3a6ede6ab4806621d Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-LiveMigrationTest-164122363 Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-LiveMigrationTest-164122363-project Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 6dbc0e90bbe94ce49ae09d2408a382c7 Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-LiveMigrationTest-164122363-project Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d could not be found. Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '25161bd4-cc08-4aae-8a4b-6a501eaa3d7d'} Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d could not be found. Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d could not be found. Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:51.655088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:51.659294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:51.659294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:51.659294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:51.659294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:38:51.659294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:38:51.659294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d could not be found. Aug 27 02:38:51.659294 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:51.661828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Returning 404 to user: Instance 25161bd4-cc08-4aae-8a4b-6a501eaa3d7d could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:51.663152 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-814c430b-3c4b-4bb7-af43-95434bab8fd8 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d" status: 404 len: 111 microversion: 2.1 time: 0.061251 Aug 27 02:38:51.664298 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1173/2132] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:51 2022] GET /compute/v2.1/servers/25161bd4-cc08-4aae-8a4b-6a501eaa3d7d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:38:51.670093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1499577481", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:51.770737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] validate_networks() for [('c124adb8-f4b7-493d-8ee4-35c76bbd1a0a', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:38:51.804435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:51.817840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:51.819500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:51.835518 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7f4087e1-3755-45b9-acdf-dd4635efe6a7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1803 microversion: 2.25 time: 1.040287 Aug 27 02:38:51.838569 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 960/2133] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:50 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1803 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:51.851370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-37d33a44-b11f-44bb-96c5-1518626eb0ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:51.852101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-37d33a44-b11f-44bb-96c5-1518626eb0ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:51.880949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37d33a44-b11f-44bb-96c5-1518626eb0ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:51.881447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37d33a44-b11f-44bb-96c5-1518626eb0ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:51.881921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37d33a44-b11f-44bb-96c5-1518626eb0ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:51.882872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37d33a44-b11f-44bb-96c5-1518626eb0ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:51.886254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37d33a44-b11f-44bb-96c5-1518626eb0ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:51.888005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37d33a44-b11f-44bb-96c5-1518626eb0ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:52.115321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-37d33a44-b11f-44bb-96c5-1518626eb0ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:52.125475 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-37d33a44-b11f-44bb-96c5-1518626eb0ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 0.285445 Aug 27 02:38:52.127733 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 961/2134] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:51 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:52.133768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5d7164b6-7cae-45a2-a8f6-2a9ff983eadf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:52.134678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5d7164b6-7cae-45a2-a8f6-2a9ff983eadf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:52.143270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d7164b6-7cae-45a2-a8f6-2a9ff983eadf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:52.144070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d7164b6-7cae-45a2-a8f6-2a9ff983eadf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:52.144748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d7164b6-7cae-45a2-a8f6-2a9ff983eadf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:52.145721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d7164b6-7cae-45a2-a8f6-2a9ff983eadf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:52.146563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d7164b6-7cae-45a2-a8f6-2a9ff983eadf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:52.147190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d7164b6-7cae-45a2-a8f6-2a9ff983eadf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:52.271513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5d7164b6-7cae-45a2-a8f6-2a9ff983eadf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122487) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 02:38:52.378342 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5d7164b6-7cae-45a2-a8f6-2a9ff983eadf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "POST /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/action" status: 202 len: 0 microversion: 2.20 time: 0.249047 Aug 27 02:38:52.379660 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 962/2135] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:38:52 2022] POST /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:38:52.390009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-feb0a29b-d8f2-43c3-898c-76ca739f2d40 tempest-TenantUsagesNegativeTestJSON-262084650 tempest-TenantUsagesNegativeTestJSON-262084650-project-admin] Calling method '.version_select at 0x7f4d29c08ee0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:52.401249 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-feb0a29b-d8f2-43c3-898c-76ca739f2d40 tempest-TenantUsagesNegativeTestJSON-262084650 tempest-TenantUsagesNegativeTestJSON-262084650-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-feb0a29b-d8f2-43c3-898c-76ca739f2d40 tempest-TenantUsagesNegativeTestJSON-262084650 tempest-TenantUsagesNegativeTestJSON-262084650-project-admin] Request method failure captured: Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-simple-tenant-usage/59a11da547364d8eaf2d43df137d99a0?start=2022-08-28T02%3A38%3A49.810642&end=2022-08-26T02%3A38%3A49.810642 HTTP/1.1 Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYO5S9p0rSuv3_ofIOJMh4Q8-hrBpe_HA078gXQvbrfivWv27dGcTty7klkGI4-JGVK06yMjPIRPcEwvOZYfMyBSeDTU5QDKSYndJP1TL2Tqb6BDSWNeincwHHE7VoxSurjHVbXhxaP-kd2XrAcE1OcYsoyh1DuO2IiFmFeiuCN3qkE Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 4a13b770b18b4358a7b99b7ad6759ba8 Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-262084650 Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4a13b770b18b4358a7b99b7ad6759ba8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4a13b770b18b4358a7b99b7ad6759ba8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4a13b770b18b4358a7b99b7ad6759ba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4a13b770b18b4358a7b99b7ad6759ba8"}]}] Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-262084650 Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 4a13b770b18b4358a7b99b7ad6759ba8 Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-262084650 Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TenantUsagesNegativeTestJSON-262084650-project-admin Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ddbea5175d38470892e6e0fcf56518b5 Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-262084650-project-admin Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid start time. The start time cannot occur after the end time. Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '59a11da547364d8eaf2d43df137d99a0'} Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 27 02:38:52.409332 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:52.413007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-feb0a29b-d8f2-43c3-898c-76ca739f2d40 tempest-TenantUsagesNegativeTestJSON-262084650 tempest-TenantUsagesNegativeTestJSON-262084650-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:52.416206 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-feb0a29b-d8f2-43c3-898c-76ca739f2d40 tempest-TenantUsagesNegativeTestJSON-262084650 tempest-TenantUsagesNegativeTestJSON-262084650-project-admin] 10.222.0.99 "GET /compute/v2.1/os-simple-tenant-usage/59a11da547364d8eaf2d43df137d99a0?start=2022-08-28T02%3A38%3A49.810642&end=2022-08-26T02%3A38%3A49.810642" status: 400 len: 111 microversion: 2.1 time: 0.034030 Aug 27 02:38:52.428881 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 963/2136] 10.222.0.99 () {58 vars in 1412 bytes} [Sat Aug 27 02:38:52 2022] GET /compute/v2.1/os-simple-tenant-usage/59a11da547364d8eaf2d43df137d99a0?start=2022-08-28T02%3A38%3A49.810642&end=2022-08-26T02%3A38%3A49.810642 => generated 111 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:38:52.442838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d6ae0f7e-4034-48e7-bf9d-7774ef600ff6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:52.443888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d6ae0f7e-4034-48e7-bf9d-7774ef600ff6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:52.454398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ae0f7e-4034-48e7-bf9d-7774ef600ff6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:52.455331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ae0f7e-4034-48e7-bf9d-7774ef600ff6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:52.456274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ae0f7e-4034-48e7-bf9d-7774ef600ff6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:52.457163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ae0f7e-4034-48e7-bf9d-7774ef600ff6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:52.458314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ae0f7e-4034-48e7-bf9d-7774ef600ff6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:52.459138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ae0f7e-4034-48e7-bf9d-7774ef600ff6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:52.493710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d6ae0f7e-4034-48e7-bf9d-7774ef600ff6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:38:52.556071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:52.630049 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d6ae0f7e-4034-48e7-bf9d-7774ef600ff6 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 204 len: 0 microversion: 2.1 time: 0.198693 Aug 27 02:38:52.631011 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 964/2137] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:38:52 2022] DELETE /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:38:52.637843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b54eedc6-43ea-4374-932e-033f94f66b97 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '.version_select at 0x7f4d29be15e0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:52.641784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b54eedc6-43ea-4374-932e-033f94f66b97 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:52.642374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b54eedc6-43ea-4374-932e-033f94f66b97 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:52.642826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b54eedc6-43ea-4374-932e-033f94f66b97 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:52.653273 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b54eedc6-43ea-4374-932e-033f94f66b97 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-migrations" status: 200 len: 1697 microversion: 2.25 time: 0.021260 Aug 27 02:38:52.653941 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 965/2138] 10.222.0.99 () {60 vars in 1184 bytes} [Sat Aug 27 02:38:52 2022] GET /compute/v2.1/os-migrations => generated 1697 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:52.661661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0d27b928-bec6-4806-8d6a-93b6120d625f req-b3a7b696-be1a-43d1-861f-e65b351aade7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "443b356d-208a-4c5d-8456-b483041b9e8d", "name": "network-vif-plugged", "status": "completed", "tag": "345eeb5c-ae6d-40de-8f6e-9fb948322417"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:52.676336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0d27b928-bec6-4806-8d6a-93b6120d625f req-b3a7b696-be1a-43d1-861f-e65b351aade7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:52.677003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0d27b928-bec6-4806-8d6a-93b6120d625f req-b3a7b696-be1a-43d1-861f-e65b351aade7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:52.677263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0d27b928-bec6-4806-8d6a-93b6120d625f req-b3a7b696-be1a-43d1-861f-e65b351aade7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:52.689851 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0d27b928-bec6-4806-8d6a-93b6120d625f req-b3a7b696-be1a-43d1-861f-e65b351aade7 service nova] Creating event network-vif-plugged:345eeb5c-ae6d-40de-8f6e-9fb948322417 for instance 443b356d-208a-4c5d-8456-b483041b9e8d on n-h1-852084-5 Aug 27 02:38:52.695175 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0d27b928-bec6-4806-8d6a-93b6120d625f req-b3a7b696-be1a-43d1-861f-e65b351aade7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039984 Aug 27 02:38:52.695761 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 966/2139] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:52.701481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:52.702197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:52.709522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:52.710073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:52.710693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:52.711429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:52.711888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:52.712338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:52.898035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:52.907539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:52.909533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:52.910872 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ea80db8f-6a9a-4fc3-afe3-184ff8f0b3dc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1747 microversion: 2.20 time: 0.213860 Aug 27 02:38:52.911455 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 967/2140] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:52 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1747 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:53.072131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd3645d8-502b-4caa-9be1-0891dbf8d29b tempest-TenantUsagesNegativeTestJSON-158839592 tempest-TenantUsagesNegativeTestJSON-158839592-project] Calling method '.version_select at 0x7f4d29b6f700>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:53.076347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd3645d8-502b-4caa-9be1-0891dbf8d29b tempest-TenantUsagesNegativeTestJSON-158839592 tempest-TenantUsagesNegativeTestJSON-158839592-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '6c01f49184fc46a3a0e2afb187f0e22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59a11da547364d8eaf2d43df137d99a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd3645d8-502b-4caa-9be1-0891dbf8d29b tempest-TenantUsagesNegativeTestJSON-158839592 tempest-TenantUsagesNegativeTestJSON-158839592-project] Request method failure captured: Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T02%3A38%3A49.810642&end=2022-08-28T02%3A38%3A49.810642&detailed=1 HTTP/1.1 Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYO3WLNMXdwDEF5_ZUi9CLlkeMfqSt9dGu18pKkMos5szdBzfvRvaSbsMEVQ0fXQUCQ5bF_oyBMU08F_ArJc6pVHbJxgV2uHyKJTMv1SNWLEFSu-Tl-8js7vuqd56wnfHLMCS5_clk0lihtB4xWdBe3RoQR4YBnSBJ6_wa11TllVj6Y Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 59a11da547364d8eaf2d43df137d99a0 Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-158839592 Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_59a11da547364d8eaf2d43df137d99a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/59a11da547364d8eaf2d43df137d99a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/59a11da547364d8eaf2d43df137d99a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/59a11da547364d8eaf2d43df137d99a0"}]}] Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-158839592 Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 59a11da547364d8eaf2d43df137d99a0 Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-158839592 Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TenantUsagesNegativeTestJSON-158839592-project Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 6c01f49184fc46a3a0e2afb187f0e22f Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-158839592-project Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: action_args: {} Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:38:53.078364 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:38:53.083264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 02:38:53.083264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:53.083264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:53.083264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:53.083264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:53.083264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:53.083264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:53.083264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:38:53.083264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:38:53.083264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 27 02:38:53.083264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:38:53.086445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd3645d8-502b-4caa-9be1-0891dbf8d29b tempest-TenantUsagesNegativeTestJSON-158839592 tempest-TenantUsagesNegativeTestJSON-158839592-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:53.087722 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd3645d8-502b-4caa-9be1-0891dbf8d29b tempest-TenantUsagesNegativeTestJSON-158839592 tempest-TenantUsagesNegativeTestJSON-158839592-project] 10.222.0.99 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T02%3A38%3A49.810642&end=2022-08-28T02%3A38%3A49.810642&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.171106 Aug 27 02:38:53.088947 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 968/2141] 10.222.0.99 () {58 vars in 1335 bytes} [Sat Aug 27 02:38:52 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T02%3A38%3A49.810642&end=2022-08-28T02%3A38%3A49.810642&detailed=1 => generated 123 bytes in 173 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:38:53.112022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f688f0b0-c849-40f8-95bb-b40dff69884f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:53.115022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f688f0b0-c849-40f8-95bb-b40dff69884f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:53.405875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f688f0b0-c849-40f8-95bb-b40dff69884f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:53.406845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f688f0b0-c849-40f8-95bb-b40dff69884f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:53.407515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f688f0b0-c849-40f8-95bb-b40dff69884f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:53.408530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f688f0b0-c849-40f8-95bb-b40dff69884f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:53.409269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f688f0b0-c849-40f8-95bb-b40dff69884f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:53.409963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f688f0b0-c849-40f8-95bb-b40dff69884f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:53.744561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f688f0b0-c849-40f8-95bb-b40dff69884f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:53.786152 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f688f0b0-c849-40f8-95bb-b40dff69884f tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1500 microversion: 2.1 time: 0.693833 Aug 27 02:38:53.788392 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 969/2142] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:53 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1500 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:53.803378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-14e47b9c-48f0-4768-b512-930b3213e95f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:53.806154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-14e47b9c-48f0-4768-b512-930b3213e95f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:53.836468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14e47b9c-48f0-4768-b512-930b3213e95f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:53.837106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14e47b9c-48f0-4768-b512-930b3213e95f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:53.837576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14e47b9c-48f0-4768-b512-930b3213e95f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:53.838846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14e47b9c-48f0-4768-b512-930b3213e95f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:53.839561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14e47b9c-48f0-4768-b512-930b3213e95f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:53.840004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14e47b9c-48f0-4768-b512-930b3213e95f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:54.156531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-14e47b9c-48f0-4768-b512-930b3213e95f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:38:54.190101 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-14e47b9c-48f0-4768-b512-930b3213e95f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 2422 microversion: 2.25 time: 0.399179 Aug 27 02:38:54.192244 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 970/2143] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:53 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 2422 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:54.202326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-62978a29-bf43-42af-a592-e59733ee2bfb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:54.203829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-62978a29-bf43-42af-a592-e59733ee2bfb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:54.218419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62978a29-bf43-42af-a592-e59733ee2bfb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:54.219572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62978a29-bf43-42af-a592-e59733ee2bfb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:54.221036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62978a29-bf43-42af-a592-e59733ee2bfb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:54.222521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62978a29-bf43-42af-a592-e59733ee2bfb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:54.223494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62978a29-bf43-42af-a592-e59733ee2bfb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:54.224384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62978a29-bf43-42af-a592-e59733ee2bfb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:54.540862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-62978a29-bf43-42af-a592-e59733ee2bfb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:54.552028 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-62978a29-bf43-42af-a592-e59733ee2bfb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1315 microversion: 2.1 time: 0.357825 Aug 27 02:38:54.552798 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 971/2144] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:54 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:54.561973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:54.563149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:54.574839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:54.578809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:54.580588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:54.582492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:54.583751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:54.584905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:54.662687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:38:54.688884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:38:54.689750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:38:54.690255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:38:54.690885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:38:54.732160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:54.733936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:54.735360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:54.737524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:54.738644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:54.739841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:54.776614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Getting quotas for project 956a66be18bb4f9e996c8e16bcf23bab. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:38:54.796659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Getting quotas for user 51b3d953421c409c9edd54287dcd11db and project 956a66be18bb4f9e996c8e16bcf23bab. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:38:54.829137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:38:54.834301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:38:54.884015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:54.901500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:54.902997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:54.904635 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-241b222a-52b5-43f2-8bcc-ba553d8181ab tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1749 microversion: 2.20 time: 0.350442 Aug 27 02:38:54.907103 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 972/2145] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:54 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1749 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:54.935703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6866099e-22a1-4b6c-bf03-4c1abf5c5667 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:54.938111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6866099e-22a1-4b6c-bf03-4c1abf5c5667 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:54.957062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6866099e-22a1-4b6c-bf03-4c1abf5c5667 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:54.957909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6866099e-22a1-4b6c-bf03-4c1abf5c5667 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:54.958375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6866099e-22a1-4b6c-bf03-4c1abf5c5667 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:54.962360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6866099e-22a1-4b6c-bf03-4c1abf5c5667 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:54.963136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6866099e-22a1-4b6c-bf03-4c1abf5c5667 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:54.963597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6866099e-22a1-4b6c-bf03-4c1abf5c5667 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:55.039186 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f0e45af5-67d6-46b2-8c35-b12002e2145c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.373296 Aug 27 02:38:55.039853 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1174/2146] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:38:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 3375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:38:55.057584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a1045c2b-2710-4f83-b446-55fc28b0f959 req-59884eb8-ff03-4ff2-97e3-7d462ecccbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a0d3c43-6a69-49d1-8e43-494b70e6b635", "name": "network-vif-deleted", "tag": "ff877ceb-42f3-4570-8d29-21cefdf8c147"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:55.095880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a1045c2b-2710-4f83-b446-55fc28b0f959 req-59884eb8-ff03-4ff2-97e3-7d462ecccbf1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:55.096940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a1045c2b-2710-4f83-b446-55fc28b0f959 req-59884eb8-ff03-4ff2-97e3-7d462ecccbf1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:55.097395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a1045c2b-2710-4f83-b446-55fc28b0f959 req-59884eb8-ff03-4ff2-97e3-7d462ecccbf1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:55.136859 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a1045c2b-2710-4f83-b446-55fc28b0f959 req-59884eb8-ff03-4ff2-97e3-7d462ecccbf1 service nova] Creating event network-vif-deleted:ff877ceb-42f3-4570-8d29-21cefdf8c147 for instance 9a0d3c43-6a69-49d1-8e43-494b70e6b635 on n-h1-852084-5 Aug 27 02:38:55.159483 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a1045c2b-2710-4f83-b446-55fc28b0f959 req-59884eb8-ff03-4ff2-97e3-7d462ecccbf1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117784 Aug 27 02:38:55.160878 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1175/2147] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:38:55.172786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:55.175751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:55.191073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:55.191640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:55.194215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:55.196012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:55.197134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:55.198237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:55.305503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-6866099e-22a1-4b6c-bf03-4c1abf5c5667 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:38:55.333988 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6866099e-22a1-4b6c-bf03-4c1abf5c5667 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 2422 microversion: 2.25 time: 0.424983 Aug 27 02:38:55.335422 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 973/2148] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:54 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 2422 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:55.346538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-697ed371-e224-4bcf-9bc5-3de47c22a5f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:55.350116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-697ed371-e224-4bcf-9bc5-3de47c22a5f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:55.384717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:55.386964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:55.388586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:55.390298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lazy-loading 'fault' on Instance uuid 9a0d3c43-6a69-49d1-8e43-494b70e6b635 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:38:55.526174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-697ed371-e224-4bcf-9bc5-3de47c22a5f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:55.578932 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-697ed371-e224-4bcf-9bc5-3de47c22a5f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1222 microversion: 2.1 time: 0.240815 Aug 27 02:38:55.584578 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 974/2149] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:55 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1222 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:55.615189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4f123ae-fc52-47ac-8fcd-4fc9b1f52720 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:55.615840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c4f123ae-fc52-47ac-8fcd-4fc9b1f52720 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:55.645896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4f123ae-fc52-47ac-8fcd-4fc9b1f52720 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:55.651281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4f123ae-fc52-47ac-8fcd-4fc9b1f52720 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:55.656137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4f123ae-fc52-47ac-8fcd-4fc9b1f52720 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:55.658481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4f123ae-fc52-47ac-8fcd-4fc9b1f52720 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:55.668532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4f123ae-fc52-47ac-8fcd-4fc9b1f52720 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:55.668532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4f123ae-fc52-47ac-8fcd-4fc9b1f52720 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:55.747724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dbc0e90bbe94ce49ae09d2408a382c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ea38ee044d41d3a6ede6ab4806621d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:55.769635 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7d644484-4197-4b33-8a2d-782ff6388035 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 200 len: 1300 microversion: 2.1 time: 0.606009 Aug 27 02:38:55.774448 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1176/2150] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:55 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 1300 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:55.794269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2b427a7-0232-4101-bbe7-c67b32e020ed tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:55.795242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f2b427a7-0232-4101-bbe7-c67b32e020ed tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:55.809846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2b427a7-0232-4101-bbe7-c67b32e020ed tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:55.811877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2b427a7-0232-4101-bbe7-c67b32e020ed tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:55.828874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2b427a7-0232-4101-bbe7-c67b32e020ed tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:55.834974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2b427a7-0232-4101-bbe7-c67b32e020ed tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:55.836348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2b427a7-0232-4101-bbe7-c67b32e020ed tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:55.839692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2b427a7-0232-4101-bbe7-c67b32e020ed tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:56.275841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-f2b427a7-0232-4101-bbe7-c67b32e020ed tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lazy-loading 'services' on Instance uuid 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:38:56.483667 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f2b427a7-0232-4101-bbe7-c67b32e020ed tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "DELETE /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments/54678e77-ca24-4d36-aa3f-3b052ce88a3b" status: 202 len: 0 microversion: 2.25 time: 0.707389 Aug 27 02:38:56.486762 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1177/2151] 10.222.0.99 () {60 vars in 1457 bytes} [Sat Aug 27 02:38:55 2022] DELETE /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments/54678e77-ca24-4d36-aa3f-3b052ce88a3b => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:38:56.501102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:56.504461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:56.521732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:56.524400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:56.525270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:56.527345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:56.532555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:56.533427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:56.795651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c4f123ae-fc52-47ac-8fcd-4fc9b1f52720 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:56.805270 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c4f123ae-fc52-47ac-8fcd-4fc9b1f52720 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1502 microversion: 2.1 time: 1.216364 Aug 27 02:38:56.810878 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 975/2152] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:55 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1502 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:56.819579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1910548816", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "166a2124-9f79-43d8-989e-c9d46946c886"}, {"port": "ea16f397-cede-434b-8c29-fdce0d801498", "tag": "port-1"}, {"port": "fa02d9de-658c-4012-8350-0eb7421c3221", "tag": "port-2"}, {"uuid": "21f1817a-0b21-4be7-a597-507269eb51bc", "tag": "net-1"}, {"uuid": "21f1817a-0b21-4be7-a597-507269eb51bc"}, {"uuid": "0a3a6842-f2d3-490e-8484-cff2e2d26d34", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0a3a6842-f2d3-490e-8484-cff2e2d26d34", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2bc1193d-87a7-42d1-90d3-b50cf4eac456", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "61ebc563-f82d-4a4d-9d28-b0e2615672ab", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "141146b3-2ec1-4440-8511-bcc2143298a5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2011981627"}], "key_name": "tempest-keypair-572989349", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:56.902125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:56.922869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:56.927491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:56.931964 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8e3626c8-b6cf-4009-85bb-25e18edca738 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1749 microversion: 2.20 time: 0.442889 Aug 27 02:38:56.935701 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1178/2153] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:56 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1749 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:56.977254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-060900a5-1738-4cbd-8244-bfe852a5abc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:56.981795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-060900a5-1738-4cbd-8244-bfe852a5abc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:57.009653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-060900a5-1738-4cbd-8244-bfe852a5abc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:57.016661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-060900a5-1738-4cbd-8244-bfe852a5abc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:57.021522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-060900a5-1738-4cbd-8244-bfe852a5abc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:57.022520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-060900a5-1738-4cbd-8244-bfe852a5abc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:57.035364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-060900a5-1738-4cbd-8244-bfe852a5abc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:57.036398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-060900a5-1738-4cbd-8244-bfe852a5abc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:57.076829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=5 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:38:57.094404 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-060900a5-1738-4cbd-8244-bfe852a5abc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.157284 Aug 27 02:38:57.096354 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1179/2154] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:38:56 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:38:57.107756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-36b9af29-0524-4e69-a8fd-bfadec74fbd6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:57.112073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-36b9af29-0524-4e69-a8fd-bfadec74fbd6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:57.130441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36b9af29-0524-4e69-a8fd-bfadec74fbd6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:57.131527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36b9af29-0524-4e69-a8fd-bfadec74fbd6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:57.132671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36b9af29-0524-4e69-a8fd-bfadec74fbd6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:57.134567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36b9af29-0524-4e69-a8fd-bfadec74fbd6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:57.139898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36b9af29-0524-4e69-a8fd-bfadec74fbd6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:57.140537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36b9af29-0524-4e69-a8fd-bfadec74fbd6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:57.265363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] validate_networks() for [('166a2124-9f79-43d8-989e-c9d46946c886', None, None, None, None, None), (None, None, 'ea16f397-cede-434b-8c29-fdce0d801498', None, None, None), (None, None, 'fa02d9de-658c-4012-8350-0eb7421c3221', None, None, None), ('21f1817a-0b21-4be7-a597-507269eb51bc', None, None, None, None, None), ('21f1817a-0b21-4be7-a597-507269eb51bc', None, None, None, None, None), ('0a3a6842-f2d3-490e-8484-cff2e2d26d34', '10.2.2.100', None, None, None, None), ('0a3a6842-f2d3-490e-8484-cff2e2d26d34', '10.2.2.200', None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:38:57.547552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-36b9af29-0524-4e69-a8fd-bfadec74fbd6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:57.561558 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-36b9af29-0524-4e69-a8fd-bfadec74fbd6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1218 microversion: 2.1 time: 0.463759 Aug 27 02:38:57.569388 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1180/2155] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:57 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1218 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:57.583375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:57.590481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] [instance: 9a0d3c43-6a69-49d1-8e43-494b70e6b635] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:57.614717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:57.625522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:57.629925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:57.631620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:57.632365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:57.633533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:57.679863 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] HTTP exception thrown: Instance 9a0d3c43-6a69-49d1-8e43-494b70e6b635 could not be found. Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Request method failure captured: Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 HTTP/1.1 Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYGW4il2K9idfy6FW7Qr0Eh1KIt0CCEoaOXQJtmj-oYJ_UX6GqXdVm96pYEaMgxFTMcTSTYpbnUDaAV_ZUi1ge6yInSdWgfsuWHHABkfx-9e56RVG0EfLBptAWCajqyGi_q6VefbBbsTuYpy61Fo5bP9OsFivNIZYuNr5EayLx4B01Y Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c2ea38ee044d41d3a6ede6ab4806621d Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-LiveMigrationTest-164122363 Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2ea38ee044d41d3a6ede6ab4806621d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c2ea38ee044d41d3a6ede6ab4806621d"}]}] Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-LiveMigrationTest-164122363 Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c2ea38ee044d41d3a6ede6ab4806621d Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-LiveMigrationTest-164122363 Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-LiveMigrationTest-164122363-project Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 6dbc0e90bbe94ce49ae09d2408a382c7 Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-LiveMigrationTest-164122363-project Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 9a0d3c43-6a69-49d1-8e43-494b70e6b635 could not be found. Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '9a0d3c43-6a69-49d1-8e43-494b70e6b635'} Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a0d3c43-6a69-49d1-8e43-494b70e6b635 could not be found. Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a0d3c43-6a69-49d1-8e43-494b70e6b635 could not be found. Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:38:57.684692 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:57.688412 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:38:57.688412 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:38:57.688412 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:38:57.688412 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:38:57.688412 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:38:57.688412 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a0d3c43-6a69-49d1-8e43-494b70e6b635 could not be found. Aug 27 02:38:57.688412 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:38:57.693970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] Returning 404 to user: Instance 9a0d3c43-6a69-49d1-8e43-494b70e6b635 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:38:57.697075 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-22319b78-6f87-44b9-bba9-4a7ffa20bdf3 tempest-LiveMigrationTest-164122363 tempest-LiveMigrationTest-164122363-project] 10.222.0.99 "GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635" status: 404 len: 111 microversion: 2.1 time: 0.126050 Aug 27 02:38:57.698263 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1181/2156] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:57 2022] GET /compute/v2.1/servers/9a0d3c43-6a69-49d1-8e43-494b70e6b635 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:38:57.706774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0b5930bb-63ba-4b4c-9a8d-7a50a6353347 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:38:57.736268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b5930bb-63ba-4b4c-9a8d-7a50a6353347 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:57.739717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b5930bb-63ba-4b4c-9a8d-7a50a6353347 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:57.742086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b5930bb-63ba-4b4c-9a8d-7a50a6353347 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:57.836118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0b5930bb-63ba-4b4c-9a8d-7a50a6353347 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Going to try to stop instance {{(pid=122488) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:38:57.968286 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0b5930bb-63ba-4b4c-9a8d-7a50a6353347 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d/action" status: 202 len: 0 microversion: 2.1 time: 0.264443 Aug 27 02:38:57.977737 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1182/2157] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:38:57 2022] POST /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:38:57.992289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-275eabb0-8809-4503-87be-c755a9906824 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:57.993326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-275eabb0-8809-4503-87be-c755a9906824 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:58.009314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-275eabb0-8809-4503-87be-c755a9906824 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:58.012003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-275eabb0-8809-4503-87be-c755a9906824 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:58.013042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-275eabb0-8809-4503-87be-c755a9906824 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:58.016542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-275eabb0-8809-4503-87be-c755a9906824 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:58.018596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-275eabb0-8809-4503-87be-c755a9906824 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:58.022541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-275eabb0-8809-4503-87be-c755a9906824 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:58.828570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-275eabb0-8809-4503-87be-c755a9906824 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:58.840978 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-275eabb0-8809-4503-87be-c755a9906824 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1512 microversion: 2.1 time: 0.861506 Aug 27 02:38:58.843300 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1183/2158] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:57 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1512 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:58.864631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:58.865091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:58.876715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:58.884989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:58.885505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:58.886544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:58.887208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:58.887807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:59.362779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:59.379451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:59.381318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:59.385736 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3a646ad9-160f-485e-9104-0f6ec4756e78 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1749 microversion: 2.20 time: 0.538677 Aug 27 02:38:59.389359 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1184/2159] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:38:58 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1749 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:38:59.399672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bbd75bed-7b3f-492c-a780-250d7105cff9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:59.405398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bbd75bed-7b3f-492c-a780-250d7105cff9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:59.444126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd75bed-7b3f-492c-a780-250d7105cff9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:59.444716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd75bed-7b3f-492c-a780-250d7105cff9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:59.446475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd75bed-7b3f-492c-a780-250d7105cff9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:59.447281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd75bed-7b3f-492c-a780-250d7105cff9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:59.447779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd75bed-7b3f-492c-a780-250d7105cff9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:59.451562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd75bed-7b3f-492c-a780-250d7105cff9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:59.533154 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bbd75bed-7b3f-492c-a780-250d7105cff9 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.138405 Aug 27 02:38:59.534230 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1185/2160] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:38:59 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:38:59.551901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cd45bad9-e9e7-4e94-b45b-8b506a5e2d9d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:59.552868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cd45bad9-e9e7-4e94-b45b-8b506a5e2d9d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:59.571275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd45bad9-e9e7-4e94-b45b-8b506a5e2d9d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:59.572068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd45bad9-e9e7-4e94-b45b-8b506a5e2d9d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:59.572718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd45bad9-e9e7-4e94-b45b-8b506a5e2d9d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:59.573648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd45bad9-e9e7-4e94-b45b-8b506a5e2d9d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:59.576173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd45bad9-e9e7-4e94-b45b-8b506a5e2d9d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:59.577769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd45bad9-e9e7-4e94-b45b-8b506a5e2d9d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:59.792747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cd45bad9-e9e7-4e94-b45b-8b506a5e2d9d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:38:59.806893 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cd45bad9-e9e7-4e94-b45b-8b506a5e2d9d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1280 microversion: 2.1 time: 0.260006 Aug 27 02:38:59.807775 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1186/2161] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:59 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1280 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:38:59.871634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9eb8833d-26a4-4bad-8436-9638aa88f77b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:38:59.872316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9eb8833d-26a4-4bad-8436-9638aa88f77b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:38:59.883458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eb8833d-26a4-4bad-8436-9638aa88f77b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:59.894091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eb8833d-26a4-4bad-8436-9638aa88f77b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:59.897049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eb8833d-26a4-4bad-8436-9638aa88f77b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:38:59.898132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eb8833d-26a4-4bad-8436-9638aa88f77b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:38:59.902650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eb8833d-26a4-4bad-8436-9638aa88f77b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:38:59.903633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9eb8833d-26a4-4bad-8436-9638aa88f77b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:00.203663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9eb8833d-26a4-4bad-8436-9638aa88f77b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:00.213487 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9eb8833d-26a4-4bad-8436-9638aa88f77b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1512 microversion: 2.1 time: 0.349150 Aug 27 02:39:00.226066 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1187/2162] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:38:59 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:39:00.381570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-29255a88-41e1-4ec4-b650-95978b7b493d req-3d6364cf-307b-4df0-a52e-d7374f878a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f", "tag": "96d739bd-0e58-4047-8369-dc1d8b9f5043"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:00.410777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-29255a88-41e1-4ec4-b650-95978b7b493d req-3d6364cf-307b-4df0-a52e-d7374f878a0e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:00.414496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-29255a88-41e1-4ec4-b650-95978b7b493d req-3d6364cf-307b-4df0-a52e-d7374f878a0e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:00.415228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-29255a88-41e1-4ec4-b650-95978b7b493d req-3d6364cf-307b-4df0-a52e-d7374f878a0e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:00.441947 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-29255a88-41e1-4ec4-b650-95978b7b493d req-3d6364cf-307b-4df0-a52e-d7374f878a0e service nova] Creating event network-changed:96d739bd-0e58-4047-8369-dc1d8b9f5043 for instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f on n-h2-852084-5 Aug 27 02:39:00.457927 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-29255a88-41e1-4ec4-b650-95978b7b493d req-3d6364cf-307b-4df0-a52e-d7374f878a0e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087933 Aug 27 02:39:00.459161 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1188/2163] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:39:00.468447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:00.469599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:00.496360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:00.498866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:00.499831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:00.506723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:00.507229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:00.507686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:00.966093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:00.980427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:00.986033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:00.987674 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6955b17-174e-4cbb-ad59-48197f8a2002 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1749 microversion: 2.20 time: 0.526474 Aug 27 02:39:00.989265 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1189/2164] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:00 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1749 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:00.994359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-54d6ef82-4aa1-4914-b624-b5518837d62f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:01.005167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-54d6ef82-4aa1-4914-b624-b5518837d62f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:01.025714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54d6ef82-4aa1-4914-b624-b5518837d62f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:01.026233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54d6ef82-4aa1-4914-b624-b5518837d62f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:01.027010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54d6ef82-4aa1-4914-b624-b5518837d62f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:01.027758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54d6ef82-4aa1-4914-b624-b5518837d62f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:01.028227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54d6ef82-4aa1-4914-b624-b5518837d62f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:01.028653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54d6ef82-4aa1-4914-b624-b5518837d62f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:01.101579 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-54d6ef82-4aa1-4914-b624-b5518837d62f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111142 Aug 27 02:39:01.102487 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1190/2165] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:39:00 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:39:01.107644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c32d75b-df18-48e1-811f-780aef35420d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:01.114367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5c32d75b-df18-48e1-811f-780aef35420d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:01.137228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c32d75b-df18-48e1-811f-780aef35420d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:01.138522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c32d75b-df18-48e1-811f-780aef35420d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:01.145616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c32d75b-df18-48e1-811f-780aef35420d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:01.148015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c32d75b-df18-48e1-811f-780aef35420d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:01.148709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c32d75b-df18-48e1-811f-780aef35420d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:01.149998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c32d75b-df18-48e1-811f-780aef35420d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:01.290957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5c32d75b-df18-48e1-811f-780aef35420d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:01.306297 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5c32d75b-df18-48e1-811f-780aef35420d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1280 microversion: 2.1 time: 0.201989 Aug 27 02:39:01.324467 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1191/2166] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:01 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1280 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:01.341064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba279f46-3af2-47a2-828b-54805d66e755 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:01.343473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ba279f46-3af2-47a2-828b-54805d66e755 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:01.363594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba279f46-3af2-47a2-828b-54805d66e755 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:01.364202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba279f46-3af2-47a2-828b-54805d66e755 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:01.366002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba279f46-3af2-47a2-828b-54805d66e755 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:01.368089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba279f46-3af2-47a2-828b-54805d66e755 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:01.369852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba279f46-3af2-47a2-828b-54805d66e755 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:01.373832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba279f46-3af2-47a2-828b-54805d66e755 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:01.802175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ba279f46-3af2-47a2-828b-54805d66e755 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:01.813134 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ba279f46-3af2-47a2-828b-54805d66e755 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1512 microversion: 2.1 time: 0.486816 Aug 27 02:39:01.817108 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1192/2167] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:01 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1512 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:02.016516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:02.018382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:02.027252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:02.028060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:02.028849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:02.030445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:02.031556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:02.032920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:02.286461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:02.306094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:02.308452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:02.312300 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-df19f5f5-3295-4a46-96e8-3cf336f22994 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1749 microversion: 2.20 time: 0.299778 Aug 27 02:39:02.315625 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1193/2168] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:02 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1749 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:39:02.338136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ddc74941-af49-41aa-851a-48909f3d1793 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:02.341751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ddc74941-af49-41aa-851a-48909f3d1793 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:02.354612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddc74941-af49-41aa-851a-48909f3d1793 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:02.356838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddc74941-af49-41aa-851a-48909f3d1793 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:02.357774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddc74941-af49-41aa-851a-48909f3d1793 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:02.358849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddc74941-af49-41aa-851a-48909f3d1793 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:02.359947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddc74941-af49-41aa-851a-48909f3d1793 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:02.361636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddc74941-af49-41aa-851a-48909f3d1793 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:02.497871 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ddc74941-af49-41aa-851a-48909f3d1793 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.176446 Aug 27 02:39:02.499163 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1194/2169] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:39:02 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:39:02.514532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-510cd4e9-e370-4afc-990f-bd16793e2ad6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:02.521053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-510cd4e9-e370-4afc-990f-bd16793e2ad6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:02.544935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-510cd4e9-e370-4afc-990f-bd16793e2ad6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:02.558047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-510cd4e9-e370-4afc-990f-bd16793e2ad6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:02.559079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-510cd4e9-e370-4afc-990f-bd16793e2ad6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:02.560835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-510cd4e9-e370-4afc-990f-bd16793e2ad6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:02.561972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-510cd4e9-e370-4afc-990f-bd16793e2ad6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:02.562991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-510cd4e9-e370-4afc-990f-bd16793e2ad6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:02.689596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-510cd4e9-e370-4afc-990f-bd16793e2ad6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:02.700383 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-510cd4e9-e370-4afc-990f-bd16793e2ad6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1280 microversion: 2.1 time: 0.193334 Aug 27 02:39:02.702406 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1195/2170] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:02 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:02.838309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1f9e5ca2-ef51-44cc-8358-7e0da6e00032 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:02.839854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1f9e5ca2-ef51-44cc-8358-7e0da6e00032 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:02.857702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f9e5ca2-ef51-44cc-8358-7e0da6e00032 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:02.858605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f9e5ca2-ef51-44cc-8358-7e0da6e00032 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:02.859409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f9e5ca2-ef51-44cc-8358-7e0da6e00032 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:02.864885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f9e5ca2-ef51-44cc-8358-7e0da6e00032 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:02.873174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f9e5ca2-ef51-44cc-8358-7e0da6e00032 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:02.875480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f9e5ca2-ef51-44cc-8358-7e0da6e00032 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:02.950781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:03.512567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f9e5ca2-ef51-44cc-8358-7e0da6e00032 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:03.523651 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1f9e5ca2-ef51-44cc-8358-7e0da6e00032 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1512 microversion: 2.1 time: 0.689507 Aug 27 02:39:03.524914 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1196/2171] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:02 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1512 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:39:03.531435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:03.532999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:03.542459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:03.543205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:03.543791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:03.544733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:03.545375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:03.546030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:04.279791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:04.326566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:04.336077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:04.342242 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0cd2e561-0bce-48d0-9209-fc3703337df8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1749 microversion: 2.20 time: 0.815617 Aug 27 02:39:04.343551 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1197/2172] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:03 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1749 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:04.367296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f3a82220-6a4f-49f2-895f-fdfab65ffeb3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:04.375403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f3a82220-6a4f-49f2-895f-fdfab65ffeb3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:04.409051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3a82220-6a4f-49f2-895f-fdfab65ffeb3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:04.410307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3a82220-6a4f-49f2-895f-fdfab65ffeb3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:04.411893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3a82220-6a4f-49f2-895f-fdfab65ffeb3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:04.415987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3a82220-6a4f-49f2-895f-fdfab65ffeb3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:04.416891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3a82220-6a4f-49f2-895f-fdfab65ffeb3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:04.417721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3a82220-6a4f-49f2-895f-fdfab65ffeb3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:04.511774 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f3a82220-6a4f-49f2-895f-fdfab65ffeb3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.164523 Aug 27 02:39:04.520076 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1198/2173] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:39:04 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:39:04.524795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff798d52-6763-45a5-9fd5-ad1dea93f40d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:04.527404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ff798d52-6763-45a5-9fd5-ad1dea93f40d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:04.543351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff798d52-6763-45a5-9fd5-ad1dea93f40d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:04.545067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff798d52-6763-45a5-9fd5-ad1dea93f40d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:04.546563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff798d52-6763-45a5-9fd5-ad1dea93f40d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:04.548930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff798d52-6763-45a5-9fd5-ad1dea93f40d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:04.550235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff798d52-6763-45a5-9fd5-ad1dea93f40d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:04.552559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff798d52-6763-45a5-9fd5-ad1dea93f40d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:04.760142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:04.811550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=16 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:05.493089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ff798d52-6763-45a5-9fd5-ad1dea93f40d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:05.504992 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff798d52-6763-45a5-9fd5-ad1dea93f40d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1322 microversion: 2.1 time: 0.989736 Aug 27 02:39:05.509092 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1199/2174] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:04 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1322 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:05.524476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0477c438-0db3-414e-b37f-73fe0daf0d0c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:05.530604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0477c438-0db3-414e-b37f-73fe0daf0d0c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:05.544575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0477c438-0db3-414e-b37f-73fe0daf0d0c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:05.547231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0477c438-0db3-414e-b37f-73fe0daf0d0c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:05.548605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0477c438-0db3-414e-b37f-73fe0daf0d0c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:05.549649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0477c438-0db3-414e-b37f-73fe0daf0d0c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:05.551866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0477c438-0db3-414e-b37f-73fe0daf0d0c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:05.556205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0477c438-0db3-414e-b37f-73fe0daf0d0c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:05.577957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:05.931504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0477c438-0db3-414e-b37f-73fe0daf0d0c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:05.948309 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0477c438-0db3-414e-b37f-73fe0daf0d0c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1512 microversion: 2.1 time: 0.435611 Aug 27 02:39:05.950990 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1200/2175] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:05 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1512 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:05.964916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:05.966005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:05.985059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:05.986692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:05.987989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:05.990310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:05.993123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:05.994139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:06.731842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:06.745830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:06.750102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:06.754202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0d62c409-434c-41c5-99c6-13fb34bcdeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1749 microversion: 2.20 time: 0.797064 Aug 27 02:39:06.767461 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1201/2176] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:05 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1749 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:06.778437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e28e72f8-5666-4007-bfbf-311996feaa75 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:06.784298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e28e72f8-5666-4007-bfbf-311996feaa75 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:06.804081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:06.828368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e28e72f8-5666-4007-bfbf-311996feaa75 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:06.829697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e28e72f8-5666-4007-bfbf-311996feaa75 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:06.831466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e28e72f8-5666-4007-bfbf-311996feaa75 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:06.835061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e28e72f8-5666-4007-bfbf-311996feaa75 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:06.838068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e28e72f8-5666-4007-bfbf-311996feaa75 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:06.845871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e28e72f8-5666-4007-bfbf-311996feaa75 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:07.035877 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e28e72f8-5666-4007-bfbf-311996feaa75 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.259049 Aug 27 02:39:07.042329 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1202/2177] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:39:06 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments => generated 197 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:39:07.049194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bbcfb8a1-c1f0-4cc3-9da8-cae4d0db5274 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:07.053021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bbcfb8a1-c1f0-4cc3-9da8-cae4d0db5274 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:07.066677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbcfb8a1-c1f0-4cc3-9da8-cae4d0db5274 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:07.068742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbcfb8a1-c1f0-4cc3-9da8-cae4d0db5274 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:07.070432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbcfb8a1-c1f0-4cc3-9da8-cae4d0db5274 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:07.071611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbcfb8a1-c1f0-4cc3-9da8-cae4d0db5274 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:07.072416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbcfb8a1-c1f0-4cc3-9da8-cae4d0db5274 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:07.073440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbcfb8a1-c1f0-4cc3-9da8-cae4d0db5274 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:07.544290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bbcfb8a1-c1f0-4cc3-9da8-cae4d0db5274 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:07.586309 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bbcfb8a1-c1f0-4cc3-9da8-cae4d0db5274 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1322 microversion: 2.1 time: 0.541083 Aug 27 02:39:07.589211 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1203/2178] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:07 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:07.615049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d480af22-13bd-49f0-b0e3-243f68581e04 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:07.616826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d480af22-13bd-49f0-b0e3-243f68581e04 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:07.651230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d480af22-13bd-49f0-b0e3-243f68581e04 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:07.658105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d480af22-13bd-49f0-b0e3-243f68581e04 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:07.659805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d480af22-13bd-49f0-b0e3-243f68581e04 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:07.665253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d480af22-13bd-49f0-b0e3-243f68581e04 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:07.667556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d480af22-13bd-49f0-b0e3-243f68581e04 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:07.670612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d480af22-13bd-49f0-b0e3-243f68581e04 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:08.069541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d480af22-13bd-49f0-b0e3-243f68581e04 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:08.101900 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d480af22-13bd-49f0-b0e3-243f68581e04 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1512 microversion: 2.1 time: 0.508447 Aug 27 02:39:08.103351 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1204/2179] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:07 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1512 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:08.127415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:08.130530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:08.142648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:08.143504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:08.144284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:08.145570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:08.146411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:08.147173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:08.551046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:08.583715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:08.591752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:08.604414 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d3815bb6-df54-440a-aa54-b5d2af84965b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1749 microversion: 2.20 time: 0.495379 Aug 27 02:39:08.605845 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1205/2180] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:08 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1749 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:08.656053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-63d622e0-561d-4050-b3d0-5ad7d0d7dd8f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:08.667473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-63d622e0-561d-4050-b3d0-5ad7d0d7dd8f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:08.683733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63d622e0-561d-4050-b3d0-5ad7d0d7dd8f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:08.685175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63d622e0-561d-4050-b3d0-5ad7d0d7dd8f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:08.686358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63d622e0-561d-4050-b3d0-5ad7d0d7dd8f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:08.688126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63d622e0-561d-4050-b3d0-5ad7d0d7dd8f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:08.689414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63d622e0-561d-4050-b3d0-5ad7d0d7dd8f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:08.690566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63d622e0-561d-4050-b3d0-5ad7d0d7dd8f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:08.761148 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-63d622e0-561d-4050-b3d0-5ad7d0d7dd8f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136412 Aug 27 02:39:08.768095 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1206/2181] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:39:08 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:39:08.780043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a33771c9-ae43-40f5-ad00-7b22f4c20d41 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:08.782759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a33771c9-ae43-40f5-ad00-7b22f4c20d41 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:08.795591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a33771c9-ae43-40f5-ad00-7b22f4c20d41 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:08.796988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a33771c9-ae43-40f5-ad00-7b22f4c20d41 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:08.798261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a33771c9-ae43-40f5-ad00-7b22f4c20d41 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:08.800339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a33771c9-ae43-40f5-ad00-7b22f4c20d41 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:08.801892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a33771c9-ae43-40f5-ad00-7b22f4c20d41 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:08.803001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a33771c9-ae43-40f5-ad00-7b22f4c20d41 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:09.406524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a33771c9-ae43-40f5-ad00-7b22f4c20d41 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:09.416968 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a33771c9-ae43-40f5-ad00-7b22f4c20d41 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1322 microversion: 2.1 time: 0.646557 Aug 27 02:39:09.424207 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1207/2182] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:08 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1322 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:09.457761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-43450288-8760-4135-851c-ceaa665dec9d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:09.459278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-43450288-8760-4135-851c-ceaa665dec9d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:09.481344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43450288-8760-4135-851c-ceaa665dec9d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:09.486858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43450288-8760-4135-851c-ceaa665dec9d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:09.494225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43450288-8760-4135-851c-ceaa665dec9d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:09.496612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43450288-8760-4135-851c-ceaa665dec9d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:09.498157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43450288-8760-4135-851c-ceaa665dec9d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:09.499235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43450288-8760-4135-851c-ceaa665dec9d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:10.007038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-43450288-8760-4135-851c-ceaa665dec9d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:10.034280 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-43450288-8760-4135-851c-ceaa665dec9d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1512 microversion: 2.1 time: 0.598143 Aug 27 02:39:10.071018 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1208/2183] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:09 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1512 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:10.086545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:10.087247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:10.115276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:10.115813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:10.119005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:10.119897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:10.120397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:10.120844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:10.623344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:10.634410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:10.643052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:10.644476 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-69db3127-9a65-494d-8367-872cfe5d7e6e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1749 microversion: 2.20 time: 0.571386 Aug 27 02:39:10.649083 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1209/2184] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:10 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1749 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:10.656958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-733e3aa4-64da-4985-9b92-24c1ba00aa49 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:10.659439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-733e3aa4-64da-4985-9b92-24c1ba00aa49 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:10.674466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:10.679986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733e3aa4-64da-4985-9b92-24c1ba00aa49 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:10.682933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733e3aa4-64da-4985-9b92-24c1ba00aa49 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:10.683591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733e3aa4-64da-4985-9b92-24c1ba00aa49 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:10.684538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733e3aa4-64da-4985-9b92-24c1ba00aa49 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:10.687592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733e3aa4-64da-4985-9b92-24c1ba00aa49 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:10.688736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733e3aa4-64da-4985-9b92-24c1ba00aa49 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:10.769293 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-733e3aa4-64da-4985-9b92-24c1ba00aa49 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.118810 Aug 27 02:39:10.773516 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1210/2185] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:39:10 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:10.778746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:10.783978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-76ade5a3-1b77-473b-8cf7-ccd810736e34 req-6e66b841-a555-4ff1-a735-b575251508f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f", "name": "network-vif-plugged", "status": "completed", "tag": "96d739bd-0e58-4047-8369-dc1d8b9f5043"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:10.806553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-76ade5a3-1b77-473b-8cf7-ccd810736e34 req-6e66b841-a555-4ff1-a735-b575251508f5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:10.809784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-76ade5a3-1b77-473b-8cf7-ccd810736e34 req-6e66b841-a555-4ff1-a735-b575251508f5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:10.815532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-76ade5a3-1b77-473b-8cf7-ccd810736e34 req-6e66b841-a555-4ff1-a735-b575251508f5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:10.846952 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-76ade5a3-1b77-473b-8cf7-ccd810736e34 req-6e66b841-a555-4ff1-a735-b575251508f5 service nova] Creating event network-vif-plugged:96d739bd-0e58-4047-8369-dc1d8b9f5043 for instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f on n-h2-852084-5 Aug 27 02:39:10.854763 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-76ade5a3-1b77-473b-8cf7-ccd810736e34 req-6e66b841-a555-4ff1-a735-b575251508f5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078870 Aug 27 02:39:10.857537 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1211/2186] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:10.867281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46e44bc0-21fc-4739-adc5-7a381c48bc40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:10.873279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-46e44bc0-21fc-4739-adc5-7a381c48bc40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:10.887174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46e44bc0-21fc-4739-adc5-7a381c48bc40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:10.888204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46e44bc0-21fc-4739-adc5-7a381c48bc40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:10.892642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46e44bc0-21fc-4739-adc5-7a381c48bc40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:10.893648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46e44bc0-21fc-4739-adc5-7a381c48bc40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:10.894283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46e44bc0-21fc-4739-adc5-7a381c48bc40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:10.894928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46e44bc0-21fc-4739-adc5-7a381c48bc40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:11.480425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-46e44bc0-21fc-4739-adc5-7a381c48bc40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:11.495161 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-46e44bc0-21fc-4739-adc5-7a381c48bc40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1322 microversion: 2.1 time: 0.636066 Aug 27 02:39:11.501446 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1212/2187] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:10 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1322 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:11.511901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c6e4bbdf-d468-44d3-ade0-3bcdf4ce29b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:11.512831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6e4bbdf-d468-44d3-ade0-3bcdf4ce29b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:11.533969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e4bbdf-d468-44d3-ade0-3bcdf4ce29b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:11.534735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e4bbdf-d468-44d3-ade0-3bcdf4ce29b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:11.535384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e4bbdf-d468-44d3-ade0-3bcdf4ce29b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:11.536306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e4bbdf-d468-44d3-ade0-3bcdf4ce29b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:11.537126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e4bbdf-d468-44d3-ade0-3bcdf4ce29b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:11.537761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e4bbdf-d468-44d3-ade0-3bcdf4ce29b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:11.586282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:12.008960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:39:12.009515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:39:12.010384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:39:12.010838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:39:12.011263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:39:12.046064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:12.046943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:12.050119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:12.051941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:12.052916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:12.055406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:12.116856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Getting quotas for project 38241ddbb3324f4db5a3c6bbdd46cc5f. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:39:12.154741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Getting quotas for user 6cf1a7e187724affa4066f06ad8a908f and project 38241ddbb3324f4db5a3c6bbdd46cc5f. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:39:13.085833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:39:13.089500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2bc1193d-87a7-42d1-90d3-b50cf4eac456',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='61ebc563-f82d-4a4d-9d28-b0e2615672ab',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='141146b3-2ec1-4440-8511-bcc2143298a5',volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:39:13.202375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c6e4bbdf-d468-44d3-ade0-3bcdf4ce29b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:13.230732 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c6e4bbdf-d468-44d3-ade0-3bcdf4ce29b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1512 microversion: 2.1 time: 1.724873 Aug 27 02:39:13.249711 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1213/2188] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:11 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1512 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:13.262072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d000b52e-f6f6-4dfd-8e7f-abb67d19a327 req-81e26cc9-e47a-4832-92c5-6bbb2c6a09de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846f11d0-56dc-4717-87da-d2c70805d9ef", "tag": "04c28e0e-a581-4f71-bb11-9ac533fb7ad2"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:13.325154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d000b52e-f6f6-4dfd-8e7f-abb67d19a327 req-81e26cc9-e47a-4832-92c5-6bbb2c6a09de service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:13.325959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d000b52e-f6f6-4dfd-8e7f-abb67d19a327 req-81e26cc9-e47a-4832-92c5-6bbb2c6a09de service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:13.327401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d000b52e-f6f6-4dfd-8e7f-abb67d19a327 req-81e26cc9-e47a-4832-92c5-6bbb2c6a09de service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:13.430291 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d000b52e-f6f6-4dfd-8e7f-abb67d19a327 req-81e26cc9-e47a-4832-92c5-6bbb2c6a09de service nova] Creating event network-changed:04c28e0e-a581-4f71-bb11-9ac533fb7ad2 for instance 846f11d0-56dc-4717-87da-d2c70805d9ef on n-h1-852084-5 Aug 27 02:39:13.455598 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d000b52e-f6f6-4dfd-8e7f-abb67d19a327 req-81e26cc9-e47a-4832-92c5-6bbb2c6a09de service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214684 Aug 27 02:39:13.470137 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1214/2189] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:13.499568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:13.501517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:13.530435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:13.531468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:13.532211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:13.533532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:13.543594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:13.544767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:14.626320 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6f0d9944-d8e6-430a-b724-7d7a83eb5af8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 17.813327 Aug 27 02:39:14.633127 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 976/2190] 10.222.0.99 () {62 vars in 1189 bytes} [Sat Aug 27 02:38:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 17821 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:39:14.651689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6969ae55-4387-40d0-9fc3-5b1c11193dc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:14.654052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6969ae55-4387-40d0-9fc3-5b1c11193dc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:14.671538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6969ae55-4387-40d0-9fc3-5b1c11193dc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:14.672333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6969ae55-4387-40d0-9fc3-5b1c11193dc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:14.673127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6969ae55-4387-40d0-9fc3-5b1c11193dc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:14.674120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6969ae55-4387-40d0-9fc3-5b1c11193dc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:14.676925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6969ae55-4387-40d0-9fc3-5b1c11193dc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:14.677477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6969ae55-4387-40d0-9fc3-5b1c11193dc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:14.961279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:15.016806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:15.026201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:15.034819 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8d44c0c5-cc6c-4bcc-aa67-397439d16cbf tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1749 microversion: 2.20 time: 1.561461 Aug 27 02:39:15.040231 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1215/2191] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:13 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1749 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:15.567360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c982741-b586-4989-8fc9-ee98baeb23dc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:15.569601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5c982741-b586-4989-8fc9-ee98baeb23dc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:15.613595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c982741-b586-4989-8fc9-ee98baeb23dc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:15.615457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c982741-b586-4989-8fc9-ee98baeb23dc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:15.616398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c982741-b586-4989-8fc9-ee98baeb23dc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:15.618408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c982741-b586-4989-8fc9-ee98baeb23dc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:15.619617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c982741-b586-4989-8fc9-ee98baeb23dc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:15.620639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c982741-b586-4989-8fc9-ee98baeb23dc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:15.791889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6969ae55-4387-40d0-9fc3-5b1c11193dc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:15.859093 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6969ae55-4387-40d0-9fc3-5b1c11193dc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1322 microversion: 2.1 time: 1.214867 Aug 27 02:39:15.866893 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 977/2192] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:14 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1322 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:15.905484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3df949cf-fe8e-4559-a4e7-1594ac46ef6c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:15.910088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3df949cf-fe8e-4559-a4e7-1594ac46ef6c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:16.600702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5c982741-b586-4989-8fc9-ee98baeb23dc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:16.610051 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5c982741-b586-4989-8fc9-ee98baeb23dc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1512 microversion: 2.1 time: 1.567152 Aug 27 02:39:16.616092 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1216/2193] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:15 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1512 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:16.633933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:16.634575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:16.647761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:16.650411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:16.653936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:16.655113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:16.655777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:16.656396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:16.667514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3df949cf-fe8e-4559-a4e7-1594ac46ef6c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:16.716847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3df949cf-fe8e-4559-a4e7-1594ac46ef6c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:16.724918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3df949cf-fe8e-4559-a4e7-1594ac46ef6c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:16.734117 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3df949cf-fe8e-4559-a4e7-1594ac46ef6c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1285 microversion: 2.32 time: 0.864209 Aug 27 02:39:16.750062 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 978/2194] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:15 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1285 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:16.889548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-25b3255e-9f2a-4997-8de0-b0cad2304edf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:16.892355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-25b3255e-9f2a-4997-8de0-b0cad2304edf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:16.955525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b3255e-9f2a-4997-8de0-b0cad2304edf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:16.956406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b3255e-9f2a-4997-8de0-b0cad2304edf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:16.958703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b3255e-9f2a-4997-8de0-b0cad2304edf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:16.962542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b3255e-9f2a-4997-8de0-b0cad2304edf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:16.963530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b3255e-9f2a-4997-8de0-b0cad2304edf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:16.964818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25b3255e-9f2a-4997-8de0-b0cad2304edf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:17.157692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:17.191117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:17.195784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:17.199801 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4dd0e57-2ba3-4e97-8c5c-7a73217fde8c tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1749 microversion: 2.20 time: 0.580519 Aug 27 02:39:17.201594 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1217/2195] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:16 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1749 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:17.660044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a686287b-0a35-48eb-a30f-cde12d8719de tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:17.673505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a686287b-0a35-48eb-a30f-cde12d8719de tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:17.693887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a686287b-0a35-48eb-a30f-cde12d8719de tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:17.695523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a686287b-0a35-48eb-a30f-cde12d8719de tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:17.696634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a686287b-0a35-48eb-a30f-cde12d8719de tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:17.699730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a686287b-0a35-48eb-a30f-cde12d8719de tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:17.701037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a686287b-0a35-48eb-a30f-cde12d8719de tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:17.702217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a686287b-0a35-48eb-a30f-cde12d8719de tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:17.720795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-25b3255e-9f2a-4997-8de0-b0cad2304edf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:17.746022 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-25b3255e-9f2a-4997-8de0-b0cad2304edf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1322 microversion: 2.1 time: 0.866553 Aug 27 02:39:17.770354 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 979/2196] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:16 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1322 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:17.776441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:17.787150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:17.808433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:17.814567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:17.816128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:17.826098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:17.827827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:17.829063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:18.363070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:18.438786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:18.465177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:18.467527 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3f5f0fbf-93d7-44a8-a42a-684ddf6ccee7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1519 microversion: 2.32 time: 0.694700 Aug 27 02:39:18.482135 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 980/2197] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:17 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1519 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:18.512186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:18.518308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:18.548114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:18.555409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:18.556300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:18.563027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:18.566281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:18.569438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:18.695997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a686287b-0a35-48eb-a30f-cde12d8719de tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:18.727767 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a686287b-0a35-48eb-a30f-cde12d8719de tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1512 microversion: 2.1 time: 1.057532 Aug 27 02:39:18.728900 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1218/2198] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:17 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1512 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:18.769070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3d6091dd-db0f-45e9-affc-c46da481da3e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:18.769343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3d6091dd-db0f-45e9-affc-c46da481da3e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:18.787407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d6091dd-db0f-45e9-affc-c46da481da3e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:18.787919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d6091dd-db0f-45e9-affc-c46da481da3e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:18.788378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d6091dd-db0f-45e9-affc-c46da481da3e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:18.789116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d6091dd-db0f-45e9-affc-c46da481da3e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:18.789933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d6091dd-db0f-45e9-affc-c46da481da3e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:18.790284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d6091dd-db0f-45e9-affc-c46da481da3e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:19.379335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3d6091dd-db0f-45e9-affc-c46da481da3e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:19.393484 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3d6091dd-db0f-45e9-affc-c46da481da3e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1322 microversion: 2.1 time: 0.629201 Aug 27 02:39:19.394114 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1219/2199] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:18 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:19.525440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:19.534000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:19.537735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:19.537996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:19.545510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:19.547645 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0b9e9f44-b3e2-449e-a73f-bb685a20ae81 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 1.063715 Aug 27 02:39:19.548243 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 981/2200] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:18 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:19.551723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:19.552235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:19.552684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:19.553423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:19.558707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:19.559261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:19.755105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7c731f48-6bae-4762-a38f-849842049783 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:19.755846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7c731f48-6bae-4762-a38f-849842049783 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:19.772507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:19.779476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c731f48-6bae-4762-a38f-849842049783 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:19.781161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c731f48-6bae-4762-a38f-849842049783 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:19.788276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c731f48-6bae-4762-a38f-849842049783 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:19.789321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c731f48-6bae-4762-a38f-849842049783 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:19.791656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:19.792513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c731f48-6bae-4762-a38f-849842049783 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:19.794102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c731f48-6bae-4762-a38f-849842049783 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:19.806993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:19.810528 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b0e3bb29-ee35-4438-8e63-1168a07a5c60 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1583 microversion: 2.32 time: 0.282668 Aug 27 02:39:19.825851 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1220/2201] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:19 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1583 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:20.415093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2c2f14db-af85-4ef1-9fac-8ca76130fb8c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:20.415725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2c2f14db-af85-4ef1-9fac-8ca76130fb8c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:20.426891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c2f14db-af85-4ef1-9fac-8ca76130fb8c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:20.427437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c2f14db-af85-4ef1-9fac-8ca76130fb8c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:20.427913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c2f14db-af85-4ef1-9fac-8ca76130fb8c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:20.428658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c2f14db-af85-4ef1-9fac-8ca76130fb8c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:20.429127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c2f14db-af85-4ef1-9fac-8ca76130fb8c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:20.429566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c2f14db-af85-4ef1-9fac-8ca76130fb8c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:22.013557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2c2f14db-af85-4ef1-9fac-8ca76130fb8c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:22.035645 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2c2f14db-af85-4ef1-9fac-8ca76130fb8c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1322 microversion: 2.1 time: 1.623219 Aug 27 02:39:22.039935 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1221/2202] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:20 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1322 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:39:22.063522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:22.065974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:22.085144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:22.093098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:22.097006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:22.101025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:22.105311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:22.109955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:22.113101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:22.319770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7c731f48-6bae-4762-a38f-849842049783 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:22.349931 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7c731f48-6bae-4762-a38f-849842049783 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1512 microversion: 2.1 time: 2.591283 Aug 27 02:39:22.352097 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 982/2203] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:19 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1512 bytes in 2603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:22.772936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-19f0186e-6f3b-4b7d-afb7-32a3921f16f3 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Action: 'create', calling method: .version_select at 0x7f4d29be1ee0>, body: {"pool": null} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:24.159110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:24.195118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:24.230624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:24.233016 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-596654a4-d8a2-4916-b2e5-e8b8a6a9b016 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 2.185988 Aug 27 02:39:24.240916 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1222/2204] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:22 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:24.270571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:24.272403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:24.313263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:24.323071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:24.324208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:24.325853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:24.326958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:24.327952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:25.074254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:25.129345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:25.136360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:25.147581 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-611a3d42-76a2-48c0-85f2-0a11998de5f7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1593 microversion: 2.32 time: 0.904546 Aug 27 02:39:25.165745 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1223/2205] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:24 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1593 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:25.200052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2018e907-0da2-4f6a-8cb4-31245fe9446a req-b7b090b3-52d0-40c1-bd24-65b917f08035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846f11d0-56dc-4717-87da-d2c70805d9ef", "name": "network-vif-plugged", "status": "completed", "tag": "04c28e0e-a581-4f71-bb11-9ac533fb7ad2"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:25.270675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2018e907-0da2-4f6a-8cb4-31245fe9446a req-b7b090b3-52d0-40c1-bd24-65b917f08035 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:25.272145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2018e907-0da2-4f6a-8cb4-31245fe9446a req-b7b090b3-52d0-40c1-bd24-65b917f08035 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:25.277722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2018e907-0da2-4f6a-8cb4-31245fe9446a req-b7b090b3-52d0-40c1-bd24-65b917f08035 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:25.357710 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2018e907-0da2-4f6a-8cb4-31245fe9446a req-b7b090b3-52d0-40c1-bd24-65b917f08035 service nova] Creating event network-vif-plugged:04c28e0e-a581-4f71-bb11-9ac533fb7ad2 for instance 846f11d0-56dc-4717-87da-d2c70805d9ef on n-h1-852084-5 Aug 27 02:39:25.399944 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2018e907-0da2-4f6a-8cb4-31245fe9446a req-b7b090b3-52d0-40c1-bd24-65b917f08035 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225543 Aug 27 02:39:25.410324 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1224/2206] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:25.452460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8543af07-5494-4602-a1b6-8b112bc53d22 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:25.466477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8543af07-5494-4602-a1b6-8b112bc53d22 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:25.512875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8543af07-5494-4602-a1b6-8b112bc53d22 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:25.513845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8543af07-5494-4602-a1b6-8b112bc53d22 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:25.520145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8543af07-5494-4602-a1b6-8b112bc53d22 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:25.527363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8543af07-5494-4602-a1b6-8b112bc53d22 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:25.534413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8543af07-5494-4602-a1b6-8b112bc53d22 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:25.536242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8543af07-5494-4602-a1b6-8b112bc53d22 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:26.674479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:26.773539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8543af07-5494-4602-a1b6-8b112bc53d22 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:26.800539 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8543af07-5494-4602-a1b6-8b112bc53d22 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1322 microversion: 2.1 time: 1.387689 Aug 27 02:39:26.833943 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1225/2207] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:25 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1322 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:26.849260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb168f90-e991-48f8-9bbd-e26d91718d54 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:26.855099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb168f90-e991-48f8-9bbd-e26d91718d54 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:26.883454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb168f90-e991-48f8-9bbd-e26d91718d54 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:26.884943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb168f90-e991-48f8-9bbd-e26d91718d54 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:26.887690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb168f90-e991-48f8-9bbd-e26d91718d54 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:26.889409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb168f90-e991-48f8-9bbd-e26d91718d54 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:26.894919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb168f90-e991-48f8-9bbd-e26d91718d54 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:26.897265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb168f90-e991-48f8-9bbd-e26d91718d54 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:27.891701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cb168f90-e991-48f8-9bbd-e26d91718d54 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:27.916444 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb168f90-e991-48f8-9bbd-e26d91718d54 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1489 microversion: 2.1 time: 1.079998 Aug 27 02:39:27.917522 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1226/2208] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:26 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1489 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:27.941462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-5b59c423-0954-4bf2-9a56-9b773a18d984 req-c46d3bf3-de40-4a3f-bf81-802fb7006f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893e335c-913a-479a-9ee8-f61fc9a3b36f", "tag": "e392649a-1f13-4247-832b-e0b1080e8799"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:27.988294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5b59c423-0954-4bf2-9a56-9b773a18d984 req-c46d3bf3-de40-4a3f-bf81-802fb7006f24 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:27.989566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5b59c423-0954-4bf2-9a56-9b773a18d984 req-c46d3bf3-de40-4a3f-bf81-802fb7006f24 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:27.994836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5b59c423-0954-4bf2-9a56-9b773a18d984 req-c46d3bf3-de40-4a3f-bf81-802fb7006f24 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:28.061853 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-5b59c423-0954-4bf2-9a56-9b773a18d984 req-c46d3bf3-de40-4a3f-bf81-802fb7006f24 service nova] Creating event network-changed:e392649a-1f13-4247-832b-e0b1080e8799 for instance 893e335c-913a-479a-9ee8-f61fc9a3b36f on n-h1-852084-5 Aug 27 02:39:28.100191 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-5b59c423-0954-4bf2-9a56-9b773a18d984 req-c46d3bf3-de40-4a3f-bf81-802fb7006f24 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170594 Aug 27 02:39:28.102059 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1227/2209] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:28.135902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:28.136654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:28.153931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:28.154349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:28.156042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:28.157233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:28.160732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:28.162237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:28.875176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:28.898780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:28.907462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:28.910536 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d9bfb2c3-bdf8-4ce8-ab8d-05e054d8a4af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 0.806336 Aug 27 02:39:28.911154 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1228/2210] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:28 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:28.925045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:28.934597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:28.941485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:28.950906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:28.950906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:28.950906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:28.951211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:28.951595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:29.762336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:30.949591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:30.967755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:30.983160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:30.986755 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0fb9e46f-f792-49b1-82a3-ffc1e5e576dc tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1661 microversion: 2.32 time: 2.074512 Aug 27 02:39:30.992253 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1229/2211] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:28 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1661 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:31.002605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c87111d8-8c5d-4a2b-8c6a-ae6705d11662 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:31.003209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c87111d8-8c5d-4a2b-8c6a-ae6705d11662 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:31.039549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87111d8-8c5d-4a2b-8c6a-ae6705d11662 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:31.040055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87111d8-8c5d-4a2b-8c6a-ae6705d11662 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:31.040506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87111d8-8c5d-4a2b-8c6a-ae6705d11662 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:31.041249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87111d8-8c5d-4a2b-8c6a-ae6705d11662 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:31.041742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87111d8-8c5d-4a2b-8c6a-ae6705d11662 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:31.042250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87111d8-8c5d-4a2b-8c6a-ae6705d11662 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:32.329329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=32 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:32.544702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c87111d8-8c5d-4a2b-8c6a-ae6705d11662 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:32.600801 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c87111d8-8c5d-4a2b-8c6a-ae6705d11662 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1516 microversion: 2.1 time: 1.601084 Aug 27 02:39:32.602064 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1230/2212] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:30 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1516 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:32.657811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b51d4406-95cd-45c5-b4cd-53caf6bce5d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:32.672114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b51d4406-95cd-45c5-b4cd-53caf6bce5d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:32.739914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b51d4406-95cd-45c5-b4cd-53caf6bce5d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:32.743841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b51d4406-95cd-45c5-b4cd-53caf6bce5d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:32.747899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b51d4406-95cd-45c5-b4cd-53caf6bce5d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:32.748946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b51d4406-95cd-45c5-b4cd-53caf6bce5d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:32.776097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b51d4406-95cd-45c5-b4cd-53caf6bce5d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:32.776922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b51d4406-95cd-45c5-b4cd-53caf6bce5d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:33.054519 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b51d4406-95cd-45c5-b4cd-53caf6bce5d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 200 len: 169 microversion: 2.1 time: 0.449803 Aug 27 02:39:33.057600 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1231/2213] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:39:32 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 169 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:33.082749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:33.084659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:33.113647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:33.115319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:33.116481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:33.122694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:33.124118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:33.127814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:33.129411 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-19f0186e-6f3b-4b7d-afb7-32a3921f16f3 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] 10.222.0.99 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 10.771274 Aug 27 02:39:33.131253 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 983/2214] 10.222.0.99 () {60 vars in 1170 bytes} [Sat Aug 27 02:39:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 10778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:33.164844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:33.166161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:33.174268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:33.175420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:33.176283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:33.177275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:33.178003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:33.178654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:33.206800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:34.177044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:34.199079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:34.201962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:34.208524 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c69ff664-0bdd-462c-bf84-ab9247560cb1 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1708 microversion: 2.32 time: 1.070860 Aug 27 02:39:34.210202 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 984/2215] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:33 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1708 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:34.217783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea264609-98c4-4653-bf06-34b43700dcc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:34.246690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ea264609-98c4-4653-bf06-34b43700dcc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:34.263365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea264609-98c4-4653-bf06-34b43700dcc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:34.266468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea264609-98c4-4653-bf06-34b43700dcc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:34.267345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea264609-98c4-4653-bf06-34b43700dcc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:34.272898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea264609-98c4-4653-bf06-34b43700dcc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:34.273812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea264609-98c4-4653-bf06-34b43700dcc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:34.274552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea264609-98c4-4653-bf06-34b43700dcc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:34.350887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-ea264609-98c4-4653-bf06-34b43700dcc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lazy-loading 'flavor' on Instance uuid 846f11d0-56dc-4717-87da-d2c70805d9ef {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:39:34.773341 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ea264609-98c4-4653-bf06-34b43700dcc4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef/action" status: 200 len: 32 microversion: 2.1 time: 0.552872 Aug 27 02:39:34.777753 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 985/2216] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:39:34 2022] POST /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef/action => generated 32 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:39:34.815561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-867ecaf1-0f0a-429b-b111-47fa2ef6e505 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:34.822185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-867ecaf1-0f0a-429b-b111-47fa2ef6e505 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:34.854017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ecaf1-0f0a-429b-b111-47fa2ef6e505 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:34.860611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ecaf1-0f0a-429b-b111-47fa2ef6e505 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:34.866384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ecaf1-0f0a-429b-b111-47fa2ef6e505 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:34.868219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ecaf1-0f0a-429b-b111-47fa2ef6e505 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:34.869972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ecaf1-0f0a-429b-b111-47fa2ef6e505 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:34.872540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-867ecaf1-0f0a-429b-b111-47fa2ef6e505 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:35.039709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:35.078222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:35.087557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:35.090270 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7e6a9cfb-8daa-4cbd-9d53-ba32e066b3af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 2.029383 Aug 27 02:39:35.107022 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1232/2217] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:33 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 2048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:35.136199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-89a3ec68-8912-4fbc-9ebc-6c3e555a76e4 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Calling method '.version_select at 0x7f4d293f0e50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:35.989317 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-89a3ec68-8912-4fbc-9ebc-6c3e555a76e4 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] 10.222.0.99 "GET /compute/v2.1/os-floating-ips/ed4da1c6-fb8b-425c-b2be-426c58e69a9b" status: 200 len: 142 microversion: 2.1 time: 0.870579 Aug 27 02:39:35.998291 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1233/2218] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:39:35 2022] GET /compute/v2.1/os-floating-ips/ed4da1c6-fb8b-425c-b2be-426c58e69a9b => generated 142 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:36.003984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c043d4e-5580-4a22-9798-9a5ff50db98e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:36.005943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c043d4e-5580-4a22-9798-9a5ff50db98e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:36.034129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c043d4e-5580-4a22-9798-9a5ff50db98e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:36.046533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c043d4e-5580-4a22-9798-9a5ff50db98e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:36.048031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c043d4e-5580-4a22-9798-9a5ff50db98e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:36.049590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c043d4e-5580-4a22-9798-9a5ff50db98e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:36.054166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c043d4e-5580-4a22-9798-9a5ff50db98e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:36.055380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c043d4e-5580-4a22-9798-9a5ff50db98e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:36.995008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1c043d4e-5580-4a22-9798-9a5ff50db98e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:37.007253 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c043d4e-5580-4a22-9798-9a5ff50db98e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1522 microversion: 2.1 time: 1.007197 Aug 27 02:39:37.008166 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1234/2219] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:35 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1522 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:37.013247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:37.014215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:37.030371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:37.031715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:37.033238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:37.036347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:37.038960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:37.041520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:37.339492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-867ecaf1-0f0a-429b-b111-47fa2ef6e505 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:37.356524 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-867ecaf1-0f0a-429b-b111-47fa2ef6e505 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 2.576968 Aug 27 02:39:37.386279 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 986/2220] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:34 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:37.407610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-424c54a9-c1ab-4a9a-b4d9-ab651a1f63eb tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Calling method '.version_select at 0x7f4d29d81700>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:37.740639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:37.767420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:37.772370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:37.774248 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c63d4af5-02e8-49c6-b601-e18a2593e786 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1755 microversion: 2.32 time: 0.764736 Aug 27 02:39:37.777645 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1235/2221] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:37 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1755 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:37.790110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:37.791155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:37.807498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:37.808329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:37.810305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:37.815492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:37.816314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:37.816976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:40.105087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:40.125142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:40.128802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:40.131549 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c8ae97d-4568-4beb-a148-9d78cd7be56f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 2.352158 Aug 27 02:39:40.132862 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1236/2222] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:37 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:40.167745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c40bbd31-6479-49ce-8a58-287ee3d79617 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:40.174358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c40bbd31-6479-49ce-8a58-287ee3d79617 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:40.212235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c40bbd31-6479-49ce-8a58-287ee3d79617 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:40.213443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c40bbd31-6479-49ce-8a58-287ee3d79617 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:40.215406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c40bbd31-6479-49ce-8a58-287ee3d79617 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:40.218766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c40bbd31-6479-49ce-8a58-287ee3d79617 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:40.228191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c40bbd31-6479-49ce-8a58-287ee3d79617 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:40.229374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c40bbd31-6479-49ce-8a58-287ee3d79617 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:40.586008 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-424c54a9-c1ab-4a9a-b4d9-ab651a1f63eb tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] 10.222.0.99 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 3.197932 Aug 27 02:39:40.589496 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 987/2223] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:39:37 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 3202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:40.597470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6f94d0fe-4889-43cd-a483-bc1e0c05febe tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:40.602116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6f94d0fe-4889-43cd-a483-bc1e0c05febe tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:40.628265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f94d0fe-4889-43cd-a483-bc1e0c05febe tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:40.645321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f94d0fe-4889-43cd-a483-bc1e0c05febe tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:40.646669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f94d0fe-4889-43cd-a483-bc1e0c05febe tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:40.652145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f94d0fe-4889-43cd-a483-bc1e0c05febe tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:40.653014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f94d0fe-4889-43cd-a483-bc1e0c05febe tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:40.657156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f94d0fe-4889-43cd-a483-bc1e0c05febe tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:40.940123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c40bbd31-6479-49ce-8a58-287ee3d79617 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:40.959351 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c40bbd31-6479-49ce-8a58-287ee3d79617 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.821076 Aug 27 02:39:40.962606 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1237/2224] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:40 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:40.988181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:40.991406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:41.022201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=54 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:41.036169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:41.037071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:41.037867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:41.046170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:41.048895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:41.051048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:41.499044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6f94d0fe-4889-43cd-a483-bc1e0c05febe tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:41.510257 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6f94d0fe-4889-43cd-a483-bc1e0c05febe tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1522 microversion: 2.1 time: 0.919323 Aug 27 02:39:41.515206 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 988/2225] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:40 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1522 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:41.556813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3db62792-a41a-4d61-9551-f8e61d51fabf tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Calling method '.version_select at 0x7f4d29c19a60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:42.603295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:42.714552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:42.735144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:42.761417 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2fb2bc7c-4d1a-40b7-a621-900fe660b416 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1755 microversion: 2.32 time: 1.790266 Aug 27 02:39:42.771564 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1238/2226] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:40 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1755 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:42.829103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8ba7599d-e542-48ba-b602-7ed0dc7544eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:42.837521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8ba7599d-e542-48ba-b602-7ed0dc7544eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:42.905523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ba7599d-e542-48ba-b602-7ed0dc7544eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:42.918387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ba7599d-e542-48ba-b602-7ed0dc7544eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:42.920532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ba7599d-e542-48ba-b602-7ed0dc7544eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:42.928044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ba7599d-e542-48ba-b602-7ed0dc7544eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:42.928920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ba7599d-e542-48ba-b602-7ed0dc7544eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:42.933521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ba7599d-e542-48ba-b602-7ed0dc7544eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:45.316765 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3db62792-a41a-4d61-9551-f8e61d51fabf tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/ed4da1c6-fb8b-425c-b2be-426c58e69a9b" status: 202 len: 0 microversion: 2.1 time: 3.799597 Aug 27 02:39:45.326592 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 989/2227] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:39:41 2022] DELETE /compute/v2.1/os-floating-ips/ed4da1c6-fb8b-425c-b2be-426c58e69a9b => generated 0 bytes in 3810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:39:45.354139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:45.363651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:45.415112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:45.425575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:45.428024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:45.434479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:45.437161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:45.445016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:45.537983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8ba7599d-e542-48ba-b602-7ed0dc7544eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:45.562953 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8ba7599d-e542-48ba-b602-7ed0dc7544eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 2.786180 Aug 27 02:39:45.566240 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1239/2228] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:42 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 2794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:45.586878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d5763286-2a50-4c78-8ea4-d97beebff3bc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:45.593812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d5763286-2a50-4c78-8ea4-d97beebff3bc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:45.614596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5763286-2a50-4c78-8ea4-d97beebff3bc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:45.617647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5763286-2a50-4c78-8ea4-d97beebff3bc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:45.619544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5763286-2a50-4c78-8ea4-d97beebff3bc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:45.622284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5763286-2a50-4c78-8ea4-d97beebff3bc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:45.623825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5763286-2a50-4c78-8ea4-d97beebff3bc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:45.624897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5763286-2a50-4c78-8ea4-d97beebff3bc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:45.946774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:45.967772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:45.970252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:45.971814 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-12ecc5c9-2a4d-418a-a8b2-e6cad0863abc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 0.642364 Aug 27 02:39:45.980963 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 990/2229] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:45 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:45.987187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:45.989885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:45.997885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:46.000084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:46.010564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:46.011648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:46.012296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:46.013204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:46.487128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:46.505235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:46.509715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:46.512454 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cb49882a-97ec-45f4-9fee-08f5a2b5f63f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1802 microversion: 2.32 time: 0.529889 Aug 27 02:39:46.546193 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 991/2230] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:45 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1802 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:46.569049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-245d59be-11d6-4e95-a987-9e6660f7e73b tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Action: 'create', calling method: .version_select at 0x7f4d29be1040>, body: {"pool": null} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:48.925551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d5763286-2a50-4c78-8ea4-d97beebff3bc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:48.955136 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d5763286-2a50-4c78-8ea4-d97beebff3bc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1522 microversion: 2.1 time: 3.386352 Aug 27 02:39:48.958993 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1240/2231] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:45 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1522 bytes in 3392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:48.978705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4e076562-6695-48bd-89f2-958540e5a6a9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:48.985293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4e076562-6695-48bd-89f2-958540e5a6a9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:49.013273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e076562-6695-48bd-89f2-958540e5a6a9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:49.017586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e076562-6695-48bd-89f2-958540e5a6a9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:49.018861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e076562-6695-48bd-89f2-958540e5a6a9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:49.019686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e076562-6695-48bd-89f2-958540e5a6a9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:49.020177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e076562-6695-48bd-89f2-958540e5a6a9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:49.020993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e076562-6695-48bd-89f2-958540e5a6a9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:49.680415 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-245d59be-11d6-4e95-a987-9e6660f7e73b tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] 10.222.0.99 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.131847 Aug 27 02:39:49.682900 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 992/2232] 10.222.0.99 () {60 vars in 1170 bytes} [Sat Aug 27 02:39:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:49.700216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:49.701751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:49.729587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:49.730921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:49.731966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:49.733596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:49.738282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:49.739405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:49.873640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4e076562-6695-48bd-89f2-958540e5a6a9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:49.888698 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4e076562-6695-48bd-89f2-958540e5a6a9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.920545 Aug 27 02:39:49.889774 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1241/2233] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:48 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:49.904496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:49.905709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:49.926465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:49.928189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:49.931189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:49.932408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:49.933975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:49.936317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:50.504285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:50.538544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:50.548360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:50.553777 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d2876a24-e304-4918-8147-12240f57f7ba tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 0.868162 Aug 27 02:39:50.558340 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 993/2234] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:49 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:50.583679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a3b74f6-0ced-415b-b364-a03b6aedf6c1 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Calling method '.version_select at 0x7f4d29e12ca0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:51.435315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:51.454960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:51.459852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:51.464942 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21adc420-ee82-4e6b-a6d2-821397b32669 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1802 microversion: 2.32 time: 1.571539 Aug 27 02:39:51.491589 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1242/2235] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:49 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1802 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:51.504660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b9b410f-ce35-4ceb-8d35-cd6c7bbae799 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:51.507435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6b9b410f-ce35-4ceb-8d35-cd6c7bbae799 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:51.524303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9b410f-ce35-4ceb-8d35-cd6c7bbae799 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.525230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9b410f-ce35-4ceb-8d35-cd6c7bbae799 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.526632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9b410f-ce35-4ceb-8d35-cd6c7bbae799 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:51.530807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9b410f-ce35-4ceb-8d35-cd6c7bbae799 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:51.531712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9b410f-ce35-4ceb-8d35-cd6c7bbae799 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:51.532444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9b410f-ce35-4ceb-8d35-cd6c7bbae799 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:52.540990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6b9b410f-ce35-4ceb-8d35-cd6c7bbae799 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:52.555425 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b9b410f-ce35-4ceb-8d35-cd6c7bbae799 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1522 microversion: 2.1 time: 1.058738 Aug 27 02:39:52.556529 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1243/2236] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:51 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1522 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:52.585632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-507585559", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a5df9b9c-03e6-4d14-a511-7974335d0f10"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:52.872014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] validate_networks() for [('a5df9b9c-03e6-4d14-a511-7974335d0f10', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:39:53.349612 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4a3b74f6-0ced-415b-b364-a03b6aedf6c1 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/24089885-7f68-4d72-a118-8182199f662f" status: 202 len: 0 microversion: 2.1 time: 2.789118 Aug 27 02:39:53.351963 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 994/2237] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:39:50 2022] DELETE /compute/v2.1/os-floating-ips/24089885-7f68-4d72-a118-8182199f662f => generated 0 bytes in 2793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:39:53.376807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:53.395652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:53.432478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:53.436194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:53.441993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:53.450530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:53.451439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:53.452308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:54.571665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:54.637836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:54.649160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:54.651097 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-99731419-1897-465d-a480-128e47875d56 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 1.297190 Aug 27 02:39:54.653129 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 995/2238] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:53 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:54.670024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:54.674812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:54.695052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:54.696730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:54.697392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:54.699891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:54.700599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:54.701488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:55.084547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:39:55.085366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:39:55.086165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:39:55.086871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:39:55.087440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:39:55.096425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:55.109640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:55.115764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:55.119137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:55.122320 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b42fc7bd-581b-452e-8dec-875d9ba5e23e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1849 microversion: 2.32 time: 0.465477 Aug 27 02:39:55.123571 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 996/2239] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:54 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1849 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:55.124823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:55.125826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:55.129867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:55.131974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:55.132783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3c23a7d-b9a8-4e76-8d18-de8c08adfcd9 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Calling method '.version_select at 0x7f4d29d29670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:55.133722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:55.218778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for project 69945a768314456fae9bf75e854510c2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:39:55.227309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-f3c23a7d-b9a8-4e76-8d18-de8c08adfcd9 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 24089885-7f68-4d72-a118-8182199f662f could not be found", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:39:55.228320 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-f3c23a7d-b9a8-4e76-8d18-de8c08adfcd9 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] HTTP exception thrown: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3c23a7d-b9a8-4e76-8d18-de8c08adfcd9 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Request method failure captured: Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-floating-ips/24089885-7f68-4d72-a118-8182199f662f HTTP/1.1 Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYPYfc4axHiQW2MNy6K27CD_nJ1aQO-9zdtVa3U3l66aHH36VBPnt3oTJtL0eSl3ThiUg4itkIWpstXrJXRFKsly7VmRPpHsXIGcbtX4JNHWlYQMKazCVzgyfszVzs6FfJnQyfBTrbMo44msewDgbD7QsolavQXb-WTAYGzaLuUr4wA Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 4c64e4a79eae45ef9286978295e6f21b Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-FloatingIPsTestJSON-1256356298 Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4c64e4a79eae45ef9286978295e6f21b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4c64e4a79eae45ef9286978295e6f21b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4c64e4a79eae45ef9286978295e6f21b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4c64e4a79eae45ef9286978295e6f21b"}]}] Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-FloatingIPsTestJSON-1256356298 Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 4c64e4a79eae45ef9286978295e6f21b Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1256356298 Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-FloatingIPsTestJSON-1256356298-project Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 126f4108d7d041cb904f9407e17e5168 Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-FloatingIPsTestJSON-1256356298-project Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: exception: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '24089885-7f68-4d72-a118-8182199f662f'} Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 24089885-7f68-4d72-a118-8182199f662f could not be found Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd896ed9-a01b-43ac-a494-ba75a1af5a5c'] Aug 27 02:39:55.231476 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f. Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f Aug 27 02:39:55.236365 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.240002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3c23a7d-b9a8-4e76-8d18-de8c08adfcd9 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Returning 404 to user: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:39:55.241504 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f3c23a7d-b9a8-4e76-8d18-de8c08adfcd9 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] 10.222.0.99 "GET /compute/v2.1/os-floating-ips/24089885-7f68-4d72-a118-8182199f662f" status: 404 len: 111 microversion: 2.1 time: 0.115609 Aug 27 02:39:55.242632 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 997/2240] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:39:55 2022] GET /compute/v2.1/os-floating-ips/24089885-7f68-4d72-a118-8182199f662f => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:39:55.254245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-33bd5de7-825d-49ba-8206-e14df536ce6c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:55.259840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for user 281834367cf24a809448bdeea36a9c97 and project 69945a768314456fae9bf75e854510c2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:39:55.261995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-33bd5de7-825d-49ba-8206-e14df536ce6c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:55.296249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33bd5de7-825d-49ba-8206-e14df536ce6c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:55.299128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33bd5de7-825d-49ba-8206-e14df536ce6c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:55.299318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:39:55.299403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33bd5de7-825d-49ba-8206-e14df536ce6c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:55.299403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33bd5de7-825d-49ba-8206-e14df536ce6c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:55.312040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:39:55.321789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33bd5de7-825d-49ba-8206-e14df536ce6c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:55.329180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33bd5de7-825d-49ba-8206-e14df536ce6c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:55.445728 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9c5a3850-5e3b-47c1-bd3a-21957fbc3d20 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.885523 Aug 27 02:39:55.446663 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1244/2241] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:39:55.456076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-480df2db-9f36-4f88-9ec6-d4e629995890 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Calling method '.version_select at 0x7f4d29413af0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:55.627593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG neutronclient.v2_0.client [None req-480df2db-9f36-4f88-9ec6-d4e629995890 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 24089885-7f68-4d72-a118-8182199f662f could not be found", "detail": ""}} {{(pid=122488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:39:55.628418 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-480df2db-9f36-4f88-9ec6-d4e629995890 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] HTTP exception thrown: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-480df2db-9f36-4f88-9ec6-d4e629995890 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Request method failure captured: Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/os-floating-ips/24089885-7f68-4d72-a118-8182199f662f HTTP/1.1 Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYPYfc4axHiQW2MNy6K27CD_nJ1aQO-9zdtVa3U3l66aHH36VBPnt3oTJtL0eSl3ThiUg4itkIWpstXrJXRFKsly7VmRPpHsXIGcbtX4JNHWlYQMKazCVzgyfszVzs6FfJnQyfBTrbMo44msewDgbD7QsolavQXb-WTAYGzaLuUr4wA Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 4c64e4a79eae45ef9286978295e6f21b Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FloatingIPsTestJSON-1256356298 Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4c64e4a79eae45ef9286978295e6f21b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4c64e4a79eae45ef9286978295e6f21b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4c64e4a79eae45ef9286978295e6f21b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4c64e4a79eae45ef9286978295e6f21b"}]}] Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FloatingIPsTestJSON-1256356298 Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 4c64e4a79eae45ef9286978295e6f21b Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1256356298 Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FloatingIPsTestJSON-1256356298-project Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 126f4108d7d041cb904f9407e17e5168 Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FloatingIPsTestJSON-1256356298-project Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: exception: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '24089885-7f68-4d72-a118-8182199f662f'} Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 24089885-7f68-4d72-a118-8182199f662f could not be found Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdce24b2-21ac-484d-acd1-86f5ecc6ef98'] Aug 27 02:39:55.630709 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f. Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-480df2db-9f36-4f88-9ec6-d4e629995890 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] Returning 404 to user: Floating IP not found for ID 24089885-7f68-4d72-a118-8182199f662f {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-480df2db-9f36-4f88-9ec6-d4e629995890 tempest-FloatingIPsTestJSON-1256356298 tempest-FloatingIPsTestJSON-1256356298-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/24089885-7f68-4d72-a118-8182199f662f" status: 404 len: 111 microversion: 2.1 time: 0.184258 Aug 27 02:39:55.634620 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1245/2242] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:39:55 2022] DELETE /compute/v2.1/os-floating-ips/24089885-7f68-4d72-a118-8182199f662f => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:39:55.654423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-daa54391-7be1-4282-bcf9-1f4e9c005737 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:55.655929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-daa54391-7be1-4282-bcf9-1f4e9c005737 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:55.808106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-33bd5de7-825d-49ba-8206-e14df536ce6c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:55.830249 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-33bd5de7-825d-49ba-8206-e14df536ce6c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1502 microversion: 2.1 time: 0.586180 Aug 27 02:39:55.831357 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 998/2243] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:55 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1502 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:55.890691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:55.898429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:55.928633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:55.929099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:55.929546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:55.935089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:55.935465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:55.935918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:56.338088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:56.356940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:56.359095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:56.360508 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4f1574da-49b7-469c-b59c-72702c94cced tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 0.525797 Aug 27 02:39:56.374882 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 999/2244] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:55 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:56.391359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-31f677f0-f240-4696-ad34-839ff0b0a34e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:56.392137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-31f677f0-f240-4696-ad34-839ff0b0a34e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:56.407756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31f677f0-f240-4696-ad34-839ff0b0a34e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:56.408431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31f677f0-f240-4696-ad34-839ff0b0a34e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:56.408892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31f677f0-f240-4696-ad34-839ff0b0a34e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:56.410065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31f677f0-f240-4696-ad34-839ff0b0a34e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:56.410154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31f677f0-f240-4696-ad34-839ff0b0a34e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:56.410598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-31f677f0-f240-4696-ad34-839ff0b0a34e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:56.721644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-31f677f0-f240-4696-ad34-839ff0b0a34e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:56.740644 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-31f677f0-f240-4696-ad34-839ff0b0a34e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1516 microversion: 2.1 time: 0.370116 Aug 27 02:39:56.741348 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1000/2245] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:56 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1516 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:56.753768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:56.754568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:56.767935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:56.768697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:56.769274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:56.770250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:56.770817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:56.775365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:56.851324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-daa54391-7be1-4282-bcf9-1f4e9c005737 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:56.871002 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-daa54391-7be1-4282-bcf9-1f4e9c005737 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1214 microversion: 2.1 time: 1.236034 Aug 27 02:39:56.871994 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1246/2246] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:55 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1214 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:56.885528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0b90e05-51af-425d-8aae-2dc402ba4648 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:56.889571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b0b90e05-51af-425d-8aae-2dc402ba4648 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 3d8b3843-377e-49ec-a080-a65ed1dbc79b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:56.897075 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-b0b90e05-51af-425d-8aae-2dc402ba4648 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] HTTP exception thrown: Instance 3d8b3843-377e-49ec-a080-a65ed1dbc79b could not be found. Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0b90e05-51af-425d-8aae-2dc402ba4648 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Request method failure captured: Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/3d8b3843-377e-49ec-a080-a65ed1dbc79b/action HTTP/1.1 Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 14 Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYO1ujqvCLBmMVe65fdN2J5dIO7-HUqI3Js5YGestJSXRt-3jM1W-KzE8NnECJ1ryJNn-_nCYfE1drEJmtuv9wrerAqLuupZmy6gs9vrBdbjKq9YdwsxzP7b-WGUVBzCCEf1u8fLpuDoBEeADCldZf84VX9NU_VzQjP9Knt2NuVZyVU Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/956a66be18bb4f9e996c8e16bcf23bab"}]}] Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 51b3d953421c409c9edd54287dcd11db Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: {"rescue": {}} Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 3d8b3843-377e-49ec-a080-a65ed1dbc79b could not be found. Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '3d8b3843-377e-49ec-a080-a65ed1dbc79b', 'body': {'rescue': {}}} Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8b3843-377e-49ec-a080-a65ed1dbc79b could not be found. Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8b3843-377e-49ec-a080-a65ed1dbc79b could not be found. Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:56.904807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:39:56.908613 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:39:56.908613 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:39:56.908613 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:39:56.908613 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:39:56.908613 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8b3843-377e-49ec-a080-a65ed1dbc79b could not be found. Aug 27 02:39:56.908613 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:39:56.910852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0b90e05-51af-425d-8aae-2dc402ba4648 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Returning 404 to user: Instance 3d8b3843-377e-49ec-a080-a65ed1dbc79b could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:39:56.917287 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b0b90e05-51af-425d-8aae-2dc402ba4648 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/3d8b3843-377e-49ec-a080-a65ed1dbc79b/action" status: 404 len: 111 microversion: 2.1 time: 0.043109 Aug 27 02:39:56.941048 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1247/2247] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:39:56 2022] POST /compute/v2.1/servers/3d8b3843-377e-49ec-a080-a65ed1dbc79b/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:39:57.001593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a66283b0-7ac0-468e-9754-a68ea09aa925 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:57.007090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a66283b0-7ac0-468e-9754-a68ea09aa925 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:57.054422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a66283b0-7ac0-468e-9754-a68ea09aa925 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:57.075599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a66283b0-7ac0-468e-9754-a68ea09aa925 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:57.122429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a66283b0-7ac0-468e-9754-a68ea09aa925 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:57.124595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a66283b0-7ac0-468e-9754-a68ea09aa925 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:57.136891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a66283b0-7ac0-468e-9754-a68ea09aa925 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:57.137744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a66283b0-7ac0-468e-9754-a68ea09aa925 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:57.288769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:57.315519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:57.317116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:57.327995 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c01d17e1-32e6-4f0b-bee0-f17618208910 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1849 microversion: 2.32 time: 0.584770 Aug 27 02:39:57.330435 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1001/2248] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:56 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1849 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:39:57.389095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:57.390658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:57.406864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:57.407707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:57.408330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:57.409285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:57.409982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:57.410583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:57.562309 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a66283b0-7ac0-468e-9754-a68ea09aa925 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/action" status: 202 len: 0 microversion: 2.1 time: 0.609453 Aug 27 02:39:57.571636 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1248/2249] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:39:56 2022] POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:39:57.586827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bf800bb5-1af2-4222-92f1-7f2fb59806ca tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:57.594919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bf800bb5-1af2-4222-92f1-7f2fb59806ca tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:57.623515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf800bb5-1af2-4222-92f1-7f2fb59806ca tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:57.625128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf800bb5-1af2-4222-92f1-7f2fb59806ca tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:57.625694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf800bb5-1af2-4222-92f1-7f2fb59806ca tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:57.632659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf800bb5-1af2-4222-92f1-7f2fb59806ca tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:57.633468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf800bb5-1af2-4222-92f1-7f2fb59806ca tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:57.634308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf800bb5-1af2-4222-92f1-7f2fb59806ca tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.000348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:58.038625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:58.049315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:58.051104 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0723abcb-ba09-48b7-bc26-c6cbe3e991af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 0.666461 Aug 27 02:39:58.052382 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1002/2250] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:57 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:39:58.060098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d81464b8-a254-4162-8eee-26886c9da7e5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:58.062078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d81464b8-a254-4162-8eee-26886c9da7e5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:58.080432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d81464b8-a254-4162-8eee-26886c9da7e5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.086761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d81464b8-a254-4162-8eee-26886c9da7e5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.088151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d81464b8-a254-4162-8eee-26886c9da7e5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.091415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d81464b8-a254-4162-8eee-26886c9da7e5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.096707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d81464b8-a254-4162-8eee-26886c9da7e5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.098450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d81464b8-a254-4162-8eee-26886c9da7e5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.168053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:39:58.284902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d81464b8-a254-4162-8eee-26886c9da7e5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:58.293796 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d81464b8-a254-4162-8eee-26886c9da7e5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1266 microversion: 2.1 time: 0.239712 Aug 27 02:39:58.318819 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1003/2251] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:58 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:39:58.358008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:58.359140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:58.402204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.404278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.404862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.406583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:58.417351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:58.418143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:58.967525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:58.979763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:58.994814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:59.015335 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0c90ea83-2192-4ab8-9c46-b38186493620 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1849 microversion: 2.32 time: 0.662073 Aug 27 02:39:59.016113 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1004/2252] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:58 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1849 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:39:59.020951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-f09c016e-bcbf-4269-8f25-b50cc9c30492 req-8d07e19a-2380-4c49-903b-7a683c262140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "tag": "5014a7dc-c60b-4976-93dc-28dbb2c34306"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:39:59.058016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f09c016e-bcbf-4269-8f25-b50cc9c30492 req-8d07e19a-2380-4c49-903b-7a683c262140 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:59.060368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f09c016e-bcbf-4269-8f25-b50cc9c30492 req-8d07e19a-2380-4c49-903b-7a683c262140 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:59.065987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f09c016e-bcbf-4269-8f25-b50cc9c30492 req-8d07e19a-2380-4c49-903b-7a683c262140 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:59.078117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bf800bb5-1af2-4222-92f1-7f2fb59806ca tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:59.127491 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bf800bb5-1af2-4222-92f1-7f2fb59806ca tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1521 microversion: 2.1 time: 1.538456 Aug 27 02:39:59.128716 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1249/2253] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:57 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1521 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:39:59.140923 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-f09c016e-bcbf-4269-8f25-b50cc9c30492 req-8d07e19a-2380-4c49-903b-7a683c262140 service nova] Creating event network-changed:5014a7dc-c60b-4976-93dc-28dbb2c34306 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:39:59.164461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:59.165555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:59.171836 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-f09c016e-bcbf-4269-8f25-b50cc9c30492 req-8d07e19a-2380-4c49-903b-7a683c262140 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152537 Aug 27 02:39:59.173872 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1005/2254] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:39:59.213881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:59.219471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:59.223943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:59.232663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:59.242346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:59.243553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:59.316884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-401c19ee-18fe-4dc2-8d42-4077aa169d65 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:39:59.317710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-401c19ee-18fe-4dc2-8d42-4077aa169d65 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:39:59.331769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401c19ee-18fe-4dc2-8d42-4077aa169d65 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:59.332351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401c19ee-18fe-4dc2-8d42-4077aa169d65 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:59.332826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401c19ee-18fe-4dc2-8d42-4077aa169d65 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:59.333638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401c19ee-18fe-4dc2-8d42-4077aa169d65 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:39:59.345066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401c19ee-18fe-4dc2-8d42-4077aa169d65 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:39:59.347375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401c19ee-18fe-4dc2-8d42-4077aa169d65 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:39:59.655274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-401c19ee-18fe-4dc2-8d42-4077aa169d65 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:39:59.683964 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-401c19ee-18fe-4dc2-8d42-4077aa169d65 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1272 microversion: 2.1 time: 0.371069 Aug 27 02:39:59.690384 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1006/2255] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:39:59 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1272 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:00.072828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:00.079891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:00.145587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=37 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:00.154273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:00.166904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:00.174891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:00.176517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:00.177518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:00.178690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:01.072764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:01.092792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:01.099722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:01.106766 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11a8978c-a85a-47c0-a1a3-4d8ab4ef3aad tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 1.968790 Aug 27 02:40:01.110459 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1250/2256] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:39:59 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:01.129726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ea76ddf0-e7b5-4222-bd3e-fd75f1a17abc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:01.134010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ea76ddf0-e7b5-4222-bd3e-fd75f1a17abc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:01.171930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea76ddf0-e7b5-4222-bd3e-fd75f1a17abc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:01.175855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea76ddf0-e7b5-4222-bd3e-fd75f1a17abc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:01.176933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea76ddf0-e7b5-4222-bd3e-fd75f1a17abc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:01.178454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea76ddf0-e7b5-4222-bd3e-fd75f1a17abc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:01.189020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea76ddf0-e7b5-4222-bd3e-fd75f1a17abc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:01.189995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea76ddf0-e7b5-4222-bd3e-fd75f1a17abc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:01.886623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:01.973263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:01.981579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:01.997412 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd73a49b-f17e-4585-9e9f-20c63687a6f8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1849 microversion: 2.32 time: 1.931660 Aug 27 02:40:02.006225 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1007/2257] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:00 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1849 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:02.035422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-b3cfcf94-6c7e-4f68-adeb-96bc6a607a01 req-1cbd6d20-52b3-428f-aa8e-5a848885f248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893e335c-913a-479a-9ee8-f61fc9a3b36f", "name": "network-vif-plugged", "status": "completed", "tag": "e392649a-1f13-4247-832b-e0b1080e8799"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:02.139233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b3cfcf94-6c7e-4f68-adeb-96bc6a607a01 req-1cbd6d20-52b3-428f-aa8e-5a848885f248 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:02.140703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b3cfcf94-6c7e-4f68-adeb-96bc6a607a01 req-1cbd6d20-52b3-428f-aa8e-5a848885f248 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:02.141807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b3cfcf94-6c7e-4f68-adeb-96bc6a607a01 req-1cbd6d20-52b3-428f-aa8e-5a848885f248 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:02.241812 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-b3cfcf94-6c7e-4f68-adeb-96bc6a607a01 req-1cbd6d20-52b3-428f-aa8e-5a848885f248 service nova] Creating event network-vif-plugged:e392649a-1f13-4247-832b-e0b1080e8799 for instance 893e335c-913a-479a-9ee8-f61fc9a3b36f on n-h1-852084-5 Aug 27 02:40:02.292483 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-b3cfcf94-6c7e-4f68-adeb-96bc6a607a01 req-1cbd6d20-52b3-428f-aa8e-5a848885f248 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264310 Aug 27 02:40:02.299338 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1008/2258] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:02.423613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a31ed2f-c572-4b42-8c6f-1a6d0d43a8fb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:02.467687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5a31ed2f-c572-4b42-8c6f-1a6d0d43a8fb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:02.545435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31ed2f-c572-4b42-8c6f-1a6d0d43a8fb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:02.603251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31ed2f-c572-4b42-8c6f-1a6d0d43a8fb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.058s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:02.616459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31ed2f-c572-4b42-8c6f-1a6d0d43a8fb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:02.622959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31ed2f-c572-4b42-8c6f-1a6d0d43a8fb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:02.626544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31ed2f-c572-4b42-8c6f-1a6d0d43a8fb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:02.629038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31ed2f-c572-4b42-8c6f-1a6d0d43a8fb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:02.795815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ea76ddf0-e7b5-4222-bd3e-fd75f1a17abc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:02.854383 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ea76ddf0-e7b5-4222-bd3e-fd75f1a17abc tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1501 microversion: 2.1 time: 1.740927 Aug 27 02:40:02.876016 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1251/2259] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:01 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1501 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:02.936991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:02.947888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:03.004699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:03.009305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:03.015187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:03.017345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:03.018650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:03.021714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:03.707495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5a31ed2f-c572-4b42-8c6f-1a6d0d43a8fb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:03.730922 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a31ed2f-c572-4b42-8c6f-1a6d0d43a8fb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1272 microversion: 2.1 time: 1.388357 Aug 27 02:40:03.756139 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1009/2260] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:02 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1272 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:03.775810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-675969250", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "fb40e9d4-9a6b-4f53-9e40-c59943eeffc8"}], "block_device_mapping_v2": [{"uuid": "8a6d793a-24a3-46ca-9d3d-9fc99f57c5ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:04.158430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] validate_networks() for [('fb40e9d4-9a6b-4f53-9e40-c59943eeffc8', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:40:05.082073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:05.105077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:05.120460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:05.122256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:05.123628 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a7fe6192-d080-4ad5-8125-14cd972cf90d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1805 microversion: 2.20 time: 2.243876 Aug 27 02:40:05.142458 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1252/2261] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:02 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1805 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:05.159070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:05.167842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:05.198349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:05.199999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:05.200511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:05.201013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:05.217225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:05.218498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:05.218970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:05.341282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lazy-loading 'flavor' on Instance uuid f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:05.396861 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] HTTP exception thrown: Cannot 'rescue' instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f while it is in vm_state paused Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Request method failure captured: Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/action HTTP/1.1 Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 14 Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYO1ujqvCLBmMVe65fdN2J5dIO7-HUqI3Js5YGestJSXRt-3jM1W-KzE8NnECJ1ryJNn-_nCYfE1drEJmtuv9wrerAqLuupZmy6gs9vrBdbjKq9YdwsxzP7b-WGUVBzCCEf1u8fLpuDoBEeADCldZf84VX9NU_VzQjP9Knt2NuVZyVU Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/956a66be18bb4f9e996c8e16bcf23bab"}]}] Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 51b3d953421c409c9edd54287dcd11db Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: {"rescue": {}} Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: exception: Cannot 'rescue' instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f while it is in vm_state paused Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f', 'body': {'rescue': {}}} Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f in vm_state paused. Cannot rescue while the instance is in this state. Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f while it is in vm_state paused Aug 27 02:40:05.410580 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:05.417518 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:05.417518 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:05.417518 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:05.417518 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:05.417518 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:05.417518 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:05.417518 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:05.417518 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f while it is in vm_state paused Aug 27 02:40:05.417518 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:05.417518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Returning 409 to user: Cannot 'rescue' instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f while it is in vm_state paused {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:05.417518 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-90266458-fc15-456c-bb98-26a5e68da113 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/action" status: 409 len: 144 microversion: 2.1 time: 0.269933 Aug 27 02:40:05.425133 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1253/2262] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:05 2022] POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/action => generated 144 bytes in 289 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:05.441926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:05.447813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:05.483592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:05.490575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:05.491043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:05.491818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:05.492292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:05.492931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:06.422289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:06.478010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:06.487755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:06.492498 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-968107bd-b5ae-4daf-ad5f-3e143e880d85 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1870 microversion: 2.32 time: 1.063065 Aug 27 02:40:06.503970 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1254/2263] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:05 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1870 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:06.862707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:07.187858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1b95acc7-b51b-45be-8f1f-a3974a50e2b5 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:07.206865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b95acc7-b51b-45be-8f1f-a3974a50e2b5 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:07.217025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b95acc7-b51b-45be-8f1f-a3974a50e2b5 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:07.222150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b95acc7-b51b-45be-8f1f-a3974a50e2b5 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:07.230284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b95acc7-b51b-45be-8f1f-a3974a50e2b5 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:07.239779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b95acc7-b51b-45be-8f1f-a3974a50e2b5 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:07.240533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b95acc7-b51b-45be-8f1f-a3974a50e2b5 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:07.591116 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1b95acc7-b51b-45be-8f1f-a3974a50e2b5 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 1.077833 Aug 27 02:40:07.603773 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1255/2264] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:40:06 2022] GET /compute/v2.1/os-services => generated 944 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:07.623209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:40:07.625233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:40:07.626261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:40:07.626990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:40:07.627874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:40:07.629973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f4988e01-8308-4a61-87e7-0ba38f40a7cf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:07.641070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f4988e01-8308-4a61-87e7-0ba38f40a7cf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:07.662989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:07.667101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:07.667667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4988e01-8308-4a61-87e7-0ba38f40a7cf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:07.671202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:07.671803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4988e01-8308-4a61-87e7-0ba38f40a7cf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:07.674271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4988e01-8308-4a61-87e7-0ba38f40a7cf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:07.677169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:07.679427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4988e01-8308-4a61-87e7-0ba38f40a7cf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:07.680009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:07.681285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:07.708116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4988e01-8308-4a61-87e7-0ba38f40a7cf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:07.709189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4988e01-8308-4a61-87e7-0ba38f40a7cf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:07.779492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Getting quotas for project 4d2da2e10e53450096a68048f98bd99a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:07.803728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Getting quotas for user 4cf03330b076434098eef9230222830e and project 4d2da2e10e53450096a68048f98bd99a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:07.988959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:40:07.992930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a6d793a-24a3-46ca-9d3d-9fc99f57c5ef',volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:40:08.297189 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-97d994c4-4b91-430a-a6bb-1b59c83d190c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.534434 Aug 27 02:40:08.300286 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1010/2265] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:40:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4540 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:40:08.311221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5eeafa7e-ea41-4fb2-82cb-36022fc5c81d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:08.314133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5eeafa7e-ea41-4fb2-82cb-36022fc5c81d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:08.330116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eeafa7e-ea41-4fb2-82cb-36022fc5c81d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:08.336375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eeafa7e-ea41-4fb2-82cb-36022fc5c81d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:08.337050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eeafa7e-ea41-4fb2-82cb-36022fc5c81d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:08.338592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eeafa7e-ea41-4fb2-82cb-36022fc5c81d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:08.341629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eeafa7e-ea41-4fb2-82cb-36022fc5c81d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:08.343917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eeafa7e-ea41-4fb2-82cb-36022fc5c81d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:08.564525 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5eeafa7e-ea41-4fb2-82cb-36022fc5c81d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/action" status: 202 len: 0 microversion: 2.1 time: 0.262538 Aug 27 02:40:08.569312 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1011/2266] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:08 2022] POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:08.580921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-128bd489-b527-4e4d-a9c1-c0a2112c07dd req-153b9677-5499-41e4-a00b-cbe33566c9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "tag": "ea16f397-cede-434b-8c29-fdce0d801498"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:08.607402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-128bd489-b527-4e4d-a9c1-c0a2112c07dd req-153b9677-5499-41e4-a00b-cbe33566c9aa service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:08.612084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-128bd489-b527-4e4d-a9c1-c0a2112c07dd req-153b9677-5499-41e4-a00b-cbe33566c9aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:08.613268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-128bd489-b527-4e4d-a9c1-c0a2112c07dd req-153b9677-5499-41e4-a00b-cbe33566c9aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:08.644375 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-128bd489-b527-4e4d-a9c1-c0a2112c07dd req-153b9677-5499-41e4-a00b-cbe33566c9aa service nova] Creating event network-changed:ea16f397-cede-434b-8c29-fdce0d801498 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:40:08.658286 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-128bd489-b527-4e4d-a9c1-c0a2112c07dd req-153b9677-5499-41e4-a00b-cbe33566c9aa service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086276 Aug 27 02:40:08.661175 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1012/2267] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:08.677636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:08.679147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:08.695947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:08.697143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:08.701327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:08.704888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:08.705659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:08.707322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:09.468125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f4988e01-8308-4a61-87e7-0ba38f40a7cf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:09.515907 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f4988e01-8308-4a61-87e7-0ba38f40a7cf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1314 microversion: 2.1 time: 1.915198 Aug 27 02:40:09.529652 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1256/2268] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:07 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1314 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:09.563641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:09.564793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:09.585208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:09.585727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:09.594199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:09.594993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:09.595486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:09.595930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.020047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:10.043055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:10.044605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:10.046524 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a0adc938-7836-4c36-8cbc-a90e2ba167aa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1792 microversion: 2.20 time: 1.381891 Aug 27 02:40:10.054142 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1013/2269] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:08 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1792 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:10.071088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a6ff8e45-4bd4-46b0-80f1-426fc952089e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:10.092140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6ff8e45-4bd4-46b0-80f1-426fc952089e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.093002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6ff8e45-4bd4-46b0-80f1-426fc952089e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.093785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6ff8e45-4bd4-46b0-80f1-426fc952089e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.094880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6ff8e45-4bd4-46b0-80f1-426fc952089e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.100325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6ff8e45-4bd4-46b0-80f1-426fc952089e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.101194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6ff8e45-4bd4-46b0-80f1-426fc952089e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.207516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:10.218832 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a6ff8e45-4bd4-46b0-80f1-426fc952089e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?host=n-d-852084-5" status: 200 len: 578 microversion: 2.1 time: 0.163134 Aug 27 02:40:10.224622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:10.230115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:10.231865 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-756d3d05-4fc7-4e34-83f6-21ff86972ab4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1870 microversion: 2.32 time: 0.699044 Aug 27 02:40:10.234385 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1257/2270] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:09 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1870 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:10.241213 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1014/2271] 10.222.0.99 () {58 vars in 1172 bytes} [Sat Aug 27 02:40:10 2022] GET /compute/v2.1/os-services?host=n-d-852084-5 => generated 578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:10.246325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:10.247502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:10.250549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2aaf6f77-d126-419e-b64c-89062053189a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:10.259755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2aaf6f77-d126-419e-b64c-89062053189a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:10.269244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.270193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.271139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.272095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.275794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.276681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.278602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aaf6f77-d126-419e-b64c-89062053189a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.279291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aaf6f77-d126-419e-b64c-89062053189a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.280654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aaf6f77-d126-419e-b64c-89062053189a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.285011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aaf6f77-d126-419e-b64c-89062053189a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.290049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aaf6f77-d126-419e-b64c-89062053189a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.293984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aaf6f77-d126-419e-b64c-89062053189a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.482669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:10.495762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:10.499595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:10.502454 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6af18769-8043-45a8-a5b5-a14d2399eee4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1232 microversion: 2.25 time: 0.264643 Aug 27 02:40:10.503311 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1258/2272] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:10 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1232 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:10.512266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-bff1d9fd-dd21-46ba-b244-01c7e5bfccf9 req-ec012454-7863-4b9a-9ff8-c399a1f26e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120c91be-4afa-4162-8769-618367cf59c6", "tag": "78c29adc-056f-496c-9618-0392a270c5f5"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:10.534374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bff1d9fd-dd21-46ba-b244-01c7e5bfccf9 req-ec012454-7863-4b9a-9ff8-c399a1f26e2e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.534860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bff1d9fd-dd21-46ba-b244-01c7e5bfccf9 req-ec012454-7863-4b9a-9ff8-c399a1f26e2e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.541733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bff1d9fd-dd21-46ba-b244-01c7e5bfccf9 req-ec012454-7863-4b9a-9ff8-c399a1f26e2e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.570526 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-bff1d9fd-dd21-46ba-b244-01c7e5bfccf9 req-ec012454-7863-4b9a-9ff8-c399a1f26e2e service nova] Creating event network-changed:78c29adc-056f-496c-9618-0392a270c5f5 for instance 120c91be-4afa-4162-8769-618367cf59c6 on n-h1-852084-5 Aug 27 02:40:10.578543 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-bff1d9fd-dd21-46ba-b244-01c7e5bfccf9 req-ec012454-7863-4b9a-9ff8-c399a1f26e2e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074156 Aug 27 02:40:10.581961 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1259/2273] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:10.595081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61b7c6ef-5052-492a-85b9-8639ef88b70e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:10.599800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61b7c6ef-5052-492a-85b9-8639ef88b70e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.601049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61b7c6ef-5052-492a-85b9-8639ef88b70e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.601696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61b7c6ef-5052-492a-85b9-8639ef88b70e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.608348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61b7c6ef-5052-492a-85b9-8639ef88b70e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.609133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61b7c6ef-5052-492a-85b9-8639ef88b70e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.616191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61b7c6ef-5052-492a-85b9-8639ef88b70e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.692157 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61b7c6ef-5052-492a-85b9-8639ef88b70e tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.108321 Aug 27 02:40:10.709018 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1260/2274] 10.222.0.99 () {58 vars in 1176 bytes} [Sat Aug 27 02:40:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:10.726217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b6ded540-3022-434a-bd84-aff1357daced tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:10.728809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b6ded540-3022-434a-bd84-aff1357daced tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:10.745940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6ded540-3022-434a-bd84-aff1357daced tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.749789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6ded540-3022-434a-bd84-aff1357daced tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.750358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6ded540-3022-434a-bd84-aff1357daced tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:10.752516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6ded540-3022-434a-bd84-aff1357daced tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:10.754330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6ded540-3022-434a-bd84-aff1357daced tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:10.754950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6ded540-3022-434a-bd84-aff1357daced tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:11.060609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2aaf6f77-d126-419e-b64c-89062053189a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:11.074909 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2aaf6f77-d126-419e-b64c-89062053189a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1516 microversion: 2.1 time: 0.831710 Aug 27 02:40:11.086699 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1015/2275] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:10 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1516 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:11.107464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c9f30b47-9e27-40d8-9016-e26058d5ea80 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:11.119789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f30b47-9e27-40d8-9016-e26058d5ea80 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:11.123909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f30b47-9e27-40d8-9016-e26058d5ea80 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:11.125889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f30b47-9e27-40d8-9016-e26058d5ea80 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:11.127685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f30b47-9e27-40d8-9016-e26058d5ea80 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:11.129331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f30b47-9e27-40d8-9016-e26058d5ea80 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:11.130355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9f30b47-9e27-40d8-9016-e26058d5ea80 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:11.198972 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c9f30b47-9e27-40d8-9016-e26058d5ea80 tempest-ServicesAdminTestJSON-1186986477 tempest-ServicesAdminTestJSON-1186986477-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.114329 Aug 27 02:40:11.204403 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1016/2276] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:40:11 2022] GET /compute/v2.1/os-services => generated 944 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:11.297957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:11.298891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:11.315579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:11.316373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:11.317417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:11.322006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:11.322763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:11.325908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:11.853839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6ded540-3022-434a-bd84-aff1357daced tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:11.863047 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b6ded540-3022-434a-bd84-aff1357daced tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1314 microversion: 2.1 time: 1.152398 Aug 27 02:40:11.863654 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1261/2277] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:10 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1314 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:11.899530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:11.900234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:11.917440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:11.930076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:11.931021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:11.934212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:11.935244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:11.939184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:11.942253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:12.734887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:12.752439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:12.758542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:12.762924 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7934cc12-3bcc-4d11-a5c1-a583df47c3a5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1250 microversion: 2.25 time: 0.898067 Aug 27 02:40:12.776412 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1262/2278] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:11 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1250 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:12.820205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-769d96cf-d902-4014-94ca-76376219628f req-9ef68455-f965-4e6e-8c61-3423b61bcb4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "tag": "fa02d9de-658c-4012-8350-0eb7421c3221"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:12.861171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-769d96cf-d902-4014-94ca-76376219628f req-9ef68455-f965-4e6e-8c61-3423b61bcb4d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:12.861933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-769d96cf-d902-4014-94ca-76376219628f req-9ef68455-f965-4e6e-8c61-3423b61bcb4d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:12.862102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-769d96cf-d902-4014-94ca-76376219628f req-9ef68455-f965-4e6e-8c61-3423b61bcb4d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:12.908486 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-769d96cf-d902-4014-94ca-76376219628f req-9ef68455-f965-4e6e-8c61-3423b61bcb4d service nova] Creating event network-changed:fa02d9de-658c-4012-8350-0eb7421c3221 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:40:12.925593 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-769d96cf-d902-4014-94ca-76376219628f req-9ef68455-f965-4e6e-8c61-3423b61bcb4d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147464 Aug 27 02:40:12.926646 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1263/2279] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:12.931995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:12.948924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0b53a01d-a12e-45ab-9733-3a6c4c19ab82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:12.960316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0b53a01d-a12e-45ab-9733-3a6c4c19ab82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:12.960480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:12.962265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:12.973995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b53a01d-a12e-45ab-9733-3a6c4c19ab82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:12.975179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b53a01d-a12e-45ab-9733-3a6c4c19ab82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:12.977892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b53a01d-a12e-45ab-9733-3a6c4c19ab82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:12.979064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b53a01d-a12e-45ab-9733-3a6c4c19ab82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:12.979774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b53a01d-a12e-45ab-9733-3a6c4c19ab82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:12.979885 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd6f4911-1ed1-4d12-9fbb-89b4cebe6392 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 1.682312 Aug 27 02:40:12.980565 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1017/2280] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:11 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:12.987082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b53a01d-a12e-45ab-9733-3a6c4c19ab82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:13.830674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:13.831612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:13.856601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:13.859140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:13.880029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:13.900524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:13.901301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:13.901996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:14.234317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:14.283143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:14.288217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:14.331521 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-03492993-30fd-4f10-9545-c0bf53dd6104 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1250 microversion: 2.25 time: 0.507595 Aug 27 02:40:14.364414 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1018/2281] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:13 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1250 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:40:14.418497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:14.419146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:14.448004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:14.448822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:14.469574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:14.473413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:14.474792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:14.476949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:14.503526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0b53a01d-a12e-45ab-9733-3a6c4c19ab82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:14.549230 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0b53a01d-a12e-45ab-9733-3a6c4c19ab82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1314 microversion: 2.1 time: 1.617863 Aug 27 02:40:14.556632 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1264/2282] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:12 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1314 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:15.372900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:15.375246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:15.428444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:15.428444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:15.431800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:15.442259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:15.444951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:15.447706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:15.759689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:15.799006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:15.812023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:15.815640 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c2d8f7ee-6b8b-4727-ae43-b38a585b8ffb tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1250 microversion: 2.25 time: 0.448444 Aug 27 02:40:15.821361 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1265/2283] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:15 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1250 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:15.852830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3451586e-b695-4b66-aafa-ecede2777aa0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:15.855045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3451586e-b695-4b66-aafa-ecede2777aa0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:15.885798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3451586e-b695-4b66-aafa-ecede2777aa0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:15.893719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3451586e-b695-4b66-aafa-ecede2777aa0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:15.895127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3451586e-b695-4b66-aafa-ecede2777aa0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:15.897288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3451586e-b695-4b66-aafa-ecede2777aa0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:15.903393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3451586e-b695-4b66-aafa-ecede2777aa0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:15.907153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3451586e-b695-4b66-aafa-ecede2777aa0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.090555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:16.128390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:16.133931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:16.137331 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cd2eb286-45f3-49ae-a00e-525d7143f75e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 1.770729 Aug 27 02:40:16.144497 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1019/2284] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:14 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:16.155409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c41573b-04aa-4caa-be11-dd65c357d29d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:16.160713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4c41573b-04aa-4caa-be11-dd65c357d29d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:16.179361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c41573b-04aa-4caa-be11-dd65c357d29d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.183415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c41573b-04aa-4caa-be11-dd65c357d29d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.184357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c41573b-04aa-4caa-be11-dd65c357d29d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.202834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c41573b-04aa-4caa-be11-dd65c357d29d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.203613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c41573b-04aa-4caa-be11-dd65c357d29d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.204272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c41573b-04aa-4caa-be11-dd65c357d29d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.316267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-4c41573b-04aa-4caa-be11-dd65c357d29d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lazy-loading 'flavor' on Instance uuid f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:16.561215 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4c41573b-04aa-4caa-be11-dd65c357d29d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/action" status: 200 len: 32 microversion: 2.1 time: 0.412979 Aug 27 02:40:16.562206 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1020/2285] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:16 2022] POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/action => generated 32 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:16.580047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5c2dfcab-99bb-46d4-9dae-821e285a25d4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:16.582752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5c2dfcab-99bb-46d4-9dae-821e285a25d4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:16.596127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3451586e-b695-4b66-aafa-ecede2777aa0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:16.599848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2dfcab-99bb-46d4-9dae-821e285a25d4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.603143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2dfcab-99bb-46d4-9dae-821e285a25d4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.605907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2dfcab-99bb-46d4-9dae-821e285a25d4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.610305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2dfcab-99bb-46d4-9dae-821e285a25d4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.613473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2dfcab-99bb-46d4-9dae-821e285a25d4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.616481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c2dfcab-99bb-46d4-9dae-821e285a25d4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.625399 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3451586e-b695-4b66-aafa-ecede2777aa0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1314 microversion: 2.1 time: 0.801795 Aug 27 02:40:16.642342 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1266/2286] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:15 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:16.719332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:16.719640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ba52a576-0b08-4cd3-9cf9-12b186928422 req-99b2e44e-f0e4-46a1-bc58-b46a6b4c05bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120c91be-4afa-4162-8769-618367cf59c6", "name": "network-vif-plugged", "status": "completed", "tag": "78c29adc-056f-496c-9618-0392a270c5f5"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:16.757612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ba52a576-0b08-4cd3-9cf9-12b186928422 req-99b2e44e-f0e4-46a1-bc58-b46a6b4c05bb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.759054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ba52a576-0b08-4cd3-9cf9-12b186928422 req-99b2e44e-f0e4-46a1-bc58-b46a6b4c05bb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.762203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ba52a576-0b08-4cd3-9cf9-12b186928422 req-99b2e44e-f0e4-46a1-bc58-b46a6b4c05bb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.803115 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ba52a576-0b08-4cd3-9cf9-12b186928422 req-99b2e44e-f0e4-46a1-bc58-b46a6b4c05bb service nova] Creating event network-vif-plugged:78c29adc-056f-496c-9618-0392a270c5f5 for instance 120c91be-4afa-4162-8769-618367cf59c6 on n-h1-852084-5 Aug 27 02:40:16.818391 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ba52a576-0b08-4cd3-9cf9-12b186928422 req-99b2e44e-f0e4-46a1-bc58-b46a6b4c05bb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112455 Aug 27 02:40:16.821211 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1267/2287] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:16.832546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-0ad596c5-bbfa-4402-a8ae-010eaaeaf329 req-a9870d66-8031-477b-aa1b-67f60721a33e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "tag": "3fd3c81a-a52d-487b-b96d-897eb5de6ea3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:16.849577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0ad596c5-bbfa-4402-a8ae-010eaaeaf329 req-a9870d66-8031-477b-aa1b-67f60721a33e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.850712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0ad596c5-bbfa-4402-a8ae-010eaaeaf329 req-a9870d66-8031-477b-aa1b-67f60721a33e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.851415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0ad596c5-bbfa-4402-a8ae-010eaaeaf329 req-a9870d66-8031-477b-aa1b-67f60721a33e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.872079 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-0ad596c5-bbfa-4402-a8ae-010eaaeaf329 req-a9870d66-8031-477b-aa1b-67f60721a33e service nova] Creating event network-changed:3fd3c81a-a52d-487b-b96d-897eb5de6ea3 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:40:16.882007 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-0ad596c5-bbfa-4402-a8ae-010eaaeaf329 req-a9870d66-8031-477b-aa1b-67f60721a33e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058674 Aug 27 02:40:16.884149 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1268/2288] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:16.899053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:16.904335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:16.925200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.931170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.935058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:16.939184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:16.940494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:16.946799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:17.838508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:18.010374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5c2dfcab-99bb-46d4-9dae-821e285a25d4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:18.022897 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5c2dfcab-99bb-46d4-9dae-821e285a25d4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 1.453441 Aug 27 02:40:18.039205 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1021/2289] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:16 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:18.044620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:18.051394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:18.065350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:18.068376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:18.069094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:18.074740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:18.075477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:18.076638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:18.760585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:18.782876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:18.784955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:18.786478 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ea1fcad9-960a-4572-9f6c-e2ad61fb8dfa tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1292 microversion: 2.25 time: 1.900461 Aug 27 02:40:18.802718 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1269/2290] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:16 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1292 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:18.809133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-03cbf9bb-842d-4842-a9c0-ee17b15f6484 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:18.809841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-03cbf9bb-842d-4842-a9c0-ee17b15f6484 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:18.826676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03cbf9bb-842d-4842-a9c0-ee17b15f6484 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:18.827203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03cbf9bb-842d-4842-a9c0-ee17b15f6484 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:18.827721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03cbf9bb-842d-4842-a9c0-ee17b15f6484 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:18.828465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03cbf9bb-842d-4842-a9c0-ee17b15f6484 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:18.828968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03cbf9bb-842d-4842-a9c0-ee17b15f6484 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:18.829399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03cbf9bb-842d-4842-a9c0-ee17b15f6484 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.085323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-03cbf9bb-842d-4842-a9c0-ee17b15f6484 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:19.093798 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-03cbf9bb-842d-4842-a9c0-ee17b15f6484 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1314 microversion: 2.1 time: 0.289641 Aug 27 02:40:19.094412 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1270/2291] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:18 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:19.112398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f7df6a82-5371-4fd4-a0df-f4c69689951e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:19.113321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f7df6a82-5371-4fd4-a0df-f4c69689951e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:19.127315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7df6a82-5371-4fd4-a0df-f4c69689951e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.131430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7df6a82-5371-4fd4-a0df-f4c69689951e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.131900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7df6a82-5371-4fd4-a0df-f4c69689951e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.132654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7df6a82-5371-4fd4-a0df-f4c69689951e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.133301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7df6a82-5371-4fd4-a0df-f4c69689951e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.137171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7df6a82-5371-4fd4-a0df-f4c69689951e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.374814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:19.417284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:19.427711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:19.434238 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0fac149c-8d4a-4dda-a25b-a1b1862f6e30 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 1.390496 Aug 27 02:40:19.439360 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1022/2292] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:18 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:19.810848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ff880dac-12ff-4181-b807-0f55ac0eb94f req-eedcc0de-c7ab-48cd-ad87-efe2a81291ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "tag": "2b0d5ce5-a7a9-4698-8572-d722b196f9c1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:19.824042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ff880dac-12ff-4181-b807-0f55ac0eb94f req-eedcc0de-c7ab-48cd-ad87-efe2a81291ee service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.828147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ff880dac-12ff-4181-b807-0f55ac0eb94f req-eedcc0de-c7ab-48cd-ad87-efe2a81291ee service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.828854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ff880dac-12ff-4181-b807-0f55ac0eb94f req-eedcc0de-c7ab-48cd-ad87-efe2a81291ee service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.861391 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ff880dac-12ff-4181-b807-0f55ac0eb94f req-eedcc0de-c7ab-48cd-ad87-efe2a81291ee service nova] Creating event network-changed:2b0d5ce5-a7a9-4698-8572-d722b196f9c1 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:40:19.869654 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ff880dac-12ff-4181-b807-0f55ac0eb94f req-eedcc0de-c7ab-48cd-ad87-efe2a81291ee service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066241 Aug 27 02:40:19.875063 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1023/2293] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 02:40:19.893211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:19.901101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:19.918984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.925662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.926411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:19.927717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:19.928483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:19.929098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:20.482994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f7df6a82-5371-4fd4-a0df-f4c69689951e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:20.550107 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f7df6a82-5371-4fd4-a0df-f4c69689951e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 1.447538 Aug 27 02:40:20.569179 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1271/2294] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:19 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:20.590897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-febd030a-dc45-4db0-804f-01df993dbd98 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:20.596430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-febd030a-dc45-4db0-804f-01df993dbd98 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:20.617765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-febd030a-dc45-4db0-804f-01df993dbd98 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:20.618269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-febd030a-dc45-4db0-804f-01df993dbd98 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:20.618717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-febd030a-dc45-4db0-804f-01df993dbd98 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:20.619452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-febd030a-dc45-4db0-804f-01df993dbd98 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:20.619922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-febd030a-dc45-4db0-804f-01df993dbd98 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:20.620354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-febd030a-dc45-4db0-804f-01df993dbd98 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:20.720971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:21.068658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:21.084119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:21.086120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:21.087360 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-efeeff33-4756-4a7e-b17d-faba5b845ee0 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1292 microversion: 2.25 time: 1.203227 Aug 27 02:40:21.101755 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1024/2295] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:19 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1292 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:21.103131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:21.103985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:21.121914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.124793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.128962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.131258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.132327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.132740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.170812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:21.521243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-febd030a-dc45-4db0-804f-01df993dbd98 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:21.547838 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-febd030a-dc45-4db0-804f-01df993dbd98 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1501 microversion: 2.1 time: 0.989449 Aug 27 02:40:21.556693 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1272/2296] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:20 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1501 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:21.626726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-145dcd31-76d0-4f8e-ae08-d6ecb16d6619 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:21.627828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-145dcd31-76d0-4f8e-ae08-d6ecb16d6619 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:21.669620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-145dcd31-76d0-4f8e-ae08-d6ecb16d6619 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.670796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-145dcd31-76d0-4f8e-ae08-d6ecb16d6619 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.671757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-145dcd31-76d0-4f8e-ae08-d6ecb16d6619 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.673027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-145dcd31-76d0-4f8e-ae08-d6ecb16d6619 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:21.673885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-145dcd31-76d0-4f8e-ae08-d6ecb16d6619 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:21.674686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-145dcd31-76d0-4f8e-ae08-d6ecb16d6619 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:21.768379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:22.496974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-145dcd31-76d0-4f8e-ae08-d6ecb16d6619 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:22.513588 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-145dcd31-76d0-4f8e-ae08-d6ecb16d6619 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.929812 Aug 27 02:40:22.516025 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1273/2297] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:21 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:22.529867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bca75c6e-073d-4d11-a994-c6d5abd79dae tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:22.553865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bca75c6e-073d-4d11-a994-c6d5abd79dae tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:22.584808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca75c6e-073d-4d11-a994-c6d5abd79dae tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.588600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca75c6e-073d-4d11-a994-c6d5abd79dae tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.591868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca75c6e-073d-4d11-a994-c6d5abd79dae tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:22.595896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca75c6e-073d-4d11-a994-c6d5abd79dae tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.599354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca75c6e-073d-4d11-a994-c6d5abd79dae tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.603016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca75c6e-073d-4d11-a994-c6d5abd79dae tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:22.647353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:22.670928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:22.672485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:22.679331 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-feb63b14-9c46-4c77-8d53-b18ed0c719bb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 1.579480 Aug 27 02:40:22.694763 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1025/2298] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:21 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:22.726003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-1196615d-1fc0-4cc6-ad8a-e2e27d3d5a6c req-8e625f63-7cf6-4b76-b7bf-73b5e6104c07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f562df2c-cfe6-463e-89a2-b5dc19206114", "tag": "71f73dc2-9f50-4ee7-807a-67585a999a89"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:22.751726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1196615d-1fc0-4cc6-ad8a-e2e27d3d5a6c req-8e625f63-7cf6-4b76-b7bf-73b5e6104c07 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.754241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1196615d-1fc0-4cc6-ad8a-e2e27d3d5a6c req-8e625f63-7cf6-4b76-b7bf-73b5e6104c07 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.756815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1196615d-1fc0-4cc6-ad8a-e2e27d3d5a6c req-8e625f63-7cf6-4b76-b7bf-73b5e6104c07 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:22.843048 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1196615d-1fc0-4cc6-ad8a-e2e27d3d5a6c req-8e625f63-7cf6-4b76-b7bf-73b5e6104c07 service nova] Creating event network-changed:71f73dc2-9f50-4ee7-807a-67585a999a89 for instance f562df2c-cfe6-463e-89a2-b5dc19206114 on n-h2-852084-5 Aug 27 02:40:22.901527 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-1196615d-1fc0-4cc6-ad8a-e2e27d3d5a6c req-8e625f63-7cf6-4b76-b7bf-73b5e6104c07 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204947 Aug 27 02:40:22.914451 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1026/2299] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:22.938904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:22.945239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:22.974583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.983827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.994840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:22.996513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:22.997633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:22.999220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:23.658399 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bca75c6e-073d-4d11-a994-c6d5abd79dae tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action" status: 200 len: 14 microversion: 2.1 time: 1.140570 Aug 27 02:40:23.659174 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1274/2300] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:22 2022] POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action => generated 14 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:23.668157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a1007a35-61bc-48d3-8286-07eccaeeef67 req-7cfef746-8ce7-4763-9f65-b38327d0862e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "tag": "51a61470-c7d5-497f-9946-3031f09ce89e"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:23.710700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a1007a35-61bc-48d3-8286-07eccaeeef67 req-7cfef746-8ce7-4763-9f65-b38327d0862e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:23.711194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a1007a35-61bc-48d3-8286-07eccaeeef67 req-7cfef746-8ce7-4763-9f65-b38327d0862e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:23.711635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a1007a35-61bc-48d3-8286-07eccaeeef67 req-7cfef746-8ce7-4763-9f65-b38327d0862e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:23.777713 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a1007a35-61bc-48d3-8286-07eccaeeef67 req-7cfef746-8ce7-4763-9f65-b38327d0862e service nova] Creating event network-changed:51a61470-c7d5-497f-9946-3031f09ce89e for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:40:23.803615 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a1007a35-61bc-48d3-8286-07eccaeeef67 req-7cfef746-8ce7-4763-9f65-b38327d0862e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140866 Aug 27 02:40:23.808897 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1275/2301] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:23.835531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b178ba71-1e11-41ec-8fd9-f1ba8f411434 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:23.842796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b178ba71-1e11-41ec-8fd9-f1ba8f411434 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:23.863984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b178ba71-1e11-41ec-8fd9-f1ba8f411434 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:23.866732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b178ba71-1e11-41ec-8fd9-f1ba8f411434 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:23.868590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b178ba71-1e11-41ec-8fd9-f1ba8f411434 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:23.870964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b178ba71-1e11-41ec-8fd9-f1ba8f411434 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:23.873616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b178ba71-1e11-41ec-8fd9-f1ba8f411434 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:23.874589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b178ba71-1e11-41ec-8fd9-f1ba8f411434 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:24.339417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:24.355856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:24.365536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:24.384494 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-91aa78e1-53cf-4a74-a03f-dca6eabee9b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1292 microversion: 2.25 time: 1.463698 Aug 27 02:40:24.388166 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1027/2302] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:22 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1292 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:24.414846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:24.416758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:24.456004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:24.460612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:24.469194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:24.470766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:24.475306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:24.476502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:24.511347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b178ba71-1e11-41ec-8fd9-f1ba8f411434 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:24.530647 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b178ba71-1e11-41ec-8fd9-f1ba8f411434 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.716126 Aug 27 02:40:24.554098 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1276/2303] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:23 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:25.184289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2506f6ba-181b-4055-bac6-eec01b4388c1 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.190194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2506f6ba-181b-4055-bac6-eec01b4388c1 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.193643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2506f6ba-181b-4055-bac6-eec01b4388c1 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.195851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2506f6ba-181b-4055-bac6-eec01b4388c1 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.199093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2506f6ba-181b-4055-bac6-eec01b4388c1 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.200053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2506f6ba-181b-4055-bac6-eec01b4388c1 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.200799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2506f6ba-181b-4055-bac6-eec01b4388c1 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.285381 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2506f6ba-181b-4055-bac6-eec01b4388c1 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.727545 Aug 27 02:40:25.306372 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1277/2304] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:40:24 2022] GET /compute/v2.1/os-services => generated 944 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:25.314789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb6ac750-0f5e-4ed6-891c-03de30e70320 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:25.318245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fb6ac750-0f5e-4ed6-891c-03de30e70320 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:25.327743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6ac750-0f5e-4ed6-891c-03de30e70320 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.328999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6ac750-0f5e-4ed6-891c-03de30e70320 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.329720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6ac750-0f5e-4ed6-891c-03de30e70320 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.330925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6ac750-0f5e-4ed6-891c-03de30e70320 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.332219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6ac750-0f5e-4ed6-891c-03de30e70320 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.332917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6ac750-0f5e-4ed6-891c-03de30e70320 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.366308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:25.377656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:25.387663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:25.395960 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ff22b40e-c5f4-4215-a7e6-70e467b2f877 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 1.002468 Aug 27 02:40:25.397140 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1028/2305] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:24 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:25.407277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a250ba96-ca51-4c4e-b6d0-336b6a2ac9c0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.411339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a250ba96-ca51-4c4e-b6d0-336b6a2ac9c0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.414967 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fb6ac750-0f5e-4ed6-891c-03de30e70320 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action" status: 200 len: 14 microversion: 2.1 time: 0.106441 Aug 27 02:40:25.418051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a250ba96-ca51-4c4e-b6d0-336b6a2ac9c0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.418734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a250ba96-ca51-4c4e-b6d0-336b6a2ac9c0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.419756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a250ba96-ca51-4c4e-b6d0-336b6a2ac9c0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.420508 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1278/2306] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:25 2022] POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:25.421207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a250ba96-ca51-4c4e-b6d0-336b6a2ac9c0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.423812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a250ba96-ca51-4c4e-b6d0-336b6a2ac9c0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.429617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.430556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:25.440918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.441573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.443215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.444079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.444809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.445832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.493264 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a250ba96-ca51-4c4e-b6d0-336b6a2ac9c0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.094715 Aug 27 02:40:25.494164 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1029/2307] 10.222.0.99 () {58 vars in 1170 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:25.512968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-716a09c8-ed98-441d-bfc6-46b9cd88cae5 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.526929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-716a09c8-ed98-441d-bfc6-46b9cd88cae5 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.534544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-716a09c8-ed98-441d-bfc6-46b9cd88cae5 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.536221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-716a09c8-ed98-441d-bfc6-46b9cd88cae5 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.537398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-716a09c8-ed98-441d-bfc6-46b9cd88cae5 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.538167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-716a09c8-ed98-441d-bfc6-46b9cd88cae5 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.539883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-716a09c8-ed98-441d-bfc6-46b9cd88cae5 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.581759 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-716a09c8-ed98-441d-bfc6-46b9cd88cae5 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.072473 Aug 27 02:40:25.593771 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1030/2308] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/os-services => generated 944 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:25.601148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-565bbe7f-3c7a-4353-bb8b-a67fa5a2752f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.603122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-565bbe7f-3c7a-4353-bb8b-a67fa5a2752f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:25.611736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-565bbe7f-3c7a-4353-bb8b-a67fa5a2752f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.613337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-565bbe7f-3c7a-4353-bb8b-a67fa5a2752f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.614296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-565bbe7f-3c7a-4353-bb8b-a67fa5a2752f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.616008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-565bbe7f-3c7a-4353-bb8b-a67fa5a2752f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.616982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-565bbe7f-3c7a-4353-bb8b-a67fa5a2752f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.617696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-565bbe7f-3c7a-4353-bb8b-a67fa5a2752f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.767701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:25.786743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:25.799943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:25.801492 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c15422e9-022b-423c-87b8-aa75fc00d169 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1292 microversion: 2.25 time: 0.378553 Aug 27 02:40:25.817540 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1279/2309] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1292 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:25.823331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b2bfa3c-ea12-4f81-8b8e-8055375c3b64 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.828407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2bfa3c-ea12-4f81-8b8e-8055375c3b64 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.829144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2bfa3c-ea12-4f81-8b8e-8055375c3b64 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.829818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2bfa3c-ea12-4f81-8b8e-8055375c3b64 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.830764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2bfa3c-ea12-4f81-8b8e-8055375c3b64 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.831383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2bfa3c-ea12-4f81-8b8e-8055375c3b64 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.831987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2bfa3c-ea12-4f81-8b8e-8055375c3b64 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.860202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9b2bfa3c-ea12-4f81-8b8e-8055375c3b64 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?host=n-d-852084-5&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.041185 Aug 27 02:40:25.861114 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1280/2310] 10.222.0.99 () {58 vars in 1194 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/os-services?host=n-d-852084-5&binary=xxx => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:25.879371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d48e528b-96e8-4b9e-a17a-290b86db12e3 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.883507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48e528b-96e8-4b9e-a17a-290b86db12e3 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.884269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48e528b-96e8-4b9e-a17a-290b86db12e3 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.885120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48e528b-96e8-4b9e-a17a-290b86db12e3 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.886093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48e528b-96e8-4b9e-a17a-290b86db12e3 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.886741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48e528b-96e8-4b9e-a17a-290b86db12e3 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.887329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48e528b-96e8-4b9e-a17a-290b86db12e3 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.923498 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d48e528b-96e8-4b9e-a17a-290b86db12e3 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.042978 Aug 27 02:40:25.933649 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1281/2311] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/os-services => generated 944 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:40:25.939776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ed5e5230-1e05-4084-9c43-653ce63983e0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:25.946062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5e5230-1e05-4084-9c43-653ce63983e0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.947019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5e5230-1e05-4084-9c43-653ce63983e0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.947813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5e5230-1e05-4084-9c43-653ce63983e0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:25.948736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5e5230-1e05-4084-9c43-653ce63983e0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:25.949452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5e5230-1e05-4084-9c43-653ce63983e0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:25.949986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5e5230-1e05-4084-9c43-653ce63983e0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.035171 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ed5e5230-1e05-4084-9c43-653ce63983e0 tempest-ServicesAdminNegativeTestJSON-1482967094 tempest-ServicesAdminNegativeTestJSON-1482967094-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.099138 Aug 27 02:40:26.037513 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1282/2312] 10.222.0.99 () {58 vars in 1198 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:26.172257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-565bbe7f-3c7a-4353-bb8b-a67fa5a2752f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:26.181507 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-565bbe7f-3c7a-4353-bb8b-a67fa5a2752f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.586105 Aug 27 02:40:26.187527 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1031/2313] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:25 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:26.203505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-90e4b3b1-4c48-45db-899e-cc104a6b0151 req-96dab312-5f44-4b59-815a-777fd1469ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "tag": "5b8a4190-5436-4df2-9d49-7f30f4f5b7c6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:26.225397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-90e4b3b1-4c48-45db-899e-cc104a6b0151 req-96dab312-5f44-4b59-815a-777fd1469ee6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.230086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-90e4b3b1-4c48-45db-899e-cc104a6b0151 req-96dab312-5f44-4b59-815a-777fd1469ee6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.230847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-90e4b3b1-4c48-45db-899e-cc104a6b0151 req-96dab312-5f44-4b59-815a-777fd1469ee6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.266595 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-90e4b3b1-4c48-45db-899e-cc104a6b0151 req-96dab312-5f44-4b59-815a-777fd1469ee6 service nova] Creating event network-changed:5b8a4190-5436-4df2-9d49-7f30f4f5b7c6 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:40:26.415567 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-90e4b3b1-4c48-45db-899e-cc104a6b0151 req-96dab312-5f44-4b59-815a-777fd1469ee6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226030 Aug 27 02:40:26.417302 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1032/2314] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:26.428222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c4ef7d7-1c2b-4961-b1ec-7f8fec591a2e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:26.445620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c4ef7d7-1c2b-4961-b1ec-7f8fec591a2e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:26.461792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4ef7d7-1c2b-4961-b1ec-7f8fec591a2e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.464006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4ef7d7-1c2b-4961-b1ec-7f8fec591a2e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.464705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4ef7d7-1c2b-4961-b1ec-7f8fec591a2e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.468431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4ef7d7-1c2b-4961-b1ec-7f8fec591a2e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.469326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4ef7d7-1c2b-4961-b1ec-7f8fec591a2e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.470097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4ef7d7-1c2b-4961-b1ec-7f8fec591a2e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.573785 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c4ef7d7-1c2b-4961-b1ec-7f8fec591a2e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action" status: 200 len: 14 microversion: 2.1 time: 0.149819 Aug 27 02:40:26.574455 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1033/2315] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:26 2022] POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:26.586858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4abe17ba-e36c-40d6-93ef-7f2749c63b43 tempest-ServicesAdminNegativeTestJSON-1319051434 tempest-ServicesAdminNegativeTestJSON-1319051434-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:26.589261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:26.596192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:26.597075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4abe17ba-e36c-40d6-93ef-7f2749c63b43 tempest-ServicesAdminNegativeTestJSON-1319051434 tempest-ServicesAdminNegativeTestJSON-1319051434-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4ff936c8a3b5476e8c682d81e85ac32c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b51ce8d4eac44990a423bbdf9661b099', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4abe17ba-e36c-40d6-93ef-7f2749c63b43 tempest-ServicesAdminNegativeTestJSON-1319051434 tempest-ServicesAdminNegativeTestJSON-1319051434-project] Request method failure captured: Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYQVSqD0-g6jPGa5sslEDV9TQpt3zjUl83b7-R3TQCkl8pBT6WciehW4v0u1d_k3Z1J4aMSAoYmvs6q71fQRvGxj1pmdjCSC2YJia4D3f11E12WZ2MrgMOmHjP-dyozLgaQYyiZuNxg3vEbzvCtN5uxfcMucoCJCuTfuEKE7Mwal8FA Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: b51ce8d4eac44990a423bbdf9661b099 Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1319051434 Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b51ce8d4eac44990a423bbdf9661b099"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b51ce8d4eac44990a423bbdf9661b099"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b51ce8d4eac44990a423bbdf9661b099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b51ce8d4eac44990a423bbdf9661b099"}]}] Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1319051434 Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: b51ce8d4eac44990a423bbdf9661b099 Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1319051434 Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServicesAdminNegativeTestJSON-1319051434-project Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 4ff936c8a3b5476e8c682d81e85ac32c Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1319051434-project Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: action_args: {} Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:40:26.611265 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4abe17ba-e36c-40d6-93ef-7f2749c63b43 tempest-ServicesAdminNegativeTestJSON-1319051434 tempest-ServicesAdminNegativeTestJSON-1319051434-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4abe17ba-e36c-40d6-93ef-7f2749c63b43 tempest-ServicesAdminNegativeTestJSON-1319051434 tempest-ServicesAdminNegativeTestJSON-1319051434-project] 10.222.0.99 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.565422 Aug 27 02:40:26.623908 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1283/2316] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:40:26 2022] GET /compute/v2.1/os-services => generated 112 bytes in 567 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:40:26.631078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.631803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.632262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.633017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.633493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.633964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.844260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:26.845800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:26.896388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.896937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.897451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:26.898247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:26.913682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:26.918368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.346265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:27.365733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:27.367520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:27.372450 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cc9762f9-e903-43f0-a40c-a55846d74b79 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.795464 Aug 27 02:40:27.373487 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1034/2317] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:26 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:27.389423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d43dae5e-2090-4335-94f3-fafae60dcf7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:27.390372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d43dae5e-2090-4335-94f3-fafae60dcf7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:27.401756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43dae5e-2090-4335-94f3-fafae60dcf7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.402533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43dae5e-2090-4335-94f3-fafae60dcf7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.403194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43dae5e-2090-4335-94f3-fafae60dcf7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.404883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43dae5e-2090-4335-94f3-fafae60dcf7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.405543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43dae5e-2090-4335-94f3-fafae60dcf7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.406237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43dae5e-2090-4335-94f3-fafae60dcf7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.437153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:27.447519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:27.458051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:27.460022 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a32727e4-136b-4e42-8074-c44eed1dd5ca tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1292 microversion: 2.25 time: 0.629886 Aug 27 02:40:27.461222 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1284/2318] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:26 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1292 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:27.586983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5f1d1964-ac67-4741-b9a9-9fb0f46a64c9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:27.588535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5f1d1964-ac67-4741-b9a9-9fb0f46a64c9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:27.605754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f1d1964-ac67-4741-b9a9-9fb0f46a64c9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.606706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f1d1964-ac67-4741-b9a9-9fb0f46a64c9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.608173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f1d1964-ac67-4741-b9a9-9fb0f46a64c9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.609197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f1d1964-ac67-4741-b9a9-9fb0f46a64c9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:27.609904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f1d1964-ac67-4741-b9a9-9fb0f46a64c9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:27.610576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f1d1964-ac67-4741-b9a9-9fb0f46a64c9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:27.711750 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f1d1964-ac67-4741-b9a9-9fb0f46a64c9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action" status: 200 len: 14 microversion: 2.1 time: 0.129338 Aug 27 02:40:27.713090 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1285/2319] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:27 2022] POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:40:28.049337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d43dae5e-2090-4335-94f3-fafae60dcf7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:28.070061 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d43dae5e-2090-4335-94f3-fafae60dcf7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.686672 Aug 27 02:40:28.073225 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1035/2320] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:27 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:28.405647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:28.407492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:28.431754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.433072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.435966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.437762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.441232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.442688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.509287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:28.514424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:28.544759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.546011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.547177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.549460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.551185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.552398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.890873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:28.907572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:28.910847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:28.913445 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-17d79ee2-4844-40ce-a443-d0d1b39cffb7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.517203 Aug 27 02:40:28.928309 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1286/2321] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:28 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:28.942719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2c79f0e-30a2-44f2-81be-be759eb44659 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:28.945855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f2c79f0e-30a2-44f2-81be-be759eb44659 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:28.963973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2c79f0e-30a2-44f2-81be-be759eb44659 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.965382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2c79f0e-30a2-44f2-81be-be759eb44659 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.966852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2c79f0e-30a2-44f2-81be-be759eb44659 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:28.968223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2c79f0e-30a2-44f2-81be-be759eb44659 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:28.970195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2c79f0e-30a2-44f2-81be-be759eb44659 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:28.970975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2c79f0e-30a2-44f2-81be-be759eb44659 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.059025 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f2c79f0e-30a2-44f2-81be-be759eb44659 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action" status: 200 len: 14 microversion: 2.1 time: 0.128492 Aug 27 02:40:29.060686 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1287/2322] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:28 2022] POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:40:29.110058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-892090f6-41a8-4cdd-a2f5-b05eaaad5c42 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:29.111641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-892090f6-41a8-4cdd-a2f5-b05eaaad5c42 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:29.128264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-892090f6-41a8-4cdd-a2f5-b05eaaad5c42 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.129637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-892090f6-41a8-4cdd-a2f5-b05eaaad5c42 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.130670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-892090f6-41a8-4cdd-a2f5-b05eaaad5c42 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.132521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-892090f6-41a8-4cdd-a2f5-b05eaaad5c42 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.135036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-892090f6-41a8-4cdd-a2f5-b05eaaad5c42 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.136274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-892090f6-41a8-4cdd-a2f5-b05eaaad5c42 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.567274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:29.581496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:29.583893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:29.585477 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c4ed9f50-1394-4792-8524-702252fd265e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1280 microversion: 2.25 time: 1.103305 Aug 27 02:40:29.586352 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1036/2323] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:28 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1280 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:29.647662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-892090f6-41a8-4cdd-a2f5-b05eaaad5c42 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:29.665128 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-892090f6-41a8-4cdd-a2f5-b05eaaad5c42 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.567449 Aug 27 02:40:29.681120 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1288/2324] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:29 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:29.947481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:29.948472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:29.959174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.960277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.961311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:29.962617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:29.963506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:29.964345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:30.072312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d045df23-f1c6-41d9-93a0-7cf2e77e0c22 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:30.075394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d045df23-f1c6-41d9-93a0-7cf2e77e0c22 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:30.104004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d045df23-f1c6-41d9-93a0-7cf2e77e0c22 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:30.104909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d045df23-f1c6-41d9-93a0-7cf2e77e0c22 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:30.106092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d045df23-f1c6-41d9-93a0-7cf2e77e0c22 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:30.107087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d045df23-f1c6-41d9-93a0-7cf2e77e0c22 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:30.107733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d045df23-f1c6-41d9-93a0-7cf2e77e0c22 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:30.108368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d045df23-f1c6-41d9-93a0-7cf2e77e0c22 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:30.189272 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d045df23-f1c6-41d9-93a0-7cf2e77e0c22 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action" status: 200 len: 14 microversion: 2.1 time: 0.120888 Aug 27 02:40:30.190427 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1289/2325] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:30 2022] POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:40:30.612323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:30.613236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:30.630849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:30.631621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:30.651753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:30.655492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:30.660728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:30.666589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:31.002399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.020608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.022469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.026097 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b0e52447-b3ef-4883-9e4c-cbd00930ac28 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1280 microversion: 2.25 time: 0.418538 Aug 27 02:40:31.045813 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1290/2326] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:30 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1280 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:31.052133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fca824c2-8c2b-4de9-8c0c-6b7e4edc1dba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:31.059325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fca824c2-8c2b-4de9-8c0c-6b7e4edc1dba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:31.075283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fca824c2-8c2b-4de9-8c0c-6b7e4edc1dba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:31.076851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fca824c2-8c2b-4de9-8c0c-6b7e4edc1dba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:31.077026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fca824c2-8c2b-4de9-8c0c-6b7e4edc1dba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:31.077912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fca824c2-8c2b-4de9-8c0c-6b7e4edc1dba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:31.088271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fca824c2-8c2b-4de9-8c0c-6b7e4edc1dba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:31.088943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fca824c2-8c2b-4de9-8c0c-6b7e4edc1dba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:31.158073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.181897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.183679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.184972 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e3a5c4a3-03f7-4a19-99a3-86c23d51b95c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 1.245223 Aug 27 02:40:31.185904 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1037/2327] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:29 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:40:31.202487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b40e77df-78e4-486c-87ed-c4cdb4844c00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:31.205286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b40e77df-78e4-486c-87ed-c4cdb4844c00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:31.211864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:31.229167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b40e77df-78e4-486c-87ed-c4cdb4844c00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:31.233650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b40e77df-78e4-486c-87ed-c4cdb4844c00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:31.234415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b40e77df-78e4-486c-87ed-c4cdb4844c00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:31.235357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b40e77df-78e4-486c-87ed-c4cdb4844c00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:31.236037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b40e77df-78e4-486c-87ed-c4cdb4844c00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:31.237975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b40e77df-78e4-486c-87ed-c4cdb4844c00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:31.351868 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b40e77df-78e4-486c-87ed-c4cdb4844c00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action" status: 200 len: 14 microversion: 2.1 time: 0.153783 Aug 27 02:40:31.353113 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1038/2328] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:31 2022] POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:40:31.435891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fca824c2-8c2b-4de9-8c0c-6b7e4edc1dba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:31.459346 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fca824c2-8c2b-4de9-8c0c-6b7e4edc1dba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.411247 Aug 27 02:40:31.478571 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1291/2329] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:31 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:32.054782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:32.055673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:32.072989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.073849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.074395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.075348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.077257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.078148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.242029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:32.243744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:32.267994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.268902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.284437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.289718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:32.295126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:32.319011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:32.920124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:32.962381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:32.966230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:32.969580 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-08512659-150a-4042-a5f2-8dcd7360acd8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1280 microversion: 2.25 time: 0.919590 Aug 27 02:40:33.002334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:33.004181 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1039/2330] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:32 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1280 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:33.009966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65f0aa47-5196-40be-b87d-eb2d0ea9a8a6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:33.012695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65f0aa47-5196-40be-b87d-eb2d0ea9a8a6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:33.021095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f0aa47-5196-40be-b87d-eb2d0ea9a8a6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.022018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f0aa47-5196-40be-b87d-eb2d0ea9a8a6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.022660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f0aa47-5196-40be-b87d-eb2d0ea9a8a6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.023652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f0aa47-5196-40be-b87d-eb2d0ea9a8a6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.025056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f0aa47-5196-40be-b87d-eb2d0ea9a8a6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.026831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f0aa47-5196-40be-b87d-eb2d0ea9a8a6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.042189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:33.050033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:33.055754 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-85ea818f-ce3b-434a-bd42-0aee4c5aeca9 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.827425 Aug 27 02:40:33.062307 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1292/2331] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:32 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:40:33.071837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13273ba6-8c04-4ad6-bbde-814f4102e808 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:33.081977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13273ba6-8c04-4ad6-bbde-814f4102e808 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:33.106385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13273ba6-8c04-4ad6-bbde-814f4102e808 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.109890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13273ba6-8c04-4ad6-bbde-814f4102e808 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.118416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13273ba6-8c04-4ad6-bbde-814f4102e808 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.120517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13273ba6-8c04-4ad6-bbde-814f4102e808 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.123691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13273ba6-8c04-4ad6-bbde-814f4102e808 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.128719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13273ba6-8c04-4ad6-bbde-814f4102e808 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.133304 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65f0aa47-5196-40be-b87d-eb2d0ea9a8a6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action" status: 200 len: 8208 microversion: 2.1 time: 0.127252 Aug 27 02:40:33.134564 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1040/2332] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:33 2022] POST /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6/action => generated 8208 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:33.421072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74c75e65-a5df-41b1-beb9-2b69cdeeb52c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2ac30280>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:33.428905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74c75e65-a5df-41b1-beb9-2b69cdeeb52c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.429561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74c75e65-a5df-41b1-beb9-2b69cdeeb52c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.430181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74c75e65-a5df-41b1-beb9-2b69cdeeb52c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.443003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74c75e65-a5df-41b1-beb9-2b69cdeeb52c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.446111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74c75e65-a5df-41b1-beb9-2b69cdeeb52c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.447280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74c75e65-a5df-41b1-beb9-2b69cdeeb52c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.470104 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-74c75e65-a5df-41b1-beb9-2b69cdeeb52c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] HTTP exception thrown: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74c75e65-a5df-41b1-beb9-2b69cdeeb52c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Request method failure captured: Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: request: PUT /compute/v2.1/os-services/d243e51c-4633-4d10-b747-5918e00c5f01 HTTP/1.1 Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 56 Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYQg-IIAcp-750XqdQp4xJUVOeMRICUjFHW9yu3aZh5Et6fU2h2TOSQxt0tlr8u4MfkiPItXJlkZZpDOUbU1vmeM-7zFQJ-aIdn72sRr-lTkVw4oDC8HB4wjwSoklWQss_Gv07kDGSEnPDfkzaBR8rjoO5XAPoaCFMWGCVuZcyj66XM Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2cee5f3bc32847479cfae150855c93bf Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-661643556 Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2cee5f3bc32847479cfae150855c93bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2cee5f3bc32847479cfae150855c93bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2cee5f3bc32847479cfae150855c93bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2cee5f3bc32847479cfae150855c93bf"}]}] Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-661643556 Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2cee5f3bc32847479cfae150855c93bf Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-661643556 Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 25fd73e13c8249e1abbfa18fdf99098c Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: exception: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'd243e51c-4633-4d10-b747-5918e00c5f01', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:33.479043 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.487448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74c75e65-a5df-41b1-beb9-2b69cdeeb52c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Returning 404 to user: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:33.490374 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-74c75e65-a5df-41b1-beb9-2b69cdeeb52c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-services/d243e51c-4633-4d10-b747-5918e00c5f01" status: 404 len: 110 microversion: 2.53 time: 0.346525 Aug 27 02:40:33.491434 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1041/2333] 10.222.0.99 () {62 vars in 1309 bytes} [Sat Aug 27 02:40:33 2022] PUT /compute/v2.1/os-services/d243e51c-4633-4d10-b747-5918e00c5f01 => generated 110 bytes in 350 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:40:33.515507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5eda1a5e-5db1-4960-be15-5258dd8387a7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:33.516901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5eda1a5e-5db1-4960-be15-5258dd8387a7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:33.535036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eda1a5e-5db1-4960-be15-5258dd8387a7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.535964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eda1a5e-5db1-4960-be15-5258dd8387a7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.536775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eda1a5e-5db1-4960-be15-5258dd8387a7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.538462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eda1a5e-5db1-4960-be15-5258dd8387a7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.539634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eda1a5e-5db1-4960-be15-5258dd8387a7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.540784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eda1a5e-5db1-4960-be15-5258dd8387a7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.560626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-13273ba6-8c04-4ad6-bbde-814f4102e808 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:33.576394 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13273ba6-8c04-4ad6-bbde-814f4102e808 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.511476 Aug 27 02:40:33.582627 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1293/2334] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:33 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:33.600239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b89bbf58-59eb-4fbf-b9b9-87ad9afaa86e tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Action: 'update', calling method: .version_select at 0x7f4d2a256dc0>, body: {"status": "disabled"} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:33.606905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b89bbf58-59eb-4fbf-b9b9-87ad9afaa86e tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.607928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b89bbf58-59eb-4fbf-b9b9-87ad9afaa86e tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.608582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b89bbf58-59eb-4fbf-b9b9-87ad9afaa86e tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.625054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b89bbf58-59eb-4fbf-b9b9-87ad9afaa86e tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.626195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b89bbf58-59eb-4fbf-b9b9-87ad9afaa86e tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.627122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b89bbf58-59eb-4fbf-b9b9-87ad9afaa86e tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.643819 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-b89bbf58-59eb-4fbf-b9b9-87ad9afaa86e tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] HTTP exception thrown: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b89bbf58-59eb-4fbf-b9b9-87ad9afaa86e tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Request method failure captured: Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/os-services/d243e51c-4633-4d10-b747-5918e00c5f01 HTTP/1.1 Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 22 Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYQg-IIAcp-750XqdQp4xJUVOeMRICUjFHW9yu3aZh5Et6fU2h2TOSQxt0tlr8u4MfkiPItXJlkZZpDOUbU1vmeM-7zFQJ-aIdn72sRr-lTkVw4oDC8HB4wjwSoklWQss_Gv07kDGSEnPDfkzaBR8rjoO5XAPoaCFMWGCVuZcyj66XM Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2cee5f3bc32847479cfae150855c93bf Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-661643556 Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2cee5f3bc32847479cfae150855c93bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2cee5f3bc32847479cfae150855c93bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2cee5f3bc32847479cfae150855c93bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2cee5f3bc32847479cfae150855c93bf"}]}] Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-661643556 Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2cee5f3bc32847479cfae150855c93bf Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-661643556 Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 25fd73e13c8249e1abbfa18fdf99098c Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: {"status": "disabled"} Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: exception: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd243e51c-4633-4d10-b747-5918e00c5f01', 'body': {'status': 'disabled'}} Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:33.647589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b89bbf58-59eb-4fbf-b9b9-87ad9afaa86e tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Returning 404 to user: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:33.651282 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b89bbf58-59eb-4fbf-b9b9-87ad9afaa86e tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-services/d243e51c-4633-4d10-b747-5918e00c5f01" status: 404 len: 110 microversion: 2.53 time: 0.066191 Aug 27 02:40:33.657877 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1294/2335] 10.222.0.99 () {62 vars in 1309 bytes} [Sat Aug 27 02:40:33 2022] PUT /compute/v2.1/os-services/d243e51c-4633-4d10-b747-5918e00c5f01 => generated 110 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:40:33.665073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7005f270-e0a9-4c5e-a673-14daa4b7703c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Action: 'update', calling method: .version_select at 0x7f4d29418670>, body: {"status": "enabled"} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:33.671458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7005f270-e0a9-4c5e-a673-14daa4b7703c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.672297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7005f270-e0a9-4c5e-a673-14daa4b7703c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.673133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7005f270-e0a9-4c5e-a673-14daa4b7703c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.683046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7005f270-e0a9-4c5e-a673-14daa4b7703c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.683541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7005f270-e0a9-4c5e-a673-14daa4b7703c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.683989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7005f270-e0a9-4c5e-a673-14daa4b7703c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.697390 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-7005f270-e0a9-4c5e-a673-14daa4b7703c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] HTTP exception thrown: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7005f270-e0a9-4c5e-a673-14daa4b7703c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Request method failure captured: Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/os-services/d243e51c-4633-4d10-b747-5918e00c5f01 HTTP/1.1 Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 21 Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYQg-IIAcp-750XqdQp4xJUVOeMRICUjFHW9yu3aZh5Et6fU2h2TOSQxt0tlr8u4MfkiPItXJlkZZpDOUbU1vmeM-7zFQJ-aIdn72sRr-lTkVw4oDC8HB4wjwSoklWQss_Gv07kDGSEnPDfkzaBR8rjoO5XAPoaCFMWGCVuZcyj66XM Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2cee5f3bc32847479cfae150855c93bf Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-661643556 Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2cee5f3bc32847479cfae150855c93bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2cee5f3bc32847479cfae150855c93bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2cee5f3bc32847479cfae150855c93bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2cee5f3bc32847479cfae150855c93bf"}]}] Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-661643556 Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2cee5f3bc32847479cfae150855c93bf Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-661643556 Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 25fd73e13c8249e1abbfa18fdf99098c Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: {"status": "enabled"} Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: exception: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd243e51c-4633-4d10-b747-5918e00c5f01', 'body': {'status': 'enabled'}} Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:33.702281 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7005f270-e0a9-4c5e-a673-14daa4b7703c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Returning 404 to user: Service d243e51c-4633-4d10-b747-5918e00c5f01 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7005f270-e0a9-4c5e-a673-14daa4b7703c tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-services/d243e51c-4633-4d10-b747-5918e00c5f01" status: 404 len: 110 microversion: 2.53 time: 0.046346 Aug 27 02:40:33.711831 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1295/2336] 10.222.0.99 () {62 vars in 1309 bytes} [Sat Aug 27 02:40:33 2022] PUT /compute/v2.1/os-services/d243e51c-4633-4d10-b747-5918e00c5f01 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:40:33.721015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-951ff4ba-e760-4716-84b1-38e91e4c3069 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:33.728450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-951ff4ba-e760-4716-84b1-38e91e4c3069 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.730617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-951ff4ba-e760-4716-84b1-38e91e4c3069 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.731444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-951ff4ba-e760-4716-84b1-38e91e4c3069 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.733599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-951ff4ba-e760-4716-84b1-38e91e4c3069 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.735427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-951ff4ba-e760-4716-84b1-38e91e4c3069 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.736571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-951ff4ba-e760-4716-84b1-38e91e4c3069 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.791991 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-951ff4ba-e760-4716-84b1-38e91e4c3069 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.078269 Aug 27 02:40:33.798332 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1296/2337] 10.222.0.99 () {60 vars in 1178 bytes} [Sat Aug 27 02:40:33 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:33.810783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d8a0255a-bad3-440b-b031-af11169ff8e0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:33.817302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8a0255a-bad3-440b-b031-af11169ff8e0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.818464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8a0255a-bad3-440b-b031-af11169ff8e0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.819162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8a0255a-bad3-440b-b031-af11169ff8e0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.820458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8a0255a-bad3-440b-b031-af11169ff8e0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.821264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8a0255a-bad3-440b-b031-af11169ff8e0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.821995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8a0255a-bad3-440b-b031-af11169ff8e0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.879488 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d8a0255a-bad3-440b-b031-af11169ff8e0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.075900 Aug 27 02:40:33.881216 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1297/2338] 10.222.0.99 () {60 vars in 1211 bytes} [Sat Aug 27 02:40:33 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:33.899608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd6f675b-075a-485c-abf9-765e1b2be8f6 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:33.904217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd6f675b-075a-485c-abf9-765e1b2be8f6 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.905100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd6f675b-075a-485c-abf9-765e1b2be8f6 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.905820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd6f675b-075a-485c-abf9-765e1b2be8f6 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.906843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd6f675b-075a-485c-abf9-765e1b2be8f6 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.907546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd6f675b-075a-485c-abf9-765e1b2be8f6 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.908281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd6f675b-075a-485c-abf9-765e1b2be8f6 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.939699 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dd6f675b-075a-485c-abf9-765e1b2be8f6 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.046619 Aug 27 02:40:33.947809 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1298/2339] 10.222.0.99 () {60 vars in 1178 bytes} [Sat Aug 27 02:40:33 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:33.953839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50a36175-b8e1-4eb0-b6de-29f28e0ebd49 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:33.958567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50a36175-b8e1-4eb0-b6de-29f28e0ebd49 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.962523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50a36175-b8e1-4eb0-b6de-29f28e0ebd49 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.963112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50a36175-b8e1-4eb0-b6de-29f28e0ebd49 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.964102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50a36175-b8e1-4eb0-b6de-29f28e0ebd49 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:33.964605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50a36175-b8e1-4eb0-b6de-29f28e0ebd49 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:33.965049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50a36175-b8e1-4eb0-b6de-29f28e0ebd49 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:33.996714 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-50a36175-b8e1-4eb0-b6de-29f28e0ebd49 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?host=n-d-852084-5&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.047586 Aug 27 02:40:34.004982 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1299/2340] 10.222.0.99 () {60 vars in 1235 bytes} [Sat Aug 27 02:40:33 2022] GET /compute/v2.1/os-services?host=n-d-852084-5&binary=xxx => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:40:34.012125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1826c598-5ee3-4457-b95d-b97f277b3cf0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:34.016099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1826c598-5ee3-4457-b95d-b97f277b3cf0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.016599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1826c598-5ee3-4457-b95d-b97f277b3cf0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.017062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1826c598-5ee3-4457-b95d-b97f277b3cf0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.017937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1826c598-5ee3-4457-b95d-b97f277b3cf0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.018436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1826c598-5ee3-4457-b95d-b97f277b3cf0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.018878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1826c598-5ee3-4457-b95d-b97f277b3cf0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.024193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:34.071283 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1826c598-5ee3-4457-b95d-b97f277b3cf0 tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.062529 Aug 27 02:40:34.073088 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1300/2341] 10.222.0.99 () {60 vars in 1178 bytes} [Sat Aug 27 02:40:34 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:34.082895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:34.084051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:34.097717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.098003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.098851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.100531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.101321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.103709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.348736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5eda1a5e-5db1-4960-be15-5258dd8387a7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:34.358957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:34.362630 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5eda1a5e-5db1-4960-be15-5258dd8387a7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.869568 Aug 27 02:40:34.378349 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1042/2342] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:33 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:34.407542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2983a852-f7f4-4ac2-9cd7-35922f2ed2ac tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:34.414735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2983a852-f7f4-4ac2-9cd7-35922f2ed2ac tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.415589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2983a852-f7f4-4ac2-9cd7-35922f2ed2ac tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.416856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2983a852-f7f4-4ac2-9cd7-35922f2ed2ac tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.418326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2983a852-f7f4-4ac2-9cd7-35922f2ed2ac tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.419222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2983a852-f7f4-4ac2-9cd7-35922f2ed2ac tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.420015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2983a852-f7f4-4ac2-9cd7-35922f2ed2ac tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.437106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:34.458347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:34.461352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:34.463760 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c2fef471-191f-4c8a-9b65-f998ee6a363f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1280 microversion: 2.25 time: 0.389036 Aug 27 02:40:34.465217 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1301/2343] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:34 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1280 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:34.476615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:34.478520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:34.499320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.500230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.500958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.501662 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2983a852-f7f4-4ac2-9cd7-35922f2ed2ac tempest-ServicesAdminNegativeV253TestJSON-661643556 tempest-ServicesAdminNegativeV253TestJSON-661643556-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.121407 Aug 27 02:40:34.502291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.502789 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1043/2344] 10.222.0.99 () {60 vars in 1239 bytes} [Sat Aug 27 02:40:34 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:34.503695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.504645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.525125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7e99d515-80ca-4a6c-8a91-0ce6dcbbc521 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:34.527193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7e99d515-80ca-4a6c-8a91-0ce6dcbbc521 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:34.539989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e99d515-80ca-4a6c-8a91-0ce6dcbbc521 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.541516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e99d515-80ca-4a6c-8a91-0ce6dcbbc521 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.542658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e99d515-80ca-4a6c-8a91-0ce6dcbbc521 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.544271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e99d515-80ca-4a6c-8a91-0ce6dcbbc521 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:34.545528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e99d515-80ca-4a6c-8a91-0ce6dcbbc521 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:34.546648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e99d515-80ca-4a6c-8a91-0ce6dcbbc521 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:34.954475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:34.967863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:34.970009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:34.971780 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6577e5f4-36b4-4c51-9f1e-6e7bb9641e29 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.503792 Aug 27 02:40:34.973797 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1302/2345] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:34 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:35.264507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b8b4b783-0b10-47a2-a654-99af6d60446b tempest-ServicesAdminNegativeV253TestJSON-689750482 tempest-ServicesAdminNegativeV253TestJSON-689750482-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:35.279181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b8b4b783-0b10-47a2-a654-99af6d60446b tempest-ServicesAdminNegativeV253TestJSON-689750482 tempest-ServicesAdminNegativeV253TestJSON-689750482-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'baffe7c0bddd4aef811211d1b4ffc160', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8a8671745140adb63c1d13d6c328b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b8b4b783-0b10-47a2-a654-99af6d60446b tempest-ServicesAdminNegativeV253TestJSON-689750482 tempest-ServicesAdminNegativeV253TestJSON-689750482-project] Request method failure captured: Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYQflZAj2XULK03GqnhTXJQpZ1xoFmFHNrwWDKP1jHHBIk2s4EX0__amUw199hrZjYx-b71GTzlBRQ6li1kwwlgJwbG7DihZvxeBskaa2AQhfKx8WvTQ8Nz11hD2kKQ6D62GFAtHRVzcHqNQioq6YkUEyKqmunbUvhfpAg88bIu9gq8 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.53 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 7c8a8671745140adb63c1d13d6c328b5 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-689750482 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7c8a8671745140adb63c1d13d6c328b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7c8a8671745140adb63c1d13d6c328b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7c8a8671745140adb63c1d13d6c328b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7c8a8671745140adb63c1d13d6c328b5"}]}] Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-689750482 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 7c8a8671745140adb63c1d13d6c328b5 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-689750482 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServicesAdminNegativeV253TestJSON-689750482-project Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: baffe7c0bddd4aef811211d1b4ffc160 Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-689750482-project Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: action_args: {} Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 27 02:40:35.282497 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b8b4b783-0b10-47a2-a654-99af6d60446b tempest-ServicesAdminNegativeV253TestJSON-689750482 tempest-ServicesAdminNegativeV253TestJSON-689750482-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b8b4b783-0b10-47a2-a654-99af6d60446b tempest-ServicesAdminNegativeV253TestJSON-689750482 tempest-ServicesAdminNegativeV253TestJSON-689750482-project] 10.222.0.99 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.293689 Aug 27 02:40:35.293491 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1303/2346] 10.222.0.99 () {60 vars in 1178 bytes} [Sat Aug 27 02:40:34 2022] GET /compute/v2.1/os-services => generated 112 bytes in 313 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:40:35.313856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-54f56779-e762-47bc-8dc1-6539a95875f9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:35.313856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-54f56779-e762-47bc-8dc1-6539a95875f9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:35.313856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54f56779-e762-47bc-8dc1-6539a95875f9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.313856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54f56779-e762-47bc-8dc1-6539a95875f9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.313856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54f56779-e762-47bc-8dc1-6539a95875f9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:35.313856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54f56779-e762-47bc-8dc1-6539a95875f9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.314917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54f56779-e762-47bc-8dc1-6539a95875f9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.315366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54f56779-e762-47bc-8dc1-6539a95875f9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:35.586434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7e99d515-80ca-4a6c-8a91-0ce6dcbbc521 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:35.657560 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7e99d515-80ca-4a6c-8a91-0ce6dcbbc521 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 1.151599 Aug 27 02:40:35.662760 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1044/2347] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:34 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:35.720939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:35.726070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:35.729258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-54f56779-e762-47bc-8dc1-6539a95875f9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:35.753347 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-54f56779-e762-47bc-8dc1-6539a95875f9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.463531 Aug 27 02:40:35.755248 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1304/2348] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:35 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:35.770404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cacaf79c-def0-4729-9bf8-173dca4662b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:35.771353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cacaf79c-def0-4729-9bf8-173dca4662b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:35.782584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cacaf79c-def0-4729-9bf8-173dca4662b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.784399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cacaf79c-def0-4729-9bf8-173dca4662b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.790184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cacaf79c-def0-4729-9bf8-173dca4662b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:35.791334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cacaf79c-def0-4729-9bf8-173dca4662b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.792082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cacaf79c-def0-4729-9bf8-173dca4662b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.792740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cacaf79c-def0-4729-9bf8-173dca4662b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:35.814134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.815109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.815959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:35.817272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:35.818132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:35.841909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.708331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:36.732549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:36.736700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:36.741376 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dde93f98-6810-4d84-8721-a5fa033595a4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1280 microversion: 2.25 time: 1.075236 Aug 27 02:40:36.743646 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1045/2349] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:35 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1280 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:36.757377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:36.759048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:36.776123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.779067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.780242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.782085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.784905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.788513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.876320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cacaf79c-def0-4729-9bf8-173dca4662b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:36.886283 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cacaf79c-def0-4729-9bf8-173dca4662b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 1.129524 Aug 27 02:40:36.893752 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1305/2350] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:35 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:36.906130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-82401f91-41cd-458a-a6ec-e60234518aed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:36.911556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-82401f91-41cd-458a-a6ec-e60234518aed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:36.937321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82401f91-41cd-458a-a6ec-e60234518aed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.941236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82401f91-41cd-458a-a6ec-e60234518aed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.941954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82401f91-41cd-458a-a6ec-e60234518aed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:36.942894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82401f91-41cd-458a-a6ec-e60234518aed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:36.943526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82401f91-41cd-458a-a6ec-e60234518aed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:36.945006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82401f91-41cd-458a-a6ec-e60234518aed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.595786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-82401f91-41cd-458a-a6ec-e60234518aed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:37.616986 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-82401f91-41cd-458a-a6ec-e60234518aed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.716610 Aug 27 02:40:37.618186 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1306/2351] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:36 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:37.645855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cf5b192a-531b-45f4-91ba-8f4d3bbec044 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:37.653024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cf5b192a-531b-45f4-91ba-8f4d3bbec044 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:37.669959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:37.677084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf5b192a-531b-45f4-91ba-8f4d3bbec044 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:37.679439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf5b192a-531b-45f4-91ba-8f4d3bbec044 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:37.681434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf5b192a-531b-45f4-91ba-8f4d3bbec044 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.682553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf5b192a-531b-45f4-91ba-8f4d3bbec044 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:37.684415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf5b192a-531b-45f4-91ba-8f4d3bbec044 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:37.687492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf5b192a-531b-45f4-91ba-8f4d3bbec044 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:37.940074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:37.971311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:37.976548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:37.982592 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2a33e220-86f8-4704-93e4-4b7bea7f8e5c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 1.233032 Aug 27 02:40:37.985361 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1046/2352] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:36 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:38.000013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-356815ae-b40a-43ae-b436-28d67e1741f0 req-b9ca55df-788d-437d-b732-70dc9f67c634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f562df2c-cfe6-463e-89a2-b5dc19206114", "name": "network-vif-plugged", "status": "completed", "tag": "71f73dc2-9f50-4ee7-807a-67585a999a89"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:38.030022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-356815ae-b40a-43ae-b436-28d67e1741f0 req-b9ca55df-788d-437d-b732-70dc9f67c634 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.033207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-356815ae-b40a-43ae-b436-28d67e1741f0 req-b9ca55df-788d-437d-b732-70dc9f67c634 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.034789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-356815ae-b40a-43ae-b436-28d67e1741f0 req-b9ca55df-788d-437d-b732-70dc9f67c634 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.077645 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-356815ae-b40a-43ae-b436-28d67e1741f0 req-b9ca55df-788d-437d-b732-70dc9f67c634 service nova] Creating event network-vif-plugged:71f73dc2-9f50-4ee7-807a-67585a999a89 for instance f562df2c-cfe6-463e-89a2-b5dc19206114 on n-h2-852084-5 Aug 27 02:40:38.110880 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-356815ae-b40a-43ae-b436-28d67e1741f0 req-b9ca55df-788d-437d-b732-70dc9f67c634 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121592 Aug 27 02:40:38.119345 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1047/2353] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:38.131147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:38.147001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:38.167524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.168874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.170192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.171205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.172573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.173714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.543594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:38.584287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:38.593659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:38.603690 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a5769d9b-cbe3-4329-83bd-8aa64ed91d3d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1280 microversion: 2.25 time: 0.481547 Aug 27 02:40:38.605479 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1048/2354] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:38 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1280 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:38.662259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d5892737-7d9c-420f-bb70-6349d591934b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:38.663920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d5892737-7d9c-420f-bb70-6349d591934b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:38.679476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5892737-7d9c-420f-bb70-6349d591934b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.680667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5892737-7d9c-420f-bb70-6349d591934b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.681626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5892737-7d9c-420f-bb70-6349d591934b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.683628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5892737-7d9c-420f-bb70-6349d591934b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.684393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5892737-7d9c-420f-bb70-6349d591934b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.686497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5892737-7d9c-420f-bb70-6349d591934b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.859695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cf5b192a-531b-45f4-91ba-8f4d3bbec044 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:38.870345 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cf5b192a-531b-45f4-91ba-8f4d3bbec044 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 1.246628 Aug 27 02:40:38.872462 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1307/2355] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:37 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:38.902447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f10034b8-f62d-4996-9244-16c82c5f4d2c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:38.910523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f10034b8-f62d-4996-9244-16c82c5f4d2c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:38.922871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f10034b8-f62d-4996-9244-16c82c5f4d2c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.924098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f10034b8-f62d-4996-9244-16c82c5f4d2c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.925123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f10034b8-f62d-4996-9244-16c82c5f4d2c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:38.926757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f10034b8-f62d-4996-9244-16c82c5f4d2c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:38.927964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f10034b8-f62d-4996-9244-16c82c5f4d2c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:38.929109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f10034b8-f62d-4996-9244-16c82c5f4d2c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.066400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f10034b8-f62d-4996-9244-16c82c5f4d2c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Locking {{(pid=122488) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 27 02:40:39.173508 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f10034b8-f62d-4996-9244-16c82c5f4d2c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.279757 Aug 27 02:40:39.174676 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1308/2356] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:38 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:40:39.181212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.181901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:39.189716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.190230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.190689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.191636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.192127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.192732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.547025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d5892737-7d9c-420f-bb70-6349d591934b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:39.589992 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d5892737-7d9c-420f-bb70-6349d591934b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.934828 Aug 27 02:40:39.605708 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1049/2357] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:38 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:39.605708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-20d1dde2-b433-4dd4-95ad-dddb4ee8186a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:39.605708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-20d1dde2-b433-4dd4-95ad-dddb4ee8186a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:39.625709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20d1dde2-b433-4dd4-95ad-dddb4ee8186a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.625709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20d1dde2-b433-4dd4-95ad-dddb4ee8186a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.625709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20d1dde2-b433-4dd4-95ad-dddb4ee8186a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:39.625709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20d1dde2-b433-4dd4-95ad-dddb4ee8186a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:39.625709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20d1dde2-b433-4dd4-95ad-dddb4ee8186a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:39.625709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20d1dde2-b433-4dd4-95ad-dddb4ee8186a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.179820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-20d1dde2-b433-4dd4-95ad-dddb4ee8186a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:40.197770 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-20d1dde2-b433-4dd4-95ad-dddb4ee8186a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.598373 Aug 27 02:40:40.203344 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1050/2358] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:39 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:40.237382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:40.248393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:40.263949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:40.266787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:40.268166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.269494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:40.272609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:40.273302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.276034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:40.328606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:40.338080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:40.341480 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6490b4b9-74cd-44d4-9173-f6adfc68b21e tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 1.165232 Aug 27 02:40:40.345773 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1309/2359] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:39 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:40.392604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a9fbb911-bfdb-45cf-aeff-76436fbb14a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:40.442618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9fbb911-bfdb-45cf-aeff-76436fbb14a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:40.443186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9fbb911-bfdb-45cf-aeff-76436fbb14a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:40.443878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9fbb911-bfdb-45cf-aeff-76436fbb14a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.522861 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-a9fbb911-bfdb-45cf-aeff-76436fbb14a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] HTTP exception thrown: Instance 59462ca6-1830-4fae-a141-ffade28879f6 is locked Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a9fbb911-bfdb-45cf-aeff-76436fbb14a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Request method failure captured: Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action HTTP/1.1 Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 15 Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYKm_d0JxxqDywZg3wD_COBvn-f59wxHd5W6ptfAZGBGOv_Flzhk-aSso1ZnVxHt4Wn3_mE_eMwZzPt26zHlVRxUGMxoQr16MR2iVAECQBE2HR0fGaw53Bq8Fj7F37vVG3tMdQMgN6KVjqYBiNLXuttuRfd3bP6t4FmBCNrcWoio4C8 Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_69945a768314456fae9bf75e854510c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/69945a768314456fae9bf75e854510c2"}]}] Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 281834367cf24a809448bdeea36a9c97 Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: {"os-stop": {}} Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 59462ca6-1830-4fae-a141-ffade28879f6 is locked Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '59462ca6-1830-4fae-a141-ffade28879f6', 'body': {'os-stop': {}}} Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 59462ca6-1830-4fae-a141-ffade28879f6 is locked Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 59462ca6-1830-4fae-a141-ffade28879f6 is locked Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59462ca6-1830-4fae-a141-ffade28879f6 is locked Aug 27 02:40:40.524534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:40:40.558605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a9fbb911-bfdb-45cf-aeff-76436fbb14a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Returning 409 to user: Instance 59462ca6-1830-4fae-a141-ffade28879f6 is locked {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:40.558605 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a9fbb911-bfdb-45cf-aeff-76436fbb14a4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 409 len: 107 microversion: 2.1 time: 0.177076 Aug 27 02:40:40.558605 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1310/2360] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:40 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 107 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:40.558605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a8f861a3-7c84-44c1-ab27-c7a7f90f38f2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:40.558605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a8f861a3-7c84-44c1-ab27-c7a7f90f38f2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:40.558605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f861a3-7c84-44c1-ab27-c7a7f90f38f2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:40.565469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f861a3-7c84-44c1-ab27-c7a7f90f38f2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:40.566820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f861a3-7c84-44c1-ab27-c7a7f90f38f2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.586149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f861a3-7c84-44c1-ab27-c7a7f90f38f2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:40.588620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f861a3-7c84-44c1-ab27-c7a7f90f38f2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:40.592827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8f861a3-7c84-44c1-ab27-c7a7f90f38f2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:40.802800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a8f861a3-7c84-44c1-ab27-c7a7f90f38f2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Unlocking {{(pid=122488) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 02:40:40.964809 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a8f861a3-7c84-44c1-ab27-c7a7f90f38f2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.421444 Aug 27 02:40:40.971758 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1311/2361] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:40 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:40.988417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0efd1790-e404-48c8-9feb-67bb64c40e40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:40.989366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0efd1790-e404-48c8-9feb-67bb64c40e40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:41.014342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0efd1790-e404-48c8-9feb-67bb64c40e40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.014869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0efd1790-e404-48c8-9feb-67bb64c40e40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.015333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0efd1790-e404-48c8-9feb-67bb64c40e40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.016161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0efd1790-e404-48c8-9feb-67bb64c40e40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.016641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0efd1790-e404-48c8-9feb-67bb64c40e40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.017087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0efd1790-e404-48c8-9feb-67bb64c40e40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.196159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:41.218561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:41.221754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:41.225338 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e92e461b-0997-41c8-9772-a06e6fd3eb9a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1280 microversion: 2.25 time: 1.020103 Aug 27 02:40:41.226399 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1051/2362] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:40 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1280 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:41.235490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-757357c0-a4eb-4ced-83e1-9f12843845a5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:41.248623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-757357c0-a4eb-4ced-83e1-9f12843845a5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.249847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-757357c0-a4eb-4ced-83e1-9f12843845a5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.250793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-757357c0-a4eb-4ced-83e1-9f12843845a5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.289152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-757357c0-a4eb-4ced-83e1-9f12843845a5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Going to try to stop instance {{(pid=122487) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:40:41.377394 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-757357c0-a4eb-4ced-83e1-9f12843845a5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.146266 Aug 27 02:40:41.391946 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1052/2363] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:41 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:41.406092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:41.412084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:41.435937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.439966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.440947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.441979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:41.442642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:41.447498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:41.903803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0efd1790-e404-48c8-9feb-67bb64c40e40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:41.933366 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0efd1790-e404-48c8-9feb-67bb64c40e40 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.959385 Aug 27 02:40:41.983283 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1312/2364] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:40 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:42.005164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2c064221-f354-4202-aae4-44f242ecb8b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:42.041303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2c064221-f354-4202-aae4-44f242ecb8b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:42.078059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c064221-f354-4202-aae4-44f242ecb8b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:42.079465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c064221-f354-4202-aae4-44f242ecb8b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:42.080949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c064221-f354-4202-aae4-44f242ecb8b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:42.082307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c064221-f354-4202-aae4-44f242ecb8b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:42.082917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c064221-f354-4202-aae4-44f242ecb8b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:42.083480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c064221-f354-4202-aae4-44f242ecb8b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:42.381017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2c064221-f354-4202-aae4-44f242ecb8b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:42.390785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:42.405941 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2c064221-f354-4202-aae4-44f242ecb8b6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1678 microversion: 2.1 time: 0.420854 Aug 27 02:40:42.407927 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1313/2365] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:41 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1678 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:42.437491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:42.459161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:42.485230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:42.486126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:42.486882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:42.490987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:42.495600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:42.496642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:42.796799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:42.815876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:42.817381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:42.824625 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-688778fb-a89e-4388-b24f-3f6c235d9b24 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 1.425876 Aug 27 02:40:42.825730 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1053/2366] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:41 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:42.847974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-73b15d7e-beee-4e80-b22a-bf22761de6da tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:42.850342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-73b15d7e-beee-4e80-b22a-bf22761de6da tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:42.867924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73b15d7e-beee-4e80-b22a-bf22761de6da tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:42.868625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73b15d7e-beee-4e80-b22a-bf22761de6da tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:42.870981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73b15d7e-beee-4e80-b22a-bf22761de6da tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:42.873889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73b15d7e-beee-4e80-b22a-bf22761de6da tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:42.874628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73b15d7e-beee-4e80-b22a-bf22761de6da tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:42.876193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73b15d7e-beee-4e80-b22a-bf22761de6da tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:42.934239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:42.952813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:42.955643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-73b15d7e-beee-4e80-b22a-bf22761de6da tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments/de19cc58-a912-4bf3-91ff-364538d94f47" status: 200 len: 194 microversion: 2.20 time: 0.124474 Aug 27 02:40:42.956844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:42.959186 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cac23cd4-be32-4604-98c1-38a47867d715 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1476 microversion: 2.25 time: 0.548881 Aug 27 02:40:42.969969 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1054/2367] 10.222.0.99 () {60 vars in 1454 bytes} [Sat Aug 27 02:40:42 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments/de19cc58-a912-4bf3-91ff-364538d94f47 => generated 194 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:42.996532 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1314/2368] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:42 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1476 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:43.026792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eccad679-c3bc-4669-949a-8d4f88ec6dda tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:43.033382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eccad679-c3bc-4669-949a-8d4f88ec6dda tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:43.066629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eccad679-c3bc-4669-949a-8d4f88ec6dda tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.069904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eccad679-c3bc-4669-949a-8d4f88ec6dda tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.074040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eccad679-c3bc-4669-949a-8d4f88ec6dda tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.080285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eccad679-c3bc-4669-949a-8d4f88ec6dda tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.081698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eccad679-c3bc-4669-949a-8d4f88ec6dda tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.085467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eccad679-c3bc-4669-949a-8d4f88ec6dda tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.235550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1697682234", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "c0e01839-7cf2-4a76-9f86-ed22a92507b6"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:43.333213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eccad679-c3bc-4669-949a-8d4f88ec6dda tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:43.336640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] validate_networks() for [('c0e01839-7cf2-4a76-9f86-ed22a92507b6', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:40:43.343455 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eccad679-c3bc-4669-949a-8d4f88ec6dda tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.345265 Aug 27 02:40:43.344446 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1315/2369] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:42 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:43.546362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cc6d18b2-cc38-4859-b2b6-91cf9e80168c tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Action: 'create', calling method: .version_select at 0x7f4d2a1c03a0>, body: {"keypair": {"name": "tempest-keypair-2143639217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLjZsgd0RiCJc2ML406ku5OUzXuYVkwhM9p8fHGu9n8ngDUwFSO1oCz/NvhG5GmbKoCWpfAk3H8HqneR9HnyBNBp1zFMhKpEP/PmxyEr9zOcxUOoT+iXmop2mWzIriJzg=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:43.568709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-cc6d18b2-cc38-4859-b2b6-91cf9e80168c tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Getting quotas for project f77a9603b9be4fcabc47dc5564ea7404. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:43.575931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-cc6d18b2-cc38-4859-b2b6-91cf9e80168c tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Getting quotas for user c9be55cd0921479b874ce0ce799d10a0 and project f77a9603b9be4fcabc47dc5564ea7404. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:43.632510 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cc6d18b2-cc38-4859-b2b6-91cf9e80168c tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.282836 Aug 27 02:40:43.633435 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1316/2370] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:40:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:43.647594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-183c1c4a-a028-4f1b-a3bd-e1284a784eff tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:43.648292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-183c1c4a-a028-4f1b-a3bd-e1284a784eff tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:43.659702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-183c1c4a-a028-4f1b-a3bd-e1284a784eff tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.660217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-183c1c4a-a028-4f1b-a3bd-e1284a784eff tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.660671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-183c1c4a-a028-4f1b-a3bd-e1284a784eff tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.661430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-183c1c4a-a028-4f1b-a3bd-e1284a784eff tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.661934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-183c1c4a-a028-4f1b-a3bd-e1284a784eff tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.662384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-183c1c4a-a028-4f1b-a3bd-e1284a784eff tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.892524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-183c1c4a-a028-4f1b-a3bd-e1284a784eff tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid f562df2c-cfe6-463e-89a2-b5dc19206114 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:43.902873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:40:43.903700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:40:43.904545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:40:43.905214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:40:43.907609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:40:43.919699 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-183c1c4a-a028-4f1b-a3bd-e1284a784eff tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1968 microversion: 2.25 time: 0.284890 Aug 27 02:40:43.922394 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1317/2371] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:43 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1968 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:43.927940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-17a5365b-6854-4a7d-85f5-de379ecde3c0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:43.928549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-17a5365b-6854-4a7d-85f5-de379ecde3c0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:43.931537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.932261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.932856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.933890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.935936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.936988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.956912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17a5365b-6854-4a7d-85f5-de379ecde3c0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.957760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17a5365b-6854-4a7d-85f5-de379ecde3c0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.957899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17a5365b-6854-4a7d-85f5-de379ecde3c0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:43.958698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17a5365b-6854-4a7d-85f5-de379ecde3c0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:43.959195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17a5365b-6854-4a7d-85f5-de379ecde3c0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:43.959642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17a5365b-6854-4a7d-85f5-de379ecde3c0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.004384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Getting quotas for project 3a7deb7b2e0f44db9408c63d75634406. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:44.042706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=22 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:44.052270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Getting quotas for user 3ba5de1a75904079a6d4ae345c9c8025 and project 3a7deb7b2e0f44db9408c63d75634406. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:44.120634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:40:44.127526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:40:44.137937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-17a5365b-6854-4a7d-85f5-de379ecde3c0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lazy-loading 'services' on Instance uuid 893e335c-913a-479a-9ee8-f61fc9a3b36f {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:44.262220 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-587a4fb4-f9ac-425f-91d2-e4db492eda25 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.291672 Aug 27 02:40:44.265026 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1055/2372] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:40:44.282514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f34bca83-ef37-4c6d-9652-8c02b512c471 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:44.283297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f34bca83-ef37-4c6d-9652-8c02b512c471 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:44.290983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f34bca83-ef37-4c6d-9652-8c02b512c471 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.291493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f34bca83-ef37-4c6d-9652-8c02b512c471 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.291944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f34bca83-ef37-4c6d-9652-8c02b512c471 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.293005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f34bca83-ef37-4c6d-9652-8c02b512c471 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.293496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f34bca83-ef37-4c6d-9652-8c02b512c471 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.294122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f34bca83-ef37-4c6d-9652-8c02b512c471 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.330479 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-17a5365b-6854-4a7d-85f5-de379ecde3c0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "DELETE /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments/de19cc58-a912-4bf3-91ff-364538d94f47" status: 202 len: 0 microversion: 2.20 time: 0.405716 Aug 27 02:40:44.333072 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1318/2373] 10.222.0.99 () {60 vars in 1457 bytes} [Sat Aug 27 02:40:43 2022] DELETE /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments/de19cc58-a912-4bf3-91ff-364538d94f47 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:40:44.350021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:44.353274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:44.400432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.407245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.409422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.412476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.415291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.416592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.578549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f34bca83-ef37-4c6d-9652-8c02b512c471 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:44.596352 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f34bca83-ef37-4c6d-9652-8c02b512c471 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1678 microversion: 2.1 time: 0.319456 Aug 27 02:40:44.615671 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1056/2374] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:44 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1678 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:44.625873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-afb773dd-af09-414a-bbfe-8c40b3f9a59f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:44.627799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-afb773dd-af09-414a-bbfe-8c40b3f9a59f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:44.642342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afb773dd-af09-414a-bbfe-8c40b3f9a59f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.660214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afb773dd-af09-414a-bbfe-8c40b3f9a59f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.661632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afb773dd-af09-414a-bbfe-8c40b3f9a59f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.665313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afb773dd-af09-414a-bbfe-8c40b3f9a59f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:44.666111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afb773dd-af09-414a-bbfe-8c40b3f9a59f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:44.667358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afb773dd-af09-414a-bbfe-8c40b3f9a59f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:44.878888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-afb773dd-af09-414a-bbfe-8c40b3f9a59f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid f562df2c-cfe6-463e-89a2-b5dc19206114 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:44.899160 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-afb773dd-af09-414a-bbfe-8c40b3f9a59f tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1968 microversion: 2.25 time: 0.282045 Aug 27 02:40:44.915133 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1057/2375] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:44 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1968 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:44.926715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f0066f5-0af7-464c-942f-aefaaab212a4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:44.927793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9f0066f5-0af7-464c-942f-aefaaab212a4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:45.017698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9f0066f5-0af7-464c-942f-aefaaab212a4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:45.031068 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9f0066f5-0af7-464c-942f-aefaaab212a4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1208 microversion: 2.1 time: 0.113718 Aug 27 02:40:45.047616 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1058/2376] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:44 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1208 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:45.058590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-89ce80d5-2a84-467f-9b23-259efbf6edec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:45.061120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-89ce80d5-2a84-467f-9b23-259efbf6edec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:45.069075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89ce80d5-2a84-467f-9b23-259efbf6edec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.069760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89ce80d5-2a84-467f-9b23-259efbf6edec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.070458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89ce80d5-2a84-467f-9b23-259efbf6edec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.071208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89ce80d5-2a84-467f-9b23-259efbf6edec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.071681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89ce80d5-2a84-467f-9b23-259efbf6edec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.072111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89ce80d5-2a84-467f-9b23-259efbf6edec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.114759 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-89ce80d5-2a84-467f-9b23-259efbf6edec tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062750 Aug 27 02:40:45.116369 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1059/2377] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:40:45 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:45.123335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ae3f4a38-932b-4096-8c34-858115b07586 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:45.124391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ae3f4a38-932b-4096-8c34-858115b07586 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:45.145002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae3f4a38-932b-4096-8c34-858115b07586 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.146164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae3f4a38-932b-4096-8c34-858115b07586 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.147209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae3f4a38-932b-4096-8c34-858115b07586 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.148684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae3f4a38-932b-4096-8c34-858115b07586 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.149451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae3f4a38-932b-4096-8c34-858115b07586 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.151079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae3f4a38-932b-4096-8c34-858115b07586 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.215883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:45.248823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:45.255724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:45.259368 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a547f436-f45b-4df8-a970-4381633f63b6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.923206 Aug 27 02:40:45.261341 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1319/2378] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:44 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:45.274227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5cdc3fa1-7dae-44da-b61a-49f9818cf035 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:45.283846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cdc3fa1-7dae-44da-b61a-49f9818cf035 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.285872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cdc3fa1-7dae-44da-b61a-49f9818cf035 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.287468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cdc3fa1-7dae-44da-b61a-49f9818cf035 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.292045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cdc3fa1-7dae-44da-b61a-49f9818cf035 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.293587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cdc3fa1-7dae-44da-b61a-49f9818cf035 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.295930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cdc3fa1-7dae-44da-b61a-49f9818cf035 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.372772 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5cdc3fa1-7dae-44da-b61a-49f9818cf035 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.107169 Aug 27 02:40:45.374915 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1320/2379] 10.222.0.99 () {60 vars in 1217 bytes} [Sat Aug 27 02:40:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:45.412080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f61f5e8c-5de3-442e-919f-f8d9f44ee478 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852084-5", "block_migration": "auto"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:45.418818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f61f5e8c-5de3-442e-919f-f8d9f44ee478 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:45.432158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f61f5e8c-5de3-442e-919f-f8d9f44ee478 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.436346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f61f5e8c-5de3-442e-919f-f8d9f44ee478 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.437539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f61f5e8c-5de3-442e-919f-f8d9f44ee478 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.439217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f61f5e8c-5de3-442e-919f-f8d9f44ee478 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.440411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f61f5e8c-5de3-442e-919f-f8d9f44ee478 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.441003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f61f5e8c-5de3-442e-919f-f8d9f44ee478 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.522108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-f61f5e8c-5de3-442e-919f-f8d9f44ee478 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'flavor' on Instance uuid f562df2c-cfe6-463e-89a2-b5dc19206114 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:40:45.565003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f61f5e8c-5de3-442e-919f-f8d9f44ee478 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Going to try to live migrate instance to n-h1-852084-5 {{(pid=122488) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 02:40:45.573921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ae3f4a38-932b-4096-8c34-858115b07586 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:45.627672 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ae3f4a38-932b-4096-8c34-858115b07586 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.508644 Aug 27 02:40:45.640548 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1060/2380] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:45 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:45.660434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-43c73f42-606a-4394-b0ed-3f94c5507c68 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:45.668126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-43c73f42-606a-4394-b0ed-3f94c5507c68 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:45.683671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43c73f42-606a-4394-b0ed-3f94c5507c68 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.684182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43c73f42-606a-4394-b0ed-3f94c5507c68 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.684673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43c73f42-606a-4394-b0ed-3f94c5507c68 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.685416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43c73f42-606a-4394-b0ed-3f94c5507c68 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:45.685909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43c73f42-606a-4394-b0ed-3f94c5507c68 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:45.686535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43c73f42-606a-4394-b0ed-3f94c5507c68 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:45.773244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:46.368731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-43c73f42-606a-4394-b0ed-3f94c5507c68 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:46.396853 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-43c73f42-606a-4394-b0ed-3f94c5507c68 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1678 microversion: 2.1 time: 0.751111 Aug 27 02:40:46.430397 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1061/2381] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:45 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1678 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:46.475258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ee78c7ff-6771-420a-b89a-cd4fd2b121e2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:46.476664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ee78c7ff-6771-420a-b89a-cd4fd2b121e2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:46.488750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee78c7ff-6771-420a-b89a-cd4fd2b121e2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:46.490301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee78c7ff-6771-420a-b89a-cd4fd2b121e2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:46.491372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee78c7ff-6771-420a-b89a-cd4fd2b121e2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:46.492899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee78c7ff-6771-420a-b89a-cd4fd2b121e2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:46.494256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee78c7ff-6771-420a-b89a-cd4fd2b121e2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:46.496169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee78c7ff-6771-420a-b89a-cd4fd2b121e2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:46.704680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ee78c7ff-6771-420a-b89a-cd4fd2b121e2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:46.721408 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ee78c7ff-6771-420a-b89a-cd4fd2b121e2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1260 microversion: 2.1 time: 0.289384 Aug 27 02:40:46.722810 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1062/2382] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:46 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:46.728621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c00e161b-d154-4272-9df3-4e59762deeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:46.731952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c00e161b-d154-4272-9df3-4e59762deeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:46.744462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00e161b-d154-4272-9df3-4e59762deeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:46.745237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00e161b-d154-4272-9df3-4e59762deeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:46.745889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00e161b-d154-4272-9df3-4e59762deeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:46.747546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00e161b-d154-4272-9df3-4e59762deeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:46.755054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00e161b-d154-4272-9df3-4e59762deeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:46.755549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00e161b-d154-4272-9df3-4e59762deeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:46.852847 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c00e161b-d154-4272-9df3-4e59762deeda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.128635 Aug 27 02:40:46.854733 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1063/2383] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:40:46 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:46.866161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:46.871196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:46.886657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:46.893355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:46.894210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:46.909041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:46.909548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:46.910047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:47.505236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:47.518587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:47.520176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:47.521480 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4872f124-bab4-45f5-81c0-c24e65f884e4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.663350 Aug 27 02:40:47.522138 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1064/2384] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:46 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:47.547251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1565b48a-25ab-4faf-ad9e-20e511b90ede tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:47.554275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1565b48a-25ab-4faf-ad9e-20e511b90ede tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:47.579761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1565b48a-25ab-4faf-ad9e-20e511b90ede tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:47.580356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1565b48a-25ab-4faf-ad9e-20e511b90ede tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:47.580975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1565b48a-25ab-4faf-ad9e-20e511b90ede tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:47.592130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1565b48a-25ab-4faf-ad9e-20e511b90ede tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:47.592882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1565b48a-25ab-4faf-ad9e-20e511b90ede tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:47.593364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1565b48a-25ab-4faf-ad9e-20e511b90ede tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:48.498010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1565b48a-25ab-4faf-ad9e-20e511b90ede tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:48.516672 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1565b48a-25ab-4faf-ad9e-20e511b90ede tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.993287 Aug 27 02:40:48.535008 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1065/2385] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:47 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:48.541398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de17e80c-6db3-4b7a-ab52-930575df459c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:48.543179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de17e80c-6db3-4b7a-ab52-930575df459c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:48.551601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de17e80c-6db3-4b7a-ab52-930575df459c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:48.552499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de17e80c-6db3-4b7a-ab52-930575df459c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:48.553174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de17e80c-6db3-4b7a-ab52-930575df459c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:48.555223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de17e80c-6db3-4b7a-ab52-930575df459c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:48.558044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de17e80c-6db3-4b7a-ab52-930575df459c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:48.558886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de17e80c-6db3-4b7a-ab52-930575df459c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:49.529308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de17e80c-6db3-4b7a-ab52-930575df459c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:49.561997 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de17e80c-6db3-4b7a-ab52-930575df459c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1678 microversion: 2.1 time: 1.025361 Aug 27 02:40:49.563502 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1066/2386] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:48 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1678 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:49.576850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5fb3a17f-5503-4d6d-954f-4cf42a05370b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:49.577485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5fb3a17f-5503-4d6d-954f-4cf42a05370b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:49.588841 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:40:49.590532 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 02:40:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b (ip 10.222.0.99) !!! Aug 27 02:40:49.599826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fb3a17f-5503-4d6d-954f-4cf42a05370b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:49.601891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fb3a17f-5503-4d6d-954f-4cf42a05370b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:49.602651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fb3a17f-5503-4d6d-954f-4cf42a05370b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:49.603885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fb3a17f-5503-4d6d-954f-4cf42a05370b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:49.604540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fb3a17f-5503-4d6d-954f-4cf42a05370b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:49.605316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fb3a17f-5503-4d6d-954f-4cf42a05370b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.024381 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f61f5e8c-5de3-442e-919f-f8d9f44ee478 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114/action" status: 202 len: 0 microversion: 2.25 time: 4.622349 Aug 27 02:40:50.025333 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1321/2387] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:40:45 2022] POST /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114/action => generated 0 bytes in 4630 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:40:50.032036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-068350a9-3d08-4207-a6d5-2c3c69a2c23e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:50.037625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-068350a9-3d08-4207-a6d5-2c3c69a2c23e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:50.052581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068350a9-3d08-4207-a6d5-2c3c69a2c23e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.053329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068350a9-3d08-4207-a6d5-2c3c69a2c23e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.053994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068350a9-3d08-4207-a6d5-2c3c69a2c23e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.054921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068350a9-3d08-4207-a6d5-2c3c69a2c23e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.055683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068350a9-3d08-4207-a6d5-2c3c69a2c23e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.056364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068350a9-3d08-4207-a6d5-2c3c69a2c23e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.129103 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-068350a9-3d08-4207-a6d5-2c3c69a2c23e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102174 Aug 27 02:40:50.134925 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1322/2388] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:40:50 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:50.144183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:50.146580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:50.193316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.198153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.200558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.207770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.208753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.209481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.258610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5fb3a17f-5503-4d6d-954f-4cf42a05370b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:50.276294 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5fb3a17f-5503-4d6d-954f-4cf42a05370b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1266 microversion: 2.1 time: 0.711277 Aug 27 02:40:50.279973 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1067/2389] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:49 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1266 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:50.313793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-878ddab9-2981-4d74-85e7-5dccc5b9cf0d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:50.315885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-878ddab9-2981-4d74-85e7-5dccc5b9cf0d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:50.327073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878ddab9-2981-4d74-85e7-5dccc5b9cf0d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.327855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878ddab9-2981-4d74-85e7-5dccc5b9cf0d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.329178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878ddab9-2981-4d74-85e7-5dccc5b9cf0d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.330269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878ddab9-2981-4d74-85e7-5dccc5b9cf0d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.331095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878ddab9-2981-4d74-85e7-5dccc5b9cf0d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.331722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878ddab9-2981-4d74-85e7-5dccc5b9cf0d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.818865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:50.838739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:50.840366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:50.842160 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1f78158a-6e49-4d7f-86f2-947a4432564b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.705544 Aug 27 02:40:50.846099 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1323/2390] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:50 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:50.856282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:50.860247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:50.875456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.876936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.878162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:50.880796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:50.882171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:50.884112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.404393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:51.424271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:51.433819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:51.443553 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7240ec91-e556-4354-9a38-4c009a9b9dc7 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 0.595405 Aug 27 02:40:51.445138 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1324/2391] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:50 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:51.458440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1b8ddc8-a598-4853-9200-500d74cb9c37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:51.459824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a1b8ddc8-a598-4853-9200-500d74cb9c37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:51.473863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1b8ddc8-a598-4853-9200-500d74cb9c37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.475575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1b8ddc8-a598-4853-9200-500d74cb9c37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.476638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1b8ddc8-a598-4853-9200-500d74cb9c37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.478557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1b8ddc8-a598-4853-9200-500d74cb9c37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:51.480024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1b8ddc8-a598-4853-9200-500d74cb9c37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:51.481986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1b8ddc8-a598-4853-9200-500d74cb9c37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:51.741700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-878ddab9-2981-4d74-85e7-5dccc5b9cf0d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:51.763191 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-878ddab9-2981-4d74-85e7-5dccc5b9cf0d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 1.473194 Aug 27 02:40:51.773624 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1068/2392] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:50 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:51.805232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1879550385", "imageRef": "cb8da31f-aa6c-4d63-80b7-29a7db70ee76", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d3ff066e-7901-4e6c-936e-129992aab746"}], "security_groups": [{"name": "tempest-securitygroup--2067040024"}], "key_name": "tempest-keypair-2143639217", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:52.113015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a1b8ddc8-a598-4853-9200-500d74cb9c37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:52.160997 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a1b8ddc8-a598-4853-9200-500d74cb9c37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1678 microversion: 2.1 time: 0.706792 Aug 27 02:40:52.166775 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1325/2393] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:51 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1678 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:52.190276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-09362236-4ebd-452d-9c64-acd64f1382ce tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:52.205153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-09362236-4ebd-452d-9c64-acd64f1382ce tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:52.217524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09362236-4ebd-452d-9c64-acd64f1382ce tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.218843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09362236-4ebd-452d-9c64-acd64f1382ce tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.220041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09362236-4ebd-452d-9c64-acd64f1382ce tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.222296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09362236-4ebd-452d-9c64-acd64f1382ce tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.223397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09362236-4ebd-452d-9c64-acd64f1382ce tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.224397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09362236-4ebd-452d-9c64-acd64f1382ce tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.300567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-09362236-4ebd-452d-9c64-acd64f1382ce tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123399 Aug 27 02:40:52.302572 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1326/2394] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:40:52 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:52.312558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-48499580-e305-480d-955a-b888b5f85f2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:52.314265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-48499580-e305-480d-955a-b888b5f85f2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:52.323685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] validate_networks() for [('d3ff066e-7901-4e6c-936e-129992aab746', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:40:52.344952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48499580-e305-480d-955a-b888b5f85f2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.346405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48499580-e305-480d-955a-b888b5f85f2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.347511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48499580-e305-480d-955a-b888b5f85f2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.349133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48499580-e305-480d-955a-b888b5f85f2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:52.350545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48499580-e305-480d-955a-b888b5f85f2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:52.351682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48499580-e305-480d-955a-b888b5f85f2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:52.881574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-48499580-e305-480d-955a-b888b5f85f2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:52.929469 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-48499580-e305-480d-955a-b888b5f85f2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1308 microversion: 2.1 time: 0.624424 Aug 27 02:40:52.934643 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1327/2395] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:52 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:52.958125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:52.971453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:53.009463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:53.010464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:53.011281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:53.029151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:53.035455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:53.037229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:53.587869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:53.963475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:54.027045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:54.064223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:54.067243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:54.073155 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a033a874-6666-416a-8109-84b8466bcb23 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 1.133432 Aug 27 02:40:54.079231 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1328/2396] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:52 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:54.095782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:54.097139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:54.105218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:54.107387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:54.108224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:54.109310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:54.110047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:54.110708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:54.139507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:54.146069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:40:54.146877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:40:54.147578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:40:54.148243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:40:54.148877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:40:54.166841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:54.170308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:54.171667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:54.175295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:54.179214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:54.180117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:54.210148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Getting quotas for project f77a9603b9be4fcabc47dc5564ea7404. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:40:54.235606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Getting quotas for user c9be55cd0921479b874ce0ce799d10a0 and project f77a9603b9be4fcabc47dc5564ea7404. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:40:54.253864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:40:54.260141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb8da31f-aa6c-4d63-80b7-29a7db70ee76',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:40:54.429300 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2caba5e2-a6b0-4028-8f3a-46f2eabb5393 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.652386 Aug 27 02:40:54.456234 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1069/2397] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:40:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 2664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:40:54.465451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3271de2e-7d66-4053-b8e7-a825f68a30cf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:54.468983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3271de2e-7d66-4053-b8e7-a825f68a30cf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:54.484778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3271de2e-7d66-4053-b8e7-a825f68a30cf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:54.485740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3271de2e-7d66-4053-b8e7-a825f68a30cf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:54.487080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3271de2e-7d66-4053-b8e7-a825f68a30cf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:54.488373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3271de2e-7d66-4053-b8e7-a825f68a30cf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:54.489062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3271de2e-7d66-4053-b8e7-a825f68a30cf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:54.489749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3271de2e-7d66-4053-b8e7-a825f68a30cf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:54.874163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:54.890653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:54.909712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:54.916171 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4ef7095f-70e2-4c5c-b34b-5a604568d45c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 0.831269 Aug 27 02:40:54.919066 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1329/2398] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:54 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:54.930684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c1bde69f-f1f4-48f4-905a-3d07a1eba952 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:54.933174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c1bde69f-f1f4-48f4-905a-3d07a1eba952 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:54.946909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1bde69f-f1f4-48f4-905a-3d07a1eba952 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:54.953115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1bde69f-f1f4-48f4-905a-3d07a1eba952 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:54.954180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1bde69f-f1f4-48f4-905a-3d07a1eba952 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:54.955231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1bde69f-f1f4-48f4-905a-3d07a1eba952 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:54.955960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1bde69f-f1f4-48f4-905a-3d07a1eba952 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:54.956647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1bde69f-f1f4-48f4-905a-3d07a1eba952 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.136835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3271de2e-7d66-4053-b8e7-a825f68a30cf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:55.152258 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3271de2e-7d66-4053-b8e7-a825f68a30cf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1502 microversion: 2.1 time: 0.711461 Aug 27 02:40:55.158609 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1070/2399] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:54 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1502 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:55.186710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c871473-8094-4527-9fa0-98fa84114bda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:55.192101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c871473-8094-4527-9fa0-98fa84114bda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:55.225947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c871473-8094-4527-9fa0-98fa84114bda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.229578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c871473-8094-4527-9fa0-98fa84114bda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.236248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c871473-8094-4527-9fa0-98fa84114bda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.237218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c871473-8094-4527-9fa0-98fa84114bda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.240841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c871473-8094-4527-9fa0-98fa84114bda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.241529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c871473-8094-4527-9fa0-98fa84114bda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.319521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:55.365966 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c871473-8094-4527-9fa0-98fa84114bda tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.204044 Aug 27 02:40:55.374637 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1071/2400] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:40:55 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:55.382464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-85e9074a-f2a5-4753-abac-e5655c3c8bd5 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:55.385475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-85e9074a-f2a5-4753-abac-e5655c3c8bd5 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:55.423498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:55.429601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85e9074a-f2a5-4753-abac-e5655c3c8bd5 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.430371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85e9074a-f2a5-4753-abac-e5655c3c8bd5 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.432495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85e9074a-f2a5-4753-abac-e5655c3c8bd5 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.433498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85e9074a-f2a5-4753-abac-e5655c3c8bd5 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.435858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85e9074a-f2a5-4753-abac-e5655c3c8bd5 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.436515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85e9074a-f2a5-4753-abac-e5655c3c8bd5 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.518580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c1bde69f-f1f4-48f4-905a-3d07a1eba952 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:55.534441 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c1bde69f-f1f4-48f4-905a-3d07a1eba952 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1655 microversion: 2.1 time: 0.613023 Aug 27 02:40:55.544684 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1330/2401] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:54 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1655 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:55.563387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-564bc9e8-991b-404e-80f9-a5211ea9feaa tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:55.566709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-564bc9e8-991b-404e-80f9-a5211ea9feaa tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:55.598016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-564bc9e8-991b-404e-80f9-a5211ea9feaa tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.599091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-564bc9e8-991b-404e-80f9-a5211ea9feaa tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.602420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-564bc9e8-991b-404e-80f9-a5211ea9feaa tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.603614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-564bc9e8-991b-404e-80f9-a5211ea9feaa tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.607338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-564bc9e8-991b-404e-80f9-a5211ea9feaa tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.610725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-564bc9e8-991b-404e-80f9-a5211ea9feaa tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.921933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-85e9074a-f2a5-4753-abac-e5655c3c8bd5 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:55.923685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-564bc9e8-991b-404e-80f9-a5211ea9feaa tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:55.940547 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-85e9074a-f2a5-4753-abac-e5655c3c8bd5 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1308 microversion: 2.1 time: 0.569903 Aug 27 02:40:55.942623 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1072/2402] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:55 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1308 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:55.952638 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-564bc9e8-991b-404e-80f9-a5211ea9feaa tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1250 microversion: 2.1 time: 0.402485 Aug 27 02:40:55.957237 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1331/2403] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:55 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1250 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:55.967888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:55.968514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:55.971308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-a94d8f4b-b3bd-47ed-9a20-5d644bf179de req-d2454dab-69bf-4c57-9949-9a82d120c8fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada54a54-66b3-47b3-87dd-e3e7b5bf934b", "tag": "972893de-522e-44d8-bab8-60c023b9fb4c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:55.983380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.984015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.984641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:55.985828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:55.988500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:55.989209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.007155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a94d8f4b-b3bd-47ed-9a20-5d644bf179de req-d2454dab-69bf-4c57-9949-9a82d120c8fd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.008610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a94d8f4b-b3bd-47ed-9a20-5d644bf179de req-d2454dab-69bf-4c57-9949-9a82d120c8fd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.009952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a94d8f4b-b3bd-47ed-9a20-5d644bf179de req-d2454dab-69bf-4c57-9949-9a82d120c8fd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.037221 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a94d8f4b-b3bd-47ed-9a20-5d644bf179de req-d2454dab-69bf-4c57-9949-9a82d120c8fd service nova] Creating event network-changed:972893de-522e-44d8-bab8-60c023b9fb4c for instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b on n-h1-852084-5 Aug 27 02:40:56.050974 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-a94d8f4b-b3bd-47ed-9a20-5d644bf179de req-d2454dab-69bf-4c57-9949-9a82d120c8fd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105738 Aug 27 02:40:56.052735 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1073/2404] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:40:56.080927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30658124-ef50-4ff7-a254-2bc087b1a084"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.088610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:56.100785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.101753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.102389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.114690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.117564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.119811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.212028 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] HTTP exception thrown: Cannot 'attach_volume' instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f while it is in vm_state rescued Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Request method failure captured: Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/os-volume_attachments HTTP/1.1 Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 74 Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYO1ujqvCLBmMVe65fdN2J5dIO7-HUqI3Js5YGestJSXRt-3jM1W-KzE8NnECJ1ryJNn-_nCYfE1drEJmtuv9wrerAqLuupZmy6gs9vrBdbjKq9YdwsxzP7b-WGUVBzCCEf1u8fLpuDoBEeADCldZf84VX9NU_VzQjP9Knt2NuVZyVU Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/956a66be18bb4f9e996c8e16bcf23bab"}]}] Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 51b3d953421c409c9edd54287dcd11db Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: {"volumeAttachment": {"volumeId": "30658124-ef50-4ff7-a254-2bc087b1a084"}} Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'attach_volume' instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f while it is in vm_state rescued Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': 'f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f', 'body': {'volumeAttachment': {'volumeId': '30658124-ef50-4ff7-a254-2bc087b1a084'}}} Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 27 02:40:56.220205 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f while it is in vm_state rescued Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f while it is in vm_state rescued Aug 27 02:40:56.223864 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:40:56.228152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Returning 409 to user: Cannot 'attach_volume' instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f while it is in vm_state rescued {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:40:56.231288 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d551e50e-a054-46cc-8334-eac64e75d1e8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.175285 Aug 27 02:40:56.234784 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1074/2405] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/os-volume_attachments => generated 152 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:40:56.250769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e72e0c6c-b91d-4699-a6db-2ddf191d1b82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.270852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e72e0c6c-b91d-4699-a6db-2ddf191d1b82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.273316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e72e0c6c-b91d-4699-a6db-2ddf191d1b82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.273965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e72e0c6c-b91d-4699-a6db-2ddf191d1b82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.340818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e72e0c6c-b91d-4699-a6db-2ddf191d1b82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Going to try to start instance {{(pid=122487) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 02:40:56.421192 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e72e0c6c-b91d-4699-a6db-2ddf191d1b82 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.184676 Aug 27 02:40:56.422226 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1075/2406] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:56.447009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:56.448489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:56.453548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:56.476660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.477547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.477711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:56.479229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:56.483225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.489539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.498525 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1a63ee41-11d2-4c97-b815-ce80d62e1f8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.519777 Aug 27 02:40:56.499867 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1332/2407] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:55 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:56.511479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e1d5fa20-47c9-471a-a3c8-9ca6a1722ef1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:40:56.515444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.516808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.521518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e1d5fa20-47c9-471a-a3c8-9ca6a1722ef1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:56.540736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1d5fa20-47c9-471a-a3c8-9ca6a1722ef1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.541657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1d5fa20-47c9-471a-a3c8-9ca6a1722ef1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.542440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1d5fa20-47c9-471a-a3c8-9ca6a1722ef1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.544039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1d5fa20-47c9-471a-a3c8-9ca6a1722ef1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.545637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1d5fa20-47c9-471a-a3c8-9ca6a1722ef1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.546712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1d5fa20-47c9-471a-a3c8-9ca6a1722ef1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.699569 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e1d5fa20-47c9-471a-a3c8-9ca6a1722ef1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/action" status: 202 len: 0 microversion: 2.1 time: 0.197787 Aug 27 02:40:56.704153 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1333/2408] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:40:56 2022] POST /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:40:56.718775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7177a02-d4dd-4e7f-9d93-62fce8cd249b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:56.725687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d7177a02-d4dd-4e7f-9d93-62fce8cd249b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:56.738013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7177a02-d4dd-4e7f-9d93-62fce8cd249b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.738975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7177a02-d4dd-4e7f-9d93-62fce8cd249b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.740928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7177a02-d4dd-4e7f-9d93-62fce8cd249b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.742656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7177a02-d4dd-4e7f-9d93-62fce8cd249b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.743870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7177a02-d4dd-4e7f-9d93-62fce8cd249b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.745044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7177a02-d4dd-4e7f-9d93-62fce8cd249b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.831391 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d7177a02-d4dd-4e7f-9d93-62fce8cd249b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123200 Aug 27 02:40:56.834750 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1334/2409] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:40:56 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:40:56.843950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b12e7573-877f-4d5c-a818-0bed8c1b092d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:56.850412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b12e7573-877f-4d5c-a818-0bed8c1b092d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:56.866538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12e7573-877f-4d5c-a818-0bed8c1b092d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.869523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12e7573-877f-4d5c-a818-0bed8c1b092d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.870410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12e7573-877f-4d5c-a818-0bed8c1b092d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:56.876355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12e7573-877f-4d5c-a818-0bed8c1b092d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:56.876355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12e7573-877f-4d5c-a818-0bed8c1b092d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:56.876696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12e7573-877f-4d5c-a818-0bed8c1b092d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.177750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.191564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.193121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.195398 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-728482ab-6bed-46e6-a5c4-4ea4eb90ab8d tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 0.770742 Aug 27 02:40:57.196376 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1076/2410] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:56 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:57.203651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-07250ed3-afb5-4fe9-b9f5-f4af861d808c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.208293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-07250ed3-afb5-4fe9-b9f5-f4af861d808c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:57.220902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07250ed3-afb5-4fe9-b9f5-f4af861d808c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.223310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07250ed3-afb5-4fe9-b9f5-f4af861d808c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.224101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07250ed3-afb5-4fe9-b9f5-f4af861d808c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.226154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07250ed3-afb5-4fe9-b9f5-f4af861d808c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.226849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07250ed3-afb5-4fe9-b9f5-f4af861d808c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.236623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07250ed3-afb5-4fe9-b9f5-f4af861d808c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.419775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b12e7573-877f-4d5c-a818-0bed8c1b092d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.432909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b12e7573-877f-4d5c-a818-0bed8c1b092d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1664 microversion: 2.1 time: 0.596432 Aug 27 02:40:57.446691 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1335/2411] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:56 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1664 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:57.465936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e7538dd4-e660-42aa-9803-202df724f143 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.481587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e7538dd4-e660-42aa-9803-202df724f143 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:57.489455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7538dd4-e660-42aa-9803-202df724f143 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.490001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7538dd4-e660-42aa-9803-202df724f143 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.490448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7538dd4-e660-42aa-9803-202df724f143 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.491212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7538dd4-e660-42aa-9803-202df724f143 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.495971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7538dd4-e660-42aa-9803-202df724f143 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.497917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7538dd4-e660-42aa-9803-202df724f143 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.544626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-07250ed3-afb5-4fe9-b9f5-f4af861d808c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.570721 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-07250ed3-afb5-4fe9-b9f5-f4af861d808c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1510 microversion: 2.1 time: 0.372958 Aug 27 02:40:57.572156 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1077/2412] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:57 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:57.624488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f279a86c-2c35-4e31-b303-0de36375c525 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.629342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f279a86c-2c35-4e31-b303-0de36375c525 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:57.646663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f279a86c-2c35-4e31-b303-0de36375c525 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.648290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f279a86c-2c35-4e31-b303-0de36375c525 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.650339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f279a86c-2c35-4e31-b303-0de36375c525 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.652252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f279a86c-2c35-4e31-b303-0de36375c525 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.653764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f279a86c-2c35-4e31-b303-0de36375c525 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.654550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f279a86c-2c35-4e31-b303-0de36375c525 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.712334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:40:57.859135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f279a86c-2c35-4e31-b303-0de36375c525 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:57.872657 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f279a86c-2c35-4e31-b303-0de36375c525 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1298 microversion: 2.1 time: 0.298871 Aug 27 02:40:57.874975 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1078/2413] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:57 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1298 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:57.884979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:57.886018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:57.902326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.906338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.907130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:57.908127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:57.908868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:57.909564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.024066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e7538dd4-e660-42aa-9803-202df724f143 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:58.041045 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e7538dd4-e660-42aa-9803-202df724f143 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1308 microversion: 2.1 time: 0.591358 Aug 27 02:40:58.054837 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1336/2414] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:57 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1308 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:58.064359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b44f737-8048-4ea6-ab4e-82df22637fac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:58.066884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6b44f737-8048-4ea6-ab4e-82df22637fac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:58.090322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b44f737-8048-4ea6-ab4e-82df22637fac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.090838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b44f737-8048-4ea6-ab4e-82df22637fac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.091297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b44f737-8048-4ea6-ab4e-82df22637fac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.092206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b44f737-8048-4ea6-ab4e-82df22637fac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.092691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b44f737-8048-4ea6-ab4e-82df22637fac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.093244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b44f737-8048-4ea6-ab4e-82df22637fac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.183457 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b44f737-8048-4ea6-ab4e-82df22637fac tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.126896 Aug 27 02:40:58.196374 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1337/2415] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:40:58 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f/os-volume_attachments => generated 25 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:40:58.236525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:58.241259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:58.265343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.266019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.266776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:58.267319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:58.267994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:58.268314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:59.248015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:59.263017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:59.264548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:59.265176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:59.270970 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-160eb1ea-3b8a-4298-9359-c603c1010e71 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 1.038822 Aug 27 02:40:59.271588 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1338/2416] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:58 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:59.279001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:59.280073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7d295654-5ab5-4a44-9762-971b9915af0f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:59.280779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d295654-5ab5-4a44-9762-971b9915af0f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:59.291428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d295654-5ab5-4a44-9762-971b9915af0f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:59.292231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d295654-5ab5-4a44-9762-971b9915af0f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:59.292831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d295654-5ab5-4a44-9762-971b9915af0f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:59.293125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:40:59.294018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d295654-5ab5-4a44-9762-971b9915af0f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:59.294642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d295654-5ab5-4a44-9762-971b9915af0f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:59.294787 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-62158b46-9245-45fc-a26f-932c951215aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 1.413855 Aug 27 02:40:59.295359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d295654-5ab5-4a44-9762-971b9915af0f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:59.295534 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1079/2417] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:40:57 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:40:59.305619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1e95a570-a790-4469-872e-d8a1913eee72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:59.312060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1e95a570-a790-4469-872e-d8a1913eee72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:59.329632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e95a570-a790-4469-872e-d8a1913eee72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:59.330581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e95a570-a790-4469-872e-d8a1913eee72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:59.332135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e95a570-a790-4469-872e-d8a1913eee72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:59.338009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e95a570-a790-4469-872e-d8a1913eee72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:59.338798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e95a570-a790-4469-872e-d8a1913eee72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:59.342465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e95a570-a790-4469-872e-d8a1913eee72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:59.430008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d295654-5ab5-4a44-9762-971b9915af0f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:40:59.653361 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7d295654-5ab5-4a44-9762-971b9915af0f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "DELETE /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 204 len: 0 microversion: 2.20 time: 0.379364 Aug 27 02:40:59.654471 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1339/2418] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:40:59 2022] DELETE /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:40:59.665573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d44cd061-5904-4632-a66a-3a71b7fb7b1c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:40:59.669487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d44cd061-5904-4632-a66a-3a71b7fb7b1c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:40:59.689288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d44cd061-5904-4632-a66a-3a71b7fb7b1c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:59.690177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d44cd061-5904-4632-a66a-3a71b7fb7b1c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:59.690804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d44cd061-5904-4632-a66a-3a71b7fb7b1c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:40:59.691731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d44cd061-5904-4632-a66a-3a71b7fb7b1c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:40:59.693766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d44cd061-5904-4632-a66a-3a71b7fb7b1c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:40:59.694695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d44cd061-5904-4632-a66a-3a71b7fb7b1c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.136451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d44cd061-5904-4632-a66a-3a71b7fb7b1c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:00.153386 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d44cd061-5904-4632-a66a-3a71b7fb7b1c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1510 microversion: 2.1 time: 0.495303 Aug 27 02:41:00.170094 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1340/2419] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:59 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1510 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:00.184973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd81a5c7-aa0a-4420-bf87-308b4f1470b4 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:00.187891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dd81a5c7-aa0a-4420-bf87-308b4f1470b4 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:00.211040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd81a5c7-aa0a-4420-bf87-308b4f1470b4 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.213427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd81a5c7-aa0a-4420-bf87-308b4f1470b4 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.214194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd81a5c7-aa0a-4420-bf87-308b4f1470b4 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.217115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd81a5c7-aa0a-4420-bf87-308b4f1470b4 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.220072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd81a5c7-aa0a-4420-bf87-308b4f1470b4 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.222485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd81a5c7-aa0a-4420-bf87-308b4f1470b4 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.408477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dd81a5c7-aa0a-4420-bf87-308b4f1470b4 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:00.424676 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dd81a5c7-aa0a-4420-bf87-308b4f1470b4 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1304 microversion: 2.1 time: 0.249430 Aug 27 02:41:00.426301 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1341/2420] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:00 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1304 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:00.460120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c900e866-78a3-450a-bc55-f955f8a79ab4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:00.461852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c900e866-78a3-450a-bc55-f955f8a79ab4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:00.475906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c900e866-78a3-450a-bc55-f955f8a79ab4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.477541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c900e866-78a3-450a-bc55-f955f8a79ab4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.479106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c900e866-78a3-450a-bc55-f955f8a79ab4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.481472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c900e866-78a3-450a-bc55-f955f8a79ab4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.482686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c900e866-78a3-450a-bc55-f955f8a79ab4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.483901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c900e866-78a3-450a-bc55-f955f8a79ab4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.806696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1e95a570-a790-4469-872e-d8a1913eee72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:00.835122 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1e95a570-a790-4469-872e-d8a1913eee72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1664 microversion: 2.1 time: 1.537538 Aug 27 02:41:00.869294 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1080/2421] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:40:59 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1664 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:00.879220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:00.890342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:00.922477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.924446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.926842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.936857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:00.938296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:00.939482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:00.957534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c900e866-78a3-450a-bc55-f955f8a79ab4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:00.972008 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c900e866-78a3-450a-bc55-f955f8a79ab4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1308 microversion: 2.1 time: 0.538568 Aug 27 02:41:00.973421 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1342/2422] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:00 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1308 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:01.067757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9bec1b75-bb45-4f4f-8352-c8813b2b7d4f tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] Action: 'create', calling method: .version_select at 0x7f4d2a2c81f0>, body: {"pool": null} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:02.142418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:02.186259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:02.213372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:02.217050 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-26737632-c4c8-43f0-936e-62cdf29157af tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1720 microversion: 2.20 time: 1.344473 Aug 27 02:41:02.237711 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1081/2423] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:00 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1720 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:02.265963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:02.267709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:02.281214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:02.282928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:02.284916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:02.287064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:02.289051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:02.290483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:02.953657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:02.967181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:02.970794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:02.972344 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-119778cd-b14b-4df9-98dd-081688d695e6 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 0.732104 Aug 27 02:41:02.973609 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1082/2424] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:02 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:02.980377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:02.982028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:02.990918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:02.992521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:02.993163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:02.994259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:02.994878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:02.995470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:03.779593 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9bec1b75-bb45-4f4f-8352-c8813b2b7d4f tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] 10.222.0.99 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.804864 Aug 27 02:41:03.780582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1343/2425] 10.222.0.99 () {60 vars in 1170 bytes} [Sat Aug 27 02:41:00 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:03.786594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b60bf3ef-5596-441b-bee1-f896fdcae7b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:03.791565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b60bf3ef-5596-441b-bee1-f896fdcae7b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:03.805772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b60bf3ef-5596-441b-bee1-f896fdcae7b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:03.806571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b60bf3ef-5596-441b-bee1-f896fdcae7b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:03.807225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b60bf3ef-5596-441b-bee1-f896fdcae7b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:03.808286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b60bf3ef-5596-441b-bee1-f896fdcae7b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:03.809512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b60bf3ef-5596-441b-bee1-f896fdcae7b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:03.810556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b60bf3ef-5596-441b-bee1-f896fdcae7b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:03.853374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:04.105132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b60bf3ef-5596-441b-bee1-f896fdcae7b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:04.115536 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b60bf3ef-5596-441b-bee1-f896fdcae7b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1510 microversion: 2.1 time: 0.333823 Aug 27 02:41:04.125783 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1344/2426] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:03 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1510 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:04.146373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c3a3a13b-ddac-497c-83f3-abf3186f4c85 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:04.153152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c3a3a13b-ddac-497c-83f3-abf3186f4c85 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:04.180561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3a3a13b-ddac-497c-83f3-abf3186f4c85 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:04.181951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3a3a13b-ddac-497c-83f3-abf3186f4c85 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:04.182397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3a3a13b-ddac-497c-83f3-abf3186f4c85 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:04.183169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3a3a13b-ddac-497c-83f3-abf3186f4c85 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:04.184279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3a3a13b-ddac-497c-83f3-abf3186f4c85 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:04.184735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3a3a13b-ddac-497c-83f3-abf3186f4c85 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:04.192796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:04.252907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=14 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:04.508368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c3a3a13b-ddac-497c-83f3-abf3186f4c85 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:04.544088 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c3a3a13b-ddac-497c-83f3-abf3186f4c85 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1304 microversion: 2.1 time: 0.414294 Aug 27 02:41:04.547975 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1345/2427] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:04 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1304 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:04.565868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0b12bc5f-d3fa-4b45-b698-3fce0b3b7142 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:04.567834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0b12bc5f-d3fa-4b45-b698-3fce0b3b7142 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:04.587622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b12bc5f-d3fa-4b45-b698-3fce0b3b7142 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:04.588668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b12bc5f-d3fa-4b45-b698-3fce0b3b7142 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:04.590470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b12bc5f-d3fa-4b45-b698-3fce0b3b7142 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:04.592182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b12bc5f-d3fa-4b45-b698-3fce0b3b7142 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:04.594407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b12bc5f-d3fa-4b45-b698-3fce0b3b7142 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:04.595565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b12bc5f-d3fa-4b45-b698-3fce0b3b7142 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:05.047717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:05.067987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:05.070721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:05.072335 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba4a442d-8474-4ce7-9a53-9b8f96192d7c tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 2.097038 Aug 27 02:41:05.107042 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1083/2428] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:02 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 2132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:05.119966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fd46608c-5e45-4b41-ab5f-e52213e787ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:05.120603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fd46608c-5e45-4b41-ab5f-e52213e787ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:05.150503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd46608c-5e45-4b41-ab5f-e52213e787ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.155100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd46608c-5e45-4b41-ab5f-e52213e787ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.160299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd46608c-5e45-4b41-ab5f-e52213e787ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:05.164376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd46608c-5e45-4b41-ab5f-e52213e787ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.165254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd46608c-5e45-4b41-ab5f-e52213e787ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.168784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd46608c-5e45-4b41-ab5f-e52213e787ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:05.315636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0b12bc5f-d3fa-4b45-b698-3fce0b3b7142 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:05.364571 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0b12bc5f-d3fa-4b45-b698-3fce0b3b7142 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.816460 Aug 27 02:41:05.416733 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1346/2429] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:04 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:05.459675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:05.463645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:05.484461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.485481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.486161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:05.487151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:05.487826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:05.488719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:06.040593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:06.058579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:06.060262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:06.061552 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2eda1c99-fff6-4908-a15d-e154b027eee0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1720 microversion: 2.20 time: 0.630117 Aug 27 02:41:06.062178 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1347/2430] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:05 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1720 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:06.069433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-de5666f3-2643-4dfa-81f9-8fe6b31b7355 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] Action: 'create', calling method: .version_select at 0x7f4d2a278d30>, body: {"pool": null} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:06.826941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fd46608c-5e45-4b41-ab5f-e52213e787ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:06.844736 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fd46608c-5e45-4b41-ab5f-e52213e787ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1308 microversion: 2.1 time: 1.736062 Aug 27 02:41:06.861182 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1084/2431] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:05 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1308 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:06.866811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:06.867720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:06.878487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:06.879246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:06.879886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:06.880885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:06.881519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:06.882152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:07.543355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:07.571019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:07.579976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:07.586251 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-77896044-0376-4f8a-b3b8-448d5b249265 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 0.723500 Aug 27 02:41:07.595205 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1085/2432] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:06 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:07.615782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3995551e-3d3e-4386-bbf1-b1dc85916f02 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:07.620376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3995551e-3d3e-4386-bbf1-b1dc85916f02 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:07.660987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3995551e-3d3e-4386-bbf1-b1dc85916f02 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:07.660987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3995551e-3d3e-4386-bbf1-b1dc85916f02 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:07.660987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3995551e-3d3e-4386-bbf1-b1dc85916f02 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:07.660987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3995551e-3d3e-4386-bbf1-b1dc85916f02 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:07.660987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3995551e-3d3e-4386-bbf1-b1dc85916f02 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:07.660987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3995551e-3d3e-4386-bbf1-b1dc85916f02 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:08.785606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3995551e-3d3e-4386-bbf1-b1dc85916f02 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:08.864547 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3995551e-3d3e-4386-bbf1-b1dc85916f02 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1516 microversion: 2.1 time: 1.267004 Aug 27 02:41:08.870228 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1086/2433] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:07 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1516 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:08.898615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d72f9ec6-d328-4430-88f3-c93806b65918 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:08.925946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d72f9ec6-d328-4430-88f3-c93806b65918 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:08.942202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d72f9ec6-d328-4430-88f3-c93806b65918 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:08.943586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d72f9ec6-d328-4430-88f3-c93806b65918 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:08.944581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d72f9ec6-d328-4430-88f3-c93806b65918 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:08.946134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d72f9ec6-d328-4430-88f3-c93806b65918 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:08.947242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d72f9ec6-d328-4430-88f3-c93806b65918 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:08.948249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d72f9ec6-d328-4430-88f3-c93806b65918 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:10.495567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-de5666f3-2643-4dfa-81f9-8fe6b31b7355 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] 10.222.0.99 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.430325 Aug 27 02:41:10.497047 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1348/2434] 10.222.0.99 () {60 vars in 1170 bytes} [Sat Aug 27 02:41:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:10.503945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-25c5fe14-02c6-46b5-b6ab-8af18a86d53a tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:10.507640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-25c5fe14-02c6-46b5-b6ab-8af18a86d53a tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:10.526461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d72f9ec6-d328-4430-88f3-c93806b65918 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:10.544960 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d72f9ec6-d328-4430-88f3-c93806b65918 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 1.669479 Aug 27 02:41:10.545566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:10.555341 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1087/2435] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:08 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:10.561726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25c5fe14-02c6-46b5-b6ab-8af18a86d53a tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:10.570961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:10.572066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:10.592326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25c5fe14-02c6-46b5-b6ab-8af18a86d53a tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:10.595208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25c5fe14-02c6-46b5-b6ab-8af18a86d53a tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:10.598683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:10.603332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:10.604721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:10.606506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25c5fe14-02c6-46b5-b6ab-8af18a86d53a tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:10.608788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25c5fe14-02c6-46b5-b6ab-8af18a86d53a tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:10.609920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:10.613639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25c5fe14-02c6-46b5-b6ab-8af18a86d53a tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:10.615861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:10.617741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.243583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-25c5fe14-02c6-46b5-b6ab-8af18a86d53a tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.255650 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-25c5fe14-02c6-46b5-b6ab-8af18a86d53a tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1372 microversion: 2.1 time: 0.756793 Aug 27 02:41:11.256066 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1349/2436] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:10 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1372 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:11.271549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:11.287873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:11.325686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:11.326606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:11.348607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.362948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.365226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:11.366152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:11.366975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.435628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.443370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.459442 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b6685072-067d-4ce5-9672-4e616209dd2d tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.892550 Aug 27 02:41:11.462459 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1088/2437] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:10 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:11.485010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b6e7cbc5-6272-464b-bb94-a5cac0d1017d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:11.491776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b6e7cbc5-6272-464b-bb94-a5cac0d1017d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:11.542931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6e7cbc5-6272-464b-bb94-a5cac0d1017d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:11.559464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6e7cbc5-6272-464b-bb94-a5cac0d1017d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:11.561606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6e7cbc5-6272-464b-bb94-a5cac0d1017d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.564929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6e7cbc5-6272-464b-bb94-a5cac0d1017d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:11.576588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6e7cbc5-6272-464b-bb94-a5cac0d1017d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:11.579039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6e7cbc5-6272-464b-bb94-a5cac0d1017d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.661136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:11.662071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:11.668260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:11.669148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lazy-loading 'fault' on Instance uuid 893e335c-913a-479a-9ee8-f61fc9a3b36f {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:41:11.887088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.969278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.988168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:11.990572 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bb8c7712-b9c6-484a-bbb3-86dca462c0d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 200 len: 1369 microversion: 2.20 time: 0.733115 Aug 27 02:41:11.991644 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1350/2438] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:11 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 1369 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:12.035969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:12.040116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:12.091367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.098645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.100189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.102703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.112413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.113552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.409625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b6e7cbc5-6272-464b-bb94-a5cac0d1017d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:12.463715 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b6e7cbc5-6272-464b-bb94-a5cac0d1017d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1308 microversion: 2.1 time: 0.993832 Aug 27 02:41:12.468255 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1089/2439] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:11 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1308 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:12.496386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-103a8675-3fc0-4989-8ccc-e54110d306ee req-08b7e8fb-8612-4a5f-980f-87d244e3bfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534917a1-8a02-493c-af75-fdef81207a5a", "tag": "0f7fcd3c-1acc-47b8-ada7-d2c162f10d89"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.562558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-103a8675-3fc0-4989-8ccc-e54110d306ee req-08b7e8fb-8612-4a5f-980f-87d244e3bfe2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.566927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-103a8675-3fc0-4989-8ccc-e54110d306ee req-08b7e8fb-8612-4a5f-980f-87d244e3bfe2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.575070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-103a8675-3fc0-4989-8ccc-e54110d306ee req-08b7e8fb-8612-4a5f-980f-87d244e3bfe2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.643474 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-103a8675-3fc0-4989-8ccc-e54110d306ee req-08b7e8fb-8612-4a5f-980f-87d244e3bfe2 service nova] Creating event network-changed:0f7fcd3c-1acc-47b8-ada7-d2c162f10d89 for instance 534917a1-8a02-493c-af75-fdef81207a5a on n-h2-852084-5 Aug 27 02:41:12.661225 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-103a8675-3fc0-4989-8ccc-e54110d306ee req-08b7e8fb-8612-4a5f-980f-87d244e3bfe2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187526 Aug 27 02:41:12.662615 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1090/2440] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:12.696830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-22047c50-82b3-4e31-bc70-1c140e8fff4b req-661ee4c6-f53d-42bb-b8ce-d3003fc4170b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada54a54-66b3-47b3-87dd-e3e7b5bf934b", "name": "network-vif-plugged", "status": "completed", "tag": "972893de-522e-44d8-bab8-60c023b9fb4c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.726699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-22047c50-82b3-4e31-bc70-1c140e8fff4b req-661ee4c6-f53d-42bb-b8ce-d3003fc4170b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.729837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-22047c50-82b3-4e31-bc70-1c140e8fff4b req-661ee4c6-f53d-42bb-b8ce-d3003fc4170b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.732817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-22047c50-82b3-4e31-bc70-1c140e8fff4b req-661ee4c6-f53d-42bb-b8ce-d3003fc4170b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.773949 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-22047c50-82b3-4e31-bc70-1c140e8fff4b req-661ee4c6-f53d-42bb-b8ce-d3003fc4170b service nova] Creating event network-vif-plugged:972893de-522e-44d8-bab8-60c023b9fb4c for instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b on n-h1-852084-5 Aug 27 02:41:12.792368 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-22047c50-82b3-4e31-bc70-1c140e8fff4b req-661ee4c6-f53d-42bb-b8ce-d3003fc4170b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128021 Aug 27 02:41:12.795034 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1091/2441] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:12.801918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:12.809311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-20f8c196-1a92-45dd-97d7-9a8a910d39a9 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] Action: 'create', calling method: .version_select at 0x7f4d2a7b3820>, body: {"pool": null} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.880404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:12.882567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:12.883854 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1d27f5a5-4d32-4be4-9f2f-e3a4da69f7d1 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 0.885418 Aug 27 02:41:12.887277 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1351/2442] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:11 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:12.911926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f778831f-0169-4bfa-887d-fd0afe297709 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:12.919107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f778831f-0169-4bfa-887d-fd0afe297709 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:12.937142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f778831f-0169-4bfa-887d-fd0afe297709 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.940102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f778831f-0169-4bfa-887d-fd0afe297709 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.941007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f778831f-0169-4bfa-887d-fd0afe297709 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:12.944775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f778831f-0169-4bfa-887d-fd0afe297709 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:12.945515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f778831f-0169-4bfa-887d-fd0afe297709 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:12.946324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f778831f-0169-4bfa-887d-fd0afe297709 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:13.016697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f778831f-0169-4bfa-887d-fd0afe297709 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Unlocking {{(pid=122488) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 27 02:41:13.117426 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f778831f-0169-4bfa-887d-fd0afe297709 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.228583 Aug 27 02:41:13.118766 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1352/2443] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:41:12 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:13.132674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bfa2334e-f0cf-4aa1-9dca-c58c93c967cd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:13.133487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bfa2334e-f0cf-4aa1-9dca-c58c93c967cd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:13.143886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfa2334e-f0cf-4aa1-9dca-c58c93c967cd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:13.144513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfa2334e-f0cf-4aa1-9dca-c58c93c967cd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:13.147226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfa2334e-f0cf-4aa1-9dca-c58c93c967cd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:13.147226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfa2334e-f0cf-4aa1-9dca-c58c93c967cd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:13.147226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfa2334e-f0cf-4aa1-9dca-c58c93c967cd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:13.147226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfa2334e-f0cf-4aa1-9dca-c58c93c967cd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:13.546187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bfa2334e-f0cf-4aa1-9dca-c58c93c967cd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:13.561484 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bfa2334e-f0cf-4aa1-9dca-c58c93c967cd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1372 microversion: 2.1 time: 0.441398 Aug 27 02:41:13.576207 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1353/2444] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:13 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1372 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:13.576207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:13.576207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:13.580191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:13.580965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:13.581528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:13.582981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:13.583675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:13.584823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:14.182145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:14.227293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:14.231061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:14.246547 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f756d884-3f79-4339-ae15-644aa00c9421 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.679759 Aug 27 02:41:14.260922 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1354/2445] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:13 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:14.292538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.293601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:14.322114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:14.323208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:14.324556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:14.325653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:14.326432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:14.327207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:14.354600 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] HTTP exception thrown: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Request method failure captured: Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f HTTP/1.1 Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYMkVU2znMGNqolJJqDa2e5VnAnkfd1fDfn2MAnqFt5te_i-jPpxMYwjTkhE50qC5yWSzRkbNmwcz1bNB7i9tyoVITk7oX3Cr0vdClFdc-HDVtMstCPXedvmZY6tjseacR8HF-Y-PhEdTPkO5P4kpaTMAu6zNKVAI0bVw9Zb_bFiICc Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/195d9a2cd949478ebc0c53dae45f6501"}]}] Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 61a386e483ae4ab3a33f3a40d5bf41cf Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '893e335c-913a-479a-9ee8-f61fc9a3b36f'} Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:41:14.364097 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:14.368130 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:41:14.368130 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:14.368130 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:14.368130 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:14.368130 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:14.368130 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:14.368130 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:41:14.368130 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:41:14.370533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Returning 404 to user: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:14.372356 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cd2b6f8e-037c-4df2-885a-e638aaff58c5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 404 len: 111 microversion: 2.20 time: 0.088419 Aug 27 02:41:14.377460 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1355/2446] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:41:14.386265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b9bda99-c0c2-40c9-a74d-23afaf6036d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.386265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6b9bda99-c0c2-40c9-a74d-23afaf6036d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:14.390922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9bda99-c0c2-40c9-a74d-23afaf6036d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:14.391689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9bda99-c0c2-40c9-a74d-23afaf6036d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:14.393175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9bda99-c0c2-40c9-a74d-23afaf6036d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:14.393175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9bda99-c0c2-40c9-a74d-23afaf6036d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:14.393534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9bda99-c0c2-40c9-a74d-23afaf6036d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:14.394212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b9bda99-c0c2-40c9-a74d-23afaf6036d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:14.854102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6b9bda99-c0c2-40c9-a74d-23afaf6036d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:14.874329 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b9bda99-c0c2-40c9-a74d-23afaf6036d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.494733 Aug 27 02:41:14.875200 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1356/2447] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:14.885701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-96685519-77bd-453f-a608-9cb15642ac4d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:14.887176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-96685519-77bd-453f-a608-9cb15642ac4d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:14.903374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96685519-77bd-453f-a608-9cb15642ac4d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:14.904327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96685519-77bd-453f-a608-9cb15642ac4d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:14.905203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96685519-77bd-453f-a608-9cb15642ac4d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:14.915071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96685519-77bd-453f-a608-9cb15642ac4d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:14.918407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96685519-77bd-453f-a608-9cb15642ac4d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:14.919046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96685519-77bd-453f-a608-9cb15642ac4d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:15.463851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-96685519-77bd-453f-a608-9cb15642ac4d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:15.486669 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-96685519-77bd-453f-a608-9cb15642ac4d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1308 microversion: 2.1 time: 0.608557 Aug 27 02:41:15.490632 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1357/2448] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:14 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1308 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:15.502077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:15.503758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:15.531106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:15.534910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:15.538866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:15.541285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:15.543261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:15.544860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:16.154636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:16.202656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:16.205825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:16.231907 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4f1f560f-f9bc-4ba0-ae34-1065534f2fde tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 0.738785 Aug 27 02:41:16.246956 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1358/2449] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:15 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:16.291188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37ca2da5-c1c2-4f02-8023-7fe42275b4d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '.version_select at 0x7f4d2a24d8b0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.353962 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-37ca2da5-c1c2-4f02-8023-7fe42275b4d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46522345" status: 204 len: 0 microversion: 2.20 time: 0.104464 Aug 27 02:41:16.362276 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1359/2450] 10.222.0.99 () {60 vars in 1256 bytes} [Sat Aug 27 02:41:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46522345 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:41:16.400730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2741da24-6825-4460-8884-1f326ac23ed5 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:16.402400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2741da24-6825-4460-8884-1f326ac23ed5 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:16.429180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2741da24-6825-4460-8884-1f326ac23ed5 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:16.430672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2741da24-6825-4460-8884-1f326ac23ed5 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:16.431616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2741da24-6825-4460-8884-1f326ac23ed5 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:16.433621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2741da24-6825-4460-8884-1f326ac23ed5 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:16.434559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2741da24-6825-4460-8884-1f326ac23ed5 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:16.435363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2741da24-6825-4460-8884-1f326ac23ed5 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:16.544132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:16.916742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2741da24-6825-4460-8884-1f326ac23ed5 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:16.939668 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2741da24-6825-4460-8884-1f326ac23ed5 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1372 microversion: 2.1 time: 0.575086 Aug 27 02:41:16.950045 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1360/2451] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:16 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1372 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:16.959455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-dbde961d-4ade-4d4d-880f-72a8a944b6ff req-8b5a676e-5ade-4d90-a9b4-a3380863b1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893e335c-913a-479a-9ee8-f61fc9a3b36f", "name": "network-vif-deleted", "tag": "e392649a-1f13-4247-832b-e0b1080e8799"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:16.994816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dbde961d-4ade-4d4d-880f-72a8a944b6ff req-8b5a676e-5ade-4d90-a9b4-a3380863b1b0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:16.996788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dbde961d-4ade-4d4d-880f-72a8a944b6ff req-8b5a676e-5ade-4d90-a9b4-a3380863b1b0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:16.997882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dbde961d-4ade-4d4d-880f-72a8a944b6ff req-8b5a676e-5ade-4d90-a9b4-a3380863b1b0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.026531 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-dbde961d-4ade-4d4d-880f-72a8a944b6ff req-8b5a676e-5ade-4d90-a9b4-a3380863b1b0 service nova] Creating event network-vif-deleted:e392649a-1f13-4247-832b-e0b1080e8799 for instance 893e335c-913a-479a-9ee8-f61fc9a3b36f on n-h1-852084-5 Aug 27 02:41:17.039001 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-dbde961d-4ade-4d4d-880f-72a8a944b6ff req-8b5a676e-5ade-4d90-a9b4-a3380863b1b0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085637 Aug 27 02:41:17.040385 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1361/2452] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:17.051268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d19f2d95-4d12-453b-a4f3-2404c5e9eb79 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'create', calling method: .version_select at 0x7f4d2a278e50>, body: {"keypair": {"name": "tempest-keypair-1841856236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOpN1E6pXld3rCCbOnJGVSd0AayBh/GxNNl9TYDt2dxOlMPErxJS3sreNwft1BSXxxtj+27mestzWosT1e6xUc/4ZZOKjdTcyoIq5dJKxbYWiqY7yutpEzYxlypxdSCVw=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:17.086289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-d19f2d95-4d12-453b-a4f3-2404c5e9eb79 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Getting quotas for project 956a66be18bb4f9e996c8e16bcf23bab. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:17.099502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-d19f2d95-4d12-453b-a4f3-2404c5e9eb79 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Getting quotas for user 51b3d953421c409c9edd54287dcd11db and project 956a66be18bb4f9e996c8e16bcf23bab. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:17.157557 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d19f2d95-4d12-453b-a4f3-2404c5e9eb79 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114511 Aug 27 02:41:17.159559 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1362/2453] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:41:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:17.172041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7981e665-9823-430d-ad91-9509cc295232 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:17.174217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7981e665-9823-430d-ad91-9509cc295232 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:17.188458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7981e665-9823-430d-ad91-9509cc295232 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.189772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7981e665-9823-430d-ad91-9509cc295232 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.190723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7981e665-9823-430d-ad91-9509cc295232 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.192082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7981e665-9823-430d-ad91-9509cc295232 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.193046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7981e665-9823-430d-ad91-9509cc295232 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.193958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7981e665-9823-430d-ad91-9509cc295232 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.716371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7981e665-9823-430d-ad91-9509cc295232 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:17.730702 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7981e665-9823-430d-ad91-9509cc295232 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.568369 Aug 27 02:41:17.732316 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1363/2454] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:17 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:17.740736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-bde996ea-0d41-42d9-83c9-b037cb1497b8 req-b057cea2-3186-456c-9609-f32c377fcd4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-plugged", "status": "completed", "tag": "fa02d9de-658c-4012-8350-0eb7421c3221"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:17.769868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bde996ea-0d41-42d9-83c9-b037cb1497b8 req-b057cea2-3186-456c-9609-f32c377fcd4e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.771327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bde996ea-0d41-42d9-83c9-b037cb1497b8 req-b057cea2-3186-456c-9609-f32c377fcd4e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.772122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bde996ea-0d41-42d9-83c9-b037cb1497b8 req-b057cea2-3186-456c-9609-f32c377fcd4e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.794136 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-bde996ea-0d41-42d9-83c9-b037cb1497b8 req-b057cea2-3186-456c-9609-f32c377fcd4e service nova] Creating event network-vif-plugged:fa02d9de-658c-4012-8350-0eb7421c3221 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:41:17.802492 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-bde996ea-0d41-42d9-83c9-b037cb1497b8 req-b057cea2-3186-456c-9609-f32c377fcd4e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068728 Aug 27 02:41:17.804555 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1364/2455] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:17.812799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:17.813542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:17.822381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.824421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.824421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:17.824813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:17.825185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:17.825627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.273981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.287320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.289611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.292004 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0e102d97-3b42-4fa7-b7fd-a9feb81577fd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.485965 Aug 27 02:41:18.309697 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1365/2456] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:17 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:18.312559 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-20f8c196-1a92-45dd-97d7-9a8a910d39a9 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] 10.222.0.99 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.513257 Aug 27 02:41:18.314476 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1092/2457] 10.222.0.99 () {60 vars in 1170 bytes} [Sat Aug 27 02:41:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:18.322716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:18.325200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:18.335331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5570aa3-c413-4829-9dd6-e401a0152eed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:18.336489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e5570aa3-c413-4829-9dd6-e401a0152eed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:18.338117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:18.339608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:18.340330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.341636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:18.343335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:18.344052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.356262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5570aa3-c413-4829-9dd6-e401a0152eed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:18.356625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5570aa3-c413-4829-9dd6-e401a0152eed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:18.357084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5570aa3-c413-4829-9dd6-e401a0152eed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.358082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5570aa3-c413-4829-9dd6-e401a0152eed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:18.358621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5570aa3-c413-4829-9dd6-e401a0152eed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:18.359060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5570aa3-c413-4829-9dd6-e401a0152eed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.607400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e5570aa3-c413-4829-9dd6-e401a0152eed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.626230 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e5570aa3-c413-4829-9dd6-e401a0152eed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1488 microversion: 2.1 time: 0.314465 Aug 27 02:41:18.639209 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1366/2458] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:18 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1488 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:18.639209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78a9aad5-224f-465c-a1ee-36ff1b597296 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:18.639209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-78a9aad5-224f-465c-a1ee-36ff1b597296 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:18.646744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.650296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78a9aad5-224f-465c-a1ee-36ff1b597296 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:18.652022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78a9aad5-224f-465c-a1ee-36ff1b597296 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:18.652993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78a9aad5-224f-465c-a1ee-36ff1b597296 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.654599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78a9aad5-224f-465c-a1ee-36ff1b597296 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:18.655750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78a9aad5-224f-465c-a1ee-36ff1b597296 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:18.656185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.656586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78a9aad5-224f-465c-a1ee-36ff1b597296 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.657742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.659010 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8093c4aa-6091-4b39-9789-6bee580e6996 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 0.343251 Aug 27 02:41:18.659589 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1093/2459] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:18 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:18.665138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8acf8ad2-75f7-43a5-8b8d-66e379be1051 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:18.665791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8acf8ad2-75f7-43a5-8b8d-66e379be1051 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:18.674563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8acf8ad2-75f7-43a5-8b8d-66e379be1051 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:18.675347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8acf8ad2-75f7-43a5-8b8d-66e379be1051 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:18.676102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8acf8ad2-75f7-43a5-8b8d-66e379be1051 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.677367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8acf8ad2-75f7-43a5-8b8d-66e379be1051 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:18.678244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8acf8ad2-75f7-43a5-8b8d-66e379be1051 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:18.679048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8acf8ad2-75f7-43a5-8b8d-66e379be1051 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:18.915750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-78a9aad5-224f-465c-a1ee-36ff1b597296 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.928605 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-78a9aad5-224f-465c-a1ee-36ff1b597296 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.299322 Aug 27 02:41:18.929845 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1367/2460] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:18 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:18.941779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9a308e39-b3fd-4d83-a44e-ee980bb9835e tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] Action: 'create', calling method: .version_select at 0x7f4d2940c550>, body: {"pool": null} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:18.950500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8acf8ad2-75f7-43a5-8b8d-66e379be1051 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:18.971372 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8acf8ad2-75f7-43a5-8b8d-66e379be1051 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1372 microversion: 2.1 time: 0.309992 Aug 27 02:41:18.972515 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1094/2461] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:18 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:18.986255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-59bb3983-7eaf-48b1-9d00-696e92128ed0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Action: 'create', calling method: .version_select at 0x7f4d2a7ab310>, body: {"keypair": {"name": "tempest-keypair-483759875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfqeM3uZ4eGwVKaLIQ/jXDOtbG+FQJ8bN740f0KvB7VkvLoodxcU2ABDlWCJc80xILWp2WsIRM3CxA5ny0Uk+ME4l2koTE3dOqJZ4qPil6vsao7htyssq92+GRljbRwAw=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:19.029849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-59bb3983-7eaf-48b1-9d00-696e92128ed0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Getting quotas for project 195d9a2cd949478ebc0c53dae45f6501. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:19.043727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-59bb3983-7eaf-48b1-9d00-696e92128ed0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Getting quotas for user 61a386e483ae4ab3a33f3a40d5bf41cf and project 195d9a2cd949478ebc0c53dae45f6501. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:19.113504 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-59bb3983-7eaf-48b1-9d00-696e92128ed0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.137866 Aug 27 02:41:19.115700 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1095/2462] 10.222.0.99 () {62 vars in 1200 bytes} [Sat Aug 27 02:41:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:41:19.122351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-89e4a7a6-3ec5-4bd7-a22f-a29a2e413cdf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:19.122908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-89e4a7a6-3ec5-4bd7-a22f-a29a2e413cdf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:19.130857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89e4a7a6-3ec5-4bd7-a22f-a29a2e413cdf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:19.131348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89e4a7a6-3ec5-4bd7-a22f-a29a2e413cdf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:19.131799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89e4a7a6-3ec5-4bd7-a22f-a29a2e413cdf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:19.132666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89e4a7a6-3ec5-4bd7-a22f-a29a2e413cdf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:19.133151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89e4a7a6-3ec5-4bd7-a22f-a29a2e413cdf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:19.133648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89e4a7a6-3ec5-4bd7-a22f-a29a2e413cdf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:19.269971 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-89e4a7a6-3ec5-4bd7-a22f-a29a2e413cdf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "POST /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b/action" status: 202 len: 0 microversion: 2.1 time: 0.151914 Aug 27 02:41:19.277235 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1096/2463] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:41:19 2022] POST /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:19.290321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c5805994-e76c-4f08-92cf-15c7951178c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:19.293094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c5805994-e76c-4f08-92cf-15c7951178c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:19.306929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5805994-e76c-4f08-92cf-15c7951178c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:19.308950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5805994-e76c-4f08-92cf-15c7951178c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:19.310345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5805994-e76c-4f08-92cf-15c7951178c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:19.312464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5805994-e76c-4f08-92cf-15c7951178c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:19.314010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5805994-e76c-4f08-92cf-15c7951178c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:19.315938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5805994-e76c-4f08-92cf-15c7951178c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:19.377456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:19.525759 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c5805994-e76c-4f08-92cf-15c7951178c2 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.250182 Aug 27 02:41:19.531149 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1097/2464] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:41:19 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:19.537325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-efd8f410-c20e-462e-a0a6-136c937b31e8 req-dd530d22-0549-4dd8-a7f8-336184e3e652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f562df2c-cfe6-463e-89a2-b5dc19206114", "name": "network-vif-unplugged", "status": "completed", "tag": "71f73dc2-9f50-4ee7-807a-67585a999a89"}, {"name": "network-changed", "server_uuid": "f562df2c-cfe6-463e-89a2-b5dc19206114", "tag": "71f73dc2-9f50-4ee7-807a-67585a999a89"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:19.550422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-efd8f410-c20e-462e-a0a6-136c937b31e8 req-dd530d22-0549-4dd8-a7f8-336184e3e652 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:19.551694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-efd8f410-c20e-462e-a0a6-136c937b31e8 req-dd530d22-0549-4dd8-a7f8-336184e3e652 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:19.551694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-efd8f410-c20e-462e-a0a6-136c937b31e8 req-dd530d22-0549-4dd8-a7f8-336184e3e652 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:19.570745 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-efd8f410-c20e-462e-a0a6-136c937b31e8 req-dd530d22-0549-4dd8-a7f8-336184e3e652 service nova] Creating event network-vif-unplugged:71f73dc2-9f50-4ee7-807a-67585a999a89 for instance f562df2c-cfe6-463e-89a2-b5dc19206114 on n-h2-852084-5 Aug 27 02:41:19.571194 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-efd8f410-c20e-462e-a0a6-136c937b31e8 req-dd530d22-0549-4dd8-a7f8-336184e3e652 service nova] Creating event network-changed:71f73dc2-9f50-4ee7-807a-67585a999a89 for instance f562df2c-cfe6-463e-89a2-b5dc19206114 on n-h2-852084-5 Aug 27 02:41:19.580727 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-efd8f410-c20e-462e-a0a6-136c937b31e8 req-dd530d22-0549-4dd8-a7f8-336184e3e652 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.047645 Aug 27 02:41:19.581796 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1098/2465] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:19.590272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b0b8935-dc5e-4c91-ac11-10388362036f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:19.592080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4b0b8935-dc5e-4c91-ac11-10388362036f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:19.607575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b0b8935-dc5e-4c91-ac11-10388362036f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:19.608523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b0b8935-dc5e-4c91-ac11-10388362036f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:19.609089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b0b8935-dc5e-4c91-ac11-10388362036f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:19.610023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b0b8935-dc5e-4c91-ac11-10388362036f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:19.611122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b0b8935-dc5e-4c91-ac11-10388362036f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:19.612218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b0b8935-dc5e-4c91-ac11-10388362036f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:20.580557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4b0b8935-dc5e-4c91-ac11-10388362036f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:20.608477 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4b0b8935-dc5e-4c91-ac11-10388362036f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1493 microversion: 2.1 time: 1.024930 Aug 27 02:41:20.633515 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1099/2466] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:19 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1493 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:20.647716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:20.648912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:20.660496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:20.661373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:20.662193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:20.663809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:20.664367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:20.665145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.368051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:21.408372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:21.413522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:21.416010 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-87aa0d02-7d96-4f49-83b9-cea375d114bd tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.780461 Aug 27 02:41:21.422206 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1100/2467] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:20 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:21.437622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1417ca39-ba2b-4524-9cb5-f444e170ad27 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:21.443061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1417ca39-ba2b-4524-9cb5-f444e170ad27 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:21.475205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1417ca39-ba2b-4524-9cb5-f444e170ad27 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.476489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1417ca39-ba2b-4524-9cb5-f444e170ad27 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.477348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1417ca39-ba2b-4524-9cb5-f444e170ad27 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:21.479001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1417ca39-ba2b-4524-9cb5-f444e170ad27 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:21.480690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1417ca39-ba2b-4524-9cb5-f444e170ad27 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:21.481802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1417ca39-ba2b-4524-9cb5-f444e170ad27 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.103603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1417ca39-ba2b-4524-9cb5-f444e170ad27 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:22.117086 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1417ca39-ba2b-4524-9cb5-f444e170ad27 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1653 microversion: 2.1 time: 0.692794 Aug 27 02:41:22.119587 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1101/2468] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:21 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1653 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:22.125017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:22.128469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:22.145764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.150222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.151901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.163410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.164777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.165894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.342331 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9a308e39-b3fd-4d83-a44e-ee980bb9835e tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] 10.222.0.99 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.410348 Aug 27 02:41:22.343971 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1368/2469] 10.222.0.99 () {60 vars in 1170 bytes} [Sat Aug 27 02:41:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:22.360082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-52ad8977-178e-4dff-8cce-5c9cf6a20fc6 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:22.361176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-52ad8977-178e-4dff-8cce-5c9cf6a20fc6 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:22.388342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52ad8977-178e-4dff-8cce-5c9cf6a20fc6 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.389433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52ad8977-178e-4dff-8cce-5c9cf6a20fc6 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.390452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52ad8977-178e-4dff-8cce-5c9cf6a20fc6 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.393983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52ad8977-178e-4dff-8cce-5c9cf6a20fc6 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.395002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52ad8977-178e-4dff-8cce-5c9cf6a20fc6 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.402319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52ad8977-178e-4dff-8cce-5c9cf6a20fc6 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.728315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:22.761789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:22.765396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:22.773710 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c542edff-8172-4c4e-95fc-a7955c5f64b4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 0.652246 Aug 27 02:41:22.794570 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1102/2470] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:22 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:22.823430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7817dd46-50a3-4565-9248-d44ef8b9b371 req-28266b57-3046-4dd2-b2d0-116e55f45ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-plugged", "status": "completed", "tag": "ea16f397-cede-434b-8c29-fdce0d801498"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:22.858344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7817dd46-50a3-4565-9248-d44ef8b9b371 req-28266b57-3046-4dd2-b2d0-116e55f45ee3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.859138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7817dd46-50a3-4565-9248-d44ef8b9b371 req-28266b57-3046-4dd2-b2d0-116e55f45ee3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.860052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7817dd46-50a3-4565-9248-d44ef8b9b371 req-28266b57-3046-4dd2-b2d0-116e55f45ee3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.880751 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7817dd46-50a3-4565-9248-d44ef8b9b371 req-28266b57-3046-4dd2-b2d0-116e55f45ee3 service nova] Creating event network-vif-plugged:ea16f397-cede-434b-8c29-fdce0d801498 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:41:22.891880 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7817dd46-50a3-4565-9248-d44ef8b9b371 req-28266b57-3046-4dd2-b2d0-116e55f45ee3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093721 Aug 27 02:41:22.894127 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1103/2471] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:22.906232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-754f5d7d-204a-4aa8-ab86-9697d3329dfa tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:22.907881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-754f5d7d-204a-4aa8-ab86-9697d3329dfa tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:22.917400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-754f5d7d-204a-4aa8-ab86-9697d3329dfa tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.918779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-754f5d7d-204a-4aa8-ab86-9697d3329dfa tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.920496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-754f5d7d-204a-4aa8-ab86-9697d3329dfa tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:22.921510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-754f5d7d-204a-4aa8-ab86-9697d3329dfa tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:22.923326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-754f5d7d-204a-4aa8-ab86-9697d3329dfa tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:22.925436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-754f5d7d-204a-4aa8-ab86-9697d3329dfa tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:23.065382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-52ad8977-178e-4dff-8cce-5c9cf6a20fc6 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:23.094832 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-52ad8977-178e-4dff-8cce-5c9cf6a20fc6 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1372 microversion: 2.1 time: 0.748658 Aug 27 02:41:23.111025 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1369/2472] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:22 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1372 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:23.124895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-7342703", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c124adb8-f4b7-493d-8ee4-35c76bbd1a0a"}], "security_groups": [{"name": "tempest-securitygroup--1431815745"}], "key_name": "tempest-keypair-1841856236", "user_data": "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:23.336569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-754f5d7d-204a-4aa8-ab86-9697d3329dfa tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:23.362187 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-754f5d7d-204a-4aa8-ab86-9697d3329dfa tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 200 len: 1473 microversion: 2.1 time: 0.464878 Aug 27 02:41:23.364041 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1104/2473] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:22 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 1473 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:23.372256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f32b3e9-5d95-485a-9096-5d1b64ac818a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:23.373347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9f32b3e9-5d95-485a-9096-5d1b64ac818a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:23.395697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f32b3e9-5d95-485a-9096-5d1b64ac818a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:23.396243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f32b3e9-5d95-485a-9096-5d1b64ac818a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:23.396698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f32b3e9-5d95-485a-9096-5d1b64ac818a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:23.397536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f32b3e9-5d95-485a-9096-5d1b64ac818a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:23.398114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f32b3e9-5d95-485a-9096-5d1b64ac818a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:23.398564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f32b3e9-5d95-485a-9096-5d1b64ac818a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:23.478662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] validate_networks() for [('c124adb8-f4b7-493d-8ee4-35c76bbd1a0a', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:23.508000 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9f32b3e9-5d95-485a-9096-5d1b64ac818a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.141946 Aug 27 02:41:23.528901 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1105/2474] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:41:23 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:23.548550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-527eeae3-faec-4e65-ac0e-e5e74f70afa1 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] Calling method '.version_select at 0x7f4d2e74edc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:23.936892 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-527eeae3-faec-4e65-ac0e-e5e74f70afa1 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] 10.222.0.99 "GET /compute/v2.1/os-floating-ips/1420b871-d0df-4487-828c-1f17d80ad5f7" status: 200 len: 142 microversion: 2.1 time: 0.406342 Aug 27 02:41:23.938582 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1106/2475] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:41:23 2022] GET /compute/v2.1/os-floating-ips/1420b871-d0df-4487-828c-1f17d80ad5f7 => generated 142 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:23.946212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:23.946212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:23.956095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:23.956350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:23.957017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:23.957961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:23.958442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:23.958873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.242163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:24.262726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:24.266117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:24.268466 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-52f7d801-85db-448e-ba33-4f9fb91c2361 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.328784 Aug 27 02:41:24.269521 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1107/2476] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:23 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:24.279434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-96ac8825-5fd0-4e56-8d14-37821f82486e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1778955695"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:24.284634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-96ac8825-5fd0-4e56-8d14-37821f82486e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:24.297308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96ac8825-5fd0-4e56-8d14-37821f82486e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.298546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96ac8825-5fd0-4e56-8d14-37821f82486e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.299702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96ac8825-5fd0-4e56-8d14-37821f82486e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.301556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96ac8825-5fd0-4e56-8d14-37821f82486e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.302624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96ac8825-5fd0-4e56-8d14-37821f82486e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.303476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96ac8825-5fd0-4e56-8d14-37821f82486e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.652804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:24.653646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:24.654790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:24.655722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:24.656631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:24.675915 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-96ac8825-5fd0-4e56-8d14-37821f82486e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "POST /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b/action" status: 202 len: 0 microversion: 2.1 time: 0.405027 Aug 27 02:41:24.676836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.678198 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1108/2477] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:41:24 2022] POST /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:41:24.684702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05636f55-5037-4c01-a8d7-ece8bc0d28d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:24.694056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-05636f55-5037-4c01-a8d7-ece8bc0d28d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:24.697209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.702833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05636f55-5037-4c01-a8d7-ece8bc0d28d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.703534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05636f55-5037-4c01-a8d7-ece8bc0d28d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.704086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05636f55-5037-4c01-a8d7-ece8bc0d28d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.704839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.705244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05636f55-5037-4c01-a8d7-ece8bc0d28d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.705925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05636f55-5037-4c01-a8d7-ece8bc0d28d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.706492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05636f55-5037-4c01-a8d7-ece8bc0d28d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.707250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.708396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.709403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.775608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Getting quotas for project 956a66be18bb4f9e996c8e16bcf23bab. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:24.785086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Getting quotas for user 51b3d953421c409c9edd54287dcd11db and project 956a66be18bb4f9e996c8e16bcf23bab. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:24.814551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:24.817692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:24.886909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-10fc5932-44e6-46ed-927d-8c6a3cc5a12a tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.772074 Aug 27 02:41:24.888940 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1370/2478] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 1775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:41:24.894876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:24.895647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:24.910371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.910886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.911425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.912271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:24.912764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:24.914660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:24.944060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-05636f55-5037-4c01-a8d7-ece8bc0d28d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:24.981066 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-05636f55-5037-4c01-a8d7-ece8bc0d28d4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.301487 Aug 27 02:41:24.994868 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1109/2479] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:24 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:25.022911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58c1837e-488e-47d9-96e7-1d70046cbd88 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] Calling method '.version_select at 0x7f4d2acba4c0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:25.197248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:25.216980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:25.223353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:25.226207 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a437809f-eb29-4c54-b8c3-9bfb9c9739ff tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 0.335720 Aug 27 02:41:25.227910 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1371/2480] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:24 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:25.238266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb80f7ff-7770-4f81-a536-a53a55ae2b67 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:25.239588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fb80f7ff-7770-4f81-a536-a53a55ae2b67 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:25.252657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb80f7ff-7770-4f81-a536-a53a55ae2b67 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:25.253861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb80f7ff-7770-4f81-a536-a53a55ae2b67 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:25.254604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb80f7ff-7770-4f81-a536-a53a55ae2b67 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:25.256160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb80f7ff-7770-4f81-a536-a53a55ae2b67 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:25.257374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb80f7ff-7770-4f81-a536-a53a55ae2b67 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:25.258090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb80f7ff-7770-4f81-a536-a53a55ae2b67 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:25.479943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fb80f7ff-7770-4f81-a536-a53a55ae2b67 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:25.496529 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fb80f7ff-7770-4f81-a536-a53a55ae2b67 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1372 microversion: 2.1 time: 0.264587 Aug 27 02:41:25.498108 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1372/2481] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:25 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1372 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:25.518875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1640329495", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbe38f30-5c1c-448e-a343-52aede3a0292"}], "security_groups": [{"name": "tempest-securitygroup--478865620"}], "key_name": "tempest-keypair-483759875", "user_data": "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:25.708698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] validate_networks() for [('bbe38f30-5c1c-448e-a343-52aede3a0292', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:26.399522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:26.399956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:26.400769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:26.401970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:26.402581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:26.415124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.415750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.416337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.417754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.418243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.418810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.443131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Getting quotas for project 195d9a2cd949478ebc0c53dae45f6501. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:26.449527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Getting quotas for user 61a386e483ae4ab3a33f3a40d5bf41cf and project 195d9a2cd949478ebc0c53dae45f6501. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:26.467083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:26.469834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:26.537482 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-38ce3531-f3b9-4d2f-94cb-f07d1b32ebbd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.037299 Aug 27 02:41:26.539125 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1373/2482] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:41:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:41:26.553588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-409177ef-7068-4b7e-b86b-b3b1f26d14ca tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a0fb9d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:26.621116 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-409177ef-7068-4b7e-b86b-b3b1f26d14ca tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.078740 Aug 27 02:41:26.622074 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1374/2483] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:26 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:26.630355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eae6d7db-9c3a-45c2-9c36-0528065b2fc1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:26.631591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eae6d7db-9c3a-45c2-9c36-0528065b2fc1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:26.643318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae6d7db-9c3a-45c2-9c36-0528065b2fc1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.643831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae6d7db-9c3a-45c2-9c36-0528065b2fc1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.644289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae6d7db-9c3a-45c2-9c36-0528065b2fc1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.645066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae6d7db-9c3a-45c2-9c36-0528065b2fc1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.645545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae6d7db-9c3a-45c2-9c36-0528065b2fc1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.646028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae6d7db-9c3a-45c2-9c36-0528065b2fc1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.803635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eae6d7db-9c3a-45c2-9c36-0528065b2fc1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:26.824118 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eae6d7db-9c3a-45c2-9c36-0528065b2fc1 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1295 microversion: 2.1 time: 0.199762 Aug 27 02:41:26.842941 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1375/2484] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:26 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1295 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:26.859239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b7042454-b0c6-430e-bc5b-b20d7c6b5733 req-40f8fb0a-a812-4795-a405-4d15b466124f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-plugged", "status": "completed", "tag": "5b8a4190-5436-4df2-9d49-7f30f4f5b7c6"}, {"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-plugged", "status": "completed", "tag": "2b0d5ce5-a7a9-4698-8572-d722b196f9c1"}, {"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-plugged", "status": "completed", "tag": "3fd3c81a-a52d-487b-b96d-897eb5de6ea3"}, {"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-plugged", "status": "completed", "tag": "51a61470-c7d5-497f-9946-3031f09ce89e"}, {"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-plugged", "status": "completed", "tag": "5014a7dc-c60b-4976-93dc-28dbb2c34306"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:26.896899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b7042454-b0c6-430e-bc5b-b20d7c6b5733 req-40f8fb0a-a812-4795-a405-4d15b466124f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.899134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b7042454-b0c6-430e-bc5b-b20d7c6b5733 req-40f8fb0a-a812-4795-a405-4d15b466124f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.902298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b7042454-b0c6-430e-bc5b-b20d7c6b5733 req-40f8fb0a-a812-4795-a405-4d15b466124f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.928079 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b7042454-b0c6-430e-bc5b-b20d7c6b5733 req-40f8fb0a-a812-4795-a405-4d15b466124f service nova] Creating event network-vif-plugged:5b8a4190-5436-4df2-9d49-7f30f4f5b7c6 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:41:26.929701 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b7042454-b0c6-430e-bc5b-b20d7c6b5733 req-40f8fb0a-a812-4795-a405-4d15b466124f service nova] Creating event network-vif-plugged:2b0d5ce5-a7a9-4698-8572-d722b196f9c1 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:41:26.931510 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b7042454-b0c6-430e-bc5b-b20d7c6b5733 req-40f8fb0a-a812-4795-a405-4d15b466124f service nova] Creating event network-vif-plugged:3fd3c81a-a52d-487b-b96d-897eb5de6ea3 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:41:26.932491 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b7042454-b0c6-430e-bc5b-b20d7c6b5733 req-40f8fb0a-a812-4795-a405-4d15b466124f service nova] Creating event network-vif-plugged:51a61470-c7d5-497f-9946-3031f09ce89e for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:41:26.934358 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b7042454-b0c6-430e-bc5b-b20d7c6b5733 req-40f8fb0a-a812-4795-a405-4d15b466124f service nova] Creating event network-vif-plugged:5014a7dc-c60b-4976-93dc-28dbb2c34306 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:41:26.946864 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b7042454-b0c6-430e-bc5b-b20d7c6b5733 req-40f8fb0a-a812-4795-a405-4d15b466124f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.101148 Aug 27 02:41:26.948193 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1376/2485] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:26.960536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d45d0fe6-6121-41b7-a4e3-f0ac2735f3ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:26.962542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d45d0fe6-6121-41b7-a4e3-f0ac2735f3ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:26.976692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d45d0fe6-6121-41b7-a4e3-f0ac2735f3ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.978402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d45d0fe6-6121-41b7-a4e3-f0ac2735f3ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.980266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d45d0fe6-6121-41b7-a4e3-f0ac2735f3ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:26.983357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d45d0fe6-6121-41b7-a4e3-f0ac2735f3ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:26.985032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d45d0fe6-6121-41b7-a4e3-f0ac2735f3ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:26.986390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d45d0fe6-6121-41b7-a4e3-f0ac2735f3ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.262409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d45d0fe6-6121-41b7-a4e3-f0ac2735f3ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.282760 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d45d0fe6-6121-41b7-a4e3-f0ac2735f3ca tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.331605 Aug 27 02:41:27.285879 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1377/2486] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:26 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:27.299176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:27.300835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:27.305416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:27.317490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.318896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.320039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.321769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.323048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.324184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.607688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.623760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.625964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.627582 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3a4261fe-1816-4ed9-acee-5e8d3fc3a32a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.339644 Aug 27 02:41:27.628354 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1378/2487] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:27 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:27.634288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:27.635231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:27.648377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.649139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.649923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.651240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.652363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.653427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.727422 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-58c1837e-488e-47d9-96e7-1d70046cbd88 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/1420b871-d0df-4487-828c-1f17d80ad5f7" status: 202 len: 0 microversion: 2.1 time: 2.730802 Aug 27 02:41:27.728656 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1110/2488] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:41:24 2022] DELETE /compute/v2.1/os-floating-ips/1420b871-d0df-4487-828c-1f17d80ad5f7 => generated 0 bytes in 2733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:27.736582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5454dede-8f6b-4823-97e8-da02850dc697 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:27.737843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5454dede-8f6b-4823-97e8-da02850dc697 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:27.745764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:27.747873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5454dede-8f6b-4823-97e8-da02850dc697 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.748660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5454dede-8f6b-4823-97e8-da02850dc697 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.749342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5454dede-8f6b-4823-97e8-da02850dc697 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.750899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5454dede-8f6b-4823-97e8-da02850dc697 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.752511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5454dede-8f6b-4823-97e8-da02850dc697 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.753421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5454dede-8f6b-4823-97e8-da02850dc697 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.906965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.926475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.930329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:27.934035 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1fdc47e3-d96b-4fb3-9a12-338a30719fc3 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 0.303178 Aug 27 02:41:27.936225 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1379/2489] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:27 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:27.946155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:27.947261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:27.961866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.963200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.964281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:27.966645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:27.968149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:27.968337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.203227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:28.216490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:28.218131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:28.220189 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d1b2bfe4-bead-4829-9e66-9176e65df2b4 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1333 microversion: 2.20 time: 0.281890 Aug 27 02:41:28.235272 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1380/2490] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:27 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1333 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:28.243006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6e8ba1bc-a127-44af-90c8-8154a37ee97c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:28.243657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6e8ba1bc-a127-44af-90c8-8154a37ee97c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:28.254084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8ba1bc-a127-44af-90c8-8154a37ee97c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.254862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8ba1bc-a127-44af-90c8-8154a37ee97c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.255707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8ba1bc-a127-44af-90c8-8154a37ee97c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.258076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8ba1bc-a127-44af-90c8-8154a37ee97c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.258451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8ba1bc-a127-44af-90c8-8154a37ee97c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.258934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8ba1bc-a127-44af-90c8-8154a37ee97c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.397625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5454dede-8f6b-4823-97e8-da02850dc697 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:28.410927 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5454dede-8f6b-4823-97e8-da02850dc697 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1372 microversion: 2.1 time: 0.680436 Aug 27 02:41:28.413486 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1111/2491] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:27 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1372 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:28.422800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-39e32916-cc3e-4d19-81fa-91c3fe142688 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2ac30430>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:28.490164 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-39e32916-cc3e-4d19-81fa-91c3fe142688 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.074647 Aug 27 02:41:28.492921 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1112/2492] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:28 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:28.499673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e9e6770c-8e3e-4af2-94f6-7534e26cf8c3 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] Calling method '.version_select at 0x7f4d29d29310>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:28.664559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6e8ba1bc-a127-44af-90c8-8154a37ee97c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:28.681958 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6e8ba1bc-a127-44af-90c8-8154a37ee97c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.444715 Aug 27 02:41:28.702383 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1381/2493] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:28 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:28.711863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a40d0231-514d-4bcc-a75a-3abc3e119901 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:28.714504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a40d0231-514d-4bcc-a75a-3abc3e119901 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:28.723691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a40d0231-514d-4bcc-a75a-3abc3e119901 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.724821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a40d0231-514d-4bcc-a75a-3abc3e119901 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.726232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a40d0231-514d-4bcc-a75a-3abc3e119901 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.727496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a40d0231-514d-4bcc-a75a-3abc3e119901 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.728183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a40d0231-514d-4bcc-a75a-3abc3e119901 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.729286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a40d0231-514d-4bcc-a75a-3abc3e119901 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.833657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a40d0231-514d-4bcc-a75a-3abc3e119901 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:28.847025 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a40d0231-514d-4bcc-a75a-3abc3e119901 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1301 microversion: 2.1 time: 0.142581 Aug 27 02:41:28.848263 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1382/2494] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:28 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1301 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:28.862221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:28.864934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:28.878711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.879819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.880837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.882304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:28.883421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:28.884295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:28.934384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:29.062799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:29.282478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:29.303726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:29.307770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:29.310653 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58b1e195-7037-439b-8f61-ecd760705063 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1879 microversion: 2.32 time: 0.460263 Aug 27 02:41:29.312074 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1383/2495] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:28 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1879 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:29.352183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-73c0a191-8c32-4b94-9156-9154a1fe722e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:29.354032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-73c0a191-8c32-4b94-9156-9154a1fe722e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:29.366483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73c0a191-8c32-4b94-9156-9154a1fe722e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:29.367861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73c0a191-8c32-4b94-9156-9154a1fe722e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:29.369058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73c0a191-8c32-4b94-9156-9154a1fe722e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:29.371551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73c0a191-8c32-4b94-9156-9154a1fe722e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:29.372857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73c0a191-8c32-4b94-9156-9154a1fe722e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:29.374034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73c0a191-8c32-4b94-9156-9154a1fe722e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:29.436838 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e9e6770c-8e3e-4af2-94f6-7534e26cf8c3 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] 10.222.0.99 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.942427 Aug 27 02:41:29.438031 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1113/2496] 10.222.0.99 () {58 vars in 1164 bytes} [Sat Aug 27 02:41:28 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:41:29.446180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:29.448838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:29.471767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:29.476048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:29.480136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:29.484444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:29.485919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:29.489942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:29.728847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-73c0a191-8c32-4b94-9156-9154a1fe722e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:29.741803 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-73c0a191-8c32-4b94-9156-9154a1fe722e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.417057 Aug 27 02:41:29.753697 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1384/2497] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:29 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:29.753697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7a4d669c-f512-4920-9f0b-a05f807d96cf req-7c574de6-6ccc-4d2a-be8d-2545b83691aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534917a1-8a02-493c-af75-fdef81207a5a", "name": "network-vif-plugged", "status": "completed", "tag": "0f7fcd3c-1acc-47b8-ada7-d2c162f10d89"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:29.763980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7a4d669c-f512-4920-9f0b-a05f807d96cf req-7c574de6-6ccc-4d2a-be8d-2545b83691aa service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:29.764597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7a4d669c-f512-4920-9f0b-a05f807d96cf req-7c574de6-6ccc-4d2a-be8d-2545b83691aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:29.765319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7a4d669c-f512-4920-9f0b-a05f807d96cf req-7c574de6-6ccc-4d2a-be8d-2545b83691aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:29.780748 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7a4d669c-f512-4920-9f0b-a05f807d96cf req-7c574de6-6ccc-4d2a-be8d-2545b83691aa service nova] Creating event network-vif-plugged:0f7fcd3c-1acc-47b8-ada7-d2c162f10d89 for instance 534917a1-8a02-493c-af75-fdef81207a5a on n-h2-852084-5 Aug 27 02:41:29.788267 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7a4d669c-f512-4920-9f0b-a05f807d96cf req-7c574de6-6ccc-4d2a-be8d-2545b83691aa service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043785 Aug 27 02:41:29.789078 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1385/2498] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:29.797142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:29.798116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:29.807470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:29.808450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:29.809140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:29.810175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:29.810914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:29.811610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:29.931521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:29.950444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:29.952424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:29.953862 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-efa4125e-5399-4a82-bcb1-82d0b2667cbc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1339 microversion: 2.20 time: 0.163158 Aug 27 02:41:29.965697 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1386/2499] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:29 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1339 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:29.965697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95a45a09-2530-4042-977e-910d5446a9b6 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] Calling method '.version_select at 0x7f4d2a72ba60>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:30.389176 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-95a45a09-2530-4042-977e-910d5446a9b6 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] 10.222.0.99 "GET /compute/v2.1/os-floating-ips" status: 200 len: 395 microversion: 2.1 time: 0.432315 Aug 27 02:41:30.389816 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1387/2500] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:41:29 2022] GET /compute/v2.1/os-floating-ips => generated 395 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:30.394949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2eea9f22-e710-4dfe-8ec6-3a52bead13c2 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:30.395565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2eea9f22-e710-4dfe-8ec6-3a52bead13c2 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:30.405654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eea9f22-e710-4dfe-8ec6-3a52bead13c2 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.406212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eea9f22-e710-4dfe-8ec6-3a52bead13c2 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.406849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eea9f22-e710-4dfe-8ec6-3a52bead13c2 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.407605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eea9f22-e710-4dfe-8ec6-3a52bead13c2 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.408080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eea9f22-e710-4dfe-8ec6-3a52bead13c2 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.408646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eea9f22-e710-4dfe-8ec6-3a52bead13c2 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.526841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:30.540395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:30.549212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:30.550548 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-668d1096-31ec-4e43-8a3a-3268f2201764 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1486 microversion: 2.25 time: 1.110915 Aug 27 02:41:30.566902 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1114/2501] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:29 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1486 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:30.573468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b599817d-47a1-4f9e-9258-23005bfd8dc1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2af32dc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:30.609016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2eea9f22-e710-4dfe-8ec6-3a52bead13c2 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:30.621012 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2eea9f22-e710-4dfe-8ec6-3a52bead13c2 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1372 microversion: 2.1 time: 0.229100 Aug 27 02:41:30.634896 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1388/2502] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:30 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:30.642538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ace8b50a-ddc5-4963-b95f-ad871a93fefc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:30.643212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ace8b50a-ddc5-4963-b95f-ad871a93fefc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:30.652800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ace8b50a-ddc5-4963-b95f-ad871a93fefc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.660556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ace8b50a-ddc5-4963-b95f-ad871a93fefc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.661312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ace8b50a-ddc5-4963-b95f-ad871a93fefc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.668391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ace8b50a-ddc5-4963-b95f-ad871a93fefc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.672287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ace8b50a-ddc5-4963-b95f-ad871a93fefc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.673204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ace8b50a-ddc5-4963-b95f-ad871a93fefc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.679850 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b599817d-47a1-4f9e-9258-23005bfd8dc1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.110538 Aug 27 02:41:30.680772 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1115/2503] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:30 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:30.688972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ecf0e0a4-8220-4721-8789-573b820e9d8b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:30.698753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ecf0e0a4-8220-4721-8789-573b820e9d8b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:30.706164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf0e0a4-8220-4721-8789-573b820e9d8b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.718403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf0e0a4-8220-4721-8789-573b820e9d8b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.718989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf0e0a4-8220-4721-8789-573b820e9d8b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.719850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf0e0a4-8220-4721-8789-573b820e9d8b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.720419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf0e0a4-8220-4721-8789-573b820e9d8b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.720958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecf0e0a4-8220-4721-8789-573b820e9d8b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.862368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ecf0e0a4-8220-4721-8789-573b820e9d8b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:30.875616 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ecf0e0a4-8220-4721-8789-573b820e9d8b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1301 microversion: 2.1 time: 0.193463 Aug 27 02:41:30.891212 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1116/2504] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:30 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1301 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:30.898677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:30.899639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:30.913853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.914821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.915451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.916520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:30.917917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:30.918740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:30.920884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ace8b50a-ddc5-4963-b95f-ad871a93fefc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:30.924439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:30.932901 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ace8b50a-ddc5-4963-b95f-ad871a93fefc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.309338 Aug 27 02:41:30.949756 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1389/2505] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:30 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:30.956690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bde8096d-3c54-41ce-96c2-c1baffa0c874 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] Calling method '.version_select at 0x7f4d2a1c0af0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:31.548405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:31.562762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:31.565186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:31.569236 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a31b728e-e990-45c8-b653-2f9307ba5b48 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 2830 microversion: 2.32 time: 0.676468 Aug 27 02:41:31.583134 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1117/2506] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:30 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 2830 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:31.601337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7bac549-9858-407f-9892-c26b58dafc90 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:31.602440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c7bac549-9858-407f-9892-c26b58dafc90 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:31.610717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7bac549-9858-407f-9892-c26b58dafc90 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:31.611528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7bac549-9858-407f-9892-c26b58dafc90 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:31.612145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7bac549-9858-407f-9892-c26b58dafc90 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:31.613130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7bac549-9858-407f-9892-c26b58dafc90 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:31.613800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7bac549-9858-407f-9892-c26b58dafc90 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:31.614464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7bac549-9858-407f-9892-c26b58dafc90 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:32.415962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c7bac549-9858-407f-9892-c26b58dafc90 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:32.434854 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c7bac549-9858-407f-9892-c26b58dafc90 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.850210 Aug 27 02:41:32.435812 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1118/2507] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:31 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:32.443957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:32.445569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:32.461608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:32.463772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:32.464486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:32.465426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:32.466124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:32.466725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:32.628694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:32.643567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:32.654600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:32.657183 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fa9f6d50-5b56-4663-8632-39715f4bb290 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1339 microversion: 2.20 time: 0.219934 Aug 27 02:41:32.658444 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1119/2508] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:32 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1339 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:32.663486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:32.664346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:32.672749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:32.673829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:32.674448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:32.675425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:32.676057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:32.676770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:32.735138 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bde8096d-3c54-41ce-96c2-c1baffa0c874 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/74b92062-0edc-41b7-bc31-668fb1793521" status: 202 len: 0 microversion: 2.1 time: 1.783911 Aug 27 02:41:32.737085 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1390/2509] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:41:30 2022] DELETE /compute/v2.1/os-floating-ips/74b92062-0edc-41b7-bc31-668fb1793521 => generated 0 bytes in 1786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:32.751841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8d92b574-2238-4342-a193-96be4d49bd8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:32.752718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8d92b574-2238-4342-a193-96be4d49bd8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:32.764779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d92b574-2238-4342-a193-96be4d49bd8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:32.765637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d92b574-2238-4342-a193-96be4d49bd8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:32.766269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d92b574-2238-4342-a193-96be4d49bd8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:32.767676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d92b574-2238-4342-a193-96be4d49bd8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:32.768441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d92b574-2238-4342-a193-96be4d49bd8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:32.769166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d92b574-2238-4342-a193-96be4d49bd8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:33.035364 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8d92b574-2238-4342-a193-96be4d49bd8a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.296330 Aug 27 02:41:33.036835 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1391/2510] 10.222.0.99 () {60 vars in 1316 bytes} [Sat Aug 27 02:41:32 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2/os-interface => generated 1830 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:33.045563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cc21119e-9437-41e8-86e1-dbc426f85fe1 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:33.052739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cc21119e-9437-41e8-86e1-dbc426f85fe1 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:33.079988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc21119e-9437-41e8-86e1-dbc426f85fe1 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:33.080864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc21119e-9437-41e8-86e1-dbc426f85fe1 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:33.081581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc21119e-9437-41e8-86e1-dbc426f85fe1 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:33.101217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc21119e-9437-41e8-86e1-dbc426f85fe1 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:33.102212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc21119e-9437-41e8-86e1-dbc426f85fe1 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:33.102977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc21119e-9437-41e8-86e1-dbc426f85fe1 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:33.560120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:33.595119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:33.598754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:33.603962 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-44c9faca-4592-4543-90d8-e69a5751184e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1476 microversion: 2.25 time: 0.941818 Aug 27 02:41:33.606352 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1120/2511] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:32 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1476 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:33.618305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5882147b-2f0e-460c-9d1f-f6b8f7ee3e98 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e74eaf0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:33.793259 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5882147b-2f0e-460c-9d1f-f6b8f7ee3e98 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.183407 Aug 27 02:41:33.796832 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1121/2512] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:33 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:33.823361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-716de0a7-4ba7-4854-9abe-714680d7e04c req-e599ecbf-6626-46c8-ab13-d46ba0e7a8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada54a54-66b3-47b3-87dd-e3e7b5bf934b", "name": "network-vif-plugged", "status": "completed", "tag": "972893de-522e-44d8-bab8-60c023b9fb4c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:33.869503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-716de0a7-4ba7-4854-9abe-714680d7e04c req-e599ecbf-6626-46c8-ab13-d46ba0e7a8b5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:33.871826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-716de0a7-4ba7-4854-9abe-714680d7e04c req-e599ecbf-6626-46c8-ab13-d46ba0e7a8b5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:33.872644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-716de0a7-4ba7-4854-9abe-714680d7e04c req-e599ecbf-6626-46c8-ab13-d46ba0e7a8b5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:33.921158 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-716de0a7-4ba7-4854-9abe-714680d7e04c req-e599ecbf-6626-46c8-ab13-d46ba0e7a8b5 service nova] Creating event network-vif-plugged:972893de-522e-44d8-bab8-60c023b9fb4c for instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b on n-h1-852084-5 Aug 27 02:41:33.935710 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-716de0a7-4ba7-4854-9abe-714680d7e04c req-e599ecbf-6626-46c8-ab13-d46ba0e7a8b5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136708 Aug 27 02:41:33.946039 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1122/2513] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:33.969711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ffb497a7-31e6-45e4-9ec7-41350c7d48b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:33.972450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ffb497a7-31e6-45e4-9ec7-41350c7d48b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:33.985419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffb497a7-31e6-45e4-9ec7-41350c7d48b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:33.986642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffb497a7-31e6-45e4-9ec7-41350c7d48b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:33.987664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffb497a7-31e6-45e4-9ec7-41350c7d48b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:33.989455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffb497a7-31e6-45e4-9ec7-41350c7d48b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:33.990795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffb497a7-31e6-45e4-9ec7-41350c7d48b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:33.991795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffb497a7-31e6-45e4-9ec7-41350c7d48b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:34.462106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cc21119e-9437-41e8-86e1-dbc426f85fe1 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:34.489812 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cc21119e-9437-41e8-86e1-dbc426f85fe1 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1559 microversion: 2.1 time: 1.450996 Aug 27 02:41:34.492950 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1392/2514] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:33 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1559 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:34.499907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba4a69df-08e8-4897-a360-ddf3bf425ffc tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] Calling method '.version_select at 0x7f4d2a111550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:35.135886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ffb497a7-31e6-45e4-9ec7-41350c7d48b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:35.155853 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ffb497a7-31e6-45e4-9ec7-41350c7d48b5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1369 microversion: 2.1 time: 1.199520 Aug 27 02:41:35.176233 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1123/2515] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:33 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1369 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:35.200817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9d631e43-3fcf-4c98-a47a-3d202ac83779 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '.version_select at 0x7f4d2e8fe430>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:35.214487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d631e43-3fcf-4c98-a47a-3d202ac83779 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:35.216389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d631e43-3fcf-4c98-a47a-3d202ac83779 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:35.217589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d631e43-3fcf-4c98-a47a-3d202ac83779 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:35.238831 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9d631e43-3fcf-4c98-a47a-3d202ac83779 tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/os-migrations" status: 200 len: 1698 microversion: 2.25 time: 0.059607 Aug 27 02:41:35.240200 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1124/2516] 10.222.0.99 () {60 vars in 1184 bytes} [Sat Aug 27 02:41:35 2022] GET /compute/v2.1/os-migrations => generated 1698 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:35.259381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:35.261638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:35.292897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:35.294535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:35.296088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:35.297815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:35.298995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:35.300105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:36.140168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:36.159379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:36.163645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:36.167969 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e745fae5-e3d9-4993-aa29-007990e84515 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1406 microversion: 2.20 time: 0.925027 Aug 27 02:41:36.182362 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1125/2517] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:35 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1406 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:36.197950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-761b1aa2-5719-4e3c-b76a-16bd2b902a93 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:36.197950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-761b1aa2-5719-4e3c-b76a-16bd2b902a93 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:36.206725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-761b1aa2-5719-4e3c-b76a-16bd2b902a93 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:36.207851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-761b1aa2-5719-4e3c-b76a-16bd2b902a93 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:36.208623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-761b1aa2-5719-4e3c-b76a-16bd2b902a93 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:36.210308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-761b1aa2-5719-4e3c-b76a-16bd2b902a93 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:36.211167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-761b1aa2-5719-4e3c-b76a-16bd2b902a93 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:36.211942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-761b1aa2-5719-4e3c-b76a-16bd2b902a93 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:36.429157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:36.462456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=16 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:36.559871 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-761b1aa2-5719-4e3c-b76a-16bd2b902a93 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.380233 Aug 27 02:41:36.560893 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1126/2518] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:41:36 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-interface => generated 285 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:36.587566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cb54bc17-5e7b-4183-8110-ee2867339c89 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e774f70>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:36.678752 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cb54bc17-5e7b-4183-8110-ee2867339c89 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.102257 Aug 27 02:41:36.694894 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1127/2519] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:36 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:36.703716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e5d3d892-4ed5-4c08-8104-6d6650a9da8e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:36.704790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e5d3d892-4ed5-4c08-8104-6d6650a9da8e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:36.718252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d3d892-4ed5-4c08-8104-6d6650a9da8e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:36.719067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d3d892-4ed5-4c08-8104-6d6650a9da8e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:36.719842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d3d892-4ed5-4c08-8104-6d6650a9da8e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:36.721116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d3d892-4ed5-4c08-8104-6d6650a9da8e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:36.721975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d3d892-4ed5-4c08-8104-6d6650a9da8e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:36.722719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d3d892-4ed5-4c08-8104-6d6650a9da8e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:37.526890 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ba4a69df-08e8-4897-a360-ddf3bf425ffc tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/f6434db2-88b8-4f40-a910-e53340255d8b" status: 202 len: 0 microversion: 2.1 time: 3.032395 Aug 27 02:41:37.536407 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1393/2520] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:41:34 2022] DELETE /compute/v2.1/os-floating-ips/f6434db2-88b8-4f40-a910-e53340255d8b => generated 0 bytes in 3043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:37.548908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1568907d-4e64-4b1e-8240-ae6f9f830e71 req-126e6789-ebbd-47e1-b977-8f19daf3d996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875762f1-6b75-4c91-859b-76fb857ecb26", "tag": "ef6abdee-33da-4ec5-9d71-9440e01d80d1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:37.580335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1568907d-4e64-4b1e-8240-ae6f9f830e71 req-126e6789-ebbd-47e1-b977-8f19daf3d996 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:37.584763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1568907d-4e64-4b1e-8240-ae6f9f830e71 req-126e6789-ebbd-47e1-b977-8f19daf3d996 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:37.588986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1568907d-4e64-4b1e-8240-ae6f9f830e71 req-126e6789-ebbd-47e1-b977-8f19daf3d996 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:37.631087 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1568907d-4e64-4b1e-8240-ae6f9f830e71 req-126e6789-ebbd-47e1-b977-8f19daf3d996 service nova] Creating event network-changed:ef6abdee-33da-4ec5-9d71-9440e01d80d1 for instance 875762f1-6b75-4c91-859b-76fb857ecb26 on n-h1-852084-5 Aug 27 02:41:37.652725 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1568907d-4e64-4b1e-8240-ae6f9f830e71 req-126e6789-ebbd-47e1-b977-8f19daf3d996 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112519 Aug 27 02:41:37.662356 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1394/2521] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:37.679716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aef9e7c6-9f99-4276-9fb6-0b62bd4c71b9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:37.683186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aef9e7c6-9f99-4276-9fb6-0b62bd4c71b9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:37.721973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef9e7c6-9f99-4276-9fb6-0b62bd4c71b9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:37.722886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef9e7c6-9f99-4276-9fb6-0b62bd4c71b9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:37.723708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef9e7c6-9f99-4276-9fb6-0b62bd4c71b9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:37.735814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef9e7c6-9f99-4276-9fb6-0b62bd4c71b9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:37.736710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef9e7c6-9f99-4276-9fb6-0b62bd4c71b9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:37.737373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef9e7c6-9f99-4276-9fb6-0b62bd4c71b9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:37.795403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-e5d3d892-4ed5-4c08-8104-6d6650a9da8e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] Lazy-loading 'services' on Instance uuid f562df2c-cfe6-463e-89a2-b5dc19206114 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:41:37.892655 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e5d3d892-4ed5-4c08-8104-6d6650a9da8e tempest-LiveAutoBlockMigrationV225Test-1910048258 tempest-LiveAutoBlockMigrationV225Test-1910048258-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1968 microversion: 2.25 time: 1.194710 Aug 27 02:41:37.903265 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1128/2522] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:36 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1968 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:37.959203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:37.967385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:38.001897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.003330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.006351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.008337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.013856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.015603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.201755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aef9e7c6-9f99-4276-9fb6-0b62bd4c71b9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:38.211812 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aef9e7c6-9f99-4276-9fb6-0b62bd4c71b9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1369 microversion: 2.1 time: 0.547171 Aug 27 02:41:38.212421 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1395/2523] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:37 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1369 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:38.219982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-401ba7f7-2ad8-4731-b68f-5d83ea32f55a req-0530a3b2-9f18-456f-b7ed-1f6ac3f1fbaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "tag": "5014a7dc-c60b-4976-93dc-28dbb2c34306"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:38.244168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-401ba7f7-2ad8-4731-b68f-5d83ea32f55a req-0530a3b2-9f18-456f-b7ed-1f6ac3f1fbaf service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.245102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-401ba7f7-2ad8-4731-b68f-5d83ea32f55a req-0530a3b2-9f18-456f-b7ed-1f6ac3f1fbaf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.245845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-401ba7f7-2ad8-4731-b68f-5d83ea32f55a req-0530a3b2-9f18-456f-b7ed-1f6ac3f1fbaf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.273771 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-401ba7f7-2ad8-4731-b68f-5d83ea32f55a req-0530a3b2-9f18-456f-b7ed-1f6ac3f1fbaf service nova] Creating event network-changed:5014a7dc-c60b-4976-93dc-28dbb2c34306 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:41:38.283451 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-401ba7f7-2ad8-4731-b68f-5d83ea32f55a req-0530a3b2-9f18-456f-b7ed-1f6ac3f1fbaf service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067968 Aug 27 02:41:38.284923 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1396/2524] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:38.291949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2e20b197-29d3-4fc0-aa99-c339864a6d95 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] Calling method '.version_select at 0x7f4d2e8c0dc0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:38.574283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:38.591213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:38.592710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:38.593924 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c3e47756-820a-4fc8-9346-fdf82aaed1f9 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1406 microversion: 2.20 time: 0.679089 Aug 27 02:41:38.609729 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1129/2525] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:37 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1406 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:38.612581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3ade87ee-0dbc-4bb7-adf7-debc1869e201 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a6e6ca0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:38.712384 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3ade87ee-0dbc-4bb7-adf7-debc1869e201 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.112567 Aug 27 02:41:38.721078 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1130/2526] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:38 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:38.726968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0783a1ae-68a6-4377-a8c2-131343250f09 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:38.727806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0783a1ae-68a6-4377-a8c2-131343250f09 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:38.735379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0783a1ae-68a6-4377-a8c2-131343250f09 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.738382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0783a1ae-68a6-4377-a8c2-131343250f09 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.739006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0783a1ae-68a6-4377-a8c2-131343250f09 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.740040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0783a1ae-68a6-4377-a8c2-131343250f09 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:38.747248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0783a1ae-68a6-4377-a8c2-131343250f09 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:38.747890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0783a1ae-68a6-4377-a8c2-131343250f09 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:38.844263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0783a1ae-68a6-4377-a8c2-131343250f09 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:41:39.080168 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0783a1ae-68a6-4377-a8c2-131343250f09 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 204 len: 0 microversion: 2.25 time: 0.353861 Aug 27 02:41:39.087039 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1131/2527] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:41:38 2022] DELETE /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:41:39.110025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:39.111716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:39.129886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:39.131073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:39.132017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:39.133971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:39.135457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:39.136782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:39.824011 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2e20b197-29d3-4fc0-aa99-c339864a6d95 tempest-FloatingIPDetailsTestJSON-1082453523 tempest-FloatingIPDetailsTestJSON-1082453523-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/9f7aa7bd-7a6f-4bd6-b135-59c9cba347ec" status: 202 len: 0 microversion: 2.1 time: 1.536403 Aug 27 02:41:39.825596 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1397/2528] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:41:38 2022] DELETE /compute/v2.1/os-floating-ips/9f7aa7bd-7a6f-4bd6-b135-59c9cba347ec => generated 0 bytes in 1540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:39.844020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-caf5e1f7-95bb-4bd0-b0ca-a52971f2e889 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:39.848136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-caf5e1f7-95bb-4bd0-b0ca-a52971f2e889 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:39.875892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf5e1f7-95bb-4bd0-b0ca-a52971f2e889 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:39.881860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf5e1f7-95bb-4bd0-b0ca-a52971f2e889 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:39.884331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf5e1f7-95bb-4bd0-b0ca-a52971f2e889 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:39.890541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf5e1f7-95bb-4bd0-b0ca-a52971f2e889 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:39.891951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf5e1f7-95bb-4bd0-b0ca-a52971f2e889 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:39.895171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf5e1f7-95bb-4bd0-b0ca-a52971f2e889 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.241148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:40.250753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:40.256221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:40.267218 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7ef3515-2951-4f68-a474-c2f1a3547062 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1482 microversion: 2.25 time: 1.173926 Aug 27 02:41:40.268307 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1132/2529] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:39 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1482 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:40.288612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:40.289370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:40.309788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.325600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.326528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.327890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.328756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.329569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.464865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-caf5e1f7-95bb-4bd0-b0ca-a52971f2e889 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:40.487254 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-caf5e1f7-95bb-4bd0-b0ca-a52971f2e889 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1369 microversion: 2.1 time: 0.659206 Aug 27 02:41:40.505006 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1398/2530] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:39 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1369 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:40.510835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-60c0fb14-0ea8-4eef-b390-d2a43dc8efa6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e8904c0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:40.586678 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-60c0fb14-0ea8-4eef-b390-d2a43dc8efa6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.079948 Aug 27 02:41:40.596197 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1399/2531] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:40 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:40.602078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-542e0427-da4a-4fb9-b9a1-05dc3f0be6e1 req-8e6ef1a4-3bef-4d85-a753-2ffddf380f4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7489a8a-8682-4455-abba-671195effab4", "tag": "63f5c4dc-7c22-4bfa-8abc-a93876b795f0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:40.640590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-542e0427-da4a-4fb9-b9a1-05dc3f0be6e1 req-8e6ef1a4-3bef-4d85-a753-2ffddf380f4b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:40.641496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-542e0427-da4a-4fb9-b9a1-05dc3f0be6e1 req-8e6ef1a4-3bef-4d85-a753-2ffddf380f4b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:40.642216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-542e0427-da4a-4fb9-b9a1-05dc3f0be6e1 req-8e6ef1a4-3bef-4d85-a753-2ffddf380f4b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:40.675704 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-542e0427-da4a-4fb9-b9a1-05dc3f0be6e1 req-8e6ef1a4-3bef-4d85-a753-2ffddf380f4b service nova] Creating event network-changed:63f5c4dc-7c22-4bfa-8abc-a93876b795f0 for instance a7489a8a-8682-4455-abba-671195effab4 on n-h1-852084-5 Aug 27 02:41:40.688262 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-542e0427-da4a-4fb9-b9a1-05dc3f0be6e1 req-8e6ef1a4-3bef-4d85-a753-2ffddf380f4b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087742 Aug 27 02:41:40.689992 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1400/2532] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:41.300879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:41.310271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:41.329443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:41.331822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:41.333202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:41.340510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:41.342189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:41.344612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:41.348042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:41.357588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:41.359260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:41.360524 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3173e50f-9b55-42e9-8fd4-382f62d98164 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1406 microversion: 2.20 time: 1.081585 Aug 27 02:41:41.390172 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1133/2533] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:40 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1406 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:41.518878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-17ad3fa8-356a-456e-9f3a-08405400df82 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:41.519975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-17ad3fa8-356a-456e-9f3a-08405400df82 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:41.537827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17ad3fa8-356a-456e-9f3a-08405400df82 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:41.538319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17ad3fa8-356a-456e-9f3a-08405400df82 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:41.538919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17ad3fa8-356a-456e-9f3a-08405400df82 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:41.539776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17ad3fa8-356a-456e-9f3a-08405400df82 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:41.540355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17ad3fa8-356a-456e-9f3a-08405400df82 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:41.540904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-17ad3fa8-356a-456e-9f3a-08405400df82 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:41.748126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:41.761443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:41.765857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:41.765857 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-142a96a4-ef28-4cab-b249-63f5b30e00b5 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1482 microversion: 2.25 time: 0.477051 Aug 27 02:41:41.767264 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1401/2534] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:41 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1482 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:41.789198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-80399672-fb38-4457-ac30-c6ccb28a79a9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a2c8040>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:41.972591 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-80399672-fb38-4457-ac30-c6ccb28a79a9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.203324 Aug 27 02:41:41.980590 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1402/2535] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:41 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:42.147744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-86c55e35-4a5a-4bf7-8f8c-07b615d27420 req-74a6d1ba-c675-4ebf-a77c-9938fe51bf33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875762f1-6b75-4c91-859b-76fb857ecb26", "name": "network-vif-plugged", "status": "completed", "tag": "ef6abdee-33da-4ec5-9d71-9440e01d80d1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:42.208780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-86c55e35-4a5a-4bf7-8f8c-07b615d27420 req-74a6d1ba-c675-4ebf-a77c-9938fe51bf33 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:42.210034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-86c55e35-4a5a-4bf7-8f8c-07b615d27420 req-74a6d1ba-c675-4ebf-a77c-9938fe51bf33 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:42.210929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-86c55e35-4a5a-4bf7-8f8c-07b615d27420 req-74a6d1ba-c675-4ebf-a77c-9938fe51bf33 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:42.241853 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-86c55e35-4a5a-4bf7-8f8c-07b615d27420 req-74a6d1ba-c675-4ebf-a77c-9938fe51bf33 service nova] Creating event network-vif-plugged:ef6abdee-33da-4ec5-9d71-9440e01d80d1 for instance 875762f1-6b75-4c91-859b-76fb857ecb26 on n-h1-852084-5 Aug 27 02:41:42.257261 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-86c55e35-4a5a-4bf7-8f8c-07b615d27420 req-74a6d1ba-c675-4ebf-a77c-9938fe51bf33 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117794 Aug 27 02:41:42.258956 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1403/2536] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:42.392058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:42.401313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:42.433586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:42.446778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:42.454066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:42.455085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:42.455588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:42.457262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:42.553349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-17ad3fa8-356a-456e-9f3a-08405400df82 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:42.580534 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-17ad3fa8-356a-456e-9f3a-08405400df82 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1369 microversion: 2.1 time: 1.067067 Aug 27 02:41:42.598052 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1134/2537] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:41 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1369 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:42.851469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:42.866367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:42.915990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:42.918320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:42.919576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:42.921270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:42.922632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:42.925100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:42.977867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:43.034813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:43.057341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:43.062546 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-42b74576-cda2-4d20-97a1-f9045cf0ab0d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1406 microversion: 2.20 time: 0.679849 Aug 27 02:41:43.066448 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1404/2538] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:42 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1406 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:41:43.095565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21e66594-f0b4-4090-8ad2-dc1bcb704b81 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a0fb1f0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:43.286866 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21e66594-f0b4-4090-8ad2-dc1bcb704b81 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.215512 Aug 27 02:41:43.310102 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1405/2539] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:43 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:43.622670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1417c4d-d44f-437f-99ad-34580c2c5efa tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:43.623849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a1417c4d-d44f-437f-99ad-34580c2c5efa tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:43.644661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1417c4d-d44f-437f-99ad-34580c2c5efa tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:43.645195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1417c4d-d44f-437f-99ad-34580c2c5efa tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:43.653120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1417c4d-d44f-437f-99ad-34580c2c5efa tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:43.657136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1417c4d-d44f-437f-99ad-34580c2c5efa tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:43.657766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1417c4d-d44f-437f-99ad-34580c2c5efa tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:43.658237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1417c4d-d44f-437f-99ad-34580c2c5efa tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:43.992050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:44.015052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:44.025101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:44.031753 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dc196176-c896-4a67-b1e7-c586b17df5df tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1482 microversion: 2.25 time: 1.212796 Aug 27 02:41:44.036644 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1135/2540] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:42 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1482 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:44.063967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-5a709ce5-c32b-4ec1-9ed8-060405ca6070 req-6c37ced1-ca38-461e-a754-22a2fd4797a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534917a1-8a02-493c-af75-fdef81207a5a", "tag": "0f7fcd3c-1acc-47b8-ada7-d2c162f10d89"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:44.087256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5a709ce5-c32b-4ec1-9ed8-060405ca6070 req-6c37ced1-ca38-461e-a754-22a2fd4797a7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:44.089925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5a709ce5-c32b-4ec1-9ed8-060405ca6070 req-6c37ced1-ca38-461e-a754-22a2fd4797a7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:44.090683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5a709ce5-c32b-4ec1-9ed8-060405ca6070 req-6c37ced1-ca38-461e-a754-22a2fd4797a7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:44.116943 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-5a709ce5-c32b-4ec1-9ed8-060405ca6070 req-6c37ced1-ca38-461e-a754-22a2fd4797a7 service nova] Creating event network-changed:0f7fcd3c-1acc-47b8-ada7-d2c162f10d89 for instance 534917a1-8a02-493c-af75-fdef81207a5a on n-h2-852084-5 Aug 27 02:41:44.131835 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-5a709ce5-c32b-4ec1-9ed8-060405ca6070 req-6c37ced1-ca38-461e-a754-22a2fd4797a7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088912 Aug 27 02:41:44.136210 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1136/2541] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:44.147898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:44.153910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:44.165144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:44.167405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:44.169321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:44.171909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:44.174574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:44.175736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:44.239634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:44.705322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a1417c4d-d44f-437f-99ad-34580c2c5efa tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:44.726821 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a1417c4d-d44f-437f-99ad-34580c2c5efa tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1369 microversion: 2.1 time: 1.109957 Aug 27 02:41:44.732500 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1406/2542] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:43 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1369 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:44.750216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ad47029-ca2b-4ed9-be87-2314f3b717c6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:44.753904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ad47029-ca2b-4ed9-be87-2314f3b717c6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:44.767781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad47029-ca2b-4ed9-be87-2314f3b717c6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:44.772203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad47029-ca2b-4ed9-be87-2314f3b717c6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:44.772974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad47029-ca2b-4ed9-be87-2314f3b717c6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:44.774086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad47029-ca2b-4ed9-be87-2314f3b717c6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:44.774740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad47029-ca2b-4ed9-be87-2314f3b717c6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:44.778190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad47029-ca2b-4ed9-be87-2314f3b717c6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:44.993759 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ad47029-ca2b-4ed9-be87-2314f3b717c6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.259516 Aug 27 02:41:44.996147 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1407/2543] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:41:44 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:41:45.008793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4778e778-9d4c-43d7-9ac9-e4d63f6e69d1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a11e670>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:45.127940 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4778e778-9d4c-43d7-9ac9-e4d63f6e69d1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.130148 Aug 27 02:41:45.129166 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1408/2544] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:44 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:45.142033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f6263c16-e158-43c4-b31c-86fa8fe02642 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:45.146487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f6263c16-e158-43c4-b31c-86fa8fe02642 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:45.163377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f6263c16-e158-43c4-b31c-86fa8fe02642 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.163909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f6263c16-e158-43c4-b31c-86fa8fe02642 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.164373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f6263c16-e158-43c4-b31c-86fa8fe02642 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.165133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f6263c16-e158-43c4-b31c-86fa8fe02642 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.165605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f6263c16-e158-43c4-b31c-86fa8fe02642 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.171988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f6263c16-e158-43c4-b31c-86fa8fe02642 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.231419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.248846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.263479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.267916 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba241230-4d7d-4f4e-84ab-ab542e36c516 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1406 microversion: 2.20 time: 1.129403 Aug 27 02:41:45.268439 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1137/2545] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:44 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1406 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:45.310063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:45.310702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:45.340987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.341551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.342073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.343468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.345533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.346363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.612651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.628204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.632307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:45.634671 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e21d025a-cfa5-4a30-bb0c-4ceee4d3ca0e tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1440 microversion: 2.25 time: 0.338810 Aug 27 02:41:45.638449 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1138/2546] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:45 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1440 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:45.774409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-507bf094-c285-42f6-a1c6-488e54af2fb0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:45.776075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-507bf094-c285-42f6-a1c6-488e54af2fb0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:45.796268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-507bf094-c285-42f6-a1c6-488e54af2fb0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.798239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-507bf094-c285-42f6-a1c6-488e54af2fb0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.800389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-507bf094-c285-42f6-a1c6-488e54af2fb0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:45.801691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-507bf094-c285-42f6-a1c6-488e54af2fb0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:45.804414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-507bf094-c285-42f6-a1c6-488e54af2fb0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:45.805010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-507bf094-c285-42f6-a1c6-488e54af2fb0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.056954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f6263c16-e158-43c4-b31c-86fa8fe02642 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:46.073129 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f6263c16-e158-43c4-b31c-86fa8fe02642 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1670 microversion: 2.1 time: 0.942663 Aug 27 02:41:46.074076 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1409/2547] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:45 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1670 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:46.153417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a91e746a-a4db-41d3-8b9c-57c7280ae0d0 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e8a05e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:46.254654 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a91e746a-a4db-41d3-8b9c-57c7280ae0d0 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.113836 Aug 27 02:41:46.263290 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1410/2548] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:46 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:46.301715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:46.306083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:46.352696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.354538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.357158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.359026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.360383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.361424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.823509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-507bf094-c285-42f6-a1c6-488e54af2fb0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:46.859736 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-507bf094-c285-42f6-a1c6-488e54af2fb0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1564 microversion: 2.1 time: 1.095957 Aug 27 02:41:46.860346 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1139/2549] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:45 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1564 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:46.873526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-942f884e-0033-466c-9b98-4fb2ce8203fa req-582559ee-70a2-4685-b61f-403951a8fc23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f562df2c-cfe6-463e-89a2-b5dc19206114", "name": "network-vif-deleted", "tag": "71f73dc2-9f50-4ee7-807a-67585a999a89"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:46.906625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-942f884e-0033-466c-9b98-4fb2ce8203fa req-582559ee-70a2-4685-b61f-403951a8fc23 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:46.907369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-942f884e-0033-466c-9b98-4fb2ce8203fa req-582559ee-70a2-4685-b61f-403951a8fc23 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:46.908017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-942f884e-0033-466c-9b98-4fb2ce8203fa req-582559ee-70a2-4685-b61f-403951a8fc23 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:46.947901 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-942f884e-0033-466c-9b98-4fb2ce8203fa req-582559ee-70a2-4685-b61f-403951a8fc23 service nova] Creating event network-vif-deleted:71f73dc2-9f50-4ee7-807a-67585a999a89 for instance f562df2c-cfe6-463e-89a2-b5dc19206114 on n-h1-852084-5 Aug 27 02:41:46.972584 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-942f884e-0033-466c-9b98-4fb2ce8203fa req-582559ee-70a2-4685-b61f-403951a8fc23 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107367 Aug 27 02:41:46.974048 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1140/2550] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:47.000587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:47.001881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:47.030161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.031047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.037280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.042110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.043151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.044225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.277148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.280996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:47.303461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.305190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.307268 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70ef1446-cbca-4176-9869-802ee94b6c35 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1406 microversion: 2.20 time: 1.017317 Aug 27 02:41:47.319984 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1411/2551] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:46 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1406 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:47.330855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f7d08392-9564-4085-973a-bdccaa557257 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:47.334738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f7d08392-9564-4085-973a-bdccaa557257 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:47.357141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7d08392-9564-4085-973a-bdccaa557257 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.357652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7d08392-9564-4085-973a-bdccaa557257 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.358136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7d08392-9564-4085-973a-bdccaa557257 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.358886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7d08392-9564-4085-973a-bdccaa557257 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.359364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7d08392-9564-4085-973a-bdccaa557257 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.359810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7d08392-9564-4085-973a-bdccaa557257 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.453547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.482870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.488355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:47.494424 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d6c9cd21-6c53-47ba-947f-39d4cab545ab tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1265 microversion: 2.25 time: 0.513367 Aug 27 02:41:47.499255 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1141/2552] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:46 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1265 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:47.522836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8b85deca-566b-464e-9754-afafb422bdbc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:47.532315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8b85deca-566b-464e-9754-afafb422bdbc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:47.558725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b85deca-566b-464e-9754-afafb422bdbc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.560232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b85deca-566b-464e-9754-afafb422bdbc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.561360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b85deca-566b-464e-9754-afafb422bdbc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.564357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b85deca-566b-464e-9754-afafb422bdbc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:47.566029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b85deca-566b-464e-9754-afafb422bdbc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:47.567203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b85deca-566b-464e-9754-afafb422bdbc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:47.649101 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f7d08392-9564-4085-973a-bdccaa557257 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.339211 Aug 27 02:41:47.650871 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1412/2553] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:41:47 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-interface => generated 285 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:47.670727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2b9aa44-2250-4659-b4ba-6fa93296da50 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a11a280>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:47.870136 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2b9aa44-2250-4659-b4ba-6fa93296da50 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.215480 Aug 27 02:41:47.871899 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1413/2554] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:47 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:48.372585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:48.384084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:48.452076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.456117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.459280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.465546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.467633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.471489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.580184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8b85deca-566b-464e-9754-afafb422bdbc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:48.595586 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8b85deca-566b-464e-9754-afafb422bdbc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1670 microversion: 2.1 time: 1.093889 Aug 27 02:41:48.626089 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1142/2555] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:47 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1670 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:48.631192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:48.631827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:48.663176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.667390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.667864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.668650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:48.669125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:48.669570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:48.849481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:48.891688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:48.895540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:48.906279 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de86f345-50c9-4c53-968b-9f7e40485ab2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1265 microversion: 2.25 time: 0.278521 Aug 27 02:41:48.907888 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1143/2556] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:48 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:48.919076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-43e82c95-8d06-4664-a2c1-8c27cfdea89e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a7ab4c0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:49.102775 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-43e82c95-8d06-4664-a2c1-8c27cfdea89e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.187792 Aug 27 02:41:49.104925 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1144/2557] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:48 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:49.321799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:49.339793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:49.341357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:49.342611 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fb3029df-7e6e-48f4-a1b8-960ee425f57a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1406 microversion: 2.20 time: 0.984718 Aug 27 02:41:49.346951 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1414/2558] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:48 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1406 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:49.638226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f35853cc-7bdd-4ba5-8b8b-061cd1701cf7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:49.643590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f35853cc-7bdd-4ba5-8b8b-061cd1701cf7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:49.668736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f35853cc-7bdd-4ba5-8b8b-061cd1701cf7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:49.680514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f35853cc-7bdd-4ba5-8b8b-061cd1701cf7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:49.683489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f35853cc-7bdd-4ba5-8b8b-061cd1701cf7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:49.688926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f35853cc-7bdd-4ba5-8b8b-061cd1701cf7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:49.694439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f35853cc-7bdd-4ba5-8b8b-061cd1701cf7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:49.695866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f35853cc-7bdd-4ba5-8b8b-061cd1701cf7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:49.939842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:49.941018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:49.973227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:49.974850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:49.979126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:49.983379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:49.993092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:49.994865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.272211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:50.294963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:50.299931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:50.301840 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f08b8566-cca2-4899-9a09-14f9e972210a tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1265 microversion: 2.25 time: 0.370242 Aug 27 02:41:50.304660 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1415/2559] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:49 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1265 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:50.316626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-30562ca5-7077-4e45-bba8-d5888de2f374 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a2425e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:50.469383 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-30562ca5-7077-4e45-bba8-d5888de2f374 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.161182 Aug 27 02:41:50.472647 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1416/2560] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:50 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:50.496563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:50.498144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:50.536188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:50.537167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:50.538391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.540848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:50.545815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:50.546530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.653598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f35853cc-7bdd-4ba5-8b8b-061cd1701cf7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:50.704906 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f35853cc-7bdd-4ba5-8b8b-061cd1701cf7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1670 microversion: 2.1 time: 1.079370 Aug 27 02:41:50.716454 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1145/2561] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:49 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1670 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:50.810178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-39f66b21-8023-44cc-9d7e-5a29fcedccc7 req-da5b3a36-01c8-4a25-a8e3-aca3d4d510ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7489a8a-8682-4455-abba-671195effab4", "name": "network-vif-plugged", "status": "completed", "tag": "63f5c4dc-7c22-4bfa-8abc-a93876b795f0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:50.833831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-39f66b21-8023-44cc-9d7e-5a29fcedccc7 req-da5b3a36-01c8-4a25-a8e3-aca3d4d510ad service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:50.836910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-39f66b21-8023-44cc-9d7e-5a29fcedccc7 req-da5b3a36-01c8-4a25-a8e3-aca3d4d510ad service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:50.839981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-39f66b21-8023-44cc-9d7e-5a29fcedccc7 req-da5b3a36-01c8-4a25-a8e3-aca3d4d510ad service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:50.869769 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-39f66b21-8023-44cc-9d7e-5a29fcedccc7 req-da5b3a36-01c8-4a25-a8e3-aca3d4d510ad service nova] Creating event network-vif-plugged:63f5c4dc-7c22-4bfa-8abc-a93876b795f0 for instance a7489a8a-8682-4455-abba-671195effab4 on n-h1-852084-5 Aug 27 02:41:50.893968 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-39f66b21-8023-44cc-9d7e-5a29fcedccc7 req-da5b3a36-01c8-4a25-a8e3-aca3d4d510ad service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089249 Aug 27 02:41:50.900914 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1146/2562] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:41:51.326372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:51.334312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:51.335579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:51.349153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:51.350966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:51.368428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.369759 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f9339d09-3628-4c55-9f9f-7101817a20ca tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1406 microversion: 2.20 time: 0.888224 Aug 27 02:41:51.370457 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1417/2563] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:50 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1406 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:51.371371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.379690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c60665d2-f442-418f-a406-b32196472be5 req-e5a8f75b-cd8f-4ac1-8a53-c298d2c56598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875762f1-6b75-4c91-859b-76fb857ecb26", "tag": "ef6abdee-33da-4ec5-9d71-9440e01d80d1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:51.380602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.381730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.382469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.390905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.457304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c60665d2-f442-418f-a406-b32196472be5 req-e5a8f75b-cd8f-4ac1-8a53-c298d2c56598 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.457904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c60665d2-f442-418f-a406-b32196472be5 req-e5a8f75b-cd8f-4ac1-8a53-c298d2c56598 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.458354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c60665d2-f442-418f-a406-b32196472be5 req-e5a8f75b-cd8f-4ac1-8a53-c298d2c56598 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.522778 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c60665d2-f442-418f-a406-b32196472be5 req-e5a8f75b-cd8f-4ac1-8a53-c298d2c56598 service nova] Creating event network-changed:ef6abdee-33da-4ec5-9d71-9440e01d80d1 for instance 875762f1-6b75-4c91-859b-76fb857ecb26 on n-h1-852084-5 Aug 27 02:41:51.547153 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c60665d2-f442-418f-a406-b32196472be5 req-e5a8f75b-cd8f-4ac1-8a53-c298d2c56598 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167257 Aug 27 02:41:51.551883 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1418/2564] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:41:51.593184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-596f4fa1-6271-43af-9bb4-aa72651f22f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a107d30>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:51.753742 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-596f4fa1-6271-43af-9bb4-aa72651f22f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.191136 Aug 27 02:41:51.753742 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1419/2565] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:51 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:51.770873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-47715e63-bc66-4a01-8421-15b8ff4adbf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:51.774976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-47715e63-bc66-4a01-8421-15b8ff4adbf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:51.792486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47715e63-bc66-4a01-8421-15b8ff4adbf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.794887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47715e63-bc66-4a01-8421-15b8ff4adbf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.798954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47715e63-bc66-4a01-8421-15b8ff4adbf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.802234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47715e63-bc66-4a01-8421-15b8ff4adbf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:51.804029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47715e63-bc66-4a01-8421-15b8ff4adbf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:51.805519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47715e63-bc66-4a01-8421-15b8ff4adbf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:51.921242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:51.951090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:51.957463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:51.962965 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-24f76f77-7875-4b0a-bddb-a5019f043219 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1265 microversion: 2.25 time: 0.634583 Aug 27 02:41:51.963557 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1147/2566] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:51 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1265 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:52.140963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-47715e63-bc66-4a01-8421-15b8ff4adbf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:52.161387 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-47715e63-bc66-4a01-8421-15b8ff4adbf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.409875 Aug 27 02:41:52.164267 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1420/2567] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:51 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:52.413432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:52.418806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:52.452710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:52.453962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:52.456723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:52.457887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:52.459661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:52.464977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:52.776153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-df2c2bea-9305-4609-ac30-5e24bb8368b0 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e886310>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:52.870397 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-df2c2bea-9305-4609-ac30-5e24bb8368b0 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1414 microversion: 2.1 time: 0.102988 Aug 27 02:41:52.873810 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1421/2568] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:52 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:52.895895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:52.905814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:52.910152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:52.915055 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1cd984a8-3178-4b73-8db2-b1a62afde2ea tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1406 microversion: 2.20 time: 0.522246 Aug 27 02:41:52.918938 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1148/2569] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:52 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1406 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:52.987542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:52.988469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:52.998876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:53.000909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:53.005700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:53.006959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:53.011850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:53.017607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:53.153364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:53.163819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:53.165311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:53.169912 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-41ff6a68-b4ad-422b-bed1-0c4e7549cf64 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1265 microversion: 2.25 time: 0.187075 Aug 27 02:41:53.177400 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1422/2570] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:52 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:53.886272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9dae57b0-3bfa-42a1-9628-4e159b48431a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e885160>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:53.954144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:53.962899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:53.972718 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9dae57b0-3bfa-42a1-9628-4e159b48431a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1423 microversion: 2.1 time: 0.090135 Aug 27 02:41:53.975831 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1149/2571] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:53 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1423 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:53.991647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:53.992184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:53.993025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e9b848ad-b419-446c-9a6e-12a2bdf09723 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a6d0670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:53.998045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:53.999782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.000946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.002001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.094248 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e9b848ad-b419-446c-9a6e-12a2bdf09723 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 200 len: 1423 microversion: 2.1 time: 0.108550 Aug 27 02:41:54.097163 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1150/2572] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:41:53 2022] GET /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 1423 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:54.110067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8b11cbe-8216-4678-996f-dc170c05b33f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e885940>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:54.338047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:54.367138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:54.370307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:54.373484 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6653a69b-681e-4838-80eb-b68a89475275 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1406 microversion: 2.20 time: 0.425982 Aug 27 02:41:54.375089 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1423/2573] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:53 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1406 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:54.382039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:54.393413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:54.402755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.403709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.404429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.405578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:54.406396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:54.407011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:54.540052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:54.566961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:54.575095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:54.579056 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-37004bb8-68ff-48c7-b095-d268f0dfd999 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1265 microversion: 2.25 time: 0.201190 Aug 27 02:41:54.581407 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1424/2574] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:54 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:54.825719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1019700930", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:54.912589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:55.275169 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e8b11cbe-8216-4678-996f-dc170c05b33f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 204 len: 0 microversion: 2.1 time: 1.169606 Aug 27 02:41:55.276380 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1151/2575] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:54 2022] DELETE /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 0 bytes in 1172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:41:55.290389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-136a87b9-9e6d-48ab-a1de-2e5728978080 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:55.291828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-136a87b9-9e6d-48ab-a1de-2e5728978080 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:55.303586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:55.304917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:55.306153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:55.307582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:55.308426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:55.308608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-136a87b9-9e6d-48ab-a1de-2e5728978080 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.309655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-136a87b9-9e6d-48ab-a1de-2e5728978080 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.310705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-136a87b9-9e6d-48ab-a1de-2e5728978080 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.312607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-136a87b9-9e6d-48ab-a1de-2e5728978080 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.313503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-136a87b9-9e6d-48ab-a1de-2e5728978080 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.314371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-136a87b9-9e6d-48ab-a1de-2e5728978080 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.323486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.324393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.325137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.326419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.327200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.327930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.362390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Getting quotas for project f791aca5ebbf40e98bc6538ab86e95da. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:55.372795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Getting quotas for user aeb7891a621941f88c8db1f2a5135c23 and project f791aca5ebbf40e98bc6538ab86e95da. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:55.378736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-136a87b9-9e6d-48ab-a1de-2e5728978080 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:41:55.399327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:55.404477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:55.496917 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-46ff0de8-4123-42a0-ba0d-caae7ab772cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912812 Aug 27 02:41:55.498581 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1425/2576] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:41:55.509894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:55.511885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:55.524153 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-136a87b9-9e6d-48ab-a1de-2e5728978080 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 204 len: 0 microversion: 2.1 time: 0.240011 Aug 27 02:41:55.525255 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1152/2577] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:41:55 2022] DELETE /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:41:55.541726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.541726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.541726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.541726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.541726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.541726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.554282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0769877e-8603-40b9-b558-582766ac8d6d tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:55.555824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0769877e-8603-40b9-b558-582766ac8d6d tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:55.719109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0769877e-8603-40b9-b558-582766ac8d6d tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:55.733357 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0769877e-8603-40b9-b558-582766ac8d6d tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1217 microversion: 2.1 time: 0.205209 Aug 27 02:41:55.734496 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1153/2578] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:55 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1217 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:55.764123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:55.765615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:55.781887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.782781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.783615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.784942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.788072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.789252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.848579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:55.863045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:55.871808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:55.874350 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aa4651f7-acea-4451-ac5a-df389701a4f5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1597 microversion: 2.20 time: 0.372913 Aug 27 02:41:55.875473 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1426/2579] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:55 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1597 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:55.918541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:55.928648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:55.930305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:55.932092 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9dbd6bda-e2f6-4b59-8400-00cbd509bfcc tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1265 microversion: 2.25 time: 0.195455 Aug 27 02:41:55.932680 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1154/2580] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:55 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:55.938296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e5c6b39-b3cc-4cf8-988e-9c8b278ad1be tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:55.939138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5e5c6b39-b3cc-4cf8-988e-9c8b278ad1be tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:55.939388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2033758326", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "c0e01839-7cf2-4a76-9f86-ed22a92507b6"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:55.953986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e5c6b39-b3cc-4cf8-988e-9c8b278ad1be tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.954786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e5c6b39-b3cc-4cf8-988e-9c8b278ad1be tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.957198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e5c6b39-b3cc-4cf8-988e-9c8b278ad1be tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:55.958056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e5c6b39-b3cc-4cf8-988e-9c8b278ad1be tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:55.958554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e5c6b39-b3cc-4cf8-988e-9c8b278ad1be tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:55.958998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e5c6b39-b3cc-4cf8-988e-9c8b278ad1be tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:56.023870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] validate_networks() for [('c0e01839-7cf2-4a76-9f86-ed22a92507b6', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:41:56.115645 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5e5c6b39-b3cc-4cf8-988e-9c8b278ad1be tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.181662 Aug 27 02:41:56.116249 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1155/2581] 10.222.0.99 () {60 vars in 1316 bytes} [Sat Aug 27 02:41:55 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:41:56.764465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5bcaa916-129e-4c28-bdfd-1e244782cb61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:56.768187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5bcaa916-129e-4c28-bdfd-1e244782cb61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:56.793003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bcaa916-129e-4c28-bdfd-1e244782cb61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:56.793529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bcaa916-129e-4c28-bdfd-1e244782cb61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:56.797099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bcaa916-129e-4c28-bdfd-1e244782cb61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:56.797993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bcaa916-129e-4c28-bdfd-1e244782cb61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:56.799428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bcaa916-129e-4c28-bdfd-1e244782cb61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:56.800073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bcaa916-129e-4c28-bdfd-1e244782cb61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:56.941628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5bcaa916-129e-4c28-bdfd-1e244782cb61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:56.952430 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5bcaa916-129e-4c28-bdfd-1e244782cb61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1269 microversion: 2.1 time: 0.196738 Aug 27 02:41:56.953350 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1156/2582] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:56 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1269 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:56.971658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:56.973306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:56.986817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:56.987633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:56.988404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:56.989317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:56.990549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:56.991331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.060951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:41:57.061546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:41:57.062384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:41:57.063011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:41:57.063514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:41:57.076703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.077308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.078360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.079144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:57.079711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:57.080222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:57.102404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:57.120229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:57.121636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Getting quotas for project 3a7deb7b2e0f44db9408c63d75634406. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:41:57.123695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:57.125608 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5ff1a016-b436-47ac-b5d4-315162f2e923 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1265 microversion: 2.25 time: 0.160112 Aug 27 02:41:57.126848 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1157/2583] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:56 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:41:57.131557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Getting quotas for user 3ba5de1a75904079a6d4ae345c9c8025 and project 3a7deb7b2e0f44db9408c63d75634406. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:41:57.161694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:41:57.166908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:41:57.207907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:57.268616 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ad014cc-fcd2-48bb-a87f-2bc3e7426d71 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360652 Aug 27 02:41:57.288947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b9b22ddd-b5cc-472e-a9b5-22ca4a323849 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:57.290096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b9b22ddd-b5cc-472e-a9b5-22ca4a323849 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:57.294218 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1427/2584] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:41:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:41:57.579849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b9b22ddd-b5cc-472e-a9b5-22ca4a323849 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:57.591214 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b9b22ddd-b5cc-472e-a9b5-22ca4a323849 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1208 microversion: 2.1 time: 0.309434 Aug 27 02:41:57.592497 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1158/2585] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:57 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1208 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:57.995724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc7eb86d-7d94-410c-8d79-5f2c15870f8a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:57.996989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fc7eb86d-7d94-410c-8d79-5f2c15870f8a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:58.034889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc7eb86d-7d94-410c-8d79-5f2c15870f8a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.035687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc7eb86d-7d94-410c-8d79-5f2c15870f8a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.037314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc7eb86d-7d94-410c-8d79-5f2c15870f8a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.038669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc7eb86d-7d94-410c-8d79-5f2c15870f8a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.048473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc7eb86d-7d94-410c-8d79-5f2c15870f8a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.049600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc7eb86d-7d94-410c-8d79-5f2c15870f8a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.153495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:58.154519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:58.157535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:58.183558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.184938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.185583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.186667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.188516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.189448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.227451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fc7eb86d-7d94-410c-8d79-5f2c15870f8a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:58.242376 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fc7eb86d-7d94-410c-8d79-5f2c15870f8a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1275 microversion: 2.1 time: 0.255080 Aug 27 02:41:58.243250 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1428/2586] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:57 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:41:58.266554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.267337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.267855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.269086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lazy-loading 'fault' on Instance uuid f562df2c-cfe6-463e-89a2-b5dc19206114 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:41:58.274538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:41:58.438047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:58.457369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:58.460289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:58.475876 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-430101ed-8b35-452d-a978-5afb89a037e4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 200 len: 1270 microversion: 2.25 time: 0.324609 Aug 27 02:41:58.477174 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1159/2587] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:58 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 1270 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:41:58.630625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5184d644-4fd5-47e1-9008-22985782a841 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:58.631764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5184d644-4fd5-47e1-9008-22985782a841 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:58.646194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5184d644-4fd5-47e1-9008-22985782a841 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.646682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5184d644-4fd5-47e1-9008-22985782a841 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.647137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5184d644-4fd5-47e1-9008-22985782a841 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.651268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5184d644-4fd5-47e1-9008-22985782a841 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.652065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5184d644-4fd5-47e1-9008-22985782a841 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.656833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5184d644-4fd5-47e1-9008-22985782a841 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.663722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3bc0b464-e410-4cdf-a682-c9356fbe611a req-daedd6c5-4451-4950-91e4-cf7a29eb652d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada54a54-66b3-47b3-87dd-e3e7b5bf934b", "name": "network-vif-unplugged", "status": "completed", "tag": "972893de-522e-44d8-bab8-60c023b9fb4c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:58.677593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3bc0b464-e410-4cdf-a682-c9356fbe611a req-daedd6c5-4451-4950-91e4-cf7a29eb652d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:58.679319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3bc0b464-e410-4cdf-a682-c9356fbe611a req-daedd6c5-4451-4950-91e4-cf7a29eb652d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:58.680206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3bc0b464-e410-4cdf-a682-c9356fbe611a req-daedd6c5-4451-4950-91e4-cf7a29eb652d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:58.730047 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3bc0b464-e410-4cdf-a682-c9356fbe611a req-daedd6c5-4451-4950-91e4-cf7a29eb652d service nova] Creating event network-vif-unplugged:972893de-522e-44d8-bab8-60c023b9fb4c for instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b on n-h1-852084-5 Aug 27 02:41:58.736243 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3bc0b464-e410-4cdf-a682-c9356fbe611a req-daedd6c5-4451-4950-91e4-cf7a29eb652d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078214 Aug 27 02:41:58.737442 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1160/2588] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:41:58.778527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5184d644-4fd5-47e1-9008-22985782a841 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:41:58.789308 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5184d644-4fd5-47e1-9008-22985782a841 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1260 microversion: 2.1 time: 0.163319 Aug 27 02:41:58.791303 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1429/2589] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:58 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:41:59.268430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ffdf80e-efb4-4b71-a57a-81d883b677ed tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:59.269264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ffdf80e-efb4-4b71-a57a-81d883b677ed tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:59.277538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ffdf80e-efb4-4b71-a57a-81d883b677ed tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.278144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ffdf80e-efb4-4b71-a57a-81d883b677ed tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.278879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ffdf80e-efb4-4b71-a57a-81d883b677ed tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.279692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ffdf80e-efb4-4b71-a57a-81d883b677ed tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.280163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ffdf80e-efb4-4b71-a57a-81d883b677ed tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.280658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ffdf80e-efb4-4b71-a57a-81d883b677ed tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.458358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-85958b67-5165-4918-8de1-ebd6390f84d3 req-4d3c6fb3-bcbf-4c9c-80b2-3d15d7b4f493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7489a8a-8682-4455-abba-671195effab4", "tag": "63f5c4dc-7c22-4bfa-8abc-a93876b795f0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:41:59.501111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-85958b67-5165-4918-8de1-ebd6390f84d3 req-4d3c6fb3-bcbf-4c9c-80b2-3d15d7b4f493 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.501607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-85958b67-5165-4918-8de1-ebd6390f84d3 req-4d3c6fb3-bcbf-4c9c-80b2-3d15d7b4f493 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.502157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-85958b67-5165-4918-8de1-ebd6390f84d3 req-4d3c6fb3-bcbf-4c9c-80b2-3d15d7b4f493 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.547527 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-85958b67-5165-4918-8de1-ebd6390f84d3 req-4d3c6fb3-bcbf-4c9c-80b2-3d15d7b4f493 service nova] Creating event network-changed:63f5c4dc-7c22-4bfa-8abc-a93876b795f0 for instance a7489a8a-8682-4455-abba-671195effab4 on n-h1-852084-5 Aug 27 02:41:59.555889 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-85958b67-5165-4918-8de1-ebd6390f84d3 req-4d3c6fb3-bcbf-4c9c-80b2-3d15d7b4f493 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100773 Aug 27 02:41:59.557518 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1430/2590] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:41:59.573554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:59.576360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: f562df2c-cfe6-463e-89a2-b5dc19206114] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:59.595078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.598901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.621075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.622093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.622598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.623052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.667845 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] HTTP exception thrown: Instance f562df2c-cfe6-463e-89a2-b5dc19206114 could not be found. Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Request method failure captured: Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 HTTP/1.1 Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYI_UMxHDhZscLZ1C5hiK_DKMle2OgO10TJN3MASp0Vb8eQyB7IXk2CVzBEnsnvleC2F5m6hB4iCUIG9VXCZ42bTk_XHRMlqBEupA7yYu5Sxcxsz9ievFfzu_5R_6jqpxCe179ZAlxL_sntknKcHVG_lwrfXMT7qe4aX_l4YeDHZIls Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 4d2da2e10e53450096a68048f98bd99a Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4d2da2e10e53450096a68048f98bd99a"}]}] Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 4d2da2e10e53450096a68048f98bd99a Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-LiveAutoBlockMigrationV225Test-1759099354-project Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 4cf03330b076434098eef9230222830e Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354-project Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance f562df2c-cfe6-463e-89a2-b5dc19206114 could not be found. Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f562df2c-cfe6-463e-89a2-b5dc19206114'} Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f562df2c-cfe6-463e-89a2-b5dc19206114 could not be found. Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f562df2c-cfe6-463e-89a2-b5dc19206114 could not be found. Aug 27 02:41:59.669713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f562df2c-cfe6-463e-89a2-b5dc19206114 could not be found. Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Returning 404 to user: Instance f562df2c-cfe6-463e-89a2-b5dc19206114 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-43fd0a55-4ed5-4e83-8ac1-17b77e3f5fa4 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114" status: 404 len: 111 microversion: 2.25 time: 0.108454 Aug 27 02:41:59.676726 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1431/2591] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:41:59 2022] GET /compute/v2.1/servers/f562df2c-cfe6-463e-89a2-b5dc19206114 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:41:59.826124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8cbc5d72-0ede-47ae-aa42-97136b3275c2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:41:59.826707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8cbc5d72-0ede-47ae-aa42-97136b3275c2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:41:59.839896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cbc5d72-0ede-47ae-aa42-97136b3275c2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.842434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cbc5d72-0ede-47ae-aa42-97136b3275c2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.843273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cbc5d72-0ede-47ae-aa42-97136b3275c2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:41:59.845092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cbc5d72-0ede-47ae-aa42-97136b3275c2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:41:59.852850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cbc5d72-0ede-47ae-aa42-97136b3275c2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:41:59.853908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cbc5d72-0ede-47ae-aa42-97136b3275c2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:00.013309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ffdf80e-efb4-4b71-a57a-81d883b677ed tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:00.064944 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ffdf80e-efb4-4b71-a57a-81d883b677ed tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1275 microversion: 2.1 time: 0.799781 Aug 27 02:42:00.068459 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1161/2592] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:59 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1275 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:00.077999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8cbc5d72-0ede-47ae-aa42-97136b3275c2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:00.098859 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8cbc5d72-0ede-47ae-aa42-97136b3275c2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1268 microversion: 2.1 time: 0.277278 Aug 27 02:42:00.106488 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1432/2593] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:41:59 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1268 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:01.137125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0cb7265-5cf6-49ca-8d9f-9e8e04dfe51d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:01.146586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a20321ab-dcba-463d-ae5c-11cfbaa82bc5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:01.147697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a20321ab-dcba-463d-ae5c-11cfbaa82bc5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:01.152211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b0cb7265-5cf6-49ca-8d9f-9e8e04dfe51d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:01.185194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a20321ab-dcba-463d-ae5c-11cfbaa82bc5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:01.191758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0cb7265-5cf6-49ca-8d9f-9e8e04dfe51d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:01.192632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0cb7265-5cf6-49ca-8d9f-9e8e04dfe51d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:01.193355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0cb7265-5cf6-49ca-8d9f-9e8e04dfe51d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:01.194536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0cb7265-5cf6-49ca-8d9f-9e8e04dfe51d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:01.197590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a20321ab-dcba-463d-ae5c-11cfbaa82bc5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:01.198644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a20321ab-dcba-463d-ae5c-11cfbaa82bc5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:01.199973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a20321ab-dcba-463d-ae5c-11cfbaa82bc5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:01.200831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a20321ab-dcba-463d-ae5c-11cfbaa82bc5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:01.202417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0cb7265-5cf6-49ca-8d9f-9e8e04dfe51d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:01.203502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0cb7265-5cf6-49ca-8d9f-9e8e04dfe51d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:01.213167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a20321ab-dcba-463d-ae5c-11cfbaa82bc5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:01.352589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b0cb7265-5cf6-49ca-8d9f-9e8e04dfe51d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:01.369939 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b0cb7265-5cf6-49ca-8d9f-9e8e04dfe51d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1266 microversion: 2.1 time: 0.244467 Aug 27 02:42:01.371582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1433/2594] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:01 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:01.633615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-32031f51-ca3b-4d82-b47c-6e63f72ac3a3 req-cdc15ed2-bf0b-4bc3-aec6-cbc3f42f675c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada54a54-66b3-47b3-87dd-e3e7b5bf934b", "name": "network-vif-deleted", "tag": "972893de-522e-44d8-bab8-60c023b9fb4c"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:01.669159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-32031f51-ca3b-4d82-b47c-6e63f72ac3a3 req-cdc15ed2-bf0b-4bc3-aec6-cbc3f42f675c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:01.675566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-32031f51-ca3b-4d82-b47c-6e63f72ac3a3 req-cdc15ed2-bf0b-4bc3-aec6-cbc3f42f675c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:01.678984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-32031f51-ca3b-4d82-b47c-6e63f72ac3a3 req-cdc15ed2-bf0b-4bc3-aec6-cbc3f42f675c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:01.759103 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-32031f51-ca3b-4d82-b47c-6e63f72ac3a3 req-cdc15ed2-bf0b-4bc3-aec6-cbc3f42f675c service nova] Creating event network-vif-deleted:972893de-522e-44d8-bab8-60c023b9fb4c for instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b on n-h1-852084-5 Aug 27 02:42:01.770896 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-32031f51-ca3b-4d82-b47c-6e63f72ac3a3 req-cdc15ed2-bf0b-4bc3-aec6-cbc3f42f675c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142237 Aug 27 02:42:01.774588 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1434/2595] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:42:02.365900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a20321ab-dcba-463d-ae5c-11cfbaa82bc5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:02.399006 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a20321ab-dcba-463d-ae5c-11cfbaa82bc5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1317 microversion: 2.1 time: 1.289603 Aug 27 02:42:02.418445 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1162/2596] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:01 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1317 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:02.440762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4737653-55bb-4e63-8e88-eab355622b59 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:02.450759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b4737653-55bb-4e63-8e88-eab355622b59 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:02.472936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4737653-55bb-4e63-8e88-eab355622b59 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.474615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4737653-55bb-4e63-8e88-eab355622b59 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.476931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4737653-55bb-4e63-8e88-eab355622b59 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.483103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4737653-55bb-4e63-8e88-eab355622b59 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:02.484521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4737653-55bb-4e63-8e88-eab355622b59 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:02.485750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4737653-55bb-4e63-8e88-eab355622b59 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:02.680623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b4737653-55bb-4e63-8e88-eab355622b59 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:02.692840 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b4737653-55bb-4e63-8e88-eab355622b59 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1266 microversion: 2.1 time: 0.293890 Aug 27 02:42:02.695681 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1435/2597] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:02 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:03.438339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-611771f7-b483-4bfd-b9dc-a216baed2ddd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:03.441315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-611771f7-b483-4bfd-b9dc-a216baed2ddd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:03.463683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-611771f7-b483-4bfd-b9dc-a216baed2ddd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:03.465120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-611771f7-b483-4bfd-b9dc-a216baed2ddd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:03.466419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-611771f7-b483-4bfd-b9dc-a216baed2ddd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:03.468754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-611771f7-b483-4bfd-b9dc-a216baed2ddd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:03.470162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-611771f7-b483-4bfd-b9dc-a216baed2ddd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:03.471447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-611771f7-b483-4bfd-b9dc-a216baed2ddd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:03.747216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-076822db-459f-4a35-b7da-619c0e8fcc58 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:03.749462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-076822db-459f-4a35-b7da-619c0e8fcc58 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:03.764915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076822db-459f-4a35-b7da-619c0e8fcc58 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:03.765853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076822db-459f-4a35-b7da-619c0e8fcc58 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:03.766537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076822db-459f-4a35-b7da-619c0e8fcc58 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:03.767624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076822db-459f-4a35-b7da-619c0e8fcc58 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:03.768342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076822db-459f-4a35-b7da-619c0e8fcc58 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:03.769204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076822db-459f-4a35-b7da-619c0e8fcc58 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:04.006755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-611771f7-b483-4bfd-b9dc-a216baed2ddd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:04.022425 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-611771f7-b483-4bfd-b9dc-a216baed2ddd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1317 microversion: 2.1 time: 0.598560 Aug 27 02:42:04.039996 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1163/2598] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:03 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:04.217246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-076822db-459f-4a35-b7da-619c0e8fcc58 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:04.228174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:04.244050 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-076822db-459f-4a35-b7da-619c0e8fcc58 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1308 microversion: 2.1 time: 0.510898 Aug 27 02:42:04.253162 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1436/2599] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:03 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1308 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:04.286067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-bd693316-b8d3-4424-a4fb-ea5e899b4422 req-96239a85-f56f-48a2-808a-530fc5c29760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514c8adb-41ea-426e-8a55-aea191d0fd3d", "tag": "330cbd96-d3f2-4d8e-bf9b-22961d787d26"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:04.310571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bd693316-b8d3-4424-a4fb-ea5e899b4422 req-96239a85-f56f-48a2-808a-530fc5c29760 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:04.311302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bd693316-b8d3-4424-a4fb-ea5e899b4422 req-96239a85-f56f-48a2-808a-530fc5c29760 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:04.311836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bd693316-b8d3-4424-a4fb-ea5e899b4422 req-96239a85-f56f-48a2-808a-530fc5c29760 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:04.325925 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-bd693316-b8d3-4424-a4fb-ea5e899b4422 req-96239a85-f56f-48a2-808a-530fc5c29760 service nova] Creating event network-changed:330cbd96-d3f2-4d8e-bf9b-22961d787d26 for instance 514c8adb-41ea-426e-8a55-aea191d0fd3d on n-h2-852084-5 Aug 27 02:42:04.344134 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-bd693316-b8d3-4424-a4fb-ea5e899b4422 req-96239a85-f56f-48a2-808a-530fc5c29760 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061693 Aug 27 02:42:04.346041 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1164/2600] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:05.052395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-308ead39-3cf5-4c8a-9fe1-402cc68054fd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:05.053556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-308ead39-3cf5-4c8a-9fe1-402cc68054fd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:05.066644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308ead39-3cf5-4c8a-9fe1-402cc68054fd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:05.067756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308ead39-3cf5-4c8a-9fe1-402cc68054fd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:05.068674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308ead39-3cf5-4c8a-9fe1-402cc68054fd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:05.069887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308ead39-3cf5-4c8a-9fe1-402cc68054fd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:05.070593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308ead39-3cf5-4c8a-9fe1-402cc68054fd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:05.071378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308ead39-3cf5-4c8a-9fe1-402cc68054fd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:05.261975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-308ead39-3cf5-4c8a-9fe1-402cc68054fd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:05.273495 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-308ead39-3cf5-4c8a-9fe1-402cc68054fd tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1317 microversion: 2.1 time: 0.226253 Aug 27 02:42:05.286547 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1437/2601] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:05 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:05.290257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5258c87c-14cb-4de6-b029-c4b4463b8bb9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:05.291991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5258c87c-14cb-4de6-b029-c4b4463b8bb9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:05.300869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5258c87c-14cb-4de6-b029-c4b4463b8bb9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:05.301747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5258c87c-14cb-4de6-b029-c4b4463b8bb9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:05.302530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5258c87c-14cb-4de6-b029-c4b4463b8bb9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:05.303629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5258c87c-14cb-4de6-b029-c4b4463b8bb9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:05.304477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5258c87c-14cb-4de6-b029-c4b4463b8bb9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:05.305137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5258c87c-14cb-4de6-b029-c4b4463b8bb9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:05.599600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-426525c6-0b49-4c09-a7c3-6ef483cd9e35 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:05.600518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-426525c6-0b49-4c09-a7c3-6ef483cd9e35 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:05.612161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-426525c6-0b49-4c09-a7c3-6ef483cd9e35 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:05.613086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-426525c6-0b49-4c09-a7c3-6ef483cd9e35 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:05.613971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-426525c6-0b49-4c09-a7c3-6ef483cd9e35 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:05.615317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-426525c6-0b49-4c09-a7c3-6ef483cd9e35 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:05.616284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-426525c6-0b49-4c09-a7c3-6ef483cd9e35 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:05.617063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-426525c6-0b49-4c09-a7c3-6ef483cd9e35 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:05.672533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-426525c6-0b49-4c09-a7c3-6ef483cd9e35 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:42:05.704420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5258c87c-14cb-4de6-b029-c4b4463b8bb9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:05.718922 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5258c87c-14cb-4de6-b029-c4b4463b8bb9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1308 microversion: 2.1 time: 0.450252 Aug 27 02:42:05.719540 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1165/2602] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:05 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1308 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:05.800127 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-426525c6-0b49-4c09-a7c3-6ef483cd9e35 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "DELETE /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 204 len: 0 microversion: 2.25 time: 0.208009 Aug 27 02:42:05.801104 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1438/2603] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:42:05 2022] DELETE /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 02:42:05.812103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:05.813472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:05.821067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:05.822438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:05.823121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:05.823998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:05.824653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:05.825193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:06.013934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:06.024509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:06.026792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:06.028291 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ac1f5d0f-3b26-46e5-8859-270dfd7eb958 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1731 microversion: 2.25 time: 0.221583 Aug 27 02:42:06.029112 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1166/2604] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:05 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:42:06.299602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1e83144a-e5c2-4e65-a235-04d46ffc44d0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:06.300835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1e83144a-e5c2-4e65-a235-04d46ffc44d0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:06.311855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e83144a-e5c2-4e65-a235-04d46ffc44d0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:06.313012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e83144a-e5c2-4e65-a235-04d46ffc44d0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:06.313704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e83144a-e5c2-4e65-a235-04d46ffc44d0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:06.315128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e83144a-e5c2-4e65-a235-04d46ffc44d0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:06.315944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e83144a-e5c2-4e65-a235-04d46ffc44d0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:06.317026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e83144a-e5c2-4e65-a235-04d46ffc44d0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:06.371689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-4d0f34a6-082f-402d-a486-05a284eb42ef req-318b0b24-48a4-48a9-82ef-5007797032cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b863d40c-1266-4beb-a51e-02d683ffba71", "tag": "938a9794-4a8d-4ef4-92ab-23ae622e61c2"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:06.397644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4d0f34a6-082f-402d-a486-05a284eb42ef req-318b0b24-48a4-48a9-82ef-5007797032cc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:06.398566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4d0f34a6-082f-402d-a486-05a284eb42ef req-318b0b24-48a4-48a9-82ef-5007797032cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:06.399367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4d0f34a6-082f-402d-a486-05a284eb42ef req-318b0b24-48a4-48a9-82ef-5007797032cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:06.421900 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-4d0f34a6-082f-402d-a486-05a284eb42ef req-318b0b24-48a4-48a9-82ef-5007797032cc service nova] Creating event network-changed:938a9794-4a8d-4ef4-92ab-23ae622e61c2 for instance b863d40c-1266-4beb-a51e-02d683ffba71 on n-h2-852084-5 Aug 27 02:42:06.431720 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-4d0f34a6-082f-402d-a486-05a284eb42ef req-318b0b24-48a4-48a9-82ef-5007797032cc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066983 Aug 27 02:42:06.432831 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1167/2605] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:06.482642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1e83144a-e5c2-4e65-a235-04d46ffc44d0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:06.491899 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1e83144a-e5c2-4e65-a235-04d46ffc44d0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1317 microversion: 2.1 time: 0.197906 Aug 27 02:42:06.492643 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1439/2606] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:06 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:06.741724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aba545f0-6df6-4348-9dc1-d5b78ff016f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:06.742334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aba545f0-6df6-4348-9dc1-d5b78ff016f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:06.749397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba545f0-6df6-4348-9dc1-d5b78ff016f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:06.750004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba545f0-6df6-4348-9dc1-d5b78ff016f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:06.750439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba545f0-6df6-4348-9dc1-d5b78ff016f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:06.751156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba545f0-6df6-4348-9dc1-d5b78ff016f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:06.751604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba545f0-6df6-4348-9dc1-d5b78ff016f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:06.752032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aba545f0-6df6-4348-9dc1-d5b78ff016f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:06.905284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-aba545f0-6df6-4348-9dc1-d5b78ff016f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:06.914994 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aba545f0-6df6-4348-9dc1-d5b78ff016f1 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1308 microversion: 2.1 time: 0.177891 Aug 27 02:42:06.915647 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1168/2607] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:06 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1308 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:07.069468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:07.070159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:07.078125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:07.078618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:07.079062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:07.079787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:07.080250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:07.080681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:07.097504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:07.145832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=12 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:07.244273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:07.254563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:07.256436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:07.257849 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-19642154-39e4-4890-86e4-4593c496abd2 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1731 microversion: 2.25 time: 0.192577 Aug 27 02:42:07.259533 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1440/2608] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:07 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:07.515078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fe4e6023-a743-446f-aa04-cf9ba1a84816 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:07.515673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fe4e6023-a743-446f-aa04-cf9ba1a84816 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:07.523766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe4e6023-a743-446f-aa04-cf9ba1a84816 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:07.524340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe4e6023-a743-446f-aa04-cf9ba1a84816 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:07.524798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe4e6023-a743-446f-aa04-cf9ba1a84816 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:07.525582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe4e6023-a743-446f-aa04-cf9ba1a84816 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:07.526745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe4e6023-a743-446f-aa04-cf9ba1a84816 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:07.526745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe4e6023-a743-446f-aa04-cf9ba1a84816 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:07.590553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:07.947064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5dd6f7a5-ed04-4397-898c-380e22563e4f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:07.950818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5dd6f7a5-ed04-4397-898c-380e22563e4f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:07.975251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dd6f7a5-ed04-4397-898c-380e22563e4f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:07.976535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dd6f7a5-ed04-4397-898c-380e22563e4f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:07.977651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dd6f7a5-ed04-4397-898c-380e22563e4f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:07.979802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dd6f7a5-ed04-4397-898c-380e22563e4f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:07.981395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dd6f7a5-ed04-4397-898c-380e22563e4f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:07.982502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dd6f7a5-ed04-4397-898c-380e22563e4f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:08.113475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fe4e6023-a743-446f-aa04-cf9ba1a84816 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:08.179069 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fe4e6023-a743-446f-aa04-cf9ba1a84816 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1317 microversion: 2.1 time: 0.668233 Aug 27 02:42:08.181639 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1169/2609] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:07 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1317 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:08.290706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:08.295247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:08.322237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:08.323570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:08.324615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:08.326374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:08.327518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:08.328555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:08.551654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5dd6f7a5-ed04-4397-898c-380e22563e4f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:08.552456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:08.579475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:08.579775 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5dd6f7a5-ed04-4397-898c-380e22563e4f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1308 microversion: 2.1 time: 0.645266 Aug 27 02:42:08.583610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:08.586380 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e7ce1206-fdc9-4589-a49a-4a1877ef3480 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1731 microversion: 2.25 time: 0.304714 Aug 27 02:42:08.588815 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1170/2610] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:08 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:42:08.602292 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1441/2611] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:07 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1308 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:09.176237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-dc03e9b3-243d-4aba-a940-98e01a62aea4 req-4074241d-2b5c-4e10-b73d-2e219dc9c154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "099723a4-8d6a-4f11-9e89-cde00fbdbdf6", "name": "network-vif-deleted", "tag": "d0e84c9b-db44-407d-9fe2-65f84a836cbb"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:09.194938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dc03e9b3-243d-4aba-a940-98e01a62aea4 req-4074241d-2b5c-4e10-b73d-2e219dc9c154 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.195966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dc03e9b3-243d-4aba-a940-98e01a62aea4 req-4074241d-2b5c-4e10-b73d-2e219dc9c154 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.197059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dc03e9b3-243d-4aba-a940-98e01a62aea4 req-4074241d-2b5c-4e10-b73d-2e219dc9c154 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.208546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ecfe762-485d-4f88-8c9a-07adaf60dfa6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:09.209757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1ecfe762-485d-4f88-8c9a-07adaf60dfa6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:09.227385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ecfe762-485d-4f88-8c9a-07adaf60dfa6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.229752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ecfe762-485d-4f88-8c9a-07adaf60dfa6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.231228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ecfe762-485d-4f88-8c9a-07adaf60dfa6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.233411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ecfe762-485d-4f88-8c9a-07adaf60dfa6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.234797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ecfe762-485d-4f88-8c9a-07adaf60dfa6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.236017 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-dc03e9b3-243d-4aba-a940-98e01a62aea4 req-4074241d-2b5c-4e10-b73d-2e219dc9c154 service nova] Creating event network-vif-deleted:d0e84c9b-db44-407d-9fe2-65f84a836cbb for instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 on n-h2-852084-5 Aug 27 02:42:09.236956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ecfe762-485d-4f88-8c9a-07adaf60dfa6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.253734 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-dc03e9b3-243d-4aba-a940-98e01a62aea4 req-4074241d-2b5c-4e10-b73d-2e219dc9c154 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083617 Aug 27 02:42:09.255913 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1442/2612] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:42:09.620227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2f68cf93-402d-4429-8e99-66d6fc8c22f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:09.621352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2f68cf93-402d-4429-8e99-66d6fc8c22f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:09.633593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f68cf93-402d-4429-8e99-66d6fc8c22f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.634638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f68cf93-402d-4429-8e99-66d6fc8c22f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.635343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f68cf93-402d-4429-8e99-66d6fc8c22f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.636557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f68cf93-402d-4429-8e99-66d6fc8c22f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.639958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1ecfe762-485d-4f88-8c9a-07adaf60dfa6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:09.640679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f68cf93-402d-4429-8e99-66d6fc8c22f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.641703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f68cf93-402d-4429-8e99-66d6fc8c22f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.666823 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1ecfe762-485d-4f88-8c9a-07adaf60dfa6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1317 microversion: 2.1 time: 0.467010 Aug 27 02:42:09.677241 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1171/2613] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:09 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:09.688610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:09.692924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:09.717044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.720471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.722668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.728401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.729842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.731892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.784975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:09.786628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:09.787116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:09.787590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lazy-loading 'fault' on Instance uuid 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:09.878220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:09.902509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:09.905639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:09.907981 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-124e2cd9-ee40-421f-8df5-5be66fa30a3c tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 200 len: 1376 microversion: 2.25 time: 0.228452 Aug 27 02:42:09.914953 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1172/2614] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:09 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 1376 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:10.012624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2f68cf93-402d-4429-8e99-66d6fc8c22f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:10.021479 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2f68cf93-402d-4429-8e99-66d6fc8c22f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1308 microversion: 2.1 time: 0.408514 Aug 27 02:42:10.022377 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1443/2615] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:09 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:10.365441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-4bc04cc1-6366-44df-b138-904f5f637141 req-8f85eab8-e1e1-4119-af8e-b984db6964eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514c8adb-41ea-426e-8a55-aea191d0fd3d", "name": "network-vif-plugged", "status": "completed", "tag": "330cbd96-d3f2-4d8e-bf9b-22961d787d26"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:10.392891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4bc04cc1-6366-44df-b138-904f5f637141 req-8f85eab8-e1e1-4119-af8e-b984db6964eb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:10.394891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4bc04cc1-6366-44df-b138-904f5f637141 req-8f85eab8-e1e1-4119-af8e-b984db6964eb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:10.397090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4bc04cc1-6366-44df-b138-904f5f637141 req-8f85eab8-e1e1-4119-af8e-b984db6964eb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:10.454730 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-4bc04cc1-6366-44df-b138-904f5f637141 req-8f85eab8-e1e1-4119-af8e-b984db6964eb service nova] Creating event network-vif-plugged:330cbd96-d3f2-4d8e-bf9b-22961d787d26 for instance 514c8adb-41ea-426e-8a55-aea191d0fd3d on n-h2-852084-5 Aug 27 02:42:10.474070 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-4bc04cc1-6366-44df-b138-904f5f637141 req-8f85eab8-e1e1-4119-af8e-b984db6964eb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113145 Aug 27 02:42:10.475390 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1173/2616] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:10.692568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a8390fcc-fd9d-4ad5-a2ec-40108949a7cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:10.693270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a8390fcc-fd9d-4ad5-a2ec-40108949a7cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:10.701085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8390fcc-fd9d-4ad5-a2ec-40108949a7cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:10.701647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8390fcc-fd9d-4ad5-a2ec-40108949a7cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:10.702372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8390fcc-fd9d-4ad5-a2ec-40108949a7cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:10.703154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8390fcc-fd9d-4ad5-a2ec-40108949a7cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:10.703631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8390fcc-fd9d-4ad5-a2ec-40108949a7cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:10.704076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8390fcc-fd9d-4ad5-a2ec-40108949a7cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:10.897178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a8390fcc-fd9d-4ad5-a2ec-40108949a7cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:10.909403 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a8390fcc-fd9d-4ad5-a2ec-40108949a7cc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1317 microversion: 2.1 time: 0.220642 Aug 27 02:42:10.910728 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1444/2617] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:10 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:10.946687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:10.947422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 099723a4-8d6a-4f11-9e89-cde00fbdbdf6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:10.954230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:10.954810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:10.955243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:10.956049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:10.956577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:10.957042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:10.973190 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] HTTP exception thrown: Instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 could not be found. Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Request method failure captured: Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 HTTP/1.1 Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYI_UMxHDhZscLZ1C5hiK_DKMle2OgO10TJN3MASp0Vb8eQyB7IXk2CVzBEnsnvleC2F5m6hB4iCUIG9VXCZ42bTk_XHRMlqBEupA7yYu5Sxcxsz9ievFfzu_5R_6jqpxCe179ZAlxL_sntknKcHVG_lwrfXMT7qe4aX_l4YeDHZIls Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 4d2da2e10e53450096a68048f98bd99a Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4d2da2e10e53450096a68048f98bd99a"}]}] Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 4d2da2e10e53450096a68048f98bd99a Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-LiveAutoBlockMigrationV225Test-1759099354-project Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 4cf03330b076434098eef9230222830e Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354-project Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 could not be found. Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '099723a4-8d6a-4f11-9e89-cde00fbdbdf6'} Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 could not be found. Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 could not be found. Aug 27 02:42:10.975288 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 could not be found. Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Returning 404 to user: Instance 099723a4-8d6a-4f11-9e89-cde00fbdbdf6 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6a3c9f5c-5582-45e4-b7dd-447a72d0b636 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6" status: 404 len: 111 microversion: 2.25 time: 0.035841 Aug 27 02:42:10.984207 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1174/2618] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:10 2022] GET /compute/v2.1/servers/099723a4-8d6a-4f11-9e89-cde00fbdbdf6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:42:10.989975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a67626f1-b526-4692-a1f1-b490c1f2a67f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '.version_select at 0x7f4d2e8bcc10>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:11.023603 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a67626f1-b526-4692-a1f1-b490c1f2a67f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492035077" status: 204 len: 0 microversion: 2.25 time: 0.038353 Aug 27 02:42:11.025315 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1445/2619] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 02:42:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492035077 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 02:42:11.053201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b9c2f159-78d4-47aa-bde5-20378f419e8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:11.054535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b9c2f159-78d4-47aa-bde5-20378f419e8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:11.067856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9c2f159-78d4-47aa-bde5-20378f419e8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.068674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9c2f159-78d4-47aa-bde5-20378f419e8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.069438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9c2f159-78d4-47aa-bde5-20378f419e8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.070772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9c2f159-78d4-47aa-bde5-20378f419e8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.072418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9c2f159-78d4-47aa-bde5-20378f419e8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.073203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9c2f159-78d4-47aa-bde5-20378f419e8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.294372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b9c2f159-78d4-47aa-bde5-20378f419e8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:11.331357 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b9c2f159-78d4-47aa-bde5-20378f419e8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1308 microversion: 2.1 time: 0.288723 Aug 27 02:42:11.332038 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1175/2620] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:11 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1308 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:11.922053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6e54e489-37db-4049-9771-c2c837821c95 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:11.922962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6e54e489-37db-4049-9771-c2c837821c95 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:11.931096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e54e489-37db-4049-9771-c2c837821c95 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.933117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e54e489-37db-4049-9771-c2c837821c95 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.933117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e54e489-37db-4049-9771-c2c837821c95 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.933117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e54e489-37db-4049-9771-c2c837821c95 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.933652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e54e489-37db-4049-9771-c2c837821c95 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.934119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e54e489-37db-4049-9771-c2c837821c95 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.944580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48ef60dc-dc96-4928-a2f1-bef54f4d0c62 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:11.945809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-48ef60dc-dc96-4928-a2f1-bef54f4d0c62 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:11.965390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48ef60dc-dc96-4928-a2f1-bef54f4d0c62 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.968211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48ef60dc-dc96-4928-a2f1-bef54f4d0c62 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.969496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48ef60dc-dc96-4928-a2f1-bef54f4d0c62 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:11.971873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6e54e489-37db-4049-9771-c2c837821c95 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:42:11.972905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48ef60dc-dc96-4928-a2f1-bef54f4d0c62 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:11.974807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48ef60dc-dc96-4928-a2f1-bef54f4d0c62 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:11.976054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48ef60dc-dc96-4928-a2f1-bef54f4d0c62 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:12.073567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6e54e489-37db-4049-9771-c2c837821c95 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 204 len: 0 microversion: 2.25 time: 0.156656 Aug 27 02:42:12.074272 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1446/2621] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:42:11 2022] DELETE /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 02:42:12.089973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:12.090705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:12.098049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:12.098803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:12.100173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:12.100173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:12.100601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:12.100867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:12.209007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-48ef60dc-dc96-4928-a2f1-bef54f4d0c62 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:12.224785 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-48ef60dc-dc96-4928-a2f1-bef54f4d0c62 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1466 microversion: 2.1 time: 0.287807 Aug 27 02:42:12.225887 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1176/2622] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:11 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1466 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:12.267418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-970a8bfd-02fc-4252-97fc-3c300b6760ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1956773821", "metadata": {"image_type": "test"}}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:12.272086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-970a8bfd-02fc-4252-97fc-3c300b6760ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:12.283780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970a8bfd-02fc-4252-97fc-3c300b6760ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:12.284410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970a8bfd-02fc-4252-97fc-3c300b6760ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:12.285209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970a8bfd-02fc-4252-97fc-3c300b6760ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:12.286560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970a8bfd-02fc-4252-97fc-3c300b6760ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:12.287415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970a8bfd-02fc-4252-97fc-3c300b6760ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:12.288167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970a8bfd-02fc-4252-97fc-3c300b6760ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:12.338801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:12.349886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:12.351517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:12.353059 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-273d2e53-b01b-4c99-a852-9918cde08357 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1550 microversion: 2.25 time: 0.271530 Aug 27 02:42:12.353958 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1447/2623] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:12 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1550 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:12.358996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-970a8bfd-02fc-4252-97fc-3c300b6760ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Getting quotas for project f791aca5ebbf40e98bc6538ab86e95da. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:42:12.359283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b7d61fa-f77a-415e-af15-33de48ac9da4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:12.359627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6b7d61fa-f77a-415e-af15-33de48ac9da4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:12.366924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b7d61fa-f77a-415e-af15-33de48ac9da4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:12.367430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b7d61fa-f77a-415e-af15-33de48ac9da4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:12.367857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b7d61fa-f77a-415e-af15-33de48ac9da4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:12.368524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-970a8bfd-02fc-4252-97fc-3c300b6760ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Getting quotas for user aeb7891a621941f88c8db1f2a5135c23 and project f791aca5ebbf40e98bc6538ab86e95da. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:42:12.369462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b7d61fa-f77a-415e-af15-33de48ac9da4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:12.370064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b7d61fa-f77a-415e-af15-33de48ac9da4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:12.370679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b7d61fa-f77a-415e-af15-33de48ac9da4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:12.609516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:12.630492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6b7d61fa-f77a-415e-af15-33de48ac9da4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:12.641422 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b7d61fa-f77a-415e-af15-33de48ac9da4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1308 microversion: 2.1 time: 0.286259 Aug 27 02:42:12.642439 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1448/2624] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:12 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:12.683237 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-970a8bfd-02fc-4252-97fc-3c300b6760ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "POST /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d/action" status: 202 len: 0 microversion: 2.1 time: 0.423046 Aug 27 02:42:12.684049 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1177/2625] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:12 2022] POST /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 02:42:12.695307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ee4d4ca8-0494-4078-a6f7-fb27b5de49b0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29462670>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:12.765329 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ee4d4ca8-0494-4078-a6f7-fb27b5de49b0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.073933 Aug 27 02:42:12.766308 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1449/2626] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:12 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:13.245449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-cf1a3a1d-caf6-40b9-912c-cb105c2ff763 req-b5c9a170-2bcb-4ecd-bc98-fd5de1cb4325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ade60c1-89d3-4f5d-94e0-42f8b573f14b", "name": "network-vif-deleted", "tag": "0541fb29-89c6-4ee0-96d0-f5319ae94bf3"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:13.257456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cf1a3a1d-caf6-40b9-912c-cb105c2ff763 req-b5c9a170-2bcb-4ecd-bc98-fd5de1cb4325 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:13.257981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cf1a3a1d-caf6-40b9-912c-cb105c2ff763 req-b5c9a170-2bcb-4ecd-bc98-fd5de1cb4325 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:13.258430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cf1a3a1d-caf6-40b9-912c-cb105c2ff763 req-b5c9a170-2bcb-4ecd-bc98-fd5de1cb4325 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:13.284378 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-cf1a3a1d-caf6-40b9-912c-cb105c2ff763 req-b5c9a170-2bcb-4ecd-bc98-fd5de1cb4325 service nova] Creating event network-vif-deleted:0541fb29-89c6-4ee0-96d0-f5319ae94bf3 for instance 1ade60c1-89d3-4f5d-94e0-42f8b573f14b on n-h2-852084-5 Aug 27 02:42:13.294222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-cf1a3a1d-caf6-40b9-912c-cb105c2ff763 req-b5c9a170-2bcb-4ecd-bc98-fd5de1cb4325 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053652 Aug 27 02:42:13.300198 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1178/2627] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:42:13.399035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:13.400693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:13.412571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:13.413298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:13.414006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:13.415719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:13.416557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:13.417328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:13.468543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:13.469118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:13.469638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:13.470349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lazy-loading 'fault' on Instance uuid 1ade60c1-89d3-4f5d-94e0-42f8b573f14b {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:13.542288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:13.552340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:13.553899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:13.555153 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab9bfedb-b5b3-47be-abcc-d1926cdac030 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 200 len: 1352 microversion: 2.25 time: 0.165370 Aug 27 02:42:13.556391 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1450/2628] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:13 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 1352 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:13.678285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-22680a08-1507-4e7e-a9d7-7e0ec3104e67 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:13.682980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-22680a08-1507-4e7e-a9d7-7e0ec3104e67 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:13.688163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22680a08-1507-4e7e-a9d7-7e0ec3104e67 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:13.688972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22680a08-1507-4e7e-a9d7-7e0ec3104e67 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:13.689595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22680a08-1507-4e7e-a9d7-7e0ec3104e67 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:13.691085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22680a08-1507-4e7e-a9d7-7e0ec3104e67 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:13.691998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22680a08-1507-4e7e-a9d7-7e0ec3104e67 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:13.692538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22680a08-1507-4e7e-a9d7-7e0ec3104e67 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:13.788816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab7cf991-1d61-4baa-942f-8d9c3d68d7d8 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d298e8a60>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:13.898656 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab7cf991-1d61-4baa-942f-8d9c3d68d7d8 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.118118 Aug 27 02:42:13.900316 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1451/2629] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:13 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:14.010793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-22680a08-1507-4e7e-a9d7-7e0ec3104e67 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:14.026420 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-22680a08-1507-4e7e-a9d7-7e0ec3104e67 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1308 microversion: 2.1 time: 0.353006 Aug 27 02:42:14.027663 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1179/2630] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:13 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1308 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:14.438738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f7eb6b0a-d9dc-4ca3-9465-5bd51ec96bc2 req-fb5ba48c-6be3-409a-8645-f5ad399099c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b863d40c-1266-4beb-a51e-02d683ffba71", "name": "network-vif-plugged", "status": "completed", "tag": "938a9794-4a8d-4ef4-92ab-23ae622e61c2"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:14.456385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f7eb6b0a-d9dc-4ca3-9465-5bd51ec96bc2 req-fb5ba48c-6be3-409a-8645-f5ad399099c1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:14.457233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f7eb6b0a-d9dc-4ca3-9465-5bd51ec96bc2 req-fb5ba48c-6be3-409a-8645-f5ad399099c1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:14.457849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f7eb6b0a-d9dc-4ca3-9465-5bd51ec96bc2 req-fb5ba48c-6be3-409a-8645-f5ad399099c1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.475201 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f7eb6b0a-d9dc-4ca3-9465-5bd51ec96bc2 req-fb5ba48c-6be3-409a-8645-f5ad399099c1 service nova] Creating event network-vif-plugged:938a9794-4a8d-4ef4-92ab-23ae622e61c2 for instance b863d40c-1266-4beb-a51e-02d683ffba71 on n-h2-852084-5 Aug 27 02:42:14.484858 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f7eb6b0a-d9dc-4ca3-9465-5bd51ec96bc2 req-fb5ba48c-6be3-409a-8645-f5ad399099c1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054106 Aug 27 02:42:14.485713 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1452/2631] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:14.610541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:14.611225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 1ade60c1-89d3-4f5d-94e0-42f8b573f14b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:14.624542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:14.625650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:14.626690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.627840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:14.628921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:14.629740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.661692 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] HTTP exception thrown: Instance 1ade60c1-89d3-4f5d-94e0-42f8b573f14b could not be found. Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Request method failure captured: Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b HTTP/1.1 Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYI_UMxHDhZscLZ1C5hiK_DKMle2OgO10TJN3MASp0Vb8eQyB7IXk2CVzBEnsnvleC2F5m6hB4iCUIG9VXCZ42bTk_XHRMlqBEupA7yYu5Sxcxsz9ievFfzu_5R_6jqpxCe179ZAlxL_sntknKcHVG_lwrfXMT7qe4aX_l4YeDHZIls Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 4d2da2e10e53450096a68048f98bd99a Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4d2da2e10e53450096a68048f98bd99a"}]}] Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 4d2da2e10e53450096a68048f98bd99a Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-LiveAutoBlockMigrationV225Test-1759099354-project Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 4cf03330b076434098eef9230222830e Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354-project Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 1ade60c1-89d3-4f5d-94e0-42f8b573f14b could not be found. Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '1ade60c1-89d3-4f5d-94e0-42f8b573f14b'} Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ade60c1-89d3-4f5d-94e0-42f8b573f14b could not be found. Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ade60c1-89d3-4f5d-94e0-42f8b573f14b could not be found. Aug 27 02:42:14.665541 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:42:14.676877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:14.676877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:42:14.676877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:14.676877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:14.676877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:14.676877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:14.676877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:14.676877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ade60c1-89d3-4f5d-94e0-42f8b573f14b could not be found. Aug 27 02:42:14.676877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:42:14.676877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Returning 404 to user: Instance 1ade60c1-89d3-4f5d-94e0-42f8b573f14b could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:14.676877 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aed75c8b-1a54-4ce5-a8bc-1ddcabe80b62 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b" status: 404 len: 111 microversion: 2.25 time: 0.063023 Aug 27 02:42:14.684948 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1180/2632] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:14 2022] GET /compute/v2.1/servers/1ade60c1-89d3-4f5d-94e0-42f8b573f14b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:42:14.688179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-324a82d3-ec7e-4e58-8641-5c09eabd0486 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:14.689099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-324a82d3-ec7e-4e58-8641-5c09eabd0486 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:14.703140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-324a82d3-ec7e-4e58-8641-5c09eabd0486 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:14.704291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-324a82d3-ec7e-4e58-8641-5c09eabd0486 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:14.705239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-324a82d3-ec7e-4e58-8641-5c09eabd0486 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.706492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-324a82d3-ec7e-4e58-8641-5c09eabd0486 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:14.707596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-324a82d3-ec7e-4e58-8641-5c09eabd0486 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:14.708337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-324a82d3-ec7e-4e58-8641-5c09eabd0486 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.759627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-324a82d3-ec7e-4e58-8641-5c09eabd0486 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:42:14.779909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:14.870700 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-324a82d3-ec7e-4e58-8641-5c09eabd0486 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "DELETE /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 204 len: 0 microversion: 2.25 time: 0.193259 Aug 27 02:42:14.871975 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1453/2633] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:42:14 2022] DELETE /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:42:14.882956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:14.884154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:14.891791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:14.892485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:14.893151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.894113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:14.894729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:14.895300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:14.928987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-201abbd1-246e-4e71-8a7c-427768ce47d8 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2a11ab80>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:14.998418 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-201abbd1-246e-4e71-8a7c-427768ce47d8 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.078611 Aug 27 02:42:14.999687 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1454/2634] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:14 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:15.056234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-190c9bca-7790-4e3d-afe4-701f1f41e47a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:15.058748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-190c9bca-7790-4e3d-afe4-701f1f41e47a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:15.069852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-190c9bca-7790-4e3d-afe4-701f1f41e47a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:15.070924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-190c9bca-7790-4e3d-afe4-701f1f41e47a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:15.073396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-190c9bca-7790-4e3d-afe4-701f1f41e47a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:15.075338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-190c9bca-7790-4e3d-afe4-701f1f41e47a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:15.076272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-190c9bca-7790-4e3d-afe4-701f1f41e47a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:15.077095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-190c9bca-7790-4e3d-afe4-701f1f41e47a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:15.134637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:15.160500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:15.163770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:15.165933 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-af3ef818-feac-4da0-994d-d9c270405b65 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1565 microversion: 2.25 time: 0.288600 Aug 27 02:42:15.167427 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1181/2635] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:14 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1565 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:42:15.359136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-190c9bca-7790-4e3d-afe4-701f1f41e47a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:15.369408 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-190c9bca-7790-4e3d-afe4-701f1f41e47a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1308 microversion: 2.1 time: 0.318744 Aug 27 02:42:15.370060 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1455/2636] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:15 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1308 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:16.026236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6f8efcc1-a689-46ca-b15c-a0a694489b3d tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2b1f1160>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:16.127852 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6f8efcc1-a689-46ca-b15c-a0a694489b3d tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.109293 Aug 27 02:42:16.129028 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1182/2637] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:16 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:16.196575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:16.199296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:16.214779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:16.215822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:16.216584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:16.217921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:16.218754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:16.219510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:16.352007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-15d2fddc-38f8-47cc-9b47-f1009104d14b tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eda29a87-5fbf-4efc-aea9-e3586a374711"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:16.358821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-15d2fddc-38f8-47cc-9b47-f1009104d14b tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:16.375425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15d2fddc-38f8-47cc-9b47-f1009104d14b tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:16.376433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15d2fddc-38f8-47cc-9b47-f1009104d14b tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:16.377724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15d2fddc-38f8-47cc-9b47-f1009104d14b tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:16.379601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15d2fddc-38f8-47cc-9b47-f1009104d14b tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:16.380820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15d2fddc-38f8-47cc-9b47-f1009104d14b tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:16.382503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15d2fddc-38f8-47cc-9b47-f1009104d14b tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:16.527467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:16.548701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:16.554683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:16.558302 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-90b11470-8914-4c39-9711-1ca2c1a22b5f tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1565 microversion: 2.25 time: 0.368285 Aug 27 02:42:16.570398 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1456/2638] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:16 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1565 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:16.582180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ee0da4ef-0313-4d7e-91cd-49cd9e47f0f4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:16.583175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ee0da4ef-0313-4d7e-91cd-49cd9e47f0f4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:16.591454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee0da4ef-0313-4d7e-91cd-49cd9e47f0f4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:16.592101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee0da4ef-0313-4d7e-91cd-49cd9e47f0f4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:16.592653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee0da4ef-0313-4d7e-91cd-49cd9e47f0f4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:16.593537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee0da4ef-0313-4d7e-91cd-49cd9e47f0f4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:16.594197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee0da4ef-0313-4d7e-91cd-49cd9e47f0f4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:16.594806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee0da4ef-0313-4d7e-91cd-49cd9e47f0f4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:16.944578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ee0da4ef-0313-4d7e-91cd-49cd9e47f0f4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:16.967533 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ee0da4ef-0313-4d7e-91cd-49cd9e47f0f4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1489 microversion: 2.1 time: 0.389473 Aug 27 02:42:16.968496 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-15d2fddc-38f8-47cc-9b47-f1009104d14b tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "POST /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627770 Aug 27 02:42:16.969364 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1457/2639] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:16 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1489 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:16.976786 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1183/2640] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 02:42:16 2022] POST /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-volume_attachments => generated 194 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:17.007551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68e136bb-87c4-4356-a6b0-1a8d899e9315 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:17.010486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-8d7a8d9a-f908-4a66-a787-efc9fb02d773 req-64ca1192-2f9e-404e-b94c-bf2e4174bf1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93453131-995a-46d6-848d-ec13cb596c67", "name": "network-vif-deleted", "tag": "22fd1df6-6d25-4d2d-a30d-bb3482bb2130"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:17.032652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68e136bb-87c4-4356-a6b0-1a8d899e9315 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:17.035184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68e136bb-87c4-4356-a6b0-1a8d899e9315 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:17.036314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68e136bb-87c4-4356-a6b0-1a8d899e9315 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:17.048032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8d7a8d9a-f908-4a66-a787-efc9fb02d773 req-64ca1192-2f9e-404e-b94c-bf2e4174bf1d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:17.049559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8d7a8d9a-f908-4a66-a787-efc9fb02d773 req-64ca1192-2f9e-404e-b94c-bf2e4174bf1d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:17.051360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8d7a8d9a-f908-4a66-a787-efc9fb02d773 req-64ca1192-2f9e-404e-b94c-bf2e4174bf1d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:17.087691 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-8d7a8d9a-f908-4a66-a787-efc9fb02d773 req-64ca1192-2f9e-404e-b94c-bf2e4174bf1d service nova] Creating event network-vif-deleted:22fd1df6-6d25-4d2d-a30d-bb3482bb2130 for instance 93453131-995a-46d6-848d-ec13cb596c67 on n-h2-852084-5 Aug 27 02:42:17.103520 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-8d7a8d9a-f908-4a66-a787-efc9fb02d773 req-64ca1192-2f9e-404e-b94c-bf2e4174bf1d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117417 Aug 27 02:42:17.111860 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1458/2641] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:17.144887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-68e136bb-87c4-4356-a6b0-1a8d899e9315 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Going to try to stop instance {{(pid=122487) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:42:17.156103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0d831ca4-5776-483a-9f0a-3a4995e0849c tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2e79ac10>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:17.281479 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-68e136bb-87c4-4356-a6b0-1a8d899e9315 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "POST /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71/action" status: 202 len: 0 microversion: 2.1 time: 0.282014 Aug 27 02:42:17.282340 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1184/2642] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:16 2022] POST /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:42:17.293310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bed10824-edf8-4977-81a9-1bd9e00bfa73 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:17.294451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bed10824-edf8-4977-81a9-1bd9e00bfa73 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:17.304507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bed10824-edf8-4977-81a9-1bd9e00bfa73 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:17.305009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bed10824-edf8-4977-81a9-1bd9e00bfa73 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:17.305581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bed10824-edf8-4977-81a9-1bd9e00bfa73 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:17.309716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bed10824-edf8-4977-81a9-1bd9e00bfa73 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:17.310650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bed10824-edf8-4977-81a9-1bd9e00bfa73 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:17.311379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bed10824-edf8-4977-81a9-1bd9e00bfa73 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:17.338569 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0d831ca4-5776-483a-9f0a-3a4995e0849c tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.190298 Aug 27 02:42:17.348242 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1459/2643] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:17 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:17.614588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:17.618600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:17.688519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:17.689394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:17.690575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:17.696761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:17.699364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:17.700915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:17.721807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bed10824-edf8-4977-81a9-1bd9e00bfa73 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:17.745355 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bed10824-edf8-4977-81a9-1bd9e00bfa73 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.456817 Aug 27 02:42:17.747220 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1185/2644] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:17 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:17.851005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:17.853951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:17.854966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:17.855827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lazy-loading 'fault' on Instance uuid 93453131-995a-46d6-848d-ec13cb596c67 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:17.965898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:17.990199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:17.994847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cf03330b076434098eef9230222830e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2da2e10e53450096a68048f98bd99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:17.996094 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-197b80ad-7cf7-4508-af62-4cd74abc7027 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 200 len: 1352 microversion: 2.25 time: 0.414298 Aug 27 02:42:18.019056 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1460/2645] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:17 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 1352 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:42:18.215062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e7a3fe7e-f724-4986-a0a0-e34d79c1d40a req-d62ba2f6-01c4-4153-9f28-7f41be07dfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514c8adb-41ea-426e-8a55-aea191d0fd3d", "name": "network-vif-plugged", "status": "completed", "tag": "330cbd96-d3f2-4d8e-bf9b-22961d787d26"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:18.251366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e7a3fe7e-f724-4986-a0a0-e34d79c1d40a req-d62ba2f6-01c4-4153-9f28-7f41be07dfe0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:18.254123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e7a3fe7e-f724-4986-a0a0-e34d79c1d40a req-d62ba2f6-01c4-4153-9f28-7f41be07dfe0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:18.256055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e7a3fe7e-f724-4986-a0a0-e34d79c1d40a req-d62ba2f6-01c4-4153-9f28-7f41be07dfe0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:18.280273 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e7a3fe7e-f724-4986-a0a0-e34d79c1d40a req-d62ba2f6-01c4-4153-9f28-7f41be07dfe0 service nova] Creating event network-vif-plugged:330cbd96-d3f2-4d8e-bf9b-22961d787d26 for instance 514c8adb-41ea-426e-8a55-aea191d0fd3d on n-h2-852084-5 Aug 27 02:42:18.292894 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e7a3fe7e-f724-4986-a0a0-e34d79c1d40a req-d62ba2f6-01c4-4153-9f28-7f41be07dfe0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099572 Aug 27 02:42:18.294873 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1186/2646] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:18.364570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-732f9a9c-26b4-4bbd-b179-53f9ddefd330 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2a242940>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:18.546138 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-732f9a9c-26b4-4bbd-b179-53f9ddefd330 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.189060 Aug 27 02:42:18.553731 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1461/2647] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:18 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:18.795106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f4de8416-8cec-4b2b-ab6e-2152d68a0c1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:18.796505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f4de8416-8cec-4b2b-ab6e-2152d68a0c1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:18.818079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4de8416-8cec-4b2b-ab6e-2152d68a0c1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:18.819001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4de8416-8cec-4b2b-ab6e-2152d68a0c1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:18.820091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4de8416-8cec-4b2b-ab6e-2152d68a0c1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:18.822605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4de8416-8cec-4b2b-ab6e-2152d68a0c1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:18.823743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4de8416-8cec-4b2b-ab6e-2152d68a0c1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:18.824753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4de8416-8cec-4b2b-ab6e-2152d68a0c1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:19.030713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:19.035069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] [instance: 93453131-995a-46d6-848d-ec13cb596c67] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:19.078363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:19.081320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:19.083697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:19.087582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:19.089368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:19.091013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:19.127604 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] HTTP exception thrown: Instance 93453131-995a-46d6-848d-ec13cb596c67 could not be found. Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Request method failure captured: Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 HTTP/1.1 Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYI_UMxHDhZscLZ1C5hiK_DKMle2OgO10TJN3MASp0Vb8eQyB7IXk2CVzBEnsnvleC2F5m6hB4iCUIG9VXCZ42bTk_XHRMlqBEupA7yYu5Sxcxsz9ievFfzu_5R_6jqpxCe179ZAlxL_sntknKcHVG_lwrfXMT7qe4aX_l4YeDHZIls Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.25 Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 4d2da2e10e53450096a68048f98bd99a Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4d2da2e10e53450096a68048f98bd99a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4d2da2e10e53450096a68048f98bd99a"}]}] Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 4d2da2e10e53450096a68048f98bd99a Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354 Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-LiveAutoBlockMigrationV225Test-1759099354-project Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 4cf03330b076434098eef9230222830e Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1759099354-project Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 93453131-995a-46d6-848d-ec13cb596c67 could not be found. Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '93453131-995a-46d6-848d-ec13cb596c67'} Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93453131-995a-46d6-848d-ec13cb596c67 could not be found. Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93453131-995a-46d6-848d-ec13cb596c67 could not be found. Aug 27 02:42:19.131889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:19.144157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:19.144157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:19.144157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:19.144157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:19.144157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:19.144157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:19.144157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:19.144157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93453131-995a-46d6-848d-ec13cb596c67 could not be found. Aug 27 02:42:19.144157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:19.151717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] Returning 404 to user: Instance 93453131-995a-46d6-848d-ec13cb596c67 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:19.155991 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13501b08-3548-4f3d-904b-3b93226f3ed8 tempest-LiveAutoBlockMigrationV225Test-1759099354 tempest-LiveAutoBlockMigrationV225Test-1759099354-project] 10.222.0.99 "GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67" status: 404 len: 111 microversion: 2.25 time: 0.132639 Aug 27 02:42:19.157999 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1462/2648] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:19 2022] GET /compute/v2.1/servers/93453131-995a-46d6-848d-ec13cb596c67 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:42:19.198210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f4de8416-8cec-4b2b-ab6e-2152d68a0c1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:19.232828 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f4de8416-8cec-4b2b-ab6e-2152d68a0c1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.447882 Aug 27 02:42:19.234895 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1187/2649] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:18 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:19.578452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1dd4b53f-89af-4072-9afc-0a9828ce92b9 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2a11eaf0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:19.832204 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1dd4b53f-89af-4072-9afc-0a9828ce92b9 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.261582 Aug 27 02:42:19.837343 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1463/2650] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:19 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:20.273330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-401ca977-e455-4a99-bf69-75e710012ed3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:20.273330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-401ca977-e455-4a99-bf69-75e710012ed3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:20.293513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401ca977-e455-4a99-bf69-75e710012ed3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:20.294062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401ca977-e455-4a99-bf69-75e710012ed3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:20.294513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401ca977-e455-4a99-bf69-75e710012ed3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:20.295292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401ca977-e455-4a99-bf69-75e710012ed3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:20.295764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401ca977-e455-4a99-bf69-75e710012ed3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:20.296400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-401ca977-e455-4a99-bf69-75e710012ed3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:20.527399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-401ca977-e455-4a99-bf69-75e710012ed3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:20.548824 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-401ca977-e455-4a99-bf69-75e710012ed3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.279721 Aug 27 02:42:20.551318 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1188/2651] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:20 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:20.870006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f50694a-a558-49d7-b0c3-5198b5d79653 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2e8a0280>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:20.940600 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f50694a-a558-49d7-b0c3-5198b5d79653 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.076583 Aug 27 02:42:20.943437 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1464/2652] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:20 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:21.580777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-47372fca-72a4-4f40-a048-7184e4d8f652 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:21.585805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-47372fca-72a4-4f40-a048-7184e4d8f652 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:21.608103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47372fca-72a4-4f40-a048-7184e4d8f652 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:21.609009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47372fca-72a4-4f40-a048-7184e4d8f652 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:21.609754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47372fca-72a4-4f40-a048-7184e4d8f652 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:21.610766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47372fca-72a4-4f40-a048-7184e4d8f652 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:21.611719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47372fca-72a4-4f40-a048-7184e4d8f652 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:21.612410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47372fca-72a4-4f40-a048-7184e4d8f652 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:21.954891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-47372fca-72a4-4f40-a048-7184e4d8f652 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:21.979460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-434cd044-e86f-4aaa-a74d-e44c220d9e93 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2e7fe0d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:21.989093 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-47372fca-72a4-4f40-a048-7184e4d8f652 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.420020 Aug 27 02:42:22.006585 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1189/2653] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:21 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:22.070404 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-434cd044-e86f-4aaa-a74d-e44c220d9e93 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.109843 Aug 27 02:42:22.071474 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1465/2654] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:21 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:23.020931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-49e1f165-961a-4f64-86cd-68c7e7332c03 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:23.022322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-49e1f165-961a-4f64-86cd-68c7e7332c03 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:23.035873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49e1f165-961a-4f64-86cd-68c7e7332c03 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:23.041327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49e1f165-961a-4f64-86cd-68c7e7332c03 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:23.042198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49e1f165-961a-4f64-86cd-68c7e7332c03 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:23.047874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49e1f165-961a-4f64-86cd-68c7e7332c03 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:23.049392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49e1f165-961a-4f64-86cd-68c7e7332c03 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:23.050211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49e1f165-961a-4f64-86cd-68c7e7332c03 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:23.093381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e993e26f-385e-4c09-8cdb-fdf2dd26592f tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2948d0d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:23.198771 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e993e26f-385e-4c09-8cdb-fdf2dd26592f tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.116266 Aug 27 02:42:23.199790 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1466/2655] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:23 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:23.477613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-49e1f165-961a-4f64-86cd-68c7e7332c03 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:23.511045 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-49e1f165-961a-4f64-86cd-68c7e7332c03 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.499016 Aug 27 02:42:23.517824 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1190/2656] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:23 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:24.216423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1626eab8-1cb9-4329-a9a8-3419c01b5883 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2e7463a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:24.296355 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1626eab8-1cb9-4329-a9a8-3419c01b5883 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.085336 Aug 27 02:42:24.306347 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1467/2657] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:24 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:24.533522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-794bdea6-9bbb-4fb6-8bb0-380bee3162df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:24.534810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-794bdea6-9bbb-4fb6-8bb0-380bee3162df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:24.548991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-794bdea6-9bbb-4fb6-8bb0-380bee3162df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:24.554514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-794bdea6-9bbb-4fb6-8bb0-380bee3162df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:24.555814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-794bdea6-9bbb-4fb6-8bb0-380bee3162df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:24.556978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-794bdea6-9bbb-4fb6-8bb0-380bee3162df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:24.557711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-794bdea6-9bbb-4fb6-8bb0-380bee3162df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:24.558439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-794bdea6-9bbb-4fb6-8bb0-380bee3162df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:25.314317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dc874a2b-1b21-4b99-90b4-995829acdc3f tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2a111e50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:25.436303 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dc874a2b-1b21-4b99-90b4-995829acdc3f tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.104831 Aug 27 02:42:25.456632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-794bdea6-9bbb-4fb6-8bb0-380bee3162df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:25.460046 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1468/2658] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:25 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:25.466611 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-794bdea6-9bbb-4fb6-8bb0-380bee3162df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.936323 Aug 27 02:42:25.467820 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1191/2659] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:24 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:26.466103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9fe0748b-ecee-4445-8f83-d3705dc200ab tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2e7ba670>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:26.494563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-488d62e8-8eab-45bb-b92c-b5f6ef97b0b4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:26.495346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-488d62e8-8eab-45bb-b92c-b5f6ef97b0b4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:26.514052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488d62e8-8eab-45bb-b92c-b5f6ef97b0b4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:26.514888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488d62e8-8eab-45bb-b92c-b5f6ef97b0b4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:26.516359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488d62e8-8eab-45bb-b92c-b5f6ef97b0b4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:26.517246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488d62e8-8eab-45bb-b92c-b5f6ef97b0b4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:26.519394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488d62e8-8eab-45bb-b92c-b5f6ef97b0b4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:26.522216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488d62e8-8eab-45bb-b92c-b5f6ef97b0b4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:26.576395 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9fe0748b-ecee-4445-8f83-d3705dc200ab tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.117053 Aug 27 02:42:26.579320 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1469/2660] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:26 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:26.962082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-913db93d-3451-495b-a126-0d311acb7cdf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e9641d7-91ea-4339-b1e6-97093d761511"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:26.965878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-913db93d-3451-495b-a126-0d311acb7cdf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:26.985810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-913db93d-3451-495b-a126-0d311acb7cdf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:26.986744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-913db93d-3451-495b-a126-0d311acb7cdf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:26.987506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-913db93d-3451-495b-a126-0d311acb7cdf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:26.988556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-913db93d-3451-495b-a126-0d311acb7cdf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:26.989329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-913db93d-3451-495b-a126-0d311acb7cdf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:26.989917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-913db93d-3451-495b-a126-0d311acb7cdf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:27.028667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-488d62e8-8eab-45bb-b92c-b5f6ef97b0b4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:27.041203 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-488d62e8-8eab-45bb-b92c-b5f6ef97b0b4 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.550530 Aug 27 02:42:27.058822 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1192/2661] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:26 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:27.439371 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-913db93d-3451-495b-a126-0d311acb7cdf tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484143 Aug 27 02:42:27.441762 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1470/2662] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 02:42:26 2022] POST /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:42:27.615676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e041a7f-9a8f-4195-a64c-c050d1e9f1d5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2a6e6f70>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:27.769545 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4e041a7f-9a8f-4195-a64c-c050d1e9f1d5 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.168596 Aug 27 02:42:27.771519 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1193/2663] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:27 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:28.068410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4b2788f-c7d1-4d78-9185-39a0a0a4ff9a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:28.069876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4b2788f-c7d1-4d78-9185-39a0a0a4ff9a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:28.084045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:28.089287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4b2788f-c7d1-4d78-9185-39a0a0a4ff9a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:28.091462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4b2788f-c7d1-4d78-9185-39a0a0a4ff9a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:28.092223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4b2788f-c7d1-4d78-9185-39a0a0a4ff9a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:28.095637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4b2788f-c7d1-4d78-9185-39a0a0a4ff9a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:28.096224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4b2788f-c7d1-4d78-9185-39a0a0a4ff9a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:28.096920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4b2788f-c7d1-4d78-9185-39a0a0a4ff9a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:28.609832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4b2788f-c7d1-4d78-9185-39a0a0a4ff9a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:28.643418 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4b2788f-c7d1-4d78-9185-39a0a0a4ff9a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.579085 Aug 27 02:42:28.647111 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1471/2664] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:28 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:28.808464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df5e4434-3dea-4768-8e86-4d48719acac7 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29aabaf0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:28.940730 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-df5e4434-3dea-4768-8e86-4d48719acac7 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.150126 Aug 27 02:42:28.941602 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1194/2665] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:28 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:29.687810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32d16045-8ad3-441d-8177-70026b51b69c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:29.690289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-32d16045-8ad3-441d-8177-70026b51b69c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:29.741646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32d16045-8ad3-441d-8177-70026b51b69c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:29.743086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32d16045-8ad3-441d-8177-70026b51b69c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:29.745961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32d16045-8ad3-441d-8177-70026b51b69c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:29.748199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32d16045-8ad3-441d-8177-70026b51b69c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:29.750995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32d16045-8ad3-441d-8177-70026b51b69c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:29.755476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32d16045-8ad3-441d-8177-70026b51b69c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:29.968587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f13c6124-19b9-4d73-9186-e7622e1cdca2 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29b304c0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:30.101232 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f13c6124-19b9-4d73-9186-e7622e1cdca2 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.139861 Aug 27 02:42:30.104923 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1195/2666] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:29 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:30.214648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-32d16045-8ad3-441d-8177-70026b51b69c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:30.240934 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-32d16045-8ad3-441d-8177-70026b51b69c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.561653 Aug 27 02:42:30.259036 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1472/2667] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:29 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:30.402840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d5376bad-08f0-474d-8aff-7077826e03cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:30.404636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d5376bad-08f0-474d-8aff-7077826e03cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:30.419138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=78 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:30.455775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5376bad-08f0-474d-8aff-7077826e03cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:30.456316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5376bad-08f0-474d-8aff-7077826e03cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:30.456859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5376bad-08f0-474d-8aff-7077826e03cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:30.458435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5376bad-08f0-474d-8aff-7077826e03cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:30.459052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5376bad-08f0-474d-8aff-7077826e03cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:30.459701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5376bad-08f0-474d-8aff-7077826e03cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:30.761243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:30.762081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:30.773322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:30.775878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:30.782555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:30.783015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d5376bad-08f0-474d-8aff-7077826e03cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:30.783442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:30.783953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:30.789523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:30.792963 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d5376bad-08f0-474d-8aff-7077826e03cd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.401013 Aug 27 02:42:30.793971 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1196/2668] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:30 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:30.818824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b99a600d-4081-4bfb-a866-c391b2e1770b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:30.820066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b99a600d-4081-4bfb-a866-c391b2e1770b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:30.841587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b99a600d-4081-4bfb-a866-c391b2e1770b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:30.842559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b99a600d-4081-4bfb-a866-c391b2e1770b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:30.844458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b99a600d-4081-4bfb-a866-c391b2e1770b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:30.845500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b99a600d-4081-4bfb-a866-c391b2e1770b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:30.850275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b99a600d-4081-4bfb-a866-c391b2e1770b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:30.851080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b99a600d-4081-4bfb-a866-c391b2e1770b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:30.884159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:31.060554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b99a600d-4081-4bfb-a866-c391b2e1770b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:31.073827 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b99a600d-4081-4bfb-a866-c391b2e1770b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.259701 Aug 27 02:42:31.088671 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1197/2669] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:30 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:31.103049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-621530f3-a3b3-4d81-ba44-b520312dad4a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:31.103684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-621530f3-a3b3-4d81-ba44-b520312dad4a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:31.122856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-621530f3-a3b3-4d81-ba44-b520312dad4a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.126938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-621530f3-a3b3-4d81-ba44-b520312dad4a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.128131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-621530f3-a3b3-4d81-ba44-b520312dad4a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.131373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-621530f3-a3b3-4d81-ba44-b520312dad4a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.136759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-621530f3-a3b3-4d81-ba44-b520312dad4a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.137534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-621530f3-a3b3-4d81-ba44-b520312dad4a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.490234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-621530f3-a3b3-4d81-ba44-b520312dad4a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:31.496978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:31.510222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-621530f3-a3b3-4d81-ba44-b520312dad4a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.409591 Aug 27 02:42:31.513154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:31.518129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:31.522947 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1a78cd69-e28e-475d-9140-bfda3b30b774 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 2949 microversion: 2.32 time: 1.032856 Aug 27 02:42:31.524513 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1473/2670] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:30 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 2949 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:31.530334 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1198/2671] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:31 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:31.541417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-84fb3bc2-6b1a-48b8-b294-1c8066a1a28a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2e7af790>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:31.542078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-befc1847-ef98-4e76-9fc3-af088e33eb6f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:31.543205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-befc1847-ef98-4e76-9fc3-af088e33eb6f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:31.557121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-befc1847-ef98-4e76-9fc3-af088e33eb6f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.559504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-befc1847-ef98-4e76-9fc3-af088e33eb6f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.561274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-befc1847-ef98-4e76-9fc3-af088e33eb6f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.562073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-befc1847-ef98-4e76-9fc3-af088e33eb6f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.562541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-befc1847-ef98-4e76-9fc3-af088e33eb6f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.564883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-befc1847-ef98-4e76-9fc3-af088e33eb6f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.607785 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-84fb3bc2-6b1a-48b8-b294-1c8066a1a28a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.080716 Aug 27 02:42:31.609697 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1474/2672] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:31 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:31.615308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c6f64e0e-0018-4984-960c-8d89fc565cf8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:31.616367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6f64e0e-0018-4984-960c-8d89fc565cf8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:31.625070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6f64e0e-0018-4984-960c-8d89fc565cf8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.626015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6f64e0e-0018-4984-960c-8d89fc565cf8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.626814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6f64e0e-0018-4984-960c-8d89fc565cf8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.627822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6f64e0e-0018-4984-960c-8d89fc565cf8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.628530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6f64e0e-0018-4984-960c-8d89fc565cf8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.629187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6f64e0e-0018-4984-960c-8d89fc565cf8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.887643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c6f64e0e-0018-4984-960c-8d89fc565cf8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:31.904865 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c6f64e0e-0018-4984-960c-8d89fc565cf8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.288844 Aug 27 02:42:31.906216 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1475/2673] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:31 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:31.921747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6305e127-138f-4dd8-b1f6-894dcec3f22a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:31.922813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6305e127-138f-4dd8-b1f6-894dcec3f22a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:31.951915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6305e127-138f-4dd8-b1f6-894dcec3f22a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.952734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6305e127-138f-4dd8-b1f6-894dcec3f22a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.953356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6305e127-138f-4dd8-b1f6-894dcec3f22a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:31.954128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6305e127-138f-4dd8-b1f6-894dcec3f22a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:31.954754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6305e127-138f-4dd8-b1f6-894dcec3f22a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:31.955345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6305e127-138f-4dd8-b1f6-894dcec3f22a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:32.231365 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6305e127-138f-4dd8-b1f6-894dcec3f22a tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.323140 Aug 27 02:42:32.232163 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1476/2674] 10.222.0.99 () {60 vars in 1316 bytes} [Sat Aug 27 02:42:31 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2/os-interface => generated 1830 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:32.249431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-433ff5d3-a0f5-4802-bdb2-092ebf3a3afa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:32.249982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-433ff5d3-a0f5-4802-bdb2-092ebf3a3afa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:32.265397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-433ff5d3-a0f5-4802-bdb2-092ebf3a3afa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:32.273025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-433ff5d3-a0f5-4802-bdb2-092ebf3a3afa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:32.274333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-433ff5d3-a0f5-4802-bdb2-092ebf3a3afa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:32.275306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-433ff5d3-a0f5-4802-bdb2-092ebf3a3afa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:32.278682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-433ff5d3-a0f5-4802-bdb2-092ebf3a3afa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:32.279144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-433ff5d3-a0f5-4802-bdb2-092ebf3a3afa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:32.335685 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-433ff5d3-a0f5-4802-bdb2-092ebf3a3afa tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/ips" status: 200 len: 151 microversion: 2.20 time: 0.090957 Aug 27 02:42:32.336687 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1477/2675] 10.222.0.99 () {60 vars in 1289 bytes} [Sat Aug 27 02:42:32 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:42:32.342020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1803150359", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a5df9b9c-03e6-4d14-a511-7974335d0f10"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:32.394029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-befc1847-ef98-4e76-9fc3-af088e33eb6f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:32.427862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] validate_networks() for [('a5df9b9c-03e6-4d14-a511-7974335d0f10', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:42:32.444100 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-befc1847-ef98-4e76-9fc3-af088e33eb6f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.905924 Aug 27 02:42:32.447043 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1199/2676] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:31 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:32.632413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4183202b-35f5-4a8f-b35a-39ce86dfb00f tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29aaba60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:32.761807 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4183202b-35f5-4a8f-b35a-39ce86dfb00f tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.139606 Aug 27 02:42:32.770677 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1200/2677] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:32 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:33.492892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e126887-ad11-40bf-b88e-fd3b8fa3c137 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:33.494535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e126887-ad11-40bf-b88e-fd3b8fa3c137 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:33.524181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e126887-ad11-40bf-b88e-fd3b8fa3c137 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:33.527402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e126887-ad11-40bf-b88e-fd3b8fa3c137 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:33.528920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e126887-ad11-40bf-b88e-fd3b8fa3c137 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:33.533539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e126887-ad11-40bf-b88e-fd3b8fa3c137 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:33.535012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e126887-ad11-40bf-b88e-fd3b8fa3c137 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:33.537073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e126887-ad11-40bf-b88e-fd3b8fa3c137 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.040546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6e126887-ad11-40bf-b88e-fd3b8fa3c137 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:34.058048 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e126887-ad11-40bf-b88e-fd3b8fa3c137 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.572089 Aug 27 02:42:34.058679 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1201/2678] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:33 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:34.068205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-edefca78-3f12-4de6-aeb0-7e9c832f1f82 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2e74e1f0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:34.164035 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-edefca78-3f12-4de6-aeb0-7e9c832f1f82 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.094902 Aug 27 02:42:34.165187 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1202/2679] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:34 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:34.173852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e0d216a1-189c-41a6-b2a0-396ad55d9a4d tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:34.192050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e0d216a1-189c-41a6-b2a0-396ad55d9a4d tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:34.225965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d216a1-189c-41a6-b2a0-396ad55d9a4d tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:34.227541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d216a1-189c-41a6-b2a0-396ad55d9a4d tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:34.228108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d216a1-189c-41a6-b2a0-396ad55d9a4d tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.229786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d216a1-189c-41a6-b2a0-396ad55d9a4d tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:34.230436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d216a1-189c-41a6-b2a0-396ad55d9a4d tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:34.231033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0d216a1-189c-41a6-b2a0-396ad55d9a4d tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.298120 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e0d216a1-189c-41a6-b2a0-396ad55d9a4d tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131420 Aug 27 02:42:34.299516 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1203/2680] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:42:34 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:34.316379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba466274-0970-4c7a-ba97-a08fd583dcbd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:34.317423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba466274-0970-4c7a-ba97-a08fd583dcbd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:34.330833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba466274-0970-4c7a-ba97-a08fd583dcbd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:34.334520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba466274-0970-4c7a-ba97-a08fd583dcbd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:34.344601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba466274-0970-4c7a-ba97-a08fd583dcbd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.346582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba466274-0970-4c7a-ba97-a08fd583dcbd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:34.347502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba466274-0970-4c7a-ba97-a08fd583dcbd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:34.348213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba466274-0970-4c7a-ba97-a08fd583dcbd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.762376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-ba466274-0970-4c7a-ba97-a08fd583dcbd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lazy-loading 'services' on Instance uuid 534917a1-8a02-493c-af75-fdef81207a5a {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:34.766663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:42:34.767204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:42:34.769028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:42:34.769485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:42:34.769945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:42:34.803464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:34.813269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:34.814139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.815304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:34.816442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:34.818934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:34.871665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for project 69945a768314456fae9bf75e854510c2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:42:34.888407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for user 281834367cf24a809448bdeea36a9c97 and project 69945a768314456fae9bf75e854510c2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:42:34.923650 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba466274-0970-4c7a-ba97-a08fd583dcbd tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "DELETE /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-volume_attachments/eda29a87-5fbf-4efc-aea9-e3586a374711" status: 202 len: 0 microversion: 2.1 time: 0.615285 Aug 27 02:42:34.924609 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1204/2681] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 02:42:34 2022] DELETE /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-volume_attachments/eda29a87-5fbf-4efc-aea9-e3586a374711 => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:42:34.928694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:42:34.933232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:42:35.085235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a341cce5-aaac-49ae-be90-2478abb091f7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:35.086961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a341cce5-aaac-49ae-be90-2478abb091f7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:35.100809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a341cce5-aaac-49ae-be90-2478abb091f7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:35.102615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a341cce5-aaac-49ae-be90-2478abb091f7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:35.106368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a341cce5-aaac-49ae-be90-2478abb091f7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:35.110766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a341cce5-aaac-49ae-be90-2478abb091f7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:35.112614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a341cce5-aaac-49ae-be90-2478abb091f7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:35.113235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a341cce5-aaac-49ae-be90-2478abb091f7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:35.193891 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-37c7007e-fecb-462f-b721-3fdd35382f9c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.851933 Aug 27 02:42:35.194638 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1478/2682] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:42:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:42:35.218092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b79b346b-328b-4ab1-aa6e-7fa1f5332a0f tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2e7af310>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:35.360576 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b79b346b-328b-4ab1-aa6e-7fa1f5332a0f tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.158491 Aug 27 02:42:35.369346 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1479/2683] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:35 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:35.380748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-290164c6-3957-47d0-a313-133e0822eda4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:35.381391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-290164c6-3957-47d0-a313-133e0822eda4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:35.581209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a341cce5-aaac-49ae-be90-2478abb091f7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:35.608789 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a341cce5-aaac-49ae-be90-2478abb091f7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.527983 Aug 27 02:42:35.614222 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1205/2684] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:35 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:35.811257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-290164c6-3957-47d0-a313-133e0822eda4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:35.835148 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-290164c6-3957-47d0-a313-133e0822eda4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1215 microversion: 2.1 time: 0.464384 Aug 27 02:42:35.837060 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1480/2685] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:35 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1215 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:36.382349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e56f5fad-038c-4e96-a1be-2d0eb076b9e7 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2a6e6820>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:36.469430 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e56f5fad-038c-4e96-a1be-2d0eb076b9e7 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.096714 Aug 27 02:42:36.486171 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1206/2686] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:36 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:36.652136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6bf51c3e-b6b8-49c2-9bd7-5a6edc8b6b3e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:36.652776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6bf51c3e-b6b8-49c2-9bd7-5a6edc8b6b3e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:36.671130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6bf51c3e-b6b8-49c2-9bd7-5a6edc8b6b3e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:36.671645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6bf51c3e-b6b8-49c2-9bd7-5a6edc8b6b3e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:36.672105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6bf51c3e-b6b8-49c2-9bd7-5a6edc8b6b3e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:36.672857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6bf51c3e-b6b8-49c2-9bd7-5a6edc8b6b3e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:36.684606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6bf51c3e-b6b8-49c2-9bd7-5a6edc8b6b3e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:36.689025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6bf51c3e-b6b8-49c2-9bd7-5a6edc8b6b3e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:36.882134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7608c75b-1991-4e57-a41c-3de09e1b579e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:36.882991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7608c75b-1991-4e57-a41c-3de09e1b579e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:37.099840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6bf51c3e-b6b8-49c2-9bd7-5a6edc8b6b3e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:37.107460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7608c75b-1991-4e57-a41c-3de09e1b579e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:37.117075 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7608c75b-1991-4e57-a41c-3de09e1b579e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1215 microversion: 2.1 time: 0.239356 Aug 27 02:42:37.123887 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1207/2687] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:36 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:37.140650 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6bf51c3e-b6b8-49c2-9bd7-5a6edc8b6b3e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.493153 Aug 27 02:42:37.141724 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1481/2688] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:36 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:37.502220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42d290a5-8044-46f4-99a2-18bd35893e54 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2b1f1160>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:37.623287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42d290a5-8044-46f4-99a2-18bd35893e54 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.129043 Aug 27 02:42:37.634633 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1208/2689] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:37 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:38.173701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a60d0a05-4700-4e5d-8c8e-b62503cc896f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:38.174608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a5f19ad8-efba-4e8a-af84-6889f313243c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:38.175130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a5f19ad8-efba-4e8a-af84-6889f313243c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:38.176442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a60d0a05-4700-4e5d-8c8e-b62503cc896f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:38.186932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f19ad8-efba-4e8a-af84-6889f313243c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:38.187490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f19ad8-efba-4e8a-af84-6889f313243c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:38.188153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f19ad8-efba-4e8a-af84-6889f313243c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:38.189090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f19ad8-efba-4e8a-af84-6889f313243c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:38.189774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f19ad8-efba-4e8a-af84-6889f313243c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:38.190580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f19ad8-efba-4e8a-af84-6889f313243c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:38.207053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60d0a05-4700-4e5d-8c8e-b62503cc896f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:38.208841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60d0a05-4700-4e5d-8c8e-b62503cc896f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:38.213075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60d0a05-4700-4e5d-8c8e-b62503cc896f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:38.214960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60d0a05-4700-4e5d-8c8e-b62503cc896f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:38.219347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60d0a05-4700-4e5d-8c8e-b62503cc896f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:38.221005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60d0a05-4700-4e5d-8c8e-b62503cc896f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:38.460326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a60d0a05-4700-4e5d-8c8e-b62503cc896f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:38.496930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a5f19ad8-efba-4e8a-af84-6889f313243c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:38.500115 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a60d0a05-4700-4e5d-8c8e-b62503cc896f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1267 microversion: 2.1 time: 0.339833 Aug 27 02:42:38.510878 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a5f19ad8-efba-4e8a-af84-6889f313243c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.345366 Aug 27 02:42:38.512594 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1209/2690] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:38 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:38.527157 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1482/2691] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:38 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1267 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:38.644582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-33fc2e04-eeda-4c16-bd0f-1d64c10cb53c tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2b1b8940>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:38.715407 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-33fc2e04-eeda-4c16-bd0f-1d64c10cb53c tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1422 microversion: 2.1 time: 0.066435 Aug 27 02:42:38.727959 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1210/2692] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:38 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:39.395188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c9bef72d-4b0f-4997-a980-4b04b85edf44 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:39.400679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c9bef72d-4b0f-4997-a980-4b04b85edf44 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:39.421860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9bef72d-4b0f-4997-a980-4b04b85edf44 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.423401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9bef72d-4b0f-4997-a980-4b04b85edf44 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.424045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9bef72d-4b0f-4997-a980-4b04b85edf44 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.425470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9bef72d-4b0f-4997-a980-4b04b85edf44 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.426243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9bef72d-4b0f-4997-a980-4b04b85edf44 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.427100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9bef72d-4b0f-4997-a980-4b04b85edf44 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.432570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:39.498764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-c9bef72d-4b0f-4997-a980-4b04b85edf44 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lazy-loading 'flavor' on Instance uuid a7489a8a-8682-4455-abba-671195effab4 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:39.561142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4383549a-7506-47f0-a27c-28f895a07731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:39.567546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4383549a-7506-47f0-a27c-28f895a07731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:39.587212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4383549a-7506-47f0-a27c-28f895a07731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.588213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4383549a-7506-47f0-a27c-28f895a07731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.590170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4383549a-7506-47f0-a27c-28f895a07731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.591958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4383549a-7506-47f0-a27c-28f895a07731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:39.594921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4383549a-7506-47f0-a27c-28f895a07731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:39.595768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4383549a-7506-47f0-a27c-28f895a07731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:39.942826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4383549a-7506-47f0-a27c-28f895a07731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:39.952427 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4383549a-7506-47f0-a27c-28f895a07731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.403148 Aug 27 02:42:39.958473 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1211/2693] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:39 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:39.983556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a8c14bc-4f42-4a2a-a26a-5b2a53d64ddf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:39.983965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a8c14bc-4f42-4a2a-a26a-5b2a53d64ddf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:40.024041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8c14bc-4f42-4a2a-a26a-5b2a53d64ddf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:40.024933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8c14bc-4f42-4a2a-a26a-5b2a53d64ddf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:40.025578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8c14bc-4f42-4a2a-a26a-5b2a53d64ddf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:40.026549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8c14bc-4f42-4a2a-a26a-5b2a53d64ddf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:40.028086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8c14bc-4f42-4a2a-a26a-5b2a53d64ddf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:40.031599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8c14bc-4f42-4a2a-a26a-5b2a53d64ddf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:40.107665 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c9bef72d-4b0f-4997-a980-4b04b85edf44 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "POST /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/action" status: 202 len: 0 microversion: 2.20 time: 0.700757 Aug 27 02:42:40.109136 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1483/2694] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:42:39 2022] POST /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/action => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:42:40.120497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61cf3f0b-c692-4758-9ac1-4cfbc8a635c8 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2940c670>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:40.215998 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61cf3f0b-c692-4758-9ac1-4cfbc8a635c8 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1431 microversion: 2.1 time: 0.102856 Aug 27 02:42:40.218022 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1484/2695] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:40 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1431 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:40.223713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:40.224713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:40.237638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:40.238759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:40.239986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:40.241490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:40.242309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:40.243305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:40.250859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a8c14bc-4f42-4a2a-a26a-5b2a53d64ddf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:40.261235 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a8c14bc-4f42-4a2a-a26a-5b2a53d64ddf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1273 microversion: 2.1 time: 0.293842 Aug 27 02:42:40.278856 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1212/2696] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:39 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1273 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:40.295387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a7eee252-9b75-47e9-b1f5-1a17e67291ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2e708ca0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:40.378721 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a7eee252-9b75-47e9-b1f5-1a17e67291ac tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 200 len: 1431 microversion: 2.1 time: 0.098541 Aug 27 02:42:40.380033 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1213/2697] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:40 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 1431 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:40.400600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ad7988c-b92a-4f39-9a8d-29aadd90a4cf tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:40.403009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9ad7988c-b92a-4f39-9a8d-29aadd90a4cf tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:40.435950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ad7988c-b92a-4f39-9a8d-29aadd90a4cf tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:40.436460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ad7988c-b92a-4f39-9a8d-29aadd90a4cf tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:40.436905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ad7988c-b92a-4f39-9a8d-29aadd90a4cf tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:40.444375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ad7988c-b92a-4f39-9a8d-29aadd90a4cf tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:40.445692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ad7988c-b92a-4f39-9a8d-29aadd90a4cf tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:40.446260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ad7988c-b92a-4f39-9a8d-29aadd90a4cf tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:40.596293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:40.629534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:40.634701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:40.638183 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab3dcbb4-bf2a-4ec9-b0eb-cbadd6f5746d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1722 microversion: 2.20 time: 0.418295 Aug 27 02:42:40.640067 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1485/2698] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:40 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1722 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:40.988398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9ad7988c-b92a-4f39-9a8d-29aadd90a4cf tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:40.988962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74f771db-259f-4d0f-a9fd-b33d1e24bc8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:40.993864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-74f771db-259f-4d0f-a9fd-b33d1e24bc8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:41.030089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74f771db-259f-4d0f-a9fd-b33d1e24bc8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.035305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74f771db-259f-4d0f-a9fd-b33d1e24bc8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.035638 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9ad7988c-b92a-4f39-9a8d-29aadd90a4cf tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1466 microversion: 2.1 time: 0.645591 Aug 27 02:42:41.045762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74f771db-259f-4d0f-a9fd-b33d1e24bc8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.045762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74f771db-259f-4d0f-a9fd-b33d1e24bc8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.045762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74f771db-259f-4d0f-a9fd-b33d1e24bc8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.045762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74f771db-259f-4d0f-a9fd-b33d1e24bc8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.046621 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1214/2699] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:40 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1466 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:41.063610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2f10e47f-42e2-4bd6-9a1e-b716f2843fe0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29d69040>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:41.184754 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2f10e47f-42e2-4bd6-9a1e-b716f2843fe0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/6230fa40-aadc-49b6-823d-ddde81ab4f89" status: 200 len: 784 microversion: 2.1 time: 0.122147 Aug 27 02:42:41.186666 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1215/2700] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:41 2022] GET /compute/v2.1/images/6230fa40-aadc-49b6-823d-ddde81ab4f89 => generated 784 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:42:41.214947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-70f8a647-fca3-4121-bd06-709205257183 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:41.237117 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-70f8a647-fca3-4121-bd06-709205257183 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030171 Aug 27 02:42:41.243598 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1216/2701] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:42:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:41.258788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb668e57-896e-40f1-a7f5-d24820fffffe tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29b1a040>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:41.396166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-74f771db-259f-4d0f-a9fd-b33d1e24bc8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:41.406859 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-74f771db-259f-4d0f-a9fd-b33d1e24bc8c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.426555 Aug 27 02:42:41.408275 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1486/2702] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:40 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:41.434525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b55a45fe-ead9-4841-ad9f-c8f73f8dabbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:41.435307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b55a45fe-ead9-4841-ad9f-c8f73f8dabbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:41.444512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b55a45fe-ead9-4841-ad9f-c8f73f8dabbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.445703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b55a45fe-ead9-4841-ad9f-c8f73f8dabbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.446420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b55a45fe-ead9-4841-ad9f-c8f73f8dabbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.447600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b55a45fe-ead9-4841-ad9f-c8f73f8dabbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.448338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b55a45fe-ead9-4841-ad9f-c8f73f8dabbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.449137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b55a45fe-ead9-4841-ad9f-c8f73f8dabbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.659452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b55a45fe-ead9-4841-ad9f-c8f73f8dabbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:41.671431 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b55a45fe-ead9-4841-ad9f-c8f73f8dabbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1315 microversion: 2.1 time: 0.261686 Aug 27 02:42:41.675551 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1487/2703] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:41 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:41.693325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:41.694425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:41.708229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.709037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.710547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.711659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:41.712441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:41.713455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:41.964293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:41.999039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:42.000559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:42.001946 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7851dbca-15ea-4714-a6c3-55e7b61c8b5b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1722 microversion: 2.20 time: 0.318774 Aug 27 02:42:42.002856 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1488/2704] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:41 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:42.356139 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb668e57-896e-40f1-a7f5-d24820fffffe tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "DELETE /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 204 len: 0 microversion: 2.1 time: 1.101003 Aug 27 02:42:42.357779 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1217/2705] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:41 2022] DELETE /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 0 bytes in 1104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:42:42.367978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aefd98f5-2cdc-4b74-a36c-7a7d389296bc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2a1c03a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:42.406730 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-aefd98f5-2cdc-4b74-a36c-7a7d389296bc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] HTTP exception thrown: Image not found. Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aefd98f5-2cdc-4b74-a36c-7a7d389296bc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Request method failure captured: Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d HTTP/1.1 Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYRxstDwOpvRF0vwXp5jTN7kt-1AN7XwGblEddrd_I4fTkIcDzyml9E6rK30WkqmPUkM-wXofxd2yPCltp3R16b-KrRoKvwQTSaL5vFYk8GevafMywe9CoKhG5XvN3Y3_zx4WakxuZFwcrvZveu3ydkLXw1XVWKtjphzEgSosqkwz8Q Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: f791aca5ebbf40e98bc6538ab86e95da Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesOneServerTestJSON-105323499 Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f791aca5ebbf40e98bc6538ab86e95da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f791aca5ebbf40e98bc6538ab86e95da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f791aca5ebbf40e98bc6538ab86e95da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f791aca5ebbf40e98bc6538ab86e95da"}]}] Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesOneServerTestJSON-105323499 Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: f791aca5ebbf40e98bc6538ab86e95da Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-105323499 Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesOneServerTestJSON-105323499-project Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: aeb7891a621941f88c8db1f2a5135c23 Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesOneServerTestJSON-105323499-project Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d'} Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:42:42.412713 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d could not be found. Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:42:42.422099 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:42:42.434049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aefd98f5-2cdc-4b74-a36c-7a7d389296bc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:42:42.434049 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aefd98f5-2cdc-4b74-a36c-7a7d389296bc tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 404 len: 62 microversion: 2.1 time: 0.071050 Aug 27 02:42:42.451186 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1489/2706] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:42 2022] GET /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:42:42.464136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-692909b2-842c-42de-b9e6-cd953efb737f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:42.466731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-692909b2-842c-42de-b9e6-cd953efb737f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:42.483168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692909b2-842c-42de-b9e6-cd953efb737f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:42.484418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692909b2-842c-42de-b9e6-cd953efb737f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:42.485434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692909b2-842c-42de-b9e6-cd953efb737f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:42.486981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692909b2-842c-42de-b9e6-cd953efb737f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:42.488068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692909b2-842c-42de-b9e6-cd953efb737f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:42.489044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-692909b2-842c-42de-b9e6-cd953efb737f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:42.830340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-692909b2-842c-42de-b9e6-cd953efb737f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:42.839471 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-692909b2-842c-42de-b9e6-cd953efb737f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.386306 Aug 27 02:42:42.840461 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1490/2707] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:42 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:42.857170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5c9d3ca-65ff-47dc-81a2-eefc1127329a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1771915968"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:42.861066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e5c9d3ca-65ff-47dc-81a2-eefc1127329a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:42.878832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5c9d3ca-65ff-47dc-81a2-eefc1127329a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:42.880069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5c9d3ca-65ff-47dc-81a2-eefc1127329a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:42.880696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5c9d3ca-65ff-47dc-81a2-eefc1127329a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:42.881618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5c9d3ca-65ff-47dc-81a2-eefc1127329a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:42.887428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5c9d3ca-65ff-47dc-81a2-eefc1127329a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:42.890648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5c9d3ca-65ff-47dc-81a2-eefc1127329a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:42.918483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0ac9cf6f-1141-48aa-83fb-84b76458bee6 req-6218d4de-3539-4342-a692-c73d9e687a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a34ed4c2-b127-4bef-a152-eb401414f9a9", "tag": "81442ca5-b287-4fa9-83b3-9bd314e98190"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:42.959176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0ac9cf6f-1141-48aa-83fb-84b76458bee6 req-6218d4de-3539-4342-a692-c73d9e687a1e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:42.959668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0ac9cf6f-1141-48aa-83fb-84b76458bee6 req-6218d4de-3539-4342-a692-c73d9e687a1e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:42.960116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0ac9cf6f-1141-48aa-83fb-84b76458bee6 req-6218d4de-3539-4342-a692-c73d9e687a1e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:42.980078 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0ac9cf6f-1141-48aa-83fb-84b76458bee6 req-6218d4de-3539-4342-a692-c73d9e687a1e service nova] Creating event network-changed:81442ca5-b287-4fa9-83b3-9bd314e98190 for instance a34ed4c2-b127-4bef-a152-eb401414f9a9 on n-h1-852084-5 Aug 27 02:42:42.992606 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0ac9cf6f-1141-48aa-83fb-84b76458bee6 req-6218d4de-3539-4342-a692-c73d9e687a1e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.595181 Aug 27 02:42:42.993232 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1218/2708] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:42:42.998827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e16c9b18-a8ff-4fbd-8861-50b20f555be4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:42.999563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e16c9b18-a8ff-4fbd-8861-50b20f555be4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:43.024877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e16c9b18-a8ff-4fbd-8861-50b20f555be4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.027245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e16c9b18-a8ff-4fbd-8861-50b20f555be4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.028932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e16c9b18-a8ff-4fbd-8861-50b20f555be4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.030795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e16c9b18-a8ff-4fbd-8861-50b20f555be4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.032137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e16c9b18-a8ff-4fbd-8861-50b20f555be4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.033352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e16c9b18-a8ff-4fbd-8861-50b20f555be4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.268809 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e5c9d3ca-65ff-47dc-81a2-eefc1127329a tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "POST /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d/action" status: 202 len: 0 microversion: 2.1 time: 0.426003 Aug 27 02:42:43.282003 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1491/2709] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:42 2022] POST /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:42:43.292169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:43.293562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:43.319605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.321116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.322207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.323896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.325099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.326247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.369256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e16c9b18-a8ff-4fbd-8861-50b20f555be4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:43.385509 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e16c9b18-a8ff-4fbd-8861-50b20f555be4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1315 microversion: 2.1 time: 0.389675 Aug 27 02:42:43.385509 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1219/2710] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:42 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:43.519821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-523340406", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:43.612526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:42:43.630860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:43.641029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:43.643771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:43.645098 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c1ade98e-9873-4639-a969-009cabf2bdc3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1722 microversion: 2.20 time: 0.361326 Aug 27 02:42:43.646247 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1492/2711] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:43 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:43.652143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fa3f870a-c2cf-40d9-ab6b-7cd7b42cdbc2 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2e7cc940>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:43.709202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fa3f870a-c2cf-40d9-ab6b-7cd7b42cdbc2 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11" status: 200 len: 1427 microversion: 2.1 time: 0.061433 Aug 27 02:42:43.710187 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1493/2712] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:43 2022] GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11 => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:43.891591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ca1719c0-b9aa-4a02-aac9-02a6b6a033dd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:43.894408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ca1719c0-b9aa-4a02-aac9-02a6b6a033dd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:43.908611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca1719c0-b9aa-4a02-aac9-02a6b6a033dd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.909613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca1719c0-b9aa-4a02-aac9-02a6b6a033dd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.910372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca1719c0-b9aa-4a02-aac9-02a6b6a033dd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.911704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca1719c0-b9aa-4a02-aac9-02a6b6a033dd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.912543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca1719c0-b9aa-4a02-aac9-02a6b6a033dd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.913352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca1719c0-b9aa-4a02-aac9-02a6b6a033dd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.952004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:42:43.953459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:42:43.954517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:42:43.955366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:42:43.956553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:42:43.974934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.976015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.977482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:43.979119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:43.979932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:43.980636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:44.002460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Getting quotas for project c55251a7822148a8845f898a36865376. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:42:44.010908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Getting quotas for user 71e3477c3fff48ab8f1dc3079bd7453f and project c55251a7822148a8845f898a36865376. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:42:44.029435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:42:44.032901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:42:44.121242 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-328862a5-8939-4f20-b5b0-5e48d2c9de8f tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734446 Aug 27 02:42:44.123506 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1220/2713] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:42:44.172006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ca1719c0-b9aa-4a02-aac9-02a6b6a033dd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:44.192962 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ca1719c0-b9aa-4a02-aac9-02a6b6a033dd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.306632 Aug 27 02:42:44.208526 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1494/2714] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:43 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:44.235798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1966436322", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:44.282585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e897f7f8-1ffb-4481-82e0-b5547340bddb req-51d284e1-9adb-44b6-83fd-d5bb40ae5720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514c8adb-41ea-426e-8a55-aea191d0fd3d", "name": "network-vif-unplugged", "status": "completed", "tag": "330cbd96-d3f2-4d8e-bf9b-22961d787d26"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:44.307150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e897f7f8-1ffb-4481-82e0-b5547340bddb req-51d284e1-9adb-44b6-83fd-d5bb40ae5720 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:44.308576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e897f7f8-1ffb-4481-82e0-b5547340bddb req-51d284e1-9adb-44b6-83fd-d5bb40ae5720 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:44.310438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e897f7f8-1ffb-4481-82e0-b5547340bddb req-51d284e1-9adb-44b6-83fd-d5bb40ae5720 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:44.339349 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e897f7f8-1ffb-4481-82e0-b5547340bddb req-51d284e1-9adb-44b6-83fd-d5bb40ae5720 service nova] Creating event network-vif-unplugged:330cbd96-d3f2-4d8e-bf9b-22961d787d26 for instance 514c8adb-41ea-426e-8a55-aea191d0fd3d on n-h2-852084-5 Aug 27 02:42:44.351758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:42:44.352651 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e897f7f8-1ffb-4481-82e0-b5547340bddb req-51d284e1-9adb-44b6-83fd-d5bb40ae5720 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080081 Aug 27 02:42:44.354445 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1495/2715] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:44.424041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0cc84536-b6c7-42ac-9bb8-8a5400223037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:44.425808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0cc84536-b6c7-42ac-9bb8-8a5400223037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:44.440934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cc84536-b6c7-42ac-9bb8-8a5400223037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:44.442052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cc84536-b6c7-42ac-9bb8-8a5400223037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:44.443156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cc84536-b6c7-42ac-9bb8-8a5400223037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:44.445506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cc84536-b6c7-42ac-9bb8-8a5400223037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:44.446917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cc84536-b6c7-42ac-9bb8-8a5400223037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:44.448048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cc84536-b6c7-42ac-9bb8-8a5400223037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:44.838042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0cc84536-b6c7-42ac-9bb8-8a5400223037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:44.841492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:44.852773 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0cc84536-b6c7-42ac-9bb8-8a5400223037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1315 microversion: 2.1 time: 0.437870 Aug 27 02:42:44.865927 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1496/2716] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:44 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:44.880099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:44.882457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:44.899541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:44.900458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:44.901338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:44.903982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:44.904904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:44.905796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.111613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:45.123992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:45.125581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:45.127530 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c0107fb0-417d-49c5-9201-d11b38a5c3d6 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1722 microversion: 2.20 time: 0.267411 Aug 27 02:42:45.128286 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1497/2717] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:44 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:45.134765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-387243d1-2a1e-4c2b-9d79-45cdebbc8536 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29a63940>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:45.211442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:42:45.212041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:42:45.212315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:42:45.213139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:42:45.214047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:42:45.253614 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-387243d1-2a1e-4c2b-9d79-45cdebbc8536 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11" status: 200 len: 1427 microversion: 2.1 time: 0.124015 Aug 27 02:42:45.254252 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1498/2718] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:45 2022] GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11 => generated 1427 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:45.257929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.258562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.259018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.259943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.260524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.261129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.270901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-62c2e080-8f40-491a-b8d0-d7a10f70d057 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:45.271939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-62c2e080-8f40-491a-b8d0-d7a10f70d057 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:45.286832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c2e080-8f40-491a-b8d0-d7a10f70d057 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.287772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c2e080-8f40-491a-b8d0-d7a10f70d057 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.288233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c2e080-8f40-491a-b8d0-d7a10f70d057 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.289105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c2e080-8f40-491a-b8d0-d7a10f70d057 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.289578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c2e080-8f40-491a-b8d0-d7a10f70d057 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.290049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c2e080-8f40-491a-b8d0-d7a10f70d057 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.290647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Getting quotas for project c55251a7822148a8845f898a36865376. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:42:45.305978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Getting quotas for user 71e3477c3fff48ab8f1dc3079bd7453f and project c55251a7822148a8845f898a36865376. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:42:45.328146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:42:45.331584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:42:45.395604 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2bfb02a7-a971-43c9-8f09-3b4f18266a3e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167807 Aug 27 02:42:45.397036 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1221/2719] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:42:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:42:45.415828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dc6a827e-b3cd-4cf6-bc71-0de0f77419fe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:45.416927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dc6a827e-b3cd-4cf6-bc71-0de0f77419fe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:45.495536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dc6a827e-b3cd-4cf6-bc71-0de0f77419fe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:45.518215 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dc6a827e-b3cd-4cf6-bc71-0de0f77419fe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1214 microversion: 2.1 time: 0.114208 Aug 27 02:42:45.520801 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1222/2720] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:45 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:45.537469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-62c2e080-8f40-491a-b8d0-d7a10f70d057 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:45.554504 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-62c2e080-8f40-491a-b8d0-d7a10f70d057 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.298120 Aug 27 02:42:45.555365 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1499/2721] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:45 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:45.877042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c00bce90-8f23-4e28-b7e7-9518b3d7d2b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:45.878186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c00bce90-8f23-4e28-b7e7-9518b3d7d2b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:45.898259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00bce90-8f23-4e28-b7e7-9518b3d7d2b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.900055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00bce90-8f23-4e28-b7e7-9518b3d7d2b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.900743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00bce90-8f23-4e28-b7e7-9518b3d7d2b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:45.904848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00bce90-8f23-4e28-b7e7-9518b3d7d2b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:45.907123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00bce90-8f23-4e28-b7e7-9518b3d7d2b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:45.912853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00bce90-8f23-4e28-b7e7-9518b3d7d2b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.124196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-06b34d33-c9e6-46d9-9672-6e20b0043606 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:46.139664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-06b34d33-c9e6-46d9-9672-6e20b0043606 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:46.170858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:46.178115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06b34d33-c9e6-46d9-9672-6e20b0043606 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.180629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06b34d33-c9e6-46d9-9672-6e20b0043606 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.181914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06b34d33-c9e6-46d9-9672-6e20b0043606 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.183354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06b34d33-c9e6-46d9-9672-6e20b0043606 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.187733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06b34d33-c9e6-46d9-9672-6e20b0043606 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.191623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06b34d33-c9e6-46d9-9672-6e20b0043606 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.261903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-06b34d33-c9e6-46d9-9672-6e20b0043606 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lazy-loading 'flavor' on Instance uuid 875762f1-6b75-4c91-859b-76fb857ecb26 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:42:46.319094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:46.336409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c00bce90-8f23-4e28-b7e7-9518b3d7d2b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:46.348029 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c00bce90-8f23-4e28-b7e7-9518b3d7d2b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1315 microversion: 2.1 time: 0.476458 Aug 27 02:42:46.350403 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1223/2722] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:45 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:46.372801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.373726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:46.397189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.398593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.399217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.400128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.400760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.401351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.593518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:46.609199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:46.611558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:46.613402 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2962e126-47ac-4d97-9a99-addc7280215b tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1722 microversion: 2.20 time: 0.248217 Aug 27 02:42:46.614289 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1224/2723] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:46 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:46.620880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3f4cd85a-782f-43f6-bd70-219685ec558b tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29dc9ee0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.624269 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-06b34d33-c9e6-46d9-9672-6e20b0043606 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/action" status: 200 len: 32 microversion: 2.1 time: 0.505835 Aug 27 02:42:46.625979 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1500/2724] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:46 2022] POST /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/action => generated 32 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:42:46.658526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7c4ae8ae-a7fb-42a8-9c5b-abf41fa0a555 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.665008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7c4ae8ae-a7fb-42a8-9c5b-abf41fa0a555 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:46.696399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c4ae8ae-a7fb-42a8-9c5b-abf41fa0a555 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.699110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c4ae8ae-a7fb-42a8-9c5b-abf41fa0a555 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.699955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c4ae8ae-a7fb-42a8-9c5b-abf41fa0a555 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.711182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c4ae8ae-a7fb-42a8-9c5b-abf41fa0a555 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.712313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c4ae8ae-a7fb-42a8-9c5b-abf41fa0a555 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.716922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c4ae8ae-a7fb-42a8-9c5b-abf41fa0a555 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.730735 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3f4cd85a-782f-43f6-bd70-219685ec558b tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11" status: 200 len: 1427 microversion: 2.1 time: 0.114673 Aug 27 02:42:46.733355 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1225/2725] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:46 2022] GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11 => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:46.747877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65f7f427-35ad-4bb9-83cc-1fd18623ec62 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:46.754720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65f7f427-35ad-4bb9-83cc-1fd18623ec62 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:46.778166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f7f427-35ad-4bb9-83cc-1fd18623ec62 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.782300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f7f427-35ad-4bb9-83cc-1fd18623ec62 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.785133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f7f427-35ad-4bb9-83cc-1fd18623ec62 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.790525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f7f427-35ad-4bb9-83cc-1fd18623ec62 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:46.791761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f7f427-35ad-4bb9-83cc-1fd18623ec62 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:46.794087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f7f427-35ad-4bb9-83cc-1fd18623ec62 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:46.959611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7c4ae8ae-a7fb-42a8-9c5b-abf41fa0a555 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:46.990356 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7c4ae8ae-a7fb-42a8-9c5b-abf41fa0a555 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1218 microversion: 2.1 time: 0.356848 Aug 27 02:42:47.022189 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1501/2726] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:46 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1218 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:47.041106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d324db46-81d7-46e9-bed8-29ddbb39bce7 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:47.047041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d324db46-81d7-46e9-bed8-29ddbb39bce7 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:47.070181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d324db46-81d7-46e9-bed8-29ddbb39bce7 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.070791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d324db46-81d7-46e9-bed8-29ddbb39bce7 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.071256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d324db46-81d7-46e9-bed8-29ddbb39bce7 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.072184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d324db46-81d7-46e9-bed8-29ddbb39bce7 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.072800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d324db46-81d7-46e9-bed8-29ddbb39bce7 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.073502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d324db46-81d7-46e9-bed8-29ddbb39bce7 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.370179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-65f7f427-35ad-4bb9-83cc-1fd18623ec62 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:47.386384 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65f7f427-35ad-4bb9-83cc-1fd18623ec62 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1499 microversion: 2.1 time: 0.650832 Aug 27 02:42:47.388271 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1226/2727] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:46 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1499 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:47.396865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-64cc4508-30df-4ccf-8347-5dd50a6239eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:47.397597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-64cc4508-30df-4ccf-8347-5dd50a6239eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:47.411526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64cc4508-30df-4ccf-8347-5dd50a6239eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.412044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64cc4508-30df-4ccf-8347-5dd50a6239eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.412502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64cc4508-30df-4ccf-8347-5dd50a6239eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.418325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64cc4508-30df-4ccf-8347-5dd50a6239eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.419147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64cc4508-30df-4ccf-8347-5dd50a6239eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:47.419784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64cc4508-30df-4ccf-8347-5dd50a6239eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:47.535071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:47.913991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d324db46-81d7-46e9-bed8-29ddbb39bce7 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:47.931453 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d324db46-81d7-46e9-bed8-29ddbb39bce7 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1734 microversion: 2.1 time: 0.907578 Aug 27 02:42:47.951806 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1502/2728] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:47 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1734 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:47.961788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:47.966452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:47.987823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:47.988957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.002418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.009404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.013197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.014251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.208584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-64cc4508-30df-4ccf-8347-5dd50a6239eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:48.232536 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-64cc4508-30df-4ccf-8347-5dd50a6239eb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1315 microversion: 2.1 time: 0.842499 Aug 27 02:42:48.234820 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1227/2729] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:47 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:48.255551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b99c749e-141c-4ecc-93f2-87e1de6539fa tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29b30700>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:48.373978 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b99c749e-141c-4ecc-93f2-87e1de6539fa tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11" status: 200 len: 1427 microversion: 2.1 time: 0.136819 Aug 27 02:42:48.381014 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1228/2730] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:48 2022] GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11 => generated 1427 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:48.394266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f66d2165-e856-4b7b-88c7-cb23a5ec81e3 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:48.414961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f66d2165-e856-4b7b-88c7-cb23a5ec81e3 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:48.424661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:48.444492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f66d2165-e856-4b7b-88c7-cb23a5ec81e3 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.447118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:48.447664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f66d2165-e856-4b7b-88c7-cb23a5ec81e3 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.457124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f66d2165-e856-4b7b-88c7-cb23a5ec81e3 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.457418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:48.466079 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b5f26fd9-da61-4146-b26a-c2af5d4031ef tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1722 microversion: 2.20 time: 0.506239 Aug 27 02:42:48.467310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f66d2165-e856-4b7b-88c7-cb23a5ec81e3 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.468172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f66d2165-e856-4b7b-88c7-cb23a5ec81e3 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.468968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f66d2165-e856-4b7b-88c7-cb23a5ec81e3 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.470517 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1503/2731] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:47 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1722 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:48.491205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-62763b1b-192d-47bb-be7f-ba38e0b8afae tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:48.497005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-62763b1b-192d-47bb-be7f-ba38e0b8afae tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:48.512539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62763b1b-192d-47bb-be7f-ba38e0b8afae tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.513454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62763b1b-192d-47bb-be7f-ba38e0b8afae tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.514258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62763b1b-192d-47bb-be7f-ba38e0b8afae tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.515564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62763b1b-192d-47bb-be7f-ba38e0b8afae tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.516409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62763b1b-192d-47bb-be7f-ba38e0b8afae tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.517188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62763b1b-192d-47bb-be7f-ba38e0b8afae tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.555065 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f66d2165-e856-4b7b-88c7-cb23a5ec81e3 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.171881 Aug 27 02:42:48.555677 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1229/2732] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:42:48 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-volume_attachments => generated 25 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:42:48.566066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a4e91997-28e1-4738-af84-0248e32c0270 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:48.567104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a4e91997-28e1-4738-af84-0248e32c0270 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:48.583119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e91997-28e1-4738-af84-0248e32c0270 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.584103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e91997-28e1-4738-af84-0248e32c0270 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.585044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e91997-28e1-4738-af84-0248e32c0270 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.587483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e91997-28e1-4738-af84-0248e32c0270 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.588659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e91997-28e1-4738-af84-0248e32c0270 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.589787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e91997-28e1-4738-af84-0248e32c0270 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.714273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-62763b1b-192d-47bb-be7f-ba38e0b8afae tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:48.744643 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-62763b1b-192d-47bb-be7f-ba38e0b8afae tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1266 microversion: 2.1 time: 0.267640 Aug 27 02:42:48.750323 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1504/2733] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:48 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:48.771032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1ec1fdb8-92e7-42f9-af63-24798bb58e86 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:48.775893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1ec1fdb8-92e7-42f9-af63-24798bb58e86 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:48.793066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ec1fdb8-92e7-42f9-af63-24798bb58e86 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.794659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ec1fdb8-92e7-42f9-af63-24798bb58e86 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.796210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ec1fdb8-92e7-42f9-af63-24798bb58e86 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.798363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ec1fdb8-92e7-42f9-af63-24798bb58e86 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:48.800092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ec1fdb8-92e7-42f9-af63-24798bb58e86 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:48.801974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ec1fdb8-92e7-42f9-af63-24798bb58e86 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:48.904288 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1ec1fdb8-92e7-42f9-af63-24798bb58e86 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151864 Aug 27 02:42:48.911412 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1505/2734] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:42:48 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:42:48.972838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c10bbc0c-5b50-40fe-8e33-8494f1cc202c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:48.976430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c10bbc0c-5b50-40fe-8e33-8494f1cc202c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:49.003061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10bbc0c-5b50-40fe-8e33-8494f1cc202c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.008179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10bbc0c-5b50-40fe-8e33-8494f1cc202c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.011698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10bbc0c-5b50-40fe-8e33-8494f1cc202c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.015216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10bbc0c-5b50-40fe-8e33-8494f1cc202c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.016474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10bbc0c-5b50-40fe-8e33-8494f1cc202c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.018564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10bbc0c-5b50-40fe-8e33-8494f1cc202c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.362236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a4e91997-28e1-4738-af84-0248e32c0270 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:49.403475 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a4e91997-28e1-4738-af84-0248e32c0270 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 200 len: 1476 microversion: 2.1 time: 0.846102 Aug 27 02:42:49.418432 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1230/2735] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:48 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 1476 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:49.434592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aed71fe2-1175-44f4-8196-6b598f9ffdcf tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:49.436312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aed71fe2-1175-44f4-8196-6b598f9ffdcf tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:49.467300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed71fe2-1175-44f4-8196-6b598f9ffdcf tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.478950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed71fe2-1175-44f4-8196-6b598f9ffdcf tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.482132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed71fe2-1175-44f4-8196-6b598f9ffdcf tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.485208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed71fe2-1175-44f4-8196-6b598f9ffdcf tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.486405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed71fe2-1175-44f4-8196-6b598f9ffdcf tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.489002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed71fe2-1175-44f4-8196-6b598f9ffdcf tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.570896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c10bbc0c-5b50-40fe-8e33-8494f1cc202c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:49.617738 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c10bbc0c-5b50-40fe-8e33-8494f1cc202c tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1734 microversion: 2.1 time: 0.648949 Aug 27 02:42:49.623062 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1506/2736] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:48 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1734 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:42:49.630966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aed71fe2-1175-44f4-8196-6b598f9ffdcf tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:42:49.641960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc3c0d46-45b2-462a-9769-a90ca5bbdbb7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:49.643570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fc3c0d46-45b2-462a-9769-a90ca5bbdbb7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:49.672018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc3c0d46-45b2-462a-9769-a90ca5bbdbb7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.673452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc3c0d46-45b2-462a-9769-a90ca5bbdbb7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.674646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc3c0d46-45b2-462a-9769-a90ca5bbdbb7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.676169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc3c0d46-45b2-462a-9769-a90ca5bbdbb7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:49.677245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc3c0d46-45b2-462a-9769-a90ca5bbdbb7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:49.678757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc3c0d46-45b2-462a-9769-a90ca5bbdbb7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:49.917575 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aed71fe2-1175-44f4-8196-6b598f9ffdcf tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "DELETE /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 204 len: 0 microversion: 2.1 time: 0.497140 Aug 27 02:42:49.922618 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1231/2737] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:42:49 2022] DELETE /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:42:49.929925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-446dd30e-3b6a-4285-81ea-fa6efecb1b61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29d29940>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:50.003445 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-446dd30e-3b6a-4285-81ea-fa6efecb1b61 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11" status: 200 len: 1427 microversion: 2.1 time: 0.078709 Aug 27 02:42:50.004666 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1232/2738] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:49 2022] GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11 => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:50.010735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-531ea4c7-7f2a-499c-a18d-3181e0a3ddda tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1395429660"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:50.014133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-531ea4c7-7f2a-499c-a18d-3181e0a3ddda tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:50.022090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-531ea4c7-7f2a-499c-a18d-3181e0a3ddda tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.023795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-531ea4c7-7f2a-499c-a18d-3181e0a3ddda tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.024419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-531ea4c7-7f2a-499c-a18d-3181e0a3ddda tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:50.025349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-531ea4c7-7f2a-499c-a18d-3181e0a3ddda tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.025938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-531ea4c7-7f2a-499c-a18d-3181e0a3ddda tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.026485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-531ea4c7-7f2a-499c-a18d-3181e0a3ddda tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:50.095878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fc3c0d46-45b2-462a-9769-a90ca5bbdbb7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:50.120204 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fc3c0d46-45b2-462a-9769-a90ca5bbdbb7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1315 microversion: 2.1 time: 0.492282 Aug 27 02:42:50.123327 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1507/2739] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:49 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:50.140100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:50.141129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:50.155560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.156421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.157525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:50.166748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.177968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.179508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:50.802935 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-531ea4c7-7f2a-499c-a18d-3181e0a3ddda tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "POST /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71/action" status: 202 len: 0 microversion: 2.1 time: 0.796360 Aug 27 02:42:50.820299 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1233/2740] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:42:50 2022] POST /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71/action => generated 0 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:42:50.857000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7d129a5c-b154-4a4f-a0ab-1c4088cd1d0d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:50.865193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7d129a5c-b154-4a4f-a0ab-1c4088cd1d0d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:50.892482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d129a5c-b154-4a4f-a0ab-1c4088cd1d0d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.896336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d129a5c-b154-4a4f-a0ab-1c4088cd1d0d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.912900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d129a5c-b154-4a4f-a0ab-1c4088cd1d0d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:50.918673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d129a5c-b154-4a4f-a0ab-1c4088cd1d0d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:50.926954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d129a5c-b154-4a4f-a0ab-1c4088cd1d0d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:50.930617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d129a5c-b154-4a4f-a0ab-1c4088cd1d0d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:50.990912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:51.011620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:51.016225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:51.019018 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c8ab131a-3356-4228-be46-d0bc5c00a5fd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1722 microversion: 2.20 time: 0.894228 Aug 27 02:42:51.035137 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1508/2741] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:50 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1722 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:51.073100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-41868918-75de-4cca-ac61-3f886fa08479 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:51.080952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-41868918-75de-4cca-ac61-3f886fa08479 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:51.096836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41868918-75de-4cca-ac61-3f886fa08479 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.099607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41868918-75de-4cca-ac61-3f886fa08479 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.102493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41868918-75de-4cca-ac61-3f886fa08479 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.104388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41868918-75de-4cca-ac61-3f886fa08479 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.105519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41868918-75de-4cca-ac61-3f886fa08479 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.106886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41868918-75de-4cca-ac61-3f886fa08479 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.231875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7d129a5c-b154-4a4f-a0ab-1c4088cd1d0d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:51.256550 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7d129a5c-b154-4a4f-a0ab-1c4088cd1d0d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1272 microversion: 2.1 time: 0.432415 Aug 27 02:42:51.273724 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1234/2742] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:50 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1272 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:51.297784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eaab3660-165a-4464-ba74-ea51f7fd8236 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:51.309072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eaab3660-165a-4464-ba74-ea51f7fd8236 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:51.359642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaab3660-165a-4464-ba74-ea51f7fd8236 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.360527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaab3660-165a-4464-ba74-ea51f7fd8236 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.361407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaab3660-165a-4464-ba74-ea51f7fd8236 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.367256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaab3660-165a-4464-ba74-ea51f7fd8236 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:51.368345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaab3660-165a-4464-ba74-ea51f7fd8236 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:51.369150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaab3660-165a-4464-ba74-ea51f7fd8236 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:51.728252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-41868918-75de-4cca-ac61-3f886fa08479 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:51.740533 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-41868918-75de-4cca-ac61-3f886fa08479 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1683 microversion: 2.1 time: 0.703198 Aug 27 02:42:51.753896 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1509/2743] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:51 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1683 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:51.789099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c81bc15-fbdb-4aad-a5df-2c0f297ce3d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2949cd30>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:51.932640 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5c81bc15-fbdb-4aad-a5df-2c0f297ce3d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.169293 Aug 27 02:42:51.937635 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1510/2744] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:51 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:51.955614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da030ef1-ff68-4ace-8b5e-f6d379422f20 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29aebf70>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:52.048601 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-da030ef1-ff68-4ace-8b5e-f6d379422f20 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11" status: 200 len: 1427 microversion: 2.1 time: 0.108547 Aug 27 02:42:52.049597 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1511/2745] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:51 2022] GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11 => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:52.061641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4fe505e0-64a8-4709-8194-f7b2ee56e01c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:52.065870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4fe505e0-64a8-4709-8194-f7b2ee56e01c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:52.082003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fe505e0-64a8-4709-8194-f7b2ee56e01c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.083395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fe505e0-64a8-4709-8194-f7b2ee56e01c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.084434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fe505e0-64a8-4709-8194-f7b2ee56e01c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.086102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fe505e0-64a8-4709-8194-f7b2ee56e01c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.087340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fe505e0-64a8-4709-8194-f7b2ee56e01c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.088544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fe505e0-64a8-4709-8194-f7b2ee56e01c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.587589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4fe505e0-64a8-4709-8194-f7b2ee56e01c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:52.613595 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4fe505e0-64a8-4709-8194-f7b2ee56e01c tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1315 microversion: 2.1 time: 0.561955 Aug 27 02:42:52.618459 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1512/2746] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:52 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:52.638350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-0c54602c-58e4-451f-8113-658a5af5d545 req-34cb0627-6932-4724-9b42-2e983ba8e94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34ed4c2-b127-4bef-a152-eb401414f9a9", "name": "network-vif-plugged", "status": "completed", "tag": "81442ca5-b287-4fa9-83b3-9bd314e98190"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:42:52.695290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0c54602c-58e4-451f-8113-658a5af5d545 req-34cb0627-6932-4724-9b42-2e983ba8e94e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.701160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0c54602c-58e4-451f-8113-658a5af5d545 req-34cb0627-6932-4724-9b42-2e983ba8e94e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.703509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0c54602c-58e4-451f-8113-658a5af5d545 req-34cb0627-6932-4724-9b42-2e983ba8e94e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.805475 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-0c54602c-58e4-451f-8113-658a5af5d545 req-34cb0627-6932-4724-9b42-2e983ba8e94e service nova] Creating event network-vif-plugged:81442ca5-b287-4fa9-83b3-9bd314e98190 for instance a34ed4c2-b127-4bef-a152-eb401414f9a9 on n-h1-852084-5 Aug 27 02:42:52.817079 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-0c54602c-58e4-451f-8113-658a5af5d545 req-34cb0627-6932-4724-9b42-2e983ba8e94e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193743 Aug 27 02:42:52.818037 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1513/2747] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:42:52.826373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:52.828693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:52.838062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.838897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.839529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.840453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:52.841098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:52.841740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:52.952532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eaab3660-165a-4464-ba74-ea51f7fd8236 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:53.008852 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eaab3660-165a-4464-ba74-ea51f7fd8236 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1734 microversion: 2.1 time: 1.745126 Aug 27 02:42:53.009747 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1235/2748] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:51 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1734 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:53.045341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-baa77852-c357-4f73-8eec-5f45985ac5dd tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:53.048408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-baa77852-c357-4f73-8eec-5f45985ac5dd tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:53.073857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baa77852-c357-4f73-8eec-5f45985ac5dd tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:53.076959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baa77852-c357-4f73-8eec-5f45985ac5dd tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:53.077871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baa77852-c357-4f73-8eec-5f45985ac5dd tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:53.080069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baa77852-c357-4f73-8eec-5f45985ac5dd tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:53.083628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baa77852-c357-4f73-8eec-5f45985ac5dd tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:53.084647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baa77852-c357-4f73-8eec-5f45985ac5dd tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:53.328470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:53.340415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:53.346355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:53.351219 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-868e9463-f2d4-4844-a89a-e5f48266c0bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1738 microversion: 2.20 time: 0.528685 Aug 27 02:42:53.370318 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1514/2749] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:42:52 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1738 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:42:53.385260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ded3c596-682e-4079-8ae4-64b7c341fd4e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:53.391022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ded3c596-682e-4079-8ae4-64b7c341fd4e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:42:53.409149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ded3c596-682e-4079-8ae4-64b7c341fd4e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:53.411455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ded3c596-682e-4079-8ae4-64b7c341fd4e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:53.412288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ded3c596-682e-4079-8ae4-64b7c341fd4e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:53.414597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ded3c596-682e-4079-8ae4-64b7c341fd4e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:42:53.420087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ded3c596-682e-4079-8ae4-64b7c341fd4e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:42:53.421061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ded3c596-682e-4079-8ae4-64b7c341fd4e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:42:53.983356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ded3c596-682e-4079-8ae4-64b7c341fd4e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9be55cd0921479b874ce0ce799d10a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f77a9603b9be4fcabc47dc5564ea7404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:54.000752 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ded3c596-682e-4079-8ae4-64b7c341fd4e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 200 len: 1683 microversion: 2.1 time: 0.616509 Aug 27 02:42:54.002461 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1515/2750] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:53 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 1683 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:54.019542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2b488a8a-8f75-4814-bca6-b60d1e922e7e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2998f550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:54.794168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-baa77852-c357-4f73-8eec-5f45985ac5dd tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:42:54.839009 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-baa77852-c357-4f73-8eec-5f45985ac5dd tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1314 microversion: 2.1 time: 1.797002 Aug 27 02:42:54.843864 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1236/2751] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:42:53 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1314 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:42:54.865235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ab0f80ec-d34a-44a3-9f75-bc5e91dcf359 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29b1a310>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:42:55.273759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:42:55.501115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=16 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:03.057251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:03.400953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:03.994672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:04.804837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:07.648689 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2b488a8a-8f75-4814-bca6-b60d1e922e7e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 13.643523 Aug 27 02:43:07.664278 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1516/2752] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:54 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 13660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:07.668625 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ab0f80ec-d34a-44a3-9f75-bc5e91dcf359 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11" status: 200 len: 1436 microversion: 2.1 time: 12.822420 Aug 27 02:43:07.679721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0552b3a0-8b50-4981-a230-8fedf8341689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:07.680671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0552b3a0-8b50-4981-a230-8fedf8341689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:07.688778 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1237/2753] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:42:54 2022] GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11 => generated 1436 bytes in 12844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:07.690396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0552b3a0-8b50-4981-a230-8fedf8341689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.691098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0552b3a0-8b50-4981-a230-8fedf8341689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.691713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0552b3a0-8b50-4981-a230-8fedf8341689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.692610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0552b3a0-8b50-4981-a230-8fedf8341689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.693363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0552b3a0-8b50-4981-a230-8fedf8341689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.694026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0552b3a0-8b50-4981-a230-8fedf8341689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.851594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7bf294de-1ad6-480b-abfd-71692dc59e25 req-046127a5-fec8-4225-b99e-2e13a99cdfc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1", "tag": "cc07ffc6-88d4-4347-b44f-52ae8d2126ef"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:07.864623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7bf294de-1ad6-480b-abfd-71692dc59e25 req-046127a5-fec8-4225-b99e-2e13a99cdfc9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.865147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7bf294de-1ad6-480b-abfd-71692dc59e25 req-046127a5-fec8-4225-b99e-2e13a99cdfc9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.866146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7bf294de-1ad6-480b-abfd-71692dc59e25 req-046127a5-fec8-4225-b99e-2e13a99cdfc9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.882021 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7bf294de-1ad6-480b-abfd-71692dc59e25 req-046127a5-fec8-4225-b99e-2e13a99cdfc9 service nova] Creating event network-changed:cc07ffc6-88d4-4347-b44f-52ae8d2126ef for instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 on n-h2-852084-5 Aug 27 02:43:07.888933 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7bf294de-1ad6-480b-abfd-71692dc59e25 req-046127a5-fec8-4225-b99e-2e13a99cdfc9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198409 Aug 27 02:43:07.890177 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1238/2754] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:07.896882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0be99158-8b07-4bcf-8a87-d794b94cca20 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:07.897927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0be99158-8b07-4bcf-8a87-d794b94cca20 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:07.907161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0be99158-8b07-4bcf-8a87-d794b94cca20 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.907954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0be99158-8b07-4bcf-8a87-d794b94cca20 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.908595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0be99158-8b07-4bcf-8a87-d794b94cca20 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.909576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0be99158-8b07-4bcf-8a87-d794b94cca20 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:07.910329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0be99158-8b07-4bcf-8a87-d794b94cca20 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:07.910949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0be99158-8b07-4bcf-8a87-d794b94cca20 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:07.992593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0552b3a0-8b50-4981-a230-8fedf8341689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:08.012985 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0552b3a0-8b50-4981-a230-8fedf8341689 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1501 microversion: 2.1 time: 0.346652 Aug 27 02:43:08.016356 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1517/2755] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:07 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1501 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:08.024995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:08.026380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:08.056464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.062126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:08.062819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.063974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.064688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:08.065344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.333977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:08.353389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:08.355609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:08.357506 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a3bd568c-bc6d-4153-8bdf-d8559f733941 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1738 microversion: 2.20 time: 0.339239 Aug 27 02:43:08.376384 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1518/2756] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:08 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:08.483290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0be99158-8b07-4bcf-8a87-d794b94cca20 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:08.523535 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0be99158-8b07-4bcf-8a87-d794b94cca20 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1734 microversion: 2.1 time: 0.628303 Aug 27 02:43:08.526292 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1239/2757] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:07 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1734 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:08.558516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:08.560064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:08.590122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.592318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:08.597308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.598916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.599793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:08.603284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.615015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7f175fae-2e5d-4fa4-ba11-7e7f069bf699 req-120ba544-f540-444d-b608-06e262ced471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514c8adb-41ea-426e-8a55-aea191d0fd3d", "name": "network-vif-plugged", "status": "completed", "tag": "330cbd96-d3f2-4d8e-bf9b-22961d787d26"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:08.676285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f175fae-2e5d-4fa4-ba11-7e7f069bf699 req-120ba544-f540-444d-b608-06e262ced471 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.677294 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] HTTP exception thrown: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Request method failure captured: Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a HTTP/1.1 Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYPW6aKYVBNzM-YK2J-pMFvXsCP1T3VoBOKIJHsAuX_B271DB9dtwupv0NgJ-xQaPLlMreMGOeacCYhlSQwvRL7F9El-xuLlweA9jDhf5r9P_MwK0hlyp638QpwduxpPd7wVUlryy6BAVY55R42fRYb-ZVOprMn7Z1ixWfnIrSRFFAQ Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: f77a9603b9be4fcabc47dc5564ea7404 Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-7870981 Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f77a9603b9be4fcabc47dc5564ea7404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f77a9603b9be4fcabc47dc5564ea7404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f77a9603b9be4fcabc47dc5564ea7404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f77a9603b9be4fcabc47dc5564ea7404"}]}] Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-7870981 Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: f77a9603b9be4fcabc47dc5564ea7404 Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-7870981 Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachSCSIVolumeTestJSON-7870981-project Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c9be55cd0921479b874ce0ce799d10a0 Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-7870981-project Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '534917a1-8a02-493c-af75-fdef81207a5a'} Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:08.684613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:08.692759 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:08.692759 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:08.692759 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:08.692759 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:08.692759 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:08.692759 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:08.692759 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:08.710225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f175fae-2e5d-4fa4-ba11-7e7f069bf699 req-120ba544-f540-444d-b608-06e262ced471 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:08.710225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f175fae-2e5d-4fa4-ba11-7e7f069bf699 req-120ba544-f540-444d-b608-06e262ced471 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.716962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Returning 404 to user: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:08.719293 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aed158c3-4f03-4739-bb86-6c53097c902e tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 404 len: 111 microversion: 2.1 time: 0.190431 Aug 27 02:43:08.720955 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1240/2758] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:08 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:08.739763 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7f175fae-2e5d-4fa4-ba11-7e7f069bf699 req-120ba544-f540-444d-b608-06e262ced471 service nova] Creating event network-vif-plugged:330cbd96-d3f2-4d8e-bf9b-22961d787d26 for instance 514c8adb-41ea-426e-8a55-aea191d0fd3d on n-h2-852084-5 Aug 27 02:43:08.753898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fa4920a1-b17f-4480-b8ea-c090779e2c3d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:08.755346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fa4920a1-b17f-4480-b8ea-c090779e2c3d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:08.760277 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7f175fae-2e5d-4fa4-ba11-7e7f069bf699 req-120ba544-f540-444d-b608-06e262ced471 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.381701 Aug 27 02:43:08.771034 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1519/2759] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:08.788975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9d63e48b-76b7-42d1-962a-cda6fa23cf04 req-bc2b185c-992c-43c3-bd64-0aedce367996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534917a1-8a02-493c-af75-fdef81207a5a", "name": "network-vif-deleted", "tag": "0f7fcd3c-1acc-47b8-ada7-d2c162f10d89"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:08.808815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa4920a1-b17f-4480-b8ea-c090779e2c3d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.809688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa4920a1-b17f-4480-b8ea-c090779e2c3d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:08.810454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa4920a1-b17f-4480-b8ea-c090779e2c3d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.812291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa4920a1-b17f-4480-b8ea-c090779e2c3d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.813116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa4920a1-b17f-4480-b8ea-c090779e2c3d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:08.813954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa4920a1-b17f-4480-b8ea-c090779e2c3d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.830874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9d63e48b-76b7-42d1-962a-cda6fa23cf04 req-bc2b185c-992c-43c3-bd64-0aedce367996 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:08.832218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9d63e48b-76b7-42d1-962a-cda6fa23cf04 req-bc2b185c-992c-43c3-bd64-0aedce367996 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:08.836147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9d63e48b-76b7-42d1-962a-cda6fa23cf04 req-bc2b185c-992c-43c3-bd64-0aedce367996 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:08.870407 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9d63e48b-76b7-42d1-962a-cda6fa23cf04 req-bc2b185c-992c-43c3-bd64-0aedce367996 service nova] Creating event network-vif-deleted:0f7fcd3c-1acc-47b8-ada7-d2c162f10d89 for instance 534917a1-8a02-493c-af75-fdef81207a5a on n-h2-852084-5 Aug 27 02:43:08.882344 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9d63e48b-76b7-42d1-962a-cda6fa23cf04 req-bc2b185c-992c-43c3-bd64-0aedce367996 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104648 Aug 27 02:43:08.884044 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1520/2760] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:08.898751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4e7c5fac-857c-40ee-aa18-466ef4b00daa tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29a63b80>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:09.360586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fa4920a1-b17f-4480-b8ea-c090779e2c3d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:09.394742 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fa4920a1-b17f-4480-b8ea-c090779e2c3d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1314 microversion: 2.1 time: 0.667734 Aug 27 02:43:09.414568 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1241/2761] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:08 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:09.433919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b3df264d-7a90-474d-8b20-0a83492339f7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:09.435743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b3df264d-7a90-474d-8b20-0a83492339f7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:09.457465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df264d-7a90-474d-8b20-0a83492339f7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.458821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df264d-7a90-474d-8b20-0a83492339f7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.460461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df264d-7a90-474d-8b20-0a83492339f7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.462066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df264d-7a90-474d-8b20-0a83492339f7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:09.463143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df264d-7a90-474d-8b20-0a83492339f7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:09.464273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df264d-7a90-474d-8b20-0a83492339f7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:09.707400 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.network.security_group_api [None req-b3df264d-7a90-474d-8b20-0a83492339f7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Removing security group 2371e54b-d662-48e7-9ff0-04686596a579 from port 81442ca5-b287-4fa9-83b3-9bd314e98190 Aug 27 02:43:09.921291 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4e7c5fac-857c-40ee-aa18-466ef4b00daa tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11" status: 200 len: 1436 microversion: 2.1 time: 1.033832 Aug 27 02:43:09.930921 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1521/2762] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:08 2022] GET /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11 => generated 1436 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:09.936248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6557f6ba-92e3-4c63-9903-9226e3a8fd76 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29aebf70>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:10.014770 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6557f6ba-92e3-4c63-9903-9226e3a8fd76 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.082360 Aug 27 02:43:10.015718 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1522/2763] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:09 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:10.021065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ffa18d3-e5c7-424f-87e2-2e4c4d03c89d tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '.version_select at 0x7f4d29a633a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:10.054369 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ffa18d3-e5c7-424f-87e2-2e4c4d03c89d tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143639217" status: 202 len: 0 microversion: 2.1 time: 0.035997 Aug 27 02:43:10.061254 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1523/2764] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:43:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2143639217 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:10.074601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:10.076519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:10.090165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.091070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.092145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.094294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.095775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.096842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.436279 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b3df264d-7a90-474d-8b20-0a83492339f7 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9/action" status: 202 len: 0 microversion: 2.1 time: 1.019557 Aug 27 02:43:10.437017 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1242/2765] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:43:09 2022] POST /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9/action => generated 0 bytes in 1021 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:10.442742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd64ff62-10a9-46bd-bce7-8bb936225b1b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:10.445360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd64ff62-10a9-46bd-bce7-8bb936225b1b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:10.464813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd64ff62-10a9-46bd-bce7-8bb936225b1b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.468265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd64ff62-10a9-46bd-bce7-8bb936225b1b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.470925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd64ff62-10a9-46bd-bce7-8bb936225b1b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.476407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd64ff62-10a9-46bd-bce7-8bb936225b1b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.477450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd64ff62-10a9-46bd-bce7-8bb936225b1b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.478170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd64ff62-10a9-46bd-bce7-8bb936225b1b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.500620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:10.527703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:10.541599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:10.544322 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4f9d3192-21fb-41b1-9943-e8c9ad04c18f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1738 microversion: 2.20 time: 0.478956 Aug 27 02:43:10.551923 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1524/2766] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:10 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1738 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:10.565151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d5423f6-8ddd-4ea5-ad7f-f6e872202c89 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:10.575360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d5423f6-8ddd-4ea5-ad7f-f6e872202c89 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:10.633191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d5423f6-8ddd-4ea5-ad7f-f6e872202c89 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.636219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d5423f6-8ddd-4ea5-ad7f-f6e872202c89 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.637708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d5423f6-8ddd-4ea5-ad7f-f6e872202c89 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.640397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d5423f6-8ddd-4ea5-ad7f-f6e872202c89 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.641891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d5423f6-8ddd-4ea5-ad7f-f6e872202c89 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.643700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d5423f6-8ddd-4ea5-ad7f-f6e872202c89 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.903282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd64ff62-10a9-46bd-bce7-8bb936225b1b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:10.928725 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd64ff62-10a9-46bd-bce7-8bb936225b1b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1734 microversion: 2.1 time: 0.489881 Aug 27 02:43:10.942627 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1243/2767] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:10 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1734 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:10.967007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-482005bc-dcb7-4d8e-b837-1655f0acf0b4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:10.968583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-482005bc-dcb7-4d8e-b837-1655f0acf0b4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:10.981999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-482005bc-dcb7-4d8e-b837-1655f0acf0b4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.983218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-482005bc-dcb7-4d8e-b837-1655f0acf0b4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.984212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-482005bc-dcb7-4d8e-b837-1655f0acf0b4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.985794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-482005bc-dcb7-4d8e-b837-1655f0acf0b4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:10.987799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-482005bc-dcb7-4d8e-b837-1655f0acf0b4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:10.988863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-482005bc-dcb7-4d8e-b837-1655f0acf0b4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:10.993340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2d5423f6-8ddd-4ea5-ad7f-f6e872202c89 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:11.018257 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2d5423f6-8ddd-4ea5-ad7f-f6e872202c89 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1466 microversion: 2.1 time: 0.457228 Aug 27 02:43:11.020146 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1525/2768] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:10 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1466 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:11.054913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d4007331-ce8c-4bed-a8de-950dd00602b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:11.056796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d4007331-ce8c-4bed-a8de-950dd00602b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:11.085958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4007331-ce8c-4bed-a8de-950dd00602b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.087186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4007331-ce8c-4bed-a8de-950dd00602b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.088295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4007331-ce8c-4bed-a8de-950dd00602b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:11.089850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4007331-ce8c-4bed-a8de-950dd00602b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.090949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4007331-ce8c-4bed-a8de-950dd00602b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.091931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4007331-ce8c-4bed-a8de-950dd00602b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:11.420977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-482005bc-dcb7-4d8e-b837-1655f0acf0b4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:11.463903 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-482005bc-dcb7-4d8e-b837-1655f0acf0b4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1314 microversion: 2.1 time: 0.519186 Aug 27 02:43:11.464951 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1244/2769] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:10 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:11.483437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-22624857-d750-405b-89c1-afb9bf786820 req-768fbd90-abe9-4d01-a057-ea11f2130ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7489a8a-8682-4455-abba-671195effab4", "name": "network-vif-plugged", "status": "completed", "tag": "63f5c4dc-7c22-4bfa-8abc-a93876b795f0"}, {"server_uuid": "b863d40c-1266-4beb-a51e-02d683ffba71", "name": "network-vif-plugged", "status": "completed", "tag": "938a9794-4a8d-4ef4-92ab-23ae622e61c2"}, {"server_uuid": "08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1", "name": "network-vif-plugged", "status": "completed", "tag": "cc07ffc6-88d4-4347-b44f-52ae8d2126ef"}, {"server_uuid": "9dd22e9f-968a-459e-bfcc-45c00c95f797", "name": "network-vif-plugged", "status": "completed", "tag": "5d8f7762-bde9-43e7-ad18-946fc4f2f177"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:11.521769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d4007331-ce8c-4bed-a8de-950dd00602b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:11.536948 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d4007331-ce8c-4bed-a8de-950dd00602b0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1459 microversion: 2.1 time: 0.513578 Aug 27 02:43:11.537237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-22624857-d750-405b-89c1-afb9bf786820 req-768fbd90-abe9-4d01-a057-ea11f2130ca1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.537601 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1526/2770] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:11 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1459 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:11.550331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-22624857-d750-405b-89c1-afb9bf786820 req-768fbd90-abe9-4d01-a057-ea11f2130ca1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.550331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-22624857-d750-405b-89c1-afb9bf786820 req-768fbd90-abe9-4d01-a057-ea11f2130ca1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:11.550735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-148e502f-e365-45e7-a1a0-0f8aaf915232 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29a63af0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:11.612885 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-22624857-d750-405b-89c1-afb9bf786820 req-768fbd90-abe9-4d01-a057-ea11f2130ca1 service nova] Creating event network-vif-plugged:63f5c4dc-7c22-4bfa-8abc-a93876b795f0 for instance a7489a8a-8682-4455-abba-671195effab4 on n-h1-852084-5 Aug 27 02:43:11.613760 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-22624857-d750-405b-89c1-afb9bf786820 req-768fbd90-abe9-4d01-a057-ea11f2130ca1 service nova] Creating event network-vif-plugged:938a9794-4a8d-4ef4-92ab-23ae622e61c2 for instance b863d40c-1266-4beb-a51e-02d683ffba71 on n-h2-852084-5 Aug 27 02:43:11.614563 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-22624857-d750-405b-89c1-afb9bf786820 req-768fbd90-abe9-4d01-a057-ea11f2130ca1 service nova] Creating event network-vif-plugged:cc07ffc6-88d4-4347-b44f-52ae8d2126ef for instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 on n-h2-852084-5 Aug 27 02:43:11.615270 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-22624857-d750-405b-89c1-afb9bf786820 req-768fbd90-abe9-4d01-a057-ea11f2130ca1 service nova] Creating event network-vif-plugged:5d8f7762-bde9-43e7-ad18-946fc4f2f177 for instance 9dd22e9f-968a-459e-bfcc-45c00c95f797 on n-h2-852084-5 Aug 27 02:43:11.647775 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-22624857-d750-405b-89c1-afb9bf786820 req-768fbd90-abe9-4d01-a057-ea11f2130ca1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.179651 Aug 27 02:43:11.650343 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1245/2771] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:11.668059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c1a86ee6-cb81-4b0c-a90c-0b76d9e9cba0 req-46346963-4140-45d3-b7d9-51bbc44db2ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd22e9f-968a-459e-bfcc-45c00c95f797", "tag": "5d8f7762-bde9-43e7-ad18-946fc4f2f177"}, {"name": "network-changed", "server_uuid": "a34ed4c2-b127-4bef-a152-eb401414f9a9", "tag": "81442ca5-b287-4fa9-83b3-9bd314e98190"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:11.702872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c1a86ee6-cb81-4b0c-a90c-0b76d9e9cba0 req-46346963-4140-45d3-b7d9-51bbc44db2ba service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.704205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c1a86ee6-cb81-4b0c-a90c-0b76d9e9cba0 req-46346963-4140-45d3-b7d9-51bbc44db2ba service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.707659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c1a86ee6-cb81-4b0c-a90c-0b76d9e9cba0 req-46346963-4140-45d3-b7d9-51bbc44db2ba service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:11.730062 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-148e502f-e365-45e7-a1a0-0f8aaf915232 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.185098 Aug 27 02:43:11.740330 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1527/2772] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:11 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:11.744666 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c1a86ee6-cb81-4b0c-a90c-0b76d9e9cba0 req-46346963-4140-45d3-b7d9-51bbc44db2ba service nova] Creating event network-changed:5d8f7762-bde9-43e7-ad18-946fc4f2f177 for instance 9dd22e9f-968a-459e-bfcc-45c00c95f797 on n-h2-852084-5 Aug 27 02:43:11.745551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4d15a90c-1a21-4916-9482-864348e1e793 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d2991d0d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:11.746241 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c1a86ee6-cb81-4b0c-a90c-0b76d9e9cba0 req-46346963-4140-45d3-b7d9-51bbc44db2ba service nova] Creating event network-changed:81442ca5-b287-4fa9-83b3-9bd314e98190 for instance a34ed4c2-b127-4bef-a152-eb401414f9a9 on n-h1-852084-5 Aug 27 02:43:11.771426 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c1a86ee6-cb81-4b0c-a90c-0b76d9e9cba0 req-46346963-4140-45d3-b7d9-51bbc44db2ba service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.117203 Aug 27 02:43:11.774313 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1246/2773] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:11.787237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:11.789209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:11.806486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.807835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.810004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:11.812637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:11.813875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:11.814937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:12.547861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:12.569356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:12.571644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:12.573284 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a8d19b02-d9fb-4fc4-9863-d4cee8a61c23 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1720 microversion: 2.20 time: 0.796735 Aug 27 02:43:12.574134 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1247/2774] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:11 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1720 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:12.590432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b40dc16-5f82-48d8-85f2-7bdc7ef0a4ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:12.591502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9b40dc16-5f82-48d8-85f2-7bdc7ef0a4ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:12.604485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b40dc16-5f82-48d8-85f2-7bdc7ef0a4ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:12.606010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b40dc16-5f82-48d8-85f2-7bdc7ef0a4ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:12.606698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b40dc16-5f82-48d8-85f2-7bdc7ef0a4ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:12.608738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b40dc16-5f82-48d8-85f2-7bdc7ef0a4ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:12.609499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b40dc16-5f82-48d8-85f2-7bdc7ef0a4ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:12.610132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b40dc16-5f82-48d8-85f2-7bdc7ef0a4ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:12.939154 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4d15a90c-1a21-4916-9482-864348e1e793 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "DELETE /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11" status: 204 len: 0 microversion: 2.1 time: 1.197489 Aug 27 02:43:12.940150 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1528/2775] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:11 2022] DELETE /compute/v2.1/images/6a97fc1e-1afe-4a2a-a881-ef9bdeb7fb11 => generated 0 bytes in 1199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:12.948469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d15c32bb-6b64-4da5-a849-9fcdb66df4b0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:12.949106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d15c32bb-6b64-4da5-a849-9fcdb66df4b0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:12.958237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c32bb-6b64-4da5-a849-9fcdb66df4b0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:12.959019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c32bb-6b64-4da5-a849-9fcdb66df4b0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:12.959716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c32bb-6b64-4da5-a849-9fcdb66df4b0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:12.961253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c32bb-6b64-4da5-a849-9fcdb66df4b0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:12.962369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c32bb-6b64-4da5-a849-9fcdb66df4b0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:12.963424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c32bb-6b64-4da5-a849-9fcdb66df4b0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:13.092128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9b40dc16-5f82-48d8-85f2-7bdc7ef0a4ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:13.106833 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9b40dc16-5f82-48d8-85f2-7bdc7ef0a4ac tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.528019 Aug 27 02:43:13.108030 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1248/2776] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:12 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:13.121515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3e2a6b0-5056-4f60-83ec-45aa79d737aa tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:13.122873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f3e2a6b0-5056-4f60-83ec-45aa79d737aa tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:13.134938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3e2a6b0-5056-4f60-83ec-45aa79d737aa tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:13.135860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3e2a6b0-5056-4f60-83ec-45aa79d737aa tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:13.138681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3e2a6b0-5056-4f60-83ec-45aa79d737aa tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:13.140179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3e2a6b0-5056-4f60-83ec-45aa79d737aa tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:13.148687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3e2a6b0-5056-4f60-83ec-45aa79d737aa tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:13.149479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3e2a6b0-5056-4f60-83ec-45aa79d737aa tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:13.516058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d15c32bb-6b64-4da5-a849-9fcdb66df4b0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:13.541509 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d15c32bb-6b64-4da5-a849-9fcdb66df4b0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1734 microversion: 2.1 time: 0.599688 Aug 27 02:43:13.547887 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1529/2777] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:12 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1734 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:13.558363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ee661a0-70ea-44c7-84f7-3a453aed5793 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2991d9d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:13.963348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f3e2a6b0-5056-4f60-83ec-45aa79d737aa tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:13.983071 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f3e2a6b0-5056-4f60-83ec-45aa79d737aa tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1314 microversion: 2.1 time: 0.873411 Aug 27 02:43:14.016669 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1249/2778] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:13 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1314 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:14.031229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7db36d0c-a0c0-4342-ab4f-01a182d8cfd0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '.version_select at 0x7f4d29b1a5e0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:14.515180 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-7db36d0c-a0c0-4342-ab4f-01a182d8cfd0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] HTTP exception thrown: Image not found. Aug 27 02:43:14.589765 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ee661a0-70ea-44c7-84f7-3a453aed5793 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 1.033448 Aug 27 02:43:14.602465 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1530/2779] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:13 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:14.623092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cbb1ab99-1128-4c47-8663-e22224a4c6bf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:14.632506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cbb1ab99-1128-4c47-8663-e22224a4c6bf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7db36d0c-a0c0-4342-ab4f-01a182d8cfd0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Request method failure captured: Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d HTTP/1.1 Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYRxstDwOpvRF0vwXp5jTN7kt-1AN7XwGblEddrd_I4fTkIcDzyml9E6rK30WkqmPUkM-wXofxd2yPCltp3R16b-KrRoKvwQTSaL5vFYk8GevafMywe9CoKhG5XvN3Y3_zx4WakxuZFwcrvZveu3ydkLXw1XVWKtjphzEgSosqkwz8Q Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: f791aca5ebbf40e98bc6538ab86e95da Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesOneServerTestJSON-105323499 Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f791aca5ebbf40e98bc6538ab86e95da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f791aca5ebbf40e98bc6538ab86e95da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f791aca5ebbf40e98bc6538ab86e95da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f791aca5ebbf40e98bc6538ab86e95da"}]}] Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesOneServerTestJSON-105323499 Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: f791aca5ebbf40e98bc6538ab86e95da Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-105323499 Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesOneServerTestJSON-105323499-project Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: aeb7891a621941f88c8db1f2a5135c23 Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesOneServerTestJSON-105323499-project Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: exception: Image not found. Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d'} Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d to delete Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d could not be found. Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.639606 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7db36d0c-a0c0-4342-ab4f-01a182d8cfd0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Returning 404 to user: Image not found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7db36d0c-a0c0-4342-ab4f-01a182d8cfd0 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "DELETE /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d" status: 404 len: 62 microversion: 2.1 time: 0.623463 Aug 27 02:43:14.648522 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1250/2780] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:14 2022] DELETE /compute/v2.1/images/5c7b9891-50ad-4b68-bbe2-c4b5bf69af2d => generated 62 bytes in 631 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:43:14.667638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:14.668718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:14.673265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbb1ab99-1128-4c47-8663-e22224a4c6bf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:14.674515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbb1ab99-1128-4c47-8663-e22224a4c6bf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:14.682709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbb1ab99-1128-4c47-8663-e22224a4c6bf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:14.684234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbb1ab99-1128-4c47-8663-e22224a4c6bf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:14.688872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:14.689822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:14.690622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:14.690839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbb1ab99-1128-4c47-8663-e22224a4c6bf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:14.691868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbb1ab99-1128-4c47-8663-e22224a4c6bf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:14.692056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:14.692811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:14.698571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.215586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:15.245052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cbb1ab99-1128-4c47-8663-e22224a4c6bf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:15.268663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:15.279059 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cbb1ab99-1128-4c47-8663-e22224a4c6bf tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.672880 Aug 27 02:43:15.283354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:15.288465 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1531/2781] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:14 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:15.291481 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-348ad38c-a748-466a-8b78-cdfa5eeb2562 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1720 microversion: 2.20 time: 0.641663 Aug 27 02:43:15.299562 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1251/2782] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:14 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1720 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:15.317981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c7ac3446-ab5e-44c4-a3be-0764ae0cc2e9 req-02fd9d6d-0c5e-4173-943a-3554e3306476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514c8adb-41ea-426e-8a55-aea191d0fd3d", "name": "network-vif-unplugged", "status": "completed", "tag": "330cbd96-d3f2-4d8e-bf9b-22961d787d26"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:15.326114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a2a5797f-97a7-494f-a1dc-5cea72948a87 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:15.334851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a2a5797f-97a7-494f-a1dc-5cea72948a87 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:15.350139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2a5797f-97a7-494f-a1dc-5cea72948a87 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.355546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2a5797f-97a7-494f-a1dc-5cea72948a87 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.357978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c7ac3446-ab5e-44c4-a3be-0764ae0cc2e9 req-02fd9d6d-0c5e-4173-943a-3554e3306476 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.358557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2a5797f-97a7-494f-a1dc-5cea72948a87 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.360068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c7ac3446-ab5e-44c4-a3be-0764ae0cc2e9 req-02fd9d6d-0c5e-4173-943a-3554e3306476 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.361148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2a5797f-97a7-494f-a1dc-5cea72948a87 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.361846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c7ac3446-ab5e-44c4-a3be-0764ae0cc2e9 req-02fd9d6d-0c5e-4173-943a-3554e3306476 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.364384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2a5797f-97a7-494f-a1dc-5cea72948a87 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.373712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2a5797f-97a7-494f-a1dc-5cea72948a87 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.411192 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c7ac3446-ab5e-44c4-a3be-0764ae0cc2e9 req-02fd9d6d-0c5e-4173-943a-3554e3306476 service nova] Creating event network-vif-unplugged:330cbd96-d3f2-4d8e-bf9b-22961d787d26 for instance 514c8adb-41ea-426e-8a55-aea191d0fd3d on n-h2-852084-5 Aug 27 02:43:15.426669 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c7ac3446-ab5e-44c4-a3be-0764ae0cc2e9 req-02fd9d6d-0c5e-4173-943a-3554e3306476 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132171 Aug 27 02:43:15.429998 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1532/2783] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:15.444225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8286d069-a1f4-4847-85be-3d7ce6406ed6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:15.447054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8286d069-a1f4-4847-85be-3d7ce6406ed6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:15.461522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8286d069-a1f4-4847-85be-3d7ce6406ed6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.462774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8286d069-a1f4-4847-85be-3d7ce6406ed6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.463799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8286d069-a1f4-4847-85be-3d7ce6406ed6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.465384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8286d069-a1f4-4847-85be-3d7ce6406ed6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.467474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8286d069-a1f4-4847-85be-3d7ce6406ed6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.468673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8286d069-a1f4-4847-85be-3d7ce6406ed6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.508855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8286d069-a1f4-4847-85be-3d7ce6406ed6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:43:15.682220 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8286d069-a1f4-4847-85be-3d7ce6406ed6 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "DELETE /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 204 len: 0 microversion: 2.1 time: 0.248027 Aug 27 02:43:15.683216 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1533/2784] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:43:15 2022] DELETE /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:15.691056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d51c5cea-7739-40e2-ad45-adf702e069b7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:15.710119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d51c5cea-7739-40e2-ad45-adf702e069b7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:15.730529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d51c5cea-7739-40e2-ad45-adf702e069b7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.731721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d51c5cea-7739-40e2-ad45-adf702e069b7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.733377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d51c5cea-7739-40e2-ad45-adf702e069b7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.735240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d51c5cea-7739-40e2-ad45-adf702e069b7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.736581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d51c5cea-7739-40e2-ad45-adf702e069b7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.740040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d51c5cea-7739-40e2-ad45-adf702e069b7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.892973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a2a5797f-97a7-494f-a1dc-5cea72948a87 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:15.916736 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a2a5797f-97a7-494f-a1dc-5cea72948a87 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1734 microversion: 2.1 time: 0.612031 Aug 27 02:43:15.919249 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1252/2785] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:15 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1734 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:15.940325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-038b1f17-d2a9-4979-9de0-8851486bf405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:15.941340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-038b1f17-d2a9-4979-9de0-8851486bf405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:15.949662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-038b1f17-d2a9-4979-9de0-8851486bf405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.950573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-038b1f17-d2a9-4979-9de0-8851486bf405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.951246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-038b1f17-d2a9-4979-9de0-8851486bf405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:15.952230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-038b1f17-d2a9-4979-9de0-8851486bf405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:15.952919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-038b1f17-d2a9-4979-9de0-8851486bf405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:15.953594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-038b1f17-d2a9-4979-9de0-8851486bf405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.127781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d51c5cea-7739-40e2-ad45-adf702e069b7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:16.146000 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d51c5cea-7739-40e2-ad45-adf702e069b7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1463 microversion: 2.1 time: 0.460079 Aug 27 02:43:16.157790 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1534/2786] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:15 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1463 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:16.157790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4e94862-b851-4575-be4b-13d1fe83a620 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e79ab80>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:16.292678 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b4e94862-b851-4575-be4b-13d1fe83a620 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.142755 Aug 27 02:43:16.294113 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1535/2787] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:16 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:16.316399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a60b8e63-2215-41ad-96b9-3eb7aaa59169 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:16.317383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a60b8e63-2215-41ad-96b9-3eb7aaa59169 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:16.333782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60b8e63-2215-41ad-96b9-3eb7aaa59169 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.334690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60b8e63-2215-41ad-96b9-3eb7aaa59169 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.335418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60b8e63-2215-41ad-96b9-3eb7aaa59169 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.336658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60b8e63-2215-41ad-96b9-3eb7aaa59169 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.337468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60b8e63-2215-41ad-96b9-3eb7aaa59169 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.337711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-038b1f17-d2a9-4979-9de0-8851486bf405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:16.338467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a60b8e63-2215-41ad-96b9-3eb7aaa59169 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.355829 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-038b1f17-d2a9-4979-9de0-8851486bf405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.429135 Aug 27 02:43:16.358017 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1253/2788] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:15 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:16.367774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a4387d96-9a42-4ad2-baa7-4bf0c603b219 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:16.369632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a4387d96-9a42-4ad2-baa7-4bf0c603b219 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:16.384440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4387d96-9a42-4ad2-baa7-4bf0c603b219 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.385467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4387d96-9a42-4ad2-baa7-4bf0c603b219 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.386597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4387d96-9a42-4ad2-baa7-4bf0c603b219 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.387998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4387d96-9a42-4ad2-baa7-4bf0c603b219 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.393746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4387d96-9a42-4ad2-baa7-4bf0c603b219 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.394791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4387d96-9a42-4ad2-baa7-4bf0c603b219 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.747069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a60b8e63-2215-41ad-96b9-3eb7aaa59169 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:16.768444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a4387d96-9a42-4ad2-baa7-4bf0c603b219 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:16.780861 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a60b8e63-2215-41ad-96b9-3eb7aaa59169 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1472 microversion: 2.1 time: 0.484589 Aug 27 02:43:16.781243 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a4387d96-9a42-4ad2-baa7-4bf0c603b219 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1463 microversion: 2.1 time: 0.421250 Aug 27 02:43:16.782296 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1254/2789] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:16 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1463 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:16.798614 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1536/2790] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:16 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1472 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:16.811890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:16.811890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:16.820075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-62e8213c-c199-4b40-b432-97712c510886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:16.821753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-62e8213c-c199-4b40-b432-97712c510886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:16.832122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.832769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.833307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.836828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62e8213c-c199-4b40-b432-97712c510886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.839141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.839646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.840100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.841020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62e8213c-c199-4b40-b432-97712c510886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.842502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62e8213c-c199-4b40-b432-97712c510886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:16.844974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62e8213c-c199-4b40-b432-97712c510886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:16.846323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62e8213c-c199-4b40-b432-97712c510886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:16.848310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62e8213c-c199-4b40-b432-97712c510886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:17.172294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:17.184476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:17.186575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:17.188128 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ac3c9863-0eed-461b-9492-f1624a8837dd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1663 microversion: 2.20 time: 0.404832 Aug 27 02:43:17.189277 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1255/2791] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:16 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1663 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:17.198306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2cfa6f41-f8c1-4418-b7fb-a1eda1e6b9e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:17.199233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2cfa6f41-f8c1-4418-b7fb-a1eda1e6b9e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:17.199484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-62e8213c-c199-4b40-b432-97712c510886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:17.207375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cfa6f41-f8c1-4418-b7fb-a1eda1e6b9e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:17.208130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cfa6f41-f8c1-4418-b7fb-a1eda1e6b9e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:17.208746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cfa6f41-f8c1-4418-b7fb-a1eda1e6b9e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:17.210245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cfa6f41-f8c1-4418-b7fb-a1eda1e6b9e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:17.210884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cfa6f41-f8c1-4418-b7fb-a1eda1e6b9e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:17.211485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cfa6f41-f8c1-4418-b7fb-a1eda1e6b9e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:17.232883 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-62e8213c-c199-4b40-b432-97712c510886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.431798 Aug 27 02:43:17.234215 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1537/2792] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:16 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:17.243669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1464749408", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:17.359168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:43:17.635590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2cfa6f41-f8c1-4418-b7fb-a1eda1e6b9e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:17.649973 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2cfa6f41-f8c1-4418-b7fb-a1eda1e6b9e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1734 microversion: 2.1 time: 0.456997 Aug 27 02:43:17.650580 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1256/2793] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:17 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1734 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:17.656515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fbbf7915-882e-4ec7-b5ad-d1fd6ef1e8d0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5413ddfb-522c-45bb-bd6f-2ab2f446b793"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:17.659378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fbbf7915-882e-4ec7-b5ad-d1fd6ef1e8d0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:17.667030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbf7915-882e-4ec7-b5ad-d1fd6ef1e8d0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:17.667535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbf7915-882e-4ec7-b5ad-d1fd6ef1e8d0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:17.667976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbf7915-882e-4ec7-b5ad-d1fd6ef1e8d0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:17.668706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbf7915-882e-4ec7-b5ad-d1fd6ef1e8d0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:17.669171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbf7915-882e-4ec7-b5ad-d1fd6ef1e8d0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:17.669855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbf7915-882e-4ec7-b5ad-d1fd6ef1e8d0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.159833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:18.323484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:43:18.325196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:43:18.326441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:43:18.327481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:43:18.328580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:43:18.370823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.372175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.373277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.375237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.392729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.394049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.491486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Getting quotas for project c55251a7822148a8845f898a36865376. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:18.494981 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fbbf7915-882e-4ec7-b5ad-d1fd6ef1e8d0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "POST /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.842921 Aug 27 02:43:18.506954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Getting quotas for user 71e3477c3fff48ab8f1dc3079bd7453f and project c55251a7822148a8845f898a36865376. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:18.520144 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1257/2794] 10.222.0.99 () {62 vars in 1364 bytes} [Sat Aug 27 02:43:17 2022] POST /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/os-volume_attachments => generated 188 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:43:18.554599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:43:18.558754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-020a488c-2d95-47ca-a8c5-ac1f7d362c77 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e708f70>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:18.567550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:43:18.653602 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-020a488c-2d95-47ca-a8c5-ac1f7d362c77 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.131754 Aug 27 02:43:18.660609 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1258/2795] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:18 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:18.669707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-750846976", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a5df9b9c-03e6-4d14-a511-7974335d0f10"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:18.748031 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b027695d-70da-43f7-9a2c-a060d5bf2062 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.512236 Aug 27 02:43:18.748734 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1538/2796] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:43:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:43:18.762284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a94fd7fc-e481-4b58-9e51-c260e20c62c9 req-fffc0ea7-f1f3-468e-a330-6e4f283aaaff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7489a8a-8682-4455-abba-671195effab4", "name": "network-vif-unplugged", "status": "completed", "tag": "63f5c4dc-7c22-4bfa-8abc-a93876b795f0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:18.800875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a94fd7fc-e481-4b58-9e51-c260e20c62c9 req-fffc0ea7-f1f3-468e-a330-6e4f283aaaff service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.801398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a94fd7fc-e481-4b58-9e51-c260e20c62c9 req-fffc0ea7-f1f3-468e-a330-6e4f283aaaff service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.801884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a94fd7fc-e481-4b58-9e51-c260e20c62c9 req-fffc0ea7-f1f3-468e-a330-6e4f283aaaff service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.809921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] validate_networks() for [('a5df9b9c-03e6-4d14-a511-7974335d0f10', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:43:18.843634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.compute.server_external_events [req-a94fd7fc-e481-4b58-9e51-c260e20c62c9 req-fffc0ea7-f1f3-468e-a330-6e4f283aaaff service nova] Unable to find a host for instance a7489a8a-8682-4455-abba-671195effab4. Dropping event network-vif-unplugged {{(pid=122488) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 02:43:18.848715 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a94fd7fc-e481-4b58-9e51-c260e20c62c9 req-fffc0ea7-f1f3-468e-a330-6e4f283aaaff service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.098849 Aug 27 02:43:18.849702 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1539/2797] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 100 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 02:43:18.856932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-954422c1-53d5-4763-bfe4-7f2d63042ed3 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:18.867678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-954422c1-53d5-4763-bfe4-7f2d63042ed3 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:18.895641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954422c1-53d5-4763-bfe4-7f2d63042ed3 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.896161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954422c1-53d5-4763-bfe4-7f2d63042ed3 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.896652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954422c1-53d5-4763-bfe4-7f2d63042ed3 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:18.905288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954422c1-53d5-4763-bfe4-7f2d63042ed3 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:18.909751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954422c1-53d5-4763-bfe4-7f2d63042ed3 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:18.916160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954422c1-53d5-4763-bfe4-7f2d63042ed3 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.181621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-954422c1-53d5-4763-bfe4-7f2d63042ed3 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:19.193166 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-954422c1-53d5-4763-bfe4-7f2d63042ed3 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1430 microversion: 2.1 time: 0.338950 Aug 27 02:43:19.193810 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1540/2798] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:18 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1430 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:19.205885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d9e938fb-14ad-4baf-8116-296dfa258d8e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:19.206837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d9e938fb-14ad-4baf-8116-296dfa258d8e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:19.220485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9e938fb-14ad-4baf-8116-296dfa258d8e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.222345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9e938fb-14ad-4baf-8116-296dfa258d8e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.223271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9e938fb-14ad-4baf-8116-296dfa258d8e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.235397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9e938fb-14ad-4baf-8116-296dfa258d8e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.236781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9e938fb-14ad-4baf-8116-296dfa258d8e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.237878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9e938fb-14ad-4baf-8116-296dfa258d8e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.863314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:43:19.864321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:43:19.866200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:43:19.867034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:43:19.868317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:43:19.879343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d9e938fb-14ad-4baf-8116-296dfa258d8e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:19.891674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.893104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.895136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.897582 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d9e938fb-14ad-4baf-8116-296dfa258d8e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1734 microversion: 2.1 time: 0.698585 Aug 27 02:43:19.903733 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1541/2799] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:19 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1734 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:19.912711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:19.913596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:19.918141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:19.923334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fba90963-af9d-4892-839f-9edc60e42f05 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:19.924464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fba90963-af9d-4892-839f-9edc60e42f05 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:20.028310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for project 69945a768314456fae9bf75e854510c2. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:20.067918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Getting quotas for user 281834367cf24a809448bdeea36a9c97 and project 69945a768314456fae9bf75e854510c2. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:20.119193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fba90963-af9d-4892-839f-9edc60e42f05 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:20.123295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:43:20.129920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:43:20.131653 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fba90963-af9d-4892-839f-9edc60e42f05 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1214 microversion: 2.1 time: 0.224212 Aug 27 02:43:20.132421 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1542/2800] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:19 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1214 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:20.138798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7ebac4b-7679-4d78-95d2-3b2a0802a41f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:20.139977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d7ebac4b-7679-4d78-95d2-3b2a0802a41f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:20.150492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7ebac4b-7679-4d78-95d2-3b2a0802a41f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.151790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7ebac4b-7679-4d78-95d2-3b2a0802a41f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.152454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7ebac4b-7679-4d78-95d2-3b2a0802a41f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:20.153542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7ebac4b-7679-4d78-95d2-3b2a0802a41f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.154365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7ebac4b-7679-4d78-95d2-3b2a0802a41f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.155248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7ebac4b-7679-4d78-95d2-3b2a0802a41f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:20.162317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:20.358205 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fd37c208-d4fa-47b8-9307-a1d11f52c30f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.695583 Aug 27 02:43:20.367964 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1259/2801] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:43:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:43:20.389400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0f977ba7-d84d-4178-aa1e-47be40d3d714 req-786743a2-de78-4f9e-a91a-e8709a139209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514c8adb-41ea-426e-8a55-aea191d0fd3d", "name": "network-vif-deleted", "tag": "330cbd96-d3f2-4d8e-bf9b-22961d787d26"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:20.457573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0f977ba7-d84d-4178-aa1e-47be40d3d714 req-786743a2-de78-4f9e-a91a-e8709a139209 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.459444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0f977ba7-d84d-4178-aa1e-47be40d3d714 req-786743a2-de78-4f9e-a91a-e8709a139209 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.460541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0f977ba7-d84d-4178-aa1e-47be40d3d714 req-786743a2-de78-4f9e-a91a-e8709a139209 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:20.511993 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0f977ba7-d84d-4178-aa1e-47be40d3d714 req-786743a2-de78-4f9e-a91a-e8709a139209 service nova] Creating event network-vif-deleted:330cbd96-d3f2-4d8e-bf9b-22961d787d26 for instance 514c8adb-41ea-426e-8a55-aea191d0fd3d on n-h2-852084-5 Aug 27 02:43:20.538785 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0f977ba7-d84d-4178-aa1e-47be40d3d714 req-786743a2-de78-4f9e-a91a-e8709a139209 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168677 Aug 27 02:43:20.540739 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1260/2802] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:20.550493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-90994fbe-e201-4347-b825-ee4ea3fa3d8e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29ae13a0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:20.672454 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-90994fbe-e201-4347-b825-ee4ea3fa3d8e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.130103 Aug 27 02:43:20.673036 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1261/2803] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:20 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:20.691373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:20.694918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:20.705103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.705963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.706784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:20.708140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.709473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.710169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:20.814402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:20.815735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:20.816787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:20.817956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lazy-loading 'fault' on Instance uuid 514c8adb-41ea-426e-8a55-aea191d0fd3d {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:43:20.969212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb7891a621941f88c8db1f2a5135c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f791aca5ebbf40e98bc6538ab86e95da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:20.979026 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2a20dfe6-fac9-4bf5-9925-6d3f78f84500 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 200 len: 1307 microversion: 2.1 time: 0.304456 Aug 27 02:43:20.979973 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1262/2804] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:20 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 1307 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:20.987810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cc172680-4e0b-4618-a156-d24d64ef780f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:20.988703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cc172680-4e0b-4618-a156-d24d64ef780f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:21.116319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cc172680-4e0b-4618-a156-d24d64ef780f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:21.130258 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d7ebac4b-7679-4d78-95d2-3b2a0802a41f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/os-volume_attachments/5413ddfb-522c-45bb-bd6f-2ab2f446b793" status: 202 len: 0 microversion: 2.20 time: 0.993569 Aug 27 02:43:21.136247 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1543/2805] 10.222.0.99 () {60 vars in 1457 bytes} [Sat Aug 27 02:43:20 2022] DELETE /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/os-volume_attachments/5413ddfb-522c-45bb-bd6f-2ab2f446b793 => generated 0 bytes in 1003 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:21.156205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9937732f-364b-4a27-b398-794e17753fcd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:21.171505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9937732f-364b-4a27-b398-794e17753fcd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:21.172872 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cc172680-4e0b-4618-a156-d24d64ef780f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1214 microversion: 2.1 time: 0.187650 Aug 27 02:43:21.182665 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1263/2806] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:20 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:21.192525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-294905c6-d043-4294-9e14-1f4fe0684589 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:21.194562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-294905c6-d043-4294-9e14-1f4fe0684589 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:21.219954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-294905c6-d043-4294-9e14-1f4fe0684589 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.220719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-294905c6-d043-4294-9e14-1f4fe0684589 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.223963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-294905c6-d043-4294-9e14-1f4fe0684589 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.227036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9937732f-364b-4a27-b398-794e17753fcd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.228266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9937732f-364b-4a27-b398-794e17753fcd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.229317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9937732f-364b-4a27-b398-794e17753fcd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.230920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9937732f-364b-4a27-b398-794e17753fcd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.232006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9937732f-364b-4a27-b398-794e17753fcd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.232980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9937732f-364b-4a27-b398-794e17753fcd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.252169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-294905c6-d043-4294-9e14-1f4fe0684589 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.252854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-294905c6-d043-4294-9e14-1f4fe0684589 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.263274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-294905c6-d043-4294-9e14-1f4fe0684589 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.440641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-294905c6-d043-4294-9e14-1f4fe0684589 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:21.450291 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-294905c6-d043-4294-9e14-1f4fe0684589 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1266 microversion: 2.1 time: 0.263664 Aug 27 02:43:21.451042 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1264/2807] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:21 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:21.456623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-61604650-cfaf-4f6c-ab79-d00ced706887 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:21.457705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-61604650-cfaf-4f6c-ab79-d00ced706887 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:21.466377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61604650-cfaf-4f6c-ab79-d00ced706887 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.467728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61604650-cfaf-4f6c-ab79-d00ced706887 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.468504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61604650-cfaf-4f6c-ab79-d00ced706887 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.469800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61604650-cfaf-4f6c-ab79-d00ced706887 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.470719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61604650-cfaf-4f6c-ab79-d00ced706887 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.471423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61604650-cfaf-4f6c-ab79-d00ced706887 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.538880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-61604650-cfaf-4f6c-ab79-d00ced706887 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122487) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 02:43:21.586847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9937732f-364b-4a27-b398-794e17753fcd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:21.604471 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9937732f-364b-4a27-b398-794e17753fcd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1734 microversion: 2.1 time: 0.466011 Aug 27 02:43:21.605902 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1544/2808] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:21 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1734 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:21.692033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-add8d50e-c414-499e-a322-21604620dc1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a7e55e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:21.782594 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-61604650-cfaf-4f6c-ab79-d00ced706887 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "POST /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/action" status: 202 len: 0 microversion: 2.20 time: 0.327756 Aug 27 02:43:21.786540 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1265/2809] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:43:21 2022] POST /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:21.808870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:21.811091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:21.811860 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-add8d50e-c414-499e-a322-21604620dc1a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.127717 Aug 27 02:43:21.812427 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1545/2810] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:21 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:21.853547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.856538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.861274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:21.862930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:21.863896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:21.864743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.016588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:22.017532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] [instance: 514c8adb-41ea-426e-8a55-aea191d0fd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:22.027596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.028414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.028865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.029609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.046572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.047051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.103333 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] HTTP exception thrown: Instance 514c8adb-41ea-426e-8a55-aea191d0fd3d could not be found. Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Request method failure captured: Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d HTTP/1.1 Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYRxstDwOpvRF0vwXp5jTN7kt-1AN7XwGblEddrd_I4fTkIcDzyml9E6rK30WkqmPUkM-wXofxd2yPCltp3R16b-KrRoKvwQTSaL5vFYk8GevafMywe9CoKhG5XvN3Y3_zx4WakxuZFwcrvZveu3ydkLXw1XVWKtjphzEgSosqkwz8Q Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: f791aca5ebbf40e98bc6538ab86e95da Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesOneServerTestJSON-105323499 Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f791aca5ebbf40e98bc6538ab86e95da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f791aca5ebbf40e98bc6538ab86e95da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f791aca5ebbf40e98bc6538ab86e95da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f791aca5ebbf40e98bc6538ab86e95da"}]}] Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesOneServerTestJSON-105323499 Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: f791aca5ebbf40e98bc6538ab86e95da Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-105323499 Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesOneServerTestJSON-105323499-project Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: aeb7891a621941f88c8db1f2a5135c23 Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesOneServerTestJSON-105323499-project Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 514c8adb-41ea-426e-8a55-aea191d0fd3d could not be found. Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '514c8adb-41ea-426e-8a55-aea191d0fd3d'} Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514c8adb-41ea-426e-8a55-aea191d0fd3d could not be found. Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514c8adb-41ea-426e-8a55-aea191d0fd3d could not be found. Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:22.110913 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.116112 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:22.116112 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:22.116112 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:22.116112 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:22.116112 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:22.116112 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514c8adb-41ea-426e-8a55-aea191d0fd3d could not be found. Aug 27 02:43:22.116112 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.122510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] Returning 404 to user: Instance 514c8adb-41ea-426e-8a55-aea191d0fd3d could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:22.125958 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b26e54e7-3405-47e9-8e6d-e792c0cf2858 tempest-ImagesOneServerTestJSON-105323499 tempest-ImagesOneServerTestJSON-105323499-project] 10.222.0.99 "GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d" status: 404 len: 111 microversion: 2.1 time: 0.113409 Aug 27 02:43:22.134801 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1546/2811] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:22 2022] GET /compute/v2.1/servers/514c8adb-41ea-426e-8a55-aea191d0fd3d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:22.218500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-90b971b7-a733-4670-818a-59d8d3817fa1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:22.221303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-90b971b7-a733-4670-818a-59d8d3817fa1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:22.234351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b971b7-a733-4670-818a-59d8d3817fa1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.239098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b971b7-a733-4670-818a-59d8d3817fa1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.247628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b971b7-a733-4670-818a-59d8d3817fa1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.253066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b971b7-a733-4670-818a-59d8d3817fa1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.254026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b971b7-a733-4670-818a-59d8d3817fa1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.254834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90b971b7-a733-4670-818a-59d8d3817fa1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.395598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:22.434106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:22.449160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:22.453126 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-68f4e640-7032-41eb-9dbf-c268f309ef30 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1671 microversion: 2.20 time: 0.659090 Aug 27 02:43:22.463493 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1266/2812] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:21 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1671 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:22.473147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:22.492850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:22.541248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.547368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.550904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.554977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.556671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.563450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.664317 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] HTTP exception thrown: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Request method failure captured: Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a HTTP/1.1 Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYPW6aKYVBNzM-YK2J-pMFvXsCP1T3VoBOKIJHsAuX_B271DB9dtwupv0NgJ-xQaPLlMreMGOeacCYhlSQwvRL7F9El-xuLlweA9jDhf5r9P_MwK0hlyp638QpwduxpPd7wVUlryy6BAVY55R42fRYb-ZVOprMn7Z1ixWfnIrSRFFAQ Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: f77a9603b9be4fcabc47dc5564ea7404 Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-7870981 Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f77a9603b9be4fcabc47dc5564ea7404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f77a9603b9be4fcabc47dc5564ea7404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f77a9603b9be4fcabc47dc5564ea7404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f77a9603b9be4fcabc47dc5564ea7404"}]}] Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-7870981 Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: f77a9603b9be4fcabc47dc5564ea7404 Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-7870981 Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachSCSIVolumeTestJSON-7870981-project Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c9be55cd0921479b874ce0ce799d10a0 Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-7870981-project Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '534917a1-8a02-493c-af75-fdef81207a5a'} Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:43:22.689202 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:43:22.694093 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:22.694093 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.694093 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:22.694093 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.694093 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:22.694093 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:22.694093 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:22.694093 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:22.694093 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:22.694093 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:22.694093 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:22.707951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Returning 404 to user: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:22.717446 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-58d600ec-8764-4fc0-bc38-9f199ff0ad42 tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "DELETE /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 404 len: 111 microversion: 2.1 time: 0.248171 Aug 27 02:43:22.721102 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1267/2813] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:43:22 2022] DELETE /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 111 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:22.774231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf86ff40-6971-400d-afea-70c4470cbbd3 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:22.776137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf86ff40-6971-400d-afea-70c4470cbbd3 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:22.810127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf86ff40-6971-400d-afea-70c4470cbbd3 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.819520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf86ff40-6971-400d-afea-70c4470cbbd3 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.821064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf86ff40-6971-400d-afea-70c4470cbbd3 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.826473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf86ff40-6971-400d-afea-70c4470cbbd3 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.828430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf86ff40-6971-400d-afea-70c4470cbbd3 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.835644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf86ff40-6971-400d-afea-70c4470cbbd3 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.907293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-90b971b7-a733-4670-818a-59d8d3817fa1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:22.923940 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-90b971b7-a733-4670-818a-59d8d3817fa1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1218 microversion: 2.1 time: 0.709259 Aug 27 02:43:22.928057 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1547/2814] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:22 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1218 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:22.944146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-12d05d6d-a58d-4ca6-aeac-466b3fc5b3f2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:22.945263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-12d05d6d-a58d-4ca6-aeac-466b3fc5b3f2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:22.953207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d05d6d-a58d-4ca6-aeac-466b3fc5b3f2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.954002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d05d6d-a58d-4ca6-aeac-466b3fc5b3f2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.954629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d05d6d-a58d-4ca6-aeac-466b3fc5b3f2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:22.955608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d05d6d-a58d-4ca6-aeac-466b3fc5b3f2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:22.956282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d05d6d-a58d-4ca6-aeac-466b3fc5b3f2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:22.956890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d05d6d-a58d-4ca6-aeac-466b3fc5b3f2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:23.286909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf86ff40-6971-400d-afea-70c4470cbbd3 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:23.299239 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf86ff40-6971-400d-afea-70c4470cbbd3 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1284 microversion: 2.1 time: 0.572106 Aug 27 02:43:23.325708 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1268/2815] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:22 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1284 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:23.362380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:23.366126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] [instance: 534917a1-8a02-493c-af75-fdef81207a5a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:23.393871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:23.396251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:23.397519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:23.402571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:23.403418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:23.406688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:23.498943 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] HTTP exception thrown: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Request method failure captured: Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a HTTP/1.1 Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYPW6aKYVBNzM-YK2J-pMFvXsCP1T3VoBOKIJHsAuX_B271DB9dtwupv0NgJ-xQaPLlMreMGOeacCYhlSQwvRL7F9El-xuLlweA9jDhf5r9P_MwK0hlyp638QpwduxpPd7wVUlryy6BAVY55R42fRYb-ZVOprMn7Z1ixWfnIrSRFFAQ Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: f77a9603b9be4fcabc47dc5564ea7404 Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-7870981 Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f77a9603b9be4fcabc47dc5564ea7404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f77a9603b9be4fcabc47dc5564ea7404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f77a9603b9be4fcabc47dc5564ea7404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f77a9603b9be4fcabc47dc5564ea7404"}]}] Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-7870981 Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: f77a9603b9be4fcabc47dc5564ea7404 Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-7870981 Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachSCSIVolumeTestJSON-7870981-project Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c9be55cd0921479b874ce0ce799d10a0 Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-7870981-project Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '534917a1-8a02-493c-af75-fdef81207a5a'} Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:23.501936 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:23.505874 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:23.505874 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:23.505874 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:23.505874 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:23.505874 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:23.505874 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. Aug 27 02:43:23.505874 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:23.506584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-12d05d6d-a58d-4ca6-aeac-466b3fc5b3f2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:23.514669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] Returning 404 to user: Instance 534917a1-8a02-493c-af75-fdef81207a5a could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:23.515840 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e5ef4410-1beb-4bec-a052-08910b0705fe tempest-AttachSCSIVolumeTestJSON-7870981 tempest-AttachSCSIVolumeTestJSON-7870981-project] 10.222.0.99 "GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a" status: 404 len: 111 microversion: 2.1 time: 0.195957 Aug 27 02:43:23.516614 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1269/2816] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:23 2022] GET /compute/v2.1/servers/534917a1-8a02-493c-af75-fdef81207a5a => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:23.534877 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-12d05d6d-a58d-4ca6-aeac-466b3fc5b3f2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1714 microversion: 2.1 time: 0.603393 Aug 27 02:43:23.535058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7cb8b98b-4cb1-43b0-b9f9-4c885e4fe98a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29ab8af0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:23.535432 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1548/2817] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:22 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1714 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:23.577263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:23.595330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:23.629197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:23.629197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:23.640632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:23.641519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:23.642044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:23.642497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:23.658616 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7cb8b98b-4cb1-43b0-b9f9-4c885e4fe98a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.140688 Aug 27 02:43:23.664866 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1270/2818] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:23 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:23.867712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:23.868615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:23.901076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:23.901894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:23.904085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:23.910790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:23.911357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:23.912606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:24.150045 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] HTTP exception thrown: Cannot 'detach_volume' instance 875762f1-6b75-4c91-859b-76fb857ecb26 while it is in vm_state rescued Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Request method failure captured: Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments/9e9641d7-91ea-4339-b1e6-97093d761511 HTTP/1.1 Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYO1ujqvCLBmMVe65fdN2J5dIO7-HUqI3Js5YGestJSXRt-3jM1W-KzE8NnECJ1ryJNn-_nCYfE1drEJmtuv9wrerAqLuupZmy6gs9vrBdbjKq9YdwsxzP7b-WGUVBzCCEf1u8fLpuDoBEeADCldZf84VX9NU_VzQjP9Knt2NuVZyVU Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/956a66be18bb4f9e996c8e16bcf23bab"}]}] Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 51b3d953421c409c9edd54287dcd11db Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'detach_volume' instance 875762f1-6b75-4c91-859b-76fb857ecb26 while it is in vm_state rescued Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': '875762f1-6b75-4c91-859b-76fb857ecb26', 'id': '9e9641d7-91ea-4339-b1e6-97093d761511'} Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 875762f1-6b75-4c91-859b-76fb857ecb26 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 875762f1-6b75-4c91-859b-76fb857ecb26 while it is in vm_state rescued Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:24.153247 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:24.157168 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:24.157168 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:24.157168 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:24.157168 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:24.157168 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 875762f1-6b75-4c91-859b-76fb857ecb26 while it is in vm_state rescued Aug 27 02:43:24.157168 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:24.161852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Returning 409 to user: Cannot 'detach_volume' instance 875762f1-6b75-4c91-859b-76fb857ecb26 while it is in vm_state rescued {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:24.164051 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-718f6be7-bf58-4dc2-aa73-c16ba237ff7f tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments/9e9641d7-91ea-4339-b1e6-97093d761511" status: 409 len: 152 microversion: 2.1 time: 0.303118 Aug 27 02:43:24.165292 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1271/2819] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 02:43:23 2022] DELETE /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments/9e9641d7-91ea-4339-b1e6-97093d761511 => generated 152 bytes in 305 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:43:24.176202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e961e91a-6142-479f-aa1d-7030866cc991 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:24.177386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e961e91a-6142-479f-aa1d-7030866cc991 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:24.193083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e961e91a-6142-479f-aa1d-7030866cc991 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:24.194679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e961e91a-6142-479f-aa1d-7030866cc991 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:24.195445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e961e91a-6142-479f-aa1d-7030866cc991 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:24.197052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e961e91a-6142-479f-aa1d-7030866cc991 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:24.197972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e961e91a-6142-479f-aa1d-7030866cc991 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:24.199410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e961e91a-6142-479f-aa1d-7030866cc991 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:24.408795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e961e91a-6142-479f-aa1d-7030866cc991 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:24.422165 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e961e91a-6142-479f-aa1d-7030866cc991 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1274 microversion: 2.1 time: 0.255244 Aug 27 02:43:24.423536 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1272/2820] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:24 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:24.441383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58b8364f-7db3-44ba-ba1b-be45910eb671 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:24.442421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-58b8364f-7db3-44ba-ba1b-be45910eb671 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:24.456196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58b8364f-7db3-44ba-ba1b-be45910eb671 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:24.457454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58b8364f-7db3-44ba-ba1b-be45910eb671 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:24.458190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58b8364f-7db3-44ba-ba1b-be45910eb671 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:24.462028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58b8364f-7db3-44ba-ba1b-be45910eb671 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:24.462873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58b8364f-7db3-44ba-ba1b-be45910eb671 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:24.463580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58b8364f-7db3-44ba-ba1b-be45910eb671 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:24.649387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:24.657922 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-58b8364f-7db3-44ba-ba1b-be45910eb671 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/action" status: 202 len: 0 microversion: 2.1 time: 0.232176 Aug 27 02:43:24.663572 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1273/2821] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:43:24 2022] POST /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:24.669651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0c908d30-c9ac-4d88-a7fe-bd7078e0c03d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:24.671300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0c908d30-c9ac-4d88-a7fe-bd7078e0c03d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:24.682304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c908d30-c9ac-4d88-a7fe-bd7078e0c03d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:24.683283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c908d30-c9ac-4d88-a7fe-bd7078e0c03d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:24.683858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c908d30-c9ac-4d88-a7fe-bd7078e0c03d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:24.685702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c908d30-c9ac-4d88-a7fe-bd7078e0c03d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:24.686481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c908d30-c9ac-4d88-a7fe-bd7078e0c03d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:24.687104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c908d30-c9ac-4d88-a7fe-bd7078e0c03d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:24.715196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:24.719037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:24.731969 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2f9d0d90-55bd-46e4-99bc-62b0ea1261d7 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1671 microversion: 2.20 time: 1.158223 Aug 27 02:43:24.748444 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1549/2822] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:23 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1671 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:24.769144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2495ecd2-8920-4636-8721-18792334cd58 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:24.770521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2495ecd2-8920-4636-8721-18792334cd58 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:24.804332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2495ecd2-8920-4636-8721-18792334cd58 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:24.805254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2495ecd2-8920-4636-8721-18792334cd58 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:24.806089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2495ecd2-8920-4636-8721-18792334cd58 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:24.807466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2495ecd2-8920-4636-8721-18792334cd58 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:24.808364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2495ecd2-8920-4636-8721-18792334cd58 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:24.809180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2495ecd2-8920-4636-8721-18792334cd58 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:24.975589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0c908d30-c9ac-4d88-a7fe-bd7078e0c03d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:25.011632 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0c908d30-c9ac-4d88-a7fe-bd7078e0c03d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1272 microversion: 2.1 time: 0.350648 Aug 27 02:43:25.013088 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1274/2823] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:24 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1272 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:25.030635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7fe144d2-3412-4561-8cfa-c68f704ad9b6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2adbfd30>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:25.220038 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7fe144d2-3412-4561-8cfa-c68f704ad9b6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.204591 Aug 27 02:43:25.250279 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1275/2824] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:25 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:25.453975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-55479075-d6ab-42fe-9419-5e5f182cad72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:25.471033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-55479075-d6ab-42fe-9419-5e5f182cad72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:25.502010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55479075-d6ab-42fe-9419-5e5f182cad72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:25.514363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55479075-d6ab-42fe-9419-5e5f182cad72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:25.515358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55479075-d6ab-42fe-9419-5e5f182cad72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:25.519483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55479075-d6ab-42fe-9419-5e5f182cad72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:25.526705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55479075-d6ab-42fe-9419-5e5f182cad72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:25.528029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55479075-d6ab-42fe-9419-5e5f182cad72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:25.638489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2495ecd2-8920-4636-8721-18792334cd58 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:25.659750 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2495ecd2-8920-4636-8721-18792334cd58 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1722 microversion: 2.1 time: 0.910236 Aug 27 02:43:25.663976 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1550/2825] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:24 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1722 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:25.777603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:25.778275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:25.810458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:25.814237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:25.815766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:25.818700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:25.820057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:25.821076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.104012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-55479075-d6ab-42fe-9419-5e5f182cad72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:26.117942 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-55479075-d6ab-42fe-9419-5e5f182cad72 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1272 microversion: 2.1 time: 0.674295 Aug 27 02:43:26.133858 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1276/2826] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:25 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1272 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:26.139682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-72424b6a-23e4-4202-b1fb-b6553243d7ba tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:26.142421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-72424b6a-23e4-4202-b1fb-b6553243d7ba tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:26.171337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72424b6a-23e4-4202-b1fb-b6553243d7ba tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.187058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72424b6a-23e4-4202-b1fb-b6553243d7ba tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.188655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72424b6a-23e4-4202-b1fb-b6553243d7ba tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.189618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72424b6a-23e4-4202-b1fb-b6553243d7ba tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.190104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72424b6a-23e4-4202-b1fb-b6553243d7ba tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.190549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72424b6a-23e4-4202-b1fb-b6553243d7ba tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.311767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:26.330913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:26.337496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:26.344007 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0ed8e728-eb45-4b83-b4ea-4e91b702c43a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1671 microversion: 2.20 time: 0.568886 Aug 27 02:43:26.345201 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1551/2827] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:25 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1671 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:26.364222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f49e351e-ba44-4420-92b4-2246fa15cb6a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29413d30>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:26.451093 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f49e351e-ba44-4420-92b4-2246fa15cb6a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.097228 Aug 27 02:43:26.452673 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1552/2828] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:26 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:26.703853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4c479af-19e0-4810-a68a-68d1a6ae5637 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:26.705564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4c479af-19e0-4810-a68a-68d1a6ae5637 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:26.734315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c479af-19e0-4810-a68a-68d1a6ae5637 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.735221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c479af-19e0-4810-a68a-68d1a6ae5637 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.736001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c479af-19e0-4810-a68a-68d1a6ae5637 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:26.737302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c479af-19e0-4810-a68a-68d1a6ae5637 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:26.738479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c479af-19e0-4810-a68a-68d1a6ae5637 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:26.739429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c479af-19e0-4810-a68a-68d1a6ae5637 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.281214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4c479af-19e0-4810-a68a-68d1a6ae5637 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:27.296602 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4c479af-19e0-4810-a68a-68d1a6ae5637 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1722 microversion: 2.1 time: 0.598582 Aug 27 02:43:27.297933 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1553/2829] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:26 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1722 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:27.327837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1df83760-8135-4165-aeff-247487504380 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:27.329435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1df83760-8135-4165-aeff-247487504380 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:27.344546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1df83760-8135-4165-aeff-247487504380 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.345880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1df83760-8135-4165-aeff-247487504380 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.346961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1df83760-8135-4165-aeff-247487504380 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.348762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1df83760-8135-4165-aeff-247487504380 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.349996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1df83760-8135-4165-aeff-247487504380 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.351041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1df83760-8135-4165-aeff-247487504380 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.476774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-72424b6a-23e4-4202-b1fb-b6553243d7ba tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:27.494896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:27.526628 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-72424b6a-23e4-4202-b1fb-b6553243d7ba tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1314 microversion: 2.1 time: 1.381641 Aug 27 02:43:27.542661 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1277/2830] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:26 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1314 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:27.579086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:27.582694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:27.603924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1df83760-8135-4165-aeff-247487504380 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:27.634781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.636040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.637121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.639036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:27.640349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:27.642208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:27.650920 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1df83760-8135-4165-aeff-247487504380 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1272 microversion: 2.1 time: 0.333266 Aug 27 02:43:27.673711 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1554/2831] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:27 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1272 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:27.691254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-af2effa8-f79d-47e6-a0a2-35bd14e1c764 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d298e8dc0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:27.807348 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-af2effa8-f79d-47e6-a0a2-35bd14e1c764 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.144315 Aug 27 02:43:27.812192 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1555/2832] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:27 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:28.131603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba33440b-010a-456a-908d-3057cb5ba2ba tempest-ListImageFiltersNegativeTestJSON-1329171078 tempest-ListImageFiltersNegativeTestJSON-1329171078-project] Calling method '.version_select at 0x7f4d2e8bc790>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:28.179105 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-ba33440b-010a-456a-908d-3057cb5ba2ba tempest-ListImageFiltersNegativeTestJSON-1329171078 tempest-ListImageFiltersNegativeTestJSON-1329171078-project] HTTP exception thrown: Image not found. Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba33440b-010a-456a-908d-3057cb5ba2ba tempest-ListImageFiltersNegativeTestJSON-1329171078 tempest-ListImageFiltersNegativeTestJSON-1329171078-project] Request method failure captured: Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/images/09c53b42-57a2-4393-952c-6ea8a7d65dc1 HTTP/1.1 Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYTPufRFgf2uI7gT5p1YP5pys8cnK6NjQPGQ2buqOgDl7IAeHlLu6WYHb3oWifo4EkXEJETy9k8kabbYAfDUPGbc_Evs0u5a1vua_ZV9ZDWc3AIpCEHHpAeCp0cYk6C2jhpOQEiDOknT2n9sLRGIXm6E2FO2DkmISyXOXg0qSBIDpDo Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 13e22a629d1042d7a834659164cccf39 Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1329171078 Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_13e22a629d1042d7a834659164cccf39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/13e22a629d1042d7a834659164cccf39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/13e22a629d1042d7a834659164cccf39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/13e22a629d1042d7a834659164cccf39"}]}] Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1329171078 Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 13e22a629d1042d7a834659164cccf39 Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1329171078 Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ListImageFiltersNegativeTestJSON-1329171078-project Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: f307c38f208348a8bfd06942f9ad3b9a Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1329171078-project Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '09c53b42-57a2-4393-952c-6ea8a7d65dc1'} Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 09c53b42-57a2-4393-952c-6ea8a7d65dc1 Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:43:28.183504 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 09c53b42-57a2-4393-952c-6ea8a7d65dc1 could not be found. Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:28.189103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba33440b-010a-456a-908d-3057cb5ba2ba tempest-ListImageFiltersNegativeTestJSON-1329171078 tempest-ListImageFiltersNegativeTestJSON-1329171078-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:28.196855 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ba33440b-010a-456a-908d-3057cb5ba2ba tempest-ListImageFiltersNegativeTestJSON-1329171078 tempest-ListImageFiltersNegativeTestJSON-1329171078-project] 10.222.0.99 "GET /compute/v2.1/images/09c53b42-57a2-4393-952c-6ea8a7d65dc1" status: 404 len: 62 microversion: 2.1 time: 0.381879 Aug 27 02:43:28.204398 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1556/2833] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:27 2022] GET /compute/v2.1/images/09c53b42-57a2-4393-952c-6ea8a7d65dc1 => generated 62 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:43:28.278324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-34fa21c1-09fc-487a-9ac9-432ba74765c7 req-8d0a7678-ea02-49bb-ac19-dfe533e17c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a56302-112a-470a-94c4-ca2a437560a8", "tag": "f44e56a4-faa4-480a-9a77-deeca7f2aacd"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:28.323566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-34fa21c1-09fc-487a-9ac9-432ba74765c7 req-8d0a7678-ea02-49bb-ac19-dfe533e17c49 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:28.330881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-34fa21c1-09fc-487a-9ac9-432ba74765c7 req-8d0a7678-ea02-49bb-ac19-dfe533e17c49 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:28.331385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-34fa21c1-09fc-487a-9ac9-432ba74765c7 req-8d0a7678-ea02-49bb-ac19-dfe533e17c49 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:28.383315 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-34fa21c1-09fc-487a-9ac9-432ba74765c7 req-8d0a7678-ea02-49bb-ac19-dfe533e17c49 service nova] Creating event network-changed:f44e56a4-faa4-480a-9a77-deeca7f2aacd for instance d3a56302-112a-470a-94c4-ca2a437560a8 on n-h2-852084-5 Aug 27 02:43:28.395192 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-34fa21c1-09fc-487a-9ac9-432ba74765c7 req-8d0a7678-ea02-49bb-ac19-dfe533e17c49 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129333 Aug 27 02:43:28.398308 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1557/2834] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:43:28.408993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-267ef49b-3d5d-4369-b9a9-3878be5505f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:28.411227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-267ef49b-3d5d-4369-b9a9-3878be5505f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:28.428207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267ef49b-3d5d-4369-b9a9-3878be5505f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:28.430308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267ef49b-3d5d-4369-b9a9-3878be5505f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:28.431785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267ef49b-3d5d-4369-b9a9-3878be5505f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:28.434759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267ef49b-3d5d-4369-b9a9-3878be5505f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:28.436278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267ef49b-3d5d-4369-b9a9-3878be5505f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:28.437461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267ef49b-3d5d-4369-b9a9-3878be5505f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:28.484020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:29.082575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-267ef49b-3d5d-4369-b9a9-3878be5505f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:29.155458 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-267ef49b-3d5d-4369-b9a9-3878be5505f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1722 microversion: 2.1 time: 0.751912 Aug 27 02:43:29.158114 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1558/2835] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:28 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1722 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:29.166953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-719b4aed-7781-44c6-9ff1-d5ef4c13707b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:29.169773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-719b4aed-7781-44c6-9ff1-d5ef4c13707b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:29.191923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719b4aed-7781-44c6-9ff1-d5ef4c13707b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:29.193798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719b4aed-7781-44c6-9ff1-d5ef4c13707b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:29.194905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719b4aed-7781-44c6-9ff1-d5ef4c13707b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:29.197513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719b4aed-7781-44c6-9ff1-d5ef4c13707b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:29.198903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719b4aed-7781-44c6-9ff1-d5ef4c13707b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:29.200016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719b4aed-7781-44c6-9ff1-d5ef4c13707b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:29.596755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-719b4aed-7781-44c6-9ff1-d5ef4c13707b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:29.618030 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-719b4aed-7781-44c6-9ff1-d5ef4c13707b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1314 microversion: 2.1 time: 0.457998 Aug 27 02:43:29.626117 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1559/2836] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:29 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:29.638686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be334687-05c1-4e11-900c-00af4e5538a0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:29.639850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-be334687-05c1-4e11-900c-00af4e5538a0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:29.659809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be334687-05c1-4e11-900c-00af4e5538a0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:29.660335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be334687-05c1-4e11-900c-00af4e5538a0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:29.662396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be334687-05c1-4e11-900c-00af4e5538a0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:29.671545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be334687-05c1-4e11-900c-00af4e5538a0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:29.672587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be334687-05c1-4e11-900c-00af4e5538a0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:29.673426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be334687-05c1-4e11-900c-00af4e5538a0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:29.809450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:29.843228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:29.852138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:29.857932 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-67e59c44-1b02-4c98-ab63-4cd67d8615b8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 2.312891 Aug 27 02:43:29.859615 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1278/2837] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:27 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 2316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:29.872719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f319dfe8-480e-47c7-91ec-d0a727b5002a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29a00550>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:29.965443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:30.045374 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f319dfe8-480e-47c7-91ec-d0a727b5002a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.183513 Aug 27 02:43:30.047369 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1279/2838] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:29 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:30.090995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be334687-05c1-4e11-900c-00af4e5538a0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:30.111184 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-be334687-05c1-4e11-900c-00af4e5538a0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1314 microversion: 2.1 time: 0.483510 Aug 27 02:43:30.112138 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1560/2839] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:29 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:30.180320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93a923ed-74c9-4bd3-922f-82aa3dd759b3 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:30.180950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93a923ed-74c9-4bd3-922f-82aa3dd759b3 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:30.189439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93a923ed-74c9-4bd3-922f-82aa3dd759b3 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:30.190394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93a923ed-74c9-4bd3-922f-82aa3dd759b3 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:30.191132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93a923ed-74c9-4bd3-922f-82aa3dd759b3 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:30.193318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93a923ed-74c9-4bd3-922f-82aa3dd759b3 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:30.194105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93a923ed-74c9-4bd3-922f-82aa3dd759b3 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:30.194781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93a923ed-74c9-4bd3-922f-82aa3dd759b3 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:30.598003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-93a923ed-74c9-4bd3-922f-82aa3dd759b3 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:30.611376 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-93a923ed-74c9-4bd3-922f-82aa3dd759b3 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1722 microversion: 2.1 time: 0.436252 Aug 27 02:43:30.611970 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1280/2840] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:30 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:30.671232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-db0057b2-239d-4310-b71a-45f9780f15f7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:30.673292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-db0057b2-239d-4310-b71a-45f9780f15f7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:30.683721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:30.691052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0057b2-239d-4310-b71a-45f9780f15f7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:30.692593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0057b2-239d-4310-b71a-45f9780f15f7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:30.694287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0057b2-239d-4310-b71a-45f9780f15f7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:30.695807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0057b2-239d-4310-b71a-45f9780f15f7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:30.696914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0057b2-239d-4310-b71a-45f9780f15f7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:30.700468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0057b2-239d-4310-b71a-45f9780f15f7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:30.909311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:30.914384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:30.926230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:30.926733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:30.927219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:30.927979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:30.934924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:30.935656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:31.144539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:31.745688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-db0057b2-239d-4310-b71a-45f9780f15f7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:31.758188 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-db0057b2-239d-4310-b71a-45f9780f15f7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1314 microversion: 2.1 time: 1.095094 Aug 27 02:43:31.759571 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1561/2841] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:30 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1314 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:31.778191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5f6a79a3-6345-4700-9255-074246cc2844 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e764e50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:31.866673 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f6a79a3-6345-4700-9255-074246cc2844 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1414 microversion: 2.1 time: 0.098746 Aug 27 02:43:31.867686 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1562/2842] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:31 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:31.901309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f38d396-57eb-4775-8892-3d73ce59b6b9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:31.908465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9f38d396-57eb-4775-8892-3d73ce59b6b9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:31.931987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f38d396-57eb-4775-8892-3d73ce59b6b9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:31.941620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f38d396-57eb-4775-8892-3d73ce59b6b9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:31.942388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f38d396-57eb-4775-8892-3d73ce59b6b9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:31.943922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f38d396-57eb-4775-8892-3d73ce59b6b9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:31.947369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f38d396-57eb-4775-8892-3d73ce59b6b9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:31.949560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f38d396-57eb-4775-8892-3d73ce59b6b9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:32.209302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:32.219753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:32.221953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:32.224471 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b73e8e95-8c5b-49cf-88b3-2b2d5262e076 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 1.318719 Aug 27 02:43:32.225847 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1281/2843] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:30 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:32.244067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dc8651d4-e6b8-494c-b6c8-1fac31038f85 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:32.245296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dc8651d4-e6b8-494c-b6c8-1fac31038f85 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:32.248495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:32.259541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc8651d4-e6b8-494c-b6c8-1fac31038f85 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:32.260424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc8651d4-e6b8-494c-b6c8-1fac31038f85 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:32.261902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc8651d4-e6b8-494c-b6c8-1fac31038f85 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:32.263312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc8651d4-e6b8-494c-b6c8-1fac31038f85 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:32.264068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc8651d4-e6b8-494c-b6c8-1fac31038f85 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:32.265016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc8651d4-e6b8-494c-b6c8-1fac31038f85 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:32.413567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9f38d396-57eb-4775-8892-3d73ce59b6b9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:32.416052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:32.434425 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9f38d396-57eb-4775-8892-3d73ce59b6b9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1314 microversion: 2.1 time: 0.565281 Aug 27 02:43:32.435638 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1563/2844] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:31 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:32.796577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-06be497e-2a95-4335-b5db-916b0f9055ca tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Action: 'create', calling method: .version_select at 0x7f4d2a11e430>, body: {"keypair": {"name": "tempest-keypair-1741145186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBadZyZLRMrSiEK6ByL8B54MYjExSQuAR3+s+NG9Z8t40HhP8kYHdb21uNHq4OqpfPZX5f+zgxDvxfIJhUQHjbnQ7JTgty9kdwMFkEpQ74rnsr1Q2aVcYAIjWPlhl9tWAQ=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:32.847158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:32.859389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-06be497e-2a95-4335-b5db-916b0f9055ca tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:32.873398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-06be497e-2a95-4335-b5db-916b0f9055ca tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for user f9764bef3bfb420ea3b4a2956e9a0754 and project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:32.935661 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-06be497e-2a95-4335-b5db-916b0f9055ca tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.496927 Aug 27 02:43:32.936871 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1564/2845] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:32.952975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff57f21d-028b-4df5-a1f4-056b2a8066a7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:32.955621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ff57f21d-028b-4df5-a1f4-056b2a8066a7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:32.970620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff57f21d-028b-4df5-a1f4-056b2a8066a7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:32.971429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff57f21d-028b-4df5-a1f4-056b2a8066a7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:32.972209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff57f21d-028b-4df5-a1f4-056b2a8066a7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:32.973488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff57f21d-028b-4df5-a1f4-056b2a8066a7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:32.974845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff57f21d-028b-4df5-a1f4-056b2a8066a7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:32.979725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff57f21d-028b-4df5-a1f4-056b2a8066a7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.160547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ff57f21d-028b-4df5-a1f4-056b2a8066a7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:33.170775 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff57f21d-028b-4df5-a1f4-056b2a8066a7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1314 microversion: 2.1 time: 0.222988 Aug 27 02:43:33.186083 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1565/2846] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:32 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:33.190392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f6736317-c952-4198-987e-5a496edda2e9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e8a0790>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:33.251765 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f6736317-c952-4198-987e-5a496edda2e9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1423 microversion: 2.1 time: 0.078353 Aug 27 02:43:33.261846 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1566/2847] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:33 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1423 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:33.270292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3634f2fc-f740-4cc3-bd7a-b40eb0faa78b tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Calling method '.version_select at 0x7f4d2a11eca0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:33.282996 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3634f2fc-f740-4cc3-bd7a-b40eb0faa78b tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "GET /compute/v2.1/os-keypairs/tempest-keypair-1741145186" status: 200 len: 498 microversion: 2.1 time: 0.017566 Aug 27 02:43:33.294884 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1567/2848] 10.222.0.99 () {58 vars in 1218 bytes} [Sat Aug 27 02:43:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1741145186 => generated 498 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:33.305616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:33.306954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:33.342819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dc8651d4-e6b8-494c-b6c8-1fac31038f85 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:33.358755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.363029 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dc8651d4-e6b8-494c-b6c8-1fac31038f85 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1728 microversion: 2.1 time: 1.135555 Aug 27 02:43:33.363656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.366914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.370389 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1282/2849] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:32 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1728 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:33.371218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.373527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.374315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.395348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a1238b26-2170-4491-afbe-b937ea015fc6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2a7abee0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:33.492453 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a1238b26-2170-4491-afbe-b937ea015fc6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 200 len: 1423 microversion: 2.1 time: 0.119301 Aug 27 02:43:33.494999 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1283/2850] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:43:33 2022] GET /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 1423 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:33.517856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2adb498-c160-496b-8344-2dea2c7faf65 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Calling method '.version_select at 0x7f4d29a443a0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:33.593579 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e2adb498-c160-496b-8344-2dea2c7faf65 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741145186" status: 202 len: 0 microversion: 2.1 time: 0.086312 Aug 27 02:43:33.610250 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1284/2851] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:43:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741145186 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:33.640400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b2a1c1c8-02f6-4096-92a7-0d25110069ed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:33.643103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b2a1c1c8-02f6-4096-92a7-0d25110069ed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:33.678254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2a1c1c8-02f6-4096-92a7-0d25110069ed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.688981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2a1c1c8-02f6-4096-92a7-0d25110069ed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.689418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2a1c1c8-02f6-4096-92a7-0d25110069ed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.692363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2a1c1c8-02f6-4096-92a7-0d25110069ed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.693136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2a1c1c8-02f6-4096-92a7-0d25110069ed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.695936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2a1c1c8-02f6-4096-92a7-0d25110069ed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.762852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:33.808001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:33.811741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:33.814056 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0a63c716-6f25-4027-9bf8-0326d2b9b1cc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 0.515694 Aug 27 02:43:33.815487 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1568/2852] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:33 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:33.822402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-97f0d640-6c34-4ae8-abcc-414298268181 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:33.829475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-97f0d640-6c34-4ae8-abcc-414298268181 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:33.843488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97f0d640-6c34-4ae8-abcc-414298268181 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.850545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97f0d640-6c34-4ae8-abcc-414298268181 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.851313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97f0d640-6c34-4ae8-abcc-414298268181 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:33.854840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97f0d640-6c34-4ae8-abcc-414298268181 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:33.855758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97f0d640-6c34-4ae8-abcc-414298268181 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:33.856275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97f0d640-6c34-4ae8-abcc-414298268181 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:34.066417 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b2a1c1c8-02f6-4096-92a7-0d25110069ed tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.452941 Aug 27 02:43:34.076683 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1285/2853] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:43:33 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-interface => generated 285 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:34.081875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c23902c5-e353-4d67-b957-e496cb90a29e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e73b3a0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:34.575576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-97f0d640-6c34-4ae8-abcc-414298268181 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:34.612935 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-97f0d640-6c34-4ae8-abcc-414298268181 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1314 microversion: 2.1 time: 0.792629 Aug 27 02:43:34.630485 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1569/2854] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:33 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:34.663210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-38940dc6-788f-42c5-b8da-7e1ca96b1401 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Action: 'create', calling method: .version_select at 0x7f4d2e7cc820>, body: {"keypair": {"name": "tempest-keypair-1452613146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3ZbNqgkJBwYo1zVpJCuzD43g1CxY/wA6PZ3li0lvCdGebRFBSfjjhmO6AgYbDn06E9gjoZdr1m1JZdFAe/dvus+ormP4fqKEWbt1u+LP6y3QSNNSME0nJyxQ/etDBiQw=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:34.719044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-38940dc6-788f-42c5-b8da-7e1ca96b1401 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:34.738088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-38940dc6-788f-42c5-b8da-7e1ca96b1401 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for user f9764bef3bfb420ea3b4a2956e9a0754 and project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:34.813041 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-38940dc6-788f-42c5-b8da-7e1ca96b1401 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165277 Aug 27 02:43:34.819524 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1570/2855] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:34.840901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cbfd397f-bab3-4071-b598-113f35d7de92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:34.844223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cbfd397f-bab3-4071-b598-113f35d7de92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:34.870794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfd397f-bab3-4071-b598-113f35d7de92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:34.874026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfd397f-bab3-4071-b598-113f35d7de92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:34.878279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfd397f-bab3-4071-b598-113f35d7de92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:34.879880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfd397f-bab3-4071-b598-113f35d7de92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:34.888339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfd397f-bab3-4071-b598-113f35d7de92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:34.890557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbfd397f-bab3-4071-b598-113f35d7de92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.527637 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c23902c5-e353-4d67-b957-e496cb90a29e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 204 len: 0 microversion: 2.1 time: 1.449374 Aug 27 02:43:35.528624 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1286/2856] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:34 2022] DELETE /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 0 bytes in 1451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:35.541976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d7bb0451-1b8a-415f-b6f8-b8ad824cb47d tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Calling method '.version_select at 0x7f4d29a44dc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:35.591608 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d7bb0451-1b8a-415f-b6f8-b8ad824cb47d tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452613146" status: 202 len: 0 microversion: 2.1 time: 0.052306 Aug 27 02:43:35.598778 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1287/2857] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:43:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452613146 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:35.617049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:35.624092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:35.649847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.663185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.664263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.665888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.667013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.667986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.686916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cbfd397f-bab3-4071-b598-113f35d7de92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:35.731114 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cbfd397f-bab3-4071-b598-113f35d7de92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1314 microversion: 2.1 time: 0.906921 Aug 27 02:43:35.739286 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1571/2858] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:34 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1314 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:35.771409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1a61ab30-a0be-44c1-a55c-8620aeca46e8 req-22204435-602b-46e2-aadd-92911b5c5a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc6da4b-7eaa-4955-916f-f9400d8fb491", "tag": "26a8ce3a-caa5-463a-891c-4c436615cead"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:35.824518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1a61ab30-a0be-44c1-a55c-8620aeca46e8 req-22204435-602b-46e2-aadd-92911b5c5a74 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.825348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1a61ab30-a0be-44c1-a55c-8620aeca46e8 req-22204435-602b-46e2-aadd-92911b5c5a74 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.826189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1a61ab30-a0be-44c1-a55c-8620aeca46e8 req-22204435-602b-46e2-aadd-92911b5c5a74 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.884339 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1a61ab30-a0be-44c1-a55c-8620aeca46e8 req-22204435-602b-46e2-aadd-92911b5c5a74 service nova] Creating event network-changed:26a8ce3a-caa5-463a-891c-4c436615cead for instance dbc6da4b-7eaa-4955-916f-f9400d8fb491 on n-h1-852084-5 Aug 27 02:43:35.899042 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1a61ab30-a0be-44c1-a55c-8620aeca46e8 req-22204435-602b-46e2-aadd-92911b5c5a74 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156012 Aug 27 02:43:35.901206 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1572/2859] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:35.920939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-80a46d35-9ac1-44ea-9b0a-d02ade53a55e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:35.922356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-80a46d35-9ac1-44ea-9b0a-d02ade53a55e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:35.942315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a46d35-9ac1-44ea-9b0a-d02ade53a55e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.944587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a46d35-9ac1-44ea-9b0a-d02ade53a55e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.946381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a46d35-9ac1-44ea-9b0a-d02ade53a55e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:35.950207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a46d35-9ac1-44ea-9b0a-d02ade53a55e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:35.951565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a46d35-9ac1-44ea-9b0a-d02ade53a55e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:35.954498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a46d35-9ac1-44ea-9b0a-d02ade53a55e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:36.052489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-80a46d35-9ac1-44ea-9b0a-d02ade53a55e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:43:36.395520 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-80a46d35-9ac1-44ea-9b0a-d02ade53a55e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 204 len: 0 microversion: 2.1 time: 0.490506 Aug 27 02:43:36.396477 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1573/2860] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:43:35 2022] DELETE /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:43:36.441523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a93b358-ccd1-45c0-8ece-5bdb8aeb357d tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Action: 'create', calling method: .version_select at 0x7f4d293a75e0>, body: {"keypair": {"name": "tempest-keypair-172022803", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:36.526039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4a93b358-ccd1-45c0-8ece-5bdb8aeb357d tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:36.560857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4a93b358-ccd1-45c0-8ece-5bdb8aeb357d tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for user f9764bef3bfb420ea3b4a2956e9a0754 and project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:36.595724 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a93b358-ccd1-45c0-8ece-5bdb8aeb357d tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.189173 Aug 27 02:43:36.596989 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1574/2861] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:36 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:36.603710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3424b05f-6401-45c9-8f19-32bde8866dc6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:36.604905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3424b05f-6401-45c9-8f19-32bde8866dc6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:36.613985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3424b05f-6401-45c9-8f19-32bde8866dc6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:36.615669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3424b05f-6401-45c9-8f19-32bde8866dc6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:36.616428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3424b05f-6401-45c9-8f19-32bde8866dc6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:36.617508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3424b05f-6401-45c9-8f19-32bde8866dc6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:36.618508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3424b05f-6401-45c9-8f19-32bde8866dc6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:36.619263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3424b05f-6401-45c9-8f19-32bde8866dc6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:36.725403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:36.757564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:36.765055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:36.772903 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7a39c4c7-fb70-4c61-b7b7-5e97b4f9fd34 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 1.169159 Aug 27 02:43:36.776233 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1288/2862] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:35 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:36.800141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-509879386", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "c0e01839-7cf2-4a76-9f86-ed22a92507b6"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:36.970560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] validate_networks() for [('c0e01839-7cf2-4a76-9f86-ed22a92507b6', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:43:37.492482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3424b05f-6401-45c9-8f19-32bde8866dc6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:37.523076 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3424b05f-6401-45c9-8f19-32bde8866dc6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1314 microversion: 2.1 time: 0.923943 Aug 27 02:43:37.526410 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1575/2863] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:36 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:37.535174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b73f01a6-bedb-476e-b6df-f1c515716c9d tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Calling method '.version_select at 0x7f4d2a7e55e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:37.616431 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b73f01a6-bedb-476e-b6df-f1c515716c9d tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-172022803" status: 202 len: 0 microversion: 2.1 time: 0.084308 Aug 27 02:43:37.617436 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1576/2864] 10.222.0.99 () {58 vars in 1218 bytes} [Sat Aug 27 02:43:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-172022803 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:37.624891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-139ec4b2-5a85-4121-a8ed-5771b1192d61 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:37.633715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-139ec4b2-5a85-4121-a8ed-5771b1192d61 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:37.652690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-139ec4b2-5a85-4121-a8ed-5771b1192d61 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.653524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-139ec4b2-5a85-4121-a8ed-5771b1192d61 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.654852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-139ec4b2-5a85-4121-a8ed-5771b1192d61 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.656466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-139ec4b2-5a85-4121-a8ed-5771b1192d61 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.658085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-139ec4b2-5a85-4121-a8ed-5771b1192d61 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.659203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-139ec4b2-5a85-4121-a8ed-5771b1192d61 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.911137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:43:37.913892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:43:37.914423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:43:37.914847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:43:37.915425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:43:37.935310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.942898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.944815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:37.946449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:37.947976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:37.949926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:38.007632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Getting quotas for project 3a7deb7b2e0f44db9408c63d75634406. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:38.024215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Getting quotas for user 3ba5de1a75904079a6d4ae345c9c8025 and project 3a7deb7b2e0f44db9408c63d75634406. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:38.040544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-139ec4b2-5a85-4121-a8ed-5771b1192d61 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:38.060754 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-139ec4b2-5a85-4121-a8ed-5771b1192d61 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1314 microversion: 2.1 time: 0.441742 Aug 27 02:43:38.062559 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1577/2865] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:37 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:38.068748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:43:38.073701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:43:38.080433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4c334918-2fa5-4a98-a386-904b2c17295a req-2c50e0ca-0828-44e2-a5a5-fd679739605e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875762f1-6b75-4c91-859b-76fb857ecb26", "tag": "ef6abdee-33da-4ec5-9d71-9440e01d80d1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:38.144496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4c334918-2fa5-4a98-a386-904b2c17295a req-2c50e0ca-0828-44e2-a5a5-fd679739605e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:38.147837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4c334918-2fa5-4a98-a386-904b2c17295a req-2c50e0ca-0828-44e2-a5a5-fd679739605e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:38.153027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4c334918-2fa5-4a98-a386-904b2c17295a req-2c50e0ca-0828-44e2-a5a5-fd679739605e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:38.203354 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4e670aa8-2a67-4783-bea9-2824276c01b2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.421610 Aug 27 02:43:38.206839 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1289/2866] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:43:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:43:38.217743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d8999287-ba19-4110-8dcb-0c42259b9200 req-3f31ef38-dddf-4f84-b2cd-8f0bc0cf1ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56302-112a-470a-94c4-ca2a437560a8", "name": "network-vif-plugged", "status": "completed", "tag": "f44e56a4-faa4-480a-9a77-deeca7f2aacd"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:38.225718 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4c334918-2fa5-4a98-a386-904b2c17295a req-2c50e0ca-0828-44e2-a5a5-fd679739605e service nova] Creating event network-changed:ef6abdee-33da-4ec5-9d71-9440e01d80d1 for instance 875762f1-6b75-4c91-859b-76fb857ecb26 on n-h1-852084-5 Aug 27 02:43:38.265194 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4c334918-2fa5-4a98-a386-904b2c17295a req-2c50e0ca-0828-44e2-a5a5-fd679739605e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195449 Aug 27 02:43:38.265947 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1578/2867] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:38.298260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d8999287-ba19-4110-8dcb-0c42259b9200 req-3f31ef38-dddf-4f84-b2cd-8f0bc0cf1ff9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:38.301268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d8999287-ba19-4110-8dcb-0c42259b9200 req-3f31ef38-dddf-4f84-b2cd-8f0bc0cf1ff9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:38.306739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d8999287-ba19-4110-8dcb-0c42259b9200 req-3f31ef38-dddf-4f84-b2cd-8f0bc0cf1ff9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:38.310952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-66744948-0fc4-44ef-aa1f-86456e3df4aa tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Action: 'create', calling method: .version_select at 0x7f4d293a74c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1153377791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwf+gxmemaLG5y1nZdwHQXhHGwLflvoGho6vAYVT557QK2ceVpQfUr1eyr6oYZsEiJOSOQWZ7UGuUQd/WxH7ZsC2SNUgcWsQ95p7lWw93F8hwTRjolD5Iblfg+3dbBeZw=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:38.348204 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d8999287-ba19-4110-8dcb-0c42259b9200 req-3f31ef38-dddf-4f84-b2cd-8f0bc0cf1ff9 service nova] Creating event network-vif-plugged:f44e56a4-faa4-480a-9a77-deeca7f2aacd for instance d3a56302-112a-470a-94c4-ca2a437560a8 on n-h2-852084-5 Aug 27 02:43:38.375228 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d8999287-ba19-4110-8dcb-0c42259b9200 req-3f31ef38-dddf-4f84-b2cd-8f0bc0cf1ff9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162091 Aug 27 02:43:38.378420 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1290/2868] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:38.379535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-66744948-0fc4-44ef-aa1f-86456e3df4aa tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:38.393607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:38.394372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:38.424471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-66744948-0fc4-44ef-aa1f-86456e3df4aa tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for user f9764bef3bfb420ea3b4a2956e9a0754 and project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:38.456816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:38.457431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:38.457916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:38.459223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:38.459780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:38.460223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:38.568870 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-66744948-0fc4-44ef-aa1f-86456e3df4aa tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.284223 Aug 27 02:43:38.569571 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1579/2869] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:38 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:38.609569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-47893e71-8e03-4bc2-a373-2bb7bd016c3d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:38.614125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-47893e71-8e03-4bc2-a373-2bb7bd016c3d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:39.011620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-47893e71-8e03-4bc2-a373-2bb7bd016c3d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:39.063405 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-47893e71-8e03-4bc2-a373-2bb7bd016c3d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1207 microversion: 2.1 time: 0.482978 Aug 27 02:43:39.084042 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1580/2870] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:38 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1207 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:39.132750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9e4b21b0-69ed-457e-acc3-af8e53f7b46a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:39.142304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9e4b21b0-69ed-457e-acc3-af8e53f7b46a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:39.204608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e4b21b0-69ed-457e-acc3-af8e53f7b46a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:39.220398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e4b21b0-69ed-457e-acc3-af8e53f7b46a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:39.224379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e4b21b0-69ed-457e-acc3-af8e53f7b46a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:39.227229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e4b21b0-69ed-457e-acc3-af8e53f7b46a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:39.235126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e4b21b0-69ed-457e-acc3-af8e53f7b46a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:39.246784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e4b21b0-69ed-457e-acc3-af8e53f7b46a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:39.913075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9e4b21b0-69ed-457e-acc3-af8e53f7b46a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:39.954174 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9e4b21b0-69ed-457e-acc3-af8e53f7b46a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1314 microversion: 2.1 time: 0.861660 Aug 27 02:43:39.956964 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1581/2871] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:39 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1314 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:39.997445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c07d6ba-139e-4575-9171-9c9f9e8da498 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Action: 'create', calling method: .version_select at 0x7f4d2991dd30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-733323348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5kNGMhWo+JtijQ+dbpQe/9R3OEYWzigGR43038VZ1n/b/Bd7T0G32laRebDtzyheUvJZxohb3L+GQjUy3ScEh70IcZsTQtS2+x2eZHuRoTCjh0Ppu09AQk4+fZXR0hMA=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:40.145243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3c07d6ba-139e-4575-9171-9c9f9e8da498 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:40.199577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3c07d6ba-139e-4575-9171-9c9f9e8da498 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for user f9764bef3bfb420ea3b4a2956e9a0754 and project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:40.276489 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3c07d6ba-139e-4575-9171-9c9f9e8da498 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.315046 Aug 27 02:43:40.282736 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1582/2872] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:39 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:40.325376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-206e0fb2-8c1c-4b06-81dd-80d3f2a1db19 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:40.327642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-206e0fb2-8c1c-4b06-81dd-80d3f2a1db19 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:40.356696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-206e0fb2-8c1c-4b06-81dd-80d3f2a1db19 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:40.357504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-206e0fb2-8c1c-4b06-81dd-80d3f2a1db19 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:40.359398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-206e0fb2-8c1c-4b06-81dd-80d3f2a1db19 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:40.364399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-206e0fb2-8c1c-4b06-81dd-80d3f2a1db19 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:40.365483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-206e0fb2-8c1c-4b06-81dd-80d3f2a1db19 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:40.367346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-206e0fb2-8c1c-4b06-81dd-80d3f2a1db19 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:41.133821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-206e0fb2-8c1c-4b06-81dd-80d3f2a1db19 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:41.164676 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-206e0fb2-8c1c-4b06-81dd-80d3f2a1db19 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1314 microversion: 2.1 time: 0.876239 Aug 27 02:43:41.171930 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1583/2873] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:40 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1314 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:41.194988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2eb68011-c422-452b-8cf8-d024f5aa26e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:41.203143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2eb68011-c422-452b-8cf8-d024f5aa26e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:41.227631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eb68011-c422-452b-8cf8-d024f5aa26e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:41.240663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eb68011-c422-452b-8cf8-d024f5aa26e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:41.258948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eb68011-c422-452b-8cf8-d024f5aa26e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:41.261480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eb68011-c422-452b-8cf8-d024f5aa26e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:41.263523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eb68011-c422-452b-8cf8-d024f5aa26e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:41.264671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2eb68011-c422-452b-8cf8-d024f5aa26e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:41.787458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2eb68011-c422-452b-8cf8-d024f5aa26e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:41.826361 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2eb68011-c422-452b-8cf8-d024f5aa26e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1259 microversion: 2.1 time: 0.643040 Aug 27 02:43:41.847207 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1584/2874] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:41 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1259 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:41.862940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a7db3841-48d5-49cf-aa3d-f99fe942e487 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Action: 'create', calling method: .version_select at 0x7f4d294714c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-719974776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx/uKtufRv/9KUfR1VmYuoAnOtD6tXL+51b1BV3raZo4gj53Ze8LclxFdFY1UDCsGfPPcVUE1QTiJ8FEA2XBx7isK4yVbxXrXFhg8NPCjX7KbvSXtYb985tQJwUejnrFQ=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:41.878734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:41.887935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-a7db3841-48d5-49cf-aa3d-f99fe942e487 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:41.907224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-a7db3841-48d5-49cf-aa3d-f99fe942e487 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Getting quotas for user f9764bef3bfb420ea3b4a2956e9a0754 and project 7aaa6993c7784d4b85b15dbc8b7cb2b4. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:41.972346 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a7db3841-48d5-49cf-aa3d-f99fe942e487 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.123262 Aug 27 02:43:41.988311 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1585/2875] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:42.002150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c46a9ea0-c58c-4713-8eb3-2829ad34be38 req-4b0550ab-bbc1-4ab5-be87-2adab130ed85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b863d40c-1266-4beb-a51e-02d683ffba71", "name": "network-vif-unplugged", "status": "completed", "tag": "938a9794-4a8d-4ef4-92ab-23ae622e61c2"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:42.039131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:42.047061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c46a9ea0-c58c-4713-8eb3-2829ad34be38 req-4b0550ab-bbc1-4ab5-be87-2adab130ed85 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:42.047906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c46a9ea0-c58c-4713-8eb3-2829ad34be38 req-4b0550ab-bbc1-4ab5-be87-2adab130ed85 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:42.048819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c46a9ea0-c58c-4713-8eb3-2829ad34be38 req-4b0550ab-bbc1-4ab5-be87-2adab130ed85 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:42.060847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:42.062463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:42.063718 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-96cb921c-7fb5-4b78-920f-3ef32c9b7091 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 3.682128 Aug 27 02:43:42.064679 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1291/2876] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:38 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 3685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:42.070185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6dfd00f7-61ef-4761-bfbf-0cb6975fc55f req-39f49d23-6d75-487d-85ae-66037a5f90d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875762f1-6b75-4c91-859b-76fb857ecb26", "tag": "ef6abdee-33da-4ec5-9d71-9440e01d80d1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:42.124424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6dfd00f7-61ef-4761-bfbf-0cb6975fc55f req-39f49d23-6d75-487d-85ae-66037a5f90d0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:42.125309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6dfd00f7-61ef-4761-bfbf-0cb6975fc55f req-39f49d23-6d75-487d-85ae-66037a5f90d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:42.126377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6dfd00f7-61ef-4761-bfbf-0cb6975fc55f req-39f49d23-6d75-487d-85ae-66037a5f90d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:42.135416 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c46a9ea0-c58c-4713-8eb3-2829ad34be38 req-4b0550ab-bbc1-4ab5-be87-2adab130ed85 service nova] Creating event network-vif-unplugged:938a9794-4a8d-4ef4-92ab-23ae622e61c2 for instance b863d40c-1266-4beb-a51e-02d683ffba71 on n-h2-852084-5 Aug 27 02:43:42.186065 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6dfd00f7-61ef-4761-bfbf-0cb6975fc55f req-39f49d23-6d75-487d-85ae-66037a5f90d0 service nova] Creating event network-changed:ef6abdee-33da-4ec5-9d71-9440e01d80d1 for instance 875762f1-6b75-4c91-859b-76fb857ecb26 on n-h1-852084-5 Aug 27 02:43:42.186748 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c46a9ea0-c58c-4713-8eb3-2829ad34be38 req-4b0550ab-bbc1-4ab5-be87-2adab130ed85 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.193570 Aug 27 02:43:42.188132 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1586/2877] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:42.203913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c116aed4-b41c-485a-9b50-6ba5017c665d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:42.205484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c116aed4-b41c-485a-9b50-6ba5017c665d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:42.213805 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6dfd00f7-61ef-4761-bfbf-0cb6975fc55f req-39f49d23-6d75-487d-85ae-66037a5f90d0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147240 Aug 27 02:43:42.217977 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1292/2878] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:42.233960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c116aed4-b41c-485a-9b50-6ba5017c665d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:42.234851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c116aed4-b41c-485a-9b50-6ba5017c665d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:42.245194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04218619-faf5-4cef-8026-372a918a4f10 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Calling method '.version_select at 0x7f4d29a359d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:42.246487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c116aed4-b41c-485a-9b50-6ba5017c665d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:42.248520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c116aed4-b41c-485a-9b50-6ba5017c665d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:42.249476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c116aed4-b41c-485a-9b50-6ba5017c665d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:42.250600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c116aed4-b41c-485a-9b50-6ba5017c665d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:42.271488 n-d-852084-5 devstack@n-api.service[122487]: WARNING oslo_db.sqlalchemy.utils [None req-04218619-faf5-4cef-8026-372a918a4f10 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 02:43:42.306667 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-04218619-faf5-4cef-8026-372a918a4f10 tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.081894 Aug 27 02:43:42.317738 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1293/2879] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:43:42 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:42.337831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b1f5754-6e92-422c-86f9-3d91d5cd192b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:42.351246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9b1f5754-6e92-422c-86f9-3d91d5cd192b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:42.362702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b1f5754-6e92-422c-86f9-3d91d5cd192b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:42.371545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b1f5754-6e92-422c-86f9-3d91d5cd192b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:42.372495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b1f5754-6e92-422c-86f9-3d91d5cd192b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:42.373466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b1f5754-6e92-422c-86f9-3d91d5cd192b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:42.374154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b1f5754-6e92-422c-86f9-3d91d5cd192b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:42.374784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b1f5754-6e92-422c-86f9-3d91d5cd192b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:42.634973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c116aed4-b41c-485a-9b50-6ba5017c665d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:42.648439 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c116aed4-b41c-485a-9b50-6ba5017c665d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1314 microversion: 2.1 time: 0.454258 Aug 27 02:43:42.649249 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1587/2880] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:42 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:42.660617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9009bd47-707b-4701-9f20-a97bbdcd2eeb tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Calling method '.version_select at 0x7f4d29471940>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:42.686840 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9009bd47-707b-4701-9f20-a97bbdcd2eeb tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-719974776" status: 202 len: 0 microversion: 2.1 time: 0.035470 Aug 27 02:43:42.690151 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1588/2881] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:43:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-719974776 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:42.696259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab974204-de0e-4df1-844d-30f36f70143c tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Calling method '.version_select at 0x7f4d29413ee0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:42.743902 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab974204-de0e-4df1-844d-30f36f70143c tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-733323348" status: 202 len: 0 microversion: 2.1 time: 0.052199 Aug 27 02:43:42.747590 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1589/2882] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:43:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-733323348 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:42.752874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4f435978-1540-46f0-9428-803cd2aac07c tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] Calling method '.version_select at 0x7f4d2e764700>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:42.800049 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4f435978-1540-46f0-9428-803cd2aac07c tempest-KeyPairsV2TestJSON-390671235 tempest-KeyPairsV2TestJSON-390671235-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1153377791" status: 202 len: 0 microversion: 2.1 time: 0.050666 Aug 27 02:43:42.813036 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1590/2883] 10.222.0.99 () {58 vars in 1278 bytes} [Sat Aug 27 02:43:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1153377791 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:43:42.862601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c170977-b707-4da2-a3ea-73652337bc16 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:42.863144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3c170977-b707-4da2-a3ea-73652337bc16 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:42.880890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c170977-b707-4da2-a3ea-73652337bc16 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:42.882812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c170977-b707-4da2-a3ea-73652337bc16 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:42.883297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c170977-b707-4da2-a3ea-73652337bc16 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:42.885385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c170977-b707-4da2-a3ea-73652337bc16 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:42.885908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c170977-b707-4da2-a3ea-73652337bc16 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:42.886351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c170977-b707-4da2-a3ea-73652337bc16 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:42.965812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9b1f5754-6e92-422c-86f9-3d91d5cd192b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:42.978105 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9b1f5754-6e92-422c-86f9-3d91d5cd192b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1314 microversion: 2.1 time: 0.649729 Aug 27 02:43:42.996055 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1294/2884] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:42 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:43.011651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3c170977-b707-4da2-a3ea-73652337bc16 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:43.019934 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3c170977-b707-4da2-a3ea-73652337bc16 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1259 microversion: 2.1 time: 0.161328 Aug 27 02:43:43.025473 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1591/2885] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:42 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:43.111106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:43.112429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:43.147260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:43.149099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:43.153571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:43.158227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:43.158988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:43.161040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:43.679519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-095ea92f-b5f8-44fe-9e7f-0e58527ea033 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:43.680660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-095ea92f-b5f8-44fe-9e7f-0e58527ea033 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:43.719707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095ea92f-b5f8-44fe-9e7f-0e58527ea033 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:43.722069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095ea92f-b5f8-44fe-9e7f-0e58527ea033 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:43.726925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095ea92f-b5f8-44fe-9e7f-0e58527ea033 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:43.729460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095ea92f-b5f8-44fe-9e7f-0e58527ea033 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:43.730609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095ea92f-b5f8-44fe-9e7f-0e58527ea033 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:43.733804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095ea92f-b5f8-44fe-9e7f-0e58527ea033 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:44.869939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:44.885759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:44.900962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:44.907067 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dad0009a-db89-4b6c-9f5f-69f631b401bd tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 1.800064 Aug 27 02:43:44.932228 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1295/2886] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:43 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:44.932725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-095ea92f-b5f8-44fe-9e7f-0e58527ea033 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:44.938958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-150760f9-48b5-43b0-81d4-5611f0598851 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:44.950622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-150760f9-48b5-43b0-81d4-5611f0598851 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:44.967728 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-095ea92f-b5f8-44fe-9e7f-0e58527ea033 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1314 microversion: 2.1 time: 1.298211 Aug 27 02:43:44.979507 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1592/2887] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:43 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1314 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:44.988010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-150760f9-48b5-43b0-81d4-5611f0598851 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:44.993021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-150760f9-48b5-43b0-81d4-5611f0598851 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:44.998282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-150760f9-48b5-43b0-81d4-5611f0598851 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:45.000342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-150760f9-48b5-43b0-81d4-5611f0598851 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:45.003918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-23c6b4c6-886a-40e6-aaa9-4bb7cc8dc5df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:45.008627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-150760f9-48b5-43b0-81d4-5611f0598851 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:45.010185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-150760f9-48b5-43b0-81d4-5611f0598851 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:45.020327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-23c6b4c6-886a-40e6-aaa9-4bb7cc8dc5df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:45.048111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c6b4c6-886a-40e6-aaa9-4bb7cc8dc5df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:45.050941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c6b4c6-886a-40e6-aaa9-4bb7cc8dc5df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:45.052027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c6b4c6-886a-40e6-aaa9-4bb7cc8dc5df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:45.056451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c6b4c6-886a-40e6-aaa9-4bb7cc8dc5df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:45.057226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c6b4c6-886a-40e6-aaa9-4bb7cc8dc5df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:45.058683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c6b4c6-886a-40e6-aaa9-4bb7cc8dc5df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:45.269461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-23c6b4c6-886a-40e6-aaa9-4bb7cc8dc5df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:45.311287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:45.381001 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-23c6b4c6-886a-40e6-aaa9-4bb7cc8dc5df tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1265 microversion: 2.1 time: 0.378519 Aug 27 02:43:45.419610 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1593/2888] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:44 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1265 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:45.444917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a844a88a-a3d2-4c0e-ad1a-641f0d001d12 req-87883eb6-5914-4339-9018-dfc274a32dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b863d40c-1266-4beb-a51e-02d683ffba71", "name": "network-vif-deleted", "tag": "938a9794-4a8d-4ef4-92ab-23ae622e61c2"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:45.477819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a844a88a-a3d2-4c0e-ad1a-641f0d001d12 req-87883eb6-5914-4339-9018-dfc274a32dc1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:45.479084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a844a88a-a3d2-4c0e-ad1a-641f0d001d12 req-87883eb6-5914-4339-9018-dfc274a32dc1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:45.480095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a844a88a-a3d2-4c0e-ad1a-641f0d001d12 req-87883eb6-5914-4339-9018-dfc274a32dc1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:45.529055 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a844a88a-a3d2-4c0e-ad1a-641f0d001d12 req-87883eb6-5914-4339-9018-dfc274a32dc1 service nova] Creating event network-vif-deleted:938a9794-4a8d-4ef4-92ab-23ae622e61c2 for instance b863d40c-1266-4beb-a51e-02d683ffba71 on n-h2-852084-5 Aug 27 02:43:45.539931 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a844a88a-a3d2-4c0e-ad1a-641f0d001d12 req-87883eb6-5914-4339-9018-dfc274a32dc1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117252 Aug 27 02:43:45.550870 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1594/2889] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:45.581448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-152ebb6f-018b-472c-b443-b229628ca8d6 req-6709a170-67f3-4a01-9ea2-1e01bba218c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc6da4b-7eaa-4955-916f-f9400d8fb491", "name": "network-vif-plugged", "status": "completed", "tag": "26a8ce3a-caa5-463a-891c-4c436615cead"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:45.636153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-152ebb6f-018b-472c-b443-b229628ca8d6 req-6709a170-67f3-4a01-9ea2-1e01bba218c5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:45.642449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-152ebb6f-018b-472c-b443-b229628ca8d6 req-6709a170-67f3-4a01-9ea2-1e01bba218c5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:45.649034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-152ebb6f-018b-472c-b443-b229628ca8d6 req-6709a170-67f3-4a01-9ea2-1e01bba218c5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:45.703723 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-152ebb6f-018b-472c-b443-b229628ca8d6 req-6709a170-67f3-4a01-9ea2-1e01bba218c5 service nova] Creating event network-vif-plugged:26a8ce3a-caa5-463a-891c-4c436615cead for instance dbc6da4b-7eaa-4955-916f-f9400d8fb491 on n-h1-852084-5 Aug 27 02:43:45.727272 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-152ebb6f-018b-472c-b443-b229628ca8d6 req-6709a170-67f3-4a01-9ea2-1e01bba218c5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168775 Aug 27 02:43:45.731422 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1595/2890] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:45.884173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-150760f9-48b5-43b0-81d4-5611f0598851 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:45.899569 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-150760f9-48b5-43b0-81d4-5611f0598851 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1464 microversion: 2.1 time: 0.966096 Aug 27 02:43:45.914483 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1296/2891] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:44 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1464 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:45.940388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:45.941343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:45.955412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:45.956237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:45.965400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:45.966419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:45.967298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:45.967912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:46.622574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7cc3cd98-ec7d-4806-a7ce-570e2ecdc5cc tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:46.628151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:46.633318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7cc3cd98-ec7d-4806-a7ce-570e2ecdc5cc tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Searching by: {'deleted': False, 'project_id': '48e12b8f1e09457fa018d9c195414ba7'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:43:46.638203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:46.640208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:46.641747 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8c882b2e-5d8e-4a87-a733-53f4e0677355 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 0.705298 Aug 27 02:43:46.643005 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1297/2892] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:45 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:46.649158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cd5096ad-2708-45fd-8797-74bf58e6cb59 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:46.650122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cd5096ad-2708-45fd-8797-74bf58e6cb59 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:46.652001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cc3cd98-ec7d-4806-a7ce-570e2ecdc5cc tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:46.653883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cc3cd98-ec7d-4806-a7ce-570e2ecdc5cc tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:46.655928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cc3cd98-ec7d-4806-a7ce-570e2ecdc5cc tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:46.658175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cc3cd98-ec7d-4806-a7ce-570e2ecdc5cc tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:46.659879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cc3cd98-ec7d-4806-a7ce-570e2ecdc5cc tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:46.663052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cc3cd98-ec7d-4806-a7ce-570e2ecdc5cc tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:46.669544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd5096ad-2708-45fd-8797-74bf58e6cb59 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:46.670355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd5096ad-2708-45fd-8797-74bf58e6cb59 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:46.670970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd5096ad-2708-45fd-8797-74bf58e6cb59 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:46.671896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd5096ad-2708-45fd-8797-74bf58e6cb59 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:46.672541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd5096ad-2708-45fd-8797-74bf58e6cb59 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:46.673325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd5096ad-2708-45fd-8797-74bf58e6cb59 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:46.725013 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7cc3cd98-ec7d-4806-a7ce-570e2ecdc5cc tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.790429 Aug 27 02:43:46.737706 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1596/2893] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:43:45 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:43:46.737706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-12cf22e8-3f2d-4c93-8986-f7db8781ca5f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:46.737706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-12cf22e8-3f2d-4c93-8986-f7db8781ca5f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:46.748157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12cf22e8-3f2d-4c93-8986-f7db8781ca5f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:46.748157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12cf22e8-3f2d-4c93-8986-f7db8781ca5f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:46.748845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12cf22e8-3f2d-4c93-8986-f7db8781ca5f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:46.749810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12cf22e8-3f2d-4c93-8986-f7db8781ca5f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:46.750539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12cf22e8-3f2d-4c93-8986-f7db8781ca5f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:46.751134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12cf22e8-3f2d-4c93-8986-f7db8781ca5f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:46.951989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-12cf22e8-3f2d-4c93-8986-f7db8781ca5f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:46.975467 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-12cf22e8-3f2d-4c93-8986-f7db8781ca5f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1265 microversion: 2.1 time: 0.242112 Aug 27 02:43:46.983253 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1597/2894] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:46 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:46.999606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:47.030567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Searching by: {'deleted': False} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:43:47.049262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:47.055243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:47.056420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:47.059818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:47.063464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:47.068884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:47.384736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:43:47.747387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cd5096ad-2708-45fd-8797-74bf58e6cb59 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:47.758228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:47.763989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:47.766575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:47.773291 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cd5096ad-2708-45fd-8797-74bf58e6cb59 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1314 microversion: 2.1 time: 1.128905 Aug 27 02:43:47.785209 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1298/2895] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:46 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1314 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:47.804255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:47.808297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:47.836354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:47.836997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:47.837918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:47.838908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:47.839398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:47.839849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:47.980131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:48.056077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:48.451460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:48.465226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:48.466848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:48.468975 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-517147db-8b13-4e0c-b754-509dcfffd100 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 0.674026 Aug 27 02:43:48.470787 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1299/2896] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:47 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:48.492206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-261582d8-b234-4327-a6ad-f6ab0a0badc2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:48.492790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-261582d8-b234-4327-a6ad-f6ab0a0badc2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:48.501174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261582d8-b234-4327-a6ad-f6ab0a0badc2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:48.501699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261582d8-b234-4327-a6ad-f6ab0a0badc2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:48.502365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261582d8-b234-4327-a6ad-f6ab0a0badc2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:48.503393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261582d8-b234-4327-a6ad-f6ab0a0badc2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:48.504260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261582d8-b234-4327-a6ad-f6ab0a0badc2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:48.505638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261582d8-b234-4327-a6ad-f6ab0a0badc2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:48.746447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-261582d8-b234-4327-a6ad-f6ab0a0badc2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:48.764886 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-261582d8-b234-4327-a6ad-f6ab0a0badc2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1307 microversion: 2.1 time: 0.282491 Aug 27 02:43:48.767041 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1300/2897] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:48 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1307 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:48.811986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d4174d04-995a-4b6f-bd8d-8545897d59cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:48.814210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d4174d04-995a-4b6f-bd8d-8545897d59cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:48.837044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4174d04-995a-4b6f-bd8d-8545897d59cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:48.838312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4174d04-995a-4b6f-bd8d-8545897d59cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:48.839062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4174d04-995a-4b6f-bd8d-8545897d59cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:48.840222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4174d04-995a-4b6f-bd8d-8545897d59cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:48.841009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4174d04-995a-4b6f-bd8d-8545897d59cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:48.842451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4174d04-995a-4b6f-bd8d-8545897d59cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:49.086600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d4174d04-995a-4b6f-bd8d-8545897d59cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:49.098443 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d4174d04-995a-4b6f-bd8d-8545897d59cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1314 microversion: 2.1 time: 0.294158 Aug 27 02:43:49.099382 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1301/2898] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:48 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:49.180112 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1cb97f15-9c6a-4098-a43e-a51e364ef341 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 24355 microversion: 2.1 time: 2.194063 Aug 27 02:43:49.183013 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1598/2899] 10.222.0.99 () {58 vars in 1171 bytes} [Sat Aug 27 02:43:46 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 24355 bytes in 2199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:43:49.293969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2d0b97c8-e32f-4a1e-91b3-7b05f144e639 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:49.314569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2d0b97c8-e32f-4a1e-91b3-7b05f144e639 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Searching by: {'deleted': False, 'project_id': '48e12b8f1e09457fa018d9c195414ba7'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:43:49.337331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d0b97c8-e32f-4a1e-91b3-7b05f144e639 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:49.351470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d0b97c8-e32f-4a1e-91b3-7b05f144e639 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:49.352556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d0b97c8-e32f-4a1e-91b3-7b05f144e639 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:49.366150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d0b97c8-e32f-4a1e-91b3-7b05f144e639 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:49.366973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d0b97c8-e32f-4a1e-91b3-7b05f144e639 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:49.367668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d0b97c8-e32f-4a1e-91b3-7b05f144e639 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:49.484450 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2d0b97c8-e32f-4a1e-91b3-7b05f144e639 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/detail?tenant_id=c55251a7822148a8845f898a36865376" status: 200 len: 15 microversion: 2.1 time: 0.197104 Aug 27 02:43:49.485985 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1302/2900] 10.222.0.99 () {58 vars in 1231 bytes} [Sat Aug 27 02:43:49 2022] GET /compute/v2.1/servers/detail?tenant_id=c55251a7822148a8845f898a36865376 => generated 15 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:43:49.509894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:49.514838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:49.524936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:49.539580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Searching by: {'tenant_id': 'c55251a7822148a8845f898a36865376', 'deleted': False} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:43:49.547862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:49.548849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:49.552522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:49.554965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:49.555790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:49.556654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:49.557430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:49.561237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:49.562649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:49.568320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:49.568921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:49.569636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:49.717316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:43:49.778913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:49.839166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:49.840502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:49.843091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:50.193941 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1d80a666-299e-49c1-830c-39e9b0dac6dd tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c55251a7822148a8845f898a36865376" status: 200 len: 4826 microversion: 2.1 time: 0.678805 Aug 27 02:43:50.195258 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1303/2901] 10.222.0.99 () {58 vars in 1257 bytes} [Sat Aug 27 02:43:49 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c55251a7822148a8845f898a36865376 => generated 4826 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:50.387357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:50.406607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:50.411693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:50.415378 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b98098d-8fed-42b4-aa04-2f7a68214d4d tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 0.914972 Aug 27 02:43:50.437324 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1599/2902] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:49 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:50.458199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e54d552a-a33b-4d29-aecc-56630a8e8af9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:50.458855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e54d552a-a33b-4d29-aecc-56630a8e8af9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:50.467195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54d552a-a33b-4d29-aecc-56630a8e8af9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:50.467707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54d552a-a33b-4d29-aecc-56630a8e8af9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:50.468170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54d552a-a33b-4d29-aecc-56630a8e8af9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:50.469062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54d552a-a33b-4d29-aecc-56630a8e8af9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:50.469531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54d552a-a33b-4d29-aecc-56630a8e8af9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:50.470033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54d552a-a33b-4d29-aecc-56630a8e8af9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:50.480105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea02d1a0-205f-4367-aec9-6d8260ccbc13 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Action: 'create', calling method: .version_select at 0x7f4d29a01940>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrTqvKKmwRijnFFLQTrP409MGI0nEieaYEdm5o6WHLs7Tu8g983kfZth6qwD0LCdwDQLNt1JBV8aP2on9pScikqw4otv/IcQRMM991G7T4aCQdesZ/1vPo3SHIUPwKjKA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea02d1a0-205f-4367-aec9-6d8260ccbc13 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Request method failure captured: Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 257 Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYTlkgZ-UqHK1luFuDAW9Ku_5IdqNXNnaeI1hWYN0Al8eNTZEA13zPOhLPOviyK2kLBIbeQMBPN50oEapIu935LB1LwDQZpst9PEF3T7t0Smp5ThebK8HFW1pbQB-6f_gC6wokgBof4BAmHdy5ygc3YxiTicl2lZGjkiQ_0YCDf5KlA Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/df6e8ab0706b4e439e7b9a7b269b6feb"}]}] Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 9481957f63994fcb917b724cf2758085 Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrTqvKKmwRijnFFLQTrP409MGI0nEieaYEdm5o6WHLs7Tu8g983kfZth6qwD0LCdwDQLNt1JBV8aP2on9pScikqw4otv/IcQRMM991G7T4aCQdesZ/1vPo3SHIUPwKjKA=="}} Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrTqvKKmwRijnFFLQTrP409MGI0nEieaYEdm5o6WHLs7Tu8g983kfZth6qwD0LCdwDQLNt1JBV8aP2on9pScikqw4otv/IcQRMM991G7T4aCQdesZ/1vPo3SHIUPwKjKA=='}}} Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 27 02:43:50.485490 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 27 02:43:50.490707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:50.498780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea02d1a0-205f-4367-aec9-6d8260ccbc13 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:50.500791 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ea02d1a0-205f-4367-aec9-6d8260ccbc13 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.303424 Aug 27 02:43:50.511686 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1304/2903] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:50 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 315 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:43:50.519188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-706bdb18-8204-4af5-b670-0659c6dc4ef3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:50.520210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-706bdb18-8204-4af5-b670-0659c6dc4ef3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:50.529373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-706bdb18-8204-4af5-b670-0659c6dc4ef3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:50.529926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-706bdb18-8204-4af5-b670-0659c6dc4ef3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:50.530376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-706bdb18-8204-4af5-b670-0659c6dc4ef3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:50.531105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-706bdb18-8204-4af5-b670-0659c6dc4ef3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:50.531920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-706bdb18-8204-4af5-b670-0659c6dc4ef3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:50.532364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-706bdb18-8204-4af5-b670-0659c6dc4ef3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:50.901334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e54d552a-a33b-4d29-aecc-56630a8e8af9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:50.915392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-706bdb18-8204-4af5-b670-0659c6dc4ef3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:50.920262 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e54d552a-a33b-4d29-aecc-56630a8e8af9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1307 microversion: 2.1 time: 0.479876 Aug 27 02:43:50.922416 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1600/2904] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:50 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1307 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:50.934705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8939b00-ec3e-4fe7-9b10-1b0d3f735e16 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:50.937903 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-706bdb18-8204-4af5-b670-0659c6dc4ef3 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1500 microversion: 2.1 time: 0.423955 Aug 27 02:43:50.938477 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1305/2905] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:50 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1500 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:50.948294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c8939b00-ec3e-4fe7-9b10-1b0d3f735e16 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Searching by: {'tenant_id': '48e12b8f1e09457fa018d9c195414ba7', 'deleted': False} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:43:50.959293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8939b00-ec3e-4fe7-9b10-1b0d3f735e16 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:50.960750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8939b00-ec3e-4fe7-9b10-1b0d3f735e16 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:50.962003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8939b00-ec3e-4fe7-9b10-1b0d3f735e16 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:50.962205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-153d6154-9ee3-48e6-942a-46ac81946fff tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Action: 'create', calling method: .version_select at 0x7f4d29a1b280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-44522014", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:50.964105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8939b00-ec3e-4fe7-9b10-1b0d3f735e16 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:50.966967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8939b00-ec3e-4fe7-9b10-1b0d3f735e16 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:50.970044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8939b00-ec3e-4fe7-9b10-1b0d3f735e16 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:50.998558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-153d6154-9ee3-48e6-942a-46ac81946fff tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Getting quotas for project df6e8ab0706b4e439e7b9a7b269b6feb. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:51.011912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-153d6154-9ee3-48e6-942a-46ac81946fff tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Getting quotas for user 9481957f63994fcb917b724cf2758085 and project df6e8ab0706b4e439e7b9a7b269b6feb. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:51.037831 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c8939b00-ec3e-4fe7-9b10-1b0d3f735e16 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=48e12b8f1e09457fa018d9c195414ba7" status: 200 len: 15 microversion: 2.1 time: 0.113164 Aug 27 02:43:51.039638 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1601/2906] 10.222.0.99 () {58 vars in 1257 bytes} [Sat Aug 27 02:43:50 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=48e12b8f1e09457fa018d9c195414ba7 => generated 15 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:43:51.047710 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-153d6154-9ee3-48e6-942a-46ac81946fff tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:51.050199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c800f590-47cd-4715-bb92-833efda12520 req-d098c11e-7c82-44e5-9e3e-cd0f5fda9c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e103b49d-103b-42ab-8f83-f00e41579687", "tag": "486f8f25-2be4-44c1-9ea0-b1d4afdaa66d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:51.073115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c800f590-47cd-4715-bb92-833efda12520 req-d098c11e-7c82-44e5-9e3e-cd0f5fda9c1f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:51.075594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c800f590-47cd-4715-bb92-833efda12520 req-d098c11e-7c82-44e5-9e3e-cd0f5fda9c1f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:51.077314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c800f590-47cd-4715-bb92-833efda12520 req-d098c11e-7c82-44e5-9e3e-cd0f5fda9c1f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-153d6154-9ee3-48e6-942a-46ac81946fff tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Request method failure captured: Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 2165 Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYTlkgZ-UqHK1luFuDAW9Ku_5IdqNXNnaeI1hWYN0Al8eNTZEA13zPOhLPOviyK2kLBIbeQMBPN50oEapIu935LB1LwDQZpst9PEF3T7t0Smp5ThebK8HFW1pbQB-6f_gC6wokgBof4BAmHdy5ygc3YxiTicl2lZGjkiQ_0YCDf5KlA Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/df6e8ab0706b4e439e7b9a7b269b6feb"}]}] Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 9481957f63994fcb917b724cf2758085 Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-44522014", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:43:51.085027 n-d-852084-5 devstack@n-api.service[122487]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-44522014', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:51.089235 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-153d6154-9ee3-48e6-942a-46ac81946fff tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-153d6154-9ee3-48e6-942a-46ac81946fff tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.149881 Aug 27 02:43:51.104475 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1306/2907] 10.222.0.99 () {60 vars in 1160 bytes} [Sat Aug 27 02:43:50 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:43:51.119355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0dfa4e04-c9db-467a-b1f3-e2057704f3d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:51.120379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0dfa4e04-c9db-467a-b1f3-e2057704f3d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:51.135132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0dfa4e04-c9db-467a-b1f3-e2057704f3d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:51.136919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0dfa4e04-c9db-467a-b1f3-e2057704f3d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:51.137052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0dfa4e04-c9db-467a-b1f3-e2057704f3d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:51.138423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0dfa4e04-c9db-467a-b1f3-e2057704f3d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:51.138769 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c800f590-47cd-4715-bb92-833efda12520 req-d098c11e-7c82-44e5-9e3e-cd0f5fda9c1f service nova] Creating event network-changed:486f8f25-2be4-44c1-9ea0-b1d4afdaa66d for instance e103b49d-103b-42ab-8f83-f00e41579687 on n-h1-852084-5 Aug 27 02:43:51.139421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0dfa4e04-c9db-467a-b1f3-e2057704f3d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:51.142501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0dfa4e04-c9db-467a-b1f3-e2057704f3d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:51.151519 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c800f590-47cd-4715-bb92-833efda12520 req-d098c11e-7c82-44e5-9e3e-cd0f5fda9c1f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109628 Aug 27 02:43:51.152218 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1602/2908] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:51.171336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b09360e2-98da-4745-9205-53b614bc7198 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:51.178612 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b09360e2-98da-4745-9205-53b614bc7198 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.024939 Aug 27 02:43:51.179166 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1603/2909] 10.222.0.99 () {58 vars in 1189 bytes} [Sat Aug 27 02:43:51 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:43:51.184421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-281f720d-2642-45e9-ae6f-56437d2ec65e tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Action: 'create', calling method: .version_select at 0x7f4d2932c550>, body: {"keypair": {"name": "tempest-keypair-679737734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf8wIGvWBe8l8IjIE5zz9MTPcfJYoME25huDiPhzLAQR14tYjClRXe04teCIgouowxBehDX6kV8F3HtKItTmphmb7yee3YO92yjJtsdt8PcaeJiApD8kmdBYjntjHmneQ=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:51.204871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-281f720d-2642-45e9-ae6f-56437d2ec65e tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Getting quotas for project df6e8ab0706b4e439e7b9a7b269b6feb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:51.213386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-281f720d-2642-45e9-ae6f-56437d2ec65e tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Getting quotas for user 9481957f63994fcb917b724cf2758085 and project df6e8ab0706b4e439e7b9a7b269b6feb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:51.253888 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-281f720d-2642-45e9-ae6f-56437d2ec65e tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072946 Aug 27 02:43:51.272841 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1604/2910] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:51.288121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c04e6130-5591-42ad-aa4f-d5712e5eb0db tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:51.294354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c04e6130-5591-42ad-aa4f-d5712e5eb0db tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:51.319451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c04e6130-5591-42ad-aa4f-d5712e5eb0db tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:51.320718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c04e6130-5591-42ad-aa4f-d5712e5eb0db tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:51.321897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c04e6130-5591-42ad-aa4f-d5712e5eb0db tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:51.324263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c04e6130-5591-42ad-aa4f-d5712e5eb0db tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:51.326192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c04e6130-5591-42ad-aa4f-d5712e5eb0db tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:51.327577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c04e6130-5591-42ad-aa4f-d5712e5eb0db tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:51.391924 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0dfa4e04-c9db-467a-b1f3-e2057704f3d0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491/action" status: 202 len: 0 microversion: 2.1 time: 0.281387 Aug 27 02:43:51.396111 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1307/2911] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:43:51 2022] POST /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:51.444845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5163196a-05a8-4462-91a4-32fbb7eea3d4 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Action: 'create', calling method: .version_select at 0x7f4d29a443a0>, body: {"keypair": {"name": "tempest-keypair-679737734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKuujXXZzo4X4nA/BGahphM4sgLw23vCctGYz+IGYYaHCYnMJDAokgCZWrDnLVeEKvCHMcGWVgKJXbYB5+lIrI34SQfJHcOqhLa4lNxqPoVqAucyRe+rVw5sIoB6IaYnQ=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:51.512929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-5163196a-05a8-4462-91a4-32fbb7eea3d4 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Getting quotas for project df6e8ab0706b4e439e7b9a7b269b6feb. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:51.530191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-5163196a-05a8-4462-91a4-32fbb7eea3d4 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Getting quotas for user 9481957f63994fcb917b724cf2758085 and project df6e8ab0706b4e439e7b9a7b269b6feb. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:51.560012 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c04e6130-5591-42ad-aa4f-d5712e5eb0db tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action" status: 202 len: 0 microversion: 2.1 time: 0.284256 Aug 27 02:43:51.564587 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1605/2912] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:43:51 2022] POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:51.576220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-51f1a55d-50bc-42c0-bf9a-8a25c49ad686 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:51.578594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-51f1a55d-50bc-42c0-bf9a-8a25c49ad686 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:51.590439 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-5163196a-05a8-4462-91a4-32fbb7eea3d4 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] HTTP exception thrown: Key pair 'tempest-keypair-679737734' already exists. Aug 27 02:43:51.592350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f1a55d-50bc-42c0-bf9a-8a25c49ad686 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:51.592863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f1a55d-50bc-42c0-bf9a-8a25c49ad686 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:51.593349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f1a55d-50bc-42c0-bf9a-8a25c49ad686 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:51.594101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f1a55d-50bc-42c0-bf9a-8a25c49ad686 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:51.594626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f1a55d-50bc-42c0-bf9a-8a25c49ad686 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:51.595070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f1a55d-50bc-42c0-bf9a-8a25c49ad686 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5163196a-05a8-4462-91a4-32fbb7eea3d4 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Request method failure captured: Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 272 Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYTlkgZ-UqHK1luFuDAW9Ku_5IdqNXNnaeI1hWYN0Al8eNTZEA13zPOhLPOviyK2kLBIbeQMBPN50oEapIu935LB1LwDQZpst9PEF3T7t0Smp5ThebK8HFW1pbQB-6f_gC6wokgBof4BAmHdy5ygc3YxiTicl2lZGjkiQ_0YCDf5KlA Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/df6e8ab0706b4e439e7b9a7b269b6feb"}]}] Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 9481957f63994fcb917b724cf2758085 Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: {"keypair": {"name": "tempest-keypair-679737734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKuujXXZzo4X4nA/BGahphM4sgLw23vCctGYz+IGYYaHCYnMJDAokgCZWrDnLVeEKvCHMcGWVgKJXbYB5+lIrI34SQfJHcOqhLa4lNxqPoVqAucyRe+rVw5sIoB6IaYnQ=="}} Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: exception: Key pair 'tempest-keypair-679737734' already exists. Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-679737734', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKuujXXZzo4X4nA/BGahphM4sgLw23vCctGYz+IGYYaHCYnMJDAokgCZWrDnLVeEKvCHMcGWVgKJXbYB5+lIrI34SQfJHcOqhLa4lNxqPoVqAucyRe+rVw5sIoB6IaYnQ=='}}} Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '9481957f63994fcb917b724cf2758085-tempest-keypair-679737734' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 02:43:51.617871 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi session.flush() Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result.read() Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 27 02:43:51.629104 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '9481957f63994fcb917b724cf2758085-tempest-keypair-679737734' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 27, 2, 43, 51, 575501), 'updated_at': None, 'name': 'tempest-keypair-679737734', 'user_id': '9481957f63994fcb917b724cf2758085', 'fingerprint': '69:f0:a8:c5:7a:f1:3b:4d:6c:dd:9b:4d:45:8b:1e:28', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKuujXXZzo4X4nA/BGahphM4sgLw23vCctGYz+IGYYaHCYnMJDAokgCZWrDnLVeEKvCHMcGWVgKJXbYB5+lIrI34SQfJHcOqhLa4lNxqPoVqAucyRe+rVw5sIoB6IaYnQ==', 'type': 'ssh'}] Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi keypair.create() Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._create() Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-679737734' already exists. Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 27 02:43:51.638605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-679737734' already exists. Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-679737734' already exists. Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5163196a-05a8-4462-91a4-32fbb7eea3d4 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Returning 409 to user: Key pair 'tempest-keypair-679737734' already exists. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5163196a-05a8-4462-91a4-32fbb7eea3d4 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.219642 Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1308/2913] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:51 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 232 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:43:51.648437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:51.650449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:51.665782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:51.666622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:51.667408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:51.668713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:51.669545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:51.670372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:51.865544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-51f1a55d-50bc-42c0-bf9a-8a25c49ad686 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:51.880662 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-51f1a55d-50bc-42c0-bf9a-8a25c49ad686 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1505 microversion: 2.1 time: 0.316476 Aug 27 02:43:51.898940 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1606/2914] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:51 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:51.921101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c4d87286-8d55-4469-896f-a354d7855173 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:51.931492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c4d87286-8d55-4469-896f-a354d7855173 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:51.933284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c4d87286-8d55-4469-896f-a354d7855173 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c55251a7822148a8845f898a36865376'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:43:51.946269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4d87286-8d55-4469-896f-a354d7855173 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:51.947552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4d87286-8d55-4469-896f-a354d7855173 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:51.948619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4d87286-8d55-4469-896f-a354d7855173 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:51.950365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4d87286-8d55-4469-896f-a354d7855173 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:51.951627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4d87286-8d55-4469-896f-a354d7855173 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:51.952838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4d87286-8d55-4469-896f-a354d7855173 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.019056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-c4d87286-8d55-4469-896f-a354d7855173 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:43:52.107606 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c4d87286-8d55-4469-896f-a354d7855173 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.206489 Aug 27 02:43:52.110869 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1607/2915] 10.222.0.99 () {58 vars in 1150 bytes} [Sat Aug 27 02:43:51 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:52.125001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0fa566ef-2fdf-4467-990d-fad5f38eb684 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Calling method '.version_select at 0x7f4d2e8bc0d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:52.168144 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0fa566ef-2fdf-4467-990d-fad5f38eb684 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-679737734" status: 202 len: 0 microversion: 2.1 time: 0.052880 Aug 27 02:43:52.178430 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1608/2916] 10.222.0.99 () {58 vars in 1218 bytes} [Sat Aug 27 02:43:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-679737734 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:52.182465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-23620f82-3665-4c59-8577-98089d26479d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:52.183788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-23620f82-3665-4c59-8577-98089d26479d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:52.199082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23620f82-3665-4c59-8577-98089d26479d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.201021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23620f82-3665-4c59-8577-98089d26479d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.201933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23620f82-3665-4c59-8577-98089d26479d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.203334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23620f82-3665-4c59-8577-98089d26479d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.204267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23620f82-3665-4c59-8577-98089d26479d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.205060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23620f82-3665-4c59-8577-98089d26479d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.359808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:52.374271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:52.377131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:52.381054 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-070f629c-61a0-44db-997e-c1a503ce2bcc tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 0.747171 Aug 27 02:43:52.382586 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1309/2917] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:51 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:52.388377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a0c45643-aa67-498a-81d9-587d757d6772 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:52.391317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a0c45643-aa67-498a-81d9-587d757d6772 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:52.401042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0c45643-aa67-498a-81d9-587d757d6772 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.402219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0c45643-aa67-498a-81d9-587d757d6772 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.402881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0c45643-aa67-498a-81d9-587d757d6772 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.403801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0c45643-aa67-498a-81d9-587d757d6772 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.404451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0c45643-aa67-498a-81d9-587d757d6772 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.405051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0c45643-aa67-498a-81d9-587d757d6772 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.442657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-23620f82-3665-4c59-8577-98089d26479d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:52.454351 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-23620f82-3665-4c59-8577-98089d26479d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1307 microversion: 2.1 time: 0.282497 Aug 27 02:43:52.468024 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1609/2918] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:52 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:52.475743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37c5ddcd-1f8e-447d-81a5-d330ca2b21cd tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Action: 'create', calling method: .version_select at 0x7f4d2a100b80>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEDE1pRmN1fILxB6wDcGQV0l5UJo8TKqq0hK61DhemzVPRFwKtEA8FQVqsJu24ZJLd6k0Tc36hM6LHTaD3BdA21RWnLt3DKuKEarkcacUSE0SJTYZj3GicKqdeOubLLgw=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37c5ddcd-1f8e-447d-81a5-d330ca2b21cd tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Request method failure captured: Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 247 Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYTlkgZ-UqHK1luFuDAW9Ku_5IdqNXNnaeI1hWYN0Al8eNTZEA13zPOhLPOviyK2kLBIbeQMBPN50oEapIu935LB1LwDQZpst9PEF3T7t0Smp5ThebK8HFW1pbQB-6f_gC6wokgBof4BAmHdy5ygc3YxiTicl2lZGjkiQ_0YCDf5KlA Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/df6e8ab0706b4e439e7b9a7b269b6feb"}]}] Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9481957f63994fcb917b724cf2758085 Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEDE1pRmN1fILxB6wDcGQV0l5UJo8TKqq0hK61DhemzVPRFwKtEA8FQVqsJu24ZJLd6k0Tc36hM6LHTaD3BdA21RWnLt3DKuKEarkcacUSE0SJTYZj3GicKqdeOubLLgw=="}} Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEDE1pRmN1fILxB6wDcGQV0l5UJo8TKqq0hK61DhemzVPRFwKtEA8FQVqsJu24ZJLd6k0Tc36hM6LHTaD3BdA21RWnLt3DKuKEarkcacUSE0SJTYZj3GicKqdeOubLLgw=='}}} Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi '' Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:43:52.480336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37c5ddcd-1f8e-447d-81a5-d330ca2b21cd tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-37c5ddcd-1f8e-447d-81a5-d330ca2b21cd tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.011387 Aug 27 02:43:52.491833 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1610/2919] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:52 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:43:52.497205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-476d32f7-950a-4179-8a7b-58e79e74f1db tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Action: 'create', calling method: .version_select at 0x7f4d2934e550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-679195869", "public_key": " "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:52.517081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-476d32f7-950a-4179-8a7b-58e79e74f1db tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Getting quotas for project df6e8ab0706b4e439e7b9a7b269b6feb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:52.524263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-476d32f7-950a-4179-8a7b-58e79e74f1db tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Getting quotas for user 9481957f63994fcb917b724cf2758085 and project df6e8ab0706b4e439e7b9a7b269b6feb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:52.545344 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-476d32f7-950a-4179-8a7b-58e79e74f1db tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-476d32f7-950a-4179-8a7b-58e79e74f1db tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Request method failure captured: Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 94 Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYTlkgZ-UqHK1luFuDAW9Ku_5IdqNXNnaeI1hWYN0Al8eNTZEA13zPOhLPOviyK2kLBIbeQMBPN50oEapIu935LB1LwDQZpst9PEF3T7t0Smp5ThebK8HFW1pbQB-6f_gC6wokgBof4BAmHdy5ygc3YxiTicl2lZGjkiQ_0YCDf5KlA Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/df6e8ab0706b4e439e7b9a7b269b6feb"}]}] Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9481957f63994fcb917b724cf2758085 Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-679195869", "public_key": " "}} Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-679195869', 'public_key': ' '}}} Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.548356 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-476d32f7-950a-4179-8a7b-58e79e74f1db tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:52.553305 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-476d32f7-950a-4179-8a7b-58e79e74f1db tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.062109 Aug 27 02:43:52.559317 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1611/2920] 10.222.0.99 () {60 vars in 1158 bytes} [Sat Aug 27 02:43:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 27 02:43:52.567633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7460057e-606e-4058-8ebf-d33d59dc9629 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Action: 'create', calling method: .version_select at 0x7f4d2934e790>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFy01kqRcmhI5eAzJFnGJw7W9vax58LQFGLCHvOXPnTPB752BW/2I5y8pST5yYuoxjeyRN8KgSFKqwPKq0Rp05F994o+9kA4mNDXyJ5ecOygG8gosK6Vxvg5Ofc28vJYWQ=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7460057e-606e-4058-8ebf-d33d59dc9629 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Request method failure captured: Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 507 Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYTlkgZ-UqHK1luFuDAW9Ku_5IdqNXNnaeI1hWYN0Al8eNTZEA13zPOhLPOviyK2kLBIbeQMBPN50oEapIu935LB1LwDQZpst9PEF3T7t0Smp5ThebK8HFW1pbQB-6f_gC6wokgBof4BAmHdy5ygc3YxiTicl2lZGjkiQ_0YCDf5KlA Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/df6e8ab0706b4e439e7b9a7b269b6feb"}]}] Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9481957f63994fcb917b724cf2758085 Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFy01kqRcmhI5eAzJFnGJw7W9vax58LQFGLCHvOXPnTPB752BW/2I5y8pST5yYuoxjeyRN8KgSFKqwPKq0Rp05F994o+9kA4mNDXyJ5ecOygG8gosK6Vxvg5Ofc28vJYWQ=="}} Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFy01kqRcmhI5eAzJFnGJw7W9vax58LQFGLCHvOXPnTPB752BW/2I5y8pST5yYuoxjeyRN8KgSFKqwPKq0Rp05F994o+9kA4mNDXyJ5ecOygG8gosK6Vxvg5Ofc28vJYWQ=='}}} Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 27 02:43:52.573249 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 27 02:43:52.578028 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.583403 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a0c45643-aa67-498a-81d9-587d757d6772 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action" status: 202 len: 0 microversion: 2.1 time: 0.190898 Aug 27 02:43:52.583403 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1310/2921] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:43:52 2022] POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:52.586168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7460057e-606e-4058-8ebf-d33d59dc9629 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:52.589232 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7460057e-606e-4058-8ebf-d33d59dc9629 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.026539 Aug 27 02:43:52.592445 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1612/2922] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:52 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:43:52.606941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c77f503e-8b17-4921-a145-74fc71d08fc3 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Action: 'create', calling method: .version_select at 0x7f4d29907280>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-379258744", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:52.610127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8dbba709-5476-4884-b286-5bd3c12f17e2 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:52.611483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8dbba709-5476-4884-b286-5bd3c12f17e2 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:52.627831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dbba709-5476-4884-b286-5bd3c12f17e2 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.629129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dbba709-5476-4884-b286-5bd3c12f17e2 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.630553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dbba709-5476-4884-b286-5bd3c12f17e2 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.631978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dbba709-5476-4884-b286-5bd3c12f17e2 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.633285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dbba709-5476-4884-b286-5bd3c12f17e2 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.634425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dbba709-5476-4884-b286-5bd3c12f17e2 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.664755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-c77f503e-8b17-4921-a145-74fc71d08fc3 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Getting quotas for project df6e8ab0706b4e439e7b9a7b269b6feb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:43:52.671116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-c77f503e-8b17-4921-a145-74fc71d08fc3 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Getting quotas for user 9481957f63994fcb917b724cf2758085 and project df6e8ab0706b4e439e7b9a7b269b6feb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:43:52.700259 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-c77f503e-8b17-4921-a145-74fc71d08fc3 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c77f503e-8b17-4921-a145-74fc71d08fc3 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Request method failure captured: Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 117 Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYTlkgZ-UqHK1luFuDAW9Ku_5IdqNXNnaeI1hWYN0Al8eNTZEA13zPOhLPOviyK2kLBIbeQMBPN50oEapIu935LB1LwDQZpst9PEF3T7t0Smp5ThebK8HFW1pbQB-6f_gC6wokgBof4BAmHdy5ygc3YxiTicl2lZGjkiQ_0YCDf5KlA Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/df6e8ab0706b4e439e7b9a7b269b6feb"}]}] Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9481957f63994fcb917b724cf2758085 Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-379258744", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: exception: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-379258744', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 27 02:43:52.703225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 27 02:43:52.707212 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.711332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c77f503e-8b17-4921-a145-74fc71d08fc3 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:52.712235 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c77f503e-8b17-4921-a145-74fc71d08fc3 tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.110732 Aug 27 02:43:52.712837 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1613/2923] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:43:52 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:43:52.729226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c800697-47ea-45ed-99d8-6f678f1151ae tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Calling method '.version_select at 0x7f4d2934ee50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:52.738526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:52.745221 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-1c800697-47ea-45ed-99d8-6f678f1151ae tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1738391011 not found for user 9481957f63994fcb917b724cf2758085 Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c800697-47ea-45ed-99d8-6f678f1151ae tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Request method failure captured: Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1738391011 HTTP/1.1 Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYTlkgZ-UqHK1luFuDAW9Ku_5IdqNXNnaeI1hWYN0Al8eNTZEA13zPOhLPOviyK2kLBIbeQMBPN50oEapIu935LB1LwDQZpst9PEF3T7t0Smp5ThebK8HFW1pbQB-6f_gC6wokgBof4BAmHdy5ygc3YxiTicl2lZGjkiQ_0YCDf5KlA Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/df6e8ab0706b4e439e7b9a7b269b6feb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/df6e8ab0706b4e439e7b9a7b269b6feb"}]}] Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: df6e8ab0706b4e439e7b9a7b269b6feb Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-658813164 Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9481957f63994fcb917b724cf2758085 Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-KeyPairsNegativeTestJSON-658813164-project Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: exception: Keypair tempest-keypair-non-existent-1738391011 not found for user 9481957f63994fcb917b724cf2758085 Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'tempest-keypair-non-existent-1738391011'} Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise self.value Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1738391011 not found for user 9481957f63994fcb917b724cf2758085 Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.747419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1738391011 not found for user 9481957f63994fcb917b724cf2758085 Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1738391011 not found for user 9481957f63994fcb917b724cf2758085 Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c800697-47ea-45ed-99d8-6f678f1151ae tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1738391011 not found for user 9481957f63994fcb917b724cf2758085 {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:43:52.751821 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c800697-47ea-45ed-99d8-6f678f1151ae tempest-KeyPairsNegativeTestJSON-658813164 tempest-KeyPairsNegativeTestJSON-658813164-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1738391011" status: 404 len: 145 microversion: 2.1 time: 0.023726 Aug 27 02:43:52.754475 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1614/2924] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:43:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1738391011 => generated 145 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:43:52.916664 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8dbba709-5476-4884-b286-5bd3c12f17e2 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1614 microversion: 2.1 time: 0.321845 Aug 27 02:43:52.918449 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1311/2925] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:52 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1614 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:52.946656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0b118141-311e-4025-b817-dd35e6e65e1e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:52.951450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0b118141-311e-4025-b817-dd35e6e65e1e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:52.958138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45e9db20-3df4-4c87-aaca-bfc481437ecb tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:52.963944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-45e9db20-3df4-4c87-aaca-bfc481437ecb tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:52.980354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45e9db20-3df4-4c87-aaca-bfc481437ecb tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.981219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45e9db20-3df4-4c87-aaca-bfc481437ecb tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.981994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45e9db20-3df4-4c87-aaca-bfc481437ecb tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.982471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b118141-311e-4025-b817-dd35e6e65e1e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.983009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45e9db20-3df4-4c87-aaca-bfc481437ecb tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.983189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b118141-311e-4025-b817-dd35e6e65e1e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.983674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45e9db20-3df4-4c87-aaca-bfc481437ecb tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.984232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45e9db20-3df4-4c87-aaca-bfc481437ecb tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.984648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b118141-311e-4025-b817-dd35e6e65e1e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:52.986462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b118141-311e-4025-b817-dd35e6e65e1e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:52.989361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b118141-311e-4025-b817-dd35e6e65e1e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:52.990285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b118141-311e-4025-b817-dd35e6e65e1e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:53.320032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0b118141-311e-4025-b817-dd35e6e65e1e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:53.336225 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0b118141-311e-4025-b817-dd35e6e65e1e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1485 microversion: 2.1 time: 0.410879 Aug 27 02:43:53.340502 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1615/2926] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:52 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1485 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:53.374887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-15e75db9-3ef0-4437-81fa-475ca8836886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:53.383057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-15e75db9-3ef0-4437-81fa-475ca8836886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:53.402907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e75db9-3ef0-4437-81fa-475ca8836886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:53.403710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e75db9-3ef0-4437-81fa-475ca8836886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:53.404352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e75db9-3ef0-4437-81fa-475ca8836886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:53.405108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e75db9-3ef0-4437-81fa-475ca8836886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:53.405590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e75db9-3ef0-4437-81fa-475ca8836886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:53.406072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e75db9-3ef0-4437-81fa-475ca8836886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:53.452736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-15e75db9-3ef0-4437-81fa-475ca8836886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lazy-loading 'flavor' on Instance uuid dbc6da4b-7eaa-4955-916f-f9400d8fb491 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:43:53.782097 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-15e75db9-3ef0-4437-81fa-475ca8836886 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491/action" status: 202 len: 0 microversion: 2.1 time: 0.419244 Aug 27 02:43:53.794018 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1616/2927] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:43:53 2022] POST /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:53.801924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:53.802941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:53.813148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:53.817555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:53.818488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:53.819802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:53.821661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:53.824446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:53.832077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:54.118355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:54.139035 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-45e9db20-3df4-4c87-aaca-bfc481437ecb tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1614 microversion: 2.1 time: 1.198856 Aug 27 02:43:54.139670 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1312/2928] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:52 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1614 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:54.142494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:54.148296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:54.149904 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-748391ad-46ae-4b74-b61a-1896f466315e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 0.353454 Aug 27 02:43:54.152013 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1617/2929] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:53 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:54.158197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2154d62a-375c-45e7-a469-a90f6bd51b74 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:54.159275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2154d62a-375c-45e7-a469-a90f6bd51b74 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:54.191487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7d9c058c-e4f2-4d86-a033-7a9cbfdf1a08 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:54.193219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2154d62a-375c-45e7-a469-a90f6bd51b74 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.193864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2154d62a-375c-45e7-a469-a90f6bd51b74 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.194275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7d9c058c-e4f2-4d86-a033-7a9cbfdf1a08 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:54.194482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2154d62a-375c-45e7-a469-a90f6bd51b74 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.195534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2154d62a-375c-45e7-a469-a90f6bd51b74 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.196111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2154d62a-375c-45e7-a469-a90f6bd51b74 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.196960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2154d62a-375c-45e7-a469-a90f6bd51b74 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.210882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d9c058c-e4f2-4d86-a033-7a9cbfdf1a08 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.211783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d9c058c-e4f2-4d86-a033-7a9cbfdf1a08 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.213116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d9c058c-e4f2-4d86-a033-7a9cbfdf1a08 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.214515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d9c058c-e4f2-4d86-a033-7a9cbfdf1a08 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.215877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d9c058c-e4f2-4d86-a033-7a9cbfdf1a08 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.217077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d9c058c-e4f2-4d86-a033-7a9cbfdf1a08 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.514661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2154d62a-375c-45e7-a469-a90f6bd51b74 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:54.523374 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2154d62a-375c-45e7-a469-a90f6bd51b74 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1491 microversion: 2.1 time: 0.369989 Aug 27 02:43:54.527339 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1618/2930] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:54 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1491 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:54.541195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b2bd3e97-75e6-4aae-8ed2-ff4b87cdcfe4 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:54.547884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b2bd3e97-75e6-4aae-8ed2-ff4b87cdcfe4 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Searching by: {'host': 'n-h2-852084-5', 'deleted': False} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:43:54.562313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2bd3e97-75e6-4aae-8ed2-ff4b87cdcfe4 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.563421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2bd3e97-75e6-4aae-8ed2-ff4b87cdcfe4 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.564910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2bd3e97-75e6-4aae-8ed2-ff4b87cdcfe4 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.565981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2bd3e97-75e6-4aae-8ed2-ff4b87cdcfe4 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.566642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2bd3e97-75e6-4aae-8ed2-ff4b87cdcfe4 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.567784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2bd3e97-75e6-4aae-8ed2-ff4b87cdcfe4 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.630888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7d9c058c-e4f2-4d86-a033-7a9cbfdf1a08 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:54.642885 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7d9c058c-e4f2-4d86-a033-7a9cbfdf1a08 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1307 microversion: 2.1 time: 0.467675 Aug 27 02:43:54.643808 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1313/2931] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:54 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1307 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:54.717721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-b2bd3e97-75e6-4aae-8ed2-ff4b87cdcfe4 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:43:54.797191 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b2bd3e97-75e6-4aae-8ed2-ff4b87cdcfe4 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers?host=n-h2-852084-5&all_tenants=1" status: 200 len: 1644 microversion: 2.1 time: 0.268406 Aug 27 02:43:54.805773 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1619/2932] 10.222.0.99 () {58 vars in 1190 bytes} [Sat Aug 27 02:43:54 2022] GET /compute/v2.1/servers?host=n-h2-852084-5&all_tenants=1 => generated 1644 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:54.831953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-66dfc1f4-f8e2-4201-8ae8-7bbd73728c41 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:54.866612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-66dfc1f4-f8e2-4201-8ae8-7bbd73728c41 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:43:54.875479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66dfc1f4-f8e2-4201-8ae8-7bbd73728c41 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.876862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66dfc1f4-f8e2-4201-8ae8-7bbd73728c41 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.878019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66dfc1f4-f8e2-4201-8ae8-7bbd73728c41 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:54.880165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66dfc1f4-f8e2-4201-8ae8-7bbd73728c41 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:54.881351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66dfc1f4-f8e2-4201-8ae8-7bbd73728c41 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:54.882081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66dfc1f4-f8e2-4201-8ae8-7bbd73728c41 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.010153 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-66dfc1f4-f8e2-4201-8ae8-7bbd73728c41 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.201771 Aug 27 02:43:55.013847 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1314/2933] 10.222.0.99 () {58 vars in 1196 bytes} [Sat Aug 27 02:43:54 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:43:55.024582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cef02653-cb08-45af-a958-6d8212ca9d0a tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:55.027014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cef02653-cb08-45af-a958-6d8212ca9d0a tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:55.034688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cef02653-cb08-45af-a958-6d8212ca9d0a tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.035723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cef02653-cb08-45af-a958-6d8212ca9d0a tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.035723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cef02653-cb08-45af-a958-6d8212ca9d0a tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.036553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cef02653-cb08-45af-a958-6d8212ca9d0a tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.037273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cef02653-cb08-45af-a958-6d8212ca9d0a tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.038021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cef02653-cb08-45af-a958-6d8212ca9d0a tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.169456 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cef02653-cb08-45af-a958-6d8212ca9d0a tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action" status: 202 len: 0 microversion: 2.1 time: 0.148891 Aug 27 02:43:55.170713 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1620/2934] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:43:55 2022] POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:43:55.181959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:55.184967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:55.186007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:55.187983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:55.192555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:55.202827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.204474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.205576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.206581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.206991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.208210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.208703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.208822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.209271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.209654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.210161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.210616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.375117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:43:55.375566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:43:55.376128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:43:55.376551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:43:55.378091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:43:55.484833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:55.496652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.497807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.498655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.499606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.500252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.500969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.547621 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-93bff194-c7ab-4b50-a9db-a1b207c1b09d tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action" status: 202 len: 1067 microversion: 2.1 time: 0.372155 Aug 27 02:43:55.549125 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1315/2935] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:43:55 2022] POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action => generated 1067 bytes in 375 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 02:43:55.550738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:55.555835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3fb0cf2e-4880-44e5-9675-6078d689ebd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:55.557869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3fb0cf2e-4880-44e5-9675-6078d689ebd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:55.568860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fb0cf2e-4880-44e5-9675-6078d689ebd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.569988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fb0cf2e-4880-44e5-9675-6078d689ebd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.570962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fb0cf2e-4880-44e5-9675-6078d689ebd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.572989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fb0cf2e-4880-44e5-9675-6078d689ebd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.573929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fb0cf2e-4880-44e5-9675-6078d689ebd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.574635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:55.575173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fb0cf2e-4880-44e5-9675-6078d689ebd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.579471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:55.584538 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c314b236-a211-42cc-8336-32b44cebfe70 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 0.404913 Aug 27 02:43:55.593623 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1621/2936] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:55 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:43:55.598992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-56b838e0-aa2c-4081-b5b4-90ff1a5e9cb6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:55.599931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-56b838e0-aa2c-4081-b5b4-90ff1a5e9cb6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:55.631013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56b838e0-aa2c-4081-b5b4-90ff1a5e9cb6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.631794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56b838e0-aa2c-4081-b5b4-90ff1a5e9cb6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.632236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56b838e0-aa2c-4081-b5b4-90ff1a5e9cb6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.633490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56b838e0-aa2c-4081-b5b4-90ff1a5e9cb6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:55.634414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56b838e0-aa2c-4081-b5b4-90ff1a5e9cb6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:55.635084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56b838e0-aa2c-4081-b5b4-90ff1a5e9cb6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:55.843331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-56b838e0-aa2c-4081-b5b4-90ff1a5e9cb6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:55.865052 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-56b838e0-aa2c-4081-b5b4-90ff1a5e9cb6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1471 microversion: 2.1 time: 0.269218 Aug 27 02:43:55.865706 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1622/2937] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:55 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:56.096339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2b87dad5-aee1-4044-b362-30cf37cc57a0 tempest-AbsoluteLimitsTestJSON-539150985 tempest-AbsoluteLimitsTestJSON-539150985-project] Calling method '.version_select at 0x7f4d293a8ca0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:56.102895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3fb0cf2e-4880-44e5-9675-6078d689ebd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:56.121076 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3fb0cf2e-4880-44e5-9675-6078d689ebd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1512 microversion: 2.1 time: 0.570576 Aug 27 02:43:56.123399 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1316/2938] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:55 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1512 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:56.135334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-714da787-e313-437c-aac9-34c3fbab471a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:56.136483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-714da787-e313-437c-aac9-34c3fbab471a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:56.140433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b87dad5-aee1-4044-b362-30cf37cc57a0 tempest-AbsoluteLimitsTestJSON-539150985 tempest-AbsoluteLimitsTestJSON-539150985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:56.142570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b87dad5-aee1-4044-b362-30cf37cc57a0 tempest-AbsoluteLimitsTestJSON-539150985 tempest-AbsoluteLimitsTestJSON-539150985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:56.143396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b87dad5-aee1-4044-b362-30cf37cc57a0 tempest-AbsoluteLimitsTestJSON-539150985 tempest-AbsoluteLimitsTestJSON-539150985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:56.145714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b87dad5-aee1-4044-b362-30cf37cc57a0 tempest-AbsoluteLimitsTestJSON-539150985 tempest-AbsoluteLimitsTestJSON-539150985-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:56.148386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b87dad5-aee1-4044-b362-30cf37cc57a0 tempest-AbsoluteLimitsTestJSON-539150985 tempest-AbsoluteLimitsTestJSON-539150985-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:56.148928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b87dad5-aee1-4044-b362-30cf37cc57a0 tempest-AbsoluteLimitsTestJSON-539150985 tempest-AbsoluteLimitsTestJSON-539150985-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:56.156479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-714da787-e313-437c-aac9-34c3fbab471a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:56.157026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-714da787-e313-437c-aac9-34c3fbab471a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:56.157470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-714da787-e313-437c-aac9-34c3fbab471a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:56.158522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-714da787-e313-437c-aac9-34c3fbab471a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:56.158988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-714da787-e313-437c-aac9-34c3fbab471a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:56.159514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-714da787-e313-437c-aac9-34c3fbab471a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:56.196757 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2b87dad5-aee1-4044-b362-30cf37cc57a0 tempest-AbsoluteLimitsTestJSON-539150985 tempest-AbsoluteLimitsTestJSON-539150985-project] 10.222.0.99 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.329512 Aug 27 02:43:56.197366 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1623/2939] 10.222.0.99 () {58 vars in 1122 bytes} [Sat Aug 27 02:43:55 2022] GET /compute/v2.1/limits => generated 511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:56.333011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-395dcad5-7f53-44c6-bccb-506f41c7404f req-08c90f37-2698-46a0-ad1f-003a09e1bffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7489a8a-8682-4455-abba-671195effab4", "name": "network-vif-plugged", "status": "completed", "tag": "63f5c4dc-7c22-4bfa-8abc-a93876b795f0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:43:56.357451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-395dcad5-7f53-44c6-bccb-506f41c7404f req-08c90f37-2698-46a0-ad1f-003a09e1bffb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:56.358662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-395dcad5-7f53-44c6-bccb-506f41c7404f req-08c90f37-2698-46a0-ad1f-003a09e1bffb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:56.359463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-395dcad5-7f53-44c6-bccb-506f41c7404f req-08c90f37-2698-46a0-ad1f-003a09e1bffb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:56.407371 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-395dcad5-7f53-44c6-bccb-506f41c7404f req-08c90f37-2698-46a0-ad1f-003a09e1bffb service nova] Creating event network-vif-plugged:63f5c4dc-7c22-4bfa-8abc-a93876b795f0 for instance a7489a8a-8682-4455-abba-671195effab4 on n-h1-852084-5 Aug 27 02:43:56.415518 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-395dcad5-7f53-44c6-bccb-506f41c7404f req-08c90f37-2698-46a0-ad1f-003a09e1bffb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100577 Aug 27 02:43:56.416736 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1624/2940] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:43:56.455058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-714da787-e313-437c-aac9-34c3fbab471a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:56.464426 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-714da787-e313-437c-aac9-34c3fbab471a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1307 microversion: 2.1 time: 0.338885 Aug 27 02:43:56.480398 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1317/2941] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:56 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1307 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:56.636559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:56.637328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:56.653173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:56.655801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:56.656452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:56.657214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:56.657703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:56.658142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:56.890484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e0981351-9fd8-444a-81d3-f93b26e368ee tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:56.890798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e0981351-9fd8-444a-81d3-f93b26e368ee tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:56.905692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0981351-9fd8-444a-81d3-f93b26e368ee tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:56.906352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0981351-9fd8-444a-81d3-f93b26e368ee tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:56.907027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0981351-9fd8-444a-81d3-f93b26e368ee tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:56.909169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0981351-9fd8-444a-81d3-f93b26e368ee tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:56.914656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0981351-9fd8-444a-81d3-f93b26e368ee tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:56.915389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0981351-9fd8-444a-81d3-f93b26e368ee tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:56.925905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:56.940620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:56.943683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:56.945330 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3556fde0-f970-4faf-bd4e-6ed336167922 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 0.315980 Aug 27 02:43:56.946547 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1625/2942] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:56 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:43:57.174747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ae3c2131-d145-4316-8dfc-9868a5d365fa tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:57.175507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ae3c2131-d145-4316-8dfc-9868a5d365fa tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:57.189604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae3c2131-d145-4316-8dfc-9868a5d365fa tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:57.190569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae3c2131-d145-4316-8dfc-9868a5d365fa tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:57.191330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae3c2131-d145-4316-8dfc-9868a5d365fa tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:57.192871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae3c2131-d145-4316-8dfc-9868a5d365fa tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:57.194088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae3c2131-d145-4316-8dfc-9868a5d365fa tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:57.194788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae3c2131-d145-4316-8dfc-9868a5d365fa tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:57.537982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ae3c2131-d145-4316-8dfc-9868a5d365fa tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:57.549654 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ae3c2131-d145-4316-8dfc-9868a5d365fa tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 0.391684 Aug 27 02:43:57.552856 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1626/2943] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:57 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:57.559224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5f77e1eb-ca33-451c-a50c-a1351cb713d8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:57.560164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5f77e1eb-ca33-451c-a50c-a1351cb713d8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:57.574770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e0981351-9fd8-444a-81d3-f93b26e368ee tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:57.580860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f77e1eb-ca33-451c-a50c-a1351cb713d8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:57.588959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f77e1eb-ca33-451c-a50c-a1351cb713d8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:57.589258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:43:57.591946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f77e1eb-ca33-451c-a50c-a1351cb713d8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:57.596567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f77e1eb-ca33-451c-a50c-a1351cb713d8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:57.597562 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e0981351-9fd8-444a-81d3-f93b26e368ee tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1471 microversion: 2.1 time: 0.712117 Aug 27 02:43:57.601464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f77e1eb-ca33-451c-a50c-a1351cb713d8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:57.606749 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1318/2944] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:56 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1471 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:57.606864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f77e1eb-ca33-451c-a50c-a1351cb713d8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:57.973328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:57.974316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:57.984405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:57.985156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:57.985851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:57.986790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:57.987431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:57.987850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:57.997785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5f77e1eb-ca33-451c-a50c-a1351cb713d8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:58.010804 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f77e1eb-ca33-451c-a50c-a1351cb713d8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1307 microversion: 2.1 time: 0.454344 Aug 27 02:43:58.013000 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1627/2945] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:57 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1307 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:58.372055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:58.406190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:58.409335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:58.412088 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d2e91bec-d7ab-451f-a81f-976348df0d8f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 0.443064 Aug 27 02:43:58.430106 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1319/2946] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:57 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:43:58.582412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-099768a8-6169-4365-ab53-8d1a4ed08771 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:58.586866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-099768a8-6169-4365-ab53-8d1a4ed08771 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:58.606596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-099768a8-6169-4365-ab53-8d1a4ed08771 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:58.613119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-099768a8-6169-4365-ab53-8d1a4ed08771 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:58.614872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-099768a8-6169-4365-ab53-8d1a4ed08771 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:58.624018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-78004cb7-0c5d-4f4f-b09c-96616f2e92be tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:58.626132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-78004cb7-0c5d-4f4f-b09c-96616f2e92be tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:58.632613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-099768a8-6169-4365-ab53-8d1a4ed08771 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:58.633197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-099768a8-6169-4365-ab53-8d1a4ed08771 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:58.639581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-099768a8-6169-4365-ab53-8d1a4ed08771 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:58.647872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78004cb7-0c5d-4f4f-b09c-96616f2e92be tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:58.652880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78004cb7-0c5d-4f4f-b09c-96616f2e92be tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:58.657076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78004cb7-0c5d-4f4f-b09c-96616f2e92be tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:58.661389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78004cb7-0c5d-4f4f-b09c-96616f2e92be tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:58.667228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78004cb7-0c5d-4f4f-b09c-96616f2e92be tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:58.667839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78004cb7-0c5d-4f4f-b09c-96616f2e92be tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.190945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-78004cb7-0c5d-4f4f-b09c-96616f2e92be tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:59.192020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-099768a8-6169-4365-ab53-8d1a4ed08771 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:59.205144 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-78004cb7-0c5d-4f4f-b09c-96616f2e92be tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1471 microversion: 2.1 time: 0.584649 Aug 27 02:43:59.208481 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-099768a8-6169-4365-ab53-8d1a4ed08771 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 0.638962 Aug 27 02:43:59.218584 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1320/2947] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:58 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1471 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:43:59.223640 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1628/2948] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:58 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:43:59.227037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-476b7866-4ce7-4af7-a3b1-4e2349565dbf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:59.227712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-476b7866-4ce7-4af7-a3b1-4e2349565dbf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:59.235180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-476b7866-4ce7-4af7-a3b1-4e2349565dbf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:59.235836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-476b7866-4ce7-4af7-a3b1-4e2349565dbf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:59.236244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-476b7866-4ce7-4af7-a3b1-4e2349565dbf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.237736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-476b7866-4ce7-4af7-a3b1-4e2349565dbf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:59.239378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-476b7866-4ce7-4af7-a3b1-4e2349565dbf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:59.241373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-476b7866-4ce7-4af7-a3b1-4e2349565dbf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.459423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:43:59.460049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:43:59.471162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:59.471655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:59.475543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.479077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:43:59.482455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:43:59.483858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:43:59.716230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-476b7866-4ce7-4af7-a3b1-4e2349565dbf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:43:59.732863 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-476b7866-4ce7-4af7-a3b1-4e2349565dbf tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1307 microversion: 2.1 time: 0.513058 Aug 27 02:43:59.733741 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1321/2949] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:43:59 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1307 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:00.003589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-45771282-0d05-4de9-b12c-c635eac04222 req-1bc41511-fd71-4fd2-99e5-ee9ff29c2a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e103b49d-103b-42ab-8f83-f00e41579687", "name": "network-vif-plugged", "status": "completed", "tag": "486f8f25-2be4-44c1-9ea0-b1d4afdaa66d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:00.052103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-45771282-0d05-4de9-b12c-c635eac04222 req-1bc41511-fd71-4fd2-99e5-ee9ff29c2a9a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:00.053528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-45771282-0d05-4de9-b12c-c635eac04222 req-1bc41511-fd71-4fd2-99e5-ee9ff29c2a9a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:00.055604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-45771282-0d05-4de9-b12c-c635eac04222 req-1bc41511-fd71-4fd2-99e5-ee9ff29c2a9a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:00.071894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:00.141599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:00.145983 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-45771282-0d05-4de9-b12c-c635eac04222 req-1bc41511-fd71-4fd2-99e5-ee9ff29c2a9a service nova] Creating event network-vif-plugged:486f8f25-2be4-44c1-9ea0-b1d4afdaa66d for instance e103b49d-103b-42ab-8f83-f00e41579687 on n-h1-852084-5 Aug 27 02:44:00.147683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:00.161515 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4f8db89d-4ae5-4051-abd2-8c703c9b123f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 0.706574 Aug 27 02:44:00.177033 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1629/2950] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:43:59 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:44:00.186848 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-45771282-0d05-4de9-b12c-c635eac04222 req-1bc41511-fd71-4fd2-99e5-ee9ff29c2a9a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190551 Aug 27 02:44:00.191400 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1322/2951] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 02:44:00.249467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf7adeae-3610-4dbf-9c03-90ee2e0acfbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:00.251444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-570f8ed1-dc53-4e99-9ab1-d4e9cdc02890 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:00.252702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-570f8ed1-dc53-4e99-9ab1-d4e9cdc02890 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:00.271758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf7adeae-3610-4dbf-9c03-90ee2e0acfbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:00.320805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-570f8ed1-dc53-4e99-9ab1-d4e9cdc02890 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:00.321640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-570f8ed1-dc53-4e99-9ab1-d4e9cdc02890 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:00.322436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-570f8ed1-dc53-4e99-9ab1-d4e9cdc02890 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:00.323793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-570f8ed1-dc53-4e99-9ab1-d4e9cdc02890 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:00.329563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-570f8ed1-dc53-4e99-9ab1-d4e9cdc02890 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:00.330233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf7adeae-3610-4dbf-9c03-90ee2e0acfbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:00.334285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf7adeae-3610-4dbf-9c03-90ee2e0acfbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:00.335642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-570f8ed1-dc53-4e99-9ab1-d4e9cdc02890 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:00.336764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf7adeae-3610-4dbf-9c03-90ee2e0acfbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:00.340246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf7adeae-3610-4dbf-9c03-90ee2e0acfbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:00.349223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf7adeae-3610-4dbf-9c03-90ee2e0acfbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:00.350546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf7adeae-3610-4dbf-9c03-90ee2e0acfbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:00.949038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-570f8ed1-dc53-4e99-9ab1-d4e9cdc02890 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:00.965847 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-570f8ed1-dc53-4e99-9ab1-d4e9cdc02890 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1471 microversion: 2.1 time: 0.738398 Aug 27 02:44:00.967724 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1630/2952] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:00 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1471 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:00.978166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-04c991af-7e91-4979-92cb-31b5da68a0f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:00.984874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf7adeae-3610-4dbf-9c03-90ee2e0acfbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:00.992888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-04c991af-7e91-4979-92cb-31b5da68a0f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:01.015835 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf7adeae-3610-4dbf-9c03-90ee2e0acfbe tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 0.784586 Aug 27 02:44:01.018041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04c991af-7e91-4979-92cb-31b5da68a0f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:01.032608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04c991af-7e91-4979-92cb-31b5da68a0f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:01.032954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04c991af-7e91-4979-92cb-31b5da68a0f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:01.033752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04c991af-7e91-4979-92cb-31b5da68a0f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:01.034357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04c991af-7e91-4979-92cb-31b5da68a0f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:01.034656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04c991af-7e91-4979-92cb-31b5da68a0f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:01.037837 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1323/2953] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:00 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:01.217616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:01.220020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:01.248043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:01.248896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:01.249638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:01.250989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:01.251827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:01.274799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:01.297874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-04c991af-7e91-4979-92cb-31b5da68a0f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:01.316287 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-04c991af-7e91-4979-92cb-31b5da68a0f2 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1307 microversion: 2.1 time: 0.346709 Aug 27 02:44:01.316959 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1631/2954] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:00 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1307 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:01.568946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:01.734070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:01.750483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:01.756163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:01.760426 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7049057f-8015-4d82-90b1-ac146e8389f3 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1729 microversion: 2.20 time: 0.549399 Aug 27 02:44:01.762566 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1324/2955] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:01 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1729 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:44:01.995029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd642da9-0191-40a8-9b92-5561a00982b2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:01.995992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dd642da9-0191-40a8-9b92-5561a00982b2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:02.022228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd642da9-0191-40a8-9b92-5561a00982b2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.022734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd642da9-0191-40a8-9b92-5561a00982b2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.043359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dec99bbc-b869-407d-a4b1-5d060b05c5ec tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:02.045167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dec99bbc-b869-407d-a4b1-5d060b05c5ec tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:02.047983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd642da9-0191-40a8-9b92-5561a00982b2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.052401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd642da9-0191-40a8-9b92-5561a00982b2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.054567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd642da9-0191-40a8-9b92-5561a00982b2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.056414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd642da9-0191-40a8-9b92-5561a00982b2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.061498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dec99bbc-b869-407d-a4b1-5d060b05c5ec tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.062039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dec99bbc-b869-407d-a4b1-5d060b05c5ec tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.066337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dec99bbc-b869-407d-a4b1-5d060b05c5ec tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.068865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dec99bbc-b869-407d-a4b1-5d060b05c5ec tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.070542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dec99bbc-b869-407d-a4b1-5d060b05c5ec tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.071275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dec99bbc-b869-407d-a4b1-5d060b05c5ec tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.407283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dd642da9-0191-40a8-9b92-5561a00982b2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:02.439730 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dd642da9-0191-40a8-9b92-5561a00982b2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1471 microversion: 2.1 time: 0.451467 Aug 27 02:44:02.455303 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1632/2956] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:01 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1471 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:02.482166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-feada51f-953b-4064-85a8-625ec2df61f8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:02.486017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-feada51f-953b-4064-85a8-625ec2df61f8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:02.507233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feada51f-953b-4064-85a8-625ec2df61f8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.512422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feada51f-953b-4064-85a8-625ec2df61f8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.513609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feada51f-953b-4064-85a8-625ec2df61f8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.513853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feada51f-953b-4064-85a8-625ec2df61f8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.514351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feada51f-953b-4064-85a8-625ec2df61f8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.514796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-feada51f-953b-4064-85a8-625ec2df61f8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.557456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:02.726587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dec99bbc-b869-407d-a4b1-5d060b05c5ec tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:02.742836 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dec99bbc-b869-407d-a4b1-5d060b05c5ec tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 0.703022 Aug 27 02:44:02.744007 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1325/2957] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:02 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:02.752508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7346b11c-905e-40e3-bf89-74b43f8fd43a req-e498f9f3-ecd3-446c-9d0f-bdd55d1ca566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc6da4b-7eaa-4955-916f-f9400d8fb491", "name": "network-vif-plugged", "status": "completed", "tag": "26a8ce3a-caa5-463a-891c-4c436615cead"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:02.784315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7346b11c-905e-40e3-bf89-74b43f8fd43a req-e498f9f3-ecd3-446c-9d0f-bdd55d1ca566 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.798301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7346b11c-905e-40e3-bf89-74b43f8fd43a req-e498f9f3-ecd3-446c-9d0f-bdd55d1ca566 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.798930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7346b11c-905e-40e3-bf89-74b43f8fd43a req-e498f9f3-ecd3-446c-9d0f-bdd55d1ca566 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.837919 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7346b11c-905e-40e3-bf89-74b43f8fd43a req-e498f9f3-ecd3-446c-9d0f-bdd55d1ca566 service nova] Creating event network-vif-plugged:26a8ce3a-caa5-463a-891c-4c436615cead for instance dbc6da4b-7eaa-4955-916f-f9400d8fb491 on n-h1-852084-5 Aug 27 02:44:02.850364 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7346b11c-905e-40e3-bf89-74b43f8fd43a req-e498f9f3-ecd3-446c-9d0f-bdd55d1ca566 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104907 Aug 27 02:44:02.851466 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1326/2958] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:02.862283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:02.863181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-feada51f-953b-4064-85a8-625ec2df61f8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:02.863464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:02.879496 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-feada51f-953b-4064-85a8-625ec2df61f8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1487 microversion: 2.1 time: 0.420250 Aug 27 02:44:02.879762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.880439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.882375 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1633/2959] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:02 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1487 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:02.883194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.884297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.890458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.891066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.925586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2ac1acf6-e718-4a77-b8bf-bb2b935f3400 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:02.926524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2ac1acf6-e718-4a77-b8bf-bb2b935f3400 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:02.940350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ac1acf6-e718-4a77-b8bf-bb2b935f3400 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.942017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ac1acf6-e718-4a77-b8bf-bb2b935f3400 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.943102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ac1acf6-e718-4a77-b8bf-bb2b935f3400 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:02.946967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ac1acf6-e718-4a77-b8bf-bb2b935f3400 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:02.947789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ac1acf6-e718-4a77-b8bf-bb2b935f3400 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:02.950035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ac1acf6-e718-4a77-b8bf-bb2b935f3400 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:03.016796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-2ac1acf6-e718-4a77-b8bf-bb2b935f3400 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lazy-loading 'flavor' on Instance uuid e103b49d-103b-42ab-8f83-f00e41579687 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:44:03.263232 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2ac1acf6-e718-4a77-b8bf-bb2b935f3400 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "POST /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687/action" status: 202 len: 0 microversion: 2.1 time: 0.340791 Aug 27 02:44:03.265294 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1634/2960] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:44:02 2022] POST /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:44:03.327703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-af57654b-e982-4227-ba75-ae91515cbb6b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:03.330122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-af57654b-e982-4227-ba75-ae91515cbb6b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:03.350047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af57654b-e982-4227-ba75-ae91515cbb6b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:03.352730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af57654b-e982-4227-ba75-ae91515cbb6b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:03.354015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af57654b-e982-4227-ba75-ae91515cbb6b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:03.355873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af57654b-e982-4227-ba75-ae91515cbb6b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:03.357310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af57654b-e982-4227-ba75-ae91515cbb6b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:03.358597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af57654b-e982-4227-ba75-ae91515cbb6b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:03.474406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:03.485276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:03.489214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:03.490751 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b6b7728-6b1c-4414-a120-5c40277de64e tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1716 microversion: 2.20 time: 0.637903 Aug 27 02:44:03.491832 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1327/2961] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:02 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1716 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:44:03.505620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-56f78a97-5b5b-4c85-ac30-faf018c4c10c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:03.513634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-56f78a97-5b5b-4c85-ac30-faf018c4c10c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:03.531988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f78a97-5b5b-4c85-ac30-faf018c4c10c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:03.532505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f78a97-5b5b-4c85-ac30-faf018c4c10c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:03.532958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f78a97-5b5b-4c85-ac30-faf018c4c10c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:03.533943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f78a97-5b5b-4c85-ac30-faf018c4c10c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:03.534603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f78a97-5b5b-4c85-ac30-faf018c4c10c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:03.535255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56f78a97-5b5b-4c85-ac30-faf018c4c10c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:03.901996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-56f78a97-5b5b-4c85-ac30-faf018c4c10c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:03.967436 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-56f78a97-5b5b-4c85-ac30-faf018c4c10c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1471 microversion: 2.1 time: 0.473643 Aug 27 02:44:03.977781 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1328/2962] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:03 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1471 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:04.017227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a32791c1-ca12-44f7-b091-e39c498503b8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:04.019073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a32791c1-ca12-44f7-b091-e39c498503b8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:04.044644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a32791c1-ca12-44f7-b091-e39c498503b8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:04.058772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a32791c1-ca12-44f7-b091-e39c498503b8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:04.060006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a32791c1-ca12-44f7-b091-e39c498503b8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:04.061950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a32791c1-ca12-44f7-b091-e39c498503b8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:04.063210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a32791c1-ca12-44f7-b091-e39c498503b8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:04.066344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a32791c1-ca12-44f7-b091-e39c498503b8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:04.209903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-af57654b-e982-4227-ba75-ae91515cbb6b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:04.239099 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-af57654b-e982-4227-ba75-ae91515cbb6b tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1495 microversion: 2.1 time: 0.937777 Aug 27 02:44:04.241737 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1635/2963] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:03 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1495 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:04.894014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a32791c1-ca12-44f7-b091-e39c498503b8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:04.925492 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a32791c1-ca12-44f7-b091-e39c498503b8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 0.945045 Aug 27 02:44:04.930420 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1329/2964] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:03 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:05.014604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f1f9156b-b507-4f4b-93e6-d0a9209c31e9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:05.018846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f1f9156b-b507-4f4b-93e6-d0a9209c31e9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:05.044891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1f9156b-b507-4f4b-93e6-d0a9209c31e9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:05.046363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1f9156b-b507-4f4b-93e6-d0a9209c31e9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:05.047544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1f9156b-b507-4f4b-93e6-d0a9209c31e9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:05.049183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1f9156b-b507-4f4b-93e6-d0a9209c31e9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:05.050430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1f9156b-b507-4f4b-93e6-d0a9209c31e9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:05.051730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f1f9156b-b507-4f4b-93e6-d0a9209c31e9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:05.268445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-355ed8c2-3fe7-4984-bb60-77de818cbbea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:05.276970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-355ed8c2-3fe7-4984-bb60-77de818cbbea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:05.310784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:05.314627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355ed8c2-3fe7-4984-bb60-77de818cbbea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:05.320914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355ed8c2-3fe7-4984-bb60-77de818cbbea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:05.322165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355ed8c2-3fe7-4984-bb60-77de818cbbea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:05.323701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355ed8c2-3fe7-4984-bb60-77de818cbbea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:05.331153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355ed8c2-3fe7-4984-bb60-77de818cbbea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:05.336157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355ed8c2-3fe7-4984-bb60-77de818cbbea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:05.801522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f1f9156b-b507-4f4b-93e6-d0a9209c31e9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:05.808565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-355ed8c2-3fe7-4984-bb60-77de818cbbea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:05.828674 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-355ed8c2-3fe7-4984-bb60-77de818cbbea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 200 len: 1478 microversion: 2.1 time: 0.569227 Aug 27 02:44:05.839706 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f1f9156b-b507-4f4b-93e6-d0a9209c31e9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1471 microversion: 2.1 time: 0.820371 Aug 27 02:44:05.860545 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1330/2965] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:05 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 1478 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:05.869021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f26548ae-1664-414c-b7cd-f99701540205 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-993297091"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:05.872572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f26548ae-1664-414c-b7cd-f99701540205 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:05.882372 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1636/2966] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:05 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1471 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:05.882583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f26548ae-1664-414c-b7cd-f99701540205 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:05.886810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f26548ae-1664-414c-b7cd-f99701540205 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:05.887553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f26548ae-1664-414c-b7cd-f99701540205 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:05.888560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f26548ae-1664-414c-b7cd-f99701540205 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:05.889050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f26548ae-1664-414c-b7cd-f99701540205 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:05.889490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f26548ae-1664-414c-b7cd-f99701540205 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:05.994917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-095587de-5510-4aed-b069-f13fc7b4bc34 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:05.996144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-095587de-5510-4aed-b069-f13fc7b4bc34 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:06.065917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095587de-5510-4aed-b069-f13fc7b4bc34 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:06.073091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095587de-5510-4aed-b069-f13fc7b4bc34 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:06.073996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095587de-5510-4aed-b069-f13fc7b4bc34 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:06.094751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095587de-5510-4aed-b069-f13fc7b4bc34 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:06.095689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095587de-5510-4aed-b069-f13fc7b4bc34 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:06.096514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-095587de-5510-4aed-b069-f13fc7b4bc34 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:06.148698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=42 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:06.240853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=12 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:06.464291 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f26548ae-1664-414c-b7cd-f99701540205 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "POST /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687/action" status: 202 len: 0 microversion: 2.1 time: 0.598937 Aug 27 02:44:06.469033 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1331/2967] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:44:05 2022] POST /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 27 02:44:06.502439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fce0a68c-6539-4d51-8468-55be100b8c84 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29799ca0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:06.722697 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fce0a68c-6539-4d51-8468-55be100b8c84 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.240361 Aug 27 02:44:06.723679 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1332/2968] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:06 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:06.897549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-885ba368-58d8-44a1-887d-f90772592199 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:06.898675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-885ba368-58d8-44a1-887d-f90772592199 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:06.917120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-885ba368-58d8-44a1-887d-f90772592199 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:06.918661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-885ba368-58d8-44a1-887d-f90772592199 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:06.919302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-885ba368-58d8-44a1-887d-f90772592199 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:06.920283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-885ba368-58d8-44a1-887d-f90772592199 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:06.920943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-885ba368-58d8-44a1-887d-f90772592199 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:06.921576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-885ba368-58d8-44a1-887d-f90772592199 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:07.773224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-885ba368-58d8-44a1-887d-f90772592199 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:07.790040 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-885ba368-58d8-44a1-887d-f90772592199 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1471 microversion: 2.1 time: 0.897078 Aug 27 02:44:07.792881 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1333/2969] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:06 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1471 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:07.801205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-30dedd2a-8e53-47f0-8709-3972b7f86c7e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29a35d30>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:07.862219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-095587de-5510-4aed-b069-f13fc7b4bc34 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:07.893609 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-30dedd2a-8e53-47f0-8709-3972b7f86c7e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.098692 Aug 27 02:44:07.904501 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-095587de-5510-4aed-b069-f13fc7b4bc34 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 1.955657 Aug 27 02:44:07.908310 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1334/2970] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:07 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:07.919367 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1637/2971] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:05 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:08.837857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-53431de2-3bb4-4314-929f-13bdbbd52bc7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:08.838691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-53431de2-3bb4-4314-929f-13bdbbd52bc7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:08.860366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53431de2-3bb4-4314-929f-13bdbbd52bc7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:08.861048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53431de2-3bb4-4314-929f-13bdbbd52bc7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:08.863093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53431de2-3bb4-4314-929f-13bdbbd52bc7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:08.864212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53431de2-3bb4-4314-929f-13bdbbd52bc7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:08.865812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53431de2-3bb4-4314-929f-13bdbbd52bc7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:08.867041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53431de2-3bb4-4314-929f-13bdbbd52bc7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:08.910633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1b1f462c-782a-4350-b704-925324476b22 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2928a310>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:08.995442 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1b1f462c-782a-4350-b704-925324476b22 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.089893 Aug 27 02:44:08.997212 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1638/2972] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:08 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:09.009365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-18b1009e-ea7a-441a-87ac-ca8e1b6d0625 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:09.010346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-18b1009e-ea7a-441a-87ac-ca8e1b6d0625 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:09.027642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18b1009e-ea7a-441a-87ac-ca8e1b6d0625 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:09.029844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18b1009e-ea7a-441a-87ac-ca8e1b6d0625 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:09.030483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18b1009e-ea7a-441a-87ac-ca8e1b6d0625 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:09.034052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18b1009e-ea7a-441a-87ac-ca8e1b6d0625 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:09.034696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18b1009e-ea7a-441a-87ac-ca8e1b6d0625 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:09.037098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18b1009e-ea7a-441a-87ac-ca8e1b6d0625 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:09.686766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-18b1009e-ea7a-441a-87ac-ca8e1b6d0625 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:09.711163 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-18b1009e-ea7a-441a-87ac-ca8e1b6d0625 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 0.711260 Aug 27 02:44:09.711810 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1639/2973] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:08 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:10.010963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-53431de2-3bb4-4314-929f-13bdbbd52bc7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:10.021060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-97361ebf-ac7d-4bf1-8513-ba6fe4d88c9f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e7ba040>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:10.024160 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-53431de2-3bb4-4314-929f-13bdbbd52bc7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1471 microversion: 2.1 time: 1.192303 Aug 27 02:44:10.027787 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1335/2974] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:08 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1471 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:10.328321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5c1d75b4-f8f4-4d10-90cf-d197cd0d0fba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:10.329710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5c1d75b4-f8f4-4d10-90cf-d197cd0d0fba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:10.351430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c1d75b4-f8f4-4d10-90cf-d197cd0d0fba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:10.357151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c1d75b4-f8f4-4d10-90cf-d197cd0d0fba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:10.360916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c1d75b4-f8f4-4d10-90cf-d197cd0d0fba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:10.364249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c1d75b4-f8f4-4d10-90cf-d197cd0d0fba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:10.376650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c1d75b4-f8f4-4d10-90cf-d197cd0d0fba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:10.378914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c1d75b4-f8f4-4d10-90cf-d197cd0d0fba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:10.502806 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-97361ebf-ac7d-4bf1-8513-ba6fe4d88c9f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.490750 Aug 27 02:44:10.520556 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1640/2975] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:10 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:10.546270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-5c1d75b4-f8f4-4d10-90cf-d197cd0d0fba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lazy-loading 'services' on Instance uuid 875762f1-6b75-4c91-859b-76fb857ecb26 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:44:10.759250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-12034f3d-6052-4637-b181-e8ea1c367233 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:10.760394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-12034f3d-6052-4637-b181-e8ea1c367233 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:10.814887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12034f3d-6052-4637-b181-e8ea1c367233 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:10.820094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12034f3d-6052-4637-b181-e8ea1c367233 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:10.821478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12034f3d-6052-4637-b181-e8ea1c367233 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:10.832018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12034f3d-6052-4637-b181-e8ea1c367233 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:10.835291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12034f3d-6052-4637-b181-e8ea1c367233 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:10.836696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12034f3d-6052-4637-b181-e8ea1c367233 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:10.912018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:10.969354 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5c1d75b4-f8f4-4d10-90cf-d197cd0d0fba tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments/9e9641d7-91ea-4339-b1e6-97093d761511" status: 202 len: 0 microversion: 2.1 time: 0.644047 Aug 27 02:44:10.993781 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1336/2976] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 02:44:10 2022] DELETE /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments/9e9641d7-91ea-4339-b1e6-97093d761511 => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:44:11.073900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-40aa2521-836f-4b28-af67-b0610c458c52 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:11.085162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-40aa2521-836f-4b28-af67-b0610c458c52 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:11.131215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40aa2521-836f-4b28-af67-b0610c458c52 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:11.132079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40aa2521-836f-4b28-af67-b0610c458c52 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:11.132868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40aa2521-836f-4b28-af67-b0610c458c52 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:11.134216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40aa2521-836f-4b28-af67-b0610c458c52 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:11.135572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40aa2521-836f-4b28-af67-b0610c458c52 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:11.136552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40aa2521-836f-4b28-af67-b0610c458c52 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:11.282996 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-40aa2521-836f-4b28-af67-b0610c458c52 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.277053 Aug 27 02:44:11.290193 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1337/2977] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:44:10 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments => generated 197 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:11.306786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9565b07d-c43a-4ff3-a711-17e346011df4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:11.307871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9565b07d-c43a-4ff3-a711-17e346011df4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:11.340724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9565b07d-c43a-4ff3-a711-17e346011df4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:11.341811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9565b07d-c43a-4ff3-a711-17e346011df4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:11.342573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9565b07d-c43a-4ff3-a711-17e346011df4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:11.349661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9565b07d-c43a-4ff3-a711-17e346011df4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:11.352934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9565b07d-c43a-4ff3-a711-17e346011df4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:11.354589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9565b07d-c43a-4ff3-a711-17e346011df4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:11.858274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-12034f3d-6052-4637-b181-e8ea1c367233 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:11.908831 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-12034f3d-6052-4637-b181-e8ea1c367233 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 1.152652 Aug 27 02:44:11.921849 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1641/2978] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:10 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:11.946353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6db709fa-4aff-44b6-8fc3-3a75f59aacad tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29356550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:12.139760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9565b07d-c43a-4ff3-a711-17e346011df4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:12.160568 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9565b07d-c43a-4ff3-a711-17e346011df4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1471 microversion: 2.1 time: 0.868156 Aug 27 02:44:12.166568 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1338/2979] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:11 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1471 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:12.321031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5ba245c2-c796-44ba-b1e1-b1b3cba105e4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:12.334074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5ba245c2-c796-44ba-b1e1-b1b3cba105e4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:12.374233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba245c2-c796-44ba-b1e1-b1b3cba105e4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:12.375778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba245c2-c796-44ba-b1e1-b1b3cba105e4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:12.382557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba245c2-c796-44ba-b1e1-b1b3cba105e4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:12.389323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba245c2-c796-44ba-b1e1-b1b3cba105e4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:12.395668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba245c2-c796-44ba-b1e1-b1b3cba105e4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:12.397006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba245c2-c796-44ba-b1e1-b1b3cba105e4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:12.727805 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5ba245c2-c796-44ba-b1e1-b1b3cba105e4 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.427781 Aug 27 02:44:12.746101 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1339/2980] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:44:12 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments => generated 197 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:44:12.937483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd2c501f-4932-456d-9fd9-dc1c3afeb852 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:12.938762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bd2c501f-4932-456d-9fd9-dc1c3afeb852 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:13.009943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd2c501f-4932-456d-9fd9-dc1c3afeb852 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:13.020155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd2c501f-4932-456d-9fd9-dc1c3afeb852 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:13.024388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd2c501f-4932-456d-9fd9-dc1c3afeb852 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:13.040286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd2c501f-4932-456d-9fd9-dc1c3afeb852 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:13.043478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd2c501f-4932-456d-9fd9-dc1c3afeb852 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:13.044746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd2c501f-4932-456d-9fd9-dc1c3afeb852 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:14.235142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd2c501f-4932-456d-9fd9-dc1c3afeb852 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:14.262113 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd2c501f-4932-456d-9fd9-dc1c3afeb852 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 1.332725 Aug 27 02:44:14.273846 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1340/2981] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:12 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:14.289223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2911a5a2-af06-4a65-9e70-1711fe8f9161 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:14.290098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2911a5a2-af06-4a65-9e70-1711fe8f9161 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:14.309046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2911a5a2-af06-4a65-9e70-1711fe8f9161 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:14.318280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2911a5a2-af06-4a65-9e70-1711fe8f9161 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:14.319082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2911a5a2-af06-4a65-9e70-1711fe8f9161 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:14.336540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2911a5a2-af06-4a65-9e70-1711fe8f9161 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:14.339425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2911a5a2-af06-4a65-9e70-1711fe8f9161 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:14.340111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2911a5a2-af06-4a65-9e70-1711fe8f9161 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:14.813114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2911a5a2-af06-4a65-9e70-1711fe8f9161 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:14.862890 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2911a5a2-af06-4a65-9e70-1711fe8f9161 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1477 microversion: 2.1 time: 0.587667 Aug 27 02:44:14.866903 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1341/2982] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:14 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1477 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:14.903068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5366a9d9-2c22-4c7a-951e-d07eecbdc463 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:14.914579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5366a9d9-2c22-4c7a-951e-d07eecbdc463 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:14.927343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5366a9d9-2c22-4c7a-951e-d07eecbdc463 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:14.927935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5366a9d9-2c22-4c7a-951e-d07eecbdc463 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:14.928460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5366a9d9-2c22-4c7a-951e-d07eecbdc463 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:14.970330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5366a9d9-2c22-4c7a-951e-d07eecbdc463 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:14.975530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5366a9d9-2c22-4c7a-951e-d07eecbdc463 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:14.980355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5366a9d9-2c22-4c7a-951e-d07eecbdc463 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:15.159352 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5366a9d9-2c22-4c7a-951e-d07eecbdc463 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.291227 Aug 27 02:44:15.160926 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1342/2983] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:44:14 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments => generated 197 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:16.369335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-75a8dbba-affd-4907-93a1-b0adf67f3309 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:16.371544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-75a8dbba-affd-4907-93a1-b0adf67f3309 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:16.383199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75a8dbba-affd-4907-93a1-b0adf67f3309 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:16.387482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75a8dbba-affd-4907-93a1-b0adf67f3309 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:16.388269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75a8dbba-affd-4907-93a1-b0adf67f3309 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:16.389207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75a8dbba-affd-4907-93a1-b0adf67f3309 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:16.391800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75a8dbba-affd-4907-93a1-b0adf67f3309 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:16.395542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75a8dbba-affd-4907-93a1-b0adf67f3309 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:17.006827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-75a8dbba-affd-4907-93a1-b0adf67f3309 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:17.031591 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-75a8dbba-affd-4907-93a1-b0adf67f3309 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 1.722597 Aug 27 02:44:17.032613 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1343/2984] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:15 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:17.294990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1f99faa-bf04-4433-9832-e09c21d39c66 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'create', calling method: .version_select at 0x7f4d296efc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1264391893", "description": "tempest-description-1854611829"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:18.762853 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1f99faa-bf04-4433-9832-e09c21d39c66 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.723454 Aug 27 02:44:18.763905 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1344/2985] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:44:17 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:18.772136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3ac28221-dccc-44bb-adab-5ca0b26b24a4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:18.772404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3ac28221-dccc-44bb-adab-5ca0b26b24a4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:18.791840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ac28221-dccc-44bb-adab-5ca0b26b24a4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:18.792217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ac28221-dccc-44bb-adab-5ca0b26b24a4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:18.794101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ac28221-dccc-44bb-adab-5ca0b26b24a4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:18.795481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ac28221-dccc-44bb-adab-5ca0b26b24a4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:18.798513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ac28221-dccc-44bb-adab-5ca0b26b24a4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:18.802397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ac28221-dccc-44bb-adab-5ca0b26b24a4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:19.210184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3ac28221-dccc-44bb-adab-5ca0b26b24a4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:19.268722 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3ac28221-dccc-44bb-adab-5ca0b26b24a4 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1463 microversion: 2.1 time: 0.503580 Aug 27 02:44:19.269896 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1345/2986] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:18 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1463 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:19.306891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-63286633-f918-4ee6-91be-f5dfc932594e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:19.323071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-63286633-f918-4ee6-91be-f5dfc932594e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:19.368802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63286633-f918-4ee6-91be-f5dfc932594e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:19.373997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63286633-f918-4ee6-91be-f5dfc932594e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:19.376974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63286633-f918-4ee6-91be-f5dfc932594e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:19.401727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63286633-f918-4ee6-91be-f5dfc932594e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:19.404456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63286633-f918-4ee6-91be-f5dfc932594e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:19.410329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63286633-f918-4ee6-91be-f5dfc932594e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:19.591310 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-63286633-f918-4ee6-91be-f5dfc932594e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.319332 Aug 27 02:44:19.614871 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1346/2987] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:44:19 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments => generated 197 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:19.871607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1497395208", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "bb32b795-2f79-4602-b209-39565726a842"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:20.806624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=54 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:21.873472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:24.757133 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6db709fa-4aff-44b6-8fc3-3a75f59aacad tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 12.833648 Aug 27 02:44:24.760362 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1642/2988] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:11 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 12838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:24.761704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] validate_networks() for [('bb32b795-2f79-4602-b209-39565726a842', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:44:24.777254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-79acb9d0-0bb5-4daa-aafe-72dad71a255a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:24.802473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-79acb9d0-0bb5-4daa-aafe-72dad71a255a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:24.844114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79acb9d0-0bb5-4daa-aafe-72dad71a255a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:24.852570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79acb9d0-0bb5-4daa-aafe-72dad71a255a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:24.854274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79acb9d0-0bb5-4daa-aafe-72dad71a255a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:24.858919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79acb9d0-0bb5-4daa-aafe-72dad71a255a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:24.863896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79acb9d0-0bb5-4daa-aafe-72dad71a255a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:24.868241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79acb9d0-0bb5-4daa-aafe-72dad71a255a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:25.373568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-79acb9d0-0bb5-4daa-aafe-72dad71a255a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:25.385311 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-79acb9d0-0bb5-4daa-aafe-72dad71a255a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 0.623510 Aug 27 02:44:25.398755 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1643/2989] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:24 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:25.408078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4f55a4f4-e068-4267-bccc-de8c1e43f01a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'create', calling method: .version_select at 0x7f4d2e7ba0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-819197377", "description": "tempest-description-1997340853"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:25.778042 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4f55a4f4-e068-4267-bccc-de8c1e43f01a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.377890 Aug 27 02:44:25.779762 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1644/2990] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:44:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:25.804631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-96ecafe6-cb98-4537-9c70-4d6fe84b1d3b req-fbd34522-18d3-4822-a46f-36b2c4a9e73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1", "name": "network-vif-unplugged", "status": "completed", "tag": "cc07ffc6-88d4-4347-b44f-52ae8d2126ef"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:25.845049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-96ecafe6-cb98-4537-9c70-4d6fe84b1d3b req-fbd34522-18d3-4822-a46f-36b2c4a9e73c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:25.845558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-96ecafe6-cb98-4537-9c70-4d6fe84b1d3b req-fbd34522-18d3-4822-a46f-36b2c4a9e73c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:25.850562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-96ecafe6-cb98-4537-9c70-4d6fe84b1d3b req-fbd34522-18d3-4822-a46f-36b2c4a9e73c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:25.895918 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-96ecafe6-cb98-4537-9c70-4d6fe84b1d3b req-fbd34522-18d3-4822-a46f-36b2c4a9e73c service nova] Creating event network-vif-unplugged:cc07ffc6-88d4-4347-b44f-52ae8d2126ef for instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 on n-h2-852084-5 Aug 27 02:44:25.907296 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-96ecafe6-cb98-4537-9c70-4d6fe84b1d3b req-fbd34522-18d3-4822-a46f-36b2c4a9e73c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116756 Aug 27 02:44:25.910509 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1645/2991] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:25.921960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9578d57d-e5b4-4371-87b5-0e3873ef8011 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:25.936236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9578d57d-e5b4-4371-87b5-0e3873ef8011 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:25.946161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9578d57d-e5b4-4371-87b5-0e3873ef8011 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:25.948497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9578d57d-e5b4-4371-87b5-0e3873ef8011 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:25.949121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9578d57d-e5b4-4371-87b5-0e3873ef8011 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:25.951497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9578d57d-e5b4-4371-87b5-0e3873ef8011 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:25.953738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9578d57d-e5b4-4371-87b5-0e3873ef8011 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:25.954586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9578d57d-e5b4-4371-87b5-0e3873ef8011 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:26.316536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9578d57d-e5b4-4371-87b5-0e3873ef8011 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:26.332040 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9578d57d-e5b4-4371-87b5-0e3873ef8011 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1463 microversion: 2.1 time: 0.415485 Aug 27 02:44:26.337899 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1646/2992] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:25 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1463 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:26.357022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:44:26.358050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:44:26.359183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:44:26.359568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4879de1-0319-4b0f-a77c-faa31005e182 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:26.360279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:44:26.361212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:44:26.389494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=64 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:26.396309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4879de1-0319-4b0f-a77c-faa31005e182 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:26.405253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4879de1-0319-4b0f-a77c-faa31005e182 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:26.406099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4879de1-0319-4b0f-a77c-faa31005e182 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:26.406746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4879de1-0319-4b0f-a77c-faa31005e182 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:26.407658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4879de1-0319-4b0f-a77c-faa31005e182 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:26.408299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4879de1-0319-4b0f-a77c-faa31005e182 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:26.409047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4879de1-0319-4b0f-a77c-faa31005e182 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:26.433083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:26.433083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:26.437526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:26.443398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:26.447221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:26.450758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:26.456906 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4879de1-0319-4b0f-a77c-faa31005e182 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116830 Aug 27 02:44:26.458192 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1647/2993] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:44:26 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:44:26.463976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-476c19ba-f0bf-43b2-b706-4bc894b099e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d292a64c0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:26.519647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Getting quotas for project b3fc3c2d04bf44b49a932c2eae27cf04. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:44:26.526893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Getting quotas for user 1418fca23c99496a958fffe6cc021689 and project b3fc3c2d04bf44b49a932c2eae27cf04. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:44:26.543206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Going to run 3 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:44:26.546271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:44:26.592597 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-476c19ba-f0bf-43b2-b706-4bc894b099e3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.132256 Aug 27 02:44:26.606622 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1648/2994] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:26 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:26.608191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=1e2dec37-0d3d-4970-ae03-cc5bbbdd5216,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:44:26.615043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-398093491", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "1881d242-8fc7-465c-aee4-0efe81dd9b3f"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:26.690007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=902974a7-3280-4391-b745-432c3a4f1737,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:44:26.765364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] validate_networks() for [('1881d242-8fc7-465c-aee4-0efe81dd9b3f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:44:26.859057 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ac65f092-f6c1-4eb0-b52d-fe4c6aa38b46 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.239846 Aug 27 02:44:26.868314 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1347/2995] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:44:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 7252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:44:26.880676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:26.889443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:26.903317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:26.904175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:26.905061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:26.906041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:26.906697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:26.907305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:27.121488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:44:27.122322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:44:27.123098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:44:27.129371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:44:27.130276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:44:27.421141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:27.448859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:27.450318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:27.451204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:27.452299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:27.453911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:27.454645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:27.505985 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5ba03b0c-eff0-4652-a087-28e75ffa25a0 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action" status: 202 len: 1067 microversion: 2.1 time: 0.636044 Aug 27 02:44:27.507133 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1348/2996] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:44:26 2022] POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action => generated 1067 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 02:44:27.514655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-41c722fa-0dd2-4970-bc62-f20a609b98ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:27.518823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-41c722fa-0dd2-4970-bc62-f20a609b98ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:27.536386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41c722fa-0dd2-4970-bc62-f20a609b98ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:27.537267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41c722fa-0dd2-4970-bc62-f20a609b98ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:27.537920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41c722fa-0dd2-4970-bc62-f20a609b98ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:27.538911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41c722fa-0dd2-4970-bc62-f20a609b98ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:27.539390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41c722fa-0dd2-4970-bc62-f20a609b98ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:27.541018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41c722fa-0dd2-4970-bc62-f20a609b98ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:27.885042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:44:27.885941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:44:27.886141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:44:27.886457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:44:27.886882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:44:27.914696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-41c722fa-0dd2-4970-bc62-f20a609b98ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:27.925990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:27.926506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:27.926964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:27.927805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:27.928248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:27.928689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:27.939427 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-41c722fa-0dd2-4970-bc62-f20a609b98ab tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1504 microversion: 2.1 time: 0.430695 Aug 27 02:44:27.940738 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1349/2997] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:27 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1504 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:27.948325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:27.960707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:27.978001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:27.979201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:27.979998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:27.981028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:27.981794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:27.982427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.027422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Getting quotas for project dd39361940384245b4c43e4490a261bb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:44:28.068706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Getting quotas for user b0e6dd194aa342058daf161777e0adca and project dd39361940384245b4c43e4490a261bb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:44:28.099752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:44:28.102144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:44:28.105586 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] HTTP exception thrown: Cannot 'reboot' instance 846f11d0-56dc-4717-87da-d2c70805d9ef while it is in vm_state rescued Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Request method failure captured: Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef/action HTTP/1.1 Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 28 Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYO1ujqvCLBmMVe65fdN2J5dIO7-HUqI3Js5YGestJSXRt-3jM1W-KzE8NnECJ1ryJNn-_nCYfE1drEJmtuv9wrerAqLuupZmy6gs9vrBdbjKq9YdwsxzP7b-WGUVBzCCEf1u8fLpuDoBEeADCldZf84VX9NU_VzQjP9Knt2NuVZyVU Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/956a66be18bb4f9e996c8e16bcf23bab"}]}] Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 51b3d953421c409c9edd54287dcd11db Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: {"reboot": {"type": "HARD"}} Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'reboot' instance 846f11d0-56dc-4717-87da-d2c70805d9ef while it is in vm_state rescued Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '846f11d0-56dc-4717-87da-d2c70805d9ef', 'body': {'reboot': {'type': 'HARD'}}} Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 846f11d0-56dc-4717-87da-d2c70805d9ef in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:44:28.113240 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:44:28.117279 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 846f11d0-56dc-4717-87da-d2c70805d9ef while it is in vm_state rescued Aug 27 02:44:28.117279 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:28.117279 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:28.117279 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:28.117279 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:28.117279 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:28.117279 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:28.117279 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:44:28.117279 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:44:28.117279 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 846f11d0-56dc-4717-87da-d2c70805d9ef while it is in vm_state rescued Aug 27 02:44:28.117279 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:28.129411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Returning 409 to user: Cannot 'reboot' instance 846f11d0-56dc-4717-87da-d2c70805d9ef while it is in vm_state rescued {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:44:28.132643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-039bf1b7-cfd8-4a33-8e21-40ac4fdd7117 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef/action" status: 409 len: 145 microversion: 2.1 time: 0.190595 Aug 27 02:44:28.137967 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1350/2998] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:44:27 2022] POST /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef/action => generated 145 bytes in 196 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:44:28.153071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eeca5553-7752-462e-96d5-85c46d08c96a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:28.163499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eeca5553-7752-462e-96d5-85c46d08c96a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:28.165473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eeca5553-7752-462e-96d5-85c46d08c96a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Searching by: {'deleted': False, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:44:28.191472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeca5553-7752-462e-96d5-85c46d08c96a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.192529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeca5553-7752-462e-96d5-85c46d08c96a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.193354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeca5553-7752-462e-96d5-85c46d08c96a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.194484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeca5553-7752-462e-96d5-85c46d08c96a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.195251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeca5553-7752-462e-96d5-85c46d08c96a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.195987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeca5553-7752-462e-96d5-85c46d08c96a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.219773 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4e1b0569-ea48-485e-adce-434617da5455 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.600226 Aug 27 02:44:28.220825 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1649/2999] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:44:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:44:28.226674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ced33dc6-59be-4f4f-8aa4-93f19d13e2a9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:28.227657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ced33dc6-59be-4f4f-8aa4-93f19d13e2a9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:28.244460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ced33dc6-59be-4f4f-8aa4-93f19d13e2a9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.245236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ced33dc6-59be-4f4f-8aa4-93f19d13e2a9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.245929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ced33dc6-59be-4f4f-8aa4-93f19d13e2a9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.248975 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eeca5553-7752-462e-96d5-85c46d08c96a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.105527 Aug 27 02:44:28.250002 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1351/3000] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 02:44:28 2022] GET /compute/v2.1/servers => generated 1018 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:28.250586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ced33dc6-59be-4f4f-8aa4-93f19d13e2a9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.251240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ced33dc6-59be-4f4f-8aa4-93f19d13e2a9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.251873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ced33dc6-59be-4f4f-8aa4-93f19d13e2a9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.262399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7c1b9429-a214-4a1c-9d95-ac165c7e4276 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2975d8b0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:28.354871 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7c1b9429-a214-4a1c-9d95-ac165c7e4276 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.103306 Aug 27 02:44:28.355944 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1352/3001] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:28 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:28.369758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-a136103f-79f2-4fa9-ba2a-4bc1aee8fcc5 req-f26f2a03-21cb-48d5-ac8b-d92683664e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e103b49d-103b-42ab-8f83-f00e41579687", "name": "network-vif-plugged", "status": "completed", "tag": "486f8f25-2be4-44c1-9ea0-b1d4afdaa66d"}, {"server_uuid": "08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1", "name": "network-vif-plugged", "status": "completed", "tag": "cc07ffc6-88d4-4347-b44f-52ae8d2126ef"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:28.385646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a136103f-79f2-4fa9-ba2a-4bc1aee8fcc5 req-f26f2a03-21cb-48d5-ac8b-d92683664e3b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.386202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a136103f-79f2-4fa9-ba2a-4bc1aee8fcc5 req-f26f2a03-21cb-48d5-ac8b-d92683664e3b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.386860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a136103f-79f2-4fa9-ba2a-4bc1aee8fcc5 req-f26f2a03-21cb-48d5-ac8b-d92683664e3b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.417383 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a136103f-79f2-4fa9-ba2a-4bc1aee8fcc5 req-f26f2a03-21cb-48d5-ac8b-d92683664e3b service nova] Creating event network-vif-plugged:486f8f25-2be4-44c1-9ea0-b1d4afdaa66d for instance e103b49d-103b-42ab-8f83-f00e41579687 on n-h1-852084-5 Aug 27 02:44:28.419352 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a136103f-79f2-4fa9-ba2a-4bc1aee8fcc5 req-f26f2a03-21cb-48d5-ac8b-d92683664e3b service nova] Creating event network-vif-plugged:cc07ffc6-88d4-4347-b44f-52ae8d2126ef for instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 on n-h2-852084-5 Aug 27 02:44:28.444004 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-a136103f-79f2-4fa9-ba2a-4bc1aee8fcc5 req-f26f2a03-21cb-48d5-ac8b-d92683664e3b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086766 Aug 27 02:44:28.454794 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1353/3002] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:28.478552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:28.482813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:28.528051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.528591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.532043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.534360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.540355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.542380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.624606 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] HTTP exception thrown: Cannot 'rebuild' instance 846f11d0-56dc-4717-87da-d2c70805d9ef while it is in vm_state rescued Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Request method failure captured: Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef/action HTTP/1.1 Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 65 Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYO1ujqvCLBmMVe65fdN2J5dIO7-HUqI3Js5YGestJSXRt-3jM1W-KzE8NnECJ1ryJNn-_nCYfE1drEJmtuv9wrerAqLuupZmy6gs9vrBdbjKq9YdwsxzP7b-WGUVBzCCEf1u8fLpuDoBEeADCldZf84VX9NU_VzQjP9Knt2NuVZyVU Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/956a66be18bb4f9e996c8e16bcf23bab"}]}] Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 51b3d953421c409c9edd54287dcd11db Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'rebuild' instance 846f11d0-56dc-4717-87da-d2c70805d9ef while it is in vm_state rescued Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '846f11d0-56dc-4717-87da-d2c70805d9ef', 'body': {'rebuild': {'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89'}}} Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 846f11d0-56dc-4717-87da-d2c70805d9ef in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:44:28.633188 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 846f11d0-56dc-4717-87da-d2c70805d9ef while it is in vm_state rescued Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 846f11d0-56dc-4717-87da-d2c70805d9ef while it is in vm_state rescued Aug 27 02:44:28.640321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:28.655272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Returning 409 to user: Cannot 'rebuild' instance 846f11d0-56dc-4717-87da-d2c70805d9ef while it is in vm_state rescued {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:44:28.656749 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-580da00d-4deb-4617-97f4-ae6a5c6f81a9 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "POST /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef/action" status: 409 len: 146 microversion: 2.1 time: 0.198648 Aug 27 02:44:28.668996 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1354/3003] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:44:28 2022] POST /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef/action => generated 146 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:44:28.674317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4cdca121-51ec-4b8f-ae0c-61af47bd8983 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:28.693911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4cdca121-51ec-4b8f-ae0c-61af47bd8983 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:28.705731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ced33dc6-59be-4f4f-8aa4-93f19d13e2a9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:28.722421 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ced33dc6-59be-4f4f-8aa4-93f19d13e2a9 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1472 microversion: 2.1 time: 0.498190 Aug 27 02:44:28.723608 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1650/3004] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:28 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1472 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:28.731796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b527f71a-3fed-42f3-b8f6-ef97546a6bde tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:28.733103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b527f71a-3fed-42f3-b8f6-ef97546a6bde tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:28.847382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b527f71a-3fed-42f3-b8f6-ef97546a6bde tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:28.865850 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b527f71a-3fed-42f3-b8f6-ef97546a6bde tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1223 microversion: 2.1 time: 0.140726 Aug 27 02:44:28.871189 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1651/3005] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:28 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1223 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:28.893580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4cdca121-51ec-4b8f-ae0c-61af47bd8983 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:28.912199 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4cdca121-51ec-4b8f-ae0c-61af47bd8983 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1215 microversion: 2.1 time: 0.241695 Aug 27 02:44:28.925712 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1355/3006] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:28 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1215 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:28.930021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1b065b24-fc3b-4def-8000-4239f210c1d0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:28.932525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1b065b24-fc3b-4def-8000-4239f210c1d0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:28.963575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ece54ec2-ae5a-421f-ae1d-f038baa9ae53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:28.964434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ece54ec2-ae5a-421f-ae1d-f038baa9ae53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:28.968992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b065b24-fc3b-4def-8000-4239f210c1d0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.969499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b065b24-fc3b-4def-8000-4239f210c1d0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.970046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b065b24-fc3b-4def-8000-4239f210c1d0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.974804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b065b24-fc3b-4def-8000-4239f210c1d0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.975118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ece54ec2-ae5a-421f-ae1d-f038baa9ae53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.975444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b065b24-fc3b-4def-8000-4239f210c1d0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.976001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ece54ec2-ae5a-421f-ae1d-f038baa9ae53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.976745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ece54ec2-ae5a-421f-ae1d-f038baa9ae53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.976983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b065b24-fc3b-4def-8000-4239f210c1d0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:28.979072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ece54ec2-ae5a-421f-ae1d-f038baa9ae53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:28.979769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ece54ec2-ae5a-421f-ae1d-f038baa9ae53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:28.980931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ece54ec2-ae5a-421f-ae1d-f038baa9ae53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:29.070684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1b065b24-fc3b-4def-8000-4239f210c1d0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:44:29.338655 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1b065b24-fc3b-4def-8000-4239f210c1d0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 204 len: 0 microversion: 2.1 time: 0.439938 Aug 27 02:44:29.339875 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1652/3007] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:44:28 2022] DELETE /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:44:29.350180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-854d24cc-b7f3-40aa-a45b-a3f6a523f373 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:29.356955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-854d24cc-b7f3-40aa-a45b-a3f6a523f373 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:29.375703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-854d24cc-b7f3-40aa-a45b-a3f6a523f373 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:29.376726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-854d24cc-b7f3-40aa-a45b-a3f6a523f373 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:29.377316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-854d24cc-b7f3-40aa-a45b-a3f6a523f373 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:29.379578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-854d24cc-b7f3-40aa-a45b-a3f6a523f373 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:29.379865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ece54ec2-ae5a-421f-ae1d-f038baa9ae53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:29.380805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-854d24cc-b7f3-40aa-a45b-a3f6a523f373 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:29.383133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-854d24cc-b7f3-40aa-a45b-a3f6a523f373 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:29.418509 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ece54ec2-ae5a-421f-ae1d-f038baa9ae53 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1504 microversion: 2.1 time: 0.458570 Aug 27 02:44:29.420088 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1356/3008] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:28 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:29.431494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f89c7741-09d6-4ea5-b901-9f34dcb43828 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2975d4c0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:29.517495 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f89c7741-09d6-4ea5-b901-9f34dcb43828 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.093553 Aug 27 02:44:29.522999 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1357/3009] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:29 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:29.665534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-854d24cc-b7f3-40aa-a45b-a3f6a523f373 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:29.702506 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-854d24cc-b7f3-40aa-a45b-a3f6a523f373 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1688 microversion: 2.1 time: 0.354205 Aug 27 02:44:29.719131 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1653/3010] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:29 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1688 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:29.745094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-27f0b605-93c4-48cd-8427-8f3fdd9c80cc tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:29.752903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-27f0b605-93c4-48cd-8427-8f3fdd9c80cc tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:29.762536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f0b605-93c4-48cd-8427-8f3fdd9c80cc tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:29.763708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f0b605-93c4-48cd-8427-8f3fdd9c80cc tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:29.764632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f0b605-93c4-48cd-8427-8f3fdd9c80cc tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:29.766413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f0b605-93c4-48cd-8427-8f3fdd9c80cc tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:29.767250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f0b605-93c4-48cd-8427-8f3fdd9c80cc tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:29.769428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f0b605-93c4-48cd-8427-8f3fdd9c80cc tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:29.773992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:29.892154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d497be8-918f-42f3-9c6f-d5e7119e6996 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:29.892804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d497be8-918f-42f3-9c6f-d5e7119e6996 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:30.084117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2d497be8-918f-42f3-9c6f-d5e7119e6996 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:30.095705 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2d497be8-918f-42f3-9c6f-d5e7119e6996 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1223 microversion: 2.1 time: 0.207675 Aug 27 02:44:30.099233 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1654/3011] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:29 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1223 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:30.111784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-30c09237-cc83-4098-a23b-fb9dd75fa030 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:30.115175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-30c09237-cc83-4098-a23b-fb9dd75fa030 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:30.135272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30c09237-cc83-4098-a23b-fb9dd75fa030 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:30.139202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30c09237-cc83-4098-a23b-fb9dd75fa030 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:30.141221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30c09237-cc83-4098-a23b-fb9dd75fa030 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:30.143198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30c09237-cc83-4098-a23b-fb9dd75fa030 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:30.148226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30c09237-cc83-4098-a23b-fb9dd75fa030 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:30.149590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30c09237-cc83-4098-a23b-fb9dd75fa030 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:30.187302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-27f0b605-93c4-48cd-8427-8f3fdd9c80cc tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:30.214358 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-27f0b605-93c4-48cd-8427-8f3fdd9c80cc tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1472 microversion: 2.1 time: 0.473134 Aug 27 02:44:30.228068 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1358/3012] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:29 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1472 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:30.443179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-19d4a378-f474-4244-b608-6178ceb6c042 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:30.444527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-19d4a378-f474-4244-b608-6178ceb6c042 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:30.448070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-30c09237-cc83-4098-a23b-fb9dd75fa030 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:30.456597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d4a378-f474-4244-b608-6178ceb6c042 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:30.459125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d4a378-f474-4244-b608-6178ceb6c042 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:30.460114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d4a378-f474-4244-b608-6178ceb6c042 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:30.461105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d4a378-f474-4244-b608-6178ceb6c042 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:30.461898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d4a378-f474-4244-b608-6178ceb6c042 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:30.462711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d4a378-f474-4244-b608-6178ceb6c042 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:30.474374 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-30c09237-cc83-4098-a23b-fb9dd75fa030 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1219 microversion: 2.1 time: 0.370188 Aug 27 02:44:30.489714 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1655/3013] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:30 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1219 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:30.537167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-778b8296-702d-4e5a-8772-6acbc8658cbc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29907af0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:30.633757 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-778b8296-702d-4e5a-8772-6acbc8658cbc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.100269 Aug 27 02:44:30.634367 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1656/3014] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:30 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:30.648572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b99419d4-024a-4b91-be72-aa64a62db697 req-591b2d2d-6457-41c4-8e96-0e945fc64b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc6da4b-7eaa-4955-916f-f9400d8fb491", "name": "network-vif-unplugged", "status": "completed", "tag": "26a8ce3a-caa5-463a-891c-4c436615cead"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:30.661312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b99419d4-024a-4b91-be72-aa64a62db697 req-591b2d2d-6457-41c4-8e96-0e945fc64b77 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:30.662109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b99419d4-024a-4b91-be72-aa64a62db697 req-591b2d2d-6457-41c4-8e96-0e945fc64b77 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:30.662570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b99419d4-024a-4b91-be72-aa64a62db697 req-591b2d2d-6457-41c4-8e96-0e945fc64b77 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:30.698560 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b99419d4-024a-4b91-be72-aa64a62db697 req-591b2d2d-6457-41c4-8e96-0e945fc64b77 service nova] Creating event network-vif-unplugged:26a8ce3a-caa5-463a-891c-4c436615cead for instance dbc6da4b-7eaa-4955-916f-f9400d8fb491 on n-h1-852084-5 Aug 27 02:44:30.714293 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b99419d4-024a-4b91-be72-aa64a62db697 req-591b2d2d-6457-41c4-8e96-0e945fc64b77 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071280 Aug 27 02:44:30.716393 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1657/3015] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:30.741756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c072355-243c-4fd4-aebc-e976c7102a07 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:30.742554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4c072355-243c-4fd4-aebc-e976c7102a07 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:30.765706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c072355-243c-4fd4-aebc-e976c7102a07 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:30.766991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c072355-243c-4fd4-aebc-e976c7102a07 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:30.768473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c072355-243c-4fd4-aebc-e976c7102a07 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:30.770345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c072355-243c-4fd4-aebc-e976c7102a07 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:30.771534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c072355-243c-4fd4-aebc-e976c7102a07 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:30.773082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c072355-243c-4fd4-aebc-e976c7102a07 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:30.845381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-19d4a378-f474-4244-b608-6178ceb6c042 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:30.874967 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-19d4a378-f474-4244-b608-6178ceb6c042 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1504 microversion: 2.1 time: 0.436322 Aug 27 02:44:30.898996 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1359/3016] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:30 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1504 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:31.103735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4c072355-243c-4fd4-aebc-e976c7102a07 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:31.125993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a8175381-5fb6-4663-8b0c-0b918976967a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:31.127099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a8175381-5fb6-4663-8b0c-0b918976967a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:31.138137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8175381-5fb6-4663-8b0c-0b918976967a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:31.138991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8175381-5fb6-4663-8b0c-0b918976967a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:31.140095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8175381-5fb6-4663-8b0c-0b918976967a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:31.141254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8175381-5fb6-4663-8b0c-0b918976967a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:31.142443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8175381-5fb6-4663-8b0c-0b918976967a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:31.143335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8175381-5fb6-4663-8b0c-0b918976967a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:31.153765 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4c072355-243c-4fd4-aebc-e976c7102a07 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1688 microversion: 2.1 time: 0.410196 Aug 27 02:44:31.155447 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1658/3017] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:30 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1688 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:31.254295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4bdf7ecf-d002-4a9f-8c0c-3b1a9977b8ec tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:31.255460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4bdf7ecf-d002-4a9f-8c0c-3b1a9977b8ec tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:31.333444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bdf7ecf-d002-4a9f-8c0c-3b1a9977b8ec tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:31.334355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bdf7ecf-d002-4a9f-8c0c-3b1a9977b8ec tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:31.335526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a8175381-5fb6-4663-8b0c-0b918976967a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:31.342115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bdf7ecf-d002-4a9f-8c0c-3b1a9977b8ec tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:31.345609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bdf7ecf-d002-4a9f-8c0c-3b1a9977b8ec tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:31.348106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bdf7ecf-d002-4a9f-8c0c-3b1a9977b8ec tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:31.349167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bdf7ecf-d002-4a9f-8c0c-3b1a9977b8ec tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:31.354151 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a8175381-5fb6-4663-8b0c-0b918976967a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1227 microversion: 2.1 time: 0.228851 Aug 27 02:44:31.354822 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1360/3018] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:31 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1227 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:31.521121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b3cd6e22-7e0c-487d-be84-d7cd67a31b12 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:31.522965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b3cd6e22-7e0c-487d-be84-d7cd67a31b12 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:31.542634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3cd6e22-7e0c-487d-be84-d7cd67a31b12 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:31.544820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3cd6e22-7e0c-487d-be84-d7cd67a31b12 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:31.547020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3cd6e22-7e0c-487d-be84-d7cd67a31b12 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:31.547840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3cd6e22-7e0c-487d-be84-d7cd67a31b12 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:31.548366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3cd6e22-7e0c-487d-be84-d7cd67a31b12 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:31.548770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3cd6e22-7e0c-487d-be84-d7cd67a31b12 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:31.744968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b3cd6e22-7e0c-487d-be84-d7cd67a31b12 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:31.764341 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b3cd6e22-7e0c-487d-be84-d7cd67a31b12 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1267 microversion: 2.1 time: 0.250181 Aug 27 02:44:31.774001 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1361/3019] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:31 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1267 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:31.791792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ef95f4d8-4c5b-4d68-8fa1-b95137b2175e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29a35d30>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:31.889954 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ef95f4d8-4c5b-4d68-8fa1-b95137b2175e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.106744 Aug 27 02:44:31.893116 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1362/3020] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:31 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:31.936797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c716e749-91fd-4427-be66-b5d48793d7ea tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:31.939764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c716e749-91fd-4427-be66-b5d48793d7ea tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:31.971527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c716e749-91fd-4427-be66-b5d48793d7ea tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:31.973772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c716e749-91fd-4427-be66-b5d48793d7ea tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:31.975631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c716e749-91fd-4427-be66-b5d48793d7ea tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:31.978854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c716e749-91fd-4427-be66-b5d48793d7ea tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:31.980311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c716e749-91fd-4427-be66-b5d48793d7ea tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:31.981388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c716e749-91fd-4427-be66-b5d48793d7ea tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:31.990627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4bdf7ecf-d002-4a9f-8c0c-3b1a9977b8ec tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:32.005508 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4bdf7ecf-d002-4a9f-8c0c-3b1a9977b8ec tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1472 microversion: 2.1 time: 0.760289 Aug 27 02:44:32.006196 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1659/3021] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:31 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1472 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:32.176778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1575d04-bc0b-437f-853e-abce696285b8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:32.178261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a1575d04-bc0b-437f-853e-abce696285b8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:32.201176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1575d04-bc0b-437f-853e-abce696285b8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:32.202100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1575d04-bc0b-437f-853e-abce696285b8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:32.202805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1575d04-bc0b-437f-853e-abce696285b8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:32.203957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1575d04-bc0b-437f-853e-abce696285b8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:32.204666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1575d04-bc0b-437f-853e-abce696285b8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:32.214507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1575d04-bc0b-437f-853e-abce696285b8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:32.429753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c716e749-91fd-4427-be66-b5d48793d7ea tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:32.440053 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c716e749-91fd-4427-be66-b5d48793d7ea tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1504 microversion: 2.1 time: 0.536524 Aug 27 02:44:32.441948 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1363/3022] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:31 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1504 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:32.447093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-01ef9ab7-1aaa-48cb-bd50-0fa59f3fba43 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:32.448034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-01ef9ab7-1aaa-48cb-bd50-0fa59f3fba43 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:32.482709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01ef9ab7-1aaa-48cb-bd50-0fa59f3fba43 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:32.483672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01ef9ab7-1aaa-48cb-bd50-0fa59f3fba43 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:32.484453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01ef9ab7-1aaa-48cb-bd50-0fa59f3fba43 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:32.485564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01ef9ab7-1aaa-48cb-bd50-0fa59f3fba43 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:32.486381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01ef9ab7-1aaa-48cb-bd50-0fa59f3fba43 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:32.486843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01ef9ab7-1aaa-48cb-bd50-0fa59f3fba43 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:32.637010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a1575d04-bc0b-437f-853e-abce696285b8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:32.659005 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a1575d04-bc0b-437f-853e-abce696285b8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1688 microversion: 2.1 time: 0.483121 Aug 27 02:44:32.662188 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1660/3023] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:32 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1688 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:32.755358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-01ef9ab7-1aaa-48cb-bd50-0fa59f3fba43 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:32.781451 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-01ef9ab7-1aaa-48cb-bd50-0fa59f3fba43 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1227 microversion: 2.1 time: 0.331761 Aug 27 02:44:32.797045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-efc3ab99-2e3d-4562-aa7c-28e420ca34e5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:32.798029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-efc3ab99-2e3d-4562-aa7c-28e420ca34e5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:32.802216 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1364/3024] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:32 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1227 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:32.829014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efc3ab99-2e3d-4562-aa7c-28e420ca34e5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:32.830503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efc3ab99-2e3d-4562-aa7c-28e420ca34e5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:32.832605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efc3ab99-2e3d-4562-aa7c-28e420ca34e5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:32.839541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efc3ab99-2e3d-4562-aa7c-28e420ca34e5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:32.841085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efc3ab99-2e3d-4562-aa7c-28e420ca34e5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:32.842926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efc3ab99-2e3d-4562-aa7c-28e420ca34e5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:32.925883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6bc3dc5e-a6fc-4b59-a933-36875b67f8ee tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29a13790>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:33.144166 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6bc3dc5e-a6fc-4b59-a933-36875b67f8ee tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.226972 Aug 27 02:44:33.145531 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1365/3025] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:32 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:33.154611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e338df79-9d48-44f2-ba67-8b7c47d4e81e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:33.167255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e338df79-9d48-44f2-ba67-8b7c47d4e81e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:33.218821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e338df79-9d48-44f2-ba67-8b7c47d4e81e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:33.220794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e338df79-9d48-44f2-ba67-8b7c47d4e81e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:33.223410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e338df79-9d48-44f2-ba67-8b7c47d4e81e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:33.227955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e338df79-9d48-44f2-ba67-8b7c47d4e81e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:33.231421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e338df79-9d48-44f2-ba67-8b7c47d4e81e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:33.235286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e338df79-9d48-44f2-ba67-8b7c47d4e81e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:33.275848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-efc3ab99-2e3d-4562-aa7c-28e420ca34e5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:33.305607 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-efc3ab99-2e3d-4562-aa7c-28e420ca34e5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1275 microversion: 2.1 time: 0.512202 Aug 27 02:44:33.314123 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1661/3026] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:32 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1275 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:44:33.481540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8e30b93b-5b68-4f69-848b-4afab3a1ba18 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:33.482725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8e30b93b-5b68-4f69-848b-4afab3a1ba18 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:33.523150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30b93b-5b68-4f69-848b-4afab3a1ba18 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:33.523636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30b93b-5b68-4f69-848b-4afab3a1ba18 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:33.524081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30b93b-5b68-4f69-848b-4afab3a1ba18 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:33.524825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30b93b-5b68-4f69-848b-4afab3a1ba18 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:33.525285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30b93b-5b68-4f69-848b-4afab3a1ba18 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:33.525741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30b93b-5b68-4f69-848b-4afab3a1ba18 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:34.485355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8e30b93b-5b68-4f69-848b-4afab3a1ba18 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:34.507442 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8e30b93b-5b68-4f69-848b-4afab3a1ba18 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 200 len: 1507 microversion: 2.1 time: 1.037484 Aug 27 02:44:34.508899 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1662/3027] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:33 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 1507 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:34.520986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e78a2b46-a605-470f-bfe3-10d45075abe8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:34.528970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e78a2b46-a605-470f-bfe3-10d45075abe8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:34.553764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e78a2b46-a605-470f-bfe3-10d45075abe8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:34.556213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e78a2b46-a605-470f-bfe3-10d45075abe8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:34.558311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e78a2b46-a605-470f-bfe3-10d45075abe8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:34.561037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e78a2b46-a605-470f-bfe3-10d45075abe8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:34.561584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e78a2b46-a605-470f-bfe3-10d45075abe8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:34.562357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e78a2b46-a605-470f-bfe3-10d45075abe8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:34.841390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e338df79-9d48-44f2-ba67-8b7c47d4e81e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:34.883035 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e338df79-9d48-44f2-ba67-8b7c47d4e81e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1472 microversion: 2.1 time: 1.733268 Aug 27 02:44:34.884904 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1366/3028] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:33 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1472 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:34.907733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-90c5aa03-4109-4d4b-8f48-dd6fdcee2298 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:34.909248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-90c5aa03-4109-4d4b-8f48-dd6fdcee2298 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:34.923279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90c5aa03-4109-4d4b-8f48-dd6fdcee2298 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:34.924322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90c5aa03-4109-4d4b-8f48-dd6fdcee2298 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:34.925294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90c5aa03-4109-4d4b-8f48-dd6fdcee2298 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:34.926762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90c5aa03-4109-4d4b-8f48-dd6fdcee2298 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:34.927577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90c5aa03-4109-4d4b-8f48-dd6fdcee2298 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:34.928688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90c5aa03-4109-4d4b-8f48-dd6fdcee2298 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:34.962878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e78a2b46-a605-470f-bfe3-10d45075abe8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:34.983690 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e78a2b46-a605-470f-bfe3-10d45075abe8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1688 microversion: 2.1 time: 0.472705 Aug 27 02:44:34.989798 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1663/3029] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:34 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1688 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:35.003267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb891c1b-3a4d-4ec2-aede-17eb0b8c10ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d292624c0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:35.157317 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb891c1b-3a4d-4ec2-aede-17eb0b8c10ed tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.164000 Aug 27 02:44:35.164244 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1664/3030] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:34 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:35.177101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cc6c122f-c30c-4ad3-ad25-01b98e835a26 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:35.178403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cc6c122f-c30c-4ad3-ad25-01b98e835a26 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:35.193975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc6c122f-c30c-4ad3-ad25-01b98e835a26 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:35.194728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc6c122f-c30c-4ad3-ad25-01b98e835a26 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:35.195405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc6c122f-c30c-4ad3-ad25-01b98e835a26 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:35.198892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc6c122f-c30c-4ad3-ad25-01b98e835a26 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:35.201076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc6c122f-c30c-4ad3-ad25-01b98e835a26 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:35.202136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc6c122f-c30c-4ad3-ad25-01b98e835a26 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:35.223522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-90c5aa03-4109-4d4b-8f48-dd6fdcee2298 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:35.239132 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-90c5aa03-4109-4d4b-8f48-dd6fdcee2298 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1275 microversion: 2.1 time: 0.349831 Aug 27 02:44:35.240610 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1367/3031] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:34 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1275 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:35.250973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a034e928-2af9-4381-8fbc-f7a43af9d65f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:35.252615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a034e928-2af9-4381-8fbc-f7a43af9d65f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:35.272335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a034e928-2af9-4381-8fbc-f7a43af9d65f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:35.285604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a034e928-2af9-4381-8fbc-f7a43af9d65f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:35.286823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a034e928-2af9-4381-8fbc-f7a43af9d65f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:35.290801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a034e928-2af9-4381-8fbc-f7a43af9d65f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:35.297572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a034e928-2af9-4381-8fbc-f7a43af9d65f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:35.298697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a034e928-2af9-4381-8fbc-f7a43af9d65f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:35.975541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a034e928-2af9-4381-8fbc-f7a43af9d65f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:35.985952 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a034e928-2af9-4381-8fbc-f7a43af9d65f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.743374 Aug 27 02:44:35.986572 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1368/3032] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:35 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:35.997316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-341d4b8c-2c58-47fb-b0e4-e11f93b91e23 req-940e5aae-7947-437c-a6e6-b89867c30c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875762f1-6b75-4c91-859b-76fb857ecb26", "name": "network-vif-unplugged", "status": "completed", "tag": "ef6abdee-33da-4ec5-9d71-9440e01d80d1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:36.034559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-341d4b8c-2c58-47fb-b0e4-e11f93b91e23 req-940e5aae-7947-437c-a6e6-b89867c30c31 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:36.034968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-341d4b8c-2c58-47fb-b0e4-e11f93b91e23 req-940e5aae-7947-437c-a6e6-b89867c30c31 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:36.035650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-341d4b8c-2c58-47fb-b0e4-e11f93b91e23 req-940e5aae-7947-437c-a6e6-b89867c30c31 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:36.057304 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-341d4b8c-2c58-47fb-b0e4-e11f93b91e23 req-940e5aae-7947-437c-a6e6-b89867c30c31 service nova] Creating event network-vif-unplugged:ef6abdee-33da-4ec5-9d71-9440e01d80d1 for instance 875762f1-6b75-4c91-859b-76fb857ecb26 on n-h1-852084-5 Aug 27 02:44:36.072944 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-341d4b8c-2c58-47fb-b0e4-e11f93b91e23 req-940e5aae-7947-437c-a6e6-b89867c30c31 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084552 Aug 27 02:44:36.073937 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1369/3033] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:36.089824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c24fdb04-d377-44a2-89bf-5c357e51662c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:36.090856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c24fdb04-d377-44a2-89bf-5c357e51662c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:36.107997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c24fdb04-d377-44a2-89bf-5c357e51662c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:36.108822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c24fdb04-d377-44a2-89bf-5c357e51662c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:36.110261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c24fdb04-d377-44a2-89bf-5c357e51662c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:36.112616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c24fdb04-d377-44a2-89bf-5c357e51662c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:36.116430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c24fdb04-d377-44a2-89bf-5c357e51662c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:36.117171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c24fdb04-d377-44a2-89bf-5c357e51662c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:36.229472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cc6c122f-c30c-4ad3-ad25-01b98e835a26 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:36.247223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:36.271886 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cc6c122f-c30c-4ad3-ad25-01b98e835a26 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1273 microversion: 2.1 time: 1.105403 Aug 27 02:44:36.273587 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1665/3034] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:35 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1273 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:36.287066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-59941514-1e49-47b5-99ae-9b916e8dbebd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:36.288609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-59941514-1e49-47b5-99ae-9b916e8dbebd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:36.316548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59941514-1e49-47b5-99ae-9b916e8dbebd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:36.319709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59941514-1e49-47b5-99ae-9b916e8dbebd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:36.321334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59941514-1e49-47b5-99ae-9b916e8dbebd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:36.323828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59941514-1e49-47b5-99ae-9b916e8dbebd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:36.325481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59941514-1e49-47b5-99ae-9b916e8dbebd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:36.327663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59941514-1e49-47b5-99ae-9b916e8dbebd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:36.679577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-59941514-1e49-47b5-99ae-9b916e8dbebd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:36.693599 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-59941514-1e49-47b5-99ae-9b916e8dbebd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.416339 Aug 27 02:44:36.694646 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1666/3035] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:36 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:36.704966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a4df4c52-c617-453a-8a0e-e9b040f803bd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:36.706008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a4df4c52-c617-453a-8a0e-e9b040f803bd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:36.718311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4df4c52-c617-453a-8a0e-e9b040f803bd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:36.722369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4df4c52-c617-453a-8a0e-e9b040f803bd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:36.723093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4df4c52-c617-453a-8a0e-e9b040f803bd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:36.726711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4df4c52-c617-453a-8a0e-e9b040f803bd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:36.727441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4df4c52-c617-453a-8a0e-e9b040f803bd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:36.728088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4df4c52-c617-453a-8a0e-e9b040f803bd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:37.120689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a4df4c52-c617-453a-8a0e-e9b040f803bd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:37.165903 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a4df4c52-c617-453a-8a0e-e9b040f803bd tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1688 microversion: 2.1 time: 0.468398 Aug 27 02:44:37.172895 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1667/3036] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:36 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1688 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:37.209286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70831c37-d940-4358-ac12-400bbb1ac45e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29262310>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:37.332348 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70831c37-d940-4358-ac12-400bbb1ac45e tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.137522 Aug 27 02:44:37.340467 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1668/3037] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:37 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:37.347825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e10b1651-b222-4b9e-8be6-786d8d4a2d2b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:37.348935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e10b1651-b222-4b9e-8be6-786d8d4a2d2b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:37.357213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e10b1651-b222-4b9e-8be6-786d8d4a2d2b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:37.358342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e10b1651-b222-4b9e-8be6-786d8d4a2d2b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:37.358342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e10b1651-b222-4b9e-8be6-786d8d4a2d2b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:37.358917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e10b1651-b222-4b9e-8be6-786d8d4a2d2b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:37.359600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e10b1651-b222-4b9e-8be6-786d8d4a2d2b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:37.360025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e10b1651-b222-4b9e-8be6-786d8d4a2d2b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:37.423702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c24fdb04-d377-44a2-89bf-5c357e51662c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:37.439702 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c24fdb04-d377-44a2-89bf-5c357e51662c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1472 microversion: 2.1 time: 1.360287 Aug 27 02:44:37.457266 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1370/3038] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:36 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1472 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:37.477854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-782fbdf6-35e0-4881-84e4-f3d6451a6660 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:37.479390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-782fbdf6-35e0-4881-84e4-f3d6451a6660 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:37.504743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fbdf6-35e0-4881-84e4-f3d6451a6660 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:37.507058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fbdf6-35e0-4881-84e4-f3d6451a6660 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:37.508177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fbdf6-35e0-4881-84e4-f3d6451a6660 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:37.514465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fbdf6-35e0-4881-84e4-f3d6451a6660 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:37.519049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fbdf6-35e0-4881-84e4-f3d6451a6660 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:37.520312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-782fbdf6-35e0-4881-84e4-f3d6451a6660 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:37.553705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e10b1651-b222-4b9e-8be6-786d8d4a2d2b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:37.574716 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e10b1651-b222-4b9e-8be6-786d8d4a2d2b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1281 microversion: 2.1 time: 0.232290 Aug 27 02:44:37.576162 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1669/3039] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:37 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1281 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:37.586737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ffd2bb3f-8b94-4305-80b4-08c27c53cd80 req-f043c508-cf7a-4c02-b656-7c8bb4c25818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e2dec37-0d3d-4970-ae03-cc5bbbdd5216", "tag": "7a94feaf-a246-469b-a6d9-5535266fc0cd"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:37.600900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ffd2bb3f-8b94-4305-80b4-08c27c53cd80 req-f043c508-cf7a-4c02-b656-7c8bb4c25818 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:37.603275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ffd2bb3f-8b94-4305-80b4-08c27c53cd80 req-f043c508-cf7a-4c02-b656-7c8bb4c25818 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:37.604606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ffd2bb3f-8b94-4305-80b4-08c27c53cd80 req-f043c508-cf7a-4c02-b656-7c8bb4c25818 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:37.642982 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ffd2bb3f-8b94-4305-80b4-08c27c53cd80 req-f043c508-cf7a-4c02-b656-7c8bb4c25818 service nova] Creating event network-changed:7a94feaf-a246-469b-a6d9-5535266fc0cd for instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 on n-h2-852084-5 Aug 27 02:44:37.676848 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ffd2bb3f-8b94-4305-80b4-08c27c53cd80 req-f043c508-cf7a-4c02-b656-7c8bb4c25818 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093770 Aug 27 02:44:37.679288 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1670/3040] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:37.708127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5a18927d-71e4-47bf-ab8e-a6cea3eb6444 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:37.713358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5a18927d-71e4-47bf-ab8e-a6cea3eb6444 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:37.729527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a18927d-71e4-47bf-ab8e-a6cea3eb6444 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:37.731025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a18927d-71e4-47bf-ab8e-a6cea3eb6444 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:37.732177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a18927d-71e4-47bf-ab8e-a6cea3eb6444 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:37.733850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a18927d-71e4-47bf-ab8e-a6cea3eb6444 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:37.735042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a18927d-71e4-47bf-ab8e-a6cea3eb6444 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:37.736114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a18927d-71e4-47bf-ab8e-a6cea3eb6444 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:37.818265 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5a18927d-71e4-47bf-ab8e-a6cea3eb6444 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.132942 Aug 27 02:44:37.822556 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1671/3041] 10.222.0.99 () {60 vars in 1343 bytes} [Sat Aug 27 02:44:37 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:37.858404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6d9d25fb-9a53-4279-bab4-3f9a26b25c1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:37.859537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6d9d25fb-9a53-4279-bab4-3f9a26b25c1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:37.895510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9d25fb-9a53-4279-bab4-3f9a26b25c1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:37.898028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9d25fb-9a53-4279-bab4-3f9a26b25c1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:37.899113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9d25fb-9a53-4279-bab4-3f9a26b25c1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:37.901382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9d25fb-9a53-4279-bab4-3f9a26b25c1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:37.903554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9d25fb-9a53-4279-bab4-3f9a26b25c1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:37.905841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9d25fb-9a53-4279-bab4-3f9a26b25c1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:37.986387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:38.075694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6d9d25fb-9a53-4279-bab4-3f9a26b25c1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:38.090257 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6d9d25fb-9a53-4279-bab4-3f9a26b25c1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1273 microversion: 2.1 time: 0.264180 Aug 27 02:44:38.091389 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1672/3042] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:37 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1273 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:38.099223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-111bd737-7acb-4a99-af72-e91f9140f88a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:38.099908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-111bd737-7acb-4a99-af72-e91f9140f88a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:38.107959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111bd737-7acb-4a99-af72-e91f9140f88a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:38.109621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111bd737-7acb-4a99-af72-e91f9140f88a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:38.110259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111bd737-7acb-4a99-af72-e91f9140f88a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:38.111143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111bd737-7acb-4a99-af72-e91f9140f88a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:38.111785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111bd737-7acb-4a99-af72-e91f9140f88a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:38.112339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-111bd737-7acb-4a99-af72-e91f9140f88a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:38.150013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-111bd737-7acb-4a99-af72-e91f9140f88a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:44:38.203158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:38.339226 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-111bd737-7acb-4a99-af72-e91f9140f88a tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 204 len: 0 microversion: 2.20 time: 0.244386 Aug 27 02:44:38.345447 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1673/3043] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:44:38 2022] DELETE /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:44:38.350338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5ef64ffc-c0ce-4140-843c-bdf634a77dd8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:38.351338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5ef64ffc-c0ce-4140-843c-bdf634a77dd8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:38.361077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef64ffc-c0ce-4140-843c-bdf634a77dd8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:38.363658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef64ffc-c0ce-4140-843c-bdf634a77dd8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:38.364352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef64ffc-c0ce-4140-843c-bdf634a77dd8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:38.365472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef64ffc-c0ce-4140-843c-bdf634a77dd8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:38.366464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef64ffc-c0ce-4140-843c-bdf634a77dd8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:38.367135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ef64ffc-c0ce-4140-843c-bdf634a77dd8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:38.492957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5ef64ffc-c0ce-4140-843c-bdf634a77dd8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:38.523747 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5ef64ffc-c0ce-4140-843c-bdf634a77dd8 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1620 microversion: 2.1 time: 0.179779 Aug 27 02:44:38.525183 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1674/3044] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:38 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1620 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:38.534873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4eed9d3b-86f8-492a-8fc1-561783c1e03b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:38.535823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4eed9d3b-86f8-492a-8fc1-561783c1e03b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:38.548718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eed9d3b-86f8-492a-8fc1-561783c1e03b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:38.550408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eed9d3b-86f8-492a-8fc1-561783c1e03b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:38.551267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eed9d3b-86f8-492a-8fc1-561783c1e03b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:38.553403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eed9d3b-86f8-492a-8fc1-561783c1e03b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:38.554837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eed9d3b-86f8-492a-8fc1-561783c1e03b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:38.555336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eed9d3b-86f8-492a-8fc1-561783c1e03b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:38.614717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4eed9d3b-86f8-492a-8fc1-561783c1e03b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:44:38.724653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-782fbdf6-35e0-4881-84e4-f3d6451a6660 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:38.733486 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-782fbdf6-35e0-4881-84e4-f3d6451a6660 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 1.274149 Aug 27 02:44:38.745714 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1371/3045] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:37 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:38.745714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f446732e-b9ba-4487-9b0f-eba0af04edef tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d296cd310>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:38.793161 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f446732e-b9ba-4487-9b0f-eba0af04edef tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1439 microversion: 2.1 time: 0.057460 Aug 27 02:44:38.795372 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1372/3046] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:38 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1439 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:38.796439 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4eed9d3b-86f8-492a-8fc1-561783c1e03b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 204 len: 0 microversion: 2.32 time: 0.268379 Aug 27 02:44:38.806317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:38.806317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:38.808150 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1675/3047] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:44:38 2022] DELETE /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:44:38.812627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:38.813310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:38.813902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:38.814751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:38.815400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:38.816468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:38.820095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4442bde-ff35-453b-ab43-7dda2a4c3833 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:38.821342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4442bde-ff35-453b-ab43-7dda2a4c3833 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:38.832925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4442bde-ff35-453b-ab43-7dda2a4c3833 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:38.833799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4442bde-ff35-453b-ab43-7dda2a4c3833 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:38.834520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4442bde-ff35-453b-ab43-7dda2a4c3833 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:38.835873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4442bde-ff35-453b-ab43-7dda2a4c3833 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:38.836719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4442bde-ff35-453b-ab43-7dda2a4c3833 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:38.837505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4442bde-ff35-453b-ab43-7dda2a4c3833 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:38.899310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:39.077401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4442bde-ff35-453b-ab43-7dda2a4c3833 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:39.089455 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4442bde-ff35-453b-ab43-7dda2a4c3833 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1472 microversion: 2.1 time: 0.277818 Aug 27 02:44:39.090720 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1676/3048] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:38 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1472 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:39.096161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fe573056-9824-40cd-b0e8-b2e23c787793 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:39.097502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fe573056-9824-40cd-b0e8-b2e23c787793 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:39.127037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe573056-9824-40cd-b0e8-b2e23c787793 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.128694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe573056-9824-40cd-b0e8-b2e23c787793 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.129793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe573056-9824-40cd-b0e8-b2e23c787793 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:39.130929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe573056-9824-40cd-b0e8-b2e23c787793 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.131637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe573056-9824-40cd-b0e8-b2e23c787793 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.132396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe573056-9824-40cd-b0e8-b2e23c787793 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:39.223271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe573056-9824-40cd-b0e8-b2e23c787793 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:39.231928 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fe573056-9824-40cd-b0e8-b2e23c787793 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1281 microversion: 2.1 time: 0.139931 Aug 27 02:44:39.232869 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1677/3049] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:39 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1281 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:39.238772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-397735ed-a0f2-4eae-82b5-9b5e09dfac42 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:39.239444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-397735ed-a0f2-4eae-82b5-9b5e09dfac42 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:39.245862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-397735ed-a0f2-4eae-82b5-9b5e09dfac42 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.246360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-397735ed-a0f2-4eae-82b5-9b5e09dfac42 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.247135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-397735ed-a0f2-4eae-82b5-9b5e09dfac42 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:39.248346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-397735ed-a0f2-4eae-82b5-9b5e09dfac42 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.248998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-397735ed-a0f2-4eae-82b5-9b5e09dfac42 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.249752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-397735ed-a0f2-4eae-82b5-9b5e09dfac42 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:39.500875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-397735ed-a0f2-4eae-82b5-9b5e09dfac42 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:39.525774 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-397735ed-a0f2-4eae-82b5-9b5e09dfac42 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.291088 Aug 27 02:44:39.527654 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1678/3050] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:39 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:39.538300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:39.540828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:39.548904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:39.560943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:39.566423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.567838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.569026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:39.570681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.571817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.572888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:39.583109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:39.585867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:39.588342 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6eecda1f-6aa9-467a-88d8-e21b877c89d8 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1722 microversion: 2.20 time: 0.790890 Aug 27 02:44:39.589748 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1373/3051] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:38 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1722 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:44:39.595917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-63754e24-a4e0-46d5-9066-cfdbf1e6154f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:39.597169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-63754e24-a4e0-46d5-9066-cfdbf1e6154f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:39.606717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63754e24-a4e0-46d5-9066-cfdbf1e6154f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.607587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63754e24-a4e0-46d5-9066-cfdbf1e6154f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.608242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63754e24-a4e0-46d5-9066-cfdbf1e6154f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:39.609433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63754e24-a4e0-46d5-9066-cfdbf1e6154f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:39.611089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63754e24-a4e0-46d5-9066-cfdbf1e6154f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:39.612733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63754e24-a4e0-46d5-9066-cfdbf1e6154f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:40.025606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:40.052768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:40.058431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:40.063443 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b754a262-1754-45bd-8633-52826e762938 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 2955 microversion: 2.32 time: 0.531188 Aug 27 02:44:40.078116 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1679/3052] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:39 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 2955 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:44:40.078116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0854fb86-4f54-4e1e-a9ee-c8744e5074a8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:40.086128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0854fb86-4f54-4e1e-a9ee-c8744e5074a8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:40.086128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0854fb86-4f54-4e1e-a9ee-c8744e5074a8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:40.086865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0854fb86-4f54-4e1e-a9ee-c8744e5074a8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:40.094373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=10 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:40.131936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0854fb86-4f54-4e1e-a9ee-c8744e5074a8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Going to try to stop instance {{(pid=122488) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:44:40.141319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:40.245251 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0854fb86-4f54-4e1e-a9ee-c8744e5074a8 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.172881 Aug 27 02:44:40.248430 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1680/3053] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:44:40 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:44:40.262850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:40.262850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:40.279646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:40.281336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:40.282623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:40.285244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:40.294867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:40.295732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:40.374705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:40.375814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:40.376821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:40.377945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lazy-loading 'fault' on Instance uuid 875762f1-6b75-4c91-859b-76fb857ecb26 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:44:40.382457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-63754e24-a4e0-46d5-9066-cfdbf1e6154f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:40.443656 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-63754e24-a4e0-46d5-9066-cfdbf1e6154f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1315 microversion: 2.1 time: 0.851513 Aug 27 02:44:40.445922 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1374/3054] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:39 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1315 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:40.471213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d3bbe831-08ad-4737-ba5f-4913297962c9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29758550>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:40.486084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:40.512171 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4bf3ce8b-c100-40e3-8e78-36fc82638499 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 200 len: 1333 microversion: 2.1 time: 0.261610 Aug 27 02:44:40.514818 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1681/3055] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:40 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 1333 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:40.532082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-87b31f0f-19e2-438a-b5eb-f29be728d945 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:40.533309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-87b31f0f-19e2-438a-b5eb-f29be728d945 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:40.547251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87b31f0f-19e2-438a-b5eb-f29be728d945 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:40.547860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87b31f0f-19e2-438a-b5eb-f29be728d945 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:40.548677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87b31f0f-19e2-438a-b5eb-f29be728d945 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:40.551593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87b31f0f-19e2-438a-b5eb-f29be728d945 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:40.552447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87b31f0f-19e2-438a-b5eb-f29be728d945 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:40.553208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87b31f0f-19e2-438a-b5eb-f29be728d945 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:40.593828 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d3bbe831-08ad-4737-ba5f-4913297962c9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1448 microversion: 2.1 time: 0.145183 Aug 27 02:44:40.598520 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1375/3056] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:40 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1448 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:40.610354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-72d7cf16-4e33-4832-82ff-46aa0ef5b614 req-e45c25eb-e310-4218-821f-2fd1d7f72408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875762f1-6b75-4c91-859b-76fb857ecb26", "name": "network-vif-deleted", "tag": "ef6abdee-33da-4ec5-9d71-9440e01d80d1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:40.639393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-72d7cf16-4e33-4832-82ff-46aa0ef5b614 req-e45c25eb-e310-4218-821f-2fd1d7f72408 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:40.641448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-72d7cf16-4e33-4832-82ff-46aa0ef5b614 req-e45c25eb-e310-4218-821f-2fd1d7f72408 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:40.642621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-72d7cf16-4e33-4832-82ff-46aa0ef5b614 req-e45c25eb-e310-4218-821f-2fd1d7f72408 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:40.679013 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-72d7cf16-4e33-4832-82ff-46aa0ef5b614 req-e45c25eb-e310-4218-821f-2fd1d7f72408 service nova] Creating event network-vif-deleted:ef6abdee-33da-4ec5-9d71-9440e01d80d1 for instance 875762f1-6b75-4c91-859b-76fb857ecb26 on n-h1-852084-5 Aug 27 02:44:40.696853 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-72d7cf16-4e33-4832-82ff-46aa0ef5b614 req-e45c25eb-e310-4218-821f-2fd1d7f72408 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095012 Aug 27 02:44:40.697990 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1376/3057] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:40.728716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d4fb14ae-7f4e-44b0-b672-54da486f9dd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:40.730400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d4fb14ae-7f4e-44b0-b672-54da486f9dd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:40.759534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4fb14ae-7f4e-44b0-b672-54da486f9dd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:40.760468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4fb14ae-7f4e-44b0-b672-54da486f9dd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:40.761263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4fb14ae-7f4e-44b0-b672-54da486f9dd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:40.762589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4fb14ae-7f4e-44b0-b672-54da486f9dd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:40.763453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4fb14ae-7f4e-44b0-b672-54da486f9dd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:40.764201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4fb14ae-7f4e-44b0-b672-54da486f9dd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:40.930291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-87b31f0f-19e2-438a-b5eb-f29be728d945 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:40.947543 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-87b31f0f-19e2-438a-b5eb-f29be728d945 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1472 microversion: 2.1 time: 0.429759 Aug 27 02:44:40.948827 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1682/3058] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:40 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:40.999693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fbd44c40-c6a6-491c-a81e-0ca39dc45e27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:41.001220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fbd44c40-c6a6-491c-a81e-0ca39dc45e27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:41.014782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd44c40-c6a6-491c-a81e-0ca39dc45e27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:41.015826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd44c40-c6a6-491c-a81e-0ca39dc45e27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:41.016754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd44c40-c6a6-491c-a81e-0ca39dc45e27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:41.018788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd44c40-c6a6-491c-a81e-0ca39dc45e27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:41.020211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd44c40-c6a6-491c-a81e-0ca39dc45e27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:41.021188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd44c40-c6a6-491c-a81e-0ca39dc45e27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:41.307551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fbd44c40-c6a6-491c-a81e-0ca39dc45e27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:41.327493 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fbd44c40-c6a6-491c-a81e-0ca39dc45e27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1323 microversion: 2.1 time: 0.334429 Aug 27 02:44:41.329239 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1683/3059] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:40 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:41.352689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ebe0f08b-01ca-4262-8e15-3d143c3ebfae tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d293a75e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:41.447717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ebe0f08b-01ca-4262-8e15-3d143c3ebfae tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 200 len: 1448 microversion: 2.1 time: 0.103293 Aug 27 02:44:41.448846 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1684/3060] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:44:41 2022] GET /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 1448 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:41.465360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:41.466643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:41.480045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:41.480887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:41.481371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:41.482161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:41.485205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:41.485205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:41.757502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d4fb14ae-7f4e-44b0-b672-54da486f9dd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:41.787292 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d4fb14ae-7f4e-44b0-b672-54da486f9dd0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1678 microversion: 2.1 time: 1.077349 Aug 27 02:44:41.790171 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1377/3061] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:40 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1678 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:41.840464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:41.843252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:41.890793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:41.894003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:41.895668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:41.897338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:41.900116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:41.901300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:41.904839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:41.929522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:41.948013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:41.950583 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ce10fb42-4e28-469c-8ffb-970189c3ace1 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1722 microversion: 2.20 time: 0.499460 Aug 27 02:44:41.952157 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1685/3062] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:41 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1722 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:44:41.972691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dbc51ce1-137d-4cdf-86e6-806abdabb0dc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29262f70>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:43.289356 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dbc51ce1-137d-4cdf-86e6-806abdabb0dc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 204 len: 0 microversion: 2.1 time: 1.334617 Aug 27 02:44:43.293854 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1686/3063] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:41 2022] DELETE /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 0 bytes in 1341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:44:43.317524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-01e96f1b-db19-4763-bb15-ee9330dfb8a3 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:43.319132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-01e96f1b-db19-4763-bb15-ee9330dfb8a3 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:43.341451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01e96f1b-db19-4763-bb15-ee9330dfb8a3 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.342364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01e96f1b-db19-4763-bb15-ee9330dfb8a3 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.344811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01e96f1b-db19-4763-bb15-ee9330dfb8a3 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:43.345935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01e96f1b-db19-4763-bb15-ee9330dfb8a3 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.346654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01e96f1b-db19-4763-bb15-ee9330dfb8a3 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.347684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01e96f1b-db19-4763-bb15-ee9330dfb8a3 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:43.356792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:43.371188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:43.373305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:43.375352 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-53b1d233-94b7-4251-84a3-c02dbcd297db tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 2955 microversion: 2.32 time: 1.582051 Aug 27 02:44:43.376271 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1378/3064] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:41 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 2955 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:44:43.382376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:43.384347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 875762f1-6b75-4c91-859b-76fb857ecb26] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:43.392135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.393781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.394696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:43.395850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.396570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.397236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:43.416902 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] HTTP exception thrown: Instance 875762f1-6b75-4c91-859b-76fb857ecb26 could not be found. Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Request method failure captured: Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 HTTP/1.1 Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYO1ujqvCLBmMVe65fdN2J5dIO7-HUqI3Js5YGestJSXRt-3jM1W-KzE8NnECJ1ryJNn-_nCYfE1drEJmtuv9wrerAqLuupZmy6gs9vrBdbjKq9YdwsxzP7b-WGUVBzCCEf1u8fLpuDoBEeADCldZf84VX9NU_VzQjP9Knt2NuVZyVU Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/956a66be18bb4f9e996c8e16bcf23bab"}]}] Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 51b3d953421c409c9edd54287dcd11db Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 875762f1-6b75-4c91-859b-76fb857ecb26 could not be found. Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '875762f1-6b75-4c91-859b-76fb857ecb26'} Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875762f1-6b75-4c91-859b-76fb857ecb26 could not be found. Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875762f1-6b75-4c91-859b-76fb857ecb26 could not be found. Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:43.419129 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:43.423986 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:43.423986 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:43.423986 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:43.423986 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:43.423986 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:44:43.423986 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:44:43.423986 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875762f1-6b75-4c91-859b-76fb857ecb26 could not be found. Aug 27 02:44:43.423986 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:44:43.423986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Returning 404 to user: Instance 875762f1-6b75-4c91-859b-76fb857ecb26 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:44:43.425184 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9f5df303-52b0-4f7a-aae7-edcdc291ce64 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26" status: 404 len: 111 microversion: 2.1 time: 0.046280 Aug 27 02:44:43.429465 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1379/3065] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:43 2022] GET /compute/v2.1/servers/875762f1-6b75-4c91-859b-76fb857ecb26 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:44:43.437408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e41f814e-e6f6-46e6-8ba8-6d57fdd85435 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:43.438695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e41f814e-e6f6-46e6-8ba8-6d57fdd85435 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:43.446608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e41f814e-e6f6-46e6-8ba8-6d57fdd85435 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.447531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e41f814e-e6f6-46e6-8ba8-6d57fdd85435 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.448257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e41f814e-e6f6-46e6-8ba8-6d57fdd85435 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:43.449270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e41f814e-e6f6-46e6-8ba8-6d57fdd85435 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.450177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e41f814e-e6f6-46e6-8ba8-6d57fdd85435 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.451132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e41f814e-e6f6-46e6-8ba8-6d57fdd85435 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:43.830671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-01e96f1b-db19-4763-bb15-ee9330dfb8a3 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:43.851061 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-01e96f1b-db19-4763-bb15-ee9330dfb8a3 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1315 microversion: 2.1 time: 0.543655 Aug 27 02:44:43.852284 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1687/3066] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:43 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:43.909998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-97609110-e6ed-4edc-b228-1b10f4ee0ca8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:43.910800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-97609110-e6ed-4edc-b228-1b10f4ee0ca8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:43.941401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97609110-e6ed-4edc-b228-1b10f4ee0ca8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.943681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97609110-e6ed-4edc-b228-1b10f4ee0ca8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.943681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97609110-e6ed-4edc-b228-1b10f4ee0ca8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:43.944528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97609110-e6ed-4edc-b228-1b10f4ee0ca8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:43.946381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97609110-e6ed-4edc-b228-1b10f4ee0ca8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:43.947618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97609110-e6ed-4edc-b228-1b10f4ee0ca8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:44.450147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-97609110-e6ed-4edc-b228-1b10f4ee0ca8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:44.469084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e41f814e-e6f6-46e6-8ba8-6d57fdd85435 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:44.474905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:44.481836 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-97609110-e6ed-4edc-b228-1b10f4ee0ca8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1323 microversion: 2.1 time: 0.596422 Aug 27 02:44:44.506017 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1688/3067] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:43 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1323 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:44.509111 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e41f814e-e6f6-46e6-8ba8-6d57fdd85435 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1472 microversion: 2.1 time: 1.081248 Aug 27 02:44:44.516911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b721e943-9f33-4756-9a0d-a2dd7782e305 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:44.520300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b721e943-9f33-4756-9a0d-a2dd7782e305 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:44.520899 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1380/3068] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:43 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1472 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:44.537295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:44.541589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:44.543501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b721e943-9f33-4756-9a0d-a2dd7782e305 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:44.546954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b721e943-9f33-4756-9a0d-a2dd7782e305 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:44.547735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b721e943-9f33-4756-9a0d-a2dd7782e305 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:44.548780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b721e943-9f33-4756-9a0d-a2dd7782e305 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:44.549655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b721e943-9f33-4756-9a0d-a2dd7782e305 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:44.550676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b721e943-9f33-4756-9a0d-a2dd7782e305 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:44.566709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:44.568782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:44.569602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:44.573805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:44.581078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:44.581921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:44.777093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:44.799225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:44.805930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61a386e483ae4ab3a33f3a40d5bf41cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195d9a2cd949478ebc0c53dae45f6501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:44.808198 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d0bbff13-81f2-4907-afa4-31d2f41d0c15 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 200 len: 1655 microversion: 2.20 time: 0.285637 Aug 27 02:44:44.809221 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1381/3069] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:44 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 1655 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:44:44.834168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-35572e1e-5a37-4d06-925d-3ea2aefc541f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:44.835417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-35572e1e-5a37-4d06-925d-3ea2aefc541f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:44.849170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35572e1e-5a37-4d06-925d-3ea2aefc541f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:44.850749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35572e1e-5a37-4d06-925d-3ea2aefc541f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:44.853049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35572e1e-5a37-4d06-925d-3ea2aefc541f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:44.854744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35572e1e-5a37-4d06-925d-3ea2aefc541f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:44.855822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35572e1e-5a37-4d06-925d-3ea2aefc541f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:44.856808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35572e1e-5a37-4d06-925d-3ea2aefc541f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:44.907361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-35572e1e-5a37-4d06-925d-3ea2aefc541f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:44:44.925180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b721e943-9f33-4756-9a0d-a2dd7782e305 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:44.933805 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b721e943-9f33-4756-9a0d-a2dd7782e305 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1678 microversion: 2.1 time: 0.435306 Aug 27 02:44:44.943234 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1689/3070] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:44 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1678 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:44.948248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7437c964-edb3-44b8-8f2b-3fa2633d5510 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '.version_select at 0x7f4d29262c10>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:44.999942 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7437c964-edb3-44b8-8f2b-3fa2633d5510 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841856236" status: 202 len: 0 microversion: 2.1 time: 0.055307 Aug 27 02:44:45.002710 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1690/3071] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:44:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841856236 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:44:45.015136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-86577b97-3cb0-4324-970b-1b0c0e904470 req-c6db0930-973d-490d-9bde-2b512bf4a321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e103b49d-103b-42ab-8f83-f00e41579687", "name": "network-vif-unplugged", "status": "completed", "tag": "486f8f25-2be4-44c1-9ea0-b1d4afdaa66d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:45.029225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-86577b97-3cb0-4324-970b-1b0c0e904470 req-c6db0930-973d-490d-9bde-2b512bf4a321 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:45.030247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-86577b97-3cb0-4324-970b-1b0c0e904470 req-c6db0930-973d-490d-9bde-2b512bf4a321 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:45.030929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-86577b97-3cb0-4324-970b-1b0c0e904470 req-c6db0930-973d-490d-9bde-2b512bf4a321 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:45.047518 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-86577b97-3cb0-4324-970b-1b0c0e904470 req-c6db0930-973d-490d-9bde-2b512bf4a321 service nova] Creating event network-vif-unplugged:486f8f25-2be4-44c1-9ea0-b1d4afdaa66d for instance e103b49d-103b-42ab-8f83-f00e41579687 on n-h1-852084-5 Aug 27 02:44:45.054340 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-86577b97-3cb0-4324-970b-1b0c0e904470 req-c6db0930-973d-490d-9bde-2b512bf4a321 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049887 Aug 27 02:44:45.055735 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1691/3072] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:45.063262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:45.064456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:45.072908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:45.073889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:45.074620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:45.075833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:45.076602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:45.077271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:45.100555 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-35572e1e-5a37-4d06-925d-3ea2aefc541f tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 204 len: 0 microversion: 2.1 time: 0.280538 Aug 27 02:44:45.101139 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1382/3073] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:44:44 2022] DELETE /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:44:45.108211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eacef1e2-6c29-4715-aa4a-18e4923b2e61 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:45.109294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eacef1e2-6c29-4715-aa4a-18e4923b2e61 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:45.119559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eacef1e2-6c29-4715-aa4a-18e4923b2e61 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:45.120340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eacef1e2-6c29-4715-aa4a-18e4923b2e61 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:45.121077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eacef1e2-6c29-4715-aa4a-18e4923b2e61 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:45.140206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eacef1e2-6c29-4715-aa4a-18e4923b2e61 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:45.141043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eacef1e2-6c29-4715-aa4a-18e4923b2e61 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:45.141890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eacef1e2-6c29-4715-aa4a-18e4923b2e61 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:45.578559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:45.608808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:45.626065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:45.628570 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0a9dd51d-7422-4857-98a6-8959c42bc7bf tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 2934 microversion: 2.32 time: 0.571050 Aug 27 02:44:45.653933 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1692/3074] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:45 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 2934 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:44:45.673960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-76747963", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "c0e01839-7cf2-4a76-9f86-ed22a92507b6"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:45.825920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] validate_networks() for [('c0e01839-7cf2-4a76-9f86-ed22a92507b6', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:44:46.155723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eacef1e2-6c29-4715-aa4a-18e4923b2e61 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:46.190891 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eacef1e2-6c29-4715-aa4a-18e4923b2e61 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1315 microversion: 2.1 time: 1.078408 Aug 27 02:44:46.206169 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1383/3075] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:45 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1315 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:46.206169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-12f4cba7-9b99-42a5-b6ac-5826d34c8c0d req-85b591d7-b190-4d52-855f-75a7f0f4a40b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c634682c-07d0-4f26-a6b5-b0f086cbec00", "tag": "94c9bbfb-ac17-47d2-86a4-695f53513819"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:46.253731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-12f4cba7-9b99-42a5-b6ac-5826d34c8c0d req-85b591d7-b190-4d52-855f-75a7f0f4a40b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:46.254794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-12f4cba7-9b99-42a5-b6ac-5826d34c8c0d req-85b591d7-b190-4d52-855f-75a7f0f4a40b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:46.255990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-12f4cba7-9b99-42a5-b6ac-5826d34c8c0d req-85b591d7-b190-4d52-855f-75a7f0f4a40b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:46.322141 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-12f4cba7-9b99-42a5-b6ac-5826d34c8c0d req-85b591d7-b190-4d52-855f-75a7f0f4a40b service nova] Creating event network-changed:94c9bbfb-ac17-47d2-86a4-695f53513819 for instance c634682c-07d0-4f26-a6b5-b0f086cbec00 on n-h1-852084-5 Aug 27 02:44:46.332489 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-12f4cba7-9b99-42a5-b6ac-5826d34c8c0d req-85b591d7-b190-4d52-855f-75a7f0f4a40b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137785 Aug 27 02:44:46.334122 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1384/3076] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:46.353146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-144cab9b-0d66-4052-be35-63115653ce01 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:46.354908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-144cab9b-0d66-4052-be35-63115653ce01 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:46.370623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-144cab9b-0d66-4052-be35-63115653ce01 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:46.372628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-144cab9b-0d66-4052-be35-63115653ce01 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:46.375377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-144cab9b-0d66-4052-be35-63115653ce01 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:46.376283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-144cab9b-0d66-4052-be35-63115653ce01 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:46.377812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-144cab9b-0d66-4052-be35-63115653ce01 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:46.378290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-144cab9b-0d66-4052-be35-63115653ce01 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:47.436176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-144cab9b-0d66-4052-be35-63115653ce01 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:47.490472 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-144cab9b-0d66-4052-be35-63115653ce01 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1323 microversion: 2.1 time: 1.151056 Aug 27 02:44:47.495424 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1385/3077] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:46 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1323 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:47.518724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-55235e8e-e175-4452-b015-6b4c97097fd6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:47.522528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-55235e8e-e175-4452-b015-6b4c97097fd6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:47.544440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55235e8e-e175-4452-b015-6b4c97097fd6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:47.546039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55235e8e-e175-4452-b015-6b4c97097fd6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:47.547213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55235e8e-e175-4452-b015-6b4c97097fd6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:47.549374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55235e8e-e175-4452-b015-6b4c97097fd6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:47.551203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55235e8e-e175-4452-b015-6b4c97097fd6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:47.552398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55235e8e-e175-4452-b015-6b4c97097fd6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:48.114500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:44:48.117061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:44:48.119193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:44:48.120351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:44:48.134157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:44:48.189696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:48.190509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:48.191498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:48.193291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:48.194571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:48.196183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:48.231075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Getting quotas for project 3a7deb7b2e0f44db9408c63d75634406. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:44:48.239734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Getting quotas for user 3ba5de1a75904079a6d4ae345c9c8025 and project 3a7deb7b2e0f44db9408c63d75634406. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:44:48.263535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:44:48.266123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:44:48.333527 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2e3cbe88-dbf5-400d-9101-5c2c1ff57845 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.676599 Aug 27 02:44:48.340766 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1693/3078] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:44:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:44:48.347239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:48.348137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:48.359109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:48.359926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:48.362031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:48.363102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:48.364653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:48.365515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:48.389233 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] HTTP exception thrown: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Request method failure captured: Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 HTTP/1.1 Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYMkVU2znMGNqolJJqDa2e5VnAnkfd1fDfn2MAnqFt5te_i-jPpxMYwjTkhE50qC5yWSzRkbNmwcz1bNB7i9tyoVITk7oX3Cr0vdClFdc-HDVtMstCPXedvmZY6tjseacR8HF-Y-PhEdTPkO5P4kpaTMAu6zNKVAI0bVw9Zb_bFiICc Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/195d9a2cd949478ebc0c53dae45f6501"}]}] Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 61a386e483ae4ab3a33f3a40d5bf41cf Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'a7489a8a-8682-4455-abba-671195effab4'} Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:44:48.396313 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:44:48.400975 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:44:48.400975 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:44:48.400975 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:44:48.400975 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:44:48.400975 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:44:48.400975 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:44:48.400975 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:44:48.400975 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:44:48.403181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Returning 404 to user: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:44:48.405769 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-de54c983-faf1-4dde-ab79-ce64518b7f1f tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 404 len: 111 microversion: 2.20 time: 0.062420 Aug 27 02:44:48.407079 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1694/3079] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:48 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:44:48.416906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb137728-52b9-42f0-916d-f91938130903 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:48.417587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb137728-52b9-42f0-916d-f91938130903 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:48.435156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb137728-52b9-42f0-916d-f91938130903 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:48.435755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb137728-52b9-42f0-916d-f91938130903 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:48.436350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb137728-52b9-42f0-916d-f91938130903 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:48.437201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb137728-52b9-42f0-916d-f91938130903 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:48.437728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb137728-52b9-42f0-916d-f91938130903 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:48.442436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb137728-52b9-42f0-916d-f91938130903 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:48.842144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cb137728-52b9-42f0-916d-f91938130903 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:48.852308 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb137728-52b9-42f0-916d-f91938130903 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1678 microversion: 2.1 time: 0.442920 Aug 27 02:44:48.852909 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1695/3080] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:48 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1678 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:48.881724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:48.883513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:48.895051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:48.895861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:48.896515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:48.897481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:48.899283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:48.899967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:48.908940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-55235e8e-e175-4452-b015-6b4c97097fd6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:48.938970 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-55235e8e-e175-4452-b015-6b4c97097fd6 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1472 microversion: 2.1 time: 1.441189 Aug 27 02:44:48.950824 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1386/3081] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:47 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1472 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:48.959951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2dec37-0d3d-4970-ae03-cc5bbbdd5216", "name": "network-vif-plugged", "status": "completed", "tag": "7a94feaf-a246-469b-a6d9-5535266fc0cd"}, {"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-unplugged", "status": "completed", "tag": "5b8a4190-5436-4df2-9d49-7f30f4f5b7c6"}, {"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-unplugged", "status": "completed", "tag": "ea16f397-cede-434b-8c29-fdce0d801498"}, {"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-unplugged", "status": "completed", "tag": "2b0d5ce5-a7a9-4698-8572-d722b196f9c1"}, {"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-unplugged", "status": "completed", "tag": "3fd3c81a-a52d-487b-b96d-897eb5de6ea3"}, {"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-unplugged", "status": "completed", "tag": "51a61470-c7d5-497f-9946-3031f09ce89e"}, {"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-unplugged", "status": "completed", "tag": "5014a7dc-c60b-4976-93dc-28dbb2c34306"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:48.987829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:49.003518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:49.004471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:49.005366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:49.059087 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] Creating event network-vif-plugged:7a94feaf-a246-469b-a6d9-5535266fc0cd for instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 on n-h2-852084-5 Aug 27 02:44:49.060195 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] Creating event network-vif-unplugged:5b8a4190-5436-4df2-9d49-7f30f4f5b7c6 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:44:49.061237 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] Creating event network-vif-unplugged:ea16f397-cede-434b-8c29-fdce0d801498 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:44:49.062343 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] Creating event network-vif-unplugged:2b0d5ce5-a7a9-4698-8572-d722b196f9c1 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:44:49.063661 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] Creating event network-vif-unplugged:3fd3c81a-a52d-487b-b96d-897eb5de6ea3 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:44:49.065483 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] Creating event network-vif-unplugged:51a61470-c7d5-497f-9946-3031f09ce89e for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:44:49.066912 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] Creating event network-vif-unplugged:5014a7dc-c60b-4976-93dc-28dbb2c34306 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:44:49.088870 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-1df3cd47-c801-4670-a832-c45618294401 req-67dfc6dc-b447-4609-82b9-7141878ff7d5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1221 microversion: 2.1 time: 0.135290 Aug 27 02:44:49.093762 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1387/3082] 10.222.0.99 () {64 vars in 1318 bytes} [Sat Aug 27 02:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 1221 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:49.106777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4ced9703-b153-489b-a0c2-85b6e59618d8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:49.109598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4ced9703-b153-489b-a0c2-85b6e59618d8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:49.129265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ced9703-b153-489b-a0c2-85b6e59618d8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:49.130797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ced9703-b153-489b-a0c2-85b6e59618d8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:49.131970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ced9703-b153-489b-a0c2-85b6e59618d8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:49.133826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ced9703-b153-489b-a0c2-85b6e59618d8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:49.135043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ced9703-b153-489b-a0c2-85b6e59618d8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:49.136215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ced9703-b153-489b-a0c2-85b6e59618d8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:49.279029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:49.306558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:49.308156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:49.315327 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-98d04a55-b74e-4b81-ae3a-ef04ce392c92 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 2866 microversion: 2.32 time: 0.445196 Aug 27 02:44:49.339673 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1696/3083] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:48 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 2866 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:44:49.352926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-693afea0-0a2a-4c18-abfe-4810346239cb tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:49.353571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-693afea0-0a2a-4c18-abfe-4810346239cb tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:49.478867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-693afea0-0a2a-4c18-abfe-4810346239cb tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:49.494551 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-693afea0-0a2a-4c18-abfe-4810346239cb tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1206 microversion: 2.1 time: 0.152140 Aug 27 02:44:49.506936 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1697/3084] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:49 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1206 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:49.519714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d91b6ad0-3fa6-4683-9512-358b437bcab5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '.version_select at 0x7f4d292a3ee0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:49.554605 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d91b6ad0-3fa6-4683-9512-358b437bcab5 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-483759875" status: 204 len: 0 microversion: 2.20 time: 0.045763 Aug 27 02:44:49.555564 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1698/3085] 10.222.0.99 () {60 vars in 1259 bytes} [Sat Aug 27 02:44:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-483759875 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:44:49.568077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-289c4fce-ac64-4b29-b31e-1fd2338c50d5 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:49.569596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-289c4fce-ac64-4b29-b31e-1fd2338c50d5 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:49.589027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289c4fce-ac64-4b29-b31e-1fd2338c50d5 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:49.590040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289c4fce-ac64-4b29-b31e-1fd2338c50d5 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:49.592207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289c4fce-ac64-4b29-b31e-1fd2338c50d5 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:49.593603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289c4fce-ac64-4b29-b31e-1fd2338c50d5 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:49.595331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289c4fce-ac64-4b29-b31e-1fd2338c50d5 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:49.598523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-289c4fce-ac64-4b29-b31e-1fd2338c50d5 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:50.021197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4ced9703-b153-489b-a0c2-85b6e59618d8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:50.052026 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4ced9703-b153-489b-a0c2-85b6e59618d8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1315 microversion: 2.1 time: 0.955655 Aug 27 02:44:50.070744 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1388/3086] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:49 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1315 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:50.090703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2d181253-1307-48c9-8ec4-da77bf09f8b9 req-9ac610bf-8db0-4a24-8c17-26de769fe390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63023909-57ad-4eb5-be6a-1ce0cc58b608", "tag": "8dfb1ab5-38bf-470a-9ac5-e9258d8600ed"}, {"server_uuid": "a7489a8a-8682-4455-abba-671195effab4", "name": "network-vif-deleted", "tag": "63f5c4dc-7c22-4bfa-8abc-a93876b795f0"}, {"name": "network-changed", "server_uuid": "902974a7-3280-4391-b745-432c3a4f1737", "tag": "99e417ab-547f-40b2-8976-ea9ef401d5f5"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:50.119955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-289c4fce-ac64-4b29-b31e-1fd2338c50d5 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:50.151038 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-289c4fce-ac64-4b29-b31e-1fd2338c50d5 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1323 microversion: 2.1 time: 0.593689 Aug 27 02:44:50.155879 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1699/3087] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:49 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1323 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:50.180830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d181253-1307-48c9-8ec4-da77bf09f8b9 req-9ac610bf-8db0-4a24-8c17-26de769fe390 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:50.181630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d181253-1307-48c9-8ec4-da77bf09f8b9 req-9ac610bf-8db0-4a24-8c17-26de769fe390 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:50.182653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d181253-1307-48c9-8ec4-da77bf09f8b9 req-9ac610bf-8db0-4a24-8c17-26de769fe390 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:50.184276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-93b71259-5390-4f34-abaf-84e82ad6ad21 req-5651eade-a86a-4d58-b070-a79863bd265c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-deleted", "tag": "3fd3c81a-a52d-487b-b96d-897eb5de6ea3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:50.230955 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2d181253-1307-48c9-8ec4-da77bf09f8b9 req-9ac610bf-8db0-4a24-8c17-26de769fe390 service nova] Creating event network-changed:8dfb1ab5-38bf-470a-9ac5-e9258d8600ed for instance 63023909-57ad-4eb5-be6a-1ce0cc58b608 on n-h2-852084-5 Aug 27 02:44:50.231932 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2d181253-1307-48c9-8ec4-da77bf09f8b9 req-9ac610bf-8db0-4a24-8c17-26de769fe390 service nova] Creating event network-vif-deleted:63f5c4dc-7c22-4bfa-8abc-a93876b795f0 for instance a7489a8a-8682-4455-abba-671195effab4 on n-h1-852084-5 Aug 27 02:44:50.232800 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2d181253-1307-48c9-8ec4-da77bf09f8b9 req-9ac610bf-8db0-4a24-8c17-26de769fe390 service nova] Creating event network-changed:99e417ab-547f-40b2-8976-ea9ef401d5f5 for instance 902974a7-3280-4391-b745-432c3a4f1737 on n-h2-852084-5 Aug 27 02:44:50.234257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-93b71259-5390-4f34-abaf-84e82ad6ad21 req-5651eade-a86a-4d58-b070-a79863bd265c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:50.235055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-93b71259-5390-4f34-abaf-84e82ad6ad21 req-5651eade-a86a-4d58-b070-a79863bd265c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:50.239884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-93b71259-5390-4f34-abaf-84e82ad6ad21 req-5651eade-a86a-4d58-b070-a79863bd265c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:50.263095 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-93b71259-5390-4f34-abaf-84e82ad6ad21 req-5651eade-a86a-4d58-b070-a79863bd265c service nova] Creating event network-vif-deleted:3fd3c81a-a52d-487b-b96d-897eb5de6ea3 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:44:50.266840 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2d181253-1307-48c9-8ec4-da77bf09f8b9 req-9ac610bf-8db0-4a24-8c17-26de769fe390 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.193683 Aug 27 02:44:50.268503 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1389/3088] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:50.271909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-93b71259-5390-4f34-abaf-84e82ad6ad21 req-5651eade-a86a-4d58-b070-a79863bd265c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110800 Aug 27 02:44:50.276947 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1700/3089] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:50.285986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fbd5b14d-0962-4d86-9ef6-b2708dc534c1 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:50.287088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7aaf394-7cc6-46f3-bbbd-e29b028a26e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:50.288138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fbd5b14d-0962-4d86-9ef6-b2708dc534c1 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:50.288981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c7aaf394-7cc6-46f3-bbbd-e29b028a26e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:50.302290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd5b14d-0962-4d86-9ef6-b2708dc534c1 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:50.302290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd5b14d-0962-4d86-9ef6-b2708dc534c1 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:50.304511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd5b14d-0962-4d86-9ef6-b2708dc534c1 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:50.308768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7aaf394-7cc6-46f3-bbbd-e29b028a26e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:50.309613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd5b14d-0962-4d86-9ef6-b2708dc534c1 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:50.310597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd5b14d-0962-4d86-9ef6-b2708dc534c1 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:50.312817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7aaf394-7cc6-46f3-bbbd-e29b028a26e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:50.313333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd5b14d-0962-4d86-9ef6-b2708dc534c1 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:50.314319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7aaf394-7cc6-46f3-bbbd-e29b028a26e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:50.315933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7aaf394-7cc6-46f3-bbbd-e29b028a26e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:50.316651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7aaf394-7cc6-46f3-bbbd-e29b028a26e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:50.317991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7aaf394-7cc6-46f3-bbbd-e29b028a26e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:51.040087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fbd5b14d-0962-4d86-9ef6-b2708dc534c1 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:51.048217 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fbd5b14d-0962-4d86-9ef6-b2708dc534c1 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1472 microversion: 2.1 time: 0.769134 Aug 27 02:44:51.062530 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1701/3090] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:50 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1472 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:51.074261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:51.074900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:51.089867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:51.090921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:51.098812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:51.101366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:51.102316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:51.103389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:51.246520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c7aaf394-7cc6-46f3-bbbd-e29b028a26e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:51.281562 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c7aaf394-7cc6-46f3-bbbd-e29b028a26e4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1678 microversion: 2.1 time: 1.008820 Aug 27 02:44:51.282742 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1390/3091] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:50 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1678 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:51.295652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fe604917-1b5d-4dfc-b83a-1abd61166430 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:51.297324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fe604917-1b5d-4dfc-b83a-1abd61166430 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:51.322911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe604917-1b5d-4dfc-b83a-1abd61166430 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:51.323432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe604917-1b5d-4dfc-b83a-1abd61166430 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:51.323892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe604917-1b5d-4dfc-b83a-1abd61166430 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:51.324650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe604917-1b5d-4dfc-b83a-1abd61166430 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:51.325242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe604917-1b5d-4dfc-b83a-1abd61166430 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:51.325841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fe604917-1b5d-4dfc-b83a-1abd61166430 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:51.518720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fe604917-1b5d-4dfc-b83a-1abd61166430 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:51.543052 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fe604917-1b5d-4dfc-b83a-1abd61166430 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1258 microversion: 2.1 time: 0.256916 Aug 27 02:44:51.560754 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1391/3092] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:51 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1258 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:51.565650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ca65c980-beab-48e3-8daa-b84f8e3818ec tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:51.579403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ca65c980-beab-48e3-8daa-b84f8e3818ec tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:51.601294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca65c980-beab-48e3-8daa-b84f8e3818ec tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:51.605339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca65c980-beab-48e3-8daa-b84f8e3818ec tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:51.609801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca65c980-beab-48e3-8daa-b84f8e3818ec tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:51.613984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca65c980-beab-48e3-8daa-b84f8e3818ec tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:51.616483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca65c980-beab-48e3-8daa-b84f8e3818ec tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:51.616884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca65c980-beab-48e3-8daa-b84f8e3818ec tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.082574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ca65c980-beab-48e3-8daa-b84f8e3818ec tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:52.107446 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ca65c980-beab-48e3-8daa-b84f8e3818ec tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1315 microversion: 2.1 time: 0.551940 Aug 27 02:44:52.108402 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1392/3093] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:51 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:52.123942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-baaedc9d-4b4a-4816-968a-4fe7bcdd57ff tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:52.124588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-baaedc9d-4b4a-4816-968a-4fe7bcdd57ff tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:52.141506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baaedc9d-4b4a-4816-968a-4fe7bcdd57ff tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:52.142113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baaedc9d-4b4a-4816-968a-4fe7bcdd57ff tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:52.143467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baaedc9d-4b4a-4816-968a-4fe7bcdd57ff tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.144258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baaedc9d-4b4a-4816-968a-4fe7bcdd57ff tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:52.148434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baaedc9d-4b4a-4816-968a-4fe7bcdd57ff tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:52.148959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baaedc9d-4b4a-4816-968a-4fe7bcdd57ff tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.655585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:52.682051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:52.684952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:52.709853 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cfd15249-4cb0-471d-91bf-1b31716ef6eb tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 2753 microversion: 2.32 time: 1.645761 Aug 27 02:44:52.710804 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1702/3094] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:51 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 2753 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:44:52.718104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-baaedc9d-4b4a-4816-968a-4fe7bcdd57ff tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:52.722644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1322d9ce-9b04-4acb-b405-ce5a0cbf0a21 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:52.729241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1322d9ce-9b04-4acb-b405-ce5a0cbf0a21 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:52.764815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1322d9ce-9b04-4acb-b405-ce5a0cbf0a21 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:52.765795 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-baaedc9d-4b4a-4816-968a-4fe7bcdd57ff tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1323 microversion: 2.1 time: 0.655795 Aug 27 02:44:52.766544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1322d9ce-9b04-4acb-b405-ce5a0cbf0a21 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:52.769515 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1393/3095] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:52 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1323 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:52.783539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2a63204b-cbeb-4077-8ae1-b58852432ccc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:52.795442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2a63204b-cbeb-4077-8ae1-b58852432ccc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:52.798751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a63204b-cbeb-4077-8ae1-b58852432ccc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:52.799615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a63204b-cbeb-4077-8ae1-b58852432ccc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:52.800425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a63204b-cbeb-4077-8ae1-b58852432ccc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.803194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a63204b-cbeb-4077-8ae1-b58852432ccc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:52.804070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a63204b-cbeb-4077-8ae1-b58852432ccc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:52.805052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a63204b-cbeb-4077-8ae1-b58852432ccc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.806017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1322d9ce-9b04-4acb-b405-ce5a0cbf0a21 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:52.810071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1322d9ce-9b04-4acb-b405-ce5a0cbf0a21 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:52.816734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1322d9ce-9b04-4acb-b405-ce5a0cbf0a21 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:52.817997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1322d9ce-9b04-4acb-b405-ce5a0cbf0a21 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:53.486634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2a63204b-cbeb-4077-8ae1-b58852432ccc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:53.500271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1322d9ce-9b04-4acb-b405-ce5a0cbf0a21 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:53.515938 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2a63204b-cbeb-4077-8ae1-b58852432ccc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1655 microversion: 2.1 time: 0.744520 Aug 27 02:44:53.535422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:53.542706 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1394/3096] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:52 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1655 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:53.569130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-4f7e2527-e306-40e9-a904-95530675b489 req-d5ae9d4b-ea51-444a-8e06-a2d6899dbc6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e103b49d-103b-42ab-8f83-f00e41579687", "name": "network-vif-deleted", "tag": "486f8f25-2be4-44c1-9ea0-b1d4afdaa66d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:53.590276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4f7e2527-e306-40e9-a904-95530675b489 req-d5ae9d4b-ea51-444a-8e06-a2d6899dbc6d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:53.590693 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1322d9ce-9b04-4acb-b405-ce5a0cbf0a21 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1478 microversion: 2.1 time: 0.877810 Aug 27 02:44:53.591369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4f7e2527-e306-40e9-a904-95530675b489 req-d5ae9d4b-ea51-444a-8e06-a2d6899dbc6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:53.605710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4f7e2527-e306-40e9-a904-95530675b489 req-d5ae9d4b-ea51-444a-8e06-a2d6899dbc6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:53.607058 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1703/3097] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:52 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1478 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:53.638104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-719963c6-4672-48b9-a3fc-3333df759089 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:53.646787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-719963c6-4672-48b9-a3fc-3333df759089 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:53.663397 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-4f7e2527-e306-40e9-a904-95530675b489 req-d5ae9d4b-ea51-444a-8e06-a2d6899dbc6d service nova] Creating event network-vif-deleted:486f8f25-2be4-44c1-9ea0-b1d4afdaa66d for instance e103b49d-103b-42ab-8f83-f00e41579687 on n-h1-852084-5 Aug 27 02:44:53.691861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719963c6-4672-48b9-a3fc-3333df759089 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:53.694055 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-4f7e2527-e306-40e9-a904-95530675b489 req-d5ae9d4b-ea51-444a-8e06-a2d6899dbc6d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148560 Aug 27 02:44:53.695372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719963c6-4672-48b9-a3fc-3333df759089 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:53.699648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719963c6-4672-48b9-a3fc-3333df759089 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:53.700519 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1395/3098] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:53.705618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719963c6-4672-48b9-a3fc-3333df759089 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:53.707956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719963c6-4672-48b9-a3fc-3333df759089 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:53.710124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-719963c6-4672-48b9-a3fc-3333df759089 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:53.728407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-635c7cae-b7f8-4ed1-b17b-9de5489884ab tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:53.733566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-635c7cae-b7f8-4ed1-b17b-9de5489884ab tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:53.772550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635c7cae-b7f8-4ed1-b17b-9de5489884ab tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:53.780876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635c7cae-b7f8-4ed1-b17b-9de5489884ab tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:53.782240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635c7cae-b7f8-4ed1-b17b-9de5489884ab tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:53.784211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635c7cae-b7f8-4ed1-b17b-9de5489884ab tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:53.805834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635c7cae-b7f8-4ed1-b17b-9de5489884ab tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:53.820987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635c7cae-b7f8-4ed1-b17b-9de5489884ab tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:53.979613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-719963c6-4672-48b9-a3fc-3333df759089 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:53.996336 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-719963c6-4672-48b9-a3fc-3333df759089 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1264 microversion: 2.1 time: 0.388504 Aug 27 02:44:53.997019 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1704/3099] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:53 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1264 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:54.032300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-330d6d73-8555-4ebb-8473-b233a8e2998b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:54.113165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-330d6d73-8555-4ebb-8473-b233a8e2998b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:54.119596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-330d6d73-8555-4ebb-8473-b233a8e2998b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:54.124961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-330d6d73-8555-4ebb-8473-b233a8e2998b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:54.238879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-330d6d73-8555-4ebb-8473-b233a8e2998b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Going to try to start instance {{(pid=122488) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 02:44:54.421886 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-330d6d73-8555-4ebb-8473-b233a8e2998b tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.417408 Aug 27 02:44:54.429912 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1705/3100] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:44:53 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:44:54.451723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:54.461404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:54.520800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:54.528946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:54.534242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:54.544369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:54.546752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:54.547969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:55.894191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:55.926709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:55.931275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:55.945193 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cc60171a-2ebe-4922-8ee1-49b295bfa7d4 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 2706 microversion: 2.32 time: 1.497142 Aug 27 02:44:55.946270 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1706/3101] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:54 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 2706 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:44:55.985751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-df4f836c-2302-4ed6-aa74-81abb9529d6b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:55.989509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-df4f836c-2302-4ed6-aa74-81abb9529d6b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:56.026121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df4f836c-2302-4ed6-aa74-81abb9529d6b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:56.027576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df4f836c-2302-4ed6-aa74-81abb9529d6b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:56.030783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df4f836c-2302-4ed6-aa74-81abb9529d6b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:56.032432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df4f836c-2302-4ed6-aa74-81abb9529d6b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:56.042310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df4f836c-2302-4ed6-aa74-81abb9529d6b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:56.044134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df4f836c-2302-4ed6-aa74-81abb9529d6b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:56.642823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-635c7cae-b7f8-4ed1-b17b-9de5489884ab tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:56.686867 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-635c7cae-b7f8-4ed1-b17b-9de5489884ab tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1315 microversion: 2.1 time: 2.982200 Aug 27 02:44:56.691345 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1396/3102] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:53 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1315 bytes in 2990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:56.722928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-b00caf4c-f11a-449b-9b7e-6017813e9354 req-2f101f8d-7c4e-4249-a0d5-137d3b1d568b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-deleted", "tag": "5014a7dc-c60b-4976-93dc-28dbb2c34306"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:56.831127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b00caf4c-f11a-449b-9b7e-6017813e9354 req-2f101f8d-7c4e-4249-a0d5-137d3b1d568b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:56.835734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-df4f836c-2302-4ed6-aa74-81abb9529d6b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:56.838026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b00caf4c-f11a-449b-9b7e-6017813e9354 req-2f101f8d-7c4e-4249-a0d5-137d3b1d568b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:56.842302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b00caf4c-f11a-449b-9b7e-6017813e9354 req-2f101f8d-7c4e-4249-a0d5-137d3b1d568b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:56.849533 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-df4f836c-2302-4ed6-aa74-81abb9529d6b tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1323 microversion: 2.1 time: 0.901536 Aug 27 02:44:56.850173 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1707/3103] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:55 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1323 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:56.866945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a5481d83-9d73-40f9-a3c0-2c3d5ffed700 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:56.868258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a5481d83-9d73-40f9-a3c0-2c3d5ffed700 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:56.892731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5481d83-9d73-40f9-a3c0-2c3d5ffed700 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:56.897303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5481d83-9d73-40f9-a3c0-2c3d5ffed700 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:56.900984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5481d83-9d73-40f9-a3c0-2c3d5ffed700 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:56.902013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5481d83-9d73-40f9-a3c0-2c3d5ffed700 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:56.903211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5481d83-9d73-40f9-a3c0-2c3d5ffed700 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:56.905049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5481d83-9d73-40f9-a3c0-2c3d5ffed700 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:56.936662 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-b00caf4c-f11a-449b-9b7e-6017813e9354 req-2f101f8d-7c4e-4249-a0d5-137d3b1d568b service nova] Creating event network-vif-deleted:5014a7dc-c60b-4976-93dc-28dbb2c34306 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:44:56.963791 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-b00caf4c-f11a-449b-9b7e-6017813e9354 req-2f101f8d-7c4e-4249-a0d5-137d3b1d568b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264613 Aug 27 02:44:56.980464 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1397/3104] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:57.024970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-26620fd8-0a0a-4b91-97fa-539c4eadaf51 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:57.027518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26620fd8-0a0a-4b91-97fa-539c4eadaf51 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:57.071860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26620fd8-0a0a-4b91-97fa-539c4eadaf51 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:57.073304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26620fd8-0a0a-4b91-97fa-539c4eadaf51 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:57.076769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26620fd8-0a0a-4b91-97fa-539c4eadaf51 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:57.081866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26620fd8-0a0a-4b91-97fa-539c4eadaf51 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:57.082910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26620fd8-0a0a-4b91-97fa-539c4eadaf51 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:57.083812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26620fd8-0a0a-4b91-97fa-539c4eadaf51 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:57.893879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a5481d83-9d73-40f9-a3c0-2c3d5ffed700 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:57.930566 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a5481d83-9d73-40f9-a3c0-2c3d5ffed700 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1664 microversion: 2.1 time: 1.075886 Aug 27 02:44:57.958482 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1708/3105] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:56 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1664 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:57.991207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5bf707ad-9cbc-4f66-ab67-3f8a898d0930 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:57.996345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5bf707ad-9cbc-4f66-ab67-3f8a898d0930 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:58.023044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bf707ad-9cbc-4f66-ab67-3f8a898d0930 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:58.025692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bf707ad-9cbc-4f66-ab67-3f8a898d0930 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:58.029360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bf707ad-9cbc-4f66-ab67-3f8a898d0930 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:58.031109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bf707ad-9cbc-4f66-ab67-3f8a898d0930 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:58.033354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bf707ad-9cbc-4f66-ab67-3f8a898d0930 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:58.035433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bf707ad-9cbc-4f66-ab67-3f8a898d0930 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:58.165168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-26620fd8-0a0a-4b91-97fa-539c4eadaf51 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:58.181185 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-26620fd8-0a0a-4b91-97fa-539c4eadaf51 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1463 microversion: 2.1 time: 1.190596 Aug 27 02:44:58.183323 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1398/3106] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:56 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1463 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:58.193891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:58.195530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:58.215811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:58.235776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:58.240386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:58.244138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:58.249811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:58.251273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:58.254171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:58.279877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:58.864753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5bf707ad-9cbc-4f66-ab67-3f8a898d0930 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:58.908357 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5bf707ad-9cbc-4f66-ab67-3f8a898d0930 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1306 microversion: 2.1 time: 0.940634 Aug 27 02:44:58.928171 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1709/3107] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:57 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1306 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:44:58.964771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d6874b8e-6679-43a4-aac2-c988455ad771 req-0803228e-72f4-4594-9d70-bdb9f8e2904e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63023909-57ad-4eb5-be6a-1ce0cc58b608", "name": "network-vif-plugged", "status": "completed", "tag": "8dfb1ab5-38bf-470a-9ac5-e9258d8600ed"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:44:59.014935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d6874b8e-6679-43a4-aac2-c988455ad771 req-0803228e-72f4-4594-9d70-bdb9f8e2904e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:59.022534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d6874b8e-6679-43a4-aac2-c988455ad771 req-0803228e-72f4-4594-9d70-bdb9f8e2904e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:59.023721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d6874b8e-6679-43a4-aac2-c988455ad771 req-0803228e-72f4-4594-9d70-bdb9f8e2904e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:59.103979 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d6874b8e-6679-43a4-aac2-c988455ad771 req-0803228e-72f4-4594-9d70-bdb9f8e2904e service nova] Creating event network-vif-plugged:8dfb1ab5-38bf-470a-9ac5-e9258d8600ed for instance 63023909-57ad-4eb5-be6a-1ce0cc58b608 on n-h2-852084-5 Aug 27 02:44:59.121254 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d6874b8e-6679-43a4-aac2-c988455ad771 req-0803228e-72f4-4594-9d70-bdb9f8e2904e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188330 Aug 27 02:44:59.129819 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1710/3108] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:44:59.137135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58e0bd42-e166-4f62-aae3-3f8d4dcdfb89 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:59.138414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-58e0bd42-e166-4f62-aae3-3f8d4dcdfb89 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:59.146611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58e0bd42-e166-4f62-aae3-3f8d4dcdfb89 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:59.147527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58e0bd42-e166-4f62-aae3-3f8d4dcdfb89 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:59.148243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58e0bd42-e166-4f62-aae3-3f8d4dcdfb89 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:59.149367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58e0bd42-e166-4f62-aae3-3f8d4dcdfb89 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:59.150123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58e0bd42-e166-4f62-aae3-3f8d4dcdfb89 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:59.150789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58e0bd42-e166-4f62-aae3-3f8d4dcdfb89 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:44:59.489722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:44:59.879960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:59.911055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:59.914240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:44:59.917216 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-395766e9-8bd0-45b7-ad9d-11321942a13b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 2324 microversion: 2.32 time: 1.731120 Aug 27 02:44:59.937765 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1399/3109] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:44:58 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 2324 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:44:59.948300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-53e94ef5-7746-44b1-ac05-5d2257aa4f79 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:44:59.948828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-53e94ef5-7746-44b1-ac05-5d2257aa4f79 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:44:59.991914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53e94ef5-7746-44b1-ac05-5d2257aa4f79 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:44:59.992667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53e94ef5-7746-44b1-ac05-5d2257aa4f79 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:44:59.993448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53e94ef5-7746-44b1-ac05-5d2257aa4f79 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:00.003741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53e94ef5-7746-44b1-ac05-5d2257aa4f79 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:00.004922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53e94ef5-7746-44b1-ac05-5d2257aa4f79 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:00.005968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53e94ef5-7746-44b1-ac05-5d2257aa4f79 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:00.016185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58e0bd42-e166-4f62-aae3-3f8d4dcdfb89 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:00.054467 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58e0bd42-e166-4f62-aae3-3f8d4dcdfb89 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1315 microversion: 2.1 time: 0.919253 Aug 27 02:45:00.056047 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1711/3110] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:59 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:00.077053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5ae2acb6-bc1e-433a-ade2-3511d5ed157b tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:00.090790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5ae2acb6-bc1e-433a-ade2-3511d5ed157b tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:00.140688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ae2acb6-bc1e-433a-ade2-3511d5ed157b tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:00.146713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ae2acb6-bc1e-433a-ade2-3511d5ed157b tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:00.149904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ae2acb6-bc1e-433a-ade2-3511d5ed157b tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:00.151369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ae2acb6-bc1e-433a-ade2-3511d5ed157b tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:00.152247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ae2acb6-bc1e-433a-ade2-3511d5ed157b tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:00.153049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ae2acb6-bc1e-433a-ade2-3511d5ed157b tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:00.466225 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5ae2acb6-bc1e-433a-ade2-3511d5ed157b tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action" status: 202 len: 0 microversion: 2.1 time: 0.407319 Aug 27 02:45:00.467754 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1712/3111] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:45:00 2022] POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:45:00.490927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c69e8ee3-65a1-4edb-bc40-4ab56e537037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:00.492943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c69e8ee3-65a1-4edb-bc40-4ab56e537037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:00.518374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69e8ee3-65a1-4edb-bc40-4ab56e537037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:00.522853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69e8ee3-65a1-4edb-bc40-4ab56e537037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:00.523775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69e8ee3-65a1-4edb-bc40-4ab56e537037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:00.527874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69e8ee3-65a1-4edb-bc40-4ab56e537037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:00.530149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69e8ee3-65a1-4edb-bc40-4ab56e537037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:00.531032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c69e8ee3-65a1-4edb-bc40-4ab56e537037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:00.926749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c69e8ee3-65a1-4edb-bc40-4ab56e537037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:00.939566 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c69e8ee3-65a1-4edb-bc40-4ab56e537037 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1664 microversion: 2.1 time: 0.468601 Aug 27 02:45:00.942150 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1713/3112] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:00 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1664 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:00.952410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ee28a400-bb45-4c39-9d9f-56c1d49ab411 req-f83f2392-afb9-450c-a793-3603ef3252aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-deleted", "tag": "2b0d5ce5-a7a9-4698-8572-d722b196f9c1"}, {"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-deleted", "tag": "51a61470-c7d5-497f-9946-3031f09ce89e"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:00.981707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee28a400-bb45-4c39-9d9f-56c1d49ab411 req-f83f2392-afb9-450c-a793-3603ef3252aa service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:00.982343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee28a400-bb45-4c39-9d9f-56c1d49ab411 req-f83f2392-afb9-450c-a793-3603ef3252aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:00.982797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee28a400-bb45-4c39-9d9f-56c1d49ab411 req-f83f2392-afb9-450c-a793-3603ef3252aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.021093 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ee28a400-bb45-4c39-9d9f-56c1d49ab411 req-f83f2392-afb9-450c-a793-3603ef3252aa service nova] Creating event network-vif-deleted:2b0d5ce5-a7a9-4698-8572-d722b196f9c1 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:45:01.022844 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ee28a400-bb45-4c39-9d9f-56c1d49ab411 req-f83f2392-afb9-450c-a793-3603ef3252aa service nova] Creating event network-vif-deleted:51a61470-c7d5-497f-9946-3031f09ce89e for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:45:01.036132 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ee28a400-bb45-4c39-9d9f-56c1d49ab411 req-f83f2392-afb9-450c-a793-3603ef3252aa service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091631 Aug 27 02:45:01.043212 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1714/3113] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:01.056602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-518995e5-2612-46c2-97db-e676066d0121 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:01.057426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-518995e5-2612-46c2-97db-e676066d0121 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:01.070097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-518995e5-2612-46c2-97db-e676066d0121 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.070649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-518995e5-2612-46c2-97db-e676066d0121 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.071066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-518995e5-2612-46c2-97db-e676066d0121 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.071784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-518995e5-2612-46c2-97db-e676066d0121 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.083155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-518995e5-2612-46c2-97db-e676066d0121 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.083417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-518995e5-2612-46c2-97db-e676066d0121 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.478946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-518995e5-2612-46c2-97db-e676066d0121 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:01.510678 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-518995e5-2612-46c2-97db-e676066d0121 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1306 microversion: 2.1 time: 0.464718 Aug 27 02:45:01.517735 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1715/3114] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:01 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1306 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:01.525510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:01.532562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:01.555755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.560173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.563073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.569041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.569732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.570292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.628281 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] HTTP exception thrown: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:45:01.639645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-53e94ef5-7746-44b1-ac05-5d2257aa4f79 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Request method failure captured: Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 HTTP/1.1 Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYMkVU2znMGNqolJJqDa2e5VnAnkfd1fDfn2MAnqFt5te_i-jPpxMYwjTkhE50qC5yWSzRkbNmwcz1bNB7i9tyoVITk7oX3Cr0vdClFdc-HDVtMstCPXedvmZY6tjseacR8HF-Y-PhEdTPkO5P4kpaTMAu6zNKVAI0bVw9Zb_bFiICc Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/195d9a2cd949478ebc0c53dae45f6501"}]}] Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 61a386e483ae4ab3a33f3a40d5bf41cf Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'a7489a8a-8682-4455-abba-671195effab4'} Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:01.644157 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:01.648330 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:45:01.648330 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:01.648330 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:01.648330 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:01.648330 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:01.648330 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:01.648330 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:01.648330 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:01.648330 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:01.648330 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:45:01.648330 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:01.652242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Returning 404 to user: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:01.654296 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-464e4be4-3cb2-4443-adbc-8ecc1a4699e0 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 404 len: 111 microversion: 2.20 time: 0.139397 Aug 27 02:45:01.656239 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-53e94ef5-7746-44b1-ac05-5d2257aa4f79 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1323 microversion: 2.1 time: 1.716735 Aug 27 02:45:01.659048 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1716/3115] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:45:01 2022] DELETE /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:01.659773 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1400/3116] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:44:59 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1323 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:01.669609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:01.684036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:01.685467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:01.685915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:01.699718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.701448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.704474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.720896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.721329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.722658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.723959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.725171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.726122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.726845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.727534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.728254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.848249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:01.848758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:01.849207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:01.849729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lazy-loading 'fault' on Instance uuid 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:02.000677 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0183d04c-d465-43ea-ac1e-16b2923793de tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1597 microversion: 2.1 time: 0.339737 Aug 27 02:45:02.016893 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1717/3117] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:01 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1597 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:02.022741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8ebe3a7c-c5c5-4228-a437-9f72c24dfbb8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:02.023444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8ebe3a7c-c5c5-4228-a437-9f72c24dfbb8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:02.030400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a7c-c5c5-4228-a437-9f72c24dfbb8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.030744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a7c-c5c5-4228-a437-9f72c24dfbb8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.031192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a7c-c5c5-4228-a437-9f72c24dfbb8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.032059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a7c-c5c5-4228-a437-9f72c24dfbb8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.033546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a7c-c5c5-4228-a437-9f72c24dfbb8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.034110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a7c-c5c5-4228-a437-9f72c24dfbb8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.128523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:02.149339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:02.164022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:02.174361 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ac909a8c-b18d-46e9-9e14-53c43af71ad8 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.502063 Aug 27 02:45:02.175033 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1401/3118] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:01 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:02.188442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e293bd51-0374-4112-90ea-e895dd226b0e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:02.195942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e293bd51-0374-4112-90ea-e895dd226b0e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:02.221039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e293bd51-0374-4112-90ea-e895dd226b0e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.226611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e293bd51-0374-4112-90ea-e895dd226b0e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.230861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e293bd51-0374-4112-90ea-e895dd226b0e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.231941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e293bd51-0374-4112-90ea-e895dd226b0e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.232583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e293bd51-0374-4112-90ea-e895dd226b0e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.233197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e293bd51-0374-4112-90ea-e895dd226b0e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.353433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e293bd51-0374-4112-90ea-e895dd226b0e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:02.461546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8ebe3a7c-c5c5-4228-a437-9f72c24dfbb8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:02.473719 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8ebe3a7c-c5c5-4228-a437-9f72c24dfbb8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1503 microversion: 2.1 time: 0.454982 Aug 27 02:45:02.475801 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1718/3119] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:02 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1503 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:02.481107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-6ef5aa29-895c-44ba-a028-5c3371edf5aa req-bf0e9a88-2c06-4d7c-99eb-3d2870efd48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c634682c-07d0-4f26-a6b5-b0f086cbec00", "name": "network-vif-plugged", "status": "completed", "tag": "94c9bbfb-ac17-47d2-86a4-695f53513819"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:02.491971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:02.496950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6ef5aa29-895c-44ba-a028-5c3371edf5aa req-bf0e9a88-2c06-4d7c-99eb-3d2870efd48a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.497844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6ef5aa29-895c-44ba-a028-5c3371edf5aa req-bf0e9a88-2c06-4d7c-99eb-3d2870efd48a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.498535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6ef5aa29-895c-44ba-a028-5c3371edf5aa req-bf0e9a88-2c06-4d7c-99eb-3d2870efd48a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.517060 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-6ef5aa29-895c-44ba-a028-5c3371edf5aa req-bf0e9a88-2c06-4d7c-99eb-3d2870efd48a service nova] Creating event network-vif-plugged:94c9bbfb-ac17-47d2-86a4-695f53513819 for instance c634682c-07d0-4f26-a6b5-b0f086cbec00 on n-h1-852084-5 Aug 27 02:45:02.523642 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-6ef5aa29-895c-44ba-a028-5c3371edf5aa req-bf0e9a88-2c06-4d7c-99eb-3d2870efd48a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046156 Aug 27 02:45:02.524653 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1719/3120] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:02.531613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-42693e31-9cc4-40e9-aa92-92ac5b20ddb4 req-b38e215a-86a8-4edc-80b1-dae12d8e05ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f34d83-efc5-4a91-8918-f506cd984323", "tag": "aa02dc81-0ff9-479e-85ca-2125fdb2e147"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:02.544836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-42693e31-9cc4-40e9-aa92-92ac5b20ddb4 req-b38e215a-86a8-4edc-80b1-dae12d8e05ea service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.546554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-42693e31-9cc4-40e9-aa92-92ac5b20ddb4 req-b38e215a-86a8-4edc-80b1-dae12d8e05ea service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.547483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-42693e31-9cc4-40e9-aa92-92ac5b20ddb4 req-b38e215a-86a8-4edc-80b1-dae12d8e05ea service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.567035 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-42693e31-9cc4-40e9-aa92-92ac5b20ddb4 req-b38e215a-86a8-4edc-80b1-dae12d8e05ea service nova] Creating event network-changed:aa02dc81-0ff9-479e-85ca-2125fdb2e147 for instance d9f34d83-efc5-4a91-8918-f506cd984323 on n-h1-852084-5 Aug 27 02:45:02.573195 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-42693e31-9cc4-40e9-aa92-92ac5b20ddb4 req-b38e215a-86a8-4edc-80b1-dae12d8e05ea service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046555 Aug 27 02:45:02.574664 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1720/3121] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:02.583181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:02.584315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: a7489a8a-8682-4455-abba-671195effab4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:02.592106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.593294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.594055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.595255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.596165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.597308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.601234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:02.606421 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e293bd51-0374-4112-90ea-e895dd226b0e tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 204 len: 0 microversion: 2.1 time: 0.426103 Aug 27 02:45:02.609594 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1402/3122] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:02 2022] DELETE /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:02.620607 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] HTTP exception thrown: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Request method failure captured: Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 HTTP/1.1 Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYMkVU2znMGNqolJJqDa2e5VnAnkfd1fDfn2MAnqFt5te_i-jPpxMYwjTkhE50qC5yWSzRkbNmwcz1bNB7i9tyoVITk7oX3Cr0vdClFdc-HDVtMstCPXedvmZY6tjseacR8HF-Y-PhEdTPkO5P4kpaTMAu6zNKVAI0bVw9Zb_bFiICc Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/195d9a2cd949478ebc0c53dae45f6501"}]}] Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 61a386e483ae4ab3a33f3a40d5bf41cf Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'a7489a8a-8682-4455-abba-671195effab4'} Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:02.623165 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:02.630129 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:02.630129 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:02.630129 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:02.630129 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:02.630129 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:02.630129 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:02.630129 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. Aug 27 02:45:02.630129 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:02.633372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Returning 404 to user: Instance a7489a8a-8682-4455-abba-671195effab4 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:02.634931 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ddf32de1-b95e-4b78-8a08-fe0ceccd9274 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4" status: 404 len: 111 microversion: 2.20 time: 0.057928 Aug 27 02:45:02.635166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48215457-fa1f-4e68-b8a1-6954361df33f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:02.639313 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1721/3123] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:02 2022] GET /compute/v2.1/servers/a7489a8a-8682-4455-abba-671195effab4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:02.640358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-48215457-fa1f-4e68-b8a1-6954361df33f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:02.643630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b7f21d31-b5bd-4550-aefd-4cb7c9541713 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:02.646232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b7f21d31-b5bd-4550-aefd-4cb7c9541713 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:02.656167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7f21d31-b5bd-4550-aefd-4cb7c9541713 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.656820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7f21d31-b5bd-4550-aefd-4cb7c9541713 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.657719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7f21d31-b5bd-4550-aefd-4cb7c9541713 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.658795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7f21d31-b5bd-4550-aefd-4cb7c9541713 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.659375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7f21d31-b5bd-4550-aefd-4cb7c9541713 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.659908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7f21d31-b5bd-4550-aefd-4cb7c9541713 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.667570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48215457-fa1f-4e68-b8a1-6954361df33f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.669313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48215457-fa1f-4e68-b8a1-6954361df33f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.670136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48215457-fa1f-4e68-b8a1-6954361df33f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.671111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48215457-fa1f-4e68-b8a1-6954361df33f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.671815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48215457-fa1f-4e68-b8a1-6954361df33f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.672904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48215457-fa1f-4e68-b8a1-6954361df33f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.844510 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b7f21d31-b5bd-4550-aefd-4cb7c9541713 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action" status: 202 len: 0 microversion: 2.1 time: 0.206764 Aug 27 02:45:02.850027 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1722/3124] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:45:02 2022] POST /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:45:02.855555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-30d0e15e-3eaa-462a-8213-d5f0c01c8ee4 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1264391893"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:02.869238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-30d0e15e-3eaa-462a-8213-d5f0c01c8ee4 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:02.875973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d0e15e-3eaa-462a-8213-d5f0c01c8ee4 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.876518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d0e15e-3eaa-462a-8213-d5f0c01c8ee4 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.876961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d0e15e-3eaa-462a-8213-d5f0c01c8ee4 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:02.877874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d0e15e-3eaa-462a-8213-d5f0c01c8ee4 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:02.878205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d0e15e-3eaa-462a-8213-d5f0c01c8ee4 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:02.878568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d0e15e-3eaa-462a-8213-d5f0c01c8ee4 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:03.115745 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.network.security_group_api [None req-30d0e15e-3eaa-462a-8213-d5f0c01c8ee4 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Adding security group 2104a625-b722-4ab5-9e8b-b61e9927a61c to port 8dfb1ab5-38bf-470a-9ac5-e9258d8600ed Aug 27 02:45:03.163029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-48215457-fa1f-4e68-b8a1-6954361df33f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:03.174611 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-48215457-fa1f-4e68-b8a1-6954361df33f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1664 microversion: 2.1 time: 0.560637 Aug 27 02:45:03.186579 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1403/3125] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:02 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1664 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:03.192462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-19eb4c55-5b1a-4e97-a3db-627e59e0b7be tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:03.210673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-19eb4c55-5b1a-4e97-a3db-627e59e0b7be tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:03.218738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19eb4c55-5b1a-4e97-a3db-627e59e0b7be tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:03.219628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19eb4c55-5b1a-4e97-a3db-627e59e0b7be tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:03.220891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19eb4c55-5b1a-4e97-a3db-627e59e0b7be tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:03.222310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19eb4c55-5b1a-4e97-a3db-627e59e0b7be tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:03.223104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19eb4c55-5b1a-4e97-a3db-627e59e0b7be tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:03.229115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19eb4c55-5b1a-4e97-a3db-627e59e0b7be tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.039848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-19eb4c55-5b1a-4e97-a3db-627e59e0b7be tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:04.055995 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-19eb4c55-5b1a-4e97-a3db-627e59e0b7be tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1306 microversion: 2.1 time: 0.867139 Aug 27 02:45:04.057484 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1404/3126] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:03 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1306 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:04.070915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2061fa6a-f5d9-4f7c-9977-1e46177f47e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:04.071923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2061fa6a-f5d9-4f7c-9977-1e46177f47e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:04.081388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2061fa6a-f5d9-4f7c-9977-1e46177f47e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.082101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2061fa6a-f5d9-4f7c-9977-1e46177f47e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.082981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2061fa6a-f5d9-4f7c-9977-1e46177f47e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.083837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2061fa6a-f5d9-4f7c-9977-1e46177f47e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.084372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2061fa6a-f5d9-4f7c-9977-1e46177f47e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.085136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2061fa6a-f5d9-4f7c-9977-1e46177f47e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.128719 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-30d0e15e-3eaa-462a-8213-d5f0c01c8ee4 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608/action" status: 202 len: 0 microversion: 2.1 time: 1.276447 Aug 27 02:45:04.136414 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1723/3127] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:45:02 2022] POST /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608/action => generated 0 bytes in 1281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:45:04.144271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d710d590-a36d-4d93-8c98-e45683e2db0a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:04.144605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d710d590-a36d-4d93-8c98-e45683e2db0a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:04.161843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d710d590-a36d-4d93-8c98-e45683e2db0a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.163212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d710d590-a36d-4d93-8c98-e45683e2db0a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.164685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d710d590-a36d-4d93-8c98-e45683e2db0a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.166332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d710d590-a36d-4d93-8c98-e45683e2db0a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.167516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d710d590-a36d-4d93-8c98-e45683e2db0a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.170190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d710d590-a36d-4d93-8c98-e45683e2db0a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.542367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2061fa6a-f5d9-4f7c-9977-1e46177f47e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:04.555682 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2061fa6a-f5d9-4f7c-9977-1e46177f47e5 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1508 microversion: 2.1 time: 0.496791 Aug 27 02:45:04.558428 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1405/3128] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:04 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1508 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:04.567696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2d191963-8291-424e-b77f-b41475cbe232 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:04.568698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2d191963-8291-424e-b77f-b41475cbe232 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:04.576146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d191963-8291-424e-b77f-b41475cbe232 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.576948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d191963-8291-424e-b77f-b41475cbe232 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.577571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d191963-8291-424e-b77f-b41475cbe232 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.578639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d191963-8291-424e-b77f-b41475cbe232 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.579283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d191963-8291-424e-b77f-b41475cbe232 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.580464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d191963-8291-424e-b77f-b41475cbe232 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.679607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d710d590-a36d-4d93-8c98-e45683e2db0a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:04.692987 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d710d590-a36d-4d93-8c98-e45683e2db0a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1323 microversion: 2.1 time: 0.557775 Aug 27 02:45:04.696426 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1724/3129] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:04 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1323 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:04.719517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-40113db6-8281-42e7-9ad5-c37a3a3b7eba req-e7142416-e2cd-4bf3-90f0-150c7b463531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbd5532-9135-4bc2-890e-ba2e9b080cf2", "name": "network-vif-deleted", "tag": "5b8a4190-5436-4df2-9d49-7f30f4f5b7c6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:04.754113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-40113db6-8281-42e7-9ad5-c37a3a3b7eba req-e7142416-e2cd-4bf3-90f0-150c7b463531 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.754685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-40113db6-8281-42e7-9ad5-c37a3a3b7eba req-e7142416-e2cd-4bf3-90f0-150c7b463531 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.756792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-40113db6-8281-42e7-9ad5-c37a3a3b7eba req-e7142416-e2cd-4bf3-90f0-150c7b463531 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.806956 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-40113db6-8281-42e7-9ad5-c37a3a3b7eba req-e7142416-e2cd-4bf3-90f0-150c7b463531 service nova] Creating event network-vif-deleted:5b8a4190-5436-4df2-9d49-7f30f4f5b7c6 for instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 on n-h2-852084-5 Aug 27 02:45:04.831325 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-40113db6-8281-42e7-9ad5-c37a3a3b7eba req-e7142416-e2cd-4bf3-90f0-150c7b463531 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128292 Aug 27 02:45:04.833040 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1725/3130] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:04.860458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:04.866813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:04.908281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.910201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.911244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.912515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.916721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.919378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.921876 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2d191963-8291-424e-b77f-b41475cbe232 tempest-ServersAdminTestJSON-1473529027 tempest-ServersAdminTestJSON-1473529027-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1614 microversion: 2.1 time: 0.362023 Aug 27 02:45:04.924141 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1406/3131] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:04 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1614 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:04.929844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7524d578-08a7-4895-a173-46c838927131 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-819197377"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:04.930902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7524d578-08a7-4895-a173-46c838927131 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:04.951218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7524d578-08a7-4895-a173-46c838927131 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.952948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7524d578-08a7-4895-a173-46c838927131 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.953704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7524d578-08a7-4895-a173-46c838927131 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:04.955282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7524d578-08a7-4895-a173-46c838927131 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:04.958526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7524d578-08a7-4895-a173-46c838927131 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:04.959266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7524d578-08a7-4895-a173-46c838927131 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:05.038875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:05.059585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:05.062301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:05.065214 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6793ad8c-265b-44a0-90d2-dd22ad3e0592 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.227990 Aug 27 02:45:05.066858 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1726/3132] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:04 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:05.077891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-35769c88-0025-4049-a607-902e29b5539e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:05.078890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-35769c88-0025-4049-a607-902e29b5539e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:05.093782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35769c88-0025-4049-a607-902e29b5539e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:05.094657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35769c88-0025-4049-a607-902e29b5539e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:05.095507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35769c88-0025-4049-a607-902e29b5539e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:05.097651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35769c88-0025-4049-a607-902e29b5539e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:05.098024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35769c88-0025-4049-a607-902e29b5539e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:05.098662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35769c88-0025-4049-a607-902e29b5539e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:05.201008 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.network.security_group_api [None req-7524d578-08a7-4895-a173-46c838927131 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Adding security group ae3bf98b-ed32-4572-b31b-bf4632f75659 to port 8dfb1ab5-38bf-470a-9ac5-e9258d8600ed Aug 27 02:45:05.499330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-35769c88-0025-4049-a607-902e29b5539e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:05.513035 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-35769c88-0025-4049-a607-902e29b5539e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1664 microversion: 2.1 time: 0.443791 Aug 27 02:45:05.514649 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1727/3133] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:05 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1664 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:05.532319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1d3d9c9e-8b92-45dc-a4aa-1d0b485a1b88 req-684d0d7c-b76e-4c0f-ae88-55291684b9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1", "name": "network-vif-plugged", "status": "completed", "tag": "cc07ffc6-88d4-4347-b44f-52ae8d2126ef"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:05.548462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1d3d9c9e-8b92-45dc-a4aa-1d0b485a1b88 req-684d0d7c-b76e-4c0f-ae88-55291684b9b0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:05.548944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1d3d9c9e-8b92-45dc-a4aa-1d0b485a1b88 req-684d0d7c-b76e-4c0f-ae88-55291684b9b0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:05.549388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1d3d9c9e-8b92-45dc-a4aa-1d0b485a1b88 req-684d0d7c-b76e-4c0f-ae88-55291684b9b0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:05.583209 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1d3d9c9e-8b92-45dc-a4aa-1d0b485a1b88 req-684d0d7c-b76e-4c0f-ae88-55291684b9b0 service nova] Creating event network-vif-plugged:cc07ffc6-88d4-4347-b44f-52ae8d2126ef for instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 on n-h2-852084-5 Aug 27 02:45:05.594269 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1d3d9c9e-8b92-45dc-a4aa-1d0b485a1b88 req-684d0d7c-b76e-4c0f-ae88-55291684b9b0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075457 Aug 27 02:45:05.596920 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1728/3134] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:05.607935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b61c7944-eea7-4de3-b76b-6e0f04d2e512 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:05.609370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b61c7944-eea7-4de3-b76b-6e0f04d2e512 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:05.622006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b61c7944-eea7-4de3-b76b-6e0f04d2e512 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:05.622884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b61c7944-eea7-4de3-b76b-6e0f04d2e512 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:05.624360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b61c7944-eea7-4de3-b76b-6e0f04d2e512 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:05.625429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b61c7944-eea7-4de3-b76b-6e0f04d2e512 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:05.627289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b61c7944-eea7-4de3-b76b-6e0f04d2e512 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:05.627289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b61c7944-eea7-4de3-b76b-6e0f04d2e512 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:05.668636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b61c7944-eea7-4de3-b76b-6e0f04d2e512 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:05.915237 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b61c7944-eea7-4de3-b76b-6e0f04d2e512 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 204 len: 0 microversion: 2.1 time: 0.316385 Aug 27 02:45:05.917728 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1729/3135] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:05 2022] DELETE /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:05.924324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-faf83d00-93f5-40e6-85d1-44058b7d3df6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:05.925326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-faf83d00-93f5-40e6-85d1-44058b7d3df6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:05.952494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-faf83d00-93f5-40e6-85d1-44058b7d3df6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:05.960277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-faf83d00-93f5-40e6-85d1-44058b7d3df6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:05.962069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-faf83d00-93f5-40e6-85d1-44058b7d3df6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:05.964841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-faf83d00-93f5-40e6-85d1-44058b7d3df6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:05.968331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-faf83d00-93f5-40e6-85d1-44058b7d3df6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:05.971460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-faf83d00-93f5-40e6-85d1-44058b7d3df6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.116701 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7524d578-08a7-4895-a173-46c838927131 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608/action" status: 202 len: 0 microversion: 2.1 time: 1.191361 Aug 27 02:45:06.123600 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1407/3136] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:45:04 2022] POST /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608/action => generated 0 bytes in 1199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:45:06.133523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:06.134406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:06.142752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.144609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.145286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.146460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.159897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.161115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.211742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.213308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.214002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.214691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lazy-loading 'fault' on Instance uuid 846f11d0-56dc-4717-87da-d2c70805d9ef {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:06.286331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:06.302978 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-064e9d18-d022-407a-b0ec-f54c7c949af2 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 200 len: 1312 microversion: 2.1 time: 0.172405 Aug 27 02:45:06.314615 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1408/3137] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:06 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:06.331401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-56b48db7-62ce-46c9-b8b0-5e7c45faf887 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:06.333604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-56b48db7-62ce-46c9-b8b0-5e7c45faf887 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:06.349597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b48db7-62ce-46c9-b8b0-5e7c45faf887 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.350236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b48db7-62ce-46c9-b8b0-5e7c45faf887 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.351021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b48db7-62ce-46c9-b8b0-5e7c45faf887 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.352815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b48db7-62ce-46c9-b8b0-5e7c45faf887 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.353595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b48db7-62ce-46c9-b8b0-5e7c45faf887 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.354082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b48db7-62ce-46c9-b8b0-5e7c45faf887 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.556737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-faf83d00-93f5-40e6-85d1-44058b7d3df6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:06.575989 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-faf83d00-93f5-40e6-85d1-44058b7d3df6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1306 microversion: 2.1 time: 0.657871 Aug 27 02:45:06.578695 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1730/3138] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:05 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1306 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:06.607765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-66bed715-6fd6-4775-92ce-da1c30ad9b8c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:06.608714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-66bed715-6fd6-4775-92ce-da1c30ad9b8c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:06.631836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66bed715-6fd6-4775-92ce-da1c30ad9b8c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.633308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66bed715-6fd6-4775-92ce-da1c30ad9b8c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.633980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66bed715-6fd6-4775-92ce-da1c30ad9b8c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.634881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66bed715-6fd6-4775-92ce-da1c30ad9b8c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.635515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66bed715-6fd6-4775-92ce-da1c30ad9b8c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.636546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66bed715-6fd6-4775-92ce-da1c30ad9b8c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.746951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-56b48db7-62ce-46c9-b8b0-5e7c45faf887 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:06.758014 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-56b48db7-62ce-46c9-b8b0-5e7c45faf887 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 200 len: 1514 microversion: 2.1 time: 0.440066 Aug 27 02:45:06.758870 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1409/3139] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:06 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 1514 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:06.764057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:06.765591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:06.774479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.775352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.775968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.776913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.777602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.779200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.901030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-66bed715-6fd6-4775-92ce-da1c30ad9b8c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:06.918624 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-66bed715-6fd6-4775-92ce-da1c30ad9b8c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1470 microversion: 2.1 time: 0.320274 Aug 27 02:45:06.921945 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1731/3140] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:06 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:06.925309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:06.931486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a0561d54-5ba9-4369-bea2-8a6f83678ad5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:06.932579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a0561d54-5ba9-4369-bea2-8a6f83678ad5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:06.943727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:06.944897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0561d54-5ba9-4369-bea2-8a6f83678ad5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.945985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0561d54-5ba9-4369-bea2-8a6f83678ad5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.946990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0561d54-5ba9-4369-bea2-8a6f83678ad5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.948619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0561d54-5ba9-4369-bea2-8a6f83678ad5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.949718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0561d54-5ba9-4369-bea2-8a6f83678ad5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.950935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0561d54-5ba9-4369-bea2-8a6f83678ad5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:06.952041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:06.954772 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5148be7e-0198-4020-8e64-6f08baab4257 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.194229 Aug 27 02:45:06.971853 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1410/3141] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:06 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:06.971853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-352ab166-d73f-4a46-a954-49740f71853b req-691f16b9-9249-4249-b5f1-bd068c1aaf4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63023909-57ad-4eb5-be6a-1ce0cc58b608", "tag": "8dfb1ab5-38bf-470a-9ac5-e9258d8600ed"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:06.985262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-352ab166-d73f-4a46-a954-49740f71853b req-691f16b9-9249-4249-b5f1-bd068c1aaf4d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:06.985262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-352ab166-d73f-4a46-a954-49740f71853b req-691f16b9-9249-4249-b5f1-bd068c1aaf4d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:06.985262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-352ab166-d73f-4a46-a954-49740f71853b req-691f16b9-9249-4249-b5f1-bd068c1aaf4d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:07.311660 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-352ab166-d73f-4a46-a954-49740f71853b req-691f16b9-9249-4249-b5f1-bd068c1aaf4d service nova] Creating event network-changed:8dfb1ab5-38bf-470a-9ac5-e9258d8600ed for instance 63023909-57ad-4eb5-be6a-1ce0cc58b608 on n-h2-852084-5 Aug 27 02:45:07.317785 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-352ab166-d73f-4a46-a954-49740f71853b req-691f16b9-9249-4249-b5f1-bd068c1aaf4d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358670 Aug 27 02:45:07.319124 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1411/3142] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:07.325962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f13655a-e48e-43e0-a3bf-ba0993784576 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:07.328937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5f13655a-e48e-43e0-a3bf-ba0993784576 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:07.341864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f13655a-e48e-43e0-a3bf-ba0993784576 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:07.342673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f13655a-e48e-43e0-a3bf-ba0993784576 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:07.343291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f13655a-e48e-43e0-a3bf-ba0993784576 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:07.344399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f13655a-e48e-43e0-a3bf-ba0993784576 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:07.345608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f13655a-e48e-43e0-a3bf-ba0993784576 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:07.346277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f13655a-e48e-43e0-a3bf-ba0993784576 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:07.426031 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a0561d54-5ba9-4369-bea2-8a6f83678ad5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.502400 Aug 27 02:45:07.427249 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1732/3143] 10.222.0.99 () {58 vars in 1293 bytes} [Sat Aug 27 02:45:06 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608/os-security-groups => generated 1158 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:07.432335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-06bbea5b-cf35-4bb7-9f1b-0c4d0acf7ca2 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:07.433341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-06bbea5b-cf35-4bb7-9f1b-0c4d0acf7ca2 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:07.456058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06bbea5b-cf35-4bb7-9f1b-0c4d0acf7ca2 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:07.456565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06bbea5b-cf35-4bb7-9f1b-0c4d0acf7ca2 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:07.458502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06bbea5b-cf35-4bb7-9f1b-0c4d0acf7ca2 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:07.462464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06bbea5b-cf35-4bb7-9f1b-0c4d0acf7ca2 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:07.463226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06bbea5b-cf35-4bb7-9f1b-0c4d0acf7ca2 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:07.464979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06bbea5b-cf35-4bb7-9f1b-0c4d0acf7ca2 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:07.593142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5f13655a-e48e-43e0-a3bf-ba0993784576 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:07.634082 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5f13655a-e48e-43e0-a3bf-ba0993784576 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.307209 Aug 27 02:45:07.635707 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1412/3144] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:07 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:07.645951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3eeafa78-d3ae-4e5a-a940-79936e64aa9c req-9eb4dfc1-6060-4f1b-b2e6-6f293407dadd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63023909-57ad-4eb5-be6a-1ce0cc58b608", "tag": "8dfb1ab5-38bf-470a-9ac5-e9258d8600ed"}, {"server_uuid": "846f11d0-56dc-4717-87da-d2c70805d9ef", "name": "network-vif-deleted", "tag": "04c28e0e-a581-4f71-bb11-9ac533fb7ad2"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:07.674659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3eeafa78-d3ae-4e5a-a940-79936e64aa9c req-9eb4dfc1-6060-4f1b-b2e6-6f293407dadd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:07.675874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3eeafa78-d3ae-4e5a-a940-79936e64aa9c req-9eb4dfc1-6060-4f1b-b2e6-6f293407dadd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:07.676905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3eeafa78-d3ae-4e5a-a940-79936e64aa9c req-9eb4dfc1-6060-4f1b-b2e6-6f293407dadd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:07.707739 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3eeafa78-d3ae-4e5a-a940-79936e64aa9c req-9eb4dfc1-6060-4f1b-b2e6-6f293407dadd service nova] Creating event network-changed:8dfb1ab5-38bf-470a-9ac5-e9258d8600ed for instance 63023909-57ad-4eb5-be6a-1ce0cc58b608 on n-h2-852084-5 Aug 27 02:45:07.708806 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3eeafa78-d3ae-4e5a-a940-79936e64aa9c req-9eb4dfc1-6060-4f1b-b2e6-6f293407dadd service nova] Creating event network-vif-deleted:04c28e0e-a581-4f71-bb11-9ac533fb7ad2 for instance 846f11d0-56dc-4717-87da-d2c70805d9ef on n-h1-852084-5 Aug 27 02:45:07.727506 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3eeafa78-d3ae-4e5a-a940-79936e64aa9c req-9eb4dfc1-6060-4f1b-b2e6-6f293407dadd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.089409 Aug 27 02:45:07.729354 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1413/3145] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:07.740523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:07.742511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: 846f11d0-56dc-4717-87da-d2c70805d9ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:07.759073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:07.760367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:07.761450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:07.763098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:07.764259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:07.765628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:07.795174 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] HTTP exception thrown: Instance 846f11d0-56dc-4717-87da-d2c70805d9ef could not be found. Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Request method failure captured: Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef HTTP/1.1 Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYO1ujqvCLBmMVe65fdN2J5dIO7-HUqI3Js5YGestJSXRt-3jM1W-KzE8NnECJ1ryJNn-_nCYfE1drEJmtuv9wrerAqLuupZmy6gs9vrBdbjKq9YdwsxzP7b-WGUVBzCCEf1u8fLpuDoBEeADCldZf84VX9NU_VzQjP9Knt2NuVZyVU Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/956a66be18bb4f9e996c8e16bcf23bab"}]}] Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 51b3d953421c409c9edd54287dcd11db Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 846f11d0-56dc-4717-87da-d2c70805d9ef could not be found. Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '846f11d0-56dc-4717-87da-d2c70805d9ef'} Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846f11d0-56dc-4717-87da-d2c70805d9ef could not be found. Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846f11d0-56dc-4717-87da-d2c70805d9ef could not be found. Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:07.799406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:07.809182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:07.809182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:07.809182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:07.809182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:07.809182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:07.809182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:07.809182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846f11d0-56dc-4717-87da-d2c70805d9ef could not be found. Aug 27 02:45:07.809182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:07.809182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Returning 404 to user: Instance 846f11d0-56dc-4717-87da-d2c70805d9ef could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:07.809182 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b61e6d42-9705-43c4-8068-fa060a02591d tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef" status: 404 len: 111 microversion: 2.1 time: 0.075476 Aug 27 02:45:07.809182 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1414/3146] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:07 2022] GET /compute/v2.1/servers/846f11d0-56dc-4717-87da-d2c70805d9ef => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:07.817292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-021e0072-ad01-4d26-b9b5-72f929521e32 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'create', calling method: .version_select at 0x7f4d29756af0>, body: {"security_group": {"name": " tempest-securitygroup -394476732 ", "description": "tempest-description-1311567868"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:08.085807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-06bbea5b-cf35-4bb7-9f1b-0c4d0acf7ca2 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:08.108646 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-06bbea5b-cf35-4bb7-9f1b-0c4d0acf7ca2 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737" status: 200 len: 1323 microversion: 2.1 time: 0.679981 Aug 27 02:45:08.109930 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1733/3147] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:07 2022] GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737 => generated 1323 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:08.115543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-103d33a2-0753-4195-8c2d-1eaf81cca425 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:08.116385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-103d33a2-0753-4195-8c2d-1eaf81cca425 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:08.123348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-103d33a2-0753-4195-8c2d-1eaf81cca425 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.124120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-103d33a2-0753-4195-8c2d-1eaf81cca425 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.124711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-103d33a2-0753-4195-8c2d-1eaf81cca425 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.125593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-103d33a2-0753-4195-8c2d-1eaf81cca425 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.126880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-103d33a2-0753-4195-8c2d-1eaf81cca425 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.127503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-103d33a2-0753-4195-8c2d-1eaf81cca425 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.230501 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-021e0072-ad01-4d26-b9b5-72f929521e32 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.420348 Aug 27 02:45:08.236641 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1415/3148] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:45:07 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:08.273650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-97892420-a5fa-4ac9-a133-b07c4ab61271 req-d29ebaae-9eb4-476f-b931-93abaa6b38aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902974a7-3280-4391-b745-432c3a4f1737", "name": "network-vif-plugged", "status": "completed", "tag": "99e417ab-547f-40b2-8976-ea9ef401d5f5"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:08.297071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-97892420-a5fa-4ac9-a133-b07c4ab61271 req-d29ebaae-9eb4-476f-b931-93abaa6b38aa service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.299775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-97892420-a5fa-4ac9-a133-b07c4ab61271 req-d29ebaae-9eb4-476f-b931-93abaa6b38aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.300748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-97892420-a5fa-4ac9-a133-b07c4ab61271 req-d29ebaae-9eb4-476f-b931-93abaa6b38aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.322921 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-97892420-a5fa-4ac9-a133-b07c4ab61271 req-d29ebaae-9eb4-476f-b931-93abaa6b38aa service nova] Creating event network-vif-plugged:99e417ab-547f-40b2-8976-ea9ef401d5f5 for instance 902974a7-3280-4391-b745-432c3a4f1737 on n-h2-852084-5 Aug 27 02:45:08.331029 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-97892420-a5fa-4ac9-a133-b07c4ab61271 req-d29ebaae-9eb4-476f-b931-93abaa6b38aa service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092215 Aug 27 02:45:08.332361 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1416/3149] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:08.362795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-53b7e190-d0da-4059-9330-47ece9bb7619 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:08.363761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-53b7e190-d0da-4059-9330-47ece9bb7619 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:08.370878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b7e190-d0da-4059-9330-47ece9bb7619 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.371893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b7e190-d0da-4059-9330-47ece9bb7619 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.372686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b7e190-d0da-4059-9330-47ece9bb7619 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.373633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b7e190-d0da-4059-9330-47ece9bb7619 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.374784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b7e190-d0da-4059-9330-47ece9bb7619 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.386494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53b7e190-d0da-4059-9330-47ece9bb7619 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.437729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-103d33a2-0753-4195-8c2d-1eaf81cca425 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:08.480121 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-103d33a2-0753-4195-8c2d-1eaf81cca425 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1306 microversion: 2.1 time: 0.368250 Aug 27 02:45:08.484276 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1734/3150] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:08 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1306 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:08.501437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2bba4a3-d47d-49bd-9d1a-8248b3b7e382 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:08.504570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2bba4a3-d47d-49bd-9d1a-8248b3b7e382 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:08.522795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bba4a3-d47d-49bd-9d1a-8248b3b7e382 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.530056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bba4a3-d47d-49bd-9d1a-8248b3b7e382 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.531082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bba4a3-d47d-49bd-9d1a-8248b3b7e382 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.532987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bba4a3-d47d-49bd-9d1a-8248b3b7e382 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.533778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bba4a3-d47d-49bd-9d1a-8248b3b7e382 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.534511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bba4a3-d47d-49bd-9d1a-8248b3b7e382 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.601794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2bba4a3-d47d-49bd-9d1a-8248b3b7e382 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:08.701806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:08.790558 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2bba4a3-d47d-49bd-9d1a-8248b3b7e382 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 204 len: 0 microversion: 2.1 time: 0.304669 Aug 27 02:45:08.794625 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1735/3151] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:08 2022] DELETE /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:08.804044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c4ca452-1338-4a6c-8648-6c1b98b09f7e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:08.804489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c4ca452-1338-4a6c-8648-6c1b98b09f7e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:08.836617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c4ca452-1338-4a6c-8648-6c1b98b09f7e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.836953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c4ca452-1338-4a6c-8648-6c1b98b09f7e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.837581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c4ca452-1338-4a6c-8648-6c1b98b09f7e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.838536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c4ca452-1338-4a6c-8648-6c1b98b09f7e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.847254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c4ca452-1338-4a6c-8648-6c1b98b09f7e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.852356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c4ca452-1338-4a6c-8648-6c1b98b09f7e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.868038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-53b7e190-d0da-4059-9330-47ece9bb7619 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:08.901899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:08.913139 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-53b7e190-d0da-4059-9330-47ece9bb7619 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.579318 Aug 27 02:45:08.915511 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1417/3152] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:08 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:08.921770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:08.922705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:08.940961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.950960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.952657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:08.954073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:08.955470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:08.956268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.098699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1c4ca452-1338-4a6c-8648-6c1b98b09f7e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:09.135860 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c4ca452-1338-4a6c-8648-6c1b98b09f7e tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1299 microversion: 2.1 time: 0.338925 Aug 27 02:45:09.151774 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1736/3153] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:08 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1299 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:09.171728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e8eb2016-99a9-4b88-8ad4-33f06a47f2aa tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d29262dc0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:09.212042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:09.238393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:09.243477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:09.246655 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-37418224-a3e7-48b2-8541-b6846d638c2b tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.328870 Aug 27 02:45:09.249236 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1418/3154] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:08 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:09.272760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8a5cca69-af44-4226-ac88-d40cd5fe65f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:09.281465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8a5cca69-af44-4226-ac88-d40cd5fe65f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:09.309828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a5cca69-af44-4226-ac88-d40cd5fe65f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.310736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a5cca69-af44-4226-ac88-d40cd5fe65f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.311530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a5cca69-af44-4226-ac88-d40cd5fe65f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.313617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a5cca69-af44-4226-ac88-d40cd5fe65f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.315434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a5cca69-af44-4226-ac88-d40cd5fe65f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.318462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8a5cca69-af44-4226-ac88-d40cd5fe65f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.426286 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e8eb2016-99a9-4b88-8ad4-33f06a47f2aa tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups/76e34f85-a1b2-45a9-85da-1fed38550222" status: 200 len: 223 microversion: 2.1 time: 0.278757 Aug 27 02:45:09.427349 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1737/3155] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:45:09 2022] GET /compute/v2.1/os-security-groups/76e34f85-a1b2-45a9-85da-1fed38550222 => generated 223 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:09.451844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e56d393b-7b57-462f-966e-43de23fe6f37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:09.453021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e56d393b-7b57-462f-966e-43de23fe6f37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:09.473057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e56d393b-7b57-462f-966e-43de23fe6f37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.474732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e56d393b-7b57-462f-966e-43de23fe6f37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.476145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e56d393b-7b57-462f-966e-43de23fe6f37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.478219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e56d393b-7b57-462f-966e-43de23fe6f37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.479960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e56d393b-7b57-462f-966e-43de23fe6f37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.482277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e56d393b-7b57-462f-966e-43de23fe6f37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.702728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8a5cca69-af44-4226-ac88-d40cd5fe65f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:09.745789 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8a5cca69-af44-4226-ac88-d40cd5fe65f0 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.493679 Aug 27 02:45:09.747333 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1419/3156] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:09 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:09.755875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf2a9da8-0a94-4b0e-9903-013afbe84b75 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:09.757791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf2a9da8-0a94-4b0e-9903-013afbe84b75 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:09.766214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2a9da8-0a94-4b0e-9903-013afbe84b75 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.767610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2a9da8-0a94-4b0e-9903-013afbe84b75 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.768363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2a9da8-0a94-4b0e-9903-013afbe84b75 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.769422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2a9da8-0a94-4b0e-9903-013afbe84b75 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.770309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2a9da8-0a94-4b0e-9903-013afbe84b75 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.770958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2a9da8-0a94-4b0e-9903-013afbe84b75 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.777364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e56d393b-7b57-462f-966e-43de23fe6f37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:09.795512 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e56d393b-7b57-462f-966e-43de23fe6f37 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.353260 Aug 27 02:45:09.824161 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1738/3157] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:09 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:09.838516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7b8200cf-75ef-43f4-bb5d-bfbbce0b9163 req-66af2354-a630-449a-994b-223f1b21a7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56302-112a-470a-94c4-ca2a437560a8", "name": "network-vif-deleted", "tag": "f44e56a4-faa4-480a-9a77-deeca7f2aacd"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:09.857153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7b8200cf-75ef-43f4-bb5d-bfbbce0b9163 req-66af2354-a630-449a-994b-223f1b21a7fd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:09.858503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7b8200cf-75ef-43f4-bb5d-bfbbce0b9163 req-66af2354-a630-449a-994b-223f1b21a7fd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:09.859576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7b8200cf-75ef-43f4-bb5d-bfbbce0b9163 req-66af2354-a630-449a-994b-223f1b21a7fd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:09.874095 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7b8200cf-75ef-43f4-bb5d-bfbbce0b9163 req-66af2354-a630-449a-994b-223f1b21a7fd service nova] Creating event network-vif-deleted:f44e56a4-faa4-480a-9a77-deeca7f2aacd for instance d3a56302-112a-470a-94c4-ca2a437560a8 on n-h2-852084-5 Aug 27 02:45:09.881420 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7b8200cf-75ef-43f4-bb5d-bfbbce0b9163 req-66af2354-a630-449a-994b-223f1b21a7fd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054913 Aug 27 02:45:09.882378 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1739/3158] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:09.890848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0d65af67-0482-4b1a-8a5b-dc011fa61f47 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d292653a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:09.963334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf2a9da8-0a94-4b0e-9903-013afbe84b75 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:09.973484 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf2a9da8-0a94-4b0e-9903-013afbe84b75 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737" status: 200 len: 1323 microversion: 2.1 time: 0.224702 Aug 27 02:45:09.988486 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1420/3159] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:09 2022] GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737 => generated 1323 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:09.993561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-81f9ae06-53b2-416f-87a5-5aa2c295a0c6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:09.994268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-81f9ae06-53b2-416f-87a5-5aa2c295a0c6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:10.001401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81f9ae06-53b2-416f-87a5-5aa2c295a0c6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.002020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81f9ae06-53b2-416f-87a5-5aa2c295a0c6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.002485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81f9ae06-53b2-416f-87a5-5aa2c295a0c6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.016256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81f9ae06-53b2-416f-87a5-5aa2c295a0c6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.016256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81f9ae06-53b2-416f-87a5-5aa2c295a0c6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.017656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81f9ae06-53b2-416f-87a5-5aa2c295a0c6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.221380 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0d65af67-0482-4b1a-8a5b-dc011fa61f47 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/76e34f85-a1b2-45a9-85da-1fed38550222" status: 202 len: 0 microversion: 2.1 time: 0.335862 Aug 27 02:45:10.226227 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1740/3160] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:45:09 2022] DELETE /compute/v2.1/os-security-groups/76e34f85-a1b2-45a9-85da-1fed38550222 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:45:10.234730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-125e9c7e-b44b-4016-93e2-6f80feed694d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:10.246064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-125e9c7e-b44b-4016-93e2-6f80feed694d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:10.269906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-125e9c7e-b44b-4016-93e2-6f80feed694d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.271164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-125e9c7e-b44b-4016-93e2-6f80feed694d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.272215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-125e9c7e-b44b-4016-93e2-6f80feed694d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.277094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-125e9c7e-b44b-4016-93e2-6f80feed694d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.280749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-125e9c7e-b44b-4016-93e2-6f80feed694d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.284361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-125e9c7e-b44b-4016-93e2-6f80feed694d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.312522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-81f9ae06-53b2-416f-87a5-5aa2c295a0c6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:10.325705 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-81f9ae06-53b2-416f-87a5-5aa2c295a0c6 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1306 microversion: 2.1 time: 0.335848 Aug 27 02:45:10.326586 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1421/3161] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:09 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1306 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:10.332384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:10.334455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:10.342363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.343196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.344030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.345604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.346912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.347580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.421099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.422022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.423640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.424412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lazy-loading 'fault' on Instance uuid d3a56302-112a-470a-94c4-ca2a437560a8 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:10.494087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:10.503881 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1e6aa9fb-7e44-45e0-a33e-190d9d853916 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1304 microversion: 2.1 time: 0.175888 Aug 27 02:45:10.521478 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1422/3162] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:10 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1304 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:10.529178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-14c0a167-cc5c-45d4-8ddb-13e36c2ceaa9 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d29756310>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:10.570264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-14c0a167-cc5c-45d4-8ddb-13e36c2ceaa9 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:45:10.571299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-14c0a167-cc5c-45d4-8ddb-13e36c2ceaa9 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Neutron security group 76e34f85-a1b2-45a9-85da-1fed38550222 not found {{(pid=122487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:45:10.572146 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-14c0a167-cc5c-45d4-8ddb-13e36c2ceaa9 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:45:10.572146 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-f922e868-9798-4382-9cd5-d6c4b638acf6'] Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-14c0a167-cc5c-45d4-8ddb-13e36c2ceaa9 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-security-groups/76e34f85-a1b2-45a9-85da-1fed38550222 HTTP/1.1 Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-f922e868-9798-4382-9cd5-d6c4b638acf6'] Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '76e34f85-a1b2-45a9-85da-1fed38550222'} Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:45:10.574613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f922e868-9798-4382-9cd5-d6c4b638acf6'] Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f922e868-9798-4382-9cd5-d6c4b638acf6'] Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f922e868-9798-4382-9cd5-d6c4b638acf6'] Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f922e868-9798-4382-9cd5-d6c4b638acf6'] Aug 27 02:45:10.578538 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:10.583409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-14c0a167-cc5c-45d4-8ddb-13e36c2ceaa9 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:45:10.583409 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-f922e868-9798-4382-9cd5-d6c4b638acf6'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:10.584319 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-14c0a167-cc5c-45d4-8ddb-13e36c2ceaa9 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups/76e34f85-a1b2-45a9-85da-1fed38550222" status: 404 len: 194 microversion: 2.1 time: 0.060321 Aug 27 02:45:10.584902 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1423/3163] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:45:10 2022] GET /compute/v2.1/os-security-groups/76e34f85-a1b2-45a9-85da-1fed38550222 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:10.596425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:10.598018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:10.614082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.615432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.616735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.618539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.619709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.620961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.660659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-125e9c7e-b44b-4016-93e2-6f80feed694d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:10.683440 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-125e9c7e-b44b-4016-93e2-6f80feed694d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.455677 Aug 27 02:45:10.685981 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1741/3164] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:10 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:10.692335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9575db35-d392-480e-adef-33fa534788c7 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'create', calling method: .version_select at 0x7f4d29265ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-648241328", "description": "tempest-description-389578685"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:10.771798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:10.789226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:10.791129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:10.792438 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a7e26247-24bd-4a5e-ba65-1e8cfa6a2ce2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.205078 Aug 27 02:45:10.793296 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1424/3165] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:10 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:10.803178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-97bedca8-8ce4-473c-bf4d-142928c52512 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:10.803814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-97bedca8-8ce4-473c-bf4d-142928c52512 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:10.828645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97bedca8-8ce4-473c-bf4d-142928c52512 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.829053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97bedca8-8ce4-473c-bf4d-142928c52512 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.830272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97bedca8-8ce4-473c-bf4d-142928c52512 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.831049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97bedca8-8ce4-473c-bf4d-142928c52512 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:10.835075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97bedca8-8ce4-473c-bf4d-142928c52512 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:10.835650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97bedca8-8ce4-473c-bf4d-142928c52512 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:10.989831 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9575db35-d392-480e-adef-33fa534788c7 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.301718 Aug 27 02:45:10.992477 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1742/3166] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:45:10 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:11.017651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8026ed72-1a64-4991-acca-b5754411f585 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:11.025011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8026ed72-1a64-4991-acca-b5754411f585 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:11.041436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8026ed72-1a64-4991-acca-b5754411f585 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.042022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8026ed72-1a64-4991-acca-b5754411f585 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.043780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8026ed72-1a64-4991-acca-b5754411f585 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.045613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8026ed72-1a64-4991-acca-b5754411f585 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.046185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8026ed72-1a64-4991-acca-b5754411f585 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.046765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8026ed72-1a64-4991-acca-b5754411f585 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.062525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-97bedca8-8ce4-473c-bf4d-142928c52512 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:11.072968 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-97bedca8-8ce4-473c-bf4d-142928c52512 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.274537 Aug 27 02:45:11.074031 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1425/3167] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:10 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:11.080704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3642b52-cdca-4c7b-b482-1eb3e8daa1ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:11.081453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c3642b52-cdca-4c7b-b482-1eb3e8daa1ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:11.089317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3642b52-cdca-4c7b-b482-1eb3e8daa1ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.090880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3642b52-cdca-4c7b-b482-1eb3e8daa1ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.091465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3642b52-cdca-4c7b-b482-1eb3e8daa1ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.092522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3642b52-cdca-4c7b-b482-1eb3e8daa1ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.093424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3642b52-cdca-4c7b-b482-1eb3e8daa1ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.094005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3642b52-cdca-4c7b-b482-1eb3e8daa1ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.293101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8026ed72-1a64-4991-acca-b5754411f585 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:11.307444 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8026ed72-1a64-4991-acca-b5754411f585 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.304394 Aug 27 02:45:11.308405 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1743/3168] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:10 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:11.314372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-03543cb5-33b5-48a8-81a0-1baecb160bd6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'create', calling method: .version_select at 0x7f4d291cd160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-642603249", "description": "tempest-description-955074395"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:11.316398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c3642b52-cdca-4c7b-b482-1eb3e8daa1ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:11.331045 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c3642b52-cdca-4c7b-b482-1eb3e8daa1ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737" status: 200 len: 1323 microversion: 2.1 time: 0.255360 Aug 27 02:45:11.332163 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1426/3169] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:11 2022] GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:11.349737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ca39e3d2-5719-4228-b472-9108913fe7b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:11.349737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ca39e3d2-5719-4228-b472-9108913fe7b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:11.362631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca39e3d2-5719-4228-b472-9108913fe7b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.363722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca39e3d2-5719-4228-b472-9108913fe7b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.364827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca39e3d2-5719-4228-b472-9108913fe7b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.366657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca39e3d2-5719-4228-b472-9108913fe7b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.367650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca39e3d2-5719-4228-b472-9108913fe7b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.368448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca39e3d2-5719-4228-b472-9108913fe7b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.432500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-ca39e3d2-5719-4228-b472-9108913fe7b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lazy-loading 'flavor' on Instance uuid 59462ca6-1830-4fae-a141-ffade28879f6 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:11.589131 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-03543cb5-33b5-48a8-81a0-1baecb160bd6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.279630 Aug 27 02:45:11.589688 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ca39e3d2-5719-4228-b472-9108913fe7b5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.245176 Aug 27 02:45:11.589863 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1744/3170] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:45:11 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:11.603246 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1427/3171] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:45:11 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:45:11.607570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-862e9475-7a63-4ad2-be32-5f90dbea61d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:11.608216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-862e9475-7a63-4ad2-be32-5f90dbea61d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:11.615733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:11.617883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:11.632968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862e9475-7a63-4ad2-be32-5f90dbea61d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.636156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.636770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862e9475-7a63-4ad2-be32-5f90dbea61d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.638060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.639307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.639489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862e9475-7a63-4ad2-be32-5f90dbea61d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.640325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862e9475-7a63-4ad2-be32-5f90dbea61d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.642763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862e9475-7a63-4ad2-be32-5f90dbea61d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.642763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862e9475-7a63-4ad2-be32-5f90dbea61d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.643213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.643838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.644133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.687472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.688034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.689090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.689550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lazy-loading 'fault' on Instance uuid d3a56302-112a-470a-94c4-ca2a437560a8 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:11.769710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:11.778588 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1db4f87d-4144-4fc6-b34c-fcbe37818a2a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1304 microversion: 2.1 time: 0.177327 Aug 27 02:45:11.792136 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1428/3172] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:11 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1304 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:11.797462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-70615ae4-eafe-4f2f-91ef-4af17c4aa864 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:11.798750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-70615ae4-eafe-4f2f-91ef-4af17c4aa864 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:11.805645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70615ae4-eafe-4f2f-91ef-4af17c4aa864 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.806215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70615ae4-eafe-4f2f-91ef-4af17c4aa864 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.806667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70615ae4-eafe-4f2f-91ef-4af17c4aa864 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.807461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70615ae4-eafe-4f2f-91ef-4af17c4aa864 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:11.808001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70615ae4-eafe-4f2f-91ef-4af17c4aa864 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:11.808552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70615ae4-eafe-4f2f-91ef-4af17c4aa864 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:11.879614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-862e9475-7a63-4ad2-be32-5f90dbea61d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:11.890032 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-862e9475-7a63-4ad2-be32-5f90dbea61d9 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1306 microversion: 2.1 time: 0.298697 Aug 27 02:45:11.892302 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1745/3173] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:11 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1306 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:11.897864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-76cc7d19-3e38-44d1-9cea-d9241d06125b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'create', calling method: .version_select at 0x7f4d292248b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1673257013", "description": "tempest-description-2033778494"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:12.199149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-70615ae4-eafe-4f2f-91ef-4af17c4aa864 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:12.214827 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-70615ae4-eafe-4f2f-91ef-4af17c4aa864 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1676 microversion: 2.1 time: 0.421408 Aug 27 02:45:12.233028 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1429/3174] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:11 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1676 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:12.247755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:12.248431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:12.262941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:12.263463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:12.267377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:12.268307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:12.268808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:12.269260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:12.490435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:12.516102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:12.521031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:12.525945 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-60fe9c5f-a296-4549-8df0-2d33e7de58aa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.291623 Aug 27 02:45:12.539169 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1430/3175] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:12 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:12.555187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05dc7d56-28e7-4d02-8700-89762e70b631 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:12.556348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-05dc7d56-28e7-4d02-8700-89762e70b631 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:12.570810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05dc7d56-28e7-4d02-8700-89762e70b631 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:12.571866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05dc7d56-28e7-4d02-8700-89762e70b631 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:12.572517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05dc7d56-28e7-4d02-8700-89762e70b631 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:12.573625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05dc7d56-28e7-4d02-8700-89762e70b631 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:12.574322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05dc7d56-28e7-4d02-8700-89762e70b631 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:12.575048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05dc7d56-28e7-4d02-8700-89762e70b631 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:12.832037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-05dc7d56-28e7-4d02-8700-89762e70b631 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:12.842817 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-05dc7d56-28e7-4d02-8700-89762e70b631 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1522 microversion: 2.1 time: 0.294915 Aug 27 02:45:12.844045 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1431/3176] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:12 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:12.853069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-10f219a1-2be6-4fe7-9339-b95915607524 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:12.854147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-10f219a1-2be6-4fe7-9339-b95915607524 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:12.868755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10f219a1-2be6-4fe7-9339-b95915607524 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:12.870187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10f219a1-2be6-4fe7-9339-b95915607524 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:12.872107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10f219a1-2be6-4fe7-9339-b95915607524 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:12.873809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10f219a1-2be6-4fe7-9339-b95915607524 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:12.874611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10f219a1-2be6-4fe7-9339-b95915607524 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:12.876011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10f219a1-2be6-4fe7-9339-b95915607524 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:12.919303 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-76cc7d19-3e38-44d1-9cea-d9241d06125b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.025200 Aug 27 02:45:12.924272 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1746/3177] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:45:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:12.941564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4d3322ea-7f73-4287-95ed-9610698a587a req-e5c6be96-ec47-49ff-a6dc-857b8642857c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f34d83-efc5-4a91-8918-f506cd984323", "name": "network-vif-plugged", "status": "completed", "tag": "aa02dc81-0ff9-479e-85ca-2125fdb2e147"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:12.977359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4d3322ea-7f73-4287-95ed-9610698a587a req-e5c6be96-ec47-49ff-a6dc-857b8642857c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:12.982811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4d3322ea-7f73-4287-95ed-9610698a587a req-e5c6be96-ec47-49ff-a6dc-857b8642857c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:12.984174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4d3322ea-7f73-4287-95ed-9610698a587a req-e5c6be96-ec47-49ff-a6dc-857b8642857c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:13.023128 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4d3322ea-7f73-4287-95ed-9610698a587a req-e5c6be96-ec47-49ff-a6dc-857b8642857c service nova] Creating event network-vif-plugged:aa02dc81-0ff9-479e-85ca-2125fdb2e147 for instance d9f34d83-efc5-4a91-8918-f506cd984323 on n-h1-852084-5 Aug 27 02:45:13.053308 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4d3322ea-7f73-4287-95ed-9610698a587a req-e5c6be96-ec47-49ff-a6dc-857b8642857c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126278 Aug 27 02:45:13.057183 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1747/3178] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:13.077631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:13.085659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:13.099636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:13.100931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:13.102039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:13.103650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:13.104740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:13.106136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:13.175987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:13.177233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:13.179878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:13.181200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lazy-loading 'fault' on Instance uuid d3a56302-112a-470a-94c4-ca2a437560a8 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:13.295339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-10f219a1-2be6-4fe7-9339-b95915607524 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:13.312569 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-10f219a1-2be6-4fe7-9339-b95915607524 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737" status: 200 len: 1515 microversion: 2.1 time: 0.466428 Aug 27 02:45:13.314584 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1432/3179] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:12 2022] GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737 => generated 1515 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:13.335093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ff3f7884-d3a4-42c3-bed0-afe502dd0545 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:13.336214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ff3f7884-d3a4-42c3-bed0-afe502dd0545 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:13.340295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:13.377939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3f7884-d3a4-42c3-bed0-afe502dd0545 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:13.380853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3f7884-d3a4-42c3-bed0-afe502dd0545 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:13.383230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3f7884-d3a4-42c3-bed0-afe502dd0545 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:13.387656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3f7884-d3a4-42c3-bed0-afe502dd0545 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:13.394300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3f7884-d3a4-42c3-bed0-afe502dd0545 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:13.401000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3f7884-d3a4-42c3-bed0-afe502dd0545 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:13.424514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:13.440710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:13.470811 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2ddc7387-ca83-4368-a801-b34d22f0d3d7 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 200 len: 1304 microversion: 2.1 time: 0.404934 Aug 27 02:45:13.482761 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1748/3180] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:13 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 1304 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:13.499123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b86de7e8-eae5-42c7-9d8d-3d7994200f5c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d292a6b80>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:13.782871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ff3f7884-d3a4-42c3-bed0-afe502dd0545 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:13.805780 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ff3f7884-d3a4-42c3-bed0-afe502dd0545 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1306 microversion: 2.1 time: 0.489461 Aug 27 02:45:13.810160 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1433/3181] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:13 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1306 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:13.820691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-191f3ec8-0965-41be-b3d9-c7ce22d6766a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:13.822646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-191f3ec8-0965-41be-b3d9-c7ce22d6766a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:13.836117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-191f3ec8-0965-41be-b3d9-c7ce22d6766a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:13.838263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-191f3ec8-0965-41be-b3d9-c7ce22d6766a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:13.839503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-191f3ec8-0965-41be-b3d9-c7ce22d6766a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:13.841068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-191f3ec8-0965-41be-b3d9-c7ce22d6766a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:13.842552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-191f3ec8-0965-41be-b3d9-c7ce22d6766a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:13.843588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-191f3ec8-0965-41be-b3d9-c7ce22d6766a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:14.135611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-191f3ec8-0965-41be-b3d9-c7ce22d6766a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:14.154761 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-191f3ec8-0965-41be-b3d9-c7ce22d6766a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1659 microversion: 2.1 time: 0.341917 Aug 27 02:45:14.159239 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1434/3182] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:13 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1659 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:14.182757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fa8b918b-de68-408d-8e74-923a23523070 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:14.185752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fa8b918b-de68-408d-8e74-923a23523070 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:14.201193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa8b918b-de68-408d-8e74-923a23523070 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:14.202859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa8b918b-de68-408d-8e74-923a23523070 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:14.204497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa8b918b-de68-408d-8e74-923a23523070 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:14.206089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa8b918b-de68-408d-8e74-923a23523070 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:14.207202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa8b918b-de68-408d-8e74-923a23523070 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:14.208546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa8b918b-de68-408d-8e74-923a23523070 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:14.536047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fa8b918b-de68-408d-8e74-923a23523070 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:14.553069 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fa8b918b-de68-408d-8e74-923a23523070 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216" status: 200 len: 1514 microversion: 2.1 time: 0.391287 Aug 27 02:45:14.554955 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1435/3183] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:14 2022] GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 => generated 1514 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:14.575637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:14.577308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:14.598381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:14.599451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:14.600279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:14.602670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:14.603570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:14.604567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:14.824615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:14.846972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:14.851357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:14.854062 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-16c0f473-fde1-403c-9f13-e79e52c93547 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.297076 Aug 27 02:45:14.890125 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1436/3184] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:14 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:14.900227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-51ab727c-35c8-429f-815a-ec2f2516ec15 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:14.901350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-51ab727c-35c8-429f-815a-ec2f2516ec15 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:14.914827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ab727c-35c8-429f-815a-ec2f2516ec15 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:14.915676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ab727c-35c8-429f-815a-ec2f2516ec15 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:14.916487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ab727c-35c8-429f-815a-ec2f2516ec15 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:14.917857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ab727c-35c8-429f-815a-ec2f2516ec15 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:14.918706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ab727c-35c8-429f-815a-ec2f2516ec15 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:14.919479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ab727c-35c8-429f-815a-ec2f2516ec15 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.076335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-51ab727c-35c8-429f-815a-ec2f2516ec15 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:15.096305 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-51ab727c-35c8-429f-815a-ec2f2516ec15 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1480 microversion: 2.1 time: 0.204318 Aug 27 02:45:15.103668 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1437/3185] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:14 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1480 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:15.119126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2a2c0a95-64b4-4ac6-908e-58ab25f48cfd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:15.119936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2a2c0a95-64b4-4ac6-908e-58ab25f48cfd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:15.132654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a2c0a95-64b4-4ac6-908e-58ab25f48cfd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.133539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a2c0a95-64b4-4ac6-908e-58ab25f48cfd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.134591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a2c0a95-64b4-4ac6-908e-58ab25f48cfd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.135900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a2c0a95-64b4-4ac6-908e-58ab25f48cfd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.136756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a2c0a95-64b4-4ac6-908e-58ab25f48cfd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.137543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a2c0a95-64b4-4ac6-908e-58ab25f48cfd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.358884 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2a2c0a95-64b4-4ac6-908e-58ab25f48cfd tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action" status: 202 len: 0 microversion: 2.1 time: 0.253130 Aug 27 02:45:15.362603 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1438/3186] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:45:15 2022] POST /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:45:15.372242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:15.378949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:15.400363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.403732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.404934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.406754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.408598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.409719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.477793 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] HTTP exception thrown: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:45:15.482383 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b86de7e8-eae5-42c7-9d8d-3d7994200f5c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 2.002381 Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Request method failure captured: Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f HTTP/1.1 Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYMkVU2znMGNqolJJqDa2e5VnAnkfd1fDfn2MAnqFt5te_i-jPpxMYwjTkhE50qC5yWSzRkbNmwcz1bNB7i9tyoVITk7oX3Cr0vdClFdc-HDVtMstCPXedvmZY6tjseacR8HF-Y-PhEdTPkO5P4kpaTMAu6zNKVAI0bVw9Zb_bFiICc Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/195d9a2cd949478ebc0c53dae45f6501"}]}] Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 61a386e483ae4ab3a33f3a40d5bf41cf Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '893e335c-913a-479a-9ee8-f61fc9a3b36f'} Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:15.484070 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:15.493394 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:45:15.493394 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:15.493394 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:15.493394 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:15.493394 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:15.493394 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:15.493394 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:15.493394 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:15.493394 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:15.493394 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:45:15.493394 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:15.497548 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1749/3187] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:45:13 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:15.497769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Returning 404 to user: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:15.497947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:15.499881 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e19238cb-469b-4905-a65d-3a259f7ec859 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "DELETE /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 404 len: 111 microversion: 2.20 time: 0.131380 Aug 27 02:45:15.500484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: d3a56302-112a-470a-94c4-ca2a437560a8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:15.501691 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1439/3188] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:45:15 2022] DELETE /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:15.512177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-57c407eb-2403-43e2-b224-e378bf1765ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:15.514545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-57c407eb-2403-43e2-b224-e378bf1765ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:15.518244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.518894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.519506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.520394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.526614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.527292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.529025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c407eb-2403-43e2-b224-e378bf1765ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.530142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c407eb-2403-43e2-b224-e378bf1765ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.533394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c407eb-2403-43e2-b224-e378bf1765ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.535233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c407eb-2403-43e2-b224-e378bf1765ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.536338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c407eb-2403-43e2-b224-e378bf1765ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.537368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c407eb-2403-43e2-b224-e378bf1765ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.577287 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] HTTP exception thrown: Instance d3a56302-112a-470a-94c4-ca2a437560a8 could not be found. Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Request method failure captured: Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 HTTP/1.1 Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYShFc2ldrr4SLwZDhAYhBPbMMoW1HD3KxSVYuMLOf0th0SNv_rYy06_pO-ewjCNwW1-eAoqtMvtircBF1SIvn1UXtzFNgFZ8POhdwdholw7w5rTxKRmBxf5hRknIjBNk5OM9EGx0uIJQX3nZhL1D7RyEguh7HwaNCUoZfRt6eo2L0A Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c55251a7822148a8845f898a36865376 Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdminTestJSON-1477970876 Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c55251a7822148a8845f898a36865376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c55251a7822148a8845f898a36865376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c55251a7822148a8845f898a36865376"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c55251a7822148a8845f898a36865376"}]}] Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdminTestJSON-1477970876 Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c55251a7822148a8845f898a36865376 Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdminTestJSON-1477970876 Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdminTestJSON-1477970876-project Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 71e3477c3fff48ab8f1dc3079bd7453f Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdminTestJSON-1477970876-project Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d3a56302-112a-470a-94c4-ca2a437560a8 could not be found. Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd3a56302-112a-470a-94c4-ca2a437560a8'} Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3a56302-112a-470a-94c4-ca2a437560a8 could not be found. Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3a56302-112a-470a-94c4-ca2a437560a8 could not be found. Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:15.581438 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:15.590354 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:15.590354 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:15.590354 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:15.590354 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:15.590354 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:15.590354 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3a56302-112a-470a-94c4-ca2a437560a8 could not be found. Aug 27 02:45:15.590354 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:15.604468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Returning 404 to user: Instance d3a56302-112a-470a-94c4-ca2a437560a8 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:15.606767 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-947aa704-5103-4230-90a8-c98a21fad11c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8" status: 404 len: 111 microversion: 2.1 time: 0.118662 Aug 27 02:45:15.614831 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1750/3189] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:15 2022] GET /compute/v2.1/servers/d3a56302-112a-470a-94c4-ca2a437560a8 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:15.632254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b843ba7c-7d48-48da-b1d8-3c9f3e101b7d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:15.637928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b843ba7c-7d48-48da-b1d8-3c9f3e101b7d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:15.645243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-57c407eb-2403-43e2-b224-e378bf1765ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:15.651848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b843ba7c-7d48-48da-b1d8-3c9f3e101b7d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.652730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b843ba7c-7d48-48da-b1d8-3c9f3e101b7d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.659349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b843ba7c-7d48-48da-b1d8-3c9f3e101b7d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.665101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b843ba7c-7d48-48da-b1d8-3c9f3e101b7d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.678018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b843ba7c-7d48-48da-b1d8-3c9f3e101b7d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.680174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b843ba7c-7d48-48da-b1d8-3c9f3e101b7d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.875312 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-57c407eb-2403-43e2-b224-e378bf1765ab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216" status: 204 len: 0 microversion: 2.1 time: 0.362368 Aug 27 02:45:15.876983 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1440/3190] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:15 2022] DELETE /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:15.886097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-bb0d61f0-7d1c-4a82-ae9f-fb9ed8c12bfd req-07b642e1-5c09-40e3-bbf6-9c7b5852ce2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f", "name": "network-vif-deleted", "tag": "96d739bd-0e58-4047-8369-dc1d8b9f5043"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:15.909955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bb0d61f0-7d1c-4a82-ae9f-fb9ed8c12bfd req-07b642e1-5c09-40e3-bbf6-9c7b5852ce2b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.912161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bb0d61f0-7d1c-4a82-ae9f-fb9ed8c12bfd req-07b642e1-5c09-40e3-bbf6-9c7b5852ce2b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.914241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bb0d61f0-7d1c-4a82-ae9f-fb9ed8c12bfd req-07b642e1-5c09-40e3-bbf6-9c7b5852ce2b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.931996 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-bb0d61f0-7d1c-4a82-ae9f-fb9ed8c12bfd req-07b642e1-5c09-40e3-bbf6-9c7b5852ce2b service nova] Creating event network-vif-deleted:96d739bd-0e58-4047-8369-dc1d8b9f5043 for instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f on n-h2-852084-5 Aug 27 02:45:15.937906 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-bb0d61f0-7d1c-4a82-ae9f-fb9ed8c12bfd req-07b642e1-5c09-40e3-bbf6-9c7b5852ce2b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059144 Aug 27 02:45:15.939543 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1441/3191] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:15.945743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8574769d-3bd7-43c4-8c86-0fc2035f48c5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:15.946596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8574769d-3bd7-43c4-8c86-0fc2035f48c5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:15.956139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8574769d-3bd7-43c4-8c86-0fc2035f48c5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.956806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8574769d-3bd7-43c4-8c86-0fc2035f48c5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.957372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8574769d-3bd7-43c4-8c86-0fc2035f48c5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.959019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8574769d-3bd7-43c4-8c86-0fc2035f48c5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:15.959644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8574769d-3bd7-43c4-8c86-0fc2035f48c5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:15.960171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8574769d-3bd7-43c4-8c86-0fc2035f48c5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:15.976526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b843ba7c-7d48-48da-b1d8-3c9f3e101b7d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:15.987304 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b843ba7c-7d48-48da-b1d8-3c9f3e101b7d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1306 microversion: 2.1 time: 0.370592 Aug 27 02:45:15.988678 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1751/3192] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:15 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1306 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:15.994881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-491b844f-d03f-4686-b8a3-095ea7fdcca9 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d291daaf0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:16.215433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8574769d-3bd7-43c4-8c86-0fc2035f48c5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:16.231913 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8574769d-3bd7-43c4-8c86-0fc2035f48c5 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1665 microversion: 2.1 time: 0.290361 Aug 27 02:45:16.234265 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1442/3193] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:15 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1665 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:16.245083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:16.246410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] [instance: 893e335c-913a-479a-9ee8-f61fc9a3b36f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:16.259103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:16.260231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:16.261202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:16.263499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:16.264834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:16.265929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:16.298672 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] HTTP exception thrown: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Request method failure captured: Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f HTTP/1.1 Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYMkVU2znMGNqolJJqDa2e5VnAnkfd1fDfn2MAnqFt5te_i-jPpxMYwjTkhE50qC5yWSzRkbNmwcz1bNB7i9tyoVITk7oX3Cr0vdClFdc-HDVtMstCPXedvmZY6tjseacR8HF-Y-PhEdTPkO5P4kpaTMAu6zNKVAI0bVw9Zb_bFiICc Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Openstack-Nova-Api-Version: 2.20 Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/195d9a2cd949478ebc0c53dae45f6501"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/195d9a2cd949478ebc0c53dae45f6501"}]}] Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 195d9a2cd949478ebc0c53dae45f6501 Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1260171882 Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 61a386e483ae4ab3a33f3a40d5bf41cf Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1260171882-project Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '893e335c-913a-479a-9ee8-f61fc9a3b36f'} Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.302919 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:16.307438 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.307438 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:16.307438 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:16.307438 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:16.307438 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:16.307438 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:16.307438 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. Aug 27 02:45:16.307438 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.310107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] Returning 404 to user: Instance 893e335c-913a-479a-9ee8-f61fc9a3b36f could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:16.311813 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da69bff1-b797-482c-a46e-d6c87a26bc37 tempest-AttachVolumeShelveTestJSON-1260171882 tempest-AttachVolumeShelveTestJSON-1260171882-project] 10.222.0.99 "GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f" status: 404 len: 111 microversion: 2.20 time: 0.075134 Aug 27 02:45:16.316825 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1443/3194] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:16 2022] GET /compute/v2.1/servers/893e335c-913a-479a-9ee8-f61fc9a3b36f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:16.322869 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-491b844f-d03f-4686-b8a3-095ea7fdcca9 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/37fa5f83-a75c-49d8-a9f4-e86f3838e805" status: 202 len: 0 microversion: 2.1 time: 0.332789 Aug 27 02:45:16.323086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b0d44f3f-72bd-4689-a430-e8c99eaf8f01 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:16.324332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b0d44f3f-72bd-4689-a430-e8c99eaf8f01 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:16.326594 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1752/3195] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:45:15 2022] DELETE /compute/v2.1/os-security-groups/37fa5f83-a75c-49d8-a9f4-e86f3838e805 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:45:16.332740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95018bec-7c83-4482-ad11-bd4bb2951f78 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:16.343521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-95018bec-7c83-4482-ad11-bd4bb2951f78 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:16.349784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0d44f3f-72bd-4689-a430-e8c99eaf8f01 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:16.350857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0d44f3f-72bd-4689-a430-e8c99eaf8f01 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:16.351831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0d44f3f-72bd-4689-a430-e8c99eaf8f01 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:16.353347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0d44f3f-72bd-4689-a430-e8c99eaf8f01 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:16.354780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0d44f3f-72bd-4689-a430-e8c99eaf8f01 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:16.355721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0d44f3f-72bd-4689-a430-e8c99eaf8f01 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:16.357053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95018bec-7c83-4482-ad11-bd4bb2951f78 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:16.359162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95018bec-7c83-4482-ad11-bd4bb2951f78 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:16.360496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95018bec-7c83-4482-ad11-bd4bb2951f78 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:16.364727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95018bec-7c83-4482-ad11-bd4bb2951f78 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:16.377180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95018bec-7c83-4482-ad11-bd4bb2951f78 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:16.377715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95018bec-7c83-4482-ad11-bd4bb2951f78 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:16.423922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b0d44f3f-72bd-4689-a430-e8c99eaf8f01 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:16.634402 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b0d44f3f-72bd-4689-a430-e8c99eaf8f01 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 204 len: 0 microversion: 2.1 time: 0.317658 Aug 27 02:45:16.638088 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1444/3196] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:16 2022] DELETE /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:16.651480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:16.652776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:16.664983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:16.666122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:16.666808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:16.668861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:16.668861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:16.669621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:16.774391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-95018bec-7c83-4482-ad11-bd4bb2951f78 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:16.788441 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-95018bec-7c83-4482-ad11-bd4bb2951f78 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216" status: 200 len: 1520 microversion: 2.1 time: 0.460070 Aug 27 02:45:16.806435 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1753/3197] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:16 2022] GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 => generated 1520 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:16.820311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:16.827503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:16.829035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:16.841744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:16.842980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:16.844050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:16.845719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:16.847125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:16.848208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:16.856121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:16.859326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:16.865033 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b4a6ebe5-5fb6-445f-b23c-0cca29d38c4f tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.221772 Aug 27 02:45:16.872622 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1445/3198] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:16 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:16.892070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-03707011-2c67-4013-af0f-b38408b7c6b6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d296cde50>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:16.918210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:16.919503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:16.920572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:16.921642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lazy-loading 'fault' on Instance uuid f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:16.965907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-03707011-2c67-4013-af0f-b38408b7c6b6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:45:16.967658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-03707011-2c67-4013-af0f-b38408b7c6b6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Neutron security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 not found {{(pid=122487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:45:16.968323 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-03707011-2c67-4013-af0f-b38408b7c6b6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:45:16.968323 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-fb8a4fdd-21c8-4678-ab9d-737e958ae657'] Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-03707011-2c67-4013-af0f-b38408b7c6b6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-security-groups/37fa5f83-a75c-49d8-a9f4-e86f3838e805 HTTP/1.1 Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-fb8a4fdd-21c8-4678-ab9d-737e958ae657'] Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '37fa5f83-a75c-49d8-a9f4-e86f3838e805'} Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:45:16.972699 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb8a4fdd-21c8-4678-ab9d-737e958ae657'] Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb8a4fdd-21c8-4678-ab9d-737e958ae657'] Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb8a4fdd-21c8-4678-ab9d-737e958ae657'] Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb8a4fdd-21c8-4678-ab9d-737e958ae657'] Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-03707011-2c67-4013-af0f-b38408b7c6b6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-fb8a4fdd-21c8-4678-ab9d-737e958ae657'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:16.981788 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-03707011-2c67-4013-af0f-b38408b7c6b6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups/37fa5f83-a75c-49d8-a9f4-e86f3838e805" status: 404 len: 194 microversion: 2.1 time: 0.101139 Aug 27 02:45:16.989857 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1446/3199] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:45:16 2022] GET /compute/v2.1/os-security-groups/37fa5f83-a75c-49d8-a9f4-e86f3838e805 => generated 194 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:16.993720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c21635f9-025f-4351-8cbd-3aa5dd97ff0c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:16.993965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c21635f9-025f-4351-8cbd-3aa5dd97ff0c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:17.007192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21635f9-025f-4351-8cbd-3aa5dd97ff0c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:17.008071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21635f9-025f-4351-8cbd-3aa5dd97ff0c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:17.008928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21635f9-025f-4351-8cbd-3aa5dd97ff0c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:17.010269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21635f9-025f-4351-8cbd-3aa5dd97ff0c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:17.011100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21635f9-025f-4351-8cbd-3aa5dd97ff0c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:17.012078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21635f9-025f-4351-8cbd-3aa5dd97ff0c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:17.110435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:17.145600 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4374899d-5323-4eb1-8713-3877a10c06a6 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1312 microversion: 2.1 time: 0.336479 Aug 27 02:45:17.148471 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1754/3200] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:16 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1312 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:17.165413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc8632af-6dc9-467c-89c8-d0a1e3bd47c6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d29224550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:17.370548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c21635f9-025f-4351-8cbd-3aa5dd97ff0c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:17.404135 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c21635f9-025f-4351-8cbd-3aa5dd97ff0c tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1469 microversion: 2.1 time: 0.419791 Aug 27 02:45:17.406268 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1447/3201] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:16 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1469 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:17.423995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-679f2454-909f-4067-a0a3-be729ae87d6c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:17.427231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-679f2454-909f-4067-a0a3-be729ae87d6c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:17.446386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-679f2454-909f-4067-a0a3-be729ae87d6c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:17.453727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-679f2454-909f-4067-a0a3-be729ae87d6c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:17.455073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-679f2454-909f-4067-a0a3-be729ae87d6c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:17.456079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-679f2454-909f-4067-a0a3-be729ae87d6c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:17.456743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-679f2454-909f-4067-a0a3-be729ae87d6c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:17.457356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-679f2454-909f-4067-a0a3-be729ae87d6c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:17.490490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:17.742254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-679f2454-909f-4067-a0a3-be729ae87d6c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:17.761170 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-679f2454-909f-4067-a0a3-be729ae87d6c tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1486 microversion: 2.1 time: 0.349387 Aug 27 02:45:17.762449 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1448/3202] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:17 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1486 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:17.786057 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fc8632af-6dc9-467c-89c8-d0a1e3bd47c6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/1843e7fe-0338-456b-a473-647616f6b1fb" status: 202 len: 0 microversion: 2.1 time: 0.635803 Aug 27 02:45:17.787360 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1755/3203] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:45:17 2022] DELETE /compute/v2.1/os-security-groups/1843e7fe-0338-456b-a473-647616f6b1fb => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:45:17.787812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9575770f-f8b8-402e-90e2-e5be7306f6cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:17.789284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9575770f-f8b8-402e-90e2-e5be7306f6cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:17.793318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-593071bd-0760-414f-a1c6-39a1626c04ee tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-604433217"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:17.796258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-593071bd-0760-414f-a1c6-39a1626c04ee tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:17.804321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9575770f-f8b8-402e-90e2-e5be7306f6cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:17.805469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9575770f-f8b8-402e-90e2-e5be7306f6cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:17.806098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9575770f-f8b8-402e-90e2-e5be7306f6cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:17.807560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9575770f-f8b8-402e-90e2-e5be7306f6cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:17.808623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9575770f-f8b8-402e-90e2-e5be7306f6cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:17.809700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9575770f-f8b8-402e-90e2-e5be7306f6cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:17.817763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-593071bd-0760-414f-a1c6-39a1626c04ee tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:17.818679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-593071bd-0760-414f-a1c6-39a1626c04ee tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:17.819329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-593071bd-0760-414f-a1c6-39a1626c04ee tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:17.820303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-593071bd-0760-414f-a1c6-39a1626c04ee tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:17.820798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-593071bd-0760-414f-a1c6-39a1626c04ee tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:17.821862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-593071bd-0760-414f-a1c6-39a1626c04ee tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:18.094466 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-593071bd-0760-414f-a1c6-39a1626c04ee tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "POST /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323/action" status: 202 len: 0 microversion: 2.1 time: 0.304679 Aug 27 02:45:18.096236 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1756/3204] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:45:17 2022] POST /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:45:18.106352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9575770f-f8b8-402e-90e2-e5be7306f6cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:18.107117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3d23efaf-d3a8-4c9b-a75b-64f72ef80c91 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d29216820>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:18.116818 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9575770f-f8b8-402e-90e2-e5be7306f6cb tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1665 microversion: 2.1 time: 0.352170 Aug 27 02:45:18.130276 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1449/3205] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:17 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1665 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:18.138729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ac7d8c17-49cb-4918-9419-5198781d0687 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:18.139369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac7d8c17-49cb-4918-9419-5198781d0687 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:18.147139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac7d8c17-49cb-4918-9419-5198781d0687 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:18.147644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac7d8c17-49cb-4918-9419-5198781d0687 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:18.148092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac7d8c17-49cb-4918-9419-5198781d0687 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:18.148817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac7d8c17-49cb-4918-9419-5198781d0687 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:18.149290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac7d8c17-49cb-4918-9419-5198781d0687 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:18.149755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac7d8c17-49cb-4918-9419-5198781d0687 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:18.190796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG neutronclient.v2_0.client [None req-3d23efaf-d3a8-4c9b-a75b-64f72ef80c91 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist", "detail": ""}} {{(pid=122488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:45:18.192062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.security_group_api [None req-3d23efaf-d3a8-4c9b-a75b-64f72ef80c91 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Neutron security group 1843e7fe-0338-456b-a473-647616f6b1fb not found {{(pid=122488) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:45:18.193181 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3d23efaf-d3a8-4c9b-a75b-64f72ef80c91 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:45:18.193181 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-cf9817dc-1721-4286-ade2-002423a0c356'] Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3d23efaf-d3a8-4c9b-a75b-64f72ef80c91 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-security-groups/1843e7fe-0338-456b-a473-647616f6b1fb HTTP/1.1 Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: exception: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-cf9817dc-1721-4286-ade2-002423a0c356'] Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '1843e7fe-0338-456b-a473-647616f6b1fb'} Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:45:18.198006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf9817dc-1721-4286-ade2-002423a0c356'] Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf9817dc-1721-4286-ade2-002423a0c356'] Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf9817dc-1721-4286-ade2-002423a0c356'] Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf9817dc-1721-4286-ade2-002423a0c356'] Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3d23efaf-d3a8-4c9b-a75b-64f72ef80c91 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-cf9817dc-1721-4286-ade2-002423a0c356'] {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:18.201850 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3d23efaf-d3a8-4c9b-a75b-64f72ef80c91 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups/1843e7fe-0338-456b-a473-647616f6b1fb" status: 404 len: 194 microversion: 2.1 time: 0.103120 Aug 27 02:45:18.207625 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1757/3206] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:45:18 2022] GET /compute/v2.1/os-security-groups/1843e7fe-0338-456b-a473-647616f6b1fb => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:18.216095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:18.217590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:18.232535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:18.233282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:18.233931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:18.235035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:18.236478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:18.237232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:18.334442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:18.351589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:18.354509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:18.356983 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-36acb241-89f7-4d86-9db4-88f30b94eda6 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.147352 Aug 27 02:45:18.358139 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1758/3207] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:18 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:18.366666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f51c480d-221e-4e55-9cff-3ff75a3346fc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2929b430>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:18.417262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac7d8c17-49cb-4918-9419-5198781d0687 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:18.431454 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ac7d8c17-49cb-4918-9419-5198781d0687 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216" status: 200 len: 1520 microversion: 2.1 time: 0.299659 Aug 27 02:45:18.433512 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1450/3208] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:18 2022] GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:18.458894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:18.460621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:18.472459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:18.473771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:18.475085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:18.477067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:18.478209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:18.479381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:18.493070 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f51c480d-221e-4e55-9cff-3ff75a3346fc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2" status: 200 len: 1413 microversion: 2.1 time: 0.130953 Aug 27 02:45:18.494620 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1759/3209] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:45:18 2022] GET /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2 => generated 1413 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:18.503826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e9438c00-8dd2-4fdc-bb03-cbb93fbd528b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2921be50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:18.558791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:18.560022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:18.561078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:18.564677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lazy-loading 'fault' on Instance uuid f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:18.670645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51b3d953421c409c9edd54287dcd11db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956a66be18bb4f9e996c8e16bcf23bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:18.721392 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4a24a795-d74f-4ebc-8011-c61b5090888b tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 200 len: 1312 microversion: 2.1 time: 0.280360 Aug 27 02:45:18.723220 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1451/3210] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:18 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 1312 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:18.740136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8d84973d-4520-4b8e-8fed-46fa0b862131 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:18.741452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8d84973d-4520-4b8e-8fed-46fa0b862131 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:18.767222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d84973d-4520-4b8e-8fed-46fa0b862131 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:18.767705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d84973d-4520-4b8e-8fed-46fa0b862131 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:18.769775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d84973d-4520-4b8e-8fed-46fa0b862131 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:18.770053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d84973d-4520-4b8e-8fed-46fa0b862131 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:18.770933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d84973d-4520-4b8e-8fed-46fa0b862131 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:18.772368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d84973d-4520-4b8e-8fed-46fa0b862131 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:19.025757 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e9438c00-8dd2-4fdc-bb03-cbb93fbd528b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/8b5834d2-ba66-4d6c-93f0-e64c8c779ee9" status: 202 len: 0 microversion: 2.1 time: 0.528990 Aug 27 02:45:19.031679 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1760/3211] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:45:18 2022] DELETE /compute/v2.1/os-security-groups/8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:45:19.052379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3278160d-a2bf-4c7e-b5e4-98222b0710bb tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d291cd820>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:19.175927 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3278160d-a2bf-4c7e-b5e4-98222b0710bb tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2" status: 200 len: 1413 microversion: 2.1 time: 0.146391 Aug 27 02:45:19.177759 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1761/3212] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:45:19 2022] GET /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2 => generated 1413 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:19.194847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cae399c0-dd05-40a6-b744-658f65746636 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d292a3ca0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:19.265705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8d84973d-4520-4b8e-8fed-46fa0b862131 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:19.305787 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8d84973d-4520-4b8e-8fed-46fa0b862131 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1469 microversion: 2.1 time: 0.579656 Aug 27 02:45:19.307992 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1452/3213] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:18 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1469 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:19.344096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9262908e-8880-4228-98fc-7af3966c295f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:19.345504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9262908e-8880-4228-98fc-7af3966c295f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:19.353143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9262908e-8880-4228-98fc-7af3966c295f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:19.353643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9262908e-8880-4228-98fc-7af3966c295f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:19.354133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9262908e-8880-4228-98fc-7af3966c295f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:19.354894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9262908e-8880-4228-98fc-7af3966c295f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:19.356304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9262908e-8880-4228-98fc-7af3966c295f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:19.357473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9262908e-8880-4228-98fc-7af3966c295f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:19.514525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG neutronclient.v2_0.client [None req-cae399c0-dd05-40a6-b744-658f65746636 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist", "detail": ""}} {{(pid=122488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:45:19.516107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.security_group_api [None req-cae399c0-dd05-40a6-b744-658f65746636 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Neutron security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 not found {{(pid=122488) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:45:19.517458 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-cae399c0-dd05-40a6-b744-658f65746636 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:45:19.517458 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-9cad855e-c4ac-4de1-8a5c-4248a27fb173'] Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cae399c0-dd05-40a6-b744-658f65746636 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-security-groups/8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 HTTP/1.1 Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: exception: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-9cad855e-c4ac-4de1-8a5c-4248a27fb173'] Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '8b5834d2-ba66-4d6c-93f0-e64c8c779ee9'} Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:45:19.521805 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cad855e-c4ac-4de1-8a5c-4248a27fb173'] Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cad855e-c4ac-4de1-8a5c-4248a27fb173'] Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cad855e-c4ac-4de1-8a5c-4248a27fb173'] Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9cad855e-c4ac-4de1-8a5c-4248a27fb173'] Aug 27 02:45:19.529386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:19.543678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cae399c0-dd05-40a6-b744-658f65746636 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:45:19.543678 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-9cad855e-c4ac-4de1-8a5c-4248a27fb173'] {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:19.543678 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cae399c0-dd05-40a6-b744-658f65746636 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups/8b5834d2-ba66-4d6c-93f0-e64c8c779ee9" status: 404 len: 194 microversion: 2.1 time: 0.352292 Aug 27 02:45:19.545122 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1762/3214] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:45:19 2022] GET /compute/v2.1/os-security-groups/8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 => generated 194 bytes in 367 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:19.555243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c9cc5f3b-049e-43e9-932d-e0d82fe7faf8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d291cd700>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:19.709746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9262908e-8880-4228-98fc-7af3966c295f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:19.725543 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9262908e-8880-4228-98fc-7af3966c295f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.399110 Aug 27 02:45:19.728967 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1453/3215] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:19 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:19.767456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:19.769330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:19.787124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:19.787973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:19.788596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:19.789480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:19.790083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:19.790561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:19.884030 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c9cc5f3b-049e-43e9-932d-e0d82fe7faf8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2" status: 204 len: 0 microversion: 2.1 time: 0.336439 Aug 27 02:45:19.888012 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1763/3216] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:19 2022] DELETE /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:19.900983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4419905e-d997-42e6-a7f8-873c946db997 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:19.902792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4419905e-d997-42e6-a7f8-873c946db997 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:19.927192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4419905e-d997-42e6-a7f8-873c946db997 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:19.928399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4419905e-d997-42e6-a7f8-873c946db997 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:19.929543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4419905e-d997-42e6-a7f8-873c946db997 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:19.932217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4419905e-d997-42e6-a7f8-873c946db997 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:19.936311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4419905e-d997-42e6-a7f8-873c946db997 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:19.937611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4419905e-d997-42e6-a7f8-873c946db997 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:19.967149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:19.985447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:19.987488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:19.988776 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7fc150d-508d-4b3c-97fe-44b3622efb41 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.258309 Aug 27 02:45:19.989368 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1454/3217] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:19 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:20.003085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2cd914cf-0a53-42ee-8625-86f1942194e6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d296cd310>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:20.393551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4419905e-d997-42e6-a7f8-873c946db997 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:20.411142 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4419905e-d997-42e6-a7f8-873c946db997 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216" status: 200 len: 1520 microversion: 2.1 time: 0.519552 Aug 27 02:45:20.415673 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1764/3218] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:19 2022] GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 => generated 1520 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:20.436315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:20.436315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] [instance: f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:20.444231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.444231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.444231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:20.444231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.444231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.444231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:20.468080 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] HTTP exception thrown: Instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f could not be found. Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Request method failure captured: Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f HTTP/1.1 Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYO1ujqvCLBmMVe65fdN2J5dIO7-HUqI3Js5YGestJSXRt-3jM1W-KzE8NnECJ1ryJNn-_nCYfE1drEJmtuv9wrerAqLuupZmy6gs9vrBdbjKq9YdwsxzP7b-WGUVBzCCEf1u8fLpuDoBEeADCldZf84VX9NU_VzQjP9Knt2NuVZyVU Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/956a66be18bb4f9e996c8e16bcf23bab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/956a66be18bb4f9e996c8e16bcf23bab"}]}] Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 956a66be18bb4f9e996c8e16bcf23bab Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714147338 Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 51b3d953421c409c9edd54287dcd11db Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714147338-project Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f could not be found. Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f'} Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f could not be found. Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f could not be found. Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:20.472003 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:20.482756 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:20.482756 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:20.482756 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:20.482756 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:20.482756 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:20.482756 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:20.482756 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f could not be found. Aug 27 02:45:20.482756 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:20.482756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] Returning 404 to user: Instance f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:20.482756 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e6b41c0f-e2c9-4999-9479-8d45d590ab49 tempest-ServerRescueNegativeTestJSON-714147338 tempest-ServerRescueNegativeTestJSON-714147338-project] 10.222.0.99 "GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f" status: 404 len: 111 microversion: 2.1 time: 0.057522 Aug 27 02:45:20.482756 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1765/3219] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:20 2022] GET /compute/v2.1/servers/f0115ca9-6df0-42a1-9c8c-a5bf92ca8c5f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:20.491577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6769a33d-0d0f-4aee-91fb-0358c9bed173 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:20.492821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6769a33d-0d0f-4aee-91fb-0358c9bed173 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:20.505341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6769a33d-0d0f-4aee-91fb-0358c9bed173 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.506292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6769a33d-0d0f-4aee-91fb-0358c9bed173 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.507097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6769a33d-0d0f-4aee-91fb-0358c9bed173 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:20.508394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6769a33d-0d0f-4aee-91fb-0358c9bed173 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:20.509541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6769a33d-0d0f-4aee-91fb-0358c9bed173 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:20.510360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6769a33d-0d0f-4aee-91fb-0358c9bed173 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.363266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6769a33d-0d0f-4aee-91fb-0358c9bed173 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:21.384990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:21.399798 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6769a33d-0d0f-4aee-91fb-0358c9bed173 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1668 microversion: 2.1 time: 0.916176 Aug 27 02:45:21.414740 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1766/3220] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:20 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1668 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:21.418568 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2cd914cf-0a53-42ee-8625-86f1942194e6 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.423391 Aug 27 02:45:21.421396 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1455/3221] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:45:19 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:21.452122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2fd8188-3509-4d96-9c2d-64c84f2f4d47 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d291da160>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:21.465892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:21.476348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:21.497736 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f2fd8188-3509-4d96-9c2d-64c84f2f4d47 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Image not found. Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2fd8188-3509-4d96-9c2d-64c84f2f4d47 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2 HTTP/1.1 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '7faa9425-3341-43aa-8f19-cbbac5bea7a2'} Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7faa9425-3341-43aa-8f19-cbbac5bea7a2 Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:45:21.502324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7faa9425-3341-43aa-8f19-cbbac5bea7a2 could not be found. Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2fd8188-3509-4d96-9c2d-64c84f2f4d47 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:21.510135 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f2fd8188-3509-4d96-9c2d-64c84f2f4d47 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2" status: 404 len: 62 microversion: 2.1 time: 0.088563 Aug 27 02:45:21.522545 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1767/3222] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:45:21 2022] GET /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2 => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:45:21.524717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-8a1178e7-07a5-499e-8eca-ab8f5f2f6aa6 req-79459a5a-d832-4250-83fd-94dc1b458ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd22e9f-968a-459e-bfcc-45c00c95f797", "name": "network-vif-deleted", "tag": "5d8f7762-bde9-43e7-ad18-946fc4f2f177"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:21.565486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.571895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.573618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.580360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.581328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.582194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8a1178e7-07a5-499e-8eca-ab8f5f2f6aa6 req-79459a5a-d832-4250-83fd-94dc1b458ce6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.583571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.585322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8a1178e7-07a5-499e-8eca-ab8f5f2f6aa6 req-79459a5a-d832-4250-83fd-94dc1b458ce6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.586980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8a1178e7-07a5-499e-8eca-ab8f5f2f6aa6 req-79459a5a-d832-4250-83fd-94dc1b458ce6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.634316 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-8a1178e7-07a5-499e-8eca-ab8f5f2f6aa6 req-79459a5a-d832-4250-83fd-94dc1b458ce6 service nova] Creating event network-vif-deleted:5d8f7762-bde9-43e7-ad18-946fc4f2f177 for instance 9dd22e9f-968a-459e-bfcc-45c00c95f797 on n-h2-852084-5 Aug 27 02:45:21.660479 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-8a1178e7-07a5-499e-8eca-ab8f5f2f6aa6 req-79459a5a-d832-4250-83fd-94dc1b458ce6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139535 Aug 27 02:45:21.662423 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1768/3223] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:21.668934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:21.679324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:21.696145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.698230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.700393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.703257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.704134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.706903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.869357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:21.891112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:21.892447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:21.894364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lazy-loading 'fault' on Instance uuid 9dd22e9f-968a-459e-bfcc-45c00c95f797 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:22.211363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:22.228940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:22.258103 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a5438047-6526-4ef7-a140-b2c22f97cffe tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 200 len: 1304 microversion: 2.1 time: 0.825974 Aug 27 02:45:22.261059 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1456/3224] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:21 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 1304 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:22.279528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:22.280807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:22.288200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:22.290003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:22.291527 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-50305191-06e8-45ed-bf5b-a5a64a5435ff tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.627311 Aug 27 02:45:22.292213 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1769/3225] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:21 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:22.311308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6cfaed2-61df-4364-b48b-f41d182eab3d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'create', calling method: .version_select at 0x7f4d292a6160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1353231473", "description": "tempest-description-2024540525"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:22.321784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:22.334999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:22.336220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:22.348554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:22.350227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:22.351176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:22.520770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:22.543349 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.compute.api [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Working on deleting snapshot 8f723f9b-8dd8-4931-a707-34aeed88f9d4 from shelved instance... Aug 27 02:45:23.592918 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6cfaed2-61df-4364-b48b-f41d182eab3d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.299190 Aug 27 02:45:23.595680 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1770/3226] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:45:22 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:23.626745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:23.628512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:23.658396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.660000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.675306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:23.685735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.687169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.689612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:23.769774 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] HTTP exception thrown: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Request method failure captured: Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 HTTP/1.1 Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYUB3Cra_5HCjso70Z1Ngmxfo9Cop4N5v6fOOcQeGuRdusuY4GFYbgWURM5dqRX_a55Vv3JgVZs01ykT_F0OvZ5XwW351OKqDTSTJweJiqiVcmVwedgfbaN24sEYfMtCLgnlKOvSocnPaWJRZPOOfhWcXHxIWcrAHotQqpH3qxpwiZo Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b3fc3c2d04bf44b49a932c2eae27cf04"}]}] Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 1418fca23c99496a958fffe6cc021689 Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '1e2dec37-0d3d-4970-ae03-cc5bbbdd5216'} Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:23.776945 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:23.791445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:23.791445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:23.791445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:23.791445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:23.791445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:23.791445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:23.791445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:23.791445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:23.813963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Returning 404 to user: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:23.815985 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-835977c9-7d02-4b42-8b18-2fb986b31465 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216" status: 404 len: 111 microversion: 2.1 time: 0.218004 Aug 27 02:45:23.819757 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1771/3227] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:23 2022] GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:23.873641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2fe5f635-ba09-4cba-89b1-7cc240c55c5a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:23.875243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2fe5f635-ba09-4cba-89b1-7cc240c55c5a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:23.905317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fe5f635-ba09-4cba-89b1-7cc240c55c5a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.908130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fe5f635-ba09-4cba-89b1-7cc240c55c5a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.913054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fe5f635-ba09-4cba-89b1-7cc240c55c5a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:23.915010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fe5f635-ba09-4cba-89b1-7cc240c55c5a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:23.916140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fe5f635-ba09-4cba-89b1-7cc240c55c5a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:23.922773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fe5f635-ba09-4cba-89b1-7cc240c55c5a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:24.412416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Doing local delete in cell 8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) {{(pid=122487) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 02:45:24.424793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:24.426011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:24.427055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:24.428138 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.compute.api [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 02:45:24.447939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] deallocate_for_instance() {{(pid=122487) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 02:45:24.708753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2fe5f635-ba09-4cba-89b1-7cc240c55c5a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:24.739347 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2fe5f635-ba09-4cba-89b1-7cc240c55c5a tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1486 microversion: 2.1 time: 0.910711 Aug 27 02:45:24.744407 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1772/3228] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:23 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1486 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:24.768470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:24.769797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 9dd22e9f-968a-459e-bfcc-45c00c95f797] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:24.786680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:24.787740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:24.788389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:24.789516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:24.790238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:24.790954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:24.817987 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] HTTP exception thrown: Instance 9dd22e9f-968a-459e-bfcc-45c00c95f797 could not be found. Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Request method failure captured: Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 HTTP/1.1 Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYShFc2ldrr4SLwZDhAYhBPbMMoW1HD3KxSVYuMLOf0th0SNv_rYy06_pO-ewjCNwW1-eAoqtMvtircBF1SIvn1UXtzFNgFZ8POhdwdholw7w5rTxKRmBxf5hRknIjBNk5OM9EGx0uIJQX3nZhL1D7RyEguh7HwaNCUoZfRt6eo2L0A Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c55251a7822148a8845f898a36865376 Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdminTestJSON-1477970876 Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c55251a7822148a8845f898a36865376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c55251a7822148a8845f898a36865376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c55251a7822148a8845f898a36865376"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c55251a7822148a8845f898a36865376"}]}] Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdminTestJSON-1477970876 Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c55251a7822148a8845f898a36865376 Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdminTestJSON-1477970876 Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdminTestJSON-1477970876-project Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 71e3477c3fff48ab8f1dc3079bd7453f Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdminTestJSON-1477970876-project Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 9dd22e9f-968a-459e-bfcc-45c00c95f797 could not be found. Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '9dd22e9f-968a-459e-bfcc-45c00c95f797'} Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd22e9f-968a-459e-bfcc-45c00c95f797 could not be found. Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd22e9f-968a-459e-bfcc-45c00c95f797 could not be found. Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:24.822750 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:24.827289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:24.827289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:24.827289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:24.827289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:24.827289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:24.827289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd22e9f-968a-459e-bfcc-45c00c95f797 could not be found. Aug 27 02:45:24.827289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:24.831696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Returning 404 to user: Instance 9dd22e9f-968a-459e-bfcc-45c00c95f797 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:24.833347 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab198fc8-2949-48ad-824a-e4c47d7fd802 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797" status: 404 len: 111 microversion: 2.1 time: 0.076219 Aug 27 02:45:24.837463 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1773/3229] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:24 2022] GET /compute/v2.1/servers/9dd22e9f-968a-459e-bfcc-45c00c95f797 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:24.845256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:24.846171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:24.854550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:24.855309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:24.855944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:24.856857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:24.857484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:24.859132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:25.068890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:25.080299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:25.082557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:25.084496 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c44d6bd4-e64b-4b01-b1b8-312e86c53026 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.245291 Aug 27 02:45:25.085646 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1774/3230] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:24 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:25.092437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8a36e87a-7174-4aea-bd65-e6bd22317781 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'create', calling method: .version_select at 0x7f4d29265a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-577128365", "description": "tempest-description-1138788821"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:26.070515 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8a36e87a-7174-4aea-bd65-e6bd22317781 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.981982 Aug 27 02:45:26.071506 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1775/3231] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:45:25 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:26.077110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c4a10ac2-7967-4ca5-a357-389e1ba55212 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:26.089973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c4a10ac2-7967-4ca5-a357-389e1ba55212 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:26.093474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c4a10ac2-7967-4ca5-a357-389e1ba55212 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:26.108520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4a10ac2-7967-4ca5-a357-389e1ba55212 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.109024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4a10ac2-7967-4ca5-a357-389e1ba55212 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.109470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4a10ac2-7967-4ca5-a357-389e1ba55212 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.115689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4a10ac2-7967-4ca5-a357-389e1ba55212 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.116197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4a10ac2-7967-4ca5-a357-389e1ba55212 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.116708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4a10ac2-7967-4ca5-a357-389e1ba55212 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.363679 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c4a10ac2-7967-4ca5-a357-389e1ba55212 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.290699 Aug 27 02:45:26.364674 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1776/3232] 10.222.0.99 () {58 vars in 1230 bytes} [Sat Aug 27 02:45:26 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:45:26.377382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b1478cdb-5410-4755-bdee-5430c0d2003f req-f472c0f1-2c5b-4229-9d8a-716135d2acaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e2dec37-0d3d-4970-ae03-cc5bbbdd5216", "name": "network-vif-deleted", "tag": "7a94feaf-a246-469b-a6d9-5535266fc0cd"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:26.396421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b1478cdb-5410-4755-bdee-5430c0d2003f req-f472c0f1-2c5b-4229-9d8a-716135d2acaf service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.397189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b1478cdb-5410-4755-bdee-5430c0d2003f req-f472c0f1-2c5b-4229-9d8a-716135d2acaf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.398033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b1478cdb-5410-4755-bdee-5430c0d2003f req-f472c0f1-2c5b-4229-9d8a-716135d2acaf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.423209 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b1478cdb-5410-4755-bdee-5430c0d2003f req-f472c0f1-2c5b-4229-9d8a-716135d2acaf service nova] Creating event network-vif-deleted:7a94feaf-a246-469b-a6d9-5535266fc0cd for instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 on n-h2-852084-5 Aug 27 02:45:26.432974 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b1478cdb-5410-4755-bdee-5430c0d2003f req-f472c0f1-2c5b-4229-9d8a-716135d2acaf service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065916 Aug 27 02:45:26.439462 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1777/3233] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:26.446716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b7fb4f34-1c5e-4e9e-803e-ede6c3651923 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:26.447796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b7fb4f34-1c5e-4e9e-803e-ede6c3651923 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:26.455407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:26.460232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7fb4f34-1c5e-4e9e-803e-ede6c3651923 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.462805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7fb4f34-1c5e-4e9e-803e-ede6c3651923 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.463667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7fb4f34-1c5e-4e9e-803e-ede6c3651923 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.465002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7fb4f34-1c5e-4e9e-803e-ede6c3651923 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.465736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7fb4f34-1c5e-4e9e-803e-ede6c3651923 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.466572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7fb4f34-1c5e-4e9e-803e-ede6c3651923 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.529957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b7fb4f34-1c5e-4e9e-803e-ede6c3651923 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:26.793875 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b7fb4f34-1c5e-4e9e-803e-ede6c3651923 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 204 len: 0 microversion: 2.1 time: 0.350500 Aug 27 02:45:26.798171 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1778/3234] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:26 2022] DELETE /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:26.830341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-957d0d17-a3dc-46cc-b681-0c17a6197a5b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:26.833149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-957d0d17-a3dc-46cc-b681-0c17a6197a5b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:26.863322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-957d0d17-a3dc-46cc-b681-0c17a6197a5b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.868808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-957d0d17-a3dc-46cc-b681-0c17a6197a5b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.871016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-957d0d17-a3dc-46cc-b681-0c17a6197a5b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:26.878070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-957d0d17-a3dc-46cc-b681-0c17a6197a5b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:26.882788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-957d0d17-a3dc-46cc-b681-0c17a6197a5b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:26.885209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-957d0d17-a3dc-46cc-b681-0c17a6197a5b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:27.034886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-957d0d17-a3dc-46cc-b681-0c17a6197a5b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:27.373728 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-957d0d17-a3dc-46cc-b681-0c17a6197a5b tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "DELETE /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 204 len: 0 microversion: 2.1 time: 0.563199 Aug 27 02:45:27.379424 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1779/3235] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:26 2022] DELETE /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:27.387028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:27.388067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:27.397341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:27.398100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:27.398729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:27.400956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:27.401767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:27.402372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:27.565520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Updating instance_info_cache with network_info: [] {{(pid=122487) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:45:27.612956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:27.647913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:27.651342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:27.654487 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ef4af8c-a090-4409-8a6a-7062f86393c7 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.271733 Aug 27 02:45:27.655742 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1780/3236] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:27 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:27.695459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1790350127", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "1881d242-8fc7-465c-aee4-0efe81dd9b3f"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:27.791645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] validate_networks() for [('1881d242-8fc7-465c-aee4-0efe81dd9b3f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:45:28.056553 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0c3a9df3-a636-47cc-860a-2de9b083808e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "DELETE /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 204 len: 0 microversion: 2.1 time: 5.791426 Aug 27 02:45:28.058002 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1457/3237] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:22 2022] DELETE /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 0 bytes in 5796 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:28.064062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a97662bd-8ba6-4937-ab7e-5f1dd34429d7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a97662bd-8ba6-4937-ab7e-5f1dd34429d7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Request method failure captured: Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYUB3Cra_5HCjso70Z1Ngmxfo9Cop4N5v6fOOcQeGuRdusuY4GFYbgWURM5dqRX_a55Vv3JgVZs01ykT_F0OvZ5XwW351OKqDTSTJweJiqiVcmVwedgfbaN24sEYfMtCLgnlKOvSocnPaWJRZPOOfhWcXHxIWcrAHotQqpH3qxpwiZo Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b3fc3c2d04bf44b49a932c2eae27cf04"}]}] Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 1418fca23c99496a958fffe6cc021689 Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: action_args: {} Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 02:45:28.069522 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a97662bd-8ba6-4937-ab7e-5f1dd34429d7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:28.083075 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a97662bd-8ba6-4937-ab7e-5f1dd34429d7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.016530 Aug 27 02:45:28.086672 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1458/3238] 10.222.0.99 () {58 vars in 1182 bytes} [Sat Aug 27 02:45:28 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:28.091760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-908900e8-e585-48dc-8557-5ad6afbc3da8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29aabb80>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:28.143991 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-908900e8-e585-48dc-8557-5ad6afbc3da8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Image not found. Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-908900e8-e585-48dc-8557-5ad6afbc3da8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2 HTTP/1.1 Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: exception: Image not found. Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '7faa9425-3341-43aa-8f19-cbbac5bea7a2'} Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7faa9425-3341-43aa-8f19-cbbac5bea7a2 to delete Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7faa9425-3341-43aa-8f19-cbbac5bea7a2 could not be found. Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.146713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-908900e8-e585-48dc-8557-5ad6afbc3da8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Image not found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-908900e8-e585-48dc-8557-5ad6afbc3da8 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2" status: 404 len: 62 microversion: 2.1 time: 0.061032 Aug 27 02:45:28.155060 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1459/3239] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:28 2022] DELETE /compute/v2.1/images/7faa9425-3341-43aa-8f19-cbbac5bea7a2 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:45:28.164090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-dbafd22a-f85b-4d04-8847-1a9b239f29e4 req-040121ef-a6be-4c17-b844-b923ae2f85de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f34d83-efc5-4a91-8918-f506cd984323", "name": "network-vif-plugged", "status": "completed", "tag": "aa02dc81-0ff9-479e-85ca-2125fdb2e147"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:28.179095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-dbafd22a-f85b-4d04-8847-1a9b239f29e4 req-040121ef-a6be-4c17-b844-b923ae2f85de service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:28.179639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-dbafd22a-f85b-4d04-8847-1a9b239f29e4 req-040121ef-a6be-4c17-b844-b923ae2f85de service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:28.180146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-dbafd22a-f85b-4d04-8847-1a9b239f29e4 req-040121ef-a6be-4c17-b844-b923ae2f85de service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:28.197132 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-dbafd22a-f85b-4d04-8847-1a9b239f29e4 req-040121ef-a6be-4c17-b844-b923ae2f85de service nova] Creating event network-vif-plugged:aa02dc81-0ff9-479e-85ca-2125fdb2e147 for instance d9f34d83-efc5-4a91-8918-f506cd984323 on n-h1-852084-5 Aug 27 02:45:28.216930 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-dbafd22a-f85b-4d04-8847-1a9b239f29e4 req-040121ef-a6be-4c17-b844-b923ae2f85de service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066849 Aug 27 02:45:28.217547 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1460/3240] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:28.228370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ff3ea4db-acd4-4479-ac52-096055ff467a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:28.229114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ff3ea4db-acd4-4479-ac52-096055ff467a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:28.243921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3ea4db-acd4-4479-ac52-096055ff467a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:28.244668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3ea4db-acd4-4479-ac52-096055ff467a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:28.246687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3ea4db-acd4-4479-ac52-096055ff467a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:28.247707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3ea4db-acd4-4479-ac52-096055ff467a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:28.252433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3ea4db-acd4-4479-ac52-096055ff467a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:28.253157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff3ea4db-acd4-4479-ac52-096055ff467a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:28.834699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ff3ea4db-acd4-4479-ac52-096055ff467a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:28.844987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:28.879094 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ff3ea4db-acd4-4479-ac52-096055ff467a tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1469 microversion: 2.1 time: 0.654989 Aug 27 02:45:28.910831 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1461/3241] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:28 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1469 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:28.935338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3f2d7423-1efb-43f6-a030-399b16af4d74 req-5f8ec395-227a-4e17-b577-23b25b595abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc6da4b-7eaa-4955-916f-f9400d8fb491", "name": "network-vif-deleted", "tag": "26a8ce3a-caa5-463a-891c-4c436615cead"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:28.991520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3f2d7423-1efb-43f6-a030-399b16af4d74 req-5f8ec395-227a-4e17-b577-23b25b595abd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:28.992405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3f2d7423-1efb-43f6-a030-399b16af4d74 req-5f8ec395-227a-4e17-b577-23b25b595abd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:28.993460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3f2d7423-1efb-43f6-a030-399b16af4d74 req-5f8ec395-227a-4e17-b577-23b25b595abd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.022791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.compute.server_external_events [req-3f2d7423-1efb-43f6-a030-399b16af4d74 req-5f8ec395-227a-4e17-b577-23b25b595abd service nova] Unable to find a host for instance dbc6da4b-7eaa-4955-916f-f9400d8fb491. Dropping event network-vif-deleted {{(pid=122487) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 02:45:29.025417 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3f2d7423-1efb-43f6-a030-399b16af4d74 req-5f8ec395-227a-4e17-b577-23b25b595abd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.112304 Aug 27 02:45:29.027218 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1462/3242] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 116 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 02:45:29.037969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:29.039441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: dbc6da4b-7eaa-4955-916f-f9400d8fb491] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:29.053148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.054498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.058202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.059844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.060721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.065330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.122731 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] HTTP exception thrown: Instance dbc6da4b-7eaa-4955-916f-f9400d8fb491 could not be found. Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Request method failure captured: Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 HTTP/1.1 Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYKm_d0JxxqDywZg3wD_COBvn-f59wxHd5W6ptfAZGBGOv_Flzhk-aSso1ZnVxHt4Wn3_mE_eMwZzPt26zHlVRxUGMxoQr16MR2iVAECQBE2HR0fGaw53Bq8Fj7F37vVG3tMdQMgN6KVjqYBiNLXuttuRfd3bP6t4FmBCNrcWoio4C8 Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_69945a768314456fae9bf75e854510c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/69945a768314456fae9bf75e854510c2"}]}] Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 281834367cf24a809448bdeea36a9c97 Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance dbc6da4b-7eaa-4955-916f-f9400d8fb491 could not be found. Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'dbc6da4b-7eaa-4955-916f-f9400d8fb491'} Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc6da4b-7eaa-4955-916f-f9400d8fb491 could not be found. Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc6da4b-7eaa-4955-916f-f9400d8fb491 could not be found. Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:29.129366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:29.139484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:29.139484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:29.139484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:29.139484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:29.139484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:29.139484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc6da4b-7eaa-4955-916f-f9400d8fb491 could not be found. Aug 27 02:45:29.139484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:29.144540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Returning 404 to user: Instance dbc6da4b-7eaa-4955-916f-f9400d8fb491 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:29.146670 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7db197fb-884d-4582-9e85-a3a753f3c98d tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491" status: 404 len: 111 microversion: 2.1 time: 0.117453 Aug 27 02:45:29.148574 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1463/3243] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:29 2022] GET /compute/v2.1/servers/dbc6da4b-7eaa-4955-916f-f9400d8fb491 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:29.162756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-293345ef-774f-48ad-972a-60f44e168fab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:29.180694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-293345ef-774f-48ad-972a-60f44e168fab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:29.182556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-293345ef-774f-48ad-972a-60f44e168fab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Searching by: {'deleted': False, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:29.196303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-293345ef-774f-48ad-972a-60f44e168fab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.197523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-293345ef-774f-48ad-972a-60f44e168fab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.198664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-293345ef-774f-48ad-972a-60f44e168fab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.200316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-293345ef-774f-48ad-972a-60f44e168fab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.201406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-293345ef-774f-48ad-972a-60f44e168fab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.202773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-293345ef-774f-48ad-972a-60f44e168fab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.278267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-293345ef-774f-48ad-972a-60f44e168fab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:45:29.360483 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-293345ef-774f-48ad-972a-60f44e168fab tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.209951 Aug 27 02:45:29.365959 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1464/3244] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 02:45:29 2022] GET /compute/v2.1/servers => generated 683 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:29.379910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-40eaa6df-9949-492c-8caf-0e00b6003bbd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:29.380570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-40eaa6df-9949-492c-8caf-0e00b6003bbd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:29.395900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40eaa6df-9949-492c-8caf-0e00b6003bbd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.397622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40eaa6df-9949-492c-8caf-0e00b6003bbd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.404852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40eaa6df-9949-492c-8caf-0e00b6003bbd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.406604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40eaa6df-9949-492c-8caf-0e00b6003bbd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.407623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40eaa6df-9949-492c-8caf-0e00b6003bbd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.408374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40eaa6df-9949-492c-8caf-0e00b6003bbd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.461136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-40eaa6df-9949-492c-8caf-0e00b6003bbd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:29.584740 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.compute.api [None req-40eaa6df-9949-492c-8caf-0e00b6003bbd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Instance is already in deleting state, ignoring this request Aug 27 02:45:29.588710 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-40eaa6df-9949-492c-8caf-0e00b6003bbd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 204 len: 0 microversion: 2.1 time: 0.221120 Aug 27 02:45:29.593351 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1465/3245] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:29 2022] DELETE /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:29.614890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:29.617138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:29.636417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.640828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.644863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.646685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:29.647492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:29.647956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:29.647956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:29.648384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:29.650173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.651723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.654925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.670010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.670506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.671188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.672813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.673506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.673969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.723042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Getting quotas for project dd39361940384245b4c43e4490a261bb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:29.739481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Getting quotas for user b0e6dd194aa342058daf161777e0adca and project dd39361940384245b4c43e4490a261bb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:29.789199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:29.792872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:29.891610 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-44a6782a-4733-44ca-b898-9d158651d4cf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.222368 Aug 27 02:45:29.896609 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1781/3246] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:45:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:45:29.908573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dc280ea1-0b35-4ca7-8870-3b5c6acdc07f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:29.909761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dc280ea1-0b35-4ca7-8870-3b5c6acdc07f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:29.927760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc280ea1-0b35-4ca7-8870-3b5c6acdc07f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.928269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc280ea1-0b35-4ca7-8870-3b5c6acdc07f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.928717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc280ea1-0b35-4ca7-8870-3b5c6acdc07f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.929722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc280ea1-0b35-4ca7-8870-3b5c6acdc07f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:29.932319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc280ea1-0b35-4ca7-8870-3b5c6acdc07f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:29.934273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc280ea1-0b35-4ca7-8870-3b5c6acdc07f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:29.969286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:29.998745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:30.005084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6cf1a7e187724affa4066f06ad8a908f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38241ddbb3324f4db5a3c6bbdd46cc5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:30.013213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dc280ea1-0b35-4ca7-8870-3b5c6acdc07f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:30.015227 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-883ba8eb-0625-4dd0-ae80-2d74f478c925 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 200 len: 1604 microversion: 2.32 time: 0.416045 Aug 27 02:45:30.023819 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1466/3247] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:29 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 1604 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:30.049569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:30.072429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:30.080116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.compute.servers [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Removing options 'limit' from query {{(pid=122487) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 27 02:45:30.082236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Searching by: {'deleted': False, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:30.118437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.119893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.122242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:30.127743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.129272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.130362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:30.248167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:45:30.382888 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3bb4ff8f-c3d5-4ebc-bc9b-4cb51a2f76a8 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.353214 Aug 27 02:45:30.386648 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1467/3248] 10.222.0.99 () {58 vars in 1144 bytes} [Sat Aug 27 02:45:30 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:30.402962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-30c5b453-4f53-4880-87d7-7ab890652aa7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:30.406292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-30c5b453-4f53-4880-87d7-7ab890652aa7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:30.412731 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dc280ea1-0b35-4ca7-8870-3b5c6acdc07f tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 204 len: 0 microversion: 2.1 time: 0.512770 Aug 27 02:45:30.415040 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1782/3249] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:29 2022] DELETE /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:30.436963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bf65569b-1d74-4f23-8ed0-3a258a150341 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:30.442271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30c5b453-4f53-4880-87d7-7ab890652aa7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.442568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bf65569b-1d74-4f23-8ed0-3a258a150341 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:30.442776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30c5b453-4f53-4880-87d7-7ab890652aa7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.443263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30c5b453-4f53-4880-87d7-7ab890652aa7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:30.448135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30c5b453-4f53-4880-87d7-7ab890652aa7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.448669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30c5b453-4f53-4880-87d7-7ab890652aa7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.449129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30c5b453-4f53-4880-87d7-7ab890652aa7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:30.695555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bf65569b-1d74-4f23-8ed0-3a258a150341 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:30.758597 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bf65569b-1d74-4f23-8ed0-3a258a150341 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1216 microversion: 2.1 time: 0.340699 Aug 27 02:45:30.759592 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1783/3250] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:30 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1216 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:30.788254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5572e99-4390-4d73-bf25-4bc56307a2a2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:30.805356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c5572e99-4390-4d73-bf25-4bc56307a2a2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:30.836908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5572e99-4390-4d73-bf25-4bc56307a2a2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.839651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5572e99-4390-4d73-bf25-4bc56307a2a2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.840812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5572e99-4390-4d73-bf25-4bc56307a2a2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:30.843817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5572e99-4390-4d73-bf25-4bc56307a2a2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:30.847137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5572e99-4390-4d73-bf25-4bc56307a2a2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:30.849053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5572e99-4390-4d73-bf25-4bc56307a2a2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.054203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-30c5b453-4f53-4880-87d7-7ab890652aa7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:31.087730 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-30c5b453-4f53-4880-87d7-7ab890652aa7 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1492 microversion: 2.1 time: 0.699578 Aug 27 02:45:31.105836 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1468/3251] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:30 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1492 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:31.122553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48294f6e-2678-4d94-9ab4-599ef8e842a3 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48294f6e-2678-4d94-9ab4-599ef8e842a3 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Request method failure captured: Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYUB3Cra_5HCjso70Z1Ngmxfo9Cop4N5v6fOOcQeGuRdusuY4GFYbgWURM5dqRX_a55Vv3JgVZs01ykT_F0OvZ5XwW351OKqDTSTJweJiqiVcmVwedgfbaN24sEYfMtCLgnlKOvSocnPaWJRZPOOfhWcXHxIWcrAHotQqpH3qxpwiZo Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b3fc3c2d04bf44b49a932c2eae27cf04"}]}] Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 1418fca23c99496a958fffe6cc021689 Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: action_args: {} Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi '-1' Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 02:45:31.134392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.148415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48294f6e-2678-4d94-9ab4-599ef8e842a3 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:31.152521 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-48294f6e-2678-4d94-9ab4-599ef8e842a3 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.028996 Aug 27 02:45:31.152521 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1469/3252] 10.222.0.99 () {58 vars in 1142 bytes} [Sat Aug 27 02:45:31 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:31.184403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-81e6a02a-c7ec-44df-a8c6-b9575c0aa9d6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:31.185464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-81e6a02a-c7ec-44df-a8c6-b9575c0aa9d6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:31.251543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e6a02a-c7ec-44df-a8c6-b9575c0aa9d6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.252436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e6a02a-c7ec-44df-a8c6-b9575c0aa9d6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.253181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e6a02a-c7ec-44df-a8c6-b9575c0aa9d6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.254422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e6a02a-c7ec-44df-a8c6-b9575c0aa9d6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.255166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e6a02a-c7ec-44df-a8c6-b9575c0aa9d6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.255866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81e6a02a-c7ec-44df-a8c6-b9575c0aa9d6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.329333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c5572e99-4390-4d73-bf25-4bc56307a2a2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e3477c3fff48ab8f1dc3079bd7453f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c55251a7822148a8845f898a36865376', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:31.400486 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c5572e99-4390-4d73-bf25-4bc56307a2a2 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 200 len: 1427 microversion: 2.1 time: 0.634573 Aug 27 02:45:31.402941 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1784/3253] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:30 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 1427 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:31.425396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:31.427384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:31.477580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.481081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.485166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.491588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.493202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.493925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.592386 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] HTTP exception thrown: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Request method failure captured: Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 HTTP/1.1 Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYND6UrdDlvmV6wseSqAPa0vE1nqSPR69SfsIzSd0fIEP_6ZK3IYPtr0nSHPoB35fnYnFRlxBxeoCBUfEl4VRS5JErHjXXXyTwUHhxo-Iura-Sd2GSt79cTgpNBhg8oaXx-tTuH6yyrErDApjDgkgwST8ovbNPwjKDZQnLsza0R7DP0 Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 38241ddbb3324f4db5a3c6bbdd46cc5f Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TaggedBootDevicesTest-1103139010 Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_38241ddbb3324f4db5a3c6bbdd46cc5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/38241ddbb3324f4db5a3c6bbdd46cc5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/38241ddbb3324f4db5a3c6bbdd46cc5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/38241ddbb3324f4db5a3c6bbdd46cc5f"}]}] Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TaggedBootDevicesTest-1103139010 Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 38241ddbb3324f4db5a3c6bbdd46cc5f Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1103139010 Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TaggedBootDevicesTest-1103139010-project Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 6cf1a7e187724affa4066f06ad8a908f Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TaggedBootDevicesTest-1103139010-project Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4cbd5532-9135-4bc2-890e-ba2e9b080cf2'} Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.597615 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:31.611673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.611673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.611673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:31.611673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:31.611673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:31.611673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:31.611673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:31.611673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.616253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Returning 404 to user: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:31.618945 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3eae03b4-f989-4f1b-a6e4-f219bbf9adaa tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 404 len: 111 microversion: 2.32 time: 0.211536 Aug 27 02:45:31.620762 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1785/3254] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:31 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 111 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:31.633283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-304d01e5-782a-48be-9648-33af97e99311 req-c5e25b7f-0b94-43ca-a43b-dba7ae3318c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1", "name": "network-vif-deleted", "tag": "cc07ffc6-88d4-4347-b44f-52ae8d2126ef"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:31.662034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-304d01e5-782a-48be-9648-33af97e99311 req-c5e25b7f-0b94-43ca-a43b-dba7ae3318c5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.663071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-304d01e5-782a-48be-9648-33af97e99311 req-c5e25b7f-0b94-43ca-a43b-dba7ae3318c5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.663998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-304d01e5-782a-48be-9648-33af97e99311 req-c5e25b7f-0b94-43ca-a43b-dba7ae3318c5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.693066 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-304d01e5-782a-48be-9648-33af97e99311 req-c5e25b7f-0b94-43ca-a43b-dba7ae3318c5 service nova] Creating event network-vif-deleted:cc07ffc6-88d4-4347-b44f-52ae8d2126ef for instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 on n-h2-852084-5 Aug 27 02:45:31.702973 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-304d01e5-782a-48be-9648-33af97e99311 req-c5e25b7f-0b94-43ca-a43b-dba7ae3318c5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079181 Aug 27 02:45:31.706973 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1786/3255] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:31.720624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57362d7b-03f0-4b61-8744-9d401bf49e93 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57362d7b-03f0-4b61-8744-9d401bf49e93 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Request method failure captured: Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYUB3Cra_5HCjso70Z1Ngmxfo9Cop4N5v6fOOcQeGuRdusuY4GFYbgWURM5dqRX_a55Vv3JgVZs01ykT_F0OvZ5XwW351OKqDTSTJweJiqiVcmVwedgfbaN24sEYfMtCLgnlKOvSocnPaWJRZPOOfhWcXHxIWcrAHotQqpH3qxpwiZo Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b3fc3c2d04bf44b49a932c2eae27cf04"}]}] Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 1418fca23c99496a958fffe6cc021689 Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: action_args: {} Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'testing' Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 27 02:45:31.733257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57362d7b-03f0-4b61-8744-9d401bf49e93 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:31.739394 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-57362d7b-03f0-4b61-8744-9d401bf49e93 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.028007 Aug 27 02:45:31.747433 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1787/3256] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:45:31 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:31.758826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-321ac0e8-c1a8-4dab-844d-b21b0371db15 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '.version_select at 0x7f4d291cd3a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:31.806625 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-321ac0e8-c1a8-4dab-844d-b21b0371db15 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-572989349" status: 204 len: 0 microversion: 2.32 time: 0.057247 Aug 27 02:45:31.811690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-81e6a02a-c7ec-44df-a8c6-b9575c0aa9d6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:31.815093 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1788/3257] 10.222.0.99 () {60 vars in 1259 bytes} [Sat Aug 27 02:45:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-572989349 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:45:31.824094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c314c3a4-3359-4248-bf92-c96464621b27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:31.835152 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-81e6a02a-c7ec-44df-a8c6-b9575c0aa9d6 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1465 microversion: 2.1 time: 0.681124 Aug 27 02:45:31.835472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c314c3a4-3359-4248-bf92-c96464621b27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:31.836656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c314c3a4-3359-4248-bf92-c96464621b27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:31.852494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.compute.servers [None req-c314c3a4-3359-4248-bf92-c96464621b27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Flavor 'non_existing_flavor' could not be found {{(pid=122488) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 27 02:45:31.852904 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1470/3258] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:31 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1465 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:31.854496 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c314c3a4-3359-4248-bf92-c96464621b27 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.037491 Aug 27 02:45:31.855583 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1789/3259] 10.222.0.99 () {58 vars in 1178 bytes} [Sat Aug 27 02:45:31 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:45:31.863811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cff31ad7-0179-46a4-806a-97d47aad4a27 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:31.865037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cff31ad7-0179-46a4-806a-97d47aad4a27 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:31.880772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff31ad7-0179-46a4-806a-97d47aad4a27 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.881331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff31ad7-0179-46a4-806a-97d47aad4a27 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.881909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff31ad7-0179-46a4-806a-97d47aad4a27 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.883355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3e04f029-5a6a-4f81-9483-fe5ba92f9a05 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:31.884599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff31ad7-0179-46a4-806a-97d47aad4a27 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.885447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff31ad7-0179-46a4-806a-97d47aad4a27 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.885994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cff31ad7-0179-46a4-806a-97d47aad4a27 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.915552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3e04f029-5a6a-4f81-9483-fe5ba92f9a05 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:31.924068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3e04f029-5a6a-4f81-9483-fe5ba92f9a05 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:31.942777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e04f029-5a6a-4f81-9483-fe5ba92f9a05 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.944095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e04f029-5a6a-4f81-9483-fe5ba92f9a05 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.945368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e04f029-5a6a-4f81-9483-fe5ba92f9a05 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:31.947316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e04f029-5a6a-4f81-9483-fe5ba92f9a05 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:31.948928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e04f029-5a6a-4f81-9483-fe5ba92f9a05 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:31.950740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e04f029-5a6a-4f81-9483-fe5ba92f9a05 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.273026 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3e04f029-5a6a-4f81-9483-fe5ba92f9a05 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.398663 Aug 27 02:45:32.290191 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1790/3260] 10.222.0.99 () {58 vars in 1174 bytes} [Sat Aug 27 02:45:31 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:45:32.310288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8867d6dd-42a9-415d-9ce9-ae42df19affc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:32.311572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8867d6dd-42a9-415d-9ce9-ae42df19affc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:32.329042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8867d6dd-42a9-415d-9ce9-ae42df19affc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.341104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8867d6dd-42a9-415d-9ce9-ae42df19affc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.342767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8867d6dd-42a9-415d-9ce9-ae42df19affc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.344149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8867d6dd-42a9-415d-9ce9-ae42df19affc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.345429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8867d6dd-42a9-415d-9ce9-ae42df19affc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.346979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8867d6dd-42a9-415d-9ce9-ae42df19affc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.371429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cff31ad7-0179-46a4-806a-97d47aad4a27 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:32.380970 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cff31ad7-0179-46a4-806a-97d47aad4a27 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1220 microversion: 2.1 time: 0.527016 Aug 27 02:45:32.387096 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1471/3261] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:31 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1220 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:32.402614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-29810a2c-4a8b-4fab-aaea-90e56604c06f tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:32.415636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:32.418073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-29810a2c-4a8b-4fab-aaea-90e56604c06f tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:32.419963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-29810a2c-4a8b-4fab-aaea-90e56604c06f tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:32.440368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29810a2c-4a8b-4fab-aaea-90e56604c06f tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.441141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29810a2c-4a8b-4fab-aaea-90e56604c06f tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.444214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29810a2c-4a8b-4fab-aaea-90e56604c06f tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.447461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29810a2c-4a8b-4fab-aaea-90e56604c06f tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.450845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29810a2c-4a8b-4fab-aaea-90e56604c06f tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.455550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29810a2c-4a8b-4fab-aaea-90e56604c06f tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.528724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8867d6dd-42a9-415d-9ce9-ae42df19affc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:32.541442 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8867d6dd-42a9-415d-9ce9-ae42df19affc tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1291 microversion: 2.1 time: 0.245874 Aug 27 02:45:32.542893 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1791/3262] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:32 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1291 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:32.550445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:32.552056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] [instance: 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:32.566488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.570309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.571099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.575735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.576223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.576663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.628695 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] HTTP exception thrown: Instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 could not be found. Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Request method failure captured: Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 HTTP/1.1 Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYShFc2ldrr4SLwZDhAYhBPbMMoW1HD3KxSVYuMLOf0th0SNv_rYy06_pO-ewjCNwW1-eAoqtMvtircBF1SIvn1UXtzFNgFZ8POhdwdholw7w5rTxKRmBxf5hRknIjBNk5OM9EGx0uIJQX3nZhL1D7RyEguh7HwaNCUoZfRt6eo2L0A Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c55251a7822148a8845f898a36865376 Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdminTestJSON-1477970876 Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c55251a7822148a8845f898a36865376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c55251a7822148a8845f898a36865376"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c55251a7822148a8845f898a36865376"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c55251a7822148a8845f898a36865376"}]}] Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdminTestJSON-1477970876 Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c55251a7822148a8845f898a36865376 Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdminTestJSON-1477970876 Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdminTestJSON-1477970876-project Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 71e3477c3fff48ab8f1dc3079bd7453f Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdminTestJSON-1477970876-project Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 could not be found. Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1'} Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 could not be found. Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 could not be found. Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:32.630907 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:32.636811 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:32.636811 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:32.636811 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:32.636811 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:32.636811 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:32.636811 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 could not be found. Aug 27 02:45:32.636811 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:32.636811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] Returning 404 to user: Instance 08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:32.636811 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-da250744-b6aa-4ba3-96ea-60fe9553ca92 tempest-ServersAdminTestJSON-1477970876 tempest-ServersAdminTestJSON-1477970876-project] 10.222.0.99 "GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1" status: 404 len: 111 microversion: 2.1 time: 0.091418 Aug 27 02:45:32.640387 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1792/3263] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:32 2022] GET /compute/v2.1/servers/08dabd7a-ed70-48b6-8f54-1d80b2a3e9a1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:32.692872 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-29810a2c-4a8b-4fab-aaea-90e56604c06f tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.303727 Aug 27 02:45:32.706210 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1472/3264] 10.222.0.99 () {58 vars in 1184 bytes} [Sat Aug 27 02:45:32 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:45:32.710767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:32.719972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:32.722592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Searching by: {'deleted': False, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:32.732259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.733177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.733887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.736129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.737033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.738217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.808261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:45:32.903392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-54f502f6-3c04-424d-a753-d40b953d2d23 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:32.906138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:32.910192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-54f502f6-3c04-424d-a753-d40b953d2d23 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:32.949020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.949792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.951116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.972587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54f502f6-3c04-424d-a753-d40b953d2d23 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.978869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54f502f6-3c04-424d-a753-d40b953d2d23 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.984505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54f502f6-3c04-424d-a753-d40b953d2d23 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:32.985955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54f502f6-3c04-424d-a753-d40b953d2d23 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:32.991586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54f502f6-3c04-424d-a753-d40b953d2d23 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:32.994080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54f502f6-3c04-424d-a753-d40b953d2d23 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.277120 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e60168d8-e694-4c71-9569-27fe0684794c tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.569862 Aug 27 02:45:33.282767 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1793/3265] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:45:32 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:33.317538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4091ff7-7364-4873-b1a0-34ce3beb7e06 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:33.327717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b4091ff7-7364-4873-b1a0-34ce3beb7e06 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:33.334184 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b4091ff7-7364-4873-b1a0-34ce3beb7e06 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.021379 Aug 27 02:45:33.335004 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1794/3266] 10.222.0.99 () {58 vars in 1178 bytes} [Sat Aug 27 02:45:33 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:45:33.350633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-605771fa-aff2-4f9c-bf74-3f757be14ef7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:33.359001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-605771fa-aff2-4f9c-bf74-3f757be14ef7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:33.359461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-605771fa-aff2-4f9c-bf74-3f757be14ef7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Searching by: {'deleted': False, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:45:33.371166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605771fa-aff2-4f9c-bf74-3f757be14ef7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.371668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605771fa-aff2-4f9c-bf74-3f757be14ef7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.372394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605771fa-aff2-4f9c-bf74-3f757be14ef7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.374383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605771fa-aff2-4f9c-bf74-3f757be14ef7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.374883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605771fa-aff2-4f9c-bf74-3f757be14ef7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.375862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605771fa-aff2-4f9c-bf74-3f757be14ef7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.414434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-605771fa-aff2-4f9c-bf74-3f757be14ef7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:45:33.458842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-54f502f6-3c04-424d-a753-d40b953d2d23 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:33.463144 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-605771fa-aff2-4f9c-bf74-3f757be14ef7 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.119219 Aug 27 02:45:33.463691 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1795/3267] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 02:45:33 2022] GET /compute/v2.1/servers => generated 683 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:33.473337 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-54f502f6-3c04-424d-a753-d40b953d2d23 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1465 microversion: 2.1 time: 0.612222 Aug 27 02:45:33.474173 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1473/3268] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:32 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1465 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:33.478268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d39cdee8-c34a-428c-bc91-8aa27ceab71e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:33.478804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:33.479311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:33.479461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d39cdee8-c34a-428c-bc91-8aa27ceab71e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:33.487400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39cdee8-c34a-428c-bc91-8aa27ceab71e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.488372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39cdee8-c34a-428c-bc91-8aa27ceab71e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.489028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39cdee8-c34a-428c-bc91-8aa27ceab71e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.490565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39cdee8-c34a-428c-bc91-8aa27ceab71e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.491386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39cdee8-c34a-428c-bc91-8aa27ceab71e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.492111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d39cdee8-c34a-428c-bc91-8aa27ceab71e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.498888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.499388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.500030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.501504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.502196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.502636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.535819 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] HTTP exception thrown: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Request method failure captured: Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 HTTP/1.1 Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYUB3Cra_5HCjso70Z1Ngmxfo9Cop4N5v6fOOcQeGuRdusuY4GFYbgWURM5dqRX_a55Vv3JgVZs01ykT_F0OvZ5XwW351OKqDTSTJweJiqiVcmVwedgfbaN24sEYfMtCLgnlKOvSocnPaWJRZPOOfhWcXHxIWcrAHotQqpH3qxpwiZo Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b3fc3c2d04bf44b49a932c2eae27cf04"}]}] Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 1418fca23c99496a958fffe6cc021689 Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '1e2dec37-0d3d-4970-ae03-cc5bbbdd5216'} Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:33.537543 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Returning 404 to user: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9156eb17-080f-4a54-9b8c-381e19b3f234 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216" status: 404 len: 111 microversion: 2.1 time: 0.064074 Aug 27 02:45:33.543974 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1474/3269] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:33 2022] DELETE /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:33.552447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c9b25e02-943b-4974-a1b1-45401f5df54d tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:33.553029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c9b25e02-943b-4974-a1b1-45401f5df54d tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:33.583229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9b25e02-943b-4974-a1b1-45401f5df54d tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.583731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9b25e02-943b-4974-a1b1-45401f5df54d tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.584203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9b25e02-943b-4974-a1b1-45401f5df54d tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.584990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9b25e02-943b-4974-a1b1-45401f5df54d tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.585468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9b25e02-943b-4974-a1b1-45401f5df54d tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.585935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9b25e02-943b-4974-a1b1-45401f5df54d tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.620337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c9b25e02-943b-4974-a1b1-45401f5df54d tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:33.672565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d39cdee8-c34a-428c-bc91-8aa27ceab71e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:33.698619 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d39cdee8-c34a-428c-bc91-8aa27ceab71e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1268 microversion: 2.1 time: 0.223891 Aug 27 02:45:33.699547 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1796/3270] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:33 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1268 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:33.713890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:33.715399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:33.738580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.739552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.742299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.743775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.746511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.747273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.751792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:33.791234 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c9b25e02-943b-4974-a1b1-45401f5df54d tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "DELETE /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737" status: 204 len: 0 microversion: 2.1 time: 0.245249 Aug 27 02:45:33.792643 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1475/3271] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:33 2022] DELETE /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:33.804576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ba5fe32-c392-4d8a-93e1-57fb04eef8a0 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:33.805807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0ba5fe32-c392-4d8a-93e1-57fb04eef8a0 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:33.819225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ba5fe32-c392-4d8a-93e1-57fb04eef8a0 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.820283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ba5fe32-c392-4d8a-93e1-57fb04eef8a0 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.821769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ba5fe32-c392-4d8a-93e1-57fb04eef8a0 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.824018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ba5fe32-c392-4d8a-93e1-57fb04eef8a0 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.824781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ba5fe32-c392-4d8a-93e1-57fb04eef8a0 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.827564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ba5fe32-c392-4d8a-93e1-57fb04eef8a0 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.836285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:33.838419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:33.841444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:33.845559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lazy-loading 'fault' on Instance uuid d9f34d83-efc5-4a91-8918-f506cd984323 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:33.914991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0ba5fe32-c392-4d8a-93e1-57fb04eef8a0 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:33.943387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba5de1a75904079a6d4ae345c9c8025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7deb7b2e0f44db9408c63d75634406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:33.956576 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-45062d1b-c482-4196-8c56-d6429c7def2d tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 200 len: 1296 microversion: 2.1 time: 0.255099 Aug 27 02:45:33.959145 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1797/3272] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:33 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 1296 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:33.973124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-92f7829e-c11d-49d9-8ed3-149aa8ed1674 req-8b18381f-34e7-4674-a58d-9b5b8d18a9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f34d83-efc5-4a91-8918-f506cd984323", "name": "network-vif-deleted", "tag": "aa02dc81-0ff9-479e-85ca-2125fdb2e147"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:33.999396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-92f7829e-c11d-49d9-8ed3-149aa8ed1674 req-8b18381f-34e7-4674-a58d-9b5b8d18a9ec service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.000815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-92f7829e-c11d-49d9-8ed3-149aa8ed1674 req-8b18381f-34e7-4674-a58d-9b5b8d18a9ec service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.001629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-92f7829e-c11d-49d9-8ed3-149aa8ed1674 req-8b18381f-34e7-4674-a58d-9b5b8d18a9ec service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.037861 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-92f7829e-c11d-49d9-8ed3-149aa8ed1674 req-8b18381f-34e7-4674-a58d-9b5b8d18a9ec service nova] Creating event network-vif-deleted:aa02dc81-0ff9-479e-85ca-2125fdb2e147 for instance d9f34d83-efc5-4a91-8918-f506cd984323 on n-h1-852084-5 Aug 27 02:45:34.048284 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-92f7829e-c11d-49d9-8ed3-149aa8ed1674 req-8b18381f-34e7-4674-a58d-9b5b8d18a9ec service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085810 Aug 27 02:45:34.054772 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1798/3273] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:34.066969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:34.137300 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0ba5fe32-c392-4d8a-93e1-57fb04eef8a0 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "DELETE /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 204 len: 0 microversion: 2.1 time: 0.338196 Aug 27 02:45:34.138722 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1476/3274] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:33 2022] DELETE /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:34.154253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:34.155537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:34.171831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.175086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.179939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.181249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.185457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.187742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.253723 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] HTTP exception thrown: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Request method failure captured: Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 HTTP/1.1 Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYUB3Cra_5HCjso70Z1Ngmxfo9Cop4N5v6fOOcQeGuRdusuY4GFYbgWURM5dqRX_a55Vv3JgVZs01ykT_F0OvZ5XwW351OKqDTSTJweJiqiVcmVwedgfbaN24sEYfMtCLgnlKOvSocnPaWJRZPOOfhWcXHxIWcrAHotQqpH3qxpwiZo Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b3fc3c2d04bf44b49a932c2eae27cf04"}]}] Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 1418fca23c99496a958fffe6cc021689 Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '1e2dec37-0d3d-4970-ae03-cc5bbbdd5216'} Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:34.255901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:34.275682 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:34.275682 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:34.275682 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:34.275682 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:34.275682 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:34.275682 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:34.275682 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. Aug 27 02:45:34.275682 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:34.275682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Returning 404 to user: Instance 1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:34.275682 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-872c7a25-3f89-4c99-b854-331cdec6d673 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216" status: 404 len: 111 microversion: 2.1 time: 0.111967 Aug 27 02:45:34.275682 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1799/3275] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:34 2022] GET /compute/v2.1/servers/1e2dec37-0d3d-4970-ae03-cc5bbbdd5216 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:34.283318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-29381611-f65f-45b0-8a83-c5c7d0c04f28 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:34.283318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-29381611-f65f-45b0-8a83-c5c7d0c04f28 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:34.299468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29381611-f65f-45b0-8a83-c5c7d0c04f28 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.299468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29381611-f65f-45b0-8a83-c5c7d0c04f28 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.299468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29381611-f65f-45b0-8a83-c5c7d0c04f28 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.299468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29381611-f65f-45b0-8a83-c5c7d0c04f28 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.299468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29381611-f65f-45b0-8a83-c5c7d0c04f28 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.299468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29381611-f65f-45b0-8a83-c5c7d0c04f28 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.452892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-8e0133cf-7b42-4cfa-bd2b-bcb6aecfb430 req-33cf8a63-c2e4-4f79-b184-a362841f1700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34ed4c2-b127-4bef-a152-eb401414f9a9", "name": "network-vif-deleted", "tag": "81442ca5-b287-4fa9-83b3-9bd314e98190"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:34.477544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8e0133cf-7b42-4cfa-bd2b-bcb6aecfb430 req-33cf8a63-c2e4-4f79-b184-a362841f1700 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.478079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8e0133cf-7b42-4cfa-bd2b-bcb6aecfb430 req-33cf8a63-c2e4-4f79-b184-a362841f1700 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.478530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8e0133cf-7b42-4cfa-bd2b-bcb6aecfb430 req-33cf8a63-c2e4-4f79-b184-a362841f1700 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.516269 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-8e0133cf-7b42-4cfa-bd2b-bcb6aecfb430 req-33cf8a63-c2e4-4f79-b184-a362841f1700 service nova] Creating event network-vif-deleted:81442ca5-b287-4fa9-83b3-9bd314e98190 for instance a34ed4c2-b127-4bef-a152-eb401414f9a9 on n-h1-852084-5 Aug 27 02:45:34.522086 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-8e0133cf-7b42-4cfa-bd2b-bcb6aecfb430 req-33cf8a63-c2e4-4f79-b184-a362841f1700 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072768 Aug 27 02:45:34.523716 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1800/3276] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:45:34.531900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8c37915d-54e5-46e4-ae4d-ce3babe86563 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:34.533402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8c37915d-54e5-46e4-ae4d-ce3babe86563 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:34.542500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c37915d-54e5-46e4-ae4d-ce3babe86563 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.543460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c37915d-54e5-46e4-ae4d-ce3babe86563 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.544188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c37915d-54e5-46e4-ae4d-ce3babe86563 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.545193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c37915d-54e5-46e4-ae4d-ce3babe86563 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.546593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c37915d-54e5-46e4-ae4d-ce3babe86563 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.547784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c37915d-54e5-46e4-ae4d-ce3babe86563 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.698841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8c37915d-54e5-46e4-ae4d-ce3babe86563 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:34.719355 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8c37915d-54e5-46e4-ae4d-ce3babe86563 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1465 microversion: 2.1 time: 0.193116 Aug 27 02:45:34.720410 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1801/3277] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:34 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1465 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:34.736418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-44f972eb-4c21-4416-a908-48bc8f7a7cef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:34.737078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-44f972eb-4c21-4416-a908-48bc8f7a7cef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:34.740129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-29381611-f65f-45b0-8a83-c5c7d0c04f28 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:34.744649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44f972eb-4c21-4416-a908-48bc8f7a7cef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.745277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44f972eb-4c21-4416-a908-48bc8f7a7cef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.746687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44f972eb-4c21-4416-a908-48bc8f7a7cef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.747870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44f972eb-4c21-4416-a908-48bc8f7a7cef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:34.748578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44f972eb-4c21-4416-a908-48bc8f7a7cef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:34.749088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44f972eb-4c21-4416-a908-48bc8f7a7cef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:34.751088 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-29381611-f65f-45b0-8a83-c5c7d0c04f28 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737" status: 200 len: 1521 microversion: 2.1 time: 0.485849 Aug 27 02:45:34.754410 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1477/3278] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:34 2022] GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:34.873434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-44f972eb-4c21-4416-a908-48bc8f7a7cef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:34.897147 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-44f972eb-4c21-4416-a908-48bc8f7a7cef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1286 microversion: 2.1 time: 0.165736 Aug 27 02:45:34.910534 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1802/3279] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:34 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1286 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:34.995741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:34.996382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: d9f34d83-efc5-4a91-8918-f506cd984323] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:35.004823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.009954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.010637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.011577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.012251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.014702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.039347 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Instance d9f34d83-efc5-4a91-8918-f506cd984323 could not be found. Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 HTTP/1.1 Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance d9f34d83-efc5-4a91-8918-f506cd984323 could not be found. Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'd9f34d83-efc5-4a91-8918-f506cd984323'} Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9f34d83-efc5-4a91-8918-f506cd984323 could not be found. Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9f34d83-efc5-4a91-8918-f506cd984323 could not be found. Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.041201 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.046805 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.046805 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.046805 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:35.046805 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:35.046805 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9f34d83-efc5-4a91-8918-f506cd984323 could not be found. Aug 27 02:45:35.046805 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.046805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Instance d9f34d83-efc5-4a91-8918-f506cd984323 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:35.046805 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-80d35ca9-2f56-422b-bbb8-d018597d94f3 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323" status: 404 len: 111 microversion: 2.1 time: 0.054029 Aug 27 02:45:35.046805 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1478/3280] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:34 2022] GET /compute/v2.1/servers/d9f34d83-efc5-4a91-8918-f506cd984323 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:35.056736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d13c59d0-f922-4057-a408-9351d9b105bd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2921e310>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.098191 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-d13c59d0-f922-4057-a408-9351d9b105bd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Image not found. Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d13c59d0-f922-4057-a408-9351d9b105bd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 HTTP/1.1 Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '21920eaf-c7be-4b60-813a-55711cc37486'} Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 21920eaf-c7be-4b60-813a-55711cc37486 to delete Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 21920eaf-c7be-4b60-813a-55711cc37486 could not be found. Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.101926 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d13c59d0-f922-4057-a408-9351d9b105bd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d13c59d0-f922-4057-a408-9351d9b105bd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486" status: 404 len: 62 microversion: 2.1 time: 0.055359 Aug 27 02:45:35.114953 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1803/3281] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:35 2022] DELETE /compute/v2.1/images/21920eaf-c7be-4b60-813a-55711cc37486 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:45:35.128632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.129506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:35.141219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.142129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.142918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.144491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.145351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.146618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.174044 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 HTTP/1.1 Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'e103b49d-103b-42ab-8f83-f00e41579687'} Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:35.177203 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:35.181975 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e75a8c3c-534c-4f77-9b3f-2de8108f1731 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 404 len: 111 microversion: 2.1 time: 0.060294 Aug 27 02:45:35.185865 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1479/3282] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:35 2022] DELETE /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:35.191472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.192401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: e103b49d-103b-42ab-8f83-f00e41579687] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:35.209984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.212346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.213404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.215994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.216778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.217549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.251460 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 HTTP/1.1 Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'e103b49d-103b-42ab-8f83-f00e41579687'} Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.255206 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.260230 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.260230 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.260230 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:35.260230 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:35.260230 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. Aug 27 02:45:35.260230 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.260230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Instance e103b49d-103b-42ab-8f83-f00e41579687 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:35.260230 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c48e9f03-3357-4911-8e31-8e6a540af188 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687" status: 404 len: 111 microversion: 2.1 time: 0.070518 Aug 27 02:45:35.261821 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1804/3283] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:35 2022] GET /compute/v2.1/servers/e103b49d-103b-42ab-8f83-f00e41579687 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:45:35.284165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b277396a-267c-48dd-8fd0-8adcdbd98095 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d2e6c7280>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.350513 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-b277396a-267c-48dd-8fd0-8adcdbd98095 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Image not found. Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b277396a-267c-48dd-8fd0-8adcdbd98095 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 HTTP/1.1 Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: exception: Image not found. Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'af5761f7-211f-4bc1-8b8d-5710b2b5c8b6'} Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 to delete Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 could not be found. Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.352461 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:45:35.356549 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.359902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b277396a-267c-48dd-8fd0-8adcdbd98095 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Image not found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:35.361183 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b277396a-267c-48dd-8fd0-8adcdbd98095 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6" status: 404 len: 62 microversion: 2.1 time: 0.093543 Aug 27 02:45:35.362009 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1480/3284] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:35 2022] DELETE /compute/v2.1/images/af5761f7-211f-4bc1-8b8d-5710b2b5c8b6 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:45:35.372204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.372713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:35.385932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.387321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.387668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.388482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.388957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.389864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.426163 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 HTTP/1.1 Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'b863d40c-1266-4beb-a51e-02d683ffba71'} Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:35.428651 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. Aug 27 02:45:35.433331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.433331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.433331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.433331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.433331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.433331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.433331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:35.433331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:35.433331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. Aug 27 02:45:35.433331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.435270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:35.436357 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2779c4c7-4969-4254-a084-637aef73b139 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 404 len: 111 microversion: 2.1 time: 0.068318 Aug 27 02:45:35.437359 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1805/3285] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:35 2022] DELETE /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:35.448244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.449077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: b863d40c-1266-4beb-a51e-02d683ffba71] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:35.458171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.459180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.459813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.460761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.461231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.461661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.481310 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 HTTP/1.1 Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'b863d40c-1266-4beb-a51e-02d683ffba71'} Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.483356 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.487853 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.487853 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.487853 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:35.487853 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:35.487853 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. Aug 27 02:45:35.487853 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.489258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Instance b863d40c-1266-4beb-a51e-02d683ffba71 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:35.490662 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0b491683-0412-44bc-a102-35d696860984 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71" status: 404 len: 111 microversion: 2.1 time: 0.046945 Aug 27 02:45:35.491932 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1481/3286] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:35 2022] GET /compute/v2.1/servers/b863d40c-1266-4beb-a51e-02d683ffba71 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:35.504155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3351ae70-5be7-47c9-b85a-ec8f8a332972 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '.version_select at 0x7f4d29297a60>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.557700 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3351ae70-5be7-47c9-b85a-ec8f8a332972 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Image not found. Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3351ae70-5be7-47c9-b85a-ec8f8a332972 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 HTTP/1.1 Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57'} Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 to delete Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 could not be found. Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.561529 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:45:35.566799 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.570325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3351ae70-5be7-47c9-b85a-ec8f8a332972 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:35.572228 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3351ae70-5be7-47c9-b85a-ec8f8a332972 tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57" status: 404 len: 62 microversion: 2.1 time: 0.074810 Aug 27 02:45:35.573513 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1806/3287] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:35 2022] DELETE /compute/v2.1/images/8c8ab47d-59b8-40a9-ac5f-1725bdc8bf57 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:45:35.592609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.597394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:35.619849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.620440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.620907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.625693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.626205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.626667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.663985 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b HTTP/1.1 Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'ada54a54-66b3-47b3-87dd-e3e7b5bf934b'} Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:35.667859 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. Aug 27 02:45:35.671949 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.671949 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.671949 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.671949 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.671949 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.671949 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.671949 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:35.671949 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:35.671949 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. Aug 27 02:45:35.671949 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.674946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:35.679078 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6d7319d6-c342-42ad-9f88-f4233bbe3dea tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "DELETE /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 404 len: 111 microversion: 2.1 time: 0.096672 Aug 27 02:45:35.681558 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1482/3288] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:35 2022] DELETE /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:35.691374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.692055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] [instance: ada54a54-66b3-47b3-87dd-e3e7b5bf934b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:35.709922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.710608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.711150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.711960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.715015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.720699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.741706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45a1e3e4-0886-42e5-b898-0055bb236290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.742573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-45a1e3e4-0886-42e5-b898-0055bb236290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:35.757325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45a1e3e4-0886-42e5-b898-0055bb236290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.757911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45a1e3e4-0886-42e5-b898-0055bb236290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.758320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45a1e3e4-0886-42e5-b898-0055bb236290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.759077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45a1e3e4-0886-42e5-b898-0055bb236290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.759540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45a1e3e4-0886-42e5-b898-0055bb236290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.760173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45a1e3e4-0886-42e5-b898-0055bb236290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.765466 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] HTTP exception thrown: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Request method failure captured: Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b HTTP/1.1 Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYQqXX0kERnQzqkYdk402p5C8BYXt0kUq5Td3opDq9C__L9mJSsekIxBUJ7hlAZ0A1qPBst1pmOrtZbfiTIWta2gJmx16UnV17cx8742kDz8Yik4Hl66xw9rN76unBWvDjMjWmnu8sjYp6ZxlhrTTt1PObFTZVU7_o_zixTZuTw5wz0 Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3a7deb7b2e0f44db9408c63d75634406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3a7deb7b2e0f44db9408c63d75634406"}]}] Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 3a7deb7b2e0f44db9408c63d75634406 Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesTestJSON-2096561128 Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 3ba5de1a75904079a6d4ae345c9c8025 Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesTestJSON-2096561128-project Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'ada54a54-66b3-47b3-87dd-e3e7b5bf934b'} Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.772299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:35.787707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:35.787707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:35.787707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:35.787707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:35.787707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. Aug 27 02:45:35.787707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:35.794058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] Returning 404 to user: Instance ada54a54-66b3-47b3-87dd-e3e7b5bf934b could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:35.797036 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6eb58679-3034-438f-96c1-7d5d60dd0abd tempest-ImagesTestJSON-2096561128 tempest-ImagesTestJSON-2096561128-project] 10.222.0.99 "GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b" status: 404 len: 111 microversion: 2.1 time: 0.110459 Aug 27 02:45:35.801149 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1807/3289] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:35 2022] GET /compute/v2.1/servers/ada54a54-66b3-47b3-87dd-e3e7b5bf934b => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:35.816602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-804693a7-f5c8-4891-8636-d147cc5a8e21 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.819325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-804693a7-f5c8-4891-8636-d147cc5a8e21 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:35.835863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-804693a7-f5c8-4891-8636-d147cc5a8e21 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.836379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-804693a7-f5c8-4891-8636-d147cc5a8e21 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.836836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-804693a7-f5c8-4891-8636-d147cc5a8e21 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.837599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-804693a7-f5c8-4891-8636-d147cc5a8e21 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.838103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-804693a7-f5c8-4891-8636-d147cc5a8e21 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.838565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-804693a7-f5c8-4891-8636-d147cc5a8e21 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.952853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-45a1e3e4-0886-42e5-b898-0055bb236290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:35.964320 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-45a1e3e4-0886-42e5-b898-0055bb236290 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 200 len: 1300 microversion: 2.1 time: 0.226937 Aug 27 02:45:35.978727 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1483/3290] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:35 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 1300 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:35.986272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9197c695-2b79-40a1-b97f-10b8fb699125 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:35.987438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9197c695-2b79-40a1-b97f-10b8fb699125 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:35.997067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9197c695-2b79-40a1-b97f-10b8fb699125 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:35.997931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9197c695-2b79-40a1-b97f-10b8fb699125 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:35.998542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9197c695-2b79-40a1-b97f-10b8fb699125 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:35.999991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9197c695-2b79-40a1-b97f-10b8fb699125 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:36.001259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9197c695-2b79-40a1-b97f-10b8fb699125 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:36.002252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9197c695-2b79-40a1-b97f-10b8fb699125 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:36.265590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9197c695-2b79-40a1-b97f-10b8fb699125 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:36.284195 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9197c695-2b79-40a1-b97f-10b8fb699125 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1274 microversion: 2.1 time: 0.303786 Aug 27 02:45:36.285229 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1484/3291] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:35 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:36.719006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-804693a7-f5c8-4891-8636-d147cc5a8e21 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:36.748158 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-804693a7-f5c8-4891-8636-d147cc5a8e21 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737" status: 200 len: 1521 microversion: 2.1 time: 0.945170 Aug 27 02:45:36.759447 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1808/3292] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:35 2022] GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737 => generated 1521 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:36.992166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:36.992794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: a34ed4c2-b127-4bef-a152-eb401414f9a9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:37.005386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.011592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.012543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.013970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.014646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.023524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.060077 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] HTTP exception thrown: Instance a34ed4c2-b127-4bef-a152-eb401414f9a9 could not be found. Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Request method failure captured: Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 HTTP/1.1 Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYKm_d0JxxqDywZg3wD_COBvn-f59wxHd5W6ptfAZGBGOv_Flzhk-aSso1ZnVxHt4Wn3_mE_eMwZzPt26zHlVRxUGMxoQr16MR2iVAECQBE2HR0fGaw53Bq8Fj7F37vVG3tMdQMgN6KVjqYBiNLXuttuRfd3bP6t4FmBCNrcWoio4C8 Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_69945a768314456fae9bf75e854510c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/69945a768314456fae9bf75e854510c2"}]}] Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 281834367cf24a809448bdeea36a9c97 Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance a34ed4c2-b127-4bef-a152-eb401414f9a9 could not be found. Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'a34ed4c2-b127-4bef-a152-eb401414f9a9'} Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a34ed4c2-b127-4bef-a152-eb401414f9a9 could not be found. Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a34ed4c2-b127-4bef-a152-eb401414f9a9 could not be found. Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:37.061825 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:37.068139 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:37.068139 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:37.068139 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:37.068139 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:37.068139 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:37.068139 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a34ed4c2-b127-4bef-a152-eb401414f9a9 could not be found. Aug 27 02:45:37.068139 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:37.068139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Returning 404 to user: Instance a34ed4c2-b127-4bef-a152-eb401414f9a9 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:37.070209 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1369ae6e-d233-4a0d-af76-34e481362c79 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9" status: 404 len: 111 microversion: 2.1 time: 0.081822 Aug 27 02:45:37.079898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1b82163c-4480-48fa-97e0-195ecf895d31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:37.080416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1b82163c-4480-48fa-97e0-195ecf895d31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:37.083451 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1485/3293] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:36 2022] GET /compute/v2.1/servers/a34ed4c2-b127-4bef-a152-eb401414f9a9 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:37.097911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b82163c-4480-48fa-97e0-195ecf895d31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.098834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b82163c-4480-48fa-97e0-195ecf895d31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.099618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b82163c-4480-48fa-97e0-195ecf895d31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.100593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b82163c-4480-48fa-97e0-195ecf895d31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.101258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b82163c-4480-48fa-97e0-195ecf895d31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.101923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b82163c-4480-48fa-97e0-195ecf895d31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.154346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1b82163c-4480-48fa-97e0-195ecf895d31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:37.280160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e4c9464e-1130-4a14-9cc9-36eb29f2b941 req-dcd0a134-e229-4f06-a4e2-8472a605590c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c634682c-07d0-4f26-a6b5-b0f086cbec00", "name": "network-vif-deleted", "tag": "94c9bbfb-ac17-47d2-86a4-695f53513819"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:37.328960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e4c9464e-1130-4a14-9cc9-36eb29f2b941 req-dcd0a134-e229-4f06-a4e2-8472a605590c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.329222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e4c9464e-1130-4a14-9cc9-36eb29f2b941 req-dcd0a134-e229-4f06-a4e2-8472a605590c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.330095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e4c9464e-1130-4a14-9cc9-36eb29f2b941 req-dcd0a134-e229-4f06-a4e2-8472a605590c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.381905 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e4c9464e-1130-4a14-9cc9-36eb29f2b941 req-dcd0a134-e229-4f06-a4e2-8472a605590c service nova] Creating event network-vif-deleted:94c9bbfb-ac17-47d2-86a4-695f53513819 for instance c634682c-07d0-4f26-a6b5-b0f086cbec00 on n-h1-852084-5 Aug 27 02:45:37.387238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:37.392363 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e4c9464e-1130-4a14-9cc9-36eb29f2b941 req-dcd0a134-e229-4f06-a4e2-8472a605590c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116672 Aug 27 02:45:37.394117 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1486/3294] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:37.401155 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1b82163c-4480-48fa-97e0-195ecf895d31 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "DELETE /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 204 len: 0 microversion: 2.1 time: 0.325997 Aug 27 02:45:37.402232 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1809/3295] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:37 2022] DELETE /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:37.402637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7d234490-9ded-4271-b89f-4e86ce1d0c51 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:37.403913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7d234490-9ded-4271-b89f-4e86ce1d0c51 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:37.413215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d234490-9ded-4271-b89f-4e86ce1d0c51 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.413818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d234490-9ded-4271-b89f-4e86ce1d0c51 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.414422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d234490-9ded-4271-b89f-4e86ce1d0c51 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.415646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d234490-9ded-4271-b89f-4e86ce1d0c51 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.417304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d234490-9ded-4271-b89f-4e86ce1d0c51 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.418116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d234490-9ded-4271-b89f-4e86ce1d0c51 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.423917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0132193-aa06-47db-92d8-7d673752d203 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:37.426559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b0132193-aa06-47db-92d8-7d673752d203 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:37.455764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0132193-aa06-47db-92d8-7d673752d203 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.461171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0132193-aa06-47db-92d8-7d673752d203 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.462454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0132193-aa06-47db-92d8-7d673752d203 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.466220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0132193-aa06-47db-92d8-7d673752d203 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.467425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0132193-aa06-47db-92d8-7d673752d203 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.468206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0132193-aa06-47db-92d8-7d673752d203 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.608391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7d234490-9ded-4271-b89f-4e86ce1d0c51 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:37.628322 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7d234490-9ded-4271-b89f-4e86ce1d0c51 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1274 microversion: 2.1 time: 0.233061 Aug 27 02:45:37.628949 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1487/3296] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:37 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:37.784118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-51bc8c0e-ac9e-4ce9-8460-73922ed32291 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:37.784746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-51bc8c0e-ac9e-4ce9-8460-73922ed32291 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:37.800010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0e-ac9e-4ce9-8460-73922ed32291 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.807331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0e-ac9e-4ce9-8460-73922ed32291 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.808105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0e-ac9e-4ce9-8460-73922ed32291 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:37.810092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0e-ac9e-4ce9-8460-73922ed32291 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:37.814050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0e-ac9e-4ce9-8460-73922ed32291 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:37.818349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0e-ac9e-4ce9-8460-73922ed32291 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:38.351355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-51bc8c0e-ac9e-4ce9-8460-73922ed32291 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:38.368460 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-51bc8c0e-ac9e-4ce9-8460-73922ed32291 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737" status: 200 len: 1521 microversion: 2.1 time: 0.589509 Aug 27 02:45:38.382882 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1488/3297] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:37 2022] GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737 => generated 1521 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:38.442238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b0132193-aa06-47db-92d8-7d673752d203 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:38.463487 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b0132193-aa06-47db-92d8-7d673752d203 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1507 microversion: 2.1 time: 1.052070 Aug 27 02:45:38.468471 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1810/3298] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:37 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1507 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:38.655879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d80aadbb-919a-4b09-80ab-8196aef7a56a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:38.657508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d80aadbb-919a-4b09-80ab-8196aef7a56a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:38.688138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d80aadbb-919a-4b09-80ab-8196aef7a56a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:38.693899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d80aadbb-919a-4b09-80ab-8196aef7a56a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:38.696780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d80aadbb-919a-4b09-80ab-8196aef7a56a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:38.699665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d80aadbb-919a-4b09-80ab-8196aef7a56a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:38.704656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d80aadbb-919a-4b09-80ab-8196aef7a56a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:38.707580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d80aadbb-919a-4b09-80ab-8196aef7a56a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.095461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d80aadbb-919a-4b09-80ab-8196aef7a56a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:39.110909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d80aadbb-919a-4b09-80ab-8196aef7a56a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1274 microversion: 2.1 time: 0.463738 Aug 27 02:45:39.124412 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1811/3299] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:38 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1274 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:39.367763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-390907833", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": "none"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:39.390549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-afc9c5c5-1b4e-4f2a-8776-d8930598471e tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:39.391718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-afc9c5c5-1b4e-4f2a-8776-d8930598471e tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:39.419054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afc9c5c5-1b4e-4f2a-8776-d8930598471e tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.419578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afc9c5c5-1b4e-4f2a-8776-d8930598471e tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.424312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afc9c5c5-1b4e-4f2a-8776-d8930598471e tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.429923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afc9c5c5-1b4e-4f2a-8776-d8930598471e tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.430428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afc9c5c5-1b4e-4f2a-8776-d8930598471e tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.434065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afc9c5c5-1b4e-4f2a-8776-d8930598471e tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.561455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:39.562272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:39.563037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:39.564885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:39.566515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:39.596603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.601806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.601806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.602765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.603500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.604194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.671341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Getting quotas for project eb86f82e39d24217bed0c5317fce8449. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:39.687311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Getting quotas for user 8706cfc5cb634a66bf28dfcdd1efde54 and project eb86f82e39d24217bed0c5317fce8449. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:39.688432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-afc9c5c5-1b4e-4f2a-8776-d8930598471e tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1418fca23c99496a958fffe6cc021689', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc3c2d04bf44b49a932c2eae27cf04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:39.700737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:39.728611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:39.728857 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-afc9c5c5-1b4e-4f2a-8776-d8930598471e tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737" status: 200 len: 1308 microversion: 2.1 time: 0.341742 Aug 27 02:45:39.737758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:39.742170 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1812/3300] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:39 2022] GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737 => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:39.751431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2352ba15-03a4-49d5-a609-5eee1d95ac11 req-1c245505-2f82-4358-813b-c4be47539170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902974a7-3280-4391-b745-432c3a4f1737", "name": "network-vif-deleted", "tag": "99e417ab-547f-40b2-8976-ea9ef401d5f5"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:39.806755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2352ba15-03a4-49d5-a609-5eee1d95ac11 req-1c245505-2f82-4358-813b-c4be47539170 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.808121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2352ba15-03a4-49d5-a609-5eee1d95ac11 req-1c245505-2f82-4358-813b-c4be47539170 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.809214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2352ba15-03a4-49d5-a609-5eee1d95ac11 req-1c245505-2f82-4358-813b-c4be47539170 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.855404 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4ad965cf-52a0-4ef1-a7bd-041e608bf462 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.470416 Aug 27 02:45:39.863335 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1489/3301] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:45:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:45:39.868224 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2352ba15-03a4-49d5-a609-5eee1d95ac11 req-1c245505-2f82-4358-813b-c4be47539170 service nova] Creating event network-vif-deleted:99e417ab-547f-40b2-8976-ea9ef401d5f5 for instance 902974a7-3280-4391-b745-432c3a4f1737 on n-h2-852084-5 Aug 27 02:45:39.881751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1e15aee9-2df1-4eec-ad41-54911e076f00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:39.884028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1e15aee9-2df1-4eec-ad41-54911e076f00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:39.900002 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2352ba15-03a4-49d5-a609-5eee1d95ac11 req-1c245505-2f82-4358-813b-c4be47539170 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155082 Aug 27 02:45:39.905015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e15aee9-2df1-4eec-ad41-54911e076f00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.905761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e15aee9-2df1-4eec-ad41-54911e076f00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.906551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e15aee9-2df1-4eec-ad41-54911e076f00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:39.908124 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1813/3302] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:39.926018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e15aee9-2df1-4eec-ad41-54911e076f00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:39.926765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd2280c8-5790-4144-95ba-a523223269e6 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:39.928334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd2280c8-5790-4144-95ba-a523223269e6 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:39.929269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e15aee9-2df1-4eec-ad41-54911e076f00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:39.929860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e15aee9-2df1-4eec-ad41-54911e076f00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.078996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd2280c8-5790-4144-95ba-a523223269e6 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:40.117445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd2280c8-5790-4144-95ba-a523223269e6 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:40.119256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd2280c8-5790-4144-95ba-a523223269e6 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:40.139032 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd2280c8-5790-4144-95ba-a523223269e6 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1277 microversion: 2.54 time: 0.228902 Aug 27 02:45:40.147006 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1814/3303] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:39 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:40.161017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8e42e04b-ae31-411d-83d6-753e8ed913ef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:40.164443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8e42e04b-ae31-411d-83d6-753e8ed913ef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:40.185940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e42e04b-ae31-411d-83d6-753e8ed913ef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.186978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e42e04b-ae31-411d-83d6-753e8ed913ef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.188095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e42e04b-ae31-411d-83d6-753e8ed913ef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.190697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e42e04b-ae31-411d-83d6-753e8ed913ef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.192967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e42e04b-ae31-411d-83d6-753e8ed913ef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.195498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e42e04b-ae31-411d-83d6-753e8ed913ef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.572044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8e42e04b-ae31-411d-83d6-753e8ed913ef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:40.605453 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8e42e04b-ae31-411d-83d6-753e8ed913ef tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1274 microversion: 2.1 time: 0.456769 Aug 27 02:45:40.640489 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1815/3304] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:40 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1274 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:40.645557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1e15aee9-2df1-4eec-ad41-54911e076f00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:40.668722 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1e15aee9-2df1-4eec-ad41-54911e076f00 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1465 microversion: 2.1 time: 0.802633 Aug 27 02:45:40.671459 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1490/3305] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:39 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1465 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:40.752195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:40.754597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: 902974a7-3280-4391-b745-432c3a4f1737] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:40.805807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.806719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.807535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.808869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.820974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.822295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.913989 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] HTTP exception thrown: Instance 902974a7-3280-4391-b745-432c3a4f1737 could not be found. Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Request method failure captured: Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737 HTTP/1.1 Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYUB3Cra_5HCjso70Z1Ngmxfo9Cop4N5v6fOOcQeGuRdusuY4GFYbgWURM5dqRX_a55Vv3JgVZs01ykT_F0OvZ5XwW351OKqDTSTJweJiqiVcmVwedgfbaN24sEYfMtCLgnlKOvSocnPaWJRZPOOfhWcXHxIWcrAHotQqpH3qxpwiZo Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b3fc3c2d04bf44b49a932c2eae27cf04"}]}] Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 1418fca23c99496a958fffe6cc021689 Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 902974a7-3280-4391-b745-432c3a4f1737 could not be found. Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '902974a7-3280-4391-b745-432c3a4f1737'} Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902974a7-3280-4391-b745-432c3a4f1737 could not be found. Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902974a7-3280-4391-b745-432c3a4f1737 could not be found. Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:40.921350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:40.934637 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:40.934637 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:40.934637 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:40.934637 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:40.934637 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:40.934637 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:40.934637 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902974a7-3280-4391-b745-432c3a4f1737 could not be found. Aug 27 02:45:40.934637 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:40.934637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Returning 404 to user: Instance 902974a7-3280-4391-b745-432c3a4f1737 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:40.934637 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a5f6b408-8185-4a03-a4b1-bfdef81cca36 tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737" status: 404 len: 111 microversion: 2.1 time: 0.177030 Aug 27 02:45:40.934637 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1816/3306] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:40 2022] GET /compute/v2.1/servers/902974a7-3280-4391-b745-432c3a4f1737 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:40.941178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:40.941178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] [instance: c634682c-07d0-4f26-a6b5-b0f086cbec00] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:40.967538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.967538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.967912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:40.968820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:40.972462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:40.972922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:41.034490 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] HTTP exception thrown: Instance c634682c-07d0-4f26-a6b5-b0f086cbec00 could not be found. Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Request method failure captured: Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 HTTP/1.1 Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYUB3Cra_5HCjso70Z1Ngmxfo9Cop4N5v6fOOcQeGuRdusuY4GFYbgWURM5dqRX_a55Vv3JgVZs01ykT_F0OvZ5XwW351OKqDTSTJweJiqiVcmVwedgfbaN24sEYfMtCLgnlKOvSocnPaWJRZPOOfhWcXHxIWcrAHotQqpH3qxpwiZo Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b3fc3c2d04bf44b49a932c2eae27cf04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b3fc3c2d04bf44b49a932c2eae27cf04"}]}] Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: b3fc3c2d04bf44b49a932c2eae27cf04 Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-883441354 Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 1418fca23c99496a958fffe6cc021689 Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ListServersNegativeTestJSON-883441354-project Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance c634682c-07d0-4f26-a6b5-b0f086cbec00 could not be found. Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'c634682c-07d0-4f26-a6b5-b0f086cbec00'} Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c634682c-07d0-4f26-a6b5-b0f086cbec00 could not be found. Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c634682c-07d0-4f26-a6b5-b0f086cbec00 could not be found. Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:41.039611 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:41.044085 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:41.044085 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:41.044085 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:41.044085 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:41.044085 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:41.044085 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:41.044085 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c634682c-07d0-4f26-a6b5-b0f086cbec00 could not be found. Aug 27 02:45:41.044085 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:41.046500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] Returning 404 to user: Instance c634682c-07d0-4f26-a6b5-b0f086cbec00 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:41.050953 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-625ff148-8e8a-46b7-a80e-6ef74335de7a tempest-ListServersNegativeTestJSON-883441354 tempest-ListServersNegativeTestJSON-883441354-project] 10.222.0.99 "GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00" status: 404 len: 111 microversion: 2.1 time: 0.115143 Aug 27 02:45:41.056645 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1491/3307] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:40 2022] GET /compute/v2.1/servers/c634682c-07d0-4f26-a6b5-b0f086cbec00 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:41.168756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3a0d531c-fb3f-4d32-892f-4fc5e2985eef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:41.169710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3a0d531c-fb3f-4d32-892f-4fc5e2985eef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:41.423373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-349f7a5c-4a2f-4cc2-8d38-a56fb03f50a5 req-1317a7cb-6a0f-4fc9-9280-3208167a4427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120c91be-4afa-4162-8769-618367cf59c6", "name": "network-vif-deleted", "tag": "78c29adc-056f-496c-9618-0392a270c5f5"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:41.456250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-349f7a5c-4a2f-4cc2-8d38-a56fb03f50a5 req-1317a7cb-6a0f-4fc9-9280-3208167a4427 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:41.459870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-349f7a5c-4a2f-4cc2-8d38-a56fb03f50a5 req-1317a7cb-6a0f-4fc9-9280-3208167a4427 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:41.460379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-349f7a5c-4a2f-4cc2-8d38-a56fb03f50a5 req-1317a7cb-6a0f-4fc9-9280-3208167a4427 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:41.557962 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-349f7a5c-4a2f-4cc2-8d38-a56fb03f50a5 req-1317a7cb-6a0f-4fc9-9280-3208167a4427 service nova] Creating event network-vif-deleted:78c29adc-056f-496c-9618-0392a270c5f5 for instance 120c91be-4afa-4162-8769-618367cf59c6 on n-h1-852084-5 Aug 27 02:45:41.591506 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-349f7a5c-4a2f-4cc2-8d38-a56fb03f50a5 req-1317a7cb-6a0f-4fc9-9280-3208167a4427 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163870 Aug 27 02:45:41.597644 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1492/3308] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:45:41.662115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2420a03c-e51f-4730-a2fb-ecc914c41c3b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:41.671066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2420a03c-e51f-4730-a2fb-ecc914c41c3b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:41.724029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2420a03c-e51f-4730-a2fb-ecc914c41c3b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:41.738542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2420a03c-e51f-4730-a2fb-ecc914c41c3b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:41.741121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2420a03c-e51f-4730-a2fb-ecc914c41c3b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:41.746351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2420a03c-e51f-4730-a2fb-ecc914c41c3b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:41.748227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2420a03c-e51f-4730-a2fb-ecc914c41c3b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:41.749468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2420a03c-e51f-4730-a2fb-ecc914c41c3b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.144930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3a0d531c-fb3f-4d32-892f-4fc5e2985eef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:42.174251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3a0d531c-fb3f-4d32-892f-4fc5e2985eef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:42.189508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3a0d531c-fb3f-4d32-892f-4fc5e2985eef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:42.201845 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3a0d531c-fb3f-4d32-892f-4fc5e2985eef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1277 microversion: 2.54 time: 1.036545 Aug 27 02:45:42.206742 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1817/3309] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:41 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1277 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:45:42.225408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:42.233956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:42.263342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.264469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.264469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.265047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.267134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.268876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.354811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:42.355325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:42.355781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:42.356254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lazy-loading 'fault' on Instance uuid 120c91be-4afa-4162-8769-618367cf59c6 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:42.524530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:42.535124 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-53bf01c2-89b9-430e-ab7d-0dbc8db2c488 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 200 len: 1304 microversion: 2.1 time: 0.324810 Aug 27 02:45:42.552719 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1818/3310] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:42 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 1304 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:42.851873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2420a03c-e51f-4730-a2fb-ecc914c41c3b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:42.905397 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2420a03c-e51f-4730-a2fb-ecc914c41c3b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1316 microversion: 2.1 time: 1.255223 Aug 27 02:45:42.908745 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1493/3311] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:41 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1316 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:43.245937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:43.246575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:43.259773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.262577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.263302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.266739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.267728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.268381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.383086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=10 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:43.729097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:43.761957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:43.769472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:43.773438 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b1669891-c329-42b8-8809-2253d9691586 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1337 microversion: 2.54 time: 0.531442 Aug 27 02:45:43.787856 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1494/3312] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:43 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1337 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:45:43.802776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:43.804009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 120c91be-4afa-4162-8769-618367cf59c6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:43.811505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-539196400", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:43.813447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.814193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.814647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.815406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.815879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.816378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.852104 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] HTTP exception thrown: Instance 120c91be-4afa-4162-8769-618367cf59c6 could not be found. Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Request method failure captured: Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 HTTP/1.1 Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYKm_d0JxxqDywZg3wD_COBvn-f59wxHd5W6ptfAZGBGOv_Flzhk-aSso1ZnVxHt4Wn3_mE_eMwZzPt26zHlVRxUGMxoQr16MR2iVAECQBE2HR0fGaw53Bq8Fj7F37vVG3tMdQMgN6KVjqYBiNLXuttuRfd3bP6t4FmBCNrcWoio4C8 Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_69945a768314456fae9bf75e854510c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/69945a768314456fae9bf75e854510c2"}]}] Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 281834367cf24a809448bdeea36a9c97 Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 120c91be-4afa-4162-8769-618367cf59c6 could not be found. Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '120c91be-4afa-4162-8769-618367cf59c6'} Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120c91be-4afa-4162-8769-618367cf59c6 could not be found. Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120c91be-4afa-4162-8769-618367cf59c6 could not be found. Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:43.853844 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:43.859227 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:43.859227 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:43.859227 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:43.859227 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:43.859227 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:43.859227 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120c91be-4afa-4162-8769-618367cf59c6 could not be found. Aug 27 02:45:43.859227 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:45:43.859227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Returning 404 to user: Instance 120c91be-4afa-4162-8769-618367cf59c6 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:43.859227 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-05342b90-51e2-4639-a96e-71ba710706cc tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6" status: 404 len: 111 microversion: 2.1 time: 0.057575 Aug 27 02:45:43.860747 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1495/3313] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:43 2022] GET /compute/v2.1/servers/120c91be-4afa-4162-8769-618367cf59c6 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:43.869370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0bf99885-4002-42a3-8077-0b368f45d405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:43.870078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0bf99885-4002-42a3-8077-0b368f45d405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:43.888113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf99885-4002-42a3-8077-0b368f45d405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.888623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf99885-4002-42a3-8077-0b368f45d405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.891378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf99885-4002-42a3-8077-0b368f45d405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.895769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf99885-4002-42a3-8077-0b368f45d405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:43.896372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf99885-4002-42a3-8077-0b368f45d405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:43.897032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf99885-4002-42a3-8077-0b368f45d405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:43.930322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:45:43.970205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0bf99885-4002-42a3-8077-0b368f45d405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:44.197103 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0bf99885-4002-42a3-8077-0b368f45d405 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "DELETE /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 204 len: 0 microversion: 2.1 time: 0.336140 Aug 27 02:45:44.198092 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1496/3314] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:43 2022] DELETE /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:44.208554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d3e0c9ba-0282-4c46-8742-c1ece2562f9d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:44.213093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d3e0c9ba-0282-4c46-8742-c1ece2562f9d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:44.226174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3e0c9ba-0282-4c46-8742-c1ece2562f9d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:44.228622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3e0c9ba-0282-4c46-8742-c1ece2562f9d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:44.231135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3e0c9ba-0282-4c46-8742-c1ece2562f9d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:44.232179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3e0c9ba-0282-4c46-8742-c1ece2562f9d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:44.236114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3e0c9ba-0282-4c46-8742-c1ece2562f9d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:44.236950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3e0c9ba-0282-4c46-8742-c1ece2562f9d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:44.703039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:44.703760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:44.704621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:44.705316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:44.706111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:44.761942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:44.762745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:44.763481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:44.764818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:44.766247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:44.766962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:44.831845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Getting quotas for project 5bedef4a4cad40db8a5fb7c04a01d787. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:44.848082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Getting quotas for user 60ce49610f90415a946edb24fd34b509 and project 5bedef4a4cad40db8a5fb7c04a01d787. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:44.878626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:45:44.885221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:45:45.005439 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-87600237-2db8-424f-92da-13013f9e62cf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.075889 Aug 27 02:45:45.007248 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1819/3315] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:45:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:45:45.018288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4c6b16a-7f3e-4990-ba85-abd6422b8322 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:45.019976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4c6b16a-7f3e-4990-ba85-abd6422b8322 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:45.035203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c6b16a-7f3e-4990-ba85-abd6422b8322 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:45.036465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c6b16a-7f3e-4990-ba85-abd6422b8322 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:45.037544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c6b16a-7f3e-4990-ba85-abd6422b8322 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:45.039491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c6b16a-7f3e-4990-ba85-abd6422b8322 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:45.040609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c6b16a-7f3e-4990-ba85-abd6422b8322 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:45.041717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4c6b16a-7f3e-4990-ba85-abd6422b8322 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:45.054966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d3e0c9ba-0282-4c46-8742-c1ece2562f9d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:45.087643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d3e0c9ba-0282-4c46-8742-c1ece2562f9d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1316 microversion: 2.1 time: 0.888041 Aug 27 02:45:45.091270 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1497/3316] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:44 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1316 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:45.101136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:45.103600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:45.113411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:45.114471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:45.115192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:45.117833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:45.118650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:45.119355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:45.357302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:45.375602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:45.381423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:45.403515 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8e78368d-ea32-493f-935d-387a8d3d2a37 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1335 microversion: 2.54 time: 0.309735 Aug 27 02:45:45.406371 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1498/3317] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:45 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1335 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:45.418408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-95250ffd-7c89-4426-9a88-002fe742af2a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:45.419884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-95250ffd-7c89-4426-9a88-002fe742af2a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:45.763657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-95250ffd-7c89-4426-9a88-002fe742af2a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:45.776254 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-95250ffd-7c89-4426-9a88-002fe742af2a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1213 microversion: 2.1 time: 0.368045 Aug 27 02:45:45.792674 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1499/3318] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:45 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1213 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:45.874355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4c6b16a-7f3e-4990-ba85-abd6422b8322 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:45.889337 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4c6b16a-7f3e-4990-ba85-abd6422b8322 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1495 microversion: 2.1 time: 0.878340 Aug 27 02:45:45.891227 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1820/3319] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:45 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1495 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:46.125695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c95eea69-7b5e-43cc-bd0d-6f95c73abae8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:46.126753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c95eea69-7b5e-43cc-bd0d-6f95c73abae8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:46.170496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c95eea69-7b5e-43cc-bd0d-6f95c73abae8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.171366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c95eea69-7b5e-43cc-bd0d-6f95c73abae8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.172196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c95eea69-7b5e-43cc-bd0d-6f95c73abae8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.173398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c95eea69-7b5e-43cc-bd0d-6f95c73abae8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.174235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c95eea69-7b5e-43cc-bd0d-6f95c73abae8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.174996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c95eea69-7b5e-43cc-bd0d-6f95c73abae8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.246655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:46.257260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:46.299950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.301067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.311395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.314022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.317957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.321742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.335386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:46.378515 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] HTTP exception thrown: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Request method failure captured: Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 HTTP/1.1 Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYND6UrdDlvmV6wseSqAPa0vE1nqSPR69SfsIzSd0fIEP_6ZK3IYPtr0nSHPoB35fnYnFRlxBxeoCBUfEl4VRS5JErHjXXXyTwUHhxo-Iura-Sd2GSt79cTgpNBhg8oaXx-tTuH6yyrErDApjDgkgwST8ovbNPwjKDZQnLsza0R7DP0 Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 38241ddbb3324f4db5a3c6bbdd46cc5f Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TaggedBootDevicesTest-1103139010 Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_38241ddbb3324f4db5a3c6bbdd46cc5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/38241ddbb3324f4db5a3c6bbdd46cc5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/38241ddbb3324f4db5a3c6bbdd46cc5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/38241ddbb3324f4db5a3c6bbdd46cc5f"}]}] Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TaggedBootDevicesTest-1103139010 Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 38241ddbb3324f4db5a3c6bbdd46cc5f Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1103139010 Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TaggedBootDevicesTest-1103139010-project Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 6cf1a7e187724affa4066f06ad8a908f Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TaggedBootDevicesTest-1103139010-project Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4cbd5532-9135-4bc2-890e-ba2e9b080cf2'} Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:46.382427 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:46.392257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:46.392257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:46.392257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:46.392257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:46.392257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:46.392257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:46.392257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:46.392257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:46.392257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:46.392257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:46.392257 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:46.395559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Returning 404 to user: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:46.397692 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-46ac70c9-5fd1-4901-8693-7bf8ca4eb758 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 404 len: 111 microversion: 2.32 time: 0.169971 Aug 27 02:45:46.399890 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1821/3320] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:45:46 2022] DELETE /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:46.429821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:46.431442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] [instance: 4cbd5532-9135-4bc2-890e-ba2e9b080cf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:46.459823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.462794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.466147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.470918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.471995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.472656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.536620 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] HTTP exception thrown: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Request method failure captured: Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 HTTP/1.1 Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYND6UrdDlvmV6wseSqAPa0vE1nqSPR69SfsIzSd0fIEP_6ZK3IYPtr0nSHPoB35fnYnFRlxBxeoCBUfEl4VRS5JErHjXXXyTwUHhxo-Iura-Sd2GSt79cTgpNBhg8oaXx-tTuH6yyrErDApjDgkgwST8ovbNPwjKDZQnLsza0R7DP0 Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.32 Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 38241ddbb3324f4db5a3c6bbdd46cc5f Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TaggedBootDevicesTest-1103139010 Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_38241ddbb3324f4db5a3c6bbdd46cc5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/38241ddbb3324f4db5a3c6bbdd46cc5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/38241ddbb3324f4db5a3c6bbdd46cc5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/38241ddbb3324f4db5a3c6bbdd46cc5f"}]}] Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TaggedBootDevicesTest-1103139010 Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 38241ddbb3324f4db5a3c6bbdd46cc5f Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1103139010 Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TaggedBootDevicesTest-1103139010-project Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 6cf1a7e187724affa4066f06ad8a908f Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TaggedBootDevicesTest-1103139010-project Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4cbd5532-9135-4bc2-890e-ba2e9b080cf2'} Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:46.541923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:46.551630 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:46.551630 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:46.551630 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:46.551630 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:46.551630 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:46.551630 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:46.551630 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. Aug 27 02:45:46.551630 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:46.559081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] Returning 404 to user: Instance 4cbd5532-9135-4bc2-890e-ba2e9b080cf2 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:46.559081 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5deac57e-fcca-4147-8929-6d351f62a3f2 tempest-TaggedBootDevicesTest-1103139010 tempest-TaggedBootDevicesTest-1103139010-project] 10.222.0.99 "GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2" status: 404 len: 111 microversion: 2.32 time: 0.147219 Aug 27 02:45:46.559852 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1822/3321] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:46 2022] GET /compute/v2.1/servers/4cbd5532-9135-4bc2-890e-ba2e9b080cf2 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:45:46.574480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:46.576061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:46.591787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.593008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.594832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.596638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:46.597803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:46.598866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:46.957629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:46.983158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:46.999398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:47.001760 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5851c346-6e5e-4040-aba5-2970d5148e60 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1356 microversion: 2.54 time: 0.439562 Aug 27 02:45:47.002873 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1823/3322] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:46 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1356 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:47.020514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7fb2af6-6797-44be-bdb0-7350c4dcac15 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:47.028324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d7fb2af6-6797-44be-bdb0-7350c4dcac15 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:47.047325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7fb2af6-6797-44be-bdb0-7350c4dcac15 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.057320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7fb2af6-6797-44be-bdb0-7350c4dcac15 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.060816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7fb2af6-6797-44be-bdb0-7350c4dcac15 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.063097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7fb2af6-6797-44be-bdb0-7350c4dcac15 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.063841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7fb2af6-6797-44be-bdb0-7350c4dcac15 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.069138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7fb2af6-6797-44be-bdb0-7350c4dcac15 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.477920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c95eea69-7b5e-43cc-bd0d-6f95c73abae8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:47.521932 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c95eea69-7b5e-43cc-bd0d-6f95c73abae8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1316 microversion: 2.1 time: 1.411563 Aug 27 02:45:47.525838 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1500/3323] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:46 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1316 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:47.544304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2fb34401-7c9d-4aac-8ef8-b3e592ed3599 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:47.546004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2fb34401-7c9d-4aac-8ef8-b3e592ed3599 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:47.568729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb34401-7c9d-4aac-8ef8-b3e592ed3599 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.569865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb34401-7c9d-4aac-8ef8-b3e592ed3599 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.572956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb34401-7c9d-4aac-8ef8-b3e592ed3599 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:47.575259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb34401-7c9d-4aac-8ef8-b3e592ed3599 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:47.579102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb34401-7c9d-4aac-8ef8-b3e592ed3599 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:47.580088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb34401-7c9d-4aac-8ef8-b3e592ed3599 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.004579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2fb34401-7c9d-4aac-8ef8-b3e592ed3599 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.017376 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2fb34401-7c9d-4aac-8ef8-b3e592ed3599 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 200 len: 1453 microversion: 2.1 time: 0.489061 Aug 27 02:45:48.022441 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1501/3324] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:47 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 1453 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:48.042299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2cc129af-1b24-4c78-a5ee-2fabb2bd325d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Action: 'create', calling method: .version_select at 0x7f4d2af93670>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1740120060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlRwGo4yUbhnDwAzv5+deOdIRaZzI4thQMFptGJmW/EHKzLkwaD2UdkQr7dp7DJKlspaCTosE9M8vvGw6IphRoNM0T7UY04SbXViizEa6EcrOA7P5Ih6LRzJImC6gcfhA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:48.071429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d7fb2af6-6797-44be-bdb0-7350c4dcac15 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:48.090843 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d7fb2af6-6797-44be-bdb0-7350c4dcac15 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1265 microversion: 2.1 time: 1.085421 Aug 27 02:45:48.103408 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1824/3325] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:47 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1265 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:48.135292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2cc129af-1b24-4c78-a5ee-2fabb2bd325d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Getting quotas for project eb86f82e39d24217bed0c5317fce8449. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:45:48.151975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b5348053-e476-47a1-a34f-a8330959ae44 req-1c7d4cbc-0da2-4fb6-82f8-7f5f18790805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c63679-0a51-4dd6-b3f9-cb79446fb91f", "tag": "f6236cbc-343f-420c-b926-0192ef026193"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:48.170957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2cc129af-1b24-4c78-a5ee-2fabb2bd325d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Getting quotas for user 8706cfc5cb634a66bf28dfcdd1efde54 and project eb86f82e39d24217bed0c5317fce8449. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:45:48.186823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5348053-e476-47a1-a34f-a8330959ae44 req-1c7d4cbc-0da2-4fb6-82f8-7f5f18790805 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.193760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5348053-e476-47a1-a34f-a8330959ae44 req-1c7d4cbc-0da2-4fb6-82f8-7f5f18790805 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.194503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5348053-e476-47a1-a34f-a8330959ae44 req-1c7d4cbc-0da2-4fb6-82f8-7f5f18790805 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.258474 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b5348053-e476-47a1-a34f-a8330959ae44 req-1c7d4cbc-0da2-4fb6-82f8-7f5f18790805 service nova] Creating event network-changed:f6236cbc-343f-420c-b926-0192ef026193 for instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f on n-h1-852084-5 Aug 27 02:45:48.276609 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b5348053-e476-47a1-a34f-a8330959ae44 req-1c7d4cbc-0da2-4fb6-82f8-7f5f18790805 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170594 Aug 27 02:45:48.282289 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1825/3326] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:48.298939 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2cc129af-1b24-4c78-a5ee-2fabb2bd325d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.268613 Aug 27 02:45:48.301980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-70119957-23f1-4d1d-84dc-05a97d73af18 req-ed6a93f2-9e3c-4be6-b542-df10876c7111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "443b356d-208a-4c5d-8456-b483041b9e8d", "name": "network-vif-deleted", "tag": "345eeb5c-ae6d-40de-8f6e-9fb948322417"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:48.311901 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1502/3327] 10.222.0.99 () {62 vars in 1200 bytes} [Sat Aug 27 02:45:48 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 287 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:45:48.332203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1740120060", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:48.343106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-70119957-23f1-4d1d-84dc-05a97d73af18 req-ed6a93f2-9e3c-4be6-b542-df10876c7111 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.343448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:48.354789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-70119957-23f1-4d1d-84dc-05a97d73af18 req-ed6a93f2-9e3c-4be6-b542-df10876c7111 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.356238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-70119957-23f1-4d1d-84dc-05a97d73af18 req-ed6a93f2-9e3c-4be6-b542-df10876c7111 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.360697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.363751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.365232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.368969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.370350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.371482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.420620 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-70119957-23f1-4d1d-84dc-05a97d73af18 req-ed6a93f2-9e3c-4be6-b542-df10876c7111 service nova] Creating event network-vif-deleted:345eeb5c-ae6d-40de-8f6e-9fb948322417 for instance 443b356d-208a-4c5d-8456-b483041b9e8d on n-h1-852084-5 Aug 27 02:45:48.458756 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-70119957-23f1-4d1d-84dc-05a97d73af18 req-ed6a93f2-9e3c-4be6-b542-df10876c7111 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171460 Aug 27 02:45:48.470278 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1826/3328] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:48.576455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec6dc649-4b3c-4660-bf26-e0ab4a89ee85 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:48.584741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ec6dc649-4b3c-4660-bf26-e0ab4a89ee85 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:48.611032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6dc649-4b3c-4660-bf26-e0ab4a89ee85 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.612483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6dc649-4b3c-4660-bf26-e0ab4a89ee85 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.613431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6dc649-4b3c-4660-bf26-e0ab4a89ee85 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.614951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6dc649-4b3c-4660-bf26-e0ab4a89ee85 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:48.615805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6dc649-4b3c-4660-bf26-e0ab4a89ee85 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:48.616654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6dc649-4b3c-4660-bf26-e0ab4a89ee85 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:48.774079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:48.788555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:45:48.789869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:45:48.791220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:45:48.792770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:45:48.794709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:45:49.132443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:49.169260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.176554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.177428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.178680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.184522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.190983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.404162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ec6dc649-4b3c-4660-bf26-e0ab4a89ee85 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:49.420575 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec6dc649-4b3c-4660-bf26-e0ab4a89ee85 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1316 microversion: 2.1 time: 0.856069 Aug 27 02:45:49.423750 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1827/3329] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:48 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1316 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:49.444354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:49.445550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 443b356d-208a-4c5d-8456-b483041b9e8d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:49.450744 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-64d142dd-3a53-4c3b-ac89-a4f88c96a508 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "POST /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f/action" status: 202 len: 1139 microversion: 2.54 time: 1.130219 Aug 27 02:45:49.463295 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1503/3330] 10.222.0.99 () {62 vars in 1320 bytes} [Sat Aug 27 02:45:48 2022] POST /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f/action => generated 1139 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 27 02:45:49.480226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.481145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.483898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.487815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.491300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.493342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05bcdf98-3e1c-4180-b3c4-c630be3dce8d tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:49.496766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.517315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-05bcdf98-3e1c-4180-b3c4-c630be3dce8d tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:49.541447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05bcdf98-3e1c-4180-b3c4-c630be3dce8d tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.548181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05bcdf98-3e1c-4180-b3c4-c630be3dce8d tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.549153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05bcdf98-3e1c-4180-b3c4-c630be3dce8d tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.551757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05bcdf98-3e1c-4180-b3c4-c630be3dce8d tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.552658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05bcdf98-3e1c-4180-b3c4-c630be3dce8d tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.553496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05bcdf98-3e1c-4180-b3c4-c630be3dce8d tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.611338 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] HTTP exception thrown: Instance 443b356d-208a-4c5d-8456-b483041b9e8d could not be found. Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Request method failure captured: Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d HTTP/1.1 Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYKm_d0JxxqDywZg3wD_COBvn-f59wxHd5W6ptfAZGBGOv_Flzhk-aSso1ZnVxHt4Wn3_mE_eMwZzPt26zHlVRxUGMxoQr16MR2iVAECQBE2HR0fGaw53Bq8Fj7F37vVG3tMdQMgN6KVjqYBiNLXuttuRfd3bP6t4FmBCNrcWoio4C8 Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_69945a768314456fae9bf75e854510c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/69945a768314456fae9bf75e854510c2"}]}] Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 281834367cf24a809448bdeea36a9c97 Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 443b356d-208a-4c5d-8456-b483041b9e8d could not be found. Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '443b356d-208a-4c5d-8456-b483041b9e8d'} Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 443b356d-208a-4c5d-8456-b483041b9e8d could not be found. Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 443b356d-208a-4c5d-8456-b483041b9e8d could not be found. Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:49.621199 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:49.626309 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:49.626309 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:49.626309 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:49.626309 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:49.626309 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:49.626309 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 443b356d-208a-4c5d-8456-b483041b9e8d could not be found. Aug 27 02:45:49.626309 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:49.626309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Returning 404 to user: Instance 443b356d-208a-4c5d-8456-b483041b9e8d could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:49.626309 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-094bcd31-17f7-473d-8d50-09c7995046be tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d" status: 404 len: 111 microversion: 2.1 time: 0.197431 Aug 27 02:45:49.626309 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1828/3331] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:49 2022] GET /compute/v2.1/servers/443b356d-208a-4c5d-8456-b483041b9e8d => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:49.664766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:49.705611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:49.711001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:49.745134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.745988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.762003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.772453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:49.773291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:49.774311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:49.945478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-05bcdf98-3e1c-4180-b3c4-c630be3dce8d tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:49.969490 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-05bcdf98-3e1c-4180-b3c4-c630be3dce8d tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1271 microversion: 2.1 time: 0.502846 Aug 27 02:45:49.976922 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1504/3332] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:49 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1271 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:50.000635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a149c580-ddfc-4e00-847c-2fa7e471dea0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:50.002054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a149c580-ddfc-4e00-847c-2fa7e471dea0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:50.040509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a149c580-ddfc-4e00-847c-2fa7e471dea0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.041392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a149c580-ddfc-4e00-847c-2fa7e471dea0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.057434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a149c580-ddfc-4e00-847c-2fa7e471dea0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.065412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a149c580-ddfc-4e00-847c-2fa7e471dea0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.067930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a149c580-ddfc-4e00-847c-2fa7e471dea0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.070037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a149c580-ddfc-4e00-847c-2fa7e471dea0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.218101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a149c580-ddfc-4e00-847c-2fa7e471dea0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:45:50.362208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:50.440090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:50.441541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:50.442869 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f13ae995-8606-42ee-b868-ddde6dc1468e tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.791789 Aug 27 02:45:50.443458 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1829/3333] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:49 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:50.488034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-91f9604b-4a0a-4257-8235-5b3cf46b8681 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:50.488721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-91f9604b-4a0a-4257-8235-5b3cf46b8681 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:50.502929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f9604b-4a0a-4257-8235-5b3cf46b8681 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.503522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f9604b-4a0a-4257-8235-5b3cf46b8681 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.504019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f9604b-4a0a-4257-8235-5b3cf46b8681 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.504759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f9604b-4a0a-4257-8235-5b3cf46b8681 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.505262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f9604b-4a0a-4257-8235-5b3cf46b8681 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.509914 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a149c580-ddfc-4e00-847c-2fa7e471dea0 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "DELETE /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 204 len: 0 microversion: 2.1 time: 0.527377 Aug 27 02:45:50.511109 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1505/3334] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:45:49 2022] DELETE /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:45:50.511948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f9604b-4a0a-4257-8235-5b3cf46b8681 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.522067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0e34a399-d0fd-457e-b8dd-abca912e5ee1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:50.523109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0e34a399-d0fd-457e-b8dd-abca912e5ee1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:50.544577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e34a399-d0fd-457e-b8dd-abca912e5ee1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.545091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e34a399-d0fd-457e-b8dd-abca912e5ee1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.550199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e34a399-d0fd-457e-b8dd-abca912e5ee1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:50.551152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e34a399-d0fd-457e-b8dd-abca912e5ee1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:50.555658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e34a399-d0fd-457e-b8dd-abca912e5ee1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:50.557647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e34a399-d0fd-457e-b8dd-abca912e5ee1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.028664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0e34a399-d0fd-457e-b8dd-abca912e5ee1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.065057 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0e34a399-d0fd-457e-b8dd-abca912e5ee1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1674 microversion: 2.1 time: 0.546478 Aug 27 02:45:51.083063 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1506/3335] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:50 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1674 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:51.112888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8e990a26-564e-4ab5-950f-d0a248b37265 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:51.114205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8e990a26-564e-4ab5-950f-d0a248b37265 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:51.138032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e990a26-564e-4ab5-950f-d0a248b37265 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.143892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e990a26-564e-4ab5-950f-d0a248b37265 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.144688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e990a26-564e-4ab5-950f-d0a248b37265 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.147359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e990a26-564e-4ab5-950f-d0a248b37265 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.148261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e990a26-564e-4ab5-950f-d0a248b37265 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.149007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e990a26-564e-4ab5-950f-d0a248b37265 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.394959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8e990a26-564e-4ab5-950f-d0a248b37265 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.442308 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8e990a26-564e-4ab5-950f-d0a248b37265 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1271 microversion: 2.1 time: 0.357261 Aug 27 02:45:51.457808 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1507/3336] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:51 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1271 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:51.481357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:51.484902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:51.501034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.503467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.506214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.508201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:51.510302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:51.511495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:51.793251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.836818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.842539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:51.849606 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d5228a6d-5ca8-4903-8086-a7e64c62b41d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.378383 Aug 27 02:45:51.853197 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1508/3337] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:51 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:45:52.119638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2f66b32f-0895-4e79-8781-b5bc79f758c4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:52.124767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2f66b32f-0895-4e79-8781-b5bc79f758c4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:52.152891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f66b32f-0895-4e79-8781-b5bc79f758c4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.155117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f66b32f-0895-4e79-8781-b5bc79f758c4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.159128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f66b32f-0895-4e79-8781-b5bc79f758c4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.160894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f66b32f-0895-4e79-8781-b5bc79f758c4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.161928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f66b32f-0895-4e79-8781-b5bc79f758c4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.163654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f66b32f-0895-4e79-8781-b5bc79f758c4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.431597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-91f9604b-4a0a-4257-8235-5b3cf46b8681 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:52.470289 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-91f9604b-4a0a-4257-8235-5b3cf46b8681 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1316 microversion: 2.1 time: 1.985355 Aug 27 02:45:52.473186 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1830/3338] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:50 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1316 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:52.498644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-495b7a3d-ef64-4f4b-86c0-0bf25e058168 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:52.502946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-495b7a3d-ef64-4f4b-86c0-0bf25e058168 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:52.531828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-495b7a3d-ef64-4f4b-86c0-0bf25e058168 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.536733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-495b7a3d-ef64-4f4b-86c0-0bf25e058168 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.540031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-495b7a3d-ef64-4f4b-86c0-0bf25e058168 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.562428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-495b7a3d-ef64-4f4b-86c0-0bf25e058168 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.580407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-495b7a3d-ef64-4f4b-86c0-0bf25e058168 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.587830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-495b7a3d-ef64-4f4b-86c0-0bf25e058168 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.685885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2f66b32f-0895-4e79-8781-b5bc79f758c4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:52.701509 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2f66b32f-0895-4e79-8781-b5bc79f758c4 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1674 microversion: 2.1 time: 0.596096 Aug 27 02:45:52.702176 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1509/3339] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:52 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1674 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:52.897888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:52.899158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:52.912840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.918621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.919358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:52.920318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:52.921556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:52.922320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.224055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-495b7a3d-ef64-4f4b-86c0-0bf25e058168 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.256346 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-495b7a3d-ef64-4f4b-86c0-0bf25e058168 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1271 microversion: 2.1 time: 0.775936 Aug 27 02:45:53.257711 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1831/3340] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:52 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1271 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:53.446560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.498138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.499905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-424fa207-7c3b-4265-977b-c626fdf3eba1 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:53.504190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-424fa207-7c3b-4265-977b-c626fdf3eba1 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:53.517926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:53.520517 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-22e9b05c-117f-45ec-8f93-e2ab2b79b7da tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.630724 Aug 27 02:45:53.531190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-424fa207-7c3b-4265-977b-c626fdf3eba1 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.538456 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1510/3341] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:52 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:53.543923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-424fa207-7c3b-4265-977b-c626fdf3eba1 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.545774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-424fa207-7c3b-4265-977b-c626fdf3eba1 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.548236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-424fa207-7c3b-4265-977b-c626fdf3eba1 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.555304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-424fa207-7c3b-4265-977b-c626fdf3eba1 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.556582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-424fa207-7c3b-4265-977b-c626fdf3eba1 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.754527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c516ae62-ef8c-4618-a9b1-afa591089e0a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:53.756314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c516ae62-ef8c-4618-a9b1-afa591089e0a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:53.776329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c516ae62-ef8c-4618-a9b1-afa591089e0a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.776850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c516ae62-ef8c-4618-a9b1-afa591089e0a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.777319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c516ae62-ef8c-4618-a9b1-afa591089e0a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:53.778121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c516ae62-ef8c-4618-a9b1-afa591089e0a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:53.778598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c516ae62-ef8c-4618-a9b1-afa591089e0a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:53.779035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c516ae62-ef8c-4618-a9b1-afa591089e0a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.317327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c516ae62-ef8c-4618-a9b1-afa591089e0a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:54.337380 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c516ae62-ef8c-4618-a9b1-afa591089e0a tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1674 microversion: 2.1 time: 0.593338 Aug 27 02:45:54.340149 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1511/3342] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:53 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1674 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:54.357024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-424fa207-7c3b-4265-977b-c626fdf3eba1 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:54.360684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-47bda2cd-6ea3-40bc-aa52-fb1416d81f69 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:54.365307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-47bda2cd-6ea3-40bc-aa52-fb1416d81f69 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:54.375725 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-424fa207-7c3b-4265-977b-c626fdf3eba1 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1316 microversion: 2.1 time: 0.883780 Aug 27 02:45:54.377795 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1832/3343] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:53 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1316 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:54.404053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47bda2cd-6ea3-40bc-aa52-fb1416d81f69 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.408179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47bda2cd-6ea3-40bc-aa52-fb1416d81f69 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.409378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47bda2cd-6ea3-40bc-aa52-fb1416d81f69 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.411187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47bda2cd-6ea3-40bc-aa52-fb1416d81f69 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.412499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47bda2cd-6ea3-40bc-aa52-fb1416d81f69 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.414335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47bda2cd-6ea3-40bc-aa52-fb1416d81f69 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.576505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:54.587949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:54.599016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.600451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.601631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.603404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:54.604640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:54.605902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:54.821888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-47bda2cd-6ea3-40bc-aa52-fb1416d81f69 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:54.843074 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-47bda2cd-6ea3-40bc-aa52-fb1416d81f69 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1271 microversion: 2.1 time: 0.496950 Aug 27 02:45:54.865920 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1512/3344] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:54 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1271 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:55.295147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:55.299270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=20 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:55.385505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f338ee8b-be43-475a-baa6-d7e6f3a02880 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.386696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f338ee8b-be43-475a-baa6-d7e6f3a02880 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:55.444888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f338ee8b-be43-475a-baa6-d7e6f3a02880 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.445967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f338ee8b-be43-475a-baa6-d7e6f3a02880 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.446798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f338ee8b-be43-475a-baa6-d7e6f3a02880 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.462942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f338ee8b-be43-475a-baa6-d7e6f3a02880 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:55.464134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f338ee8b-be43-475a-baa6-d7e6f3a02880 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:55.464983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f338ee8b-be43-475a-baa6-d7e6f3a02880 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:55.955469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f338ee8b-be43-475a-baa6-d7e6f3a02880 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:55.973334 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f338ee8b-be43-475a-baa6-d7e6f3a02880 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1606 microversion: 2.1 time: 0.601241 Aug 27 02:45:55.978221 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1513/3345] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1606 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:55.984456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-515b4577-8747-4ea2-9b80-6ce55c3dba4a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:55.995229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-515b4577-8747-4ea2-9b80-6ce55c3dba4a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:56.011334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-515b4577-8747-4ea2-9b80-6ce55c3dba4a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.015229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-515b4577-8747-4ea2-9b80-6ce55c3dba4a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.018448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-515b4577-8747-4ea2-9b80-6ce55c3dba4a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.019690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-515b4577-8747-4ea2-9b80-6ce55c3dba4a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.021516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-515b4577-8747-4ea2-9b80-6ce55c3dba4a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.023947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-515b4577-8747-4ea2-9b80-6ce55c3dba4a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.031079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:56.102282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.135484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.141970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.152930 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c8898e80-61dd-4099-a26e-0d1e2c03f324 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 1.584065 Aug 27 02:45:56.156595 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1833/3346] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:54 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:45:56.177091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4bb02370-fd98-4fe5-b904-9dbe1189c5e6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:56.183185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4bb02370-fd98-4fe5-b904-9dbe1189c5e6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:56.213373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb02370-fd98-4fe5-b904-9dbe1189c5e6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.215122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb02370-fd98-4fe5-b904-9dbe1189c5e6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.217297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb02370-fd98-4fe5-b904-9dbe1189c5e6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.219908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb02370-fd98-4fe5-b904-9dbe1189c5e6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.221432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb02370-fd98-4fe5-b904-9dbe1189c5e6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.222634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb02370-fd98-4fe5-b904-9dbe1189c5e6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.760365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-515b4577-8747-4ea2-9b80-6ce55c3dba4a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:56.775222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-515b4577-8747-4ea2-9b80-6ce55c3dba4a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1316 microversion: 2.1 time: 0.795296 Aug 27 02:45:56.780993 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1514/3347] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:55 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1316 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:56.789452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-53cdf7de-9aa7-4061-818b-d71577b4790c req-b43e41ec-fa30-4657-baf4-73079341d270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59462ca6-1830-4fae-a141-ffade28879f6", "name": "network-vif-deleted", "tag": "b9a18ca7-1e41-4aa3-9c64-1d916f180dce"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:45:56.834354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-53cdf7de-9aa7-4061-818b-d71577b4790c req-b43e41ec-fa30-4657-baf4-73079341d270 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:56.835186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-53cdf7de-9aa7-4061-818b-d71577b4790c req-b43e41ec-fa30-4657-baf4-73079341d270 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:56.835768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-53cdf7de-9aa7-4061-818b-d71577b4790c req-b43e41ec-fa30-4657-baf4-73079341d270 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:56.877593 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-53cdf7de-9aa7-4061-818b-d71577b4790c req-b43e41ec-fa30-4657-baf4-73079341d270 service nova] Creating event network-vif-deleted:b9a18ca7-1e41-4aa3-9c64-1d916f180dce for instance 59462ca6-1830-4fae-a141-ffade28879f6 on n-h1-852084-5 Aug 27 02:45:56.901300 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-53cdf7de-9aa7-4061-818b-d71577b4790c req-b43e41ec-fa30-4657-baf4-73079341d270 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118618 Aug 27 02:45:56.903581 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1515/3348] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:45:57.024687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:57.027884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:57.048154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.049136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.053010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.054859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.055648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.056501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.142299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.146822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.147798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.148540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lazy-loading 'fault' on Instance uuid 59462ca6-1830-4fae-a141-ffade28879f6 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:45:57.374034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '281834367cf24a809448bdeea36a9c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69945a768314456fae9bf75e854510c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.402403 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-785239b7-8805-4094-8978-48eb22969fe9 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 200 len: 1327 microversion: 2.1 time: 0.388808 Aug 27 02:45:57.404670 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1516/3349] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:57 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 1327 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:45:57.418290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:57.427342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:57.451187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.452056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.453483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.466024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.466823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.468471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.851064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.898320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.905046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.912767 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-02164c4f-d455-4c84-9da6-2eb24def6f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.506192 Aug 27 02:45:57.940322 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1517/3350] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:57 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:57.958596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68e042d5-0dba-43ad-b353-e84bb7d4b207 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:57.960547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-68e042d5-0dba-43ad-b353-e84bb7d4b207 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:57.973977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4bb02370-fd98-4fe5-b904-9dbe1189c5e6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:57.978849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68e042d5-0dba-43ad-b353-e84bb7d4b207 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.979887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68e042d5-0dba-43ad-b353-e84bb7d4b207 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.981057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68e042d5-0dba-43ad-b353-e84bb7d4b207 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:57.984471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68e042d5-0dba-43ad-b353-e84bb7d4b207 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:57.988550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68e042d5-0dba-43ad-b353-e84bb7d4b207 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:57.991895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68e042d5-0dba-43ad-b353-e84bb7d4b207 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.024534 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4bb02370-fd98-4fe5-b904-9dbe1189c5e6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1313 microversion: 2.1 time: 1.864331 Aug 27 02:45:58.045357 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1834/3351] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:56 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1313 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:58.215358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=12 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:45:58.447525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:58.453475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] [instance: 59462ca6-1830-4fae-a141-ffade28879f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:58.475598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.480880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.481457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.482303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.482802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.485601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.510552 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] HTTP exception thrown: Instance 59462ca6-1830-4fae-a141-ffade28879f6 could not be found. Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Request method failure captured: Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 HTTP/1.1 Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYKm_d0JxxqDywZg3wD_COBvn-f59wxHd5W6ptfAZGBGOv_Flzhk-aSso1ZnVxHt4Wn3_mE_eMwZzPt26zHlVRxUGMxoQr16MR2iVAECQBE2HR0fGaw53Bq8Fj7F37vVG3tMdQMgN6KVjqYBiNLXuttuRfd3bP6t4FmBCNrcWoio4C8 Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_69945a768314456fae9bf75e854510c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/69945a768314456fae9bf75e854510c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/69945a768314456fae9bf75e854510c2"}]}] Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 69945a768314456fae9bf75e854510c2 Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerActionsTestJSON-1963050408 Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 281834367cf24a809448bdeea36a9c97 Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerActionsTestJSON-1963050408-project Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 59462ca6-1830-4fae-a141-ffade28879f6 could not be found. Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '59462ca6-1830-4fae-a141-ffade28879f6'} Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59462ca6-1830-4fae-a141-ffade28879f6 could not be found. Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59462ca6-1830-4fae-a141-ffade28879f6 could not be found. Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:45:58.525574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:58.534273 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:45:58.534273 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:45:58.534273 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:45:58.534273 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:45:58.534273 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:45:58.534273 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59462ca6-1830-4fae-a141-ffade28879f6 could not be found. Aug 27 02:45:58.534273 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:45:58.534273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Returning 404 to user: Instance 59462ca6-1830-4fae-a141-ffade28879f6 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:45:58.534273 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-82b74a10-215c-4991-8b32-cd2da8b24cf1 tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6" status: 404 len: 111 microversion: 2.1 time: 0.085296 Aug 27 02:45:58.538089 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1835/3352] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:58 2022] GET /compute/v2.1/servers/59462ca6-1830-4fae-a141-ffade28879f6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:45:58.554587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3db171a7-b2b4-4f62-b702-60f928bd019e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] Calling method '.version_select at 0x7f4d290f53a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:58.626935 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3db171a7-b2b4-4f62-b702-60f928bd019e tempest-ServerActionsTestJSON-1963050408 tempest-ServerActionsTestJSON-1963050408-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-206560499" status: 202 len: 0 microversion: 2.1 time: 0.087545 Aug 27 02:45:58.633244 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1836/3353] 10.222.0.99 () {58 vars in 1218 bytes} [Sat Aug 27 02:45:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-206560499 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:45:58.638853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-68e042d5-0dba-43ad-b353-e84bb7d4b207 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:58.651854 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-68e042d5-0dba-43ad-b353-e84bb7d4b207 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1316 microversion: 2.1 time: 0.708061 Aug 27 02:45:58.653958 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1518/3354] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:57 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1316 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:45:58.959740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:58.960543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:58.974899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.975972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.977492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:58.981745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:58.985382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:58.986469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.060097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d57a7c9f-e85d-45f4-91d2-13bd565ebe57 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:59.069072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d57a7c9f-e85d-45f4-91d2-13bd565ebe57 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:59.130560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57a7c9f-e85d-45f4-91d2-13bd565ebe57 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.133095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57a7c9f-e85d-45f4-91d2-13bd565ebe57 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.134904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57a7c9f-e85d-45f4-91d2-13bd565ebe57 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.144622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57a7c9f-e85d-45f4-91d2-13bd565ebe57 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.145827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57a7c9f-e85d-45f4-91d2-13bd565ebe57 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.147774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57a7c9f-e85d-45f4-91d2-13bd565ebe57 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.230695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:59.243191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:59.244735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:45:59.268899 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f871f43f-fca0-43a7-8a3b-0b2f50c0c46d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.290563 Aug 27 02:45:59.287498 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1837/3355] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:45:58 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:45:59.675499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ca32e4e9-063e-4b85-b7a3-754a3be4fea0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:45:59.676144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ca32e4e9-063e-4b85-b7a3-754a3be4fea0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:45:59.700071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca32e4e9-063e-4b85-b7a3-754a3be4fea0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.708010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca32e4e9-063e-4b85-b7a3-754a3be4fea0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.710157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca32e4e9-063e-4b85-b7a3-754a3be4fea0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.711218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca32e4e9-063e-4b85-b7a3-754a3be4fea0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:45:59.713551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca32e4e9-063e-4b85-b7a3-754a3be4fea0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:45:59.714318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca32e4e9-063e-4b85-b7a3-754a3be4fea0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:45:59.729091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:00.072854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d57a7c9f-e85d-45f4-91d2-13bd565ebe57 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:00.091850 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d57a7c9f-e85d-45f4-91d2-13bd565ebe57 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1313 microversion: 2.1 time: 1.035752 Aug 27 02:46:00.094174 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1519/3356] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:59 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1313 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:00.296973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:00.297894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:00.320424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:00.320424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:00.320424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:00.320424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:00.320424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:00.320424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:00.650395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:00.707581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:00.719321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:00.720760 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-20352bd5-936e-447a-9265-118ff23100b8 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.429742 Aug 27 02:46:00.722041 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1520/3357] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:00 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:46:00.739245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-cfbc1358-a9d2-4919-8af1-ddc87c4e4e79 req-22e94bbd-f962-4190-ba13-e9e2be419a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466603af-2b17-4539-98cc-d5d2f6a3c13e", "tag": "6f75bc58-72ef-4043-b38e-bacd51eaf67b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:00.750711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cfbc1358-a9d2-4919-8af1-ddc87c4e4e79 req-22e94bbd-f962-4190-ba13-e9e2be419a60 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:00.751500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cfbc1358-a9d2-4919-8af1-ddc87c4e4e79 req-22e94bbd-f962-4190-ba13-e9e2be419a60 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:00.752115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cfbc1358-a9d2-4919-8af1-ddc87c4e4e79 req-22e94bbd-f962-4190-ba13-e9e2be419a60 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:00.765555 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-cfbc1358-a9d2-4919-8af1-ddc87c4e4e79 req-22e94bbd-f962-4190-ba13-e9e2be419a60 service nova] Creating event network-changed:6f75bc58-72ef-4043-b38e-bacd51eaf67b for instance 466603af-2b17-4539-98cc-d5d2f6a3c13e on n-h2-852084-5 Aug 27 02:46:00.771392 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-cfbc1358-a9d2-4919-8af1-ddc87c4e4e79 req-22e94bbd-f962-4190-ba13-e9e2be419a60 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047529 Aug 27 02:46:00.772622 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1521/3358] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:00.789695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ca32e4e9-063e-4b85-b7a3-754a3be4fea0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:00.824639 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ca32e4e9-063e-4b85-b7a3-754a3be4fea0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1316 microversion: 2.1 time: 1.153492 Aug 27 02:46:00.851005 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1838/3359] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:45:59 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1316 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:01.127895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-35fb37c4-27ac-4598-8779-3e78b9bff8fd tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:01.142720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-35fb37c4-27ac-4598-8779-3e78b9bff8fd tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:01.193396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35fb37c4-27ac-4598-8779-3e78b9bff8fd tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.195683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35fb37c4-27ac-4598-8779-3e78b9bff8fd tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.198044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35fb37c4-27ac-4598-8779-3e78b9bff8fd tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.205348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35fb37c4-27ac-4598-8779-3e78b9bff8fd tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.206728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35fb37c4-27ac-4598-8779-3e78b9bff8fd tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.208038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35fb37c4-27ac-4598-8779-3e78b9bff8fd tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.559302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ead3090f-59fd-473e-ae6b-2c34b2f39622 req-dc898a9d-451e-42fe-9d8a-4fbc1f57e5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c63679-0a51-4dd6-b3f9-cb79446fb91f", "name": "network-vif-plugged", "status": "completed", "tag": "f6236cbc-343f-420c-b926-0192ef026193"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:01.618335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ead3090f-59fd-473e-ae6b-2c34b2f39622 req-dc898a9d-451e-42fe-9d8a-4fbc1f57e5fd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.621084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ead3090f-59fd-473e-ae6b-2c34b2f39622 req-dc898a9d-451e-42fe-9d8a-4fbc1f57e5fd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.626380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ead3090f-59fd-473e-ae6b-2c34b2f39622 req-dc898a9d-451e-42fe-9d8a-4fbc1f57e5fd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.687279 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ead3090f-59fd-473e-ae6b-2c34b2f39622 req-dc898a9d-451e-42fe-9d8a-4fbc1f57e5fd service nova] Creating event network-vif-plugged:f6236cbc-343f-420c-b926-0192ef026193 for instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f on n-h1-852084-5 Aug 27 02:46:01.724654 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ead3090f-59fd-473e-ae6b-2c34b2f39622 req-dc898a9d-451e-42fe-9d8a-4fbc1f57e5fd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178864 Aug 27 02:46:01.728719 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1839/3360] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:01.758334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:01.763216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:01.795335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.805060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.806295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:01.808089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:01.809316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:01.815996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:02.147936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:02.172615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:02.180359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:02.184312 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c5c1f334-c9c3-4d5d-a886-35cdbd70ccd9 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.438293 Aug 27 02:46:02.205585 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1840/3361] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:01 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:02.213262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dff76d91-786d-4552-8e9e-b160d1b9b774 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:02.214795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dff76d91-786d-4552-8e9e-b160d1b9b774 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:02.225074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dff76d91-786d-4552-8e9e-b160d1b9b774 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:02.226813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dff76d91-786d-4552-8e9e-b160d1b9b774 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:02.227671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dff76d91-786d-4552-8e9e-b160d1b9b774 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:02.229338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dff76d91-786d-4552-8e9e-b160d1b9b774 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:02.230108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dff76d91-786d-4552-8e9e-b160d1b9b774 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:02.230779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dff76d91-786d-4552-8e9e-b160d1b9b774 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:02.454383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-35fb37c4-27ac-4598-8779-3e78b9bff8fd tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:02.495106 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-35fb37c4-27ac-4598-8779-3e78b9bff8fd tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1313 microversion: 2.1 time: 1.375831 Aug 27 02:46:02.517837 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1522/3362] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:01 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1313 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:02.858122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dff76d91-786d-4552-8e9e-b160d1b9b774 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:02.891063 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dff76d91-786d-4552-8e9e-b160d1b9b774 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1316 microversion: 2.1 time: 0.683326 Aug 27 02:46:02.896996 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1841/3363] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:02 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1316 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:03.213007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:03.213777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:03.229540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.234702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.235619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.237762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.240729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.241468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.520556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b3d79af4-7f5d-4c55-988b-c03c4fc59660 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:03.522167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b3d79af4-7f5d-4c55-988b-c03c4fc59660 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:03.536321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3d79af4-7f5d-4c55-988b-c03c4fc59660 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.536801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3d79af4-7f5d-4c55-988b-c03c4fc59660 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.540378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3d79af4-7f5d-4c55-988b-c03c4fc59660 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.542062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3d79af4-7f5d-4c55-988b-c03c4fc59660 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.547228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3d79af4-7f5d-4c55-988b-c03c4fc59660 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.548025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3d79af4-7f5d-4c55-988b-c03c4fc59660 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.734854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.795648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.809007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:03.827862 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4dfea1b8-b4c8-4d62-981d-b1144910c859 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.614175 Aug 27 02:46:03.829900 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1523/3364] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:03 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:03.934722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd16f7a9-6a0b-4530-9e91-508ab8390a95 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:03.940190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd16f7a9-6a0b-4530-9e91-508ab8390a95 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:03.973518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd16f7a9-6a0b-4530-9e91-508ab8390a95 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.974086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd16f7a9-6a0b-4530-9e91-508ab8390a95 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.977796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd16f7a9-6a0b-4530-9e91-508ab8390a95 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:03.981074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd16f7a9-6a0b-4530-9e91-508ab8390a95 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:03.981485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd16f7a9-6a0b-4530-9e91-508ab8390a95 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:03.984552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd16f7a9-6a0b-4530-9e91-508ab8390a95 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.517105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd16f7a9-6a0b-4530-9e91-508ab8390a95 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:04.548101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b3d79af4-7f5d-4c55-988b-c03c4fc59660 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:04.574190 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd16f7a9-6a0b-4530-9e91-508ab8390a95 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1503 microversion: 2.1 time: 0.647668 Aug 27 02:46:04.577767 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1524/3365] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:03 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1503 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:04.592446 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b3d79af4-7f5d-4c55-988b-c03c4fc59660 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1313 microversion: 2.1 time: 1.072784 Aug 27 02:46:04.605702 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1842/3366] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:03 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1313 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:04.623006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4dda7b25-74fe-4445-9bb4-462f765b9694 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1353231473"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:04.623728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4dda7b25-74fe-4445-9bb4-462f765b9694 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:04.645709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dda7b25-74fe-4445-9bb4-462f765b9694 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.647010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dda7b25-74fe-4445-9bb4-462f765b9694 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.649328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dda7b25-74fe-4445-9bb4-462f765b9694 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.654093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dda7b25-74fe-4445-9bb4-462f765b9694 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.654759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dda7b25-74fe-4445-9bb4-462f765b9694 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.655743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dda7b25-74fe-4445-9bb4-462f765b9694 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.887578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:04.888660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:04.915985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.916827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.917721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:04.926353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:04.928588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:04.929422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.177163 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.network.security_group_api [None req-4dda7b25-74fe-4445-9bb4-462f765b9694 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Adding security group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 to port f6236cbc-343f-420c-b926-0192ef026193 Aug 27 02:46:05.301416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:05.318654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:05.326095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:05.341378 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-99f395a7-d8d6-420f-bdbf-5052b19204af tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.463704 Aug 27 02:46:05.344336 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1843/3367] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:04 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:05.625065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c6814227-c3c0-456c-8fa2-30b653c70ea4 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:05.631075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6814227-c3c0-456c-8fa2-30b653c70ea4 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:05.671930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6814227-c3c0-456c-8fa2-30b653c70ea4 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.675502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6814227-c3c0-456c-8fa2-30b653c70ea4 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.677301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6814227-c3c0-456c-8fa2-30b653c70ea4 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:05.683241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6814227-c3c0-456c-8fa2-30b653c70ea4 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:05.685537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6814227-c3c0-456c-8fa2-30b653c70ea4 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:05.687970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6814227-c3c0-456c-8fa2-30b653c70ea4 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:06.285935 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4dda7b25-74fe-4445-9bb4-462f765b9694 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f/action" status: 202 len: 0 microversion: 2.1 time: 1.668248 Aug 27 02:46:06.289482 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1525/3368] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:46:04 2022] POST /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f/action => generated 0 bytes in 1673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:46:06.312771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aede456d-b006-4330-b722-0f1abd1bfdaf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2e89ae50>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:06.522792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c6814227-c3c0-456c-8fa2-30b653c70ea4 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:06.549727 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c6814227-c3c0-456c-8fa2-30b653c70ea4 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1313 microversion: 2.1 time: 0.934230 Aug 27 02:46:06.565573 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1844/3369] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:05 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1313 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:06.575021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-da55d65b-e913-434f-b9f2-59ae1e0d0a94 req-994c9086-e4d5-443a-b2e9-cbc344c602d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c63679-0a51-4dd6-b3f9-cb79446fb91f", "tag": "f6236cbc-343f-420c-b926-0192ef026193"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:06.604841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-da55d65b-e913-434f-b9f2-59ae1e0d0a94 req-994c9086-e4d5-443a-b2e9-cbc344c602d5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:06.605369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-da55d65b-e913-434f-b9f2-59ae1e0d0a94 req-994c9086-e4d5-443a-b2e9-cbc344c602d5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:06.607887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-da55d65b-e913-434f-b9f2-59ae1e0d0a94 req-994c9086-e4d5-443a-b2e9-cbc344c602d5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:06.643779 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-da55d65b-e913-434f-b9f2-59ae1e0d0a94 req-994c9086-e4d5-443a-b2e9-cbc344c602d5 service nova] Creating event network-changed:f6236cbc-343f-420c-b926-0192ef026193 for instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f on n-h1-852084-5 Aug 27 02:46:06.663526 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-da55d65b-e913-434f-b9f2-59ae1e0d0a94 req-994c9086-e4d5-443a-b2e9-cbc344c602d5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095919 Aug 27 02:46:06.672828 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1845/3370] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:06.691365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:06.695857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:06.722191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:06.727627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:06.733847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:06.735463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:06.736566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:06.737638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:06.933850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-aede456d-b006-4330-b722-0f1abd1bfdaf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 in use.", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:46:06.935031 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-aede456d-b006-4330-b722-0f1abd1bfdaf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security Group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 in use. Aug 27 02:46:06.935031 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-e00f7bbd-f9c4-4de5-972a-6654261225d9'] Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aede456d-b006-4330-b722-0f1abd1bfdaf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-security-groups/fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 HTTP/1.1 Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: exception: Security Group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 in use. Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-e00f7bbd-f9c4-4de5-972a-6654261225d9'] Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'fae4c8d6-9a2f-4dfe-862e-4763cd98cd28'} Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:46:06.946017 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 in use. Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e00f7bbd-f9c4-4de5-972a-6654261225d9'] Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 in use. Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e00f7bbd-f9c4-4de5-972a-6654261225d9'] Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 in use. Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e00f7bbd-f9c4-4de5-972a-6654261225d9'] Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 in use. Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e00f7bbd-f9c4-4de5-972a-6654261225d9'] Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aede456d-b006-4330-b722-0f1abd1bfdaf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 400 to user: Security Group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 in use. Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-e00f7bbd-f9c4-4de5-972a-6654261225d9'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:06.960839 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aede456d-b006-4330-b722-0f1abd1bfdaf tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/fae4c8d6-9a2f-4dfe-862e-4763cd98cd28" status: 400 len: 185 microversion: 2.1 time: 0.665463 Aug 27 02:46:06.977018 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1526/3371] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:06 2022] DELETE /compute/v2.1/os-security-groups/fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 => generated 185 bytes in 683 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:46:06.990808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a3f691b-d69c-4928-a49d-17208f49b2f5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:07.004132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1a3f691b-d69c-4928-a49d-17208f49b2f5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:07.034294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a3f691b-d69c-4928-a49d-17208f49b2f5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:07.038010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a3f691b-d69c-4928-a49d-17208f49b2f5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:07.040325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a3f691b-d69c-4928-a49d-17208f49b2f5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:07.050754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a3f691b-d69c-4928-a49d-17208f49b2f5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:07.051778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a3f691b-d69c-4928-a49d-17208f49b2f5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:07.052487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a3f691b-d69c-4928-a49d-17208f49b2f5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:07.275385 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1a3f691b-d69c-4928-a49d-17208f49b2f5 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f/action" status: 202 len: 0 microversion: 2.1 time: 0.295399 Aug 27 02:46:07.276605 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1527/3372] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:46:06 2022] POST /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:46:07.309051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-138158f9-60fd-43af-8761-5672e5c2b708 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:07.329944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-138158f9-60fd-43af-8761-5672e5c2b708 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:07.358558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-138158f9-60fd-43af-8761-5672e5c2b708 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:07.360391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-138158f9-60fd-43af-8761-5672e5c2b708 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:07.364673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-138158f9-60fd-43af-8761-5672e5c2b708 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:07.366386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-138158f9-60fd-43af-8761-5672e5c2b708 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:07.392401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-138158f9-60fd-43af-8761-5672e5c2b708 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:07.413265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-138158f9-60fd-43af-8761-5672e5c2b708 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:07.767121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:07.785597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:07.795437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:07.801417 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-782a9317-290f-48ac-8ba7-37df98ed4016 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 1.125928 Aug 27 02:46:07.806455 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1846/3373] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:06 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:07.822908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c0a3805-1a01-4332-a5a8-1beba348cc56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:07.824150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3c0a3805-1a01-4332-a5a8-1beba348cc56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:07.830138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:07.844157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-138158f9-60fd-43af-8761-5672e5c2b708 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:07.845597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c0a3805-1a01-4332-a5a8-1beba348cc56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:07.847093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c0a3805-1a01-4332-a5a8-1beba348cc56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:07.847833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c0a3805-1a01-4332-a5a8-1beba348cc56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:07.850409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c0a3805-1a01-4332-a5a8-1beba348cc56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:07.851813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c0a3805-1a01-4332-a5a8-1beba348cc56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:07.852874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c0a3805-1a01-4332-a5a8-1beba348cc56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:07.879910 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-138158f9-60fd-43af-8761-5672e5c2b708 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1574 microversion: 2.1 time: 0.597123 Aug 27 02:46:07.895235 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1528/3374] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:07 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1574 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:08.855785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:08.856892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:08.893807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:08.895751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:08.897313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:08.911261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:08.912530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:08.913703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.115756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.147344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.151144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.165639 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0f295c9a-38c4-4fdd-85a3-2e8fd8468892 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.318202 Aug 27 02:46:09.177709 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1529/3375] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:08 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:46:09.179481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-61d9e865-cd3f-40b4-8c3f-8608c4bc7226 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:09.193706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-61d9e865-cd3f-40b4-8c3f-8608c4bc7226 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:09.205006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d9e865-cd3f-40b4-8c3f-8608c4bc7226 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.206643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d9e865-cd3f-40b4-8c3f-8608c4bc7226 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.207955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d9e865-cd3f-40b4-8c3f-8608c4bc7226 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.209708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d9e865-cd3f-40b4-8c3f-8608c4bc7226 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:09.211397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d9e865-cd3f-40b4-8c3f-8608c4bc7226 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:09.212623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d9e865-cd3f-40b4-8c3f-8608c4bc7226 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:09.468752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3c0a3805-1a01-4332-a5a8-1beba348cc56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:09.499001 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3c0a3805-1a01-4332-a5a8-1beba348cc56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1313 microversion: 2.1 time: 1.690593 Aug 27 02:46:09.500056 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1847/3376] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:07 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1313 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:10.185816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-61d9e865-cd3f-40b4-8c3f-8608c4bc7226 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:10.218338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:10.219266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:10.236317 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-61d9e865-cd3f-40b4-8c3f-8608c4bc7226 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1574 microversion: 2.1 time: 1.063080 Aug 27 02:46:10.250300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:10.251185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:10.251966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:10.254832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:10.255716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:10.256529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:10.274053 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1530/3377] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:09 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1574 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:10.534827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd339c3e-30a6-4646-aa33-d23495421ddf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:10.537246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd339c3e-30a6-4646-aa33-d23495421ddf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:10.569000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd339c3e-30a6-4646-aa33-d23495421ddf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:10.570754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:10.571762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd339c3e-30a6-4646-aa33-d23495421ddf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:10.576040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd339c3e-30a6-4646-aa33-d23495421ddf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:10.580442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd339c3e-30a6-4646-aa33-d23495421ddf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:10.580442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd339c3e-30a6-4646-aa33-d23495421ddf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:10.580442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd339c3e-30a6-4646-aa33-d23495421ddf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:10.596382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:10.601649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:10.605034 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a7b3d4c1-605c-478f-8b5b-3571bbed057d tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.392013 Aug 27 02:46:10.608156 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1848/3378] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:10 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:11.168351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd339c3e-30a6-4646-aa33-d23495421ddf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:11.205488 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd339c3e-30a6-4646-aa33-d23495421ddf tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1313 microversion: 2.1 time: 0.683435 Aug 27 02:46:11.212656 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1531/3379] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:10 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:11.289067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-101fc053-e5d1-42f1-8b3f-1f01b3ac6d13 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:11.291787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-101fc053-e5d1-42f1-8b3f-1f01b3ac6d13 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:11.315172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101fc053-e5d1-42f1-8b3f-1f01b3ac6d13 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:11.315675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101fc053-e5d1-42f1-8b3f-1f01b3ac6d13 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:11.321315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101fc053-e5d1-42f1-8b3f-1f01b3ac6d13 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:11.324314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101fc053-e5d1-42f1-8b3f-1f01b3ac6d13 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:11.329720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101fc053-e5d1-42f1-8b3f-1f01b3ac6d13 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:11.334014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101fc053-e5d1-42f1-8b3f-1f01b3ac6d13 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:11.682902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:11.685154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:11.713924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:11.715768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:11.718768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:11.725194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:11.729542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:11.731193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:11.751114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:11.971386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:12.006419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:12.021933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:12.034864 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9f3403fd-fd31-40e0-b207-d20ab26fe926 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.368280 Aug 27 02:46:12.042554 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1532/3380] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:11 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:12.066279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-9bb71297-e269-4caa-be06-813af20d05fe req-156f8164-7b51-4a5f-8b1b-8bc4fb7c94cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466603af-2b17-4539-98cc-d5d2f6a3c13e", "name": "network-vif-plugged", "status": "completed", "tag": "6f75bc58-72ef-4043-b38e-bacd51eaf67b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:12.078631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9bb71297-e269-4caa-be06-813af20d05fe req-156f8164-7b51-4a5f-8b1b-8bc4fb7c94cd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.079538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9bb71297-e269-4caa-be06-813af20d05fe req-156f8164-7b51-4a5f-8b1b-8bc4fb7c94cd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.080362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9bb71297-e269-4caa-be06-813af20d05fe req-156f8164-7b51-4a5f-8b1b-8bc4fb7c94cd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.110972 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-9bb71297-e269-4caa-be06-813af20d05fe req-156f8164-7b51-4a5f-8b1b-8bc4fb7c94cd service nova] Creating event network-vif-plugged:6f75bc58-72ef-4043-b38e-bacd51eaf67b for instance 466603af-2b17-4539-98cc-d5d2f6a3c13e on n-h2-852084-5 Aug 27 02:46:12.122963 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-9bb71297-e269-4caa-be06-813af20d05fe req-156f8164-7b51-4a5f-8b1b-8bc4fb7c94cd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061523 Aug 27 02:46:12.124114 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1533/3381] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:12.233918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-70392054-5f43-425d-874a-e475a2522fe6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:12.235788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-70392054-5f43-425d-874a-e475a2522fe6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:12.247487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70392054-5f43-425d-874a-e475a2522fe6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.250416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70392054-5f43-425d-874a-e475a2522fe6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.251861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70392054-5f43-425d-874a-e475a2522fe6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.253990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70392054-5f43-425d-874a-e475a2522fe6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:12.256294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70392054-5f43-425d-874a-e475a2522fe6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:12.257091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70392054-5f43-425d-874a-e475a2522fe6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:12.651442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-101fc053-e5d1-42f1-8b3f-1f01b3ac6d13 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:12.661327 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-101fc053-e5d1-42f1-8b3f-1f01b3ac6d13 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1574 microversion: 2.1 time: 1.383898 Aug 27 02:46:12.667543 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1849/3382] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:11 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1574 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:12.950537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-70392054-5f43-425d-874a-e475a2522fe6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:12.981813 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-70392054-5f43-425d-874a-e475a2522fe6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1313 microversion: 2.1 time: 0.752180 Aug 27 02:46:13.002963 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1534/3383] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:12 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1313 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:13.077776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:13.080541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:13.097434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.098500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.099263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.100995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.101986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.103493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.345532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:13.370490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:13.378245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:13.382339 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fb05acd6-bdf5-4933-83b3-cae643a60d2a tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.316332 Aug 27 02:46:13.410476 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1850/3384] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:13 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:13.716186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-350f606a-7868-4c61-8500-3428ab325e58 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:13.723319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-350f606a-7868-4c61-8500-3428ab325e58 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:13.760892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350f606a-7868-4c61-8500-3428ab325e58 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.763709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350f606a-7868-4c61-8500-3428ab325e58 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.767104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350f606a-7868-4c61-8500-3428ab325e58 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:13.784878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350f606a-7868-4c61-8500-3428ab325e58 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:13.786612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350f606a-7868-4c61-8500-3428ab325e58 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:13.787633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-350f606a-7868-4c61-8500-3428ab325e58 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:14.030877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1895f70b-27af-41c2-9fe4-1200ae2410d5 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:14.035725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1895f70b-27af-41c2-9fe4-1200ae2410d5 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:14.062973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1895f70b-27af-41c2-9fe4-1200ae2410d5 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:14.064394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1895f70b-27af-41c2-9fe4-1200ae2410d5 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:14.069747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1895f70b-27af-41c2-9fe4-1200ae2410d5 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:14.074658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1895f70b-27af-41c2-9fe4-1200ae2410d5 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:14.083153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1895f70b-27af-41c2-9fe4-1200ae2410d5 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:14.089249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1895f70b-27af-41c2-9fe4-1200ae2410d5 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:15.068213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1895f70b-27af-41c2-9fe4-1200ae2410d5 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:15.085123 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1895f70b-27af-41c2-9fe4-1200ae2410d5 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1313 microversion: 2.1 time: 1.068365 Aug 27 02:46:15.086284 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1851/3385] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:14 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1313 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:15.098393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:15.099428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:15.118139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:15.124207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:15.127125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:15.134747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:15.140295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-350f606a-7868-4c61-8500-3428ab325e58 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:15.145112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:15.150395 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-350f606a-7868-4c61-8500-3428ab325e58 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1574 microversion: 2.1 time: 1.450159 Aug 27 02:46:15.150654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:15.166361 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1535/3386] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:13 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1574 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:15.649200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:15.666995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:15.679941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:15.688898 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-54070a97-eb09-4157-8a4e-1e0e9b95a90f tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1408 microversion: 2.54 time: 0.599552 Aug 27 02:46:15.693888 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1852/3387] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:15 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1408 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:16.123761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-03e595dd-cf01-4655-a6a1-02750148797f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:16.124849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-03e595dd-cf01-4655-a6a1-02750148797f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:16.142399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e595dd-cf01-4655-a6a1-02750148797f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:16.145342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e595dd-cf01-4655-a6a1-02750148797f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:16.146349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e595dd-cf01-4655-a6a1-02750148797f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:16.148519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e595dd-cf01-4655-a6a1-02750148797f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:16.150375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e595dd-cf01-4655-a6a1-02750148797f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:16.156218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e595dd-cf01-4655-a6a1-02750148797f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:16.182544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94acd01c-0091-4c73-86ac-367c54053bcd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:16.182914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-94acd01c-0091-4c73-86ac-367c54053bcd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:16.190016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94acd01c-0091-4c73-86ac-367c54053bcd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:16.191211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94acd01c-0091-4c73-86ac-367c54053bcd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:16.191920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94acd01c-0091-4c73-86ac-367c54053bcd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:16.192921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94acd01c-0091-4c73-86ac-367c54053bcd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:16.193696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94acd01c-0091-4c73-86ac-367c54053bcd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:16.194376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94acd01c-0091-4c73-86ac-367c54053bcd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:16.918200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-03e595dd-cf01-4655-a6a1-02750148797f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:16.938506 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-03e595dd-cf01-4655-a6a1-02750148797f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1463 microversion: 2.1 time: 0.818468 Aug 27 02:46:16.940424 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1536/3388] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:16 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1463 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:16.950062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:16.952201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:16.963805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:16.964794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:16.965601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:16.967500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:16.971276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:16.972910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:17.259693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:17.277361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:17.284335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:17.292490 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a540feaf-2759-4253-bb32-276880077988 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1414 microversion: 2.54 time: 0.349625 Aug 27 02:46:17.305461 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1537/3389] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:16 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1414 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:17.837227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2924aac-e2e2-4a55-8b62-daa5c95ff89a tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Calling method '.version_select at 0x7f4d2a71f160>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:17.925084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2924aac-e2e2-4a55-8b62-daa5c95ff89a tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:17.928039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2924aac-e2e2-4a55-8b62-daa5c95ff89a tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:17.933365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2924aac-e2e2-4a55-8b62-daa5c95ff89a tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.063262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2924aac-e2e2-4a55-8b62-daa5c95ff89a tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.064330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2924aac-e2e2-4a55-8b62-daa5c95ff89a tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.065126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2924aac-e2e2-4a55-8b62-daa5c95ff89a tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.164420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-94acd01c-0091-4c73-86ac-367c54053bcd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:18.179592 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c2924aac-e2e2-4a55-8b62-daa5c95ff89a tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] 10.222.0.99 "GET /compute/v2.1/os-simple-tenant-usage/5bedef4a4cad40db8a5fb7c04a01d787?start=2022-08-26T02%3A46%3A16.969403&end=2022-08-28T02%3A46%3A16.969403" status: 200 len: 694 microversion: 2.1 time: 0.883903 Aug 27 02:46:18.191539 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1538/3390] 10.222.0.99 () {58 vars in 1412 bytes} [Sat Aug 27 02:46:17 2022] GET /compute/v2.1/os-simple-tenant-usage/5bedef4a4cad40db8a5fb7c04a01d787?start=2022-08-26T02%3A46%3A16.969403&end=2022-08-28T02%3A46%3A16.969403 => generated 694 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:18.222417 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-94acd01c-0091-4c73-86ac-367c54053bcd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1572 microversion: 2.1 time: 2.044748 Aug 27 02:46:18.225428 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1853/3391] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:16 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1572 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:18.259509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c29561ad-1679-45a9-ad40-504ca87ab423 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '.version_select at 0x7f4d2a71fa60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:18.290796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13f09deb-fb35-4135-92fe-20697d0ab4df tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-577128365"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:18.292393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13f09deb-fb35-4135-92fe-20697d0ab4df tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:18.324871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c29561ad-1679-45a9-ad40-504ca87ab423 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.328051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c29561ad-1679-45a9-ad40-504ca87ab423 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.328889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c29561ad-1679-45a9-ad40-504ca87ab423 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.330792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f09deb-fb35-4135-92fe-20697d0ab4df tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.333105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f09deb-fb35-4135-92fe-20697d0ab4df tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.336851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f09deb-fb35-4135-92fe-20697d0ab4df tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.352644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f09deb-fb35-4135-92fe-20697d0ab4df tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.355498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f09deb-fb35-4135-92fe-20697d0ab4df tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.356177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f09deb-fb35-4135-92fe-20697d0ab4df tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.370711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c29561ad-1679-45a9-ad40-504ca87ab423 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.378302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c29561ad-1679-45a9-ad40-504ca87ab423 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.379473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c29561ad-1679-45a9-ad40-504ca87ab423 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.439224 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c29561ad-1679-45a9-ad40-504ca87ab423 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/os-simple-tenant-usage/5bedef4a4cad40db8a5fb7c04a01d787?start=2022-08-26T02%3A46%3A16.969403&end=2022-08-28T02%3A46%3A16.969403" status: 200 len: 650 microversion: 2.1 time: 0.223076 Aug 27 02:46:18.440732 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1539/3392] 10.222.0.99 () {58 vars in 1412 bytes} [Sat Aug 27 02:46:18 2022] GET /compute/v2.1/os-simple-tenant-usage/5bedef4a4cad40db8a5fb7c04a01d787?start=2022-08-26T02%3A46%3A16.969403&end=2022-08-28T02%3A46%3A16.969403 => generated 650 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:18.450250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:18.462511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:18.489800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.490562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.491370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.492695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.493726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.501249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.672441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:18.713358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:18.720669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:18.727844 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e5d25c09-f4e5-42e6-a83d-58cb9ecd7f72 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1414 microversion: 2.54 time: 0.284912 Aug 27 02:46:18.735729 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1540/3393] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:18 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1414 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:18.802952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cbe84c83-2870-4e61-8a23-6d7e6c7e74de tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Calling method '.version_select at 0x7f4d2a57e8b0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:18.826112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbe84c83-2870-4e61-8a23-6d7e6c7e74de tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.827787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbe84c83-2870-4e61-8a23-6d7e6c7e74de tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.828575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbe84c83-2870-4e61-8a23-6d7e6c7e74de tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:18.906583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbe84c83-2870-4e61-8a23-6d7e6c7e74de tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:18.909112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbe84c83-2870-4e61-8a23-6d7e6c7e74de tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:18.913500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbe84c83-2870-4e61-8a23-6d7e6c7e74de tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:19.034367 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.network.security_group_api [None req-13f09deb-fb35-4135-92fe-20697d0ab4df tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Adding security group 46fa3f5c-f303-4129-8792-83513dafb86f to port f6236cbc-343f-420c-b926-0192ef026193 Aug 27 02:46:19.414834 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cbe84c83-2870-4e61-8a23-6d7e6c7e74de tempest-TenantUsagesTestJSON-2144821536 tempest-TenantUsagesTestJSON-2144821536-project-admin] 10.222.0.99 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T02%3A46%3A16.969403&end=2022-08-28T02%3A46%3A16.969403&detailed=1" status: 200 len: 38920 microversion: 2.1 time: 0.676443 Aug 27 02:46:19.426777 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1541/3394] 10.222.0.99 () {58 vars in 1335 bytes} [Sat Aug 27 02:46:18 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-26T02%3A46%3A16.969403&end=2022-08-28T02%3A46%3A16.969403&detailed=1 => generated 38920 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:46:19.529274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58bae82b-bfbc-419c-beaf-98d9339ff28a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:19.533932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-58bae82b-bfbc-419c-beaf-98d9339ff28a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:19.550452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:19.574891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58bae82b-bfbc-419c-beaf-98d9339ff28a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:19.580263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58bae82b-bfbc-419c-beaf-98d9339ff28a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:19.581461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58bae82b-bfbc-419c-beaf-98d9339ff28a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:19.584471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58bae82b-bfbc-419c-beaf-98d9339ff28a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:19.590602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58bae82b-bfbc-419c-beaf-98d9339ff28a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:19.591763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58bae82b-bfbc-419c-beaf-98d9339ff28a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:19.725895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-58bae82b-bfbc-419c-beaf-98d9339ff28a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:19.987142 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-58bae82b-bfbc-419c-beaf-98d9339ff28a tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "DELETE /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 204 len: 0 microversion: 2.1 time: 0.469866 Aug 27 02:46:19.988274 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1542/3395] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:19 2022] DELETE /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:20.001205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:20.002542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:20.012687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.015080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.017175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:20.019248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.020742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.021858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:20.560447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:20.585398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:20.588538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:20.603184 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ac462fd-2c3b-4c12-97ac-9f816bc12057 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1399 microversion: 2.54 time: 0.612323 Aug 27 02:46:20.604379 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1543/3396] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:19 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1399 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:20.628922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b9d825a-e0de-4bb7-9da7-50ae24bd3603 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:20.633414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b9d825a-e0de-4bb7-9da7-50ae24bd3603 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:20.661406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9d825a-e0de-4bb7-9da7-50ae24bd3603 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.662508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9d825a-e0de-4bb7-9da7-50ae24bd3603 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.663637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9d825a-e0de-4bb7-9da7-50ae24bd3603 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:20.665275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9d825a-e0de-4bb7-9da7-50ae24bd3603 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:20.666524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9d825a-e0de-4bb7-9da7-50ae24bd3603 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:20.675361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9d825a-e0de-4bb7-9da7-50ae24bd3603 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:21.679693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5b9d825a-e0de-4bb7-9da7-50ae24bd3603 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:21.698213 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5b9d825a-e0de-4bb7-9da7-50ae24bd3603 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1469 microversion: 2.1 time: 1.087955 Aug 27 02:46:21.703660 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1544/3397] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:20 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1469 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:21.716665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3491da70-b6f1-4007-8ddc-137bd053eea0 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '.version_select at 0x7f4d2a6e6670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:21.803174 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3491da70-b6f1-4007-8ddc-137bd053eea0 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1740120060" status: 204 len: 0 microversion: 2.54 time: 0.095350 Aug 27 02:46:21.803899 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1545/3398] 10.222.0.99 () {60 vars in 1319 bytes} [Sat Aug 27 02:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1740120060 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:46:21.821425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f4b80823-4a47-4a28-be53-79d89b1afbef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:21.836089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f4b80823-4a47-4a28-be53-79d89b1afbef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:21.857202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4b80823-4a47-4a28-be53-79d89b1afbef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:21.857810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4b80823-4a47-4a28-be53-79d89b1afbef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:21.858265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4b80823-4a47-4a28-be53-79d89b1afbef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:21.859007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4b80823-4a47-4a28-be53-79d89b1afbef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:21.859484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4b80823-4a47-4a28-be53-79d89b1afbef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:21.859923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4b80823-4a47-4a28-be53-79d89b1afbef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:21.952479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f4b80823-4a47-4a28-be53-79d89b1afbef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:22.256287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f4b80823-4a47-4a28-be53-79d89b1afbef tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 204 len: 0 microversion: 2.54 time: 0.439402 Aug 27 02:46:22.256968 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1546/3399] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:46:21 2022] DELETE /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:46:22.278074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:22.280293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:22.311957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:22.313795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:22.314329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:22.316295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:22.316795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:22.317254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:22.891720 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13f09deb-fb35-4135-92fe-20697d0ab4df tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f/action" status: 202 len: 0 microversion: 2.1 time: 4.614454 Aug 27 02:46:22.893943 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1854/3400] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:46:18 2022] POST /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f/action => generated 0 bytes in 4618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:46:22.919434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6ee08bd9-bd66-45ec-816f-02a080b1b96f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:22.920806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6ee08bd9-bd66-45ec-816f-02a080b1b96f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:22.962927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee08bd9-bd66-45ec-816f-02a080b1b96f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:22.968242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee08bd9-bd66-45ec-816f-02a080b1b96f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:22.973768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee08bd9-bd66-45ec-816f-02a080b1b96f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:22.979353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee08bd9-bd66-45ec-816f-02a080b1b96f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:22.987702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee08bd9-bd66-45ec-816f-02a080b1b96f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:22.989072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee08bd9-bd66-45ec-816f-02a080b1b96f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:23.220476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:23.251280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:23.258275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:23.263197 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f4d32697-44f0-4891-a6aa-de718f4ae65c tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1405 microversion: 2.54 time: 0.996131 Aug 27 02:46:23.278706 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1547/3401] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:22 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1405 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:23.306149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1cf5823e-2625-4108-b046-eff51232beea tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2a71f310>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:23.738016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-1cf5823e-2625-4108-b046-eff51232beea tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 46fa3f5c-f303-4129-8792-83513dafb86f in use.", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:46:23.739800 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-1cf5823e-2625-4108-b046-eff51232beea tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security Group 46fa3f5c-f303-4129-8792-83513dafb86f in use. Aug 27 02:46:23.739800 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-6af1fe78-103d-4abd-82ce-133a1d622777'] Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1cf5823e-2625-4108-b046-eff51232beea tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-security-groups/46fa3f5c-f303-4129-8792-83513dafb86f HTTP/1.1 Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: exception: Security Group 46fa3f5c-f303-4129-8792-83513dafb86f in use. Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-6af1fe78-103d-4abd-82ce-133a1d622777'] Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '46fa3f5c-f303-4129-8792-83513dafb86f'} Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:46:23.744987 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 46fa3f5c-f303-4129-8792-83513dafb86f in use. Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af1fe78-103d-4abd-82ce-133a1d622777'] Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 46fa3f5c-f303-4129-8792-83513dafb86f in use. Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af1fe78-103d-4abd-82ce-133a1d622777'] Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 46fa3f5c-f303-4129-8792-83513dafb86f in use. Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af1fe78-103d-4abd-82ce-133a1d622777'] Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 46fa3f5c-f303-4129-8792-83513dafb86f in use. Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af1fe78-103d-4abd-82ce-133a1d622777'] Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1cf5823e-2625-4108-b046-eff51232beea tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 400 to user: Security Group 46fa3f5c-f303-4129-8792-83513dafb86f in use. Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-6af1fe78-103d-4abd-82ce-133a1d622777'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1cf5823e-2625-4108-b046-eff51232beea tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/46fa3f5c-f303-4129-8792-83513dafb86f" status: 400 len: 185 microversion: 2.1 time: 0.466477 Aug 27 02:46:23.756232 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1548/3402] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:23 2022] DELETE /compute/v2.1/os-security-groups/46fa3f5c-f303-4129-8792-83513dafb86f => generated 185 bytes in 469 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:46:23.767651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0b0855a4-79de-44eb-ad4e-62386d623efc req-9310adc9-fba5-4399-8796-38f08fc299a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c63679-0a51-4dd6-b3f9-cb79446fb91f", "tag": "f6236cbc-343f-420c-b926-0192ef026193"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:23.780501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0b0855a4-79de-44eb-ad4e-62386d623efc req-9310adc9-fba5-4399-8796-38f08fc299a8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:23.780996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0b0855a4-79de-44eb-ad4e-62386d623efc req-9310adc9-fba5-4399-8796-38f08fc299a8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:23.781474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0b0855a4-79de-44eb-ad4e-62386d623efc req-9310adc9-fba5-4399-8796-38f08fc299a8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:23.822993 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0b0855a4-79de-44eb-ad4e-62386d623efc req-9310adc9-fba5-4399-8796-38f08fc299a8 service nova] Creating event network-changed:f6236cbc-343f-420c-b926-0192ef026193 for instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f on n-h1-852084-5 Aug 27 02:46:23.841590 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0b0855a4-79de-44eb-ad4e-62386d623efc req-9310adc9-fba5-4399-8796-38f08fc299a8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090528 Aug 27 02:46:23.843714 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1549/3403] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:23.862694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aa6f44f0-15df-40af-807d-a31a94f76fd8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:23.866591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aa6f44f0-15df-40af-807d-a31a94f76fd8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:23.883314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6f44f0-15df-40af-807d-a31a94f76fd8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:23.884885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6f44f0-15df-40af-807d-a31a94f76fd8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:23.887291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6f44f0-15df-40af-807d-a31a94f76fd8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:23.888394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6f44f0-15df-40af-807d-a31a94f76fd8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:23.889098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6f44f0-15df-40af-807d-a31a94f76fd8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:23.889731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa6f44f0-15df-40af-807d-a31a94f76fd8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:23.937875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aa6f44f0-15df-40af-807d-a31a94f76fd8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:23.945794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:24.206019 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aa6f44f0-15df-40af-807d-a31a94f76fd8 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 204 len: 0 microversion: 2.1 time: 0.358046 Aug 27 02:46:24.209924 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1550/3404] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:23 2022] DELETE /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:24.218298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-948e1252-5bb4-4e48-8dac-2744fa0c241b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:24.219074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-948e1252-5bb4-4e48-8dac-2744fa0c241b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:24.228448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-948e1252-5bb4-4e48-8dac-2744fa0c241b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.229347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-948e1252-5bb4-4e48-8dac-2744fa0c241b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.229723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-948e1252-5bb4-4e48-8dac-2744fa0c241b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.231922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-948e1252-5bb4-4e48-8dac-2744fa0c241b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.232842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-948e1252-5bb4-4e48-8dac-2744fa0c241b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.233447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-948e1252-5bb4-4e48-8dac-2744fa0c241b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.653849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-948e1252-5bb4-4e48-8dac-2744fa0c241b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:24.673259 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-948e1252-5bb4-4e48-8dac-2744fa0c241b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1646 microversion: 2.1 time: 0.460685 Aug 27 02:46:24.675240 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1551/3405] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:24 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1646 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:24.686724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:24.689625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:24.705401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.710138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.711052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.712093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:24.715221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:24.716075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:24.736964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6ee08bd9-bd66-45ec-816f-02a080b1b96f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:24.757472 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6ee08bd9-bd66-45ec-816f-02a080b1b96f tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1469 microversion: 2.1 time: 1.861442 Aug 27 02:46:24.758537 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1855/3406] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:22 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1469 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:24.964621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:25.003442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:25.007685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:25.019535 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b02ffed1-7042-4c39-b920-161ed0e2cde4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1405 microversion: 2.54 time: 0.336775 Aug 27 02:46:25.020798 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1552/3407] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:24 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1405 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:25.726258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f51dbcff-d872-47a0-8911-1a6fcc204628 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:25.729693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-632036300", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "c1765e93-5dc0-441a-857d-a2529523c525"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:25.737442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f51dbcff-d872-47a0-8911-1a6fcc204628 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:25.770059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f51dbcff-d872-47a0-8911-1a6fcc204628 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:25.770747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f51dbcff-d872-47a0-8911-1a6fcc204628 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:25.776625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f51dbcff-d872-47a0-8911-1a6fcc204628 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:25.779671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f51dbcff-d872-47a0-8911-1a6fcc204628 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:25.781833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f51dbcff-d872-47a0-8911-1a6fcc204628 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:25.784792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f51dbcff-d872-47a0-8911-1a6fcc204628 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:25.980203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] validate_networks() for [('c1765e93-5dc0-441a-857d-a2529523c525', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:46:27.160533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f51dbcff-d872-47a0-8911-1a6fcc204628 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:27.183185 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f51dbcff-d872-47a0-8911-1a6fcc204628 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1646 microversion: 2.1 time: 1.470122 Aug 27 02:46:27.186559 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1553/3408] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:25 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1646 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:27.198534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:27.200955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:27.235796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.236607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.237751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.239317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.249398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.250211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.359455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:27.361743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:27.366139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:27.367159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lazy-loading 'fault' on Instance uuid 466603af-2b17-4539-98cc-d5d2f6a3c13e {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:27.991069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60ce49610f90415a946edb24fd34b509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bedef4a4cad40db8a5fb7c04a01d787', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:27.999436 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-937279ee-377a-4f18-a40c-153437ba4b56 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 200 len: 1303 microversion: 2.1 time: 0.811439 Aug 27 02:46:28.009412 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1554/3409] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:27 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 1303 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:28.026597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:28.027227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:28.066571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.067083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.067534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.068293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.068768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.069215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.230226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.231273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.231273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.231623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lazy-loading 'fault' on Instance uuid e50804ce-9a61-4cc7-8bd4-031e4db6ed6f {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:28.504239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:28.521617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:28.528700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8706cfc5cb634a66bf28dfcdd1efde54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb86f82e39d24217bed0c5317fce8449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:28.539046 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1b618f16-3aea-43b7-84db-45d43b506ed4 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 200 len: 1410 microversion: 2.54 time: 0.528082 Aug 27 02:46:28.540084 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1555/3410] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:28 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 1410 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:46:28.558547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-650b0d75-627f-49b2-b67d-a14225cb7ae4 req-05ddf732-842a-4527-bfc7-5d18b8b85ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466603af-2b17-4539-98cc-d5d2f6a3c13e", "name": "network-vif-deleted", "tag": "6f75bc58-72ef-4043-b38e-bacd51eaf67b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:28.604621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-650b0d75-627f-49b2-b67d-a14225cb7ae4 req-05ddf732-842a-4527-bfc7-5d18b8b85ff0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.608049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-650b0d75-627f-49b2-b67d-a14225cb7ae4 req-05ddf732-842a-4527-bfc7-5d18b8b85ff0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.610201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-650b0d75-627f-49b2-b67d-a14225cb7ae4 req-05ddf732-842a-4527-bfc7-5d18b8b85ff0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.642795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:46:28.643464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:46:28.644202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:46:28.644787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:46:28.645569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:46:28.666897 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-650b0d75-627f-49b2-b67d-a14225cb7ae4 req-05ddf732-842a-4527-bfc7-5d18b8b85ff0 service nova] Creating event network-vif-deleted:6f75bc58-72ef-4043-b38e-bacd51eaf67b for instance 466603af-2b17-4539-98cc-d5d2f6a3c13e on n-h2-852084-5 Aug 27 02:46:28.672927 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-650b0d75-627f-49b2-b67d-a14225cb7ae4 req-05ddf732-842a-4527-bfc7-5d18b8b85ff0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129165 Aug 27 02:46:28.673359 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1556/3411] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:28.678238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.680395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.683323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.689525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f78b52c0-9fb4-451d-b146-ed0b130738bd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:28.690236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f78b52c0-9fb4-451d-b146-ed0b130738bd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:28.690644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.691265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.693252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.700915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f78b52c0-9fb4-451d-b146-ed0b130738bd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.706216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f78b52c0-9fb4-451d-b146-ed0b130738bd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.706798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f78b52c0-9fb4-451d-b146-ed0b130738bd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.707757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f78b52c0-9fb4-451d-b146-ed0b130738bd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:28.708300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f78b52c0-9fb4-451d-b146-ed0b130738bd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:28.708977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f78b52c0-9fb4-451d-b146-ed0b130738bd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:28.775823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Getting quotas for project 31ad0b862644480a932205fb3680ac00. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:46:28.795935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Getting quotas for user 857495adaa914d33989cbe1ff12e9e04 and project 31ad0b862644480a932205fb3680ac00. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:46:28.855022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:46:28.864405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:46:28.872751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:29.074685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f78b52c0-9fb4-451d-b146-ed0b130738bd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:29.126175 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f78b52c0-9fb4-451d-b146-ed0b130738bd tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 200 len: 1301 microversion: 2.1 time: 0.450002 Aug 27 02:46:29.127494 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-48f97268-5fd6-4d69-b252-bde6086a7b9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.326096 Aug 27 02:46:29.128785 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1856/3412] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:46:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 4370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:46:29.140194 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1557/3413] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:28 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 1301 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:29.144089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e42b45dd-56d1-46b9-896d-5a60ac22c099 req-4892034b-1762-4f2c-b573-ba0e9798489c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c63679-0a51-4dd6-b3f9-cb79446fb91f", "name": "network-vif-deleted", "tag": "f6236cbc-343f-420c-b926-0192ef026193"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:29.164181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:29.207759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] [instance: 466603af-2b17-4539-98cc-d5d2f6a3c13e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:29.215537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e42b45dd-56d1-46b9-896d-5a60ac22c099 req-4892034b-1762-4f2c-b573-ba0e9798489c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.216608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e42b45dd-56d1-46b9-896d-5a60ac22c099 req-4892034b-1762-4f2c-b573-ba0e9798489c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.221946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e42b45dd-56d1-46b9-896d-5a60ac22c099 req-4892034b-1762-4f2c-b573-ba0e9798489c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.226392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.226904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.227363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.228123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.228593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.229035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.280009 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] HTTP exception thrown: Instance 466603af-2b17-4539-98cc-d5d2f6a3c13e could not be found. Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Request method failure captured: Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e HTTP/1.1 Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYVTzYGRIPNDV73K1a0p0GMhz5mMB0oSPwN9SSfgHrFG6t_hvyjkOZpc2pGNc8gbVTR4zWvL7V7r2V1WT6M3eEo5JXyG9VhzvQIEWBurlPoZpsmnDZE_R6XIzeyFnaPsHib4-6FyITJloXBm142oGeiraFtX0ySBxF9q3Qq-AenxnZ8 Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 5bedef4a4cad40db8a5fb7c04a01d787 Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TenantUsagesTestJSON-1555251518 Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5bedef4a4cad40db8a5fb7c04a01d787"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5bedef4a4cad40db8a5fb7c04a01d787"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5bedef4a4cad40db8a5fb7c04a01d787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5bedef4a4cad40db8a5fb7c04a01d787"}]}] Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TenantUsagesTestJSON-1555251518 Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 5bedef4a4cad40db8a5fb7c04a01d787 Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1555251518 Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TenantUsagesTestJSON-1555251518-project Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 60ce49610f90415a946edb24fd34b509 Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TenantUsagesTestJSON-1555251518-project Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 466603af-2b17-4539-98cc-d5d2f6a3c13e could not be found. Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '466603af-2b17-4539-98cc-d5d2f6a3c13e'} Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466603af-2b17-4539-98cc-d5d2f6a3c13e could not be found. Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466603af-2b17-4539-98cc-d5d2f6a3c13e could not be found. Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:29.282890 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:29.287533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:29.287533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:29.287533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:29.287533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:29.287533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:29.287533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466603af-2b17-4539-98cc-d5d2f6a3c13e could not be found. Aug 27 02:46:29.287533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:29.288015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:29.296683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] Returning 404 to user: Instance 466603af-2b17-4539-98cc-d5d2f6a3c13e could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:29.298349 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-365605b2-711b-4d3f-9bae-b22a8f268dc6 tempest-TenantUsagesTestJSON-1555251518 tempest-TenantUsagesTestJSON-1555251518-project] 10.222.0.99 "GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e" status: 404 len: 111 microversion: 2.1 time: 0.151317 Aug 27 02:46:29.299816 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1558/3414] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:29 2022] GET /compute/v2.1/servers/466603af-2b17-4539-98cc-d5d2f6a3c13e => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:29.311913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0013772f-ded0-4f5f-bff7-f885dd7e37c3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:29.313942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0013772f-ded0-4f5f-bff7-f885dd7e37c3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:29.336781 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e42b45dd-56d1-46b9-896d-5a60ac22c099 req-4892034b-1762-4f2c-b573-ba0e9798489c service nova] Creating event network-vif-deleted:f6236cbc-343f-420c-b926-0192ef026193 for instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f on n-h1-852084-5 Aug 27 02:46:29.365736 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e42b45dd-56d1-46b9-896d-5a60ac22c099 req-4892034b-1762-4f2c-b573-ba0e9798489c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230443 Aug 27 02:46:29.369544 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1857/3415] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:29.582759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0013772f-ded0-4f5f-bff7-f885dd7e37c3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:29.593981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:29.601794 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0013772f-ded0-4f5f-bff7-f885dd7e37c3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1224 microversion: 2.1 time: 0.300361 Aug 27 02:46:29.614782 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1559/3416] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:29 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1224 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:29.614880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] [instance: e50804ce-9a61-4cc7-8bd4-031e4db6ed6f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:29.659009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.660073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.666067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.668752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:29.670206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:29.681866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:29.825167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] HTTP exception thrown: Instance e50804ce-9a61-4cc7-8bd4-031e4db6ed6f could not be found. Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Request method failure captured: Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f HTTP/1.1 Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYVRUPcJLyw1Uy-4XKU7BorQrhmQs2KL4taPLZ68OwaqedZmTjZh2hJtY2NOy3hL0mEFLWuGTXRenFtp3W8bPiqmOjv3qqg9u4tmyM2rd3jTJqN_8je5OLbPbA9ZrNGYt6DADEZwuakl635alqNFYYQttcjE3osintySLB0jUaIHo2c Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.54 Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: eb86f82e39d24217bed0c5317fce8449 Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerShowV254Test-884749543 Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_eb86f82e39d24217bed0c5317fce8449"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/eb86f82e39d24217bed0c5317fce8449"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/eb86f82e39d24217bed0c5317fce8449"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/eb86f82e39d24217bed0c5317fce8449"}]}] Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerShowV254Test-884749543 Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: eb86f82e39d24217bed0c5317fce8449 Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerShowV254Test-884749543 Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerShowV254Test-884749543-project Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 8706cfc5cb634a66bf28dfcdd1efde54 Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerShowV254Test-884749543-project Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance e50804ce-9a61-4cc7-8bd4-031e4db6ed6f could not be found. Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'e50804ce-9a61-4cc7-8bd4-031e4db6ed6f'} Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e50804ce-9a61-4cc7-8bd4-031e4db6ed6f could not be found. Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e50804ce-9a61-4cc7-8bd4-031e4db6ed6f could not be found. Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:29.837509 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:29.848839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:29.848839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:29.848839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:29.848839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:29.848839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:29.848839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e50804ce-9a61-4cc7-8bd4-031e4db6ed6f could not be found. Aug 27 02:46:29.848839 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:29.851838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] Returning 404 to user: Instance e50804ce-9a61-4cc7-8bd4-031e4db6ed6f could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:29.854839 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b4ff9877-4c1f-4d59-95be-27edcde0f955 tempest-ServerShowV254Test-884749543 tempest-ServerShowV254Test-884749543-project] 10.222.0.99 "GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f" status: 404 len: 111 microversion: 2.54 time: 0.293324 Aug 27 02:46:29.859533 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1858/3417] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:46:29 2022] GET /compute/v2.1/servers/e50804ce-9a61-4cc7-8bd4-031e4db6ed6f => generated 111 bytes in 301 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:46:30.176327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:30.190819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:30.237206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:30.238462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:30.245364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:30.250887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:30.256470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:30.257230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:30.364123 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f HTTP/1.1 Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '05c63679-0a51-4dd6-b3f9-cb79446fb91f'} Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:30.373100 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.386333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:30.386333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:30.386333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:30.386333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:30.386333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:30.386333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:30.386333 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:30.397282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:30.400601 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-314ab82f-bb47-41a3-95cd-63eb706bd833 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 404 len: 111 microversion: 2.1 time: 0.230579 Aug 27 02:46:30.405224 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1560/3418] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:30 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 111 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:30.427427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-449d0973-1dc7-4c43-82eb-2ef8697e9271 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d29168550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:30.630771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ef095ac8-5076-4d16-a1de-a4aca980aa5f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:30.632379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ef095ac8-5076-4d16-a1de-a4aca980aa5f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:30.896897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ef095ac8-5076-4d16-a1de-a4aca980aa5f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:30.932521 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ef095ac8-5076-4d16-a1de-a4aca980aa5f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1224 microversion: 2.1 time: 0.308506 Aug 27 02:46:30.939153 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1561/3419] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:30 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1224 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:31.974360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f90565b0-95c4-453c-8e11-052d7317ecbc tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:31.980672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f90565b0-95c4-453c-8e11-052d7317ecbc tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:32.058580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90565b0-95c4-453c-8e11-052d7317ecbc tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:32.062125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90565b0-95c4-453c-8e11-052d7317ecbc tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:32.067895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90565b0-95c4-453c-8e11-052d7317ecbc tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:32.080943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90565b0-95c4-453c-8e11-052d7317ecbc tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:32.093313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90565b0-95c4-453c-8e11-052d7317ecbc tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:32.095521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f90565b0-95c4-453c-8e11-052d7317ecbc tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:32.180571 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-449d0973-1dc7-4c43-82eb-2ef8697e9271 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/fae4c8d6-9a2f-4dfe-862e-4763cd98cd28" status: 202 len: 0 microversion: 2.1 time: 1.768279 Aug 27 02:46:32.187553 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1859/3420] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:30 2022] DELETE /compute/v2.1/os-security-groups/fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 => generated 0 bytes in 1776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:46:32.200087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e8c9344-356a-4f74-b3a4-aca6c1756ba7 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2921b700>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:32.823737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f90565b0-95c4-453c-8e11-052d7317ecbc tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:32.855029 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f90565b0-95c4-453c-8e11-052d7317ecbc tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1284 microversion: 2.1 time: 0.894773 Aug 27 02:46:32.859646 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1562/3421] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:31 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1284 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:33.890989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b96fac7-a598-421b-a0a0-2a6711635faa tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:33.892366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9b96fac7-a598-421b-a0a0-2a6711635faa tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:33.906193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b96fac7-a598-421b-a0a0-2a6711635faa tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.907270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b96fac7-a598-421b-a0a0-2a6711635faa tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.908058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b96fac7-a598-421b-a0a0-2a6711635faa tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:33.909208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b96fac7-a598-421b-a0a0-2a6711635faa tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:33.910090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b96fac7-a598-421b-a0a0-2a6711635faa tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:33.910698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b96fac7-a598-421b-a0a0-2a6711635faa tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:34.151460 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e8c9344-356a-4f74-b3a4-aca6c1756ba7 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/46fa3f5c-f303-4129-8792-83513dafb86f" status: 202 len: 0 microversion: 2.1 time: 1.959240 Aug 27 02:46:34.152416 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1860/3422] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:32 2022] DELETE /compute/v2.1/os-security-groups/46fa3f5c-f303-4129-8792-83513dafb86f => generated 0 bytes in 1964 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:46:34.164949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9b96fac7-a598-421b-a0a0-2a6711635faa tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:34.210074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0921834a-62ec-451e-8c06-5b327ffa0707 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'create', calling method: .version_select at 0x7f4d2921bf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-96883548", "description": "tempest-description-682668667"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:34.222704 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9b96fac7-a598-421b-a0a0-2a6711635faa tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1282 microversion: 2.1 time: 0.337904 Aug 27 02:46:34.230525 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1563/3423] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:33 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1282 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:35.169029 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0921834a-62ec-451e-8c06-5b327ffa0707 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.998224 Aug 27 02:46:35.178930 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1861/3424] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:46:34 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:35.194336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bcf7372c-452e-4144-9dd7-ed19c7f319ed tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Action: 'update', calling method: .version_select at 0x7f4d2e740820>, body: {"security_group": {"name": "tempest-sg-hth-1862502629", "description": "tempest-description-hth-371650732"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:35.255326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-601b80bd-517f-48e6-b48c-e821f8e53c90 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:35.256102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-601b80bd-517f-48e6-b48c-e821f8e53c90 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:35.281545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-601b80bd-517f-48e6-b48c-e821f8e53c90 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:35.286622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-601b80bd-517f-48e6-b48c-e821f8e53c90 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:35.287316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-601b80bd-517f-48e6-b48c-e821f8e53c90 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:35.289007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-601b80bd-517f-48e6-b48c-e821f8e53c90 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:35.289810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-601b80bd-517f-48e6-b48c-e821f8e53c90 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:35.291439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-601b80bd-517f-48e6-b48c-e821f8e53c90 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:35.640373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-601b80bd-517f-48e6-b48c-e821f8e53c90 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:35.677989 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-601b80bd-517f-48e6-b48c-e821f8e53c90 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1282 microversion: 2.1 time: 0.432397 Aug 27 02:46:35.682254 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1862/3425] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:35 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1282 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:36.538345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1291190748", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "81160f92-d48b-40f7-aec3-0899de13d6b2"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:36.810847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] validate_networks() for [('81160f92-d48b-40f7-aec3-0899de13d6b2', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:46:37.532863 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bcf7372c-452e-4144-9dd7-ed19c7f319ed tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "PUT /compute/v2.1/os-security-groups/a2cb00ad-aa99-4d1b-a26d-d5ffb29e1194" status: 200 len: 217 microversion: 2.1 time: 2.344947 Aug 27 02:46:37.535541 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1564/3426] 10.222.0.99 () {60 vars in 1290 bytes} [Sat Aug 27 02:46:35 2022] PUT /compute/v2.1/os-security-groups/a2cb00ad-aa99-4d1b-a26d-d5ffb29e1194 => generated 217 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:37.556926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-61037d66-d22c-4bc3-aedf-10c0f8839614 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:37.562531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-61037d66-d22c-4bc3-aedf-10c0f8839614 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:37.651833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61037d66-d22c-4bc3-aedf-10c0f8839614 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.653174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61037d66-d22c-4bc3-aedf-10c0f8839614 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.655878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61037d66-d22c-4bc3-aedf-10c0f8839614 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:37.662458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61037d66-d22c-4bc3-aedf-10c0f8839614 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:37.663902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61037d66-d22c-4bc3-aedf-10c0f8839614 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:37.669187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61037d66-d22c-4bc3-aedf-10c0f8839614 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:38.730588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:38.825129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:38.855183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-61037d66-d22c-4bc3-aedf-10c0f8839614 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:38.878761 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-61037d66-d22c-4bc3-aedf-10c0f8839614 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1324 microversion: 2.1 time: 1.335176 Aug 27 02:46:38.879455 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1565/3427] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:37 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1324 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:38.893988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b7f0609-198a-4f18-9558-5077db47a30d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2e73b430>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:39.174563 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0b7f0609-198a-4f18-9558-5077db47a30d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups/a2cb00ad-aa99-4d1b-a26d-d5ffb29e1194" status: 200 len: 217 microversion: 2.1 time: 0.290360 Aug 27 02:46:39.196005 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1566/3428] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:46:38 2022] GET /compute/v2.1/os-security-groups/a2cb00ad-aa99-4d1b-a26d-d5ffb29e1194 => generated 217 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:39.201465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b7f0609-198a-4f18-9558-5077db47a30d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:39.208121 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0b7f0609-198a-4f18-9558-5077db47a30d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006041 Aug 27 02:46:39.209734 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1567/3429] 10.222.0.99 () {56 vars in 886 bytes} [Sat Aug 27 02:46:39 2022] GET /compute/ => generated 377 bytes in 13 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 27 02:46:39.231801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8f120a68-447a-4a42-b048-ace62ebaffc2 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d29c11790>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:40.538210 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8f120a68-447a-4a42-b048-ace62ebaffc2 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/a2cb00ad-aa99-4d1b-a26d-d5ffb29e1194" status: 202 len: 0 microversion: 2.1 time: 1.326149 Aug 27 02:46:40.544797 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1568/3430] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:39 2022] DELETE /compute/v2.1/os-security-groups/a2cb00ad-aa99-4d1b-a26d-d5ffb29e1194 => generated 0 bytes in 1329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:46:40.548297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-331b6b30-eba8-4dda-bbd7-9691c1cd4c9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:40.549424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-331b6b30-eba8-4dda-bbd7-9691c1cd4c9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:40.596935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331b6b30-eba8-4dda-bbd7-9691c1cd4c9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.597634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331b6b30-eba8-4dda-bbd7-9691c1cd4c9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.618378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331b6b30-eba8-4dda-bbd7-9691c1cd4c9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.619820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331b6b30-eba8-4dda-bbd7-9691c1cd4c9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.620670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331b6b30-eba8-4dda-bbd7-9691c1cd4c9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.621435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-331b6b30-eba8-4dda-bbd7-9691c1cd4c9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.642854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:46:40.643927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:46:40.644663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:46:40.645644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:46:40.646364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:46:40.651512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:40.672722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.673736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.674843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.682363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:40.683561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:40.684344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:40.757948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Getting quotas for project 9af784466d744e7fbb40d43d6b6e62c5. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:46:40.785078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Getting quotas for user 96a627797d4943e294544d084a5bf814 and project 9af784466d744e7fbb40d43d6b6e62c5. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:46:40.848705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:46:40.857044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:46:40.908814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:41.066491 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ed2544f-6b3c-40e2-9664-4c94bbf6c07e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.382272 Aug 27 02:46:41.074021 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1863/3431] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:46:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 5391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:46:41.429345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-331b6b30-eba8-4dda-bbd7-9691c1cd4c9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:41.447902 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-331b6b30-eba8-4dda-bbd7-9691c1cd4c9c tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1324 microversion: 2.1 time: 0.907435 Aug 27 02:46:41.464306 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1569/3432] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:40 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1324 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:41.464306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:41.468842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:41.494122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.494991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.495854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.497115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.498072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.498839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.593398 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f HTTP/1.1 Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '05c63679-0a51-4dd6-b3f9-cb79446fb91f'} Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:41.603465 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-308262a5-c86c-4aae-9357-b5f81e217c1c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 404 len: 111 microversion: 2.1 time: 0.151847 Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1570/3433] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:41 2022] DELETE /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8f29dbec-0749-446a-b853-ccb2d4295c38 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:41.625487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8f29dbec-0749-446a-b853-ccb2d4295c38 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:41.843810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8f29dbec-0749-446a-b853-ccb2d4295c38 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:41.852596 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8f29dbec-0749-446a-b853-ccb2d4295c38 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1225 microversion: 2.1 time: 0.245902 Aug 27 02:46:41.863041 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1571/3434] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:41 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1225 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:41.883297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:41.883956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 05c63679-0a51-4dd6-b3f9-cb79446fb91f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:41.900956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5e36a48-8022-4341-a928-728eabad0069 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:41.921248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.931781 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c5e36a48-8022-4341-a928-728eabad0069 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.855248 Aug 27 02:46:41.936878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.937626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.938601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:41.950063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:41.952427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:41.952559 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1864/3435] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:46:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:41.961451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec3e2aa2-8ca9-44f0-b471-c1aab5a0a70e tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:42.008596 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f HTTP/1.1 Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '05c63679-0a51-4dd6-b3f9-cb79446fb91f'} Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:42.039444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.044968 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:42.044968 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:42.044968 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:42.044968 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:42.044968 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:42.044968 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. Aug 27 02:46:42.044968 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.057099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Instance 05c63679-0a51-4dd6-b3f9-cb79446fb91f could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:42.061006 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2809877e-956b-4f8f-a5c0-f70b9b09116e tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f" status: 404 len: 111 microversion: 2.1 time: 0.195925 Aug 27 02:46:42.064922 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1572/3436] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:41 2022] GET /compute/v2.1/servers/05c63679-0a51-4dd6-b3f9-cb79446fb91f => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:42.079617 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec3e2aa2-8ca9-44f0-b471-c1aab5a0a70e tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.112379 Aug 27 02:46:42.080462 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1865/3437] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 02:46:41 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:42.082033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e6ce9fd-1d5c-48d5-aa04-0703b546cb5c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2e740700>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:42.098704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a576dc4c-4149-4380-8d9c-6e9bd620fc2f tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:42.113995 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a576dc4c-4149-4380-8d9c-6e9bd620fc2f tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019457 Aug 27 02:46:42.123682 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1866/3438] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:46:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:42.144767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-90a0480e-f5fc-4017-add8-b67525107903 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:42.169760 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-90a0480e-f5fc-4017-add8-b67525107903 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028927 Aug 27 02:46:42.174136 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1867/3439] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:46:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:42.187477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a0ad071-6f3c-4788-bd48-476bfe907b6b tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:42.413724 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a0ad071-6f3c-4788-bd48-476bfe907b6b tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.230412 Aug 27 02:46:42.418158 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1868/3440] 10.222.0.99 () {58 vars in 1165 bytes} [Sat Aug 27 02:46:42 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:42.445495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-043a2e02-ce64-44e4-8f66-f14ef257ba62 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:42.495900 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-043a2e02-ce64-44e4-8f66-f14ef257ba62 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.061446 Aug 27 02:46:42.499201 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1869/3441] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:46:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:42.507439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4d9b0394-b6a8-4c57-8d9d-eafd6979d0cb tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:42.519246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4d9b0394-b6a8-4c57-8d9d-eafd6979d0cb tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:42.547317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d9b0394-b6a8-4c57-8d9d-eafd6979d0cb tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:42.547892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d9b0394-b6a8-4c57-8d9d-eafd6979d0cb tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:42.551173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d9b0394-b6a8-4c57-8d9d-eafd6979d0cb tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:42.554546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d9b0394-b6a8-4c57-8d9d-eafd6979d0cb tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:42.560200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d9b0394-b6a8-4c57-8d9d-eafd6979d0cb tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:42.562016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d9b0394-b6a8-4c57-8d9d-eafd6979d0cb tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:42.906329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-5e6ce9fd-1d5c-48d5-aa04-0703b546cb5c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 46fa3f5c-f303-4129-8792-83513dafb86f does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:46:42.906964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-5e6ce9fd-1d5c-48d5-aa04-0703b546cb5c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Neutron security group 46fa3f5c-f303-4129-8792-83513dafb86f not found {{(pid=122487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:46:42.907801 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-5e6ce9fd-1d5c-48d5-aa04-0703b546cb5c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security group 46fa3f5c-f303-4129-8792-83513dafb86f does not exist Aug 27 02:46:42.907801 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-faaad066-e255-40f3-80a1-ee6a968c365c'] Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e6ce9fd-1d5c-48d5-aa04-0703b546cb5c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-security-groups/46fa3f5c-f303-4129-8792-83513dafb86f HTTP/1.1 Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group 46fa3f5c-f303-4129-8792-83513dafb86f does not exist Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-faaad066-e255-40f3-80a1-ee6a968c365c'] Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '46fa3f5c-f303-4129-8792-83513dafb86f'} Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:46:42.910707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 46fa3f5c-f303-4129-8792-83513dafb86f does not exist Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-faaad066-e255-40f3-80a1-ee6a968c365c'] Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 46fa3f5c-f303-4129-8792-83513dafb86f does not exist Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-faaad066-e255-40f3-80a1-ee6a968c365c'] Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 46fa3f5c-f303-4129-8792-83513dafb86f does not exist Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-faaad066-e255-40f3-80a1-ee6a968c365c'] Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 46fa3f5c-f303-4129-8792-83513dafb86f does not exist Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-faaad066-e255-40f3-80a1-ee6a968c365c'] Aug 27 02:46:42.917392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:42.931077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e6ce9fd-1d5c-48d5-aa04-0703b546cb5c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Security group 46fa3f5c-f303-4129-8792-83513dafb86f does not exist Aug 27 02:46:42.931077 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-faaad066-e255-40f3-80a1-ee6a968c365c'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:42.935863 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5e6ce9fd-1d5c-48d5-aa04-0703b546cb5c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/46fa3f5c-f303-4129-8792-83513dafb86f" status: 404 len: 194 microversion: 2.1 time: 0.863817 Aug 27 02:46:42.941038 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1573/3442] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:42 2022] DELETE /compute/v2.1/os-security-groups/46fa3f5c-f303-4129-8792-83513dafb86f => generated 194 bytes in 870 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:42.957687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-363ab900-60a6-47aa-b3c1-459e0e663155 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:43.072358 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-363ab900-60a6-47aa-b3c1-459e0e663155 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.127845 Aug 27 02:46:43.075114 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1574/3443] 10.222.0.99 () {58 vars in 1169 bytes} [Sat Aug 27 02:46:42 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:43.107515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c979f4f-03f0-45ad-8b54-41f1b6a0de7e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:43.108244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c979f4f-03f0-45ad-8b54-41f1b6a0de7e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:43.139613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c979f4f-03f0-45ad-8b54-41f1b6a0de7e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:43.140144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c979f4f-03f0-45ad-8b54-41f1b6a0de7e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:43.143892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c979f4f-03f0-45ad-8b54-41f1b6a0de7e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:43.144700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c979f4f-03f0-45ad-8b54-41f1b6a0de7e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:43.145201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c979f4f-03f0-45ad-8b54-41f1b6a0de7e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:43.149273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c979f4f-03f0-45ad-8b54-41f1b6a0de7e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:43.431837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2c979f4f-03f0-45ad-8b54-41f1b6a0de7e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:43.467244 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c979f4f-03f0-45ad-8b54-41f1b6a0de7e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1277 microversion: 2.1 time: 0.388519 Aug 27 02:46:43.469888 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1575/3444] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:43 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1277 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:43.510028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-99233a91-f9a1-42a2-b0c0-fb25120e29e4 req-d00e70aa-4995-4d5d-be2c-121a673b9967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f767cefe-4357-4575-99ac-aa019f4de78c", "tag": "75d24a4a-8398-4219-a260-6156de9b422c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:43.551050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99233a91-f9a1-42a2-b0c0-fb25120e29e4 req-d00e70aa-4995-4d5d-be2c-121a673b9967 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:43.551555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99233a91-f9a1-42a2-b0c0-fb25120e29e4 req-d00e70aa-4995-4d5d-be2c-121a673b9967 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:43.551998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99233a91-f9a1-42a2-b0c0-fb25120e29e4 req-d00e70aa-4995-4d5d-be2c-121a673b9967 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:43.582097 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-99233a91-f9a1-42a2-b0c0-fb25120e29e4 req-d00e70aa-4995-4d5d-be2c-121a673b9967 service nova] Creating event network-changed:75d24a4a-8398-4219-a260-6156de9b422c for instance f767cefe-4357-4575-99ac-aa019f4de78c on n-h1-852084-5 Aug 27 02:46:43.596840 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-99233a91-f9a1-42a2-b0c0-fb25120e29e4 req-d00e70aa-4995-4d5d-be2c-121a673b9967 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123582 Aug 27 02:46:43.599361 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1576/3445] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:43.617131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-44e4fcb2-a6f8-4e33-9c09-b556b493fd1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2a7ab940>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:43.804371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4d9b0394-b6a8-4c57-8d9d-eafd6979d0cb tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:43.819294 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4d9b0394-b6a8-4c57-8d9d-eafd6979d0cb tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1324 microversion: 2.1 time: 1.318258 Aug 27 02:46:43.820136 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1870/3446] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:42 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1324 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:43.840069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c41a10c9-66a1-4d16-9646-81ee492244a0 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:43.863881 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c41a10c9-66a1-4d16-9646-81ee492244a0 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.042259 Aug 27 02:46:43.865156 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1871/3447] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 02:46:43 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:43.886404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d29b4bc3-daec-4abc-98cc-4074739b21aa tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:43.899506 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d29b4bc3-daec-4abc-98cc-4074739b21aa tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023029 Aug 27 02:46:43.900109 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1872/3448] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:46:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:43.933754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-322285c8-6386-4221-ae47-824b13d524f0 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.060437 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-322285c8-6386-4221-ae47-824b13d524f0 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.148878 Aug 27 02:46:44.073429 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1873/3449] 10.222.0.99 () {58 vars in 1167 bytes} [Sat Aug 27 02:46:43 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:44.084395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94a19dc9-47cb-40b8-8e67-705edd30f087 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.098706 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-94a19dc9-47cb-40b8-8e67-705edd30f087 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022657 Aug 27 02:46:44.099720 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1874/3450] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:44.112634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad55c8f4-fd8e-4e30-bd6f-26ee21a01a2f tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.133659 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad55c8f4-fd8e-4e30-bd6f-26ee21a01a2f tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.024882 Aug 27 02:46:44.134866 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1875/3451] 10.222.0.99 () {58 vars in 1144 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:44.151789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-89fe76c5-5540-4290-b132-7e41d96e0617 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.155949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-44e4fcb2-a6f8-4e33-9c09-b556b493fd1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:46:44.156707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-44e4fcb2-a6f8-4e33-9c09-b556b493fd1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Neutron security group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 not found {{(pid=122487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:46:44.157076 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-44e4fcb2-a6f8-4e33-9c09-b556b493fd1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 does not exist Aug 27 02:46:44.157076 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-486142e5-9329-4e57-a060-4a6594d448c0'] Aug 27 02:46:44.162459 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-89fe76c5-5540-4290-b132-7e41d96e0617 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014770 Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-44e4fcb2-a6f8-4e33-9c09-b556b493fd1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-security-groups/fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 HTTP/1.1 Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 does not exist Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-486142e5-9329-4e57-a060-4a6594d448c0'] Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'fae4c8d6-9a2f-4dfe-862e-4763cd98cd28'} Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:46:44.163163 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 does not exist Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-486142e5-9329-4e57-a060-4a6594d448c0'] Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 does not exist Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-486142e5-9329-4e57-a060-4a6594d448c0'] Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 does not exist Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-486142e5-9329-4e57-a060-4a6594d448c0'] Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 does not exist Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-486142e5-9329-4e57-a060-4a6594d448c0'] Aug 27 02:46:44.167866 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.171877 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1876/3452] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:44.172998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-44e4fcb2-a6f8-4e33-9c09-b556b493fd1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Security group fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 does not exist Aug 27 02:46:44.172998 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-486142e5-9329-4e57-a060-4a6594d448c0'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:44.174882 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-44e4fcb2-a6f8-4e33-9c09-b556b493fd1d tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/fae4c8d6-9a2f-4dfe-862e-4763cd98cd28" status: 404 len: 194 microversion: 2.1 time: 0.572964 Aug 27 02:46:44.175949 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1577/3453] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:43 2022] DELETE /compute/v2.1/os-security-groups/fae4c8d6-9a2f-4dfe-862e-4763cd98cd28 => generated 194 bytes in 576 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:44.177101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-accff6e8-9fde-4a24-8f08-02ec00e4e168 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.191998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b0a56a30-bdd7-473d-910b-3ec958128cd0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2e902940>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.211750 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-accff6e8-9fde-4a24-8f08-02ec00e4e168 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.038730 Aug 27 02:46:44.212541 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1877/3454] 10.222.0.99 () {58 vars in 1148 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:44.228878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ae443c9d-779c-4a52-8165-8163c25692d7 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.252607 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ae443c9d-779c-4a52-8165-8163c25692d7 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.029417 Aug 27 02:46:44.253814 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1878/3455] 10.222.0.99 () {58 vars in 1140 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:44.267546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a935ee8f-c730-41b4-be59-fc807bb818ee tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.276940 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a935ee8f-c730-41b4-be59-fc807bb818ee tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014913 Aug 27 02:46:44.277535 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1879/3456] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:44.290226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ac554194-aeb2-4799-992e-be528646a6e7 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.326544 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ac554194-aeb2-4799-992e-be528646a6e7 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.040705 Aug 27 02:46:44.327426 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1880/3457] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:44.344506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f0913c9a-8769-490e-b86a-abe4dabb459b tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.412767 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f0913c9a-8769-490e-b86a-abe4dabb459b tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075329 Aug 27 02:46:44.415445 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1881/3458] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:44.454874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cd1aa88a-6866-4831-8151-b42fe57d6f20 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.475862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-b0a56a30-bdd7-473d-910b-3ec958128cd0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:46:44.477541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-b0a56a30-bdd7-473d-910b-3ec958128cd0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Neutron security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 not found {{(pid=122487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:46:44.478650 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-b0a56a30-bdd7-473d-910b-3ec958128cd0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:46:44.478650 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-3f255795-a632-4bdf-beea-c8ad61a004a5'] Aug 27 02:46:44.482909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cd1aa88a-6866-4831-8151-b42fe57d6f20 tempest-FlavorsV2TestJSON-1171248250 tempest-FlavorsV2TestJSON-1171248250-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035380 Aug 27 02:46:44.486501 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1882/3459] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b0a56a30-bdd7-473d-910b-3ec958128cd0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-security-groups/8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 HTTP/1.1 Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-3f255795-a632-4bdf-beea-c8ad61a004a5'] Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '8b5834d2-ba66-4d6c-93f0-e64c8c779ee9'} Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:46:44.497998 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f255795-a632-4bdf-beea-c8ad61a004a5'] Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f255795-a632-4bdf-beea-c8ad61a004a5'] Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f255795-a632-4bdf-beea-c8ad61a004a5'] Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f255795-a632-4bdf-beea-c8ad61a004a5'] Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b0a56a30-bdd7-473d-910b-3ec958128cd0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Security group 8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 does not exist Aug 27 02:46:44.507876 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-3f255795-a632-4bdf-beea-c8ad61a004a5'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:44.518981 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b0a56a30-bdd7-473d-910b-3ec958128cd0 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/8b5834d2-ba66-4d6c-93f0-e64c8c779ee9" status: 404 len: 194 microversion: 2.1 time: 0.324957 Aug 27 02:46:44.519295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f037189-ae08-4650-a7ea-8d41e5b03c79 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.519295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8f037189-ae08-4650-a7ea-8d41e5b03c79 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:44.519773 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1578/3460] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:44 2022] DELETE /compute/v2.1/os-security-groups/8b5834d2-ba66-4d6c-93f0-e64c8c779ee9 => generated 194 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:44.531542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f037189-ae08-4650-a7ea-8d41e5b03c79 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.532306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f037189-ae08-4650-a7ea-8d41e5b03c79 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.534599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f037189-ae08-4650-a7ea-8d41e5b03c79 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.538851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3001e9f-7ecd-419f-9148-743df0322517 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2e75c3a0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.540675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f037189-ae08-4650-a7ea-8d41e5b03c79 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.541614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f037189-ae08-4650-a7ea-8d41e5b03c79 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.542238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f037189-ae08-4650-a7ea-8d41e5b03c79 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.720798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-c3001e9f-7ecd-419f-9148-743df0322517 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:46:44.721850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-c3001e9f-7ecd-419f-9148-743df0322517 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Neutron security group 1843e7fe-0338-456b-a473-647616f6b1fb not found {{(pid=122487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:46:44.722764 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-c3001e9f-7ecd-419f-9148-743df0322517 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:46:44.722764 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-23cfb644-73e3-468c-9b22-f694d79b97df'] Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3001e9f-7ecd-419f-9148-743df0322517 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-security-groups/1843e7fe-0338-456b-a473-647616f6b1fb HTTP/1.1 Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-23cfb644-73e3-468c-9b22-f694d79b97df'] Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '1843e7fe-0338-456b-a473-647616f6b1fb'} Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:46:44.727790 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23cfb644-73e3-468c-9b22-f694d79b97df'] Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23cfb644-73e3-468c-9b22-f694d79b97df'] Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23cfb644-73e3-468c-9b22-f694d79b97df'] Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23cfb644-73e3-468c-9b22-f694d79b97df'] Aug 27 02:46:44.735742 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.747019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3001e9f-7ecd-419f-9148-743df0322517 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Security group 1843e7fe-0338-456b-a473-647616f6b1fb does not exist Aug 27 02:46:44.747019 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-23cfb644-73e3-468c-9b22-f694d79b97df'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:44.750067 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c3001e9f-7ecd-419f-9148-743df0322517 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/1843e7fe-0338-456b-a473-647616f6b1fb" status: 404 len: 194 microversion: 2.1 time: 0.228360 Aug 27 02:46:44.759059 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1579/3461] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:44 2022] DELETE /compute/v2.1/os-security-groups/1843e7fe-0338-456b-a473-647616f6b1fb => generated 194 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:44.773247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb2f6206-90de-416f-8a9d-f39da1d4c236 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2a5c6e50>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.773568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8f037189-ae08-4650-a7ea-8d41e5b03c79 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:44.792959 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f037189-ae08-4650-a7ea-8d41e5b03c79 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1283 microversion: 2.1 time: 0.285924 Aug 27 02:46:44.797739 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1883/3462] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1283 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:44.846445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-490d51f1-7874-4224-bbea-5cf19c75a3f3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:44.849373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-490d51f1-7874-4224-bbea-5cf19c75a3f3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:44.863658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-490d51f1-7874-4224-bbea-5cf19c75a3f3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.865714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-490d51f1-7874-4224-bbea-5cf19c75a3f3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.867368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-490d51f1-7874-4224-bbea-5cf19c75a3f3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.869173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-490d51f1-7874-4224-bbea-5cf19c75a3f3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:44.870460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-490d51f1-7874-4224-bbea-5cf19c75a3f3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:44.871642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-490d51f1-7874-4224-bbea-5cf19c75a3f3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:44.945243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-bb2f6206-90de-416f-8a9d-f39da1d4c236 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:46:44.946707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-bb2f6206-90de-416f-8a9d-f39da1d4c236 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Neutron security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 not found {{(pid=122487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:46:44.948817 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-bb2f6206-90de-416f-8a9d-f39da1d4c236 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:46:44.948817 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-bbef756a-b116-437e-9270-c786845b7991'] Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb2f6206-90de-416f-8a9d-f39da1d4c236 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-security-groups/37fa5f83-a75c-49d8-a9f4-e86f3838e805 HTTP/1.1 Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-bbef756a-b116-437e-9270-c786845b7991'] Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '37fa5f83-a75c-49d8-a9f4-e86f3838e805'} Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:46:44.953108 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbef756a-b116-437e-9270-c786845b7991'] Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbef756a-b116-437e-9270-c786845b7991'] Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbef756a-b116-437e-9270-c786845b7991'] Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbef756a-b116-437e-9270-c786845b7991'] Aug 27 02:46:44.960379 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:44.967343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb2f6206-90de-416f-8a9d-f39da1d4c236 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Security group 37fa5f83-a75c-49d8-a9f4-e86f3838e805 does not exist Aug 27 02:46:44.967343 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-bbef756a-b116-437e-9270-c786845b7991'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:44.967833 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bb2f6206-90de-416f-8a9d-f39da1d4c236 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/37fa5f83-a75c-49d8-a9f4-e86f3838e805" status: 404 len: 194 microversion: 2.1 time: 0.199419 Aug 27 02:46:44.972195 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1580/3463] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:44 2022] DELETE /compute/v2.1/os-security-groups/37fa5f83-a75c-49d8-a9f4-e86f3838e805 => generated 194 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:46:44.990915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8e7d5203-67c5-4af0-a1ca-a5a50112f684 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d29b30dc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:45.463139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-490d51f1-7874-4224-bbea-5cf19c75a3f3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:45.474073 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-490d51f1-7874-4224-bbea-5cf19c75a3f3 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1324 microversion: 2.1 time: 0.636238 Aug 27 02:46:45.491908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-8e7d5203-67c5-4af0-a1ca-a5a50112f684 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:46:45.491908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-8e7d5203-67c5-4af0-a1ca-a5a50112f684 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Neutron security group 76e34f85-a1b2-45a9-85da-1fed38550222 not found {{(pid=122487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:46:45.491908 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-8e7d5203-67c5-4af0-a1ca-a5a50112f684 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:46:45.491908 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-f1ad3bf1-4997-4902-98ba-f57552867595'] Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8e7d5203-67c5-4af0-a1ca-a5a50112f684 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-security-groups/76e34f85-a1b2-45a9-85da-1fed38550222 HTTP/1.1 Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-f1ad3bf1-4997-4902-98ba-f57552867595'] Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '76e34f85-a1b2-45a9-85da-1fed38550222'} Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:46:45.492850 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1ad3bf1-4997-4902-98ba-f57552867595'] Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1ad3bf1-4997-4902-98ba-f57552867595'] Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1ad3bf1-4997-4902-98ba-f57552867595'] Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1ad3bf1-4997-4902-98ba-f57552867595'] Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8e7d5203-67c5-4af0-a1ca-a5a50112f684 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Security group 76e34f85-a1b2-45a9-85da-1fed38550222 does not exist Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-f1ad3bf1-4997-4902-98ba-f57552867595'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:45.499269 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8e7d5203-67c5-4af0-a1ca-a5a50112f684 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/76e34f85-a1b2-45a9-85da-1fed38550222" status: 404 len: 194 microversion: 2.1 time: 0.522227 Aug 27 02:46:45.504232 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1884/3464] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:44 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1324 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:45.505568 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1581/3465] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:44 2022] DELETE /compute/v2.1/os-security-groups/76e34f85-a1b2-45a9-85da-1fed38550222 => generated 194 bytes in 531 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:46:45.511782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3381ada3-2a62-4215-9500-94b7a65a107f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:45.514282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3381ada3-2a62-4215-9500-94b7a65a107f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:45.523613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3381ada3-2a62-4215-9500-94b7a65a107f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.524726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3381ada3-2a62-4215-9500-94b7a65a107f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.525446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3381ada3-2a62-4215-9500-94b7a65a107f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.526444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3381ada3-2a62-4215-9500-94b7a65a107f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.527101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3381ada3-2a62-4215-9500-94b7a65a107f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.527755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3381ada3-2a62-4215-9500-94b7a65a107f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.570612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3381ada3-2a62-4215-9500-94b7a65a107f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:45.808000 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3381ada3-2a62-4215-9500-94b7a65a107f tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 204 len: 0 microversion: 2.1 time: 0.300944 Aug 27 02:46:45.813081 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1885/3466] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:45 2022] DELETE /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:45.820152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:45.821118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:45.835144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f15f2775-5835-46e9-a115-6a34e8a1cc6e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:45.835896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f15f2775-5835-46e9-a115-6a34e8a1cc6e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:45.857225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.858387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.858881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.863698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f15f2775-5835-46e9-a115-6a34e8a1cc6e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.865358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f15f2775-5835-46e9-a115-6a34e8a1cc6e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.866025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f15f2775-5835-46e9-a115-6a34e8a1cc6e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.868245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.871929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.873733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f15f2775-5835-46e9-a115-6a34e8a1cc6e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:45.874881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:45.877066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f15f2775-5835-46e9-a115-6a34e8a1cc6e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:45.877620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f15f2775-5835-46e9-a115-6a34e8a1cc6e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:46.123151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f15f2775-5835-46e9-a115-6a34e8a1cc6e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:46.139338 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f15f2775-5835-46e9-a115-6a34e8a1cc6e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1283 microversion: 2.1 time: 0.308695 Aug 27 02:46:46.141466 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1886/3467] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:45 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1283 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:46.496918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e130f7b0-571f-4f6f-a7ba-c2b623d4437a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:46.498179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e130f7b0-571f-4f6f-a7ba-c2b623d4437a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:46.527629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e130f7b0-571f-4f6f-a7ba-c2b623d4437a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:46.528941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e130f7b0-571f-4f6f-a7ba-c2b623d4437a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:46.529407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e130f7b0-571f-4f6f-a7ba-c2b623d4437a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:46.530201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e130f7b0-571f-4f6f-a7ba-c2b623d4437a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:46.530841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e130f7b0-571f-4f6f-a7ba-c2b623d4437a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:46.531440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e130f7b0-571f-4f6f-a7ba-c2b623d4437a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:46.692876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:46.705441 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1646 microversion: 2.1 time: 0.890381 Aug 27 02:46:46.712954 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1582/3468] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:45 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1646 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:46.898855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:46.900076 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001671 Aug 27 02:46:46.900513 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1583/3469] 10.222.0.99 () {56 vars in 886 bytes} [Sat Aug 27 02:46:46 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 27 02:46:46.909062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:46.910380 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001831 Aug 27 02:46:46.911852 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1584/3470] 10.222.0.99 () {54 vars in 1035 bytes} [Sat Aug 27 02:46:46 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Aug 27 02:46:46.919053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:46.920186 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001627 Aug 27 02:46:46.920697 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1585/3471] 10.222.0.99 () {54 vars in 1041 bytes} [Sat Aug 27 02:46:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:46:46.930040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:46.931833 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba1eb0ab-24b4-4326-90f5-120455394304 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002145 Aug 27 02:46:46.932207 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1586/3472] 10.222.0.99 () {56 vars in 886 bytes} [Sat Aug 27 02:46:46 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 27 02:46:47.175962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ee0f845-e987-4b49-85e9-0c0cab12f95a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:47.176905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1ee0f845-e987-4b49-85e9-0c0cab12f95a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:47.196122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee0f845-e987-4b49-85e9-0c0cab12f95a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:47.197778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee0f845-e987-4b49-85e9-0c0cab12f95a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:47.200003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee0f845-e987-4b49-85e9-0c0cab12f95a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:47.202419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee0f845-e987-4b49-85e9-0c0cab12f95a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:47.204163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee0f845-e987-4b49-85e9-0c0cab12f95a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:47.207687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee0f845-e987-4b49-85e9-0c0cab12f95a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:47.315380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:47.510981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e130f7b0-571f-4f6f-a7ba-c2b623d4437a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:47.550200 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e130f7b0-571f-4f6f-a7ba-c2b623d4437a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1324 microversion: 2.1 time: 1.056913 Aug 27 02:46:47.581614 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1887/3473] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:46 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1324 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:47.736832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74bd00c4-c78c-473e-9332-3e60abb2f55a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:47.737477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-74bd00c4-c78c-473e-9332-3e60abb2f55a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:47.760526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74bd00c4-c78c-473e-9332-3e60abb2f55a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:47.764768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74bd00c4-c78c-473e-9332-3e60abb2f55a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:47.765430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74bd00c4-c78c-473e-9332-3e60abb2f55a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:47.768250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74bd00c4-c78c-473e-9332-3e60abb2f55a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:47.768771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74bd00c4-c78c-473e-9332-3e60abb2f55a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:47.771030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74bd00c4-c78c-473e-9332-3e60abb2f55a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:47.911800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1ee0f845-e987-4b49-85e9-0c0cab12f95a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:47.931572 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1ee0f845-e987-4b49-85e9-0c0cab12f95a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1325 microversion: 2.1 time: 0.760024 Aug 27 02:46:47.945714 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1587/3474] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:47 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1325 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:48.359281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-74bd00c4-c78c-473e-9332-3e60abb2f55a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:48.376611 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-74bd00c4-c78c-473e-9332-3e60abb2f55a tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1646 microversion: 2.1 time: 0.644995 Aug 27 02:46:48.383178 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1888/3475] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:47 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1646 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:46:48.591930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5ee56a35-c075-48a8-8096-1af91df59252 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:48.595469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5ee56a35-c075-48a8-8096-1af91df59252 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:48.631221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ee56a35-c075-48a8-8096-1af91df59252 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.633042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ee56a35-c075-48a8-8096-1af91df59252 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:48.640369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ee56a35-c075-48a8-8096-1af91df59252 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:48.644909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ee56a35-c075-48a8-8096-1af91df59252 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.647847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ee56a35-c075-48a8-8096-1af91df59252 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:48.648385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ee56a35-c075-48a8-8096-1af91df59252 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:48.975222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e88b7ce3-a6e0-4220-8e4b-3ea66b1507ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:48.976490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e88b7ce3-a6e0-4220-8e4b-3ea66b1507ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:48.997524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e88b7ce3-a6e0-4220-8e4b-3ea66b1507ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:48.998794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e88b7ce3-a6e0-4220-8e4b-3ea66b1507ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:49.002176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e88b7ce3-a6e0-4220-8e4b-3ea66b1507ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:49.003905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e88b7ce3-a6e0-4220-8e4b-3ea66b1507ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:49.006409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e88b7ce3-a6e0-4220-8e4b-3ea66b1507ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:49.006718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5ee56a35-c075-48a8-8096-1af91df59252 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:49.008968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e88b7ce3-a6e0-4220-8e4b-3ea66b1507ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:49.019499 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5ee56a35-c075-48a8-8096-1af91df59252 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1324 microversion: 2.1 time: 0.441566 Aug 27 02:46:49.024136 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1588/3476] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:48 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1324 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:49.411371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-899b36af-8f41-447d-87cb-75eb734b914b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:49.415183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-899b36af-8f41-447d-87cb-75eb734b914b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:49.443830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-899b36af-8f41-447d-87cb-75eb734b914b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:49.447056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-899b36af-8f41-447d-87cb-75eb734b914b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:49.447825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-899b36af-8f41-447d-87cb-75eb734b914b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:49.448983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-899b36af-8f41-447d-87cb-75eb734b914b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:49.454426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-899b36af-8f41-447d-87cb-75eb734b914b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:49.456293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-899b36af-8f41-447d-87cb-75eb734b914b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:50.163731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-899b36af-8f41-447d-87cb-75eb734b914b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:50.198398 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-899b36af-8f41-447d-87cb-75eb734b914b tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1646 microversion: 2.1 time: 0.794731 Aug 27 02:46:50.212241 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1589/3477] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:49 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1646 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:50.216193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-91bd9b7f-dbae-48cc-8127-12aab868afa5 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:50.217250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-91bd9b7f-dbae-48cc-8127-12aab868afa5 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:50.240672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:50.243369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bd9b7f-dbae-48cc-8127-12aab868afa5 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:50.251878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bd9b7f-dbae-48cc-8127-12aab868afa5 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:50.253123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bd9b7f-dbae-48cc-8127-12aab868afa5 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:50.257053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bd9b7f-dbae-48cc-8127-12aab868afa5 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:50.259101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bd9b7f-dbae-48cc-8127-12aab868afa5 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:50.260303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bd9b7f-dbae-48cc-8127-12aab868afa5 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:50.519169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e88b7ce3-a6e0-4220-8e4b-3ea66b1507ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:50.550997 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e88b7ce3-a6e0-4220-8e4b-3ea66b1507ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1325 microversion: 2.1 time: 1.587125 Aug 27 02:46:50.554170 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1889/3478] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:48 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1325 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:50.975248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d6ace7e7-f143-4ae2-bed6-b0d26a37585d req-0d5abcda-6a89-4fc3-a312-3865002d8e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63023909-57ad-4eb5-be6a-1ce0cc58b608", "name": "network-vif-deleted", "tag": "8dfb1ab5-38bf-470a-9ac5-e9258d8600ed"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:50.993996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:50.995269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:51.014787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d6ace7e7-f143-4ae2-bed6-b0d26a37585d req-0d5abcda-6a89-4fc3-a312-3865002d8e32 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.015333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d6ace7e7-f143-4ae2-bed6-b0d26a37585d req-0d5abcda-6a89-4fc3-a312-3865002d8e32 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.015785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d6ace7e7-f143-4ae2-bed6-b0d26a37585d req-0d5abcda-6a89-4fc3-a312-3865002d8e32 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.065407 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d6ace7e7-f143-4ae2-bed6-b0d26a37585d req-0d5abcda-6a89-4fc3-a312-3865002d8e32 service nova] Creating event network-vif-deleted:8dfb1ab5-38bf-470a-9ac5-e9258d8600ed for instance 63023909-57ad-4eb5-be6a-1ce0cc58b608 on n-h2-852084-5 Aug 27 02:46:51.083836 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d6ace7e7-f143-4ae2-bed6-b0d26a37585d req-0d5abcda-6a89-4fc3-a312-3865002d8e32 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120642 Aug 27 02:46:51.085377 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1890/3479] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:46:51.239145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:51.240594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:51.273188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.274542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.275453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.282316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.284943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.295898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.416333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:51.419755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:51.423288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:51.427318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lazy-loading 'fault' on Instance uuid 63023909-57ad-4eb5-be6a-1ce0cc58b608 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:46:51.848906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:52.105181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e6dd194aa342058daf161777e0adca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd39361940384245b4c43e4490a261bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:52.128245 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-054731c0-e021-4531-b0e8-4c9c1d320677 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 200 len: 1305 microversion: 2.1 time: 0.908209 Aug 27 02:46:52.131410 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1891/3480] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:51 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 1305 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:52.171198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2c106b50-b1c2-4f59-9c94-e245acd8db45 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:52.173051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2c106b50-b1c2-4f59-9c94-e245acd8db45 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:52.195212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c106b50-b1c2-4f59-9c94-e245acd8db45 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:52.195761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c106b50-b1c2-4f59-9c94-e245acd8db45 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:52.198490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c106b50-b1c2-4f59-9c94-e245acd8db45 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:52.201577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c106b50-b1c2-4f59-9c94-e245acd8db45 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:52.205176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c106b50-b1c2-4f59-9c94-e245acd8db45 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:52.207249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c106b50-b1c2-4f59-9c94-e245acd8db45 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:52.289436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-91bd9b7f-dbae-48cc-8127-12aab868afa5 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:52.304110 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-91bd9b7f-dbae-48cc-8127-12aab868afa5 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1324 microversion: 2.1 time: 2.097391 Aug 27 02:46:52.318307 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1590/3481] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:50 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1324 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:52.322570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-9bddfc87-bf2f-4bbb-84af-c2809309db7d req-ace98511-d415-4e48-99f2-9bda294d71bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f767cefe-4357-4575-99ac-aa019f4de78c", "name": "network-vif-plugged", "status": "completed", "tag": "75d24a4a-8398-4219-a260-6156de9b422c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:52.344806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9bddfc87-bf2f-4bbb-84af-c2809309db7d req-ace98511-d415-4e48-99f2-9bda294d71bb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:52.349230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9bddfc87-bf2f-4bbb-84af-c2809309db7d req-ace98511-d415-4e48-99f2-9bda294d71bb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:52.350196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9bddfc87-bf2f-4bbb-84af-c2809309db7d req-ace98511-d415-4e48-99f2-9bda294d71bb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:52.379227 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-9bddfc87-bf2f-4bbb-84af-c2809309db7d req-ace98511-d415-4e48-99f2-9bda294d71bb service nova] Creating event network-vif-plugged:75d24a4a-8398-4219-a260-6156de9b422c for instance f767cefe-4357-4575-99ac-aa019f4de78c on n-h1-852084-5 Aug 27 02:46:52.386626 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-9bddfc87-bf2f-4bbb-84af-c2809309db7d req-ace98511-d415-4e48-99f2-9bda294d71bb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070606 Aug 27 02:46:52.389436 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1591/3482] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:52.583023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1826523341", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "2188ed37-6503-48b6-b57d-d1f130980da6"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:52.665221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] validate_networks() for [('2188ed37-6503-48b6-b57d-d1f130980da6', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:46:52.921220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2c106b50-b1c2-4f59-9c94-e245acd8db45 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:52.934191 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2c106b50-b1c2-4f59-9c94-e245acd8db45 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1325 microversion: 2.1 time: 0.801237 Aug 27 02:46:52.950506 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1892/3483] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:52 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1325 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:53.155327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:53.155992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] [instance: 63023909-57ad-4eb5-be6a-1ce0cc58b608] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:53.162925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.163421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.163860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.164585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.179936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.180430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.210567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] HTTP exception thrown: Instance 63023909-57ad-4eb5-be6a-1ce0cc58b608 could not be found. Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Request method failure captured: Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 HTTP/1.1 Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYT_IN12DYtqEzmeQAsTGE54mBYTuFZ3LKNzQtv98KT5SHUB7vri05xHKQQho1nohfBThGYHJNyCorj2V-1ywtvi0WOB8_DnNxkkU8tzLf3gGg1qygckAwNRQYVnEqIvL5wxowWbF1yokrvAHXqJdxFviyzgzZPawuzFZGClNaM6vm4 Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd39361940384245b4c43e4490a261bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd39361940384245b4c43e4490a261bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd39361940384245b4c43e4490a261bb"}]}] Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: dd39361940384245b4c43e4490a261bb Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-500662746 Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b0e6dd194aa342058daf161777e0adca Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-SecurityGroupsTestJSON-500662746-project Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 63023909-57ad-4eb5-be6a-1ce0cc58b608 could not be found. Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '63023909-57ad-4eb5-be6a-1ce0cc58b608'} Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63023909-57ad-4eb5-be6a-1ce0cc58b608 could not be found. Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63023909-57ad-4eb5-be6a-1ce0cc58b608 could not be found. Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:53.212417 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:53.218910 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:53.218910 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:53.218910 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:53.218910 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:53.218910 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:53.218910 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63023909-57ad-4eb5-be6a-1ce0cc58b608 could not be found. Aug 27 02:46:53.218910 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:53.218910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Returning 404 to user: Instance 63023909-57ad-4eb5-be6a-1ce0cc58b608 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:53.218910 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1bbd808d-e30c-4b3f-b883-4aa89e7f483c tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608" status: 404 len: 111 microversion: 2.1 time: 0.063262 Aug 27 02:46:53.218910 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1893/3484] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:53 2022] GET /compute/v2.1/servers/63023909-57ad-4eb5-be6a-1ce0cc58b608 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:46:53.224775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4084ef21-38da-4041-9f71-a5b56a819252 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2920c1f0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:53.464729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:46:53.465609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:46:53.465969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:46:53.466827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:46:53.467555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:46:53.492675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.493175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.494650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.495757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.509192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.513621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.544595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Getting quotas for project cc17e7035bc944c0b2709e2c48c86913. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:46:53.552567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Getting quotas for user 06b9779adbc448b98b2d17bdda361164 and project cc17e7035bc944c0b2709e2c48c86913. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:46:53.572597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:46:53.576289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:46:53.691307 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7e537ebd-3f87-4920-847f-09348ce93400 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300103 Aug 27 02:46:53.714961 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1592/3485] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:46:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:46:53.721276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8afe8acf-d518-4809-af84-f35a32a7cc9a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:53.755939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8afe8acf-d518-4809-af84-f35a32a7cc9a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:53.880394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8afe8acf-d518-4809-af84-f35a32a7cc9a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.882463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8afe8acf-d518-4809-af84-f35a32a7cc9a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.883754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8afe8acf-d518-4809-af84-f35a32a7cc9a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:53.889550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8afe8acf-d518-4809-af84-f35a32a7cc9a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:53.891583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8afe8acf-d518-4809-af84-f35a32a7cc9a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:53.892707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8afe8acf-d518-4809-af84-f35a32a7cc9a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:54.566502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8afe8acf-d518-4809-af84-f35a32a7cc9a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:54.619792 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8afe8acf-d518-4809-af84-f35a32a7cc9a tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1324 microversion: 2.1 time: 0.898647 Aug 27 02:46:54.630660 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1593/3486] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:53 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1324 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:54.678180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ed14c512-5d0b-4f46-b903-9dc6d92acdf4 req-33a620b7-1907-4f56-99cd-69a9c1d9fc20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d77305-6bf5-4d11-bb93-187f23a42307", "tag": "527191ef-390a-438e-a31e-10660e3e62b3"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:46:54.732727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ed14c512-5d0b-4f46-b903-9dc6d92acdf4 req-33a620b7-1907-4f56-99cd-69a9c1d9fc20 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:54.734031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ed14c512-5d0b-4f46-b903-9dc6d92acdf4 req-33a620b7-1907-4f56-99cd-69a9c1d9fc20 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:54.735133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ed14c512-5d0b-4f46-b903-9dc6d92acdf4 req-33a620b7-1907-4f56-99cd-69a9c1d9fc20 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:54.770191 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ed14c512-5d0b-4f46-b903-9dc6d92acdf4 req-33a620b7-1907-4f56-99cd-69a9c1d9fc20 service nova] Creating event network-changed:527191ef-390a-438e-a31e-10660e3e62b3 for instance f5d77305-6bf5-4d11-bb93-187f23a42307 on n-h2-852084-5 Aug 27 02:46:54.792226 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ed14c512-5d0b-4f46-b903-9dc6d92acdf4 req-33a620b7-1907-4f56-99cd-69a9c1d9fc20 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152319 Aug 27 02:46:54.795897 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1594/3487] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:46:54.822897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9099b6df-db84-46e7-99b3-e0ec375b12e2 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:54.824435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9099b6df-db84-46e7-99b3-e0ec375b12e2 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:54.876226 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4084ef21-38da-4041-9f71-a5b56a819252 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/ae3bf98b-ed32-4572-b31b-bf4632f75659" status: 202 len: 0 microversion: 2.1 time: 1.656059 Aug 27 02:46:54.877585 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1894/3488] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:53 2022] DELETE /compute/v2.1/os-security-groups/ae3bf98b-ed32-4572-b31b-bf4632f75659 => generated 0 bytes in 1658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:46:54.886117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c03dfa2c-efc9-463e-a79a-c602fa37ea89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:54.888991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c03dfa2c-efc9-463e-a79a-c602fa37ea89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:54.927964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03dfa2c-efc9-463e-a79a-c602fa37ea89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:54.930789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03dfa2c-efc9-463e-a79a-c602fa37ea89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:54.933257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03dfa2c-efc9-463e-a79a-c602fa37ea89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:54.941160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03dfa2c-efc9-463e-a79a-c602fa37ea89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:54.942888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03dfa2c-efc9-463e-a79a-c602fa37ea89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:54.944730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03dfa2c-efc9-463e-a79a-c602fa37ea89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:55.072516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9099b6df-db84-46e7-99b3-e0ec375b12e2 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:55.114564 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9099b6df-db84-46e7-99b3-e0ec375b12e2 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1224 microversion: 2.1 time: 0.315667 Aug 27 02:46:55.144588 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1595/3489] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:54 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1224 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:55.158008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cab42e5a-cae3-45af-8887-f86ba5d5ab38 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] Calling method '.version_select at 0x7f4d2e740f70>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:55.951759 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cab42e5a-cae3-45af-8887-f86ba5d5ab38 tempest-SecurityGroupsTestJSON-500662746 tempest-SecurityGroupsTestJSON-500662746-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/2104a625-b722-4ab5-9e8b-b61e9927a61c" status: 202 len: 0 microversion: 2.1 time: 0.805616 Aug 27 02:46:55.952883 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1596/3490] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:55 2022] DELETE /compute/v2.1/os-security-groups/2104a625-b722-4ab5-9e8b-b61e9927a61c => generated 0 bytes in 808 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:46:55.958520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-91bf30a5-b7ea-46be-8877-e165d332d5f1 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:55.959657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-91bf30a5-b7ea-46be-8877-e165d332d5f1 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:55.992032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bf30a5-b7ea-46be-8877-e165d332d5f1 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:55.995528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bf30a5-b7ea-46be-8877-e165d332d5f1 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:55.996335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bf30a5-b7ea-46be-8877-e165d332d5f1 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.003088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bf30a5-b7ea-46be-8877-e165d332d5f1 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.003806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bf30a5-b7ea-46be-8877-e165d332d5f1 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.004458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91bf30a5-b7ea-46be-8877-e165d332d5f1 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.341285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c03dfa2c-efc9-463e-a79a-c602fa37ea89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:56.350902 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c03dfa2c-efc9-463e-a79a-c602fa37ea89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1325 microversion: 2.1 time: 1.471889 Aug 27 02:46:56.359395 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1895/3491] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:54 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1325 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:56.372594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4cfb842b-65df-4a94-95ff-f5ada4b6c813 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:56.385320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4cfb842b-65df-4a94-95ff-f5ada4b6c813 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:56.404404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cfb842b-65df-4a94-95ff-f5ada4b6c813 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.411038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cfb842b-65df-4a94-95ff-f5ada4b6c813 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.415316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cfb842b-65df-4a94-95ff-f5ada4b6c813 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.417155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cfb842b-65df-4a94-95ff-f5ada4b6c813 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.424288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cfb842b-65df-4a94-95ff-f5ada4b6c813 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.424777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cfb842b-65df-4a94-95ff-f5ada4b6c813 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.688983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-91bf30a5-b7ea-46be-8877-e165d332d5f1 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:56.714975 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-91bf30a5-b7ea-46be-8877-e165d332d5f1 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1520 microversion: 2.1 time: 0.752720 Aug 27 02:46:56.717195 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1597/3492] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:55 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1520 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:56.725223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4cfb842b-65df-4a94-95ff-f5ada4b6c813 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:56.759098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:56.759966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:56.772820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.779414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.780377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.781377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.782467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.783180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.788250 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4cfb842b-65df-4a94-95ff-f5ada4b6c813 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1276 microversion: 2.1 time: 0.425406 Aug 27 02:46:56.795076 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1896/3493] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:56 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1276 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:56.863628 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] HTTP exception thrown: Instance is not a member of specified network Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Request method failure captured: Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c/ips/invalid HTTP/1.1 Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYV_U1CeUdvw6DgqFvVp0U79EtuVkoANe4VAgI3K4CJ841W01a9s_ZU1uMimJ3x0qEemK-l8HRl_g2eZP2hoaMg5ZWI3NLOynPR8xKZlMqsZsiZiy-epYn_78HixRiIOO62EP_IMRy3O0TdfRY0y1lqpCqgoyqT5ZEJO7vLdhTZzrQ4 Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 31ad0b862644480a932205fb3680ac00 Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1976649108 Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_31ad0b862644480a932205fb3680ac00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/31ad0b862644480a932205fb3680ac00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/31ad0b862644480a932205fb3680ac00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/31ad0b862644480a932205fb3680ac00"}]}] Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1976649108 Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 31ad0b862644480a932205fb3680ac00 Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1976649108 Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerAddressesNegativeTestJSON-1976649108-project Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 857495adaa914d33989cbe1ff12e9e04 Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1976649108-project Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance is not a member of specified network Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': 'f767cefe-4357-4575-99ac-aa019f4de78c', 'id': 'invalid'} Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:46:56.882047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:56.889321 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c1214448-d604-49a3-b1ad-b411644d49b8 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.127983 Aug 27 02:46:56.889321 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1598/3494] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:46:56 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c/ips/invalid => generated 91 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:46:56.918150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-054e84dc-c94a-459a-9846-e9db98f76847 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:56.919604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-054e84dc-c94a-459a-9846-e9db98f76847 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Failed to fetch instance by id 999 {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 02:46:56.920916 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-054e84dc-c94a-459a-9846-e9db98f76847 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] HTTP exception thrown: Instance 999 could not be found. Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-054e84dc-c94a-459a-9846-e9db98f76847 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Request method failure captured: Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYV_U1CeUdvw6DgqFvVp0U79EtuVkoANe4VAgI3K4CJ841W01a9s_ZU1uMimJ3x0qEemK-l8HRl_g2eZP2hoaMg5ZWI3NLOynPR8xKZlMqsZsiZiy-epYn_78HixRiIOO62EP_IMRy3O0TdfRY0y1lqpCqgoyqT5ZEJO7vLdhTZzrQ4 Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 31ad0b862644480a932205fb3680ac00 Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1976649108 Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_31ad0b862644480a932205fb3680ac00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/31ad0b862644480a932205fb3680ac00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/31ad0b862644480a932205fb3680ac00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/31ad0b862644480a932205fb3680ac00"}]}] Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1976649108 Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 31ad0b862644480a932205fb3680ac00 Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1976649108 Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerAddressesNegativeTestJSON-1976649108-project Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 857495adaa914d33989cbe1ff12e9e04 Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1976649108-project Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 999 could not be found. Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'server_id': '999'} Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 27 02:46:56.925915 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:46:56.937222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-054e84dc-c94a-459a-9846-e9db98f76847 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:46:56.941759 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-054e84dc-c94a-459a-9846-e9db98f76847 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.045434 Aug 27 02:46:56.950603 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1897/3495] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:46:56 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:46:56.962354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4acf06f7-7a80-4b81-9e1d-be09245c2e99 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:56.963245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4acf06f7-7a80-4b81-9e1d-be09245c2e99 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:56.974299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4acf06f7-7a80-4b81-9e1d-be09245c2e99 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.974809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4acf06f7-7a80-4b81-9e1d-be09245c2e99 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.975262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4acf06f7-7a80-4b81-9e1d-be09245c2e99 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:56.977159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4acf06f7-7a80-4b81-9e1d-be09245c2e99 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:56.982272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4acf06f7-7a80-4b81-9e1d-be09245c2e99 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:56.985528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4acf06f7-7a80-4b81-9e1d-be09245c2e99 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:57.069597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4acf06f7-7a80-4b81-9e1d-be09245c2e99 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:46:57.353103 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4acf06f7-7a80-4b81-9e1d-be09245c2e99 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 204 len: 0 microversion: 2.1 time: 0.391657 Aug 27 02:46:57.355010 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1599/3496] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:46:56 2022] DELETE /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:46:57.365713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aa1f0960-9c06-4707-bc53-7e38976da56f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:57.367680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aa1f0960-9c06-4707-bc53-7e38976da56f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:57.393507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa1f0960-9c06-4707-bc53-7e38976da56f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:57.394487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa1f0960-9c06-4707-bc53-7e38976da56f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:57.395265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa1f0960-9c06-4707-bc53-7e38976da56f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:57.396327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa1f0960-9c06-4707-bc53-7e38976da56f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:57.397100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa1f0960-9c06-4707-bc53-7e38976da56f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:57.399426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa1f0960-9c06-4707-bc53-7e38976da56f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:57.417079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-90f75307-fdf2-4c95-87b2-32c22bf26061 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:57.418095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:46:57.421497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-90f75307-fdf2-4c95-87b2-32c22bf26061 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:57.441377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f75307-fdf2-4c95-87b2-32c22bf26061 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:57.442376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f75307-fdf2-4c95-87b2-32c22bf26061 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:57.443439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f75307-fdf2-4c95-87b2-32c22bf26061 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:57.444824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f75307-fdf2-4c95-87b2-32c22bf26061 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:57.446110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f75307-fdf2-4c95-87b2-32c22bf26061 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:57.446925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f75307-fdf2-4c95-87b2-32c22bf26061 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:57.939279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-90f75307-fdf2-4c95-87b2-32c22bf26061 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:57.953731 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-90f75307-fdf2-4c95-87b2-32c22bf26061 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1325 microversion: 2.1 time: 0.556702 Aug 27 02:46:57.954329 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1600/3497] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:57 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1325 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:57.966021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a6f078a-dc8d-482f-af65-18c42dfcded1 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:57.971262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1a6f078a-dc8d-482f-af65-18c42dfcded1 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:58.007980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a6f078a-dc8d-482f-af65-18c42dfcded1 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:58.013521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a6f078a-dc8d-482f-af65-18c42dfcded1 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:58.018450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a6f078a-dc8d-482f-af65-18c42dfcded1 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:58.024959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a6f078a-dc8d-482f-af65-18c42dfcded1 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:58.026711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a6f078a-dc8d-482f-af65-18c42dfcded1 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:58.030194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a6f078a-dc8d-482f-af65-18c42dfcded1 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:58.076986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa1f0960-9c06-4707-bc53-7e38976da56f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:58.093486 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aa1f0960-9c06-4707-bc53-7e38976da56f tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1526 microversion: 2.1 time: 0.733681 Aug 27 02:46:58.106266 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1898/3498] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:57 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1526 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:58.455603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1a6f078a-dc8d-482f-af65-18c42dfcded1 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:46:58.465426 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1a6f078a-dc8d-482f-af65-18c42dfcded1 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1282 microversion: 2.1 time: 0.509893 Aug 27 02:46:58.479921 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1601/3499] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:57 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1282 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:46:58.975257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58fedc42-5994-42aa-992a-8ae64fc5f010 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:58.976021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-58fedc42-5994-42aa-992a-8ae64fc5f010 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:58.991572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58fedc42-5994-42aa-992a-8ae64fc5f010 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:58.993953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58fedc42-5994-42aa-992a-8ae64fc5f010 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:58.997407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58fedc42-5994-42aa-992a-8ae64fc5f010 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:58.999863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58fedc42-5994-42aa-992a-8ae64fc5f010 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.001042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58fedc42-5994-42aa-992a-8ae64fc5f010 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.002420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58fedc42-5994-42aa-992a-8ae64fc5f010 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.120659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-39ce2ba5-b3ad-4bc0-827b-a128328af92b tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:46:59.121288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-39ce2ba5-b3ad-4bc0-827b-a128328af92b tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:46:59.146056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39ce2ba5-b3ad-4bc0-827b-a128328af92b tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.146573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39ce2ba5-b3ad-4bc0-827b-a128328af92b tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.154494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39ce2ba5-b3ad-4bc0-827b-a128328af92b tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:46:59.155618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39ce2ba5-b3ad-4bc0-827b-a128328af92b tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:46:59.156438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39ce2ba5-b3ad-4bc0-827b-a128328af92b tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:46:59.157128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39ce2ba5-b3ad-4bc0-827b-a128328af92b tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.480035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58fedc42-5994-42aa-992a-8ae64fc5f010 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:00.499085 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58fedc42-5994-42aa-992a-8ae64fc5f010 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1325 microversion: 2.1 time: 1.524759 Aug 27 02:47:00.500489 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1899/3500] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:58 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1325 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:00.517123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb97a396-b27f-4bc5-9fe0-7b1b001eeb1d tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:00.521819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fb97a396-b27f-4bc5-9fe0-7b1b001eeb1d tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:00.534630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb97a396-b27f-4bc5-9fe0-7b1b001eeb1d tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.535479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb97a396-b27f-4bc5-9fe0-7b1b001eeb1d tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.536109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb97a396-b27f-4bc5-9fe0-7b1b001eeb1d tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.537378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb97a396-b27f-4bc5-9fe0-7b1b001eeb1d tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:00.545336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb97a396-b27f-4bc5-9fe0-7b1b001eeb1d tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:00.546339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb97a396-b27f-4bc5-9fe0-7b1b001eeb1d tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:00.817176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-39ce2ba5-b3ad-4bc0-827b-a128328af92b tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:00.832245 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-39ce2ba5-b3ad-4bc0-827b-a128328af92b tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1526 microversion: 2.1 time: 1.716594 Aug 27 02:47:00.834327 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1602/3501] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:46:59 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1526 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:01.239854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fb97a396-b27f-4bc5-9fe0-7b1b001eeb1d tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:01.254616 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fb97a396-b27f-4bc5-9fe0-7b1b001eeb1d tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1324 microversion: 2.1 time: 0.750367 Aug 27 02:47:01.255493 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1900/3502] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:00 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1324 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:01.523502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8554de36-d908-484e-a30a-a9c0981c5d86 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:01.524147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8554de36-d908-484e-a30a-a9c0981c5d86 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:01.547770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8554de36-d908-484e-a30a-a9c0981c5d86 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.548297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8554de36-d908-484e-a30a-a9c0981c5d86 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.548738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8554de36-d908-484e-a30a-a9c0981c5d86 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.549495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8554de36-d908-484e-a30a-a9c0981c5d86 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.549996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8554de36-d908-484e-a30a-a9c0981c5d86 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.550439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8554de36-d908-484e-a30a-a9c0981c5d86 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.873315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3774b968-a9d9-4576-9c06-a8d2e061b0f6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:01.876911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3774b968-a9d9-4576-9c06-a8d2e061b0f6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:01.911271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3774b968-a9d9-4576-9c06-a8d2e061b0f6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.911789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3774b968-a9d9-4576-9c06-a8d2e061b0f6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.912303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3774b968-a9d9-4576-9c06-a8d2e061b0f6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:01.913031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3774b968-a9d9-4576-9c06-a8d2e061b0f6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:01.913502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3774b968-a9d9-4576-9c06-a8d2e061b0f6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:01.913976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3774b968-a9d9-4576-9c06-a8d2e061b0f6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:02.411627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8554de36-d908-484e-a30a-a9c0981c5d86 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:02.421152 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8554de36-d908-484e-a30a-a9c0981c5d86 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1325 microversion: 2.1 time: 0.901610 Aug 27 02:47:02.424484 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1603/3503] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:01 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1325 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:02.438496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-b8225c29-45bb-425a-bba6-88854ebd164a req-236a09f2-1336-413d-87bd-7c44f9880f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d77305-6bf5-4d11-bb93-187f23a42307", "name": "network-vif-plugged", "status": "completed", "tag": "527191ef-390a-438e-a31e-10660e3e62b3"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:02.470857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b8225c29-45bb-425a-bba6-88854ebd164a req-236a09f2-1336-413d-87bd-7c44f9880f3d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:02.471987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b8225c29-45bb-425a-bba6-88854ebd164a req-236a09f2-1336-413d-87bd-7c44f9880f3d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:02.472607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b8225c29-45bb-425a-bba6-88854ebd164a req-236a09f2-1336-413d-87bd-7c44f9880f3d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:02.500571 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-b8225c29-45bb-425a-bba6-88854ebd164a req-236a09f2-1336-413d-87bd-7c44f9880f3d service nova] Creating event network-vif-plugged:527191ef-390a-438e-a31e-10660e3e62b3 for instance f5d77305-6bf5-4d11-bb93-187f23a42307 on n-h2-852084-5 Aug 27 02:47:02.517231 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-b8225c29-45bb-425a-bba6-88854ebd164a req-236a09f2-1336-413d-87bd-7c44f9880f3d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090282 Aug 27 02:47:02.518168 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1604/3504] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:02.523849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-66d459e3-b770-4316-9bb4-e1a983072c7f req-4f1cf213-9b70-4f79-9b5b-07ca2eb5418a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f767cefe-4357-4575-99ac-aa019f4de78c", "name": "network-vif-deleted", "tag": "75d24a4a-8398-4219-a260-6156de9b422c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:02.552104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-66d459e3-b770-4316-9bb4-e1a983072c7f req-4f1cf213-9b70-4f79-9b5b-07ca2eb5418a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:02.555125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-66d459e3-b770-4316-9bb4-e1a983072c7f req-4f1cf213-9b70-4f79-9b5b-07ca2eb5418a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:02.555757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-66d459e3-b770-4316-9bb4-e1a983072c7f req-4f1cf213-9b70-4f79-9b5b-07ca2eb5418a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:02.593058 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-66d459e3-b770-4316-9bb4-e1a983072c7f req-4f1cf213-9b70-4f79-9b5b-07ca2eb5418a service nova] Creating event network-vif-deleted:75d24a4a-8398-4219-a260-6156de9b422c for instance f767cefe-4357-4575-99ac-aa019f4de78c on n-h1-852084-5 Aug 27 02:47:02.599194 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-66d459e3-b770-4316-9bb4-e1a983072c7f req-4f1cf213-9b70-4f79-9b5b-07ca2eb5418a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079271 Aug 27 02:47:02.600495 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1605/3505] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:02.619548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-37210a62-54c7-4a08-b11e-a7bcde8088d5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:02.620565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-37210a62-54c7-4a08-b11e-a7bcde8088d5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:02.630734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37210a62-54c7-4a08-b11e-a7bcde8088d5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:02.631509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37210a62-54c7-4a08-b11e-a7bcde8088d5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:02.633247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37210a62-54c7-4a08-b11e-a7bcde8088d5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:02.637878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37210a62-54c7-4a08-b11e-a7bcde8088d5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:02.641566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37210a62-54c7-4a08-b11e-a7bcde8088d5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:02.642444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37210a62-54c7-4a08-b11e-a7bcde8088d5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:02.697185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3774b968-a9d9-4576-9c06-a8d2e061b0f6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857495adaa914d33989cbe1ff12e9e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ad0b862644480a932205fb3680ac00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:02.713551 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3774b968-a9d9-4576-9c06-a8d2e061b0f6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 200 len: 1484 microversion: 2.1 time: 0.844665 Aug 27 02:47:02.714938 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1901/3506] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:01 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 1484 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:03.321085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-37210a62-54c7-4a08-b11e-a7bcde8088d5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:03.334114 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-37210a62-54c7-4a08-b11e-a7bcde8088d5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1324 microversion: 2.1 time: 0.732134 Aug 27 02:47:03.337288 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1606/3507] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:02 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1324 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:03.483204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-96742dfa-d315-4c53-b8d1-9e6c0906fbd1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:03.484655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-96742dfa-d315-4c53-b8d1-9e6c0906fbd1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:03.492014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96742dfa-d315-4c53-b8d1-9e6c0906fbd1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:03.492840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96742dfa-d315-4c53-b8d1-9e6c0906fbd1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:03.493291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96742dfa-d315-4c53-b8d1-9e6c0906fbd1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:03.494061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96742dfa-d315-4c53-b8d1-9e6c0906fbd1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:03.494785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96742dfa-d315-4c53-b8d1-9e6c0906fbd1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:03.495482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96742dfa-d315-4c53-b8d1-9e6c0906fbd1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:03.765243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:03.770017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] [instance: f767cefe-4357-4575-99ac-aa019f4de78c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:03.779816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:03.792646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:03.795035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:03.796535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:03.798874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:03.800443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:03.801351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:03.820988 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] HTTP exception thrown: Instance f767cefe-4357-4575-99ac-aa019f4de78c could not be found. Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Request method failure captured: Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c HTTP/1.1 Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYV_U1CeUdvw6DgqFvVp0U79EtuVkoANe4VAgI3K4CJ841W01a9s_ZU1uMimJ3x0qEemK-l8HRl_g2eZP2hoaMg5ZWI3NLOynPR8xKZlMqsZsiZiy-epYn_78HixRiIOO62EP_IMRy3O0TdfRY0y1lqpCqgoyqT5ZEJO7vLdhTZzrQ4 Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 31ad0b862644480a932205fb3680ac00 Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1976649108 Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_31ad0b862644480a932205fb3680ac00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/31ad0b862644480a932205fb3680ac00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/31ad0b862644480a932205fb3680ac00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/31ad0b862644480a932205fb3680ac00"}]}] Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1976649108 Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 31ad0b862644480a932205fb3680ac00 Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1976649108 Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerAddressesNegativeTestJSON-1976649108-project Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 857495adaa914d33989cbe1ff12e9e04 Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1976649108-project Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance f767cefe-4357-4575-99ac-aa019f4de78c could not be found. Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f767cefe-4357-4575-99ac-aa019f4de78c'} Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f767cefe-4357-4575-99ac-aa019f4de78c could not be found. Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f767cefe-4357-4575-99ac-aa019f4de78c could not be found. Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:03.827431 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:03.832146 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:03.832146 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:03.832146 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:03.832146 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:03.832146 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:03.832146 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:03.832146 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f767cefe-4357-4575-99ac-aa019f4de78c could not be found. Aug 27 02:47:03.832146 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:03.837975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] Returning 404 to user: Instance f767cefe-4357-4575-99ac-aa019f4de78c could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:03.841545 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e92476f1-a1d1-417a-8a4c-8ed8047f11d6 tempest-ServerAddressesNegativeTestJSON-1976649108 tempest-ServerAddressesNegativeTestJSON-1976649108-project] 10.222.0.99 "GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c" status: 404 len: 111 microversion: 2.1 time: 0.087000 Aug 27 02:47:03.842585 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1607/3508] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:03 2022] GET /compute/v2.1/servers/f767cefe-4357-4575-99ac-aa019f4de78c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:04.358133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f5f913f8-03c3-4ed6-9335-5e9a3b00018a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:04.358815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f5f913f8-03c3-4ed6-9335-5e9a3b00018a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:04.372277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5f913f8-03c3-4ed6-9335-5e9a3b00018a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.372788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5f913f8-03c3-4ed6-9335-5e9a3b00018a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.373905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5f913f8-03c3-4ed6-9335-5e9a3b00018a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.374938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5f913f8-03c3-4ed6-9335-5e9a3b00018a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:04.375812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5f913f8-03c3-4ed6-9335-5e9a3b00018a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:04.376556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5f913f8-03c3-4ed6-9335-5e9a3b00018a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:04.430232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:05.104506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f5f913f8-03c3-4ed6-9335-5e9a3b00018a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:05.110475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:05.142234 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f5f913f8-03c3-4ed6-9335-5e9a3b00018a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1324 microversion: 2.1 time: 0.787438 Aug 27 02:47:05.152451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-96742dfa-d315-4c53-b8d1-9e6c0906fbd1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:05.174168 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1608/3509] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:04 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1324 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:05.194054 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-96742dfa-d315-4c53-b8d1-9e6c0906fbd1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1325 microversion: 2.1 time: 1.717077 Aug 27 02:47:05.196024 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1902/3510] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:03 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1325 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:06.195008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4f523d9a-bff4-41cc-b61b-ac3395d5ea4b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:06.207505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4f523d9a-bff4-41cc-b61b-ac3395d5ea4b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:06.224213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a76daaf-9a09-45ef-8584-2da6988defed tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:06.232916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a76daaf-9a09-45ef-8584-2da6988defed tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:06.273766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a76daaf-9a09-45ef-8584-2da6988defed tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:06.276433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a76daaf-9a09-45ef-8584-2da6988defed tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:06.278356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a76daaf-9a09-45ef-8584-2da6988defed tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:06.282167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f523d9a-bff4-41cc-b61b-ac3395d5ea4b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:06.283451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f523d9a-bff4-41cc-b61b-ac3395d5ea4b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:06.284807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f523d9a-bff4-41cc-b61b-ac3395d5ea4b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:06.293026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a76daaf-9a09-45ef-8584-2da6988defed tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:06.294575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a76daaf-9a09-45ef-8584-2da6988defed tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:06.299853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f523d9a-bff4-41cc-b61b-ac3395d5ea4b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:06.301443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f523d9a-bff4-41cc-b61b-ac3395d5ea4b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:06.312429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f523d9a-bff4-41cc-b61b-ac3395d5ea4b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:06.315450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a76daaf-9a09-45ef-8584-2da6988defed tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:07.008746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4f523d9a-bff4-41cc-b61b-ac3395d5ea4b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:07.026931 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4f523d9a-bff4-41cc-b61b-ac3395d5ea4b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1324 microversion: 2.1 time: 0.835500 Aug 27 02:47:07.043630 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1609/3511] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:06 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1324 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:07.057826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-38e2cf25-133c-412e-bb6e-c91f36cb51af req-271a07ae-eea4-416f-bb16-97db113d3e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104cc615-4155-4157-b995-0bbf57ab176d", "tag": "34d016fe-a06a-440d-8c9b-1abc35b14a0c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:07.085237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-38e2cf25-133c-412e-bb6e-c91f36cb51af req-271a07ae-eea4-416f-bb16-97db113d3e7c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:07.089211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-38e2cf25-133c-412e-bb6e-c91f36cb51af req-271a07ae-eea4-416f-bb16-97db113d3e7c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:07.090815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-38e2cf25-133c-412e-bb6e-c91f36cb51af req-271a07ae-eea4-416f-bb16-97db113d3e7c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:07.117266 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-38e2cf25-133c-412e-bb6e-c91f36cb51af req-271a07ae-eea4-416f-bb16-97db113d3e7c service nova] Creating event network-changed:34d016fe-a06a-440d-8c9b-1abc35b14a0c for instance 104cc615-4155-4157-b995-0bbf57ab176d on n-h1-852084-5 Aug 27 02:47:07.141345 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-38e2cf25-133c-412e-bb6e-c91f36cb51af req-271a07ae-eea4-416f-bb16-97db113d3e7c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094920 Aug 27 02:47:07.145038 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1610/3512] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:07.609192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7a76daaf-9a09-45ef-8584-2da6988defed tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:07.661298 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a76daaf-9a09-45ef-8584-2da6988defed tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1523 microversion: 2.1 time: 1.445582 Aug 27 02:47:07.691415 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1903/3513] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:06 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1523 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:07.721224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0cee5d93-fa8c-4be1-99ea-fb08be2c5e4b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:07.725295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0cee5d93-fa8c-4be1-99ea-fb08be2c5e4b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:07.776442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cee5d93-fa8c-4be1-99ea-fb08be2c5e4b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:07.777389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cee5d93-fa8c-4be1-99ea-fb08be2c5e4b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:07.784845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cee5d93-fa8c-4be1-99ea-fb08be2c5e4b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:07.787441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cee5d93-fa8c-4be1-99ea-fb08be2c5e4b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:07.789853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cee5d93-fa8c-4be1-99ea-fb08be2c5e4b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:07.792485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cee5d93-fa8c-4be1-99ea-fb08be2c5e4b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:08.096201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8e30bb24-9bb9-498a-bb67-dce0b8c9b451 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:08.118139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8e30bb24-9bb9-498a-bb67-dce0b8c9b451 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:08.149421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:08.173348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30bb24-9bb9-498a-bb67-dce0b8c9b451 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:08.174082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30bb24-9bb9-498a-bb67-dce0b8c9b451 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:08.174562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30bb24-9bb9-498a-bb67-dce0b8c9b451 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:08.176761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30bb24-9bb9-498a-bb67-dce0b8c9b451 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:08.177306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30bb24-9bb9-498a-bb67-dce0b8c9b451 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:08.177835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8e30bb24-9bb9-498a-bb67-dce0b8c9b451 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:08.525220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0cee5d93-fa8c-4be1-99ea-fb08be2c5e4b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:08.534264 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0cee5d93-fa8c-4be1-99ea-fb08be2c5e4b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1523 microversion: 2.1 time: 0.830471 Aug 27 02:47:08.540757 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1611/3514] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:07 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1523 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:08.570499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cfef07c6-2210-445b-9757-783d0618a6ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1188676498", "metadata": {"": ""}}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cfef07c6-2210-445b-9757-783d0618a6ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action HTTP/1.1 Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 107 Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1188676498", "metadata": {"": ""}}} Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f5d77305-6bf5-4d11-bb93-187f23a42307', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1188676498', 'metadata': {'': ''}}}} Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'': ''} Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:08.575775 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:08.581078 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:08.586796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cfef07c6-2210-445b-9757-783d0618a6ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:08.593322 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cfef07c6-2210-445b-9757-783d0618a6ef tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action" status: 400 len: 170 microversion: 2.1 time: 0.027300 Aug 27 02:47:08.597046 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1612/3515] 10.222.0.99 () {60 vars in 1279 bytes} [Sat Aug 27 02:47:08 2022] POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action => generated 170 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:47:08.613846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9383d5f4-ac1f-45c3-8b5b-680d648700d2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:08.615659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9383d5f4-ac1f-45c3-8b5b-680d648700d2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:08.633364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9383d5f4-ac1f-45c3-8b5b-680d648700d2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:08.634488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9383d5f4-ac1f-45c3-8b5b-680d648700d2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:08.635343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9383d5f4-ac1f-45c3-8b5b-680d648700d2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:08.640122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9383d5f4-ac1f-45c3-8b5b-680d648700d2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:08.641231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9383d5f4-ac1f-45c3-8b5b-680d648700d2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:08.643313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9383d5f4-ac1f-45c3-8b5b-680d648700d2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:09.269874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9383d5f4-ac1f-45c3-8b5b-680d648700d2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:09.311101 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9383d5f4-ac1f-45c3-8b5b-680d648700d2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1523 microversion: 2.1 time: 0.707376 Aug 27 02:47:09.314308 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1613/3516] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:08 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1523 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:09.369038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0122667d-2b0a-4cdb-8437-9e2a5b1bb00c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:09.370746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0122667d-2b0a-4cdb-8437-9e2a5b1bb00c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:09.383699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0122667d-2b0a-4cdb-8437-9e2a5b1bb00c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:09.385344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0122667d-2b0a-4cdb-8437-9e2a5b1bb00c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:09.386513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0122667d-2b0a-4cdb-8437-9e2a5b1bb00c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:09.388398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0122667d-2b0a-4cdb-8437-9e2a5b1bb00c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:09.389555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0122667d-2b0a-4cdb-8437-9e2a5b1bb00c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:09.390658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0122667d-2b0a-4cdb-8437-9e2a5b1bb00c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:09.539829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8e30bb24-9bb9-498a-bb67-dce0b8c9b451 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:09.580468 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8e30bb24-9bb9-498a-bb67-dce0b8c9b451 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1324 microversion: 2.1 time: 1.532889 Aug 27 02:47:09.593490 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1904/3517] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:08 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1324 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:10.627052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-31d8e942-adc0-4f77-acf9-3dff6e23fc26 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:10.644893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-31d8e942-adc0-4f77-acf9-3dff6e23fc26 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:10.667044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31d8e942-adc0-4f77-acf9-3dff6e23fc26 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:10.669068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31d8e942-adc0-4f77-acf9-3dff6e23fc26 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:10.670844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31d8e942-adc0-4f77-acf9-3dff6e23fc26 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:10.676060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31d8e942-adc0-4f77-acf9-3dff6e23fc26 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:10.677492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31d8e942-adc0-4f77-acf9-3dff6e23fc26 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:10.678997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31d8e942-adc0-4f77-acf9-3dff6e23fc26 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:11.041437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0122667d-2b0a-4cdb-8437-9e2a5b1bb00c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:11.060547 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0122667d-2b0a-4cdb-8437-9e2a5b1bb00c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1523 microversion: 2.1 time: 1.702300 Aug 27 02:47:11.061351 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1614/3518] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:09 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1523 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:11.107199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a551ea2-37b9-4dc1-b226-da16a51a6176 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1378485684", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a551ea2-37b9-4dc1-b226-da16a51a6176 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action HTTP/1.1 Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 619 Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1378485684", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f5d77305-6bf5-4d11-bb93-187f23a42307', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1378485684', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:47:11.124829 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:11.132223 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:11.146168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a551ea2-37b9-4dc1-b226-da16a51a6176 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:11.149158 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6a551ea2-37b9-4dc1-b226-da16a51a6176 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action" status: 400 len: 938 microversion: 2.1 time: 0.050042 Aug 27 02:47:11.158974 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1615/3519] 10.222.0.99 () {60 vars in 1279 bytes} [Sat Aug 27 02:47:11 2022] POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action => generated 938 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:47:11.178832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93e3a64f-254c-478e-8b4e-65390e5bc487 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:11.187701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93e3a64f-254c-478e-8b4e-65390e5bc487 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:11.207788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93e3a64f-254c-478e-8b4e-65390e5bc487 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:11.214323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93e3a64f-254c-478e-8b4e-65390e5bc487 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:11.215184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93e3a64f-254c-478e-8b4e-65390e5bc487 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:11.216499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93e3a64f-254c-478e-8b4e-65390e5bc487 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:11.217259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93e3a64f-254c-478e-8b4e-65390e5bc487 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:11.218061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93e3a64f-254c-478e-8b4e-65390e5bc487 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:12.270395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-31d8e942-adc0-4f77-acf9-3dff6e23fc26 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:12.280149 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-31d8e942-adc0-4f77-acf9-3dff6e23fc26 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1324 microversion: 2.1 time: 1.668459 Aug 27 02:47:12.280766 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1905/3520] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:10 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1324 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:12.283774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-93e3a64f-254c-478e-8b4e-65390e5bc487 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:12.311054 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-93e3a64f-254c-478e-8b4e-65390e5bc487 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1523 microversion: 2.1 time: 1.146635 Aug 27 02:47:12.311968 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1616/3521] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:11 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1523 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:12.355898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c1f2aec-e8b7-45bf-91d4-f38520fba7b3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:12.356471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9c1f2aec-e8b7-45bf-91d4-f38520fba7b3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:12.367425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c1f2aec-e8b7-45bf-91d4-f38520fba7b3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:12.368600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c1f2aec-e8b7-45bf-91d4-f38520fba7b3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:12.372037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c1f2aec-e8b7-45bf-91d4-f38520fba7b3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:12.373409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c1f2aec-e8b7-45bf-91d4-f38520fba7b3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:12.375493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c1f2aec-e8b7-45bf-91d4-f38520fba7b3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:12.376443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c1f2aec-e8b7-45bf-91d4-f38520fba7b3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:13.111464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9c1f2aec-e8b7-45bf-91d4-f38520fba7b3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:13.129516 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9c1f2aec-e8b7-45bf-91d4-f38520fba7b3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1523 microversion: 2.1 time: 0.777845 Aug 27 02:47:13.144937 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1906/3522] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:12 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1523 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:13.178049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5dedbbf1-65a2-44be-8fe9-218de74d8c54 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5dedbbf1-65a2-44be-8fe9-218de74d8c54 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action HTTP/1.1 Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 285 Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f5d77305-6bf5-4d11-bb93-187f23a42307', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.205194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5dedbbf1-65a2-44be-8fe9-218de74d8c54 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5dedbbf1-65a2-44be-8fe9-218de74d8c54 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action" status: 400 len: 619 microversion: 2.1 time: 0.024926 Aug 27 02:47:13.215374 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1617/3523] 10.222.0.99 () {60 vars in 1279 bytes} [Sat Aug 27 02:47:13 2022] POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:47:13.226294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab2b6443-e5f9-4bc1-b29e-f980bcc2a882 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:13.226294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ab2b6443-e5f9-4bc1-b29e-f980bcc2a882 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:13.233209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2b6443-e5f9-4bc1-b29e-f980bcc2a882 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:13.233964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2b6443-e5f9-4bc1-b29e-f980bcc2a882 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:13.236694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2b6443-e5f9-4bc1-b29e-f980bcc2a882 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:13.238036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2b6443-e5f9-4bc1-b29e-f980bcc2a882 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:13.238911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2b6443-e5f9-4bc1-b29e-f980bcc2a882 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:13.241916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2b6443-e5f9-4bc1-b29e-f980bcc2a882 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:13.320136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7a3ee136-e747-4fb4-baa4-3eb2bf4ec987 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:13.320748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7a3ee136-e747-4fb4-baa4-3eb2bf4ec987 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:13.359282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a3ee136-e747-4fb4-baa4-3eb2bf4ec987 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:13.360139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a3ee136-e747-4fb4-baa4-3eb2bf4ec987 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:13.360994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a3ee136-e747-4fb4-baa4-3eb2bf4ec987 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:13.361990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a3ee136-e747-4fb4-baa4-3eb2bf4ec987 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:13.362681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a3ee136-e747-4fb4-baa4-3eb2bf4ec987 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:13.363116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a3ee136-e747-4fb4-baa4-3eb2bf4ec987 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:13.729181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7a3ee136-e747-4fb4-baa4-3eb2bf4ec987 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:13.772151 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7a3ee136-e747-4fb4-baa4-3eb2bf4ec987 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1324 microversion: 2.1 time: 0.456747 Aug 27 02:47:13.773404 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1618/3524] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:13 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:14.814563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a6951eb1-baeb-40cd-b55e-80c3d1796526 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:14.815705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a6951eb1-baeb-40cd-b55e-80c3d1796526 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:14.846395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6951eb1-baeb-40cd-b55e-80c3d1796526 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:14.849296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6951eb1-baeb-40cd-b55e-80c3d1796526 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:14.851324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6951eb1-baeb-40cd-b55e-80c3d1796526 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:14.852401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6951eb1-baeb-40cd-b55e-80c3d1796526 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:14.860113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6951eb1-baeb-40cd-b55e-80c3d1796526 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:14.860955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6951eb1-baeb-40cd-b55e-80c3d1796526 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:15.046257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ab2b6443-e5f9-4bc1-b29e-f980bcc2a882 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:15.073443 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab2b6443-e5f9-4bc1-b29e-f980bcc2a882 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1523 microversion: 2.1 time: 1.861954 Aug 27 02:47:15.074581 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1907/3525] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:13 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1523 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:15.099803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32b55d9b-9134-4b02-8b3c-6233bcf96ff2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:15.100721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-32b55d9b-9134-4b02-8b3c-6233bcf96ff2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:15.111179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32b55d9b-9134-4b02-8b3c-6233bcf96ff2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:15.111993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32b55d9b-9134-4b02-8b3c-6233bcf96ff2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:15.112675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32b55d9b-9134-4b02-8b3c-6233bcf96ff2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:15.113687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32b55d9b-9134-4b02-8b3c-6233bcf96ff2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:15.114405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32b55d9b-9134-4b02-8b3c-6233bcf96ff2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:15.115029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32b55d9b-9134-4b02-8b3c-6233bcf96ff2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:16.025428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-32b55d9b-9134-4b02-8b3c-6233bcf96ff2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:16.033595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a6951eb1-baeb-40cd-b55e-80c3d1796526 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:16.044643 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-32b55d9b-9134-4b02-8b3c-6233bcf96ff2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1523 microversion: 2.1 time: 0.951549 Aug 27 02:47:16.064253 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1908/3526] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:15 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1523 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:16.066314 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a6951eb1-baeb-40cd-b55e-80c3d1796526 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1324 microversion: 2.1 time: 1.260165 Aug 27 02:47:16.068726 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1619/3527] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:14 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1324 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:16.080657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fd934d22-5bba-4e24-a38e-605f9abf7bd4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-522746751"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:16.088702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fd934d22-5bba-4e24-a38e-605f9abf7bd4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:16.107185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd934d22-5bba-4e24-a38e-605f9abf7bd4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:16.108051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd934d22-5bba-4e24-a38e-605f9abf7bd4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:16.108882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd934d22-5bba-4e24-a38e-605f9abf7bd4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:16.113071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd934d22-5bba-4e24-a38e-605f9abf7bd4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:16.113863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd934d22-5bba-4e24-a38e-605f9abf7bd4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:16.114579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd934d22-5bba-4e24-a38e-605f9abf7bd4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:16.587426 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fd934d22-5bba-4e24-a38e-605f9abf7bd4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action" status: 202 len: 0 microversion: 2.1 time: 0.516090 Aug 27 02:47:16.589337 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1909/3528] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:47:16 2022] POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:47:16.608336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-177143171"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:16.616659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:16.643554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:16.645213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:16.646306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:16.649877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:16.650702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:16.651540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:16.770171 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] HTTP exception thrown: Cannot 'createImage' instance f5d77305-6bf5-4d11-bb93-187f23a42307 while it is in task_state image_snapshot_pending Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action HTTP/1.1 Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 84 Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-177143171"}} Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'createImage' instance f5d77305-6bf5-4d11-bb93-187f23a42307 while it is in task_state image_snapshot_pending Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f5d77305-6bf5-4d11-bb93-187f23a42307', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-177143171'}}} Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:47:16.780923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance f5d77305-6bf5-4d11-bb93-187f23a42307 while it is in task_state image_snapshot_pending Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance f5d77305-6bf5-4d11-bb93-187f23a42307 while it is in task_state image_snapshot_pending Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:16.784980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 409 to user: Cannot 'createImage' instance f5d77305-6bf5-4d11-bb93-187f23a42307 while it is in task_state image_snapshot_pending {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:16.785981 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-760d9cb6-3d32-42a0-95d7-27019432c1be tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action" status: 409 len: 167 microversion: 2.1 time: 0.186363 Aug 27 02:47:16.793396 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1620/3529] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:47:16 2022] POST /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307/action => generated 167 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:47:16.801631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5fe0de4e-dd52-4ad7-a510-453ee54d843e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '.version_select at 0x7f4d29168280>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:17.104702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8b77de4c-e782-4784-94f7-89795c0bda3f tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:17.106098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8b77de4c-e782-4784-94f7-89795c0bda3f tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:17.127480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b77de4c-e782-4784-94f7-89795c0bda3f tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:17.128525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b77de4c-e782-4784-94f7-89795c0bda3f tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.128992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b77de4c-e782-4784-94f7-89795c0bda3f tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:17.133982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b77de4c-e782-4784-94f7-89795c0bda3f tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:17.135919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b77de4c-e782-4784-94f7-89795c0bda3f tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.136930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b77de4c-e782-4784-94f7-89795c0bda3f tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:17.144044 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5fe0de4e-dd52-4ad7-a510-453ee54d843e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "DELETE /compute/v2.1/images/5f01d73e-7ba0-435a-88a5-e71125bc95a0" status: 204 len: 0 microversion: 2.1 time: 0.349704 Aug 27 02:47:17.146618 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1910/3530] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:16 2022] DELETE /compute/v2.1/images/5f01d73e-7ba0-435a-88a5-e71125bc95a0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:47:17.173809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-67e28a42-2d43-47c1-a546-f960734e62d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:17.175184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-67e28a42-2d43-47c1-a546-f960734e62d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:17.207633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e28a42-2d43-47c1-a546-f960734e62d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:17.211615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e28a42-2d43-47c1-a546-f960734e62d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.213036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e28a42-2d43-47c1-a546-f960734e62d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:17.219807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e28a42-2d43-47c1-a546-f960734e62d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:17.222880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e28a42-2d43-47c1-a546-f960734e62d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:17.228959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e28a42-2d43-47c1-a546-f960734e62d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:18.069611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8b77de4c-e782-4784-94f7-89795c0bda3f tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:18.087932 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8b77de4c-e782-4784-94f7-89795c0bda3f tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1324 microversion: 2.1 time: 0.990379 Aug 27 02:47:18.094274 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1621/3531] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:17 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1324 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:18.420474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-67e28a42-2d43-47c1-a546-f960734e62d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:18.477744 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-67e28a42-2d43-47c1-a546-f960734e62d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1535 microversion: 2.1 time: 1.324104 Aug 27 02:47:18.479586 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1911/3532] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:17 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1535 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:18.636556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d064dacc-bdb8-409b-bfd4-fff985e7186f req-dd5ca032-10d6-4aeb-b8f8-d6376dc25d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104cc615-4155-4157-b995-0bbf57ab176d", "name": "network-vif-plugged", "status": "completed", "tag": "34d016fe-a06a-440d-8c9b-1abc35b14a0c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:18.662082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d064dacc-bdb8-409b-bfd4-fff985e7186f req-dd5ca032-10d6-4aeb-b8f8-d6376dc25d74 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:18.663915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d064dacc-bdb8-409b-bfd4-fff985e7186f req-dd5ca032-10d6-4aeb-b8f8-d6376dc25d74 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:18.664789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d064dacc-bdb8-409b-bfd4-fff985e7186f req-dd5ca032-10d6-4aeb-b8f8-d6376dc25d74 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:18.705724 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d064dacc-bdb8-409b-bfd4-fff985e7186f req-dd5ca032-10d6-4aeb-b8f8-d6376dc25d74 service nova] Creating event network-vif-plugged:34d016fe-a06a-440d-8c9b-1abc35b14a0c for instance 104cc615-4155-4157-b995-0bbf57ab176d on n-h1-852084-5 Aug 27 02:47:18.726000 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d064dacc-bdb8-409b-bfd4-fff985e7186f req-dd5ca032-10d6-4aeb-b8f8-d6376dc25d74 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093722 Aug 27 02:47:18.730229 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1622/3533] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:19.130102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff556747-1b69-4112-816a-a8590a1340a9 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:19.131211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ff556747-1b69-4112-816a-a8590a1340a9 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:19.158686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff556747-1b69-4112-816a-a8590a1340a9 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:19.161945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff556747-1b69-4112-816a-a8590a1340a9 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:19.164568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff556747-1b69-4112-816a-a8590a1340a9 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:19.179057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff556747-1b69-4112-816a-a8590a1340a9 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:19.179952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff556747-1b69-4112-816a-a8590a1340a9 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:19.180606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff556747-1b69-4112-816a-a8590a1340a9 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:19.650098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ff556747-1b69-4112-816a-a8590a1340a9 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:19.703102 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff556747-1b69-4112-816a-a8590a1340a9 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1324 microversion: 2.1 time: 0.569535 Aug 27 02:47:19.733345 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1912/3534] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:19 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1324 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:20.268701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-759821806", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:20.477828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] validate_networks() for [('7f5f647c-3eb3-4e25-8f1b-498211cb650b', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:47:20.898759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-148198690", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "e0d9a993-a33f-4021-8fe8-2409a593643d"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:21.045307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] validate_networks() for [('e0d9a993-a33f-4021-8fe8-2409a593643d', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:47:21.945432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:47:21.948888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:47:21.950149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:47:21.951440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:47:21.952741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:47:21.994540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:22.023695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.027353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.029855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.049032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.049899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.053221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.198459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Getting quotas for project bd6b3bb36fb84f07a8fb9a38b1a9689b. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:22.234955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Getting quotas for user ad43ce0d2e9a40e99da82044ff843cd6 and project bd6b3bb36fb84f07a8fb9a38b1a9689b. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:22.304002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:47:22.329142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:47:22.545572 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9633a594-2fbc-4921-9d38-ef53a8ab2fd8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.300513 Aug 27 02:47:22.547255 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1623/3535] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:47:22.553102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-35dbf5c1-7dcc-4b4a-9bcd-928eef65cb6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:22.554620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-35dbf5c1-7dcc-4b4a-9bcd-928eef65cb6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:22.566023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35dbf5c1-7dcc-4b4a-9bcd-928eef65cb6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.567090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35dbf5c1-7dcc-4b4a-9bcd-928eef65cb6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.567980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35dbf5c1-7dcc-4b4a-9bcd-928eef65cb6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:22.568981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35dbf5c1-7dcc-4b4a-9bcd-928eef65cb6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:22.569729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35dbf5c1-7dcc-4b4a-9bcd-928eef65cb6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:22.570406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35dbf5c1-7dcc-4b4a-9bcd-928eef65cb6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:24.150687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-35dbf5c1-7dcc-4b4a-9bcd-928eef65cb6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:24.168443 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-35dbf5c1-7dcc-4b4a-9bcd-928eef65cb6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1523 microversion: 2.1 time: 1.617501 Aug 27 02:47:24.183101 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1624/3536] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:22 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1523 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:24.192443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-285b19aa-9e09-45c4-9e86-ed4d06d3799a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:24.193529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-285b19aa-9e09-45c4-9e86-ed4d06d3799a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:24.201541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-285b19aa-9e09-45c4-9e86-ed4d06d3799a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:24.202380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-285b19aa-9e09-45c4-9e86-ed4d06d3799a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:24.203373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-285b19aa-9e09-45c4-9e86-ed4d06d3799a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:24.204992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-285b19aa-9e09-45c4-9e86-ed4d06d3799a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:24.205864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-285b19aa-9e09-45c4-9e86-ed4d06d3799a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:24.206614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-285b19aa-9e09-45c4-9e86-ed4d06d3799a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:24.458117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-285b19aa-9e09-45c4-9e86-ed4d06d3799a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:24.468464 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-285b19aa-9e09-45c4-9e86-ed4d06d3799a tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1519 microversion: 2.1 time: 0.283766 Aug 27 02:47:24.469151 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1625/3537] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:24 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:24.477842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-03d02fab-df5c-4345-9cb6-091d5bad498a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:24.485891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-03d02fab-df5c-4345-9cb6-091d5bad498a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:24.499496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03d02fab-df5c-4345-9cb6-091d5bad498a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:24.500225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03d02fab-df5c-4345-9cb6-091d5bad498a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:24.503753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03d02fab-df5c-4345-9cb6-091d5bad498a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:24.505656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03d02fab-df5c-4345-9cb6-091d5bad498a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:24.507477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03d02fab-df5c-4345-9cb6-091d5bad498a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:24.507931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03d02fab-df5c-4345-9cb6-091d5bad498a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:24.636827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-03d02fab-df5c-4345-9cb6-091d5bad498a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:24.661236 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-03d02fab-df5c-4345-9cb6-091d5bad498a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1212 microversion: 2.1 time: 0.177354 Aug 27 02:47:24.676132 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1626/3538] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:24 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1212 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:24.690045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1407b178-84eb-44ce-a177-d1d8ebc35a8f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:24.690568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1407b178-84eb-44ce-a177-d1d8ebc35a8f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:24.727473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1407b178-84eb-44ce-a177-d1d8ebc35a8f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:24.727992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1407b178-84eb-44ce-a177-d1d8ebc35a8f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:24.747471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1407b178-84eb-44ce-a177-d1d8ebc35a8f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:24.748898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1407b178-84eb-44ce-a177-d1d8ebc35a8f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:24.749588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1407b178-84eb-44ce-a177-d1d8ebc35a8f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:24.750425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1407b178-84eb-44ce-a177-d1d8ebc35a8f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:24.816119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1407b178-84eb-44ce-a177-d1d8ebc35a8f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:47:25.062762 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1407b178-84eb-44ce-a177-d1d8ebc35a8f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 204 len: 0 microversion: 2.1 time: 0.384650 Aug 27 02:47:25.064979 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1627/3539] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:47:24 2022] DELETE /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:47:25.080028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aa94a86a-a337-476a-8c81-8587b2281204 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1222011973", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "2188ed37-6503-48b6-b57d-d1f130980da6"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aa94a86a-a337-476a-8c81-8587b2281204 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Request method failure captured: Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 243 Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWcRXtwiFRBmGL93WPHc_atR_1RV5M_eAmGPxoo-pzHL_4_h8t17BZYcuxviU8AgFLW8UCoXZu8WeTaVgNeaRGSzaJyTpQoM2eb9OtJ_iRnXhVDXN1PdkCf4YZQJPkfcEAdBMvPw4oy0gMw7WFNsxc0ryiRdCN0sBw9xq84WHRTfUE Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cc17e7035bc944c0b2709e2c48c86913"}]}] Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 06b9779adbc448b98b2d17bdda361164 Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1222011973", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "2188ed37-6503-48b6-b57d-d1f130980da6"}]}} Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1222011973', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '2188ed37-6503-48b6-b57d-d1f130980da6'}]}}} Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:25.093995 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:25.105583 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.112619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aa94a86a-a337-476a-8c81-8587b2281204 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:25.116122 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aa94a86a-a337-476a-8c81-8587b2281204 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.048375 Aug 27 02:47:25.119955 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1628/3540] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:25 2022] POST /compute/v2.1/servers => generated 175 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:47:25.158496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04213502-dcb8-4b88-bef4-659b0e0ddbdd tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:25.167263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-04213502-dcb8-4b88-bef4-659b0e0ddbdd tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:25.211939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04213502-dcb8-4b88-bef4-659b0e0ddbdd tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:25.218175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04213502-dcb8-4b88-bef4-659b0e0ddbdd tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.221598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04213502-dcb8-4b88-bef4-659b0e0ddbdd tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:25.225275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04213502-dcb8-4b88-bef4-659b0e0ddbdd tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:25.226739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04213502-dcb8-4b88-bef4-659b0e0ddbdd tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.229313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04213502-dcb8-4b88-bef4-659b0e0ddbdd tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:25.272763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:25.550995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-04213502-dcb8-4b88-bef4-659b0e0ddbdd tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:25.561287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-04213502-dcb8-4b88-bef4-659b0e0ddbdd tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1529 microversion: 2.1 time: 0.438691 Aug 27 02:47:25.561965 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1629/3541] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:25 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1529 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:25.583527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93d61977-7d01-40bd-936f-1ac0076e98a5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:25.584969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93d61977-7d01-40bd-936f-1ac0076e98a5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 1abf15ee-908c-4839-9fe1-147a246dc879] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:25.593804 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-93d61977-7d01-40bd-936f-1ac0076e98a5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] HTTP exception thrown: Instance 1abf15ee-908c-4839-9fe1-147a246dc879 could not be found. Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93d61977-7d01-40bd-936f-1ac0076e98a5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Request method failure captured: Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/1abf15ee-908c-4839-9fe1-147a246dc879/metadata HTTP/1.1 Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWcRXtwiFRBmGL93WPHc_atR_1RV5M_eAmGPxoo-pzHL_4_h8t17BZYcuxviU8AgFLW8UCoXZu8WeTaVgNeaRGSzaJyTpQoM2eb9OtJ_iRnXhVDXN1PdkCf4YZQJPkfcEAdBMvPw4oy0gMw7WFNsxc0ryiRdCN0sBw9xq84WHRTfUE Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cc17e7035bc944c0b2709e2c48c86913"}]}] Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 06b9779adbc448b98b2d17bdda361164 Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 1abf15ee-908c-4839-9fe1-147a246dc879 could not be found. Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': '1abf15ee-908c-4839-9fe1-147a246dc879'} Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1abf15ee-908c-4839-9fe1-147a246dc879 could not be found. Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1abf15ee-908c-4839-9fe1-147a246dc879 could not be found. Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:25.599755 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:25.608633 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:25.608633 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:25.608633 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1abf15ee-908c-4839-9fe1-147a246dc879 could not be found. Aug 27 02:47:25.608633 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.613586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93d61977-7d01-40bd-936f-1ac0076e98a5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Returning 404 to user: Instance 1abf15ee-908c-4839-9fe1-147a246dc879 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:25.618360 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-93d61977-7d01-40bd-936f-1ac0076e98a5 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/1abf15ee-908c-4839-9fe1-147a246dc879/metadata" status: 404 len: 111 microversion: 2.1 time: 0.039074 Aug 27 02:47:25.620277 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1630/3542] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:47:25 2022] GET /compute/v2.1/servers/1abf15ee-908c-4839-9fe1-147a246dc879/metadata => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:25.719982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65145772-e91f-484e-9b53-e0959decaab2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:25.721316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65145772-e91f-484e-9b53-e0959decaab2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:25.753389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65145772-e91f-484e-9b53-e0959decaab2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:25.755892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65145772-e91f-484e-9b53-e0959decaab2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.762423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65145772-e91f-484e-9b53-e0959decaab2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:25.763829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65145772-e91f-484e-9b53-e0959decaab2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:25.764597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65145772-e91f-484e-9b53-e0959decaab2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.766881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65145772-e91f-484e-9b53-e0959decaab2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:25.780987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:47:25.781721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:47:25.782967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:47:25.783766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:47:25.784530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:47:25.816182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:25.822643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.824264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:25.825539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:25.826305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:25.826966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:25.919415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-65145772-e91f-484e-9b53-e0959decaab2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:25.929398 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65145772-e91f-484e-9b53-e0959decaab2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1276 microversion: 2.1 time: 0.216211 Aug 27 02:47:25.929657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Getting quotas for project 2b3c9fc569ff43fc8c28ef7edeb1c62a. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:25.934626 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1631/3543] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:25 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1276 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:25.947628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Getting quotas for user 58c2cdb5435340e59fd0cd482de64bb3 and project 2b3c9fc569ff43fc8c28ef7edeb1c62a. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:25.949553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d10ff916-fb1d-42ac-a745-9b0b111dead4 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-255073234", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2188ed37-6503-48b6-b57d-d1f130980da6"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d10ff916-fb1d-42ac-a745-9b0b111dead4 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Request method failure captured: Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 498 Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWcRXtwiFRBmGL93WPHc_atR_1RV5M_eAmGPxoo-pzHL_4_h8t17BZYcuxviU8AgFLW8UCoXZu8WeTaVgNeaRGSzaJyTpQoM2eb9OtJ_iRnXhVDXN1PdkCf4YZQJPkfcEAdBMvPw4oy0gMw7WFNsxc0ryiRdCN0sBw9xq84WHRTfUE Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cc17e7035bc944c0b2709e2c48c86913"}]}] Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 06b9779adbc448b98b2d17bdda361164 Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-255073234", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2188ed37-6503-48b6-b57d-d1f130980da6"}]}} Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-255073234', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2188ed37-6503-48b6-b57d-d1f130980da6'}]}}} Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 02:47:25.963690 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d10ff916-fb1d-42ac-a745-9b0b111dead4 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d10ff916-fb1d-42ac-a745-9b0b111dead4 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.030188 Aug 27 02:47:25.987563 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1632/3544] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:25 2022] POST /compute/v2.1/servers => generated 687 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:47:26.056808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5276335d-7863-4908-8d4c-c68fb2d5ba9b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-84483573", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2188ed37-6503-48b6-b57d-d1f130980da6"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:26.059282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:47:26.066083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5276335d-7863-4908-8d4c-c68fb2d5ba9b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Request method failure captured: Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 498 Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWcRXtwiFRBmGL93WPHc_atR_1RV5M_eAmGPxoo-pzHL_4_h8t17BZYcuxviU8AgFLW8UCoXZu8WeTaVgNeaRGSzaJyTpQoM2eb9OtJ_iRnXhVDXN1PdkCf4YZQJPkfcEAdBMvPw4oy0gMw7WFNsxc0ryiRdCN0sBw9xq84WHRTfUE Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cc17e7035bc944c0b2709e2c48c86913"}]}] Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 06b9779adbc448b98b2d17bdda361164 Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-84483573", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2188ed37-6503-48b6-b57d-d1f130980da6"}]}} Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-84483573', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2188ed37-6503-48b6-b57d-d1f130980da6'}]}}} Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 02:47:26.069897 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5276335d-7863-4908-8d4c-c68fb2d5ba9b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5276335d-7863-4908-8d4c-c68fb2d5ba9b tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.018887 Aug 27 02:47:26.077094 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1633/3545] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:26 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:47:26.179991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58a6a305-acd7-4648-ac6e-27a447f97dbd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-949771916", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2188ed37-6503-48b6-b57d-d1f130980da6"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58a6a305-acd7-4648-ac6e-27a447f97dbd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Request method failure captured: Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 753 Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWcRXtwiFRBmGL93WPHc_atR_1RV5M_eAmGPxoo-pzHL_4_h8t17BZYcuxviU8AgFLW8UCoXZu8WeTaVgNeaRGSzaJyTpQoM2eb9OtJ_iRnXhVDXN1PdkCf4YZQJPkfcEAdBMvPw4oy0gMw7WFNsxc0ryiRdCN0sBw9xq84WHRTfUE Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cc17e7035bc944c0b2709e2c48c86913"}]}] Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 06b9779adbc448b98b2d17bdda361164 Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-949771916", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2188ed37-6503-48b6-b57d-d1f130980da6"}]}} Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-949771916', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2188ed37-6503-48b6-b57d-d1f130980da6'}]}}} Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:47:26.189643 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:47:26.197468 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:47:26.210838 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.210838 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.210838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58a6a305-acd7-4648-ac6e-27a447f97dbd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:26.210838 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-58a6a305-acd7-4648-ac6e-27a447f97dbd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.017672 Aug 27 02:47:26.210838 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1634/3546] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:26 2022] POST /compute/v2.1/servers => generated 1197 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 27 02:47:26.210838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-264e9120-87d2-4a3b-81ea-c665f6f34a49 req-eb70e944-90b7-4ff8-96d2-b40cbc3f4e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d77305-6bf5-4d11-bb93-187f23a42307", "name": "network-vif-plugged", "status": "completed", "tag": "527191ef-390a-438e-a31e-10660e3e62b3"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:26.240969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-264e9120-87d2-4a3b-81ea-c665f6f34a49 req-eb70e944-90b7-4ff8-96d2-b40cbc3f4e97 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:26.241354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-264e9120-87d2-4a3b-81ea-c665f6f34a49 req-eb70e944-90b7-4ff8-96d2-b40cbc3f4e97 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:26.242432 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d99686a1-06f5-4c2e-9a13-0b70f873763a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.506697 Aug 27 02:47:26.244942 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1913/3547] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 6511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:47:26.245142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-264e9120-87d2-4a3b-81ea-c665f6f34a49 req-eb70e944-90b7-4ff8-96d2-b40cbc3f4e97 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:26.267252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70417ae7-1a46-42ef-a26f-272d6c06f8b4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:26.268604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-70417ae7-1a46-42ef-a26f-272d6c06f8b4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:26.314826 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-264e9120-87d2-4a3b-81ea-c665f6f34a49 req-eb70e944-90b7-4ff8-96d2-b40cbc3f4e97 service nova] Creating event network-vif-plugged:527191ef-390a-438e-a31e-10660e3e62b3 for instance f5d77305-6bf5-4d11-bb93-187f23a42307 on n-h2-852084-5 Aug 27 02:47:26.341531 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-264e9120-87d2-4a3b-81ea-c665f6f34a49 req-eb70e944-90b7-4ff8-96d2-b40cbc3f4e97 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142806 Aug 27 02:47:26.342186 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1635/3548] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:26.360324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0dd10446-05ca-40c3-b211-856cf2285647 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-119411342", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2188ed37-6503-48b6-b57d-d1f130980da6"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0dd10446-05ca-40c3-b211-856cf2285647 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Request method failure captured: Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 1265 Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWcRXtwiFRBmGL93WPHc_atR_1RV5M_eAmGPxoo-pzHL_4_h8t17BZYcuxviU8AgFLW8UCoXZu8WeTaVgNeaRGSzaJyTpQoM2eb9OtJ_iRnXhVDXN1PdkCf4YZQJPkfcEAdBMvPw4oy0gMw7WFNsxc0ryiRdCN0sBw9xq84WHRTfUE Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cc17e7035bc944c0b2709e2c48c86913"}]}] Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 06b9779adbc448b98b2d17bdda361164 Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-119411342", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2188ed37-6503-48b6-b57d-d1f130980da6"}]}} Aug 27 02:47:26.365241 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-119411342', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2188ed37-6503-48b6-b57d-d1f130980da6'}]}}} Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.367839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:47:26.369014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:47:26.374298 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 27 02:47:26.374298 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.379192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0dd10446-05ca-40c3-b211-856cf2285647 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:26.382864 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0dd10446-05ca-40c3-b211-856cf2285647 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.031677 Aug 27 02:47:26.401192 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1636/3549] 10.222.0.99 () {60 vars in 1148 bytes} [Sat Aug 27 02:47:26 2022] POST /compute/v2.1/servers => generated 2221 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 27 02:47:26.427080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ce771465-2533-4d90-86ff-dbb96103e336 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:26.427856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ce771465-2533-4d90-86ff-dbb96103e336 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 10c5dca6-321e-4070-9ccc-dc337458cd7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:26.459422 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-ce771465-2533-4d90-86ff-dbb96103e336 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] HTTP exception thrown: Instance 10c5dca6-321e-4070-9ccc-dc337458cd7c could not be found. Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ce771465-2533-4d90-86ff-dbb96103e336 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Request method failure captured: Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/10c5dca6-321e-4070-9ccc-dc337458cd7c/metadata/test2 HTTP/1.1 Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWcRXtwiFRBmGL93WPHc_atR_1RV5M_eAmGPxoo-pzHL_4_h8t17BZYcuxviU8AgFLW8UCoXZu8WeTaVgNeaRGSzaJyTpQoM2eb9OtJ_iRnXhVDXN1PdkCf4YZQJPkfcEAdBMvPw4oy0gMw7WFNsxc0ryiRdCN0sBw9xq84WHRTfUE Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cc17e7035bc944c0b2709e2c48c86913"}]}] Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 06b9779adbc448b98b2d17bdda361164 Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 10c5dca6-321e-4070-9ccc-dc337458cd7c could not be found. Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': '10c5dca6-321e-4070-9ccc-dc337458cd7c', 'id': 'test2'} Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c5dca6-321e-4070-9ccc-dc337458cd7c could not be found. Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c5dca6-321e-4070-9ccc-dc337458cd7c could not be found. Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:26.461988 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:26.466697 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:26.466697 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:26.466697 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c5dca6-321e-4070-9ccc-dc337458cd7c could not be found. Aug 27 02:47:26.466697 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:26.468509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ce771465-2533-4d90-86ff-dbb96103e336 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Returning 404 to user: Instance 10c5dca6-321e-4070-9ccc-dc337458cd7c could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:26.470404 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ce771465-2533-4d90-86ff-dbb96103e336 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/10c5dca6-321e-4070-9ccc-dc337458cd7c/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.063091 Aug 27 02:47:26.481205 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1637/3550] 10.222.0.99 () {58 vars in 1281 bytes} [Sat Aug 27 02:47:26 2022] GET /compute/v2.1/servers/10c5dca6-321e-4070-9ccc-dc337458cd7c/metadata/test2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:26.482546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-70417ae7-1a46-42ef-a26f-272d6c06f8b4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:26.492597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-552eb97c-a81b-4f64-8c08-6a58e79cf006 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:26.493015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-552eb97c-a81b-4f64-8c08-6a58e79cf006 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:26.500230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-552eb97c-a81b-4f64-8c08-6a58e79cf006 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:26.500873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-552eb97c-a81b-4f64-8c08-6a58e79cf006 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:26.501407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-552eb97c-a81b-4f64-8c08-6a58e79cf006 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:26.502325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-552eb97c-a81b-4f64-8c08-6a58e79cf006 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:26.502886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-552eb97c-a81b-4f64-8c08-6a58e79cf006 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:26.503497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-552eb97c-a81b-4f64-8c08-6a58e79cf006 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:26.517202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70417ae7-1a46-42ef-a26f-272d6c06f8b4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1223 microversion: 2.1 time: 0.265268 Aug 27 02:47:26.518587 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1914/3551] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:26 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1223 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:26.575894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-552eb97c-a81b-4f64-8c08-6a58e79cf006 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:47:26.583549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-43175432-2414-444f-9006-fa30ba7a42d3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:26.584594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-43175432-2414-444f-9006-fa30ba7a42d3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:26.599029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43175432-2414-444f-9006-fa30ba7a42d3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:26.602838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43175432-2414-444f-9006-fa30ba7a42d3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:26.607472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43175432-2414-444f-9006-fa30ba7a42d3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:26.609284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43175432-2414-444f-9006-fa30ba7a42d3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:26.610827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43175432-2414-444f-9006-fa30ba7a42d3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:26.613025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43175432-2414-444f-9006-fa30ba7a42d3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:26.842300 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-552eb97c-a81b-4f64-8c08-6a58e79cf006 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "DELETE /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 204 len: 0 microversion: 2.1 time: 0.352769 Aug 27 02:47:26.846113 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1638/3552] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:47:26 2022] DELETE /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:47:26.861886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-566df93f-cdda-4bde-9ad0-82d87edd1ab8 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:26.863990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-566df93f-cdda-4bde-9ad0-82d87edd1ab8 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:26.887731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-566df93f-cdda-4bde-9ad0-82d87edd1ab8 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:26.887731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-566df93f-cdda-4bde-9ad0-82d87edd1ab8 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:26.887731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-566df93f-cdda-4bde-9ad0-82d87edd1ab8 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:26.887731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-566df93f-cdda-4bde-9ad0-82d87edd1ab8 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:26.887731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-566df93f-cdda-4bde-9ad0-82d87edd1ab8 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:26.887731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-566df93f-cdda-4bde-9ad0-82d87edd1ab8 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:27.368107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-566df93f-cdda-4bde-9ad0-82d87edd1ab8 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:27.408234 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-566df93f-cdda-4bde-9ad0-82d87edd1ab8 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1525 microversion: 2.1 time: 0.555028 Aug 27 02:47:27.408895 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1639/3553] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:26 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1525 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:27.455410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-80f55c3e-6cb8-426d-a4cb-6653f025e99c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:27.456610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-80f55c3e-6cb8-426d-a4cb-6653f025e99c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:27.487455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f55c3e-6cb8-426d-a4cb-6653f025e99c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:27.488338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f55c3e-6cb8-426d-a4cb-6653f025e99c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:27.492937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f55c3e-6cb8-426d-a4cb-6653f025e99c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:27.494499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f55c3e-6cb8-426d-a4cb-6653f025e99c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:27.495377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f55c3e-6cb8-426d-a4cb-6653f025e99c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:27.496128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80f55c3e-6cb8-426d-a4cb-6653f025e99c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:27.715993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-43175432-2414-444f-9006-fa30ba7a42d3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:27.722073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:27.777978 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-43175432-2414-444f-9006-fa30ba7a42d3 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1529 microversion: 2.1 time: 1.196829 Aug 27 02:47:27.780028 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1915/3554] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:26 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1529 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:27.792464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-75765882-12b2-4188-83ba-4fb5fdce23ca tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:27.794257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-75765882-12b2-4188-83ba-4fb5fdce23ca tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:27.831957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75765882-12b2-4188-83ba-4fb5fdce23ca tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:27.834817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75765882-12b2-4188-83ba-4fb5fdce23ca tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:27.837235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75765882-12b2-4188-83ba-4fb5fdce23ca tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:27.840580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75765882-12b2-4188-83ba-4fb5fdce23ca tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:27.841107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75765882-12b2-4188-83ba-4fb5fdce23ca tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:27.842343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75765882-12b2-4188-83ba-4fb5fdce23ca tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:27.851710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-80f55c3e-6cb8-426d-a4cb-6653f025e99c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:27.874236 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-80f55c3e-6cb8-426d-a4cb-6653f025e99c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1274 microversion: 2.1 time: 0.426895 Aug 27 02:47:27.888434 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1640/3555] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:27 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1274 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:28.255410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-75765882-12b2-4188-83ba-4fb5fdce23ca tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:28.294811 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-75765882-12b2-4188-83ba-4fb5fdce23ca tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1219 microversion: 2.1 time: 0.505267 Aug 27 02:47:28.300475 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1916/3556] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:27 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1219 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:28.450726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3b17acfa-c965-43bf-882b-a1bd1bc8bef6 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:28.452377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3b17acfa-c965-43bf-882b-a1bd1bc8bef6 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:28.478705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b17acfa-c965-43bf-882b-a1bd1bc8bef6 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:28.484660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b17acfa-c965-43bf-882b-a1bd1bc8bef6 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:28.486457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b17acfa-c965-43bf-882b-a1bd1bc8bef6 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:28.491069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b17acfa-c965-43bf-882b-a1bd1bc8bef6 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:28.491579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b17acfa-c965-43bf-882b-a1bd1bc8bef6 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:28.495948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b17acfa-c965-43bf-882b-a1bd1bc8bef6 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:28.826725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f0351ad6-8b68-4e21-a586-ddedb13e10ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:28.829792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f0351ad6-8b68-4e21-a586-ddedb13e10ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:28.864978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0351ad6-8b68-4e21-a586-ddedb13e10ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:28.866290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0351ad6-8b68-4e21-a586-ddedb13e10ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:28.871088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0351ad6-8b68-4e21-a586-ddedb13e10ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:28.874653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0351ad6-8b68-4e21-a586-ddedb13e10ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:28.875932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0351ad6-8b68-4e21-a586-ddedb13e10ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:28.878647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0351ad6-8b68-4e21-a586-ddedb13e10ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:29.677849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3b17acfa-c965-43bf-882b-a1bd1bc8bef6 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:29.704702 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3b17acfa-c965-43bf-882b-a1bd1bc8bef6 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1525 microversion: 2.1 time: 1.262024 Aug 27 02:47:29.711192 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1641/3557] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:28 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1525 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:29.733730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e0e3809-e6ad-46e1-ba3d-60c9f54dd6f5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:29.738728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2e0e3809-e6ad-46e1-ba3d-60c9f54dd6f5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:29.769398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e0e3809-e6ad-46e1-ba3d-60c9f54dd6f5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:29.774925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e0e3809-e6ad-46e1-ba3d-60c9f54dd6f5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:29.785045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e0e3809-e6ad-46e1-ba3d-60c9f54dd6f5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:29.787264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e0e3809-e6ad-46e1-ba3d-60c9f54dd6f5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:29.788733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e0e3809-e6ad-46e1-ba3d-60c9f54dd6f5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:29.789845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e0e3809-e6ad-46e1-ba3d-60c9f54dd6f5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:30.005727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2e0e3809-e6ad-46e1-ba3d-60c9f54dd6f5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:30.044763 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e0e3809-e6ad-46e1-ba3d-60c9f54dd6f5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1274 microversion: 2.1 time: 0.330595 Aug 27 02:47:30.050434 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1642/3558] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:29 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1274 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:30.055935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de0517f1-a7d8-49f0-a7d9-d39bc33f724f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:30.064445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de0517f1-a7d8-49f0-a7d9-d39bc33f724f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:30.081243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de0517f1-a7d8-49f0-a7d9-d39bc33f724f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:30.082273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de0517f1-a7d8-49f0-a7d9-d39bc33f724f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:30.082982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de0517f1-a7d8-49f0-a7d9-d39bc33f724f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:30.084039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de0517f1-a7d8-49f0-a7d9-d39bc33f724f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:30.092463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de0517f1-a7d8-49f0-a7d9-d39bc33f724f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:30.093330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de0517f1-a7d8-49f0-a7d9-d39bc33f724f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:30.214370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f0351ad6-8b68-4e21-a586-ddedb13e10ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:30.230204 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f0351ad6-8b68-4e21-a586-ddedb13e10ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1529 microversion: 2.1 time: 1.411293 Aug 27 02:47:30.231198 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1917/3559] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:28 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1529 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:30.478333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de0517f1-a7d8-49f0-a7d9-d39bc33f724f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:30.488104 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de0517f1-a7d8-49f0-a7d9-d39bc33f724f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1281 microversion: 2.1 time: 0.436263 Aug 27 02:47:30.506095 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1643/3560] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:30 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1281 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:30.518964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-840d8451-36ff-4a0a-8d9e-99f4f75a5bce req-2f0d65e5-25a6-4b60-8252-f8413a87787c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d77305-6bf5-4d11-bb93-187f23a42307", "name": "network-vif-deleted", "tag": "527191ef-390a-438e-a31e-10660e3e62b3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:30.560938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-840d8451-36ff-4a0a-8d9e-99f4f75a5bce req-2f0d65e5-25a6-4b60-8252-f8413a87787c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:30.561747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-840d8451-36ff-4a0a-8d9e-99f4f75a5bce req-2f0d65e5-25a6-4b60-8252-f8413a87787c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:30.562313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-840d8451-36ff-4a0a-8d9e-99f4f75a5bce req-2f0d65e5-25a6-4b60-8252-f8413a87787c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:30.607583 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-840d8451-36ff-4a0a-8d9e-99f4f75a5bce req-2f0d65e5-25a6-4b60-8252-f8413a87787c service nova] Creating event network-vif-deleted:527191ef-390a-438e-a31e-10660e3e62b3 for instance f5d77305-6bf5-4d11-bb93-187f23a42307 on n-h2-852084-5 Aug 27 02:47:30.624418 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-840d8451-36ff-4a0a-8d9e-99f4f75a5bce req-2f0d65e5-25a6-4b60-8252-f8413a87787c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109336 Aug 27 02:47:30.635643 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1918/3561] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:30.747494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf6b1e59-0a65-478b-a725-b58ef44d2085 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:30.749129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf6b1e59-0a65-478b-a725-b58ef44d2085 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:30.772521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf6b1e59-0a65-478b-a725-b58ef44d2085 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:30.774924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf6b1e59-0a65-478b-a725-b58ef44d2085 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:30.779102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf6b1e59-0a65-478b-a725-b58ef44d2085 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:30.780291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf6b1e59-0a65-478b-a725-b58ef44d2085 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:30.787614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf6b1e59-0a65-478b-a725-b58ef44d2085 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:30.794441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf6b1e59-0a65-478b-a725-b58ef44d2085 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.092424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-516d6ec5-620c-44ca-b96b-3ed23c793add tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:31.094260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-516d6ec5-620c-44ca-b96b-3ed23c793add tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:31.126082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-516d6ec5-620c-44ca-b96b-3ed23c793add tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.127087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-516d6ec5-620c-44ca-b96b-3ed23c793add tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.127832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-516d6ec5-620c-44ca-b96b-3ed23c793add tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.138247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-516d6ec5-620c-44ca-b96b-3ed23c793add tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.139179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-516d6ec5-620c-44ca-b96b-3ed23c793add tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.139867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-516d6ec5-620c-44ca-b96b-3ed23c793add tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.284892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf6b1e59-0a65-478b-a725-b58ef44d2085 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:31.295975 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf6b1e59-0a65-478b-a725-b58ef44d2085 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1483 microversion: 2.1 time: 0.553042 Aug 27 02:47:31.298698 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1644/3562] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:30 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1483 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:31.305545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:31.306832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:31.314436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.315412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.316295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.318164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.319308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.320033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.364258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.365242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.365993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.366846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lazy-loading 'fault' on Instance uuid f5d77305-6bf5-4d11-bb93-187f23a42307 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:47:31.375417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-516d6ec5-620c-44ca-b96b-3ed23c793add tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:31.390373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-516d6ec5-620c-44ca-b96b-3ed23c793add tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1274 microversion: 2.1 time: 0.303600 Aug 27 02:47:31.391770 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1919/3563] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:31 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:31.437892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b78ca388-7ed0-4103-a4d3-266a049e6f60 req-7b9cb97e-7551-4b13-9c47-21ebae0d0517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104cc615-4155-4157-b995-0bbf57ab176d", "name": "network-vif-deleted", "tag": "34d016fe-a06a-440d-8c9b-1abc35b14a0c"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:31.456295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b78ca388-7ed0-4103-a4d3-266a049e6f60 req-7b9cb97e-7551-4b13-9c47-21ebae0d0517 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.469444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b78ca388-7ed0-4103-a4d3-266a049e6f60 req-7b9cb97e-7551-4b13-9c47-21ebae0d0517 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.470065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b78ca388-7ed0-4103-a4d3-266a049e6f60 req-7b9cb97e-7551-4b13-9c47-21ebae0d0517 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.488556 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b78ca388-7ed0-4103-a4d3-266a049e6f60 req-7b9cb97e-7551-4b13-9c47-21ebae0d0517 service nova] Creating event network-vif-deleted:34d016fe-a06a-440d-8c9b-1abc35b14a0c for instance 104cc615-4155-4157-b995-0bbf57ab176d on n-h1-852084-5 Aug 27 02:47:31.510271 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b78ca388-7ed0-4103-a4d3-266a049e6f60 req-7b9cb97e-7551-4b13-9c47-21ebae0d0517 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076423 Aug 27 02:47:31.511428 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1920/3564] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:47:31.536200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-379dad10-b04c-47d8-8869-f5b6d855342e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:31.537434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-379dad10-b04c-47d8-8869-f5b6d855342e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:31.553597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379dad10-b04c-47d8-8869-f5b6d855342e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.558691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379dad10-b04c-47d8-8869-f5b6d855342e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.558691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379dad10-b04c-47d8-8869-f5b6d855342e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.563302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379dad10-b04c-47d8-8869-f5b6d855342e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:31.564930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379dad10-b04c-47d8-8869-f5b6d855342e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:31.565879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-379dad10-b04c-47d8-8869-f5b6d855342e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:31.689367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:31.698698 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-604de6b5-89cd-4e9c-84c0-83158d3f38ec tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 200 len: 1315 microversion: 2.1 time: 0.398313 Aug 27 02:47:31.699397 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1645/3565] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:31 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:31.965579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-379dad10-b04c-47d8-8869-f5b6d855342e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:31.990204 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-379dad10-b04c-47d8-8869-f5b6d855342e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1281 microversion: 2.1 time: 0.450194 Aug 27 02:47:31.991199 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1921/3566] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:31 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1281 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:32.341418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:32.342235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:32.357569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:32.359771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:32.373490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.376002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.376574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.377602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.380080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.382658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.425498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b482169d-0993-481b-83be-2ed8ef477a39 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:32.426496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b482169d-0993-481b-83be-2ed8ef477a39 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:32.450878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b482169d-0993-481b-83be-2ed8ef477a39 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.451653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b482169d-0993-481b-83be-2ed8ef477a39 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.452262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b482169d-0993-481b-83be-2ed8ef477a39 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.457372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b482169d-0993-481b-83be-2ed8ef477a39 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.458191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b482169d-0993-481b-83be-2ed8ef477a39 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.458830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b482169d-0993-481b-83be-2ed8ef477a39 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.515611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.516081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.516542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.517011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lazy-loading 'fault' on Instance uuid 104cc615-4155-4157-b995-0bbf57ab176d {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:47:32.774140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06b9779adbc448b98b2d17bdda361164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc17e7035bc944c0b2709e2c48c86913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:32.783767 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3e85343b-7357-475c-bdc7-15ae799d3d99 tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 200 len: 1314 microversion: 2.1 time: 0.447456 Aug 27 02:47:32.788343 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1646/3567] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:32 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:32.795601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:32.801273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:32.818113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.818620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.819399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.820143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:32.820610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:32.821046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:32.865094 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] HTTP exception thrown: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 HTTP/1.1 Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f5d77305-6bf5-4d11-bb93-187f23a42307'} Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:32.866795 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:32.871386 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:32.871386 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:32.871386 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:32.871386 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:32.871386 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:32.871386 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:32.871386 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:47:32.871386 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:32.871386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 404 to user: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:32.871386 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4d730672-1037-48e2-82af-8955e35af9ee tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 404 len: 111 microversion: 2.1 time: 0.078642 Aug 27 02:47:32.881888 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1647/3568] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:32 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:32.897111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7756cbbc-4ec4-4077-98da-d8cad30e068c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Action: 'create', calling method: .version_select at 0x7f4d29d29550>, body: {"keypair": {"name": "tempest-keypair-1822803637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQzQBireszzxT7MqQr/TXVWbVEYxti8AGJq9hNs8LJrYEL6FUwkBrY/bp8JZfoeGlFKlq+lHtBUWtJv5p5FiuIdHQMS7kop8oqx6EdSxN7eNeT08WP3+wxxQ8TvyUQpPw=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:32.919926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7756cbbc-4ec4-4077-98da-d8cad30e068c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Getting quotas for project 9af784466d744e7fbb40d43d6b6e62c5. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:32.927178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7756cbbc-4ec4-4077-98da-d8cad30e068c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Getting quotas for user 96a627797d4943e294544d084a5bf814 and project 9af784466d744e7fbb40d43d6b6e62c5. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:32.970870 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7756cbbc-4ec4-4077-98da-d8cad30e068c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086434 Aug 27 02:47:32.972274 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1648/3569] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:47:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:33.017650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-83904d20-4b67-4453-9fd1-95a3af3e0248 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:33.018742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-83904d20-4b67-4453-9fd1-95a3af3e0248 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:33.028409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83904d20-4b67-4453-9fd1-95a3af3e0248 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:33.029360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83904d20-4b67-4453-9fd1-95a3af3e0248 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:33.030105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83904d20-4b67-4453-9fd1-95a3af3e0248 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:33.031129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83904d20-4b67-4453-9fd1-95a3af3e0248 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:33.031863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83904d20-4b67-4453-9fd1-95a3af3e0248 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:33.032571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83904d20-4b67-4453-9fd1-95a3af3e0248 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:33.187384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-83904d20-4b67-4453-9fd1-95a3af3e0248 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:33.196254 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-83904d20-4b67-4453-9fd1-95a3af3e0248 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1281 microversion: 2.1 time: 0.182972 Aug 27 02:47:33.196867 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1649/3570] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:33 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:33.400592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b482169d-0993-481b-83be-2ed8ef477a39 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:33.409309 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b482169d-0993-481b-83be-2ed8ef477a39 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1316 microversion: 2.1 time: 0.988447 Aug 27 02:47:33.410569 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1922/3571] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:32 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1316 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:33.819918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:33.821342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] [instance: 104cc615-4155-4157-b995-0bbf57ab176d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:33.842469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:33.843425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:33.847282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:33.848755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:33.849165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:33.851797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:33.877725 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] HTTP exception thrown: Instance 104cc615-4155-4157-b995-0bbf57ab176d could not be found. Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Request method failure captured: Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d HTTP/1.1 Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWcRXtwiFRBmGL93WPHc_atR_1RV5M_eAmGPxoo-pzHL_4_h8t17BZYcuxviU8AgFLW8UCoXZu8WeTaVgNeaRGSzaJyTpQoM2eb9OtJ_iRnXhVDXN1PdkCf4YZQJPkfcEAdBMvPw4oy0gMw7WFNsxc0ryiRdCN0sBw9xq84WHRTfUE Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cc17e7035bc944c0b2709e2c48c86913"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cc17e7035bc944c0b2709e2c48c86913"}]}] Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cc17e7035bc944c0b2709e2c48c86913 Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-675647401 Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 06b9779adbc448b98b2d17bdda361164 Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-675647401-project Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 104cc615-4155-4157-b995-0bbf57ab176d could not be found. Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '104cc615-4155-4157-b995-0bbf57ab176d'} Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 104cc615-4155-4157-b995-0bbf57ab176d could not be found. Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 104cc615-4155-4157-b995-0bbf57ab176d could not be found. Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:33.879809 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:33.884222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:33.884222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:33.884222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:33.884222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:33.884222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:33.884222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:33.884222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 104cc615-4155-4157-b995-0bbf57ab176d could not be found. Aug 27 02:47:33.884222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:47:33.884222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] Returning 404 to user: Instance 104cc615-4155-4157-b995-0bbf57ab176d could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:33.884222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-38f3b698-de75-479e-989a-5325f9aabdfd tempest-ServerMetadataNegativeTestJSON-675647401 tempest-ServerMetadataNegativeTestJSON-675647401-project] 10.222.0.99 "GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d" status: 404 len: 111 microversion: 2.1 time: 0.072567 Aug 27 02:47:33.898687 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1650/3572] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:33 2022] GET /compute/v2.1/servers/104cc615-4155-4157-b995-0bbf57ab176d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:47:34.252920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-85a89df6-df92-4f49-9f66-3377cc01d733 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:34.254341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-85a89df6-df92-4f49-9f66-3377cc01d733 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:34.288035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85a89df6-df92-4f49-9f66-3377cc01d733 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.288802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85a89df6-df92-4f49-9f66-3377cc01d733 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.289635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85a89df6-df92-4f49-9f66-3377cc01d733 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:34.293466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85a89df6-df92-4f49-9f66-3377cc01d733 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.294395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85a89df6-df92-4f49-9f66-3377cc01d733 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.295415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85a89df6-df92-4f49-9f66-3377cc01d733 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:34.449621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2cbf9f56-b7ae-441e-8252-b212caee808e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:34.451222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2cbf9f56-b7ae-441e-8252-b212caee808e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:34.486284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f56-b7ae-441e-8252-b212caee808e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.489685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f56-b7ae-441e-8252-b212caee808e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.490968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f56-b7ae-441e-8252-b212caee808e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:34.493335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f56-b7ae-441e-8252-b212caee808e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:34.494510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f56-b7ae-441e-8252-b212caee808e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:34.496289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cbf9f56-b7ae-441e-8252-b212caee808e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:35.493724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2cbf9f56-b7ae-441e-8252-b212caee808e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:35.504230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-85a89df6-df92-4f49-9f66-3377cc01d733 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:35.510131 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2cbf9f56-b7ae-441e-8252-b212caee808e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1316 microversion: 2.1 time: 1.082325 Aug 27 02:47:35.516921 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-85a89df6-df92-4f49-9f66-3377cc01d733 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1323 microversion: 2.1 time: 1.278997 Aug 27 02:47:35.518964 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1923/3573] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:34 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1323 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:35.525109 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1651/3574] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:34 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1316 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:36.562073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5ed936df-3a30-495f-b9e5-630274aeefc4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:36.563535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5ed936df-3a30-495f-b9e5-630274aeefc4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:36.570041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fbefb9c3-1833-491a-a9c3-09459711229d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:36.574477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:36.578224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:36.583659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ed936df-3a30-495f-b9e5-630274aeefc4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:36.584258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ed936df-3a30-495f-b9e5-630274aeefc4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:36.584466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fbefb9c3-1833-491a-a9c3-09459711229d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:36.584836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ed936df-3a30-495f-b9e5-630274aeefc4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:36.585578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ed936df-3a30-495f-b9e5-630274aeefc4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:36.586169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ed936df-3a30-495f-b9e5-630274aeefc4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:36.586611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ed936df-3a30-495f-b9e5-630274aeefc4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:36.630640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbefb9c3-1833-491a-a9c3-09459711229d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:36.631159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbefb9c3-1833-491a-a9c3-09459711229d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:36.631791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbefb9c3-1833-491a-a9c3-09459711229d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:36.632635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbefb9c3-1833-491a-a9c3-09459711229d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:36.633167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbefb9c3-1833-491a-a9c3-09459711229d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:36.633703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbefb9c3-1833-491a-a9c3-09459711229d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:37.567045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5ed936df-3a30-495f-b9e5-630274aeefc4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:37.581367 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5ed936df-3a30-495f-b9e5-630274aeefc4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1323 microversion: 2.1 time: 1.030839 Aug 27 02:47:37.583054 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1924/3575] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:36 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1323 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:37.602929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-05871126-4525-4347-99e9-b1819973f94d req-0e286c0e-bfba-47be-aad3-b57563d12a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f7ed66-f5a7-42ec-be91-bd5a08981d8f", "tag": "6c86ab3b-0086-4926-853f-bbbc6acba033"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:37.634423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fbefb9c3-1833-491a-a9c3-09459711229d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:37.647055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-05871126-4525-4347-99e9-b1819973f94d req-0e286c0e-bfba-47be-aad3-b57563d12a0c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:37.648512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-05871126-4525-4347-99e9-b1819973f94d req-0e286c0e-bfba-47be-aad3-b57563d12a0c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:37.649807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-05871126-4525-4347-99e9-b1819973f94d req-0e286c0e-bfba-47be-aad3-b57563d12a0c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:37.652279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:37.658672 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fbefb9c3-1833-491a-a9c3-09459711229d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1316 microversion: 2.1 time: 1.098415 Aug 27 02:47:37.660197 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1652/3576] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:36 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1316 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:37.680338 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-05871126-4525-4347-99e9-b1819973f94d req-0e286c0e-bfba-47be-aad3-b57563d12a0c service nova] Creating event network-changed:6c86ab3b-0086-4926-853f-bbbc6acba033 for instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f on n-h1-852084-5 Aug 27 02:47:37.704921 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-05871126-4525-4347-99e9-b1819973f94d req-0e286c0e-bfba-47be-aad3-b57563d12a0c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119980 Aug 27 02:47:37.711582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1925/3577] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:38.628150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d59c082-5237-460b-99b3-f1f8bc3c3ab4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:38.628772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4d59c082-5237-460b-99b3-f1f8bc3c3ab4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:38.652475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d59c082-5237-460b-99b3-f1f8bc3c3ab4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:38.653487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d59c082-5237-460b-99b3-f1f8bc3c3ab4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:38.653685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d59c082-5237-460b-99b3-f1f8bc3c3ab4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:38.658283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d59c082-5237-460b-99b3-f1f8bc3c3ab4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:38.659875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d59c082-5237-460b-99b3-f1f8bc3c3ab4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:38.660675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d59c082-5237-460b-99b3-f1f8bc3c3ab4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:38.691754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5d8d91c7-4046-4155-a221-97fc081abe14 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:38.692500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5d8d91c7-4046-4155-a221-97fc081abe14 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:38.709503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:38.719720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d8d91c7-4046-4155-a221-97fc081abe14 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:38.720560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d8d91c7-4046-4155-a221-97fc081abe14 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:38.721013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d8d91c7-4046-4155-a221-97fc081abe14 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:38.725259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d8d91c7-4046-4155-a221-97fc081abe14 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:38.729258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d8d91c7-4046-4155-a221-97fc081abe14 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:38.730518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d8d91c7-4046-4155-a221-97fc081abe14 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:39.507348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5d8d91c7-4046-4155-a221-97fc081abe14 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:39.554019 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5d8d91c7-4046-4155-a221-97fc081abe14 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1316 microversion: 2.1 time: 0.866589 Aug 27 02:47:39.590684 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1926/3578] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:38 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1316 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:39.783366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-be498a25-e3d0-4db7-934f-cda3eef5bc52 req-0b5028c3-26c1-411d-b9d0-5d9a0c670ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729c813c-9a69-418d-a6d8-d9f923b1c4f2", "tag": "00c7f942-8e70-4330-89b9-f94a286f91c8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:39.826785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-be498a25-e3d0-4db7-934f-cda3eef5bc52 req-0b5028c3-26c1-411d-b9d0-5d9a0c670ebd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:39.828427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-be498a25-e3d0-4db7-934f-cda3eef5bc52 req-0b5028c3-26c1-411d-b9d0-5d9a0c670ebd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:39.830603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-be498a25-e3d0-4db7-934f-cda3eef5bc52 req-0b5028c3-26c1-411d-b9d0-5d9a0c670ebd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:39.863647 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-be498a25-e3d0-4db7-934f-cda3eef5bc52 req-0b5028c3-26c1-411d-b9d0-5d9a0c670ebd service nova] Creating event network-changed:00c7f942-8e70-4330-89b9-f94a286f91c8 for instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 on n-h2-852084-5 Aug 27 02:47:39.893814 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-be498a25-e3d0-4db7-934f-cda3eef5bc52 req-0b5028c3-26c1-411d-b9d0-5d9a0c670ebd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120039 Aug 27 02:47:39.896495 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1927/3579] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:40.614133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ee3333df-82b8-4489-be80-932d6e0cecfb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:40.627944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ee3333df-82b8-4489-be80-932d6e0cecfb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:40.658973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee3333df-82b8-4489-be80-932d6e0cecfb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:40.663230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee3333df-82b8-4489-be80-932d6e0cecfb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:40.664558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee3333df-82b8-4489-be80-932d6e0cecfb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:40.670534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee3333df-82b8-4489-be80-932d6e0cecfb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:40.672156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee3333df-82b8-4489-be80-932d6e0cecfb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:40.677317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee3333df-82b8-4489-be80-932d6e0cecfb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:41.136550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4d59c082-5237-460b-99b3-f1f8bc3c3ab4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:41.148844 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4d59c082-5237-460b-99b3-f1f8bc3c3ab4 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1323 microversion: 2.1 time: 2.528773 Aug 27 02:47:41.156192 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1653/3580] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:38 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1323 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:41.706207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ee3333df-82b8-4489-be80-932d6e0cecfb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:41.738472 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ee3333df-82b8-4489-be80-932d6e0cecfb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1316 microversion: 2.1 time: 1.135959 Aug 27 02:47:41.754597 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1928/3581] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:40 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1316 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:42.192214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2fe9a42-85ff-404e-82bc-7aabd8dd2e99 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:42.194271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e2fe9a42-85ff-404e-82bc-7aabd8dd2e99 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:42.218803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2fe9a42-85ff-404e-82bc-7aabd8dd2e99 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.223174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2fe9a42-85ff-404e-82bc-7aabd8dd2e99 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.228667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2fe9a42-85ff-404e-82bc-7aabd8dd2e99 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.230921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2fe9a42-85ff-404e-82bc-7aabd8dd2e99 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.234868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2fe9a42-85ff-404e-82bc-7aabd8dd2e99 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.237380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2fe9a42-85ff-404e-82bc-7aabd8dd2e99 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.785399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4719ebfc-6d57-41ce-8185-f885f683ca17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:42.787729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4719ebfc-6d57-41ce-8185-f885f683ca17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:42.840057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4719ebfc-6d57-41ce-8185-f885f683ca17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.846484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4719ebfc-6d57-41ce-8185-f885f683ca17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.847824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4719ebfc-6d57-41ce-8185-f885f683ca17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.857908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4719ebfc-6d57-41ce-8185-f885f683ca17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:42.860275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4719ebfc-6d57-41ce-8185-f885f683ca17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:42.862859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4719ebfc-6d57-41ce-8185-f885f683ca17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:42.937816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:43.211904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e2fe9a42-85ff-404e-82bc-7aabd8dd2e99 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:43.227774 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e2fe9a42-85ff-404e-82bc-7aabd8dd2e99 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1323 microversion: 2.1 time: 1.039212 Aug 27 02:47:43.230768 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1654/3582] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:42 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1323 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:43.638658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4719ebfc-6d57-41ce-8185-f885f683ca17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:43.657576 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4719ebfc-6d57-41ce-8185-f885f683ca17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1316 microversion: 2.1 time: 0.885616 Aug 27 02:47:43.660375 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1929/3583] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:42 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1316 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:44.278777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b6d220f5-85cb-44eb-aeac-7542519b04cc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:44.280360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b6d220f5-85cb-44eb-aeac-7542519b04cc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:44.305837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6d220f5-85cb-44eb-aeac-7542519b04cc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:44.306655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6d220f5-85cb-44eb-aeac-7542519b04cc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:44.307918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6d220f5-85cb-44eb-aeac-7542519b04cc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:44.310587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6d220f5-85cb-44eb-aeac-7542519b04cc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:44.315422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6d220f5-85cb-44eb-aeac-7542519b04cc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:44.316237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6d220f5-85cb-44eb-aeac-7542519b04cc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:44.694097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-51a9e118-34de-4fe5-bc73-1a41f8e66157 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:44.694887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-51a9e118-34de-4fe5-bc73-1a41f8e66157 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:44.715354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51a9e118-34de-4fe5-bc73-1a41f8e66157 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:44.715864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51a9e118-34de-4fe5-bc73-1a41f8e66157 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:44.721111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51a9e118-34de-4fe5-bc73-1a41f8e66157 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:44.722739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51a9e118-34de-4fe5-bc73-1a41f8e66157 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:44.723243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51a9e118-34de-4fe5-bc73-1a41f8e66157 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:44.723697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51a9e118-34de-4fe5-bc73-1a41f8e66157 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:44.945015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b6d220f5-85cb-44eb-aeac-7542519b04cc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:44.982759 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b6d220f5-85cb-44eb-aeac-7542519b04cc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1323 microversion: 2.1 time: 0.709486 Aug 27 02:47:44.983717 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1655/3584] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:44 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1323 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:45.554442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-51a9e118-34de-4fe5-bc73-1a41f8e66157 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:45.567855 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-51a9e118-34de-4fe5-bc73-1a41f8e66157 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1316 microversion: 2.1 time: 0.876414 Aug 27 02:47:45.570212 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1930/3585] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:44 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1316 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:45.916825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-992867962", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:46.027783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a4b04505-8416-411a-8741-bdb70cc2b4f9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:46.037113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a4b04505-8416-411a-8741-bdb70cc2b4f9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:46.085850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b04505-8416-411a-8741-bdb70cc2b4f9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:46.101107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b04505-8416-411a-8741-bdb70cc2b4f9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:46.102401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b04505-8416-411a-8741-bdb70cc2b4f9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:46.114435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b04505-8416-411a-8741-bdb70cc2b4f9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:46.118639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b04505-8416-411a-8741-bdb70cc2b4f9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:46.124890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b04505-8416-411a-8741-bdb70cc2b4f9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:46.129338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] validate_networks() for [('81160f92-d48b-40f7-aec3-0899de13d6b2', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:47:46.786879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a4b04505-8416-411a-8741-bdb70cc2b4f9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:46.840982 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a4b04505-8416-411a-8741-bdb70cc2b4f9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1323 microversion: 2.1 time: 0.824780 Aug 27 02:47:46.847374 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1931/3586] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:46 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1323 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:46.871245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13e797a5-9fab-4e7c-8759-694264270859 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:46.876653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13e797a5-9fab-4e7c-8759-694264270859 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:46.905305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13e797a5-9fab-4e7c-8759-694264270859 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:46.910455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13e797a5-9fab-4e7c-8759-694264270859 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:46.912176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13e797a5-9fab-4e7c-8759-694264270859 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:46.917267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13e797a5-9fab-4e7c-8759-694264270859 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:46.921824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13e797a5-9fab-4e7c-8759-694264270859 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:46.922568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13e797a5-9fab-4e7c-8759-694264270859 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:47.914823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-13e797a5-9fab-4e7c-8759-694264270859 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:47.935177 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13e797a5-9fab-4e7c-8759-694264270859 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1316 microversion: 2.1 time: 1.085966 Aug 27 02:47:47.952637 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1932/3587] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:46 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1316 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:47.991714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a34e6cc7-625d-4c49-8668-9081d4286fbf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:47.997039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a34e6cc7-625d-4c49-8668-9081d4286fbf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:48.031741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34e6cc7-625d-4c49-8668-9081d4286fbf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:48.032602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34e6cc7-625d-4c49-8668-9081d4286fbf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:48.033342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34e6cc7-625d-4c49-8668-9081d4286fbf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:48.052633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34e6cc7-625d-4c49-8668-9081d4286fbf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:48.053253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34e6cc7-625d-4c49-8668-9081d4286fbf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:48.054241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34e6cc7-625d-4c49-8668-9081d4286fbf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:48.139449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:47:48.140245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:47:48.141145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:47:48.142268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:47:48.142990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:47:48.208128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:48.214476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:48.217103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:48.219328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:48.225404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:48.238357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:48.363139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Getting quotas for project 9af784466d744e7fbb40d43d6b6e62c5. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:48.377294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:48.391739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Getting quotas for user 96a627797d4943e294544d084a5bf814 and project 9af784466d744e7fbb40d43d6b6e62c5. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:48.437873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:47:48.444464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:47:48.693929 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba7afedf-6178-4d01-bd77-228c4cbdd859 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.780877 Aug 27 02:47:48.697768 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1656/3588] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:47:48.737433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e45647ef-3242-495b-95a2-c62fb1b54d1b req-60bba80d-a247-45df-a99d-4c3c8d343109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f7ed66-f5a7-42ec-be91-bd5a08981d8f", "name": "network-vif-plugged", "status": "completed", "tag": "6c86ab3b-0086-4926-853f-bbbc6acba033"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:48.821188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e45647ef-3242-495b-95a2-c62fb1b54d1b req-60bba80d-a247-45df-a99d-4c3c8d343109 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:48.825635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e45647ef-3242-495b-95a2-c62fb1b54d1b req-60bba80d-a247-45df-a99d-4c3c8d343109 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:48.834987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e45647ef-3242-495b-95a2-c62fb1b54d1b req-60bba80d-a247-45df-a99d-4c3c8d343109 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:48.913251 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e45647ef-3242-495b-95a2-c62fb1b54d1b req-60bba80d-a247-45df-a99d-4c3c8d343109 service nova] Creating event network-vif-plugged:6c86ab3b-0086-4926-853f-bbbc6acba033 for instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f on n-h1-852084-5 Aug 27 02:47:48.950261 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e45647ef-3242-495b-95a2-c62fb1b54d1b req-60bba80d-a247-45df-a99d-4c3c8d343109 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245270 Aug 27 02:47:48.961505 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1657/3589] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:47:49.006733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-afdc3434-20e1-4939-9207-de3611108a16 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:49.007478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-afdc3434-20e1-4939-9207-de3611108a16 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:49.094830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a34e6cc7-625d-4c49-8668-9081d4286fbf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:49.122031 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a34e6cc7-625d-4c49-8668-9081d4286fbf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1323 microversion: 2.1 time: 1.160652 Aug 27 02:47:49.125645 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1933/3590] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:47 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1323 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:49.142712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cff59195-9280-4b1b-b341-e46e1b063f58 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:49.145530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cff59195-9280-4b1b-b341-e46e1b063f58 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:49.184292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff59195-9280-4b1b-b341-e46e1b063f58 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:49.186570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff59195-9280-4b1b-b341-e46e1b063f58 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:49.189618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff59195-9280-4b1b-b341-e46e1b063f58 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:49.193485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff59195-9280-4b1b-b341-e46e1b063f58 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:49.196523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff59195-9280-4b1b-b341-e46e1b063f58 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:49.199354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff59195-9280-4b1b-b341-e46e1b063f58 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:49.305261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-afdc3434-20e1-4939-9207-de3611108a16 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:49.318290 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-afdc3434-20e1-4939-9207-de3611108a16 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1224 microversion: 2.1 time: 0.344200 Aug 27 02:47:49.322889 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1658/3591] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:48 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1224 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:50.160716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c2c8286-7398-4ecd-ab4d-fe0906d494fa tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:50.164136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4c2c8286-7398-4ecd-ab4d-fe0906d494fa tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:50.199786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c2c8286-7398-4ecd-ab4d-fe0906d494fa tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:50.207485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c2c8286-7398-4ecd-ab4d-fe0906d494fa tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:50.212280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c2c8286-7398-4ecd-ab4d-fe0906d494fa tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:50.215407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c2c8286-7398-4ecd-ab4d-fe0906d494fa tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:50.220456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c2c8286-7398-4ecd-ab4d-fe0906d494fa tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:50.221941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c2c8286-7398-4ecd-ab4d-fe0906d494fa tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:50.449980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cff59195-9280-4b1b-b341-e46e1b063f58 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:50.484660 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cff59195-9280-4b1b-b341-e46e1b063f58 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1316 microversion: 2.1 time: 1.352748 Aug 27 02:47:50.485563 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1934/3592] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:49 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1316 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:50.513458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c79429bf-1282-44cb-a1a0-6fae9f7a7479 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:50.514841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c79429bf-1282-44cb-a1a0-6fae9f7a7479 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:50.522734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c79429bf-1282-44cb-a1a0-6fae9f7a7479 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:50.524435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c79429bf-1282-44cb-a1a0-6fae9f7a7479 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:50.525161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c79429bf-1282-44cb-a1a0-6fae9f7a7479 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:50.527241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c79429bf-1282-44cb-a1a0-6fae9f7a7479 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:50.528017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c79429bf-1282-44cb-a1a0-6fae9f7a7479 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:50.528728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c79429bf-1282-44cb-a1a0-6fae9f7a7479 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:50.535517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:51.091691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c79429bf-1282-44cb-a1a0-6fae9f7a7479 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:51.102782 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c79429bf-1282-44cb-a1a0-6fae9f7a7479 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1220 microversion: 2.1 time: 0.598772 Aug 27 02:47:51.113438 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1935/3593] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:50 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1220 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:51.217521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-609ff50e-6f3e-4d7a-90b2-684f8d2ad87b req-5b471b14-3454-44b4-8683-529fd4fefb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729c813c-9a69-418d-a6d8-d9f923b1c4f2", "name": "network-vif-plugged", "status": "completed", "tag": "00c7f942-8e70-4330-89b9-f94a286f91c8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:51.243008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-609ff50e-6f3e-4d7a-90b2-684f8d2ad87b req-5b471b14-3454-44b4-8683-529fd4fefb07 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:51.243496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-609ff50e-6f3e-4d7a-90b2-684f8d2ad87b req-5b471b14-3454-44b4-8683-529fd4fefb07 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:51.243937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-609ff50e-6f3e-4d7a-90b2-684f8d2ad87b req-5b471b14-3454-44b4-8683-529fd4fefb07 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:51.294529 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-609ff50e-6f3e-4d7a-90b2-684f8d2ad87b req-5b471b14-3454-44b4-8683-529fd4fefb07 service nova] Creating event network-vif-plugged:00c7f942-8e70-4330-89b9-f94a286f91c8 for instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 on n-h2-852084-5 Aug 27 02:47:51.318188 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-609ff50e-6f3e-4d7a-90b2-684f8d2ad87b req-5b471b14-3454-44b4-8683-529fd4fefb07 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104900 Aug 27 02:47:51.318831 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1936/3594] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 02:47:51.487054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4c2c8286-7398-4ecd-ab4d-fe0906d494fa tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:51.502989 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4c2c8286-7398-4ecd-ab4d-fe0906d494fa tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1323 microversion: 2.1 time: 1.363619 Aug 27 02:47:51.504232 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1659/3595] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:50 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1323 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:51.522972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4084416-576e-4299-9593-5b26fbb1fabb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:51.523698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b4084416-576e-4299-9593-5b26fbb1fabb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:51.543576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4084416-576e-4299-9593-5b26fbb1fabb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:51.546734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4084416-576e-4299-9593-5b26fbb1fabb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:51.547419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4084416-576e-4299-9593-5b26fbb1fabb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:51.551520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4084416-576e-4299-9593-5b26fbb1fabb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:51.552755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4084416-576e-4299-9593-5b26fbb1fabb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:51.554843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4084416-576e-4299-9593-5b26fbb1fabb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:52.153266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a0d1f017-a17d-4c9b-b999-c6596c7b01c4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:52.154216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a0d1f017-a17d-4c9b-b999-c6596c7b01c4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:52.192217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0d1f017-a17d-4c9b-b999-c6596c7b01c4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:52.193237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0d1f017-a17d-4c9b-b999-c6596c7b01c4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:52.194570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0d1f017-a17d-4c9b-b999-c6596c7b01c4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:52.196086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0d1f017-a17d-4c9b-b999-c6596c7b01c4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:52.196986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0d1f017-a17d-4c9b-b999-c6596c7b01c4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:52.198011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0d1f017-a17d-4c9b-b999-c6596c7b01c4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:52.390171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b4084416-576e-4299-9593-5b26fbb1fabb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:52.399081 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b4084416-576e-4299-9593-5b26fbb1fabb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1316 microversion: 2.1 time: 0.896261 Aug 27 02:47:52.422608 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1937/3596] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:51 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1316 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:52.501973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a0d1f017-a17d-4c9b-b999-c6596c7b01c4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:52.524600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13448121-bc98-4e52-afda-9428ac002257 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:52.526275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13448121-bc98-4e52-afda-9428ac002257 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:52.534343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13448121-bc98-4e52-afda-9428ac002257 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:52.534846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13448121-bc98-4e52-afda-9428ac002257 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:52.535302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13448121-bc98-4e52-afda-9428ac002257 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:52.536091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13448121-bc98-4e52-afda-9428ac002257 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:52.536689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13448121-bc98-4e52-afda-9428ac002257 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:52.537138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13448121-bc98-4e52-afda-9428ac002257 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:52.548653 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a0d1f017-a17d-4c9b-b999-c6596c7b01c4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1282 microversion: 2.1 time: 0.396528 Aug 27 02:47:52.551335 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1660/3597] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:52 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1282 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:53.303377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-13448121-bc98-4e52-afda-9428ac002257 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:53.315151 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13448121-bc98-4e52-afda-9428ac002257 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1323 microversion: 2.1 time: 0.792223 Aug 27 02:47:53.318346 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1938/3598] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:52 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1323 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:47:53.432935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea638f4d-dfa4-4aa6-9dbb-7063d214f04f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:53.435591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ea638f4d-dfa4-4aa6-9dbb-7063d214f04f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:53.481974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea638f4d-dfa4-4aa6-9dbb-7063d214f04f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:53.488946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea638f4d-dfa4-4aa6-9dbb-7063d214f04f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:53.490522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea638f4d-dfa4-4aa6-9dbb-7063d214f04f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:53.497457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea638f4d-dfa4-4aa6-9dbb-7063d214f04f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:53.498511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea638f4d-dfa4-4aa6-9dbb-7063d214f04f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:53.499351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea638f4d-dfa4-4aa6-9dbb-7063d214f04f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:53.601337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57363ec1-915e-4808-a764-02059488a0d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:53.610111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-57363ec1-915e-4808-a764-02059488a0d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:53.651924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57363ec1-915e-4808-a764-02059488a0d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:53.659272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57363ec1-915e-4808-a764-02059488a0d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:53.660287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57363ec1-915e-4808-a764-02059488a0d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:53.661698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57363ec1-915e-4808-a764-02059488a0d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:53.662538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57363ec1-915e-4808-a764-02059488a0d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:53.663338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57363ec1-915e-4808-a764-02059488a0d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:54.412085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ea638f4d-dfa4-4aa6-9dbb-7063d214f04f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:54.434700 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ea638f4d-dfa4-4aa6-9dbb-7063d214f04f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.017705 Aug 27 02:47:54.451465 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1661/3599] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:53 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:54.481719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-57363ec1-915e-4808-a764-02059488a0d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:54.535407 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-57363ec1-915e-4808-a764-02059488a0d0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1282 microversion: 2.1 time: 0.943639 Aug 27 02:47:54.536414 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1939/3600] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:53 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1282 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:54.576570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8c80b302-54c9-42ba-8329-5144da4c9c7c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:54.579944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8c80b302-54c9-42ba-8329-5144da4c9c7c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:54.604561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c80b302-54c9-42ba-8329-5144da4c9c7c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:54.606710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c80b302-54c9-42ba-8329-5144da4c9c7c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:54.615310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c80b302-54c9-42ba-8329-5144da4c9c7c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:54.619530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c80b302-54c9-42ba-8329-5144da4c9c7c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:54.619729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c80b302-54c9-42ba-8329-5144da4c9c7c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:54.620414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c80b302-54c9-42ba-8329-5144da4c9c7c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:55.139461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8c80b302-54c9-42ba-8329-5144da4c9c7c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:55.152216 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8c80b302-54c9-42ba-8329-5144da4c9c7c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1519 microversion: 2.1 time: 0.594233 Aug 27 02:47:55.167733 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1940/3601] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:54 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1519 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:55.179490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1034586110", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:55.234154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a114c5e7-d205-40aa-8f44-1a8f48123886 tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] Action: 'create', calling method: .version_select at 0x7f4d29d731f0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:55.273380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a114c5e7-d205-40aa-8f44-1a8f48123886 tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] Getting quotas for project 4b53861742b54caba5582b23c2d26825. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:55.282979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a114c5e7-d205-40aa-8f44-1a8f48123886 tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] Getting quotas for user dbbb088ee1b64defa3b007d4714c80a2 and project 4b53861742b54caba5582b23c2d26825. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:55.387559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] validate_networks() for [('7f5f647c-3eb3-4e25-8f1b-498211cb650b', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:47:55.433425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a114c5e7-d205-40aa-8f44-1a8f48123886 tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] Getting quotas for project 4b53861742b54caba5582b23c2d26825. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:55.462814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a114c5e7-d205-40aa-8f44-1a8f48123886 tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] Getting quotas for user dbbb088ee1b64defa3b007d4714c80a2 and project 4b53861742b54caba5582b23c2d26825. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:55.535603 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a114c5e7-d205-40aa-8f44-1a8f48123886 tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] 10.222.0.99 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.082623 Aug 27 02:47:55.546281 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1662/3602] 10.222.0.99 () {62 vars in 1214 bytes} [Sat Aug 27 02:47:54 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:47:55.552656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-505de9e3-3609-41fd-a5d5-3bfe4ee1c25c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Action: 'create', calling method: .version_select at 0x7f4d29e120d0>, body: {"pool": null} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:47:56.945565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:47:56.946944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:47:56.948574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:47:56.950114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:47:56.950853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:47:56.979877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:56.980367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:56.981090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:56.982446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:56.983310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:56.984402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:57.060838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Getting quotas for project bd6b3bb36fb84f07a8fb9a38b1a9689b. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:47:57.075933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Getting quotas for user ad43ce0d2e9a40e99da82044ff843cd6 and project bd6b3bb36fb84f07a8fb9a38b1a9689b. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:47:57.121594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:47:57.130056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:47:57.294545 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-53376853-413b-4fee-8c68-512d0d9976c4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.121413 Aug 27 02:47:57.299774 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1941/3603] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:47:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:47:57.320276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e173b58e-ac90-4bd5-860c-e858b56b3a2f tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:57.392760 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e173b58e-ac90-4bd5-860c-e858b56b3a2f tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] 10.222.0.99 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.091185 Aug 27 02:47:57.395959 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1942/3604] 10.222.0.99 () {60 vars in 1193 bytes} [Sat Aug 27 02:47:57 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:47:57.411616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-214ba33d-0fc8-4986-91cb-19092fd7846a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:57.413467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-214ba33d-0fc8-4986-91cb-19092fd7846a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:57.432266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-214ba33d-0fc8-4986-91cb-19092fd7846a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:57.433456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-214ba33d-0fc8-4986-91cb-19092fd7846a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:57.437190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-214ba33d-0fc8-4986-91cb-19092fd7846a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:57.438711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-214ba33d-0fc8-4986-91cb-19092fd7846a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:57.439741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-214ba33d-0fc8-4986-91cb-19092fd7846a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:57.440929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-214ba33d-0fc8-4986-91cb-19092fd7846a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:57.951236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-214ba33d-0fc8-4986-91cb-19092fd7846a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:57.989400 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-214ba33d-0fc8-4986-91cb-19092fd7846a tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1324 microversion: 2.1 time: 0.588316 Aug 27 02:47:57.991794 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1943/3605] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:57 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1324 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:58.015957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6cbc13d1-1613-4901-9ced-f741fbdec818 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:58.017234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6cbc13d1-1613-4901-9ced-f741fbdec818 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:58.317139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:47:58.523919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6cbc13d1-1613-4901-9ced-f741fbdec818 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:58.545927 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6cbc13d1-1613-4901-9ced-f741fbdec818 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1217 microversion: 2.1 time: 0.552152 Aug 27 02:47:58.558160 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1944/3606] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:57 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1217 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:47:58.568997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6ded4916-c430-4f6f-a67c-ae92aec6d1df tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:58.614324 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6ded4916-c430-4f6f-a67c-ae92aec6d1df tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] 10.222.0.99 "GET /compute/v2.1/os-server-groups/b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa" status: 200 len: 235 microversion: 2.64 time: 0.053037 Aug 27 02:47:58.615349 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1945/3607] 10.222.0.99 () {60 vars in 1304 bytes} [Sat Aug 27 02:47:58 2022] GET /compute/v2.1/os-server-groups/b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa => generated 235 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:47:58.649029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-acfe8330-40d9-42a4-b384-de9f8d51c8ee tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:58.820722 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-acfe8330-40d9-42a4-b384-de9f8d51c8ee tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa" status: 204 len: 0 microversion: 2.64 time: 0.189200 Aug 27 02:47:58.830194 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1946/3608] 10.222.0.99 () {60 vars in 1307 bytes} [Sat Aug 27 02:47:58 2022] DELETE /compute/v2.1/os-server-groups/b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 27 02:47:58.848338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-54582457-fdcd-4306-9bd6-589bcff7b2a8 tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:58.872666 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-54582457-fdcd-4306-9bd6-589bcff7b2a8 tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] HTTP exception thrown: Instance group b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa could not be found. Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-54582457-fdcd-4306-9bd6-589bcff7b2a8 tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] Request method failure captured: Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/os-server-groups/b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa HTTP/1.1 Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYXZ1cHYznZ4DXTCPSGCNRcVCFKk1vGvr6qtMKFWSNnI7ApTrKjSFEYO6dSga7laOxWc6OVHQyQHVd3sG17RrsmT8aegBRJB9M0Gi3dLyhZ52VT8X6Ofx66MNO2uWle2GEfBUZ9FDg9uMH-ObV3dABcpX-QzWXNMtwypI0hcJnzi6bQ Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.64 Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 4b53861742b54caba5582b23c2d26825 Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerGroup264TestJSON-1898251542 Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4b53861742b54caba5582b23c2d26825"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4b53861742b54caba5582b23c2d26825"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4b53861742b54caba5582b23c2d26825"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4b53861742b54caba5582b23c2d26825"}]}] Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerGroup264TestJSON-1898251542 Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 4b53861742b54caba5582b23c2d26825 Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1898251542 Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerGroup264TestJSON-1898251542-project Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: dbbb088ee1b64defa3b007d4714c80a2 Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerGroup264TestJSON-1898251542-project Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance group b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa could not be found. Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa'} Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa could not be found. Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa could not be found. Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:47:58.885341 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:47:58.896795 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:47:58.896795 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:47:58.896795 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:47:58.896795 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:47:58.896795 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa could not be found. Aug 27 02:47:58.896795 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:47:58.896795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-54582457-fdcd-4306-9bd6-589bcff7b2a8 tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] Returning 404 to user: Instance group b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:47:58.896795 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-54582457-fdcd-4306-9bd6-589bcff7b2a8 tempest-ServerGroup264TestJSON-1898251542 tempest-ServerGroup264TestJSON-1898251542-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa" status: 404 len: 117 microversion: 2.64 time: 0.056604 Aug 27 02:47:58.900196 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1947/3609] 10.222.0.99 () {60 vars in 1307 bytes} [Sat Aug 27 02:47:58 2022] DELETE /compute/v2.1/os-server-groups/b07a5c21-bd77-49b8-a4cc-0ec9f3c694fa => generated 117 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:47:59.040307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-63e8ac18-10fc-42cd-9238-53747e3b38ba tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:47:59.045474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-63e8ac18-10fc-42cd-9238-53747e3b38ba tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:47:59.092738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63e8ac18-10fc-42cd-9238-53747e3b38ba tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:59.093997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63e8ac18-10fc-42cd-9238-53747e3b38ba tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:59.094796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63e8ac18-10fc-42cd-9238-53747e3b38ba tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:59.101559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63e8ac18-10fc-42cd-9238-53747e3b38ba tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:47:59.105621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63e8ac18-10fc-42cd-9238-53747e3b38ba tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:47:59.107430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-63e8ac18-10fc-42cd-9238-53747e3b38ba tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:47:59.973074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-63e8ac18-10fc-42cd-9238-53747e3b38ba tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:47:59.995544 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-63e8ac18-10fc-42cd-9238-53747e3b38ba tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1324 microversion: 2.1 time: 0.966035 Aug 27 02:48:00.000156 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1948/3610] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:47:59 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1324 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:00.014584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-306441909", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "40aca3e6-c82f-4196-b023-fadc66e349fa"}, {"uuid": "80ceec5f-f410-4955-a247-6f7f8bbb908c"}, {"uuid": "40aca3e6-c82f-4196-b023-fadc66e349fa"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:00.155500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] validate_networks() for [('40aca3e6-c82f-4196-b023-fadc66e349fa', None, None, None, None, None), ('80ceec5f-f410-4955-a247-6f7f8bbb908c', None, None, None, None, None), ('40aca3e6-c82f-4196-b023-fadc66e349fa', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:48:01.665550 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-505de9e3-3609-41fd-a5d5-3bfe4ee1c25c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.116802 Aug 27 02:48:01.683735 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1663/3611] 10.222.0.99 () {60 vars in 1170 bytes} [Sat Aug 27 02:47:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:01.705533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6465a33a-3f0d-4179-b4a2-ad2629921a65 req-f0bde4fa-3816-42eb-8f7a-efc49b7db325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a94dab-d39c-4da5-9e11-1f90cbe1ed32", "tag": "c13ec949-4599-4041-afca-f7ce67428f9c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:01.722584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6465a33a-3f0d-4179-b4a2-ad2629921a65 req-f0bde4fa-3816-42eb-8f7a-efc49b7db325 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:01.723355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6465a33a-3f0d-4179-b4a2-ad2629921a65 req-f0bde4fa-3816-42eb-8f7a-efc49b7db325 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:01.724703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6465a33a-3f0d-4179-b4a2-ad2629921a65 req-f0bde4fa-3816-42eb-8f7a-efc49b7db325 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:01.762521 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6465a33a-3f0d-4179-b4a2-ad2629921a65 req-f0bde4fa-3816-42eb-8f7a-efc49b7db325 service nova] Creating event network-changed:c13ec949-4599-4041-afca-f7ce67428f9c for instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 on n-h1-852084-5 Aug 27 02:48:01.777840 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6465a33a-3f0d-4179-b4a2-ad2629921a65 req-f0bde4fa-3816-42eb-8f7a-efc49b7db325 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091098 Aug 27 02:48:01.779495 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1664/3612] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:01.789215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3fedb687-92e4-4a35-91d0-c2c5299e17b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:01.791497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3fedb687-92e4-4a35-91d0-c2c5299e17b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:01.804009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fedb687-92e4-4a35-91d0-c2c5299e17b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:01.805232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fedb687-92e4-4a35-91d0-c2c5299e17b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:01.806320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fedb687-92e4-4a35-91d0-c2c5299e17b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:01.808127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fedb687-92e4-4a35-91d0-c2c5299e17b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:01.809306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fedb687-92e4-4a35-91d0-c2c5299e17b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:01.810490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3fedb687-92e4-4a35-91d0-c2c5299e17b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:02.141135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3fedb687-92e4-4a35-91d0-c2c5299e17b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:02.171243 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3fedb687-92e4-4a35-91d0-c2c5299e17b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1275 microversion: 2.1 time: 0.389496 Aug 27 02:48:02.172292 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1665/3613] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:01 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1275 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:02.196388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d12336db-12da-466a-a94e-e668b1e38d1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:02.201077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d12336db-12da-466a-a94e-e668b1e38d1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:02.216959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d12336db-12da-466a-a94e-e668b1e38d1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:02.218020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d12336db-12da-466a-a94e-e668b1e38d1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:02.221011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d12336db-12da-466a-a94e-e668b1e38d1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:02.222901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d12336db-12da-466a-a94e-e668b1e38d1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:02.224028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d12336db-12da-466a-a94e-e668b1e38d1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:02.225119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d12336db-12da-466a-a94e-e668b1e38d1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:03.913347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d12336db-12da-466a-a94e-e668b1e38d1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:03.926154 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d12336db-12da-466a-a94e-e668b1e38d1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1324 microversion: 2.1 time: 1.752333 Aug 27 02:48:03.927041 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1666/3614] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:02 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1324 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:03.937906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-920058306", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "e0d9a993-a33f-4021-8fe8-2409a593643d"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:04.084940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] validate_networks() for [('e0d9a993-a33f-4021-8fe8-2409a593643d', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:48:05.151647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:48:05.152464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:48:05.155487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:48:05.166388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:48:05.178292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:48:05.227071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:05.228661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:05.232794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:05.234876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:05.236264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:05.238763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:05.312614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Getting quotas for project 2b3c9fc569ff43fc8c28ef7edeb1c62a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:05.344618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Getting quotas for user 58c2cdb5435340e59fd0cd482de64bb3 and project 2b3c9fc569ff43fc8c28ef7edeb1c62a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:05.382972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:48:05.388539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:48:05.605498 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7e25ea24-a253-4324-a492-0324adedde6e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.676667 Aug 27 02:48:05.606751 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1667/3615] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:48:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:48:05.623555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b1448ec-f33a-469f-a521-8b3ed9541e94 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:05.625503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b1448ec-f33a-469f-a521-8b3ed9541e94 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:05.652414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1448ec-f33a-469f-a521-8b3ed9541e94 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:05.658814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1448ec-f33a-469f-a521-8b3ed9541e94 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:05.660046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1448ec-f33a-469f-a521-8b3ed9541e94 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:05.661394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1448ec-f33a-469f-a521-8b3ed9541e94 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:05.666843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1448ec-f33a-469f-a521-8b3ed9541e94 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:05.667668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1448ec-f33a-469f-a521-8b3ed9541e94 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:06.129199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b1448ec-f33a-469f-a521-8b3ed9541e94 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:06.145246 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b1448ec-f33a-469f-a521-8b3ed9541e94 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1317 microversion: 2.1 time: 0.537201 Aug 27 02:48:06.154156 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1668/3616] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:05 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:06.155373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92bc40b6-bc2c-457d-b34b-ceb8101ad547 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:06.156012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-92bc40b6-bc2c-457d-b34b-ceb8101ad547 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:06.167399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92bc40b6-bc2c-457d-b34b-ceb8101ad547 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:06.168048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92bc40b6-bc2c-457d-b34b-ceb8101ad547 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:06.168514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92bc40b6-bc2c-457d-b34b-ceb8101ad547 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:06.169856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92bc40b6-bc2c-457d-b34b-ceb8101ad547 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:06.170681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92bc40b6-bc2c-457d-b34b-ceb8101ad547 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:06.171234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92bc40b6-bc2c-457d-b34b-ceb8101ad547 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:06.641644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-92bc40b6-bc2c-457d-b34b-ceb8101ad547 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:06.650873 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-92bc40b6-bc2c-457d-b34b-ceb8101ad547 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1324 microversion: 2.1 time: 0.498805 Aug 27 02:48:06.667712 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1669/3617] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:06 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1324 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:06.684644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-811b8184-f2c8-44f4-b662-32d9c140bb1a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:06.685761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-811b8184-f2c8-44f4-b662-32d9c140bb1a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:06.713922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-811b8184-f2c8-44f4-b662-32d9c140bb1a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:06.726556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-811b8184-f2c8-44f4-b662-32d9c140bb1a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:06.727370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-811b8184-f2c8-44f4-b662-32d9c140bb1a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:06.728393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-811b8184-f2c8-44f4-b662-32d9c140bb1a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:06.729289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-811b8184-f2c8-44f4-b662-32d9c140bb1a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:06.729946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-811b8184-f2c8-44f4-b662-32d9c140bb1a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:06.835956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-811b8184-f2c8-44f4-b662-32d9c140bb1a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:06.849906 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-811b8184-f2c8-44f4-b662-32d9c140bb1a tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 200 len: 1227 microversion: 2.1 time: 0.180876 Aug 27 02:48:06.868052 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1670/3618] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:06 2022] GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 1227 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:07.010676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:07.167084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-57c39ee4-4517-4ac1-9b44-2f8ac709810b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:07.168380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-57c39ee4-4517-4ac1-9b44-2f8ac709810b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:07.200337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c39ee4-4517-4ac1-9b44-2f8ac709810b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:07.211459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c39ee4-4517-4ac1-9b44-2f8ac709810b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:07.212254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c39ee4-4517-4ac1-9b44-2f8ac709810b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:07.213569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c39ee4-4517-4ac1-9b44-2f8ac709810b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:07.214084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c39ee4-4517-4ac1-9b44-2f8ac709810b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:07.214542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57c39ee4-4517-4ac1-9b44-2f8ac709810b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:08.159257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:48:08.160426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:48:08.161605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:48:08.162712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:48:08.166112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:48:08.227307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:08.227939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:08.228442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:08.234402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:08.237083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:08.238639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:08.302380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Getting quotas for project ed47bfc9a7cc46c0a789d7ebd0a14bb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:08.314912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Getting quotas for user 0e9ba043fc844b0eaca32db087924226 and project ed47bfc9a7cc46c0a789d7ebd0a14bb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:08.352557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:48:08.356682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-57c39ee4-4517-4ac1-9b44-2f8ac709810b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:08.362961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:48:08.383779 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-57c39ee4-4517-4ac1-9b44-2f8ac709810b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1317 microversion: 2.1 time: 1.221133 Aug 27 02:48:08.388404 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1671/3619] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:07 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1317 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:08.452149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e764fdec-bb1e-4729-a7e4-1890e41c1aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:08.459925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e764fdec-bb1e-4729-a7e4-1890e41c1aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:08.475638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e764fdec-bb1e-4729-a7e4-1890e41c1aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:08.476414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e764fdec-bb1e-4729-a7e4-1890e41c1aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:08.479235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e764fdec-bb1e-4729-a7e4-1890e41c1aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:08.480886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e764fdec-bb1e-4729-a7e4-1890e41c1aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:08.481642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e764fdec-bb1e-4729-a7e4-1890e41c1aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:08.482381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e764fdec-bb1e-4729-a7e4-1890e41c1aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:08.587988 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f40610f5-2879-4e9c-9e4e-e0951e1bd951 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.584492 Aug 27 02:48:08.596521 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1949/3620] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 8595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:48:08.626976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-40cf73b2-f689-474a-8b73-8f993f8cc704 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:08.627697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-40cf73b2-f689-474a-8b73-8f993f8cc704 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:08.642082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40cf73b2-f689-474a-8b73-8f993f8cc704 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:08.642652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40cf73b2-f689-474a-8b73-8f993f8cc704 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:08.643083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40cf73b2-f689-474a-8b73-8f993f8cc704 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:08.644811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40cf73b2-f689-474a-8b73-8f993f8cc704 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:08.645524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40cf73b2-f689-474a-8b73-8f993f8cc704 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:08.647924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40cf73b2-f689-474a-8b73-8f993f8cc704 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:09.005338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-40cf73b2-f689-474a-8b73-8f993f8cc704 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:09.024369 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-40cf73b2-f689-474a-8b73-8f993f8cc704 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 200 len: 1281 microversion: 2.1 time: 0.422483 Aug 27 02:48:09.025862 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1950/3621] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:08 2022] GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 1281 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:09.051976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-76ad7604-3182-43cf-9313-41aed049e7cb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:09.053156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-76ad7604-3182-43cf-9313-41aed049e7cb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:09.068906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:09.485557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-76ad7604-3182-43cf-9313-41aed049e7cb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:09.494737 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-76ad7604-3182-43cf-9313-41aed049e7cb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1212 microversion: 2.1 time: 0.454051 Aug 27 02:48:09.495362 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1951/3622] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:09 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1212 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:09.511722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13fd3f53-76d0-4133-90ec-7de5fe2543bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:09.512359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13fd3f53-76d0-4133-90ec-7de5fe2543bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:09.524725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13fd3f53-76d0-4133-90ec-7de5fe2543bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:09.525852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13fd3f53-76d0-4133-90ec-7de5fe2543bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:09.526345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13fd3f53-76d0-4133-90ec-7de5fe2543bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:09.527143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13fd3f53-76d0-4133-90ec-7de5fe2543bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:09.534729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13fd3f53-76d0-4133-90ec-7de5fe2543bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:09.535524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13fd3f53-76d0-4133-90ec-7de5fe2543bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:09.845805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e764fdec-bb1e-4729-a7e4-1890e41c1aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:09.853809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=86 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:09.866599 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e764fdec-bb1e-4729-a7e4-1890e41c1aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1324 microversion: 2.1 time: 1.470789 Aug 27 02:48:09.881987 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1672/3623] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:08 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1324 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:10.060627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1c9b0c7c-b22d-4a46-bca9-940bac28c178 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:10.062845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1c9b0c7c-b22d-4a46-bca9-940bac28c178 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:10.079098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9b0c7c-b22d-4a46-bca9-940bac28c178 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:10.080481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9b0c7c-b22d-4a46-bca9-940bac28c178 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:10.082780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9b0c7c-b22d-4a46-bca9-940bac28c178 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:10.085488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9b0c7c-b22d-4a46-bca9-940bac28c178 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:10.086670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9b0c7c-b22d-4a46-bca9-940bac28c178 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:10.087405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9b0c7c-b22d-4a46-bca9-940bac28c178 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:10.405760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1c9b0c7c-b22d-4a46-bca9-940bac28c178 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:10.424745 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1c9b0c7c-b22d-4a46-bca9-940bac28c178 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 200 len: 1281 microversion: 2.1 time: 0.378275 Aug 27 02:48:10.427067 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1673/3624] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:10 2022] GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 1281 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:10.523188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-39686d82-d99a-4cd4-8bf1-67570760d4b2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:10.525809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-39686d82-d99a-4cd4-8bf1-67570760d4b2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:10.579092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39686d82-d99a-4cd4-8bf1-67570760d4b2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:10.591779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39686d82-d99a-4cd4-8bf1-67570760d4b2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:10.596647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39686d82-d99a-4cd4-8bf1-67570760d4b2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:10.609161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39686d82-d99a-4cd4-8bf1-67570760d4b2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:10.610467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39686d82-d99a-4cd4-8bf1-67570760d4b2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:10.613287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39686d82-d99a-4cd4-8bf1-67570760d4b2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:10.713549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-13fd3f53-76d0-4133-90ec-7de5fe2543bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:10.729501 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13fd3f53-76d0-4133-90ec-7de5fe2543bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1317 microversion: 2.1 time: 1.218743 Aug 27 02:48:10.730689 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1952/3625] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:09 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1317 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:10.906559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-10b445f8-d462-41e3-a785-f80ee2ae09a1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:10.908506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-10b445f8-d462-41e3-a785-f80ee2ae09a1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:10.923856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10b445f8-d462-41e3-a785-f80ee2ae09a1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:10.926330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10b445f8-d462-41e3-a785-f80ee2ae09a1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:10.927602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10b445f8-d462-41e3-a785-f80ee2ae09a1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:10.929508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10b445f8-d462-41e3-a785-f80ee2ae09a1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:10.930886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10b445f8-d462-41e3-a785-f80ee2ae09a1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:10.932901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10b445f8-d462-41e3-a785-f80ee2ae09a1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:11.192932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-39686d82-d99a-4cd4-8bf1-67570760d4b2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:11.240497 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-39686d82-d99a-4cd4-8bf1-67570760d4b2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1264 microversion: 2.1 time: 0.725336 Aug 27 02:48:11.258635 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1674/3626] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:10 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1264 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:11.451454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7f1ebc7-9ffb-44bf-9bc4-7e34793e2ea9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:11.452576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b7f1ebc7-9ffb-44bf-9bc4-7e34793e2ea9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:11.481885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebc7-9ffb-44bf-9bc4-7e34793e2ea9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:11.482729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebc7-9ffb-44bf-9bc4-7e34793e2ea9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:11.483502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebc7-9ffb-44bf-9bc4-7e34793e2ea9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:11.488123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebc7-9ffb-44bf-9bc4-7e34793e2ea9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:11.489346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebc7-9ffb-44bf-9bc4-7e34793e2ea9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:11.509183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7f1ebc7-9ffb-44bf-9bc4-7e34793e2ea9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:12.283212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-10b445f8-d462-41e3-a785-f80ee2ae09a1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:12.302153 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-10b445f8-d462-41e3-a785-f80ee2ae09a1 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1324 microversion: 2.1 time: 1.406514 Aug 27 02:48:12.304529 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1953/3627] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:10 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1324 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:12.311237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e36c149b-f0e7-40d0-8c5e-2fc45fc26a9f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:12.318489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e36c149b-f0e7-40d0-8c5e-2fc45fc26a9f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:12.341294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c149b-f0e7-40d0-8c5e-2fc45fc26a9f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:12.347290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c149b-f0e7-40d0-8c5e-2fc45fc26a9f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:12.348276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c149b-f0e7-40d0-8c5e-2fc45fc26a9f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:12.349355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c149b-f0e7-40d0-8c5e-2fc45fc26a9f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:12.350034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c149b-f0e7-40d0-8c5e-2fc45fc26a9f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:12.352615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c149b-f0e7-40d0-8c5e-2fc45fc26a9f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:12.364678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7f1ebc7-9ffb-44bf-9bc4-7e34793e2ea9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:12.378265 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7f1ebc7-9ffb-44bf-9bc4-7e34793e2ea9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 200 len: 1323 microversion: 2.1 time: 0.934047 Aug 27 02:48:12.380079 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1675/3628] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:11 2022] GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 1323 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:13.079148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2067194466", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "b2081d82-cb69-46ec-950d-4ad038113a2e"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:13.314660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] validate_networks() for [('b2081d82-cb69-46ec-950d-4ad038113a2e', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:48:13.871270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e36c149b-f0e7-40d0-8c5e-2fc45fc26a9f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:13.889272 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e36c149b-f0e7-40d0-8c5e-2fc45fc26a9f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1317 microversion: 2.1 time: 1.583121 Aug 27 02:48:13.890987 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1954/3629] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:12 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1317 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:13.902540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8d554b41-172e-4a8a-bed4-3c3a423f6871 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:13.903763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8d554b41-172e-4a8a-bed4-3c3a423f6871 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:13.912984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d554b41-172e-4a8a-bed4-3c3a423f6871 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:13.914120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d554b41-172e-4a8a-bed4-3c3a423f6871 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:13.914912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d554b41-172e-4a8a-bed4-3c3a423f6871 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:13.916173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d554b41-172e-4a8a-bed4-3c3a423f6871 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:13.916947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d554b41-172e-4a8a-bed4-3c3a423f6871 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:13.917869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d554b41-172e-4a8a-bed4-3c3a423f6871 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:14.101848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8d554b41-172e-4a8a-bed4-3c3a423f6871 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:14.116871 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8d554b41-172e-4a8a-bed4-3c3a423f6871 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1270 microversion: 2.1 time: 0.222335 Aug 27 02:48:14.120122 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1955/3630] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:13 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:14.291640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c9bdf8ac-b5fd-4949-a363-ccb0062a5140 req-d846bd9a-1c03-4ff1-ac74-f1cd37affdae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a94dab-d39c-4da5-9e11-1f90cbe1ed32", "name": "network-vif-plugged", "status": "completed", "tag": "c13ec949-4599-4041-afca-f7ce67428f9c"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:14.323766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9bdf8ac-b5fd-4949-a363-ccb0062a5140 req-d846bd9a-1c03-4ff1-ac74-f1cd37affdae service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:14.324264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9bdf8ac-b5fd-4949-a363-ccb0062a5140 req-d846bd9a-1c03-4ff1-ac74-f1cd37affdae service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:14.332830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9bdf8ac-b5fd-4949-a363-ccb0062a5140 req-d846bd9a-1c03-4ff1-ac74-f1cd37affdae service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:14.369519 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c9bdf8ac-b5fd-4949-a363-ccb0062a5140 req-d846bd9a-1c03-4ff1-ac74-f1cd37affdae service nova] Creating event network-vif-plugged:c13ec949-4599-4041-afca-f7ce67428f9c for instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 on n-h1-852084-5 Aug 27 02:48:14.377706 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c9bdf8ac-b5fd-4949-a363-ccb0062a5140 req-d846bd9a-1c03-4ff1-ac74-f1cd37affdae service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254863 Aug 27 02:48:14.378816 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1956/3631] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:14.415365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2f51d5f0-8e6e-4613-9cdc-5f7dcc81bbd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:14.416115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2f51d5f0-8e6e-4613-9cdc-5f7dcc81bbd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:14.435354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f51d5f0-8e6e-4613-9cdc-5f7dcc81bbd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:14.436825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f51d5f0-8e6e-4613-9cdc-5f7dcc81bbd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:14.438272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f51d5f0-8e6e-4613-9cdc-5f7dcc81bbd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:14.441262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f51d5f0-8e6e-4613-9cdc-5f7dcc81bbd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:14.442294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f51d5f0-8e6e-4613-9cdc-5f7dcc81bbd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:14.443275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f51d5f0-8e6e-4613-9cdc-5f7dcc81bbd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:14.801041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:48:14.803734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:48:14.804937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:48:14.806940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:48:14.807994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:48:14.838237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=23 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:14.847645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:14.849021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:14.851176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:14.854041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:14.857617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:14.860202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:14.902360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Getting quotas for project c1e64f98555345459a5619fdbb08b32e. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:14.910836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Getting quotas for user 36b0238566f245d997b8f2302687951a and project c1e64f98555345459a5619fdbb08b32e. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:14.933611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:48:14.938769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:48:14.960468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:15.062261 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-340c8d49-45f6-4e50-b73d-94a4a8626d59 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.679268 Aug 27 02:48:15.065288 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1676/3632] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:48:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:48:15.076772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3b9e1c51-d428-43fd-9f24-87ad79131498 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:15.079129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3b9e1c51-d428-43fd-9f24-87ad79131498 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:15.093421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b9e1c51-d428-43fd-9f24-87ad79131498 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:15.094974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b9e1c51-d428-43fd-9f24-87ad79131498 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:15.096274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b9e1c51-d428-43fd-9f24-87ad79131498 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:15.098440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b9e1c51-d428-43fd-9f24-87ad79131498 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:15.099742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b9e1c51-d428-43fd-9f24-87ad79131498 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:15.100907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b9e1c51-d428-43fd-9f24-87ad79131498 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:15.348268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3b9e1c51-d428-43fd-9f24-87ad79131498 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:15.366682 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3b9e1c51-d428-43fd-9f24-87ad79131498 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 200 len: 1323 microversion: 2.1 time: 0.298673 Aug 27 02:48:15.369557 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1677/3633] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:15 2022] GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 1323 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:15.564754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-36497645-0bd5-400f-b505-166cd0dd60ea req-67c0da8d-3981-4d7b-a539-9b47661e04d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2ba8af-754a-4aaf-84e7-257aeb402178", "tag": "f26cc28b-247d-4c43-ab4f-fc8cea284db2"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:15.607596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-36497645-0bd5-400f-b505-166cd0dd60ea req-67c0da8d-3981-4d7b-a539-9b47661e04d8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:15.610868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-36497645-0bd5-400f-b505-166cd0dd60ea req-67c0da8d-3981-4d7b-a539-9b47661e04d8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:15.612198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-36497645-0bd5-400f-b505-166cd0dd60ea req-67c0da8d-3981-4d7b-a539-9b47661e04d8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:15.681997 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-36497645-0bd5-400f-b505-166cd0dd60ea req-67c0da8d-3981-4d7b-a539-9b47661e04d8 service nova] Creating event network-changed:f26cc28b-247d-4c43-ab4f-fc8cea284db2 for instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 on n-h1-852084-5 Aug 27 02:48:15.688058 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-36497645-0bd5-400f-b505-166cd0dd60ea req-67c0da8d-3981-4d7b-a539-9b47661e04d8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.316650 Aug 27 02:48:15.688503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2f51d5f0-8e6e-4613-9cdc-5f7dcc81bbd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:15.689016 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1678/3634] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:15.715433 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2f51d5f0-8e6e-4613-9cdc-5f7dcc81bbd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1324 microversion: 2.1 time: 1.320289 Aug 27 02:48:15.729701 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1957/3635] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:14 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1324 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:15.731050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-48e44ca6-36a3-4f86-8a1b-3310ca9501b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:15.732560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-48e44ca6-36a3-4f86-8a1b-3310ca9501b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:15.747998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48e44ca6-36a3-4f86-8a1b-3310ca9501b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:15.750907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48e44ca6-36a3-4f86-8a1b-3310ca9501b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:15.752216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48e44ca6-36a3-4f86-8a1b-3310ca9501b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:15.754677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48e44ca6-36a3-4f86-8a1b-3310ca9501b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:15.758908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48e44ca6-36a3-4f86-8a1b-3310ca9501b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:15.760200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48e44ca6-36a3-4f86-8a1b-3310ca9501b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:15.846795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-b3326979-7899-4b73-9ea8-c745c11fc9f9 req-44d32908-f598-4858-b9e1-fe99b7ad133c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b7bec6-d7a4-4b51-b360-a710046d55e8", "tag": "f6e3e061-ec81-4e02-a22d-21144052c815"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:15.867733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b3326979-7899-4b73-9ea8-c745c11fc9f9 req-44d32908-f598-4858-b9e1-fe99b7ad133c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:15.869962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b3326979-7899-4b73-9ea8-c745c11fc9f9 req-44d32908-f598-4858-b9e1-fe99b7ad133c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:15.870675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b3326979-7899-4b73-9ea8-c745c11fc9f9 req-44d32908-f598-4858-b9e1-fe99b7ad133c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:15.910317 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-b3326979-7899-4b73-9ea8-c745c11fc9f9 req-44d32908-f598-4858-b9e1-fe99b7ad133c service nova] Creating event network-changed:f6e3e061-ec81-4e02-a22d-21144052c815 for instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 on n-h2-852084-5 Aug 27 02:48:15.917863 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-b3326979-7899-4b73-9ea8-c745c11fc9f9 req-44d32908-f598-4858-b9e1-fe99b7ad133c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227051 Aug 27 02:48:15.919266 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1679/3636] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:15.925072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-acff96c3-0ba1-4f62-bd00-38c4243e6e52 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:15.926211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-acff96c3-0ba1-4f62-bd00-38c4243e6e52 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:16.095812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-acff96c3-0ba1-4f62-bd00-38c4243e6e52 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:16.110110 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-acff96c3-0ba1-4f62-bd00-38c4243e6e52 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1216 microversion: 2.1 time: 0.188869 Aug 27 02:48:16.126272 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1680/3637] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:15 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1216 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:16.152144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1c5d6e09-ac37-4266-911b-dd17cfcebc10 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:16.153650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1c5d6e09-ac37-4266-911b-dd17cfcebc10 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:16.165295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c5d6e09-ac37-4266-911b-dd17cfcebc10 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:16.166865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c5d6e09-ac37-4266-911b-dd17cfcebc10 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:16.168044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c5d6e09-ac37-4266-911b-dd17cfcebc10 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:16.169486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c5d6e09-ac37-4266-911b-dd17cfcebc10 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:16.170665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c5d6e09-ac37-4266-911b-dd17cfcebc10 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:16.171682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c5d6e09-ac37-4266-911b-dd17cfcebc10 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:16.452277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1c5d6e09-ac37-4266-911b-dd17cfcebc10 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:16.500899 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1c5d6e09-ac37-4266-911b-dd17cfcebc10 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1270 microversion: 2.1 time: 0.351995 Aug 27 02:48:16.502409 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1681/3638] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:16 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1270 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:16.521584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a3aef36-5282-407b-b7c3-84a53d8c1eb7 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:16.531425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4a3aef36-5282-407b-b7c3-84a53d8c1eb7 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:16.548604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3aef36-5282-407b-b7c3-84a53d8c1eb7 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:16.549893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3aef36-5282-407b-b7c3-84a53d8c1eb7 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:16.550687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3aef36-5282-407b-b7c3-84a53d8c1eb7 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:16.551975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3aef36-5282-407b-b7c3-84a53d8c1eb7 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:16.554049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3aef36-5282-407b-b7c3-84a53d8c1eb7 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:16.555483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3aef36-5282-407b-b7c3-84a53d8c1eb7 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.018891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4a3aef36-5282-407b-b7c3-84a53d8c1eb7 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:17.031028 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4a3aef36-5282-407b-b7c3-84a53d8c1eb7 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 200 len: 1323 microversion: 2.1 time: 0.519492 Aug 27 02:48:17.032359 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1682/3639] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:16 2022] GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 1323 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:17.037707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f1909619-8b32-4e66-ac35-9d44dfa707e0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:17.038683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f1909619-8b32-4e66-ac35-9d44dfa707e0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:17.060241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1909619-8b32-4e66-ac35-9d44dfa707e0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.061365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1909619-8b32-4e66-ac35-9d44dfa707e0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.069822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1909619-8b32-4e66-ac35-9d44dfa707e0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.070805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1909619-8b32-4e66-ac35-9d44dfa707e0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.073013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1909619-8b32-4e66-ac35-9d44dfa707e0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.074559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1909619-8b32-4e66-ac35-9d44dfa707e0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.285883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-48e44ca6-36a3-4f86-8a1b-3310ca9501b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:17.295496 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-48e44ca6-36a3-4f86-8a1b-3310ca9501b2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1317 microversion: 2.1 time: 1.576177 Aug 27 02:48:17.313219 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1958/3640] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:15 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1317 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:17.318299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-043877a5-2e2a-47cd-802c-baf3f0dd5271 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:17.318915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-043877a5-2e2a-47cd-802c-baf3f0dd5271 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:17.357443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-043877a5-2e2a-47cd-802c-baf3f0dd5271 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.357980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-043877a5-2e2a-47cd-802c-baf3f0dd5271 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.358425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-043877a5-2e2a-47cd-802c-baf3f0dd5271 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.359145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-043877a5-2e2a-47cd-802c-baf3f0dd5271 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.359607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-043877a5-2e2a-47cd-802c-baf3f0dd5271 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.360039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-043877a5-2e2a-47cd-802c-baf3f0dd5271 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.858772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-043877a5-2e2a-47cd-802c-baf3f0dd5271 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:17.874928 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-043877a5-2e2a-47cd-802c-baf3f0dd5271 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1276 microversion: 2.1 time: 0.560482 Aug 27 02:48:17.875764 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1959/3641] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:17 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1276 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:17.880638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eb288006-8499-4a30-afd4-5c8e3530253c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:17.889576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eb288006-8499-4a30-afd4-5c8e3530253c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:17.899267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb288006-8499-4a30-afd4-5c8e3530253c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.902677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb288006-8499-4a30-afd4-5c8e3530253c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.906302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb288006-8499-4a30-afd4-5c8e3530253c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.907608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb288006-8499-4a30-afd4-5c8e3530253c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:17.908300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb288006-8499-4a30-afd4-5c8e3530253c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:17.914352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb288006-8499-4a30-afd4-5c8e3530253c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:17.983845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:18.150347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eb288006-8499-4a30-afd4-5c8e3530253c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:18.167139 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eb288006-8499-4a30-afd4-5c8e3530253c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1270 microversion: 2.1 time: 0.290089 Aug 27 02:48:18.178532 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1960/3642] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:17 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1270 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:18.194217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e509d014-f8f7-4472-9ce8-0685e362211d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:18.195243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e509d014-f8f7-4472-9ce8-0685e362211d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:18.210617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e509d014-f8f7-4472-9ce8-0685e362211d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:18.211576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e509d014-f8f7-4472-9ce8-0685e362211d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:18.216185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e509d014-f8f7-4472-9ce8-0685e362211d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:18.217813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e509d014-f8f7-4472-9ce8-0685e362211d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:18.221542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e509d014-f8f7-4472-9ce8-0685e362211d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:18.222304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e509d014-f8f7-4472-9ce8-0685e362211d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:18.283916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:18.742012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f1909619-8b32-4e66-ac35-9d44dfa707e0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:18.752026 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f1909619-8b32-4e66-ac35-9d44dfa707e0 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1324 microversion: 2.1 time: 1.718319 Aug 27 02:48:18.756378 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1683/3643] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:17 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1324 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:18.765941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-49f34e22-2558-46fa-88e1-61b942eb40f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:18.770155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-49f34e22-2558-46fa-88e1-61b942eb40f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:18.783151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49f34e22-2558-46fa-88e1-61b942eb40f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:18.784554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49f34e22-2558-46fa-88e1-61b942eb40f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:18.785248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49f34e22-2558-46fa-88e1-61b942eb40f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:18.796297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49f34e22-2558-46fa-88e1-61b942eb40f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:18.798317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49f34e22-2558-46fa-88e1-61b942eb40f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:18.799082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49f34e22-2558-46fa-88e1-61b942eb40f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:19.007791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e509d014-f8f7-4472-9ce8-0685e362211d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:19.018148 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e509d014-f8f7-4472-9ce8-0685e362211d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 200 len: 1323 microversion: 2.1 time: 0.838036 Aug 27 02:48:19.032592 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1961/3644] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:18 2022] GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 1323 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:19.041449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9517a9a7-1600-4a2c-b43d-60bf5536091f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:19.042834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9517a9a7-1600-4a2c-b43d-60bf5536091f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:19.050922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9517a9a7-1600-4a2c-b43d-60bf5536091f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:19.052060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9517a9a7-1600-4a2c-b43d-60bf5536091f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:19.054498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9517a9a7-1600-4a2c-b43d-60bf5536091f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:19.056161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9517a9a7-1600-4a2c-b43d-60bf5536091f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:19.057114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9517a9a7-1600-4a2c-b43d-60bf5536091f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:19.057941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9517a9a7-1600-4a2c-b43d-60bf5536091f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:19.298717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9517a9a7-1600-4a2c-b43d-60bf5536091f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:19.326132 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9517a9a7-1600-4a2c-b43d-60bf5536091f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1274 microversion: 2.1 time: 0.291454 Aug 27 02:48:19.328523 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1962/3645] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:19 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1274 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:19.337993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2fa40004-4dc4-4561-afe0-878b206d175c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:19.338878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2fa40004-4dc4-4561-afe0-878b206d175c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:19.350723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa40004-4dc4-4561-afe0-878b206d175c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:19.351703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa40004-4dc4-4561-afe0-878b206d175c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:19.352489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa40004-4dc4-4561-afe0-878b206d175c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:19.355022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa40004-4dc4-4561-afe0-878b206d175c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:19.356011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa40004-4dc4-4561-afe0-878b206d175c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:19.357790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa40004-4dc4-4561-afe0-878b206d175c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:19.491224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=16 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:19.494137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-49f34e22-2558-46fa-88e1-61b942eb40f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:19.506098 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-49f34e22-2558-46fa-88e1-61b942eb40f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1317 microversion: 2.1 time: 0.747964 Aug 27 02:48:19.507127 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1684/3646] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:18 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:19.800983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6225c75c-d80e-4c67-97d7-f823b853a90b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:19.804915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6225c75c-d80e-4c67-97d7-f823b853a90b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:19.824061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6225c75c-d80e-4c67-97d7-f823b853a90b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:19.825490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6225c75c-d80e-4c67-97d7-f823b853a90b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:19.826330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6225c75c-d80e-4c67-97d7-f823b853a90b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:19.827393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6225c75c-d80e-4c67-97d7-f823b853a90b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:19.828038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6225c75c-d80e-4c67-97d7-f823b853a90b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:19.828855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6225c75c-d80e-4c67-97d7-f823b853a90b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.019435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2fa40004-4dc4-4561-afe0-878b206d175c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:20.036450 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2fa40004-4dc4-4561-afe0-878b206d175c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1312 microversion: 2.1 time: 0.706322 Aug 27 02:48:20.037061 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1963/3647] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:19 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1312 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:20.053607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0fc8906e-61ca-4cae-bce9-dfc56b4ec4bf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:20.054715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0fc8906e-61ca-4cae-bce9-dfc56b4ec4bf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:20.068438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc8906e-61ca-4cae-bce9-dfc56b4ec4bf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.069477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc8906e-61ca-4cae-bce9-dfc56b4ec4bf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.070207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc8906e-61ca-4cae-bce9-dfc56b4ec4bf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.074687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc8906e-61ca-4cae-bce9-dfc56b4ec4bf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.075528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc8906e-61ca-4cae-bce9-dfc56b4ec4bf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.076207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc8906e-61ca-4cae-bce9-dfc56b4ec4bf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.217896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6225c75c-d80e-4c67-97d7-f823b853a90b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:20.232670 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6225c75c-d80e-4c67-97d7-f823b853a90b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1521 microversion: 2.1 time: 0.457913 Aug 27 02:48:20.233612 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1685/3648] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:19 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:20.264153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ed0caa7e-c9bc-4b97-a794-dfd2bade88d8 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:20.265448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ed0caa7e-c9bc-4b97-a794-dfd2bade88d8 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:20.273416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed0caa7e-c9bc-4b97-a794-dfd2bade88d8 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.274376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed0caa7e-c9bc-4b97-a794-dfd2bade88d8 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.275400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed0caa7e-c9bc-4b97-a794-dfd2bade88d8 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.277218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed0caa7e-c9bc-4b97-a794-dfd2bade88d8 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.278357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed0caa7e-c9bc-4b97-a794-dfd2bade88d8 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.279045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed0caa7e-c9bc-4b97-a794-dfd2bade88d8 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.589804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ed0caa7e-c9bc-4b97-a794-dfd2bade88d8 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:20.602168 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ed0caa7e-c9bc-4b97-a794-dfd2bade88d8 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1521 microversion: 2.1 time: 0.344002 Aug 27 02:48:20.621871 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1686/3649] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:20 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:20.633519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f5ac6c63-a73c-40c5-9ef1-7967f849a076 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:20.635039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f5ac6c63-a73c-40c5-9ef1-7967f849a076 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:20.643831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ac6c63-a73c-40c5-9ef1-7967f849a076 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.644562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ac6c63-a73c-40c5-9ef1-7967f849a076 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.645001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ac6c63-a73c-40c5-9ef1-7967f849a076 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.645789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ac6c63-a73c-40c5-9ef1-7967f849a076 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.646231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ac6c63-a73c-40c5-9ef1-7967f849a076 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.646641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ac6c63-a73c-40c5-9ef1-7967f849a076 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.728578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f5ac6c63-a73c-40c5-9ef1-7967f849a076 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:20.740008 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f5ac6c63-a73c-40c5-9ef1-7967f849a076 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1274 microversion: 2.1 time: 0.116806 Aug 27 02:48:20.740964 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1687/3650] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:20 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:20.747139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-fbb0bdfa-a200-4517-8f28-8e03ba036a39 req-d1e4a641-bfdc-433e-80c2-3b0b5a411b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2ba8af-754a-4aaf-84e7-257aeb402178", "name": "network-vif-plugged", "status": "completed", "tag": "f26cc28b-247d-4c43-ab4f-fc8cea284db2"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:20.759974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fbb0bdfa-a200-4517-8f28-8e03ba036a39 req-d1e4a641-bfdc-433e-80c2-3b0b5a411b71 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.760579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fbb0bdfa-a200-4517-8f28-8e03ba036a39 req-d1e4a641-bfdc-433e-80c2-3b0b5a411b71 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.761137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fbb0bdfa-a200-4517-8f28-8e03ba036a39 req-d1e4a641-bfdc-433e-80c2-3b0b5a411b71 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.782054 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-fbb0bdfa-a200-4517-8f28-8e03ba036a39 req-d1e4a641-bfdc-433e-80c2-3b0b5a411b71 service nova] Creating event network-vif-plugged:f26cc28b-247d-4c43-ab4f-fc8cea284db2 for instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 on n-h1-852084-5 Aug 27 02:48:20.789616 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-fbb0bdfa-a200-4517-8f28-8e03ba036a39 req-d1e4a641-bfdc-433e-80c2-3b0b5a411b71 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047098 Aug 27 02:48:20.790414 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1688/3651] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:20.798441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-94cc2776-022a-4ec8-bb17-709b8ca84cb5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:20.799256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-94cc2776-022a-4ec8-bb17-709b8ca84cb5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:20.807096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94cc2776-022a-4ec8-bb17-709b8ca84cb5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.807743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94cc2776-022a-4ec8-bb17-709b8ca84cb5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.808130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94cc2776-022a-4ec8-bb17-709b8ca84cb5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.808918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94cc2776-022a-4ec8-bb17-709b8ca84cb5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.809468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94cc2776-022a-4ec8-bb17-709b8ca84cb5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.809995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94cc2776-022a-4ec8-bb17-709b8ca84cb5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.856809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0fc8906e-61ca-4cae-bce9-dfc56b4ec4bf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:20.865582 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0fc8906e-61ca-4cae-bce9-dfc56b4ec4bf tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 200 len: 1323 microversion: 2.1 time: 0.816153 Aug 27 02:48:20.866615 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1964/3652] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:20 2022] GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 1323 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:48:20.899180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-291c91e7-8ce9-48ac-a7d1-39d6336bb39e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1530848202"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:20.911897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-291c91e7-8ce9-48ac-a7d1-39d6336bb39e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:20.928902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-291c91e7-8ce9-48ac-a7d1-39d6336bb39e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.932352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-291c91e7-8ce9-48ac-a7d1-39d6336bb39e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.933809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-291c91e7-8ce9-48ac-a7d1-39d6336bb39e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:20.936221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-291c91e7-8ce9-48ac-a7d1-39d6336bb39e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:20.937860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-291c91e7-8ce9-48ac-a7d1-39d6336bb39e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:20.939778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-291c91e7-8ce9-48ac-a7d1-39d6336bb39e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:21.051253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-94cc2776-022a-4ec8-bb17-709b8ca84cb5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:21.062786 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-94cc2776-022a-4ec8-bb17-709b8ca84cb5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1317 microversion: 2.1 time: 0.270331 Aug 27 02:48:21.079813 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1689/3653] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:20 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:21.089852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2199209-c65e-41cd-b4e6-3677f910ed57 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:21.090665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e2199209-c65e-41cd-b4e6-3677f910ed57 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:21.104218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2199209-c65e-41cd-b4e6-3677f910ed57 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:21.104718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2199209-c65e-41cd-b4e6-3677f910ed57 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:21.105160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2199209-c65e-41cd-b4e6-3677f910ed57 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:21.105925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2199209-c65e-41cd-b4e6-3677f910ed57 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:21.111300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2199209-c65e-41cd-b4e6-3677f910ed57 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:21.112586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2199209-c65e-41cd-b4e6-3677f910ed57 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:21.383703 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-291c91e7-8ce9-48ac-a7d1-39d6336bb39e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "POST /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32/action" status: 202 len: 0 microversion: 2.1 time: 0.512810 Aug 27 02:48:21.400138 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1965/3654] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:48:20 2022] POST /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 02:48:21.415647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7f760ff1-da52-405f-952c-f28c5af8584e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '.version_select at 0x7f4d2a279820>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:21.547791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e2199209-c65e-41cd-b4e6-3677f910ed57 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:21.593708 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e2199209-c65e-41cd-b4e6-3677f910ed57 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1312 microversion: 2.1 time: 0.510032 Aug 27 02:48:21.625734 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1690/3655] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:21 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1312 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:21.712800 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7f760ff1-da52-405f-952c-f28c5af8584e tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "DELETE /compute/v2.1/images/3b064ca9-3148-446c-be4d-769e3a585936" status: 204 len: 0 microversion: 2.1 time: 0.309719 Aug 27 02:48:21.721763 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1966/3656] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:21 2022] DELETE /compute/v2.1/images/3b064ca9-3148-446c-be4d-769e3a585936 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:48:21.727058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4eea1f2f-313e-4c80-8a3a-03c6f721c6eb tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '.version_select at 0x7f4d2a57e9d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:21.777263 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-4eea1f2f-313e-4c80-8a3a-03c6f721c6eb tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] HTTP exception thrown: Image not found. Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4eea1f2f-313e-4c80-8a3a-03c6f721c6eb tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/images/3b064ca9-3148-446c-be4d-769e3a585936 HTTP/1.1 Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: exception: Image not found. Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '3b064ca9-3148-446c-be4d-769e3a585936'} Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3b064ca9-3148-446c-be4d-769e3a585936 Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:48:21.780388 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3b064ca9-3148-446c-be4d-769e3a585936 could not be found. Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4eea1f2f-313e-4c80-8a3a-03c6f721c6eb tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 404 to user: Image not found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4eea1f2f-313e-4c80-8a3a-03c6f721c6eb tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/images/3b064ca9-3148-446c-be4d-769e3a585936" status: 404 len: 62 microversion: 2.1 time: 0.061393 Aug 27 02:48:21.787743 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1691/3657] 10.222.0.99 () {58 vars in 1233 bytes} [Sat Aug 27 02:48:21 2022] GET /compute/v2.1/images/3b064ca9-3148-446c-be4d-769e3a585936 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:48:21.800905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad302088-1447-4d63-87f2-c56589129856 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:21.802266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ad302088-1447-4d63-87f2-c56589129856 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:21.807000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-26dc4496-716c-40ee-9cec-96f136838a84 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:21.810564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26dc4496-716c-40ee-9cec-96f136838a84 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:21.811199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad302088-1447-4d63-87f2-c56589129856 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:21.811414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad302088-1447-4d63-87f2-c56589129856 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:21.811779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad302088-1447-4d63-87f2-c56589129856 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:21.812502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad302088-1447-4d63-87f2-c56589129856 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:21.816792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad302088-1447-4d63-87f2-c56589129856 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:21.817274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad302088-1447-4d63-87f2-c56589129856 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:21.827492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26dc4496-716c-40ee-9cec-96f136838a84 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:21.830118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26dc4496-716c-40ee-9cec-96f136838a84 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:21.832797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26dc4496-716c-40ee-9cec-96f136838a84 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:21.833923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26dc4496-716c-40ee-9cec-96f136838a84 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:21.838426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26dc4496-716c-40ee-9cec-96f136838a84 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:21.839438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26dc4496-716c-40ee-9cec-96f136838a84 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:22.228911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-26dc4496-716c-40ee-9cec-96f136838a84 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:22.238951 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-26dc4496-716c-40ee-9cec-96f136838a84 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1533 microversion: 2.1 time: 0.444846 Aug 27 02:48:22.239602 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1692/3658] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:21 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1533 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:22.245927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf5b7433-738b-47f4-8342-259bdf4f2ff6 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:22.247219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf5b7433-738b-47f4-8342-259bdf4f2ff6 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:22.260008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5b7433-738b-47f4-8342-259bdf4f2ff6 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:22.260519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5b7433-738b-47f4-8342-259bdf4f2ff6 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:22.261164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5b7433-738b-47f4-8342-259bdf4f2ff6 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:22.262153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5b7433-738b-47f4-8342-259bdf4f2ff6 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:22.262619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5b7433-738b-47f4-8342-259bdf4f2ff6 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:22.263061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5b7433-738b-47f4-8342-259bdf4f2ff6 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:22.908890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad302088-1447-4d63-87f2-c56589129856 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:22.924927 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad302088-1447-4d63-87f2-c56589129856 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1316 microversion: 2.1 time: 1.136657 Aug 27 02:48:22.926473 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1967/3659] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:21 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1316 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:22.932282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a61fef02-1a2b-41cb-a1e1-c1fa43590111 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:22.941497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a61fef02-1a2b-41cb-a1e1-c1fa43590111 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:22.952020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a61fef02-1a2b-41cb-a1e1-c1fa43590111 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:22.956128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a61fef02-1a2b-41cb-a1e1-c1fa43590111 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:22.956713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a61fef02-1a2b-41cb-a1e1-c1fa43590111 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:22.957612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a61fef02-1a2b-41cb-a1e1-c1fa43590111 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:22.958244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a61fef02-1a2b-41cb-a1e1-c1fa43590111 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:22.959784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a61fef02-1a2b-41cb-a1e1-c1fa43590111 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:22.969520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf5b7433-738b-47f4-8342-259bdf4f2ff6 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:22.994700 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf5b7433-738b-47f4-8342-259bdf4f2ff6 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 200 len: 1323 microversion: 2.1 time: 0.749801 Aug 27 02:48:22.998617 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1693/3660] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:22 2022] GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 1323 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:23.027192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b5dd5dd4-f752-47d5-b197-609bf6bbc1ab tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:23.031808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b5dd5dd4-f752-47d5-b197-609bf6bbc1ab tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:23.052476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dd4-f752-47d5-b197-609bf6bbc1ab tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:23.053897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dd4-f752-47d5-b197-609bf6bbc1ab tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:23.056602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dd4-f752-47d5-b197-609bf6bbc1ab tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:23.062253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dd4-f752-47d5-b197-609bf6bbc1ab tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:23.064930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dd4-f752-47d5-b197-609bf6bbc1ab tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:23.066233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5dd5dd4-f752-47d5-b197-609bf6bbc1ab tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:23.176559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:23.502375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a61fef02-1a2b-41cb-a1e1-c1fa43590111 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:23.515003 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a61fef02-1a2b-41cb-a1e1-c1fa43590111 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1317 microversion: 2.1 time: 0.587098 Aug 27 02:48:23.524261 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1968/3661] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:22 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:23.529736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7d245727-bdd8-44fd-8a1c-45269085a1f2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:23.530719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d245727-bdd8-44fd-8a1c-45269085a1f2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:23.544871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d245727-bdd8-44fd-8a1c-45269085a1f2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:23.545466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d245727-bdd8-44fd-8a1c-45269085a1f2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:23.548518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d245727-bdd8-44fd-8a1c-45269085a1f2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:23.549368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d245727-bdd8-44fd-8a1c-45269085a1f2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:23.550008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d245727-bdd8-44fd-8a1c-45269085a1f2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:23.551058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d245727-bdd8-44fd-8a1c-45269085a1f2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:23.980125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d245727-bdd8-44fd-8a1c-45269085a1f2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:23.994848 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7d245727-bdd8-44fd-8a1c-45269085a1f2 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1539 microversion: 2.1 time: 0.469071 Aug 27 02:48:23.996091 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1969/3662] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:23 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1539 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:24.013942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50455524-b21d-4a69-9092-4c6f80dbd877 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:24.015030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-50455524-b21d-4a69-9092-4c6f80dbd877 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:24.029121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50455524-b21d-4a69-9092-4c6f80dbd877 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:24.030027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50455524-b21d-4a69-9092-4c6f80dbd877 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:24.030932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50455524-b21d-4a69-9092-4c6f80dbd877 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:24.032965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50455524-b21d-4a69-9092-4c6f80dbd877 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:24.034092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50455524-b21d-4a69-9092-4c6f80dbd877 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:24.034744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50455524-b21d-4a69-9092-4c6f80dbd877 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:24.098927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b5dd5dd4-f752-47d5-b197-609bf6bbc1ab tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:24.122326 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b5dd5dd4-f752-47d5-b197-609bf6bbc1ab tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1333 microversion: 2.1 time: 1.118979 Aug 27 02:48:24.123618 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1694/3663] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:22 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1333 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:24.129566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-09e4a3f6-07a9-4f94-a9f7-4eeee06caaa2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:24.145198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-09e4a3f6-07a9-4f94-a9f7-4eeee06caaa2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:24.183534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09e4a3f6-07a9-4f94-a9f7-4eeee06caaa2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:24.184837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09e4a3f6-07a9-4f94-a9f7-4eeee06caaa2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:24.190968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09e4a3f6-07a9-4f94-a9f7-4eeee06caaa2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:24.192674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09e4a3f6-07a9-4f94-a9f7-4eeee06caaa2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:24.193867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09e4a3f6-07a9-4f94-a9f7-4eeee06caaa2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:24.195060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09e4a3f6-07a9-4f94-a9f7-4eeee06caaa2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:24.723895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-09e4a3f6-07a9-4f94-a9f7-4eeee06caaa2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:24.730642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-50455524-b21d-4a69-9092-4c6f80dbd877 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:24.735213 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-09e4a3f6-07a9-4f94-a9f7-4eeee06caaa2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 200 len: 1520 microversion: 2.1 time: 0.608197 Aug 27 02:48:24.751228 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1695/3664] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:24 2022] GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 1520 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:24.751228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7527dcf6-7047-4219-bda0-de1b18dcfef0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:24.751228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7527dcf6-7047-4219-bda0-de1b18dcfef0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:24.778633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7527dcf6-7047-4219-bda0-de1b18dcfef0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:24.778633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7527dcf6-7047-4219-bda0-de1b18dcfef0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:24.778633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7527dcf6-7047-4219-bda0-de1b18dcfef0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:24.778633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7527dcf6-7047-4219-bda0-de1b18dcfef0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:24.778633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7527dcf6-7047-4219-bda0-de1b18dcfef0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:24.782876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7527dcf6-7047-4219-bda0-de1b18dcfef0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:24.803808 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-50455524-b21d-4a69-9092-4c6f80dbd877 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1316 microversion: 2.1 time: 0.805949 Aug 27 02:48:24.814073 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1970/3665] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:23 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1316 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:24.836034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a65fde3a-7b8f-4385-bccd-158eacacd81e req-ffa7a6de-7a20-4ff1-82af-7987c6b57459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b7bec6-d7a4-4b51-b360-a710046d55e8", "name": "network-vif-plugged", "status": "completed", "tag": "f6e3e061-ec81-4e02-a22d-21144052c815"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:24.867827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a65fde3a-7b8f-4385-bccd-158eacacd81e req-ffa7a6de-7a20-4ff1-82af-7987c6b57459 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:24.869597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a65fde3a-7b8f-4385-bccd-158eacacd81e req-ffa7a6de-7a20-4ff1-82af-7987c6b57459 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:24.870999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a65fde3a-7b8f-4385-bccd-158eacacd81e req-ffa7a6de-7a20-4ff1-82af-7987c6b57459 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:24.884570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:24.916484 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a65fde3a-7b8f-4385-bccd-158eacacd81e req-ffa7a6de-7a20-4ff1-82af-7987c6b57459 service nova] Creating event network-vif-plugged:f6e3e061-ec81-4e02-a22d-21144052c815 for instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 on n-h2-852084-5 Aug 27 02:48:24.936423 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a65fde3a-7b8f-4385-bccd-158eacacd81e req-ffa7a6de-7a20-4ff1-82af-7987c6b57459 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119569 Aug 27 02:48:24.938724 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1971/3666] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:24.954704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.158"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:24.961479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:24.974991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:24.976386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:24.978059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:24.979734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:24.980972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:24.982658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:25.072245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "refresh_cache-729c813c-9a69-418d-a6d8-d9f923b1c4f2" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:48:25.074148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquired lock "refresh_cache-729c813c-9a69-418d-a6d8-d9f923b1c4f2" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:48:25.439144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7527dcf6-7047-4219-bda0-de1b18dcfef0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:25.456716 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7527dcf6-7047-4219-bda0-de1b18dcfef0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1317 microversion: 2.1 time: 0.717485 Aug 27 02:48:25.458022 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1696/3667] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:24 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:25.475323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e24e2260-02fa-48f4-85ca-c1f82d48ab89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:25.476291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e24e2260-02fa-48f4-85ca-c1f82d48ab89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:25.493720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e24e2260-02fa-48f4-85ca-c1f82d48ab89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:25.494514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e24e2260-02fa-48f4-85ca-c1f82d48ab89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:25.495211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e24e2260-02fa-48f4-85ca-c1f82d48ab89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:25.496826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e24e2260-02fa-48f4-85ca-c1f82d48ab89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:25.498122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e24e2260-02fa-48f4-85ca-c1f82d48ab89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:25.498781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e24e2260-02fa-48f4-85ca-c1f82d48ab89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:25.861001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e24e2260-02fa-48f4-85ca-c1f82d48ab89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:25.874456 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e24e2260-02fa-48f4-85ca-c1f82d48ab89 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1521 microversion: 2.1 time: 0.415074 Aug 27 02:48:25.887114 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1697/3668] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:25 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:25.914731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0bc11fc7-507a-4b5a-a88c-ff7704f7c3ff tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:25.917060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0bc11fc7-507a-4b5a-a88c-ff7704f7c3ff tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:25.937325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc11fc7-507a-4b5a-a88c-ff7704f7c3ff tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:25.940020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc11fc7-507a-4b5a-a88c-ff7704f7c3ff tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:25.941220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc11fc7-507a-4b5a-a88c-ff7704f7c3ff tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:25.947263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc11fc7-507a-4b5a-a88c-ff7704f7c3ff tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:25.950762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc11fc7-507a-4b5a-a88c-ff7704f7c3ff tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:25.952729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bc11fc7-507a-4b5a-a88c-ff7704f7c3ff tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:26.103570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=7 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:26.530413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0bc11fc7-507a-4b5a-a88c-ff7704f7c3ff tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:26.554802 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0bc11fc7-507a-4b5a-a88c-ff7704f7c3ff tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.665072 Aug 27 02:48:26.556443 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1698/3669] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:25 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:26.569176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-265d5de0-e7d5-4e35-afc6-102f556ea97f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:26.572493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-265d5de0-e7d5-4e35-afc6-102f556ea97f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:26.595142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-265d5de0-e7d5-4e35-afc6-102f556ea97f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:26.596450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-265d5de0-e7d5-4e35-afc6-102f556ea97f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:26.597432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-265d5de0-e7d5-4e35-afc6-102f556ea97f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:26.599134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-265d5de0-e7d5-4e35-afc6-102f556ea97f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:26.601153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-265d5de0-e7d5-4e35-afc6-102f556ea97f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:26.604215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-265d5de0-e7d5-4e35-afc6-102f556ea97f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:27.092707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-265d5de0-e7d5-4e35-afc6-102f556ea97f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:27.115925 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-265d5de0-e7d5-4e35-afc6-102f556ea97f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1316 microversion: 2.1 time: 0.555918 Aug 27 02:48:27.117605 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1699/3670] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:26 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1316 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:27.128818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2ed3e06-4640-436c-b5c6-260da78a281f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:27.148508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c2ed3e06-4640-436c-b5c6-260da78a281f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:27.161860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ed3e06-4640-436c-b5c6-260da78a281f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:27.163313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ed3e06-4640-436c-b5c6-260da78a281f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:27.164523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ed3e06-4640-436c-b5c6-260da78a281f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:27.166815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ed3e06-4640-436c-b5c6-260da78a281f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:27.168048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ed3e06-4640-436c-b5c6-260da78a281f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:27.169207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2ed3e06-4640-436c-b5c6-260da78a281f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:27.226021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c2ed3e06-4640-436c-b5c6-260da78a281f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:48:27.591275 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c2ed3e06-4640-436c-b5c6-260da78a281f tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "DELETE /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 204 len: 0 microversion: 2.1 time: 0.469208 Aug 27 02:48:27.598864 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1700/3671] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:48:27 2022] DELETE /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:48:27.632584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb1a6ec8-556c-4d53-b440-08caf38e34c9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:27.637081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb1a6ec8-556c-4d53-b440-08caf38e34c9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:27.654810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb1a6ec8-556c-4d53-b440-08caf38e34c9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:27.656318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb1a6ec8-556c-4d53-b440-08caf38e34c9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:27.659690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb1a6ec8-556c-4d53-b440-08caf38e34c9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:27.662514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb1a6ec8-556c-4d53-b440-08caf38e34c9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:27.664017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb1a6ec8-556c-4d53-b440-08caf38e34c9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:27.672924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb1a6ec8-556c-4d53-b440-08caf38e34c9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:28.437366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb1a6ec8-556c-4d53-b440-08caf38e34c9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:28.459811 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb1a6ec8-556c-4d53-b440-08caf38e34c9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1505 microversion: 2.1 time: 0.853281 Aug 27 02:48:28.460896 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1701/3672] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:27 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1505 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:28.513755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6d0cb7a4-711e-4250-8fc3-0ea0cf74aad3 req-275a25dd-3648-4e64-8393-e6ff918a1e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7003020-aea4-4c84-b929-b7fb8cb19aae", "tag": "580a5330-5c6c-41c9-bdbd-37408ae5ab4a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:28.531935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6d0cb7a4-711e-4250-8fc3-0ea0cf74aad3 req-275a25dd-3648-4e64-8393-e6ff918a1e5c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:28.533420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6d0cb7a4-711e-4250-8fc3-0ea0cf74aad3 req-275a25dd-3648-4e64-8393-e6ff918a1e5c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:28.534524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6d0cb7a4-711e-4250-8fc3-0ea0cf74aad3 req-275a25dd-3648-4e64-8393-e6ff918a1e5c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:28.557120 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6d0cb7a4-711e-4250-8fc3-0ea0cf74aad3 req-275a25dd-3648-4e64-8393-e6ff918a1e5c service nova] Creating event network-changed:580a5330-5c6c-41c9-bdbd-37408ae5ab4a for instance f7003020-aea4-4c84-b929-b7fb8cb19aae on n-h1-852084-5 Aug 27 02:48:28.567426 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6d0cb7a4-711e-4250-8fc3-0ea0cf74aad3 req-275a25dd-3648-4e64-8393-e6ff918a1e5c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070164 Aug 27 02:48:28.569746 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1702/3673] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:28.583084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1772b1a-7f39-457a-b1cc-abf225aabf2c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:28.584968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d1772b1a-7f39-457a-b1cc-abf225aabf2c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:28.600213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1772b1a-7f39-457a-b1cc-abf225aabf2c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:28.601257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1772b1a-7f39-457a-b1cc-abf225aabf2c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:28.603711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1772b1a-7f39-457a-b1cc-abf225aabf2c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:28.608230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1772b1a-7f39-457a-b1cc-abf225aabf2c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:28.609774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1772b1a-7f39-457a-b1cc-abf225aabf2c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:28.610685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1772b1a-7f39-457a-b1cc-abf225aabf2c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:29.171939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1772b1a-7f39-457a-b1cc-abf225aabf2c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:29.234833 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1772b1a-7f39-457a-b1cc-abf225aabf2c tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1527 microversion: 2.1 time: 0.656398 Aug 27 02:48:29.239874 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1703/3674] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:28 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1527 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:29.269325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b255f500-92c9-49fb-9e47-d1250255d2d9 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:29.275896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b255f500-92c9-49fb-9e47-d1250255d2d9 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:29.307937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b255f500-92c9-49fb-9e47-d1250255d2d9 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:29.309452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b255f500-92c9-49fb-9e47-d1250255d2d9 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:29.310293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b255f500-92c9-49fb-9e47-d1250255d2d9 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:29.311689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b255f500-92c9-49fb-9e47-d1250255d2d9 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:29.312378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b255f500-92c9-49fb-9e47-d1250255d2d9 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:29.318626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b255f500-92c9-49fb-9e47-d1250255d2d9 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:29.738837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b255f500-92c9-49fb-9e47-d1250255d2d9 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:29.752748 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b255f500-92c9-49fb-9e47-d1250255d2d9 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.510602 Aug 27 02:48:29.756107 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1704/3675] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:29 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:29.770436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7e8105e-577f-4c70-88ff-db978fba4666 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:29.771524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7e8105e-577f-4c70-88ff-db978fba4666 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:29.793609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7e8105e-577f-4c70-88ff-db978fba4666 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:29.799464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7e8105e-577f-4c70-88ff-db978fba4666 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:29.801595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7e8105e-577f-4c70-88ff-db978fba4666 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:29.802899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7e8105e-577f-4c70-88ff-db978fba4666 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:29.803615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7e8105e-577f-4c70-88ff-db978fba4666 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:29.804679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7e8105e-577f-4c70-88ff-db978fba4666 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:30.303035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7e8105e-577f-4c70-88ff-db978fba4666 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:30.331769 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7e8105e-577f-4c70-88ff-db978fba4666 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1316 microversion: 2.1 time: 0.574149 Aug 27 02:48:30.332380 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1705/3676] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:29 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:30.350507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d7755302-57f4-4e01-bd55-ec2427a705e5 req-676ce055-1c48-42c5-942c-6c453ed42300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a94dab-d39c-4da5-9e11-1f90cbe1ed32", "name": "network-vif-plugged", "status": "completed", "tag": "c13ec949-4599-4041-afca-f7ce67428f9c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:30.362320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d7755302-57f4-4e01-bd55-ec2427a705e5 req-676ce055-1c48-42c5-942c-6c453ed42300 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:30.363138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d7755302-57f4-4e01-bd55-ec2427a705e5 req-676ce055-1c48-42c5-942c-6c453ed42300 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:30.363772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d7755302-57f4-4e01-bd55-ec2427a705e5 req-676ce055-1c48-42c5-942c-6c453ed42300 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:30.391860 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d7755302-57f4-4e01-bd55-ec2427a705e5 req-676ce055-1c48-42c5-942c-6c453ed42300 service nova] Creating event network-vif-plugged:c13ec949-4599-4041-afca-f7ce67428f9c for instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 on n-h1-852084-5 Aug 27 02:48:30.403660 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d7755302-57f4-4e01-bd55-ec2427a705e5 req-676ce055-1c48-42c5-942c-6c453ed42300 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056741 Aug 27 02:48:30.404578 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1706/3677] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:30.415277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-312ba2d1-fa48-4e9e-b811-6ac3bda8b52b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:30.422157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-312ba2d1-fa48-4e9e-b811-6ac3bda8b52b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:30.439215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-312ba2d1-fa48-4e9e-b811-6ac3bda8b52b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:30.440005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-312ba2d1-fa48-4e9e-b811-6ac3bda8b52b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:30.440650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-312ba2d1-fa48-4e9e-b811-6ac3bda8b52b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:30.441576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-312ba2d1-fa48-4e9e-b811-6ac3bda8b52b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:30.443967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-312ba2d1-fa48-4e9e-b811-6ac3bda8b52b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:30.444659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-312ba2d1-fa48-4e9e-b811-6ac3bda8b52b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:30.514223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-312ba2d1-fa48-4e9e-b811-6ac3bda8b52b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:48:30.749061 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-312ba2d1-fa48-4e9e-b811-6ac3bda8b52b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 204 len: 0 microversion: 2.1 time: 0.341937 Aug 27 02:48:30.750296 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1707/3678] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:48:30 2022] DELETE /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:48:30.769485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-52f0c2fb-99db-4d5e-9e30-419f8854bc95 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:30.770800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-52f0c2fb-99db-4d5e-9e30-419f8854bc95 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:30.797156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f0c2fb-99db-4d5e-9e30-419f8854bc95 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:30.799167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f0c2fb-99db-4d5e-9e30-419f8854bc95 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:30.799630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f0c2fb-99db-4d5e-9e30-419f8854bc95 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:30.802869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f0c2fb-99db-4d5e-9e30-419f8854bc95 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:30.803412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f0c2fb-99db-4d5e-9e30-419f8854bc95 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:30.803863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f0c2fb-99db-4d5e-9e30-419f8854bc95 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:31.110830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-52f0c2fb-99db-4d5e-9e30-419f8854bc95 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:31.114909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:31.127453 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-52f0c2fb-99db-4d5e-9e30-419f8854bc95 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1485 microversion: 2.1 time: 0.374962 Aug 27 02:48:31.142235 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1708/3679] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:30 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1485 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:31.148421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6ff2a8fc-2ec9-4810-8094-d7c1fc661d25 req-62d93f55-1f5a-408b-af89-787f7313fa30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6", "tag": "bf7e1285-ec6b-4d91-818f-c74ed2d02185"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:31.163337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6ff2a8fc-2ec9-4810-8094-d7c1fc661d25 req-62d93f55-1f5a-408b-af89-787f7313fa30 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:31.164319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6ff2a8fc-2ec9-4810-8094-d7c1fc661d25 req-62d93f55-1f5a-408b-af89-787f7313fa30 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:31.165094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6ff2a8fc-2ec9-4810-8094-d7c1fc661d25 req-62d93f55-1f5a-408b-af89-787f7313fa30 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:31.179504 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6ff2a8fc-2ec9-4810-8094-d7c1fc661d25 req-62d93f55-1f5a-408b-af89-787f7313fa30 service nova] Creating event network-changed:bf7e1285-ec6b-4d91-818f-c74ed2d02185 for instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 on n-h2-852084-5 Aug 27 02:48:31.186278 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6ff2a8fc-2ec9-4810-8094-d7c1fc661d25 req-62d93f55-1f5a-408b-af89-787f7313fa30 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042211 Aug 27 02:48:31.187328 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1709/3680] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:31.194404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f2f185b0-7fd0-4c27-8d96-d5453c3e8a3c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:31.195488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f2f185b0-7fd0-4c27-8d96-d5453c3e8a3c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:31.204150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2f185b0-7fd0-4c27-8d96-d5453c3e8a3c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:31.205110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2f185b0-7fd0-4c27-8d96-d5453c3e8a3c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:31.205902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2f185b0-7fd0-4c27-8d96-d5453c3e8a3c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:31.206955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2f185b0-7fd0-4c27-8d96-d5453c3e8a3c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:31.207682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2f185b0-7fd0-4c27-8d96-d5453c3e8a3c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:31.208525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2f185b0-7fd0-4c27-8d96-d5453c3e8a3c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:31.641095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f2f185b0-7fd0-4c27-8d96-d5453c3e8a3c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:31.649826 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f2f185b0-7fd0-4c27-8d96-d5453c3e8a3c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1511 microversion: 2.1 time: 0.460247 Aug 27 02:48:31.665381 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1710/3681] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:31 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1511 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:31.673058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-85347583-b249-4774-9856-162e98f6c140 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:31.674128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-85347583-b249-4774-9856-162e98f6c140 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:31.683183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85347583-b249-4774-9856-162e98f6c140 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:31.684075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85347583-b249-4774-9856-162e98f6c140 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:31.684754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85347583-b249-4774-9856-162e98f6c140 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:31.685780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85347583-b249-4774-9856-162e98f6c140 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:31.686676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85347583-b249-4774-9856-162e98f6c140 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:31.687588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85347583-b249-4774-9856-162e98f6c140 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:32.000561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-85347583-b249-4774-9856-162e98f6c140 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:32.019067 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-85347583-b249-4774-9856-162e98f6c140 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.351952 Aug 27 02:48:32.020018 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1711/3682] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:31 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:32.025652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0cf8e708-0edd-4332-89a2-07fe7104b6d3 req-8299a6c7-0ff4-4195-b3bc-2c40d3eb3c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a94dab-d39c-4da5-9e11-1f90cbe1ed32", "name": "network-vif-deleted", "tag": "c13ec949-4599-4041-afca-f7ce67428f9c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:32.036058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0cf8e708-0edd-4332-89a2-07fe7104b6d3 req-8299a6c7-0ff4-4195-b3bc-2c40d3eb3c28 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:32.036817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0cf8e708-0edd-4332-89a2-07fe7104b6d3 req-8299a6c7-0ff4-4195-b3bc-2c40d3eb3c28 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:32.037415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0cf8e708-0edd-4332-89a2-07fe7104b6d3 req-8299a6c7-0ff4-4195-b3bc-2c40d3eb3c28 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:32.076791 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0cf8e708-0edd-4332-89a2-07fe7104b6d3 req-8299a6c7-0ff4-4195-b3bc-2c40d3eb3c28 service nova] Creating event network-vif-deleted:c13ec949-4599-4041-afca-f7ce67428f9c for instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 on n-h1-852084-5 Aug 27 02:48:32.085446 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0cf8e708-0edd-4332-89a2-07fe7104b6d3 req-8299a6c7-0ff4-4195-b3bc-2c40d3eb3c28 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063692 Aug 27 02:48:32.089694 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1712/3683] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:32.101327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1cc7c28b-f0d7-4614-88af-5508bc04f64c tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:32.104620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1cc7c28b-f0d7-4614-88af-5508bc04f64c tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:32.120471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cc7c28b-f0d7-4614-88af-5508bc04f64c tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:32.123263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cc7c28b-f0d7-4614-88af-5508bc04f64c tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:32.124077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cc7c28b-f0d7-4614-88af-5508bc04f64c tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:32.125163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cc7c28b-f0d7-4614-88af-5508bc04f64c tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:32.127779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cc7c28b-f0d7-4614-88af-5508bc04f64c tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:32.129375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cc7c28b-f0d7-4614-88af-5508bc04f64c tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:32.430634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Building network info cache for instance {{(pid=122488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:48:32.607406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1cc7c28b-f0d7-4614-88af-5508bc04f64c tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:32.635058 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1cc7c28b-f0d7-4614-88af-5508bc04f64c tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1316 microversion: 2.1 time: 0.541278 Aug 27 02:48:32.641694 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1713/3684] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:32 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:32.660047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:32.663723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:32.692167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:32.692167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:32.692167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:32.693396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:32.697124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:32.703513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:32.822414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:32.823242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:32.824532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:32.825639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lazy-loading 'fault' on Instance uuid c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:48:32.906283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:32.933705 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-088a493a-315f-4c55-b05e-febddb127652 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 200 len: 1314 microversion: 2.1 time: 0.289071 Aug 27 02:48:32.936892 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1714/3685] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:32 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:32.947874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d71c1f0f-b6e4-4cf8-82fd-fe01bdb443fe tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:32.949867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d71c1f0f-b6e4-4cf8-82fd-fe01bdb443fe tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:32.965981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d71c1f0f-b6e4-4cf8-82fd-fe01bdb443fe tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:32.968655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d71c1f0f-b6e4-4cf8-82fd-fe01bdb443fe tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:32.970600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d71c1f0f-b6e4-4cf8-82fd-fe01bdb443fe tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:32.973027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d71c1f0f-b6e4-4cf8-82fd-fe01bdb443fe tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:32.974528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d71c1f0f-b6e4-4cf8-82fd-fe01bdb443fe tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:32.975977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d71c1f0f-b6e4-4cf8-82fd-fe01bdb443fe tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:33.577923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d71c1f0f-b6e4-4cf8-82fd-fe01bdb443fe tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:33.613071 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d71c1f0f-b6e4-4cf8-82fd-fe01bdb443fe tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 200 len: 1511 microversion: 2.1 time: 0.673647 Aug 27 02:48:33.614246 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1715/3686] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:32 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 1511 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:33.624314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1e22699-cf10-49e2-af73-1e0eec5023a8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:33.636233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d1e22699-cf10-49e2-af73-1e0eec5023a8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:33.650792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1e22699-cf10-49e2-af73-1e0eec5023a8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:33.651936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1e22699-cf10-49e2-af73-1e0eec5023a8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:33.652606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1e22699-cf10-49e2-af73-1e0eec5023a8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:33.654195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1e22699-cf10-49e2-af73-1e0eec5023a8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:33.665941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1e22699-cf10-49e2-af73-1e0eec5023a8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:33.667034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1e22699-cf10-49e2-af73-1e0eec5023a8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:34.313407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1e22699-cf10-49e2-af73-1e0eec5023a8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:34.330861 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1e22699-cf10-49e2-af73-1e0eec5023a8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.714767 Aug 27 02:48:34.347174 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1716/3687] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:33 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:34.355533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-b0beaed2-6539-4be4-a295-bbd461579069 req-8045cbbd-648d-4007-adbb-d2caafb8ffd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729c813c-9a69-418d-a6d8-d9f923b1c4f2", "tag": "00c7f942-8e70-4330-89b9-f94a286f91c8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:34.373793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b0beaed2-6539-4be4-a295-bbd461579069 req-8045cbbd-648d-4007-adbb-d2caafb8ffd5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:34.374505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b0beaed2-6539-4be4-a295-bbd461579069 req-8045cbbd-648d-4007-adbb-d2caafb8ffd5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:34.375119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b0beaed2-6539-4be4-a295-bbd461579069 req-8045cbbd-648d-4007-adbb-d2caafb8ffd5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:34.401927 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-b0beaed2-6539-4be4-a295-bbd461579069 req-8045cbbd-648d-4007-adbb-d2caafb8ffd5 service nova] Creating event network-changed:00c7f942-8e70-4330-89b9-f94a286f91c8 for instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 on n-h2-852084-5 Aug 27 02:48:34.414381 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-b0beaed2-6539-4be4-a295-bbd461579069 req-8045cbbd-648d-4007-adbb-d2caafb8ffd5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064738 Aug 27 02:48:34.416931 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1717/3688] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:34.433727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b49e6249-3ff4-438b-8388-49a500695d31 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:34.438136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b49e6249-3ff4-438b-8388-49a500695d31 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:34.445624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:34.454118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49e6249-3ff4-438b-8388-49a500695d31 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:34.454525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49e6249-3ff4-438b-8388-49a500695d31 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:34.455262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49e6249-3ff4-438b-8388-49a500695d31 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:34.458300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49e6249-3ff4-438b-8388-49a500695d31 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:34.459707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49e6249-3ff4-438b-8388-49a500695d31 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:34.461524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49e6249-3ff4-438b-8388-49a500695d31 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:34.899292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b49e6249-3ff4-438b-8388-49a500695d31 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:34.919380 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b49e6249-3ff4-438b-8388-49a500695d31 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1316 microversion: 2.1 time: 0.495956 Aug 27 02:48:34.932380 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1718/3689] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:34 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:34.932380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:34.932824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:34.962005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:34.964273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:34.965330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:34.966317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:34.966979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:34.967781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:34.969397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=43 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:34.989457 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] HTTP exception thrown: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 HTTP/1.1 Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'c5a94dab-d39c-4da5-9e11-1f90cbe1ed32'} Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:34.993023 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:34.998346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:34.998346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:34.998346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:34.998346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:34.998346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:34.998346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:34.998346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:48:34.998346 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:35.000612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 404 to user: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:35.001721 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-43d5d287-99de-41d3-9906-9a78cf704df5 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 404 len: 111 microversion: 2.1 time: 0.078897 Aug 27 02:48:35.002675 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1719/3690] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:34 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:48:35.010697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7b0e0c55-90af-46e1-86c9-42412e217172 req-4349b7a6-e0ba-4424-b223-43585747d2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b7bec6-d7a4-4b51-b360-a710046d55e8", "name": "network-vif-deleted", "tag": "f6e3e061-ec81-4e02-a22d-21144052c815"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:35.029458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7b0e0c55-90af-46e1-86c9-42412e217172 req-4349b7a6-e0ba-4424-b223-43585747d2ac service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:35.033151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7b0e0c55-90af-46e1-86c9-42412e217172 req-4349b7a6-e0ba-4424-b223-43585747d2ac service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:35.035110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7b0e0c55-90af-46e1-86c9-42412e217172 req-4349b7a6-e0ba-4424-b223-43585747d2ac service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:35.069095 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7b0e0c55-90af-46e1-86c9-42412e217172 req-4349b7a6-e0ba-4424-b223-43585747d2ac service nova] Creating event network-vif-deleted:f6e3e061-ec81-4e02-a22d-21144052c815 for instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 on n-h2-852084-5 Aug 27 02:48:35.079793 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7b0e0c55-90af-46e1-86c9-42412e217172 req-4349b7a6-e0ba-4424-b223-43585747d2ac service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075144 Aug 27 02:48:35.089226 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1720/3691] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:35.101311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:35.104301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:35.120350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:35.121909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:35.123133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:35.125721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:35.128427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:35.129776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:35.170290 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 HTTP/1.1 Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'd0b7bec6-d7a4-4b51-b360-a710046d55e8'} Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:35.175803 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:35.193117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:35.193117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:35.193117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:35.193117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:35.193117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:35.193117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:48:35.193117 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:35.193117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:35.193117 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4fed0326-bc1f-4d58-998b-bbf293150507 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 404 len: 111 microversion: 2.1 time: 0.098757 Aug 27 02:48:35.193117 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1721/3692] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:35 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:48:35.205801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-96158be0-197a-464a-bee1-b59583c8697e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:35.207408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-96158be0-197a-464a-bee1-b59583c8697e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:35.218942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96158be0-197a-464a-bee1-b59583c8697e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:35.221013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96158be0-197a-464a-bee1-b59583c8697e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:35.222889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96158be0-197a-464a-bee1-b59583c8697e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:35.224584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96158be0-197a-464a-bee1-b59583c8697e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:35.225658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96158be0-197a-464a-bee1-b59583c8697e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:35.227702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96158be0-197a-464a-bee1-b59583c8697e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:35.478568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-96158be0-197a-464a-bee1-b59583c8697e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:35.488637 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-96158be0-197a-464a-bee1-b59583c8697e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.290040 Aug 27 02:48:35.490092 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1722/3693] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:35 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:35.507891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-695602377", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:35.657281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] validate_networks() for [('81160f92-d48b-40f7-aec3-0899de13d6b2', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:48:36.724155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:48:36.726407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:48:36.727928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:48:36.728904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:48:36.729929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:48:36.772923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:36.775335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:36.776769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:36.778322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:36.779095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Updating instance_info_cache with network_info: [{"id": "00c7f942-8e70-4330-89b9-f94a286f91c8", "address": "fa:16:3e:4d:c1:08", "network": {"id": "e0d9a993-a33f-4021-8fe8-2409a593643d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1342458713-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b3c9fc569ff43fc8c28ef7edeb1c62a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap00c7f942-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:48:36.781163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:36.785946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:36.802814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Releasing lock "refresh_cache-729c813c-9a69-418d-a6d8-d9f923b1c4f2" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:48:36.805559 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-59d7d09d-9968-43d8-bc2f-e6fea8557129 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "POST /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2/action" status: 202 len: 0 microversion: 2.1 time: 11.858300 Aug 27 02:48:36.809616 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1972/3694] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:48:24 2022] POST /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2/action => generated 0 bytes in 11870 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:48:36.828789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-920e05cd-01b9-4e51-afa3-8a592e973f33 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:36.829520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-920e05cd-01b9-4e51-afa3-8a592e973f33 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:36.849221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-920e05cd-01b9-4e51-afa3-8a592e973f33 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:36.849778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-920e05cd-01b9-4e51-afa3-8a592e973f33 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:36.856484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-920e05cd-01b9-4e51-afa3-8a592e973f33 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:36.857333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-920e05cd-01b9-4e51-afa3-8a592e973f33 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:36.858000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-920e05cd-01b9-4e51-afa3-8a592e973f33 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:36.859494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Getting quotas for project 9af784466d744e7fbb40d43d6b6e62c5. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:36.859944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-920e05cd-01b9-4e51-afa3-8a592e973f33 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:36.880073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Getting quotas for user 96a627797d4943e294544d084a5bf814 and project 9af784466d744e7fbb40d43d6b6e62c5. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:36.939262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:48:36.955160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:48:37.106110 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-40cff457-1db0-411d-af0e-724dc8c05374 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.613556 Aug 27 02:48:37.107711 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1723/3695] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:48:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:48:37.126076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb5787b2-673d-41cd-acad-eae442c5b5da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb5787b2-673d-41cd-acad-eae442c5b5da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 163 Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": 12345, "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 12345 Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:48:37.139449 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:37.153224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb5787b2-673d-41cd-acad-eae442c5b5da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:37.159591 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb5787b2-673d-41cd-acad-eae442c5b5da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.049038 Aug 27 02:48:37.162342 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1724/3696] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:48:37 2022] POST /compute/v2.1/servers => generated 127 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:48:37.177493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c992541a-3d46-4c23-975f-aa052bdbc963 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:37.180759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c992541a-3d46-4c23-975f-aa052bdbc963 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:37.197896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c992541a-3d46-4c23-975f-aa052bdbc963 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:37.201308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c992541a-3d46-4c23-975f-aa052bdbc963 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:37.203483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c992541a-3d46-4c23-975f-aa052bdbc963 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:37.206820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c992541a-3d46-4c23-975f-aa052bdbc963 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:37.211256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c992541a-3d46-4c23-975f-aa052bdbc963 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:37.211256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c992541a-3d46-4c23-975f-aa052bdbc963 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:37.477489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c992541a-3d46-4c23-975f-aa052bdbc963 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:37.490126 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c992541a-3d46-4c23-975f-aa052bdbc963 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1316 microversion: 2.1 time: 0.322897 Aug 27 02:48:37.490946 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1725/3697] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:37 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:37.511786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-abdbe68e-60cf-49c9-bdc0-dc10cc2e00c0 req-bf155f35-a95d-43a6-bd68-ff820fdde659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6", "tag": "8607c35c-e3a4-4738-bb5e-bc5077916026"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:37.536180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-abdbe68e-60cf-49c9-bdc0-dc10cc2e00c0 req-bf155f35-a95d-43a6-bd68-ff820fdde659 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:37.537859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-abdbe68e-60cf-49c9-bdc0-dc10cc2e00c0 req-bf155f35-a95d-43a6-bd68-ff820fdde659 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:37.538952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-abdbe68e-60cf-49c9-bdc0-dc10cc2e00c0 req-bf155f35-a95d-43a6-bd68-ff820fdde659 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:37.601527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-920e05cd-01b9-4e51-afa3-8a592e973f33 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:37.628436 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-920e05cd-01b9-4e51-afa3-8a592e973f33 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.816227 Aug 27 02:48:37.630614 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1973/3698] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:36 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:37.633878 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-abdbe68e-60cf-49c9-bdc0-dc10cc2e00c0 req-bf155f35-a95d-43a6-bd68-ff820fdde659 service nova] Creating event network-changed:8607c35c-e3a4-4738-bb5e-bc5077916026 for instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 on n-h2-852084-5 Aug 27 02:48:37.642886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.158"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:37.660857 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-abdbe68e-60cf-49c9-bdc0-dc10cc2e00c0 req-bf155f35-a95d-43a6-bd68-ff820fdde659 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161398 Aug 27 02:48:37.662910 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1726/3699] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:37.666113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:37.683686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7c28b82e-39d6-4835-b3d3-7fa781433722 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:37.688394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7c28b82e-39d6-4835-b3d3-7fa781433722 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:37.689419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:37.702865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:37.705998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:37.712837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:37.713620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:37.714338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:37.771796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "refresh_cache-0c2ba8af-754a-4aaf-84e7-257aeb402178" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:48:37.772554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquired lock "refresh_cache-0c2ba8af-754a-4aaf-84e7-257aeb402178" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:48:37.864279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7c28b82e-39d6-4835-b3d3-7fa781433722 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:37.877414 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7c28b82e-39d6-4835-b3d3-7fa781433722 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1224 microversion: 2.1 time: 0.209410 Aug 27 02:48:37.878074 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1727/3700] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:37 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1224 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:37.917778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-093621f0-3084-422e-9fd5-246177f1a22f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:37.920955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-093621f0-3084-422e-9fd5-246177f1a22f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:37.941161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-093621f0-3084-422e-9fd5-246177f1a22f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:37.946902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-093621f0-3084-422e-9fd5-246177f1a22f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:37.948956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-093621f0-3084-422e-9fd5-246177f1a22f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:37.950259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-093621f0-3084-422e-9fd5-246177f1a22f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:37.951156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-093621f0-3084-422e-9fd5-246177f1a22f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:37.951725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-093621f0-3084-422e-9fd5-246177f1a22f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:38.676622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-093621f0-3084-422e-9fd5-246177f1a22f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:38.688086 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-093621f0-3084-422e-9fd5-246177f1a22f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.808396 Aug 27 02:48:38.694129 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1728/3701] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:37 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:38.699580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7d3fe929-e7d7-4f6e-a57d-b47763e52ba2 req-d874ce9b-6a15-4a4b-aaf1-b2c86281d7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7003020-aea4-4c84-b929-b7fb8cb19aae", "name": "network-vif-plugged", "status": "completed", "tag": "580a5330-5c6c-41c9-bdbd-37408ae5ab4a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:38.749577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7d3fe929-e7d7-4f6e-a57d-b47763e52ba2 req-d874ce9b-6a15-4a4b-aaf1-b2c86281d7ea service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:38.750419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7d3fe929-e7d7-4f6e-a57d-b47763e52ba2 req-d874ce9b-6a15-4a4b-aaf1-b2c86281d7ea service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:38.751063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7d3fe929-e7d7-4f6e-a57d-b47763e52ba2 req-d874ce9b-6a15-4a4b-aaf1-b2c86281d7ea service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:38.766074 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7d3fe929-e7d7-4f6e-a57d-b47763e52ba2 req-d874ce9b-6a15-4a4b-aaf1-b2c86281d7ea service nova] Creating event network-vif-plugged:580a5330-5c6c-41c9-bdbd-37408ae5ab4a for instance f7003020-aea4-4c84-b929-b7fb8cb19aae on n-h1-852084-5 Aug 27 02:48:38.775931 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7d3fe929-e7d7-4f6e-a57d-b47763e52ba2 req-d874ce9b-6a15-4a4b-aaf1-b2c86281d7ea service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078195 Aug 27 02:48:38.777274 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1729/3702] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:38.783726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-36167c4c-1bc6-4ab2-b9af-8e543ffaad53 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:38.785278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-36167c4c-1bc6-4ab2-b9af-8e543ffaad53 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:38.794969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36167c4c-1bc6-4ab2-b9af-8e543ffaad53 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:38.795741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36167c4c-1bc6-4ab2-b9af-8e543ffaad53 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:38.796587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36167c4c-1bc6-4ab2-b9af-8e543ffaad53 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:38.797870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36167c4c-1bc6-4ab2-b9af-8e543ffaad53 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:38.798970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36167c4c-1bc6-4ab2-b9af-8e543ffaad53 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:38.799597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36167c4c-1bc6-4ab2-b9af-8e543ffaad53 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:39.231930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-36167c4c-1bc6-4ab2-b9af-8e543ffaad53 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:39.251000 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-36167c4c-1bc6-4ab2-b9af-8e543ffaad53 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1316 microversion: 2.1 time: 0.472066 Aug 27 02:48:39.254340 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1730/3703] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:38 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:39.324952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-18cd5301-8e1c-479f-ba7c-62e2481313c1 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:39.338315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-18cd5301-8e1c-479f-ba7c-62e2481313c1 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:39.410559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18cd5301-8e1c-479f-ba7c-62e2481313c1 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:39.411392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18cd5301-8e1c-479f-ba7c-62e2481313c1 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:39.414449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18cd5301-8e1c-479f-ba7c-62e2481313c1 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:39.418043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18cd5301-8e1c-479f-ba7c-62e2481313c1 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:39.418929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18cd5301-8e1c-479f-ba7c-62e2481313c1 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:39.420777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18cd5301-8e1c-479f-ba7c-62e2481313c1 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:39.937163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-18cd5301-8e1c-479f-ba7c-62e2481313c1 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:39.968269 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-18cd5301-8e1c-479f-ba7c-62e2481313c1 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.695970 Aug 27 02:48:39.978818 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1731/3704] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:39 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:40.031077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-22b43702-5f07-4d64-a062-9adf9d5f1527 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:40.032339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-22b43702-5f07-4d64-a062-9adf9d5f1527 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:40.062045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22b43702-5f07-4d64-a062-9adf9d5f1527 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:40.063446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22b43702-5f07-4d64-a062-9adf9d5f1527 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:40.064456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22b43702-5f07-4d64-a062-9adf9d5f1527 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:40.066206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22b43702-5f07-4d64-a062-9adf9d5f1527 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:40.070344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22b43702-5f07-4d64-a062-9adf9d5f1527 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:40.077712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22b43702-5f07-4d64-a062-9adf9d5f1527 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:40.512297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-22b43702-5f07-4d64-a062-9adf9d5f1527 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:40.522492 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-22b43702-5f07-4d64-a062-9adf9d5f1527 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.525717 Aug 27 02:48:40.525706 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1732/3705] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:39 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:40.531285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a75f5409-9dde-45e2-992e-d9db74618de4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:40.532442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a75f5409-9dde-45e2-992e-d9db74618de4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:40.543502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a75f5409-9dde-45e2-992e-d9db74618de4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:40.544361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a75f5409-9dde-45e2-992e-d9db74618de4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:40.544802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a75f5409-9dde-45e2-992e-d9db74618de4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:40.545529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a75f5409-9dde-45e2-992e-d9db74618de4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:40.546224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a75f5409-9dde-45e2-992e-d9db74618de4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:40.549487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a75f5409-9dde-45e2-992e-d9db74618de4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:40.555249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:41.130437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a75f5409-9dde-45e2-992e-d9db74618de4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:41.187710 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a75f5409-9dde-45e2-992e-d9db74618de4 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1284 microversion: 2.1 time: 0.658320 Aug 27 02:48:41.250261 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1733/3706] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:40 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1284 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:41.295939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2bdb8a15-df8a-4c37-a536-f5bba65ba6e9 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:41.298135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2bdb8a15-df8a-4c37-a536-f5bba65ba6e9 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:41.320496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb8a15-df8a-4c37-a536-f5bba65ba6e9 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:41.322394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb8a15-df8a-4c37-a536-f5bba65ba6e9 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:41.326043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb8a15-df8a-4c37-a536-f5bba65ba6e9 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:41.328272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb8a15-df8a-4c37-a536-f5bba65ba6e9 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:41.329785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb8a15-df8a-4c37-a536-f5bba65ba6e9 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:41.331432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb8a15-df8a-4c37-a536-f5bba65ba6e9 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:41.927058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2bdb8a15-df8a-4c37-a536-f5bba65ba6e9 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:41.940454 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2bdb8a15-df8a-4c37-a536-f5bba65ba6e9 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1503 microversion: 2.1 time: 0.685239 Aug 27 02:48:41.965810 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1734/3707] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:41 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1503 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:41.971912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e4703203-c372-4f15-8afe-eb614cd5388b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:41.973125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e4703203-c372-4f15-8afe-eb614cd5388b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:41.989944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4703203-c372-4f15-8afe-eb614cd5388b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:41.990585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4703203-c372-4f15-8afe-eb614cd5388b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:41.991052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4703203-c372-4f15-8afe-eb614cd5388b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:41.991918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4703203-c372-4f15-8afe-eb614cd5388b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:41.992616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4703203-c372-4f15-8afe-eb614cd5388b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:41.992872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4703203-c372-4f15-8afe-eb614cd5388b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:42.395657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e4703203-c372-4f15-8afe-eb614cd5388b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:42.408495 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e4703203-c372-4f15-8afe-eb614cd5388b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.441063 Aug 27 02:48:42.409297 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1735/3708] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:41 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:42.422191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c29c6287-c06c-4ee4-a930-9c66aee468ed req-0b6d3edc-494e-4cb4-8516-b7d1a537c9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6", "tag": "44cf6fb5-e006-4840-91d8-c9247c84debd"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:42.446551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c29c6287-c06c-4ee4-a930-9c66aee468ed req-0b6d3edc-494e-4cb4-8516-b7d1a537c9f4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:42.447310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c29c6287-c06c-4ee4-a930-9c66aee468ed req-0b6d3edc-494e-4cb4-8516-b7d1a537c9f4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:42.448097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c29c6287-c06c-4ee4-a930-9c66aee468ed req-0b6d3edc-494e-4cb4-8516-b7d1a537c9f4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:42.477567 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c29c6287-c06c-4ee4-a930-9c66aee468ed req-0b6d3edc-494e-4cb4-8516-b7d1a537c9f4 service nova] Creating event network-changed:44cf6fb5-e006-4840-91d8-c9247c84debd for instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 on n-h2-852084-5 Aug 27 02:48:42.485699 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c29c6287-c06c-4ee4-a930-9c66aee468ed req-0b6d3edc-494e-4cb4-8516-b7d1a537c9f4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070420 Aug 27 02:48:42.489292 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1736/3709] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:42.503894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-681c99ca-fff5-4e71-a634-42670ecf552f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:42.504787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-681c99ca-fff5-4e71-a634-42670ecf552f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:42.523672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-681c99ca-fff5-4e71-a634-42670ecf552f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:42.524940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-681c99ca-fff5-4e71-a634-42670ecf552f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:42.525579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-681c99ca-fff5-4e71-a634-42670ecf552f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:42.526542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-681c99ca-fff5-4e71-a634-42670ecf552f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:42.527187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-681c99ca-fff5-4e71-a634-42670ecf552f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:42.527788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-681c99ca-fff5-4e71-a634-42670ecf552f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:42.676595 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-681c99ca-fff5-4e71-a634-42670ecf552f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.182044 Aug 27 02:48:42.677809 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1737/3710] 10.222.0.99 () {58 vars in 1296 bytes} [Sat Aug 27 02:48:42 2022] DELETE /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae/os-server-password => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:48:42.686429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d47c2f48-98b5-4455-8150-339b484c8293 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:42.688854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d47c2f48-98b5-4455-8150-339b484c8293 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:42.706353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d47c2f48-98b5-4455-8150-339b484c8293 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:42.707132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d47c2f48-98b5-4455-8150-339b484c8293 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:42.708572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d47c2f48-98b5-4455-8150-339b484c8293 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:42.709629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d47c2f48-98b5-4455-8150-339b484c8293 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:42.711920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d47c2f48-98b5-4455-8150-339b484c8293 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:42.712573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d47c2f48-98b5-4455-8150-339b484c8293 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:43.129353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d47c2f48-98b5-4455-8150-339b484c8293 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:43.158954 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d47c2f48-98b5-4455-8150-339b484c8293 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1324 microversion: 2.1 time: 0.478778 Aug 27 02:48:43.160068 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1738/3711] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:42 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1324 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:43.171735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6d093cce-1106-4f7e-a394-f880045df88f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:43.172775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6d093cce-1106-4f7e-a394-f880045df88f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:43.210902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d093cce-1106-4f7e-a394-f880045df88f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:43.211769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d093cce-1106-4f7e-a394-f880045df88f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:43.212563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d093cce-1106-4f7e-a394-f880045df88f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:43.222054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d093cce-1106-4f7e-a394-f880045df88f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:43.223388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d093cce-1106-4f7e-a394-f880045df88f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:43.224163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d093cce-1106-4f7e-a394-f880045df88f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:43.476537 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6d093cce-1106-4f7e-a394-f880045df88f tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.313867 Aug 27 02:48:43.481545 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1739/3712] 10.222.0.99 () {58 vars in 1293 bytes} [Sat Aug 27 02:48:43 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae/os-server-password => generated 16 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:48:43.494124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-22f0caaf-206a-4cbf-9bf3-d845d1a45b1f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:43.498849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-22f0caaf-206a-4cbf-9bf3-d845d1a45b1f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:43.516396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22f0caaf-206a-4cbf-9bf3-d845d1a45b1f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:43.517473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22f0caaf-206a-4cbf-9bf3-d845d1a45b1f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:43.521780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22f0caaf-206a-4cbf-9bf3-d845d1a45b1f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:43.523609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22f0caaf-206a-4cbf-9bf3-d845d1a45b1f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:43.524503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22f0caaf-206a-4cbf-9bf3-d845d1a45b1f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:43.528972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22f0caaf-206a-4cbf-9bf3-d845d1a45b1f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:44.305869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-22f0caaf-206a-4cbf-9bf3-d845d1a45b1f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:44.319742 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-22f0caaf-206a-4cbf-9bf3-d845d1a45b1f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.834698 Aug 27 02:48:44.338037 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1740/3713] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:43 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:44.364168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c69d178b-94d1-4eff-bd08-056f750a7798 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:44.365014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c69d178b-94d1-4eff-bd08-056f750a7798 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:44.433772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69d178b-94d1-4eff-bd08-056f750a7798 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:44.434721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69d178b-94d1-4eff-bd08-056f750a7798 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:44.435502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69d178b-94d1-4eff-bd08-056f750a7798 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:44.436768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69d178b-94d1-4eff-bd08-056f750a7798 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:44.437617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69d178b-94d1-4eff-bd08-056f750a7798 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:44.448206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c69d178b-94d1-4eff-bd08-056f750a7798 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:44.522256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c69d178b-94d1-4eff-bd08-056f750a7798 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:48:44.751877 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c69d178b-94d1-4eff-bd08-056f750a7798 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 204 len: 0 microversion: 2.1 time: 0.409906 Aug 27 02:48:44.753128 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1741/3714] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:48:44 2022] DELETE /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:48:44.767282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-214b318e-6fba-430a-8d7c-08f80ea2a449 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:44.771752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-214b318e-6fba-430a-8d7c-08f80ea2a449 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:44.792665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-214b318e-6fba-430a-8d7c-08f80ea2a449 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:44.795412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-214b318e-6fba-430a-8d7c-08f80ea2a449 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:44.798976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-214b318e-6fba-430a-8d7c-08f80ea2a449 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:44.803572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-214b318e-6fba-430a-8d7c-08f80ea2a449 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:44.805959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-214b318e-6fba-430a-8d7c-08f80ea2a449 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:44.806700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-214b318e-6fba-430a-8d7c-08f80ea2a449 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:46.174789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-214b318e-6fba-430a-8d7c-08f80ea2a449 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:46.184679 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-214b318e-6fba-430a-8d7c-08f80ea2a449 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1324 microversion: 2.1 time: 1.429894 Aug 27 02:48:46.188515 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1742/3715] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:44 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1324 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:46.208486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e91813fe-8fbd-4206-b5d0-560ae8e5367c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-306216318", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "dc3e6beb-11a4-4648-ac3a-41f7108a61e0", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:46.416119 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e91813fe-8fbd-4206-b5d0-560ae8e5367c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Block Device dc3e6beb-11a4-4648-ac3a-41f7108a61e0 is not bootable. Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e91813fe-8fbd-4206-b5d0-560ae8e5367c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 357 Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-306216318", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "dc3e6beb-11a4-4648-ac3a-41f7108a61e0", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: exception: Block Device dc3e6beb-11a4-4648-ac3a-41f7108a61e0 is not bootable. Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-306216318', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'dc3e6beb-11a4-4648-ac3a-41f7108a61e0'}], 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device dc3e6beb-11a4-4648-ac3a-41f7108a61e0 is not bootable. Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:46.424984 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device dc3e6beb-11a4-4648-ac3a-41f7108a61e0 is not bootable. Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device dc3e6beb-11a4-4648-ac3a-41f7108a61e0 is not bootable. Aug 27 02:48:46.429249 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:46.432155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e91813fe-8fbd-4206-b5d0-560ae8e5367c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Block Device dc3e6beb-11a4-4648-ac3a-41f7108a61e0 is not bootable. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:46.433297 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e91813fe-8fbd-4206-b5d0-560ae8e5367c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.242545 Aug 27 02:48:46.434204 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1743/3716] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:48:46 2022] POST /compute/v2.1/servers => generated 110 bytes in 245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:48:46.442802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b2c3ecaa-9112-4094-ae13-5128c3ea3bc1 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:46.443882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b2c3ecaa-9112-4094-ae13-5128c3ea3bc1 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:46.471571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2c3ecaa-9112-4094-ae13-5128c3ea3bc1 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:46.487812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2c3ecaa-9112-4094-ae13-5128c3ea3bc1 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:46.491492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2c3ecaa-9112-4094-ae13-5128c3ea3bc1 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:46.492325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2c3ecaa-9112-4094-ae13-5128c3ea3bc1 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:46.492824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2c3ecaa-9112-4094-ae13-5128c3ea3bc1 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:46.493308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2c3ecaa-9112-4094-ae13-5128c3ea3bc1 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:46.827724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:47.011115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b2c3ecaa-9112-4094-ae13-5128c3ea3bc1 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:47.023016 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b2c3ecaa-9112-4094-ae13-5128c3ea3bc1 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1509 microversion: 2.1 time: 0.586531 Aug 27 02:48:47.025107 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1744/3717] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:46 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1509 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:47.042208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4157b9b6-8afd-48ea-8fe2-ee10fdc5780a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:47.052413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4157b9b6-8afd-48ea-8fe2-ee10fdc5780a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:47.061932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4157b9b6-8afd-48ea-8fe2-ee10fdc5780a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:47.063021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4157b9b6-8afd-48ea-8fe2-ee10fdc5780a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:47.070033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4157b9b6-8afd-48ea-8fe2-ee10fdc5780a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:47.071717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4157b9b6-8afd-48ea-8fe2-ee10fdc5780a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:47.072463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4157b9b6-8afd-48ea-8fe2-ee10fdc5780a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:47.073314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4157b9b6-8afd-48ea-8fe2-ee10fdc5780a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:47.680731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:47.766474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4157b9b6-8afd-48ea-8fe2-ee10fdc5780a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:47.770460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:47.779710 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4157b9b6-8afd-48ea-8fe2-ee10fdc5780a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.753079 Aug 27 02:48:47.780325 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1745/3718] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:47 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:47.796067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-906c6091-6b4f-4157-b9a3-220e92d0672e req-bf1c72b5-e095-4f8f-9680-d7cb90b76fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635f24c5-9ee5-4edd-8900-c4f37390ff84", "tag": "98430134-569d-4143-9520-ba734f558738"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:47.840851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-906c6091-6b4f-4157-b9a3-220e92d0672e req-bf1c72b5-e095-4f8f-9680-d7cb90b76fad service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:47.841756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-906c6091-6b4f-4157-b9a3-220e92d0672e req-bf1c72b5-e095-4f8f-9680-d7cb90b76fad service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:47.842846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-906c6091-6b4f-4157-b9a3-220e92d0672e req-bf1c72b5-e095-4f8f-9680-d7cb90b76fad service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:47.870708 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-906c6091-6b4f-4157-b9a3-220e92d0672e req-bf1c72b5-e095-4f8f-9680-d7cb90b76fad service nova] Creating event network-changed:98430134-569d-4143-9520-ba734f558738 for instance 635f24c5-9ee5-4edd-8900-c4f37390ff84 on n-h2-852084-5 Aug 27 02:48:47.880528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:47.885974 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-906c6091-6b4f-4157-b9a3-220e92d0672e req-bf1c72b5-e095-4f8f-9680-d7cb90b76fad service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103640 Aug 27 02:48:47.888024 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1746/3719] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:47.901032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3970d5d0-ca1e-4f9f-bf0c-3831ac735363 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:47.904526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3970d5d0-ca1e-4f9f-bf0c-3831ac735363 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:47.919812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3970d5d0-ca1e-4f9f-bf0c-3831ac735363 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:47.920362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3970d5d0-ca1e-4f9f-bf0c-3831ac735363 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:47.920758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3970d5d0-ca1e-4f9f-bf0c-3831ac735363 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:47.921519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3970d5d0-ca1e-4f9f-bf0c-3831ac735363 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:47.922042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3970d5d0-ca1e-4f9f-bf0c-3831ac735363 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:47.922483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3970d5d0-ca1e-4f9f-bf0c-3831ac735363 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:48.166029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3970d5d0-ca1e-4f9f-bf0c-3831ac735363 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:48.182117 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3970d5d0-ca1e-4f9f-bf0c-3831ac735363 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.290570 Aug 27 02:48:48.183248 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1747/3720] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:47 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:48.225142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-33ce89c8-87c8-444b-8b2b-086685c93fff tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:48.226442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-33ce89c8-87c8-444b-8b2b-086685c93fff tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:48.238638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33ce89c8-87c8-444b-8b2b-086685c93fff tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:48.239916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33ce89c8-87c8-444b-8b2b-086685c93fff tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:48.240969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33ce89c8-87c8-444b-8b2b-086685c93fff tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:48.243273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33ce89c8-87c8-444b-8b2b-086685c93fff tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:48.244454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33ce89c8-87c8-444b-8b2b-086685c93fff tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:48.245949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33ce89c8-87c8-444b-8b2b-086685c93fff tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:48.276313 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.network.neutron [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] re-assign floating IP 172.25.9.158 from instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 Aug 27 02:48:48.387783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Building network info cache for instance {{(pid=122488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:48:48.674760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-33ce89c8-87c8-444b-8b2b-086685c93fff tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:48.697084 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-33ce89c8-87c8-444b-8b2b-086685c93fff tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1324 microversion: 2.1 time: 0.497021 Aug 27 02:48:48.698218 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1748/3721] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:48 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1324 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:48.732100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-43e8b0b5-43dd-48ee-b074-e1eb5d00b610 req-0b41c428-0b2a-48c1-b1dc-8ca00ddf1656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729c813c-9a69-418d-a6d8-d9f923b1c4f2", "tag": "00c7f942-8e70-4330-89b9-f94a286f91c8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:48.772501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-43e8b0b5-43dd-48ee-b074-e1eb5d00b610 req-0b41c428-0b2a-48c1-b1dc-8ca00ddf1656 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:48.775094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-43e8b0b5-43dd-48ee-b074-e1eb5d00b610 req-0b41c428-0b2a-48c1-b1dc-8ca00ddf1656 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:48.776159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-43e8b0b5-43dd-48ee-b074-e1eb5d00b610 req-0b41c428-0b2a-48c1-b1dc-8ca00ddf1656 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:48.822590 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-43e8b0b5-43dd-48ee-b074-e1eb5d00b610 req-0b41c428-0b2a-48c1-b1dc-8ca00ddf1656 service nova] Creating event network-changed:00c7f942-8e70-4330-89b9-f94a286f91c8 for instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 on n-h2-852084-5 Aug 27 02:48:48.871030 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-43e8b0b5-43dd-48ee-b074-e1eb5d00b610 req-0b41c428-0b2a-48c1-b1dc-8ca00ddf1656 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161688 Aug 27 02:48:48.872056 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1749/3722] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:48.922864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ab46520-94eb-4c29-8664-12b76381f62a tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:48.926584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0ab46520-94eb-4c29-8664-12b76381f62a tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:48.957564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ab46520-94eb-4c29-8664-12b76381f62a tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:48.959041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ab46520-94eb-4c29-8664-12b76381f62a tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:48.960130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ab46520-94eb-4c29-8664-12b76381f62a tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:48.967745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ab46520-94eb-4c29-8664-12b76381f62a tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:48.969000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ab46520-94eb-4c29-8664-12b76381f62a tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:48.970435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ab46520-94eb-4c29-8664-12b76381f62a tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:48.994591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:49.885222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0ab46520-94eb-4c29-8664-12b76381f62a tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b0238566f245d997b8f2302687951a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e64f98555345459a5619fdbb08b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:49.918865 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0ab46520-94eb-4c29-8664-12b76381f62a tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 200 len: 1509 microversion: 2.1 time: 1.037179 Aug 27 02:48:49.921454 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1750/3723] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:48 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 1509 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:49.929156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0acc7379-f4a2-4eb6-ad49-c32740d0f0f6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:49.930467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0acc7379-f4a2-4eb6-ad49-c32740d0f0f6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:49.940136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0acc7379-f4a2-4eb6-ad49-c32740d0f0f6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:49.941946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0acc7379-f4a2-4eb6-ad49-c32740d0f0f6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:49.942845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0acc7379-f4a2-4eb6-ad49-c32740d0f0f6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:49.944062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0acc7379-f4a2-4eb6-ad49-c32740d0f0f6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:49.945242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0acc7379-f4a2-4eb6-ad49-c32740d0f0f6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:49.945954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0acc7379-f4a2-4eb6-ad49-c32740d0f0f6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:51.024319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0acc7379-f4a2-4eb6-ad49-c32740d0f0f6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:51.043972 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0acc7379-f4a2-4eb6-ad49-c32740d0f0f6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.116178 Aug 27 02:48:51.046411 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1751/3724] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:49 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:51.053930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9209a52a-ceea-4943-9302-2ff9fe279b30 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:51.055766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9209a52a-ceea-4943-9302-2ff9fe279b30 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:51.097081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9209a52a-ceea-4943-9302-2ff9fe279b30 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:51.103796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9209a52a-ceea-4943-9302-2ff9fe279b30 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:51.104609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9209a52a-ceea-4943-9302-2ff9fe279b30 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:51.105605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9209a52a-ceea-4943-9302-2ff9fe279b30 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:51.108133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9209a52a-ceea-4943-9302-2ff9fe279b30 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:51.115135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9209a52a-ceea-4943-9302-2ff9fe279b30 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:51.788459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9209a52a-ceea-4943-9302-2ff9fe279b30 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:51.813111 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9209a52a-ceea-4943-9302-2ff9fe279b30 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.765259 Aug 27 02:48:51.836425 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1752/3725] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:51 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:51.847325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb4eb890-fbe0-4319-ba7f-277ec9dcef6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:51.848240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bb4eb890-fbe0-4319-ba7f-277ec9dcef6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:51.866357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb4eb890-fbe0-4319-ba7f-277ec9dcef6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:51.868500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb4eb890-fbe0-4319-ba7f-277ec9dcef6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:51.869190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb4eb890-fbe0-4319-ba7f-277ec9dcef6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:51.870182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb4eb890-fbe0-4319-ba7f-277ec9dcef6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:51.872606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb4eb890-fbe0-4319-ba7f-277ec9dcef6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:51.877258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb4eb890-fbe0-4319-ba7f-277ec9dcef6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:52.262085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Updating instance_info_cache with network_info: [{"id": "00c7f942-8e70-4330-89b9-f94a286f91c8", "address": "fa:16:3e:4d:c1:08", "network": {"id": "e0d9a993-a33f-4021-8fe8-2409a593643d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1342458713-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b3c9fc569ff43fc8c28ef7edeb1c62a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap00c7f942-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:48:52.304288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Building network info cache for instance {{(pid=122488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:48:52.720735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bb4eb890-fbe0-4319-ba7f-277ec9dcef6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:52.747458 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bb4eb890-fbe0-4319-ba7f-277ec9dcef6d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1324 microversion: 2.1 time: 0.907519 Aug 27 02:48:52.750636 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1753/3726] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:51 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1324 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:52.761458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3c8947a8-b972-4f83-bcd8-cbd310911186 req-32ec03b3-b210-4180-95cc-dc44ebd9baf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2ba8af-754a-4aaf-84e7-257aeb402178", "tag": "f26cc28b-247d-4c43-ab4f-fc8cea284db2"}, {"server_uuid": "f7003020-aea4-4c84-b929-b7fb8cb19aae", "name": "network-vif-deleted", "tag": "580a5330-5c6c-41c9-bdbd-37408ae5ab4a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:52.795746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3c8947a8-b972-4f83-bcd8-cbd310911186 req-32ec03b3-b210-4180-95cc-dc44ebd9baf4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:52.796272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3c8947a8-b972-4f83-bcd8-cbd310911186 req-32ec03b3-b210-4180-95cc-dc44ebd9baf4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:52.798720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3c8947a8-b972-4f83-bcd8-cbd310911186 req-32ec03b3-b210-4180-95cc-dc44ebd9baf4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:52.844908 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3c8947a8-b972-4f83-bcd8-cbd310911186 req-32ec03b3-b210-4180-95cc-dc44ebd9baf4 service nova] Creating event network-changed:f26cc28b-247d-4c43-ab4f-fc8cea284db2 for instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 on n-h1-852084-5 Aug 27 02:48:52.845433 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3c8947a8-b972-4f83-bcd8-cbd310911186 req-32ec03b3-b210-4180-95cc-dc44ebd9baf4 service nova] Creating event network-vif-deleted:580a5330-5c6c-41c9-bdbd-37408ae5ab4a for instance f7003020-aea4-4c84-b929-b7fb8cb19aae on n-h1-852084-5 Aug 27 02:48:52.869833 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3c8947a8-b972-4f83-bcd8-cbd310911186 req-32ec03b3-b210-4180-95cc-dc44ebd9baf4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.114785 Aug 27 02:48:52.870478 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1754/3727] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:52.878037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:52.879062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] [instance: f7003020-aea4-4c84-b929-b7fb8cb19aae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:52.890318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:52.890947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:52.919213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:52.920501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:52.927155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:52.930387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:52.968780 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] HTTP exception thrown: Instance f7003020-aea4-4c84-b929-b7fb8cb19aae could not be found. Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Request method failure captured: Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae HTTP/1.1 Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYXrsc-oVHLPvCtizr4xFkhu9LIV4jaCtTwY0wIltKkPvYOz1y6t7WdlqPKrBi149vqO9qKSh9U26Weo5uEPX3Z7WZXsZu5__hjNBgt1xdimKwoRTc_D8l2N0luqt5hINF1ul0bieolkQphtui03VxRWLeQn703wUGnRcxFeeRtcJWs Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c1e64f98555345459a5619fdbb08b32e Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerPasswordTestJSON-928894235 Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c1e64f98555345459a5619fdbb08b32e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c1e64f98555345459a5619fdbb08b32e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c1e64f98555345459a5619fdbb08b32e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c1e64f98555345459a5619fdbb08b32e"}]}] Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerPasswordTestJSON-928894235 Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c1e64f98555345459a5619fdbb08b32e Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerPasswordTestJSON-928894235 Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerPasswordTestJSON-928894235-project Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 36b0238566f245d997b8f2302687951a Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerPasswordTestJSON-928894235-project Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance f7003020-aea4-4c84-b929-b7fb8cb19aae could not be found. Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f7003020-aea4-4c84-b929-b7fb8cb19aae'} Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7003020-aea4-4c84-b929-b7fb8cb19aae could not be found. Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7003020-aea4-4c84-b929-b7fb8cb19aae could not be found. Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:52.971260 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.979551 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:52.979551 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:52.979551 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:52.979551 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:52.979551 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:52.979551 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7003020-aea4-4c84-b929-b7fb8cb19aae could not be found. Aug 27 02:48:52.979551 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:52.979551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] Returning 404 to user: Instance f7003020-aea4-4c84-b929-b7fb8cb19aae could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:52.979551 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0ac2bc4f-6880-4a72-8525-21bf4df2ec27 tempest-ServerPasswordTestJSON-928894235 tempest-ServerPasswordTestJSON-928894235-project] 10.222.0.99 "GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae" status: 404 len: 111 microversion: 2.1 time: 0.101204 Aug 27 02:48:52.979551 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1755/3728] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:52 2022] GET /compute/v2.1/servers/f7003020-aea4-4c84-b929-b7fb8cb19aae => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:48:53.351291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-50652350-896d-49fe-a577-881a1a93637e tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Action: 'create', calling method: .version_select at 0x7f4d2e6e1160>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-685763418", "policies": ["affinity"]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:53.377342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-50652350-896d-49fe-a577-881a1a93637e tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:53.393541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:48:53.394896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-50652350-896d-49fe-a577-881a1a93637e tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:53.547449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-50652350-896d-49fe-a577-881a1a93637e tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:53.556724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-50652350-896d-49fe-a577-881a1a93637e tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:53.617058 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-50652350-896d-49fe-a577-881a1a93637e tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.637618 Aug 27 02:48:53.619420 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1756/3729] 10.222.0.99 () {60 vars in 1174 bytes} [Sat Aug 27 02:48:52 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:53.640854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3997523c-c050-49e5-b97f-650e5da2681f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:53.643472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3997523c-c050-49e5-b97f-650e5da2681f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:53.663615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3997523c-c050-49e5-b97f-650e5da2681f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:53.667386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3997523c-c050-49e5-b97f-650e5da2681f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:53.668121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3997523c-c050-49e5-b97f-650e5da2681f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:53.669166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3997523c-c050-49e5-b97f-650e5da2681f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:53.675252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3997523c-c050-49e5-b97f-650e5da2681f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:53.676034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3997523c-c050-49e5-b97f-650e5da2681f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:54.485472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3997523c-c050-49e5-b97f-650e5da2681f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:54.504599 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3997523c-c050-49e5-b97f-650e5da2681f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.883726 Aug 27 02:48:54.505788 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1757/3730] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:53 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:54.518378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8c5c1a7-38b9-428a-aa38-ec91fad25520 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Action: 'create', calling method: .version_select at 0x7f4d2956af70>, body: {"server_group": {"name": "tempest-server-group-1791440860", "policies": ["affinity"]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:54.599430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-e8c5c1a7-38b9-428a-aa38-ec91fad25520 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:54.658093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-e8c5c1a7-38b9-428a-aa38-ec91fad25520 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:54.829987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-e8c5c1a7-38b9-428a-aa38-ec91fad25520 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:54.859327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-e8c5c1a7-38b9-428a-aa38-ec91fad25520 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:54.900115 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e8c5c1a7-38b9-428a-aa38-ec91fad25520 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.392248 Aug 27 02:48:54.900979 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1758/3731] 10.222.0.99 () {60 vars in 1173 bytes} [Sat Aug 27 02:48:54 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:54.938583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a8bc15d-6149-43f1-a805-1b6aa8552cd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:54.942170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a8bc15d-6149-43f1-a805-1b6aa8552cd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:54.971650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8bc15d-6149-43f1-a805-1b6aa8552cd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:54.972892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8bc15d-6149-43f1-a805-1b6aa8552cd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:54.975327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8bc15d-6149-43f1-a805-1b6aa8552cd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:54.977006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8bc15d-6149-43f1-a805-1b6aa8552cd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:54.977889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8bc15d-6149-43f1-a805-1b6aa8552cd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:54.978676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8bc15d-6149-43f1-a805-1b6aa8552cd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:55.258640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Updating instance_info_cache with network_info: [{"id": "f26cc28b-247d-4c43-ab4f-fc8cea284db2", "address": "fa:16:3e:a2:0a:a4", "network": {"id": "e0d9a993-a33f-4021-8fe8-2409a593643d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1342458713-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b3c9fc569ff43fc8c28ef7edeb1c62a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf26cc28b-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:48:55.365618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Releasing lock "refresh_cache-0c2ba8af-754a-4aaf-84e7-257aeb402178" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:48:55.367889 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-521a86e2-e01c-4447-af35-42f5afd06d9e tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "POST /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178/action" status: 202 len: 0 microversion: 2.1 time: 17.733829 Aug 27 02:48:55.371514 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1974/3732] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:48:37 2022] POST /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178/action => generated 0 bytes in 17738 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:48:55.381847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-638bf718-fdfc-4203-86ce-cccdda89c0c1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-251422969", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "destination_type": "local"}, {"source_type": "volume", "uuid": "12c50d41-006c-47fe-9552-de687942646e", "destination_type": "invalid"}], "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-638bf718-fdfc-4203-86ce-cccdda89c0c1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 494 Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-251422969", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "destination_type": "local"}, {"source_type": "volume", "uuid": "12c50d41-006c-47fe-9552-de687942646e", "destination_type": "invalid"}], "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-251422969', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '12c50d41-006c-47fe-9552-de687942646e', 'destination_type': 'invalid'}], 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'invalid' Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:55.390675 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 27 02:48:55.395289 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:48:55.403160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-638bf718-fdfc-4203-86ce-cccdda89c0c1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:55.405087 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-638bf718-fdfc-4203-86ce-cccdda89c0c1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.032375 Aug 27 02:48:55.406481 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1975/3733] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:48:55 2022] POST /compute/v2.1/servers => generated 155 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:48:55.417244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-322ab743-6d67-45df-8aff-5b2a39340d67 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Action: 'create', calling method: .version_select at 0x7f4d290f5ca0>, body: {"server_group": {"name": "tempest-server-group-1791440860", "policies": ["affinity"]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:55.448783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-322ab743-6d67-45df-8aff-5b2a39340d67 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:55.456390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-322ab743-6d67-45df-8aff-5b2a39340d67 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:55.681545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-322ab743-6d67-45df-8aff-5b2a39340d67 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:48:55.697633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-322ab743-6d67-45df-8aff-5b2a39340d67 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:48:55.730455 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-322ab743-6d67-45df-8aff-5b2a39340d67 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.322027 Aug 27 02:48:55.732353 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1976/3734] 10.222.0.99 () {60 vars in 1173 bytes} [Sat Aug 27 02:48:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:55.742870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.158"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:55.841160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a8bc15d-6149-43f1-a805-1b6aa8552cd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:55.850004 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a8bc15d-6149-43f1-a805-1b6aa8552cd6 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1324 microversion: 2.1 time: 0.944113 Aug 27 02:48:55.875259 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1759/3735] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:54 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1324 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:55.887710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf441bc9-5cec-408d-887a-7ee9017429cc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:55.888644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf441bc9-5cec-408d-887a-7ee9017429cc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:55.895417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf441bc9-5cec-408d-887a-7ee9017429cc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:55.896194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf441bc9-5cec-408d-887a-7ee9017429cc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:55.896808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf441bc9-5cec-408d-887a-7ee9017429cc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:55.899529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf441bc9-5cec-408d-887a-7ee9017429cc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:55.900515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf441bc9-5cec-408d-887a-7ee9017429cc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:55.901290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf441bc9-5cec-408d-887a-7ee9017429cc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:56.258339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:56.280695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:56.281847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:56.282276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:56.283247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:56.284054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:56.284805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:56.349634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf441bc9-5cec-408d-887a-7ee9017429cc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:56.363330 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf441bc9-5cec-408d-887a-7ee9017429cc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.486515 Aug 27 02:48:56.378266 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1760/3736] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:55 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:56.380381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-83ff3530-6e9d-47a3-a074-23598b4e752b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:56.386737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-83ff3530-6e9d-47a3-a074-23598b4e752b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:56.405732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83ff3530-6e9d-47a3-a074-23598b4e752b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:56.408468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83ff3530-6e9d-47a3-a074-23598b4e752b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:56.410751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83ff3530-6e9d-47a3-a074-23598b4e752b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:56.412460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83ff3530-6e9d-47a3-a074-23598b4e752b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:56.415157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83ff3530-6e9d-47a3-a074-23598b4e752b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:56.416396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83ff3530-6e9d-47a3-a074-23598b4e752b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:56.887686 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] HTTP exception thrown: Floating IP 172.25.9.158 is not associated with instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2. Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Request method failure captured: Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2/action HTTP/1.1 Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 49 Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2ZVlZSRAB0Vl6LylE1Z13wKYKpzdRChm8PIbGNPB4qN8ujckQegCrdlh2OB_lCWkLpVAWssNl9TNyzcqhSC164sAIiAKR54yB1FrCkk4NROTvClqfQa7G2EopX53xfi2ByGua9hKWBKf4KxTMO9YY560TpF3VIsjwkIYvbMLm_A4 Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2b3c9fc569ff43fc8c28ef7edeb1c62a Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}] Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2b3c9fc569ff43fc8c28ef7edeb1c62a Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FloatingIPsAssociationTestJSON-733446844-project Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 58c2cdb5435340e59fd0cd482de64bb3 Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-733446844-project Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: {"removeFloatingIp": {"address": "172.25.9.158"}} Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: exception: Floating IP 172.25.9.158 is not associated with instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2. Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '729c813c-9a69-418d-a6d8-d9f923b1c4f2', 'body': {'removeFloatingIp': {'address': '172.25.9.158'}}} Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.158 is not associated with instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2. Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.158 is not associated with instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2. Aug 27 02:48:56.889977 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:48:56.900656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Returning 409 to user: Floating IP 172.25.9.158 is not associated with instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:56.900656 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-41d05aed-9bd2-4def-8e93-d21d54b9ca28 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "POST /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2/action" status: 409 len: 146 microversion: 2.1 time: 1.158303 Aug 27 02:48:56.900656 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1977/3737] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:48:55 2022] POST /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2/action => generated 146 bytes in 1167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:48:56.927466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fa46e738-e4e9-43af-83fc-b27bf6245160 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:57.010128 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fa46e738-e4e9-43af-83fc-b27bf6245160 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a" status: 204 len: 0 microversion: 2.1 time: 0.108305 Aug 27 02:48:57.011123 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1978/3738] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:48:56 2022] DELETE /compute/v2.1/os-server-groups/a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:48:57.027921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d04c0d4a-fcf1-4d52-9d4d-2d57828c7088 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:57.029039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d04c0d4a-fcf1-4d52-9d4d-2d57828c7088 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:57.049976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d04c0d4a-fcf1-4d52-9d4d-2d57828c7088 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:57.050816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d04c0d4a-fcf1-4d52-9d4d-2d57828c7088 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:57.051606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d04c0d4a-fcf1-4d52-9d4d-2d57828c7088 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:57.052884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d04c0d4a-fcf1-4d52-9d4d-2d57828c7088 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:57.060405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d04c0d4a-fcf1-4d52-9d4d-2d57828c7088 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:57.061905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d04c0d4a-fcf1-4d52-9d4d-2d57828c7088 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:57.125858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-83ff3530-6e9d-47a3-a074-23598b4e752b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:57.169399 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-83ff3530-6e9d-47a3-a074-23598b4e752b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.793747 Aug 27 02:48:57.172617 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1761/3739] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:56 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:57.225370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-57db0a52-210e-4e43-8672-b8005b3b9aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:57.230937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-57db0a52-210e-4e43-8672-b8005b3b9aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:57.269641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57db0a52-210e-4e43-8672-b8005b3b9aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:57.275256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57db0a52-210e-4e43-8672-b8005b3b9aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:57.278515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57db0a52-210e-4e43-8672-b8005b3b9aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:57.284052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57db0a52-210e-4e43-8672-b8005b3b9aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:57.285019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57db0a52-210e-4e43-8672-b8005b3b9aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:57.290266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57db0a52-210e-4e43-8672-b8005b3b9aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:58.111309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d04c0d4a-fcf1-4d52-9d4d-2d57828c7088 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:58.127208 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d04c0d4a-fcf1-4d52-9d4d-2d57828c7088 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.114180 Aug 27 02:48:58.129761 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1979/3740] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:57 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:58.151048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.158"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:58.255256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-57db0a52-210e-4e43-8672-b8005b3b9aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:58.270413 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-57db0a52-210e-4e43-8672-b8005b3b9aa9 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1324 microversion: 2.1 time: 1.093688 Aug 27 02:48:58.284454 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1762/3741] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:57 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1324 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:58.298140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f59357e-7491-410b-8fbd-4ca126b55315 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:58.365934 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5f59357e-7491-410b-8fbd-4ca126b55315 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.079736 Aug 27 02:48:58.390352 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1763/3742] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:48:58 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:58.410620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-77a2af06-0468-4a46-9de1-2bf5f7f55395 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:58.417989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-77a2af06-0468-4a46-9de1-2bf5f7f55395 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:58.449451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a2af06-0468-4a46-9de1-2bf5f7f55395 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:58.454707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a2af06-0468-4a46-9de1-2bf5f7f55395 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:58.464474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a2af06-0468-4a46-9de1-2bf5f7f55395 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:58.466948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a2af06-0468-4a46-9de1-2bf5f7f55395 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:58.468078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a2af06-0468-4a46-9de1-2bf5f7f55395 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:58.469127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a2af06-0468-4a46-9de1-2bf5f7f55395 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:58.734928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:58.755362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:58.756823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:58.758385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:58.759680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:58.762091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:58.763158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:59.345648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-77a2af06-0468-4a46-9de1-2bf5f7f55395 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:48:59.362326 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-77a2af06-0468-4a46-9de1-2bf5f7f55395 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.968531 Aug 27 02:48:59.363415 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1764/3743] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:58 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:48:59.373171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68f08fff-9680-4d59-86eb-df713526d8bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-57634092", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68f08fff-9680-4d59-86eb-df713526d8bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 490 Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-57634092", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-57634092', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:59.386018 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 27 02:48:59.392545 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:48:59.411213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68f08fff-9680-4d59-86eb-df713526d8bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:48:59.415765 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-68f08fff-9680-4d59-86eb-df713526d8bf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.050421 Aug 27 02:48:59.419017 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1765/3744] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:48:59 2022] POST /compute/v2.1/servers => generated 624 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:48:59.431560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-54dbe84e-5ab8-4cbd-94c2-2fdaedc831e1 req-4e61c46a-ca0f-4f03-beeb-d7787d0979cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635f24c5-9ee5-4edd-8900-c4f37390ff84", "name": "network-vif-plugged", "status": "completed", "tag": "98430134-569d-4143-9520-ba734f558738"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:48:59.451036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-54dbe84e-5ab8-4cbd-94c2-2fdaedc831e1 req-4e61c46a-ca0f-4f03-beeb-d7787d0979cc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:59.452466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-54dbe84e-5ab8-4cbd-94c2-2fdaedc831e1 req-4e61c46a-ca0f-4f03-beeb-d7787d0979cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:59.453614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-54dbe84e-5ab8-4cbd-94c2-2fdaedc831e1 req-4e61c46a-ca0f-4f03-beeb-d7787d0979cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:59.474398 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-54dbe84e-5ab8-4cbd-94c2-2fdaedc831e1 req-4e61c46a-ca0f-4f03-beeb-d7787d0979cc service nova] Creating event network-vif-plugged:98430134-569d-4143-9520-ba734f558738 for instance 635f24c5-9ee5-4edd-8900-c4f37390ff84 on n-h2-852084-5 Aug 27 02:48:59.483936 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-54dbe84e-5ab8-4cbd-94c2-2fdaedc831e1 req-4e61c46a-ca0f-4f03-beeb-d7787d0979cc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062395 Aug 27 02:48:59.486125 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1766/3745] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:48:59.499505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4572f5a6-39d6-4829-bd0c-731616f60caf tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:59.556355 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4572f5a6-39d6-4829-bd0c-731616f60caf tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/44339751-434c-4752-b477-55be1ae3a4dc" status: 204 len: 0 microversion: 2.1 time: 0.067173 Aug 27 02:48:59.558438 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1767/3746] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:48:59 2022] DELETE /compute/v2.1/os-server-groups/44339751-434c-4752-b477-55be1ae3a4dc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:48:59.567602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "refresh_cache-0c2ba8af-754a-4aaf-84e7-257aeb402178" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:48:59.570548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquired lock "refresh_cache-0c2ba8af-754a-4aaf-84e7-257aeb402178" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:48:59.577490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e6cd1ad-a09e-481d-8719-425bb85a0211 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:48:59.580010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5e6cd1ad-a09e-481d-8719-425bb85a0211 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:48:59.612723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e6cd1ad-a09e-481d-8719-425bb85a0211 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:59.614560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e6cd1ad-a09e-481d-8719-425bb85a0211 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:59.618271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e6cd1ad-a09e-481d-8719-425bb85a0211 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:48:59.620511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e6cd1ad-a09e-481d-8719-425bb85a0211 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:48:59.623089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e6cd1ad-a09e-481d-8719-425bb85a0211 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:48:59.626515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e6cd1ad-a09e-481d-8719-425bb85a0211 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:00.319229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5e6cd1ad-a09e-481d-8719-425bb85a0211 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:00.407064 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5e6cd1ad-a09e-481d-8719-425bb85a0211 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1324 microversion: 2.1 time: 0.845922 Aug 27 02:49:00.411412 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1768/3747] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:48:59 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1324 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:00.446061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4accbfc4-a249-4ef4-bedb-77b4439f2f61 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:00.448520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4accbfc4-a249-4ef4-bedb-77b4439f2f61 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:00.492557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4accbfc4-a249-4ef4-bedb-77b4439f2f61 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:00.493883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4accbfc4-a249-4ef4-bedb-77b4439f2f61 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:00.497325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4accbfc4-a249-4ef4-bedb-77b4439f2f61 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:00.506941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4accbfc4-a249-4ef4-bedb-77b4439f2f61 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:00.508654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4accbfc4-a249-4ef4-bedb-77b4439f2f61 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:00.511789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4accbfc4-a249-4ef4-bedb-77b4439f2f61 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:01.100810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4accbfc4-a249-4ef4-bedb-77b4439f2f61 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:01.115904 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4accbfc4-a249-4ef4-bedb-77b4439f2f61 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.698235 Aug 27 02:49:01.131043 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1769/3748] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:00 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:01.131043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-10887a63-e09d-4eff-b310-4516ae4933a0 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:01.157179 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-10887a63-e09d-4eff-b310-4516ae4933a0 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.038029 Aug 27 02:49:01.158150 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1770/3749] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:49:01 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:01.171294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0e5adffe-1156-413b-933d-16bebc8bc102 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:01.171929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0e5adffe-1156-413b-933d-16bebc8bc102 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:01.190989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e5adffe-1156-413b-933d-16bebc8bc102 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:01.191765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e5adffe-1156-413b-933d-16bebc8bc102 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:01.194227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e5adffe-1156-413b-933d-16bebc8bc102 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:01.201255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e5adffe-1156-413b-933d-16bebc8bc102 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:01.203411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e5adffe-1156-413b-933d-16bebc8bc102 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:01.205425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e5adffe-1156-413b-933d-16bebc8bc102 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:01.840966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0e5adffe-1156-413b-933d-16bebc8bc102 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:01.855968 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0e5adffe-1156-413b-933d-16bebc8bc102 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.695618 Aug 27 02:49:01.858008 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1771/3750] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:01 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:01.871185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1227efa9-9cf2-45e3-b56b-700c6aa91b93 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:01.872094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1227efa9-9cf2-45e3-b56b-700c6aa91b93 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:01.879854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1227efa9-9cf2-45e3-b56b-700c6aa91b93 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:01.880641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1227efa9-9cf2-45e3-b56b-700c6aa91b93 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:01.881251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1227efa9-9cf2-45e3-b56b-700c6aa91b93 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:01.882761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1227efa9-9cf2-45e3-b56b-700c6aa91b93 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:01.883465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1227efa9-9cf2-45e3-b56b-700c6aa91b93 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:01.884079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1227efa9-9cf2-45e3-b56b-700c6aa91b93 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:02.069013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Building network info cache for instance {{(pid=122488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:49:02.273689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1227efa9-9cf2-45e3-b56b-700c6aa91b93 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:02.288265 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1227efa9-9cf2-45e3-b56b-700c6aa91b93 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.421062 Aug 27 02:49:02.319392 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1772/3751] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:01 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:02.334442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0287119a-dc8d-490a-b709-bdeba68c4c3d tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Action: 'create', calling method: .version_select at 0x7f4d29d10790>, body: {"server_group": {"name": "tempest-server-group-1835071915", "policies": ["affinity"]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:02.417912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0287119a-dc8d-490a-b709-bdeba68c4c3d tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:02.436498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0287119a-dc8d-490a-b709-bdeba68c4c3d tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:02.560016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:02.578874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0287119a-dc8d-490a-b709-bdeba68c4c3d tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:02.586010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0287119a-dc8d-490a-b709-bdeba68c4c3d tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:02.605124 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0287119a-dc8d-490a-b709-bdeba68c4c3d tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.282740 Aug 27 02:49:02.606389 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1773/3752] 10.222.0.99 () {60 vars in 1173 bytes} [Sat Aug 27 02:49:02 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:02.620324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-731dca23-24ad-4c27-a5f5-78062d92bf19 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:02.621338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-731dca23-24ad-4c27-a5f5-78062d92bf19 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:02.629147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-731dca23-24ad-4c27-a5f5-78062d92bf19 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:02.629793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-731dca23-24ad-4c27-a5f5-78062d92bf19 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:02.630316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-731dca23-24ad-4c27-a5f5-78062d92bf19 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:02.631448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-731dca23-24ad-4c27-a5f5-78062d92bf19 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:02.632750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-731dca23-24ad-4c27-a5f5-78062d92bf19 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:02.633780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-731dca23-24ad-4c27-a5f5-78062d92bf19 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:03.233496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-731dca23-24ad-4c27-a5f5-78062d92bf19 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:03.246719 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-731dca23-24ad-4c27-a5f5-78062d92bf19 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1522 microversion: 2.1 time: 0.638849 Aug 27 02:49:03.247328 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1774/3753] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:02 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1522 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:03.280934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ef66aa78-f521-489f-af70-14716896ebc2 req-0963be55-4ada-4817-94ef-72c61c462df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6", "name": "network-vif-plugged", "status": "completed", "tag": "44cf6fb5-e006-4840-91d8-c9247c84debd"}, {"server_uuid": "4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6", "name": "network-vif-plugged", "status": "completed", "tag": "8607c35c-e3a4-4738-bb5e-bc5077916026"}, {"server_uuid": "4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6", "name": "network-vif-plugged", "status": "completed", "tag": "bf7e1285-ec6b-4d91-818f-c74ed2d02185"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:03.313568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ef66aa78-f521-489f-af70-14716896ebc2 req-0963be55-4ada-4817-94ef-72c61c462df6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:03.314680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ef66aa78-f521-489f-af70-14716896ebc2 req-0963be55-4ada-4817-94ef-72c61c462df6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:03.316026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ef66aa78-f521-489f-af70-14716896ebc2 req-0963be55-4ada-4817-94ef-72c61c462df6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:03.345157 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ef66aa78-f521-489f-af70-14716896ebc2 req-0963be55-4ada-4817-94ef-72c61c462df6 service nova] Creating event network-vif-plugged:44cf6fb5-e006-4840-91d8-c9247c84debd for instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 on n-h2-852084-5 Aug 27 02:49:03.347447 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ef66aa78-f521-489f-af70-14716896ebc2 req-0963be55-4ada-4817-94ef-72c61c462df6 service nova] Creating event network-vif-plugged:8607c35c-e3a4-4738-bb5e-bc5077916026 for instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 on n-h2-852084-5 Aug 27 02:49:03.348975 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ef66aa78-f521-489f-af70-14716896ebc2 req-0963be55-4ada-4817-94ef-72c61c462df6 service nova] Creating event network-vif-plugged:bf7e1285-ec6b-4d91-818f-c74ed2d02185 for instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 on n-h2-852084-5 Aug 27 02:49:03.361651 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ef66aa78-f521-489f-af70-14716896ebc2 req-0963be55-4ada-4817-94ef-72c61c462df6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.103450 Aug 27 02:49:03.363549 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1775/3754] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:03.375436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-15e9e60f-db3d-4193-a773-ac26dd7f721e req-c0ac6014-6cb1-40a7-9d9a-6dd4dfe2e765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2ba8af-754a-4aaf-84e7-257aeb402178", "tag": "f26cc28b-247d-4c43-ab4f-fc8cea284db2"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:03.408923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-15e9e60f-db3d-4193-a773-ac26dd7f721e req-c0ac6014-6cb1-40a7-9d9a-6dd4dfe2e765 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:03.410181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-15e9e60f-db3d-4193-a773-ac26dd7f721e req-c0ac6014-6cb1-40a7-9d9a-6dd4dfe2e765 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:03.411224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-15e9e60f-db3d-4193-a773-ac26dd7f721e req-c0ac6014-6cb1-40a7-9d9a-6dd4dfe2e765 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:03.435748 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-15e9e60f-db3d-4193-a773-ac26dd7f721e req-c0ac6014-6cb1-40a7-9d9a-6dd4dfe2e765 service nova] Creating event network-changed:f26cc28b-247d-4c43-ab4f-fc8cea284db2 for instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 on n-h1-852084-5 Aug 27 02:49:03.448478 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-15e9e60f-db3d-4193-a773-ac26dd7f721e req-c0ac6014-6cb1-40a7-9d9a-6dd4dfe2e765 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082209 Aug 27 02:49:03.456902 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1776/3755] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:03.471928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c6bf9866-d87c-463a-b8c4-be2f473b5f41 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c6bf9866-d87c-463a-b8c4-be2f473b5f41 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 416 Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:03.476571 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c6bf9866-d87c-463a-b8c4-be2f473b5f41 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c6bf9866-d87c-463a-b8c4-be2f473b5f41 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.019014 Aug 27 02:49:03.484107 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1777/3756] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:03 2022] POST /compute/v2.1/servers => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:49:03.491002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3d6dd50c-b8a5-4933-ba46-a33ee7eed141 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:03.529878 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3d6dd50c-b8a5-4933-ba46-a33ee7eed141 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/b372f942-6dc7-4d90-8946-d0eac8862772" status: 204 len: 0 microversion: 2.1 time: 0.046596 Aug 27 02:49:03.535938 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1778/3757] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:49:03 2022] DELETE /compute/v2.1/os-server-groups/b372f942-6dc7-4d90-8946-d0eac8862772 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:03.537615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-120a4384-cc76-4811-b323-3a79cddc0b2a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:03.538977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-120a4384-cc76-4811-b323-3a79cddc0b2a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:03.547710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-120a4384-cc76-4811-b323-3a79cddc0b2a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:03.548470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-120a4384-cc76-4811-b323-3a79cddc0b2a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:03.549700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-120a4384-cc76-4811-b323-3a79cddc0b2a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:03.557377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-120a4384-cc76-4811-b323-3a79cddc0b2a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:03.558689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-120a4384-cc76-4811-b323-3a79cddc0b2a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:03.564940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-120a4384-cc76-4811-b323-3a79cddc0b2a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:03.571949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:03.949939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-120a4384-cc76-4811-b323-3a79cddc0b2a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:03.971519 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-120a4384-cc76-4811-b323-3a79cddc0b2a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.438100 Aug 27 02:49:03.973497 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1779/3758] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:03 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:03.987127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-20317821-5243-4396-854d-99c3a4b4e822 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:03.990699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-20317821-5243-4396-854d-99c3a4b4e822 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:04.003169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20317821-5243-4396-854d-99c3a4b4e822 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:04.003692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20317821-5243-4396-854d-99c3a4b4e822 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:04.004317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20317821-5243-4396-854d-99c3a4b4e822 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:04.005398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20317821-5243-4396-854d-99c3a4b4e822 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:04.005909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20317821-5243-4396-854d-99c3a4b4e822 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:04.006543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20317821-5243-4396-854d-99c3a4b4e822 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:04.042986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-20317821-5243-4396-854d-99c3a4b4e822 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:49:04.184529 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-20317821-5243-4396-854d-99c3a4b4e822 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "DELETE /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 204 len: 0 microversion: 2.1 time: 0.208698 Aug 27 02:49:04.193050 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1780/3759] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:03 2022] DELETE /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:04.201657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-15011f67-d47d-4e0b-af10-e8fac372f553 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:04.202902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-15011f67-d47d-4e0b-af10-e8fac372f553 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:04.211445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15011f67-d47d-4e0b-af10-e8fac372f553 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:04.211863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15011f67-d47d-4e0b-af10-e8fac372f553 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:04.212437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15011f67-d47d-4e0b-af10-e8fac372f553 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:04.213365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15011f67-d47d-4e0b-af10-e8fac372f553 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:04.214264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15011f67-d47d-4e0b-af10-e8fac372f553 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:04.214484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15011f67-d47d-4e0b-af10-e8fac372f553 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:04.311918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Updating instance_info_cache with network_info: [{"id": "f26cc28b-247d-4c43-ab4f-fc8cea284db2", "address": "fa:16:3e:a2:0a:a4", "network": {"id": "e0d9a993-a33f-4021-8fe8-2409a593643d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1342458713-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b3c9fc569ff43fc8c28ef7edeb1c62a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf26cc28b-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:49:04.351771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Releasing lock "refresh_cache-0c2ba8af-754a-4aaf-84e7-257aeb402178" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:49:04.353969 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a1332b97-a449-4414-aff7-75bff66045dc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "POST /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178/action" status: 202 len: 0 microversion: 2.1 time: 6.222184 Aug 27 02:49:04.361568 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1980/3760] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:48:58 2022] POST /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178/action => generated 0 bytes in 6231 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:49:04.371233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-adeec8b2-8357-49ed-94ba-c236c88198bd tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:04.399773 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-adeec8b2-8357-49ed-94ba-c236c88198bd tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.034779 Aug 27 02:49:04.402493 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1981/3761] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:49:04 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:04.410975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4f61ae2-ab8a-4f19-b29b-87900c442f1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:04.412413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4f61ae2-ab8a-4f19-b29b-87900c442f1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:04.423526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4f61ae2-ab8a-4f19-b29b-87900c442f1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:04.424131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4f61ae2-ab8a-4f19-b29b-87900c442f1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:04.424603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4f61ae2-ab8a-4f19-b29b-87900c442f1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:04.425413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4f61ae2-ab8a-4f19-b29b-87900c442f1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:04.425943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4f61ae2-ab8a-4f19-b29b-87900c442f1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:04.426393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4f61ae2-ab8a-4f19-b29b-87900c442f1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:04.912336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-15011f67-d47d-4e0b-af10-e8fac372f553 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:04.957466 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-15011f67-d47d-4e0b-af10-e8fac372f553 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.760873 Aug 27 02:49:04.983330 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1781/3762] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:04 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:05.028188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1c8d4121-c812-42b0-8d95-238b087bb58f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:05.029297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1c8d4121-c812-42b0-8d95-238b087bb58f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:05.046386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c8d4121-c812-42b0-8d95-238b087bb58f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:05.047379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c8d4121-c812-42b0-8d95-238b087bb58f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:05.048808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c8d4121-c812-42b0-8d95-238b087bb58f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:05.050066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c8d4121-c812-42b0-8d95-238b087bb58f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:05.051026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c8d4121-c812-42b0-8d95-238b087bb58f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:05.052521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c8d4121-c812-42b0-8d95-238b087bb58f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:05.060690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4f61ae2-ab8a-4f19-b29b-87900c442f1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:05.069804 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4f61ae2-ab8a-4f19-b29b-87900c442f1d tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1528 microversion: 2.1 time: 0.664780 Aug 27 02:49:05.082108 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1982/3763] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:04 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1528 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:05.098217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6cc95b7e-586f-4667-9840-efbcfe85c7a9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Action: 'create', calling method: .version_select at 0x7f4d291dab80>, body: {"server_group": {"name": "tempest-server-group-661441738", "policies": ["anti-affinity"]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:05.140555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-6cc95b7e-586f-4667-9840-efbcfe85c7a9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:05.149600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1c8d4121-c812-42b0-8d95-238b087bb58f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:49:05.160689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-6cc95b7e-586f-4667-9840-efbcfe85c7a9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:05.248484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-6cc95b7e-586f-4667-9840-efbcfe85c7a9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:05.267159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-6cc95b7e-586f-4667-9840-efbcfe85c7a9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_groups'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:05.310881 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6cc95b7e-586f-4667-9840-efbcfe85c7a9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.225926 Aug 27 02:49:05.311585 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1983/3764] 10.222.0.99 () {60 vars in 1173 bytes} [Sat Aug 27 02:49:05 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:05.328398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0af36c73-8fa0-4357-af39-f892c1312b3c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:05.338525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0af36c73-8fa0-4357-af39-f892c1312b3c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:05.359191 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1c8d4121-c812-42b0-8d95-238b087bb58f tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "DELETE /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 204 len: 0 microversion: 2.1 time: 0.354256 Aug 27 02:49:05.412419 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1782/3765] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:04 2022] DELETE /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:05.439400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-47ebdbd0-8d43-4e26-978a-32a9f2ec4e16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:05.442311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0af36c73-8fa0-4357-af39-f892c1312b3c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:05.446945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-47ebdbd0-8d43-4e26-978a-32a9f2ec4e16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:05.452493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0af36c73-8fa0-4357-af39-f892c1312b3c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:05.453454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0af36c73-8fa0-4357-af39-f892c1312b3c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:05.457105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0af36c73-8fa0-4357-af39-f892c1312b3c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:05.459825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0af36c73-8fa0-4357-af39-f892c1312b3c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:05.460778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47ebdbd0-8d43-4e26-978a-32a9f2ec4e16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:05.461154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0af36c73-8fa0-4357-af39-f892c1312b3c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:05.461416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47ebdbd0-8d43-4e26-978a-32a9f2ec4e16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:05.462149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47ebdbd0-8d43-4e26-978a-32a9f2ec4e16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:05.462955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47ebdbd0-8d43-4e26-978a-32a9f2ec4e16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:05.464164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47ebdbd0-8d43-4e26-978a-32a9f2ec4e16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:05.464874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47ebdbd0-8d43-4e26-978a-32a9f2ec4e16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:05.760807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-47ebdbd0-8d43-4e26-978a-32a9f2ec4e16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:05.771704 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-47ebdbd0-8d43-4e26-978a-32a9f2ec4e16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.348392 Aug 27 02:49:05.773363 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1783/3766] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:05 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:05.779233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-316c2308-885b-49f3-ba9c-11113baaa254 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:05.841043 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-316c2308-885b-49f3-ba9c-11113baaa254 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/2951ee1b-f455-4690-b68a-8c0707fd0057" status: 204 len: 0 microversion: 2.1 time: 0.061485 Aug 27 02:49:05.843184 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1784/3767] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:49:05 2022] DELETE /compute/v2.1/os-server-groups/2951ee1b-f455-4690-b68a-8c0707fd0057 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:05.862353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.158"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:05.873558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:05.884580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:05.885079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:05.885520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:05.886290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:05.886834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:05.887264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:05.917978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "refresh_cache-729c813c-9a69-418d-a6d8-d9f923b1c4f2" {{(pid=122487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:49:05.919100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquired lock "refresh_cache-729c813c-9a69-418d-a6d8-d9f923b1c4f2" {{(pid=122487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:49:06.232775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0af36c73-8fa0-4357-af39-f892c1312b3c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:06.255772 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0af36c73-8fa0-4357-af39-f892c1312b3c tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1354 microversion: 2.1 time: 0.942503 Aug 27 02:49:06.257480 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1984/3768] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:05 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1354 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:06.269132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-446dd042-d36a-41b6-ba9a-6686733b50c2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:06.291915 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-446dd042-d36a-41b6-ba9a-6686733b50c2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.031045 Aug 27 02:49:06.294783 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1985/3769] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:49:06 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:06.348077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-41af0c85-d09d-4e14-a139-c2ed952fdf7f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-396181283", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": -1, "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:06.395250 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-41af0c85-d09d-4e14-a139-c2ed952fdf7f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Flavor -1 could not be found. Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-41af0c85-d09d-4e14-a139-c2ed952fdf7f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 205 Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-396181283", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": -1, "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: exception: Flavor -1 could not be found. Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-396181283', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': -1, 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:06.400931 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-41af0c85-d09d-4e14-a139-c2ed952fdf7f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-41af0c85-d09d-4e14-a139-c2ed952fdf7f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.098000 Aug 27 02:49:06.406025 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1986/3770] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:06 2022] POST /compute/v2.1/servers => generated 73 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:49:06.422107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b2b98f59-4e95-4e4f-9350-da88a6846668 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:06.423154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b2b98f59-4e95-4e4f-9350-da88a6846668 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:06.454790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2b98f59-4e95-4e4f-9350-da88a6846668 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:06.456179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2b98f59-4e95-4e4f-9350-da88a6846668 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:06.457516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2b98f59-4e95-4e4f-9350-da88a6846668 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:06.459049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2b98f59-4e95-4e4f-9350-da88a6846668 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:06.459913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2b98f59-4e95-4e4f-9350-da88a6846668 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:06.476779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2b98f59-4e95-4e4f-9350-da88a6846668 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:07.168374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b2b98f59-4e95-4e4f-9350-da88a6846668 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96a627797d4943e294544d084a5bf814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af784466d744e7fbb40d43d6b6e62c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:07.196711 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b2b98f59-4e95-4e4f-9350-da88a6846668 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 200 len: 1528 microversion: 2.1 time: 0.785909 Aug 27 02:49:07.198730 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1987/3771] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:06 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 1528 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:07.205280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a4f7a0d-8955-46d3-8c4d-7437bb8655a4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:07.206397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4a4f7a0d-8955-46d3-8c4d-7437bb8655a4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:07.214120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4f7a0d-8955-46d3-8c4d-7437bb8655a4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:07.215180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4f7a0d-8955-46d3-8c4d-7437bb8655a4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:07.216002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4f7a0d-8955-46d3-8c4d-7437bb8655a4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:07.217088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4f7a0d-8955-46d3-8c4d-7437bb8655a4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:07.217871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4f7a0d-8955-46d3-8c4d-7437bb8655a4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:07.218581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4f7a0d-8955-46d3-8c4d-7437bb8655a4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:07.656850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4a4f7a0d-8955-46d3-8c4d-7437bb8655a4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:07.683810 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a4f7a0d-8955-46d3-8c4d-7437bb8655a4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.483220 Aug 27 02:49:07.685736 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1988/3772] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:07 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:07.697579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1186093996", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "717df722-e68e-4623-b41b-49c8afff3c51"}]}, "os:scheduler_hints": {"group": "b4cd854e-3cba-4526-a536-ea136d4ef9cd"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:07.847007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] validate_networks() for [('717df722-e68e-4623-b41b-49c8afff3c51', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:49:09.295489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:49:09.296832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:49:09.300128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:49:09.300773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:49:09.301209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:49:09.331523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:09.332485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:09.334020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:09.337416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:09.338887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:09.339842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:09.380728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:09.396785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:09.437172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:49:09.440192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:49:09.478658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:09.517028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:09.523475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:09.573469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:09.581560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Getting quotas for user 489a94b2c2df4608b25ba4bbf2737814 and project a9b22b9201e64f1594fc84d898f188d8. Resources: {'server_group_members'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:09.616087 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-09487fb9-7b17-49dc-b43e-c13e41e00102 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.927464 Aug 27 02:49:09.617349 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1989/3773] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:49:09.622861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0be1b902-7097-4757-aec7-b15e01cd931f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:09.624096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0be1b902-7097-4757-aec7-b15e01cd931f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:09.634431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0be1b902-7097-4757-aec7-b15e01cd931f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:09.635210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0be1b902-7097-4757-aec7-b15e01cd931f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:09.635850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0be1b902-7097-4757-aec7-b15e01cd931f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:09.637942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0be1b902-7097-4757-aec7-b15e01cd931f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:09.638630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0be1b902-7097-4757-aec7-b15e01cd931f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:09.639581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0be1b902-7097-4757-aec7-b15e01cd931f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:09.959059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0be1b902-7097-4757-aec7-b15e01cd931f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:09.970770 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0be1b902-7097-4757-aec7-b15e01cd931f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1805 microversion: 2.1 time: 0.352065 Aug 27 02:49:09.971408 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1990/3774] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:09 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1805 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:09.979912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3f84fd9e-4ae5-413e-accd-ecf6e14d3ba6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:09.981022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3f84fd9e-4ae5-413e-accd-ecf6e14d3ba6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:09.998790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f84fd9e-4ae5-413e-accd-ecf6e14d3ba6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:09.999248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f84fd9e-4ae5-413e-accd-ecf6e14d3ba6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:10.000556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f84fd9e-4ae5-413e-accd-ecf6e14d3ba6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:10.000887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f84fd9e-4ae5-413e-accd-ecf6e14d3ba6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:10.001374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f84fd9e-4ae5-413e-accd-ecf6e14d3ba6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:10.001907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f84fd9e-4ae5-413e-accd-ecf6e14d3ba6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:10.265906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Building network info cache for instance {{(pid=122487) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:49:10.278227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3f84fd9e-4ae5-413e-accd-ecf6e14d3ba6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:10.330752 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3f84fd9e-4ae5-413e-accd-ecf6e14d3ba6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.351767 Aug 27 02:49:10.333322 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1991/3775] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:09 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:10.358177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:10.360008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: 635f24c5-9ee5-4edd-8900-c4f37390ff84] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:10.386735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:10.396579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:10.398531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:10.404258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:10.409974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:10.411413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:10.504551 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] HTTP exception thrown: Instance 635f24c5-9ee5-4edd-8900-c4f37390ff84 could not be found. Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 HTTP/1.1 Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 635f24c5-9ee5-4edd-8900-c4f37390ff84 could not be found. Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '635f24c5-9ee5-4edd-8900-c4f37390ff84'} Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635f24c5-9ee5-4edd-8900-c4f37390ff84 could not be found. Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635f24c5-9ee5-4edd-8900-c4f37390ff84 could not be found. Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:10.516676 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:10.523474 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:10.523474 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:10.523474 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:10.523474 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:10.523474 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:10.523474 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:10.523474 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635f24c5-9ee5-4edd-8900-c4f37390ff84 could not be found. Aug 27 02:49:10.523474 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:10.526361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 404 to user: Instance 635f24c5-9ee5-4edd-8900-c4f37390ff84 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:10.531689 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-525f9790-5a97-4598-a4d2-a7b30541eb62 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84" status: 404 len: 111 microversion: 2.1 time: 0.188874 Aug 27 02:49:10.533174 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1992/3776] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:10 2022] GET /compute/v2.1/servers/635f24c5-9ee5-4edd-8900-c4f37390ff84 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:10.556805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-feec41d3-e0ff-4d0d-90b6-f616d63829ea req-46215562-223d-4630-bf38-0e46c54e54cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635f24c5-9ee5-4edd-8900-c4f37390ff84", "name": "network-vif-deleted", "tag": "98430134-569d-4143-9520-ba734f558738"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:10.601317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-feec41d3-e0ff-4d0d-90b6-f616d63829ea req-46215562-223d-4630-bf38-0e46c54e54cf service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:10.602539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-feec41d3-e0ff-4d0d-90b6-f616d63829ea req-46215562-223d-4630-bf38-0e46c54e54cf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:10.606867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-feec41d3-e0ff-4d0d-90b6-f616d63829ea req-46215562-223d-4630-bf38-0e46c54e54cf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:10.660682 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-feec41d3-e0ff-4d0d-90b6-f616d63829ea req-46215562-223d-4630-bf38-0e46c54e54cf service nova] Creating event network-vif-deleted:98430134-569d-4143-9520-ba734f558738 for instance 635f24c5-9ee5-4edd-8900-c4f37390ff84 on n-h2-852084-5 Aug 27 02:49:10.675662 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-feec41d3-e0ff-4d0d-90b6-f616d63829ea req-46215562-223d-4630-bf38-0e46c54e54cf service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138930 Aug 27 02:49:10.679196 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1993/3777] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:10.693062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-5df3e9f3-e60f-4d20-80e5-c4a5fd66bb72 req-cbd7e090-09e1-44fd-8b08-4334be9061d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2ba8af-754a-4aaf-84e7-257aeb402178", "name": "network-vif-deleted", "tag": "f26cc28b-247d-4c43-ab4f-fc8cea284db2"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:10.741646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5df3e9f3-e60f-4d20-80e5-c4a5fd66bb72 req-cbd7e090-09e1-44fd-8b08-4334be9061d2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:10.746299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5df3e9f3-e60f-4d20-80e5-c4a5fd66bb72 req-cbd7e090-09e1-44fd-8b08-4334be9061d2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:10.748965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5df3e9f3-e60f-4d20-80e5-c4a5fd66bb72 req-cbd7e090-09e1-44fd-8b08-4334be9061d2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:10.801217 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-5df3e9f3-e60f-4d20-80e5-c4a5fd66bb72 req-cbd7e090-09e1-44fd-8b08-4334be9061d2 service nova] Creating event network-vif-deleted:f26cc28b-247d-4c43-ab4f-fc8cea284db2 for instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 on n-h1-852084-5 Aug 27 02:49:10.816687 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-5df3e9f3-e60f-4d20-80e5-c4a5fd66bb72 req-cbd7e090-09e1-44fd-8b08-4334be9061d2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130121 Aug 27 02:49:10.819588 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1994/3778] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:10.830896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b7431691-8258-45d8-b657-6430786a7f57 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:10.832234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b7431691-8258-45d8-b657-6430786a7f57 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:10.847025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7431691-8258-45d8-b657-6430786a7f57 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:10.847952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7431691-8258-45d8-b657-6430786a7f57 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:10.849238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7431691-8258-45d8-b657-6430786a7f57 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:10.852748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7431691-8258-45d8-b657-6430786a7f57 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:10.854043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7431691-8258-45d8-b657-6430786a7f57 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:10.855219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7431691-8258-45d8-b657-6430786a7f57 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:11.118409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b7431691-8258-45d8-b657-6430786a7f57 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:11.155327 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b7431691-8258-45d8-b657-6430786a7f57 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1217 microversion: 2.1 time: 0.333409 Aug 27 02:49:11.173703 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1995/3779] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:10 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1217 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:11.189707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-89d65589-e20b-46ae-8d80-d366d8c055be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:11.189707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-89d65589-e20b-46ae-8d80-d366d8c055be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:11.205712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89d65589-e20b-46ae-8d80-d366d8c055be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:11.206531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89d65589-e20b-46ae-8d80-d366d8c055be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:11.217907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89d65589-e20b-46ae-8d80-d366d8c055be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:11.219450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89d65589-e20b-46ae-8d80-d366d8c055be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:11.220254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89d65589-e20b-46ae-8d80-d366d8c055be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:11.221017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89d65589-e20b-46ae-8d80-d366d8c055be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:11.293578 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-89d65589-e20b-46ae-8d80-d366d8c055be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6/ips" status: 200 len: 219 microversion: 2.1 time: 0.128347 Aug 27 02:49:11.295414 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1996/3780] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 02:49:11 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6/ips => generated 219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:11.315783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-289dcc05-fadb-411e-9f0e-18b7c690b347 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '.version_select at 0x7f4d2e803160>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:11.359218 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-289dcc05-fadb-411e-9f0e-18b7c690b347 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] HTTP exception thrown: Image not found. Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-289dcc05-fadb-411e-9f0e-18b7c690b347 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/images/3b064ca9-3148-446c-be4d-769e3a585936 HTTP/1.1 Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '3b064ca9-3148-446c-be4d-769e3a585936'} Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3b064ca9-3148-446c-be4d-769e3a585936 to delete Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3b064ca9-3148-446c-be4d-769e3a585936 could not be found. Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:11.361171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-289dcc05-fadb-411e-9f0e-18b7c690b347 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-289dcc05-fadb-411e-9f0e-18b7c690b347 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "DELETE /compute/v2.1/images/3b064ca9-3148-446c-be4d-769e3a585936" status: 404 len: 62 microversion: 2.1 time: 0.065154 Aug 27 02:49:11.366635 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1997/3781] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:11 2022] DELETE /compute/v2.1/images/3b064ca9-3148-446c-be4d-769e3a585936 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:49:11.372232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9695b533-4815-482e-b888-8a9508346ecf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-908990469", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9695b533-4815-482e-b888-8a9508346ecf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 172 Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-908990469", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-908990469', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi -1 Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:49:11.379773 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 27 02:49:11.386900 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.391589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9695b533-4815-482e-b888-8a9508346ecf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:11.393726 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9695b533-4815-482e-b888-8a9508346ecf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.029444 Aug 27 02:49:11.403544 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1998/3782] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:11 2022] POST /compute/v2.1/servers => generated 145 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:49:11.417391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9fd5c82a-de50-4a22-83da-914498205366 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:11.419339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9fd5c82a-de50-4a22-83da-914498205366 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:11.450215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fd5c82a-de50-4a22-83da-914498205366 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:11.451843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fd5c82a-de50-4a22-83da-914498205366 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:11.452923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fd5c82a-de50-4a22-83da-914498205366 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:11.456328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fd5c82a-de50-4a22-83da-914498205366 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:11.458703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fd5c82a-de50-4a22-83da-914498205366 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:11.459293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fd5c82a-de50-4a22-83da-914498205366 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:11.574637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9fd5c82a-de50-4a22-83da-914498205366 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:49:11.675937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3,nova_cell1:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:11.822725 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9fd5c82a-de50-4a22-83da-914498205366 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 204 len: 0 microversion: 2.1 time: 0.416598 Aug 27 02:49:11.828830 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 1999/3783] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:11 2022] DELETE /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:11.847855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:11.848971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:11.879137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:11.879977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:11.884592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:11.886506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:11.891303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:11.893023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:11.928838 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] HTTP exception thrown: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 HTTP/1.1 Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'c5a94dab-d39c-4da5-9e11-1f90cbe1ed32'} Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:11.930821 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:11.935453 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:49:11.935453 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.935453 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:11.935453 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.935453 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:11.935453 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:11.935453 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:11.935453 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:11.935453 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:11.935453 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:49:11.935453 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:11.938088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 404 to user: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:11.939361 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5506f9a8-0ab8-4e75-b9e8-caf59f6c2175 tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "DELETE /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 404 len: 111 microversion: 2.1 time: 0.110542 Aug 27 02:49:11.943748 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2000/3784] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:11 2022] DELETE /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:11.950382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f19c105b-2b86-4626-abe2-ba3f577d7203 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:11.951456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f19c105b-2b86-4626-abe2-ba3f577d7203 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:11.964666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19c105b-2b86-4626-abe2-ba3f577d7203 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:11.965587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19c105b-2b86-4626-abe2-ba3f577d7203 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:11.966377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19c105b-2b86-4626-abe2-ba3f577d7203 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:11.967453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19c105b-2b86-4626-abe2-ba3f577d7203 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:11.968204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19c105b-2b86-4626-abe2-ba3f577d7203 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:11.968882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19c105b-2b86-4626-abe2-ba3f577d7203 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:12.333731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f19c105b-2b86-4626-abe2-ba3f577d7203 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:12.359103 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f19c105b-2b86-4626-abe2-ba3f577d7203 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.412589 Aug 27 02:49:12.374244 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2001/3785] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:11 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:12.595998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=24 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:12.784813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-56049f42-16a8-4a0e-85db-7c7c5cdb24f4 tempest-ComputeTenantNetworksTest-1148386490 tempest-ComputeTenantNetworksTest-1148386490-project] Calling method '.version_select at 0x7f4d2a96b280>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:13.301014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Updating instance_info_cache with network_info: [{"id": "00c7f942-8e70-4330-89b9-f94a286f91c8", "address": "fa:16:3e:4d:c1:08", "network": {"id": "e0d9a993-a33f-4021-8fe8-2409a593643d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1342458713-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b3c9fc569ff43fc8c28ef7edeb1c62a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap00c7f942-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122487) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:49:13.339231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Releasing lock "refresh_cache-729c813c-9a69-418d-a6d8-d9f923b1c4f2" {{(pid=122487) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:49:13.341290 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a05feae-df83-47f0-a4b9-d64af112a3df tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "POST /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2/action" status: 202 len: 0 microversion: 2.1 time: 7.495675 Aug 27 02:49:13.345695 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1785/3786] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:05 2022] POST /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2/action => generated 0 bytes in 7501 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:49:13.373571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dfacf0ec-1a02-4a2d-aa5c-351dea4f59eb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:13.377080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dfacf0ec-1a02-4a2d-aa5c-351dea4f59eb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:13.413421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfacf0ec-1a02-4a2d-aa5c-351dea4f59eb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:13.414352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfacf0ec-1a02-4a2d-aa5c-351dea4f59eb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:13.415140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfacf0ec-1a02-4a2d-aa5c-351dea4f59eb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:13.416425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfacf0ec-1a02-4a2d-aa5c-351dea4f59eb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:13.417263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfacf0ec-1a02-4a2d-aa5c-351dea4f59eb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:13.418358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfacf0ec-1a02-4a2d-aa5c-351dea4f59eb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:13.705440 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-56049f42-16a8-4a0e-85db-7c7c5cdb24f4 tempest-ComputeTenantNetworksTest-1148386490 tempest-ComputeTenantNetworksTest-1148386490-project] 10.222.0.99 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 421 microversion: 2.1 time: 1.329219 Aug 27 02:49:13.714530 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2002/3787] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:49:12 2022] GET /compute/v2.1/os-tenant-networks => generated 421 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:13.721437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:13.722522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: c5a94dab-d39c-4da5-9e11-1f90cbe1ed32] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:13.741817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:13.742752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:13.745880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:13.746900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:13.749556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:13.750284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:13.785848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dfacf0ec-1a02-4a2d-aa5c-351dea4f59eb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:13.794073 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] HTTP exception thrown: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 HTTP/1.1 Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'c5a94dab-d39c-4da5-9e11-1f90cbe1ed32'} Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:13.795723 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:13.800166 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:13.800166 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:13.800166 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:13.800166 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:13.800166 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:13.800166 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:13.800166 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. Aug 27 02:49:13.800166 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:13.802465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 404 to user: Instance c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:13.803573 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-94f3a49f-41f4-4775-95d2-d8bd36beed8b tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32" status: 404 len: 111 microversion: 2.1 time: 0.087758 Aug 27 02:49:13.812508 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2003/3788] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:13 2022] GET /compute/v2.1/servers/c5a94dab-d39c-4da5-9e11-1f90cbe1ed32 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:13.821216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad0fd242-99b4-49aa-a740-14d25e9138f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:13.822322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ad0fd242-99b4-49aa-a740-14d25e9138f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:13.837032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad0fd242-99b4-49aa-a740-14d25e9138f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:13.840837 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dfacf0ec-1a02-4a2d-aa5c-351dea4f59eb tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1811 microversion: 2.1 time: 0.488314 Aug 27 02:49:13.841830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad0fd242-99b4-49aa-a740-14d25e9138f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:13.842546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad0fd242-99b4-49aa-a740-14d25e9138f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:13.844716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad0fd242-99b4-49aa-a740-14d25e9138f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:13.845526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad0fd242-99b4-49aa-a740-14d25e9138f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:13.846400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad0fd242-99b4-49aa-a740-14d25e9138f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:13.856108 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1786/3789] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:13 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1811 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:13.867231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5967fc23-ffda-48f4-8355-9647b1db0515 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:13.869622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5967fc23-ffda-48f4-8355-9647b1db0515 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:13.884204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5967fc23-ffda-48f4-8355-9647b1db0515 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:13.885892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5967fc23-ffda-48f4-8355-9647b1db0515 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:13.886601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5967fc23-ffda-48f4-8355-9647b1db0515 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:13.887569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5967fc23-ffda-48f4-8355-9647b1db0515 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:13.888401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5967fc23-ffda-48f4-8355-9647b1db0515 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:13.889119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5967fc23-ffda-48f4-8355-9647b1db0515 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:14.277501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5967fc23-ffda-48f4-8355-9647b1db0515 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:14.302014 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5967fc23-ffda-48f4-8355-9647b1db0515 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.443821 Aug 27 02:49:14.305117 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1787/3790] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:13 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:14.321065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-25be5433-7d8f-4c42-a801-8688665a6610 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '.version_select at 0x7f4d2957fdc0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:14.333182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad0fd242-99b4-49aa-a740-14d25e9138f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:14.364484 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad0fd242-99b4-49aa-a740-14d25e9138f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1271 microversion: 2.1 time: 0.550151 Aug 27 02:49:14.365425 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2004/3791] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:13 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1271 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:14.374953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1a888d79-d22b-40e7-97cc-9688a5e21b70 req-bada14bb-8af0-4df8-a903-294cda0590ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729c813c-9a69-418d-a6d8-d9f923b1c4f2", "tag": "00c7f942-8e70-4330-89b9-f94a286f91c8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:14.412259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1a888d79-d22b-40e7-97cc-9688a5e21b70 req-bada14bb-8af0-4df8-a903-294cda0590ec service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:14.413196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1a888d79-d22b-40e7-97cc-9688a5e21b70 req-bada14bb-8af0-4df8-a903-294cda0590ec service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:14.414033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1a888d79-d22b-40e7-97cc-9688a5e21b70 req-bada14bb-8af0-4df8-a903-294cda0590ec service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:14.449571 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1a888d79-d22b-40e7-97cc-9688a5e21b70 req-bada14bb-8af0-4df8-a903-294cda0590ec service nova] Creating event network-changed:00c7f942-8e70-4330-89b9-f94a286f91c8 for instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 on n-h2-852084-5 Aug 27 02:49:14.460071 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1a888d79-d22b-40e7-97cc-9688a5e21b70 req-bada14bb-8af0-4df8-a903-294cda0590ec service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091875 Aug 27 02:49:14.462405 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2005/3792] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:14.469822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff386cfc-0afc-42f2-8ddd-b051c903d9f9 tempest-ComputeTenantNetworksTest-1148386490 tempest-ComputeTenantNetworksTest-1148386490-project] Calling method '.version_select at 0x7f4d2e7fe310>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:14.964270 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff386cfc-0afc-42f2-8ddd-b051c903d9f9 tempest-ComputeTenantNetworksTest-1148386490 tempest-ComputeTenantNetworksTest-1148386490-project] 10.222.0.99 "GET /compute/v2.1/os-tenant-networks/8ee33d13-7618-4110-a3ba-6433b1889345" status: 200 len: 140 microversion: 2.1 time: 0.500047 Aug 27 02:49:14.965247 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2006/3793] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:49:14 2022] GET /compute/v2.1/os-tenant-networks/8ee33d13-7618-4110-a3ba-6433b1889345 => generated 140 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:14.970864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11127129-7b10-4825-ad92-4c8f798b59dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '.version_select at 0x7f4d2991d310>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:15.008724 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11127129-7b10-4825-ad92-4c8f798b59dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822803637" status: 202 len: 0 microversion: 2.1 time: 0.041553 Aug 27 02:49:15.010790 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2007/3794] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822803637 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:49:15.018151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6bf24b02-f99e-449e-afbb-8ff950a1445b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-965099961", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:15.027273 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-6bf24b02-f99e-449e-afbb-8ff950a1445b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6bf24b02-f99e-449e-afbb-8ff950a1445b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 215 Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-965099961", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-965099961', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:15.031573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:15.038906 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:15.038906 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:15.038906 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:15.038906 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:15.038906 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:15.038906 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:15.038906 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 27 02:49:15.038906 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:15.040392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6bf24b02-f99e-449e-afbb-8ff950a1445b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:15.040392 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6bf24b02-f99e-449e-afbb-8ff950a1445b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.026887 Aug 27 02:49:15.040732 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2008/3795] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:15 2022] POST /compute/v2.1/servers => generated 123 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:49:15.060387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dc8a21a4-c033-4d2f-9f48-3d326e3d634e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:15.062264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dc8a21a4-c033-4d2f-9f48-3d326e3d634e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:15.070769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc8a21a4-c033-4d2f-9f48-3d326e3d634e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:15.071763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc8a21a4-c033-4d2f-9f48-3d326e3d634e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:15.072473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc8a21a4-c033-4d2f-9f48-3d326e3d634e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:15.073444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc8a21a4-c033-4d2f-9f48-3d326e3d634e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:15.074262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc8a21a4-c033-4d2f-9f48-3d326e3d634e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:15.074951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc8a21a4-c033-4d2f-9f48-3d326e3d634e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:15.285916 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-25be5433-7d8f-4c42-a801-8688665a6610 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/os-floating-ips/4409319e-0d2c-497d-800e-2cab5c1828c0" status: 200 len: 184 microversion: 2.1 time: 0.975959 Aug 27 02:49:15.299123 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1788/3796] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:49:14 2022] GET /compute/v2.1/os-floating-ips/4409319e-0d2c-497d-800e-2cab5c1828c0 => generated 184 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:15.313654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1dc674cf-deb2-4943-9dce-b17f730145f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:15.314676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1dc674cf-deb2-4943-9dce-b17f730145f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:15.325404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dc674cf-deb2-4943-9dce-b17f730145f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:15.326424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dc674cf-deb2-4943-9dce-b17f730145f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:15.327096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dc674cf-deb2-4943-9dce-b17f730145f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:15.328059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dc674cf-deb2-4943-9dce-b17f730145f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:15.328733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dc674cf-deb2-4943-9dce-b17f730145f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:15.329848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dc674cf-deb2-4943-9dce-b17f730145f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:15.653553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dc8a21a4-c033-4d2f-9f48-3d326e3d634e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:15.670010 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dc8a21a4-c033-4d2f-9f48-3d326e3d634e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1811 microversion: 2.1 time: 0.627785 Aug 27 02:49:15.671952 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2009/3797] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:15 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1811 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:15.680984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.158"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:16.465820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:16.479765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:16.480671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:16.481996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:16.483175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:16.483743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:16.484254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:16.687046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1dc674cf-deb2-4943-9dce-b17f730145f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:16.703852 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1dc674cf-deb2-4943-9dce-b17f730145f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.403201 Aug 27 02:49:16.705470 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1789/3798] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:15 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:16.712946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-82086c18-379a-4b1c-a2ee-10caac83c8b8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:16.714023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-82086c18-379a-4b1c-a2ee-10caac83c8b8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:16.727456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82086c18-379a-4b1c-a2ee-10caac83c8b8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:16.728338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82086c18-379a-4b1c-a2ee-10caac83c8b8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:16.729001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82086c18-379a-4b1c-a2ee-10caac83c8b8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:16.730034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82086c18-379a-4b1c-a2ee-10caac83c8b8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:16.730697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82086c18-379a-4b1c-a2ee-10caac83c8b8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:16.731409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82086c18-379a-4b1c-a2ee-10caac83c8b8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:17.253329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "refresh_cache-729c813c-9a69-418d-a6d8-d9f923b1c4f2" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:49:17.255465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquired lock "refresh_cache-729c813c-9a69-418d-a6d8-d9f923b1c4f2" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:49:17.468961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-82086c18-379a-4b1c-a2ee-10caac83c8b8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:17.502825 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-82086c18-379a-4b1c-a2ee-10caac83c8b8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1313 microversion: 2.1 time: 0.795825 Aug 27 02:49:17.503618 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1790/3799] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:16 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1313 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:17.523255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8b8e66fc-9a6b-463b-8113-88233413f0e0 req-74c6a905-9256-4c13-b8ee-1a4be7bf8011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6", "name": "network-vif-deleted", "tag": "44cf6fb5-e006-4840-91d8-c9247c84debd"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:17.541640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8b8e66fc-9a6b-463b-8113-88233413f0e0 req-74c6a905-9256-4c13-b8ee-1a4be7bf8011 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:17.542759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8b8e66fc-9a6b-463b-8113-88233413f0e0 req-74c6a905-9256-4c13-b8ee-1a4be7bf8011 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:17.543887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8b8e66fc-9a6b-463b-8113-88233413f0e0 req-74c6a905-9256-4c13-b8ee-1a4be7bf8011 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:17.572790 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8b8e66fc-9a6b-463b-8113-88233413f0e0 req-74c6a905-9256-4c13-b8ee-1a4be7bf8011 service nova] Creating event network-vif-deleted:44cf6fb5-e006-4840-91d8-c9247c84debd for instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 on n-h2-852084-5 Aug 27 02:49:17.585500 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8b8e66fc-9a6b-463b-8113-88233413f0e0 req-74c6a905-9256-4c13-b8ee-1a4be7bf8011 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077504 Aug 27 02:49:17.587400 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1791/3800] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:17.602761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-83cb8e80-4da2-4df8-92c6-a8e1539f34e6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:17.604715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-83cb8e80-4da2-4df8-92c6-a8e1539f34e6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:17.633255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83cb8e80-4da2-4df8-92c6-a8e1539f34e6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:17.634357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83cb8e80-4da2-4df8-92c6-a8e1539f34e6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:17.635101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83cb8e80-4da2-4df8-92c6-a8e1539f34e6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:17.637128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83cb8e80-4da2-4df8-92c6-a8e1539f34e6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:17.638251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83cb8e80-4da2-4df8-92c6-a8e1539f34e6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:17.639401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83cb8e80-4da2-4df8-92c6-a8e1539f34e6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:18.186930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-83cb8e80-4da2-4df8-92c6-a8e1539f34e6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:18.212524 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-83cb8e80-4da2-4df8-92c6-a8e1539f34e6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1769 microversion: 2.1 time: 0.622506 Aug 27 02:49:18.231271 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1792/3801] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:17 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1769 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:18.245421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5cd2a09f-20b5-4317-b8a8-88f947bfcdf5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:18.246214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5cd2a09f-20b5-4317-b8a8-88f947bfcdf5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:18.257275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cd2a09f-20b5-4317-b8a8-88f947bfcdf5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:18.258361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cd2a09f-20b5-4317-b8a8-88f947bfcdf5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:18.260929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cd2a09f-20b5-4317-b8a8-88f947bfcdf5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:18.267536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cd2a09f-20b5-4317-b8a8-88f947bfcdf5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:18.268923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cd2a09f-20b5-4317-b8a8-88f947bfcdf5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:18.270174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cd2a09f-20b5-4317-b8a8-88f947bfcdf5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:18.793557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5cd2a09f-20b5-4317-b8a8-88f947bfcdf5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:18.808759 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5cd2a09f-20b5-4317-b8a8-88f947bfcdf5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.576254 Aug 27 02:49:18.820906 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1793/3802] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:18 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:18.824886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-861c1e68-862e-42a1-9c65-9dca85e0f33a tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:18.825520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-861c1e68-862e-42a1-9c65-9dca85e0f33a tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:18.850229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-861c1e68-862e-42a1-9c65-9dca85e0f33a tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:18.850883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-861c1e68-862e-42a1-9c65-9dca85e0f33a tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:18.851354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-861c1e68-862e-42a1-9c65-9dca85e0f33a tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:18.852226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-861c1e68-862e-42a1-9c65-9dca85e0f33a tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:18.852700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-861c1e68-862e-42a1-9c65-9dca85e0f33a tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:18.853436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-861c1e68-862e-42a1-9c65-9dca85e0f33a tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:18.861632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:19.358304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:19.384789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-861c1e68-862e-42a1-9c65-9dca85e0f33a tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:19.399921 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-861c1e68-862e-42a1-9c65-9dca85e0f33a tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1313 microversion: 2.1 time: 0.587999 Aug 27 02:49:19.401166 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1794/3803] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:18 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:19.424238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3f4fd6f6-b3a9-400f-a6ae-f84bb4da11c1 req-04439566-f065-44f6-a64a-d41f077d5661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2536f5b-e15e-45db-8324-57a821c589d0", "tag": "f22811c5-a1cc-4eaa-bbde-653473e7e38d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:19.453996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3f4fd6f6-b3a9-400f-a6ae-f84bb4da11c1 req-04439566-f065-44f6-a64a-d41f077d5661 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:19.454490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3f4fd6f6-b3a9-400f-a6ae-f84bb4da11c1 req-04439566-f065-44f6-a64a-d41f077d5661 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:19.458408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3f4fd6f6-b3a9-400f-a6ae-f84bb4da11c1 req-04439566-f065-44f6-a64a-d41f077d5661 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:19.487844 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3f4fd6f6-b3a9-400f-a6ae-f84bb4da11c1 req-04439566-f065-44f6-a64a-d41f077d5661 service nova] Creating event network-changed:f22811c5-a1cc-4eaa-bbde-653473e7e38d for instance d2536f5b-e15e-45db-8324-57a821c589d0 on n-h1-852084-5 Aug 27 02:49:19.495575 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3f4fd6f6-b3a9-400f-a6ae-f84bb4da11c1 req-04439566-f065-44f6-a64a-d41f077d5661 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092776 Aug 27 02:49:19.499744 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1795/3804] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:19.516183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ae953465-7819-403d-93fb-809bca820a7a req-97205e45-0cfe-42f5-b3d7-ed9f9b05e851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6", "name": "network-vif-unplugged", "status": "completed", "tag": "bf7e1285-ec6b-4d91-818f-c74ed2d02185"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:19.535306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ae953465-7819-403d-93fb-809bca820a7a req-97205e45-0cfe-42f5-b3d7-ed9f9b05e851 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:19.535803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ae953465-7819-403d-93fb-809bca820a7a req-97205e45-0cfe-42f5-b3d7-ed9f9b05e851 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:19.537404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ae953465-7819-403d-93fb-809bca820a7a req-97205e45-0cfe-42f5-b3d7-ed9f9b05e851 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:19.569951 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ae953465-7819-403d-93fb-809bca820a7a req-97205e45-0cfe-42f5-b3d7-ed9f9b05e851 service nova] Creating event network-vif-unplugged:bf7e1285-ec6b-4d91-818f-c74ed2d02185 for instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 on n-h2-852084-5 Aug 27 02:49:19.578627 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ae953465-7819-403d-93fb-809bca820a7a req-97205e45-0cfe-42f5-b3d7-ed9f9b05e851 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077396 Aug 27 02:49:19.579761 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1796/3805] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:19.588799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8350640-3469-47bd-a5d1-6b22db022fdb tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '.version_select at 0x7f4d29565ca0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:19.590916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=30 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:19.656351 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e8350640-3469-47bd-a5d1-6b22db022fdb tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] HTTP exception thrown: Image not found. Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8350640-3469-47bd-a5d1-6b22db022fdb tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/images/5f01d73e-7ba0-435a-88a5-e71125bc95a0 HTTP/1.1 Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: exception: Image not found. Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5f01d73e-7ba0-435a-88a5-e71125bc95a0'} Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5f01d73e-7ba0-435a-88a5-e71125bc95a0 to delete Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5f01d73e-7ba0-435a-88a5-e71125bc95a0 could not be found. Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:19.658819 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:49:19.664877 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:19.672313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8350640-3469-47bd-a5d1-6b22db022fdb tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 404 to user: Image not found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:19.673967 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e8350640-3469-47bd-a5d1-6b22db022fdb tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "DELETE /compute/v2.1/images/5f01d73e-7ba0-435a-88a5-e71125bc95a0" status: 404 len: 62 microversion: 2.1 time: 0.093015 Aug 27 02:49:19.679575 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1797/3806] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:19 2022] DELETE /compute/v2.1/images/5f01d73e-7ba0-435a-88a5-e71125bc95a0 => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:49:19.692898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ad71a1fa-4f51-4482-9f7d-5d3456e7aa2f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-716101538", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "key_name": "tempest-key-2091815225", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:19.919900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-ad71a1fa-4f51-4482-9f7d-5d3456e7aa2f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] validate_networks() for [('7f5f647c-3eb3-4e25-8f1b-498211cb650b', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:49:20.580143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Building network info cache for instance {{(pid=122488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:49:20.905974 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-ad71a1fa-4f51-4482-9f7d-5d3456e7aa2f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Invalid key_name provided. Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ad71a1fa-4f51-4482-9f7d-5d3456e7aa2f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 246 Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-716101538", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "key_name": "tempest-key-2091815225", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid key_name provided. Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-716101538', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'key_name': 'tempest-key-2091815225', 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2091815225 not found for user ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:20.913880 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 27 02:49:20.923649 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:20.932227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ad71a1fa-4f51-4482-9f7d-5d3456e7aa2f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Invalid key_name provided. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:20.933773 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ad71a1fa-4f51-4482-9f7d-5d3456e7aa2f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.257061 Aug 27 02:49:20.942062 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1798/3807] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:19 2022] POST /compute/v2.1/servers => generated 70 bytes in 1266 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 27 02:49:20.957477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:20.959781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:20.974581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:20.976387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:20.977473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:20.979099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:20.980626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:20.982810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.103411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:21.104593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:21.105605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.107993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lazy-loading 'fault' on Instance uuid 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:49:21.664854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:21.678093 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42104ba1-b31d-4507-8d48-017700e0557f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 200 len: 1302 microversion: 2.1 time: 0.727752 Aug 27 02:49:21.679424 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1799/3808] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:20 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 1302 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:21.694882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:21.699901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:21.721637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:21.722615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:21.723240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.725187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:21.728703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:21.730620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.789108 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] HTTP exception thrown: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 HTTP/1.1 Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f5d77305-6bf5-4d11-bb93-187f23a42307'} Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:21.792735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:21.798314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:49:21.798314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:21.798314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:21.798314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:21.798314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:21.798314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:21.798314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:21.798314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:21.798314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:21.798314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:49:21.798314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:21.800144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 404 to user: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:21.802971 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1d6850de-4c08-47e2-9542-400e9c6eacfc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 404 len: 111 microversion: 2.1 time: 0.120726 Aug 27 02:49:21.805140 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1800/3809] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:21 2022] DELETE /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:21.817464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-299bf4ba-8e5c-4fec-94d4-8108c7006431 req-d283964a-21e4-4d5d-9b13-cc5e483b97db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6", "name": "network-vif-deleted", "tag": "8607c35c-e3a4-4738-bb5e-bc5077916026"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:21.847387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-299bf4ba-8e5c-4fec-94d4-8108c7006431 req-d283964a-21e4-4d5d-9b13-cc5e483b97db service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:21.848914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-299bf4ba-8e5c-4fec-94d4-8108c7006431 req-d283964a-21e4-4d5d-9b13-cc5e483b97db service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:21.850309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-299bf4ba-8e5c-4fec-94d4-8108c7006431 req-d283964a-21e4-4d5d-9b13-cc5e483b97db service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.879761 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-299bf4ba-8e5c-4fec-94d4-8108c7006431 req-d283964a-21e4-4d5d-9b13-cc5e483b97db service nova] Creating event network-vif-deleted:8607c35c-e3a4-4738-bb5e-bc5077916026 for instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 on n-h2-852084-5 Aug 27 02:49:21.891909 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-299bf4ba-8e5c-4fec-94d4-8108c7006431 req-d283964a-21e4-4d5d-9b13-cc5e483b97db service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084328 Aug 27 02:49:21.894152 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1801/3810] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:21.908541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7c1e72d-bee4-49d3-ab72-ad84d03bd1e9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:21.913905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7c1e72d-bee4-49d3-ab72-ad84d03bd1e9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:21.929320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c1e72d-bee4-49d3-ab72-ad84d03bd1e9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:21.930822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c1e72d-bee4-49d3-ab72-ad84d03bd1e9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:21.932846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c1e72d-bee4-49d3-ab72-ad84d03bd1e9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.936381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c1e72d-bee4-49d3-ab72-ad84d03bd1e9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:21.938442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c1e72d-bee4-49d3-ab72-ad84d03bd1e9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:21.941359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c1e72d-bee4-49d3-ab72-ad84d03bd1e9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:21.986956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Updating instance_info_cache with network_info: [{"id": "00c7f942-8e70-4330-89b9-f94a286f91c8", "address": "fa:16:3e:4d:c1:08", "network": {"id": "e0d9a993-a33f-4021-8fe8-2409a593643d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1342458713-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b3c9fc569ff43fc8c28ef7edeb1c62a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap00c7f942-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:49:22.010767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Releasing lock "refresh_cache-729c813c-9a69-418d-a6d8-d9f923b1c4f2" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:49:22.012121 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cd629eba-2b57-4726-bb3a-cee6322a20c2 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "POST /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2/action" status: 202 len: 0 microversion: 2.1 time: 6.338661 Aug 27 02:49:22.013179 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2010/3811] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:15 2022] POST /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2/action => generated 0 bytes in 6340 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:49:22.022528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-40518692-5b47-4692-b745-21f4042d1306 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:22.023172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-40518692-5b47-4692-b745-21f4042d1306 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:22.045042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40518692-5b47-4692-b745-21f4042d1306 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.045963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40518692-5b47-4692-b745-21f4042d1306 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.046435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40518692-5b47-4692-b745-21f4042d1306 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.047380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40518692-5b47-4692-b745-21f4042d1306 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.047878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40518692-5b47-4692-b745-21f4042d1306 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.048323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40518692-5b47-4692-b745-21f4042d1306 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.459497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-40518692-5b47-4692-b745-21f4042d1306 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:22.492223 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-40518692-5b47-4692-b745-21f4042d1306 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.477068 Aug 27 02:49:22.514020 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2011/3812] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:22 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:22.564026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:22.565555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] [instance: f5d77305-6bf5-4d11-bb93-187f23a42307] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:22.579846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.581824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.582852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.586748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.588022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.590001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.620143 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] HTTP exception thrown: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Request method failure captured: Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 HTTP/1.1 Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYWL7BpKka0942GN44zJc1IylhMpAWqhWFxM2_-VTwZLPidZCCkXhAsNs5yvFrVaQC0eeRkVbXj__5nLh8iUFz3FzlvgY-vJqSvlituhfQBEYyaGoRJBy05AtOslVsXOvqPPYU5yq7Fi0lmRZpXtE5mVVo_CI0w1HzHFsLU7mEYb__U Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9af784466d744e7fbb40d43d6b6e62c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9af784466d744e7fbb40d43d6b6e62c5"}]}] Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 9af784466d744e7fbb40d43d6b6e62c5 Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-662622941 Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 96a627797d4943e294544d084a5bf814 Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-662622941-project Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f5d77305-6bf5-4d11-bb93-187f23a42307'} Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.626089 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:22.630696 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.630696 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.630696 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:22.630696 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:22.630696 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:22.630696 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:22.630696 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. Aug 27 02:49:22.630696 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.630696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] Returning 404 to user: Instance f5d77305-6bf5-4d11-bb93-187f23a42307 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:22.630696 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c03146e4-3830-4f4c-8fe6-e8dc99ec90dc tempest-ImagesOneServerNegativeTestJSON-662622941 tempest-ImagesOneServerNegativeTestJSON-662622941-project] 10.222.0.99 "GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307" status: 404 len: 111 microversion: 2.1 time: 0.103355 Aug 27 02:49:22.630696 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2012/3813] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:22 2022] GET /compute/v2.1/servers/f5d77305-6bf5-4d11-bb93-187f23a42307 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:22.639246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:22.640108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:22.649931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.650714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.651344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.652448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.653162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.654450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.675373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] HTTP exception thrown: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Request method failure captured: Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 HTTP/1.1 Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2ZVlZSRAB0Vl6LylE1Z13wKYKpzdRChm8PIbGNPB4qN8ujckQegCrdlh2OB_lCWkLpVAWssNl9TNyzcqhSC164sAIiAKR54yB1FrCkk4NROTvClqfQa7G2EopX53xfi2ByGua9hKWBKf4KxTMO9YY560TpF3VIsjwkIYvbMLm_A4 Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2b3c9fc569ff43fc8c28ef7edeb1c62a Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}] Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2b3c9fc569ff43fc8c28ef7edeb1c62a Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FloatingIPsAssociationTestJSON-733446844-project Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 58c2cdb5435340e59fd0cd482de64bb3 Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-733446844-project Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '0c2ba8af-754a-4aaf-84e7-257aeb402178'} Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:22.678032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:22.682552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. Aug 27 02:49:22.682552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.682552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:22.682552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.682552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.682552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:22.682552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:22.682552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:22.682552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:22.682552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. Aug 27 02:49:22.682552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.687686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Returning 404 to user: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:22.689743 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-95102645-c3e5-43a7-acc0-46cbab28a658 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "DELETE /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 404 len: 111 microversion: 2.1 time: 0.060316 Aug 27 02:49:22.691464 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2013/3814] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:22 2022] DELETE /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:22.701589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bc74e728-6c57-4e95-9d54-c489d9225379 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:22.702875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bc74e728-6c57-4e95-9d54-c489d9225379 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:22.716207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc74e728-6c57-4e95-9d54-c489d9225379 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.718729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc74e728-6c57-4e95-9d54-c489d9225379 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.718729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc74e728-6c57-4e95-9d54-c489d9225379 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.720040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc74e728-6c57-4e95-9d54-c489d9225379 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.720804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc74e728-6c57-4e95-9d54-c489d9225379 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.721590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc74e728-6c57-4e95-9d54-c489d9225379 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.764329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7c1e72d-bee4-49d3-ab72-ad84d03bd1e9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:22.772980 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7c1e72d-bee4-49d3-ab72-ad84d03bd1e9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1313 microversion: 2.1 time: 0.876602 Aug 27 02:49:22.773587 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1802/3815] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:21 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1313 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:22.778641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:22.782577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 0c2ba8af-754a-4aaf-84e7-257aeb402178] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:22.804254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.805031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.805713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.806625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.807268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.807909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.827735 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] HTTP exception thrown: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Request method failure captured: Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 HTTP/1.1 Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2ZVlZSRAB0Vl6LylE1Z13wKYKpzdRChm8PIbGNPB4qN8ujckQegCrdlh2OB_lCWkLpVAWssNl9TNyzcqhSC164sAIiAKR54yB1FrCkk4NROTvClqfQa7G2EopX53xfi2ByGua9hKWBKf4KxTMO9YY560TpF3VIsjwkIYvbMLm_A4 Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b3c9fc569ff43fc8c28ef7edeb1c62a Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}] Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b3c9fc569ff43fc8c28ef7edeb1c62a Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-FloatingIPsAssociationTestJSON-733446844-project Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 58c2cdb5435340e59fd0cd482de64bb3 Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-733446844-project Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '0c2ba8af-754a-4aaf-84e7-257aeb402178'} Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.829885 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:22.834369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.834369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.834369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:22.834369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:22.834369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:22.834369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:22.834369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. Aug 27 02:49:22.834369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.836677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Returning 404 to user: Instance 0c2ba8af-754a-4aaf-84e7-257aeb402178 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:22.837859 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-266db24d-6ccf-4d17-9177-35c27291ce92 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178" status: 404 len: 111 microversion: 2.1 time: 0.062985 Aug 27 02:49:22.838683 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1803/3816] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:22 2022] GET /compute/v2.1/servers/0c2ba8af-754a-4aaf-84e7-257aeb402178 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:22.844832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:22.845892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:22.853060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.854001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.854711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.855708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:22.856419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:22.857092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:22.885599 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] HTTP exception thrown: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Request method failure captured: Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 HTTP/1.1 Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYXTyUPuu59_IH7ZRwoILwF3g4gu-2X5V8yvxv5pODCY-JsCu_C3S7m7RczuK3F0CGlyEQ_uW21JQvpyI847AcCBj6yq1cOnxBmtTC1UNfaFBOcll7SGUf3Y7jlp7yus0Xu4e1W5caDs-0yz1a4JxK2xlumJYqIQNtUfwgOqMgaobaw Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}] Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersTestMultiNic-1171342847 Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0e9ba043fc844b0eaca32db087924226 Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6'} Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:22.887613 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.892291 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:22.892291 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:22.892291 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:22.892291 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:22.892291 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:22.892291 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:49:22.892291 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:22.900832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Returning 404 to user: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:22.902065 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e6510f6-6353-47e2-9711-ffee94cbc72b tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 404 len: 111 microversion: 2.1 time: 0.061958 Aug 27 02:49:22.903326 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1804/3817] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:22 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:22.909192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d718eacc-85e8-4123-8b09-3aca9d3323f5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '.version_select at 0x7f4d2952f9d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:23.479773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bc74e728-6c57-4e95-9d54-c489d9225379 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:23.502482 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bc74e728-6c57-4e95-9d54-c489d9225379 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.809204 Aug 27 02:49:23.505783 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2014/3818] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:22 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:23.735823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b1deaad-668e-4a29-ba24-4c431ff49941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1117291715", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:24.025350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.security_group_api [None req-9b1deaad-668e-4a29-ba24-4c431ff49941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Neutron security group does_not_exist not found {{(pid=122488) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 27 02:49:24.027234 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9b1deaad-668e-4a29-ba24-4c431ff49941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b1deaad-668e-4a29-ba24-4c431ff49941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 258 Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1117291715", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1117291715', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 27 02:49:24.064654 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:24.092321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b1deaad-668e-4a29-ba24-4c431ff49941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:24.115151 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9b1deaad-668e-4a29-ba24-4c431ff49941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.341641 Aug 27 02:49:24.115151 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2015/3819] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:23 2022] POST /compute/v2.1/servers => generated 106 bytes in 349 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:49:24.115151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-978ce4bb-58c1-4737-84ba-7339bd9ee202 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:24.115151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-978ce4bb-58c1-4737-84ba-7339bd9ee202 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:24.115151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978ce4bb-58c1-4737-84ba-7339bd9ee202 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:24.115151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978ce4bb-58c1-4737-84ba-7339bd9ee202 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:24.115151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978ce4bb-58c1-4737-84ba-7339bd9ee202 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:24.115151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978ce4bb-58c1-4737-84ba-7339bd9ee202 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:24.115151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978ce4bb-58c1-4737-84ba-7339bd9ee202 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:24.118956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978ce4bb-58c1-4737-84ba-7339bd9ee202 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:25.307939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-978ce4bb-58c1-4737-84ba-7339bd9ee202 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:25.324708 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-978ce4bb-58c1-4737-84ba-7339bd9ee202 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1313 microversion: 2.1 time: 1.244499 Aug 27 02:49:25.326034 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2016/3820] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:24 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1313 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:25.332463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-262b25f8-73c2-4754-a610-88262ae34629 req-7bc591e9-180c-4a4f-b7cd-5fe82dfa199a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6", "name": "network-vif-deleted", "tag": "bf7e1285-ec6b-4d91-818f-c74ed2d02185"}, {"name": "network-changed", "server_uuid": "729c813c-9a69-418d-a6d8-d9f923b1c4f2", "tag": "00c7f942-8e70-4330-89b9-f94a286f91c8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:25.352482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-262b25f8-73c2-4754-a610-88262ae34629 req-7bc591e9-180c-4a4f-b7cd-5fe82dfa199a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:25.354154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-262b25f8-73c2-4754-a610-88262ae34629 req-7bc591e9-180c-4a4f-b7cd-5fe82dfa199a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:25.354819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-262b25f8-73c2-4754-a610-88262ae34629 req-7bc591e9-180c-4a4f-b7cd-5fe82dfa199a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:25.380231 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-262b25f8-73c2-4754-a610-88262ae34629 req-7bc591e9-180c-4a4f-b7cd-5fe82dfa199a service nova] Creating event network-vif-deleted:bf7e1285-ec6b-4d91-818f-c74ed2d02185 for instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 on n-h2-852084-5 Aug 27 02:49:25.380978 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-262b25f8-73c2-4754-a610-88262ae34629 req-7bc591e9-180c-4a4f-b7cd-5fe82dfa199a service nova] Creating event network-changed:00c7f942-8e70-4330-89b9-f94a286f91c8 for instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 on n-h2-852084-5 Aug 27 02:49:25.433277 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-262b25f8-73c2-4754-a610-88262ae34629 req-7bc591e9-180c-4a4f-b7cd-5fe82dfa199a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.104525 Aug 27 02:49:25.434957 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2017/3821] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:25.459688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be3c889b-2510-4af3-90b8-9f37ff0398eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:25.463902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-be3c889b-2510-4af3-90b8-9f37ff0398eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:25.477301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be3c889b-2510-4af3-90b8-9f37ff0398eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:25.478905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be3c889b-2510-4af3-90b8-9f37ff0398eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:25.479613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be3c889b-2510-4af3-90b8-9f37ff0398eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:25.480642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be3c889b-2510-4af3-90b8-9f37ff0398eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:25.481590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be3c889b-2510-4af3-90b8-9f37ff0398eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:25.482498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be3c889b-2510-4af3-90b8-9f37ff0398eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.201383 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d718eacc-85e8-4123-8b09-3aca9d3323f5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/4409319e-0d2c-497d-800e-2cab5c1828c0" status: 202 len: 0 microversion: 2.1 time: 3.296194 Aug 27 02:49:26.202444 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1805/3822] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:49:22 2022] DELETE /compute/v2.1/os-floating-ips/4409319e-0d2c-497d-800e-2cab5c1828c0 => generated 0 bytes in 3298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:49:26.214212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d37ef321-e83d-49d2-bcd7-cf1b819a556c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:26.214604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d37ef321-e83d-49d2-bcd7-cf1b819a556c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:26.222496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d37ef321-e83d-49d2-bcd7-cf1b819a556c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.223002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d37ef321-e83d-49d2-bcd7-cf1b819a556c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.223657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d37ef321-e83d-49d2-bcd7-cf1b819a556c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.224602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d37ef321-e83d-49d2-bcd7-cf1b819a556c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.225111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d37ef321-e83d-49d2-bcd7-cf1b819a556c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.225827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d37ef321-e83d-49d2-bcd7-cf1b819a556c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.259606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d37ef321-e83d-49d2-bcd7-cf1b819a556c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:49:26.267666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be3c889b-2510-4af3-90b8-9f37ff0398eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:26.293711 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-be3c889b-2510-4af3-90b8-9f37ff0398eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.856366 Aug 27 02:49:26.323019 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2018/3823] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:25 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:26.401294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=6,nova_api:UPDATE=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:26.405691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7fdafa92-d570-4af4-a2b1-35a8d066a466 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:26.414179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7fdafa92-d570-4af4-a2b1-35a8d066a466 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:26.426718 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d37ef321-e83d-49d2-bcd7-cf1b819a556c tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "DELETE /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 204 len: 0 microversion: 2.1 time: 0.219642 Aug 27 02:49:26.435813 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1806/3824] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:26 2022] DELETE /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:49:26.449597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fdafa92-d570-4af4-a2b1-35a8d066a466 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.453728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fdafa92-d570-4af4-a2b1-35a8d066a466 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.456081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fdafa92-d570-4af4-a2b1-35a8d066a466 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.456928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-372d88d7-1ff7-4fb8-be05-bf8fe107eff8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:26.460502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-372d88d7-1ff7-4fb8-be05-bf8fe107eff8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:26.464456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fdafa92-d570-4af4-a2b1-35a8d066a466 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.466957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fdafa92-d570-4af4-a2b1-35a8d066a466 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.469445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fdafa92-d570-4af4-a2b1-35a8d066a466 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.477417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-372d88d7-1ff7-4fb8-be05-bf8fe107eff8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.481132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-372d88d7-1ff7-4fb8-be05-bf8fe107eff8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.481132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-372d88d7-1ff7-4fb8-be05-bf8fe107eff8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:26.481548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-372d88d7-1ff7-4fb8-be05-bf8fe107eff8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:26.487138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-372d88d7-1ff7-4fb8-be05-bf8fe107eff8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:26.487989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-372d88d7-1ff7-4fb8-be05-bf8fe107eff8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:27.013845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-372d88d7-1ff7-4fb8-be05-bf8fe107eff8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:27.044073 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-372d88d7-1ff7-4fb8-be05-bf8fe107eff8 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1313 microversion: 2.1 time: 0.606594 Aug 27 02:49:27.057721 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1807/3825] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:26 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:27.057964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7fdafa92-d570-4af4-a2b1-35a8d066a466 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:27.058083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7efa7373-dbca-4e56-b9f4-da2511805cc5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:27.058083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7efa7373-dbca-4e56-b9f4-da2511805cc5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:27.066587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7efa7373-dbca-4e56-b9f4-da2511805cc5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:27.066871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7efa7373-dbca-4e56-b9f4-da2511805cc5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:27.067380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7efa7373-dbca-4e56-b9f4-da2511805cc5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:27.068268 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7fdafa92-d570-4af4-a2b1-35a8d066a466 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.705518 Aug 27 02:49:27.068521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7efa7373-dbca-4e56-b9f4-da2511805cc5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:27.069767 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2019/3826] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:26 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:27.069920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7efa7373-dbca-4e56-b9f4-da2511805cc5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:27.081760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7efa7373-dbca-4e56-b9f4-da2511805cc5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:27.082966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-aada8c9e-17e2-44a0-8eb7-c145c4f0c97a req-0e77b6dc-8b86-4a95-aa57-c7eac6e6eb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2536f5b-e15e-45db-8324-57a821c589d0", "name": "network-vif-plugged", "status": "completed", "tag": "f22811c5-a1cc-4eaa-bbde-653473e7e38d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:27.103986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-aada8c9e-17e2-44a0-8eb7-c145c4f0c97a req-0e77b6dc-8b86-4a95-aa57-c7eac6e6eb49 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:27.104744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-aada8c9e-17e2-44a0-8eb7-c145c4f0c97a req-0e77b6dc-8b86-4a95-aa57-c7eac6e6eb49 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:27.105262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-aada8c9e-17e2-44a0-8eb7-c145c4f0c97a req-0e77b6dc-8b86-4a95-aa57-c7eac6e6eb49 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:27.135168 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-aada8c9e-17e2-44a0-8eb7-c145c4f0c97a req-0e77b6dc-8b86-4a95-aa57-c7eac6e6eb49 service nova] Creating event network-vif-plugged:f22811c5-a1cc-4eaa-bbde-653473e7e38d for instance d2536f5b-e15e-45db-8324-57a821c589d0 on n-h1-852084-5 Aug 27 02:49:27.149163 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-aada8c9e-17e2-44a0-8eb7-c145c4f0c97a req-0e77b6dc-8b86-4a95-aa57-c7eac6e6eb49 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077930 Aug 27 02:49:27.154398 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2020/3827] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:27.166533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7e0e0d86-3691-48d2-8077-b6938b64bee6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:27.167556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7e0e0d86-3691-48d2-8077-b6938b64bee6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: eb3a257c-6fbb-4f0d-9f71-638ac3566c0a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:27.179199 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-7e0e0d86-3691-48d2-8077-b6938b64bee6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance eb3a257c-6fbb-4f0d-9f71-638ac3566c0a could not be found. Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7e0e0d86-3691-48d2-8077-b6938b64bee6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/eb3a257c-6fbb-4f0d-9f71-638ac3566c0a HTTP/1.1 Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance eb3a257c-6fbb-4f0d-9f71-638ac3566c0a could not be found. Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'eb3a257c-6fbb-4f0d-9f71-638ac3566c0a'} Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3a257c-6fbb-4f0d-9f71-638ac3566c0a could not be found. Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3a257c-6fbb-4f0d-9f71-638ac3566c0a could not be found. Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:27.181777 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:27.188138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:27.188138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:27.188138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:27.188138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:27.188138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:27.188138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:27.188138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3a257c-6fbb-4f0d-9f71-638ac3566c0a could not be found. Aug 27 02:49:27.188138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:27.190957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7e0e0d86-3691-48d2-8077-b6938b64bee6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance eb3a257c-6fbb-4f0d-9f71-638ac3566c0a could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:27.192618 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7e0e0d86-3691-48d2-8077-b6938b64bee6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "DELETE /compute/v2.1/servers/eb3a257c-6fbb-4f0d-9f71-638ac3566c0a" status: 404 len: 111 microversion: 2.1 time: 0.036186 Aug 27 02:49:27.195346 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2021/3828] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:27 2022] DELETE /compute/v2.1/servers/eb3a257c-6fbb-4f0d-9f71-638ac3566c0a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:27.207829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cdbcce95-1c1b-4223-88ed-149cc6225b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:27.209966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cdbcce95-1c1b-4223-88ed-149cc6225b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:27.232604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbcce95-1c1b-4223-88ed-149cc6225b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:27.234506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbcce95-1c1b-4223-88ed-149cc6225b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:27.237241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbcce95-1c1b-4223-88ed-149cc6225b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:27.241594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbcce95-1c1b-4223-88ed-149cc6225b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:27.242152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbcce95-1c1b-4223-88ed-149cc6225b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:27.244933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbcce95-1c1b-4223-88ed-149cc6225b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:27.647962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7efa7373-dbca-4e56-b9f4-da2511805cc5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:27.668375 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7efa7373-dbca-4e56-b9f4-da2511805cc5 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1525 microversion: 2.1 time: 0.618322 Aug 27 02:49:27.668983 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1808/3829] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:27 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1525 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:28.078568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bf68588f-f37b-41cc-9b32-2b7654de9c44 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:28.079705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bf68588f-f37b-41cc-9b32-2b7654de9c44 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:28.088635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf68588f-f37b-41cc-9b32-2b7654de9c44 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:28.090040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf68588f-f37b-41cc-9b32-2b7654de9c44 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:28.093370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf68588f-f37b-41cc-9b32-2b7654de9c44 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:28.094784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf68588f-f37b-41cc-9b32-2b7654de9c44 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:28.097614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf68588f-f37b-41cc-9b32-2b7654de9c44 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:28.101270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf68588f-f37b-41cc-9b32-2b7654de9c44 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:28.291785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cdbcce95-1c1b-4223-88ed-149cc6225b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:28.352521 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cdbcce95-1c1b-4223-88ed-149cc6225b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.152324 Aug 27 02:49:28.372836 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2022/3830] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:27 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:28.382500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-496d27a3-be4c-440c-823a-1e6b1effaf92 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:28.384992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-496d27a3-be4c-440c-823a-1e6b1effaf92 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:28.401419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496d27a3-be4c-440c-823a-1e6b1effaf92 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:28.402136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496d27a3-be4c-440c-823a-1e6b1effaf92 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:28.402888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496d27a3-be4c-440c-823a-1e6b1effaf92 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:28.404457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496d27a3-be4c-440c-823a-1e6b1effaf92 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:28.406119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496d27a3-be4c-440c-823a-1e6b1effaf92 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:28.406755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496d27a3-be4c-440c-823a-1e6b1effaf92 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:28.626693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bf68588f-f37b-41cc-9b32-2b7654de9c44 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:28.647208 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bf68588f-f37b-41cc-9b32-2b7654de9c44 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1313 microversion: 2.1 time: 0.581666 Aug 27 02:49:28.649152 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1809/3831] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:28 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:28.700699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-051dae04-269d-4a76-b3d6-1e87d19529b9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:28.703677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-051dae04-269d-4a76-b3d6-1e87d19529b9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:28.716624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-051dae04-269d-4a76-b3d6-1e87d19529b9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:28.718911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-051dae04-269d-4a76-b3d6-1e87d19529b9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:28.720284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-051dae04-269d-4a76-b3d6-1e87d19529b9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:28.722797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-051dae04-269d-4a76-b3d6-1e87d19529b9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:28.724324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-051dae04-269d-4a76-b3d6-1e87d19529b9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:28.725439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-051dae04-269d-4a76-b3d6-1e87d19529b9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.646057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-051dae04-269d-4a76-b3d6-1e87d19529b9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:29.666336 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-051dae04-269d-4a76-b3d6-1e87d19529b9 tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1525 microversion: 2.1 time: 0.978720 Aug 27 02:49:29.669888 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1810/3832] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:28 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1525 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:49:29.684135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-050ab623-c893-41e4-9987-be727bc148f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:29.690699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-050ab623-c893-41e4-9987-be727bc148f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:29.709717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050ab623-c893-41e4-9987-be727bc148f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.715647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050ab623-c893-41e4-9987-be727bc148f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.717970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050ab623-c893-41e4-9987-be727bc148f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.720345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050ab623-c893-41e4-9987-be727bc148f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.721898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050ab623-c893-41e4-9987-be727bc148f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.722384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-496d27a3-be4c-440c-823a-1e6b1effaf92 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:29.723366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050ab623-c893-41e4-9987-be727bc148f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.735817 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-496d27a3-be4c-440c-823a-1e6b1effaf92 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.360518 Aug 27 02:49:29.736498 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2023/3833] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:28 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:29.777724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d8260e39-1f94-4506-b167-8616ec186b4d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:29.779009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d8260e39-1f94-4506-b167-8616ec186b4d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 02:49:29.780007 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-d8260e39-1f94-4506-b167-8616ec186b4d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d8260e39-1f94-4506-b167-8616ec186b4d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 9223372036854775808 could not be found. Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '9223372036854775808'} Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:29.783400 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:29.788524 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:29.788524 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:29.788524 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:29.788524 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 27 02:49:29.788524 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:29.788524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d8260e39-1f94-4506-b167-8616ec186b4d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:29.788524 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d8260e39-1f94-4506-b167-8616ec186b4d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.016379 Aug 27 02:49:29.793317 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2024/3834] 10.222.0.99 () {58 vars in 1188 bytes} [Sat Aug 27 02:49:29 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:49:29.801187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a40e828-94e2-47d5-8cb1-e58cc71fd1d4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:29.802394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4a40e828-94e2-47d5-8cb1-e58cc71fd1d4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:29.816708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a40e828-94e2-47d5-8cb1-e58cc71fd1d4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.817768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a40e828-94e2-47d5-8cb1-e58cc71fd1d4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.818625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a40e828-94e2-47d5-8cb1-e58cc71fd1d4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:29.819956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a40e828-94e2-47d5-8cb1-e58cc71fd1d4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:29.820835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a40e828-94e2-47d5-8cb1-e58cc71fd1d4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:29.822031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a40e828-94e2-47d5-8cb1-e58cc71fd1d4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.148252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-050ab623-c893-41e4-9987-be727bc148f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:30.162063 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-050ab623-c893-41e4-9987-be727bc148f9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1498 microversion: 2.1 time: 0.490105 Aug 27 02:49:30.165638 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1811/3835] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:29 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1498 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:30.187293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cbdf1022-bdfc-4878-992f-529780d3aef9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:30.211711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.compute.server_groups [None req-cbdf1022-bdfc-4878-992f-529780d3aef9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Querying cell 8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) for 1 instances {{(pid=122487) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 02:49:30.212617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbdf1022-bdfc-4878-992f-529780d3aef9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.213421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbdf1022-bdfc-4878-992f-529780d3aef9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.214175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbdf1022-bdfc-4878-992f-529780d3aef9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.308147 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cbdf1022-bdfc-4878-992f-529780d3aef9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/os-server-groups/b4cd854e-3cba-4526-a536-ea136d4ef9cd" status: 200 len: 221 microversion: 2.1 time: 0.126018 Aug 27 02:49:30.310612 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1812/3836] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:49:30 2022] GET /compute/v2.1/os-server-groups/b4cd854e-3cba-4526-a536-ea136d4ef9cd => generated 221 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:49:30.342816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-43868db7-de13-4046-9b3c-a2877023b6a5 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:30.344344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-43868db7-de13-4046-9b3c-a2877023b6a5 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:30.369464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43868db7-de13-4046-9b3c-a2877023b6a5 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.371074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43868db7-de13-4046-9b3c-a2877023b6a5 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.372108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43868db7-de13-4046-9b3c-a2877023b6a5 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.374524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43868db7-de13-4046-9b3c-a2877023b6a5 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.376291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43868db7-de13-4046-9b3c-a2877023b6a5 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.377209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43868db7-de13-4046-9b3c-a2877023b6a5 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.480069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-43868db7-de13-4046-9b3c-a2877023b6a5 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:49:30.657472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4a40e828-94e2-47d5-8cb1-e58cc71fd1d4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:30.706083 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a40e828-94e2-47d5-8cb1-e58cc71fd1d4 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.910455 Aug 27 02:49:30.707582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2025/3837] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:29 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:30.722363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50892032-410c-40fc-9c92-64b58c91aecc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:30.723995 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-43868db7-de13-4046-9b3c-a2877023b6a5 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 204 len: 0 microversion: 2.1 time: 0.387746 Aug 27 02:49:30.724516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-50892032-410c-40fc-9c92-64b58c91aecc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:30.726292 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1813/3838] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:30 2022] DELETE /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:30.748189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-be5bec57-4f78-42d9-86fb-9093179de0e6 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:30.748627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50892032-410c-40fc-9c92-64b58c91aecc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.750633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50892032-410c-40fc-9c92-64b58c91aecc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.752599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50892032-410c-40fc-9c92-64b58c91aecc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.753444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-be5bec57-4f78-42d9-86fb-9093179de0e6 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:30.759161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50892032-410c-40fc-9c92-64b58c91aecc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.760748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50892032-410c-40fc-9c92-64b58c91aecc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.761814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50892032-410c-40fc-9c92-64b58c91aecc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.779456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be5bec57-4f78-42d9-86fb-9093179de0e6 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.780020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be5bec57-4f78-42d9-86fb-9093179de0e6 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.780932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be5bec57-4f78-42d9-86fb-9093179de0e6 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.782353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be5bec57-4f78-42d9-86fb-9093179de0e6 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:30.783599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be5bec57-4f78-42d9-86fb-9093179de0e6 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:30.784422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be5bec57-4f78-42d9-86fb-9093179de0e6 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:30.821977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:30.874305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:31.133094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-50892032-410c-40fc-9c92-64b58c91aecc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2cdb5435340e59fd0cd482de64bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c9fc569ff43fc8c28ef7edeb1c62a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:31.151260 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-50892032-410c-40fc-9c92-64b58c91aecc tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 200 len: 1483 microversion: 2.1 time: 0.440658 Aug 27 02:49:31.166367 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2026/3839] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:30 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 1483 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:31.172012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95879876-d782-4455-b253-0c83e35a4ca0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:31.173015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-95879876-d782-4455-b253-0c83e35a4ca0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:31.182664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95879876-d782-4455-b253-0c83e35a4ca0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:31.183476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95879876-d782-4455-b253-0c83e35a4ca0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:31.184135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95879876-d782-4455-b253-0c83e35a4ca0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:31.185153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95879876-d782-4455-b253-0c83e35a4ca0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:31.185857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95879876-d782-4455-b253-0c83e35a4ca0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:31.186504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95879876-d782-4455-b253-0c83e35a4ca0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:31.767568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-be5bec57-4f78-42d9-86fb-9093179de0e6 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:31.793188 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-be5bec57-4f78-42d9-86fb-9093179de0e6 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1504 microversion: 2.1 time: 1.061512 Aug 27 02:49:31.803920 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1814/3840] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:30 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1504 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:31.828708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6a7026cd-da70-4f95-94bd-d4410ab8b741 req-ffd98437-504f-4795-8252-da4cadc37c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729c813c-9a69-418d-a6d8-d9f923b1c4f2", "name": "network-vif-deleted", "tag": "00c7f942-8e70-4330-89b9-f94a286f91c8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:31.850741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6a7026cd-da70-4f95-94bd-d4410ab8b741 req-ffd98437-504f-4795-8252-da4cadc37c12 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:31.854950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6a7026cd-da70-4f95-94bd-d4410ab8b741 req-ffd98437-504f-4795-8252-da4cadc37c12 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:31.855938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6a7026cd-da70-4f95-94bd-d4410ab8b741 req-ffd98437-504f-4795-8252-da4cadc37c12 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:31.905881 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6a7026cd-da70-4f95-94bd-d4410ab8b741 req-ffd98437-504f-4795-8252-da4cadc37c12 service nova] Creating event network-vif-deleted:00c7f942-8e70-4330-89b9-f94a286f91c8 for instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 on n-h2-852084-5 Aug 27 02:49:31.914873 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6a7026cd-da70-4f95-94bd-d4410ab8b741 req-ffd98437-504f-4795-8252-da4cadc37c12 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108911 Aug 27 02:49:31.919244 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1815/3841] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:31.943393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-95879876-d782-4455-b253-0c83e35a4ca0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:31.957585 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-95879876-d782-4455-b253-0c83e35a4ca0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.789632 Aug 27 02:49:31.960951 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2027/3842] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:31 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:32.000933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb064b1e-de7b-46c4-9a3a-72d9b7943665 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:32.002412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fb064b1e-de7b-46c4-9a3a-72d9b7943665 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Failed to fetch instance by id -1 {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 27 02:49:32.003409 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-fb064b1e-de7b-46c4-9a3a-72d9b7943665 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance -1 could not be found. Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb064b1e-de7b-46c4-9a3a-72d9b7943665 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance -1 could not be found. Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '-1'} Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:32.007285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:32.022562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:32.022562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:32.022562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 27 02:49:32.022562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:32.022562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb064b1e-de7b-46c4-9a3a-72d9b7943665 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:32.025137 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fb064b1e-de7b-46c4-9a3a-72d9b7943665 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.029026 Aug 27 02:49:32.045941 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1816/3843] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:49:31 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:49:32.047357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c87ebd1a-7d33-4999-9d72-a26629c5bac6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:32.049488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c87ebd1a-7d33-4999-9d72-a26629c5bac6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:32.065012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87ebd1a-7d33-4999-9d72-a26629c5bac6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.066332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87ebd1a-7d33-4999-9d72-a26629c5bac6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.067384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87ebd1a-7d33-4999-9d72-a26629c5bac6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:32.069002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87ebd1a-7d33-4999-9d72-a26629c5bac6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.071479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87ebd1a-7d33-4999-9d72-a26629c5bac6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.072333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c87ebd1a-7d33-4999-9d72-a26629c5bac6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:32.177147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:32.179082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] [instance: 729c813c-9a69-418d-a6d8-d9f923b1c4f2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:32.191491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.192856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.194564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:32.196245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.197413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.198597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:32.260818 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] HTTP exception thrown: Instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 could not be found. Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Request method failure captured: Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 HTTP/1.1 Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2ZVlZSRAB0Vl6LylE1Z13wKYKpzdRChm8PIbGNPB4qN8ujckQegCrdlh2OB_lCWkLpVAWssNl9TNyzcqhSC164sAIiAKR54yB1FrCkk4NROTvClqfQa7G2EopX53xfi2ByGua9hKWBKf4KxTMO9YY560TpF3VIsjwkIYvbMLm_A4 Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b3c9fc569ff43fc8c28ef7edeb1c62a Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b3c9fc569ff43fc8c28ef7edeb1c62a"}]}] Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b3c9fc569ff43fc8c28ef7edeb1c62a Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-733446844 Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-FloatingIPsAssociationTestJSON-733446844-project Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 58c2cdb5435340e59fd0cd482de64bb3 Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-733446844-project Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 could not be found. Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '729c813c-9a69-418d-a6d8-d9f923b1c4f2'} Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 could not be found. Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 could not be found. Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:32.281301 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:32.308285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:32.308285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:32.308285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:32.308285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:32.308285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:32.308285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:32.308285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 could not be found. Aug 27 02:49:32.308285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:32.308285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] Returning 404 to user: Instance 729c813c-9a69-418d-a6d8-d9f923b1c4f2 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:32.308285 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42253a6f-5ba0-4d24-97c2-f27b2bc2dc5d tempest-FloatingIPsAssociationTestJSON-733446844 tempest-FloatingIPsAssociationTestJSON-733446844-project] 10.222.0.99 "GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2" status: 404 len: 111 microversion: 2.1 time: 0.114068 Aug 27 02:49:32.308285 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1817/3844] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:32 2022] GET /compute/v2.1/servers/729c813c-9a69-418d-a6d8-d9f923b1c4f2 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:32.763229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c87ebd1a-7d33-4999-9d72-a26629c5bac6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:32.780384 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c87ebd1a-7d33-4999-9d72-a26629c5bac6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.744442 Aug 27 02:49:32.781887 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2028/3845] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:32 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:32.819720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f243aaaf-3f7b-4a2e-83be-e7f39e451582 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:32.829010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4bb632f2-b5fa-49cf-a6f9-97ad80edf532 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:32.829654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4bb632f2-b5fa-49cf-a6f9-97ad80edf532 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:32.831747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f243aaaf-3f7b-4a2e-83be-e7f39e451582 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:32.844471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f243aaaf-3f7b-4a2e-83be-e7f39e451582 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.844975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f243aaaf-3f7b-4a2e-83be-e7f39e451582 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.845424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f243aaaf-3f7b-4a2e-83be-e7f39e451582 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:32.846196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f243aaaf-3f7b-4a2e-83be-e7f39e451582 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.846660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f243aaaf-3f7b-4a2e-83be-e7f39e451582 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.847101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f243aaaf-3f7b-4a2e-83be-e7f39e451582 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:32.849935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:32.851545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb632f2-b5fa-49cf-a6f9-97ad80edf532 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.852053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb632f2-b5fa-49cf-a6f9-97ad80edf532 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.852541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb632f2-b5fa-49cf-a6f9-97ad80edf532 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:32.854058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb632f2-b5fa-49cf-a6f9-97ad80edf532 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:32.854546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb632f2-b5fa-49cf-a6f9-97ad80edf532 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:32.855058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb632f2-b5fa-49cf-a6f9-97ad80edf532 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:33.410799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4bb632f2-b5fa-49cf-a6f9-97ad80edf532 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:33.430186 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4bb632f2-b5fa-49cf-a6f9-97ad80edf532 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1504 microversion: 2.1 time: 0.605321 Aug 27 02:49:33.433544 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2029/3846] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:32 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1504 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:34.040627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f243aaaf-3f7b-4a2e-83be-e7f39e451582 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:34.072352 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f243aaaf-3f7b-4a2e-83be-e7f39e451582 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.258715 Aug 27 02:49:34.098488 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1818/3847] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:32 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:49:34.118374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f943967b-dd20-445e-9319-aa339069203b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:34.119275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f943967b-dd20-445e-9319-aa339069203b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 9e92b6a0-a537-48ce-8bb0-bd2b79a26e63] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:34.126774 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f943967b-dd20-445e-9319-aa339069203b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance 9e92b6a0-a537-48ce-8bb0-bd2b79a26e63 could not be found. Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f943967b-dd20-445e-9319-aa339069203b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/9e92b6a0-a537-48ce-8bb0-bd2b79a26e63/action HTTP/1.1 Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 19 Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: {"forceDelete": {}} Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 9e92b6a0-a537-48ce-8bb0-bd2b79a26e63 could not be found. Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '9e92b6a0-a537-48ce-8bb0-bd2b79a26e63', 'body': {'forceDelete': {}}} Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e92b6a0-a537-48ce-8bb0-bd2b79a26e63 could not be found. Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e92b6a0-a537-48ce-8bb0-bd2b79a26e63 could not be found. Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:34.137582 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:34.142960 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:34.142960 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:34.142960 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e92b6a0-a537-48ce-8bb0-bd2b79a26e63 could not be found. Aug 27 02:49:34.142960 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:34.146954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f943967b-dd20-445e-9319-aa339069203b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance 9e92b6a0-a537-48ce-8bb0-bd2b79a26e63 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:34.148447 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f943967b-dd20-445e-9319-aa339069203b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/9e92b6a0-a537-48ce-8bb0-bd2b79a26e63/action" status: 404 len: 111 microversion: 2.1 time: 0.034760 Aug 27 02:49:34.149685 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2030/3848] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:34 2022] POST /compute/v2.1/servers/9e92b6a0-a537-48ce-8bb0-bd2b79a26e63/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:34.163788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b298eb6d-912f-4c46-839e-1fdc1eb54315 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:34.165053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b298eb6d-912f-4c46-839e-1fdc1eb54315 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:34.173962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b298eb6d-912f-4c46-839e-1fdc1eb54315 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.175197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b298eb6d-912f-4c46-839e-1fdc1eb54315 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.175901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b298eb6d-912f-4c46-839e-1fdc1eb54315 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.177569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b298eb6d-912f-4c46-839e-1fdc1eb54315 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.179129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b298eb6d-912f-4c46-839e-1fdc1eb54315 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.180178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b298eb6d-912f-4c46-839e-1fdc1eb54315 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.460083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ac208e4a-ac60-464f-84c5-e31806d79a4b tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:34.462893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ac208e4a-ac60-464f-84c5-e31806d79a4b tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:34.493998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac208e4a-ac60-464f-84c5-e31806d79a4b tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.496634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac208e4a-ac60-464f-84c5-e31806d79a4b tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.500432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac208e4a-ac60-464f-84c5-e31806d79a4b tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.502125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac208e4a-ac60-464f-84c5-e31806d79a4b tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.505480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac208e4a-ac60-464f-84c5-e31806d79a4b tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.511686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac208e4a-ac60-464f-84c5-e31806d79a4b tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:34.905492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b298eb6d-912f-4c46-839e-1fdc1eb54315 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:34.923268 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b298eb6d-912f-4c46-839e-1fdc1eb54315 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.765686 Aug 27 02:49:34.926657 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1819/3849] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:34 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:34.938982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0d0ea986-5707-4b3e-8ee0-a72280f6c129 req-7555f199-7137-4f58-bbe8-ee11b6d34a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2536f5b-e15e-45db-8324-57a821c589d0", "name": "network-vif-deleted", "tag": "f22811c5-a1cc-4eaa-bbde-653473e7e38d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:34.964626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0d0ea986-5707-4b3e-8ee0-a72280f6c129 req-7555f199-7137-4f58-bbe8-ee11b6d34a10 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:34.966156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0d0ea986-5707-4b3e-8ee0-a72280f6c129 req-7555f199-7137-4f58-bbe8-ee11b6d34a10 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:34.967261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0d0ea986-5707-4b3e-8ee0-a72280f6c129 req-7555f199-7137-4f58-bbe8-ee11b6d34a10 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:35.001082 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0d0ea986-5707-4b3e-8ee0-a72280f6c129 req-7555f199-7137-4f58-bbe8-ee11b6d34a10 service nova] Creating event network-vif-deleted:f22811c5-a1cc-4eaa-bbde-653473e7e38d for instance d2536f5b-e15e-45db-8324-57a821c589d0 on n-h1-852084-5 Aug 27 02:49:35.021143 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0d0ea986-5707-4b3e-8ee0-a72280f6c129 req-7555f199-7137-4f58-bbe8-ee11b6d34a10 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090340 Aug 27 02:49:35.024403 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1820/3850] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:35.040497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4894f9c4-319d-4d55-9b5e-263cbff0e726 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:35.049033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4894f9c4-319d-4d55-9b5e-263cbff0e726 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:35.065644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ac208e4a-ac60-464f-84c5-e31806d79a4b tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489a94b2c2df4608b25ba4bbf2737814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9b22b9201e64f1594fc84d898f188d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:35.083432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4894f9c4-319d-4d55-9b5e-263cbff0e726 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:35.084292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4894f9c4-319d-4d55-9b5e-263cbff0e726 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:35.085215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4894f9c4-319d-4d55-9b5e-263cbff0e726 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:35.086485 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ac208e4a-ac60-464f-84c5-e31806d79a4b tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 200 len: 1462 microversion: 2.1 time: 0.634858 Aug 27 02:49:35.086978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4894f9c4-319d-4d55-9b5e-263cbff0e726 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:35.087438 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2031/3851] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:34 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 1462 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:35.088428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4894f9c4-319d-4d55-9b5e-263cbff0e726 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:35.093237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4894f9c4-319d-4d55-9b5e-263cbff0e726 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.064250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4894f9c4-319d-4d55-9b5e-263cbff0e726 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:36.077286 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4894f9c4-319d-4d55-9b5e-263cbff0e726 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.049924 Aug 27 02:49:36.078120 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1821/3852] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:35 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:36.141295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.144400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fc266f2b-1551-4e85-8b77-a73684faed0c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:36.146940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:36.162952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fc266f2b-1551-4e85-8b77-a73684faed0c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 522f7a36-be17-4568-8e6f-b7d497a6dab0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:36.184187 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-fc266f2b-1551-4e85-8b77-a73684faed0c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance 522f7a36-be17-4568-8e6f-b7d497a6dab0 could not be found. Aug 27 02:49:36.186504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.187475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.187963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.188980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.190315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.194095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fc266f2b-1551-4e85-8b77-a73684faed0c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/522f7a36-be17-4568-8e6f-b7d497a6dab0/action HTTP/1.1 Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 39 Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: {"os-getConsoleOutput": {"length": 10}} Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 522f7a36-be17-4568-8e6f-b7d497a6dab0 could not be found. Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '522f7a36-be17-4568-8e6f-b7d497a6dab0', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522f7a36-be17-4568-8e6f-b7d497a6dab0 could not be found. Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522f7a36-be17-4568-8e6f-b7d497a6dab0 could not be found. Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.195446 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.201713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.201713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.201713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:36.201713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:36.201713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522f7a36-be17-4568-8e6f-b7d497a6dab0 could not be found. Aug 27 02:49:36.201713 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.205310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fc266f2b-1551-4e85-8b77-a73684faed0c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance 522f7a36-be17-4568-8e6f-b7d497a6dab0 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:36.206340 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fc266f2b-1551-4e85-8b77-a73684faed0c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/522f7a36-be17-4568-8e6f-b7d497a6dab0/action" status: 404 len: 111 microversion: 2.1 time: 0.085189 Aug 27 02:49:36.207378 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1822/3853] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:36 2022] POST /compute/v2.1/servers/522f7a36-be17-4568-8e6f-b7d497a6dab0/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:36.216773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-02a881ce-41d8-43f1-b368-8176dac40615 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.217876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-02a881ce-41d8-43f1-b368-8176dac40615 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:36.227261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a881ce-41d8-43f1-b368-8176dac40615 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.227852 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] HTTP exception thrown: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.228424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a881ce-41d8-43f1-b368-8176dac40615 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.229145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a881ce-41d8-43f1-b368-8176dac40615 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.230341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a881ce-41d8-43f1-b368-8176dac40615 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.231199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a881ce-41d8-43f1-b368-8176dac40615 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.232009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a881ce-41d8-43f1-b368-8176dac40615 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Request method failure captured: Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 HTTP/1.1 Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYYSbzoH9dK_yRYsE4QV_N--tmojYuYUS2tE9Xd9WrfC3DOsire75lsBPE2E3ZId6WlLjuWiodE489byS-I4xHi-E7m8JlSAYc-gNSbRl2v1k68zPtA6D4ldlJT-LSaOY2rPzUJt9FGV60UZ8hh3TbdO1IqekFhUqnxZCUF2ZuTWsMs Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a9b22b9201e64f1594fc84d898f188d8"}]}] Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 489a94b2c2df4608b25ba4bbf2737814 Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd2536f5b-e15e-45db-8324-57a821c589d0'} Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.233043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.239668 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.239668 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.239668 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.239668 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:36.239668 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:36.239668 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.239668 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.239668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Returning 404 to user: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:36.239668 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8ecc3ef6-5a5b-49c8-94b0-8340f89115f2 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 404 len: 111 microversion: 2.1 time: 0.117399 Aug 27 02:49:36.239668 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2032/3854] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:36 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:36.262460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c064d2df-287e-4f55-af79-5fdc4272fa48 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.311185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.compute.server_groups [None req-c064d2df-287e-4f55-af79-5fdc4272fa48 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Querying cell 8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) for 1 instances {{(pid=122488) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 02:49:36.312809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c064d2df-287e-4f55-af79-5fdc4272fa48 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.313983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c064d2df-287e-4f55-af79-5fdc4272fa48 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.317421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c064d2df-287e-4f55-af79-5fdc4272fa48 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.359461 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c064d2df-287e-4f55-af79-5fdc4272fa48 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.101230 Aug 27 02:49:36.370662 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2033/3855] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 02:49:36 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:36.385573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f69a355-1e0d-49c6-b37a-39471a02a1d9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.421047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.compute.server_groups [None req-8f69a355-1e0d-49c6-b37a-39471a02a1d9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Querying cell 8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) for 1 instances {{(pid=122488) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 27 02:49:36.421856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f69a355-1e0d-49c6-b37a-39471a02a1d9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.422365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f69a355-1e0d-49c6-b37a-39471a02a1d9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.422824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f69a355-1e0d-49c6-b37a-39471a02a1d9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.454274 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f69a355-1e0d-49c6-b37a-39471a02a1d9 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/os-server-groups/b4cd854e-3cba-4526-a536-ea136d4ef9cd" status: 200 len: 183 microversion: 2.1 time: 0.073336 Aug 27 02:49:36.457695 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2034/3856] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:49:36 2022] GET /compute/v2.1/os-server-groups/b4cd854e-3cba-4526-a536-ea136d4ef9cd => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:49:36.480716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.481513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:36.493748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.494264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.498314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.499302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.502482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.503328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.555195 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] HTTP exception thrown: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Request method failure captured: Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 HTTP/1.1 Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYYSbzoH9dK_yRYsE4QV_N--tmojYuYUS2tE9Xd9WrfC3DOsire75lsBPE2E3ZId6WlLjuWiodE489byS-I4xHi-E7m8JlSAYc-gNSbRl2v1k68zPtA6D4ldlJT-LSaOY2rPzUJt9FGV60UZ8hh3TbdO1IqekFhUqnxZCUF2ZuTWsMs Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a9b22b9201e64f1594fc84d898f188d8"}]}] Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 489a94b2c2df4608b25ba4bbf2737814 Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd2536f5b-e15e-45db-8324-57a821c589d0'} Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:36.575176 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Returning 404 to user: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fb03b3dc-fef8-478b-a2f7-e89f68b36b43 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 404 len: 111 microversion: 2.1 time: 0.101446 Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2035/3857] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:49:36 2022] DELETE /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.603599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] [instance: d2536f5b-e15e-45db-8324-57a821c589d0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:36.620863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.622345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.626733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.627650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.630537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.630537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.649092 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] HTTP exception thrown: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Request method failure captured: Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 HTTP/1.1 Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYYSbzoH9dK_yRYsE4QV_N--tmojYuYUS2tE9Xd9WrfC3DOsire75lsBPE2E3ZId6WlLjuWiodE489byS-I4xHi-E7m8JlSAYc-gNSbRl2v1k68zPtA6D4ldlJT-LSaOY2rPzUJt9FGV60UZ8hh3TbdO1IqekFhUqnxZCUF2ZuTWsMs Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a9b22b9201e64f1594fc84d898f188d8"}]}] Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 489a94b2c2df4608b25ba4bbf2737814 Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd2536f5b-e15e-45db-8324-57a821c589d0'} Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.651144 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.656589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.656589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.656589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.656589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:36.656589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:36.656589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. Aug 27 02:49:36.656589 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.661447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Returning 404 to user: Instance d2536f5b-e15e-45db-8324-57a821c589d0 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:36.662943 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d7d94c53-594d-4333-8725-eed9c14a0441 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0" status: 404 len: 111 microversion: 2.1 time: 0.072411 Aug 27 02:49:36.664110 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2036/3858] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:36 2022] GET /compute/v2.1/servers/d2536f5b-e15e-45db-8324-57a821c589d0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:49:36.675916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-45c6cabe-512b-4ef7-85ff-dde59aa1f5cd tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.698694 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-45c6cabe-512b-4ef7-85ff-dde59aa1f5cd tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] HTTP exception thrown: Instance group 2951ee1b-f455-4690-b68a-8c0707fd0057 could not be found. Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-45c6cabe-512b-4ef7-85ff-dde59aa1f5cd tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Request method failure captured: Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/os-server-groups/2951ee1b-f455-4690-b68a-8c0707fd0057 HTTP/1.1 Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYYSbzoH9dK_yRYsE4QV_N--tmojYuYUS2tE9Xd9WrfC3DOsire75lsBPE2E3ZId6WlLjuWiodE489byS-I4xHi-E7m8JlSAYc-gNSbRl2v1k68zPtA6D4ldlJT-LSaOY2rPzUJt9FGV60UZ8hh3TbdO1IqekFhUqnxZCUF2ZuTWsMs Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a9b22b9201e64f1594fc84d898f188d8"}]}] Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 489a94b2c2df4608b25ba4bbf2737814 Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance group 2951ee1b-f455-4690-b68a-8c0707fd0057 could not be found. Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '2951ee1b-f455-4690-b68a-8c0707fd0057'} Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2951ee1b-f455-4690-b68a-8c0707fd0057 could not be found. Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2951ee1b-f455-4690-b68a-8c0707fd0057 could not be found. Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.707923 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.714485 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.714485 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.714485 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:36.714485 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:36.714485 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2951ee1b-f455-4690-b68a-8c0707fd0057 could not be found. Aug 27 02:49:36.714485 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.714485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-45c6cabe-512b-4ef7-85ff-dde59aa1f5cd tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Returning 404 to user: Instance group 2951ee1b-f455-4690-b68a-8c0707fd0057 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:36.714485 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-45c6cabe-512b-4ef7-85ff-dde59aa1f5cd tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/2951ee1b-f455-4690-b68a-8c0707fd0057" status: 404 len: 117 microversion: 2.1 time: 0.039542 Aug 27 02:49:36.723141 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2037/3859] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:49:36 2022] DELETE /compute/v2.1/os-server-groups/2951ee1b-f455-4690-b68a-8c0707fd0057 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:36.738728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a09c271-374b-4b47-a641-fe86086653f1 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.756578 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-4a09c271-374b-4b47-a641-fe86086653f1 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] HTTP exception thrown: Instance group b372f942-6dc7-4d90-8946-d0eac8862772 could not be found. Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a09c271-374b-4b47-a641-fe86086653f1 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Request method failure captured: Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/os-server-groups/b372f942-6dc7-4d90-8946-d0eac8862772 HTTP/1.1 Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYYSbzoH9dK_yRYsE4QV_N--tmojYuYUS2tE9Xd9WrfC3DOsire75lsBPE2E3ZId6WlLjuWiodE489byS-I4xHi-E7m8JlSAYc-gNSbRl2v1k68zPtA6D4ldlJT-LSaOY2rPzUJt9FGV60UZ8hh3TbdO1IqekFhUqnxZCUF2ZuTWsMs Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a9b22b9201e64f1594fc84d898f188d8"}]}] Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 489a94b2c2df4608b25ba4bbf2737814 Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance group b372f942-6dc7-4d90-8946-d0eac8862772 could not be found. Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'b372f942-6dc7-4d90-8946-d0eac8862772'} Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b372f942-6dc7-4d90-8946-d0eac8862772 could not be found. Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b372f942-6dc7-4d90-8946-d0eac8862772 could not be found. Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.762393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.772917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.772917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.772917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:36.772917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:36.772917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b372f942-6dc7-4d90-8946-d0eac8862772 could not be found. Aug 27 02:49:36.772917 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.776763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a09c271-374b-4b47-a641-fe86086653f1 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Returning 404 to user: Instance group b372f942-6dc7-4d90-8946-d0eac8862772 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:36.779357 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a09c271-374b-4b47-a641-fe86086653f1 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/b372f942-6dc7-4d90-8946-d0eac8862772" status: 404 len: 117 microversion: 2.1 time: 0.053188 Aug 27 02:49:36.786195 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2038/3860] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:49:36 2022] DELETE /compute/v2.1/os-server-groups/b372f942-6dc7-4d90-8946-d0eac8862772 => generated 117 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:36.786533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-02a881ce-41d8-43f1-b368-8176dac40615 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:36.797809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c895ac86-45e4-4d11-84a0-6b22c7047c96 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.799865 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-02a881ce-41d8-43f1-b368-8176dac40615 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.584310 Aug 27 02:49:36.800607 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1823/3861] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:36 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:49:36.821726 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-c895ac86-45e4-4d11-84a0-6b22c7047c96 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] HTTP exception thrown: Instance group 44339751-434c-4752-b477-55be1ae3a4dc could not be found. Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c895ac86-45e4-4d11-84a0-6b22c7047c96 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Request method failure captured: Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/os-server-groups/44339751-434c-4752-b477-55be1ae3a4dc HTTP/1.1 Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYYSbzoH9dK_yRYsE4QV_N--tmojYuYUS2tE9Xd9WrfC3DOsire75lsBPE2E3ZId6WlLjuWiodE489byS-I4xHi-E7m8JlSAYc-gNSbRl2v1k68zPtA6D4ldlJT-LSaOY2rPzUJt9FGV60UZ8hh3TbdO1IqekFhUqnxZCUF2ZuTWsMs Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a9b22b9201e64f1594fc84d898f188d8"}]}] Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 489a94b2c2df4608b25ba4bbf2737814 Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance group 44339751-434c-4752-b477-55be1ae3a4dc could not be found. Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '44339751-434c-4752-b477-55be1ae3a4dc'} Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 44339751-434c-4752-b477-55be1ae3a4dc could not be found. Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 44339751-434c-4752-b477-55be1ae3a4dc could not be found. Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.823386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.829401 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.829401 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.829401 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:36.829401 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:36.829401 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 44339751-434c-4752-b477-55be1ae3a4dc could not be found. Aug 27 02:49:36.829401 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.832918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c895ac86-45e4-4d11-84a0-6b22c7047c96 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Returning 404 to user: Instance group 44339751-434c-4752-b477-55be1ae3a4dc could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:36.832918 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c895ac86-45e4-4d11-84a0-6b22c7047c96 tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/44339751-434c-4752-b477-55be1ae3a4dc" status: 404 len: 117 microversion: 2.1 time: 0.043961 Aug 27 02:49:36.833909 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2039/3862] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:49:36 2022] DELETE /compute/v2.1/os-server-groups/44339751-434c-4752-b477-55be1ae3a4dc => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:36.836612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9aef4da7-4f4b-4a57-acf9-c384866ae010 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.837241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9aef4da7-4f4b-4a57-acf9-c384866ae010 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:36.843126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-62eaa5e1-9f36-482d-8019-69664c6dd9ff tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.850601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aef4da7-4f4b-4a57-acf9-c384866ae010 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.851111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aef4da7-4f4b-4a57-acf9-c384866ae010 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.851562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aef4da7-4f4b-4a57-acf9-c384866ae010 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.852312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aef4da7-4f4b-4a57-acf9-c384866ae010 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:36.852785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aef4da7-4f4b-4a57-acf9-c384866ae010 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:36.853222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aef4da7-4f4b-4a57-acf9-c384866ae010 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:36.855177 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-62eaa5e1-9f36-482d-8019-69664c6dd9ff tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] HTTP exception thrown: Instance group a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a could not be found. Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-62eaa5e1-9f36-482d-8019-69664c6dd9ff tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Request method failure captured: Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/os-server-groups/a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a HTTP/1.1 Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYYSbzoH9dK_yRYsE4QV_N--tmojYuYUS2tE9Xd9WrfC3DOsire75lsBPE2E3ZId6WlLjuWiodE489byS-I4xHi-E7m8JlSAYc-gNSbRl2v1k68zPtA6D4ldlJT-LSaOY2rPzUJt9FGV60UZ8hh3TbdO1IqekFhUqnxZCUF2ZuTWsMs Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a9b22b9201e64f1594fc84d898f188d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a9b22b9201e64f1594fc84d898f188d8"}]}] Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a9b22b9201e64f1594fc84d898f188d8 Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerGroupTestJSON-1786031441 Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 489a94b2c2df4608b25ba4bbf2737814 Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerGroupTestJSON-1786031441-project Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance group a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a could not be found. Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a'} Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a could not be found. Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a could not be found. Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.857735 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:36.863478 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:36.863478 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:36.863478 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:36.863478 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:36.863478 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a could not be found. Aug 27 02:49:36.863478 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:36.863478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-62eaa5e1-9f36-482d-8019-69664c6dd9ff tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Returning 404 to user: Instance group a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:36.863478 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-62eaa5e1-9f36-482d-8019-69664c6dd9ff tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a" status: 404 len: 117 microversion: 2.1 time: 0.022308 Aug 27 02:49:36.866558 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2040/3863] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:49:36 2022] DELETE /compute/v2.1/os-server-groups/a65ea0c3-993e-4d2b-9aa8-83bb44c90e9a => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:49:36.878101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8697d175-0db1-44c3-8b2f-cd16e889af2c tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:36.928738 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8697d175-0db1-44c3-8b2f-cd16e889af2c tempest-ServerGroupTestJSON-1786031441 tempest-ServerGroupTestJSON-1786031441-project] 10.222.0.99 "DELETE /compute/v2.1/os-server-groups/b4cd854e-3cba-4526-a536-ea136d4ef9cd" status: 204 len: 0 microversion: 2.1 time: 0.055049 Aug 27 02:49:36.931260 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2041/3864] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 02:49:36 2022] DELETE /compute/v2.1/os-server-groups/b4cd854e-3cba-4526-a536-ea136d4ef9cd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:49:37.626461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9aef4da7-4f4b-4a57-acf9-c384866ae010 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:37.675464 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9aef4da7-4f4b-4a57-acf9-c384866ae010 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.843492 Aug 27 02:49:37.677739 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1824/3865] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:36 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:37.717909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58de24fe-05b4-4e04-baa1-30511a99422e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:37.720403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-58de24fe-05b4-4e04-baa1-30511a99422e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: c81b5b65-11d6-4c91-896c-8f83405ca14c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:37.737844 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-58de24fe-05b4-4e04-baa1-30511a99422e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance c81b5b65-11d6-4c91-896c-8f83405ca14c could not be found. Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58de24fe-05b4-4e04-baa1-30511a99422e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/c81b5b65-11d6-4c91-896c-8f83405ca14c HTTP/1.1 Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance c81b5b65-11d6-4c91-896c-8f83405ca14c could not be found. Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'c81b5b65-11d6-4c91-896c-8f83405ca14c'} Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c81b5b65-11d6-4c91-896c-8f83405ca14c could not be found. Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c81b5b65-11d6-4c91-896c-8f83405ca14c could not be found. Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:37.741445 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:37.747591 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:37.747591 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:37.747591 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:37.747591 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c81b5b65-11d6-4c91-896c-8f83405ca14c could not be found. Aug 27 02:49:37.747591 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:37.749519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58de24fe-05b4-4e04-baa1-30511a99422e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance c81b5b65-11d6-4c91-896c-8f83405ca14c could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:37.755728 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58de24fe-05b4-4e04-baa1-30511a99422e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/c81b5b65-11d6-4c91-896c-8f83405ca14c" status: 404 len: 111 microversion: 2.1 time: 0.038923 Aug 27 02:49:37.756963 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2042/3866] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:37 2022] GET /compute/v2.1/servers/c81b5b65-11d6-4c91-896c-8f83405ca14c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:37.766393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7f72638a-5576-43e0-ab73-55eb217d8f68 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:37.767366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7f72638a-5576-43e0-ab73-55eb217d8f68 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:37.779267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f72638a-5576-43e0-ab73-55eb217d8f68 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:37.780441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f72638a-5576-43e0-ab73-55eb217d8f68 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:37.781172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f72638a-5576-43e0-ab73-55eb217d8f68 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:37.784393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f72638a-5576-43e0-ab73-55eb217d8f68 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:37.790453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f72638a-5576-43e0-ab73-55eb217d8f68 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:37.791351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f72638a-5576-43e0-ab73-55eb217d8f68 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:38.943705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7f72638a-5576-43e0-ab73-55eb217d8f68 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:38.991279 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7f72638a-5576-43e0-ab73-55eb217d8f68 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.228512 Aug 27 02:49:39.014465 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1825/3867] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:37 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:39.038801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-96703bbc-c8bf-47fb-9037-b54cae761e0b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:39.048419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-96703bbc-c8bf-47fb-9037-b54cae761e0b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:39.070977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96703bbc-c8bf-47fb-9037-b54cae761e0b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:39.071497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96703bbc-c8bf-47fb-9037-b54cae761e0b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:39.072256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96703bbc-c8bf-47fb-9037-b54cae761e0b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:39.076759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96703bbc-c8bf-47fb-9037-b54cae761e0b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:39.077291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96703bbc-c8bf-47fb-9037-b54cae761e0b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:39.080971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96703bbc-c8bf-47fb-9037-b54cae761e0b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:40.720558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-96703bbc-c8bf-47fb-9037-b54cae761e0b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:40.731135 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-96703bbc-c8bf-47fb-9037-b54cae761e0b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.700145 Aug 27 02:49:40.732513 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2043/3868] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:39 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:40.984981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-345012eb-ec7d-4726-a898-4e21a019b4f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-415862462", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-345012eb-ec7d-4726-a898-4e21a019b4f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 237 Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-415862462", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-415862462', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:41.003459 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-345012eb-ec7d-4726-a898-4e21a019b4f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-345012eb-ec7d-4726-a898-4e21a019b4f9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032596 Aug 27 02:49:41.015192 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1826/3869] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:40 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:49:41.029650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e786f7f-4f8e-4b5d-8d14-5956a6603d16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:41.030997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5e786f7f-4f8e-4b5d-8d14-5956a6603d16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:41.042626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e786f7f-4f8e-4b5d-8d14-5956a6603d16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:41.043541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e786f7f-4f8e-4b5d-8d14-5956a6603d16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:41.044293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e786f7f-4f8e-4b5d-8d14-5956a6603d16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:41.045649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e786f7f-4f8e-4b5d-8d14-5956a6603d16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:41.046830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e786f7f-4f8e-4b5d-8d14-5956a6603d16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:41.048482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e786f7f-4f8e-4b5d-8d14-5956a6603d16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:41.624587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5e786f7f-4f8e-4b5d-8d14-5956a6603d16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:41.644828 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e786f7f-4f8e-4b5d-8d14-5956a6603d16 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.624831 Aug 27 02:49:41.670582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2044/3870] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:41 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:41.688081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6afa5406-e1ad-448b-8f8f-72eb30b12a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:41.688854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6afa5406-e1ad-448b-8f8f-72eb30b12a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:41.711220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6afa5406-e1ad-448b-8f8f-72eb30b12a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:41.712046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6afa5406-e1ad-448b-8f8f-72eb30b12a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:41.712743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6afa5406-e1ad-448b-8f8f-72eb30b12a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:41.713506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6afa5406-e1ad-448b-8f8f-72eb30b12a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:41.714015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6afa5406-e1ad-448b-8f8f-72eb30b12a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:41.714481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6afa5406-e1ad-448b-8f8f-72eb30b12a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:42.207589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-576624959", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a063238b-e1ea-4f41-b6c0-edbb1b24222f"}, {"uuid": "a40f90f0-850c-4fa7-a4cf-92ff8f89b27e"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:42.266536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6afa5406-e1ad-448b-8f8f-72eb30b12a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:42.274165 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6afa5406-e1ad-448b-8f8f-72eb30b12a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.591051 Aug 27 02:49:42.279340 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1827/3871] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:41 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:42.443835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] validate_networks() for [('a063238b-e1ea-4f41-b6c0-edbb1b24222f', None, None, None, None, None), ('a40f90f0-850c-4fa7-a4cf-92ff8f89b27e', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:49:42.715298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-70603078-3752-4fe3-aba5-3d140701a971 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Action: 'create', calling method: .version_select at 0x7f4d29509940>, body: {"keypair": {"name": "tempest-keypair-1644386701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCviI7RQtiF2NeloHUTylVhCRb8tzb/zJf7h6qML7NJu56WCYu6nXPr4G06WWMZtn67M190QXGxLBm23PCIdlDjMAYhajGMfleDhg7rA2WfM9jzU4FKraruskPbNGiZOSA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:42.768131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-70603078-3752-4fe3-aba5-3d140701a971 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Getting quotas for project d4399d0cd9ba4a16a4db45cf851a54f5. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:42.809795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-70603078-3752-4fe3-aba5-3d140701a971 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Getting quotas for user bfefa59129eb427687ac388dbd000d25 and project d4399d0cd9ba4a16a4db45cf851a54f5. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:42.904292 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-70603078-3752-4fe3-aba5-3d140701a971 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.623684 Aug 27 02:49:42.906176 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1828/3872] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:49:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:49:42.937451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4fc8a45d-8176-4536-bd7f-5268752caf07 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1392267942", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4fc8a45d-8176-4536-bd7f-5268752caf07 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 235 Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1392267942", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1392267942', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:42.946374 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 27 02:49:42.954561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:42.959371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4fc8a45d-8176-4536-bd7f-5268752caf07 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:42.962158 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4fc8a45d-8176-4536-bd7f-5268752caf07 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.050137 Aug 27 02:49:42.963407 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1829/3873] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:42 2022] POST /compute/v2.1/servers => generated 133 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:49:42.976945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-acfa8051-5d2c-4301-bd1a-bcb94323796c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:42.978939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-acfa8051-5d2c-4301-bd1a-bcb94323796c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:42.995045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfa8051-5d2c-4301-bd1a-bcb94323796c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:42.996330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfa8051-5d2c-4301-bd1a-bcb94323796c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:42.997033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfa8051-5d2c-4301-bd1a-bcb94323796c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:42.998223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfa8051-5d2c-4301-bd1a-bcb94323796c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:42.999783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfa8051-5d2c-4301-bd1a-bcb94323796c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:43.000521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfa8051-5d2c-4301-bd1a-bcb94323796c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:43.595785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-acfa8051-5d2c-4301-bd1a-bcb94323796c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:43.611287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-acfa8051-5d2c-4301-bd1a-bcb94323796c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.640768 Aug 27 02:49:43.616059 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1830/3874] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:42 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:43.663206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ac9c3918-1d34-49a6-bd96-a20f7e45d1b3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:43.664803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac9c3918-1d34-49a6-bd96-a20f7e45d1b3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:43.683849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac9c3918-1d34-49a6-bd96-a20f7e45d1b3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:43.684924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac9c3918-1d34-49a6-bd96-a20f7e45d1b3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:43.685597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac9c3918-1d34-49a6-bd96-a20f7e45d1b3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:43.686768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac9c3918-1d34-49a6-bd96-a20f7e45d1b3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:43.689095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac9c3918-1d34-49a6-bd96-a20f7e45d1b3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:43.690834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac9c3918-1d34-49a6-bd96-a20f7e45d1b3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:44.507389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac9c3918-1d34-49a6-bd96-a20f7e45d1b3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:44.541616 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ac9c3918-1d34-49a6-bd96-a20f7e45d1b3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.885224 Aug 27 02:49:44.554396 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1831/3875] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:43 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:49:44.592711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9732e547-afb2-432a-a59e-b0443057f8dc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:44.593751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9732e547-afb2-432a-a59e-b0443057f8dc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: a979b4c1-12d3-4a29-ac2f-fb3b964e4e86] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:44.626388 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9732e547-afb2-432a-a59e-b0443057f8dc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance a979b4c1-12d3-4a29-ac2f-fb3b964e4e86 could not be found. Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9732e547-afb2-432a-a59e-b0443057f8dc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/a979b4c1-12d3-4a29-ac2f-fb3b964e4e86/action HTTP/1.1 Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 13 Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: {"pause": {}} Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance a979b4c1-12d3-4a29-ac2f-fb3b964e4e86 could not be found. Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'a979b4c1-12d3-4a29-ac2f-fb3b964e4e86', 'body': {'pause': {}}} Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a979b4c1-12d3-4a29-ac2f-fb3b964e4e86 could not be found. Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a979b4c1-12d3-4a29-ac2f-fb3b964e4e86 could not be found. Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:44.641735 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:44.649389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:44.649389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:44.649389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a979b4c1-12d3-4a29-ac2f-fb3b964e4e86 could not be found. Aug 27 02:49:44.649389 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:44.649389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9732e547-afb2-432a-a59e-b0443057f8dc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance a979b4c1-12d3-4a29-ac2f-fb3b964e4e86 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:44.649389 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9732e547-afb2-432a-a59e-b0443057f8dc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/a979b4c1-12d3-4a29-ac2f-fb3b964e4e86/action" status: 404 len: 111 microversion: 2.1 time: 0.069416 Aug 27 02:49:44.651751 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1832/3876] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:44 2022] POST /compute/v2.1/servers/a979b4c1-12d3-4a29-ac2f-fb3b964e4e86/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:44.675318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-984f8361-42f0-41f2-ad03-8689c3bb52e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:44.682397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-984f8361-42f0-41f2-ad03-8689c3bb52e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:44.694381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-984f8361-42f0-41f2-ad03-8689c3bb52e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:44.702645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-984f8361-42f0-41f2-ad03-8689c3bb52e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:44.703369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-984f8361-42f0-41f2-ad03-8689c3bb52e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:44.704281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-984f8361-42f0-41f2-ad03-8689c3bb52e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:44.704783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-984f8361-42f0-41f2-ad03-8689c3bb52e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:44.705299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-984f8361-42f0-41f2-ad03-8689c3bb52e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:45.325476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-984f8361-42f0-41f2-ad03-8689c3bb52e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:45.335684 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-984f8361-42f0-41f2-ad03-8689c3bb52e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.677735 Aug 27 02:49:45.351364 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1833/3877] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:44 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:45.385781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-702b5d88-dfa3-4d19-a1e8-75d495eff39f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:45.385781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-702b5d88-dfa3-4d19-a1e8-75d495eff39f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:45.399881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-702b5d88-dfa3-4d19-a1e8-75d495eff39f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:45.404984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-702b5d88-dfa3-4d19-a1e8-75d495eff39f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:45.404984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-702b5d88-dfa3-4d19-a1e8-75d495eff39f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:45.412858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-702b5d88-dfa3-4d19-a1e8-75d495eff39f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:45.413486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-702b5d88-dfa3-4d19-a1e8-75d495eff39f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:45.419107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-702b5d88-dfa3-4d19-a1e8-75d495eff39f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:45.838394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-702b5d88-dfa3-4d19-a1e8-75d495eff39f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:45.879295 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-702b5d88-dfa3-4d19-a1e8-75d495eff39f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.500297 Aug 27 02:49:45.884099 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1834/3878] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:45 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:45.907510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0178d293-7be3-41a8-b756-db5a38bed1f0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:45.909065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0178d293-7be3-41a8-b756-db5a38bed1f0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:45.918551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0178d293-7be3-41a8-b756-db5a38bed1f0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:45.919371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0178d293-7be3-41a8-b756-db5a38bed1f0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:45.920021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0178d293-7be3-41a8-b756-db5a38bed1f0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:45.921348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0178d293-7be3-41a8-b756-db5a38bed1f0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:45.922097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0178d293-7be3-41a8-b756-db5a38bed1f0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:45.922765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0178d293-7be3-41a8-b756-db5a38bed1f0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:46.033591 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0178d293-7be3-41a8-b756-db5a38bed1f0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 202 len: 0 microversion: 2.1 time: 0.134356 Aug 27 02:49:46.034302 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1835/3879] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:45 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:49:46.051639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e4e23d9e-e025-4f97-a5ae-4541e0de2f86 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:46.053714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e4e23d9e-e025-4f97-a5ae-4541e0de2f86 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:46.117910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e23d9e-e025-4f97-a5ae-4541e0de2f86 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:46.119090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e23d9e-e025-4f97-a5ae-4541e0de2f86 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:46.120143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e23d9e-e025-4f97-a5ae-4541e0de2f86 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:46.131004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e23d9e-e025-4f97-a5ae-4541e0de2f86 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:46.137585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e23d9e-e025-4f97-a5ae-4541e0de2f86 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:46.139384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e23d9e-e025-4f97-a5ae-4541e0de2f86 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:46.538862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e4e23d9e-e025-4f97-a5ae-4541e0de2f86 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:46.560339 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e4e23d9e-e025-4f97-a5ae-4541e0de2f86 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1509 microversion: 2.1 time: 0.515171 Aug 27 02:49:46.564114 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1836/3880] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:46 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1509 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:47.597588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-99d3eeee-9ce9-42b4-b58a-96d63a4472d2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:47.598683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-99d3eeee-9ce9-42b4-b58a-96d63a4472d2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:47.616817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d3eeee-9ce9-42b4-b58a-96d63a4472d2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:47.617460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d3eeee-9ce9-42b4-b58a-96d63a4472d2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:47.618747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d3eeee-9ce9-42b4-b58a-96d63a4472d2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:47.621210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d3eeee-9ce9-42b4-b58a-96d63a4472d2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:47.622518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d3eeee-9ce9-42b4-b58a-96d63a4472d2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:47.622996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d3eeee-9ce9-42b4-b58a-96d63a4472d2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.138586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-99d3eeee-9ce9-42b4-b58a-96d63a4472d2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:48.147358 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-99d3eeee-9ce9-42b4-b58a-96d63a4472d2 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1489 microversion: 2.1 time: 0.553974 Aug 27 02:49:48.151599 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1837/3881] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:47 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1489 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:48.186689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:48.187533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:48.199537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:48.202636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:48.203806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.207094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:48.209285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:48.211543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.261594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:48.289959 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Cannot 'pause' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state paused Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action HTTP/1.1 Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 13 Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: {"pause": {}} Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'pause' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state paused Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '58f7ed66-f5a7-42ec-be91-bd5a08981d8f', 'body': {'pause': {}}} Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f in vm_state paused. Cannot pause while the instance is in this state. Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state paused Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:48.297375 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:48.310170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:48.310170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:48.310170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:48.310170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state paused Aug 27 02:49:48.310170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:48.310170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 409 to user: Cannot 'pause' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state paused {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:48.312479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:49:48.312479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:49:48.312479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:49:48.312479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:49:48.312479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:49:48.324576 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9e49a4c6-2a10-4433-b8d3-11820657a913 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 409 len: 143 microversion: 2.1 time: 0.141396 Aug 27 02:49:48.330627 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1838/3882] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:48 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 143 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:49:48.344361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:48.347559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ceab039-33d8-4254-a888-cae1d57c8cda tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:48.349833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:48.350800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0ceab039-33d8-4254-a888-cae1d57c8cda tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:48.352690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.356916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:48.358874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:48.361812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.370310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ceab039-33d8-4254-a888-cae1d57c8cda tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:48.372330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ceab039-33d8-4254-a888-cae1d57c8cda tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:48.373085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ceab039-33d8-4254-a888-cae1d57c8cda tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.377402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ceab039-33d8-4254-a888-cae1d57c8cda tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:48.379700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ceab039-33d8-4254-a888-cae1d57c8cda tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:48.382805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ceab039-33d8-4254-a888-cae1d57c8cda tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.417592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Getting quotas for project ed47bfc9a7cc46c0a789d7ebd0a14bb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:49:48.435206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Getting quotas for user 0e9ba043fc844b0eaca32db087924226 and project ed47bfc9a7cc46c0a789d7ebd0a14bb1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:49:48.478184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:49:48.486105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:49:48.569815 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0ceab039-33d8-4254-a888-cae1d57c8cda tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 202 len: 0 microversion: 2.1 time: 0.230245 Aug 27 02:49:48.586097 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1839/3883] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:48 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:49:48.604014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b1df7eac-76ee-4337-81a1-08735094274e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:48.610706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b1df7eac-76ee-4337-81a1-08735094274e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:48.639439 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0433bc82-cd77-439e-8826-bbba1172705f tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.446887 Aug 27 02:49:48.649938 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2045/3884] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 6458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:49:48.650695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1df7eac-76ee-4337-81a1-08735094274e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:48.651549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1df7eac-76ee-4337-81a1-08735094274e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:48.652279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1df7eac-76ee-4337-81a1-08735094274e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.653263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1df7eac-76ee-4337-81a1-08735094274e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:48.662302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1df7eac-76ee-4337-81a1-08735094274e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:48.663341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1df7eac-76ee-4337-81a1-08735094274e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:48.684695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e22233d0-ab5e-44bf-a680-52f19d7174c0 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:48.685811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e22233d0-ab5e-44bf-a680-52f19d7174c0 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:49.056867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1df7eac-76ee-4337-81a1-08735094274e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:49.070410 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b1df7eac-76ee-4337-81a1-08735094274e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1496 microversion: 2.1 time: 0.480478 Aug 27 02:49:49.071239 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1840/3885] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:48 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1496 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:49.238776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e22233d0-ab5e-44bf-a680-52f19d7174c0 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:49.279503 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e22233d0-ab5e-44bf-a680-52f19d7174c0 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1212 microversion: 2.1 time: 0.621603 Aug 27 02:49:49.281028 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2046/3886] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:48 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1212 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:50.110248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-06eed3b5-883c-4157-aa75-8fdfc3815bdc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:50.111488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-06eed3b5-883c-4157-aa75-8fdfc3815bdc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:50.145911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06eed3b5-883c-4157-aa75-8fdfc3815bdc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:50.146963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06eed3b5-883c-4157-aa75-8fdfc3815bdc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:50.147677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06eed3b5-883c-4157-aa75-8fdfc3815bdc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:50.148655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06eed3b5-883c-4157-aa75-8fdfc3815bdc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:50.149343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06eed3b5-883c-4157-aa75-8fdfc3815bdc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:50.150017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06eed3b5-883c-4157-aa75-8fdfc3815bdc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:50.321345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ac3743ec-b826-4de1-8ca6-1cfa99cb86a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:50.322942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ac3743ec-b826-4de1-8ca6-1cfa99cb86a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:50.337216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac3743ec-b826-4de1-8ca6-1cfa99cb86a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:50.339716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac3743ec-b826-4de1-8ca6-1cfa99cb86a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:50.343537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac3743ec-b826-4de1-8ca6-1cfa99cb86a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:50.345019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac3743ec-b826-4de1-8ca6-1cfa99cb86a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:50.345810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac3743ec-b826-4de1-8ca6-1cfa99cb86a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:50.346514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac3743ec-b826-4de1-8ca6-1cfa99cb86a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:50.999994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-06eed3b5-883c-4157-aa75-8fdfc3815bdc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:51.010099 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-06eed3b5-883c-4157-aa75-8fdfc3815bdc tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.914229 Aug 27 02:49:51.011303 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1841/3887] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:50 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:51.060181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-981491d8-9fda-4f11-9ffd-bbf651e91d6b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:51.061782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-981491d8-9fda-4f11-9ffd-bbf651e91d6b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:51.075795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981491d8-9fda-4f11-9ffd-bbf651e91d6b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:51.077100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981491d8-9fda-4f11-9ffd-bbf651e91d6b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:51.078250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981491d8-9fda-4f11-9ffd-bbf651e91d6b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:51.079913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981491d8-9fda-4f11-9ffd-bbf651e91d6b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:51.080877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981491d8-9fda-4f11-9ffd-bbf651e91d6b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:51.081605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981491d8-9fda-4f11-9ffd-bbf651e91d6b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:51.184046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ac3743ec-b826-4de1-8ca6-1cfa99cb86a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:51.194359 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ac3743ec-b826-4de1-8ca6-1cfa99cb86a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1264 microversion: 2.1 time: 0.877476 Aug 27 02:49:51.195361 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2047/3888] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:50 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1264 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:49:51.788452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-981491d8-9fda-4f11-9ffd-bbf651e91d6b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:51.825061 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-981491d8-9fda-4f11-9ffd-bbf651e91d6b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.775235 Aug 27 02:49:51.826574 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1842/3889] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:51 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:51.856838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:51.874173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:51.901189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:51.902821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:51.904910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:51.906774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:51.908007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:51.909282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:51.995248 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8/action HTTP/1.1 Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 28 Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: {"reboot": {"type": "SOFT"}} Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd0b7bec6-d7a4-4b51-b360-a710046d55e8', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:52.005251 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:52.015686 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:49:52.015686 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.015686 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:52.015686 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.015686 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:52.015686 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:52.015686 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:52.015686 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:52.015686 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:52.015686 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:49:52.015686 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:49:52.033200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:52.036125 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4e10a939-2d2a-40f5-865d-98b688c7729c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8/action" status: 404 len: 111 microversion: 2.1 time: 0.187240 Aug 27 02:49:52.040368 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2048/3890] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:51 2022] POST /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8/action => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:52.048082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58911cda-87bc-4a80-9f50-45b5897a1c2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:52.048717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-58911cda-87bc-4a80-9f50-45b5897a1c2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:52.056428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58911cda-87bc-4a80-9f50-45b5897a1c2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:52.056923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58911cda-87bc-4a80-9f50-45b5897a1c2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:52.057365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58911cda-87bc-4a80-9f50-45b5897a1c2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:52.058123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58911cda-87bc-4a80-9f50-45b5897a1c2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:52.058790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58911cda-87bc-4a80-9f50-45b5897a1c2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:52.059405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58911cda-87bc-4a80-9f50-45b5897a1c2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:52.242699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e73e668-3792-45f3-84df-3c0bfbe505fa tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:52.243690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5e73e668-3792-45f3-84df-3c0bfbe505fa tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:52.293804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e73e668-3792-45f3-84df-3c0bfbe505fa tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:52.297434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e73e668-3792-45f3-84df-3c0bfbe505fa tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:52.299936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e73e668-3792-45f3-84df-3c0bfbe505fa tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:52.301638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e73e668-3792-45f3-84df-3c0bfbe505fa tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:52.303249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e73e668-3792-45f3-84df-3c0bfbe505fa tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:52.304219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e73e668-3792-45f3-84df-3c0bfbe505fa tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:52.603498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5e73e668-3792-45f3-84df-3c0bfbe505fa tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:52.613724 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e73e668-3792-45f3-84df-3c0bfbe505fa tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1270 microversion: 2.1 time: 0.382268 Aug 27 02:49:52.622053 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2049/3891] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:52 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1270 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:52.848708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:52.982859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-58911cda-87bc-4a80-9f50-45b5897a1c2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:53.072072 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-58911cda-87bc-4a80-9f50-45b5897a1c2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.025705 Aug 27 02:49:53.091067 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1843/3892] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:52 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:53.123080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1ca3560-0a30-401e-a11e-6d88e21906f8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:53.123959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a1ca3560-0a30-401e-a11e-6d88e21906f8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:53.204316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1ca3560-0a30-401e-a11e-6d88e21906f8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:53.205326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1ca3560-0a30-401e-a11e-6d88e21906f8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:53.218700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1ca3560-0a30-401e-a11e-6d88e21906f8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:53.220413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1ca3560-0a30-401e-a11e-6d88e21906f8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:53.230783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1ca3560-0a30-401e-a11e-6d88e21906f8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:53.237431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1ca3560-0a30-401e-a11e-6d88e21906f8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:53.661635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8508b7c9-7174-4eec-a09c-995c0bea0fd2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:53.662557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8508b7c9-7174-4eec-a09c-995c0bea0fd2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:53.680819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8508b7c9-7174-4eec-a09c-995c0bea0fd2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:53.683800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8508b7c9-7174-4eec-a09c-995c0bea0fd2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:53.687604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8508b7c9-7174-4eec-a09c-995c0bea0fd2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:53.690083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8508b7c9-7174-4eec-a09c-995c0bea0fd2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:53.694543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8508b7c9-7174-4eec-a09c-995c0bea0fd2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:53.695398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8508b7c9-7174-4eec-a09c-995c0bea0fd2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:54.032047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8508b7c9-7174-4eec-a09c-995c0bea0fd2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:54.045479 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8508b7c9-7174-4eec-a09c-995c0bea0fd2 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1270 microversion: 2.1 time: 0.387811 Aug 27 02:49:54.046291 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1844/3893] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:53 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1270 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:49:54.582387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a1ca3560-0a30-401e-a11e-6d88e21906f8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:54.605567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a1ca3560-0a30-401e-a11e-6d88e21906f8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.486200 Aug 27 02:49:54.623332 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2050/3894] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:53 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:54.695896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-544be810-593f-45bd-b585-ea9c5460334d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:54.713248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-544be810-593f-45bd-b585-ea9c5460334d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 03258413-60bf-41ec-819c-3ac3ca4332a5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:54.795727 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-544be810-593f-45bd-b585-ea9c5460334d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance 03258413-60bf-41ec-819c-3ac3ca4332a5 could not be found. Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-544be810-593f-45bd-b585-ea9c5460334d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/03258413-60bf-41ec-819c-3ac3ca4332a5/action HTTP/1.1 Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 28 Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: {"reboot": {"type": "SOFT"}} Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 03258413-60bf-41ec-819c-3ac3ca4332a5 could not be found. Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '03258413-60bf-41ec-819c-3ac3ca4332a5', 'body': {'reboot': {'type': 'SOFT'}}} Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03258413-60bf-41ec-819c-3ac3ca4332a5 could not be found. Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03258413-60bf-41ec-819c-3ac3ca4332a5 could not be found. Aug 27 02:49:54.807143 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.816614 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:54.816614 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.816614 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:54.816614 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:54.816614 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:54.816614 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:54.816614 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:54.816614 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03258413-60bf-41ec-819c-3ac3ca4332a5 could not be found. Aug 27 02:49:54.816614 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:54.823902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-544be810-593f-45bd-b585-ea9c5460334d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance 03258413-60bf-41ec-819c-3ac3ca4332a5 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:54.839144 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-544be810-593f-45bd-b585-ea9c5460334d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/03258413-60bf-41ec-819c-3ac3ca4332a5/action" status: 404 len: 111 microversion: 2.1 time: 0.169845 Aug 27 02:49:54.844515 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1845/3895] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:54 2022] POST /compute/v2.1/servers/03258413-60bf-41ec-819c-3ac3ca4332a5/action => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:49:54.856927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dfc1db8d-389c-4350-bf32-6531466223c3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:54.858759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dfc1db8d-389c-4350-bf32-6531466223c3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:54.910555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfc1db8d-389c-4350-bf32-6531466223c3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:54.919102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfc1db8d-389c-4350-bf32-6531466223c3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:54.920122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfc1db8d-389c-4350-bf32-6531466223c3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:54.927939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfc1db8d-389c-4350-bf32-6531466223c3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:54.928863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfc1db8d-389c-4350-bf32-6531466223c3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:54.929836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dfc1db8d-389c-4350-bf32-6531466223c3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:55.094018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ee2789b1-ae30-40b8-b65e-aa12d46101be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:55.097145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ee2789b1-ae30-40b8-b65e-aa12d46101be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:55.180612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2789b1-ae30-40b8-b65e-aa12d46101be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:55.185169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2789b1-ae30-40b8-b65e-aa12d46101be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:55.186551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2789b1-ae30-40b8-b65e-aa12d46101be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:55.190517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2789b1-ae30-40b8-b65e-aa12d46101be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:55.197517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2789b1-ae30-40b8-b65e-aa12d46101be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:55.202615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee2789b1-ae30-40b8-b65e-aa12d46101be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:55.797225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ee2789b1-ae30-40b8-b65e-aa12d46101be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:55.811788 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ee2789b1-ae30-40b8-b65e-aa12d46101be tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1270 microversion: 2.1 time: 0.724856 Aug 27 02:49:55.831734 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1846/3896] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:55 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1270 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:56.846058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea54ee3e-1ca2-4ddf-877e-e0b7a5f87250 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:56.846934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ea54ee3e-1ca2-4ddf-877e-e0b7a5f87250 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:56.862909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:56.866292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea54ee3e-1ca2-4ddf-877e-e0b7a5f87250 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:56.870708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea54ee3e-1ca2-4ddf-877e-e0b7a5f87250 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:56.874765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea54ee3e-1ca2-4ddf-877e-e0b7a5f87250 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:56.878385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea54ee3e-1ca2-4ddf-877e-e0b7a5f87250 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:56.878923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea54ee3e-1ca2-4ddf-877e-e0b7a5f87250 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:56.882651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea54ee3e-1ca2-4ddf-877e-e0b7a5f87250 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:57.290196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dfc1db8d-389c-4350-bf32-6531466223c3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:57.310513 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dfc1db8d-389c-4350-bf32-6531466223c3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 2.460949 Aug 27 02:49:57.314521 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2051/3897] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:54 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:57.338641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ea54ee3e-1ca2-4ddf-877e-e0b7a5f87250 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:57.365826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13ef9ad8-50fe-4ee3-9e24-a3bdffb10455 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:57.369919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13ef9ad8-50fe-4ee3-9e24-a3bdffb10455 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:57.388780 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ea54ee3e-1ca2-4ddf-877e-e0b7a5f87250 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1270 microversion: 2.1 time: 0.549967 Aug 27 02:49:57.392172 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1847/3898] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:56 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1270 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:49:57.403701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ef9ad8-50fe-4ee3-9e24-a3bdffb10455 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:57.404913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ef9ad8-50fe-4ee3-9e24-a3bdffb10455 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:57.405979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ef9ad8-50fe-4ee3-9e24-a3bdffb10455 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:57.413580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ef9ad8-50fe-4ee3-9e24-a3bdffb10455 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:57.414961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ef9ad8-50fe-4ee3-9e24-a3bdffb10455 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:57.429796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ef9ad8-50fe-4ee3-9e24-a3bdffb10455 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:58.275210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-13ef9ad8-50fe-4ee3-9e24-a3bdffb10455 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:49:58.308943 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13ef9ad8-50fe-4ee3-9e24-a3bdffb10455 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.952665 Aug 27 02:49:58.326678 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2052/3899] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:57 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:49:58.356816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:58.360256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:58.384076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:58.384823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:58.385409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:58.386478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:58.398792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1264253758", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d099a3c-a92a-4c98-9b30-33ed6c21c726"}], "security_groups": [{"name": "tempest-securitygroup--1927267306"}], "key_name": "tempest-keypair-1644386701", "user_data": "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:49:58.402451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:58.402910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:58.418825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:58.455791 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8/action HTTP/1.1 Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 65 Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'd0b7bec6-d7a4-4b51-b360-a710046d55e8', 'body': {'rebuild': {'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89'}}} Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 02:49:58.457433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:49:58.466493 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-641a0935-420e-4540-92bb-f6dddf7a3281 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8/action" status: 404 len: 111 microversion: 2.1 time: 0.112967 Aug 27 02:49:58.469960 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1848/3900] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:49:58 2022] POST /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8/action => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:49:58.478375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-89f0e7b1-7ea9-44c0-afdc-8015c708213a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:49:58.482188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-89f0e7b1-7ea9-44c0-afdc-8015c708213a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:49:58.501203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f0e7b1-7ea9-44c0-afdc-8015c708213a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:58.501745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f0e7b1-7ea9-44c0-afdc-8015c708213a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:58.502204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f0e7b1-7ea9-44c0-afdc-8015c708213a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:58.502951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f0e7b1-7ea9-44c0-afdc-8015c708213a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:49:58.503659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f0e7b1-7ea9-44c0-afdc-8015c708213a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:49:58.508842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f0e7b1-7ea9-44c0-afdc-8015c708213a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:49:59.246028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:49:59.336409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] validate_networks() for [('7d099a3c-a92a-4c98-9b30-33ed6c21c726', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:50:00.144851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-89f0e7b1-7ea9-44c0-afdc-8015c708213a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:00.166370 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-89f0e7b1-7ea9-44c0-afdc-8015c708213a tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1312 microversion: 2.1 time: 1.695167 Aug 27 02:50:00.167410 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1849/3901] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:49:58 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1312 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:00.184637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7ff8ac6e-e6f4-4e1d-bcf8-4fe8a6ee155b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:00.185927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7ff8ac6e-e6f4-4e1d-bcf8-4fe8a6ee155b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:00.193149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ff8ac6e-e6f4-4e1d-bcf8-4fe8a6ee155b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:00.193646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ff8ac6e-e6f4-4e1d-bcf8-4fe8a6ee155b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:00.194125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ff8ac6e-e6f4-4e1d-bcf8-4fe8a6ee155b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:00.194848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ff8ac6e-e6f4-4e1d-bcf8-4fe8a6ee155b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:00.202669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ff8ac6e-e6f4-4e1d-bcf8-4fe8a6ee155b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:00.204220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ff8ac6e-e6f4-4e1d-bcf8-4fe8a6ee155b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.074053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:50:01.074965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:50:01.074965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:50:01.075350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:50:01.075768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:50:01.094989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.097020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.097872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.101084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.103097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.105235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.112683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=84 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:01.149408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Getting quotas for project d4399d0cd9ba4a16a4db45cf851a54f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:50:01.166117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Getting quotas for user bfefa59129eb427687ac388dbd000d25 and project d4399d0cd9ba4a16a4db45cf851a54f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:50:01.200485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:50:01.203392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:50:01.277835 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-62c1a4d8-23a3-45e7-95d1-e35794bf7dbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.881176 Aug 27 02:50:01.290989 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2053/3902] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:49:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:50:01.303543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-48c90856-6ebb-4b2a-93a9-5e087ebaf505 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:01.304579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-48c90856-6ebb-4b2a-93a9-5e087ebaf505 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:01.315927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48c90856-6ebb-4b2a-93a9-5e087ebaf505 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.316806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48c90856-6ebb-4b2a-93a9-5e087ebaf505 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.318740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48c90856-6ebb-4b2a-93a9-5e087ebaf505 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.320660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48c90856-6ebb-4b2a-93a9-5e087ebaf505 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:01.321695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48c90856-6ebb-4b2a-93a9-5e087ebaf505 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:01.322546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-48c90856-6ebb-4b2a-93a9-5e087ebaf505 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:01.738744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7ff8ac6e-e6f4-4e1d-bcf8-4fe8a6ee155b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:01.777874 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7ff8ac6e-e6f4-4e1d-bcf8-4fe8a6ee155b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.607494 Aug 27 02:50:01.779670 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1850/3903] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:00 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:01.794287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-19f30b9f-8253-4e62-8577-06e220d5cc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:01.795939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-19f30b9f-8253-4e62-8577-06e220d5cc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:02.113026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-48c90856-6ebb-4b2a-93a9-5e087ebaf505 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:02.135433 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-48c90856-6ebb-4b2a-93a9-5e087ebaf505 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1333 microversion: 2.1 time: 0.843173 Aug 27 02:50:02.136040 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2054/3904] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:01 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1333 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:02.146876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e74072f-53cf-4344-b459-2e1af3ecf26f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:02.149568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5e74072f-53cf-4344-b459-2e1af3ecf26f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:02.162923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e74072f-53cf-4344-b459-2e1af3ecf26f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:02.163991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e74072f-53cf-4344-b459-2e1af3ecf26f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:02.164542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e74072f-53cf-4344-b459-2e1af3ecf26f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:02.165356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e74072f-53cf-4344-b459-2e1af3ecf26f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:02.165950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e74072f-53cf-4344-b459-2e1af3ecf26f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:02.168901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e74072f-53cf-4344-b459-2e1af3ecf26f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:02.305084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-19f30b9f-8253-4e62-8577-06e220d5cc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:02.323501 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-19f30b9f-8253-4e62-8577-06e220d5cc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1238 microversion: 2.1 time: 0.541250 Aug 27 02:50:02.325689 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1851/3905] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:01 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1238 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:03.088558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5e74072f-53cf-4344-b459-2e1af3ecf26f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:03.117918 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e74072f-53cf-4344-b459-2e1af3ecf26f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.977527 Aug 27 02:50:03.120767 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2055/3906] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:02 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:03.156988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ed808fa-ef82-442b-9cd6-89e31c3ce51c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:03.172190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9ed808fa-ef82-442b-9cd6-89e31c3ce51c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: edbe47aa-12af-4a3b-8860-8729b7a1b110] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:03.203648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aa66cd5e-277f-4071-978d-7c11dac0fb62 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:03.204269 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9ed808fa-ef82-442b-9cd6-89e31c3ce51c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance edbe47aa-12af-4a3b-8860-8729b7a1b110 could not be found. Aug 27 02:50:03.204816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aa66cd5e-277f-4071-978d-7c11dac0fb62 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ed808fa-ef82-442b-9cd6-89e31c3ce51c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/edbe47aa-12af-4a3b-8860-8729b7a1b110/action HTTP/1.1 Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 65 Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance edbe47aa-12af-4a3b-8860-8729b7a1b110 could not be found. Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'edbe47aa-12af-4a3b-8860-8729b7a1b110', 'body': {'rebuild': {'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89'}}} Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edbe47aa-12af-4a3b-8860-8729b7a1b110 could not be found. Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 27 02:50:03.212184 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edbe47aa-12af-4a3b-8860-8729b7a1b110 could not be found. Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edbe47aa-12af-4a3b-8860-8729b7a1b110 could not be found. Aug 27 02:50:03.215605 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:03.221151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ed808fa-ef82-442b-9cd6-89e31c3ce51c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance edbe47aa-12af-4a3b-8860-8729b7a1b110 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:03.223920 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9ed808fa-ef82-442b-9cd6-89e31c3ce51c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/edbe47aa-12af-4a3b-8860-8729b7a1b110/action" status: 404 len: 111 microversion: 2.1 time: 0.074661 Aug 27 02:50:03.226576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:03.228761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa66cd5e-277f-4071-978d-7c11dac0fb62 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:03.229266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa66cd5e-277f-4071-978d-7c11dac0fb62 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:03.233410 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1852/3907] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:03 2022] POST /compute/v2.1/servers/edbe47aa-12af-4a3b-8860-8729b7a1b110/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:03.234384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa66cd5e-277f-4071-978d-7c11dac0fb62 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:03.235345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa66cd5e-277f-4071-978d-7c11dac0fb62 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:03.236011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa66cd5e-277f-4071-978d-7c11dac0fb62 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:03.240252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa66cd5e-277f-4071-978d-7c11dac0fb62 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:03.245294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-10bf02df-ee55-47eb-96b7-42c2e354fa3d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:03.245978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-10bf02df-ee55-47eb-96b7-42c2e354fa3d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:03.269852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10bf02df-ee55-47eb-96b7-42c2e354fa3d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:03.270438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10bf02df-ee55-47eb-96b7-42c2e354fa3d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:03.276002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10bf02df-ee55-47eb-96b7-42c2e354fa3d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:03.278746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10bf02df-ee55-47eb-96b7-42c2e354fa3d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:03.303944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10bf02df-ee55-47eb-96b7-42c2e354fa3d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:03.304542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10bf02df-ee55-47eb-96b7-42c2e354fa3d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:03.695455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa66cd5e-277f-4071-978d-7c11dac0fb62 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:03.719644 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aa66cd5e-277f-4071-978d-7c11dac0fb62 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1333 microversion: 2.1 time: 0.535484 Aug 27 02:50:03.723650 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2056/3908] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:03 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1333 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:03.741401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad32a83b-501a-4c58-987f-2498c1503fd1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:03.742455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ad32a83b-501a-4c58-987f-2498c1503fd1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:03.763516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad32a83b-501a-4c58-987f-2498c1503fd1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:03.764485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad32a83b-501a-4c58-987f-2498c1503fd1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:03.765125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad32a83b-501a-4c58-987f-2498c1503fd1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:03.765961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad32a83b-501a-4c58-987f-2498c1503fd1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:03.766474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad32a83b-501a-4c58-987f-2498c1503fd1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:03.767013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad32a83b-501a-4c58-987f-2498c1503fd1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:03.904588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad32a83b-501a-4c58-987f-2498c1503fd1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:03.920453 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad32a83b-501a-4c58-987f-2498c1503fd1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1290 microversion: 2.1 time: 0.194153 Aug 27 02:50:03.921142 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2057/3909] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:03 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1290 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:04.457893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c9f9f012-a264-43d1-a88b-87e018ec0262 req-d642abe0-1dba-4d38-b004-88086dba16e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9432a1-b52c-407f-8ebc-4cc5703afaf9", "tag": "ad8dcbca-1907-49e6-9c47-cae614bfe87e"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:04.494570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9f9f012-a264-43d1-a88b-87e018ec0262 req-d642abe0-1dba-4d38-b004-88086dba16e2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:04.496655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9f9f012-a264-43d1-a88b-87e018ec0262 req-d642abe0-1dba-4d38-b004-88086dba16e2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:04.497789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9f9f012-a264-43d1-a88b-87e018ec0262 req-d642abe0-1dba-4d38-b004-88086dba16e2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:04.542442 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c9f9f012-a264-43d1-a88b-87e018ec0262 req-d642abe0-1dba-4d38-b004-88086dba16e2 service nova] Creating event network-changed:ad8dcbca-1907-49e6-9c47-cae614bfe87e for instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 on n-h2-852084-5 Aug 27 02:50:04.604140 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c9f9f012-a264-43d1-a88b-87e018ec0262 req-d642abe0-1dba-4d38-b004-88086dba16e2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148077 Aug 27 02:50:04.607636 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2058/3910] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:50:04.771810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6af2beb6-2213-421a-b277-1630860fe7a6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:04.773346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6af2beb6-2213-421a-b277-1630860fe7a6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:04.799465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af2beb6-2213-421a-b277-1630860fe7a6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:04.800338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af2beb6-2213-421a-b277-1630860fe7a6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:04.801137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af2beb6-2213-421a-b277-1630860fe7a6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:04.803068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af2beb6-2213-421a-b277-1630860fe7a6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:04.803951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af2beb6-2213-421a-b277-1630860fe7a6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:04.811693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6af2beb6-2213-421a-b277-1630860fe7a6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:05.152157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-10bf02df-ee55-47eb-96b7-42c2e354fa3d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:05.202687 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-10bf02df-ee55-47eb-96b7-42c2e354fa3d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.966064 Aug 27 02:50:05.229242 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1853/3911] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:03 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:05.247083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-436505c9-063c-4d3b-8734-c565a99671fd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:05.248337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-436505c9-063c-4d3b-8734-c565a99671fd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:05.265835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-436505c9-063c-4d3b-8734-c565a99671fd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:05.269796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-436505c9-063c-4d3b-8734-c565a99671fd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:05.271894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-436505c9-063c-4d3b-8734-c565a99671fd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:05.274420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-436505c9-063c-4d3b-8734-c565a99671fd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:05.275807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-436505c9-063c-4d3b-8734-c565a99671fd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:05.277268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-436505c9-063c-4d3b-8734-c565a99671fd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:05.595500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-436505c9-063c-4d3b-8734-c565a99671fd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:05.608542 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-436505c9-063c-4d3b-8734-c565a99671fd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1296 microversion: 2.1 time: 0.377706 Aug 27 02:50:05.609395 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1854/3912] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:05 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1296 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:05.647513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cc7318da-3d91-4484-a3a4-1a670872d63e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:05.651098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cc7318da-3d91-4484-a3a4-1a670872d63e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:05.684633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7318da-3d91-4484-a3a4-1a670872d63e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:05.686545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7318da-3d91-4484-a3a4-1a670872d63e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:05.687367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7318da-3d91-4484-a3a4-1a670872d63e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:05.688641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7318da-3d91-4484-a3a4-1a670872d63e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:05.692660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7318da-3d91-4484-a3a4-1a670872d63e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:05.695547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7318da-3d91-4484-a3a4-1a670872d63e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:06.242541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6af2beb6-2213-421a-b277-1630860fe7a6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:06.274788 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6af2beb6-2213-421a-b277-1630860fe7a6 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1333 microversion: 2.1 time: 1.505677 Aug 27 02:50:06.316595 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2059/3913] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:04 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1333 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:06.635431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4861f93-2161-4c00-be32-de5ee3faf605 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:06.640649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4861f93-2161-4c00-be32-de5ee3faf605 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:06.672308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4861f93-2161-4c00-be32-de5ee3faf605 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:06.673215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4861f93-2161-4c00-be32-de5ee3faf605 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:06.681417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4861f93-2161-4c00-be32-de5ee3faf605 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:06.691264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4861f93-2161-4c00-be32-de5ee3faf605 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:06.692236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4861f93-2161-4c00-be32-de5ee3faf605 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:06.693036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4861f93-2161-4c00-be32-de5ee3faf605 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:06.711952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cc7318da-3d91-4484-a3a4-1a670872d63e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:06.733175 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cc7318da-3d91-4484-a3a4-1a670872d63e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.108366 Aug 27 02:50:06.742171 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1855/3914] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:05 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:06.787930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-046821f1-fa1c-4014-a68d-e69e010980ec tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:06.790882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-046821f1-fa1c-4014-a68d-e69e010980ec tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: c6e597eb-b48d-45f6-be9b-a9502da48f87] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:06.821315 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-046821f1-fa1c-4014-a68d-e69e010980ec tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance c6e597eb-b48d-45f6-be9b-a9502da48f87 could not be found. Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-046821f1-fa1c-4014-a68d-e69e010980ec tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/c6e597eb-b48d-45f6-be9b-a9502da48f87/action HTTP/1.1 Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 15 Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: {"restore": {}} Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance c6e597eb-b48d-45f6-be9b-a9502da48f87 could not be found. Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'c6e597eb-b48d-45f6-be9b-a9502da48f87', 'body': {'restore': {}}} Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e597eb-b48d-45f6-be9b-a9502da48f87 could not be found. Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e597eb-b48d-45f6-be9b-a9502da48f87 could not be found. Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:06.824785 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:06.828475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:06.828475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:06.828475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e597eb-b48d-45f6-be9b-a9502da48f87 could not be found. Aug 27 02:50:06.828475 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:06.835167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-046821f1-fa1c-4014-a68d-e69e010980ec tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance c6e597eb-b48d-45f6-be9b-a9502da48f87 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:06.837182 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-046821f1-fa1c-4014-a68d-e69e010980ec tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/c6e597eb-b48d-45f6-be9b-a9502da48f87/action" status: 404 len: 111 microversion: 2.1 time: 0.056647 Aug 27 02:50:06.848835 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1856/3915] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:06 2022] POST /compute/v2.1/servers/c6e597eb-b48d-45f6-be9b-a9502da48f87/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:06.870624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bf4b0c4e-d728-4b60-94f3-904081dcc030 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:06.872105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bf4b0c4e-d728-4b60-94f3-904081dcc030 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:06.892599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf4b0c4e-d728-4b60-94f3-904081dcc030 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:06.893804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf4b0c4e-d728-4b60-94f3-904081dcc030 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:06.894857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf4b0c4e-d728-4b60-94f3-904081dcc030 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:06.896840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf4b0c4e-d728-4b60-94f3-904081dcc030 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:06.898081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf4b0c4e-d728-4b60-94f3-904081dcc030 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:06.899077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf4b0c4e-d728-4b60-94f3-904081dcc030 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:07.719851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4861f93-2161-4c00-be32-de5ee3faf605 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:07.758841 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4861f93-2161-4c00-be32-de5ee3faf605 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1296 microversion: 2.1 time: 1.131289 Aug 27 02:50:07.771165 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2060/3916] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:06 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1296 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:07.819283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-52221cb1-2933-41a2-928b-25a4014afbc5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:07.825189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-52221cb1-2933-41a2-928b-25a4014afbc5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:07.855865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52221cb1-2933-41a2-928b-25a4014afbc5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:07.857871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52221cb1-2933-41a2-928b-25a4014afbc5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:07.859091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52221cb1-2933-41a2-928b-25a4014afbc5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:07.872791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52221cb1-2933-41a2-928b-25a4014afbc5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:07.874317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52221cb1-2933-41a2-928b-25a4014afbc5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:07.877240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52221cb1-2933-41a2-928b-25a4014afbc5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.129742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bf4b0c4e-d728-4b60-94f3-904081dcc030 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:08.148109 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bf4b0c4e-d728-4b60-94f3-904081dcc030 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.296752 Aug 27 02:50:08.161715 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1857/3917] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:06 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:08.199340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9c9aec73-6017-486a-9714-8fa3f1da2524 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:08.200028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9c9aec73-6017-486a-9714-8fa3f1da2524 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:08.212620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c9aec73-6017-486a-9714-8fa3f1da2524 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.216699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c9aec73-6017-486a-9714-8fa3f1da2524 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.217410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c9aec73-6017-486a-9714-8fa3f1da2524 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.218391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c9aec73-6017-486a-9714-8fa3f1da2524 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.224805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c9aec73-6017-486a-9714-8fa3f1da2524 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.225474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c9aec73-6017-486a-9714-8fa3f1da2524 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.605861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-52221cb1-2933-41a2-928b-25a4014afbc5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:08.629034 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-52221cb1-2933-41a2-928b-25a4014afbc5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1333 microversion: 2.1 time: 0.850050 Aug 27 02:50:08.630636 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2061/3918] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:07 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1333 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:08.750614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a946c51d-90ae-49d1-9261-cdc6aaaca5fa req-746f33cb-a6bb-4b67-a0db-f1a3fdab3079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9432a1-b52c-407f-8ebc-4cc5703afaf9", "tag": "1ed634ab-6d46-4869-b113-ba7813bceff7"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:08.781341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a946c51d-90ae-49d1-9261-cdc6aaaca5fa req-746f33cb-a6bb-4b67-a0db-f1a3fdab3079 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.782310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a946c51d-90ae-49d1-9261-cdc6aaaca5fa req-746f33cb-a6bb-4b67-a0db-f1a3fdab3079 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.783285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a946c51d-90ae-49d1-9261-cdc6aaaca5fa req-746f33cb-a6bb-4b67-a0db-f1a3fdab3079 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.828585 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a946c51d-90ae-49d1-9261-cdc6aaaca5fa req-746f33cb-a6bb-4b67-a0db-f1a3fdab3079 service nova] Creating event network-changed:1ed634ab-6d46-4869-b113-ba7813bceff7 for instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 on n-h2-852084-5 Aug 27 02:50:08.846507 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a946c51d-90ae-49d1-9261-cdc6aaaca5fa req-746f33cb-a6bb-4b67-a0db-f1a3fdab3079 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102679 Aug 27 02:50:08.848546 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2062/3919] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:08.859599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b92e953b-9081-485b-94ac-0e4f59c12b68 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:08.861098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b92e953b-9081-485b-94ac-0e4f59c12b68 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:08.872866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b92e953b-9081-485b-94ac-0e4f59c12b68 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.874886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b92e953b-9081-485b-94ac-0e4f59c12b68 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.876273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b92e953b-9081-485b-94ac-0e4f59c12b68 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:08.877916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b92e953b-9081-485b-94ac-0e4f59c12b68 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:08.879025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b92e953b-9081-485b-94ac-0e4f59c12b68 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:08.882293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b92e953b-9081-485b-94ac-0e4f59c12b68 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:09.333523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b92e953b-9081-485b-94ac-0e4f59c12b68 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:09.334109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9c9aec73-6017-486a-9714-8fa3f1da2524 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:09.354007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:09.403754 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b92e953b-9081-485b-94ac-0e4f59c12b68 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1296 microversion: 2.1 time: 0.550156 Aug 27 02:50:09.405274 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9c9aec73-6017-486a-9714-8fa3f1da2524 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.209788 Aug 27 02:50:09.421704 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1858/3920] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:08 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:09.422180 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2063/3921] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:08 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1296 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:09.450442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:09.451056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:09.487366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:09.489713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:09.490880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:09.492516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:09.493691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:09.494826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:09.601876 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Cannot 'restore' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action HTTP/1.1 Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 15 Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: {"restore": {}} Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'restore' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '58f7ed66-f5a7-42ec-be91-bd5a08981d8f', 'body': {'restore': {}}} Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f in vm_state active. Cannot restore while the instance is in this state. Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:09.608572 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:09.612198 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:09.612198 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:09.612198 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:09.612198 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:50:09.612198 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:09.615393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 409 to user: Cannot 'restore' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:09.616541 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9b3e51f6-41d8-4c54-94f6-e04d98499c57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 409 len: 145 microversion: 2.1 time: 0.171957 Aug 27 02:50:09.617701 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1859/3922] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:09 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 145 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:50:09.630214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5f3af395-eaf2-4972-be78-0f7f4beadddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:09.630865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5f3af395-eaf2-4972-be78-0f7f4beadddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:09.645705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3af395-eaf2-4972-be78-0f7f4beadddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:09.646245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3af395-eaf2-4972-be78-0f7f4beadddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:09.646697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3af395-eaf2-4972-be78-0f7f4beadddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:09.647438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3af395-eaf2-4972-be78-0f7f4beadddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:09.647914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3af395-eaf2-4972-be78-0f7f4beadddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:09.648357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3af395-eaf2-4972-be78-0f7f4beadddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:09.670133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-02a81247-5ef0-4987-bcf9-f1d81ab1a97d tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:09.671311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-02a81247-5ef0-4987-bcf9-f1d81ab1a97d tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:09.682889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a81247-5ef0-4987-bcf9-f1d81ab1a97d tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:09.683403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a81247-5ef0-4987-bcf9-f1d81ab1a97d tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:09.683853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a81247-5ef0-4987-bcf9-f1d81ab1a97d tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:09.684601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a81247-5ef0-4987-bcf9-f1d81ab1a97d tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:09.685077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a81247-5ef0-4987-bcf9-f1d81ab1a97d tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:09.690208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02a81247-5ef0-4987-bcf9-f1d81ab1a97d tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:10.151507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5f3af395-eaf2-4972-be78-0f7f4beadddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:10.167031 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f3af395-eaf2-4972-be78-0f7f4beadddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.544616 Aug 27 02:50:10.168348 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2064/3923] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:09 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:10.210918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b794657c-9f1f-4bc7-b8a3-d37c519e07c5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:10.212428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b794657c-9f1f-4bc7-b8a3-d37c519e07c5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:10.225453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b794657c-9f1f-4bc7-b8a3-d37c519e07c5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:10.226760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b794657c-9f1f-4bc7-b8a3-d37c519e07c5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:10.227865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b794657c-9f1f-4bc7-b8a3-d37c519e07c5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:10.230344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b794657c-9f1f-4bc7-b8a3-d37c519e07c5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:10.231591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b794657c-9f1f-4bc7-b8a3-d37c519e07c5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:10.232782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b794657c-9f1f-4bc7-b8a3-d37c519e07c5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:10.918011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b794657c-9f1f-4bc7-b8a3-d37c519e07c5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:10.942785 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b794657c-9f1f-4bc7-b8a3-d37c519e07c5 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.739208 Aug 27 02:50:10.959399 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2065/3924] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:10 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:11.001003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2490bc6e-286a-475a-9748-6a46464f8417 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:11.002762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2490bc6e-286a-475a-9748-6a46464f8417 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:11.017290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2490bc6e-286a-475a-9748-6a46464f8417 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:11.018632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2490bc6e-286a-475a-9748-6a46464f8417 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:11.019417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2490bc6e-286a-475a-9748-6a46464f8417 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:11.022601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2490bc6e-286a-475a-9748-6a46464f8417 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:11.023773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2490bc6e-286a-475a-9748-6a46464f8417 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:11.025018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2490bc6e-286a-475a-9748-6a46464f8417 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:11.117451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:11.195096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:11.297532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-02a81247-5ef0-4987-bcf9-f1d81ab1a97d tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:11.321750 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-02a81247-5ef0-4987-bcf9-f1d81ab1a97d tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1333 microversion: 2.1 time: 1.655457 Aug 27 02:50:11.322319 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1860/3925] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:09 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1333 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:11.350886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-696d720d-ef23-4a39-8fbe-f0826793a1a7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:11.351840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-696d720d-ef23-4a39-8fbe-f0826793a1a7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 224fa6a2-88ed-4149-aa46-466860b5e69f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:11.373695 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-696d720d-ef23-4a39-8fbe-f0826793a1a7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance 224fa6a2-88ed-4149-aa46-466860b5e69f could not be found. Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-696d720d-ef23-4a39-8fbe-f0826793a1a7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/224fa6a2-88ed-4149-aa46-466860b5e69f/action HTTP/1.1 Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 14 Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: {"resume": {}} Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 224fa6a2-88ed-4149-aa46-466860b5e69f could not be found. Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '224fa6a2-88ed-4149-aa46-466860b5e69f', 'body': {'resume': {}}} Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 224fa6a2-88ed-4149-aa46-466860b5e69f could not be found. Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 224fa6a2-88ed-4149-aa46-466860b5e69f could not be found. Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:11.381638 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:11.389420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:11.389420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:11.389420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 224fa6a2-88ed-4149-aa46-466860b5e69f could not be found. Aug 27 02:50:11.389420 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:11.391255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-696d720d-ef23-4a39-8fbe-f0826793a1a7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance 224fa6a2-88ed-4149-aa46-466860b5e69f could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:11.392797 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-696d720d-ef23-4a39-8fbe-f0826793a1a7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/224fa6a2-88ed-4149-aa46-466860b5e69f/action" status: 404 len: 111 microversion: 2.1 time: 0.057490 Aug 27 02:50:11.397200 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1861/3926] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:11 2022] POST /compute/v2.1/servers/224fa6a2-88ed-4149-aa46-466860b5e69f/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:11.403155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f874501b-c2d1-46fd-b878-0542f0114ef3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:11.404022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f874501b-c2d1-46fd-b878-0542f0114ef3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:11.412776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f874501b-c2d1-46fd-b878-0542f0114ef3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:11.413600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f874501b-c2d1-46fd-b878-0542f0114ef3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:11.414266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f874501b-c2d1-46fd-b878-0542f0114ef3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:11.415178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f874501b-c2d1-46fd-b878-0542f0114ef3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:11.415793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f874501b-c2d1-46fd-b878-0542f0114ef3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:11.416371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f874501b-c2d1-46fd-b878-0542f0114ef3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:12.321245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:12.483439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2490bc6e-286a-475a-9748-6a46464f8417 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:12.509327 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2490bc6e-286a-475a-9748-6a46464f8417 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1364 microversion: 2.1 time: 1.541445 Aug 27 02:50:12.511000 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2066/3927] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:10 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1364 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:12.527013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-affd8148-1752-4a9c-859d-609e17727066 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:12.530152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-affd8148-1752-4a9c-859d-609e17727066 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:12.547077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affd8148-1752-4a9c-859d-609e17727066 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:12.548536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affd8148-1752-4a9c-859d-609e17727066 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:12.549642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affd8148-1752-4a9c-859d-609e17727066 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:12.551806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affd8148-1752-4a9c-859d-609e17727066 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:12.552911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affd8148-1752-4a9c-859d-609e17727066 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:12.554020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-affd8148-1752-4a9c-859d-609e17727066 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:12.967686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f874501b-c2d1-46fd-b878-0542f0114ef3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:12.978613 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f874501b-c2d1-46fd-b878-0542f0114ef3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.579559 Aug 27 02:50:12.979485 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1862/3928] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:11 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:13.021397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4642e9eb-a3eb-4bed-9f5e-b4e1900df8af tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:13.022608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4642e9eb-a3eb-4bed-9f5e-b4e1900df8af tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:13.030233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4642e9eb-a3eb-4bed-9f5e-b4e1900df8af tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:13.031060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4642e9eb-a3eb-4bed-9f5e-b4e1900df8af tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:13.031699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4642e9eb-a3eb-4bed-9f5e-b4e1900df8af tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:13.032899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4642e9eb-a3eb-4bed-9f5e-b4e1900df8af tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:13.033588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4642e9eb-a3eb-4bed-9f5e-b4e1900df8af tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:13.034288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4642e9eb-a3eb-4bed-9f5e-b4e1900df8af tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:13.126610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-affd8148-1752-4a9c-859d-609e17727066 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:13.147737 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-affd8148-1752-4a9c-859d-609e17727066 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1333 microversion: 2.1 time: 0.634141 Aug 27 02:50:13.149128 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2067/3929] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:12 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1333 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:13.537726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd47b11f-0a6f-48c4-bc81-1d14a9679e63 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:13.540338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dd47b11f-0a6f-48c4-bc81-1d14a9679e63 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:13.574920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd47b11f-0a6f-48c4-bc81-1d14a9679e63 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:13.577052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd47b11f-0a6f-48c4-bc81-1d14a9679e63 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:13.583784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd47b11f-0a6f-48c4-bc81-1d14a9679e63 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:13.585420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd47b11f-0a6f-48c4-bc81-1d14a9679e63 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:13.586557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd47b11f-0a6f-48c4-bc81-1d14a9679e63 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:13.587626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd47b11f-0a6f-48c4-bc81-1d14a9679e63 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:14.190604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dd47b11f-0a6f-48c4-bc81-1d14a9679e63 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:14.200989 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dd47b11f-0a6f-48c4-bc81-1d14a9679e63 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1364 microversion: 2.1 time: 0.673134 Aug 27 02:50:14.202014 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2068/3930] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:13 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1364 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:14.207616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-62703307-29bf-4f3c-934b-67c1ee186fa4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:14.208693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-62703307-29bf-4f3c-934b-67c1ee186fa4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:14.216027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62703307-29bf-4f3c-934b-67c1ee186fa4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:14.216900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62703307-29bf-4f3c-934b-67c1ee186fa4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:14.217561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62703307-29bf-4f3c-934b-67c1ee186fa4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:14.218853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62703307-29bf-4f3c-934b-67c1ee186fa4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:14.219550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62703307-29bf-4f3c-934b-67c1ee186fa4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:14.220196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62703307-29bf-4f3c-934b-67c1ee186fa4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:14.720774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4642e9eb-a3eb-4bed-9f5e-b4e1900df8af tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:14.753572 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4642e9eb-a3eb-4bed-9f5e-b4e1900df8af tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.736403 Aug 27 02:50:14.758230 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1863/3931] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:13 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:14.786203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:14.788184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:14.808697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:14.810830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:14.812094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:14.814848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:14.816308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:14.818036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:14.889961 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Cannot 'resume' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action HTTP/1.1 Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 14 Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: {"resume": {}} Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'resume' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '58f7ed66-f5a7-42ec-be91-bd5a08981d8f', 'body': {'resume': {}}} Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f in vm_state active. Cannot resume while the instance is in this state. Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:14.894344 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:14.902733 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:14.902733 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:14.902733 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:14.902733 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:14.902733 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:14.902733 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:50:14.902733 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:14.904964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 409 to user: Cannot 'resume' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:14.904964 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-adf9c0c3-9e27-40c1-8c14-9fbf28bcb23b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 409 len: 144 microversion: 2.1 time: 0.130186 Aug 27 02:50:14.912784 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1864/3932] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:14 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 144 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:50:14.930257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-baea5d70-046d-41af-b36f-3d8603622b9b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:14.930880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-baea5d70-046d-41af-b36f-3d8603622b9b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:14.942326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baea5d70-046d-41af-b36f-3d8603622b9b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:14.942887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baea5d70-046d-41af-b36f-3d8603622b9b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:14.943361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baea5d70-046d-41af-b36f-3d8603622b9b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:14.944124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baea5d70-046d-41af-b36f-3d8603622b9b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:14.944593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baea5d70-046d-41af-b36f-3d8603622b9b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:14.945071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-baea5d70-046d-41af-b36f-3d8603622b9b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:14.951162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-62703307-29bf-4f3c-934b-67c1ee186fa4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:14.990628 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-62703307-29bf-4f3c-934b-67c1ee186fa4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1333 microversion: 2.1 time: 0.786060 Aug 27 02:50:14.991828 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2069/3933] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:14 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1333 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:15.240303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-928d9be9-f668-4dd9-8a89-de6a81fd2bf7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:15.241329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-928d9be9-f668-4dd9-8a89-de6a81fd2bf7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:15.249192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-928d9be9-f668-4dd9-8a89-de6a81fd2bf7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:15.250066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-928d9be9-f668-4dd9-8a89-de6a81fd2bf7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:15.250755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-928d9be9-f668-4dd9-8a89-de6a81fd2bf7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:15.251723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-928d9be9-f668-4dd9-8a89-de6a81fd2bf7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:15.252560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-928d9be9-f668-4dd9-8a89-de6a81fd2bf7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:15.253203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-928d9be9-f668-4dd9-8a89-de6a81fd2bf7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:15.732329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-928d9be9-f668-4dd9-8a89-de6a81fd2bf7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:15.759477 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-928d9be9-f668-4dd9-8a89-de6a81fd2bf7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1364 microversion: 2.1 time: 0.524342 Aug 27 02:50:15.774237 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2070/3934] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:15 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1364 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:16.021105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-68f46eba-d107-42ed-b2cc-b10d900a7883 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:16.022416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-68f46eba-d107-42ed-b2cc-b10d900a7883 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:16.035264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68f46eba-d107-42ed-b2cc-b10d900a7883 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:16.037230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68f46eba-d107-42ed-b2cc-b10d900a7883 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:16.038165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68f46eba-d107-42ed-b2cc-b10d900a7883 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:16.039722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68f46eba-d107-42ed-b2cc-b10d900a7883 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:16.042685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68f46eba-d107-42ed-b2cc-b10d900a7883 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:16.043091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68f46eba-d107-42ed-b2cc-b10d900a7883 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:16.078367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-baea5d70-046d-41af-b36f-3d8603622b9b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:16.087434 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-baea5d70-046d-41af-b36f-3d8603622b9b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.173715 Aug 27 02:50:16.093281 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1865/3935] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:14 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:16.136701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a8c21702-4d42-4082-9a19-ebfc594df5a6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:16.137544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a8c21702-4d42-4082-9a19-ebfc594df5a6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:16.151556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c21702-4d42-4082-9a19-ebfc594df5a6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:16.152399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c21702-4d42-4082-9a19-ebfc594df5a6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:16.153052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c21702-4d42-4082-9a19-ebfc594df5a6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:16.154016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c21702-4d42-4082-9a19-ebfc594df5a6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:16.158522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c21702-4d42-4082-9a19-ebfc594df5a6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:16.159294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8c21702-4d42-4082-9a19-ebfc594df5a6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:16.653899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-68f46eba-d107-42ed-b2cc-b10d900a7883 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:16.656433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:16.669756 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-68f46eba-d107-42ed-b2cc-b10d900a7883 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1333 microversion: 2.1 time: 0.659422 Aug 27 02:50:16.671190 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2071/3936] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:16 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1333 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:16.802136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bbebd289-3823-4695-a5e9-a18df4d87d77 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:16.805014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bbebd289-3823-4695-a5e9-a18df4d87d77 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:16.822021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbebd289-3823-4695-a5e9-a18df4d87d77 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:16.823431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbebd289-3823-4695-a5e9-a18df4d87d77 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:16.825370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbebd289-3823-4695-a5e9-a18df4d87d77 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:16.827345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbebd289-3823-4695-a5e9-a18df4d87d77 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:16.828541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbebd289-3823-4695-a5e9-a18df4d87d77 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:16.829826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbebd289-3823-4695-a5e9-a18df4d87d77 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:17.171981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a8c21702-4d42-4082-9a19-ebfc594df5a6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:17.189948 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a8c21702-4d42-4082-9a19-ebfc594df5a6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.057502 Aug 27 02:50:17.197585 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1866/3937] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:16 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:17.407599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92a1b2b1-c630-4082-88a8-b6c53522630b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92a1b2b1-c630-4082-88a8-b6c53522630b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 160 Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "7f5f647c-3eb3-4e25-8f1b-498211cb650b"}]}} Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'server': {'name': '', 'imageRef': '6230fa40-aadc-49b6-823d-ddde81ab4f89', 'flavorRef': '452', 'networks': [{'uuid': '7f5f647c-3eb3-4e25-8f1b-498211cb650b'}]}}} Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi '' Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:50:17.416814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:50:17.420218 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:17.422821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92a1b2b1-c630-4082-88a8-b6c53522630b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:17.423818 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-92a1b2b1-c630-4082-88a8-b6c53522630b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.020641 Aug 27 02:50:17.424427 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1867/3938] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:50:17 2022] POST /compute/v2.1/servers => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:50:17.437201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6dc75c33-f18c-4297-a21f-1a32fea4135d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:17.438189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6dc75c33-f18c-4297-a21f-1a32fea4135d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:17.455920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6dc75c33-f18c-4297-a21f-1a32fea4135d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:17.456554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6dc75c33-f18c-4297-a21f-1a32fea4135d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:17.457656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6dc75c33-f18c-4297-a21f-1a32fea4135d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:17.459671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6dc75c33-f18c-4297-a21f-1a32fea4135d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:17.460176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6dc75c33-f18c-4297-a21f-1a32fea4135d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:17.460758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6dc75c33-f18c-4297-a21f-1a32fea4135d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:17.764258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bbebd289-3823-4695-a5e9-a18df4d87d77 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:17.776083 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bbebd289-3823-4695-a5e9-a18df4d87d77 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1364 microversion: 2.1 time: 0.985967 Aug 27 02:50:17.776709 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2072/3939] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:16 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1364 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:17.781698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-8ed8ac55-af1d-4799-a22e-501a791122e7 req-ea7bfd06-1bd8-46f6-8789-ac87a53fec4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9432a1-b52c-407f-8ebc-4cc5703afaf9", "name": "network-vif-plugged", "status": "completed", "tag": "1ed634ab-6d46-4869-b113-ba7813bceff7"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:17.793806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8ed8ac55-af1d-4799-a22e-501a791122e7 req-ea7bfd06-1bd8-46f6-8789-ac87a53fec4b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:17.794599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8ed8ac55-af1d-4799-a22e-501a791122e7 req-ea7bfd06-1bd8-46f6-8789-ac87a53fec4b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:17.795204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8ed8ac55-af1d-4799-a22e-501a791122e7 req-ea7bfd06-1bd8-46f6-8789-ac87a53fec4b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:17.821961 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-8ed8ac55-af1d-4799-a22e-501a791122e7 req-ea7bfd06-1bd8-46f6-8789-ac87a53fec4b service nova] Creating event network-vif-plugged:1ed634ab-6d46-4869-b113-ba7813bceff7 for instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 on n-h2-852084-5 Aug 27 02:50:17.830731 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-8ed8ac55-af1d-4799-a22e-501a791122e7 req-ea7bfd06-1bd8-46f6-8789-ac87a53fec4b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052665 Aug 27 02:50:17.832345 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2073/3940] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:17.839609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-496c80a1-caba-462c-80aa-7535ce4b4392 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:17.840458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-496c80a1-caba-462c-80aa-7535ce4b4392 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:17.853233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496c80a1-caba-462c-80aa-7535ce4b4392 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:17.854038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496c80a1-caba-462c-80aa-7535ce4b4392 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:17.854857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496c80a1-caba-462c-80aa-7535ce4b4392 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:17.856600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496c80a1-caba-462c-80aa-7535ce4b4392 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:17.857490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496c80a1-caba-462c-80aa-7535ce4b4392 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:17.858166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-496c80a1-caba-462c-80aa-7535ce4b4392 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:18.265220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-496c80a1-caba-462c-80aa-7535ce4b4392 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:18.275056 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-496c80a1-caba-462c-80aa-7535ce4b4392 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1333 microversion: 2.1 time: 0.440415 Aug 27 02:50:18.275903 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2074/3941] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:17 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1333 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:18.316091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6dc75c33-f18c-4297-a21f-1a32fea4135d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:18.344895 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6dc75c33-f18c-4297-a21f-1a32fea4135d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.909971 Aug 27 02:50:18.372132 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1868/3942] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:17 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:18.395544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6536a8d2-7923-43bd-a680-6018c2051c3f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:18.396779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6536a8d2-7923-43bd-a680-6018c2051c3f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:18.409407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6536a8d2-7923-43bd-a680-6018c2051c3f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:18.410972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6536a8d2-7923-43bd-a680-6018c2051c3f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:18.412125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6536a8d2-7923-43bd-a680-6018c2051c3f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:18.415279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6536a8d2-7923-43bd-a680-6018c2051c3f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:18.416906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6536a8d2-7923-43bd-a680-6018c2051c3f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:18.418375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6536a8d2-7923-43bd-a680-6018c2051c3f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:18.643524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-bd611b33-ab3c-4891-ae96-bf38aa1ef82a req-c67e94f4-1078-460f-8f31-80e403c12fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2", "tag": "cf665155-495a-4810-89f7-0f08309c79e8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:18.672083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bd611b33-ab3c-4891-ae96-bf38aa1ef82a req-c67e94f4-1078-460f-8f31-80e403c12fa0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:18.672579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bd611b33-ab3c-4891-ae96-bf38aa1ef82a req-c67e94f4-1078-460f-8f31-80e403c12fa0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:18.673172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bd611b33-ab3c-4891-ae96-bf38aa1ef82a req-c67e94f4-1078-460f-8f31-80e403c12fa0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:18.711062 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-bd611b33-ab3c-4891-ae96-bf38aa1ef82a req-c67e94f4-1078-460f-8f31-80e403c12fa0 service nova] Creating event network-changed:cf665155-495a-4810-89f7-0f08309c79e8 for instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 on n-h1-852084-5 Aug 27 02:50:18.726509 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-bd611b33-ab3c-4891-ae96-bf38aa1ef82a req-c67e94f4-1078-460f-8f31-80e403c12fa0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086992 Aug 27 02:50:18.728553 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1869/3943] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:50:18.811101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-790fd2e4-800f-4d68-ba7f-c4dc7a5bffa1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:18.812922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-790fd2e4-800f-4d68-ba7f-c4dc7a5bffa1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:18.827036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-790fd2e4-800f-4d68-ba7f-c4dc7a5bffa1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:18.828375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-790fd2e4-800f-4d68-ba7f-c4dc7a5bffa1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:18.829884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-790fd2e4-800f-4d68-ba7f-c4dc7a5bffa1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:18.833098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-790fd2e4-800f-4d68-ba7f-c4dc7a5bffa1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:18.835890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-790fd2e4-800f-4d68-ba7f-c4dc7a5bffa1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:18.838245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-790fd2e4-800f-4d68-ba7f-c4dc7a5bffa1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:18.944872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6536a8d2-7923-43bd-a680-6018c2051c3f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:18.963204 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6536a8d2-7923-43bd-a680-6018c2051c3f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.589440 Aug 27 02:50:18.965299 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2075/3944] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:18 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:18.993761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-51ee90e5-e4a1-468d-a451-b2d3ea47ba56 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:18.995156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-51ee90e5-e4a1-468d-a451-b2d3ea47ba56 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: c8c54ed6-78e0-4170-a5b5-47dca35a8dd9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:19.007794 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-51ee90e5-e4a1-468d-a451-b2d3ea47ba56 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance c8c54ed6-78e0-4170-a5b5-47dca35a8dd9 could not be found. Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-51ee90e5-e4a1-468d-a451-b2d3ea47ba56 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/c8c54ed6-78e0-4170-a5b5-47dca35a8dd9/action HTTP/1.1 Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 14 Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: {"shelve": {}} Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance c8c54ed6-78e0-4170-a5b5-47dca35a8dd9 could not be found. Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'c8c54ed6-78e0-4170-a5b5-47dca35a8dd9', 'body': {'shelve': {}}} Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c54ed6-78e0-4170-a5b5-47dca35a8dd9 could not be found. Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c54ed6-78e0-4170-a5b5-47dca35a8dd9 could not be found. Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:19.022410 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:19.029382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:19.029382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:19.029382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c54ed6-78e0-4170-a5b5-47dca35a8dd9 could not be found. Aug 27 02:50:19.029382 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:19.033916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-51ee90e5-e4a1-468d-a451-b2d3ea47ba56 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance c8c54ed6-78e0-4170-a5b5-47dca35a8dd9 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:19.035305 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-51ee90e5-e4a1-468d-a451-b2d3ea47ba56 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/c8c54ed6-78e0-4170-a5b5-47dca35a8dd9/action" status: 404 len: 111 microversion: 2.1 time: 0.051904 Aug 27 02:50:19.037093 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2076/3945] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:18 2022] POST /compute/v2.1/servers/c8c54ed6-78e0-4170-a5b5-47dca35a8dd9/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:50:19.046906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-42302a10-eb7f-4195-80a6-491706b4e0e8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:19.047906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-42302a10-eb7f-4195-80a6-491706b4e0e8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:19.057800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42302a10-eb7f-4195-80a6-491706b4e0e8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:19.059287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42302a10-eb7f-4195-80a6-491706b4e0e8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:19.059972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42302a10-eb7f-4195-80a6-491706b4e0e8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:19.061336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42302a10-eb7f-4195-80a6-491706b4e0e8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:19.062484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42302a10-eb7f-4195-80a6-491706b4e0e8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:19.064890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-42302a10-eb7f-4195-80a6-491706b4e0e8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:19.539842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-42302a10-eb7f-4195-80a6-491706b4e0e8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:19.574649 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-42302a10-eb7f-4195-80a6-491706b4e0e8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.532884 Aug 27 02:50:19.593774 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2077/3946] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:19 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:19.606617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5191f556-956e-4541-9d7e-69b7e6c015df tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:19.611311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5191f556-956e-4541-9d7e-69b7e6c015df tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:19.658013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5191f556-956e-4541-9d7e-69b7e6c015df tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:19.659820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5191f556-956e-4541-9d7e-69b7e6c015df tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:19.663346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5191f556-956e-4541-9d7e-69b7e6c015df tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:19.667387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5191f556-956e-4541-9d7e-69b7e6c015df tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:19.670525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5191f556-956e-4541-9d7e-69b7e6c015df tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:19.673626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5191f556-956e-4541-9d7e-69b7e6c015df tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:20.044454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-790fd2e4-800f-4d68-ba7f-c4dc7a5bffa1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:20.060688 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-790fd2e4-800f-4d68-ba7f-c4dc7a5bffa1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1364 microversion: 2.1 time: 1.262607 Aug 27 02:50:20.061914 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1870/3947] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:18 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1364 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:20.067740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-46c08c13-0919-4526-b90e-721f5cf437c6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:20.076612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-46c08c13-0919-4526-b90e-721f5cf437c6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:20.089472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46c08c13-0919-4526-b90e-721f5cf437c6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:20.094673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46c08c13-0919-4526-b90e-721f5cf437c6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:20.095510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46c08c13-0919-4526-b90e-721f5cf437c6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:20.096516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46c08c13-0919-4526-b90e-721f5cf437c6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:20.097337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46c08c13-0919-4526-b90e-721f5cf437c6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:20.098591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46c08c13-0919-4526-b90e-721f5cf437c6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:20.620523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-46c08c13-0919-4526-b90e-721f5cf437c6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:20.637041 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-46c08c13-0919-4526-b90e-721f5cf437c6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.571107 Aug 27 02:50:20.640211 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1871/3948] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:20 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:20.929788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5191f556-956e-4541-9d7e-69b7e6c015df tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:20.952396 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5191f556-956e-4541-9d7e-69b7e6c015df tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1333 microversion: 2.1 time: 1.367121 Aug 27 02:50:20.959330 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2078/3949] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:19 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1333 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:20.980988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7075162d-2830-4921-abe7-97ed6b5bc6f8 req-1c9b34e2-c1dc-424a-968a-2a3aadca00cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9432a1-b52c-407f-8ebc-4cc5703afaf9", "name": "network-vif-plugged", "status": "completed", "tag": "ad8dcbca-1907-49e6-9c47-cae614bfe87e"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:21.000392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7075162d-2830-4921-abe7-97ed6b5bc6f8 req-1c9b34e2-c1dc-424a-968a-2a3aadca00cb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.001792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7075162d-2830-4921-abe7-97ed6b5bc6f8 req-1c9b34e2-c1dc-424a-968a-2a3aadca00cb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.002858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7075162d-2830-4921-abe7-97ed6b5bc6f8 req-1c9b34e2-c1dc-424a-968a-2a3aadca00cb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:21.041388 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7075162d-2830-4921-abe7-97ed6b5bc6f8 req-1c9b34e2-c1dc-424a-968a-2a3aadca00cb service nova] Creating event network-vif-plugged:ad8dcbca-1907-49e6-9c47-cae614bfe87e for instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 on n-h2-852084-5 Aug 27 02:50:21.053616 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7075162d-2830-4921-abe7-97ed6b5bc6f8 req-1c9b34e2-c1dc-424a-968a-2a3aadca00cb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092256 Aug 27 02:50:21.054735 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2079/3950] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:21.065944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-639b5f1b-5919-49cb-8c99-755aa9e7f6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:21.071883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-639b5f1b-5919-49cb-8c99-755aa9e7f6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:21.089334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639b5f1b-5919-49cb-8c99-755aa9e7f6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.092792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639b5f1b-5919-49cb-8c99-755aa9e7f6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.093810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639b5f1b-5919-49cb-8c99-755aa9e7f6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:21.094812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639b5f1b-5919-49cb-8c99-755aa9e7f6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.107227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639b5f1b-5919-49cb-8c99-755aa9e7f6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.113384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-639b5f1b-5919-49cb-8c99-755aa9e7f6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:21.195233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-639b5f1b-5919-49cb-8c99-755aa9e7f6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lazy-loading 'flavor' on Instance uuid 58f7ed66-f5a7-42ec-be91-bd5a08981d8f {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:50:21.330712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7c45cb6e-ef17-47bc-8a8b-ec548f3dd243 tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Calling method '.version_select at 0x7f4d29565040>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:21.408510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-7c45cb6e-ef17-47bc-8a8b-ec548f3dd243 tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 20512c6a-0ad3-4d61-8b80-071899d6b6a4 does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:50:21.409466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-7c45cb6e-ef17-47bc-8a8b-ec548f3dd243 tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Neutron security group 20512c6a-0ad3-4d61-8b80-071899d6b6a4 not found {{(pid=122487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:50:21.410217 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-7c45cb6e-ef17-47bc-8a8b-ec548f3dd243 tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] HTTP exception thrown: Security group 20512c6a-0ad3-4d61-8b80-071899d6b6a4 does not exist Aug 27 02:50:21.410217 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-e4953e96-7f49-4b3d-a1c9-6c00a74723ca'] Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7c45cb6e-ef17-47bc-8a8b-ec548f3dd243 tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Request method failure captured: Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-security-groups/20512c6a-0ad3-4d61-8b80-071899d6b6a4 HTTP/1.1 Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYZra_hnP30RwYnK52HP25ebvboTq0cjCHG2Cx8O1-M6XRlG5l5b-_4-ANH6MF3sJT-vLtRnwf8CzuOv8z5yPB67aR24Cn44F3thxT-kZGhL6kLS5JCk8PHNLeFDB8xMK5mnUA7ISw3wfbtJDb22QUTk1YV7-d-XQK6PcfYP45jZ_XQ Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 003002acde1c4ce7bdf1318641517158 Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_003002acde1c4ce7bdf1318641517158"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/003002acde1c4ce7bdf1318641517158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/003002acde1c4ce7bdf1318641517158"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/003002acde1c4ce7bdf1318641517158"}]}] Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 003002acde1c4ce7bdf1318641517158 Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsNegativeTestJSON-359066220-project Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 19c8bb963f5c486088ae15313746a7cb Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-359066220-project Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group 20512c6a-0ad3-4d61-8b80-071899d6b6a4 does not exist Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-e4953e96-7f49-4b3d-a1c9-6c00a74723ca'] Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '20512c6a-0ad3-4d61-8b80-071899d6b6a4'} Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:50:21.412562 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 20512c6a-0ad3-4d61-8b80-071899d6b6a4 does not exist Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4953e96-7f49-4b3d-a1c9-6c00a74723ca'] Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 20512c6a-0ad3-4d61-8b80-071899d6b6a4 does not exist Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4953e96-7f49-4b3d-a1c9-6c00a74723ca'] Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 20512c6a-0ad3-4d61-8b80-071899d6b6a4 does not exist Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4953e96-7f49-4b3d-a1c9-6c00a74723ca'] Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 20512c6a-0ad3-4d61-8b80-071899d6b6a4 does not exist Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4953e96-7f49-4b3d-a1c9-6c00a74723ca'] Aug 27 02:50:21.415687 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:21.420997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7c45cb6e-ef17-47bc-8a8b-ec548f3dd243 tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Returning 404 to user: Security group 20512c6a-0ad3-4d61-8b80-071899d6b6a4 does not exist Aug 27 02:50:21.420997 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-e4953e96-7f49-4b3d-a1c9-6c00a74723ca'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:21.422165 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7c45cb6e-ef17-47bc-8a8b-ec548f3dd243 tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/20512c6a-0ad3-4d61-8b80-071899d6b6a4" status: 404 len: 194 microversion: 2.1 time: 0.780276 Aug 27 02:50:21.423266 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1872/3951] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:50:20 2022] DELETE /compute/v2.1/os-security-groups/20512c6a-0ad3-4d61-8b80-071899d6b6a4 => generated 194 bytes in 782 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:21.436980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-51cb5736-81fd-4b1a-8c36-eafcc660bbbb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:21.437887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-51cb5736-81fd-4b1a-8c36-eafcc660bbbb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:21.458183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cb5736-81fd-4b1a-8c36-eafcc660bbbb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.461548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cb5736-81fd-4b1a-8c36-eafcc660bbbb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.462381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cb5736-81fd-4b1a-8c36-eafcc660bbbb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:21.467245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cb5736-81fd-4b1a-8c36-eafcc660bbbb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.467948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cb5736-81fd-4b1a-8c36-eafcc660bbbb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.469004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cb5736-81fd-4b1a-8c36-eafcc660bbbb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:21.617233 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-639b5f1b-5919-49cb-8c99-755aa9e7f6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 202 len: 0 microversion: 2.1 time: 0.560782 Aug 27 02:50:21.619790 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2080/3952] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:50:21 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:50:21.633047 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fcf09815-ad2a-45e3-b605-33408e526e72 tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.009661 Aug 27 02:50:21.642192 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2081/3953] 10.222.0.99 () {58 vars in 1164 bytes} [Sat Aug 27 02:50:21 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 02:50:21.657616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-92e8a71c-23a0-48c5-b1af-c9facc12cb2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:21.658449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-92e8a71c-23a0-48c5-b1af-c9facc12cb2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:21.686119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e8a71c-23a0-48c5-b1af-c9facc12cb2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.688403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e8a71c-23a0-48c5-b1af-c9facc12cb2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.689016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e8a71c-23a0-48c5-b1af-c9facc12cb2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:21.689904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e8a71c-23a0-48c5-b1af-c9facc12cb2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:21.693911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e8a71c-23a0-48c5-b1af-c9facc12cb2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:21.694432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92e8a71c-23a0-48c5-b1af-c9facc12cb2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:22.285852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-51cb5736-81fd-4b1a-8c36-eafcc660bbbb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:22.318073 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-51cb5736-81fd-4b1a-8c36-eafcc660bbbb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1364 microversion: 2.1 time: 0.893292 Aug 27 02:50:22.325919 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1873/3954] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:21 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1364 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:22.348896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6d6b1b42-9219-420b-a30b-71e775b4fc69 tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Calling method '.version_select at 0x7f4d29535670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:23.276743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-92e8a71c-23a0-48c5-b1af-c9facc12cb2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:23.336979 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-92e8a71c-23a0-48c5-b1af-c9facc12cb2c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1510 microversion: 2.1 time: 1.682726 Aug 27 02:50:23.349106 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2082/3955] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:21 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1510 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:23.395810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-10fe4abf-1f7b-43f6-8abf-e2253085bb87 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:23.397362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-10fe4abf-1f7b-43f6-8abf-e2253085bb87 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:23.426036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fe4abf-1f7b-43f6-8abf-e2253085bb87 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:23.426905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fe4abf-1f7b-43f6-8abf-e2253085bb87 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:23.427680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fe4abf-1f7b-43f6-8abf-e2253085bb87 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:23.429025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fe4abf-1f7b-43f6-8abf-e2253085bb87 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:23.429860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fe4abf-1f7b-43f6-8abf-e2253085bb87 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:23.430575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fe4abf-1f7b-43f6-8abf-e2253085bb87 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:24.349490 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6d6b1b42-9219-420b-a30b-71e775b4fc69 tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.021561 Aug 27 02:50:24.355049 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1874/3956] 10.222.0.99 () {58 vars in 1158 bytes} [Sat Aug 27 02:50:22 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:24.369437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1bc9a472-3201-4e73-9e11-0fbed6180c32 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:24.372122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1bc9a472-3201-4e73-9e11-0fbed6180c32 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:24.388808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bc9a472-3201-4e73-9e11-0fbed6180c32 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:24.391426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bc9a472-3201-4e73-9e11-0fbed6180c32 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:24.393077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bc9a472-3201-4e73-9e11-0fbed6180c32 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:24.397775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bc9a472-3201-4e73-9e11-0fbed6180c32 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:24.399962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bc9a472-3201-4e73-9e11-0fbed6180c32 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:24.401732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bc9a472-3201-4e73-9e11-0fbed6180c32 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:24.548880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-10fe4abf-1f7b-43f6-8abf-e2253085bb87 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:24.582524 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-10fe4abf-1f7b-43f6-8abf-e2253085bb87 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1667 microversion: 2.1 time: 1.235191 Aug 27 02:50:24.583756 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2083/3957] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:23 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1667 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:24.615148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aef836ab-c699-428f-8802-391dab283ddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:24.616326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aef836ab-c699-428f-8802-391dab283ddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:24.661458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef836ab-c699-428f-8802-391dab283ddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:24.662473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef836ab-c699-428f-8802-391dab283ddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:24.663160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef836ab-c699-428f-8802-391dab283ddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:24.667978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef836ab-c699-428f-8802-391dab283ddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:24.674194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef836ab-c699-428f-8802-391dab283ddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:24.677598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aef836ab-c699-428f-8802-391dab283ddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:25.118194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1bc9a472-3201-4e73-9e11-0fbed6180c32 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:25.153714 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1bc9a472-3201-4e73-9e11-0fbed6180c32 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1364 microversion: 2.1 time: 0.796406 Aug 27 02:50:25.161005 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1875/3958] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:24 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1364 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:25.187237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7db0f87-2e55-41dd-ba82-1c03ad39ea9a tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Calling method '.version_select at 0x7f4d2969ba60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:25.361129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aef836ab-c699-428f-8802-391dab283ddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:25.376803 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aef836ab-c699-428f-8802-391dab283ddf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1510 microversion: 2.1 time: 0.787072 Aug 27 02:50:25.389704 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2084/3959] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:24 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1510 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:25.389704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6693c15f-7a5e-47f4-8017-613aa5c69e2e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:25.389704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6693c15f-7a5e-47f4-8017-613aa5c69e2e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:25.412630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6693c15f-7a5e-47f4-8017-613aa5c69e2e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:25.412630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6693c15f-7a5e-47f4-8017-613aa5c69e2e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:25.412630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6693c15f-7a5e-47f4-8017-613aa5c69e2e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:25.412630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6693c15f-7a5e-47f4-8017-613aa5c69e2e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:25.412630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6693c15f-7a5e-47f4-8017-613aa5c69e2e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:25.413259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6693c15f-7a5e-47f4-8017-613aa5c69e2e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:25.474766 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6693c15f-7a5e-47f4-8017-613aa5c69e2e tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9/ips" status: 200 len: 178 microversion: 2.1 time: 0.095675 Aug 27 02:50:25.489101 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2085/3960] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 02:50:25 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9/ips => generated 178 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:25.498477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7e31dbd3-1eac-4293-bc28-214b361223e8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:25.502894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7e31dbd3-1eac-4293-bc28-214b361223e8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:25.515620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e31dbd3-1eac-4293-bc28-214b361223e8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:25.516140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e31dbd3-1eac-4293-bc28-214b361223e8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:25.516594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e31dbd3-1eac-4293-bc28-214b361223e8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:25.521788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e31dbd3-1eac-4293-bc28-214b361223e8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:25.522416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e31dbd3-1eac-4293-bc28-214b361223e8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:25.522894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e31dbd3-1eac-4293-bc28-214b361223e8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:25.597987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7e31dbd3-1eac-4293-bc28-214b361223e8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:50:25.853165 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7e31dbd3-1eac-4293-bc28-214b361223e8 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "DELETE /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 204 len: 0 microversion: 2.1 time: 0.360291 Aug 27 02:50:25.856711 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2086/3961] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:50:25 2022] DELETE /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:50:25.872895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-47faf507-a32f-489a-950e-d8214a71eb96 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:25.874123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-47faf507-a32f-489a-950e-d8214a71eb96 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:25.889136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47faf507-a32f-489a-950e-d8214a71eb96 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:25.892162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47faf507-a32f-489a-950e-d8214a71eb96 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:25.892761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47faf507-a32f-489a-950e-d8214a71eb96 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:25.893784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47faf507-a32f-489a-950e-d8214a71eb96 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:25.896788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47faf507-a32f-489a-950e-d8214a71eb96 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:25.897496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47faf507-a32f-489a-950e-d8214a71eb96 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:26.148591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-f7db0f87-2e55-41dd-ba82-1c03ad39ea9a tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:50:26.149955 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-f7db0f87-2e55-41dd-ba82-1c03ad39ea9a tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 27 02:50:26.149955 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-ed66ba4c-703a-448e-a5bd-acdf805cc8e3'] Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7db0f87-2e55-41dd-ba82-1c03ad39ea9a tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Request method failure captured: Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-security-groups/c75d78d3-bacf-4713-8239-4a7a5e4a627e HTTP/1.1 Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYZra_hnP30RwYnK52HP25ebvboTq0cjCHG2Cx8O1-M6XRlG5l5b-_4-ANH6MF3sJT-vLtRnwf8CzuOv8z5yPB67aR24Cn44F3thxT-kZGhL6kLS5JCk8PHNLeFDB8xMK5mnUA7ISw3wfbtJDb22QUTk1YV7-d-XQK6PcfYP45jZ_XQ Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 003002acde1c4ce7bdf1318641517158 Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_003002acde1c4ce7bdf1318641517158"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/003002acde1c4ce7bdf1318641517158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/003002acde1c4ce7bdf1318641517158"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/003002acde1c4ce7bdf1318641517158"}]}] Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 003002acde1c4ce7bdf1318641517158 Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsNegativeTestJSON-359066220-project Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 19c8bb963f5c486088ae15313746a7cb Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-359066220-project Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: exception: Insufficient rights for removing default security group. Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-ed66ba4c-703a-448e-a5bd-acdf805cc8e3'] Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'c75d78d3-bacf-4713-8239-4a7a5e4a627e'} Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:50:26.165246 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed66ba4c-703a-448e-a5bd-acdf805cc8e3'] Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed66ba4c-703a-448e-a5bd-acdf805cc8e3'] Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed66ba4c-703a-448e-a5bd-acdf805cc8e3'] Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed66ba4c-703a-448e-a5bd-acdf805cc8e3'] Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7db0f87-2e55-41dd-ba82-1c03ad39ea9a tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 27 02:50:26.175467 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-ed66ba4c-703a-448e-a5bd-acdf805cc8e3'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:26.187524 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7db0f87-2e55-41dd-ba82-1c03ad39ea9a tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/c75d78d3-bacf-4713-8239-4a7a5e4a627e" status: 400 len: 182 microversion: 2.1 time: 1.008768 Aug 27 02:50:26.187524 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1876/3962] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:50:25 2022] DELETE /compute/v2.1/os-security-groups/c75d78d3-bacf-4713-8239-4a7a5e4a627e => generated 182 bytes in 1019 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:50:26.207914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-70d10ae0-eaac-476c-89e5-58c7e802737f tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Calling method '.version_select at 0x7f4d294a11f0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:26.355129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG neutronclient.v2_0.client [None req-70d10ae0-eaac-476c-89e5-58c7e802737f tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8 does not exist", "detail": ""}} {{(pid=122487) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:50:26.356045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.security_group_api [None req-70d10ae0-eaac-476c-89e5-58c7e802737f tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Neutron security group fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8 not found {{(pid=122487) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:50:26.356952 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-70d10ae0-eaac-476c-89e5-58c7e802737f tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] HTTP exception thrown: Security group fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8 does not exist Aug 27 02:50:26.356952 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-1c699964-6e23-4fda-acbb-bf9f36672a76'] Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-70d10ae0-eaac-476c-89e5-58c7e802737f tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Request method failure captured: Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-security-groups/fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8 HTTP/1.1 Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYZra_hnP30RwYnK52HP25ebvboTq0cjCHG2Cx8O1-M6XRlG5l5b-_4-ANH6MF3sJT-vLtRnwf8CzuOv8z5yPB67aR24Cn44F3thxT-kZGhL6kLS5JCk8PHNLeFDB8xMK5mnUA7ISw3wfbtJDb22QUTk1YV7-d-XQK6PcfYP45jZ_XQ Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 003002acde1c4ce7bdf1318641517158 Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_003002acde1c4ce7bdf1318641517158"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/003002acde1c4ce7bdf1318641517158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/003002acde1c4ce7bdf1318641517158"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/003002acde1c4ce7bdf1318641517158"}]}] Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 003002acde1c4ce7bdf1318641517158 Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-SecurityGroupsNegativeTestJSON-359066220-project Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 19c8bb963f5c486088ae15313746a7cb Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-359066220-project Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: exception: Security group fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8 does not exist Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-1c699964-6e23-4fda-acbb-bf9f36672a76'] Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8'} Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:50:26.360154 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8 does not exist Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c699964-6e23-4fda-acbb-bf9f36672a76'] Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8 does not exist Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c699964-6e23-4fda-acbb-bf9f36672a76'] Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8 does not exist Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c699964-6e23-4fda-acbb-bf9f36672a76'] Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8 does not exist Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c699964-6e23-4fda-acbb-bf9f36672a76'] Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-70d10ae0-eaac-476c-89e5-58c7e802737f tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Returning 404 to user: Security group fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8 does not exist Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: Neutron server returns request_ids: ['req-1c699964-6e23-4fda-acbb-bf9f36672a76'] {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:26.364106 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-70d10ae0-eaac-476c-89e5-58c7e802737f tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] 10.222.0.99 "GET /compute/v2.1/os-security-groups/fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8" status: 404 len: 194 microversion: 2.1 time: 0.170686 Aug 27 02:50:26.369553 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1877/3963] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:50:26 2022] GET /compute/v2.1/os-security-groups/fcb79a66-cd4d-4c65-9ba1-3d58455f7ff8 => generated 194 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:50:26.396105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f8d65618-4a5b-4f8e-86e3-6cf6df2c7d55 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:26.397439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f8d65618-4a5b-4f8e-86e3-6cf6df2c7d55 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:26.439803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8d65618-4a5b-4f8e-86e3-6cf6df2c7d55 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:26.442237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8d65618-4a5b-4f8e-86e3-6cf6df2c7d55 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:26.445089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8d65618-4a5b-4f8e-86e3-6cf6df2c7d55 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:26.447869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8d65618-4a5b-4f8e-86e3-6cf6df2c7d55 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:26.459282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8d65618-4a5b-4f8e-86e3-6cf6df2c7d55 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:26.460257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8d65618-4a5b-4f8e-86e3-6cf6df2c7d55 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:26.771385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-47faf507-a32f-489a-950e-d8214a71eb96 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:26.785535 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-47faf507-a32f-489a-950e-d8214a71eb96 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1673 microversion: 2.1 time: 0.923966 Aug 27 02:50:26.797914 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2087/3964] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:25 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1673 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:26.799669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b03e163a-b03b-4c4c-bd8b-1b967893d16d tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Action: 'update', calling method: .version_select at 0x7f4d2e8c0af0>, body: {"security_group": {"name": "tempest-sg-204710269", "description": "tempest-description-1612477134"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:26.879531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG neutronclient.v2_0.client [None req-b03e163a-b03b-4c4c-bd8b-1b967893d16d tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4c9c2cd9-bdba-4ac1-a77a-d490f44e441f does not exist", "detail": ""}} {{(pid=122488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:50:26.880156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.security_group_api [None req-b03e163a-b03b-4c4c-bd8b-1b967893d16d tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Neutron security group 4c9c2cd9-bdba-4ac1-a77a-d490f44e441f not found {{(pid=122488) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 27 02:50:26.881532 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-b03e163a-b03b-4c4c-bd8b-1b967893d16d tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] HTTP exception thrown: Security group 4c9c2cd9-bdba-4ac1-a77a-d490f44e441f does not exist Aug 27 02:50:26.881532 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-793a98de-e355-4f85-a70b-16d994b1e2ba'] Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b03e163a-b03b-4c4c-bd8b-1b967893d16d tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Request method failure captured: Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/os-security-groups/4c9c2cd9-bdba-4ac1-a77a-d490f44e441f HTTP/1.1 Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 101 Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYZra_hnP30RwYnK52HP25ebvboTq0cjCHG2Cx8O1-M6XRlG5l5b-_4-ANH6MF3sJT-vLtRnwf8CzuOv8z5yPB67aR24Cn44F3thxT-kZGhL6kLS5JCk8PHNLeFDB8xMK5mnUA7ISw3wfbtJDb22QUTk1YV7-d-XQK6PcfYP45jZ_XQ Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 003002acde1c4ce7bdf1318641517158 Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_003002acde1c4ce7bdf1318641517158"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/003002acde1c4ce7bdf1318641517158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/003002acde1c4ce7bdf1318641517158"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/003002acde1c4ce7bdf1318641517158"}]}] Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 003002acde1c4ce7bdf1318641517158 Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-359066220 Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-SecurityGroupsNegativeTestJSON-359066220-project Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 19c8bb963f5c486088ae15313746a7cb Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-359066220-project Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: {"security_group": {"name": "tempest-sg-204710269", "description": "tempest-description-1612477134"}} Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: exception: Security group 4c9c2cd9-bdba-4ac1-a77a-d490f44e441f does not exist Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-793a98de-e355-4f85-a70b-16d994b1e2ba'] Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4c9c2cd9-bdba-4ac1-a77a-d490f44e441f', 'body': {'security_group': {'name': 'tempest-sg-204710269', 'description': 'tempest-description-1612477134'}}} Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:50:26.883731 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4c9c2cd9-bdba-4ac1-a77a-d490f44e441f does not exist Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-793a98de-e355-4f85-a70b-16d994b1e2ba'] Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4c9c2cd9-bdba-4ac1-a77a-d490f44e441f does not exist Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-793a98de-e355-4f85-a70b-16d994b1e2ba'] Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4c9c2cd9-bdba-4ac1-a77a-d490f44e441f does not exist Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-793a98de-e355-4f85-a70b-16d994b1e2ba'] Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4c9c2cd9-bdba-4ac1-a77a-d490f44e441f does not exist Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-793a98de-e355-4f85-a70b-16d994b1e2ba'] Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b03e163a-b03b-4c4c-bd8b-1b967893d16d tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] Returning 404 to user: Security group 4c9c2cd9-bdba-4ac1-a77a-d490f44e441f does not exist Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: Neutron server returns request_ids: ['req-793a98de-e355-4f85-a70b-16d994b1e2ba'] {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b03e163a-b03b-4c4c-bd8b-1b967893d16d tempest-SecurityGroupsNegativeTestJSON-359066220 tempest-SecurityGroupsNegativeTestJSON-359066220-project] 10.222.0.99 "PUT /compute/v2.1/os-security-groups/4c9c2cd9-bdba-4ac1-a77a-d490f44e441f" status: 404 len: 194 microversion: 2.1 time: 0.095447 Aug 27 02:50:26.900336 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2088/3965] 10.222.0.99 () {60 vars in 1290 bytes} [Sat Aug 27 02:50:26 2022] PUT /compute/v2.1/os-security-groups/4c9c2cd9-bdba-4ac1-a77a-d490f44e441f => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:26.909272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13ea6ab8-cb4c-45f3-9c79-9c57334e6fc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:26.909272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13ea6ab8-cb4c-45f3-9c79-9c57334e6fc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:26.944038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ea6ab8-cb4c-45f3-9c79-9c57334e6fc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:26.944555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ea6ab8-cb4c-45f3-9c79-9c57334e6fc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:26.945002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ea6ab8-cb4c-45f3-9c79-9c57334e6fc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:26.947015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ea6ab8-cb4c-45f3-9c79-9c57334e6fc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:26.947611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ea6ab8-cb4c-45f3-9c79-9c57334e6fc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:26.992413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13ea6ab8-cb4c-45f3-9c79-9c57334e6fc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:27.046409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:27.395829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f8d65618-4a5b-4f8e-86e3-6cf6df2c7d55 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:27.410989 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f8d65618-4a5b-4f8e-86e3-6cf6df2c7d55 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1364 microversion: 2.1 time: 1.043717 Aug 27 02:50:27.415749 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1878/3966] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:26 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1364 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:27.628641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0549ecda-8c88-49aa-9b68-d9ae98b98f44 req-a250d39a-5b3d-4158-b83a-099de5c5fc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2", "name": "network-vif-plugged", "status": "completed", "tag": "cf665155-495a-4810-89f7-0f08309c79e8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:27.703258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=56 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:27.712121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0549ecda-8c88-49aa-9b68-d9ae98b98f44 req-a250d39a-5b3d-4158-b83a-099de5c5fc26 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:27.715682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0549ecda-8c88-49aa-9b68-d9ae98b98f44 req-a250d39a-5b3d-4158-b83a-099de5c5fc26 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:27.716611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0549ecda-8c88-49aa-9b68-d9ae98b98f44 req-a250d39a-5b3d-4158-b83a-099de5c5fc26 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:27.786228 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0549ecda-8c88-49aa-9b68-d9ae98b98f44 req-a250d39a-5b3d-4158-b83a-099de5c5fc26 service nova] Creating event network-vif-plugged:cf665155-495a-4810-89f7-0f08309c79e8 for instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 on n-h1-852084-5 Aug 27 02:50:27.812360 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0549ecda-8c88-49aa-9b68-d9ae98b98f44 req-a250d39a-5b3d-4158-b83a-099de5c5fc26 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192739 Aug 27 02:50:27.813855 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1879/3967] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:27.838313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fbf455e2-6605-4a5e-b624-264b76d84394 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:27.841203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fbf455e2-6605-4a5e-b624-264b76d84394 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:27.865277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbf455e2-6605-4a5e-b624-264b76d84394 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:27.866224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbf455e2-6605-4a5e-b624-264b76d84394 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:27.866973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbf455e2-6605-4a5e-b624-264b76d84394 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:27.868289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbf455e2-6605-4a5e-b624-264b76d84394 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:27.869084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbf455e2-6605-4a5e-b624-264b76d84394 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:27.869845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbf455e2-6605-4a5e-b624-264b76d84394 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:28.641592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fbf455e2-6605-4a5e-b624-264b76d84394 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:28.671185 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fbf455e2-6605-4a5e-b624-264b76d84394 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1673 microversion: 2.1 time: 0.855151 Aug 27 02:50:28.673899 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1880/3968] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:27 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1673 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:28.696396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3cf92c1e-c80e-4cb7-9f34-ec869ca77b39 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:28.699377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3cf92c1e-c80e-4cb7-9f34-ec869ca77b39 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:28.711893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf92c1e-c80e-4cb7-9f34-ec869ca77b39 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:28.713209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf92c1e-c80e-4cb7-9f34-ec869ca77b39 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:28.714612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf92c1e-c80e-4cb7-9f34-ec869ca77b39 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:28.718134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf92c1e-c80e-4cb7-9f34-ec869ca77b39 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:28.719687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf92c1e-c80e-4cb7-9f34-ec869ca77b39 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:28.720646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf92c1e-c80e-4cb7-9f34-ec869ca77b39 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:28.919452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-13ea6ab8-cb4c-45f3-9c79-9c57334e6fc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:28.957762 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13ea6ab8-cb4c-45f3-9c79-9c57334e6fc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1510 microversion: 2.1 time: 2.063876 Aug 27 02:50:28.959862 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2089/3969] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:26 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1510 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:29.203486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3cf92c1e-c80e-4cb7-9f34-ec869ca77b39 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:29.232662 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3cf92c1e-c80e-4cb7-9f34-ec869ca77b39 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1364 microversion: 2.1 time: 0.552825 Aug 27 02:50:29.242247 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1881/3970] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:28 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1364 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:29.712643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-058914d8-a72d-410e-bfe1-d816fcfbd530 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:29.723634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-058914d8-a72d-410e-bfe1-d816fcfbd530 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:29.776322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-058914d8-a72d-410e-bfe1-d816fcfbd530 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:29.777856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-058914d8-a72d-410e-bfe1-d816fcfbd530 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:29.780723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-058914d8-a72d-410e-bfe1-d816fcfbd530 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:29.784066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-058914d8-a72d-410e-bfe1-d816fcfbd530 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:29.788433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-058914d8-a72d-410e-bfe1-d816fcfbd530 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:29.791717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-058914d8-a72d-410e-bfe1-d816fcfbd530 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:30.001425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-feac2809-65ee-4f7d-9eac-45fcfd0b7970 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:30.003691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-feac2809-65ee-4f7d-9eac-45fcfd0b7970 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:30.016726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feac2809-65ee-4f7d-9eac-45fcfd0b7970 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:30.019035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feac2809-65ee-4f7d-9eac-45fcfd0b7970 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:30.020226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feac2809-65ee-4f7d-9eac-45fcfd0b7970 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:30.027544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feac2809-65ee-4f7d-9eac-45fcfd0b7970 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:30.031050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feac2809-65ee-4f7d-9eac-45fcfd0b7970 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:30.042579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-feac2809-65ee-4f7d-9eac-45fcfd0b7970 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:30.685829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-feac2809-65ee-4f7d-9eac-45fcfd0b7970 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:30.708252 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-feac2809-65ee-4f7d-9eac-45fcfd0b7970 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1510 microversion: 2.1 time: 0.714819 Aug 27 02:50:30.709661 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1882/3971] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:29 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1510 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:30.717604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-058914d8-a72d-410e-bfe1-d816fcfbd530 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:30.719415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a9218777-5155-4412-b19f-2f37934a24eb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:30.720775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a9218777-5155-4412-b19f-2f37934a24eb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:30.729656 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-058914d8-a72d-410e-bfe1-d816fcfbd530 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1673 microversion: 2.1 time: 1.035017 Aug 27 02:50:30.733412 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2090/3972] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:29 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1673 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:30.747157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9218777-5155-4412-b19f-2f37934a24eb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:30.747687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9218777-5155-4412-b19f-2f37934a24eb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:30.748148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9218777-5155-4412-b19f-2f37934a24eb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:30.750318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9218777-5155-4412-b19f-2f37934a24eb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:30.750856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9218777-5155-4412-b19f-2f37934a24eb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:30.752706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9218777-5155-4412-b19f-2f37934a24eb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:30.788965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:31.075393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ee55a6e7-0cf6-4442-95a0-7d2391abf714 req-1d5d015a-fa11-45ab-bb45-77f8dd6a1c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9432a1-b52c-407f-8ebc-4cc5703afaf9", "name": "network-vif-unplugged", "status": "completed", "tag": "ad8dcbca-1907-49e6-9c47-cae614bfe87e"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:31.104733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee55a6e7-0cf6-4442-95a0-7d2391abf714 req-1d5d015a-fa11-45ab-bb45-77f8dd6a1c67 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.107974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee55a6e7-0cf6-4442-95a0-7d2391abf714 req-1d5d015a-fa11-45ab-bb45-77f8dd6a1c67 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.108705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee55a6e7-0cf6-4442-95a0-7d2391abf714 req-1d5d015a-fa11-45ab-bb45-77f8dd6a1c67 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.146435 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ee55a6e7-0cf6-4442-95a0-7d2391abf714 req-1d5d015a-fa11-45ab-bb45-77f8dd6a1c67 service nova] Creating event network-vif-unplugged:ad8dcbca-1907-49e6-9c47-cae614bfe87e for instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 on n-h2-852084-5 Aug 27 02:50:31.160431 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ee55a6e7-0cf6-4442-95a0-7d2391abf714 req-1d5d015a-fa11-45ab-bb45-77f8dd6a1c67 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099101 Aug 27 02:50:31.161349 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2091/3973] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:50:31.202532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-26a2f722-8f3a-4abc-94f1-eb586c3f3242 req-b40914d4-7cbf-41c3-92db-c8e01c6e539a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9432a1-b52c-407f-8ebc-4cc5703afaf9", "name": "network-vif-deleted", "tag": "1ed634ab-6d46-4869-b113-ba7813bceff7"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:31.214364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-26a2f722-8f3a-4abc-94f1-eb586c3f3242 req-b40914d4-7cbf-41c3-92db-c8e01c6e539a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.217722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-26a2f722-8f3a-4abc-94f1-eb586c3f3242 req-b40914d4-7cbf-41c3-92db-c8e01c6e539a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.222094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-26a2f722-8f3a-4abc-94f1-eb586c3f3242 req-b40914d4-7cbf-41c3-92db-c8e01c6e539a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.245895 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-26a2f722-8f3a-4abc-94f1-eb586c3f3242 req-b40914d4-7cbf-41c3-92db-c8e01c6e539a service nova] Creating event network-vif-deleted:1ed634ab-6d46-4869-b113-ba7813bceff7 for instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 on n-h2-852084-5 Aug 27 02:50:31.259474 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-26a2f722-8f3a-4abc-94f1-eb586c3f3242 req-b40914d4-7cbf-41c3-92db-c8e01c6e539a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061172 Aug 27 02:50:31.261574 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2092/3974] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:50:31.346283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a9218777-5155-4412-b19f-2f37934a24eb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:31.359848 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a9218777-5155-4412-b19f-2f37934a24eb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1549 microversion: 2.1 time: 0.648026 Aug 27 02:50:31.360475 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1883/3975] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:30 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1549 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:31.395384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-80a7407d-c79c-4f25-9f3d-99dd7cb046bd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:31.395993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-80a7407d-c79c-4f25-9f3d-99dd7cb046bd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:31.404289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a7407d-c79c-4f25-9f3d-99dd7cb046bd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.404799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a7407d-c79c-4f25-9f3d-99dd7cb046bd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.405250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a7407d-c79c-4f25-9f3d-99dd7cb046bd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.406139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a7407d-c79c-4f25-9f3d-99dd7cb046bd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.406627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a7407d-c79c-4f25-9f3d-99dd7cb046bd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.407065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80a7407d-c79c-4f25-9f3d-99dd7cb046bd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.683190 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-80a7407d-c79c-4f25-9f3d-99dd7cb046bd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.297812 Aug 27 02:50:31.685714 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2093/3976] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:50:31 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/os-interface => generated 284 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:31.753368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9d4443ec-cd78-4a6d-a32e-27b9708349a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:31.754811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9d4443ec-cd78-4a6d-a32e-27b9708349a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:31.759739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0b147240-da04-4727-bb05-e45301fbd1f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:31.760913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0b147240-da04-4727-bb05-e45301fbd1f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:31.763533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d4443ec-cd78-4a6d-a32e-27b9708349a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.764287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d4443ec-cd78-4a6d-a32e-27b9708349a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.764908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d4443ec-cd78-4a6d-a32e-27b9708349a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.767004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d4443ec-cd78-4a6d-a32e-27b9708349a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.767667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d4443ec-cd78-4a6d-a32e-27b9708349a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.768280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d4443ec-cd78-4a6d-a32e-27b9708349a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.787944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b147240-da04-4727-bb05-e45301fbd1f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.788830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b147240-da04-4727-bb05-e45301fbd1f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.789621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b147240-da04-4727-bb05-e45301fbd1f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:31.790991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b147240-da04-4727-bb05-e45301fbd1f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:31.791800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b147240-da04-4727-bb05-e45301fbd1f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:31.792557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b147240-da04-4727-bb05-e45301fbd1f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:32.432492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9d4443ec-cd78-4a6d-a32e-27b9708349a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:32.457733 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9d4443ec-cd78-4a6d-a32e-27b9708349a7 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1494 microversion: 2.1 time: 0.707065 Aug 27 02:50:32.459253 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1884/3977] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:31 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1494 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:32.822542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a68b35d0-e5f2-4131-904e-2851259524b6 tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] Calling method '.version_select at 0x7f4d2b2cad30>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:32.926783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0b147240-da04-4727-bb05-e45301fbd1f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:32.946364 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0b147240-da04-4727-bb05-e45301fbd1f1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1510 microversion: 2.1 time: 1.191150 Aug 27 02:50:32.947402 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2094/3978] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:31 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1510 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:33.016781 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a68b35d0-e5f2-4131-904e-2851259524b6 tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] 10.222.0.99 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.555051 Aug 27 02:50:33.019903 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1885/3979] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:50:32 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:50:33.051533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5008ffbd-2121-404e-982a-bbea4567c5ce tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] Action: 'create', calling method: .version_select at 0x7f4d2a0fb4c0>, body: {"pool": "non_exist_pool"} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:33.254379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-428268208", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:33.381199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] validate_networks() for [('e4567784-1c27-40c2-98e5-c16d6d5124d4', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:50:33.483039 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-5008ffbd-2121-404e-982a-bbea4567c5ce tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] HTTP exception thrown: Floating IP pool not found. Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5008ffbd-2121-404e-982a-bbea4567c5ce tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] Request method failure captured: Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 26 Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYZ4ieBM0Yv3V-bS8FAAikOw8xPyKYXGkyH4ZMZpq2l6d4d3-wsoCINnMWdCuBXehPe3DdDfBI_CVmYqc_HxfQBqF6_gyf9BAviqq-eB-IlHFV0uEJTQtjgdX5gRfTJv0xwgbJUY8paeUjkEMW1KF3XCZV7w5RxdHOsped_l6n14AM4 Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 44e1c945395f490087a345700b83184e Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-127615791 Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_44e1c945395f490087a345700b83184e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/44e1c945395f490087a345700b83184e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/44e1c945395f490087a345700b83184e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/44e1c945395f490087a345700b83184e"}]}] Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-127615791 Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 44e1c945395f490087a345700b83184e Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-127615791 Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FloatingIPsNegativeTestJSON-127615791-project Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 89e29399b43c40a988db9dae8518d24b Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-127615791-project Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: {"pool": "non_exist_pool"} Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: exception: Floating IP pool not found. Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:33.485393 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:33.489761 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 27 02:50:33.489761 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:33.492872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5008ffbd-2121-404e-982a-bbea4567c5ce tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] Returning 404 to user: Floating IP pool not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:33.494076 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5008ffbd-2121-404e-982a-bbea4567c5ce tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] 10.222.0.99 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.465419 Aug 27 02:50:33.495193 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2095/3980] 10.222.0.99 () {60 vars in 1170 bytes} [Sat Aug 27 02:50:33 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 467 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:50:33.503154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b9a39b9e-d7b6-48c2-94e3-bbef2196efb5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:33.506697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b9a39b9e-d7b6-48c2-94e3-bbef2196efb5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:33.510221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:33.526668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9a39b9e-d7b6-48c2-94e3-bbef2196efb5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:33.530762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9a39b9e-d7b6-48c2-94e3-bbef2196efb5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:33.533089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9a39b9e-d7b6-48c2-94e3-bbef2196efb5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:33.535635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9a39b9e-d7b6-48c2-94e3-bbef2196efb5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:33.539849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9a39b9e-d7b6-48c2-94e3-bbef2196efb5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:33.541766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9a39b9e-d7b6-48c2-94e3-bbef2196efb5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:34.196796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b9a39b9e-d7b6-48c2-94e3-bbef2196efb5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e9ba043fc844b0eaca32db087924226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed47bfc9a7cc46c0a789d7ebd0a14bb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:34.252413 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b9a39b9e-d7b6-48c2-94e3-bbef2196efb5 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 200 len: 1452 microversion: 2.1 time: 0.752432 Aug 27 02:50:34.253683 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2096/3981] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:33 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 1452 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:34.271130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f880307-5743-449d-92ee-45318c3981fa tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] Calling method '.version_select at 0x7f4d29af30d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:34.623622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG neutronclient.v2_0.client [None req-6f880307-5743-449d-92ee-45318c3981fa tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 250bbca6-1dae-47f4-8352-2942812e3ec5 could not be found", "detail": ""}} {{(pid=122488) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 27 02:50:34.624613 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-6f880307-5743-449d-92ee-45318c3981fa tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] HTTP exception thrown: Floating IP not found for ID 250bbca6-1dae-47f4-8352-2942812e3ec5 Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f880307-5743-449d-92ee-45318c3981fa tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] Request method failure captured: Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/os-floating-ips/250bbca6-1dae-47f4-8352-2942812e3ec5 HTTP/1.1 Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYZ4ieBM0Yv3V-bS8FAAikOw8xPyKYXGkyH4ZMZpq2l6d4d3-wsoCINnMWdCuBXehPe3DdDfBI_CVmYqc_HxfQBqF6_gyf9BAviqq-eB-IlHFV0uEJTQtjgdX5gRfTJv0xwgbJUY8paeUjkEMW1KF3XCZV7w5RxdHOsped_l6n14AM4 Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 44e1c945395f490087a345700b83184e Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-127615791 Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_44e1c945395f490087a345700b83184e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/44e1c945395f490087a345700b83184e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/44e1c945395f490087a345700b83184e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/44e1c945395f490087a345700b83184e"}]}] Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-127615791 Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 44e1c945395f490087a345700b83184e Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-127615791 Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-FloatingIPsNegativeTestJSON-127615791-project Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 89e29399b43c40a988db9dae8518d24b Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-127615791-project Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: exception: Floating IP not found for ID 250bbca6-1dae-47f4-8352-2942812e3ec5 Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '250bbca6-1dae-47f4-8352-2942812e3ec5'} Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 250bbca6-1dae-47f4-8352-2942812e3ec5 could not be found Aug 27 02:50:34.627029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d970a532-c167-4c49-be0d-a951941be798'] Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 250bbca6-1dae-47f4-8352-2942812e3ec5. Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 250bbca6-1dae-47f4-8352-2942812e3ec5 Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 250bbca6-1dae-47f4-8352-2942812e3ec5 Aug 27 02:50:34.630978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:34.637356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f880307-5743-449d-92ee-45318c3981fa tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] Returning 404 to user: Floating IP not found for ID 250bbca6-1dae-47f4-8352-2942812e3ec5 {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:34.638672 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6f880307-5743-449d-92ee-45318c3981fa tempest-FloatingIPsNegativeTestJSON-127615791 tempest-FloatingIPsNegativeTestJSON-127615791-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/250bbca6-1dae-47f4-8352-2942812e3ec5" status: 404 len: 111 microversion: 2.1 time: 0.383908 Aug 27 02:50:34.639381 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2097/3982] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:50:34 2022] DELETE /compute/v2.1/os-floating-ips/250bbca6-1dae-47f4-8352-2942812e3ec5 => generated 111 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:34.645166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4f8865d0-f025-4f50-9e61-587b77f62128 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:34.657565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4f8865d0-f025-4f50-9e61-587b77f62128 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:34.688836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8865d0-f025-4f50-9e61-587b77f62128 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:34.712907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8865d0-f025-4f50-9e61-587b77f62128 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:34.712907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8865d0-f025-4f50-9e61-587b77f62128 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:34.714329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8865d0-f025-4f50-9e61-587b77f62128 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:34.718637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8865d0-f025-4f50-9e61-587b77f62128 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:34.719610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f8865d0-f025-4f50-9e61-587b77f62128 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:36.071970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:50:36.073859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:50:36.075247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:50:36.076490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:50:36.077523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:50:36.107955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:36.109416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:36.110504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:36.112384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:36.114148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:36.115073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:36.171402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Getting quotas for project 0c35f17cbc704427aeaf13084be9b078. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:50:36.185466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Getting quotas for user f820d9c6655443c79c8046b396cafbba and project 0c35f17cbc704427aeaf13084be9b078. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:50:36.216538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:50:36.221846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:50:36.432057 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-23c89125-33d5-4e74-af7c-683aabb93767 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.310253 Aug 27 02:50:36.438678 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1886/3983] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:50:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 3318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:50:36.466859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-59dd4786-77a2-41f9-9e0c-ab83c746e0c1 req-0bc7fdea-6e93-4dec-a08f-17cab5a82cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2", "tag": "cf665155-495a-4810-89f7-0f08309c79e8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:36.552310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-59dd4786-77a2-41f9-9e0c-ab83c746e0c1 req-0bc7fdea-6e93-4dec-a08f-17cab5a82cf9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:36.553198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-59dd4786-77a2-41f9-9e0c-ab83c746e0c1 req-0bc7fdea-6e93-4dec-a08f-17cab5a82cf9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:36.562637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-59dd4786-77a2-41f9-9e0c-ab83c746e0c1 req-0bc7fdea-6e93-4dec-a08f-17cab5a82cf9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:36.655676 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-59dd4786-77a2-41f9-9e0c-ab83c746e0c1 req-0bc7fdea-6e93-4dec-a08f-17cab5a82cf9 service nova] Creating event network-changed:cf665155-495a-4810-89f7-0f08309c79e8 for instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 on n-h1-852084-5 Aug 27 02:50:36.675688 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-59dd4786-77a2-41f9-9e0c-ab83c746e0c1 req-0bc7fdea-6e93-4dec-a08f-17cab5a82cf9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233897 Aug 27 02:50:36.686138 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1887/3984] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:36.706959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-fa7b26d6-de8a-434c-bbac-200bb8795408 req-7d50cdf2-4030-4882-b17b-5815a74616a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9432a1-b52c-407f-8ebc-4cc5703afaf9", "name": "network-vif-deleted", "tag": "ad8dcbca-1907-49e6-9c47-cae614bfe87e"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:36.773222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fa7b26d6-de8a-434c-bbac-200bb8795408 req-7d50cdf2-4030-4882-b17b-5815a74616a4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:36.774087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fa7b26d6-de8a-434c-bbac-200bb8795408 req-7d50cdf2-4030-4882-b17b-5815a74616a4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:36.780105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fa7b26d6-de8a-434c-bbac-200bb8795408 req-7d50cdf2-4030-4882-b17b-5815a74616a4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:36.841212 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-fa7b26d6-de8a-434c-bbac-200bb8795408 req-7d50cdf2-4030-4882-b17b-5815a74616a4 service nova] Creating event network-vif-deleted:ad8dcbca-1907-49e6-9c47-cae614bfe87e for instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 on n-h2-852084-5 Aug 27 02:50:36.860734 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-fa7b26d6-de8a-434c-bbac-200bb8795408 req-7d50cdf2-4030-4882-b17b-5815a74616a4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171624 Aug 27 02:50:36.868721 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1888/3985] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:36.892638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:36.899913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:36.920482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:36.924434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:36.926695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:36.930353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:36.934895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:36.936854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:37.057108 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] HTTP exception thrown: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Request method failure captured: Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 HTTP/1.1 Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYXTyUPuu59_IH7ZRwoILwF3g4gu-2X5V8yvxv5pODCY-JsCu_C3S7m7RczuK3F0CGlyEQ_uW21JQvpyI847AcCBj6yq1cOnxBmtTC1UNfaFBOcll7SGUf3Y7jlp7yus0Xu4e1W5caDs-0yz1a4JxK2xlumJYqIQNtUfwgOqMgaobaw Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}] Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0e9ba043fc844b0eaca32db087924226 Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '8d9432a1-b52c-407f-8ebc-4cc5703afaf9'} Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:37.073862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:37.081928 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:37.081928 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:37.081928 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:37.081928 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:37.081928 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:37.081928 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:37.081928 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:37.085073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Returning 404 to user: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:37.097081 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c7b98496-e16d-4a01-a740-ccb40cd0c403 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 404 len: 111 microversion: 2.1 time: 0.222190 Aug 27 02:50:37.104546 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1889/3986] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:36 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:37.144749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ded56dd0-88c8-42cb-9fc9-ae28c5b48441 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:37.156050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ded56dd0-88c8-42cb-9fc9-ae28c5b48441 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:39.086397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f8865d0-f025-4f50-9e61-587b77f62128 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:39.162186 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4f8865d0-f025-4f50-9e61-587b77f62128 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 4.521395 Aug 27 02:50:39.178614 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2098/3987] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:34 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 4536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:39.256493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ded56dd0-88c8-42cb-9fc9-ae28c5b48441 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:39.271099 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ded56dd0-88c8-42cb-9fc9-ae28c5b48441 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1213 microversion: 2.1 time: 2.164552 Aug 27 02:50:39.276567 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1890/3988] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:37 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1213 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:40.202660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-931da548-db8d-4630-9489-2d3cb2905e2b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:40.204667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-931da548-db8d-4630-9489-2d3cb2905e2b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:40.235552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-931da548-db8d-4630-9489-2d3cb2905e2b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.240596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-931da548-db8d-4630-9489-2d3cb2905e2b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.242968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-931da548-db8d-4630-9489-2d3cb2905e2b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.245582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-931da548-db8d-4630-9489-2d3cb2905e2b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.248197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-931da548-db8d-4630-9489-2d3cb2905e2b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.248730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-931da548-db8d-4630-9489-2d3cb2905e2b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.299282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-09959b5e-7c9d-4f1d-add4-427fceadf029 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:40.301713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-09959b5e-7c9d-4f1d-add4-427fceadf029 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:40.345773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09959b5e-7c9d-4f1d-add4-427fceadf029 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.355088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09959b5e-7c9d-4f1d-add4-427fceadf029 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.366512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09959b5e-7c9d-4f1d-add4-427fceadf029 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.369037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09959b5e-7c9d-4f1d-add4-427fceadf029 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.370283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09959b5e-7c9d-4f1d-add4-427fceadf029 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.378654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09959b5e-7c9d-4f1d-add4-427fceadf029 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.666536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-09959b5e-7c9d-4f1d-add4-427fceadf029 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:40.698919 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-09959b5e-7c9d-4f1d-add4-427fceadf029 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1271 microversion: 2.1 time: 0.408272 Aug 27 02:50:40.702646 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1891/3989] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:40 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1271 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:40.715938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-90b2320d-dc34-4589-8a32-928a3070fee4 req-b0b98b10-928f-42d2-9b4e-6d912cddf4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f7ed66-f5a7-42ec-be91-bd5a08981d8f", "name": "network-vif-plugged", "status": "completed", "tag": "6c86ab3b-0086-4926-853f-bbbc6acba033"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:40.739737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-90b2320d-dc34-4589-8a32-928a3070fee4 req-b0b98b10-928f-42d2-9b4e-6d912cddf4ea service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:40.741164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-90b2320d-dc34-4589-8a32-928a3070fee4 req-b0b98b10-928f-42d2-9b4e-6d912cddf4ea service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:40.742828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-90b2320d-dc34-4589-8a32-928a3070fee4 req-b0b98b10-928f-42d2-9b4e-6d912cddf4ea service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:40.804812 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-90b2320d-dc34-4589-8a32-928a3070fee4 req-b0b98b10-928f-42d2-9b4e-6d912cddf4ea service nova] Creating event network-vif-plugged:6c86ab3b-0086-4926-853f-bbbc6acba033 for instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f on n-h1-852084-5 Aug 27 02:50:40.831814 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-90b2320d-dc34-4589-8a32-928a3070fee4 req-b0b98b10-928f-42d2-9b4e-6d912cddf4ea service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125680 Aug 27 02:50:40.834443 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1892/3990] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:41.744248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b748e13-f1b5-4ca7-ac42-7afa2270b255 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:41.745885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b748e13-f1b5-4ca7-ac42-7afa2270b255 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:41.776045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b748e13-f1b5-4ca7-ac42-7afa2270b255 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:41.783325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b748e13-f1b5-4ca7-ac42-7afa2270b255 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:41.783955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b748e13-f1b5-4ca7-ac42-7afa2270b255 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:41.785034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b748e13-f1b5-4ca7-ac42-7afa2270b255 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:41.785696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b748e13-f1b5-4ca7-ac42-7afa2270b255 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:41.786294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b748e13-f1b5-4ca7-ac42-7afa2270b255 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:42.022719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b748e13-f1b5-4ca7-ac42-7afa2270b255 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:42.031762 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b748e13-f1b5-4ca7-ac42-7afa2270b255 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1271 microversion: 2.1 time: 0.293424 Aug 27 02:50:42.040537 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1893/3991] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:41 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1271 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:42.938410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-931da548-db8d-4630-9489-2d3cb2905e2b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:42.951671 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-931da548-db8d-4630-9489-2d3cb2905e2b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 2.755274 Aug 27 02:50:42.956740 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2099/3992] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:40 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 2761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:43.082693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0bf15ec2-e04b-43a5-a572-411429dd961e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:43.084074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0bf15ec2-e04b-43a5-a572-411429dd961e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:43.102989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf15ec2-e04b-43a5-a572-411429dd961e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:43.103418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf15ec2-e04b-43a5-a572-411429dd961e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:43.103877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf15ec2-e04b-43a5-a572-411429dd961e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:43.104686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf15ec2-e04b-43a5-a572-411429dd961e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:43.105178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf15ec2-e04b-43a5-a572-411429dd961e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:43.105729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bf15ec2-e04b-43a5-a572-411429dd961e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:43.366914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0bf15ec2-e04b-43a5-a572-411429dd961e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:43.396085 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0bf15ec2-e04b-43a5-a572-411429dd961e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1271 microversion: 2.1 time: 0.322107 Aug 27 02:50:43.413893 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1894/3993] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:43 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1271 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:44.003337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb739f6e-13b8-4203-8718-af9612141a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:44.004473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb739f6e-13b8-4203-8718-af9612141a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:44.054798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb739f6e-13b8-4203-8718-af9612141a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:44.055719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb739f6e-13b8-4203-8718-af9612141a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:44.057333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb739f6e-13b8-4203-8718-af9612141a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:44.058776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb739f6e-13b8-4203-8718-af9612141a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:44.060688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb739f6e-13b8-4203-8718-af9612141a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:44.061611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb739f6e-13b8-4203-8718-af9612141a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:44.422245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f4db39cd-c465-4ba1-9f19-df0781cf452e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:44.423050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f4db39cd-c465-4ba1-9f19-df0781cf452e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:44.452599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4db39cd-c465-4ba1-9f19-df0781cf452e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:44.453279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4db39cd-c465-4ba1-9f19-df0781cf452e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:44.453897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4db39cd-c465-4ba1-9f19-df0781cf452e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:44.454797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4db39cd-c465-4ba1-9f19-df0781cf452e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:44.455400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4db39cd-c465-4ba1-9f19-df0781cf452e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:44.458980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4db39cd-c465-4ba1-9f19-df0781cf452e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:44.675775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f4db39cd-c465-4ba1-9f19-df0781cf452e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:44.688911 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f4db39cd-c465-4ba1-9f19-df0781cf452e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1271 microversion: 2.1 time: 0.271089 Aug 27 02:50:44.703478 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1895/3994] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:44 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1271 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:45.237959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cb739f6e-13b8-4203-8718-af9612141a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:45.259909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb739f6e-13b8-4203-8718-af9612141a27 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 1.259959 Aug 27 02:50:45.261427 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2100/3995] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:43 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:45.716709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-186e9910-0ad9-4369-9d8f-63a205288610 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:45.717614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-186e9910-0ad9-4369-9d8f-63a205288610 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:45.743182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-186e9910-0ad9-4369-9d8f-63a205288610 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:45.748565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-186e9910-0ad9-4369-9d8f-63a205288610 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:45.751884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-186e9910-0ad9-4369-9d8f-63a205288610 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:45.752675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-186e9910-0ad9-4369-9d8f-63a205288610 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:45.757323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-186e9910-0ad9-4369-9d8f-63a205288610 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:45.757832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-186e9910-0ad9-4369-9d8f-63a205288610 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:46.142869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:46.161520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-186e9910-0ad9-4369-9d8f-63a205288610 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:46.187613 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-186e9910-0ad9-4369-9d8f-63a205288610 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1271 microversion: 2.1 time: 0.477551 Aug 27 02:50:46.216195 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1896/3996] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:45 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1271 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:46.308096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f94cb552-d7f5-423b-9863-f591c6c195d3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:46.308848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f94cb552-d7f5-423b-9863-f591c6c195d3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:46.326277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f94cb552-d7f5-423b-9863-f591c6c195d3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:46.327611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f94cb552-d7f5-423b-9863-f591c6c195d3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:46.328081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f94cb552-d7f5-423b-9863-f591c6c195d3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:46.328953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f94cb552-d7f5-423b-9863-f591c6c195d3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:46.330189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f94cb552-d7f5-423b-9863-f591c6c195d3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:46.330641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f94cb552-d7f5-423b-9863-f591c6c195d3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:47.199559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f94cb552-d7f5-423b-9863-f591c6c195d3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:47.225997 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f94cb552-d7f5-423b-9863-f591c6c195d3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 0.919635 Aug 27 02:50:47.232863 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2101/3997] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:46 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:47.239322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c6309f20-7185-423b-bea5-25fabd294383 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:47.239946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c6309f20-7185-423b-bea5-25fabd294383 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:47.257779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6309f20-7185-423b-bea5-25fabd294383 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:47.259908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6309f20-7185-423b-bea5-25fabd294383 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:47.261177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6309f20-7185-423b-bea5-25fabd294383 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:47.290645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6309f20-7185-423b-bea5-25fabd294383 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:47.296138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6309f20-7185-423b-bea5-25fabd294383 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:47.298806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6309f20-7185-423b-bea5-25fabd294383 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:47.530345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c6309f20-7185-423b-bea5-25fabd294383 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:47.545337 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c6309f20-7185-423b-bea5-25fabd294383 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1271 microversion: 2.1 time: 0.312851 Aug 27 02:50:47.567834 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1897/3998] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:47 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1271 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:48.256230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c2b17a0a-2cf2-4c66-9989-15e903557d6c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:48.257157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c2b17a0a-2cf2-4c66-9989-15e903557d6c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:48.293927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2b17a0a-2cf2-4c66-9989-15e903557d6c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:48.294904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2b17a0a-2cf2-4c66-9989-15e903557d6c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:48.306780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2b17a0a-2cf2-4c66-9989-15e903557d6c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:48.311682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2b17a0a-2cf2-4c66-9989-15e903557d6c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:48.312988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2b17a0a-2cf2-4c66-9989-15e903557d6c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:48.314228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c2b17a0a-2cf2-4c66-9989-15e903557d6c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:48.572977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-688c1b94-538b-4ce8-b7f2-4a396b9f265f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:48.573746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-688c1b94-538b-4ce8-b7f2-4a396b9f265f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:48.617050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688c1b94-538b-4ce8-b7f2-4a396b9f265f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:48.623665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688c1b94-538b-4ce8-b7f2-4a396b9f265f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:48.627292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688c1b94-538b-4ce8-b7f2-4a396b9f265f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:48.631105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688c1b94-538b-4ce8-b7f2-4a396b9f265f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:48.635585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688c1b94-538b-4ce8-b7f2-4a396b9f265f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:48.638652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688c1b94-538b-4ce8-b7f2-4a396b9f265f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:49.271447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:49.291624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c2b17a0a-2cf2-4c66-9989-15e903557d6c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:49.316439 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c2b17a0a-2cf2-4c66-9989-15e903557d6c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 1.065812 Aug 27 02:50:49.317725 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2102/3999] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:48 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:49.899717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-688c1b94-538b-4ce8-b7f2-4a396b9f265f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:49.911853 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-688c1b94-538b-4ce8-b7f2-4a396b9f265f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1313 microversion: 2.1 time: 1.343663 Aug 27 02:50:49.920700 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1898/4000] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:48 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1313 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:50.339768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61944042-dfbf-4623-942f-9599acb30a69 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:50.340576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-61944042-dfbf-4623-942f-9599acb30a69 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:50.364051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61944042-dfbf-4623-942f-9599acb30a69 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:50.364927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61944042-dfbf-4623-942f-9599acb30a69 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:50.366399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61944042-dfbf-4623-942f-9599acb30a69 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:50.367862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61944042-dfbf-4623-942f-9599acb30a69 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:50.368362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61944042-dfbf-4623-942f-9599acb30a69 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:50.368805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61944042-dfbf-4623-942f-9599acb30a69 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:50.921764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-61944042-dfbf-4623-942f-9599acb30a69 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:50.942283 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61944042-dfbf-4623-942f-9599acb30a69 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 0.601427 Aug 27 02:50:50.947052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c47546c6-fb7a-4795-87d4-61142322098b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:50.948217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c47546c6-fb7a-4795-87d4-61142322098b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:50.966206 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2103/4001] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:50 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:50.973418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c47546c6-fb7a-4795-87d4-61142322098b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:50.978678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c47546c6-fb7a-4795-87d4-61142322098b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:50.979509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c47546c6-fb7a-4795-87d4-61142322098b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:50.986795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c47546c6-fb7a-4795-87d4-61142322098b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:50.988219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c47546c6-fb7a-4795-87d4-61142322098b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:50.989023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c47546c6-fb7a-4795-87d4-61142322098b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.111627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b581e8b1-af0d-4a30-8cf2-108d5467faf1 req-6cf2c59d-c431-45db-9323-3295c6d7d80c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed264ed-31ac-462f-864a-1479bf5fc3ef", "tag": "fe21cb15-31a5-40b7-87ce-17062fb73885"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:51.183801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b581e8b1-af0d-4a30-8cf2-108d5467faf1 req-6cf2c59d-c431-45db-9323-3295c6d7d80c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.187731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b581e8b1-af0d-4a30-8cf2-108d5467faf1 req-6cf2c59d-c431-45db-9323-3295c6d7d80c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.197785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b581e8b1-af0d-4a30-8cf2-108d5467faf1 req-6cf2c59d-c431-45db-9323-3295c6d7d80c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:51.260733 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b581e8b1-af0d-4a30-8cf2-108d5467faf1 req-6cf2c59d-c431-45db-9323-3295c6d7d80c service nova] Creating event network-changed:fe21cb15-31a5-40b7-87ce-17062fb73885 for instance 3ed264ed-31ac-462f-864a-1479bf5fc3ef on n-h2-852084-5 Aug 27 02:50:51.277929 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b581e8b1-af0d-4a30-8cf2-108d5467faf1 req-6cf2c59d-c431-45db-9323-3295c6d7d80c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171991 Aug 27 02:50:51.279218 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2104/4002] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:50:51.668102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c47546c6-fb7a-4795-87d4-61142322098b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:51.680877 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c47546c6-fb7a-4795-87d4-61142322098b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1313 microversion: 2.1 time: 0.740829 Aug 27 02:50:51.681709 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1899/4003] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:50 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1313 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:51.972796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec83c6dc-41ef-4628-a9b7-03740e4d576c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:51.974256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ec83c6dc-41ef-4628-a9b7-03740e4d576c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:51.998523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec83c6dc-41ef-4628-a9b7-03740e4d576c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:51.999202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec83c6dc-41ef-4628-a9b7-03740e4d576c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:51.999899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec83c6dc-41ef-4628-a9b7-03740e4d576c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:52.000784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec83c6dc-41ef-4628-a9b7-03740e4d576c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:52.001333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec83c6dc-41ef-4628-a9b7-03740e4d576c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:52.001870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec83c6dc-41ef-4628-a9b7-03740e4d576c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:52.724736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2ace0b1d-7326-4493-9baf-f85f876ffbf8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:52.725549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2ace0b1d-7326-4493-9baf-f85f876ffbf8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:52.741128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ace0b1d-7326-4493-9baf-f85f876ffbf8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:52.741635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ace0b1d-7326-4493-9baf-f85f876ffbf8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:52.742112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ace0b1d-7326-4493-9baf-f85f876ffbf8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:52.742850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ace0b1d-7326-4493-9baf-f85f876ffbf8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:52.745755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ace0b1d-7326-4493-9baf-f85f876ffbf8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:52.746710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ace0b1d-7326-4493-9baf-f85f876ffbf8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.180281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ec83c6dc-41ef-4628-a9b7-03740e4d576c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:53.189535 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec83c6dc-41ef-4628-a9b7-03740e4d576c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 1.223875 Aug 27 02:50:53.203380 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2105/4004] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:51 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:53.211929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:53.213106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:53.235070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.235956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.236728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.238618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.239346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.240270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.258983 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] HTTP exception thrown: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Request method failure captured: Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 HTTP/1.1 Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYXTyUPuu59_IH7ZRwoILwF3g4gu-2X5V8yvxv5pODCY-JsCu_C3S7m7RczuK3F0CGlyEQ_uW21JQvpyI847AcCBj6yq1cOnxBmtTC1UNfaFBOcll7SGUf3Y7jlp7yus0Xu4e1W5caDs-0yz1a4JxK2xlumJYqIQNtUfwgOqMgaobaw Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}] Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0e9ba043fc844b0eaca32db087924226 Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '8d9432a1-b52c-407f-8ebc-4cc5703afaf9'} Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:53.261107 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:53.264479 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:53.264479 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.264479 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:53.264479 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.264479 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.264479 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:53.264479 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:53.264479 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:53.264479 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:53.264479 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:53.264479 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.266580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Returning 404 to user: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:53.267725 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dd903576-5c4d-4836-b0c5-a828253f94e4 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "DELETE /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 404 len: 111 microversion: 2.1 time: 0.062748 Aug 27 02:50:53.269421 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2106/4005] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:50:53 2022] DELETE /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:53.280562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:53.282593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 8d9432a1-b52c-407f-8ebc-4cc5703afaf9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:53.302877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.303896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.304806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.305906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.307123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.310152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.328293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2ace0b1d-7326-4493-9baf-f85f876ffbf8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:53.342297 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2ace0b1d-7326-4493-9baf-f85f876ffbf8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1313 microversion: 2.1 time: 0.621851 Aug 27 02:50:53.343776 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1900/4006] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:52 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:53.373807 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] HTTP exception thrown: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Request method failure captured: Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 HTTP/1.1 Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYXTyUPuu59_IH7ZRwoILwF3g4gu-2X5V8yvxv5pODCY-JsCu_C3S7m7RczuK3F0CGlyEQ_uW21JQvpyI847AcCBj6yq1cOnxBmtTC1UNfaFBOcll7SGUf3Y7jlp7yus0Xu4e1W5caDs-0yz1a4JxK2xlumJYqIQNtUfwgOqMgaobaw Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}] Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0e9ba043fc844b0eaca32db087924226 Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '8d9432a1-b52c-407f-8ebc-4cc5703afaf9'} Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:53.381640 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.385036 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.385036 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:53.385036 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:53.385036 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:53.385036 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:53.385036 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. Aug 27 02:50:53.385036 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.392641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Returning 404 to user: Instance 8d9432a1-b52c-407f-8ebc-4cc5703afaf9 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:53.394691 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61bbc0fd-55de-4b71-8c91-9b619469d755 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9" status: 404 len: 111 microversion: 2.1 time: 0.119126 Aug 27 02:50:53.406487 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2107/4007] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:53 2022] GET /compute/v2.1/servers/8d9432a1-b52c-407f-8ebc-4cc5703afaf9 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:53.413133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:53.414160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:53.428149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.432557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.433407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.436977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.437867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.438596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.473212 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] HTTP exception thrown: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Request method failure captured: Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 HTTP/1.1 Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYXTyUPuu59_IH7ZRwoILwF3g4gu-2X5V8yvxv5pODCY-JsCu_C3S7m7RczuK3F0CGlyEQ_uW21JQvpyI847AcCBj6yq1cOnxBmtTC1UNfaFBOcll7SGUf3Y7jlp7yus0Xu4e1W5caDs-0yz1a4JxK2xlumJYqIQNtUfwgOqMgaobaw Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}] Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0e9ba043fc844b0eaca32db087924226 Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6'} Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:53.480750 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:53.484299 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:50:53.484299 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.484299 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:53.484299 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.484299 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.484299 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:53.484299 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:53.484299 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:53.484299 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:53.484299 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:50:53.484299 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.486407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Returning 404 to user: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:53.488235 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c3275dbd-791f-46bf-9d6b-475309e3e628 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 404 len: 111 microversion: 2.1 time: 0.080280 Aug 27 02:50:53.494808 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1901/4008] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:50:53 2022] DELETE /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:53.512857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:53.514082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] [instance: 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:53.570589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.573942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.575949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.580400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:53.582890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:53.586670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:53.655270 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] HTTP exception thrown: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Request method failure captured: Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 HTTP/1.1 Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYXTyUPuu59_IH7ZRwoILwF3g4gu-2X5V8yvxv5pODCY-JsCu_C3S7m7RczuK3F0CGlyEQ_uW21JQvpyI847AcCBj6yq1cOnxBmtTC1UNfaFBOcll7SGUf3Y7jlp7yus0Xu4e1W5caDs-0yz1a4JxK2xlumJYqIQNtUfwgOqMgaobaw Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ed47bfc9a7cc46c0a789d7ebd0a14bb1"}]}] Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: ed47bfc9a7cc46c0a789d7ebd0a14bb1 Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestMultiNic-1171342847 Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0e9ba043fc844b0eaca32db087924226 Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestMultiNic-1171342847-project Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6'} Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:53.664616 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.668085 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:53.668085 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:53.668085 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:53.668085 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:53.668085 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:53.668085 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. Aug 27 02:50:53.668085 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:53.668085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] Returning 404 to user: Instance 4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:53.668085 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c5db6450-d28b-4eed-a1db-6a8bd307dc24 tempest-ServersTestMultiNic-1171342847 tempest-ServersTestMultiNic-1171342847-project] 10.222.0.99 "GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6" status: 404 len: 111 microversion: 2.1 time: 0.165095 Aug 27 02:50:53.672659 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2108/4009] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:53 2022] GET /compute/v2.1/servers/4a705ff6-bcc8-4bd6-aecb-35bc5a2af3f6 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:50:54.232487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3327d36-9bd3-4373-ab45-144e3e6a52d6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:54.234623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c3327d36-9bd3-4373-ab45-144e3e6a52d6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:54.250921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3327d36-9bd3-4373-ab45-144e3e6a52d6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:54.255149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3327d36-9bd3-4373-ab45-144e3e6a52d6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:54.257408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3327d36-9bd3-4373-ab45-144e3e6a52d6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:54.260598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3327d36-9bd3-4373-ab45-144e3e6a52d6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:54.263276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3327d36-9bd3-4373-ab45-144e3e6a52d6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:54.266883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3327d36-9bd3-4373-ab45-144e3e6a52d6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:54.373062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ed699488-9cd4-4638-b162-26eee6333dc4 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:54.376471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ed699488-9cd4-4638-b162-26eee6333dc4 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:54.428664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed699488-9cd4-4638-b162-26eee6333dc4 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:54.436873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed699488-9cd4-4638-b162-26eee6333dc4 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:54.457489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed699488-9cd4-4638-b162-26eee6333dc4 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:54.457489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed699488-9cd4-4638-b162-26eee6333dc4 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:54.457489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed699488-9cd4-4638-b162-26eee6333dc4 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:54.460108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed699488-9cd4-4638-b162-26eee6333dc4 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:54.888851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c3327d36-9bd3-4373-ab45-144e3e6a52d6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:54.917743 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c3327d36-9bd3-4373-ab45-144e3e6a52d6 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 0.689873 Aug 27 02:50:54.921901 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1902/4010] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:54 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:55.535705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ed699488-9cd4-4638-b162-26eee6333dc4 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:55.567684 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ed699488-9cd4-4638-b162-26eee6333dc4 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1313 microversion: 2.1 time: 1.201886 Aug 27 02:50:55.586533 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2109/4011] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:54 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1313 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:55.649723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0da6674c-a77e-40c5-8fb0-ee140d78986d tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Calling method '.version_select at 0x7f4d29c19af0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:55.712826 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-0da6674c-a77e-40c5-8fb0-ee140d78986d tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] HTTP exception thrown: Image not found. Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0da6674c-a77e-40c5-8fb0-ee140d78986d tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Request method failure captured: Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/images/4d04a34d-af28-4fc0-b302-7cb6b28b76d5/metadata/os_distro HTTP/1.1 Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYaOiFkiKArvWkS7F2kGIxKgh-vwjgz0ULpvc6kLbQRa1UL_EwOio6QO-aYrsopJsPzIhG_X7PsN4iE7703zlPCMVl9A4VmyeM9mpUepxJgUNSWyjUP6C97cPiB-kEVzgTrZSULJlSkuht4roYYC8ZjAdqFJUQuR9pvfiEoW6_GhSg8 Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00f0e1063d8146cdab067027d28ce2df"}]}] Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: de038e82a0b342b7bbe4be483d3b6903 Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: exception: Image not found. Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'image_id': '4d04a34d-af28-4fc0-b302-7cb6b28b76d5', 'id': 'os_distro'} Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4d04a34d-af28-4fc0-b302-7cb6b28b76d5 Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:50:55.725242 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4d04a34d-af28-4fc0-b302-7cb6b28b76d5 could not be found. Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0da6674c-a77e-40c5-8fb0-ee140d78986d tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Returning 404 to user: Image not found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0da6674c-a77e-40c5-8fb0-ee140d78986d tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] 10.222.0.99 "DELETE /compute/v2.1/images/4d04a34d-af28-4fc0-b302-7cb6b28b76d5/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.804071 Aug 27 02:50:55.735314 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1903/4012] 10.222.0.99 () {58 vars in 1293 bytes} [Sat Aug 27 02:50:54 2022] DELETE /compute/v2.1/images/4d04a34d-af28-4fc0-b302-7cb6b28b76d5/metadata/os_distro => generated 62 bytes in 806 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:50:55.756331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-effa2b8d-e7d5-47b5-89a2-6c65157471c1 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Calling method '.version_select at 0x7f4d29a63550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:55.801716 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-effa2b8d-e7d5-47b5-89a2-6c65157471c1 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] HTTP exception thrown: Image not found. Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-effa2b8d-e7d5-47b5-89a2-6c65157471c1 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Request method failure captured: Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/images/1f8a3cdb-5614-4ddd-b4ee-c59365214916/metadata/os_version HTTP/1.1 Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYaOiFkiKArvWkS7F2kGIxKgh-vwjgz0ULpvc6kLbQRa1UL_EwOio6QO-aYrsopJsPzIhG_X7PsN4iE7703zlPCMVl9A4VmyeM9mpUepxJgUNSWyjUP6C97cPiB-kEVzgTrZSULJlSkuht4roYYC8ZjAdqFJUQuR9pvfiEoW6_GhSg8 Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00f0e1063d8146cdab067027d28ce2df"}]}] Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: de038e82a0b342b7bbe4be483d3b6903 Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'image_id': '1f8a3cdb-5614-4ddd-b4ee-c59365214916', 'id': 'os_version'} Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1f8a3cdb-5614-4ddd-b4ee-c59365214916 Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:50:55.804822 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1f8a3cdb-5614-4ddd-b4ee-c59365214916 could not be found. Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-effa2b8d-e7d5-47b5-89a2-6c65157471c1 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-effa2b8d-e7d5-47b5-89a2-6c65157471c1 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] 10.222.0.99 "GET /compute/v2.1/images/1f8a3cdb-5614-4ddd-b4ee-c59365214916/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.067545 Aug 27 02:50:55.821508 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2110/4013] 10.222.0.99 () {58 vars in 1293 bytes} [Sat Aug 27 02:50:55 2022] GET /compute/v2.1/images/1f8a3cdb-5614-4ddd-b4ee-c59365214916/metadata/os_version => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:50:55.834060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d165bca-828c-4b71-83ae-13b01d5e3a8d tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Calling method '.version_select at 0x7f4d294a1820>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:55.860462 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-4d165bca-828c-4b71-83ae-13b01d5e3a8d tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] HTTP exception thrown: Image not found. Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d165bca-828c-4b71-83ae-13b01d5e3a8d tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Request method failure captured: Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/images/4bf9b887-7013-47ae-90ec-a38ca3150640/metadata HTTP/1.1 Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYaOiFkiKArvWkS7F2kGIxKgh-vwjgz0ULpvc6kLbQRa1UL_EwOio6QO-aYrsopJsPzIhG_X7PsN4iE7703zlPCMVl9A4VmyeM9mpUepxJgUNSWyjUP6C97cPiB-kEVzgTrZSULJlSkuht4roYYC8ZjAdqFJUQuR9pvfiEoW6_GhSg8 Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00f0e1063d8146cdab067027d28ce2df"}]}] Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: de038e82a0b342b7bbe4be483d3b6903 Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: exception: Image not found. Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'image_id': '4bf9b887-7013-47ae-90ec-a38ca3150640'} Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4bf9b887-7013-47ae-90ec-a38ca3150640 Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:50:55.862646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4bf9b887-7013-47ae-90ec-a38ca3150640 could not be found. Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d165bca-828c-4b71-83ae-13b01d5e3a8d tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Returning 404 to user: Image not found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:55.870370 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4d165bca-828c-4b71-83ae-13b01d5e3a8d tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] 10.222.0.99 "GET /compute/v2.1/images/4bf9b887-7013-47ae-90ec-a38ca3150640/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048570 Aug 27 02:50:55.879193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8a5b0d92-b28f-4731-a219-a21c4c167b3a tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Action: 'update_all', calling method: .version_select at 0x7f4d2934e310>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:55.883246 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1904/4014] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 02:50:55 2022] GET /compute/v2.1/images/4bf9b887-7013-47ae-90ec-a38ca3150640/metadata => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:50:55.962207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-adb8fa07-7b82-4d2b-9798-4009a4bc6ca1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:55.962886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-adb8fa07-7b82-4d2b-9798-4009a4bc6ca1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:55.978748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb8fa07-7b82-4d2b-9798-4009a4bc6ca1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:55.980685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb8fa07-7b82-4d2b-9798-4009a4bc6ca1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:55.981483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb8fa07-7b82-4d2b-9798-4009a4bc6ca1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:55.982277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb8fa07-7b82-4d2b-9798-4009a4bc6ca1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:55.982745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb8fa07-7b82-4d2b-9798-4009a4bc6ca1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:55.987160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adb8fa07-7b82-4d2b-9798-4009a4bc6ca1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:56.001460 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-8a5b0d92-b28f-4731-a219-a21c4c167b3a tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] HTTP exception thrown: Image not found. Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8a5b0d92-b28f-4731-a219-a21c4c167b3a tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Request method failure captured: Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/images/08c86465-4b6b-45e4-a00d-e6e436e2046c/metadata HTTP/1.1 Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 57 Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYaOiFkiKArvWkS7F2kGIxKgh-vwjgz0ULpvc6kLbQRa1UL_EwOio6QO-aYrsopJsPzIhG_X7PsN4iE7703zlPCMVl9A4VmyeM9mpUepxJgUNSWyjUP6C97cPiB-kEVzgTrZSULJlSkuht4roYYC8ZjAdqFJUQuR9pvfiEoW6_GhSg8 Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00f0e1063d8146cdab067027d28ce2df"}]}] Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: de038e82a0b342b7bbe4be483d3b6903 Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'image_id': '08c86465-4b6b-45e4-a00d-e6e436e2046c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 08c86465-4b6b-45e4-a00d-e6e436e2046c Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:50:56.004337 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 08c86465-4b6b-45e4-a00d-e6e436e2046c could not be found. Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:50:56.007880 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.011939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8a5b0d92-b28f-4731-a219-a21c4c167b3a tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:56.013000 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8a5b0d92-b28f-4731-a219-a21c4c167b3a tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] 10.222.0.99 "PUT /compute/v2.1/images/08c86465-4b6b-45e4-a00d-e6e436e2046c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.142414 Aug 27 02:50:56.013785 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2111/4015] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:50:55 2022] PUT /compute/v2.1/images/08c86465-4b6b-45e4-a00d-e6e436e2046c/metadata => generated 62 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:50:56.031525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-351c68a3-4e94-42fc-87c2-e732a7cbc3f0 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Action: 'update', calling method: .version_select at 0x7f4d2949c790>, body: {"meta": {"os_distro": "alt"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:56.137913 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-351c68a3-4e94-42fc-87c2-e732a7cbc3f0 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] HTTP exception thrown: Image not found. Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-351c68a3-4e94-42fc-87c2-e732a7cbc3f0 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Request method failure captured: Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/images/56ced9b4-8c99-44fc-a5e1-186ea2444411/metadata/os_distro HTTP/1.1 Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 30 Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYaOiFkiKArvWkS7F2kGIxKgh-vwjgz0ULpvc6kLbQRa1UL_EwOio6QO-aYrsopJsPzIhG_X7PsN4iE7703zlPCMVl9A4VmyeM9mpUepxJgUNSWyjUP6C97cPiB-kEVzgTrZSULJlSkuht4roYYC8ZjAdqFJUQuR9pvfiEoW6_GhSg8 Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00f0e1063d8146cdab067027d28ce2df"}]}] Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: de038e82a0b342b7bbe4be483d3b6903 Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: {"meta": {"os_distro": "alt"}} Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'image_id': '56ced9b4-8c99-44fc-a5e1-186ea2444411', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 56ced9b4-8c99-44fc-a5e1-186ea2444411 Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:50:56.140899 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 56ced9b4-8c99-44fc-a5e1-186ea2444411 could not be found. Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-351c68a3-4e94-42fc-87c2-e732a7cbc3f0 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-351c68a3-4e94-42fc-87c2-e732a7cbc3f0 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] 10.222.0.99 "PUT /compute/v2.1/images/56ced9b4-8c99-44fc-a5e1-186ea2444411/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.121141 Aug 27 02:50:56.150084 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2112/4016] 10.222.0.99 () {60 vars in 1310 bytes} [Sat Aug 27 02:50:56 2022] PUT /compute/v2.1/images/56ced9b4-8c99-44fc-a5e1-186ea2444411/metadata/os_distro => generated 62 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:50:56.166889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-29db16c5-2f70-4ebe-a090-7025a7b2c2f9 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Action: 'create', calling method: .version_select at 0x7f4d2a0fb5e0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:50:56.229148 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-29db16c5-2f70-4ebe-a090-7025a7b2c2f9 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] HTTP exception thrown: Image not found. Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-29db16c5-2f70-4ebe-a090-7025a7b2c2f9 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Request method failure captured: Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/images/3c9e364f-ef63-45f3-8647-5a457405c877/metadata HTTP/1.1 Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 57 Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYaOiFkiKArvWkS7F2kGIxKgh-vwjgz0ULpvc6kLbQRa1UL_EwOio6QO-aYrsopJsPzIhG_X7PsN4iE7703zlPCMVl9A4VmyeM9mpUepxJgUNSWyjUP6C97cPiB-kEVzgTrZSULJlSkuht4roYYC8ZjAdqFJUQuR9pvfiEoW6_GhSg8 Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/00f0e1063d8146cdab067027d28ce2df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/00f0e1063d8146cdab067027d28ce2df"}]}] Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 00f0e1063d8146cdab067027d28ce2df Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827 Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: de038e82a0b342b7bbe4be483d3b6903 Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1095948827-project Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: exception: Image not found. Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'image_id': '3c9e364f-ef63-45f3-8647-5a457405c877', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3c9e364f-ef63-45f3-8647-5a457405c877 Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 27 02:50:56.231710 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c9e364f-ef63-45f3-8647-5a457405c877 could not be found. Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 27 02:50:56.235138 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:50:56.239054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-29db16c5-2f70-4ebe-a090-7025a7b2c2f9 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] Returning 404 to user: Image not found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:50:56.239955 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-29db16c5-2f70-4ebe-a090-7025a7b2c2f9 tempest-ImagesMetadataNegativeTestJSON-1095948827 tempest-ImagesMetadataNegativeTestJSON-1095948827-project] 10.222.0.99 "POST /compute/v2.1/images/3c9e364f-ef63-45f3-8647-5a457405c877/metadata" status: 404 len: 62 microversion: 2.1 time: 0.087620 Aug 27 02:50:56.240562 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2113/4017] 10.222.0.99 () {60 vars in 1281 bytes} [Sat Aug 27 02:50:56 2022] POST /compute/v2.1/images/3c9e364f-ef63-45f3-8647-5a457405c877/metadata => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:50:56.611288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94faa289-1613-404f-9ce4-f39df1402fbc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:56.613481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-94faa289-1613-404f-9ce4-f39df1402fbc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:56.645874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94faa289-1613-404f-9ce4-f39df1402fbc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:56.646866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94faa289-1613-404f-9ce4-f39df1402fbc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:56.647457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94faa289-1613-404f-9ce4-f39df1402fbc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:56.648424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94faa289-1613-404f-9ce4-f39df1402fbc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:56.649119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94faa289-1613-404f-9ce4-f39df1402fbc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:56.649699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94faa289-1613-404f-9ce4-f39df1402fbc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:56.791302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-adb8fa07-7b82-4d2b-9798-4009a4bc6ca1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:56.860211 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-adb8fa07-7b82-4d2b-9798-4009a4bc6ca1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 0.904748 Aug 27 02:50:56.870731 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1905/4018] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:55 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:57.914770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d4b6c81-023a-4412-bf5a-8a5386913ee7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:57.915969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4d4b6c81-023a-4412-bf5a-8a5386913ee7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:57.938386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:57.943672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d4b6c81-023a-4412-bf5a-8a5386913ee7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:57.963391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d4b6c81-023a-4412-bf5a-8a5386913ee7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:57.963391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d4b6c81-023a-4412-bf5a-8a5386913ee7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:57.963391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d4b6c81-023a-4412-bf5a-8a5386913ee7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:57.963391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d4b6c81-023a-4412-bf5a-8a5386913ee7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:57.963391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d4b6c81-023a-4412-bf5a-8a5386913ee7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:58.315900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-94faa289-1613-404f-9ce4-f39df1402fbc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:58.326240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=90 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:50:58.331372 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-94faa289-1613-404f-9ce4-f39df1402fbc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1313 microversion: 2.1 time: 1.729005 Aug 27 02:50:58.332000 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2114/4019] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:56 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1313 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:50:58.799212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4d4b6c81-023a-4412-bf5a-8a5386913ee7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:50:58.827785 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4d4b6c81-023a-4412-bf5a-8a5386913ee7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 0.921969 Aug 27 02:50:58.849706 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1906/4020] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:57 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:50:59.369338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be457d27-ac2c-45cc-a5a8-e7a53be155ad tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:59.370793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-be457d27-ac2c-45cc-a5a8-e7a53be155ad tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:59.394745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be457d27-ac2c-45cc-a5a8-e7a53be155ad tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:59.395641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be457d27-ac2c-45cc-a5a8-e7a53be155ad tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:59.396445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be457d27-ac2c-45cc-a5a8-e7a53be155ad tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:59.417938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be457d27-ac2c-45cc-a5a8-e7a53be155ad tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:59.419016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be457d27-ac2c-45cc-a5a8-e7a53be155ad tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:59.420055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be457d27-ac2c-45cc-a5a8-e7a53be155ad tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:59.885439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5cb1d37e-3157-4133-9a10-b43b7fd4560a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:50:59.905765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5cb1d37e-3157-4133-9a10-b43b7fd4560a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:50:59.944556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cb1d37e-3157-4133-9a10-b43b7fd4560a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:59.947327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cb1d37e-3157-4133-9a10-b43b7fd4560a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:59.950659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cb1d37e-3157-4133-9a10-b43b7fd4560a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:50:59.956919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cb1d37e-3157-4133-9a10-b43b7fd4560a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:50:59.960361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cb1d37e-3157-4133-9a10-b43b7fd4560a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:50:59.963520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cb1d37e-3157-4133-9a10-b43b7fd4560a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:01.222598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5cb1d37e-3157-4133-9a10-b43b7fd4560a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:01.256891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:01.263168 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5cb1d37e-3157-4133-9a10-b43b7fd4560a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 1.394951 Aug 27 02:51:01.275405 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1907/4021] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:59 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:01.309415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8af08714-de13-4984-99bb-1b12142a06a5 req-4290150b-3290-4830-87a2-0fe26ca7e7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed264ed-31ac-462f-864a-1479bf5fc3ef", "name": "network-vif-plugged", "status": "completed", "tag": "fe21cb15-31a5-40b7-87ce-17062fb73885"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:01.375614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8af08714-de13-4984-99bb-1b12142a06a5 req-4290150b-3290-4830-87a2-0fe26ca7e7a8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:01.379921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8af08714-de13-4984-99bb-1b12142a06a5 req-4290150b-3290-4830-87a2-0fe26ca7e7a8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:01.381832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8af08714-de13-4984-99bb-1b12142a06a5 req-4290150b-3290-4830-87a2-0fe26ca7e7a8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:01.468059 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8af08714-de13-4984-99bb-1b12142a06a5 req-4290150b-3290-4830-87a2-0fe26ca7e7a8 service nova] Creating event network-vif-plugged:fe21cb15-31a5-40b7-87ce-17062fb73885 for instance 3ed264ed-31ac-462f-864a-1479bf5fc3ef on n-h2-852084-5 Aug 27 02:51:01.505586 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8af08714-de13-4984-99bb-1b12142a06a5 req-4290150b-3290-4830-87a2-0fe26ca7e7a8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227070 Aug 27 02:51:01.511282 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1908/4022] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:02.065708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be457d27-ac2c-45cc-a5a8-e7a53be155ad tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:02.075816 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-be457d27-ac2c-45cc-a5a8-e7a53be155ad tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1313 microversion: 2.1 time: 2.716750 Aug 27 02:51:02.076708 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2115/4023] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:50:59 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1313 bytes in 2719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:02.308585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e3bee335-dc4d-4e4e-b505-cef33378ad2e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:02.319338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e3bee335-dc4d-4e4e-b505-cef33378ad2e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:02.341112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3bee335-dc4d-4e4e-b505-cef33378ad2e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:02.345403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3bee335-dc4d-4e4e-b505-cef33378ad2e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:02.347569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3bee335-dc4d-4e4e-b505-cef33378ad2e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:02.350590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3bee335-dc4d-4e4e-b505-cef33378ad2e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:02.353002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3bee335-dc4d-4e4e-b505-cef33378ad2e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:02.355439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3bee335-dc4d-4e4e-b505-cef33378ad2e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:03.101521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fa2e9252-2b12-4304-9cfa-aeddec893e13 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:03.103902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fa2e9252-2b12-4304-9cfa-aeddec893e13 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:03.124710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa2e9252-2b12-4304-9cfa-aeddec893e13 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:03.125222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa2e9252-2b12-4304-9cfa-aeddec893e13 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:03.125701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa2e9252-2b12-4304-9cfa-aeddec893e13 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:03.136171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa2e9252-2b12-4304-9cfa-aeddec893e13 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:03.136737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa2e9252-2b12-4304-9cfa-aeddec893e13 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:03.139519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa2e9252-2b12-4304-9cfa-aeddec893e13 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:03.509234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e3bee335-dc4d-4e4e-b505-cef33378ad2e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:03.534694 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e3bee335-dc4d-4e4e-b505-cef33378ad2e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 1.231606 Aug 27 02:51:03.538711 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1909/4024] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:02 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:04.148744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fa2e9252-2b12-4304-9cfa-aeddec893e13 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:04.157299 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fa2e9252-2b12-4304-9cfa-aeddec893e13 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1313 microversion: 2.1 time: 1.061481 Aug 27 02:51:04.169001 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2116/4025] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:03 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1313 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:04.566406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb62a3ba-637a-41a8-b985-520c1e5f5941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:04.567815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bb62a3ba-637a-41a8-b985-520c1e5f5941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:04.591046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb62a3ba-637a-41a8-b985-520c1e5f5941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:04.592202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb62a3ba-637a-41a8-b985-520c1e5f5941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:04.594807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb62a3ba-637a-41a8-b985-520c1e5f5941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:04.596147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb62a3ba-637a-41a8-b985-520c1e5f5941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:04.596880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb62a3ba-637a-41a8-b985-520c1e5f5941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:04.597586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb62a3ba-637a-41a8-b985-520c1e5f5941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:05.184822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-675d085c-40f0-489c-8389-9d5129d57872 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:05.191660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-675d085c-40f0-489c-8389-9d5129d57872 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:05.215250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=32 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:05.239817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-675d085c-40f0-489c-8389-9d5129d57872 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:05.244149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-675d085c-40f0-489c-8389-9d5129d57872 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:05.246706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-675d085c-40f0-489c-8389-9d5129d57872 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:05.250431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-675d085c-40f0-489c-8389-9d5129d57872 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:05.261971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-675d085c-40f0-489c-8389-9d5129d57872 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:05.263864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-675d085c-40f0-489c-8389-9d5129d57872 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:05.901997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bb62a3ba-637a-41a8-b985-520c1e5f5941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:05.939885 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bb62a3ba-637a-41a8-b985-520c1e5f5941 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 1.379141 Aug 27 02:51:05.941748 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1910/4026] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:04 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:06.009080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-675d085c-40f0-489c-8389-9d5129d57872 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:06.047510 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-675d085c-40f0-489c-8389-9d5129d57872 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1499 microversion: 2.1 time: 0.871152 Aug 27 02:51:06.064226 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2117/4027] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:05 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1499 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:06.073571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-85eff41d-e32e-4221-a038-0467a4e17474 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:06.078378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-85eff41d-e32e-4221-a038-0467a4e17474 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:06.088054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85eff41d-e32e-4221-a038-0467a4e17474 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:06.088888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85eff41d-e32e-4221-a038-0467a4e17474 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:06.090393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85eff41d-e32e-4221-a038-0467a4e17474 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:06.092837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85eff41d-e32e-4221-a038-0467a4e17474 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:06.093928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85eff41d-e32e-4221-a038-0467a4e17474 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:06.095215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85eff41d-e32e-4221-a038-0467a4e17474 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:06.133028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-85eff41d-e32e-4221-a038-0467a4e17474 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lazy-loading 'flavor' on Instance uuid 3ed264ed-31ac-462f-864a-1479bf5fc3ef {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:51:06.308121 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-85eff41d-e32e-4221-a038-0467a4e17474 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "POST /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef/action" status: 200 len: 32 microversion: 2.1 time: 0.239468 Aug 27 02:51:06.308852 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1911/4028] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:51:06 2022] POST /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef/action => generated 32 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:51:06.328875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a5a7ea71-233a-46e6-9ec4-ba373fe1cc25 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:06.331213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a5a7ea71-233a-46e6-9ec4-ba373fe1cc25 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:06.361288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5a7ea71-233a-46e6-9ec4-ba373fe1cc25 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:06.363077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5a7ea71-233a-46e6-9ec4-ba373fe1cc25 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:06.364016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5a7ea71-233a-46e6-9ec4-ba373fe1cc25 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:06.364795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5a7ea71-233a-46e6-9ec4-ba373fe1cc25 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:06.365278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5a7ea71-233a-46e6-9ec4-ba373fe1cc25 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:06.365766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5a7ea71-233a-46e6-9ec4-ba373fe1cc25 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:06.964943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-25379f8d-5337-4279-adb5-9dbd71a07b57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:06.966880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-25379f8d-5337-4279-adb5-9dbd71a07b57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:06.975313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25379f8d-5337-4279-adb5-9dbd71a07b57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:06.976513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25379f8d-5337-4279-adb5-9dbd71a07b57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:06.977344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25379f8d-5337-4279-adb5-9dbd71a07b57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:06.978373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25379f8d-5337-4279-adb5-9dbd71a07b57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:06.979077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25379f8d-5337-4279-adb5-9dbd71a07b57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:06.979775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-25379f8d-5337-4279-adb5-9dbd71a07b57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:07.274197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a5a7ea71-233a-46e6-9ec4-ba373fe1cc25 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:07.290998 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a5a7ea71-233a-46e6-9ec4-ba373fe1cc25 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 0.973670 Aug 27 02:51:07.322100 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2118/4029] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:06 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:07.347668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d4e8541-7fc1-46df-93e7-643903f1ba17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:07.348212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1d4e8541-7fc1-46df-93e7-643903f1ba17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:07.381714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4e8541-7fc1-46df-93e7-643903f1ba17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:07.398056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4e8541-7fc1-46df-93e7-643903f1ba17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:07.400935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4e8541-7fc1-46df-93e7-643903f1ba17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:07.404393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4e8541-7fc1-46df-93e7-643903f1ba17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:07.420982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4e8541-7fc1-46df-93e7-643903f1ba17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:07.421888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4e8541-7fc1-46df-93e7-643903f1ba17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:07.600962 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1d4e8541-7fc1-46df-93e7-643903f1ba17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/ips" status: 200 len: 144 microversion: 2.1 time: 0.274903 Aug 27 02:51:07.612097 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2119/4030] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 02:51:07 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/ips => generated 144 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:08.224645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-25379f8d-5337-4279-adb5-9dbd71a07b57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:08.247727 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-25379f8d-5337-4279-adb5-9dbd71a07b57 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 1.287703 Aug 27 02:51:08.259287 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1912/4031] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:06 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:08.332838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-34c7643d-8a91-4fbd-b49a-f68d3d35201b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:08.337810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-34c7643d-8a91-4fbd-b49a-f68d3d35201b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:08.387951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34c7643d-8a91-4fbd-b49a-f68d3d35201b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:08.393088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34c7643d-8a91-4fbd-b49a-f68d3d35201b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:08.397885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34c7643d-8a91-4fbd-b49a-f68d3d35201b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:08.399656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34c7643d-8a91-4fbd-b49a-f68d3d35201b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:08.403309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34c7643d-8a91-4fbd-b49a-f68d3d35201b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:08.404532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34c7643d-8a91-4fbd-b49a-f68d3d35201b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:09.286566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-add1f0ba-8c22-4ce5-b185-51238f88c130 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:09.296148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-add1f0ba-8c22-4ce5-b185-51238f88c130 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:09.350720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-add1f0ba-8c22-4ce5-b185-51238f88c130 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:09.351976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-add1f0ba-8c22-4ce5-b185-51238f88c130 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:09.353023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-add1f0ba-8c22-4ce5-b185-51238f88c130 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:09.354862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-add1f0ba-8c22-4ce5-b185-51238f88c130 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:09.356371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-add1f0ba-8c22-4ce5-b185-51238f88c130 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:09.362460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-add1f0ba-8c22-4ce5-b185-51238f88c130 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:10.109433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-34c7643d-8a91-4fbd-b49a-f68d3d35201b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:10.146756 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-34c7643d-8a91-4fbd-b49a-f68d3d35201b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 1.827651 Aug 27 02:51:10.151147 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2120/4032] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:08 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:11.178412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c30f70d0-561d-4790-a794-9a88c9bd334b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:11.182819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c30f70d0-561d-4790-a794-9a88c9bd334b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:11.217290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c30f70d0-561d-4790-a794-9a88c9bd334b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:11.223003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c30f70d0-561d-4790-a794-9a88c9bd334b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:11.224377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c30f70d0-561d-4790-a794-9a88c9bd334b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:11.227128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c30f70d0-561d-4790-a794-9a88c9bd334b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:11.230901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c30f70d0-561d-4790-a794-9a88c9bd334b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:11.231749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-add1f0ba-8c22-4ce5-b185-51238f88c130 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:11.235284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c30f70d0-561d-4790-a794-9a88c9bd334b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:11.242002 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-add1f0ba-8c22-4ce5-b185-51238f88c130 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1526 microversion: 2.1 time: 1.964872 Aug 27 02:51:11.257970 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1913/4033] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:09 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1526 bytes in 1982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:11.791263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da64c452-ace9-4226-995a-c2ea44492c4d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07903472-43bb-41d8-9c44-dc3c65770fce"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:11.794978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da64c452-ace9-4226-995a-c2ea44492c4d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:11.824598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da64c452-ace9-4226-995a-c2ea44492c4d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:11.825450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da64c452-ace9-4226-995a-c2ea44492c4d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:11.826798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da64c452-ace9-4226-995a-c2ea44492c4d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:11.829295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da64c452-ace9-4226-995a-c2ea44492c4d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:11.830590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da64c452-ace9-4226-995a-c2ea44492c4d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:11.836678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da64c452-ace9-4226-995a-c2ea44492c4d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:12.360618 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da64c452-ace9-4226-995a-c2ea44492c4d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "POST /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.566636 Aug 27 02:51:12.370285 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1914/4034] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 02:51:11 2022] POST /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:12.422090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7ef507a-2051-4684-bf6c-0065a479e814 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:12.430087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7ef507a-2051-4684-bf6c-0065a479e814 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:12.487325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c30f70d0-561d-4790-a794-9a88c9bd334b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:12.499934 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c30f70d0-561d-4790-a794-9a88c9bd334b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 1.329438 Aug 27 02:51:12.500486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef507a-2051-4684-bf6c-0065a479e814 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:12.505645 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2121/4035] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:11 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:12.512267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef507a-2051-4684-bf6c-0065a479e814 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:12.513932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef507a-2051-4684-bf6c-0065a479e814 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:12.517075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef507a-2051-4684-bf6c-0065a479e814 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:12.520649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef507a-2051-4684-bf6c-0065a479e814 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:12.521498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef507a-2051-4684-bf6c-0065a479e814 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:13.558761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5706a2b1-f3e0-41e6-b2a5-97a2d544dddc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:13.562730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5706a2b1-f3e0-41e6-b2a5-97a2d544dddc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:13.612458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5706a2b1-f3e0-41e6-b2a5-97a2d544dddc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:13.619258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5706a2b1-f3e0-41e6-b2a5-97a2d544dddc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:13.622239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5706a2b1-f3e0-41e6-b2a5-97a2d544dddc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:13.627186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5706a2b1-f3e0-41e6-b2a5-97a2d544dddc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:13.627674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5706a2b1-f3e0-41e6-b2a5-97a2d544dddc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:13.637900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5706a2b1-f3e0-41e6-b2a5-97a2d544dddc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:14.067363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7ef507a-2051-4684-bf6c-0065a479e814 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:14.084041 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7ef507a-2051-4684-bf6c-0065a479e814 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1508 microversion: 2.1 time: 1.710281 Aug 27 02:51:14.085375 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1915/4036] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:12 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1508 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:14.821158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5706a2b1-f3e0-41e6-b2a5-97a2d544dddc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:14.851937 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5706a2b1-f3e0-41e6-b2a5-97a2d544dddc tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 1.298669 Aug 27 02:51:14.854452 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2122/4037] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:13 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:15.113434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-487ffe24-3061-4ab4-b91c-db44f78db9ee tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:15.114315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-487ffe24-3061-4ab4-b91c-db44f78db9ee tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:15.132166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-487ffe24-3061-4ab4-b91c-db44f78db9ee tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:15.132676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-487ffe24-3061-4ab4-b91c-db44f78db9ee tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:15.133135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-487ffe24-3061-4ab4-b91c-db44f78db9ee tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:15.147408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-487ffe24-3061-4ab4-b91c-db44f78db9ee tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:15.148035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-487ffe24-3061-4ab4-b91c-db44f78db9ee tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:15.148499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-487ffe24-3061-4ab4-b91c-db44f78db9ee tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:15.717479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-931c4b7f-b29e-4d8d-9d60-6f101bce97e7 req-767920bd-81c3-40c6-be49-59597253b4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f7ed66-f5a7-42ec-be91-bd5a08981d8f", "name": "network-vif-unplugged", "status": "completed", "tag": "6c86ab3b-0086-4926-853f-bbbc6acba033"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:15.766745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-931c4b7f-b29e-4d8d-9d60-6f101bce97e7 req-767920bd-81c3-40c6-be49-59597253b4b8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:15.769728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-931c4b7f-b29e-4d8d-9d60-6f101bce97e7 req-767920bd-81c3-40c6-be49-59597253b4b8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:15.770868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-931c4b7f-b29e-4d8d-9d60-6f101bce97e7 req-767920bd-81c3-40c6-be49-59597253b4b8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:15.804542 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-931c4b7f-b29e-4d8d-9d60-6f101bce97e7 req-767920bd-81c3-40c6-be49-59597253b4b8 service nova] Creating event network-vif-unplugged:6c86ab3b-0086-4926-853f-bbbc6acba033 for instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f on n-h1-852084-5 Aug 27 02:51:15.818210 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-931c4b7f-b29e-4d8d-9d60-6f101bce97e7 req-767920bd-81c3-40c6-be49-59597253b4b8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107581 Aug 27 02:51:15.821124 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2123/4038] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:15.909815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f41dd46-5747-4b9c-b347-4f1bf3d9e839 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:15.923506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6f41dd46-5747-4b9c-b347-4f1bf3d9e839 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:15.954253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f41dd46-5747-4b9c-b347-4f1bf3d9e839 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:15.955573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f41dd46-5747-4b9c-b347-4f1bf3d9e839 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:15.956382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f41dd46-5747-4b9c-b347-4f1bf3d9e839 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:15.957582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f41dd46-5747-4b9c-b347-4f1bf3d9e839 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:15.958311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f41dd46-5747-4b9c-b347-4f1bf3d9e839 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:15.958947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f41dd46-5747-4b9c-b347-4f1bf3d9e839 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:16.693444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-487ffe24-3061-4ab4-b91c-db44f78db9ee tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:16.764647 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-487ffe24-3061-4ab4-b91c-db44f78db9ee tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1508 microversion: 2.1 time: 1.653897 Aug 27 02:51:16.770802 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1916/4039] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:15 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1508 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:17.089833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6f41dd46-5747-4b9c-b347-4f1bf3d9e839 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:17.109308 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6f41dd46-5747-4b9c-b347-4f1bf3d9e839 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 1.219954 Aug 27 02:51:17.133027 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2124/4040] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:15 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:17.803566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1c9fe82b-2719-4f2b-901d-7bc1af825c45 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:17.804847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1c9fe82b-2719-4f2b-901d-7bc1af825c45 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:17.835866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9fe82b-2719-4f2b-901d-7bc1af825c45 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:17.836732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9fe82b-2719-4f2b-901d-7bc1af825c45 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:17.837805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9fe82b-2719-4f2b-901d-7bc1af825c45 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:17.840284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9fe82b-2719-4f2b-901d-7bc1af825c45 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:17.842191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9fe82b-2719-4f2b-901d-7bc1af825c45 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:17.843505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9fe82b-2719-4f2b-901d-7bc1af825c45 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:18.155986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-200705ac-3b04-48df-9b89-1376a18c72c8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:18.157133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-200705ac-3b04-48df-9b89-1376a18c72c8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:18.193516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-200705ac-3b04-48df-9b89-1376a18c72c8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:18.194486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-200705ac-3b04-48df-9b89-1376a18c72c8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:18.197608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-200705ac-3b04-48df-9b89-1376a18c72c8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:18.203269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-200705ac-3b04-48df-9b89-1376a18c72c8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:18.206746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-200705ac-3b04-48df-9b89-1376a18c72c8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:18.212579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-200705ac-3b04-48df-9b89-1376a18c72c8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:19.104472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1c9fe82b-2719-4f2b-901d-7bc1af825c45 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:19.114943 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1c9fe82b-2719-4f2b-901d-7bc1af825c45 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1451 microversion: 2.1 time: 1.324503 Aug 27 02:51:19.116626 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1917/4041] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:17 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1451 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:19.158856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-011fcb2e-626b-4d6e-81d6-bbfab3c5de29 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:19.159506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-011fcb2e-626b-4d6e-81d6-bbfab3c5de29 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:19.174294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-011fcb2e-626b-4d6e-81d6-bbfab3c5de29 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:19.174771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-011fcb2e-626b-4d6e-81d6-bbfab3c5de29 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:19.178200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-011fcb2e-626b-4d6e-81d6-bbfab3c5de29 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:19.179093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-011fcb2e-626b-4d6e-81d6-bbfab3c5de29 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:19.179960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-011fcb2e-626b-4d6e-81d6-bbfab3c5de29 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:19.180427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-011fcb2e-626b-4d6e-81d6-bbfab3c5de29 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:19.491050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-200705ac-3b04-48df-9b89-1376a18c72c8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:19.522847 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-200705ac-3b04-48df-9b89-1376a18c72c8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 1.374620 Aug 27 02:51:19.529492 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2125/4042] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:18 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:19.928184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1266191155", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "b00c83dc-3356-46a2-9e24-ab075d6c0f2c"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:20.091636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] validate_networks() for [('b00c83dc-3356-46a2-9e24-ab075d6c0f2c', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:51:20.702153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-011fcb2e-626b-4d6e-81d6-bbfab3c5de29 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:20.717089 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-011fcb2e-626b-4d6e-81d6-bbfab3c5de29 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1451 microversion: 2.1 time: 1.563413 Aug 27 02:51:20.733717 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1918/4043] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:19 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1451 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:20.736584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d57c2059-86da-42dd-92c4-14bcc4208bbf tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:20.749943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d57c2059-86da-42dd-92c4-14bcc4208bbf tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:20.777638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57c2059-86da-42dd-92c4-14bcc4208bbf tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:20.805140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57c2059-86da-42dd-92c4-14bcc4208bbf tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:20.811350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57c2059-86da-42dd-92c4-14bcc4208bbf tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:20.815809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57c2059-86da-42dd-92c4-14bcc4208bbf tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:20.819951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57c2059-86da-42dd-92c4-14bcc4208bbf tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:20.820669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d57c2059-86da-42dd-92c4-14bcc4208bbf tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:21.586165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d57c2059-86da-42dd-92c4-14bcc4208bbf tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:21.594970 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d57c2059-86da-42dd-92c4-14bcc4208bbf tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 0.873084 Aug 27 02:51:21.606046 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1919/4044] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:20 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:21.621988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:21.638577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:21.646935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:21.648997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:21.658461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:21.661619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:21.662380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:21.665271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:21.777169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lazy-loading 'flavor' on Instance uuid 58f7ed66-f5a7-42ec-be91-bd5a08981d8f {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:51:21.828029 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Cannot 'shelve' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state shelved_offloaded Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action HTTP/1.1 Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 14 Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: {"shelve": {}} Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'shelve' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state shelved_offloaded Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '58f7ed66-f5a7-42ec-be91-bd5a08981d8f', 'body': {'shelve': {}}} Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:51:21.840972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state shelved_offloaded Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state shelved_offloaded Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 409 to user: Cannot 'shelve' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state shelved_offloaded {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:51:21.851758 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-23e1b0c9-e799-4e07-9999-7270e70a7802 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 409 len: 155 microversion: 2.1 time: 0.241786 Aug 27 02:51:21.856100 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1920/4045] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:51:21 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 155 bytes in 249 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:51:21.874709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a1c3d1e1-678a-42f8-8443-7529e2603c00 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:21.881547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a1c3d1e1-678a-42f8-8443-7529e2603c00 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:21.919037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1e1-678a-42f8-8443-7529e2603c00 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:21.921241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1e1-678a-42f8-8443-7529e2603c00 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:21.921778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1e1-678a-42f8-8443-7529e2603c00 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:21.922572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1e1-678a-42f8-8443-7529e2603c00 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:21.923061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1e1-678a-42f8-8443-7529e2603c00 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:21.924854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1c3d1e1-678a-42f8-8443-7529e2603c00 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:22.092486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a1c3d1e1-678a-42f8-8443-7529e2603c00 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122487) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 02:51:22.487449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:22.664940 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a1c3d1e1-678a-42f8-8443-7529e2603c00 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 202 len: 0 microversion: 2.1 time: 0.805088 Aug 27 02:51:22.666197 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1921/4046] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:51:21 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:51:22.725524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0cc1c9fc-c09a-4b60-8056-1935dd948e1a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:22.726513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0cc1c9fc-c09a-4b60-8056-1935dd948e1a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:22.764734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc1c9fc-c09a-4b60-8056-1935dd948e1a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:22.767907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc1c9fc-c09a-4b60-8056-1935dd948e1a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:22.768728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc1c9fc-c09a-4b60-8056-1935dd948e1a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:22.789837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc1c9fc-c09a-4b60-8056-1935dd948e1a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:22.794481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc1c9fc-c09a-4b60-8056-1935dd948e1a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:22.801205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0cc1c9fc-c09a-4b60-8056-1935dd948e1a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:23.846981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0cc1c9fc-c09a-4b60-8056-1935dd948e1a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:23.918071 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0cc1c9fc-c09a-4b60-8056-1935dd948e1a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 1.242380 Aug 27 02:51:23.939040 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1922/4047] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:22 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:23.949062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3101e2f6-a69e-4925-aa54-8e838d00cf54 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:23.952713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3101e2f6-a69e-4925-aa54-8e838d00cf54 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:23.966919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3101e2f6-a69e-4925-aa54-8e838d00cf54 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:23.970977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3101e2f6-a69e-4925-aa54-8e838d00cf54 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:23.974273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3101e2f6-a69e-4925-aa54-8e838d00cf54 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:23.976101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3101e2f6-a69e-4925-aa54-8e838d00cf54 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:23.977737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3101e2f6-a69e-4925-aa54-8e838d00cf54 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:23.979088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3101e2f6-a69e-4925-aa54-8e838d00cf54 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:24.654367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3101e2f6-a69e-4925-aa54-8e838d00cf54 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:24.667998 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3101e2f6-a69e-4925-aa54-8e838d00cf54 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1459 microversion: 2.1 time: 0.727419 Aug 27 02:51:24.686678 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1923/4048] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:23 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1459 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:24.944294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2ebaff95-9a4e-4dfe-9d7d-e0ef9415429e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:24.945942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2ebaff95-9a4e-4dfe-9d7d-e0ef9415429e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:24.956787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ebaff95-9a4e-4dfe-9d7d-e0ef9415429e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:24.957884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ebaff95-9a4e-4dfe-9d7d-e0ef9415429e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:24.958748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ebaff95-9a4e-4dfe-9d7d-e0ef9415429e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:24.960043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ebaff95-9a4e-4dfe-9d7d-e0ef9415429e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:24.960932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ebaff95-9a4e-4dfe-9d7d-e0ef9415429e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:24.961614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ebaff95-9a4e-4dfe-9d7d-e0ef9415429e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:26.160075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:51:26.160664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:51:26.161096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:51:26.161774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:51:26.162402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:51:26.184349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:26.185205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:26.187154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:26.188234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:26.191290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:26.191989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:26.252529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Getting quotas for project ebc16871a14c441c9a565c1725041d42. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:26.275430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Getting quotas for user fd4fedd5221d4f08b92f0f6722a655c3 and project ebc16871a14c441c9a565c1725041d42. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:26.321007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:51:26.326806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:51:26.457124 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-254bb894-99d6-48e6-b81e-562ae367b929 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.895063 Aug 27 02:51:26.461929 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2126/4049] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:51:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 6901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:51:26.483203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f5dcd32c-11ba-4c0e-a271-dc1206bb1253 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:26.483904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f5dcd32c-11ba-4c0e-a271-dc1206bb1253 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:26.516444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5dcd32c-11ba-4c0e-a271-dc1206bb1253 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:26.518794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5dcd32c-11ba-4c0e-a271-dc1206bb1253 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:26.519537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5dcd32c-11ba-4c0e-a271-dc1206bb1253 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:26.520611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5dcd32c-11ba-4c0e-a271-dc1206bb1253 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:26.521331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5dcd32c-11ba-4c0e-a271-dc1206bb1253 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:26.523596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5dcd32c-11ba-4c0e-a271-dc1206bb1253 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:26.802950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2ebaff95-9a4e-4dfe-9d7d-e0ef9415429e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:26.820308 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2ebaff95-9a4e-4dfe-9d7d-e0ef9415429e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 1.880541 Aug 27 02:51:26.839727 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1924/4050] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:24 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:26.879628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b785b663-7279-45da-977a-f78a84eb9824 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:26.881295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b785b663-7279-45da-977a-f78a84eb9824 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:27.238242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b785b663-7279-45da-977a-f78a84eb9824 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:27.257857 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b785b663-7279-45da-977a-f78a84eb9824 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1225 microversion: 2.1 time: 0.409573 Aug 27 02:51:27.259499 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1925/4051] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:26 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1225 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:27.842358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-09cf4f2a-371b-4658-89a0-42db15c4a54d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:27.843298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-09cf4f2a-371b-4658-89a0-42db15c4a54d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:27.863605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cf4f2a-371b-4658-89a0-42db15c4a54d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:27.864443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cf4f2a-371b-4658-89a0-42db15c4a54d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:27.866515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cf4f2a-371b-4658-89a0-42db15c4a54d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:27.877897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cf4f2a-371b-4658-89a0-42db15c4a54d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:27.880748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cf4f2a-371b-4658-89a0-42db15c4a54d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:27.882126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cf4f2a-371b-4658-89a0-42db15c4a54d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:28.283120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f5dcd32c-11ba-4c0e-a271-dc1206bb1253 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:28.322669 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f5dcd32c-11ba-4c0e-a271-dc1206bb1253 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1459 microversion: 2.1 time: 1.857254 Aug 27 02:51:28.326474 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2127/4052] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:26 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1459 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:28.340682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-09cf4f2a-371b-4658-89a0-42db15c4a54d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:28.346907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-49e3afdd-7ee5-4082-b2f8-f7ff6b9a1ffc tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:28.352484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-49e3afdd-7ee5-4082-b2f8-f7ff6b9a1ffc tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:28.358677 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-09cf4f2a-371b-4658-89a0-42db15c4a54d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 0.520618 Aug 27 02:51:28.360900 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1926/4053] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:27 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:28.368723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49e3afdd-7ee5-4082-b2f8-f7ff6b9a1ffc tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:28.372651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49e3afdd-7ee5-4082-b2f8-f7ff6b9a1ffc tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:28.373515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49e3afdd-7ee5-4082-b2f8-f7ff6b9a1ffc tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:28.376053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49e3afdd-7ee5-4082-b2f8-f7ff6b9a1ffc tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:28.378539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49e3afdd-7ee5-4082-b2f8-f7ff6b9a1ffc tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:28.379495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49e3afdd-7ee5-4082-b2f8-f7ff6b9a1ffc tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:28.591498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-49e3afdd-7ee5-4082-b2f8-f7ff6b9a1ffc tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:28.627379 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-49e3afdd-7ee5-4082-b2f8-f7ff6b9a1ffc tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1221 microversion: 2.1 time: 0.293243 Aug 27 02:51:28.634357 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2128/4054] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:28 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1221 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:29.351599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-acc88bba-313f-4f56-95cc-15bfb56e6ed7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:29.352416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-acc88bba-313f-4f56-95cc-15bfb56e6ed7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:29.363238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:29.369137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acc88bba-313f-4f56-95cc-15bfb56e6ed7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:29.371647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acc88bba-313f-4f56-95cc-15bfb56e6ed7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:29.372321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acc88bba-313f-4f56-95cc-15bfb56e6ed7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:29.374978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acc88bba-313f-4f56-95cc-15bfb56e6ed7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:29.375482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acc88bba-313f-4f56-95cc-15bfb56e6ed7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:29.375935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acc88bba-313f-4f56-95cc-15bfb56e6ed7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:29.383319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8988f644-2c77-4890-829d-452fca732b6f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:29.383963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8988f644-2c77-4890-829d-452fca732b6f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:29.400156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8988f644-2c77-4890-829d-452fca732b6f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:29.400680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8988f644-2c77-4890-829d-452fca732b6f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:29.401107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8988f644-2c77-4890-829d-452fca732b6f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:29.402162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8988f644-2c77-4890-829d-452fca732b6f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:29.402648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8988f644-2c77-4890-829d-452fca732b6f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:29.403088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8988f644-2c77-4890-829d-452fca732b6f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:30.050973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8988f644-2c77-4890-829d-452fca732b6f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:30.060268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=80 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:30.070299 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8988f644-2c77-4890-829d-452fca732b6f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 0.692248 Aug 27 02:51:30.071523 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2129/4055] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:29 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:30.074059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-acc88bba-313f-4f56-95cc-15bfb56e6ed7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:30.084180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8fead80d-36d0-4935-b4a2-81bb466a587b tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:30.085029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8fead80d-36d0-4935-b4a2-81bb466a587b tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:30.095979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fead80d-36d0-4935-b4a2-81bb466a587b tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:30.096485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fead80d-36d0-4935-b4a2-81bb466a587b tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:30.096940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fead80d-36d0-4935-b4a2-81bb466a587b tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:30.101938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fead80d-36d0-4935-b4a2-81bb466a587b tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:30.102806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fead80d-36d0-4935-b4a2-81bb466a587b tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:30.103178 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-acc88bba-313f-4f56-95cc-15bfb56e6ed7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 0.754616 Aug 27 02:51:30.103661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8fead80d-36d0-4935-b4a2-81bb466a587b tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:30.111615 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1927/4056] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:29 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:30.300483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2ea5f9d0-2e8e-4316-b286-ee0199a9174a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Action: 'create', calling method: .version_select at 0x7f4d29487160>, body: {"keypair": {"name": "tempest-keypair-1963302741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9LMOrlQLSy0bwGMElQccWD7fDvnUqQ/sZ19u9gOaE5dkDkD+aA88OI9oETGxAYBgMmXdmmj3i+deE3r7ZSwQVvGi8VCPkcCAFwC3fixNK0/8qqUF+OlHVXqRJzt3jn0Q=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:30.372518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2ea5f9d0-2e8e-4316-b286-ee0199a9174a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Getting quotas for project 3126c8641780451c8c6882179cce59d2. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:30.390300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2ea5f9d0-2e8e-4316-b286-ee0199a9174a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Getting quotas for user e6debd1d81f0463c9daaa0168051ecee and project 3126c8641780451c8c6882179cce59d2. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:30.493428 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2ea5f9d0-2e8e-4316-b286-ee0199a9174a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.379314 Aug 27 02:51:30.494655 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1928/4057] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:51:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:30.541821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8fead80d-36d0-4935-b4a2-81bb466a587b tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:30.621581 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8fead80d-36d0-4935-b4a2-81bb466a587b tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1283 microversion: 2.1 time: 0.544989 Aug 27 02:51:30.639606 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2130/4058] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:30 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1283 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:31.114263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2d5b78c7-846c-47da-b50d-fcb504fa0955 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:31.115288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2d5b78c7-846c-47da-b50d-fcb504fa0955 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:31.161152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f13beda-e2a0-4af2-9ef0-1f43841bc3eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:31.161722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6f13beda-e2a0-4af2-9ef0-1f43841bc3eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:31.169638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d5b78c7-846c-47da-b50d-fcb504fa0955 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:31.175835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f13beda-e2a0-4af2-9ef0-1f43841bc3eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:31.176325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f13beda-e2a0-4af2-9ef0-1f43841bc3eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:31.176851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f13beda-e2a0-4af2-9ef0-1f43841bc3eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:31.177545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f13beda-e2a0-4af2-9ef0-1f43841bc3eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:31.178040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f13beda-e2a0-4af2-9ef0-1f43841bc3eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:31.178475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f13beda-e2a0-4af2-9ef0-1f43841bc3eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:31.181516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d5b78c7-846c-47da-b50d-fcb504fa0955 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:31.182008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d5b78c7-846c-47da-b50d-fcb504fa0955 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:31.192855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d5b78c7-846c-47da-b50d-fcb504fa0955 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:31.193556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d5b78c7-846c-47da-b50d-fcb504fa0955 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:31.194044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d5b78c7-846c-47da-b50d-fcb504fa0955 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:32.063046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6f13beda-e2a0-4af2-9ef0-1f43841bc3eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:32.077336 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6f13beda-e2a0-4af2-9ef0-1f43841bc3eb tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 0.921948 Aug 27 02:51:32.080454 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2131/4059] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:31 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:32.112048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-129e0ade-6038-47f2-a700-620ddb31f645 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:32.112686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-129e0ade-6038-47f2-a700-620ddb31f645 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:32.122420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2d5b78c7-846c-47da-b50d-fcb504fa0955 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:32.130875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-129e0ade-6038-47f2-a700-620ddb31f645 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:32.132016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-129e0ade-6038-47f2-a700-620ddb31f645 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:32.134392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-129e0ade-6038-47f2-a700-620ddb31f645 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:32.135475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-129e0ade-6038-47f2-a700-620ddb31f645 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:32.138405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-129e0ade-6038-47f2-a700-620ddb31f645 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:32.150063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-129e0ade-6038-47f2-a700-620ddb31f645 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:32.182997 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2d5b78c7-846c-47da-b50d-fcb504fa0955 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 1.075246 Aug 27 02:51:32.218112 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1929/4060] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:31 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:33.126905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3741a430-3b70-421a-b0d7-23d49ba09383 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:33.129305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3741a430-3b70-421a-b0d7-23d49ba09383 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:33.200257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3741a430-3b70-421a-b0d7-23d49ba09383 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:33.208423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3741a430-3b70-421a-b0d7-23d49ba09383 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:33.208423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3741a430-3b70-421a-b0d7-23d49ba09383 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:33.213011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3741a430-3b70-421a-b0d7-23d49ba09383 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:33.215902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3741a430-3b70-421a-b0d7-23d49ba09383 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:33.218294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3741a430-3b70-421a-b0d7-23d49ba09383 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:33.681704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-129e0ade-6038-47f2-a700-620ddb31f645 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:33.736292 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-129e0ade-6038-47f2-a700-620ddb31f645 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1325 microversion: 2.1 time: 1.648807 Aug 27 02:51:33.741853 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2132/4061] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:32 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1325 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:33.797079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-40de884c-531d-4f25-baf9-f46546462bed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:33.810818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-40de884c-531d-4f25-baf9-f46546462bed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:33.856961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40de884c-531d-4f25-baf9-f46546462bed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:33.857579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40de884c-531d-4f25-baf9-f46546462bed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:33.879944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40de884c-531d-4f25-baf9-f46546462bed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:33.887492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40de884c-531d-4f25-baf9-f46546462bed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:33.891036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40de884c-531d-4f25-baf9-f46546462bed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:33.904096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40de884c-531d-4f25-baf9-f46546462bed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:35.030901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3741a430-3b70-421a-b0d7-23d49ba09383 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:35.148762 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3741a430-3b70-421a-b0d7-23d49ba09383 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 1.983616 Aug 27 02:51:35.160558 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1930/4062] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:33 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:35.217394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ecd3a8ed-3eea-46b7-a2eb-723908f627bb tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:35.222371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ecd3a8ed-3eea-46b7-a2eb-723908f627bb tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:35.275671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecd3a8ed-3eea-46b7-a2eb-723908f627bb tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:35.276185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecd3a8ed-3eea-46b7-a2eb-723908f627bb tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:35.276727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecd3a8ed-3eea-46b7-a2eb-723908f627bb tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:35.277610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecd3a8ed-3eea-46b7-a2eb-723908f627bb tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:35.278154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecd3a8ed-3eea-46b7-a2eb-723908f627bb tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:35.278572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ecd3a8ed-3eea-46b7-a2eb-723908f627bb tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:36.134516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ecd3a8ed-3eea-46b7-a2eb-723908f627bb tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:36.164600 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ecd3a8ed-3eea-46b7-a2eb-723908f627bb tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1325 microversion: 2.1 time: 0.997802 Aug 27 02:51:36.165220 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1931/4063] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:35 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1325 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:36.194402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-66199f6f-46ac-44dd-b83f-0adb0e94ab1b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:36.211948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66199f6f-46ac-44dd-b83f-0adb0e94ab1b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:36.213939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66199f6f-46ac-44dd-b83f-0adb0e94ab1b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:36.214702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66199f6f-46ac-44dd-b83f-0adb0e94ab1b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:36.226508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:36.263960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-40de884c-531d-4f25-baf9-f46546462bed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:36.275486 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-40de884c-531d-4f25-baf9-f46546462bed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1505 microversion: 2.1 time: 2.515030 Aug 27 02:51:36.286419 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2133/4064] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:33 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1505 bytes in 2527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:36.301199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-76015beb-f140-4917-bfb3-c35e20085af8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:36.308515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-76015beb-f140-4917-bfb3-c35e20085af8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:36.332018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:36.340981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:36.345214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-66199f6f-46ac-44dd-b83f-0adb0e94ab1b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Going to try to stop instance {{(pid=122487) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:51:36.348796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76015beb-f140-4917-bfb3-c35e20085af8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:36.349640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76015beb-f140-4917-bfb3-c35e20085af8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:36.361297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76015beb-f140-4917-bfb3-c35e20085af8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:36.362589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76015beb-f140-4917-bfb3-c35e20085af8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:36.370381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76015beb-f140-4917-bfb3-c35e20085af8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:36.379682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76015beb-f140-4917-bfb3-c35e20085af8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:36.502098 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-66199f6f-46ac-44dd-b83f-0adb0e94ab1b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "POST /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/action" status: 202 len: 0 microversion: 2.1 time: 0.316911 Aug 27 02:51:36.503225 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1932/4065] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:51:36 2022] POST /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:51:36.519073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2bfd11d8-92d4-4b95-a3e9-5833198a6dc4 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:36.520258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2bfd11d8-92d4-4b95-a3e9-5833198a6dc4 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:36.529070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfd11d8-92d4-4b95-a3e9-5833198a6dc4 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:36.530048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfd11d8-92d4-4b95-a3e9-5833198a6dc4 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:36.530746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfd11d8-92d4-4b95-a3e9-5833198a6dc4 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:36.531765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfd11d8-92d4-4b95-a3e9-5833198a6dc4 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:36.532969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfd11d8-92d4-4b95-a3e9-5833198a6dc4 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:36.533412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bfd11d8-92d4-4b95-a3e9-5833198a6dc4 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:37.422947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-76015beb-f140-4917-bfb3-c35e20085af8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:37.468083 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-76015beb-f140-4917-bfb3-c35e20085af8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 1.177155 Aug 27 02:51:37.473512 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2134/4066] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:36 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:37.511498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bce3a10f-31da-43eb-be24-3f7dad05c434 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:37.513132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bce3a10f-31da-43eb-be24-3f7dad05c434 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:37.555608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bce3a10f-31da-43eb-be24-3f7dad05c434 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:37.581912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bce3a10f-31da-43eb-be24-3f7dad05c434 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:37.581912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bce3a10f-31da-43eb-be24-3f7dad05c434 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:37.581912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bce3a10f-31da-43eb-be24-3f7dad05c434 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:37.581912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bce3a10f-31da-43eb-be24-3f7dad05c434 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:37.589977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bce3a10f-31da-43eb-be24-3f7dad05c434 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:38.545239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2bfd11d8-92d4-4b95-a3e9-5833198a6dc4 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:38.588155 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2bfd11d8-92d4-4b95-a3e9-5833198a6dc4 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1723 microversion: 2.1 time: 2.069657 Aug 27 02:51:38.623033 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1933/4067] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:36 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1723 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:38.636411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-16db0f5a-56b1-4145-8982-8d995d795ef9 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:38.641885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-16db0f5a-56b1-4145-8982-8d995d795ef9 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:38.664041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16db0f5a-56b1-4145-8982-8d995d795ef9 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:38.664554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16db0f5a-56b1-4145-8982-8d995d795ef9 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:38.665243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16db0f5a-56b1-4145-8982-8d995d795ef9 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:38.666051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16db0f5a-56b1-4145-8982-8d995d795ef9 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:38.666816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16db0f5a-56b1-4145-8982-8d995d795ef9 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:38.667342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16db0f5a-56b1-4145-8982-8d995d795ef9 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:40.270487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16db0f5a-56b1-4145-8982-8d995d795ef9 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:40.318621 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-16db0f5a-56b1-4145-8982-8d995d795ef9 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1485 microversion: 2.1 time: 1.685222 Aug 27 02:51:40.333822 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1934/4068] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:38 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1485 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:40.348951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0c499065-e981-4c8b-95bd-d35e53b6a6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:40.352725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0c499065-e981-4c8b-95bd-d35e53b6a6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:40.380536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c499065-e981-4c8b-95bd-d35e53b6a6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:40.385126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c499065-e981-4c8b-95bd-d35e53b6a6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:40.393645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c499065-e981-4c8b-95bd-d35e53b6a6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:40.395496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c499065-e981-4c8b-95bd-d35e53b6a6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:40.398036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c499065-e981-4c8b-95bd-d35e53b6a6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:40.404504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c499065-e981-4c8b-95bd-d35e53b6a6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:40.502969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:40.584096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bce3a10f-31da-43eb-be24-3f7dad05c434 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:40.645416 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bce3a10f-31da-43eb-be24-3f7dad05c434 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1325 microversion: 2.1 time: 3.158811 Aug 27 02:51:40.678023 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2135/4069] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:37 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1325 bytes in 3193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:40.697049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-28cd3fc7-4c2e-493d-bdd1-be17bf8bd77a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:40.702882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-28cd3fc7-4c2e-493d-bdd1-be17bf8bd77a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:40.725602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cd3fc7-4c2e-493d-bdd1-be17bf8bd77a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:40.730296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cd3fc7-4c2e-493d-bdd1-be17bf8bd77a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:40.733409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cd3fc7-4c2e-493d-bdd1-be17bf8bd77a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:40.739960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cd3fc7-4c2e-493d-bdd1-be17bf8bd77a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:40.741913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cd3fc7-4c2e-493d-bdd1-be17bf8bd77a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:40.745286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cd3fc7-4c2e-493d-bdd1-be17bf8bd77a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:40.871302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0c499065-e981-4c8b-95bd-d35e53b6a6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:40.899178 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0c499065-e981-4c8b-95bd-d35e53b6a6e1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 0.567801 Aug 27 02:51:40.905047 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1935/4070] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:40 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:40.932783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1545464942", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:41.160619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] validate_networks() for [('e4567784-1c27-40c2-98e5-c16d6d5124d4', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:51:42.337273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-28cd3fc7-4c2e-493d-bdd1-be17bf8bd77a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:42.354063 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-28cd3fc7-4c2e-493d-bdd1-be17bf8bd77a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1723 microversion: 2.1 time: 1.673882 Aug 27 02:51:42.361809 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2136/4071] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:40 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1723 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:42.378050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ac2de17-ba93-4e3e-a8b6-94da4abe9627 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:42.379680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3ac2de17-ba93-4e3e-a8b6-94da4abe9627 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:42.409142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac2de17-ba93-4e3e-a8b6-94da4abe9627 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:42.410209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac2de17-ba93-4e3e-a8b6-94da4abe9627 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:42.411112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac2de17-ba93-4e3e-a8b6-94da4abe9627 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:42.412457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac2de17-ba93-4e3e-a8b6-94da4abe9627 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:42.413459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac2de17-ba93-4e3e-a8b6-94da4abe9627 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:42.415008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ac2de17-ba93-4e3e-a8b6-94da4abe9627 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:42.923194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3ac2de17-ba93-4e3e-a8b6-94da4abe9627 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:42.965783 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ac2de17-ba93-4e3e-a8b6-94da4abe9627 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1325 microversion: 2.1 time: 0.599349 Aug 27 02:51:42.970776 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2137/4072] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:42 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1325 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:42.998126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7e90b54c-3687-4168-bdfb-f0b23b81e020 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:42.999527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7e90b54c-3687-4168-bdfb-f0b23b81e020 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:43.022642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e90b54c-3687-4168-bdfb-f0b23b81e020 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:43.029585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e90b54c-3687-4168-bdfb-f0b23b81e020 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:43.031497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e90b54c-3687-4168-bdfb-f0b23b81e020 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:43.033488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e90b54c-3687-4168-bdfb-f0b23b81e020 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:43.039231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e90b54c-3687-4168-bdfb-f0b23b81e020 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:43.040627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e90b54c-3687-4168-bdfb-f0b23b81e020 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:43.679097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:51:43.679097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:51:43.679097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:51:43.679097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:51:43.679097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:51:43.724446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:43.731460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:43.732264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:43.733737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:43.740161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:43.740988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:43.937083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Getting quotas for project 0c35f17cbc704427aeaf13084be9b078. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:43.973610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Getting quotas for user f820d9c6655443c79c8046b396cafbba and project 0c35f17cbc704427aeaf13084be9b078. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:44.081584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:51:44.118700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:51:44.350735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7e90b54c-3687-4168-bdfb-f0b23b81e020 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:44.368281 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a73c4f73-7503-465a-8378-991dc69449ed tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.453221 Aug 27 02:51:44.370113 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1936/4073] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:51:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 3464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:51:44.387825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-25bb94a7-7c73-49d6-8236-81d65cfa671b req-929b77a8-4a5a-4f68-aae9-4bc95e943429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852a6a23-6626-4b5a-9799-b0ef35be5250", "tag": "da94607a-76fc-4b60-acff-b9e7e61b23aa"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:44.407509 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7e90b54c-3687-4168-bdfb-f0b23b81e020 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 1.430467 Aug 27 02:51:44.408519 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2138/4074] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:42 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:44.451984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-25bb94a7-7c73-49d6-8236-81d65cfa671b req-929b77a8-4a5a-4f68-aae9-4bc95e943429 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:44.452257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ec52d4f-afe5-4f9f-bddd-998ca688907d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:44.453240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ec52d4f-afe5-4f9f-bddd-998ca688907d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:44.466853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-25bb94a7-7c73-49d6-8236-81d65cfa671b req-929b77a8-4a5a-4f68-aae9-4bc95e943429 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:44.473974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-25bb94a7-7c73-49d6-8236-81d65cfa671b req-929b77a8-4a5a-4f68-aae9-4bc95e943429 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:44.496539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ec52d4f-afe5-4f9f-bddd-998ca688907d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:44.497417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ec52d4f-afe5-4f9f-bddd-998ca688907d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:44.498465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ec52d4f-afe5-4f9f-bddd-998ca688907d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:44.499788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ec52d4f-afe5-4f9f-bddd-998ca688907d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:44.500664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ec52d4f-afe5-4f9f-bddd-998ca688907d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:44.501446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ec52d4f-afe5-4f9f-bddd-998ca688907d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:44.564275 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-25bb94a7-7c73-49d6-8236-81d65cfa671b req-929b77a8-4a5a-4f68-aae9-4bc95e943429 service nova] Creating event network-changed:da94607a-76fc-4b60-acff-b9e7e61b23aa for instance 852a6a23-6626-4b5a-9799-b0ef35be5250 on n-h1-852084-5 Aug 27 02:51:44.588581 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-25bb94a7-7c73-49d6-8236-81d65cfa671b req-929b77a8-4a5a-4f68-aae9-4bc95e943429 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214163 Aug 27 02:51:44.602796 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1937/4075] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:44.616350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-19fe70fe-eeca-4354-ba41-44486407c41e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:44.617566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-19fe70fe-eeca-4354-ba41-44486407c41e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:44.656212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fe70fe-eeca-4354-ba41-44486407c41e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:44.657625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fe70fe-eeca-4354-ba41-44486407c41e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:44.658674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fe70fe-eeca-4354-ba41-44486407c41e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:44.660281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fe70fe-eeca-4354-ba41-44486407c41e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:44.662429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fe70fe-eeca-4354-ba41-44486407c41e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:44.663507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fe70fe-eeca-4354-ba41-44486407c41e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:45.916567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-19fe70fe-eeca-4354-ba41-44486407c41e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:45.926297 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-19fe70fe-eeca-4354-ba41-44486407c41e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1325 microversion: 2.1 time: 1.321647 Aug 27 02:51:45.943754 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1938/4076] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:44 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1325 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:46.151927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1229266266", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a3bbba16-ea21-41e9-a19d-afd74184c636"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:46.514638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] validate_networks() for [('a3bbba16-ea21-41e9-a19d-afd74184c636', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:51:46.515556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ec52d4f-afe5-4f9f-bddd-998ca688907d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:46.576543 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ec52d4f-afe5-4f9f-bddd-998ca688907d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1723 microversion: 2.1 time: 2.166010 Aug 27 02:51:46.615236 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2139/4077] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:44 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1723 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:46.654741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-068fa3d3-5cfd-47c6-bd57-ed136e56113b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:46.664076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-068fa3d3-5cfd-47c6-bd57-ed136e56113b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:46.722479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068fa3d3-5cfd-47c6-bd57-ed136e56113b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:46.726346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068fa3d3-5cfd-47c6-bd57-ed136e56113b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:46.731414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068fa3d3-5cfd-47c6-bd57-ed136e56113b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:46.742682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068fa3d3-5cfd-47c6-bd57-ed136e56113b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:46.744908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068fa3d3-5cfd-47c6-bd57-ed136e56113b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:46.751779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-068fa3d3-5cfd-47c6-bd57-ed136e56113b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:47.314415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-068fa3d3-5cfd-47c6-bd57-ed136e56113b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:47.335080 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-068fa3d3-5cfd-47c6-bd57-ed136e56113b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1218 microversion: 2.1 time: 0.715030 Aug 27 02:51:47.341169 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2140/4078] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:46 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1218 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:47.347573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1fd60115-6174-4fc9-8ae7-1bd5cfaea184 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:47.362097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1fd60115-6174-4fc9-8ae7-1bd5cfaea184 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:47.394531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fd60115-6174-4fc9-8ae7-1bd5cfaea184 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:47.399001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fd60115-6174-4fc9-8ae7-1bd5cfaea184 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:47.419277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fd60115-6174-4fc9-8ae7-1bd5cfaea184 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:47.423338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fd60115-6174-4fc9-8ae7-1bd5cfaea184 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:47.427346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fd60115-6174-4fc9-8ae7-1bd5cfaea184 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:47.428232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1fd60115-6174-4fc9-8ae7-1bd5cfaea184 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.085441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1fd60115-6174-4fc9-8ae7-1bd5cfaea184 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:49.100134 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1fd60115-6174-4fc9-8ae7-1bd5cfaea184 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 1.757336 Aug 27 02:51:49.100914 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2141/4079] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:47 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:49.110671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da180037-7644-47c8-8c68-9fe5725c1f48 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:49.114643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-da180037-7644-47c8-8c68-9fe5725c1f48 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:49.131212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da180037-7644-47c8-8c68-9fe5725c1f48 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:49.132138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da180037-7644-47c8-8c68-9fe5725c1f48 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:49.132885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da180037-7644-47c8-8c68-9fe5725c1f48 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.134120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da180037-7644-47c8-8c68-9fe5725c1f48 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:49.142731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da180037-7644-47c8-8c68-9fe5725c1f48 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:49.143524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da180037-7644-47c8-8c68-9fe5725c1f48 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.626031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:51:49.626031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:51:49.626031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:51:49.626031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:51:49.627413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:51:49.648842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:49.649923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:49.650869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.653548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:49.658919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:49.659758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:49.701719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:51:49.717126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for user b508f2fe4b394f589b067f5b3de49a0e and project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:51:49.754758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:51:49.760117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:51:49.900928 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b32fd8ac-ed20-4f46-8c42-29a577667398 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.954350 Aug 27 02:51:49.916003 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1939/4080] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:51:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:51:49.930457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-07de6589-a487-402b-b9ba-9222cd7d958f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:49.936539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-07de6589-a487-402b-b9ba-9222cd7d958f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:49.991415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07de6589-a487-402b-b9ba-9222cd7d958f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:50.001597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07de6589-a487-402b-b9ba-9222cd7d958f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:50.003814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07de6589-a487-402b-b9ba-9222cd7d958f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:50.005370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07de6589-a487-402b-b9ba-9222cd7d958f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:50.009432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07de6589-a487-402b-b9ba-9222cd7d958f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:50.010356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07de6589-a487-402b-b9ba-9222cd7d958f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:50.165642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:50.925125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-07de6589-a487-402b-b9ba-9222cd7d958f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:50.998613 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-07de6589-a487-402b-b9ba-9222cd7d958f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1723 microversion: 2.1 time: 1.089605 Aug 27 02:51:51.017703 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1940/4081] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:49 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1723 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:51.058747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65962fca-07e9-4c82-a377-a7a4b40cebaa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:51.073087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65962fca-07e9-4c82-a377-a7a4b40cebaa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:51.103176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65962fca-07e9-4c82-a377-a7a4b40cebaa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.105884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65962fca-07e9-4c82-a377-a7a4b40cebaa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.106935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65962fca-07e9-4c82-a377-a7a4b40cebaa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.108449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65962fca-07e9-4c82-a377-a7a4b40cebaa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.115515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65962fca-07e9-4c82-a377-a7a4b40cebaa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.118177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65962fca-07e9-4c82-a377-a7a4b40cebaa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.234363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-da180037-7644-47c8-8c68-9fe5725c1f48 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:51.254960 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-da180037-7644-47c8-8c68-9fe5725c1f48 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1325 microversion: 2.1 time: 2.146775 Aug 27 02:51:51.268202 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2142/4082] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:49 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1325 bytes in 2167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:51.291488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd20bb2d-f506-41d7-ac30-a5e7a0859386 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:51.292358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd20bb2d-f506-41d7-ac30-a5e7a0859386 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:51.476416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd20bb2d-f506-41d7-ac30-a5e7a0859386 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:51.564113 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd20bb2d-f506-41d7-ac30-a5e7a0859386 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1215 microversion: 2.1 time: 0.287859 Aug 27 02:51:51.574392 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2143/4083] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:51 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1215 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:51.652297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c559f4c9-d44d-400e-b306-faa1cce90a8d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:51.660195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c559f4c9-d44d-400e-b306-faa1cce90a8d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:51.680192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c559f4c9-d44d-400e-b306-faa1cce90a8d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.684079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c559f4c9-d44d-400e-b306-faa1cce90a8d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.684815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c559f4c9-d44d-400e-b306-faa1cce90a8d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.689419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c559f4c9-d44d-400e-b306-faa1cce90a8d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:51.690337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c559f4c9-d44d-400e-b306-faa1cce90a8d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:51.705374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c559f4c9-d44d-400e-b306-faa1cce90a8d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:51.761136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-65962fca-07e9-4c82-a377-a7a4b40cebaa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:51.770065 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65962fca-07e9-4c82-a377-a7a4b40cebaa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1272 microversion: 2.1 time: 0.732673 Aug 27 02:51:51.770684 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1941/4084] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:51 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1272 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:52.046900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df10a966-aab4-497e-9883-025cd66734a1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:52.050333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-df10a966-aab4-497e-9883-025cd66734a1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:52.116419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df10a966-aab4-497e-9883-025cd66734a1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:52.119628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df10a966-aab4-497e-9883-025cd66734a1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:52.122352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df10a966-aab4-497e-9883-025cd66734a1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:52.126608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df10a966-aab4-497e-9883-025cd66734a1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:52.130742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df10a966-aab4-497e-9883-025cd66734a1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:52.132516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df10a966-aab4-497e-9883-025cd66734a1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:52.683695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-df10a966-aab4-497e-9883-025cd66734a1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:52.741034 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-df10a966-aab4-497e-9883-025cd66734a1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1723 microversion: 2.1 time: 0.700650 Aug 27 02:51:52.771717 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1942/4085] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:52 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1723 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:52.794745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb9ad75a-c494-4bce-befa-e40fc6a57fe7 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:52.796749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb9ad75a-c494-4bce-befa-e40fc6a57fe7 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:52.818646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb9ad75a-c494-4bce-befa-e40fc6a57fe7 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:52.819911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb9ad75a-c494-4bce-befa-e40fc6a57fe7 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:52.821286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb9ad75a-c494-4bce-befa-e40fc6a57fe7 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:52.823282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb9ad75a-c494-4bce-befa-e40fc6a57fe7 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:52.824751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb9ad75a-c494-4bce-befa-e40fc6a57fe7 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:52.826033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb9ad75a-c494-4bce-befa-e40fc6a57fe7 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:52.989052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c559f4c9-d44d-400e-b306-faa1cce90a8d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:53.013365 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c559f4c9-d44d-400e-b306-faa1cce90a8d tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 1.420058 Aug 27 02:51:53.019012 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2144/4086] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:51 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:53.086897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21a77cdc-d8ac-4325-b8e4-3079fa093bf1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:53.088235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21a77cdc-d8ac-4325-b8e4-3079fa093bf1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:53.135117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21a77cdc-d8ac-4325-b8e4-3079fa093bf1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:53.143074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21a77cdc-d8ac-4325-b8e4-3079fa093bf1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:53.144485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21a77cdc-d8ac-4325-b8e4-3079fa093bf1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:53.163270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21a77cdc-d8ac-4325-b8e4-3079fa093bf1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:53.175646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21a77cdc-d8ac-4325-b8e4-3079fa093bf1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:53.179486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21a77cdc-d8ac-4325-b8e4-3079fa093bf1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:53.409546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-21a77cdc-d8ac-4325-b8e4-3079fa093bf1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:53.425469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb9ad75a-c494-4bce-befa-e40fc6a57fe7 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:53.428408 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21a77cdc-d8ac-4325-b8e4-3079fa093bf1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1211 microversion: 2.1 time: 0.392332 Aug 27 02:51:53.433280 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2145/4087] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:53 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1211 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:53.457106 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb9ad75a-c494-4bce-befa-e40fc6a57fe7 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1325 microversion: 2.1 time: 0.683610 Aug 27 02:51:53.457849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37f6fc13-ee7f-456b-8f64-a8a9b1bc16b6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:53.462278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-37f6fc13-ee7f-456b-8f64-a8a9b1bc16b6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:53.485997 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1943/4088] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:52 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1325 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:53.502003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f6fc13-ee7f-456b-8f64-a8a9b1bc16b6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:53.502355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f6fc13-ee7f-456b-8f64-a8a9b1bc16b6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:53.518859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f6fc13-ee7f-456b-8f64-a8a9b1bc16b6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:53.525718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f6fc13-ee7f-456b-8f64-a8a9b1bc16b6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:53.529648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f6fc13-ee7f-456b-8f64-a8a9b1bc16b6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:53.530438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f6fc13-ee7f-456b-8f64-a8a9b1bc16b6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:53.805154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a5cb27cf-dbe6-4b11-84b2-c7775c5a9d4c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:53.811910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a5cb27cf-dbe6-4b11-84b2-c7775c5a9d4c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:53.862398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5cb27cf-dbe6-4b11-84b2-c7775c5a9d4c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:53.880516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5cb27cf-dbe6-4b11-84b2-c7775c5a9d4c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:53.894431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5cb27cf-dbe6-4b11-84b2-c7775c5a9d4c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:53.899378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5cb27cf-dbe6-4b11-84b2-c7775c5a9d4c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:53.900988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5cb27cf-dbe6-4b11-84b2-c7775c5a9d4c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:53.904920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5cb27cf-dbe6-4b11-84b2-c7775c5a9d4c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:54.014665 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 02:51:54.015503 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 02:51:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b (ip 10.222.0.99) !!! Aug 27 02:51:54.717474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a5cb27cf-dbe6-4b11-84b2-c7775c5a9d4c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:54.748480 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a5cb27cf-dbe6-4b11-84b2-c7775c5a9d4c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1700 microversion: 2.1 time: 0.950547 Aug 27 02:51:54.813997 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1944/4089] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:53 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1700 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:54.833309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-17522252-ce75-4ecf-85ff-b4384df880c9 req-6f216b18-9b1e-45f5-97e7-974772ba0225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852a6a23-6626-4b5a-9799-b0ef35be5250", "name": "network-vif-plugged", "status": "completed", "tag": "da94607a-76fc-4b60-acff-b9e7e61b23aa"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:54.856098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-17522252-ce75-4ecf-85ff-b4384df880c9 req-6f216b18-9b1e-45f5-97e7-974772ba0225 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:54.864183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-17522252-ce75-4ecf-85ff-b4384df880c9 req-6f216b18-9b1e-45f5-97e7-974772ba0225 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:54.866406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-17522252-ce75-4ecf-85ff-b4384df880c9 req-6f216b18-9b1e-45f5-97e7-974772ba0225 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:54.918938 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-17522252-ce75-4ecf-85ff-b4384df880c9 req-6f216b18-9b1e-45f5-97e7-974772ba0225 service nova] Creating event network-vif-plugged:da94607a-76fc-4b60-acff-b9e7e61b23aa for instance 852a6a23-6626-4b5a-9799-b0ef35be5250 on n-h1-852084-5 Aug 27 02:51:54.935446 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-17522252-ce75-4ecf-85ff-b4384df880c9 req-6f216b18-9b1e-45f5-97e7-974772ba0225 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118433 Aug 27 02:51:54.936667 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1945/4090] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:54.954819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7ecfd229-7c86-4292-bf06-c72c59bdbbb3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:54.958355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7ecfd229-7c86-4292-bf06-c72c59bdbbb3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:54.980027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ecfd229-7c86-4292-bf06-c72c59bdbbb3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:54.980900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ecfd229-7c86-4292-bf06-c72c59bdbbb3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:54.982535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ecfd229-7c86-4292-bf06-c72c59bdbbb3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:54.985109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ecfd229-7c86-4292-bf06-c72c59bdbbb3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:54.989937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ecfd229-7c86-4292-bf06-c72c59bdbbb3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:54.990619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ecfd229-7c86-4292-bf06-c72c59bdbbb3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:55.386319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-37f6fc13-ee7f-456b-8f64-a8a9b1bc16b6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:55.435864 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-37f6fc13-ee7f-456b-8f64-a8a9b1bc16b6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1314 microversion: 2.1 time: 2.000835 Aug 27 02:51:55.481137 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2146/4091] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:53 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1314 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:55.524785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3fc66c9e-31f3-4714-8a69-9884a78ff8ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:55.535997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3fc66c9e-31f3-4714-8a69-9884a78ff8ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:55.588957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fc66c9e-31f3-4714-8a69-9884a78ff8ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:55.590699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fc66c9e-31f3-4714-8a69-9884a78ff8ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:55.591483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fc66c9e-31f3-4714-8a69-9884a78ff8ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:55.593020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fc66c9e-31f3-4714-8a69-9884a78ff8ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:55.595522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fc66c9e-31f3-4714-8a69-9884a78ff8ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:55.596616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fc66c9e-31f3-4714-8a69-9884a78ff8ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:55.672626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7ecfd229-7c86-4292-bf06-c72c59bdbbb3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:55.690919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:55.716866 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7ecfd229-7c86-4292-bf06-c72c59bdbbb3 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 0.777534 Aug 27 02:51:55.717902 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1946/4092] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:54 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:55.766719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7928010-63ef-408c-9472-423412a04635 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:55.768047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7928010-63ef-408c-9472-423412a04635 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:55.780876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7928010-63ef-408c-9472-423412a04635 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:55.781782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7928010-63ef-408c-9472-423412a04635 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:55.782576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7928010-63ef-408c-9472-423412a04635 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:55.784017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7928010-63ef-408c-9472-423412a04635 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:55.784952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7928010-63ef-408c-9472-423412a04635 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:55.785737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7928010-63ef-408c-9472-423412a04635 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.209602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7928010-63ef-408c-9472-423412a04635 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:56.228257 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7928010-63ef-408c-9472-423412a04635 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1325 microversion: 2.1 time: 0.473415 Aug 27 02:51:56.238470 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1947/4093] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:55 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1325 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:56.263035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2303a716-5f8d-437a-970e-42260cc7002b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:56.283085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2303a716-5f8d-437a-970e-42260cc7002b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:56.284859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2303a716-5f8d-437a-970e-42260cc7002b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.285527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2303a716-5f8d-437a-970e-42260cc7002b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.337180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2303a716-5f8d-437a-970e-42260cc7002b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Going to try to start instance {{(pid=122487) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 02:51:56.391813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3fc66c9e-31f3-4714-8a69-9884a78ff8ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:56.430479 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3fc66c9e-31f3-4714-8a69-9884a78ff8ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1273 microversion: 2.1 time: 0.946817 Aug 27 02:51:56.436222 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2147/4094] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:55 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1273 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:56.479616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5a94c61-1da5-4e53-8b85-2757684355b8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:56.482532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e5a94c61-1da5-4e53-8b85-2757684355b8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:56.502237 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2303a716-5f8d-437a-970e-42260cc7002b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "POST /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/action" status: 202 len: 0 microversion: 2.1 time: 0.226846 Aug 27 02:51:56.508297 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1948/4095] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:51:56 2022] POST /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:51:56.528512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5a94c61-1da5-4e53-8b85-2757684355b8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:56.529487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5a94c61-1da5-4e53-8b85-2757684355b8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.532358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5a94c61-1da5-4e53-8b85-2757684355b8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.535012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6fdd8194-ee0b-4897-ae14-2e4cfaabeb59 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:56.539014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6fdd8194-ee0b-4897-ae14-2e4cfaabeb59 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:56.539536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5a94c61-1da5-4e53-8b85-2757684355b8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:56.540723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5a94c61-1da5-4e53-8b85-2757684355b8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.544037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5a94c61-1da5-4e53-8b85-2757684355b8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.591886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fdd8194-ee0b-4897-ae14-2e4cfaabeb59 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:56.592567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fdd8194-ee0b-4897-ae14-2e4cfaabeb59 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.594491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fdd8194-ee0b-4897-ae14-2e4cfaabeb59 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:56.594491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fdd8194-ee0b-4897-ae14-2e4cfaabeb59 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:56.594889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fdd8194-ee0b-4897-ae14-2e4cfaabeb59 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:56.596834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fdd8194-ee0b-4897-ae14-2e4cfaabeb59 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:57.169540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6fdd8194-ee0b-4897-ae14-2e4cfaabeb59 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:57.187219 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6fdd8194-ee0b-4897-ae14-2e4cfaabeb59 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1709 microversion: 2.1 time: 0.665869 Aug 27 02:51:57.193793 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1949/4096] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:56 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1709 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:57.207176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3d16b397-2255-4636-b090-427e1dca102a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:57.208366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3d16b397-2255-4636-b090-427e1dca102a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:57.223156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d16b397-2255-4636-b090-427e1dca102a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.224125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d16b397-2255-4636-b090-427e1dca102a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.224741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d16b397-2255-4636-b090-427e1dca102a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:57.225818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d16b397-2255-4636-b090-427e1dca102a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.227900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d16b397-2255-4636-b090-427e1dca102a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.231337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d16b397-2255-4636-b090-427e1dca102a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:57.727701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e5a94c61-1da5-4e53-8b85-2757684355b8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:57.781119 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e5a94c61-1da5-4e53-8b85-2757684355b8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1314 microversion: 2.1 time: 1.309251 Aug 27 02:51:57.781840 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2148/4097] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:56 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:51:57.809402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-97096f6e-34fa-4045-ac11-186d55fe2bd5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:57.811432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-97096f6e-34fa-4045-ac11-186d55fe2bd5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:57.830219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97096f6e-34fa-4045-ac11-186d55fe2bd5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.831014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97096f6e-34fa-4045-ac11-186d55fe2bd5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.831935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97096f6e-34fa-4045-ac11-186d55fe2bd5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:57.835228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97096f6e-34fa-4045-ac11-186d55fe2bd5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.838696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97096f6e-34fa-4045-ac11-186d55fe2bd5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.839463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97096f6e-34fa-4045-ac11-186d55fe2bd5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:57.907973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3d16b397-2255-4636-b090-427e1dca102a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:57.920935 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3d16b397-2255-4636-b090-427e1dca102a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 0.728375 Aug 27 02:51:57.921621 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1950/4098] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:57 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:57.936455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6d980d03-b86a-4ed0-9051-a0690b91e017 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:57.937014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6d980d03-b86a-4ed0-9051-a0690b91e017 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:57.964850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d980d03-b86a-4ed0-9051-a0690b91e017 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.965378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d980d03-b86a-4ed0-9051-a0690b91e017 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.965850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d980d03-b86a-4ed0-9051-a0690b91e017 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:57.966606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d980d03-b86a-4ed0-9051-a0690b91e017 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:57.967130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d980d03-b86a-4ed0-9051-a0690b91e017 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:57.967584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d980d03-b86a-4ed0-9051-a0690b91e017 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:58.100634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6d980d03-b86a-4ed0-9051-a0690b91e017 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:58.117096 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6d980d03-b86a-4ed0-9051-a0690b91e017 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1273 microversion: 2.1 time: 0.193508 Aug 27 02:51:58.118993 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1951/4099] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:57 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:58.131050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-a367893b-18bb-4687-8a14-5dd3197cc921 req-ecb61fb5-8a56-4620-a890-8f3893b6990b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f7ed66-f5a7-42ec-be91-bd5a08981d8f", "name": "network-vif-plugged", "status": "completed", "tag": "6c86ab3b-0086-4926-853f-bbbc6acba033"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:58.164117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a367893b-18bb-4687-8a14-5dd3197cc921 req-ecb61fb5-8a56-4620-a890-8f3893b6990b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:58.165005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a367893b-18bb-4687-8a14-5dd3197cc921 req-ecb61fb5-8a56-4620-a890-8f3893b6990b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:58.165697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a367893b-18bb-4687-8a14-5dd3197cc921 req-ecb61fb5-8a56-4620-a890-8f3893b6990b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:58.189577 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a367893b-18bb-4687-8a14-5dd3197cc921 req-ecb61fb5-8a56-4620-a890-8f3893b6990b service nova] Creating event network-vif-plugged:6c86ab3b-0086-4926-853f-bbbc6acba033 for instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f on n-h1-852084-5 Aug 27 02:51:58.196719 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-a367893b-18bb-4687-8a14-5dd3197cc921 req-ecb61fb5-8a56-4620-a890-8f3893b6990b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073343 Aug 27 02:51:58.206885 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1952/4100] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:58.226656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-830c1d39-e527-42ae-9c55-5e730e32373a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:58.230503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-830c1d39-e527-42ae-9c55-5e730e32373a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:58.257573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830c1d39-e527-42ae-9c55-5e730e32373a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:58.258408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830c1d39-e527-42ae-9c55-5e730e32373a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:58.259971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830c1d39-e527-42ae-9c55-5e730e32373a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:58.262459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830c1d39-e527-42ae-9c55-5e730e32373a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:58.263962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830c1d39-e527-42ae-9c55-5e730e32373a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:58.266998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830c1d39-e527-42ae-9c55-5e730e32373a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:58.780857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-830c1d39-e527-42ae-9c55-5e730e32373a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:58.800052 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-830c1d39-e527-42ae-9c55-5e730e32373a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1709 microversion: 2.1 time: 0.578310 Aug 27 02:51:58.817822 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1953/4101] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:58 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1709 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:58.834891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d7511244-0362-4053-b128-774b24233126 req-aa8fc8a1-bac9-4ac6-bba2-4b4bf562c06e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba293dd-7362-4f13-859b-609bfa1b540b", "tag": "838fc457-8fa1-4865-807d-3d531753aba0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:51:58.861260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d7511244-0362-4053-b128-774b24233126 req-aa8fc8a1-bac9-4ac6-bba2-4b4bf562c06e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:58.862003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d7511244-0362-4053-b128-774b24233126 req-aa8fc8a1-bac9-4ac6-bba2-4b4bf562c06e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:58.868081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d7511244-0362-4053-b128-774b24233126 req-aa8fc8a1-bac9-4ac6-bba2-4b4bf562c06e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:58.898815 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d7511244-0362-4053-b128-774b24233126 req-aa8fc8a1-bac9-4ac6-bba2-4b4bf562c06e service nova] Creating event network-changed:838fc457-8fa1-4865-807d-3d531753aba0 for instance eba293dd-7362-4f13-859b-609bfa1b540b on n-h2-852084-5 Aug 27 02:51:58.911193 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d7511244-0362-4053-b128-774b24233126 req-aa8fc8a1-bac9-4ac6-bba2-4b4bf562c06e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103101 Aug 27 02:51:58.913281 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1954/4102] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:51:58.925786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7410ea89-c21a-4282-a0ab-b3d693110dea tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:58.927564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7410ea89-c21a-4282-a0ab-b3d693110dea tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:58.946068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7410ea89-c21a-4282-a0ab-b3d693110dea tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:58.947364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7410ea89-c21a-4282-a0ab-b3d693110dea tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:58.949014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7410ea89-c21a-4282-a0ab-b3d693110dea tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:58.951581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7410ea89-c21a-4282-a0ab-b3d693110dea tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:58.952969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7410ea89-c21a-4282-a0ab-b3d693110dea tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:58.955275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7410ea89-c21a-4282-a0ab-b3d693110dea tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:59.209384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-97096f6e-34fa-4045-ac11-186d55fe2bd5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:51:59.220921 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-97096f6e-34fa-4045-ac11-186d55fe2bd5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1522 microversion: 2.1 time: 1.420328 Aug 27 02:51:59.231424 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2149/4103] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:57 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1522 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:51:59.246316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-216b139f-5d7e-4615-be1a-d8e661ff6f96 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:51:59.247681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-216b139f-5d7e-4615-be1a-d8e661ff6f96 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:51:59.262249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-216b139f-5d7e-4615-be1a-d8e661ff6f96 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:59.269869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-216b139f-5d7e-4615-be1a-d8e661ff6f96 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:59.271772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-216b139f-5d7e-4615-be1a-d8e661ff6f96 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:59.277258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-216b139f-5d7e-4615-be1a-d8e661ff6f96 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:51:59.278546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-216b139f-5d7e-4615-be1a-d8e661ff6f96 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:51:59.282284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-216b139f-5d7e-4615-be1a-d8e661ff6f96 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:51:59.680670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:59.740356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=12 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:51:59.991423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-216b139f-5d7e-4615-be1a-d8e661ff6f96 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:00.018190 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-216b139f-5d7e-4615-be1a-d8e661ff6f96 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 0.783157 Aug 27 02:52:00.024709 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2150/4104] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:59 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:00.037631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0ec309cd-e63e-4303-a5ab-410d999a02ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:00.049968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0ec309cd-e63e-4303-a5ab-410d999a02ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:00.073246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ec309cd-e63e-4303-a5ab-410d999a02ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:00.084298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ec309cd-e63e-4303-a5ab-410d999a02ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:00.087064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ec309cd-e63e-4303-a5ab-410d999a02ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:00.092099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ec309cd-e63e-4303-a5ab-410d999a02ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:00.094423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ec309cd-e63e-4303-a5ab-410d999a02ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:00.096534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ec309cd-e63e-4303-a5ab-410d999a02ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:00.629769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7410ea89-c21a-4282-a0ab-b3d693110dea tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:00.639559 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7410ea89-c21a-4282-a0ab-b3d693110dea tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1314 microversion: 2.1 time: 1.723908 Aug 27 02:52:00.650486 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1955/4105] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:51:58 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1314 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:00.665937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:00.666770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:00.668941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:00.699575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:00.700627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:00.708040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:00.709442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:00.712311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:00.713307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:00.976661 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] HTTP exception thrown: Action 999 not found Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Request method failure captured: Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250/os-instance-actions/999 HTTP/1.1 Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYanvGaBlk6v2kGAj7crrNWdLrVORici8wWaTK5RBK_sRjFW3cfz6vPBlc09LLohf1kLL76CAvKrmrZ6NUxclAZfq9vZ8VlF_RETJ-ar_9v5IOB32NBngFg43YK60IL82QBfjrK_m0YaZqLM5LLHWE_UWUI48tuqjMuvfSdJDevmfOM Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: ebc16871a14c441c9a565c1725041d42 Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-679580354 Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ebc16871a14c441c9a565c1725041d42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ebc16871a14c441c9a565c1725041d42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ebc16871a14c441c9a565c1725041d42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ebc16871a14c441c9a565c1725041d42"}]}] Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-679580354 Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: ebc16871a14c441c9a565c1725041d42 Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-679580354 Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-InstanceActionsNegativeTestJSON-679580354-project Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: fd4fedd5221d4f08b92f0f6722a655c3 Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-679580354-project Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: exception: Action 999 not found Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': '852a6a23-6626-4b5a-9799-b0ef35be5250', 'id': '999'} Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 27 02:52:01.000972 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.008570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Returning 404 to user: Action 999 not found {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:01.008570 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-77a671dc-00da-416a-89cb-1bdae982eaf5 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.351035 Aug 27 02:52:01.010861 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1956/4106] 10.222.0.99 () {58 vars in 1308 bytes} [Sat Aug 27 02:52:00 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250/os-instance-actions/999 => generated 66 bytes in 359 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:52:01.018640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7917bb96-eaf9-4e74-8978-2bc58cc3e0f7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:01.019646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7917bb96-eaf9-4e74-8978-2bc58cc3e0f7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:01.028252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7917bb96-eaf9-4e74-8978-2bc58cc3e0f7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.029387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7917bb96-eaf9-4e74-8978-2bc58cc3e0f7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.030069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7917bb96-eaf9-4e74-8978-2bc58cc3e0f7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.031537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7917bb96-eaf9-4e74-8978-2bc58cc3e0f7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.032227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7917bb96-eaf9-4e74-8978-2bc58cc3e0f7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.032970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7917bb96-eaf9-4e74-8978-2bc58cc3e0f7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.153438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0ec309cd-e63e-4303-a5ab-410d999a02ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:01.164334 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0ec309cd-e63e-4303-a5ab-410d999a02ab tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1315 microversion: 2.1 time: 1.137311 Aug 27 02:52:01.166404 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2151/4107] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:00 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1315 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:01.172937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e82e0d30-e527-462d-b1be-a4a7cae6b302 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '.version_select at 0x7f4d2a87e820>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:01.183948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e82e0d30-e527-462d-b1be-a4a7cae6b302 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: fc20ba86-5b22-4c46-9d12-b0f00ac019f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:01.208875 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-e82e0d30-e527-462d-b1be-a4a7cae6b302 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] HTTP exception thrown: Instance fc20ba86-5b22-4c46-9d12-b0f00ac019f3 could not be found. Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e82e0d30-e527-462d-b1be-a4a7cae6b302 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Request method failure captured: Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/fc20ba86-5b22-4c46-9d12-b0f00ac019f3/os-instance-actions HTTP/1.1 Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYanvGaBlk6v2kGAj7crrNWdLrVORici8wWaTK5RBK_sRjFW3cfz6vPBlc09LLohf1kLL76CAvKrmrZ6NUxclAZfq9vZ8VlF_RETJ-ar_9v5IOB32NBngFg43YK60IL82QBfjrK_m0YaZqLM5LLHWE_UWUI48tuqjMuvfSdJDevmfOM Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: ebc16871a14c441c9a565c1725041d42 Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-679580354 Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ebc16871a14c441c9a565c1725041d42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ebc16871a14c441c9a565c1725041d42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ebc16871a14c441c9a565c1725041d42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ebc16871a14c441c9a565c1725041d42"}]}] Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-679580354 Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: ebc16871a14c441c9a565c1725041d42 Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-679580354 Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-InstanceActionsNegativeTestJSON-679580354-project Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: fd4fedd5221d4f08b92f0f6722a655c3 Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-679580354-project Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance fc20ba86-5b22-4c46-9d12-b0f00ac019f3 could not be found. Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'server_id': 'fc20ba86-5b22-4c46-9d12-b0f00ac019f3'} Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc20ba86-5b22-4c46-9d12-b0f00ac019f3 could not be found. Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:01.211572 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc20ba86-5b22-4c46-9d12-b0f00ac019f3 could not be found. Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc20ba86-5b22-4c46-9d12-b0f00ac019f3 could not be found. Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e82e0d30-e527-462d-b1be-a4a7cae6b302 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Returning 404 to user: Instance fc20ba86-5b22-4c46-9d12-b0f00ac019f3 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e82e0d30-e527-462d-b1be-a4a7cae6b302 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/fc20ba86-5b22-4c46-9d12-b0f00ac019f3/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.044118 Aug 27 02:52:01.219383 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2152/4108] 10.222.0.99 () {58 vars in 1296 bytes} [Sat Aug 27 02:52:01 2022] GET /compute/v2.1/servers/fc20ba86-5b22-4c46-9d12-b0f00ac019f3/os-instance-actions => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:01.237080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-699a3516-0ff6-4621-9973-bae806123d04 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:01.245844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-699a3516-0ff6-4621-9973-bae806123d04 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:01.274751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-699a3516-0ff6-4621-9973-bae806123d04 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.278974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-699a3516-0ff6-4621-9973-bae806123d04 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.280892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-699a3516-0ff6-4621-9973-bae806123d04 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.290080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-699a3516-0ff6-4621-9973-bae806123d04 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.291492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-699a3516-0ff6-4621-9973-bae806123d04 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.293451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-699a3516-0ff6-4621-9973-bae806123d04 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.412924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7917bb96-eaf9-4e74-8978-2bc58cc3e0f7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:01.432193 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7917bb96-eaf9-4e74-8978-2bc58cc3e0f7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1713 microversion: 2.1 time: 0.415789 Aug 27 02:52:01.433262 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1957/4109] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:01 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1713 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:01.444915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-40030769-1693-4388-b9f3-864dc8471e3e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:01.445459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-40030769-1693-4388-b9f3-864dc8471e3e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:01.472725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40030769-1693-4388-b9f3-864dc8471e3e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.474334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40030769-1693-4388-b9f3-864dc8471e3e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.476552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40030769-1693-4388-b9f3-864dc8471e3e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.487464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40030769-1693-4388-b9f3-864dc8471e3e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.489340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40030769-1693-4388-b9f3-864dc8471e3e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.490171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40030769-1693-4388-b9f3-864dc8471e3e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.514448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:01.539094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:01.688638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-40030769-1693-4388-b9f3-864dc8471e3e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:01.739346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-699a3516-0ff6-4621-9973-bae806123d04 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:01.801550 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-699a3516-0ff6-4621-9973-bae806123d04 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 0.587112 Aug 27 02:52:01.822243 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2153/4110] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:01 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:01.845109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-68cd044e-1046-441b-8f3e-259d7d1c4161 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:01.867390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-68cd044e-1046-441b-8f3e-259d7d1c4161 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:01.923587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68cd044e-1046-441b-8f3e-259d7d1c4161 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.924603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68cd044e-1046-441b-8f3e-259d7d1c4161 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.925388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68cd044e-1046-441b-8f3e-259d7d1c4161 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:01.926711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68cd044e-1046-441b-8f3e-259d7d1c4161 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:01.933609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68cd044e-1046-441b-8f3e-259d7d1c4161 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:01.934673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68cd044e-1046-441b-8f3e-259d7d1c4161 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:02.283023 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-40030769-1693-4388-b9f3-864dc8471e3e tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "DELETE /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 204 len: 0 microversion: 2.1 time: 0.847697 Aug 27 02:52:02.285372 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1958/4111] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:01 2022] DELETE /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:52:02.300009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e03b831-456c-4874-b521-44aee3039815 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:02.301063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e03b831-456c-4874-b521-44aee3039815 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:02.320508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e03b831-456c-4874-b521-44aee3039815 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:02.323061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e03b831-456c-4874-b521-44aee3039815 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:02.325879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e03b831-456c-4874-b521-44aee3039815 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:02.326800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e03b831-456c-4874-b521-44aee3039815 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:02.330252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e03b831-456c-4874-b521-44aee3039815 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:02.330822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e03b831-456c-4874-b521-44aee3039815 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:02.647530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-68cd044e-1046-441b-8f3e-259d7d1c4161 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:02.675688 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-68cd044e-1046-441b-8f3e-259d7d1c4161 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1314 microversion: 2.1 time: 0.851338 Aug 27 02:52:02.677752 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2154/4112] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:01 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1314 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:02.699299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5a2f1830-17ab-4d38-903b-3475767f9070 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:02.700592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5a2f1830-17ab-4d38-903b-3475767f9070 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:02.716468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a2f1830-17ab-4d38-903b-3475767f9070 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:02.719155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a2f1830-17ab-4d38-903b-3475767f9070 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:02.724162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a2f1830-17ab-4d38-903b-3475767f9070 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:02.726707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a2f1830-17ab-4d38-903b-3475767f9070 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:02.728188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a2f1830-17ab-4d38-903b-3475767f9070 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:02.729510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a2f1830-17ab-4d38-903b-3475767f9070 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:02.911276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6e03b831-456c-4874-b521-44aee3039815 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:02.946605 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e03b831-456c-4874-b521-44aee3039815 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1315 microversion: 2.1 time: 0.653881 Aug 27 02:52:02.948309 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1959/4113] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:02 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:03.003491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a85bc336-b55e-4623-9153-7e74f0dec311 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:03.008066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a85bc336-b55e-4623-9153-7e74f0dec311 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:03.036309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a85bc336-b55e-4623-9153-7e74f0dec311 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.038394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a85bc336-b55e-4623-9153-7e74f0dec311 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.040516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a85bc336-b55e-4623-9153-7e74f0dec311 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.042908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a85bc336-b55e-4623-9153-7e74f0dec311 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.044836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a85bc336-b55e-4623-9153-7e74f0dec311 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.046504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a85bc336-b55e-4623-9153-7e74f0dec311 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.506036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a85bc336-b55e-4623-9153-7e74f0dec311 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:03.525333 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a85bc336-b55e-4623-9153-7e74f0dec311 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1517 microversion: 2.1 time: 0.573576 Aug 27 02:52:03.527580 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1960/4114] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:02 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1517 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:03.541167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e191f475-df35-4866-af76-209421d968d4 req-1c854498-f793-4604-a737-e11a0ed699df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7a96de-d7d1-42d0-a191-cbd4d7f257c1", "tag": "1207032e-9a66-4c7e-8dfd-67d9471d032b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:03.602804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e191f475-df35-4866-af76-209421d968d4 req-1c854498-f793-4604-a737-e11a0ed699df service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.611438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e191f475-df35-4866-af76-209421d968d4 req-1c854498-f793-4604-a737-e11a0ed699df service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.612819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e191f475-df35-4866-af76-209421d968d4 req-1c854498-f793-4604-a737-e11a0ed699df service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.676692 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e191f475-df35-4866-af76-209421d968d4 req-1c854498-f793-4604-a737-e11a0ed699df service nova] Creating event network-changed:1207032e-9a66-4c7e-8dfd-67d9471d032b for instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 on n-h1-852084-5 Aug 27 02:52:03.709132 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e191f475-df35-4866-af76-209421d968d4 req-1c854498-f793-4604-a737-e11a0ed699df service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164335 Aug 27 02:52:03.713605 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1961/4115] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:03.724993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a43fc44-53ac-4e94-8260-468f1b665711 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:03.726428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6a43fc44-53ac-4e94-8260-468f1b665711 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:03.739012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a43fc44-53ac-4e94-8260-468f1b665711 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.739937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a43fc44-53ac-4e94-8260-468f1b665711 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.742256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a43fc44-53ac-4e94-8260-468f1b665711 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:03.743565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a43fc44-53ac-4e94-8260-468f1b665711 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:03.744881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a43fc44-53ac-4e94-8260-468f1b665711 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:03.746935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a43fc44-53ac-4e94-8260-468f1b665711 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:04.103275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5a2f1830-17ab-4d38-903b-3475767f9070 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:04.112515 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5a2f1830-17ab-4d38-903b-3475767f9070 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1528 microversion: 2.1 time: 1.432793 Aug 27 02:52:04.113408 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2155/4116] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:02 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1528 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:04.126734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a43fc44-53ac-4e94-8260-468f1b665711 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:04.132349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a28013a3-d464-4f56-9ea1-219ab7b868de tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:04.133264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a28013a3-d464-4f56-9ea1-219ab7b868de tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:04.138418 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6a43fc44-53ac-4e94-8260-468f1b665711 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1314 microversion: 2.1 time: 0.422242 Aug 27 02:52:04.139077 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1962/4117] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:03 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:04.144064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a28013a3-d464-4f56-9ea1-219ab7b868de tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:04.144742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a28013a3-d464-4f56-9ea1-219ab7b868de tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:04.145405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a28013a3-d464-4f56-9ea1-219ab7b868de tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:04.146301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a28013a3-d464-4f56-9ea1-219ab7b868de tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:04.146758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a28013a3-d464-4f56-9ea1-219ab7b868de tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:04.147226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a28013a3-d464-4f56-9ea1-219ab7b868de tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:04.569287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4ffd4d69-c7b3-42b4-abbc-796c4a92ed76 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:04.570841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4ffd4d69-c7b3-42b4-abbc-796c4a92ed76 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:04.580754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ffd4d69-c7b3-42b4-abbc-796c4a92ed76 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:04.581538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ffd4d69-c7b3-42b4-abbc-796c4a92ed76 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:04.582228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ffd4d69-c7b3-42b4-abbc-796c4a92ed76 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:04.583208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ffd4d69-c7b3-42b4-abbc-796c4a92ed76 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:04.583991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ffd4d69-c7b3-42b4-abbc-796c4a92ed76 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:04.584932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ffd4d69-c7b3-42b4-abbc-796c4a92ed76 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:04.874293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4ffd4d69-c7b3-42b4-abbc-796c4a92ed76 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:04.883999 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4ffd4d69-c7b3-42b4-abbc-796c4a92ed76 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.318861 Aug 27 02:52:04.884966 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1963/4118] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:04 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:04.923784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1e3a149c-daf9-489f-9f6a-2cbde92a995f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:04.924936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1e3a149c-daf9-489f-9f6a-2cbde92a995f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:04.934347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e3a149c-daf9-489f-9f6a-2cbde92a995f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:04.935158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e3a149c-daf9-489f-9f6a-2cbde92a995f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:04.936063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e3a149c-daf9-489f-9f6a-2cbde92a995f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:04.937837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e3a149c-daf9-489f-9f6a-2cbde92a995f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:04.939126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e3a149c-daf9-489f-9f6a-2cbde92a995f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:04.940860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e3a149c-daf9-489f-9f6a-2cbde92a995f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.203409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a28013a3-d464-4f56-9ea1-219ab7b868de tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:05.207908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1e3a149c-daf9-489f-9f6a-2cbde92a995f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:05.226113 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1e3a149c-daf9-489f-9f6a-2cbde92a995f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.307386 Aug 27 02:52:05.228857 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a28013a3-d464-4f56-9ea1-219ab7b868de tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1315 microversion: 2.1 time: 1.100187 Aug 27 02:52:05.230282 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2156/4119] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:04 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1315 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:05.238376 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1964/4120] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:04 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:05.240487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6450995c-758c-4e22-99ca-cd24c6856036 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:05.242455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6450995c-758c-4e22-99ca-cd24c6856036 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:05.251338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cb62bba9-6e25-48ac-a777-e7f623f804d8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:05.252096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cb62bba9-6e25-48ac-a777-e7f623f804d8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:05.260772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6450995c-758c-4e22-99ca-cd24c6856036 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.270995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6450995c-758c-4e22-99ca-cd24c6856036 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.273285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6450995c-758c-4e22-99ca-cd24c6856036 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.275909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6450995c-758c-4e22-99ca-cd24c6856036 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.277057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6450995c-758c-4e22-99ca-cd24c6856036 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.278494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6450995c-758c-4e22-99ca-cd24c6856036 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.283133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb62bba9-6e25-48ac-a777-e7f623f804d8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.284904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb62bba9-6e25-48ac-a777-e7f623f804d8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.295667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb62bba9-6e25-48ac-a777-e7f623f804d8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.298019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb62bba9-6e25-48ac-a777-e7f623f804d8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.298696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb62bba9-6e25-48ac-a777-e7f623f804d8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.299144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb62bba9-6e25-48ac-a777-e7f623f804d8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.667733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb62bba9-6e25-48ac-a777-e7f623f804d8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:05.690890 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cb62bba9-6e25-48ac-a777-e7f623f804d8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1314 microversion: 2.1 time: 0.449329 Aug 27 02:52:05.706534 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1965/4121] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:05 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:05.731570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1c3277a9-460a-4235-857b-e79041c61f42 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:05.733828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1c3277a9-460a-4235-857b-e79041c61f42 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:05.747482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c3277a9-460a-4235-857b-e79041c61f42 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.748526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c3277a9-460a-4235-857b-e79041c61f42 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.749464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c3277a9-460a-4235-857b-e79041c61f42 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:05.750824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c3277a9-460a-4235-857b-e79041c61f42 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:05.752223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c3277a9-460a-4235-857b-e79041c61f42 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:05.753702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c3277a9-460a-4235-857b-e79041c61f42 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.013813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6450995c-758c-4e22-99ca-cd24c6856036 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:06.041334 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6450995c-758c-4e22-99ca-cd24c6856036 tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1528 microversion: 2.1 time: 0.809409 Aug 27 02:52:06.047350 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2157/4122] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:05 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1528 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:06.144649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-3c4512d4-8453-42ac-bef6-535a65fd64c6 req-78fcc994-6198-45b9-a22d-63033549d921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852a6a23-6626-4b5a-9799-b0ef35be5250", "name": "network-vif-deleted", "tag": "da94607a-76fc-4b60-acff-b9e7e61b23aa"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:06.201749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c4512d4-8453-42ac-bef6-535a65fd64c6 req-78fcc994-6198-45b9-a22d-63033549d921 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:06.207831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c4512d4-8453-42ac-bef6-535a65fd64c6 req-78fcc994-6198-45b9-a22d-63033549d921 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:06.210525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c4512d4-8453-42ac-bef6-535a65fd64c6 req-78fcc994-6198-45b9-a22d-63033549d921 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.232250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1c3277a9-460a-4235-857b-e79041c61f42 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:06.262636 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1c3277a9-460a-4235-857b-e79041c61f42 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.554076 Aug 27 02:52:06.268341 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1966/4123] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:05 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:06.278948 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-3c4512d4-8453-42ac-bef6-535a65fd64c6 req-78fcc994-6198-45b9-a22d-63033549d921 service nova] Creating event network-vif-deleted:da94607a-76fc-4b60-acff-b9e7e61b23aa for instance 852a6a23-6626-4b5a-9799-b0ef35be5250 on n-h1-852084-5 Aug 27 02:52:06.293124 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-3c4512d4-8453-42ac-bef6-535a65fd64c6 req-78fcc994-6198-45b9-a22d-63033549d921 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153342 Aug 27 02:52:06.301457 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2158/4124] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:06.307590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ef40d02-03c9-4f17-83eb-24ff65ee808c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:06.309634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ef40d02-03c9-4f17-83eb-24ff65ee808c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:06.322197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef40d02-03c9-4f17-83eb-24ff65ee808c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:06.323581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef40d02-03c9-4f17-83eb-24ff65ee808c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:06.324573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef40d02-03c9-4f17-83eb-24ff65ee808c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.325532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-88bc83d7-7ef5-40a9-a9ce-231338444b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:06.326642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef40d02-03c9-4f17-83eb-24ff65ee808c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:06.328321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef40d02-03c9-4f17-83eb-24ff65ee808c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:06.329315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef40d02-03c9-4f17-83eb-24ff65ee808c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.374441 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-88bc83d7-7ef5-40a9-a9ce-231338444b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance e7c2122c-b1cd-4e4f-8765-5bd5cd27cae3 has no mapping to a cell. Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-88bc83d7-7ef5-40a9-a9ce-231338444b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/e7c2122c-b1cd-4e4f-8765-5bd5cd27cae3/action HTTP/1.1 Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 15 Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: {"os-stop": {}} Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance e7c2122c-b1cd-4e4f-8765-5bd5cd27cae3 has no mapping to a cell. Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'e7c2122c-b1cd-4e4f-8765-5bd5cd27cae3', 'body': {'os-stop': {}}} Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance e7c2122c-b1cd-4e4f-8765-5bd5cd27cae3 has no mapping to a cell. Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:06.394673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c2122c-b1cd-4e4f-8765-5bd5cd27cae3 has no mapping to a cell. Aug 27 02:52:06.402021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:06.402021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:06.402021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:06.402021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:06.402021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:06.402021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:06.402021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:06.402021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:06.402021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c2122c-b1cd-4e4f-8765-5bd5cd27cae3 has no mapping to a cell. Aug 27 02:52:06.402021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:06.406999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-88bc83d7-7ef5-40a9-a9ce-231338444b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance e7c2122c-b1cd-4e4f-8765-5bd5cd27cae3 has no mapping to a cell. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:06.412426 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-88bc83d7-7ef5-40a9-a9ce-231338444b22 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/e7c2122c-b1cd-4e4f-8765-5bd5cd27cae3/action" status: 404 len: 117 microversion: 2.1 time: 0.109099 Aug 27 02:52:06.419152 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2159/4125] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:06 2022] POST /compute/v2.1/servers/e7c2122c-b1cd-4e4f-8765-5bd5cd27cae3/action => generated 117 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:06.437008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-83eec158-f2b0-4d98-82b4-5be8498a3920 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:06.449547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-83eec158-f2b0-4d98-82b4-5be8498a3920 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:06.460924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=54 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:06.470358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83eec158-f2b0-4d98-82b4-5be8498a3920 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:06.475413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83eec158-f2b0-4d98-82b4-5be8498a3920 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:06.477534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83eec158-f2b0-4d98-82b4-5be8498a3920 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.478634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83eec158-f2b0-4d98-82b4-5be8498a3920 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:06.482435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83eec158-f2b0-4d98-82b4-5be8498a3920 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:06.483513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83eec158-f2b0-4d98-82b4-5be8498a3920 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.836901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-83eec158-f2b0-4d98-82b4-5be8498a3920 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:06.851335 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-83eec158-f2b0-4d98-82b4-5be8498a3920 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.426961 Aug 27 02:52:06.852891 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2160/4126] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:06 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:06.879349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e1ac9636-2d7d-4c57-84c3-cc4517bac5fa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:06.880623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e1ac9636-2d7d-4c57-84c3-cc4517bac5fa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:06.897329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1ac9636-2d7d-4c57-84c3-cc4517bac5fa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:06.898518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1ac9636-2d7d-4c57-84c3-cc4517bac5fa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:06.899236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ef40d02-03c9-4f17-83eb-24ff65ee808c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:06.900361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1ac9636-2d7d-4c57-84c3-cc4517bac5fa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.902016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1ac9636-2d7d-4c57-84c3-cc4517bac5fa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:06.903099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1ac9636-2d7d-4c57-84c3-cc4517bac5fa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:06.904106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1ac9636-2d7d-4c57-84c3-cc4517bac5fa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.924695 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ef40d02-03c9-4f17-83eb-24ff65ee808c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1315 microversion: 2.1 time: 0.636013 Aug 27 02:52:06.942925 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1967/4127] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:06 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1315 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:06.967916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-26154874-e570-4054-93dd-90eda3505dbd tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:06.969154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26154874-e570-4054-93dd-90eda3505dbd tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:06.987128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26154874-e570-4054-93dd-90eda3505dbd tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:06.989751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26154874-e570-4054-93dd-90eda3505dbd tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:06.991765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26154874-e570-4054-93dd-90eda3505dbd tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:06.992814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26154874-e570-4054-93dd-90eda3505dbd tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:06.993477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26154874-e570-4054-93dd-90eda3505dbd tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:06.994224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26154874-e570-4054-93dd-90eda3505dbd tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.225246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e1ac9636-2d7d-4c57-84c3-cc4517bac5fa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:07.239240 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e1ac9636-2d7d-4c57-84c3-cc4517bac5fa tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1314 microversion: 2.1 time: 0.384576 Aug 27 02:52:07.240480 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2161/4128] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:06 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:07.246480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:07.248340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:07.257141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.257939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.262795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.264008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.265172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.266627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.339629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.340391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.341026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.341659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lazy-loading 'fault' on Instance uuid 852a6a23-6626-4b5a-9799-b0ef35be5250 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:52:07.432912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4fedd5221d4f08b92f0f6722a655c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc16871a14c441c9a565c1725041d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:07.472566 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61ba0c37-f537-4e03-a5a5-35371ebeb18d tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 200 len: 1315 microversion: 2.1 time: 0.230451 Aug 27 02:52:07.473616 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2162/4129] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:07 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:07.691778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-26154874-e570-4054-93dd-90eda3505dbd tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:07.708509 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-26154874-e570-4054-93dd-90eda3505dbd tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.762019 Aug 27 02:52:07.714637 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1968/4130] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:06 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:07.764194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9fb33d63-88f2-465a-b9ca-8172d2750d17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:07.766344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9fb33d63-88f2-465a-b9ca-8172d2750d17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 2c7a607b-76d8-4da5-9994-4aab7ad5fc7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:07.780576 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9fb33d63-88f2-465a-b9ca-8172d2750d17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance 2c7a607b-76d8-4da5-9994-4aab7ad5fc7c could not be found. Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9fb33d63-88f2-465a-b9ca-8172d2750d17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/2c7a607b-76d8-4da5-9994-4aab7ad5fc7c/action HTTP/1.1 Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 15 Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: {"suspend": {}} Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 2c7a607b-76d8-4da5-9994-4aab7ad5fc7c could not be found. Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '2c7a607b-76d8-4da5-9994-4aab7ad5fc7c', 'body': {'suspend': {}}} Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7a607b-76d8-4da5-9994-4aab7ad5fc7c could not be found. Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7a607b-76d8-4da5-9994-4aab7ad5fc7c could not be found. Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:07.789962 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:07.793662 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:07.793662 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:07.793662 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7a607b-76d8-4da5-9994-4aab7ad5fc7c could not be found. Aug 27 02:52:07.793662 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:07.793662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9fb33d63-88f2-465a-b9ca-8172d2750d17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance 2c7a607b-76d8-4da5-9994-4aab7ad5fc7c could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:07.794522 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9fb33d63-88f2-465a-b9ca-8172d2750d17 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/2c7a607b-76d8-4da5-9994-4aab7ad5fc7c/action" status: 404 len: 111 microversion: 2.1 time: 0.035523 Aug 27 02:52:07.797146 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2163/4131] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:07 2022] POST /compute/v2.1/servers/2c7a607b-76d8-4da5-9994-4aab7ad5fc7c/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:07.807645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7072c205-44ae-445b-8c69-383f51ef2548 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:07.808676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7072c205-44ae-445b-8c69-383f51ef2548 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:07.841542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7072c205-44ae-445b-8c69-383f51ef2548 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.850486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7072c205-44ae-445b-8c69-383f51ef2548 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.851426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7072c205-44ae-445b-8c69-383f51ef2548 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.853048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7072c205-44ae-445b-8c69-383f51ef2548 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.855277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7072c205-44ae-445b-8c69-383f51ef2548 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.856734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7072c205-44ae-445b-8c69-383f51ef2548 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.953686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0142e8a1-25eb-415d-9c6b-cfeae5379bfc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:07.955105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0142e8a1-25eb-415d-9c6b-cfeae5379bfc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:07.976145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0142e8a1-25eb-415d-9c6b-cfeae5379bfc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.980095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0142e8a1-25eb-415d-9c6b-cfeae5379bfc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.980920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0142e8a1-25eb-415d-9c6b-cfeae5379bfc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:07.985743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0142e8a1-25eb-415d-9c6b-cfeae5379bfc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:07.986666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0142e8a1-25eb-415d-9c6b-cfeae5379bfc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:07.987644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0142e8a1-25eb-415d-9c6b-cfeae5379bfc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:08.226640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0142e8a1-25eb-415d-9c6b-cfeae5379bfc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:08.243917 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0142e8a1-25eb-415d-9c6b-cfeae5379bfc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1315 microversion: 2.1 time: 0.294281 Aug 27 02:52:08.244707 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2164/4132] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:07 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:08.252355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a299f2ef-4fd2-4649-a952-c16f0fd37234 req-49cd0228-288c-46ae-aca4-eb7dce8c1b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba293dd-7362-4f13-859b-609bfa1b540b", "name": "network-vif-plugged", "status": "completed", "tag": "838fc457-8fa1-4865-807d-3d531753aba0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:08.287627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a299f2ef-4fd2-4649-a952-c16f0fd37234 req-49cd0228-288c-46ae-aca4-eb7dce8c1b25 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:08.288134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a299f2ef-4fd2-4649-a952-c16f0fd37234 req-49cd0228-288c-46ae-aca4-eb7dce8c1b25 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:08.288575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a299f2ef-4fd2-4649-a952-c16f0fd37234 req-49cd0228-288c-46ae-aca4-eb7dce8c1b25 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:08.319699 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a299f2ef-4fd2-4649-a952-c16f0fd37234 req-49cd0228-288c-46ae-aca4-eb7dce8c1b25 service nova] Creating event network-vif-plugged:838fc457-8fa1-4865-807d-3d531753aba0 for instance eba293dd-7362-4f13-859b-609bfa1b540b on n-h2-852084-5 Aug 27 02:52:08.330328 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a299f2ef-4fd2-4649-a952-c16f0fd37234 req-49cd0228-288c-46ae-aca4-eb7dce8c1b25 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081068 Aug 27 02:52:08.331011 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2165/4133] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:08.343969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f841e45-3e46-40f4-8ab7-0bffc3929c14 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:08.349454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9f841e45-3e46-40f4-8ab7-0bffc3929c14 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:08.363602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f841e45-3e46-40f4-8ab7-0bffc3929c14 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:08.365017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f841e45-3e46-40f4-8ab7-0bffc3929c14 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:08.365907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f841e45-3e46-40f4-8ab7-0bffc3929c14 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:08.366833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f841e45-3e46-40f4-8ab7-0bffc3929c14 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:08.367499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f841e45-3e46-40f4-8ab7-0bffc3929c14 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:08.368093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f841e45-3e46-40f4-8ab7-0bffc3929c14 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:08.735542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9f841e45-3e46-40f4-8ab7-0bffc3929c14 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:08.758215 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9f841e45-3e46-40f4-8ab7-0bffc3929c14 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1314 microversion: 2.1 time: 0.425225 Aug 27 02:52:08.759183 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2166/4134] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:08 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:08.769090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:08.770396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] [instance: 852a6a23-6626-4b5a-9799-b0ef35be5250] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:08.782401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:08.783335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:08.784151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:08.785513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:08.786520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:08.787172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:08.818006 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] HTTP exception thrown: Instance 852a6a23-6626-4b5a-9799-b0ef35be5250 could not be found. Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Request method failure captured: Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 HTTP/1.1 Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYanvGaBlk6v2kGAj7crrNWdLrVORici8wWaTK5RBK_sRjFW3cfz6vPBlc09LLohf1kLL76CAvKrmrZ6NUxclAZfq9vZ8VlF_RETJ-ar_9v5IOB32NBngFg43YK60IL82QBfjrK_m0YaZqLM5LLHWE_UWUI48tuqjMuvfSdJDevmfOM Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: ebc16871a14c441c9a565c1725041d42 Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-679580354 Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ebc16871a14c441c9a565c1725041d42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ebc16871a14c441c9a565c1725041d42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ebc16871a14c441c9a565c1725041d42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ebc16871a14c441c9a565c1725041d42"}]}] Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-679580354 Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: ebc16871a14c441c9a565c1725041d42 Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-679580354 Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-InstanceActionsNegativeTestJSON-679580354-project Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: fd4fedd5221d4f08b92f0f6722a655c3 Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-679580354-project Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 852a6a23-6626-4b5a-9799-b0ef35be5250 could not be found. Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '852a6a23-6626-4b5a-9799-b0ef35be5250'} Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852a6a23-6626-4b5a-9799-b0ef35be5250 could not be found. Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852a6a23-6626-4b5a-9799-b0ef35be5250 could not be found. Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:08.821480 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:08.831169 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:08.831169 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:08.831169 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:08.831169 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:08.831169 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:08.831169 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:08.831169 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852a6a23-6626-4b5a-9799-b0ef35be5250 could not be found. Aug 27 02:52:08.831169 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:08.831169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] Returning 404 to user: Instance 852a6a23-6626-4b5a-9799-b0ef35be5250 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:08.831169 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f0b11f67-f157-4099-9f07-b681b8b52f9f tempest-InstanceActionsNegativeTestJSON-679580354 tempest-InstanceActionsNegativeTestJSON-679580354-project] 10.222.0.99 "GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250" status: 404 len: 111 microversion: 2.1 time: 0.063441 Aug 27 02:52:08.831169 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2167/4135] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:08 2022] GET /compute/v2.1/servers/852a6a23-6626-4b5a-9799-b0ef35be5250 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:09.206856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7072c205-44ae-445b-8c69-383f51ef2548 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:09.238150 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7072c205-44ae-445b-8c69-383f51ef2548 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.435289 Aug 27 02:52:09.243728 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1969/4136] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:07 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:09.283358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea99c0fe-8faf-4ce5-84b5-7219512efebf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:09.284273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ea99c0fe-8faf-4ce5-84b5-7219512efebf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:09.286924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dc3fde5d-b1d5-4650-b766-a433060ed2d4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:09.292754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dc3fde5d-b1d5-4650-b766-a433060ed2d4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:09.294867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea99c0fe-8faf-4ce5-84b5-7219512efebf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.299316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea99c0fe-8faf-4ce5-84b5-7219512efebf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.300838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea99c0fe-8faf-4ce5-84b5-7219512efebf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:09.301632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea99c0fe-8faf-4ce5-84b5-7219512efebf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.302152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea99c0fe-8faf-4ce5-84b5-7219512efebf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.302596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea99c0fe-8faf-4ce5-84b5-7219512efebf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:09.327922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc3fde5d-b1d5-4650-b766-a433060ed2d4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.330531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc3fde5d-b1d5-4650-b766-a433060ed2d4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.332788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc3fde5d-b1d5-4650-b766-a433060ed2d4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:09.336768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc3fde5d-b1d5-4650-b766-a433060ed2d4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.337316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc3fde5d-b1d5-4650-b766-a433060ed2d4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.337775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc3fde5d-b1d5-4650-b766-a433060ed2d4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:09.724708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dc3fde5d-b1d5-4650-b766-a433060ed2d4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:09.728556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:09.745929 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dc3fde5d-b1d5-4650-b766-a433060ed2d4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1315 microversion: 2.1 time: 0.467362 Aug 27 02:52:09.761331 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2168/4137] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:09 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:09.803739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be622011-dcd5-4907-8b6f-512a0d3a2f06 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:09.804389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-be622011-dcd5-4907-8b6f-512a0d3a2f06 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:09.831924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be622011-dcd5-4907-8b6f-512a0d3a2f06 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.837842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be622011-dcd5-4907-8b6f-512a0d3a2f06 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.839243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be622011-dcd5-4907-8b6f-512a0d3a2f06 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:09.841865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be622011-dcd5-4907-8b6f-512a0d3a2f06 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:09.845785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be622011-dcd5-4907-8b6f-512a0d3a2f06 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:09.846358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be622011-dcd5-4907-8b6f-512a0d3a2f06 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:10.057935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ea99c0fe-8faf-4ce5-84b5-7219512efebf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:10.095297 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ea99c0fe-8faf-4ce5-84b5-7219512efebf tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.815255 Aug 27 02:52:10.096395 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1970/4138] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:09 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:10.136153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2938b3ac-7a46-4a57-bbb8-57b0fad077b1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:10.138755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2938b3ac-7a46-4a57-bbb8-57b0fad077b1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:10.150640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2938b3ac-7a46-4a57-bbb8-57b0fad077b1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:10.151740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2938b3ac-7a46-4a57-bbb8-57b0fad077b1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:10.152726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2938b3ac-7a46-4a57-bbb8-57b0fad077b1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:10.154282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2938b3ac-7a46-4a57-bbb8-57b0fad077b1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:10.155432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2938b3ac-7a46-4a57-bbb8-57b0fad077b1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:10.156499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2938b3ac-7a46-4a57-bbb8-57b0fad077b1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:10.239664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-2938b3ac-7a46-4a57-bbb8-57b0fad077b1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lazy-loading 'flavor' on Instance uuid 58f7ed66-f5a7-42ec-be91-bd5a08981d8f {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:52:10.370364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be622011-dcd5-4907-8b6f-512a0d3a2f06 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:10.401033 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-be622011-dcd5-4907-8b6f-512a0d3a2f06 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1314 microversion: 2.1 time: 0.612249 Aug 27 02:52:10.418868 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2169/4139] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:09 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:10.438676 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2938b3ac-7a46-4a57-bbb8-57b0fad077b1 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 202 len: 0 microversion: 2.1 time: 0.309250 Aug 27 02:52:10.444253 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1971/4140] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:10 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:52:10.454818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0183c17b-1c3f-41dc-a15c-dcef99f2dfa0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:10.455596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0183c17b-1c3f-41dc-a15c-dcef99f2dfa0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:10.457095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2537b209-2e1c-424e-86c0-04ff6d1d3730 req-ccdeee25-6c77-4a12-b970-542c89bc0abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7a96de-d7d1-42d0-a191-cbd4d7f257c1", "name": "network-vif-plugged", "status": "completed", "tag": "1207032e-9a66-4c7e-8dfd-67d9471d032b"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:10.477099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0183c17b-1c3f-41dc-a15c-dcef99f2dfa0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:10.478506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0183c17b-1c3f-41dc-a15c-dcef99f2dfa0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:10.478506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0183c17b-1c3f-41dc-a15c-dcef99f2dfa0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:10.479460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0183c17b-1c3f-41dc-a15c-dcef99f2dfa0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:10.480015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0183c17b-1c3f-41dc-a15c-dcef99f2dfa0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:10.480602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0183c17b-1c3f-41dc-a15c-dcef99f2dfa0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:10.485202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:10.502740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2537b209-2e1c-424e-86c0-04ff6d1d3730 req-ccdeee25-6c77-4a12-b970-542c89bc0abc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:10.504218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2537b209-2e1c-424e-86c0-04ff6d1d3730 req-ccdeee25-6c77-4a12-b970-542c89bc0abc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:10.505385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2537b209-2e1c-424e-86c0-04ff6d1d3730 req-ccdeee25-6c77-4a12-b970-542c89bc0abc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:10.545590 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2537b209-2e1c-424e-86c0-04ff6d1d3730 req-ccdeee25-6c77-4a12-b970-542c89bc0abc service nova] Creating event network-vif-plugged:1207032e-9a66-4c7e-8dfd-67d9471d032b for instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 on n-h1-852084-5 Aug 27 02:52:10.552703 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2537b209-2e1c-424e-86c0-04ff6d1d3730 req-ccdeee25-6c77-4a12-b970-542c89bc0abc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131815 Aug 27 02:52:10.553450 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2170/4141] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:10.783055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd7bc096-072c-42cf-b185-701d3ec3933f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:10.784358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd7bc096-072c-42cf-b185-701d3ec3933f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:10.797495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd7bc096-072c-42cf-b185-701d3ec3933f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:10.800976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd7bc096-072c-42cf-b185-701d3ec3933f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:10.802705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd7bc096-072c-42cf-b185-701d3ec3933f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:10.805601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd7bc096-072c-42cf-b185-701d3ec3933f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:10.807652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd7bc096-072c-42cf-b185-701d3ec3933f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:10.808599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd7bc096-072c-42cf-b185-701d3ec3933f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:11.329408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0183c17b-1c3f-41dc-a15c-dcef99f2dfa0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:11.350028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd7bc096-072c-42cf-b185-701d3ec3933f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:11.351782 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0183c17b-1c3f-41dc-a15c-dcef99f2dfa0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1512 microversion: 2.1 time: 0.896527 Aug 27 02:52:11.352739 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1972/4142] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:10 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1512 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:11.396093 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd7bc096-072c-42cf-b185-701d3ec3933f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1315 microversion: 2.1 time: 0.616348 Aug 27 02:52:11.423890 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2171/4143] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:10 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:11.469213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a71f305e-f93b-4590-9cf3-49955a7c2093 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:11.470045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a71f305e-f93b-4590-9cf3-49955a7c2093 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:11.476973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71f305e-f93b-4590-9cf3-49955a7c2093 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:11.477475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71f305e-f93b-4590-9cf3-49955a7c2093 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:11.478078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71f305e-f93b-4590-9cf3-49955a7c2093 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:11.479024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71f305e-f93b-4590-9cf3-49955a7c2093 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:11.480034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71f305e-f93b-4590-9cf3-49955a7c2093 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:11.480638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71f305e-f93b-4590-9cf3-49955a7c2093 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:11.946963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a71f305e-f93b-4590-9cf3-49955a7c2093 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:11.966616 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a71f305e-f93b-4590-9cf3-49955a7c2093 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1500 microversion: 2.1 time: 0.515933 Aug 27 02:52:11.968695 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1973/4144] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:11 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1500 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:11.994361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7abca049-1286-4d08-a548-60a50f20cb2e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:11.997157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7abca049-1286-4d08-a548-60a50f20cb2e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:12.007741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7abca049-1286-4d08-a548-60a50f20cb2e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:12.008256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7abca049-1286-4d08-a548-60a50f20cb2e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:12.008705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7abca049-1286-4d08-a548-60a50f20cb2e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:12.010098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7abca049-1286-4d08-a548-60a50f20cb2e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:12.010620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7abca049-1286-4d08-a548-60a50f20cb2e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:12.011063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7abca049-1286-4d08-a548-60a50f20cb2e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:12.049568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-7abca049-1286-4d08-a548-60a50f20cb2e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lazy-loading 'flavor' on Instance uuid eba293dd-7362-4f13-859b-609bfa1b540b {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:52:12.229430 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7abca049-1286-4d08-a548-60a50f20cb2e tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "POST /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b/action" status: 200 len: 32 microversion: 2.1 time: 0.241373 Aug 27 02:52:12.264597 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2172/4145] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:11 2022] POST /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b/action => generated 32 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:52:12.265662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-60167c9d-1613-4c05-b30c-b5398b070a95 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:12.267938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-60167c9d-1613-4c05-b30c-b5398b070a95 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:12.282418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60167c9d-1613-4c05-b30c-b5398b070a95 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:12.284069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60167c9d-1613-4c05-b30c-b5398b070a95 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:12.285388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60167c9d-1613-4c05-b30c-b5398b070a95 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:12.288813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60167c9d-1613-4c05-b30c-b5398b070a95 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:12.290123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60167c9d-1613-4c05-b30c-b5398b070a95 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:12.291275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60167c9d-1613-4c05-b30c-b5398b070a95 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:12.417992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6893e590-5162-4822-9d4b-2b5cb00e19b0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:12.420638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6893e590-5162-4822-9d4b-2b5cb00e19b0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:12.434717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6893e590-5162-4822-9d4b-2b5cb00e19b0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:12.436269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6893e590-5162-4822-9d4b-2b5cb00e19b0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:12.438069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6893e590-5162-4822-9d4b-2b5cb00e19b0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:12.439809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6893e590-5162-4822-9d4b-2b5cb00e19b0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:12.441063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6893e590-5162-4822-9d4b-2b5cb00e19b0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:12.442228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6893e590-5162-4822-9d4b-2b5cb00e19b0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:13.019203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6893e590-5162-4822-9d4b-2b5cb00e19b0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:13.034001 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6893e590-5162-4822-9d4b-2b5cb00e19b0 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1495 microversion: 2.1 time: 0.631411 Aug 27 02:52:13.040612 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2173/4146] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:12 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1495 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:13.054392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1bfd5ff9-e699-48d8-b308-979c9131d38a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:13.061227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1bfd5ff9-e699-48d8-b308-979c9131d38a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:13.082005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd5ff9-e699-48d8-b308-979c9131d38a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.086788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd5ff9-e699-48d8-b308-979c9131d38a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.089294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd5ff9-e699-48d8-b308-979c9131d38a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:13.093126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd5ff9-e699-48d8-b308-979c9131d38a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.098681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd5ff9-e699-48d8-b308-979c9131d38a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.099541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bfd5ff9-e699-48d8-b308-979c9131d38a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:13.301041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60167c9d-1613-4c05-b30c-b5398b070a95 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:13.339304 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-60167c9d-1613-4c05-b30c-b5398b070a95 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 1.085032 Aug 27 02:52:13.340651 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1974/4147] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:12 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:13.354708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:13.355608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:13.371340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.372132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.374063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:13.377509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.379390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.384580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:13.476123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lazy-loading 'flavor' on Instance uuid 58f7ed66-f5a7-42ec-be91-bd5a08981d8f {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:52:13.513613 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Cannot 'suspend' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state suspended Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action HTTP/1.1 Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 15 Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: {"suspend": {}} Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'suspend' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state suspended Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '58f7ed66-f5a7-42ec-be91-bd5a08981d8f', 'body': {'suspend': {}}} Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f in vm_state suspended. Cannot suspend while the instance is in this state. Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 27 02:52:13.519728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state suspended Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state suspended Aug 27 02:52:13.524229 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:13.528577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 409 to user: Cannot 'suspend' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state suspended {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:13.535813 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c5c3ef49-cb80-46b8-9453-d1df8a5e11a8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 409 len: 148 microversion: 2.1 time: 0.193673 Aug 27 02:52:13.537024 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1975/4148] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:13 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 148 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:52:13.548415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de7b9f30-7cc5-41ba-a455-253b84f18cc7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:13.549326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de7b9f30-7cc5-41ba-a455-253b84f18cc7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:13.563326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de7b9f30-7cc5-41ba-a455-253b84f18cc7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.564090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de7b9f30-7cc5-41ba-a455-253b84f18cc7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.566771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de7b9f30-7cc5-41ba-a455-253b84f18cc7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:13.569703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de7b9f30-7cc5-41ba-a455-253b84f18cc7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.570443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de7b9f30-7cc5-41ba-a455-253b84f18cc7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.571482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de7b9f30-7cc5-41ba-a455-253b84f18cc7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:13.713063 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de7b9f30-7cc5-41ba-a455-253b84f18cc7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 202 len: 0 microversion: 2.1 time: 0.169775 Aug 27 02:52:13.720325 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1976/4149] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:13 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:52:13.755557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9a88e4dc-ec25-410d-a625-90fc69c24162 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:13.757377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9a88e4dc-ec25-410d-a625-90fc69c24162 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:13.779575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9a88e4dc-ec25-410d-a625-90fc69c24162 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.781405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9a88e4dc-ec25-410d-a625-90fc69c24162 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.788859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9a88e4dc-ec25-410d-a625-90fc69c24162 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:13.790838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9a88e4dc-ec25-410d-a625-90fc69c24162 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:13.793995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9a88e4dc-ec25-410d-a625-90fc69c24162 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:13.807462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9a88e4dc-ec25-410d-a625-90fc69c24162 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:14.603611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1bfd5ff9-e699-48d8-b308-979c9131d38a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:14.641138 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1bfd5ff9-e699-48d8-b308-979c9131d38a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1500 microversion: 2.1 time: 1.594332 Aug 27 02:52:14.646171 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2174/4150] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:13 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1500 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:14.653370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-71edd6eb-44f3-44ed-b564-b1ac2a2695f3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:14.658267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-71edd6eb-44f3-44ed-b564-b1ac2a2695f3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:14.675442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71edd6eb-44f3-44ed-b564-b1ac2a2695f3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:14.676355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71edd6eb-44f3-44ed-b564-b1ac2a2695f3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:14.676978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71edd6eb-44f3-44ed-b564-b1ac2a2695f3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:14.678003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71edd6eb-44f3-44ed-b564-b1ac2a2695f3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:14.678633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71edd6eb-44f3-44ed-b564-b1ac2a2695f3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:14.679216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71edd6eb-44f3-44ed-b564-b1ac2a2695f3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:14.971922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9a88e4dc-ec25-410d-a625-90fc69c24162 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:14.987504 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9a88e4dc-ec25-410d-a625-90fc69c24162 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1501 microversion: 2.1 time: 1.259140 Aug 27 02:52:14.999227 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1977/4151] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:13 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1501 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:14.999227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04a07525-e202-4817-b92a-b44ebc2dbb4b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:14.999227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-04a07525-e202-4817-b92a-b44ebc2dbb4b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:15.017514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04a07525-e202-4817-b92a-b44ebc2dbb4b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:15.018051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04a07525-e202-4817-b92a-b44ebc2dbb4b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:15.018497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04a07525-e202-4817-b92a-b44ebc2dbb4b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:15.019224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04a07525-e202-4817-b92a-b44ebc2dbb4b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:15.019682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04a07525-e202-4817-b92a-b44ebc2dbb4b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:15.020110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04a07525-e202-4817-b92a-b44ebc2dbb4b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:15.085868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-04a07525-e202-4817-b92a-b44ebc2dbb4b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:15.304762 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-04a07525-e202-4817-b92a-b44ebc2dbb4b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 204 len: 0 microversion: 2.1 time: 0.309431 Aug 27 02:52:15.310709 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1978/4152] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:14 2022] DELETE /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:52:15.335123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c65c8ff1-7145-4967-bf3a-1fcb5352d67a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:15.341721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c65c8ff1-7145-4967-bf3a-1fcb5352d67a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:15.371564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65c8ff1-7145-4967-bf3a-1fcb5352d67a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:15.379361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65c8ff1-7145-4967-bf3a-1fcb5352d67a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:15.380207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65c8ff1-7145-4967-bf3a-1fcb5352d67a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:15.390947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65c8ff1-7145-4967-bf3a-1fcb5352d67a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:15.390947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65c8ff1-7145-4967-bf3a-1fcb5352d67a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:15.390947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65c8ff1-7145-4967-bf3a-1fcb5352d67a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:15.618877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-71edd6eb-44f3-44ed-b564-b1ac2a2695f3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:15.638964 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-71edd6eb-44f3-44ed-b564-b1ac2a2695f3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.989978 Aug 27 02:52:15.640892 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2175/4153] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:14 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:15.862736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c65c8ff1-7145-4967-bf3a-1fcb5352d67a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:15.875731 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c65c8ff1-7145-4967-bf3a-1fcb5352d67a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1506 microversion: 2.1 time: 0.559367 Aug 27 02:52:15.875731 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1979/4154] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:15 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1506 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:16.013623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f9040fc-5224-4883-b476-5e5bbf094911 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:16.013999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8f9040fc-5224-4883-b476-5e5bbf094911 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:16.030075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f9040fc-5224-4883-b476-5e5bbf094911 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:16.031837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f9040fc-5224-4883-b476-5e5bbf094911 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:16.032970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f9040fc-5224-4883-b476-5e5bbf094911 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:16.034794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f9040fc-5224-4883-b476-5e5bbf094911 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:16.037389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f9040fc-5224-4883-b476-5e5bbf094911 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:16.038418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f9040fc-5224-4883-b476-5e5bbf094911 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:16.677621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-af81dcf0-0d03-4a29-ac6e-8ece2c3a4c99 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:16.678970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-af81dcf0-0d03-4a29-ac6e-8ece2c3a4c99 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:16.695408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af81dcf0-0d03-4a29-ac6e-8ece2c3a4c99 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:16.712305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af81dcf0-0d03-4a29-ac6e-8ece2c3a4c99 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:16.713531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af81dcf0-0d03-4a29-ac6e-8ece2c3a4c99 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:16.715289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af81dcf0-0d03-4a29-ac6e-8ece2c3a4c99 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:16.716289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af81dcf0-0d03-4a29-ac6e-8ece2c3a4c99 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:16.717412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af81dcf0-0d03-4a29-ac6e-8ece2c3a4c99 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:16.876015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8f9040fc-5224-4883-b476-5e5bbf094911 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:16.894536 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f9040fc-5224-4883-b476-5e5bbf094911 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1501 microversion: 2.1 time: 0.885708 Aug 27 02:52:16.895155 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2176/4155] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:16 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1501 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:16.899975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-83660b0f-fe72-4a3b-a5ee-bdc114860bc2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:16.900610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-83660b0f-fe72-4a3b-a5ee-bdc114860bc2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:16.916985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83660b0f-fe72-4a3b-a5ee-bdc114860bc2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:16.929046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83660b0f-fe72-4a3b-a5ee-bdc114860bc2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:16.929624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83660b0f-fe72-4a3b-a5ee-bdc114860bc2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:16.930525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83660b0f-fe72-4a3b-a5ee-bdc114860bc2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:16.931030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83660b0f-fe72-4a3b-a5ee-bdc114860bc2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:16.931483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83660b0f-fe72-4a3b-a5ee-bdc114860bc2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:17.599929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-83660b0f-fe72-4a3b-a5ee-bdc114860bc2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:17.616543 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-83660b0f-fe72-4a3b-a5ee-bdc114860bc2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1506 microversion: 2.1 time: 0.720181 Aug 27 02:52:17.668220 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2177/4156] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:16 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1506 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:17.695436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-af81dcf0-0d03-4a29-ac6e-8ece2c3a4c99 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:17.723782 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-af81dcf0-0d03-4a29-ac6e-8ece2c3a4c99 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 1.048516 Aug 27 02:52:17.728364 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1980/4157] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:16 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:17.945244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f4f55477-842c-4c06-bc1b-d6b2970cd418 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:17.947044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f4f55477-842c-4c06-bc1b-d6b2970cd418 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:17.964587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f55477-842c-4c06-bc1b-d6b2970cd418 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:17.969375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f55477-842c-4c06-bc1b-d6b2970cd418 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:17.982181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f55477-842c-4c06-bc1b-d6b2970cd418 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:17.983145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f55477-842c-4c06-bc1b-d6b2970cd418 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:17.983688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f55477-842c-4c06-bc1b-d6b2970cd418 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:17.984170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4f55477-842c-4c06-bc1b-d6b2970cd418 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:18.675224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04ad3463-ce93-463b-b6fd-f77602e6e4f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:18.679069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-04ad3463-ce93-463b-b6fd-f77602e6e4f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:18.728641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04ad3463-ce93-463b-b6fd-f77602e6e4f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:18.729601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04ad3463-ce93-463b-b6fd-f77602e6e4f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:18.733258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04ad3463-ce93-463b-b6fd-f77602e6e4f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:18.734761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04ad3463-ce93-463b-b6fd-f77602e6e4f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:18.735484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04ad3463-ce93-463b-b6fd-f77602e6e4f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:18.736270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04ad3463-ce93-463b-b6fd-f77602e6e4f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:19.131620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f4f55477-842c-4c06-bc1b-d6b2970cd418 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:19.164231 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f4f55477-842c-4c06-bc1b-d6b2970cd418 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1501 microversion: 2.1 time: 1.222739 Aug 27 02:52:19.212104 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2178/4158] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:17 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1501 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:19.234497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d0b0f426-1ec1-40d0-978d-6b29472e704b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:19.235326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d0b0f426-1ec1-40d0-978d-6b29472e704b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:19.267272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0b0f426-1ec1-40d0-978d-6b29472e704b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:19.274442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0b0f426-1ec1-40d0-978d-6b29472e704b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:19.275269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0b0f426-1ec1-40d0-978d-6b29472e704b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:19.276060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0b0f426-1ec1-40d0-978d-6b29472e704b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:19.276750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0b0f426-1ec1-40d0-978d-6b29472e704b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:19.277199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0b0f426-1ec1-40d0-978d-6b29472e704b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:19.533285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-04ad3463-ce93-463b-b6fd-f77602e6e4f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:19.571243 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-04ad3463-ce93-463b-b6fd-f77602e6e4f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1506 microversion: 2.1 time: 0.907165 Aug 27 02:52:19.572171 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1981/4159] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:18 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1506 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:19.725637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c76f6766-bd6e-41d5-838c-fba13c5b890d req-3f24d19a-e574-4b7e-9dc3-7823eb265348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7a96de-d7d1-42d0-a191-cbd4d7f257c1", "name": "network-vif-deleted", "tag": "1207032e-9a66-4c7e-8dfd-67d9471d032b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:19.871451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c76f6766-bd6e-41d5-838c-fba13c5b890d req-3f24d19a-e574-4b7e-9dc3-7823eb265348 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:19.872345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c76f6766-bd6e-41d5-838c-fba13c5b890d req-3f24d19a-e574-4b7e-9dc3-7823eb265348 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:19.873115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c76f6766-bd6e-41d5-838c-fba13c5b890d req-3f24d19a-e574-4b7e-9dc3-7823eb265348 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:19.906469 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c76f6766-bd6e-41d5-838c-fba13c5b890d req-3f24d19a-e574-4b7e-9dc3-7823eb265348 service nova] Creating event network-vif-deleted:1207032e-9a66-4c7e-8dfd-67d9471d032b for instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 on n-h1-852084-5 Aug 27 02:52:19.927783 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c76f6766-bd6e-41d5-838c-fba13c5b890d req-3f24d19a-e574-4b7e-9dc3-7823eb265348 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202942 Aug 27 02:52:19.932809 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1982/4160] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:52:20.254384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d0b0f426-1ec1-40d0-978d-6b29472e704b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:20.267261 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d0b0f426-1ec1-40d0-978d-6b29472e704b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 1.052940 Aug 27 02:52:20.271192 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2179/4161] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:19 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:20.605359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:20.609124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:20.622777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:20.627176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:20.627748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:20.629486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:20.631460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:20.631988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:20.685946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:20.686626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:20.687361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:20.688085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lazy-loading 'fault' on Instance uuid 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:52:20.809893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:20.823176 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b574e39c-1023-4c37-820e-ad6ada665845 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 200 len: 1305 microversion: 2.1 time: 0.227753 Aug 27 02:52:20.824213 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2180/4162] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:20 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 1305 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:20.877850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7f0f4238-6ccf-454e-be07-9d32b110b08e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:20.878769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7f0f4238-6ccf-454e-be07-9d32b110b08e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:20.895818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f0f4238-6ccf-454e-be07-9d32b110b08e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:20.896338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f0f4238-6ccf-454e-be07-9d32b110b08e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:20.896792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f0f4238-6ccf-454e-be07-9d32b110b08e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:20.897549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f0f4238-6ccf-454e-be07-9d32b110b08e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:20.898039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f0f4238-6ccf-454e-be07-9d32b110b08e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:20.898475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f0f4238-6ccf-454e-be07-9d32b110b08e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.307408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9720b4ea-14e1-4501-bac4-c5ee72bdb91d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:21.308887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9720b4ea-14e1-4501-bac4-c5ee72bdb91d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:21.318845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9720b4ea-14e1-4501-bac4-c5ee72bdb91d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.321872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9720b4ea-14e1-4501-bac4-c5ee72bdb91d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.323315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7f0f4238-6ccf-454e-be07-9d32b110b08e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:21.326527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9720b4ea-14e1-4501-bac4-c5ee72bdb91d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.328107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9720b4ea-14e1-4501-bac4-c5ee72bdb91d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.331317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9720b4ea-14e1-4501-bac4-c5ee72bdb91d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.333645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9720b4ea-14e1-4501-bac4-c5ee72bdb91d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.339550 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7f0f4238-6ccf-454e-be07-9d32b110b08e tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.130839 Aug 27 02:52:21.340749 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1983/4163] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:20 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:21.394381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8231284-3d55-4fb7-950d-14a7f1ee41f7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:21.395179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e8231284-3d55-4fb7-950d-14a7f1ee41f7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:21.417658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8231284-3d55-4fb7-950d-14a7f1ee41f7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.420768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8231284-3d55-4fb7-950d-14a7f1ee41f7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.422302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8231284-3d55-4fb7-950d-14a7f1ee41f7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.423305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8231284-3d55-4fb7-950d-14a7f1ee41f7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.424204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8231284-3d55-4fb7-950d-14a7f1ee41f7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.425455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8231284-3d55-4fb7-950d-14a7f1ee41f7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.683954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9720b4ea-14e1-4501-bac4-c5ee72bdb91d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:21.699630 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9720b4ea-14e1-4501-bac4-c5ee72bdb91d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.407306 Aug 27 02:52:21.718204 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2181/4164] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:21 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:21.865772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:21.867043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:21.882011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.882584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.884918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.888867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:21.889783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:21.890442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:21.911983 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 HTTP/1.1 Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '7a7a96de-d7d1-42d0-a191-cbd4d7f257c1'} Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:21.913639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:21.918909 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:21.918909 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:21.918909 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:21.918909 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:21.918909 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:21.918909 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:52:21.918909 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:21.918909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:21.918909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-32062c18-05c8-4c00-a2b0-047c53ca1976 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 404 len: 111 microversion: 2.1 time: 0.055557 Aug 27 02:52:21.918909 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2182/4165] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:21 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:22.134899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-407180096", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a3bbba16-ea21-41e9-a19d-afd74184c636"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:22.225067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] validate_networks() for [('a3bbba16-ea21-41e9-a19d-afd74184c636', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:52:22.235986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e8231284-3d55-4fb7-950d-14a7f1ee41f7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:22.273220 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e8231284-3d55-4fb7-950d-14a7f1ee41f7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.886809 Aug 27 02:52:22.274376 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1984/4166] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:21 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:22.325381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8414df1d-5fb4-4de4-96d1-e54a3ebf2c19 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:22.332768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8414df1d-5fb4-4de4-96d1-e54a3ebf2c19 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: dcf24325-0507-49e2-a527-d32ea8dc8fa4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:22.362667 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-8414df1d-5fb4-4de4-96d1-e54a3ebf2c19 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance dcf24325-0507-49e2-a527-d32ea8dc8fa4 could not be found. Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8414df1d-5fb4-4de4-96d1-e54a3ebf2c19 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/dcf24325-0507-49e2-a527-d32ea8dc8fa4/action HTTP/1.1 Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 15 Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: {"unpause": {}} Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance dcf24325-0507-49e2-a527-d32ea8dc8fa4 could not be found. Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'dcf24325-0507-49e2-a527-d32ea8dc8fa4', 'body': {'unpause': {}}} Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcf24325-0507-49e2-a527-d32ea8dc8fa4 could not be found. Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcf24325-0507-49e2-a527-d32ea8dc8fa4 could not be found. Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:22.366175 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:22.373608 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:22.373608 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:22.373608 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcf24325-0507-49e2-a527-d32ea8dc8fa4 could not be found. Aug 27 02:52:22.373608 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:22.387087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8414df1d-5fb4-4de4-96d1-e54a3ebf2c19 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance dcf24325-0507-49e2-a527-d32ea8dc8fa4 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:22.388969 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8414df1d-5fb4-4de4-96d1-e54a3ebf2c19 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/dcf24325-0507-49e2-a527-d32ea8dc8fa4/action" status: 404 len: 111 microversion: 2.1 time: 0.072301 Aug 27 02:52:22.396438 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1985/4167] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:22 2022] POST /compute/v2.1/servers/dcf24325-0507-49e2-a527-d32ea8dc8fa4/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:22.407004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c1c329c4-f695-41bb-be44-6c4e98f8119b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:22.434016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c1c329c4-f695-41bb-be44-6c4e98f8119b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:22.444426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1c329c4-f695-41bb-be44-6c4e98f8119b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:22.450380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1c329c4-f695-41bb-be44-6c4e98f8119b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:22.452362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1c329c4-f695-41bb-be44-6c4e98f8119b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:22.463174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1c329c4-f695-41bb-be44-6c4e98f8119b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:22.464097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1c329c4-f695-41bb-be44-6c4e98f8119b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:22.465063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1c329c4-f695-41bb-be44-6c4e98f8119b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.050626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:23.052364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:23.053469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:23.054083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:23.054801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:23.071018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.071682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.072307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.074214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.074968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.076100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.136046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:23.165282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for user b508f2fe4b394f589b067f5b3de49a0e and project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:23.205577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:23.218854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:23.364384 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1846aee1-91ba-43d4-bc6b-c64b1e6b6879 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229986 Aug 27 02:52:23.371625 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2183/4168] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:52:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:52:23.386020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a4b86923-06de-4d41-aabd-77403a317d9d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:23.387759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a4b86923-06de-4d41-aabd-77403a317d9d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:23.411120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b86923-06de-4d41-aabd-77403a317d9d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.419347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b86923-06de-4d41-aabd-77403a317d9d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.434114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b86923-06de-4d41-aabd-77403a317d9d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.435739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b86923-06de-4d41-aabd-77403a317d9d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.438483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b86923-06de-4d41-aabd-77403a317d9d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.442756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b86923-06de-4d41-aabd-77403a317d9d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.593945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c1c329c4-f695-41bb-be44-6c4e98f8119b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:23.605520 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c1c329c4-f695-41bb-be44-6c4e98f8119b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.206186 Aug 27 02:52:23.610576 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1986/4169] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:22 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:23.618800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a495b02-3795-4bd5-bcae-a9062eb7d446 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:23.627083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5a495b02-3795-4bd5-bcae-a9062eb7d446 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:23.741197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5a495b02-3795-4bd5-bcae-a9062eb7d446 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:23.752471 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a495b02-3795-4bd5-bcae-a9062eb7d446 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1214 microversion: 2.1 time: 0.134289 Aug 27 02:52:23.753273 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1987/4170] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:23 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:23.780785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-09d5504b-fd65-4560-ac3d-701faebde7da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:23.783339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-09d5504b-fd65-4560-ac3d-701faebde7da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:23.804154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09d5504b-fd65-4560-ac3d-701faebde7da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.804658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09d5504b-fd65-4560-ac3d-701faebde7da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.805103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09d5504b-fd65-4560-ac3d-701faebde7da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:23.805914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09d5504b-fd65-4560-ac3d-701faebde7da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:23.806391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09d5504b-fd65-4560-ac3d-701faebde7da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:23.806833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09d5504b-fd65-4560-ac3d-701faebde7da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.040004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a4b86923-06de-4d41-aabd-77403a317d9d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:24.071466 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a4b86923-06de-4d41-aabd-77403a317d9d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.695334 Aug 27 02:52:24.076460 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2184/4171] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:23 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:24.516846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-09d5504b-fd65-4560-ac3d-701faebde7da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:24.523112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:24.552057 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-09d5504b-fd65-4560-ac3d-701faebde7da tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.794341 Aug 27 02:52:24.554380 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1988/4172] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:23 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:24.584026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:24.586249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:24.609777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.611130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.611749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.612842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.613299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.614940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.686686 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Cannot 'unpause' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action HTTP/1.1 Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 15 Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: {"unpause": {}} Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: exception: Cannot 'unpause' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '58f7ed66-f5a7-42ec-be91-bd5a08981d8f', 'body': {'unpause': {}}} Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f in vm_state active. Cannot unpause while the instance is in this state. Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:24.688274 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:24.698478 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:24.698478 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:24.698478 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:24.698478 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:52:24.698478 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:24.700293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 409 to user: Cannot 'unpause' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:24.701311 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3f0a20f5-c263-4f5b-bfd1-8f9d2ce91619 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 409 len: 145 microversion: 2.1 time: 0.127759 Aug 27 02:52:24.701973 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1989/4173] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:24 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 145 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 27 02:52:24.764419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45d8b1fd-2af8-4f79-8d88-e4f2995261a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:24.768562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-45d8b1fd-2af8-4f79-8d88-e4f2995261a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:24.796794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45d8b1fd-2af8-4f79-8d88-e4f2995261a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.799142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45d8b1fd-2af8-4f79-8d88-e4f2995261a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.801256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45d8b1fd-2af8-4f79-8d88-e4f2995261a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.803345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45d8b1fd-2af8-4f79-8d88-e4f2995261a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:24.804083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45d8b1fd-2af8-4f79-8d88-e4f2995261a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:24.806348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45d8b1fd-2af8-4f79-8d88-e4f2995261a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:24.926786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1714827476", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": "none"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:25.118661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:25.120245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:25.121480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:25.125743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:25.126732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:25.154681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:25.155535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:25.158535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:25.159760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:25.162316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:25.163126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:25.189702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:25.213789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Getting quotas for project dd95aab9bfc94fc0a3c1dfa4d1127830. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:25.225434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Getting quotas for user 97b5e531d3004f42af47671a0255fabb and project dd95aab9bfc94fc0a3c1dfa4d1127830. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:25.273953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:25.279019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:25.411141 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb62cac2-020d-4a7a-b2b9-446accd5f39b tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.897254 Aug 27 02:52:25.412106 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2185/4174] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:52:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:52:25.417765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4bec8c5c-b9b0-43af-9fd4-f9c96c1dd881 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:25.419051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4bec8c5c-b9b0-43af-9fd4-f9c96c1dd881 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:25.437567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bec8c5c-b9b0-43af-9fd4-f9c96c1dd881 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:25.439280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bec8c5c-b9b0-43af-9fd4-f9c96c1dd881 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:25.440374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bec8c5c-b9b0-43af-9fd4-f9c96c1dd881 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:25.441456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bec8c5c-b9b0-43af-9fd4-f9c96c1dd881 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:25.442452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bec8c5c-b9b0-43af-9fd4-f9c96c1dd881 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:25.443477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bec8c5c-b9b0-43af-9fd4-f9c96c1dd881 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:25.579395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-45d8b1fd-2af8-4f79-8d88-e4f2995261a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:25.596641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4bec8c5c-b9b0-43af-9fd4-f9c96c1dd881 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:25.617888 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4bec8c5c-b9b0-43af-9fd4-f9c96c1dd881 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1266 microversion: 2.1 time: 0.203688 Aug 27 02:52:25.619296 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-45d8b1fd-2af8-4f79-8d88-e4f2995261a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.886267 Aug 27 02:52:25.620458 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1990/4175] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:24 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:25.635391 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2186/4176] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:25 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:25.660165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc30c0a0-f301-49a9-a103-e32ea7ad480a tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:25.661488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fc30c0a0-f301-49a9-a103-e32ea7ad480a tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:25.662432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4431bc9-ec40-4a2b-b8ff-89b59da0890c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:25.662842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c4431bc9-ec40-4a2b-b8ff-89b59da0890c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:25.696818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4431bc9-ec40-4a2b-b8ff-89b59da0890c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:25.697331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4431bc9-ec40-4a2b-b8ff-89b59da0890c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:25.697913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4431bc9-ec40-4a2b-b8ff-89b59da0890c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:25.703667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4431bc9-ec40-4a2b-b8ff-89b59da0890c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:25.705416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4431bc9-ec40-4a2b-b8ff-89b59da0890c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:25.706160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4431bc9-ec40-4a2b-b8ff-89b59da0890c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:25.942833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fc30c0a0-f301-49a9-a103-e32ea7ad480a tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:25.971698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fc30c0a0-f301-49a9-a103-e32ea7ad480a tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:25.976120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fc30c0a0-f301-49a9-a103-e32ea7ad480a tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:25.978706 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fc30c0a0-f301-49a9-a103-e32ea7ad480a tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759" status: 200 len: 1281 microversion: 2.47 time: 0.340801 Aug 27 02:52:25.998688 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2187/4177] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:25 2022] GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759 => generated 1281 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:26.023176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b699025f-7771-4774-a088-cbf65df93772 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:26.025035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b699025f-7771-4774-a088-cbf65df93772 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:26.036460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b699025f-7771-4774-a088-cbf65df93772 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.037768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b699025f-7771-4774-a088-cbf65df93772 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.039392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b699025f-7771-4774-a088-cbf65df93772 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.040971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b699025f-7771-4774-a088-cbf65df93772 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.041765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b699025f-7771-4774-a088-cbf65df93772 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.042817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b699025f-7771-4774-a088-cbf65df93772 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.576157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c4431bc9-ec40-4a2b-b8ff-89b59da0890c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:26.593705 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c4431bc9-ec40-4a2b-b8ff-89b59da0890c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.939445 Aug 27 02:52:26.594373 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1991/4178] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:25 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:26.661213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ca3cafd-d80a-4e80-9260-f025201e0420 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:26.662767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0ca3cafd-d80a-4e80-9260-f025201e0420 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:26.676213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca3cafd-d80a-4e80-9260-f025201e0420 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.676725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca3cafd-d80a-4e80-9260-f025201e0420 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.677170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca3cafd-d80a-4e80-9260-f025201e0420 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.677917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca3cafd-d80a-4e80-9260-f025201e0420 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.678997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca3cafd-d80a-4e80-9260-f025201e0420 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.679445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ca3cafd-d80a-4e80-9260-f025201e0420 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.782045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b699025f-7771-4774-a088-cbf65df93772 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:26.790988 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b699025f-7771-4774-a088-cbf65df93772 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.790330 Aug 27 02:52:26.791582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2188/4179] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:25 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:26.828925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bafb9efb-085c-42d3-8b58-436f31fda127 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:26.837365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bafb9efb-085c-42d3-8b58-436f31fda127 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 71fcd19d-25d4-4ca4-9d12-d02f356afae8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:26.856014 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-bafb9efb-085c-42d3-8b58-436f31fda127 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance 71fcd19d-25d4-4ca4-9d12-d02f356afae8 could not be found. Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bafb9efb-085c-42d3-8b58-436f31fda127 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/71fcd19d-25d4-4ca4-9d12-d02f356afae8/action HTTP/1.1 Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 18 Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: {"unshelve": null} Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 71fcd19d-25d4-4ca4-9d12-d02f356afae8 could not be found. Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '71fcd19d-25d4-4ca4-9d12-d02f356afae8', 'body': {'unshelve': None}} Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71fcd19d-25d4-4ca4-9d12-d02f356afae8 could not be found. Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71fcd19d-25d4-4ca4-9d12-d02f356afae8 could not be found. Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:26.858252 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:26.862757 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:26.862757 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:26.862757 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:26.862757 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:26.862757 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:26.862757 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:26.862757 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71fcd19d-25d4-4ca4-9d12-d02f356afae8 could not be found. Aug 27 02:52:26.862757 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:26.867819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bafb9efb-085c-42d3-8b58-436f31fda127 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance 71fcd19d-25d4-4ca4-9d12-d02f356afae8 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:26.870239 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bafb9efb-085c-42d3-8b58-436f31fda127 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/71fcd19d-25d4-4ca4-9d12-d02f356afae8/action" status: 404 len: 111 microversion: 2.1 time: 0.055065 Aug 27 02:52:26.874175 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2189/4180] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:26 2022] POST /compute/v2.1/servers/71fcd19d-25d4-4ca4-9d12-d02f356afae8/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:26.885862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-81b133ea-7199-4d84-a0a7-3e09b02e233c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:26.893000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-81b133ea-7199-4d84-a0a7-3e09b02e233c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:26.902497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81b133ea-7199-4d84-a0a7-3e09b02e233c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.907631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81b133ea-7199-4d84-a0a7-3e09b02e233c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.908595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81b133ea-7199-4d84-a0a7-3e09b02e233c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:26.909577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81b133ea-7199-4d84-a0a7-3e09b02e233c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:26.919228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81b133ea-7199-4d84-a0a7-3e09b02e233c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:26.919952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81b133ea-7199-4d84-a0a7-3e09b02e233c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.196567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-81b133ea-7199-4d84-a0a7-3e09b02e233c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:27.211115 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-81b133ea-7199-4d84-a0a7-3e09b02e233c tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.331989 Aug 27 02:52:27.223573 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2190/4181] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:26 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:27.243915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:27.244944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:27.254445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.255315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.256021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.256993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.257837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.258469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.399417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0ca3cafd-d80a-4e80-9260-f025201e0420 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:27.412747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:27.413277 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0ca3cafd-d80a-4e80-9260-f025201e0420 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1272 microversion: 2.1 time: 0.753532 Aug 27 02:52:27.415998 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1992/4182] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:26 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1272 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:27.425901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:27.427224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ca76422a-edbd-46f8-8917-66f3909ab03b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:27.431219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:27.432450 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f7ea56ea-2d36-4049-93a7-cc5af5f96b7c tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759" status: 200 len: 1333 microversion: 2.47 time: 0.200675 Aug 27 02:52:27.432582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ca76422a-edbd-46f8-8917-66f3909ab03b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:27.433036 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2191/4183] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:27 2022] GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759 => generated 1333 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:27.451629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca76422a-edbd-46f8-8917-66f3909ab03b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.457035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca76422a-edbd-46f8-8917-66f3909ab03b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.458022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca76422a-edbd-46f8-8917-66f3909ab03b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.459099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca76422a-edbd-46f8-8917-66f3909ab03b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.460976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca76422a-edbd-46f8-8917-66f3909ab03b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.461767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca76422a-edbd-46f8-8917-66f3909ab03b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.634467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f5556caa-3e20-421c-aecc-063690c2dbe3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:27.643568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f5556caa-3e20-421c-aecc-063690c2dbe3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:27.658177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5556caa-3e20-421c-aecc-063690c2dbe3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.662761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5556caa-3e20-421c-aecc-063690c2dbe3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.663611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5556caa-3e20-421c-aecc-063690c2dbe3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:27.674325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5556caa-3e20-421c-aecc-063690c2dbe3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:27.675221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5556caa-3e20-421c-aecc-063690c2dbe3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:27.677075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5556caa-3e20-421c-aecc-063690c2dbe3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.159050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f5556caa-3e20-421c-aecc-063690c2dbe3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:28.168244 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f5556caa-3e20-421c-aecc-063690c2dbe3 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.538785 Aug 27 02:52:28.177718 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2192/4184] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:27 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:28.240362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ca76422a-edbd-46f8-8917-66f3909ab03b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:28.261288 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ca76422a-edbd-46f8-8917-66f3909ab03b tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.843383 Aug 27 02:52:28.274448 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1993/4185] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:27 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:28.288729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:28.289652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:28.291892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:28.306697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.307193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.310971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.317263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.318646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.319579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.460541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-89bd1a37-95cd-4308-a508-4aa7b446aaf7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:28.463378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-89bd1a37-95cd-4308-a508-4aa7b446aaf7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:28.488666 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Cannot 'unshelve' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:52:28.490238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89bd1a37-95cd-4308-a508-4aa7b446aaf7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.490772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89bd1a37-95cd-4308-a508-4aa7b446aaf7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.491290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89bd1a37-95cd-4308-a508-4aa7b446aaf7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action HTTP/1.1 Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 18 Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: {"unshelve": null} Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: exception: Cannot 'unshelve' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '58f7ed66-f5a7-42ec-be91-bd5a08981d8f', 'body': {'unshelve': None}} Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f in vm_state active. Cannot unshelve while the instance is in this state. Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 27 02:52:28.491664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 27 02:52:28.495136 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:52:28.495136 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:28.495136 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:28.495136 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:28.495136 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:28.495136 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:28.495136 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:28.495136 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:28.495136 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:28.495136 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active Aug 27 02:52:28.495136 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:28.495743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89bd1a37-95cd-4308-a508-4aa7b446aaf7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.496969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89bd1a37-95cd-4308-a508-4aa7b446aaf7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.497912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 409 to user: Cannot 'unshelve' instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f while it is in vm_state active {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:28.499643 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ea447f1-234f-4fa8-a223-bb350718cdd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action" status: 409 len: 146 microversion: 2.1 time: 0.215809 Aug 27 02:52:28.500640 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2193/4186] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:28 2022] POST /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f/action => generated 146 bytes in 218 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:52:28.503935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89bd1a37-95cd-4308-a508-4aa7b446aaf7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.513070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:28.518207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:28.541358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.542938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.544281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.546789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.551817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.551817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.702140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:28.730320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:28.738789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:28.743593 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d521e663-dd8d-4ba4-98f9-ab953d6bf1d3 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759" status: 200 len: 1339 microversion: 2.47 time: 0.237314 Aug 27 02:52:28.749970 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2194/4187] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:28 2022] GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759 => generated 1339 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:28.771218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b52b3cbe-290f-4062-90eb-2c250e0d2015 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:28.773064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b52b3cbe-290f-4062-90eb-2c250e0d2015 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:28.794939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b52b3cbe-290f-4062-90eb-2c250e0d2015 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.796988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b52b3cbe-290f-4062-90eb-2c250e0d2015 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.797722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b52b3cbe-290f-4062-90eb-2c250e0d2015 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.800425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b52b3cbe-290f-4062-90eb-2c250e0d2015 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:28.801572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b52b3cbe-290f-4062-90eb-2c250e0d2015 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:28.802678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b52b3cbe-290f-4062-90eb-2c250e0d2015 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:28.887215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-89bd1a37-95cd-4308-a508-4aa7b446aaf7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:28.907919 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-89bd1a37-95cd-4308-a508-4aa7b446aaf7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1314 microversion: 2.1 time: 0.456464 Aug 27 02:52:28.919215 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1994/4188] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:28 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:29.194740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cbb4505c-65fc-41fd-b800-5886c0888a63 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:29.196096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cbb4505c-65fc-41fd-b800-5886c0888a63 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:29.206554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbb4505c-65fc-41fd-b800-5886c0888a63 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:29.207372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbb4505c-65fc-41fd-b800-5886c0888a63 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:29.208350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbb4505c-65fc-41fd-b800-5886c0888a63 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:29.209731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbb4505c-65fc-41fd-b800-5886c0888a63 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:29.210746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbb4505c-65fc-41fd-b800-5886c0888a63 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:29.211613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbb4505c-65fc-41fd-b800-5886c0888a63 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:29.488968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b52b3cbe-290f-4062-90eb-2c250e0d2015 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:29.529053 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b52b3cbe-290f-4062-90eb-2c250e0d2015 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.776822 Aug 27 02:52:29.534249 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2195/4189] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:28 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:29.556049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-689027237", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3de346eb-ff69-432b-993f-7130e8456dbd"}], "security_groups": [{"name": "tempest-securitygroup--1371422909"}], "key_name": "tempest-keypair-1963302741", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "d6c4d803-5e3e-43a6-9fcf-91b021db249e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:29.629757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cbb4505c-65fc-41fd-b800-5886c0888a63 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:29.647337 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cbb4505c-65fc-41fd-b800-5886c0888a63 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.458960 Aug 27 02:52:29.652075 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1995/4190] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:29 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:29.670958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b505fad1-2927-48a6-9de6-efacb1fa2650 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:29.672018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b505fad1-2927-48a6-9de6-efacb1fa2650 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:29.679303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b505fad1-2927-48a6-9de6-efacb1fa2650 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:29.680248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b505fad1-2927-48a6-9de6-efacb1fa2650 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:29.681297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b505fad1-2927-48a6-9de6-efacb1fa2650 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:29.684326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b505fad1-2927-48a6-9de6-efacb1fa2650 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:29.696540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b505fad1-2927-48a6-9de6-efacb1fa2650 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:29.697468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b505fad1-2927-48a6-9de6-efacb1fa2650 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:29.819161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] validate_networks() for [('3de346eb-ff69-432b-993f-7130e8456dbd', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:52:30.149075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b505fad1-2927-48a6-9de6-efacb1fa2650 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:30.172451 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b505fad1-2927-48a6-9de6-efacb1fa2650 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.517582 Aug 27 02:52:30.175031 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1996/4191] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:29 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:30.187012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:30.188627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:30.207911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.208825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.209639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.211122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.212192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.213103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.336799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:30.356565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:30.361515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:30.364200 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7fad524f-e341-4596-8c22-681f82c90857 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759" status: 200 len: 1339 microversion: 2.47 time: 0.187393 Aug 27 02:52:30.365857 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1997/4192] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:30 2022] GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759 => generated 1339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:30.374808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1afd2e2c-6b6e-4406-861c-f81ae7d13fbe tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:30.376672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1afd2e2c-6b6e-4406-861c-f81ae7d13fbe tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:30.398385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1afd2e2c-6b6e-4406-861c-f81ae7d13fbe tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.399911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1afd2e2c-6b6e-4406-861c-f81ae7d13fbe tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.400844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1afd2e2c-6b6e-4406-861c-f81ae7d13fbe tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.402323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1afd2e2c-6b6e-4406-861c-f81ae7d13fbe tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.403660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1afd2e2c-6b6e-4406-861c-f81ae7d13fbe tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.404684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1afd2e2c-6b6e-4406-861c-f81ae7d13fbe tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.681059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1afd2e2c-6b6e-4406-861c-f81ae7d13fbe tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:30.692637 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1afd2e2c-6b6e-4406-861c-f81ae7d13fbe tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1314 microversion: 2.1 time: 0.324955 Aug 27 02:52:30.712297 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1998/4193] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:30 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:30.725423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-746ae39c-08eb-4395-bea4-e3c6da616219 req-299ae5e0-3603-4879-bb9d-05bc6b850d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e181b7bb-e89e-413d-9879-818eb731e6f5", "tag": "9021c40e-8a77-4f06-88e7-6eab99971e9b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:30.731647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:30.749805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-746ae39c-08eb-4395-bea4-e3c6da616219 req-299ae5e0-3603-4879-bb9d-05bc6b850d3e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.750465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-746ae39c-08eb-4395-bea4-e3c6da616219 req-299ae5e0-3603-4879-bb9d-05bc6b850d3e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.754382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-746ae39c-08eb-4395-bea4-e3c6da616219 req-299ae5e0-3603-4879-bb9d-05bc6b850d3e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.770017 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-746ae39c-08eb-4395-bea4-e3c6da616219 req-299ae5e0-3603-4879-bb9d-05bc6b850d3e service nova] Creating event network-changed:9021c40e-8a77-4f06-88e7-6eab99971e9b for instance e181b7bb-e89e-413d-9879-818eb731e6f5 on n-h1-852084-5 Aug 27 02:52:30.776923 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-746ae39c-08eb-4395-bea4-e3c6da616219 req-299ae5e0-3603-4879-bb9d-05bc6b850d3e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062732 Aug 27 02:52:30.778035 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 1999/4194] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:30.784214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f3bd801-588c-4ca6-ab5e-0e0a2c127400 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-581788497_updated"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:30.787170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9f3bd801-588c-4ca6-ab5e-0e0a2c127400 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 5b44afd5-76d7-4e93-bccf-2474dcecf701] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:30.794604 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9f3bd801-588c-4ca6-ab5e-0e0a2c127400 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance 5b44afd5-76d7-4e93-bccf-2474dcecf701 could not be found. Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f3bd801-588c-4ca6-ab5e-0e0a2c127400 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: request: PUT /compute/v2.1/servers/5b44afd5-76d7-4e93-bccf-2474dcecf701 HTTP/1.1 Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 80 Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-581788497_updated"}} Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 5b44afd5-76d7-4e93-bccf-2474dcecf701 could not be found. Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5b44afd5-76d7-4e93-bccf-2474dcecf701', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-581788497_updated'}}} Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b44afd5-76d7-4e93-bccf-2474dcecf701 could not be found. Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 02:52:30.797289 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b44afd5-76d7-4e93-bccf-2474dcecf701 could not be found. Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b44afd5-76d7-4e93-bccf-2474dcecf701 could not be found. Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f3bd801-588c-4ca6-ab5e-0e0a2c127400 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance 5b44afd5-76d7-4e93-bccf-2474dcecf701 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:30.803501 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9f3bd801-588c-4ca6-ab5e-0e0a2c127400 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "PUT /compute/v2.1/servers/5b44afd5-76d7-4e93-bccf-2474dcecf701" status: 404 len: 111 microversion: 2.1 time: 0.019634 Aug 27 02:52:30.806155 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2000/4195] 10.222.0.99 () {60 vars in 1256 bytes} [Sat Aug 27 02:52:30 2022] PUT /compute/v2.1/servers/5b44afd5-76d7-4e93-bccf-2474dcecf701 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:30.808757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Getting quotas for project 3126c8641780451c8c6882179cce59d2. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:30.810335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b246fdd5-3a0b-4170-82c9-48ef75926a08 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:30.811153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b246fdd5-3a0b-4170-82c9-48ef75926a08 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:30.820532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b246fdd5-3a0b-4170-82c9-48ef75926a08 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.821196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b246fdd5-3a0b-4170-82c9-48ef75926a08 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.821793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b246fdd5-3a0b-4170-82c9-48ef75926a08 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.822633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b246fdd5-3a0b-4170-82c9-48ef75926a08 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.823217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b246fdd5-3a0b-4170-82c9-48ef75926a08 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.823778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b246fdd5-3a0b-4170-82c9-48ef75926a08 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.836753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Getting quotas for user e6debd1d81f0463c9daaa0168051ecee and project 3126c8641780451c8c6882179cce59d2. Resources: dict_keys(['metadata_items']) {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:30.864599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:30.865011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:30.865501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:30.865974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:30.866375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:30.890775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.891281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.891726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.892491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:30.892950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:30.893389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:30.952412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Getting quotas for project 3126c8641780451c8c6882179cce59d2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:30.972408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Getting quotas for user e6debd1d81f0463c9daaa0168051ecee and project 3126c8641780451c8c6882179cce59d2. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:31.088070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:31.090699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6c4d803-5e3e-43a6-9fcf-91b021db249e',volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:31.255661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b246fdd5-3a0b-4170-82c9-48ef75926a08 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:31.268976 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b246fdd5-3a0b-4170-82c9-48ef75926a08 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.462841 Aug 27 02:52:31.269926 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2001/4196] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:30 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:31.277062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a9e7d17-f53d-4a48-a362-bf4443855d1f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:31.277722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6a9e7d17-f53d-4a48-a362-bf4443855d1f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:31.294119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a9e7d17-f53d-4a48-a362-bf4443855d1f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.296289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a9e7d17-f53d-4a48-a362-bf4443855d1f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.308500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a9e7d17-f53d-4a48-a362-bf4443855d1f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.310873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a9e7d17-f53d-4a48-a362-bf4443855d1f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.311310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a9e7d17-f53d-4a48-a362-bf4443855d1f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.312589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a9e7d17-f53d-4a48-a362-bf4443855d1f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.444313 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-260eaafe-52f9-46fd-bab9-50375a8ffcc5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.906654 Aug 27 02:52:31.445562 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2196/4197] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:52:29 2022] POST /compute/v2.1/servers => generated 407 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:52:31.466298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:31.483726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:31.495976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.499853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.500979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.503391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.504736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.506881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.684059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:31.729618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:31.743899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:31.751202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-399b24d0-96cc-43a0-b05f-fd1c7303bf49 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759" status: 200 len: 1360 microversion: 2.47 time: 0.287722 Aug 27 02:52:31.752279 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2197/4198] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:31 2022] GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759 => generated 1360 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:31.792207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-333a5c2a-b360-4124-a80b-9a2d9824df23 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:31.794110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-333a5c2a-b360-4124-a80b-9a2d9824df23 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:31.856876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a9e7d17-f53d-4a48-a362-bf4443855d1f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:31.866634 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6a9e7d17-f53d-4a48-a362-bf4443855d1f tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.595579 Aug 27 02:52:31.878115 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2002/4199] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:31 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:31.881377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-333a5c2a-b360-4124-a80b-9a2d9824df23 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:31.888862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e86977a8-e400-4900-ad71-0faafbfcd1b0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:31.890122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e86977a8-e400-4900-ad71-0faafbfcd1b0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:31.897174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86977a8-e400-4900-ad71-0faafbfcd1b0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.898484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86977a8-e400-4900-ad71-0faafbfcd1b0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.899433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86977a8-e400-4900-ad71-0faafbfcd1b0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.900946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86977a8-e400-4900-ad71-0faafbfcd1b0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.902315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86977a8-e400-4900-ad71-0faafbfcd1b0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.902968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e86977a8-e400-4900-ad71-0faafbfcd1b0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.911748 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-333a5c2a-b360-4124-a80b-9a2d9824df23 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1121 microversion: 2.1 time: 0.135847 Aug 27 02:52:31.914829 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2198/4200] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:31 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1121 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:31.927246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b3506e2-9f0c-48f5-9235-71574764cace tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-503852776"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:31.937457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6b3506e2-9f0c-48f5-9235-71574764cace tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:31.964930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3506e2-9f0c-48f5-9235-71574764cace tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.968762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3506e2-9f0c-48f5-9235-71574764cace tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.971004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3506e2-9f0c-48f5-9235-71574764cace tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:31.976763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3506e2-9f0c-48f5-9235-71574764cace tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:31.976763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3506e2-9f0c-48f5-9235-71574764cace tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:31.977109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b3506e2-9f0c-48f5-9235-71574764cace tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.356611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e86977a8-e400-4900-ad71-0faafbfcd1b0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:32.372672 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e86977a8-e400-4900-ad71-0faafbfcd1b0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1314 microversion: 2.1 time: 0.490761 Aug 27 02:52:32.388991 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2003/4201] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:31 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:32.399831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b176edc-a825-40e6-883a-2e63c38db115 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:32.400474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b176edc-a825-40e6-883a-2e63c38db115 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:32.415236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b176edc-a825-40e6-883a-2e63c38db115 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.416036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b176edc-a825-40e6-883a-2e63c38db115 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.416793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b176edc-a825-40e6-883a-2e63c38db115 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.418278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b176edc-a825-40e6-883a-2e63c38db115 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.419232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b176edc-a825-40e6-883a-2e63c38db115 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.420410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b176edc-a825-40e6-883a-2e63c38db115 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.487118 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b3506e2-9f0c-48f5-9235-71574764cace tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "POST /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759/action" status: 202 len: 52 microversion: 2.47 time: 0.568306 Aug 27 02:52:32.488159 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2199/4202] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:52:31 2022] POST /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759/action => generated 52 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:52:32.494369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a166100a-ff73-4459-90d8-3795963b5dd6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:32.495523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a166100a-ff73-4459-90d8-3795963b5dd6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:32.503431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a166100a-ff73-4459-90d8-3795963b5dd6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.504286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a166100a-ff73-4459-90d8-3795963b5dd6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.504943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a166100a-ff73-4459-90d8-3795963b5dd6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.507237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a166100a-ff73-4459-90d8-3795963b5dd6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.508230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a166100a-ff73-4459-90d8-3795963b5dd6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.508802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a166100a-ff73-4459-90d8-3795963b5dd6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.765903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5b176edc-a825-40e6-883a-2e63c38db115 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:32.780173 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5b176edc-a825-40e6-883a-2e63c38db115 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.394435 Aug 27 02:52:32.797185 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2004/4203] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:32 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:32.808423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-976489c1-a74c-42d0-8183-cf8020caba2e tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:32.808955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-976489c1-a74c-42d0-8183-cf8020caba2e tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:32.823970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-976489c1-a74c-42d0-8183-cf8020caba2e tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.824491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-976489c1-a74c-42d0-8183-cf8020caba2e tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.824943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-976489c1-a74c-42d0-8183-cf8020caba2e tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.825708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-976489c1-a74c-42d0-8183-cf8020caba2e tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:32.826170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-976489c1-a74c-42d0-8183-cf8020caba2e tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:32.826611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-976489c1-a74c-42d0-8183-cf8020caba2e tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:32.919188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-976489c1-a74c-42d0-8183-cf8020caba2e tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:32.922099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a166100a-ff73-4459-90d8-3795963b5dd6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:32.931691 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a166100a-ff73-4459-90d8-3795963b5dd6 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.441936 Aug 27 02:52:32.932290 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2200/4204] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:32 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:32.960561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-195837df-964c-4a6e-8d1d-d7345a241b33 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-195837df-964c-4a6e-8d1d-d7345a241b33 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: request: PUT /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f HTTP/1.1 Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 280 Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '58f7ed66-f5a7-42ec-be91-bd5a08981d8f', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.976502 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 27 02:52:32.980021 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:32.982825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-195837df-964c-4a6e-8d1d-d7345a241b33 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:32.984036 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-195837df-964c-4a6e-8d1d-d7345a241b33 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "PUT /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 400 len: 619 microversion: 2.1 time: 0.036439 Aug 27 02:52:32.984943 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2201/4205] 10.222.0.99 () {60 vars in 1257 bytes} [Sat Aug 27 02:52:32 2022] PUT /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 619 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:52:32.992345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ce77db7-2512-4424-ac78-0780f839a7cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:32.993185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ce77db7-2512-4424-ac78-0780f839a7cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:33.002685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ce77db7-2512-4424-ac78-0780f839a7cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.003550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ce77db7-2512-4424-ac78-0780f839a7cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.005827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ce77db7-2512-4424-ac78-0780f839a7cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.006770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ce77db7-2512-4424-ac78-0780f839a7cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.010435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ce77db7-2512-4424-ac78-0780f839a7cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.011108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ce77db7-2512-4424-ac78-0780f839a7cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.072864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:33.119026 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-976489c1-a74c-42d0-8183-cf8020caba2e tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759" status: 204 len: 0 microversion: 2.47 time: 0.323933 Aug 27 02:52:33.120463 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2005/4206] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:52:32 2022] DELETE /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:52:33.140586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d2e942b4-08fd-4f11-a565-6e50cd988bc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:33.143053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2e942b4-08fd-4f11-a565-6e50cd988bc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:33.153382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e942b4-08fd-4f11-a565-6e50cd988bc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.153931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e942b4-08fd-4f11-a565-6e50cd988bc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.154384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e942b4-08fd-4f11-a565-6e50cd988bc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.155799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e942b4-08fd-4f11-a565-6e50cd988bc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.156272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e942b4-08fd-4f11-a565-6e50cd988bc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.157205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e942b4-08fd-4f11-a565-6e50cd988bc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.184266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ce77db7-2512-4424-ac78-0780f839a7cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:33.211584 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ce77db7-2512-4424-ac78-0780f839a7cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1219 microversion: 2.1 time: 0.225207 Aug 27 02:52:33.212444 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2202/4207] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:32 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1219 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:33.226678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:33.227292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:33.235366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.236595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.237058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.237881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.238351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.238786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.368459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:33.416644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:33.418189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:33.419465 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b6d730a7-1d80-40b6-b78e-24085e35ffe4 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759" status: 200 len: 1366 microversion: 2.47 time: 0.206032 Aug 27 02:52:33.420421 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2203/4208] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:33 2022] GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:33.430833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-978bcba2-7e42-4118-ae00-ac81a23e346a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:33.432783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-978bcba2-7e42-4118-ae00-ac81a23e346a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:33.443494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978bcba2-7e42-4118-ae00-ac81a23e346a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.444404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978bcba2-7e42-4118-ae00-ac81a23e346a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.445639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978bcba2-7e42-4118-ae00-ac81a23e346a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.447699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978bcba2-7e42-4118-ae00-ac81a23e346a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.452445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978bcba2-7e42-4118-ae00-ac81a23e346a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.453228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-978bcba2-7e42-4118-ae00-ac81a23e346a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.516800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2e942b4-08fd-4f11-a565-6e50cd988bc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:33.532440 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d2e942b4-08fd-4f11-a565-6e50cd988bc8 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.408494 Aug 27 02:52:33.533843 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2006/4209] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:33 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:33.561843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-40c18c9a-e9f2-40b2-bb6f-3a9e36b30853 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:33.562861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-40c18c9a-e9f2-40b2-bb6f-3a9e36b30853 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:33.570845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40c18c9a-e9f2-40b2-bb6f-3a9e36b30853 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.572315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40c18c9a-e9f2-40b2-bb6f-3a9e36b30853 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.572955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40c18c9a-e9f2-40b2-bb6f-3a9e36b30853 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.574613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40c18c9a-e9f2-40b2-bb6f-3a9e36b30853 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:33.575348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40c18c9a-e9f2-40b2-bb6f-3a9e36b30853 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:33.576166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40c18c9a-e9f2-40b2-bb6f-3a9e36b30853 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:33.751835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:33.975763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-978bcba2-7e42-4118-ae00-ac81a23e346a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:34.001899 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-978bcba2-7e42-4118-ae00-ac81a23e346a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1314 microversion: 2.1 time: 0.575608 Aug 27 02:52:34.004424 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2204/4210] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:33 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:34.012891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3976b1ea-90cd-4ab9-a890-5a1ea1895def tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:34.015229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3976b1ea-90cd-4ab9-a890-5a1ea1895def tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:34.042254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3976b1ea-90cd-4ab9-a890-5a1ea1895def tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.043567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3976b1ea-90cd-4ab9-a890-5a1ea1895def tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.044263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3976b1ea-90cd-4ab9-a890-5a1ea1895def tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:34.045059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3976b1ea-90cd-4ab9-a890-5a1ea1895def tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.045579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3976b1ea-90cd-4ab9-a890-5a1ea1895def tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.047362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3976b1ea-90cd-4ab9-a890-5a1ea1895def tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:34.339972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3976b1ea-90cd-4ab9-a890-5a1ea1895def tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:34.354897 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3976b1ea-90cd-4ab9-a890-5a1ea1895def tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.342340 Aug 27 02:52:34.355602 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2205/4211] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:34 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:34.360929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7f207e40-bb7a-4c88-a173-a54bc01f408b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:34.370814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7f207e40-bb7a-4c88-a173-a54bc01f408b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:34.386675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f207e40-bb7a-4c88-a173-a54bc01f408b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.387198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f207e40-bb7a-4c88-a173-a54bc01f408b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.387576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f207e40-bb7a-4c88-a173-a54bc01f408b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:34.388563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f207e40-bb7a-4c88-a173-a54bc01f408b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.389328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f207e40-bb7a-4c88-a173-a54bc01f408b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.390012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f207e40-bb7a-4c88-a173-a54bc01f408b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:34.394007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:34.580705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7f207e40-bb7a-4c88-a173-a54bc01f408b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:34.601353 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7f207e40-bb7a-4c88-a173-a54bc01f408b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1237 microversion: 2.1 time: 0.244565 Aug 27 02:52:34.603995 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2206/4212] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:34 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1237 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:34.619085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:34.620263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:34.633801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.634321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.634741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:34.638750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.640321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.643837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:34.768643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-40c18c9a-e9f2-40b2-bb6f-3a9e36b30853 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:34.774302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:34.779985 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-40c18c9a-e9f2-40b2-bb6f-3a9e36b30853 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 1.222117 Aug 27 02:52:34.782365 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2007/4213] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:33 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:34.789287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:34.793722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:34.796570 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-941fc66c-8a02-4aa0-b57f-726b167330e9 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759" status: 200 len: 1366 microversion: 2.47 time: 0.190902 Aug 27 02:52:34.801284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7ab859d3-0d03-4c64-95a3-f001c797e698 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:34.802856 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2207/4214] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:34 2022] GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7ab859d3-0d03-4c64-95a3-f001c797e698 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: request: PUT /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f HTTP/1.1 Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 24 Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": ""}} Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '58f7ed66-f5a7-42ec-be91-bd5a08981d8f', 'body': {'server': {'name': ''}}} Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi '' Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:52:34.811966 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7ab859d3-0d03-4c64-95a3-f001c797e698 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7ab859d3-0d03-4c64-95a3-f001c797e698 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "PUT /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 400 len: 108 microversion: 2.1 time: 0.016561 Aug 27 02:52:34.821956 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2008/4215] 10.222.0.99 () {60 vars in 1256 bytes} [Sat Aug 27 02:52:34 2022] PUT /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:52:34.830615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d2b5f553-0dbe-4455-b227-99f7b807a2a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:34.835417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d2b5f553-0dbe-4455-b227-99f7b807a2a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:34.850250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b5f553-0dbe-4455-b227-99f7b807a2a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.855762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b5f553-0dbe-4455-b227-99f7b807a2a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.861758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b5f553-0dbe-4455-b227-99f7b807a2a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:34.863398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b5f553-0dbe-4455-b227-99f7b807a2a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:34.864133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b5f553-0dbe-4455-b227-99f7b807a2a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:34.869561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b5f553-0dbe-4455-b227-99f7b807a2a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.035848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6c746af6-a7b9-4062-ac3e-10be1050703b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:35.036774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6c746af6-a7b9-4062-ac3e-10be1050703b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:35.051168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c746af6-a7b9-4062-ac3e-10be1050703b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.062886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c746af6-a7b9-4062-ac3e-10be1050703b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.063352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c746af6-a7b9-4062-ac3e-10be1050703b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.064128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c746af6-a7b9-4062-ac3e-10be1050703b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.064769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c746af6-a7b9-4062-ac3e-10be1050703b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.065217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c746af6-a7b9-4062-ac3e-10be1050703b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.089869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d2b5f553-0dbe-4455-b227-99f7b807a2a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:35.114032 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d2b5f553-0dbe-4455-b227-99f7b807a2a9 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1504 microversion: 2.1 time: 0.288138 Aug 27 02:52:35.117561 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2208/4216] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:34 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:35.381622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9317077b-148d-40a8-9436-3287a08fd820 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:35.382355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9317077b-148d-40a8-9436-3287a08fd820 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:35.402987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9317077b-148d-40a8-9436-3287a08fd820 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.406110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9317077b-148d-40a8-9436-3287a08fd820 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.406988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9317077b-148d-40a8-9436-3287a08fd820 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.408463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9317077b-148d-40a8-9436-3287a08fd820 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.414099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9317077b-148d-40a8-9436-3287a08fd820 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.414968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9317077b-148d-40a8-9436-3287a08fd820 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.464520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6c746af6-a7b9-4062-ac3e-10be1050703b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:35.473589 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6c746af6-a7b9-4062-ac3e-10be1050703b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1314 microversion: 2.1 time: 0.442047 Aug 27 02:52:35.476158 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2009/4217] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:35 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:35.624929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-98f0900a-f2fb-44d4-b561-f2edf66a358d tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:35.625877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-98f0900a-f2fb-44d4-b561-f2edf66a358d tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:35.637389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9317077b-148d-40a8-9436-3287a08fd820 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:35.639668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98f0900a-f2fb-44d4-b561-f2edf66a358d tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.642382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98f0900a-f2fb-44d4-b561-f2edf66a358d tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.643611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98f0900a-f2fb-44d4-b561-f2edf66a358d tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.644777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98f0900a-f2fb-44d4-b561-f2edf66a358d tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.648383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98f0900a-f2fb-44d4-b561-f2edf66a358d tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.649595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98f0900a-f2fb-44d4-b561-f2edf66a358d tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.649883 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9317077b-148d-40a8-9436-3287a08fd820 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.272909 Aug 27 02:52:35.652557 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2209/4218] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:35 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:35.817588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-98f0900a-f2fb-44d4-b561-f2edf66a358d tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:35.836133 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-98f0900a-f2fb-44d4-b561-f2edf66a358d tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1237 microversion: 2.1 time: 0.217679 Aug 27 02:52:35.836970 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2010/4219] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:35 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1237 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:35.843613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:35.844585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:35.869989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.870501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.872846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.873814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:35.874355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:35.877552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:35.998582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:36.012486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:36.015534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97b5e531d3004f42af47671a0255fabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd95aab9bfc94fc0a3c1dfa4d1127830', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:36.018936 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4b807677-20e7-4746-9a9e-8a79c0b53ccc tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759" status: 200 len: 1366 microversion: 2.47 time: 0.189051 Aug 27 02:52:36.023028 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2210/4220] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:35 2022] GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:52:36.504508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c680fec9-2102-41f1-bb07-10e9042885cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:36.505145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c680fec9-2102-41f1-bb07-10e9042885cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:36.515656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c680fec9-2102-41f1-bb07-10e9042885cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.516154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c680fec9-2102-41f1-bb07-10e9042885cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.516598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c680fec9-2102-41f1-bb07-10e9042885cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.517317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c680fec9-2102-41f1-bb07-10e9042885cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.532523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c680fec9-2102-41f1-bb07-10e9042885cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.533173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c680fec9-2102-41f1-bb07-10e9042885cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.674886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bb8a2126-4201-4e69-b80a-c3e0a213e0cb tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:36.676108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bb8a2126-4201-4e69-b80a-c3e0a213e0cb tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:36.700012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8a2126-4201-4e69-b80a-c3e0a213e0cb tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.703784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8a2126-4201-4e69-b80a-c3e0a213e0cb tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.705255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8a2126-4201-4e69-b80a-c3e0a213e0cb tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:36.712454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8a2126-4201-4e69-b80a-c3e0a213e0cb tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:36.713597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8a2126-4201-4e69-b80a-c3e0a213e0cb tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:36.715621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb8a2126-4201-4e69-b80a-c3e0a213e0cb tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.068053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb8a2126-4201-4e69-b80a-c3e0a213e0cb tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:37.081278 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bb8a2126-4201-4e69-b80a-c3e0a213e0cb tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.411469 Aug 27 02:52:37.093708 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2211/4221] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:36 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:37.094186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-cca0bf3e-f639-456d-b138-40321f4af111 req-c77cee93-1de1-4797-a18e-994689769f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e181b7bb-e89e-413d-9879-818eb731e6f5", "name": "network-vif-plugged", "status": "completed", "tag": "9021c40e-8a77-4f06-88e7-6eab99971e9b"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:37.134840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cca0bf3e-f639-456d-b138-40321f4af111 req-c77cee93-1de1-4797-a18e-994689769f6d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.135663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cca0bf3e-f639-456d-b138-40321f4af111 req-c77cee93-1de1-4797-a18e-994689769f6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.136118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cca0bf3e-f639-456d-b138-40321f4af111 req-c77cee93-1de1-4797-a18e-994689769f6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.156101 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-cca0bf3e-f639-456d-b138-40321f4af111 req-c77cee93-1de1-4797-a18e-994689769f6d service nova] Creating event network-vif-plugged:9021c40e-8a77-4f06-88e7-6eab99971e9b for instance e181b7bb-e89e-413d-9879-818eb731e6f5 on n-h1-852084-5 Aug 27 02:52:37.162882 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-cca0bf3e-f639-456d-b138-40321f4af111 req-c77cee93-1de1-4797-a18e-994689769f6d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078171 Aug 27 02:52:37.169994 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2212/4222] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:37.176904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-10104c4c-904b-47cf-b60f-e9d849ae94c5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:37.178162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-10104c4c-904b-47cf-b60f-e9d849ae94c5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:37.189132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10104c4c-904b-47cf-b60f-e9d849ae94c5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.189831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10104c4c-904b-47cf-b60f-e9d849ae94c5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.190284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10104c4c-904b-47cf-b60f-e9d849ae94c5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.191324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10104c4c-904b-47cf-b60f-e9d849ae94c5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.191912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10104c4c-904b-47cf-b60f-e9d849ae94c5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.192871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10104c4c-904b-47cf-b60f-e9d849ae94c5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.360919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-10104c4c-904b-47cf-b60f-e9d849ae94c5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:37.378908 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-10104c4c-904b-47cf-b60f-e9d849ae94c5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1237 microversion: 2.1 time: 0.207047 Aug 27 02:52:37.381374 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2213/4223] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:37 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1237 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:37.420933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:37.422089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] [instance: 5dc91551-6fad-46d9-b75e-35146fddc759] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:37.430072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c680fec9-2102-41f1-bb07-10e9042885cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:37.447433 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c680fec9-2102-41f1-bb07-10e9042885cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1314 microversion: 2.1 time: 0.951232 Aug 27 02:52:37.452317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.452829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.453279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.454137 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2011/4224] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:36 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1314 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:37.463831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:37.465869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:37.468726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:37.509978 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] HTTP exception thrown: Instance 5dc91551-6fad-46d9-b75e-35146fddc759 could not be found. Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Request method failure captured: Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759 HTTP/1.1 Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYboSQKG_7RZMe6PFIaAZ6R-3lQsti5nYrl1Q-SBL4cX2J5UMpTv_-lPZQQ9ThC6A7Ku13XI0SA9U851Lvd0UuJn_pC1cunTcDEjDsT_0_T1JHEvnlCImxuXmZwXZD6w3wePDy8V3qQO_rCr65fbPvx9bAHlU8Ghynx6oDiFULcilr8 Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: dd95aab9bfc94fc0a3c1dfa4d1127830 Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAaction247Test-1359161903 Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_dd95aab9bfc94fc0a3c1dfa4d1127830"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd95aab9bfc94fc0a3c1dfa4d1127830"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/dd95aab9bfc94fc0a3c1dfa4d1127830"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/dd95aab9bfc94fc0a3c1dfa4d1127830"}]}] Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAaction247Test-1359161903 Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: dd95aab9bfc94fc0a3c1dfa4d1127830 Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAaction247Test-1359161903 Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAaction247Test-1359161903-project Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 97b5e531d3004f42af47671a0255fabb Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAaction247Test-1359161903-project Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 5dc91551-6fad-46d9-b75e-35146fddc759 could not be found. Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '5dc91551-6fad-46d9-b75e-35146fddc759'} Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc91551-6fad-46d9-b75e-35146fddc759 could not be found. Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc91551-6fad-46d9-b75e-35146fddc759 could not be found. Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:37.511380 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:37.518492 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:37.518492 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:37.518492 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:37.518492 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:37.518492 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:37.518492 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:37.518492 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc91551-6fad-46d9-b75e-35146fddc759 could not be found. Aug 27 02:52:37.518492 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:37.518492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] Returning 404 to user: Instance 5dc91551-6fad-46d9-b75e-35146fddc759 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:37.518492 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-20a2eab5-0e87-4998-b71c-de127c22d1a2 tempest-ServersAaction247Test-1359161903 tempest-ServersAaction247Test-1359161903-project] 10.222.0.99 "GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759" status: 404 len: 111 microversion: 2.47 time: 0.113180 Aug 27 02:52:37.521150 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2214/4225] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:52:37 2022] GET /compute/v2.1/servers/5dc91551-6fad-46d9-b75e-35146fddc759 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:52:38.107204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-084317b0-faf9-4f92-8c2a-e4a13654a83c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:38.108868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-084317b0-faf9-4f92-8c2a-e4a13654a83c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:38.121583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-084317b0-faf9-4f92-8c2a-e4a13654a83c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:38.138827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-084317b0-faf9-4f92-8c2a-e4a13654a83c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:38.141052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-084317b0-faf9-4f92-8c2a-e4a13654a83c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:38.142976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-084317b0-faf9-4f92-8c2a-e4a13654a83c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:38.147989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-084317b0-faf9-4f92-8c2a-e4a13654a83c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:38.148697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-084317b0-faf9-4f92-8c2a-e4a13654a83c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:38.411971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a028d32c-5ddf-415f-8f68-c85faec08029 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:38.413199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a028d32c-5ddf-415f-8f68-c85faec08029 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:38.451465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a028d32c-5ddf-415f-8f68-c85faec08029 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:38.464598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a028d32c-5ddf-415f-8f68-c85faec08029 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:38.468478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a028d32c-5ddf-415f-8f68-c85faec08029 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:38.481009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a028d32c-5ddf-415f-8f68-c85faec08029 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:38.481009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a028d32c-5ddf-415f-8f68-c85faec08029 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:38.481009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a028d32c-5ddf-415f-8f68-c85faec08029 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:38.912376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-084317b0-faf9-4f92-8c2a-e4a13654a83c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:38.929195 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-084317b0-faf9-4f92-8c2a-e4a13654a83c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.825799 Aug 27 02:52:38.932719 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2012/4226] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:38 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:38.954086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2fb757d6-4a26-4c97-b2be-12c0bcc55f3e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:38.955121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2fb757d6-4a26-4c97-b2be-12c0bcc55f3e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:38.971674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb757d6-4a26-4c97-b2be-12c0bcc55f3e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:38.972181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb757d6-4a26-4c97-b2be-12c0bcc55f3e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:38.977142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb757d6-4a26-4c97-b2be-12c0bcc55f3e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:38.978426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb757d6-4a26-4c97-b2be-12c0bcc55f3e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:38.979594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb757d6-4a26-4c97-b2be-12c0bcc55f3e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:38.980371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2fb757d6-4a26-4c97-b2be-12c0bcc55f3e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:39.190029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a028d32c-5ddf-415f-8f68-c85faec08029 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:39.236844 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a028d32c-5ddf-415f-8f68-c85faec08029 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1305 microversion: 2.1 time: 0.837287 Aug 27 02:52:39.247168 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2215/4227] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:38 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1305 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:39.890993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11b71c06-01de-4ad5-a11c-abb3f16f3c7b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:39.892539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-11b71c06-01de-4ad5-a11c-abb3f16f3c7b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:39.912162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11b71c06-01de-4ad5-a11c-abb3f16f3c7b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:39.915747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11b71c06-01de-4ad5-a11c-abb3f16f3c7b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:39.917291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11b71c06-01de-4ad5-a11c-abb3f16f3c7b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:39.924260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11b71c06-01de-4ad5-a11c-abb3f16f3c7b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:39.925347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11b71c06-01de-4ad5-a11c-abb3f16f3c7b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:39.926495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11b71c06-01de-4ad5-a11c-abb3f16f3c7b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.208365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-11b71c06-01de-4ad5-a11c-abb3f16f3c7b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lazy-loading 'services' on Instance uuid 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:52:40.231879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2fb757d6-4a26-4c97-b2be-12c0bcc55f3e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:40.246524 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2fb757d6-4a26-4c97-b2be-12c0bcc55f3e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1314 microversion: 2.1 time: 1.310910 Aug 27 02:52:40.248999 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2013/4228] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:38 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1314 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:40.268544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b400c5b-ad4f-44e9-9d86-17d1f6e158a5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:40.270166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4b400c5b-ad4f-44e9-9d86-17d1f6e158a5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:40.279789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b400c5b-ad4f-44e9-9d86-17d1f6e158a5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.284170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b400c5b-ad4f-44e9-9d86-17d1f6e158a5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.285921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b400c5b-ad4f-44e9-9d86-17d1f6e158a5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.287019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b400c5b-ad4f-44e9-9d86-17d1f6e158a5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.288376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b400c5b-ad4f-44e9-9d86-17d1f6e158a5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.289350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b400c5b-ad4f-44e9-9d86-17d1f6e158a5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.469098 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11b71c06-01de-4ad5-a11c-abb3f16f3c7b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/os-volume_attachments/07903472-43bb-41d8-9c44-dc3c65770fce" status: 202 len: 0 microversion: 2.1 time: 0.581423 Aug 27 02:52:40.470533 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2216/4229] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 02:52:39 2022] DELETE /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/os-volume_attachments/07903472-43bb-41d8-9c44-dc3c65770fce => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:52:40.492343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-49a5cfba-e818-4fda-8858-909218bcb9cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:40.505563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-49a5cfba-e818-4fda-8858-909218bcb9cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:40.530328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49a5cfba-e818-4fda-8858-909218bcb9cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.535493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49a5cfba-e818-4fda-8858-909218bcb9cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.539034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49a5cfba-e818-4fda-8858-909218bcb9cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.542095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49a5cfba-e818-4fda-8858-909218bcb9cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:40.548255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49a5cfba-e818-4fda-8858-909218bcb9cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:40.551167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49a5cfba-e818-4fda-8858-909218bcb9cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:40.866294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4b400c5b-ad4f-44e9-9d86-17d1f6e158a5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:40.884484 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4b400c5b-ad4f-44e9-9d86-17d1f6e158a5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.624540 Aug 27 02:52:40.885817 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2014/4230] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:40 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:40.895932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-732514067", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:40.939656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:41.014847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:52:41.152653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-49a5cfba-e818-4fda-8858-909218bcb9cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:41.163688 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-49a5cfba-e818-4fda-8858-909218bcb9cd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1305 microversion: 2.1 time: 0.688740 Aug 27 02:52:41.164664 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2217/4231] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:40 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1305 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:41.225931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2b538468-c455-455a-91fb-e961ded4d913 req-8d448431-358f-4e8a-af1c-c61155bdcea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80abc4a0-849e-4542-8318-42dd3c227e53", "tag": "7bf0553a-d66f-45ed-8f0b-087c727c1239"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:41.246949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b538468-c455-455a-91fb-e961ded4d913 req-8d448431-358f-4e8a-af1c-c61155bdcea5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.255737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b538468-c455-455a-91fb-e961ded4d913 req-8d448431-358f-4e8a-af1c-c61155bdcea5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.263160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b538468-c455-455a-91fb-e961ded4d913 req-8d448431-358f-4e8a-af1c-c61155bdcea5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.320575 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2b538468-c455-455a-91fb-e961ded4d913 req-8d448431-358f-4e8a-af1c-c61155bdcea5 service nova] Creating event network-changed:7bf0553a-d66f-45ed-8f0b-087c727c1239 for instance 80abc4a0-849e-4542-8318-42dd3c227e53 on n-h1-852084-5 Aug 27 02:52:41.328604 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2b538468-c455-455a-91fb-e961ded4d913 req-8d448431-358f-4e8a-af1c-c61155bdcea5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105663 Aug 27 02:52:41.330135 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2218/4232] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:52:41.337087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c89fd99-109c-47ac-a685-770a756d9022 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:41.338043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3c89fd99-109c-47ac-a685-770a756d9022 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:41.346927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c89fd99-109c-47ac-a685-770a756d9022 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.347712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c89fd99-109c-47ac-a685-770a756d9022 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.348334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c89fd99-109c-47ac-a685-770a756d9022 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.349482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c89fd99-109c-47ac-a685-770a756d9022 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.350569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c89fd99-109c-47ac-a685-770a756d9022 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.351864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c89fd99-109c-47ac-a685-770a756d9022 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.548750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3c89fd99-109c-47ac-a685-770a756d9022 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:41.558396 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3c89fd99-109c-47ac-a685-770a756d9022 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1500 microversion: 2.1 time: 0.226778 Aug 27 02:52:41.561749 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2219/4233] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:41 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1500 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:41.728991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:41.729491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:41.729921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:41.730336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:41.730758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:41.756498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.757000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.757445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.758238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.758707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.759145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.837252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Getting quotas for project fd36ee303d1d4f1eadcbcbf007362a80. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:41.847202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Getting quotas for user 4e1bb177ca144a83b3d45a12cd6c87fe and project fd36ee303d1d4f1eadcbcbf007362a80. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:41.866666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:41.869995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:41.911225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e22a3936-51b6-49a9-8170-8641462d0e09 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:41.912205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e22a3936-51b6-49a9-8170-8641462d0e09 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:41.922611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=26 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:41.927227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e22a3936-51b6-49a9-8170-8641462d0e09 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.928026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e22a3936-51b6-49a9-8170-8641462d0e09 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.928676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e22a3936-51b6-49a9-8170-8641462d0e09 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.935425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e22a3936-51b6-49a9-8170-8641462d0e09 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:41.938523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e22a3936-51b6-49a9-8170-8641462d0e09 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:41.941757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e22a3936-51b6-49a9-8170-8641462d0e09 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:41.982387 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-849355da-d947-44ed-a011-ac1ec7f3066b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.094987 Aug 27 02:52:41.983607 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2015/4234] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:52:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:52:42.000420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-36941afc-ac91-475d-8041-ef493dc1c05b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:42.010608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-36941afc-ac91-475d-8041-ef493dc1c05b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:42.221622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-36941afc-ac91-475d-8041-ef493dc1c05b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:42.230248 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-36941afc-ac91-475d-8041-ef493dc1c05b tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1213 microversion: 2.1 time: 0.236605 Aug 27 02:52:42.242672 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2016/4235] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:41 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1213 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:42.251476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b5d96f0-fe6f-46dd-b0a7-cc09e34e29b4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:42.253619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b5d96f0-fe6f-46dd-b0a7-cc09e34e29b4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:42.267170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b5d96f0-fe6f-46dd-b0a7-cc09e34e29b4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:42.267667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b5d96f0-fe6f-46dd-b0a7-cc09e34e29b4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:42.268107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b5d96f0-fe6f-46dd-b0a7-cc09e34e29b4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:42.268822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b5d96f0-fe6f-46dd-b0a7-cc09e34e29b4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:42.280467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b5d96f0-fe6f-46dd-b0a7-cc09e34e29b4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:42.280956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b5d96f0-fe6f-46dd-b0a7-cc09e34e29b4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:42.418417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e22a3936-51b6-49a9-8170-8641462d0e09 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:42.427113 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e22a3936-51b6-49a9-8170-8641462d0e09 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.520554 Aug 27 02:52:42.427730 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2220/4236] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:41 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:42.781842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5b5d96f0-fe6f-46dd-b0a7-cc09e34e29b4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:42.799786 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5b5d96f0-fe6f-46dd-b0a7-cc09e34e29b4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1305 microversion: 2.1 time: 0.562929 Aug 27 02:52:42.802819 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2017/4237] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:42 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1305 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:43.259077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9e87d690-6d5c-4a80-a815-38894019766d tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:43.259699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9e87d690-6d5c-4a80-a815-38894019766d tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:43.272102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e87d690-6d5c-4a80-a815-38894019766d tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:43.272602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e87d690-6d5c-4a80-a815-38894019766d tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:43.273051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e87d690-6d5c-4a80-a815-38894019766d tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:43.273816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e87d690-6d5c-4a80-a815-38894019766d tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:43.274281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e87d690-6d5c-4a80-a815-38894019766d tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:43.274712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e87d690-6d5c-4a80-a815-38894019766d tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:43.450311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e13f2e96-7f53-471e-a288-77813b77b35f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:43.450951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e13f2e96-7f53-471e-a288-77813b77b35f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:43.468998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e13f2e96-7f53-471e-a288-77813b77b35f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:43.469645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e13f2e96-7f53-471e-a288-77813b77b35f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:43.470129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e13f2e96-7f53-471e-a288-77813b77b35f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:43.470870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e13f2e96-7f53-471e-a288-77813b77b35f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:43.473719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e13f2e96-7f53-471e-a288-77813b77b35f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:43.477743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e13f2e96-7f53-471e-a288-77813b77b35f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:43.985230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9e87d690-6d5c-4a80-a815-38894019766d tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:44.027489 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9e87d690-6d5c-4a80-a815-38894019766d tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1209 microversion: 2.1 time: 0.772108 Aug 27 02:52:44.038847 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2221/4238] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:43 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1209 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:44.043738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7260e8b3-7cd1-4121-950a-27fcda9479a4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:44.044360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7260e8b3-7cd1-4121-950a-27fcda9479a4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:44.074157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7260e8b3-7cd1-4121-950a-27fcda9479a4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.074656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7260e8b3-7cd1-4121-950a-27fcda9479a4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.079222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7260e8b3-7cd1-4121-950a-27fcda9479a4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.080208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7260e8b3-7cd1-4121-950a-27fcda9479a4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:44.080906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7260e8b3-7cd1-4121-950a-27fcda9479a4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:44.083515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7260e8b3-7cd1-4121-950a-27fcda9479a4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:44.106468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e13f2e96-7f53-471e-a288-77813b77b35f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:44.120571 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e13f2e96-7f53-471e-a288-77813b77b35f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.675824 Aug 27 02:52:44.135069 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2018/4239] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:43 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:44.668304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7260e8b3-7cd1-4121-950a-27fcda9479a4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:44.689241 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7260e8b3-7cd1-4121-950a-27fcda9479a4 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1305 microversion: 2.1 time: 0.648771 Aug 27 02:52:44.693340 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2222/4240] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:44 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1305 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:45.070536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ffcbf0e1-02b3-4557-9a43-77ada6d15083 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:45.071769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ffcbf0e1-02b3-4557-9a43-77ada6d15083 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:45.114224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffcbf0e1-02b3-4557-9a43-77ada6d15083 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.114908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffcbf0e1-02b3-4557-9a43-77ada6d15083 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.117064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffcbf0e1-02b3-4557-9a43-77ada6d15083 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.121273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffcbf0e1-02b3-4557-9a43-77ada6d15083 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.122400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffcbf0e1-02b3-4557-9a43-77ada6d15083 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.126175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffcbf0e1-02b3-4557-9a43-77ada6d15083 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.143683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-99048a79-bca5-4cfc-b708-0421b30256a0 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:45.144314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-99048a79-bca5-4cfc-b708-0421b30256a0 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:45.161433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99048a79-bca5-4cfc-b708-0421b30256a0 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.171042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99048a79-bca5-4cfc-b708-0421b30256a0 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.171787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99048a79-bca5-4cfc-b708-0421b30256a0 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.172851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99048a79-bca5-4cfc-b708-0421b30256a0 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.173474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99048a79-bca5-4cfc-b708-0421b30256a0 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.174074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-99048a79-bca5-4cfc-b708-0421b30256a0 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.301409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ffcbf0e1-02b3-4557-9a43-77ada6d15083 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:45.317519 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ffcbf0e1-02b3-4557-9a43-77ada6d15083 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1271 microversion: 2.1 time: 0.252053 Aug 27 02:52:45.318222 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2019/4241] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:45 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:45.716503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f91993cc-e98e-4046-b4be-3575a4d0103b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:45.717174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f91993cc-e98e-4046-b4be-3575a4d0103b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:45.737266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f91993cc-e98e-4046-b4be-3575a4d0103b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.740520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f91993cc-e98e-4046-b4be-3575a4d0103b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.744627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f91993cc-e98e-4046-b4be-3575a4d0103b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:45.750420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f91993cc-e98e-4046-b4be-3575a4d0103b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:45.754481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f91993cc-e98e-4046-b4be-3575a4d0103b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:45.755331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f91993cc-e98e-4046-b4be-3575a4d0103b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.077327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-99048a79-bca5-4cfc-b708-0421b30256a0 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:46.114008 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-99048a79-bca5-4cfc-b708-0421b30256a0 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1486 microversion: 2.1 time: 0.974006 Aug 27 02:52:46.122700 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2223/4242] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:45 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1486 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:46.150480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3a9289e7-5cb5-4424-a9cc-7eef1e162540 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:46.153736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3a9289e7-5cb5-4424-a9cc-7eef1e162540 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:46.174863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a9289e7-5cb5-4424-a9cc-7eef1e162540 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:46.175430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a9289e7-5cb5-4424-a9cc-7eef1e162540 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:46.175925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a9289e7-5cb5-4424-a9cc-7eef1e162540 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.176831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a9289e7-5cb5-4424-a9cc-7eef1e162540 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:46.177452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a9289e7-5cb5-4424-a9cc-7eef1e162540 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:46.178101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3a9289e7-5cb5-4424-a9cc-7eef1e162540 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.183460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:46.253376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f91993cc-e98e-4046-b4be-3575a4d0103b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:46.276631 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f91993cc-e98e-4046-b4be-3575a4d0103b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1293 microversion: 2.1 time: 0.562700 Aug 27 02:52:46.278370 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2020/4243] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:45 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1293 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:46.354198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b8649e2-4df7-4b7d-be68-6f60f786a0c8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:46.354838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4b8649e2-4df7-4b7d-be68-6f60f786a0c8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:46.357011 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3a9289e7-5cb5-4424-a9cc-7eef1e162540 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "POST /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b/action" status: 202 len: 0 microversion: 2.1 time: 0.215904 Aug 27 02:52:46.360977 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2224/4244] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:46 2022] POST /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:52:46.377076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8649e2-4df7-4b7d-be68-6f60f786a0c8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:46.377739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8649e2-4df7-4b7d-be68-6f60f786a0c8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:46.378786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c787e85a-4bb3-48d1-b871-f2c1597751a2 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:46.379467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8649e2-4df7-4b7d-be68-6f60f786a0c8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.381899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c787e85a-4bb3-48d1-b871-f2c1597751a2 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:46.394354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8649e2-4df7-4b7d-be68-6f60f786a0c8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:46.395499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8649e2-4df7-4b7d-be68-6f60f786a0c8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:46.395983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8649e2-4df7-4b7d-be68-6f60f786a0c8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.396337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c787e85a-4bb3-48d1-b871-f2c1597751a2 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:46.399052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c787e85a-4bb3-48d1-b871-f2c1597751a2 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:46.399598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c787e85a-4bb3-48d1-b871-f2c1597751a2 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.400370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c787e85a-4bb3-48d1-b871-f2c1597751a2 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:46.400879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c787e85a-4bb3-48d1-b871-f2c1597751a2 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:46.405719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c787e85a-4bb3-48d1-b871-f2c1597751a2 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:46.735750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4b8649e2-4df7-4b7d-be68-6f60f786a0c8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:46.744735 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4b8649e2-4df7-4b7d-be68-6f60f786a0c8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1271 microversion: 2.1 time: 0.398951 Aug 27 02:52:46.760472 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2021/4245] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:46 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1271 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:47.190298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c787e85a-4bb3-48d1-b871-f2c1597751a2 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:47.210235 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c787e85a-4bb3-48d1-b871-f2c1597751a2 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1494 microversion: 2.1 time: 0.844116 Aug 27 02:52:47.213334 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2225/4246] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:46 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1494 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:47.322350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-699ee41d-fe37-420b-8d77-9be9b4f5cb1b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:47.323559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-699ee41d-fe37-420b-8d77-9be9b4f5cb1b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:47.342121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-699ee41d-fe37-420b-8d77-9be9b4f5cb1b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.343639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-699ee41d-fe37-420b-8d77-9be9b4f5cb1b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.345326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-699ee41d-fe37-420b-8d77-9be9b4f5cb1b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.348302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-699ee41d-fe37-420b-8d77-9be9b4f5cb1b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.358308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-699ee41d-fe37-420b-8d77-9be9b4f5cb1b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.371014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-699ee41d-fe37-420b-8d77-9be9b4f5cb1b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.680573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f9e3357b-729a-498e-b6df-f971a77ba8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e6c0c0b-c858-47c3-b6fc-20ec817bc97c"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:47.683787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f9e3357b-729a-498e-b6df-f971a77ba8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:47.716469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9e3357b-729a-498e-b6df-f971a77ba8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.719862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9e3357b-729a-498e-b6df-f971a77ba8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.721448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9e3357b-729a-498e-b6df-f971a77ba8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:47.748835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9e3357b-729a-498e-b6df-f971a77ba8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:47.749546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9e3357b-729a-498e-b6df-f971a77ba8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:47.750142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9e3357b-729a-498e-b6df-f971a77ba8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.328900 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f9e3357b-729a-498e-b6df-f971a77ba8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.661389 Aug 27 02:52:48.331902 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2226/4247] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 02:52:47 2022] POST /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5/os-volume_attachments => generated 194 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:48.356364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4fbabacb-b59d-4917-9e26-255716d1b12c tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:48.357540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4fbabacb-b59d-4917-9e26-255716d1b12c tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:48.374788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fbabacb-b59d-4917-9e26-255716d1b12c tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.376026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fbabacb-b59d-4917-9e26-255716d1b12c tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.377078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fbabacb-b59d-4917-9e26-255716d1b12c tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.379513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fbabacb-b59d-4917-9e26-255716d1b12c tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.380173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fbabacb-b59d-4917-9e26-255716d1b12c tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.382234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fbabacb-b59d-4917-9e26-255716d1b12c tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.400831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-699ee41d-fe37-420b-8d77-9be9b4f5cb1b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:48.420675 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-699ee41d-fe37-420b-8d77-9be9b4f5cb1b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1293 microversion: 2.1 time: 1.111725 Aug 27 02:52:48.424742 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2022/4248] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:47 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1293 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:48.448342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0fe69857-c831-4913-a069-e3a2a8bc723c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:48.450177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0fe69857-c831-4913-a069-e3a2a8bc723c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:48.467912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fe69857-c831-4913-a069-e3a2a8bc723c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.468680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fe69857-c831-4913-a069-e3a2a8bc723c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.470674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fe69857-c831-4913-a069-e3a2a8bc723c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.471595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fe69857-c831-4913-a069-e3a2a8bc723c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:48.473243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fe69857-c831-4913-a069-e3a2a8bc723c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:48.473870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fe69857-c831-4913-a069-e3a2a8bc723c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:48.717720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4fbabacb-b59d-4917-9e26-255716d1b12c tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:48.735198 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4fbabacb-b59d-4917-9e26-255716d1b12c tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1313 microversion: 2.1 time: 0.401623 Aug 27 02:52:48.736150 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2227/4249] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:48 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:49.075558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0fe69857-c831-4913-a069-e3a2a8bc723c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:49.090749 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0fe69857-c831-4913-a069-e3a2a8bc723c tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1494 microversion: 2.1 time: 0.662213 Aug 27 02:52:49.108450 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2023/4250] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:48 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1494 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:49.462336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-76bfafc0-50cb-420b-89f3-771463b841ab tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:49.469219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-76bfafc0-50cb-420b-89f3-771463b841ab tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:49.490604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76bfafc0-50cb-420b-89f3-771463b841ab tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.493197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76bfafc0-50cb-420b-89f3-771463b841ab tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.495012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76bfafc0-50cb-420b-89f3-771463b841ab tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.496323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76bfafc0-50cb-420b-89f3-771463b841ab tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.502749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76bfafc0-50cb-420b-89f3-771463b841ab tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.504260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76bfafc0-50cb-420b-89f3-771463b841ab tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.530254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-407ae248-4a0a-43d9-9f8e-59b2fc68e895 req-58ed1873-981d-41f2-a63f-a83692e35963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a", "tag": "35c22ead-5aad-415f-a079-665b8e261a4b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:49.558925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-407ae248-4a0a-43d9-9f8e-59b2fc68e895 req-58ed1873-981d-41f2-a63f-a83692e35963 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.563968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-407ae248-4a0a-43d9-9f8e-59b2fc68e895 req-58ed1873-981d-41f2-a63f-a83692e35963 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.566072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-407ae248-4a0a-43d9-9f8e-59b2fc68e895 req-58ed1873-981d-41f2-a63f-a83692e35963 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.609471 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-407ae248-4a0a-43d9-9f8e-59b2fc68e895 req-58ed1873-981d-41f2-a63f-a83692e35963 service nova] Creating event network-changed:35c22ead-5aad-415f-a079-665b8e261a4b for instance 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a on n-h2-852084-5 Aug 27 02:52:49.624291 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-407ae248-4a0a-43d9-9f8e-59b2fc68e895 req-58ed1873-981d-41f2-a63f-a83692e35963 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096474 Aug 27 02:52:49.625350 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2024/4251] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:52:49.758080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a74fc7c-8f16-447d-80e7-46167592d6c7 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:49.758312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a74fc7c-8f16-447d-80e7-46167592d6c7 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:49.774046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a74fc7c-8f16-447d-80e7-46167592d6c7 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.774894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a74fc7c-8f16-447d-80e7-46167592d6c7 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.775544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a74fc7c-8f16-447d-80e7-46167592d6c7 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.777935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a74fc7c-8f16-447d-80e7-46167592d6c7 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:49.794230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a74fc7c-8f16-447d-80e7-46167592d6c7 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:49.795139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a74fc7c-8f16-447d-80e7-46167592d6c7 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:49.871221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-76bfafc0-50cb-420b-89f3-771463b841ab tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:49.893010 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-76bfafc0-50cb-420b-89f3-771463b841ab tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1293 microversion: 2.1 time: 0.443325 Aug 27 02:52:49.895981 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2228/4252] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:49 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1293 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:50.118597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cf835033-f6e5-42dc-9757-e8a9ac12c13f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:50.121429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cf835033-f6e5-42dc-9757-e8a9ac12c13f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:50.134701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf835033-f6e5-42dc-9757-e8a9ac12c13f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:50.135487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf835033-f6e5-42dc-9757-e8a9ac12c13f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:50.136089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf835033-f6e5-42dc-9757-e8a9ac12c13f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:50.137007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf835033-f6e5-42dc-9757-e8a9ac12c13f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:50.137686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf835033-f6e5-42dc-9757-e8a9ac12c13f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:50.139680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cf835033-f6e5-42dc-9757-e8a9ac12c13f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:50.737160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a74fc7c-8f16-447d-80e7-46167592d6c7 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:50.739946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cf835033-f6e5-42dc-9757-e8a9ac12c13f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:50.742865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:50.755591 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a74fc7c-8f16-447d-80e7-46167592d6c7 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1313 microversion: 2.1 time: 1.002515 Aug 27 02:52:50.759928 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cf835033-f6e5-42dc-9757-e8a9ac12c13f tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1494 microversion: 2.1 time: 0.645078 Aug 27 02:52:50.774127 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2229/4253] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:50 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1494 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:50.774485 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2025/4254] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:49 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1313 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:50.926555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-59cc360b-a94b-40c9-aac3-888567f85f87 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:50.931889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-59cc360b-a94b-40c9-aac3-888567f85f87 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:50.959097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59cc360b-a94b-40c9-aac3-888567f85f87 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:50.959694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59cc360b-a94b-40c9-aac3-888567f85f87 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:50.960393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59cc360b-a94b-40c9-aac3-888567f85f87 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:50.961562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59cc360b-a94b-40c9-aac3-888567f85f87 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:50.962248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59cc360b-a94b-40c9-aac3-888567f85f87 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:50.963099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59cc360b-a94b-40c9-aac3-888567f85f87 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.329601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-59cc360b-a94b-40c9-aac3-888567f85f87 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:51.359733 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-59cc360b-a94b-40c9-aac3-888567f85f87 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1293 microversion: 2.1 time: 0.441788 Aug 27 02:52:51.369359 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2230/4255] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:50 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1293 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:51.780618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df6424af-557a-4b97-89ba-7561efe76d03 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:51.781925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-df6424af-557a-4b97-89ba-7561efe76d03 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:51.787775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e1945e90-d8e9-4c43-a451-a37a0534b2a1 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:51.789077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e1945e90-d8e9-4c43-a451-a37a0534b2a1 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:51.795459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:51.809164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df6424af-557a-4b97-89ba-7561efe76d03 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.812261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df6424af-557a-4b97-89ba-7561efe76d03 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.813622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df6424af-557a-4b97-89ba-7561efe76d03 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.817864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df6424af-557a-4b97-89ba-7561efe76d03 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.822362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df6424af-557a-4b97-89ba-7561efe76d03 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.824060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df6424af-557a-4b97-89ba-7561efe76d03 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.825052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1945e90-d8e9-4c43-a451-a37a0534b2a1 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.826837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1945e90-d8e9-4c43-a451-a37a0534b2a1 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.828426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:51.834673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1945e90-d8e9-4c43-a451-a37a0534b2a1 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:51.836491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1945e90-d8e9-4c43-a451-a37a0534b2a1 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:51.837622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1945e90-d8e9-4c43-a451-a37a0534b2a1 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:51.838677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1945e90-d8e9-4c43-a451-a37a0534b2a1 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.084797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e1945e90-d8e9-4c43-a451-a37a0534b2a1 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:52.096285 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e1945e90-d8e9-4c43-a451-a37a0534b2a1 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1313 microversion: 2.1 time: 0.312439 Aug 27 02:52:52.096897 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2231/4256] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:51 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:52.229921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:52.272719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:52.273485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:52.284596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.286775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.289715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.290697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.291872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.295286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.316238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-df6424af-557a-4b97-89ba-7561efe76d03 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:52.335066 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 HTTP/1.1 Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd0b7bec6-d7a4-4b51-b360-a710046d55e8'} Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:52.338018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:52.343573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:52:52.343573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:52.343573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:52.343573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:52.343573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:52.343573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:52.343573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:52.343573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:52.343573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:52.343573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:52:52.343573 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:52.345154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:52.346247 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-279f791d-57e2-4b14-bf50-c0f34123ff52 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 404 len: 111 microversion: 2.1 time: 0.078341 Aug 27 02:52:52.346994 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2232/4257] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:52 2022] DELETE /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:52:52.355171 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-df6424af-557a-4b97-89ba-7561efe76d03 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1500 microversion: 2.1 time: 0.576897 Aug 27 02:52:52.357049 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2026/4258] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:51 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1500 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:52.361739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:52.362347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: d0b7bec6-d7a4-4b51-b360-a710046d55e8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:52.379341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.382701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.388033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.394145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8ce590a-5e58-4c0f-b019-4f6e4c31f25b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:52.395049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e8ce590a-5e58-4c0f-b019-4f6e4c31f25b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:52.399678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.404027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.405831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.412745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8ce590a-5e58-4c0f-b019-4f6e4c31f25b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.414966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8ce590a-5e58-4c0f-b019-4f6e4c31f25b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.417044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8ce590a-5e58-4c0f-b019-4f6e4c31f25b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.421382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8ce590a-5e58-4c0f-b019-4f6e4c31f25b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.422292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8ce590a-5e58-4c0f-b019-4f6e4c31f25b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.430426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8ce590a-5e58-4c0f-b019-4f6e4c31f25b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.465202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 HTTP/1.1 Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd0b7bec6-d7a4-4b51-b360-a710046d55e8'} Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:52.467951 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance d0b7bec6-d7a4-4b51-b360-a710046d55e8 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-27567f8e-0f18-42c6-a606-c9c08711653a tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8" status: 404 len: 111 microversion: 2.1 time: 0.113207 Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2233/4259] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:52 2022] GET /compute/v2.1/servers/d0b7bec6-d7a4-4b51-b360-a710046d55e8 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fa439221-2a80-4eb1-8043-515c40fbe7f5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:52.484031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fa439221-2a80-4eb1-8043-515c40fbe7f5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:52.495632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa439221-2a80-4eb1-8043-515c40fbe7f5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.496209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa439221-2a80-4eb1-8043-515c40fbe7f5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.497922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa439221-2a80-4eb1-8043-515c40fbe7f5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.497922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa439221-2a80-4eb1-8043-515c40fbe7f5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.497922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa439221-2a80-4eb1-8043-515c40fbe7f5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.498397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa439221-2a80-4eb1-8043-515c40fbe7f5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.541062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fa439221-2a80-4eb1-8043-515c40fbe7f5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:52.697975 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fa439221-2a80-4eb1-8043-515c40fbe7f5 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "DELETE /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 204 len: 0 microversion: 2.1 time: 0.224477 Aug 27 02:52:52.699349 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2234/4260] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:52 2022] DELETE /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:52:52.714694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5b9d6f0-17ea-4cd0-a19e-e7a629535401 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:52.715846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c5b9d6f0-17ea-4cd0-a19e-e7a629535401 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:52.724459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5b9d6f0-17ea-4cd0-a19e-e7a629535401 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.725533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5b9d6f0-17ea-4cd0-a19e-e7a629535401 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.726268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5b9d6f0-17ea-4cd0-a19e-e7a629535401 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.727434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5b9d6f0-17ea-4cd0-a19e-e7a629535401 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.728151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5b9d6f0-17ea-4cd0-a19e-e7a629535401 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.728858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5b9d6f0-17ea-4cd0-a19e-e7a629535401 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.770080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c5b9d6f0-17ea-4cd0-a19e-e7a629535401 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:52.907300 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c5b9d6f0-17ea-4cd0-a19e-e7a629535401 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "DELETE /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 204 len: 0 microversion: 2.1 time: 0.201990 Aug 27 02:52:52.912512 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2235/4261] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:52 2022] DELETE /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:52:52.919838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-69ae439d-2fc0-4100-81cf-066e7d39fdbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:52.928962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69ae439d-2fc0-4100-81cf-066e7d39fdbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:52.930953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69ae439d-2fc0-4100-81cf-066e7d39fdbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:52.931642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69ae439d-2fc0-4100-81cf-066e7d39fdbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:52.958774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:52.969305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-69ae439d-2fc0-4100-81cf-066e7d39fdbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Going to try to stop instance {{(pid=122488) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:52:53.051032 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-69ae439d-2fc0-4100-81cf-066e7d39fdbe tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "POST /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/action" status: 202 len: 0 microversion: 2.1 time: 0.134918 Aug 27 02:52:53.055565 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2236/4262] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:52:52 2022] POST /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:52:53.063245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2fbbf885-0a12-465a-9970-2291d447e0d1 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:53.063966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2fbbf885-0a12-465a-9970-2291d447e0d1 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:53.071424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fbbf885-0a12-465a-9970-2291d447e0d1 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.072589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fbbf885-0a12-465a-9970-2291d447e0d1 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.072589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fbbf885-0a12-465a-9970-2291d447e0d1 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.073313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fbbf885-0a12-465a-9970-2291d447e0d1 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.073858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fbbf885-0a12-465a-9970-2291d447e0d1 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.074828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fbbf885-0a12-465a-9970-2291d447e0d1 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.133618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e8ce590a-5e58-4c0f-b019-4f6e4c31f25b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:53.150824 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e8ce590a-5e58-4c0f-b019-4f6e4c31f25b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1293 microversion: 2.1 time: 0.754981 Aug 27 02:52:53.152197 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2027/4263] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:52 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1293 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:53.163612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de9a5d20-313c-4175-8dbb-4b8e16557583 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:53.164545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de9a5d20-313c-4175-8dbb-4b8e16557583 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:53.180196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de9a5d20-313c-4175-8dbb-4b8e16557583 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.180784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de9a5d20-313c-4175-8dbb-4b8e16557583 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.181300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de9a5d20-313c-4175-8dbb-4b8e16557583 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.182435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de9a5d20-313c-4175-8dbb-4b8e16557583 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.183041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de9a5d20-313c-4175-8dbb-4b8e16557583 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.183594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de9a5d20-313c-4175-8dbb-4b8e16557583 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.475965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de9a5d20-313c-4175-8dbb-4b8e16557583 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:53.489707 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de9a5d20-313c-4175-8dbb-4b8e16557583 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1510 microversion: 2.1 time: 0.335051 Aug 27 02:52:53.490334 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2028/4264] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:53 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:53.501096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7dbbbb7f-44a4-4b76-a4ae-6ce92c232326 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:53.505853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7dbbbb7f-44a4-4b76-a4ae-6ce92c232326 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:53.521210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7dbbbb7f-44a4-4b76-a4ae-6ce92c232326 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.522043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7dbbbb7f-44a4-4b76-a4ae-6ce92c232326 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.522691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7dbbbb7f-44a4-4b76-a4ae-6ce92c232326 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.526506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7dbbbb7f-44a4-4b76-a4ae-6ce92c232326 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.527493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7dbbbb7f-44a4-4b76-a4ae-6ce92c232326 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.528110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7dbbbb7f-44a4-4b76-a4ae-6ce92c232326 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.850262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2fbbf885-0a12-465a-9970-2291d447e0d1 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:53.862919 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2fbbf885-0a12-465a-9970-2291d447e0d1 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.805879 Aug 27 02:52:53.863617 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2237/4265] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:53 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:53.886259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d31eeb1-1d73-4abb-a62d-ae8ba1d764f8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:53.886646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9d31eeb1-1d73-4abb-a62d-ae8ba1d764f8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:53.902336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d31eeb1-1d73-4abb-a62d-ae8ba1d764f8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.905388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d31eeb1-1d73-4abb-a62d-ae8ba1d764f8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.909621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d31eeb1-1d73-4abb-a62d-ae8ba1d764f8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:53.912268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d31eeb1-1d73-4abb-a62d-ae8ba1d764f8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:53.916620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d31eeb1-1d73-4abb-a62d-ae8ba1d764f8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:53.918298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d31eeb1-1d73-4abb-a62d-ae8ba1d764f8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.266094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7dbbbb7f-44a4-4b76-a4ae-6ce92c232326 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:54.282409 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7dbbbb7f-44a4-4b76-a4ae-6ce92c232326 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1677 microversion: 2.1 time: 0.786536 Aug 27 02:52:54.282795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9d31eeb1-1d73-4abb-a62d-ae8ba1d764f8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:54.292422 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2029/4266] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:53 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1677 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:54.298038 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9d31eeb1-1d73-4abb-a62d-ae8ba1d764f8 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1313 microversion: 2.1 time: 0.429376 Aug 27 02:52:54.301984 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2238/4267] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:53 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:54.320457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-60e1d370-04a8-4175-8324-23d4b277a7b6 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:54.321188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-60e1d370-04a8-4175-8324-23d4b277a7b6 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:54.330863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60e1d370-04a8-4175-8324-23d4b277a7b6 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.331499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60e1d370-04a8-4175-8324-23d4b277a7b6 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.332025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60e1d370-04a8-4175-8324-23d4b277a7b6 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.333641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60e1d370-04a8-4175-8324-23d4b277a7b6 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.334219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60e1d370-04a8-4175-8324-23d4b277a7b6 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.334728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60e1d370-04a8-4175-8324-23d4b277a7b6 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.521864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d6dbe7ae-7b3f-47f6-bdad-32ff5ddb6236 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:54.522611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d6dbe7ae-7b3f-47f6-bdad-32ff5ddb6236 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:54.542483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6dbe7ae-7b3f-47f6-bdad-32ff5ddb6236 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.543148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6dbe7ae-7b3f-47f6-bdad-32ff5ddb6236 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.546245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6dbe7ae-7b3f-47f6-bdad-32ff5ddb6236 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:54.549958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6dbe7ae-7b3f-47f6-bdad-32ff5ddb6236 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:54.551611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6dbe7ae-7b3f-47f6-bdad-32ff5ddb6236 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:54.552116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6dbe7ae-7b3f-47f6-bdad-32ff5ddb6236 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:55.073649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d6dbe7ae-7b3f-47f6-bdad-32ff5ddb6236 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:55.082550 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d6dbe7ae-7b3f-47f6-bdad-32ff5ddb6236 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1510 microversion: 2.1 time: 0.565062 Aug 27 02:52:55.085990 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2239/4268] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:54 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1510 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:55.098190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-08f8be37-9af5-4ea8-b9ee-f3ee586a3e2d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:55.099574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-08f8be37-9af5-4ea8-b9ee-f3ee586a3e2d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:55.114274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08f8be37-9af5-4ea8-b9ee-f3ee586a3e2d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:55.117327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08f8be37-9af5-4ea8-b9ee-f3ee586a3e2d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:55.118204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08f8be37-9af5-4ea8-b9ee-f3ee586a3e2d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:55.119237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08f8be37-9af5-4ea8-b9ee-f3ee586a3e2d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:55.119977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08f8be37-9af5-4ea8-b9ee-f3ee586a3e2d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:55.120684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08f8be37-9af5-4ea8-b9ee-f3ee586a3e2d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:55.361414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60e1d370-04a8-4175-8324-23d4b277a7b6 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:55.390100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-08f8be37-9af5-4ea8-b9ee-f3ee586a3e2d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:55.409273 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-08f8be37-9af5-4ea8-b9ee-f3ee586a3e2d tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 0.314497 Aug 27 02:52:55.411144 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2240/4269] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:55 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:55.411373 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-60e1d370-04a8-4175-8324-23d4b277a7b6 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1293 microversion: 2.1 time: 1.117375 Aug 27 02:52:55.411743 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2030/4270] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:54 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1293 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:55.418744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3409bfc2-bd5b-4989-860a-cab403bd4c50 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:55.424972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3409bfc2-bd5b-4989-860a-cab403bd4c50 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:55.437698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-be8eccce-d11a-4c11-a5e8-d1041ac9a5b2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:55.437698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-be8eccce-d11a-4c11-a5e8-d1041ac9a5b2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:55.447606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be8eccce-d11a-4c11-a5e8-d1041ac9a5b2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:55.448503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3409bfc2-bd5b-4989-860a-cab403bd4c50 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:55.448693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be8eccce-d11a-4c11-a5e8-d1041ac9a5b2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:55.449572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be8eccce-d11a-4c11-a5e8-d1041ac9a5b2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:55.451395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be8eccce-d11a-4c11-a5e8-d1041ac9a5b2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:55.451733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3409bfc2-bd5b-4989-860a-cab403bd4c50 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:55.452456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be8eccce-d11a-4c11-a5e8-d1041ac9a5b2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:55.453204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be8eccce-d11a-4c11-a5e8-d1041ac9a5b2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:55.454971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3409bfc2-bd5b-4989-860a-cab403bd4c50 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:55.455782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3409bfc2-bd5b-4989-860a-cab403bd4c50 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:55.456277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3409bfc2-bd5b-4989-860a-cab403bd4c50 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:55.458847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3409bfc2-bd5b-4989-860a-cab403bd4c50 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:55.910695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-be8eccce-d11a-4c11-a5e8-d1041ac9a5b2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:55.959109 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-be8eccce-d11a-4c11-a5e8-d1041ac9a5b2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1313 microversion: 2.1 time: 0.539500 Aug 27 02:52:55.960243 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2031/4271] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:55 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:56.128038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c527102-875c-4830-bc52-59906e0e6cba tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:56.128694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c527102-875c-4830-bc52-59906e0e6cba tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:56.154526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c527102-875c-4830-bc52-59906e0e6cba tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.155551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c527102-875c-4830-bc52-59906e0e6cba tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.156199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c527102-875c-4830-bc52-59906e0e6cba tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.157219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c527102-875c-4830-bc52-59906e0e6cba tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.158059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c527102-875c-4830-bc52-59906e0e6cba tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.161124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c527102-875c-4830-bc52-59906e0e6cba tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.469041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2c527102-875c-4830-bc52-59906e0e6cba tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43ce0d2e9a40e99da82044ff843cd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6b3bb36fb84f07a8fb9a38b1a9689b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:56.487114 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c527102-875c-4830-bc52-59906e0e6cba tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 200 len: 1468 microversion: 2.1 time: 0.364966 Aug 27 02:52:56.511724 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2032/4272] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:56 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 1468 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:52:56.540032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3409bfc2-bd5b-4989-860a-cab403bd4c50 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:56.586777 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3409bfc2-bd5b-4989-860a-cab403bd4c50 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1677 microversion: 2.1 time: 1.173532 Aug 27 02:52:56.593314 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2241/4273] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:55 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1677 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:56.633273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ef73f851-a815-48d3-ae15-9778e431a578 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:56.636564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ef73f851-a815-48d3-ae15-9778e431a578 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:56.658565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef73f851-a815-48d3-ae15-9778e431a578 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.661609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef73f851-a815-48d3-ae15-9778e431a578 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.665846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef73f851-a815-48d3-ae15-9778e431a578 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.667434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef73f851-a815-48d3-ae15-9778e431a578 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:56.668080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef73f851-a815-48d3-ae15-9778e431a578 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:56.668518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef73f851-a815-48d3-ae15-9778e431a578 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:56.881756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1278106939", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:57.016058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] validate_networks() for [('2d69ead8-af70-4ff6-884d-9014a0bf7a2a', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:52:57.829898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef73f851-a815-48d3-ae15-9778e431a578 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:57.881054 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ef73f851-a815-48d3-ae15-9778e431a578 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 200 len: 1506 microversion: 2.1 time: 1.274491 Aug 27 02:52:57.892874 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2242/4274] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:56 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 1506 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:57.910194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bbb15874-c344-4c71-8cc3-78eb9aba0284 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:57.914501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bbb15874-c344-4c71-8cc3-78eb9aba0284 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:57.953107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbb15874-c344-4c71-8cc3-78eb9aba0284 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:57.956642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbb15874-c344-4c71-8cc3-78eb9aba0284 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:57.959056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbb15874-c344-4c71-8cc3-78eb9aba0284 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:57.962613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbb15874-c344-4c71-8cc3-78eb9aba0284 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:57.965329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbb15874-c344-4c71-8cc3-78eb9aba0284 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:57.967498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbb15874-c344-4c71-8cc3-78eb9aba0284 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:58.508275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bbb15874-c344-4c71-8cc3-78eb9aba0284 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:58.521489 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bbb15874-c344-4c71-8cc3-78eb9aba0284 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1293 microversion: 2.1 time: 0.626573 Aug 27 02:52:58.536464 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2243/4275] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:57 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1293 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:58.541864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-afd1b12c-a000-45fc-921b-6e717e68d392 req-cc49a3cb-4550-48f8-9d51-ae7145118b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f7ed66-f5a7-42ec-be91-bd5a08981d8f", "name": "network-vif-deleted", "tag": "6c86ab3b-0086-4926-853f-bbbc6acba033"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:58.554517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-afd1b12c-a000-45fc-921b-6e717e68d392 req-cc49a3cb-4550-48f8-9d51-ae7145118b90 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:58.555541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-afd1b12c-a000-45fc-921b-6e717e68d392 req-cc49a3cb-4550-48f8-9d51-ae7145118b90 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:58.556250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-afd1b12c-a000-45fc-921b-6e717e68d392 req-cc49a3cb-4550-48f8-9d51-ae7145118b90 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:58.573155 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-afd1b12c-a000-45fc-921b-6e717e68d392 req-cc49a3cb-4550-48f8-9d51-ae7145118b90 service nova] Creating event network-vif-deleted:6c86ab3b-0086-4926-853f-bbbc6acba033 for instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f on n-h1-852084-5 Aug 27 02:52:58.580819 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-afd1b12c-a000-45fc-921b-6e717e68d392 req-cc49a3cb-4550-48f8-9d51-ae7145118b90 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042575 Aug 27 02:52:58.582983 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2244/4276] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:58.591167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e8c55d54-df2d-47ea-9355-8ea719352356 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:58.593408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e8c55d54-df2d-47ea-9355-8ea719352356 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:58.602277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8c55d54-df2d-47ea-9355-8ea719352356 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:58.603213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8c55d54-df2d-47ea-9355-8ea719352356 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:58.603921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8c55d54-df2d-47ea-9355-8ea719352356 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:58.604978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8c55d54-df2d-47ea-9355-8ea719352356 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:58.606090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8c55d54-df2d-47ea-9355-8ea719352356 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:58.606782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8c55d54-df2d-47ea-9355-8ea719352356 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:58.815835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:52:58.817143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:52:58.818046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:52:58.818733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:52:58.819637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:52:58.848600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:58.851137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:58.852029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:58.855678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:58.859114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:58.861739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:58.906172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e8c55d54-df2d-47ea-9355-8ea719352356 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:58.949894 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e8c55d54-df2d-47ea-9355-8ea719352356 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1313 microversion: 2.1 time: 0.363276 Aug 27 02:52:58.950284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Getting quotas for project a1225f40d38245f88817d37929eb4273. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:52:58.969166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Getting quotas for user cdb295ee44ec41c782d161ed620d53a8 and project a1225f40d38245f88817d37929eb4273. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:52:58.977946 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2245/4277] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:58 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:59.006122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-6f49d64c-b1e5-48a6-a00c-af8118e5027c req-7a15cdbb-2922-47d3-8d83-f9487127be24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80abc4a0-849e-4542-8318-42dd3c227e53", "name": "network-vif-plugged", "status": "completed", "tag": "7bf0553a-d66f-45ed-8f0b-087c727c1239"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:59.008288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:52:59.011536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:52:59.040220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6f49d64c-b1e5-48a6-a00c-af8118e5027c req-7a15cdbb-2922-47d3-8d83-f9487127be24 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.040750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6f49d64c-b1e5-48a6-a00c-af8118e5027c req-7a15cdbb-2922-47d3-8d83-f9487127be24 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.041206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6f49d64c-b1e5-48a6-a00c-af8118e5027c req-7a15cdbb-2922-47d3-8d83-f9487127be24 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.046073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:52:59.077541 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-6f49d64c-b1e5-48a6-a00c-af8118e5027c req-7a15cdbb-2922-47d3-8d83-f9487127be24 service nova] Creating event network-vif-plugged:7bf0553a-d66f-45ed-8f0b-087c727c1239 for instance 80abc4a0-849e-4542-8318-42dd3c227e53 on n-h1-852084-5 Aug 27 02:52:59.092423 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-6f49d64c-b1e5-48a6-a00c-af8118e5027c req-7a15cdbb-2922-47d3-8d83-f9487127be24 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103495 Aug 27 02:52:59.097140 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2246/4278] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:59.117852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:59.126088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] [instance: 58f7ed66-f5a7-42ec-be91-bd5a08981d8f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:59.148098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.148957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.151659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.152814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.153474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.156449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.192637 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] HTTP exception thrown: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f could not be found. Aug 27 02:52:59.199977 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3bafb1b9-35de-40c6-9068-f8f4106e4a6d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.685182 Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Request method failure captured: Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f HTTP/1.1 Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYW2e_GpuGSxOedHC0emqdFHSQcmoB8-AUK391GAMWRkC7AnzUegag06aLgxUzEluLRj7w_zjTg4XKzFveI26or7pBtUuH0FmgcVYp5dWFubyBtqSkCkoAMLP2uKwUC2j22Y6_dH4k-9cMFYVpK1vwP6zmP85U3QL87CQKO-0mGYbis Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bd6b3bb36fb84f07a8fb9a38b1a9689b"}]}] Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: bd6b3bb36fb84f07a8fb9a38b1a9689b Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1771651131 Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ad43ce0d2e9a40e99da82044ff843cd6 Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1771651131-project Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f could not be found. Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '58f7ed66-f5a7-42ec-be91-bd5a08981d8f'} Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f could not be found. Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f could not be found. Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:59.201826 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:59.209207 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:59.209207 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:59.209207 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:59.209207 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:59.209207 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:59.209207 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f could not be found. Aug 27 02:52:59.209207 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:52:59.209773 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2033/4279] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:52:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:52:59.209873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] Returning 404 to user: Instance 58f7ed66-f5a7-42ec-be91-bd5a08981d8f could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:59.209873 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-737eba1b-97b3-47e5-b5f4-f8ed4d713cd7 tempest-ServersNegativeTestJSON-1771651131 tempest-ServersNegativeTestJSON-1771651131-project] 10.222.0.99 "GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f" status: 404 len: 111 microversion: 2.1 time: 0.104852 Aug 27 02:52:59.209873 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2247/4280] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:59 2022] GET /compute/v2.1/servers/58f7ed66-f5a7-42ec-be91-bd5a08981d8f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:59.210131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d35a729f-9e15-4d20-85a7-6f0055793e39 req-4ba92fb6-67f9-4976-bcc3-25f909a16d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba293dd-7362-4f13-859b-609bfa1b540b", "name": "network-vif-deleted", "tag": "838fc457-8fa1-4865-807d-3d531753aba0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:52:59.210234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50574c87-0214-4375-8928-8e32e405d6a8 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:59.210234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-50574c87-0214-4375-8928-8e32e405d6a8 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:59.229587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50574c87-0214-4375-8928-8e32e405d6a8 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.230415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50574c87-0214-4375-8928-8e32e405d6a8 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.230588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50574c87-0214-4375-8928-8e32e405d6a8 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.235308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50574c87-0214-4375-8928-8e32e405d6a8 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.235945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50574c87-0214-4375-8928-8e32e405d6a8 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.236410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50574c87-0214-4375-8928-8e32e405d6a8 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.246389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d35a729f-9e15-4d20-85a7-6f0055793e39 req-4ba92fb6-67f9-4976-bcc3-25f909a16d9b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.247065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d35a729f-9e15-4d20-85a7-6f0055793e39 req-4ba92fb6-67f9-4976-bcc3-25f909a16d9b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.248072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d35a729f-9e15-4d20-85a7-6f0055793e39 req-4ba92fb6-67f9-4976-bcc3-25f909a16d9b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.281299 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d35a729f-9e15-4d20-85a7-6f0055793e39 req-4ba92fb6-67f9-4976-bcc3-25f909a16d9b service nova] Creating event network-vif-deleted:838fc457-8fa1-4865-807d-3d531753aba0 for instance eba293dd-7362-4f13-859b-609bfa1b540b on n-h2-852084-5 Aug 27 02:52:59.298101 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d35a729f-9e15-4d20-85a7-6f0055793e39 req-4ba92fb6-67f9-4976-bcc3-25f909a16d9b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093991 Aug 27 02:52:59.298777 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2034/4281] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:52:59.315462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:59.316372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: eba293dd-7362-4f13-859b-609bfa1b540b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:59.334073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.334807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.335483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.336455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.337265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.337990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.363083 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] HTTP exception thrown: Instance eba293dd-7362-4f13-859b-609bfa1b540b could not be found. Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Request method failure captured: Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b HTTP/1.1 Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYZ4inCK7_HvKYJPw8-G9uOJ4RDGEocxjJFbek3G9Y46zhwe_R16Vgai1ed956GVPT8SxP_YZ7pqRe7CHrLj8zX1-9vNWay8wzwJnXs7M7cyeW1IoGMGDR8Tzy_Sa0OV1oKJb7SvsvMNLPoRuMEPUUg_ej9Y_E2uKS3W-ozWZO5fHdo Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 0c35f17cbc704427aeaf13084be9b078 Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerRescueTestJSON-242763445 Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_0c35f17cbc704427aeaf13084be9b078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/0c35f17cbc704427aeaf13084be9b078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/0c35f17cbc704427aeaf13084be9b078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/0c35f17cbc704427aeaf13084be9b078"}]}] Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerRescueTestJSON-242763445 Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 0c35f17cbc704427aeaf13084be9b078 Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerRescueTestJSON-242763445 Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerRescueTestJSON-242763445-project Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f820d9c6655443c79c8046b396cafbba Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerRescueTestJSON-242763445-project Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance eba293dd-7362-4f13-859b-609bfa1b540b could not be found. Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'eba293dd-7362-4f13-859b-609bfa1b540b'} Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba293dd-7362-4f13-859b-609bfa1b540b could not be found. Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba293dd-7362-4f13-859b-609bfa1b540b could not be found. Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:52:59.365111 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:59.369282 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:52:59.369282 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:52:59.369282 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:52:59.369282 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:52:59.369282 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:52:59.369282 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba293dd-7362-4f13-859b-609bfa1b540b could not be found. Aug 27 02:52:59.369282 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:52:59.370875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Returning 404 to user: Instance eba293dd-7362-4f13-859b-609bfa1b540b could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:52:59.372048 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ef11a13c-008c-4b1c-b668-c38cb34b5ea8 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b" status: 404 len: 111 microversion: 2.1 time: 0.072129 Aug 27 02:52:59.374939 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2035/4282] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:59 2022] GET /compute/v2.1/servers/eba293dd-7362-4f13-859b-609bfa1b540b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:52:59.392079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ac636045-506a-46ce-b2da-ae902bef0679 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:59.392892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac636045-506a-46ce-b2da-ae902bef0679 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:59.559552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac636045-506a-46ce-b2da-ae902bef0679 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:59.584238 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ac636045-506a-46ce-b2da-ae902bef0679 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1223 microversion: 2.1 time: 0.207933 Aug 27 02:52:59.592308 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2036/4283] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:59 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1223 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:59.609824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8519f743-91a2-4758-8fd5-3a1004c5b3fe tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:59.610356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8519f743-91a2-4758-8fd5-3a1004c5b3fe tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:59.617476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8519f743-91a2-4758-8fd5-3a1004c5b3fe tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.624838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8519f743-91a2-4758-8fd5-3a1004c5b3fe tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.625263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8519f743-91a2-4758-8fd5-3a1004c5b3fe tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.626132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8519f743-91a2-4758-8fd5-3a1004c5b3fe tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.626625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8519f743-91a2-4758-8fd5-3a1004c5b3fe tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.627075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8519f743-91a2-4758-8fd5-3a1004c5b3fe tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.687824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-50574c87-0214-4375-8928-8e32e405d6a8 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:52:59.701704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8519f743-91a2-4758-8fd5-3a1004c5b3fe tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:52:59.706860 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-50574c87-0214-4375-8928-8e32e405d6a8 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1677 microversion: 2.1 time: 0.501232 Aug 27 02:52:59.707638 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2248/4284] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:59 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1677 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:52:59.727578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-45703822-cd6a-4c47-968b-22fd7454c95b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:59.728073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-45703822-cd6a-4c47-968b-22fd7454c95b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:52:59.755415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45703822-cd6a-4c47-968b-22fd7454c95b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.756301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45703822-cd6a-4c47-968b-22fd7454c95b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.757123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45703822-cd6a-4c47-968b-22fd7454c95b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.758470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45703822-cd6a-4c47-968b-22fd7454c95b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:52:59.759330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45703822-cd6a-4c47-968b-22fd7454c95b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:52:59.760125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45703822-cd6a-4c47-968b-22fd7454c95b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:52:59.963050 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8519f743-91a2-4758-8fd5-3a1004c5b3fe tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 204 len: 0 microversion: 2.1 time: 0.368664 Aug 27 02:52:59.963678 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2037/4285] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:52:59 2022] DELETE /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:52:59.976433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bc650408-6904-4a3f-aa65-a4ef27c4fe22 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:52:59.977211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bc650408-6904-4a3f-aa65-a4ef27c4fe22 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:00.010995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc650408-6904-4a3f-aa65-a4ef27c4fe22 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.011510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc650408-6904-4a3f-aa65-a4ef27c4fe22 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.011965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc650408-6904-4a3f-aa65-a4ef27c4fe22 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:00.019840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc650408-6904-4a3f-aa65-a4ef27c4fe22 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.020357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc650408-6904-4a3f-aa65-a4ef27c4fe22 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.020819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc650408-6904-4a3f-aa65-a4ef27c4fe22 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:00.470644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-45703822-cd6a-4c47-968b-22fd7454c95b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:00.506167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-45703822-cd6a-4c47-968b-22fd7454c95b tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1293 microversion: 2.1 time: 0.793062 Aug 27 02:53:00.507281 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2249/4286] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:59 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1293 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:00.517369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6280b0ae-0b26-4054-a346-eba8bdb2c351 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:00.531017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6280b0ae-0b26-4054-a346-eba8bdb2c351 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:00.548164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6280b0ae-0b26-4054-a346-eba8bdb2c351 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.549818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6280b0ae-0b26-4054-a346-eba8bdb2c351 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.554779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6280b0ae-0b26-4054-a346-eba8bdb2c351 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:00.556516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6280b0ae-0b26-4054-a346-eba8bdb2c351 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.557428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6280b0ae-0b26-4054-a346-eba8bdb2c351 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.558279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6280b0ae-0b26-4054-a346-eba8bdb2c351 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:00.815705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bc650408-6904-4a3f-aa65-a4ef27c4fe22 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:00.835608 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bc650408-6904-4a3f-aa65-a4ef27c4fe22 tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1491 microversion: 2.1 time: 0.864900 Aug 27 02:53:00.842732 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2038/4287] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:52:59 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1491 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:00.873881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a63c8eb8-18ec-41c8-91d6-459af374219e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:00.877712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a63c8eb8-18ec-41c8-91d6-459af374219e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:00.914793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a63c8eb8-18ec-41c8-91d6-459af374219e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.916163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a63c8eb8-18ec-41c8-91d6-459af374219e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.920600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a63c8eb8-18ec-41c8-91d6-459af374219e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:00.922810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a63c8eb8-18ec-41c8-91d6-459af374219e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:00.926652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a63c8eb8-18ec-41c8-91d6-459af374219e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:00.930160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a63c8eb8-18ec-41c8-91d6-459af374219e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.204820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a63c8eb8-18ec-41c8-91d6-459af374219e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:01.226203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6280b0ae-0b26-4054-a346-eba8bdb2c351 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:01.238496 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a63c8eb8-18ec-41c8-91d6-459af374219e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1227 microversion: 2.1 time: 0.392231 Aug 27 02:53:01.243433 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6280b0ae-0b26-4054-a346-eba8bdb2c351 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1313 microversion: 2.1 time: 0.734242 Aug 27 02:53:01.244183 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2250/4288] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:00 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1313 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:01.245120 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2039/4289] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:00 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1227 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:01.252495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ddae614-eef5-4f5b-94af-8a593fd96032 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:01.253130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ddae614-eef5-4f5b-94af-8a593fd96032 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:01.260802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-782e7ff3-19f4-454e-baf7-2f20dcf113fc req-2b47a48d-a8d2-4a4c-8375-c0970939cb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a", "name": "network-vif-plugged", "status": "completed", "tag": "35c22ead-5aad-415f-a079-665b8e261a4b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:01.273382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ddae614-eef5-4f5b-94af-8a593fd96032 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.273929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ddae614-eef5-4f5b-94af-8a593fd96032 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.274374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ddae614-eef5-4f5b-94af-8a593fd96032 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.275135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ddae614-eef5-4f5b-94af-8a593fd96032 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.275611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ddae614-eef5-4f5b-94af-8a593fd96032 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.276053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ddae614-eef5-4f5b-94af-8a593fd96032 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.311228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-782e7ff3-19f4-454e-baf7-2f20dcf113fc req-2b47a48d-a8d2-4a4c-8375-c0970939cb1e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.312549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-782e7ff3-19f4-454e-baf7-2f20dcf113fc req-2b47a48d-a8d2-4a4c-8375-c0970939cb1e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.320641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-782e7ff3-19f4-454e-baf7-2f20dcf113fc req-2b47a48d-a8d2-4a4c-8375-c0970939cb1e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.377555 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-782e7ff3-19f4-454e-baf7-2f20dcf113fc req-2b47a48d-a8d2-4a4c-8375-c0970939cb1e service nova] Creating event network-vif-plugged:35c22ead-5aad-415f-a079-665b8e261a4b for instance 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a on n-h2-852084-5 Aug 27 02:53:01.408593 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-782e7ff3-19f4-454e-baf7-2f20dcf113fc req-2b47a48d-a8d2-4a4c-8375-c0970939cb1e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150366 Aug 27 02:53:01.410542 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2040/4290] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:01.558603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-965b2536-a9f6-42ec-bea4-0fbf4703b9ce tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:01.569589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-965b2536-a9f6-42ec-bea4-0fbf4703b9ce tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:01.570743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ddae614-eef5-4f5b-94af-8a593fd96032 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:01.587387 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ddae614-eef5-4f5b-94af-8a593fd96032 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1677 microversion: 2.1 time: 0.339676 Aug 27 02:53:01.605948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-965b2536-a9f6-42ec-bea4-0fbf4703b9ce tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.605948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-965b2536-a9f6-42ec-bea4-0fbf4703b9ce tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.605948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-965b2536-a9f6-42ec-bea4-0fbf4703b9ce tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.605948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-965b2536-a9f6-42ec-bea4-0fbf4703b9ce tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.605948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-965b2536-a9f6-42ec-bea4-0fbf4703b9ce tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.605948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-965b2536-a9f6-42ec-bea4-0fbf4703b9ce tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.611481 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2251/4291] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:01 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1677 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:01.878732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4d081725-f21c-4bf9-965c-0b9696594c0a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:01.879483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4d081725-f21c-4bf9-965c-0b9696594c0a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:01.895840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d081725-f21c-4bf9-965c-0b9696594c0a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.896351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d081725-f21c-4bf9-965c-0b9696594c0a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.896952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d081725-f21c-4bf9-965c-0b9696594c0a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:01.897710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d081725-f21c-4bf9-965c-0b9696594c0a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:01.898201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d081725-f21c-4bf9-965c-0b9696594c0a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:01.898636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d081725-f21c-4bf9-965c-0b9696594c0a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.294919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-965b2536-a9f6-42ec-bea4-0fbf4703b9ce tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:02.333937 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-965b2536-a9f6-42ec-bea4-0fbf4703b9ce tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1484 microversion: 2.1 time: 0.787283 Aug 27 02:53:02.336090 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2041/4292] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:01 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1484 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:02.344600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ae87fb2-94c4-413f-a831-70396310f6e4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:02.348295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0ae87fb2-94c4-413f-a831-70396310f6e4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:02.363654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ae87fb2-94c4-413f-a831-70396310f6e4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.364620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ae87fb2-94c4-413f-a831-70396310f6e4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.365326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ae87fb2-94c4-413f-a831-70396310f6e4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.366902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ae87fb2-94c4-413f-a831-70396310f6e4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.368088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ae87fb2-94c4-413f-a831-70396310f6e4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.368863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ae87fb2-94c4-413f-a831-70396310f6e4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.767403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4d081725-f21c-4bf9-965c-0b9696594c0a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:02.784791 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4d081725-f21c-4bf9-965c-0b9696594c0a tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1491 microversion: 2.1 time: 0.910368 Aug 27 02:53:02.804461 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2252/4293] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:01 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1491 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:02.824622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8923731b-e7f2-4b45-b6a4-f35ab1e21940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:02.827063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8923731b-e7f2-4b45-b6a4-f35ab1e21940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:02.838390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8923731b-e7f2-4b45-b6a4-f35ab1e21940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.840889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8923731b-e7f2-4b45-b6a4-f35ab1e21940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.842980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8923731b-e7f2-4b45-b6a4-f35ab1e21940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.844567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0ae87fb2-94c4-413f-a831-70396310f6e4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:02.845606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8923731b-e7f2-4b45-b6a4-f35ab1e21940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.846434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8923731b-e7f2-4b45-b6a4-f35ab1e21940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.847248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8923731b-e7f2-4b45-b6a4-f35ab1e21940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.877390 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0ae87fb2-94c4-413f-a831-70396310f6e4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1313 microversion: 2.1 time: 0.531706 Aug 27 02:53:02.893143 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2042/4294] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:02 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1313 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:02.893143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3eac845c-859a-44b6-b06f-3c645848c3cb tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:02.893143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3eac845c-859a-44b6-b06f-3c645848c3cb tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:02.909331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3eac845c-859a-44b6-b06f-3c645848c3cb tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.922153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3eac845c-859a-44b6-b06f-3c645848c3cb tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.922736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3eac845c-859a-44b6-b06f-3c645848c3cb tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:02.923514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3eac845c-859a-44b6-b06f-3c645848c3cb tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:02.924089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3eac845c-859a-44b6-b06f-3c645848c3cb tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:02.924530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3eac845c-859a-44b6-b06f-3c645848c3cb tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.209726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8923731b-e7f2-4b45-b6a4-f35ab1e21940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:03.226014 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8923731b-e7f2-4b45-b6a4-f35ab1e21940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1275 microversion: 2.1 time: 0.418163 Aug 27 02:53:03.227610 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2253/4295] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:02 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1275 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:03.238111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-af1c6f26-6593-4697-9221-ea3db05be422 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:03.240884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-af1c6f26-6593-4697-9221-ea3db05be422 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:03.252081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1c6f26-6593-4697-9221-ea3db05be422 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.255694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1c6f26-6593-4697-9221-ea3db05be422 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.256597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1c6f26-6593-4697-9221-ea3db05be422 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.259096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1c6f26-6593-4697-9221-ea3db05be422 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.259908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1c6f26-6593-4697-9221-ea3db05be422 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.261501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1c6f26-6593-4697-9221-ea3db05be422 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.307267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:03.730851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-af1c6f26-6593-4697-9221-ea3db05be422 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:03.744724 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-af1c6f26-6593-4697-9221-ea3db05be422 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1677 microversion: 2.1 time: 0.514681 Aug 27 02:53:03.747780 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2254/4296] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:03 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1677 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:03.822136 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3eac845c-859a-44b6-b06f-3c645848c3cb tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.936420 Aug 27 02:53:03.823651 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2043/4297] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:53:02 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53/os-interface => generated 284 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:03.831491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2c5fdd36-e82a-4154-9618-f082c8fb36da tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:03.832896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2c5fdd36-e82a-4154-9618-f082c8fb36da tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:03.845321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c5fdd36-e82a-4154-9618-f082c8fb36da tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.848589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c5fdd36-e82a-4154-9618-f082c8fb36da tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.851782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c5fdd36-e82a-4154-9618-f082c8fb36da tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.853096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c5fdd36-e82a-4154-9618-f082c8fb36da tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.857270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c5fdd36-e82a-4154-9618-f082c8fb36da tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.858737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c5fdd36-e82a-4154-9618-f082c8fb36da tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.907923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8404d882-733d-4049-8011-79e5537a41cb tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:03.908634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8404d882-733d-4049-8011-79e5537a41cb tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:03.934635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8404d882-733d-4049-8011-79e5537a41cb tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.935977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8404d882-733d-4049-8011-79e5537a41cb tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.938441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8404d882-733d-4049-8011-79e5537a41cb tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:03.940717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8404d882-733d-4049-8011-79e5537a41cb tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:03.943238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8404d882-733d-4049-8011-79e5537a41cb tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:03.946552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8404d882-733d-4049-8011-79e5537a41cb tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:04.465111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2c5fdd36-e82a-4154-9618-f082c8fb36da tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:04.503598 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2c5fdd36-e82a-4154-9618-f082c8fb36da tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1491 microversion: 2.1 time: 0.676367 Aug 27 02:53:04.505621 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2255/4298] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:03 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1491 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:04.564845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-17b4907e-e4a3-4eb5-9d69-e99f3c1945b2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:04.567463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-17b4907e-e4a3-4eb5-9d69-e99f3c1945b2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:04.589971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17b4907e-e4a3-4eb5-9d69-e99f3c1945b2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:04.597876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17b4907e-e4a3-4eb5-9d69-e99f3c1945b2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:04.600802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17b4907e-e4a3-4eb5-9d69-e99f3c1945b2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:04.606647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17b4907e-e4a3-4eb5-9d69-e99f3c1945b2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:04.613253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17b4907e-e4a3-4eb5-9d69-e99f3c1945b2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:04.624407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17b4907e-e4a3-4eb5-9d69-e99f3c1945b2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:04.796618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-17b4907e-e4a3-4eb5-9d69-e99f3c1945b2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:04.902807 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-17b4907e-e4a3-4eb5-9d69-e99f3c1945b2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1281 microversion: 2.1 time: 0.378632 Aug 27 02:53:04.921410 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2256/4299] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:04 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1281 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:04.940263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-51d06fdd-5da4-4f21-9985-188028b63844 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:04.941433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-51d06fdd-5da4-4f21-9985-188028b63844 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:04.971231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51d06fdd-5da4-4f21-9985-188028b63844 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:04.975488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51d06fdd-5da4-4f21-9985-188028b63844 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:04.976015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51d06fdd-5da4-4f21-9985-188028b63844 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:04.977948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51d06fdd-5da4-4f21-9985-188028b63844 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:04.979467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51d06fdd-5da4-4f21-9985-188028b63844 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:04.981151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51d06fdd-5da4-4f21-9985-188028b63844 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.099005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8404d882-733d-4049-8011-79e5537a41cb tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:05.144214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:05.155268 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8404d882-733d-4049-8011-79e5537a41cb tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1313 microversion: 2.1 time: 1.252026 Aug 27 02:53:05.164649 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2044/4300] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:03 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1313 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:05.178788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ba1d5bfa-9fca-413f-831b-7540f56b0aac req-43040e56-078e-43ed-9bb0-570f3146e49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed264ed-31ac-462f-864a-1479bf5fc3ef", "name": "network-vif-deleted", "tag": "fe21cb15-31a5-40b7-87ce-17062fb73885"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:05.218218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ba1d5bfa-9fca-413f-831b-7540f56b0aac req-43040e56-078e-43ed-9bb0-570f3146e49a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.219474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ba1d5bfa-9fca-413f-831b-7540f56b0aac req-43040e56-078e-43ed-9bb0-570f3146e49a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.220538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ba1d5bfa-9fca-413f-831b-7540f56b0aac req-43040e56-078e-43ed-9bb0-570f3146e49a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.253130 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ba1d5bfa-9fca-413f-831b-7540f56b0aac req-43040e56-078e-43ed-9bb0-570f3146e49a service nova] Creating event network-vif-deleted:fe21cb15-31a5-40b7-87ce-17062fb73885 for instance 3ed264ed-31ac-462f-864a-1479bf5fc3ef on n-h2-852084-5 Aug 27 02:53:05.271854 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ba1d5bfa-9fca-413f-831b-7540f56b0aac req-43040e56-078e-43ed-9bb0-570f3146e49a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103059 Aug 27 02:53:05.276248 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2045/4301] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:05.534133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:05.535127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:05.543923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.544986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.545479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.546382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.547060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.547510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.575925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-51d06fdd-5da4-4f21-9985-188028b63844 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:05.593065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.593927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.594569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.595215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lazy-loading 'fault' on Instance uuid 3ed264ed-31ac-462f-864a-1479bf5fc3ef {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:53:05.600106 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-51d06fdd-5da4-4f21-9985-188028b63844 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1677 microversion: 2.1 time: 0.674968 Aug 27 02:53:05.601215 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2257/4302] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:04 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1677 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:05.753688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f820d9c6655443c79c8046b396cafbba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c35f17cbc704427aeaf13084be9b078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:05.768910 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-70f2ba6b-21bc-4c19-8c60-edeb9eb920fd tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 200 len: 1303 microversion: 2.1 time: 0.240152 Aug 27 02:53:05.779861 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2046/4303] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:05 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 1303 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:05.942222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f468a684-d8aa-4961-99c8-07b451b4bb7e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:05.942876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f468a684-d8aa-4961-99c8-07b451b4bb7e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:05.968667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f468a684-d8aa-4961-99c8-07b451b4bb7e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.969869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f468a684-d8aa-4961-99c8-07b451b4bb7e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.970410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f468a684-d8aa-4961-99c8-07b451b4bb7e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:05.971313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f468a684-d8aa-4961-99c8-07b451b4bb7e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:05.972028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f468a684-d8aa-4961-99c8-07b451b4bb7e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:05.972565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f468a684-d8aa-4961-99c8-07b451b4bb7e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.181799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e442bf6-ebd6-4f9e-865e-0beacca9b2c4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:06.184111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5e442bf6-ebd6-4f9e-865e-0beacca9b2c4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:06.199110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e442bf6-ebd6-4f9e-865e-0beacca9b2c4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.201089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e442bf6-ebd6-4f9e-865e-0beacca9b2c4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.202070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e442bf6-ebd6-4f9e-865e-0beacca9b2c4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.203491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e442bf6-ebd6-4f9e-865e-0beacca9b2c4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.204443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e442bf6-ebd6-4f9e-865e-0beacca9b2c4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.205305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e442bf6-ebd6-4f9e-865e-0beacca9b2c4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.434456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f468a684-d8aa-4961-99c8-07b451b4bb7e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:06.447699 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f468a684-d8aa-4961-99c8-07b451b4bb7e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1323 microversion: 2.1 time: 0.509542 Aug 27 02:53:06.453577 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2258/4304] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:05 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1323 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:06.641554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-88baa3e6-2ccf-46be-b78e-f56bb74fbe2c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:06.642850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-88baa3e6-2ccf-46be-b78e-f56bb74fbe2c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:06.651745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88baa3e6-2ccf-46be-b78e-f56bb74fbe2c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.652887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88baa3e6-2ccf-46be-b78e-f56bb74fbe2c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.653596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88baa3e6-2ccf-46be-b78e-f56bb74fbe2c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.655206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88baa3e6-2ccf-46be-b78e-f56bb74fbe2c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.657015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88baa3e6-2ccf-46be-b78e-f56bb74fbe2c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.657609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88baa3e6-2ccf-46be-b78e-f56bb74fbe2c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.914926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5e442bf6-ebd6-4f9e-865e-0beacca9b2c4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:06.925383 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5e442bf6-ebd6-4f9e-865e-0beacca9b2c4 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1462 microversion: 2.1 time: 0.751527 Aug 27 02:53:06.926777 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2047/4305] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:06 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1462 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:06.932245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:06.933364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] [instance: 3ed264ed-31ac-462f-864a-1479bf5fc3ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:06.941001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.941921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.942619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.943696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:06.944462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:06.945235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:06.968335 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] HTTP exception thrown: Instance 3ed264ed-31ac-462f-864a-1479bf5fc3ef could not be found. Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Request method failure captured: Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef HTTP/1.1 Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYZ4inCK7_HvKYJPw8-G9uOJ4RDGEocxjJFbek3G9Y46zhwe_R16Vgai1ed956GVPT8SxP_YZ7pqRe7CHrLj8zX1-9vNWay8wzwJnXs7M7cyeW1IoGMGDR8Tzy_Sa0OV1oKJb7SvsvMNLPoRuMEPUUg_ej9Y_E2uKS3W-ozWZO5fHdo Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 0c35f17cbc704427aeaf13084be9b078 Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerRescueTestJSON-242763445 Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_0c35f17cbc704427aeaf13084be9b078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/0c35f17cbc704427aeaf13084be9b078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/0c35f17cbc704427aeaf13084be9b078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/0c35f17cbc704427aeaf13084be9b078"}]}] Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerRescueTestJSON-242763445 Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 0c35f17cbc704427aeaf13084be9b078 Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerRescueTestJSON-242763445 Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerRescueTestJSON-242763445-project Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: f820d9c6655443c79c8046b396cafbba Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerRescueTestJSON-242763445-project Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 3ed264ed-31ac-462f-864a-1479bf5fc3ef could not be found. Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '3ed264ed-31ac-462f-864a-1479bf5fc3ef'} Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed264ed-31ac-462f-864a-1479bf5fc3ef could not be found. Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed264ed-31ac-462f-864a-1479bf5fc3ef could not be found. Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:06.970540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:06.974338 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:06.974338 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:06.974338 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:06.974338 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:53:06.974338 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:53:06.974338 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed264ed-31ac-462f-864a-1479bf5fc3ef could not be found. Aug 27 02:53:06.974338 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:06.978065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] Returning 404 to user: Instance 3ed264ed-31ac-462f-864a-1479bf5fc3ef could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:53:06.980869 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e4d6ce4f-af4b-45d6-bf6f-85eb22c8bd2b tempest-ServerRescueTestJSON-242763445 tempest-ServerRescueTestJSON-242763445-project] 10.222.0.99 "GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef" status: 404 len: 111 microversion: 2.1 time: 0.052271 Aug 27 02:53:06.982223 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2048/4306] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:06 2022] GET /compute/v2.1/servers/3ed264ed-31ac-462f-864a-1479bf5fc3ef => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:53:06.992637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2bdb4f73-6614-4b10-a024-e499423fba9f tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "499373f4-e51d-4230-b299-98aff333dc0f", "device": "/dev/sdb"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:07.005969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2bdb4f73-6614-4b10-a024-e499423fba9f tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:07.015145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb4f73-6614-4b10-a024-e499423fba9f tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.016126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb4f73-6614-4b10-a024-e499423fba9f tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.016904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb4f73-6614-4b10-a024-e499423fba9f tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.018811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb4f73-6614-4b10-a024-e499423fba9f tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.019938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb4f73-6614-4b10-a024-e499423fba9f tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.020700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bdb4f73-6614-4b10-a024-e499423fba9f tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.042138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-88baa3e6-2ccf-46be-b78e-f56bb74fbe2c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:07.056706 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-88baa3e6-2ccf-46be-b78e-f56bb74fbe2c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1654 microversion: 2.1 time: 0.420286 Aug 27 02:53:07.058215 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2259/4307] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:06 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1654 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:07.123849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2492e1c-e7c9-49b7-9647-d75a708e1f21 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:07.163485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2492e1c-e7c9-49b7-9647-d75a708e1f21 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.163945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2492e1c-e7c9-49b7-9647-d75a708e1f21 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.166906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2492e1c-e7c9-49b7-9647-d75a708e1f21 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.232849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2492e1c-e7c9-49b7-9647-d75a708e1f21 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Going to try to start instance {{(pid=122488) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 02:53:07.364544 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2492e1c-e7c9-49b7-9647-d75a708e1f21 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "POST /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/action" status: 202 len: 0 microversion: 2.1 time: 0.269018 Aug 27 02:53:07.372092 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2260/4308] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:53:07 2022] POST /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:53:07.402328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c167a55-e18a-45e3-8420-d59e993f7aa3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:07.404367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c167a55-e18a-45e3-8420-d59e993f7aa3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:07.443460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c167a55-e18a-45e3-8420-d59e993f7aa3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.446704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c167a55-e18a-45e3-8420-d59e993f7aa3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.457952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c167a55-e18a-45e3-8420-d59e993f7aa3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.459888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c167a55-e18a-45e3-8420-d59e993f7aa3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.461221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c167a55-e18a-45e3-8420-d59e993f7aa3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.462608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c167a55-e18a-45e3-8420-d59e993f7aa3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.816885 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2bdb4f73-6614-4b10-a024-e499423fba9f tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "POST /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831580 Aug 27 02:53:07.819260 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2049/4309] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 02:53:06 2022] POST /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:07.857859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88ed8ccb-4c30-4959-a8b4-21ad3ee484d9 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:07.874690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-88ed8ccb-4c30-4959-a8b4-21ad3ee484d9 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:07.923476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ed8ccb-4c30-4959-a8b4-21ad3ee484d9 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.924335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ed8ccb-4c30-4959-a8b4-21ad3ee484d9 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.930934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ed8ccb-4c30-4959-a8b4-21ad3ee484d9 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:07.932277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ed8ccb-4c30-4959-a8b4-21ad3ee484d9 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:07.933254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ed8ccb-4c30-4959-a8b4-21ad3ee484d9 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:07.937180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88ed8ccb-4c30-4959-a8b4-21ad3ee484d9 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:08.695191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-88ed8ccb-4c30-4959-a8b4-21ad3ee484d9 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:08.706465 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-88ed8ccb-4c30-4959-a8b4-21ad3ee484d9 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1323 microversion: 2.1 time: 0.873689 Aug 27 02:53:08.726855 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2050/4310] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:07 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1323 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:08.736393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-998403eb-5f92-4eb9-8e4e-74099f29b2cd tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:08.737309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-998403eb-5f92-4eb9-8e4e-74099f29b2cd tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:08.746914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-998403eb-5f92-4eb9-8e4e-74099f29b2cd tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:08.748375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-998403eb-5f92-4eb9-8e4e-74099f29b2cd tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:08.749188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-998403eb-5f92-4eb9-8e4e-74099f29b2cd tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:08.750234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-998403eb-5f92-4eb9-8e4e-74099f29b2cd tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:08.750965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-998403eb-5f92-4eb9-8e4e-74099f29b2cd tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:08.751648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-998403eb-5f92-4eb9-8e4e-74099f29b2cd tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:08.799938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-998403eb-5f92-4eb9-8e4e-74099f29b2cd tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:53:08.926528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:08.997535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1c167a55-e18a-45e3-8420-d59e993f7aa3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:09.006521 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-998403eb-5f92-4eb9-8e4e-74099f29b2cd tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 204 len: 0 microversion: 2.1 time: 0.274629 Aug 27 02:53:09.013490 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2051/4311] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:53:08 2022] DELETE /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:53:09.031970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e9828ec-6df3-41dc-b52b-7256292f6484 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:09.034299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9e9828ec-6df3-41dc-b52b-7256292f6484 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:09.036180 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c167a55-e18a-45e3-8420-d59e993f7aa3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1663 microversion: 2.1 time: 1.653735 Aug 27 02:53:09.052615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e9828ec-6df3-41dc-b52b-7256292f6484 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:09.054832 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2261/4312] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:07 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1663 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:09.069710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e9828ec-6df3-41dc-b52b-7256292f6484 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:09.069710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e9828ec-6df3-41dc-b52b-7256292f6484 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:09.069710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e9828ec-6df3-41dc-b52b-7256292f6484 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:09.069710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e9828ec-6df3-41dc-b52b-7256292f6484 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:09.069710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e9828ec-6df3-41dc-b52b-7256292f6484 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:09.097699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dbcf6a66-384d-4009-b6c5-657f30f714d2 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:09.098949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dbcf6a66-384d-4009-b6c5-657f30f714d2 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:09.129093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbcf6a66-384d-4009-b6c5-657f30f714d2 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:09.148699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbcf6a66-384d-4009-b6c5-657f30f714d2 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:09.150307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbcf6a66-384d-4009-b6c5-657f30f714d2 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:09.161563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbcf6a66-384d-4009-b6c5-657f30f714d2 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:09.165659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbcf6a66-384d-4009-b6c5-657f30f714d2 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:09.166926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dbcf6a66-384d-4009-b6c5-657f30f714d2 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:09.562425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9e9828ec-6df3-41dc-b52b-7256292f6484 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:09.597447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:09.617734 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9e9828ec-6df3-41dc-b52b-7256292f6484 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1552 microversion: 2.1 time: 0.601732 Aug 27 02:53:09.626832 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2052/4313] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:09 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1552 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:09.647407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-9d320649-48a2-4a86-8c2d-6505cf071f98 req-dc23ce05-780f-4fd9-afb9-5306eac27308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80abc4a0-849e-4542-8318-42dd3c227e53", "tag": "7bf0553a-d66f-45ed-8f0b-087c727c1239"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:09.692824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9d320649-48a2-4a86-8c2d-6505cf071f98 req-dc23ce05-780f-4fd9-afb9-5306eac27308 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:09.704894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9d320649-48a2-4a86-8c2d-6505cf071f98 req-dc23ce05-780f-4fd9-afb9-5306eac27308 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:09.705813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9d320649-48a2-4a86-8c2d-6505cf071f98 req-dc23ce05-780f-4fd9-afb9-5306eac27308 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:09.795543 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-9d320649-48a2-4a86-8c2d-6505cf071f98 req-dc23ce05-780f-4fd9-afb9-5306eac27308 service nova] Creating event network-changed:7bf0553a-d66f-45ed-8f0b-087c727c1239 for instance 80abc4a0-849e-4542-8318-42dd3c227e53 on n-h1-852084-5 Aug 27 02:53:09.808183 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-9d320649-48a2-4a86-8c2d-6505cf071f98 req-dc23ce05-780f-4fd9-afb9-5306eac27308 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179137 Aug 27 02:53:09.812591 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2053/4314] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:09.838563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-431846d5-b618-4ed3-b50b-3a4256f199d1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:09.840241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-431846d5-b618-4ed3-b50b-3a4256f199d1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:09.864659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-431846d5-b618-4ed3-b50b-3a4256f199d1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:09.867335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-431846d5-b618-4ed3-b50b-3a4256f199d1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:09.868309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-431846d5-b618-4ed3-b50b-3a4256f199d1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:09.869684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-431846d5-b618-4ed3-b50b-3a4256f199d1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:09.870654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-431846d5-b618-4ed3-b50b-3a4256f199d1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:09.871362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-431846d5-b618-4ed3-b50b-3a4256f199d1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:10.004816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dbcf6a66-384d-4009-b6c5-657f30f714d2 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:10.016199 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dbcf6a66-384d-4009-b6c5-657f30f714d2 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1484 microversion: 2.1 time: 0.928087 Aug 27 02:53:10.020883 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2262/4315] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:09 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1484 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:10.087315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6df3735d-5e1e-40ef-9b8d-3c66ab4cf97c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:10.088189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6df3735d-5e1e-40ef-9b8d-3c66ab4cf97c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:10.107853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df3735d-5e1e-40ef-9b8d-3c66ab4cf97c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:10.108342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df3735d-5e1e-40ef-9b8d-3c66ab4cf97c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:10.108972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df3735d-5e1e-40ef-9b8d-3c66ab4cf97c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:10.109906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df3735d-5e1e-40ef-9b8d-3c66ab4cf97c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:10.110550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df3735d-5e1e-40ef-9b8d-3c66ab4cf97c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:10.111147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6df3735d-5e1e-40ef-9b8d-3c66ab4cf97c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:10.806329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-431846d5-b618-4ed3-b50b-3a4256f199d1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:10.816393 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-431846d5-b618-4ed3-b50b-3a4256f199d1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1323 microversion: 2.1 time: 1.001042 Aug 27 02:53:10.817003 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2054/4316] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:09 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1323 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:10.823815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e6a07ec2-fc84-41bf-821f-fcc6927952cf req-ca8e8ff4-e7d2-42ad-b426-8c0662eeffc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb921ba2-f893-4131-a5e2-a51d05eabcd8", "tag": "e178da5f-6f2a-433b-a845-5c4706053351"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:10.854764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e6a07ec2-fc84-41bf-821f-fcc6927952cf req-ca8e8ff4-e7d2-42ad-b426-8c0662eeffc4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:10.855469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e6a07ec2-fc84-41bf-821f-fcc6927952cf req-ca8e8ff4-e7d2-42ad-b426-8c0662eeffc4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:10.855926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e6a07ec2-fc84-41bf-821f-fcc6927952cf req-ca8e8ff4-e7d2-42ad-b426-8c0662eeffc4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:10.871552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6df3735d-5e1e-40ef-9b8d-3c66ab4cf97c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:10.882081 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e6a07ec2-fc84-41bf-821f-fcc6927952cf req-ca8e8ff4-e7d2-42ad-b426-8c0662eeffc4 service nova] Creating event network-changed:e178da5f-6f2a-433b-a845-5c4706053351 for instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 on n-h2-852084-5 Aug 27 02:53:10.896783 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e6a07ec2-fc84-41bf-821f-fcc6927952cf req-ca8e8ff4-e7d2-42ad-b426-8c0662eeffc4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078417 Aug 27 02:53:10.899801 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2055/4317] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:10.910172 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6df3735d-5e1e-40ef-9b8d-3c66ab4cf97c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1663 microversion: 2.1 time: 0.825592 Aug 27 02:53:10.912385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-324bba7a-753b-4ee0-a3b8-17453ee0e067 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:10.913233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-324bba7a-753b-4ee0-a3b8-17453ee0e067 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:10.913353 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2263/4318] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:10 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1663 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:10.928085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-324bba7a-753b-4ee0-a3b8-17453ee0e067 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:10.928588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-324bba7a-753b-4ee0-a3b8-17453ee0e067 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:10.929036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-324bba7a-753b-4ee0-a3b8-17453ee0e067 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:10.934017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-324bba7a-753b-4ee0-a3b8-17453ee0e067 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:10.935174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-324bba7a-753b-4ee0-a3b8-17453ee0e067 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:10.935637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-324bba7a-753b-4ee0-a3b8-17453ee0e067 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:11.670140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-324bba7a-753b-4ee0-a3b8-17453ee0e067 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:11.687262 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-324bba7a-753b-4ee0-a3b8-17453ee0e067 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1552 microversion: 2.1 time: 0.785953 Aug 27 02:53:11.690279 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2056/4319] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:10 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1552 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:11.860543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-76d52eb6-54bf-4208-ba58-b8489245c824 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:11.861373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-76d52eb6-54bf-4208-ba58-b8489245c824 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:11.869607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d52eb6-54bf-4208-ba58-b8489245c824 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:11.870236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d52eb6-54bf-4208-ba58-b8489245c824 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:11.870879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d52eb6-54bf-4208-ba58-b8489245c824 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:11.871868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d52eb6-54bf-4208-ba58-b8489245c824 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:11.873121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d52eb6-54bf-4208-ba58-b8489245c824 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:11.873820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-76d52eb6-54bf-4208-ba58-b8489245c824 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:11.958688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b04946c-1033-4dc9-b65a-50e53f2de9fb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:11.959496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9b04946c-1033-4dc9-b65a-50e53f2de9fb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:11.975944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b04946c-1033-4dc9-b65a-50e53f2de9fb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:11.977000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b04946c-1033-4dc9-b65a-50e53f2de9fb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:11.978062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b04946c-1033-4dc9-b65a-50e53f2de9fb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:11.980035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b04946c-1033-4dc9-b65a-50e53f2de9fb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:11.980668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b04946c-1033-4dc9-b65a-50e53f2de9fb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:11.981634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b04946c-1033-4dc9-b65a-50e53f2de9fb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:12.663436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-76d52eb6-54bf-4208-ba58-b8489245c824 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:12.678398 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-76d52eb6-54bf-4208-ba58-b8489245c824 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1323 microversion: 2.1 time: 0.823462 Aug 27 02:53:12.680662 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2264/4320] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:11 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1323 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:12.733570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba115c5a-4cd5-45b8-b4c1-2167931dd704 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:12.734505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ba115c5a-4cd5-45b8-b4c1-2167931dd704 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:12.749003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba115c5a-4cd5-45b8-b4c1-2167931dd704 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:12.749556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba115c5a-4cd5-45b8-b4c1-2167931dd704 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:12.750038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba115c5a-4cd5-45b8-b4c1-2167931dd704 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:12.753906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba115c5a-4cd5-45b8-b4c1-2167931dd704 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:12.756510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba115c5a-4cd5-45b8-b4c1-2167931dd704 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:12.757504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba115c5a-4cd5-45b8-b4c1-2167931dd704 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:13.287488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ba115c5a-4cd5-45b8-b4c1-2167931dd704 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:13.300331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9b04946c-1033-4dc9-b65a-50e53f2de9fb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:13.308091 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ba115c5a-4cd5-45b8-b4c1-2167931dd704 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1552 microversion: 2.1 time: 0.580529 Aug 27 02:53:13.311893 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2265/4321] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:12 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1552 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:13.328900 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9b04946c-1033-4dc9-b65a-50e53f2de9fb tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1663 microversion: 2.1 time: 1.381033 Aug 27 02:53:13.334024 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2057/4322] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:11 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1663 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:13.613962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-fd7e0b5a-1b31-4cd3-aa64-e900fb482a90 req-56872f66-ea52-4fa7-b596-a2cdc1da3ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e181b7bb-e89e-413d-9879-818eb731e6f5", "name": "network-vif-deleted", "tag": "9021c40e-8a77-4f06-88e7-6eab99971e9b"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:13.647157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-fd7e0b5a-1b31-4cd3-aa64-e900fb482a90 req-56872f66-ea52-4fa7-b596-a2cdc1da3ea1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:13.648436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-fd7e0b5a-1b31-4cd3-aa64-e900fb482a90 req-56872f66-ea52-4fa7-b596-a2cdc1da3ea1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:13.649543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-fd7e0b5a-1b31-4cd3-aa64-e900fb482a90 req-56872f66-ea52-4fa7-b596-a2cdc1da3ea1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:13.692682 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-fd7e0b5a-1b31-4cd3-aa64-e900fb482a90 req-56872f66-ea52-4fa7-b596-a2cdc1da3ea1 service nova] Creating event network-vif-deleted:9021c40e-8a77-4f06-88e7-6eab99971e9b for instance e181b7bb-e89e-413d-9879-818eb731e6f5 on n-h1-852084-5 Aug 27 02:53:13.702339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1d02bb1e-0de6-49ce-a646-86a638977a60 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:13.703379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1d02bb1e-0de6-49ce-a646-86a638977a60 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:13.720641 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-fd7e0b5a-1b31-4cd3-aa64-e900fb482a90 req-56872f66-ea52-4fa7-b596-a2cdc1da3ea1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117818 Aug 27 02:53:13.721410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d02bb1e-0de6-49ce-a646-86a638977a60 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:13.722446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d02bb1e-0de6-49ce-a646-86a638977a60 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:13.723143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d02bb1e-0de6-49ce-a646-86a638977a60 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:13.724126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d02bb1e-0de6-49ce-a646-86a638977a60 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:13.724795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d02bb1e-0de6-49ce-a646-86a638977a60 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:13.725460 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2266/4323] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:53:13.728158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d02bb1e-0de6-49ce-a646-86a638977a60 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:14.104238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1d02bb1e-0de6-49ce-a646-86a638977a60 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:14.115835 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1d02bb1e-0de6-49ce-a646-86a638977a60 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1323 microversion: 2.1 time: 0.417986 Aug 27 02:53:14.123527 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2058/4324] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:13 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1323 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:14.344990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61279ca7-098f-4ed9-90cc-c6d04b0fd369 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:14.346805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-61279ca7-098f-4ed9-90cc-c6d04b0fd369 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:14.361321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-435b0094-50cc-45c4-8a13-82f29c3c56cc tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:14.364271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-435b0094-50cc-45c4-8a13-82f29c3c56cc tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:14.392720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61279ca7-098f-4ed9-90cc-c6d04b0fd369 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:14.395174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61279ca7-098f-4ed9-90cc-c6d04b0fd369 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:14.400118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-435b0094-50cc-45c4-8a13-82f29c3c56cc tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:14.400707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61279ca7-098f-4ed9-90cc-c6d04b0fd369 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:14.404554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61279ca7-098f-4ed9-90cc-c6d04b0fd369 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:14.405539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61279ca7-098f-4ed9-90cc-c6d04b0fd369 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:14.405972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-435b0094-50cc-45c4-8a13-82f29c3c56cc tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:14.406702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-435b0094-50cc-45c4-8a13-82f29c3c56cc tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:14.407432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61279ca7-098f-4ed9-90cc-c6d04b0fd369 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:14.409091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-435b0094-50cc-45c4-8a13-82f29c3c56cc tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:14.413777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-435b0094-50cc-45c4-8a13-82f29c3c56cc tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:14.414689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-435b0094-50cc-45c4-8a13-82f29c3c56cc tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:14.607382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-61279ca7-098f-4ed9-90cc-c6d04b0fd369 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:14.630636 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61279ca7-098f-4ed9-90cc-c6d04b0fd369 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1345 microversion: 2.1 time: 0.291633 Aug 27 02:53:14.633985 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2267/4325] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:14 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1345 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:15.103491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-435b0094-50cc-45c4-8a13-82f29c3c56cc tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:15.115540 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-435b0094-50cc-45c4-8a13-82f29c3c56cc tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1667 microversion: 2.1 time: 0.759734 Aug 27 02:53:15.116518 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2059/4326] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:14 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1667 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:15.142408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2ecbace1-905c-4fce-9a7c-cecd3c41c80f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:15.143318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2ecbace1-905c-4fce-9a7c-cecd3c41c80f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:15.154502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ecbace1-905c-4fce-9a7c-cecd3c41c80f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:15.155300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ecbace1-905c-4fce-9a7c-cecd3c41c80f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:15.155953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ecbace1-905c-4fce-9a7c-cecd3c41c80f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:15.156947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ecbace1-905c-4fce-9a7c-cecd3c41c80f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:15.157627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ecbace1-905c-4fce-9a7c-cecd3c41c80f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:15.158658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ecbace1-905c-4fce-9a7c-cecd3c41c80f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:15.578391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2ecbace1-905c-4fce-9a7c-cecd3c41c80f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:15.597028 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2ecbace1-905c-4fce-9a7c-cecd3c41c80f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1323 microversion: 2.1 time: 0.460299 Aug 27 02:53:15.602624 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2268/4327] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:15 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:15.653850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d6cef7d6-7439-493e-b915-bc033ce75728 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:15.655370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d6cef7d6-7439-493e-b915-bc033ce75728 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:15.666422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6cef7d6-7439-493e-b915-bc033ce75728 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:15.668725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6cef7d6-7439-493e-b915-bc033ce75728 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:15.671901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6cef7d6-7439-493e-b915-bc033ce75728 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:15.673131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6cef7d6-7439-493e-b915-bc033ce75728 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:15.673807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6cef7d6-7439-493e-b915-bc033ce75728 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:15.674441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6cef7d6-7439-493e-b915-bc033ce75728 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:15.898349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6cef7d6-7439-493e-b915-bc033ce75728 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:15.909311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:15.916582 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d6cef7d6-7439-493e-b915-bc033ce75728 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1345 microversion: 2.1 time: 0.263781 Aug 27 02:53:15.930964 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2060/4328] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:15 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1345 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:16.628983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-17f79f04-f27f-4686-bb61-ac00bfe06517 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:16.630295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-17f79f04-f27f-4686-bb61-ac00bfe06517 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:16.644255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17f79f04-f27f-4686-bb61-ac00bfe06517 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:16.646693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17f79f04-f27f-4686-bb61-ac00bfe06517 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:16.648152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17f79f04-f27f-4686-bb61-ac00bfe06517 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:16.650416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17f79f04-f27f-4686-bb61-ac00bfe06517 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:16.651023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17f79f04-f27f-4686-bb61-ac00bfe06517 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:16.651521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17f79f04-f27f-4686-bb61-ac00bfe06517 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:16.940993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3eea1c9-71a4-45c4-a471-3b6e4c301fa0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:16.942392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f3eea1c9-71a4-45c4-a471-3b6e4c301fa0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:16.953399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3eea1c9-71a4-45c4-a471-3b6e4c301fa0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:16.954417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3eea1c9-71a4-45c4-a471-3b6e4c301fa0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:16.955044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3eea1c9-71a4-45c4-a471-3b6e4c301fa0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:16.956259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3eea1c9-71a4-45c4-a471-3b6e4c301fa0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:16.956941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3eea1c9-71a4-45c4-a471-3b6e4c301fa0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:16.957934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3eea1c9-71a4-45c4-a471-3b6e4c301fa0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:17.071691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f3eea1c9-71a4-45c4-a471-3b6e4c301fa0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:17.087174 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f3eea1c9-71a4-45c4-a471-3b6e4c301fa0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1345 microversion: 2.1 time: 0.151920 Aug 27 02:53:17.091748 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2061/4329] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:16 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:17.109489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-17f79f04-f27f-4686-bb61-ac00bfe06517 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:17.122165 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-17f79f04-f27f-4686-bb61-ac00bfe06517 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1323 microversion: 2.1 time: 0.500608 Aug 27 02:53:17.123410 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2269/4330] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:16 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1323 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:18.116730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ccae711d-15a2-4592-8f47-d05daa247891 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:18.125769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ccae711d-15a2-4592-8f47-d05daa247891 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:18.141193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccae711d-15a2-4592-8f47-d05daa247891 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:18.141792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccae711d-15a2-4592-8f47-d05daa247891 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:18.142300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccae711d-15a2-4592-8f47-d05daa247891 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:18.143070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccae711d-15a2-4592-8f47-d05daa247891 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:18.143589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccae711d-15a2-4592-8f47-d05daa247891 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:18.144679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccae711d-15a2-4592-8f47-d05daa247891 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:18.166661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0cea466e-81e0-40b4-8da8-ff01eb25588f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:18.167874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0cea466e-81e0-40b4-8da8-ff01eb25588f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:18.177030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cea466e-81e0-40b4-8da8-ff01eb25588f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:18.177976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cea466e-81e0-40b4-8da8-ff01eb25588f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:18.178434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cea466e-81e0-40b4-8da8-ff01eb25588f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:18.179176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cea466e-81e0-40b4-8da8-ff01eb25588f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:18.179644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cea466e-81e0-40b4-8da8-ff01eb25588f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:18.180248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cea466e-81e0-40b4-8da8-ff01eb25588f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:18.207738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:18.269056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ccae711d-15a2-4592-8f47-d05daa247891 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:18.278571 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ccae711d-15a2-4592-8f47-d05daa247891 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1345 microversion: 2.1 time: 0.169399 Aug 27 02:53:18.289371 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2062/4331] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:18 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1345 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:19.077345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0cea466e-81e0-40b4-8da8-ff01eb25588f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:19.098175 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0cea466e-81e0-40b4-8da8-ff01eb25588f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1323 microversion: 2.1 time: 0.933242 Aug 27 02:53:19.099492 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2270/4332] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:18 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1323 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:19.147698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-41097108-4890-496c-a436-20273027b61c req-f24d4dcd-7c2e-49eb-8f14-ab6ba9fae859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb921ba2-f893-4131-a5e2-a51d05eabcd8", "name": "network-vif-plugged", "status": "completed", "tag": "e178da5f-6f2a-433b-a845-5c4706053351"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:19.194839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-41097108-4890-496c-a436-20273027b61c req-f24d4dcd-7c2e-49eb-8f14-ab6ba9fae859 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.195096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-41097108-4890-496c-a436-20273027b61c req-f24d4dcd-7c2e-49eb-8f14-ab6ba9fae859 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.195460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-41097108-4890-496c-a436-20273027b61c req-f24d4dcd-7c2e-49eb-8f14-ab6ba9fae859 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.222989 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-41097108-4890-496c-a436-20273027b61c req-f24d4dcd-7c2e-49eb-8f14-ab6ba9fae859 service nova] Creating event network-vif-plugged:e178da5f-6f2a-433b-a845-5c4706053351 for instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 on n-h2-852084-5 Aug 27 02:53:19.228533 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-41097108-4890-496c-a436-20273027b61c req-f24d4dcd-7c2e-49eb-8f14-ab6ba9fae859 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.510544 Aug 27 02:53:19.229925 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2063/4333] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:19.311288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-921fafba-d00a-4c7e-bb56-28aa818e658e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:19.311938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-921fafba-d00a-4c7e-bb56-28aa818e658e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:19.329279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921fafba-d00a-4c7e-bb56-28aa818e658e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.329760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921fafba-d00a-4c7e-bb56-28aa818e658e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.333352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921fafba-d00a-4c7e-bb56-28aa818e658e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.334617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921fafba-d00a-4c7e-bb56-28aa818e658e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:19.346835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921fafba-d00a-4c7e-bb56-28aa818e658e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:19.347587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921fafba-d00a-4c7e-bb56-28aa818e658e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:19.585618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-921fafba-d00a-4c7e-bb56-28aa818e658e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:19.605628 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-921fafba-d00a-4c7e-bb56-28aa818e658e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1345 microversion: 2.1 time: 0.299172 Aug 27 02:53:19.607953 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2271/4334] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:19 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1345 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:20.127915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df424fd2-8c47-4e23-8ad2-a53c82420cf0 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:20.134325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-df424fd2-8c47-4e23-8ad2-a53c82420cf0 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:20.187739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df424fd2-8c47-4e23-8ad2-a53c82420cf0 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:20.188813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df424fd2-8c47-4e23-8ad2-a53c82420cf0 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:20.189263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df424fd2-8c47-4e23-8ad2-a53c82420cf0 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:20.198381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df424fd2-8c47-4e23-8ad2-a53c82420cf0 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:20.203807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df424fd2-8c47-4e23-8ad2-a53c82420cf0 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:20.207043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df424fd2-8c47-4e23-8ad2-a53c82420cf0 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:20.666719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b3fe06fa-7c3c-44f5-a4a7-cef6e4569566 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:20.667441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b3fe06fa-7c3c-44f5-a4a7-cef6e4569566 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:20.688162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3fe06fa-7c3c-44f5-a4a7-cef6e4569566 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:20.688656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3fe06fa-7c3c-44f5-a4a7-cef6e4569566 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:20.689096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3fe06fa-7c3c-44f5-a4a7-cef6e4569566 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:20.703644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3fe06fa-7c3c-44f5-a4a7-cef6e4569566 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:20.704264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3fe06fa-7c3c-44f5-a4a7-cef6e4569566 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:20.704716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3fe06fa-7c3c-44f5-a4a7-cef6e4569566 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:21.531866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b3fe06fa-7c3c-44f5-a4a7-cef6e4569566 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:21.541261 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b3fe06fa-7c3c-44f5-a4a7-cef6e4569566 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1345 microversion: 2.1 time: 0.895379 Aug 27 02:53:21.554415 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2272/4335] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:20 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1345 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:21.625954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-df424fd2-8c47-4e23-8ad2-a53c82420cf0 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:21.637747 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-df424fd2-8c47-4e23-8ad2-a53c82420cf0 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1323 microversion: 2.1 time: 1.520720 Aug 27 02:53:21.641766 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2064/4336] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:20 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1323 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:22.582991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b2747d02-4332-4eb4-a315-ff0fc9e4d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:22.583928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b2747d02-4332-4eb4-a315-ff0fc9e4d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:22.595385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:22.605157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2747d02-4332-4eb4-a315-ff0fc9e4d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.606624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2747d02-4332-4eb4-a315-ff0fc9e4d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.607422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2747d02-4332-4eb4-a315-ff0fc9e4d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.608426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2747d02-4332-4eb4-a315-ff0fc9e4d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.610579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2747d02-4332-4eb4-a315-ff0fc9e4d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.611940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2747d02-4332-4eb4-a315-ff0fc9e4d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.660650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2f2d885a-b498-42e2-be71-d6cfc46c1c6f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:22.661755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2f2d885a-b498-42e2-be71-d6cfc46c1c6f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:22.691246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f2d885a-b498-42e2-be71-d6cfc46c1c6f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.692203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f2d885a-b498-42e2-be71-d6cfc46c1c6f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.693210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f2d885a-b498-42e2-be71-d6cfc46c1c6f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.694799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f2d885a-b498-42e2-be71-d6cfc46c1c6f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:22.695562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f2d885a-b498-42e2-be71-d6cfc46c1c6f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:22.696377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f2d885a-b498-42e2-be71-d6cfc46c1c6f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:22.749635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b2747d02-4332-4eb4-a315-ff0fc9e4d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:22.762688 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b2747d02-4332-4eb4-a315-ff0fc9e4d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1345 microversion: 2.1 time: 0.186684 Aug 27 02:53:22.763657 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2273/4337] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:22 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1345 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:23.381172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2f2d885a-b498-42e2-be71-d6cfc46c1c6f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:23.408075 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2f2d885a-b498-42e2-be71-d6cfc46c1c6f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1517 microversion: 2.1 time: 0.752569 Aug 27 02:53:23.410009 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2065/4338] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:22 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1517 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:23.436254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-62954286-32ed-4498-8c71-4abbb7d4cae6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:23.447392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-62954286-32ed-4498-8c71-4abbb7d4cae6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:23.468627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62954286-32ed-4498-8c71-4abbb7d4cae6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.469448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62954286-32ed-4498-8c71-4abbb7d4cae6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.473309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62954286-32ed-4498-8c71-4abbb7d4cae6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.476175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62954286-32ed-4498-8c71-4abbb7d4cae6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.476936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62954286-32ed-4498-8c71-4abbb7d4cae6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.478379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-62954286-32ed-4498-8c71-4abbb7d4cae6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.571796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-62954286-32ed-4498-8c71-4abbb7d4cae6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lazy-loading 'flavor' on Instance uuid cb921ba2-f893-4131-a5e2-a51d05eabcd8 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:53:23.784847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-749c784d-eb59-497f-8d5a-12a171771345 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:23.786482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-749c784d-eb59-497f-8d5a-12a171771345 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:23.799551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-749c784d-eb59-497f-8d5a-12a171771345 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.805016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-749c784d-eb59-497f-8d5a-12a171771345 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.805476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-749c784d-eb59-497f-8d5a-12a171771345 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.814140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-749c784d-eb59-497f-8d5a-12a171771345 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.814554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-749c784d-eb59-497f-8d5a-12a171771345 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.815369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-749c784d-eb59-497f-8d5a-12a171771345 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.876186 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-62954286-32ed-4498-8c71-4abbb7d4cae6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "POST /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8/action" status: 200 len: 32 microversion: 2.1 time: 0.445456 Aug 27 02:53:23.877872 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2274/4339] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:53:23 2022] POST /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8/action => generated 32 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 02:53:23.915914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-77e03bd1-f03d-4351-ad37-d01023dc3bca tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:23.920399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-77e03bd1-f03d-4351-ad37-d01023dc3bca tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:23.939236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e03bd1-f03d-4351-ad37-d01023dc3bca tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.942429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e03bd1-f03d-4351-ad37-d01023dc3bca tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.943962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e03bd1-f03d-4351-ad37-d01023dc3bca tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:23.946820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e03bd1-f03d-4351-ad37-d01023dc3bca tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:23.949794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e03bd1-f03d-4351-ad37-d01023dc3bca tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:23.950727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e03bd1-f03d-4351-ad37-d01023dc3bca tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:24.048536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-749c784d-eb59-497f-8d5a-12a171771345 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:24.066698 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-749c784d-eb59-497f-8d5a-12a171771345 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1345 microversion: 2.1 time: 0.285740 Aug 27 02:53:24.073758 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2066/4340] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:23 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1345 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:24.445340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-77e03bd1-f03d-4351-ad37-d01023dc3bca tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:24.460926 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-77e03bd1-f03d-4351-ad37-d01023dc3bca tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.569049 Aug 27 02:53:24.461562 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2275/4341] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:23 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:25.087594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9761713e-9885-4bc1-b063-de57d587288c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:25.088232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9761713e-9885-4bc1-b063-de57d587288c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:25.107758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9761713e-9885-4bc1-b063-de57d587288c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:25.108382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9761713e-9885-4bc1-b063-de57d587288c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:25.109003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9761713e-9885-4bc1-b063-de57d587288c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:25.110489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9761713e-9885-4bc1-b063-de57d587288c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:25.110908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9761713e-9885-4bc1-b063-de57d587288c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:25.111423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9761713e-9885-4bc1-b063-de57d587288c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:25.238412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9761713e-9885-4bc1-b063-de57d587288c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:25.256240 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9761713e-9885-4bc1-b063-de57d587288c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1345 microversion: 2.1 time: 0.172867 Aug 27 02:53:25.268667 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2067/4342] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:25 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1345 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:25.484499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ad5d0b2-0d3a-4baa-ad51-3c6d6075d0ab tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:25.485247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ad5d0b2-0d3a-4baa-ad51-3c6d6075d0ab tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:25.506581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ad5d0b2-0d3a-4baa-ad51-3c6d6075d0ab tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:25.510771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ad5d0b2-0d3a-4baa-ad51-3c6d6075d0ab tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:25.511336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ad5d0b2-0d3a-4baa-ad51-3c6d6075d0ab tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:25.516653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ad5d0b2-0d3a-4baa-ad51-3c6d6075d0ab tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:25.517963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ad5d0b2-0d3a-4baa-ad51-3c6d6075d0ab tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:25.518435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ad5d0b2-0d3a-4baa-ad51-3c6d6075d0ab tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:26.185781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ad5d0b2-0d3a-4baa-ad51-3c6d6075d0ab tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:26.201405 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ad5d0b2-0d3a-4baa-ad51-3c6d6075d0ab tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.721959 Aug 27 02:53:26.207983 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2276/4343] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:25 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:26.292053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:26.292688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:26.315183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:26.315672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:26.316401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:26.316847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:26.317368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:26.325213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:26.472308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:26.473945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:26.479038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:26.479890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lazy-loading 'fault' on Instance uuid e181b7bb-e89e-413d-9879-818eb731e6f5 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:53:26.699073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:26.722252 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f702d239-da48-4afb-b513-758d574e62f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 200 len: 1304 microversion: 2.1 time: 0.434639 Aug 27 02:53:26.724979 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2068/4344] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:26 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 1304 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:27.229942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-baaba34d-1d1d-4213-a54c-6c847311df68 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:27.232092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-baaba34d-1d1d-4213-a54c-6c847311df68 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:27.257214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-baaba34d-1d1d-4213-a54c-6c847311df68 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.258959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-baaba34d-1d1d-4213-a54c-6c847311df68 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.259416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-baaba34d-1d1d-4213-a54c-6c847311df68 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.265209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-baaba34d-1d1d-4213-a54c-6c847311df68 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.267374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-baaba34d-1d1d-4213-a54c-6c847311df68 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.269976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-baaba34d-1d1d-4213-a54c-6c847311df68 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.593749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-baaba34d-1d1d-4213-a54c-6c847311df68 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:27.608769 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-baaba34d-1d1d-4213-a54c-6c847311df68 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.384685 Aug 27 02:53:27.611789 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2277/4345] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:27 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:27.763248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:27.764699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:27.791289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.792805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.794430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.795883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:27.797434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:27.799717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:27.844234 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 HTTP/1.1 Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'e181b7bb-e89e-413d-9879-818eb731e6f5'} Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:27.847991 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:27.851913 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:27.851913 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:27.851913 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:27.851913 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:53:27.851913 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:53:27.851913 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:53:27.851913 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:27.858328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:53:27.859223 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cec05c89-09b4-4f31-b0f8-2f407502e862 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 404 len: 111 microversion: 2.1 time: 0.102688 Aug 27 02:53:27.872540 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2069/4346] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:27 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:53:28.185464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:28.195622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:28.219848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:28.222781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:28.223251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.224020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:28.224499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:28.224996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.257573 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5/os-volume_attachments HTTP/1.1 Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'server_id': 'e181b7bb-e89e-413d-9879-818eb731e6f5'} Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:53:28.261127 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3452b5f4-68dd-43e6-bc07-f9726e6d1b9d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.084968 Aug 27 02:53:28.272006 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2278/4347] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:53:28 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5/os-volume_attachments => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:53:28.634688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d826f03e-6722-4924-875a-4056270c9940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:28.635685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d826f03e-6722-4924-875a-4056270c9940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:28.650037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d826f03e-6722-4924-875a-4056270c9940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:28.653739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d826f03e-6722-4924-875a-4056270c9940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:28.654662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d826f03e-6722-4924-875a-4056270c9940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.658047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d826f03e-6722-4924-875a-4056270c9940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:28.659564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d826f03e-6722-4924-875a-4056270c9940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:28.664706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d826f03e-6722-4924-875a-4056270c9940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:28.681581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1232867169", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a3bbba16-ea21-41e9-a19d-afd74184c636"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:28.802582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] validate_networks() for [('a3bbba16-ea21-41e9-a19d-afd74184c636', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:53:29.235251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d826f03e-6722-4924-875a-4056270c9940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:29.263369 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d826f03e-6722-4924-875a-4056270c9940 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.632117 Aug 27 02:53:29.268186 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2070/4348] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:28 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:29.741799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:53:29.742406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:53:29.743018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:53:29.744139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:53:29.744672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:53:29.767680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.771207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.771810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.773155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:29.774190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:29.777381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:29.818246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:53:29.827319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for user b508f2fe4b394f589b067f5b3de49a0e and project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:53:29.844480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:53:29.847451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 73949063-b30f-4fe6-850f-920c49740738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:53:29.916630 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7337bbe9-c976-45ab-bdf1-bf47d9f3df5a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247719 Aug 27 02:53:29.918404 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2279/4349] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:53:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:53:29.947170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-056c7066-d43e-47f3-a1f0-886ccd278a16 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:29.948266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-056c7066-d43e-47f3-a1f0-886ccd278a16 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 73949063-b30f-4fe6-850f-920c49740738] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:29.974269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:30.111361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-056c7066-d43e-47f3-a1f0-886ccd278a16 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:30.141956 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-056c7066-d43e-47f3-a1f0-886ccd278a16 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738" status: 200 len: 1215 microversion: 2.1 time: 0.205272 Aug 27 02:53:30.143784 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2071/4350] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:29 2022] GET /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:30.173990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eb7a7811-f1ad-4f45-a0d2-2e20d8142fd0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:30.174504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eb7a7811-f1ad-4f45-a0d2-2e20d8142fd0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 73949063-b30f-4fe6-850f-920c49740738] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:30.209333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eb7a7811-f1ad-4f45-a0d2-2e20d8142fd0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 73949063-b30f-4fe6-850f-920c49740738] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:53:30.292805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5fba4222-2386-4f1a-87cf-5cc72233d9ec tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:30.293833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5fba4222-2386-4f1a-87cf-5cc72233d9ec tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:30.330693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fba4222-2386-4f1a-87cf-5cc72233d9ec tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:30.341765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fba4222-2386-4f1a-87cf-5cc72233d9ec tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:30.343000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fba4222-2386-4f1a-87cf-5cc72233d9ec tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:30.344482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fba4222-2386-4f1a-87cf-5cc72233d9ec tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:30.345366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fba4222-2386-4f1a-87cf-5cc72233d9ec tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:30.345915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5fba4222-2386-4f1a-87cf-5cc72233d9ec tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:30.985759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5fba4222-2386-4f1a-87cf-5cc72233d9ec tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:31.003305 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5fba4222-2386-4f1a-87cf-5cc72233d9ec tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.717290 Aug 27 02:53:31.006777 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2072/4351] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:30 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:31.052327 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.scheduler.client.report [None req-eb7a7811-f1ad-4f45-a0d2-2e20d8142fd0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Deleted allocations for instance 73949063-b30f-4fe6-850f-920c49740738 Aug 27 02:53:31.066358 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.compute.api [None req-eb7a7811-f1ad-4f45-a0d2-2e20d8142fd0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 73949063-b30f-4fe6-850f-920c49740738] Instance Mapping does not exist while attempting local delete cleanup. Aug 27 02:53:31.069331 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eb7a7811-f1ad-4f45-a0d2-2e20d8142fd0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738" status: 204 len: 0 microversion: 2.1 time: 0.900643 Aug 27 02:53:31.072683 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2280/4352] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:53:30 2022] DELETE /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:53:31.087757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f8c3269-4f5d-454d-81d2-47793663ca1a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:31.092734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5f8c3269-4f5d-454d-81d2-47793663ca1a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 73949063-b30f-4fe6-850f-920c49740738] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:31.108448 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-5f8c3269-4f5d-454d-81d2-47793663ca1a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f8c3269-4f5d-454d-81d2-47793663ca1a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738 HTTP/1.1 Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '73949063-b30f-4fe6-850f-920c49740738'} Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:53:31.112861 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:53:31.116502 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:53:31.116502 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:53:31.116502 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:53:31.116502 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:53:31.116502 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:53:31.118839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f8c3269-4f5d-454d-81d2-47793663ca1a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:53:31.121140 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5f8c3269-4f5d-454d-81d2-47793663ca1a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738" status: 404 len: 111 microversion: 2.1 time: 0.043158 Aug 27 02:53:31.132535 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2073/4353] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:31 2022] GET /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:53:31.413630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-662988042", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a3bbba16-ea21-41e9-a19d-afd74184c636"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:31.515042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] validate_networks() for [('a3bbba16-ea21-41e9-a19d-afd74184c636', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:53:32.038041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-900d3e0e-82f9-47d7-bdb6-208e3e94b622 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:32.039801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-900d3e0e-82f9-47d7-bdb6-208e3e94b622 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:32.083844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-900d3e0e-82f9-47d7-bdb6-208e3e94b622 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:32.095112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-900d3e0e-82f9-47d7-bdb6-208e3e94b622 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:32.097531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-900d3e0e-82f9-47d7-bdb6-208e3e94b622 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:32.101010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-900d3e0e-82f9-47d7-bdb6-208e3e94b622 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:32.101912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-900d3e0e-82f9-47d7-bdb6-208e3e94b622 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:32.102963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-900d3e0e-82f9-47d7-bdb6-208e3e94b622 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:32.787479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-900d3e0e-82f9-47d7-bdb6-208e3e94b622 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:32.804682 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-900d3e0e-82f9-47d7-bdb6-208e3e94b622 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.775799 Aug 27 02:53:32.805661 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2074/4354] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:32 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:33.837050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c9bb5cb1-1ccf-4561-82dc-2a02dc2ee823 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:33.838406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c9bb5cb1-1ccf-4561-82dc-2a02dc2ee823 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:33.856202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9bb5cb1-1ccf-4561-82dc-2a02dc2ee823 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:33.879314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9bb5cb1-1ccf-4561-82dc-2a02dc2ee823 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:33.880149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9bb5cb1-1ccf-4561-82dc-2a02dc2ee823 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:33.881137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9bb5cb1-1ccf-4561-82dc-2a02dc2ee823 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:33.881887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9bb5cb1-1ccf-4561-82dc-2a02dc2ee823 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:33.882526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9bb5cb1-1ccf-4561-82dc-2a02dc2ee823 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:34.442417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:53:34.444052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:53:34.444951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:53:34.446481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:53:34.447473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:53:34.489312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:34.495802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:34.497851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:34.503441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:34.504907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:34.508384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:34.635068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:53:34.674159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for user b508f2fe4b394f589b067f5b3de49a0e and project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:53:34.762601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c9bb5cb1-1ccf-4561-82dc-2a02dc2ee823 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:34.775681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:53:34.787102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:53:34.820303 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c9bb5cb1-1ccf-4561-82dc-2a02dc2ee823 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.991095 Aug 27 02:53:34.827445 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2075/4355] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:33 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:34.970186 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-076a80af-3256-4ab8-95c6-0c2b4e2cbb48 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.561740 Aug 27 02:53:34.978842 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2281/4356] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:53:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:53:35.016604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e8a918b-c39e-4a12-9455-cef14a88e847 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:35.018947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e8a918b-c39e-4a12-9455-cef14a88e847 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:35.362575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6e8a918b-c39e-4a12-9455-cef14a88e847 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:35.371692 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e8a918b-c39e-4a12-9455-cef14a88e847 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1214 microversion: 2.1 time: 0.386777 Aug 27 02:53:35.391607 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2076/4357] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:34 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1214 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:35.859577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1e4d1b45-02b4-43a1-be1b-62e5cb2600ea tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:35.860755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1e4d1b45-02b4-43a1-be1b-62e5cb2600ea tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:35.904808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e4d1b45-02b4-43a1-be1b-62e5cb2600ea tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:35.905308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e4d1b45-02b4-43a1-be1b-62e5cb2600ea tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:35.905821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e4d1b45-02b4-43a1-be1b-62e5cb2600ea tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:35.906569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e4d1b45-02b4-43a1-be1b-62e5cb2600ea tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:35.907038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e4d1b45-02b4-43a1-be1b-62e5cb2600ea tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:35.907474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e4d1b45-02b4-43a1-be1b-62e5cb2600ea tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:36.419444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-160a3fb1-bf9e-42f2-a26c-8d504f50b6b4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:36.421310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-160a3fb1-bf9e-42f2-a26c-8d504f50b6b4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:36.481877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-160a3fb1-bf9e-42f2-a26c-8d504f50b6b4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:36.484127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-160a3fb1-bf9e-42f2-a26c-8d504f50b6b4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:36.485857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-160a3fb1-bf9e-42f2-a26c-8d504f50b6b4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:36.487234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-160a3fb1-bf9e-42f2-a26c-8d504f50b6b4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:36.490695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-160a3fb1-bf9e-42f2-a26c-8d504f50b6b4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:36.491563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-160a3fb1-bf9e-42f2-a26c-8d504f50b6b4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:36.588576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1e4d1b45-02b4-43a1-be1b-62e5cb2600ea tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:36.602690 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1e4d1b45-02b4-43a1-be1b-62e5cb2600ea tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.757508 Aug 27 02:53:36.604584 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2282/4358] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:35 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:36.796096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-160a3fb1-bf9e-42f2-a26c-8d504f50b6b4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:36.832626 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-160a3fb1-bf9e-42f2-a26c-8d504f50b6b4 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1218 microversion: 2.1 time: 0.417538 Aug 27 02:53:36.837851 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2077/4359] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:36 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1218 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:37.654331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c151ff9b-7dd3-4392-99c3-636aba26bdcc tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:37.660489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c151ff9b-7dd3-4392-99c3-636aba26bdcc tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:37.705614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c151ff9b-7dd3-4392-99c3-636aba26bdcc tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:37.707088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c151ff9b-7dd3-4392-99c3-636aba26bdcc tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:37.708470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c151ff9b-7dd3-4392-99c3-636aba26bdcc tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:37.710201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c151ff9b-7dd3-4392-99c3-636aba26bdcc tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:37.712448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c151ff9b-7dd3-4392-99c3-636aba26bdcc tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:37.713851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c151ff9b-7dd3-4392-99c3-636aba26bdcc tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:37.921890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-630f2c93-f823-41ff-8dcf-8ffac98bb4d7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:37.938476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-630f2c93-f823-41ff-8dcf-8ffac98bb4d7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:37.986116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-630f2c93-f823-41ff-8dcf-8ffac98bb4d7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:37.987496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-630f2c93-f823-41ff-8dcf-8ffac98bb4d7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:37.988713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-630f2c93-f823-41ff-8dcf-8ffac98bb4d7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:37.990354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-630f2c93-f823-41ff-8dcf-8ffac98bb4d7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:37.991469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-630f2c93-f823-41ff-8dcf-8ffac98bb4d7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:37.992497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-630f2c93-f823-41ff-8dcf-8ffac98bb4d7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:38.273997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-630f2c93-f823-41ff-8dcf-8ffac98bb4d7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:38.282503 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-630f2c93-f823-41ff-8dcf-8ffac98bb4d7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1266 microversion: 2.1 time: 0.391880 Aug 27 02:53:38.286437 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2078/4360] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:37 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:39.185142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c151ff9b-7dd3-4392-99c3-636aba26bdcc tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:39.199629 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c151ff9b-7dd3-4392-99c3-636aba26bdcc tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 1.552844 Aug 27 02:53:39.201958 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2283/4361] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:37 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:39.313587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f066d38e-e42e-4911-8612-03285d560fd1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:39.315602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f066d38e-e42e-4911-8612-03285d560fd1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:39.340701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f066d38e-e42e-4911-8612-03285d560fd1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:39.345321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f066d38e-e42e-4911-8612-03285d560fd1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:39.346373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f066d38e-e42e-4911-8612-03285d560fd1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:39.350582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f066d38e-e42e-4911-8612-03285d560fd1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:39.351418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f066d38e-e42e-4911-8612-03285d560fd1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:39.356704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f066d38e-e42e-4911-8612-03285d560fd1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:39.548090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f066d38e-e42e-4911-8612-03285d560fd1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:39.563707 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f066d38e-e42e-4911-8612-03285d560fd1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1272 microversion: 2.1 time: 0.256757 Aug 27 02:53:39.581712 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2079/4362] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:39 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:40.229661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ced83bd-3e8f-45e5-beb3-f953a16cb05e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:40.231569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ced83bd-3e8f-45e5-beb3-f953a16cb05e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:40.245662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ced83bd-3e8f-45e5-beb3-f953a16cb05e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:40.254959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ced83bd-3e8f-45e5-beb3-f953a16cb05e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:40.256353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ced83bd-3e8f-45e5-beb3-f953a16cb05e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:40.257767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ced83bd-3e8f-45e5-beb3-f953a16cb05e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:40.258483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ced83bd-3e8f-45e5-beb3-f953a16cb05e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:40.259265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ced83bd-3e8f-45e5-beb3-f953a16cb05e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:40.591146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3580dc32-cd90-4f52-8570-538a33a5fb04 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:40.592201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3580dc32-cd90-4f52-8570-538a33a5fb04 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:40.605723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3580dc32-cd90-4f52-8570-538a33a5fb04 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:40.606191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3580dc32-cd90-4f52-8570-538a33a5fb04 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:40.607946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3580dc32-cd90-4f52-8570-538a33a5fb04 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:40.608080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3580dc32-cd90-4f52-8570-538a33a5fb04 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:40.608804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3580dc32-cd90-4f52-8570-538a33a5fb04 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:40.618138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3580dc32-cd90-4f52-8570-538a33a5fb04 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:40.878124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3580dc32-cd90-4f52-8570-538a33a5fb04 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:40.899664 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3580dc32-cd90-4f52-8570-538a33a5fb04 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1272 microversion: 2.1 time: 0.313636 Aug 27 02:53:40.914261 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2080/4363] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:40 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:41.356287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ced83bd-3e8f-45e5-beb3-f953a16cb05e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:41.383173 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ced83bd-3e8f-45e5-beb3-f953a16cb05e tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 1.159318 Aug 27 02:53:41.398536 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2284/4364] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:40 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:41.961249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0fb40ffc-31b4-4c90-8c5a-446ab2f44a53 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:41.962600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0fb40ffc-31b4-4c90-8c5a-446ab2f44a53 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:41.996204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fb40ffc-31b4-4c90-8c5a-446ab2f44a53 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:41.999411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fb40ffc-31b4-4c90-8c5a-446ab2f44a53 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:42.001742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fb40ffc-31b4-4c90-8c5a-446ab2f44a53 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:42.003487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fb40ffc-31b4-4c90-8c5a-446ab2f44a53 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:42.006186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fb40ffc-31b4-4c90-8c5a-446ab2f44a53 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:42.007201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fb40ffc-31b4-4c90-8c5a-446ab2f44a53 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:42.069099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:42.411805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0fb40ffc-31b4-4c90-8c5a-446ab2f44a53 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:42.423917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd97c584-608e-4e51-9229-a5698699fbd4 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:42.428091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dd97c584-608e-4e51-9229-a5698699fbd4 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:42.469264 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0fb40ffc-31b4-4c90-8c5a-446ab2f44a53 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1314 microversion: 2.1 time: 0.514349 Aug 27 02:53:42.476646 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2081/4365] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:41 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:42.477270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd97c584-608e-4e51-9229-a5698699fbd4 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:42.478851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd97c584-608e-4e51-9229-a5698699fbd4 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:42.479652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd97c584-608e-4e51-9229-a5698699fbd4 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:42.485028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd97c584-608e-4e51-9229-a5698699fbd4 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:42.485926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd97c584-608e-4e51-9229-a5698699fbd4 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:42.486616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd97c584-608e-4e51-9229-a5698699fbd4 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:43.520665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dd97c584-608e-4e51-9229-a5698699fbd4 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:43.530522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b4f0071f-adfd-4f49-a11a-ac92a3e45d3c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:43.544477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b4f0071f-adfd-4f49-a11a-ac92a3e45d3c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:43.591316 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dd97c584-608e-4e51-9229-a5698699fbd4 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 1.172894 Aug 27 02:53:43.595759 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2285/4366] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:42 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:43.598138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4f0071f-adfd-4f49-a11a-ac92a3e45d3c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:43.599574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4f0071f-adfd-4f49-a11a-ac92a3e45d3c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:43.600537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4f0071f-adfd-4f49-a11a-ac92a3e45d3c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:43.601977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4f0071f-adfd-4f49-a11a-ac92a3e45d3c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:43.603035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4f0071f-adfd-4f49-a11a-ac92a3e45d3c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:43.609798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4f0071f-adfd-4f49-a11a-ac92a3e45d3c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:43.925571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b4f0071f-adfd-4f49-a11a-ac92a3e45d3c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:43.952597 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b4f0071f-adfd-4f49-a11a-ac92a3e45d3c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1314 microversion: 2.1 time: 0.441687 Aug 27 02:53:43.955387 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2082/4367] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:43 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:44.614891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:44.631263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c1edd59e-3138-458b-b9cb-701bb77e8485 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:44.635176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c1edd59e-3138-458b-b9cb-701bb77e8485 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:44.662496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1edd59e-3138-458b-b9cb-701bb77e8485 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:44.663054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1edd59e-3138-458b-b9cb-701bb77e8485 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:44.676982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a4e50ce6-b876-4d34-bb05-7011821372ed tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:44.684041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1edd59e-3138-458b-b9cb-701bb77e8485 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:44.684905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1edd59e-3138-458b-b9cb-701bb77e8485 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:44.687121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a4e50ce6-b876-4d34-bb05-7011821372ed tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:44.688932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1edd59e-3138-458b-b9cb-701bb77e8485 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:44.691570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a4e50ce6-b876-4d34-bb05-7011821372ed tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Searching by: {'deleted': False, 'project_id': '3126c8641780451c8c6882179cce59d2'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:53:44.692363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1edd59e-3138-458b-b9cb-701bb77e8485 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:44.718652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e50ce6-b876-4d34-bb05-7011821372ed tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:44.721842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e50ce6-b876-4d34-bb05-7011821372ed tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:44.722745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e50ce6-b876-4d34-bb05-7011821372ed tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:44.723814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e50ce6-b876-4d34-bb05-7011821372ed tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:44.724504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e50ce6-b876-4d34-bb05-7011821372ed tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:44.729208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a4e50ce6-b876-4d34-bb05-7011821372ed tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:44.774350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=14 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:44.816272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-a4e50ce6-b876-4d34-bb05-7011821372ed tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:53:44.903325 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a4e50ce6-b876-4d34-bb05-7011821372ed tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.230951 Aug 27 02:53:44.916373 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2083/4368] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 02:53:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:44.929015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:44.952438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:44.955666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Searching by: {'deleted': False, 'project_id': '3126c8641780451c8c6882179cce59d2'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:53:44.980364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:44.982894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:44.983417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:44.984920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:44.987612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:44.994795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:45.109564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:53:45.348249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c1edd59e-3138-458b-b9cb-701bb77e8485 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:45.372914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:45.381599 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c1edd59e-3138-458b-b9cb-701bb77e8485 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.767034 Aug 27 02:53:45.406517 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2286/4369] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:44 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:45.457966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:45.458822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:45.466916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:45.468778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6d9bfc7d-9add-431f-8138-d1ea90f0b091 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:45.475311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6d9bfc7d-9add-431f-8138-d1ea90f0b091 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:45.520858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9bfc7d-9add-431f-8138-d1ea90f0b091 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:45.523111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9bfc7d-9add-431f-8138-d1ea90f0b091 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:45.524289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9bfc7d-9add-431f-8138-d1ea90f0b091 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:45.528060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9bfc7d-9add-431f-8138-d1ea90f0b091 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:45.530943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9bfc7d-9add-431f-8138-d1ea90f0b091 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:45.536468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d9bfc7d-9add-431f-8138-d1ea90f0b091 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:46.007382 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-71ff9ad0-c10b-4106-b001-621858c08441 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 1.087595 Aug 27 02:53:46.008292 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2084/4370] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 02:53:44 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:46.124588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6d9bfc7d-9add-431f-8138-d1ea90f0b091 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:46.135379 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6d9bfc7d-9add-431f-8138-d1ea90f0b091 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1314 microversion: 2.1 time: 0.726590 Aug 27 02:53:46.142032 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2287/4371] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:45 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1314 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:46.159848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-12ef6d04-a3b8-480c-b8c3-82a73880e6b9 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:46.180852 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-12ef6d04-a3b8-480c-b8c3-82a73880e6b9 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035488 Aug 27 02:53:46.184074 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2288/4372] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:53:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:46.465063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d0570425-9ecb-4c9e-87c5-34bad6b01863 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:46.465759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d0570425-9ecb-4c9e-87c5-34bad6b01863 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:46.483386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0570425-9ecb-4c9e-87c5-34bad6b01863 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:46.483901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0570425-9ecb-4c9e-87c5-34bad6b01863 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:46.490363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0570425-9ecb-4c9e-87c5-34bad6b01863 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:46.491500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0570425-9ecb-4c9e-87c5-34bad6b01863 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:46.492010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0570425-9ecb-4c9e-87c5-34bad6b01863 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:46.492463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0570425-9ecb-4c9e-87c5-34bad6b01863 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:46.513824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:46.797165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3e8e9d82-0211-444f-806d-22dfdfa1801b req-8388d5c9-8f97-43d1-ab4f-cbc6e4d13c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f304ff1-b05a-47e9-ad46-9655aef3545a", "tag": "0dcfa0a1-3661-461d-9b13-7e314c359de9"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:46.854532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3e8e9d82-0211-444f-806d-22dfdfa1801b req-8388d5c9-8f97-43d1-ab4f-cbc6e4d13c6d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:46.855053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3e8e9d82-0211-444f-806d-22dfdfa1801b req-8388d5c9-8f97-43d1-ab4f-cbc6e4d13c6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:46.858365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3e8e9d82-0211-444f-806d-22dfdfa1801b req-8388d5c9-8f97-43d1-ab4f-cbc6e4d13c6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:46.880338 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3e8e9d82-0211-444f-806d-22dfdfa1801b req-8388d5c9-8f97-43d1-ab4f-cbc6e4d13c6d service nova] Creating event network-changed:0dcfa0a1-3661-461d-9b13-7e314c359de9 for instance 5f304ff1-b05a-47e9-ad46-9655aef3545a on n-h1-852084-5 Aug 27 02:53:46.895213 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3e8e9d82-0211-444f-806d-22dfdfa1801b req-8388d5c9-8f97-43d1-ab4f-cbc6e4d13c6d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.885635 Aug 27 02:53:46.899771 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2085/4373] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:46.906369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d43bdb1c-d632-4ad2-8d54-fdd3aa165994 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:46.907543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d0570425-9ecb-4c9e-87c5-34bad6b01863 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:46.908750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d43bdb1c-d632-4ad2-8d54-fdd3aa165994 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:46.915592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43bdb1c-d632-4ad2-8d54-fdd3aa165994 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:46.916360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43bdb1c-d632-4ad2-8d54-fdd3aa165994 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:46.916996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43bdb1c-d632-4ad2-8d54-fdd3aa165994 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:46.917998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43bdb1c-d632-4ad2-8d54-fdd3aa165994 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:46.918646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43bdb1c-d632-4ad2-8d54-fdd3aa165994 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:46.919261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d43bdb1c-d632-4ad2-8d54-fdd3aa165994 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:46.949476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d43bdb1c-d632-4ad2-8d54-fdd3aa165994 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:53:46.950400 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d0570425-9ecb-4c9e-87c5-34bad6b01863 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.487379 Aug 27 02:53:46.951548 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2289/4374] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:46 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:47.086394 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d43bdb1c-d632-4ad2-8d54-fdd3aa165994 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "DELETE /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 204 len: 0 microversion: 2.1 time: 0.184577 Aug 27 02:53:47.088036 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2086/4375] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:53:46 2022] DELETE /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:53:47.101515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-50e8befd-07c9-4532-87a0-5ff2091d505c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:47.103260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-50e8befd-07c9-4532-87a0-5ff2091d505c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:47.113232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50e8befd-07c9-4532-87a0-5ff2091d505c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:47.114214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50e8befd-07c9-4532-87a0-5ff2091d505c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:47.114892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50e8befd-07c9-4532-87a0-5ff2091d505c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:47.115968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50e8befd-07c9-4532-87a0-5ff2091d505c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:47.117186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50e8befd-07c9-4532-87a0-5ff2091d505c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:47.117813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50e8befd-07c9-4532-87a0-5ff2091d505c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:47.174053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-451333034", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "1454fb62-d5be-406a-9d52-9ef0e898fc14"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:47.296780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] validate_networks() for [('1454fb62-d5be-406a-9d52-9ef0e898fc14', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:53:47.425703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-50e8befd-07c9-4532-87a0-5ff2091d505c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:47.461951 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-50e8befd-07c9-4532-87a0-5ff2091d505c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1609 microversion: 2.1 time: 0.366022 Aug 27 02:53:47.467566 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2087/4376] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:47 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1609 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:47.490844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92268edf-7af2-4811-ad82-93c0c5c317d0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:47.492827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-92268edf-7af2-4811-ad82-93c0c5c317d0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:47.519952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92268edf-7af2-4811-ad82-93c0c5c317d0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:47.521545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92268edf-7af2-4811-ad82-93c0c5c317d0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:47.523150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92268edf-7af2-4811-ad82-93c0c5c317d0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:47.534445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92268edf-7af2-4811-ad82-93c0c5c317d0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:47.538507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92268edf-7af2-4811-ad82-93c0c5c317d0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:47.542344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92268edf-7af2-4811-ad82-93c0c5c317d0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:48.022071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-92268edf-7af2-4811-ad82-93c0c5c317d0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:48.039295 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-92268edf-7af2-4811-ad82-93c0c5c317d0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1314 microversion: 2.1 time: 0.565621 Aug 27 02:53:48.040271 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2088/4377] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:47 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:48.063638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-14ce54b2-52b5-413b-955e-0f124f06342b tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:48.064279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-14ce54b2-52b5-413b-955e-0f124f06342b tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:48.076177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14ce54b2-52b5-413b-955e-0f124f06342b tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:48.076827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14ce54b2-52b5-413b-955e-0f124f06342b tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:48.077273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14ce54b2-52b5-413b-955e-0f124f06342b tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:48.078163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14ce54b2-52b5-413b-955e-0f124f06342b tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:48.078642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14ce54b2-52b5-413b-955e-0f124f06342b tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:48.079086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14ce54b2-52b5-413b-955e-0f124f06342b tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:48.377934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:53:48.378778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:53:48.378983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:53:48.379257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:53:48.379681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:53:48.392915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:48.393762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:48.394519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:48.396076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:48.396738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:48.401117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-14ce54b2-52b5-413b-955e-0f124f06342b tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:48.410188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:48.411808 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-14ce54b2-52b5-413b-955e-0f124f06342b tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.361454 Aug 27 02:53:48.415997 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2089/4378] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:48 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:48.424733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7b7d41c-4544-43fc-a6de-eaf8b1ccf31c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:48.442628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7b7d41c-4544-43fc-a6de-eaf8b1ccf31c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:48.447878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Getting quotas for project 9007b9e59d3344828fab7f5f6b42ea7a. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:53:48.455714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Getting quotas for user fa8012fabe384a3aa26e9ca9d3dc6dcf and project 9007b9e59d3344828fab7f5f6b42ea7a. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:53:48.457152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b7d41c-4544-43fc-a6de-eaf8b1ccf31c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:48.458152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b7d41c-4544-43fc-a6de-eaf8b1ccf31c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:48.459023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b7d41c-4544-43fc-a6de-eaf8b1ccf31c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:48.463632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b7d41c-4544-43fc-a6de-eaf8b1ccf31c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:48.468011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b7d41c-4544-43fc-a6de-eaf8b1ccf31c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:48.468874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7b7d41c-4544-43fc-a6de-eaf8b1ccf31c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:48.473429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:53:48.478023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:53:48.545556 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-25d1689a-4194-4a74-aaf0-f3ead31f620e tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.586772 Aug 27 02:53:48.547091 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2290/4379] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:53:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:53:48.553450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2e88e3af-1817-4f71-842b-5421c09bcca1 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:48.554444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2e88e3af-1817-4f71-842b-5421c09bcca1 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:48.565259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e88e3af-1817-4f71-842b-5421c09bcca1 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:48.566282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e88e3af-1817-4f71-842b-5421c09bcca1 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:48.566990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e88e3af-1817-4f71-842b-5421c09bcca1 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:48.567966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e88e3af-1817-4f71-842b-5421c09bcca1 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:48.568909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e88e3af-1817-4f71-842b-5421c09bcca1 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:48.569520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e88e3af-1817-4f71-842b-5421c09bcca1 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:48.619275 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7b7d41c-4544-43fc-a6de-eaf8b1ccf31c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.201614 Aug 27 02:53:48.620432 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2090/4380] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:53:48 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2/os-volume_attachments => generated 25 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:53:48.634690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2dc3807-b7b1-4bfe-bef0-6597b6c0a893 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:48.635319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c2dc3807-b7b1-4bfe-bef0-6597b6c0a893 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:48.775056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c2dc3807-b7b1-4bfe-bef0-6597b6c0a893 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:48.790450 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c2dc3807-b7b1-4bfe-bef0-6597b6c0a893 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1227 microversion: 2.1 time: 0.159139 Aug 27 02:53:48.795293 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2091/4381] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:48 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1227 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:48.806141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-40b1d470-42f5-4882-ad58-99f7cef1a711 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:48.806914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-40b1d470-42f5-4882-ad58-99f7cef1a711 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:48.828286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40b1d470-42f5-4882-ad58-99f7cef1a711 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:48.832204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40b1d470-42f5-4882-ad58-99f7cef1a711 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:48.832795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40b1d470-42f5-4882-ad58-99f7cef1a711 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:48.852729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40b1d470-42f5-4882-ad58-99f7cef1a711 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:48.859753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40b1d470-42f5-4882-ad58-99f7cef1a711 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:48.862007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40b1d470-42f5-4882-ad58-99f7cef1a711 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:48.958841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-40b1d470-42f5-4882-ad58-99f7cef1a711 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:53:49.168589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2e88e3af-1817-4f71-842b-5421c09bcca1 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:49.180607 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2e88e3af-1817-4f71-842b-5421c09bcca1 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1609 microversion: 2.1 time: 0.631656 Aug 27 02:53:49.181227 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2291/4382] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:48 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1609 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:49.202027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d70e161-1010-4158-8a3f-ef826c20387f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:49.211545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d70e161-1010-4158-8a3f-ef826c20387f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:49.234097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d70e161-1010-4158-8a3f-ef826c20387f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:49.235227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d70e161-1010-4158-8a3f-ef826c20387f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:49.238322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d70e161-1010-4158-8a3f-ef826c20387f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:49.239321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d70e161-1010-4158-8a3f-ef826c20387f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:49.241234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d70e161-1010-4158-8a3f-ef826c20387f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:49.246681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d70e161-1010-4158-8a3f-ef826c20387f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:49.262573 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-40b1d470-42f5-4882-ad58-99f7cef1a711 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 204 len: 0 microversion: 2.1 time: 0.464562 Aug 27 02:53:49.264021 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2092/4383] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:53:48 2022] DELETE /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:53:49.284503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88b8282d-4b52-4c8b-a585-f7576c11424a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:49.294112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-88b8282d-4b52-4c8b-a585-f7576c11424a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:49.318108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b8282d-4b52-4c8b-a585-f7576c11424a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:49.319038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b8282d-4b52-4c8b-a585-f7576c11424a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:49.320540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b8282d-4b52-4c8b-a585-f7576c11424a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:49.322565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b8282d-4b52-4c8b-a585-f7576c11424a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:49.324777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b8282d-4b52-4c8b-a585-f7576c11424a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:49.325572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b8282d-4b52-4c8b-a585-f7576c11424a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:49.646040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-88b8282d-4b52-4c8b-a585-f7576c11424a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:49.661364 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-88b8282d-4b52-4c8b-a585-f7576c11424a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1673 microversion: 2.1 time: 0.391763 Aug 27 02:53:49.663823 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2093/4384] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:49 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1673 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:49.670604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93869bb5-49cf-481d-b13a-7f6e4c77166a tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:49.671554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93869bb5-49cf-481d-b13a-7f6e4c77166a tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:49.698001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93869bb5-49cf-481d-b13a-7f6e4c77166a tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:49.701719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93869bb5-49cf-481d-b13a-7f6e4c77166a tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:49.703877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93869bb5-49cf-481d-b13a-7f6e4c77166a tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:49.705383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2d70e161-1010-4158-8a3f-ef826c20387f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:49.706660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93869bb5-49cf-481d-b13a-7f6e4c77166a tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:49.710193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93869bb5-49cf-481d-b13a-7f6e4c77166a tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:49.711011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93869bb5-49cf-481d-b13a-7f6e4c77166a tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:49.741052 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2d70e161-1010-4158-8a3f-ef826c20387f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1314 microversion: 2.1 time: 0.553877 Aug 27 02:53:49.743829 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2292/4385] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:49 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:49.818868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c5bdeee-ea0c-4bb8-bde4-277cc0556236 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:49.819989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c5bdeee-ea0c-4bb8-bde4-277cc0556236 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:49.929247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1c5bdeee-ea0c-4bb8-bde4-277cc0556236 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:49.943308 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c5bdeee-ea0c-4bb8-bde4-277cc0556236 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1227 microversion: 2.1 time: 0.127801 Aug 27 02:53:49.944665 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2293/4386] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:49 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1227 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:49.982662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-93869bb5-49cf-481d-b13a-7f6e4c77166a tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:49.998065 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-93869bb5-49cf-481d-b13a-7f6e4c77166a tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.332723 Aug 27 02:53:49.999846 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2094/4387] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:49 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:50.206296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d46506bd-b914-46b3-9557-65cabb6f3d8c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:50.206941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d46506bd-b914-46b3-9557-65cabb6f3d8c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:50.223434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d46506bd-b914-46b3-9557-65cabb6f3d8c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:50.224010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d46506bd-b914-46b3-9557-65cabb6f3d8c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:50.224501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d46506bd-b914-46b3-9557-65cabb6f3d8c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:50.225305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d46506bd-b914-46b3-9557-65cabb6f3d8c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:50.236588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d46506bd-b914-46b3-9557-65cabb6f3d8c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:50.237213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d46506bd-b914-46b3-9557-65cabb6f3d8c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:50.593482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d46506bd-b914-46b3-9557-65cabb6f3d8c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:50.614000 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d46506bd-b914-46b3-9557-65cabb6f3d8c tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1609 microversion: 2.1 time: 0.406438 Aug 27 02:53:50.615129 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2294/4388] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:50 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1609 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:50.686501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b3f27745-ec89-4708-bef2-732215bcdddd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:50.691154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b3f27745-ec89-4708-bef2-732215bcdddd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:50.729087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3f27745-ec89-4708-bef2-732215bcdddd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:50.731767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3f27745-ec89-4708-bef2-732215bcdddd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:50.733695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3f27745-ec89-4708-bef2-732215bcdddd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:50.742650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3f27745-ec89-4708-bef2-732215bcdddd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:50.743735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3f27745-ec89-4708-bef2-732215bcdddd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:50.744383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3f27745-ec89-4708-bef2-732215bcdddd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:50.769008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c574361-7109-4211-a1f9-97bea6c7d410 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:50.770784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4c574361-7109-4211-a1f9-97bea6c7d410 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:50.775988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:50.794959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c574361-7109-4211-a1f9-97bea6c7d410 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:50.802204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c574361-7109-4211-a1f9-97bea6c7d410 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:50.802667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c574361-7109-4211-a1f9-97bea6c7d410 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:50.803869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c574361-7109-4211-a1f9-97bea6c7d410 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:50.804349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c574361-7109-4211-a1f9-97bea6c7d410 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:50.809513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c574361-7109-4211-a1f9-97bea6c7d410 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:51.465646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4c574361-7109-4211-a1f9-97bea6c7d410 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:51.499631 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4c574361-7109-4211-a1f9-97bea6c7d410 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1314 microversion: 2.1 time: 0.738498 Aug 27 02:53:51.503996 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2295/4389] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:50 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:51.522750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-386f03aa-7799-437f-b8a6-70ea8fd5545a tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:51.525715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-386f03aa-7799-437f-b8a6-70ea8fd5545a tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:51.533583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:51.569802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386f03aa-7799-437f-b8a6-70ea8fd5545a tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:51.575876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386f03aa-7799-437f-b8a6-70ea8fd5545a tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:51.577728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386f03aa-7799-437f-b8a6-70ea8fd5545a tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:51.579473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386f03aa-7799-437f-b8a6-70ea8fd5545a tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:51.583043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386f03aa-7799-437f-b8a6-70ea8fd5545a tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:51.586000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-386f03aa-7799-437f-b8a6-70ea8fd5545a tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:51.622625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b3f27745-ec89-4708-bef2-732215bcdddd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:51.659206 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b3f27745-ec89-4708-bef2-732215bcdddd tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1673 microversion: 2.1 time: 0.978466 Aug 27 02:53:51.666036 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2095/4390] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:50 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1673 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:51.693156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f4c9c8b4-315c-4c53-b9f3-a100b5d21dde tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:51.714912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f4c9c8b4-315c-4c53-b9f3-a100b5d21dde tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:51.755532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4c9c8b4-315c-4c53-b9f3-a100b5d21dde tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:51.762780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4c9c8b4-315c-4c53-b9f3-a100b5d21dde tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:51.765316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4c9c8b4-315c-4c53-b9f3-a100b5d21dde tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:51.773763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4c9c8b4-315c-4c53-b9f3-a100b5d21dde tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:51.781020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4c9c8b4-315c-4c53-b9f3-a100b5d21dde tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:51.784421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4c9c8b4-315c-4c53-b9f3-a100b5d21dde tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:52.097657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-386f03aa-7799-437f-b8a6-70ea8fd5545a tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:52.137932 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-386f03aa-7799-437f-b8a6-70ea8fd5545a tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1223 microversion: 2.1 time: 0.630265 Aug 27 02:53:52.140012 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2296/4391] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:51 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1223 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:52.153348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb82f112-c94c-45bf-952b-ce94653fe3f5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:52.156452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fb82f112-c94c-45bf-952b-ce94653fe3f5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:52.175734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb82f112-c94c-45bf-952b-ce94653fe3f5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:52.177440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb82f112-c94c-45bf-952b-ce94653fe3f5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:52.178984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb82f112-c94c-45bf-952b-ce94653fe3f5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:52.185928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb82f112-c94c-45bf-952b-ce94653fe3f5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:52.187309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb82f112-c94c-45bf-952b-ce94653fe3f5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:52.188549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb82f112-c94c-45bf-952b-ce94653fe3f5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:53.514940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fb82f112-c94c-45bf-952b-ce94653fe3f5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:53.525688 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fb82f112-c94c-45bf-952b-ce94653fe3f5 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1609 microversion: 2.1 time: 1.382699 Aug 27 02:53:53.540327 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2297/4392] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:52 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1609 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:53.546062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fa7be024-f5d2-417b-a4cf-c2035ccfb0fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:53.546708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fa7be024-f5d2-417b-a4cf-c2035ccfb0fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:53.555649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa7be024-f5d2-417b-a4cf-c2035ccfb0fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:53.555649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa7be024-f5d2-417b-a4cf-c2035ccfb0fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:53.556319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa7be024-f5d2-417b-a4cf-c2035ccfb0fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:53.557488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa7be024-f5d2-417b-a4cf-c2035ccfb0fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:53.558537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa7be024-f5d2-417b-a4cf-c2035ccfb0fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:53.559054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa7be024-f5d2-417b-a4cf-c2035ccfb0fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:53.926997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f4c9c8b4-315c-4c53-b9f3-a100b5d21dde tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:53.942423 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f4c9c8b4-315c-4c53-b9f3-a100b5d21dde tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 2.270404 Aug 27 02:53:53.943178 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2096/4393] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:51 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 2276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:53.949198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6eb91d47-2471-4599-ba77-28431301f3df tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:53.952832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6eb91d47-2471-4599-ba77-28431301f3df tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:53.972093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eb91d47-2471-4599-ba77-28431301f3df tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:53.973315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eb91d47-2471-4599-ba77-28431301f3df tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:53.974159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eb91d47-2471-4599-ba77-28431301f3df tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:53.975207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eb91d47-2471-4599-ba77-28431301f3df tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:53.975959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eb91d47-2471-4599-ba77-28431301f3df tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:53.976802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6eb91d47-2471-4599-ba77-28431301f3df tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:53.980902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fa7be024-f5d2-417b-a4cf-c2035ccfb0fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:54.012259 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fa7be024-f5d2-417b-a4cf-c2035ccfb0fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1314 microversion: 2.1 time: 0.469753 Aug 27 02:53:54.022946 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2298/4394] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:53 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:54.054017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1328e18d-77e4-49f8-acbb-f845e80fc6db req-fc8b5aad-b862-4df8-95fb-a253584790c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f304ff1-b05a-47e9-ad46-9655aef3545a", "name": "network-vif-plugged", "status": "completed", "tag": "0dcfa0a1-3661-461d-9b13-7e314c359de9"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:54.071351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1328e18d-77e4-49f8-acbb-f845e80fc6db req-fc8b5aad-b862-4df8-95fb-a253584790c7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.072033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1328e18d-77e4-49f8-acbb-f845e80fc6db req-fc8b5aad-b862-4df8-95fb-a253584790c7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.072704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1328e18d-77e4-49f8-acbb-f845e80fc6db req-fc8b5aad-b862-4df8-95fb-a253584790c7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.099756 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1328e18d-77e4-49f8-acbb-f845e80fc6db req-fc8b5aad-b862-4df8-95fb-a253584790c7 service nova] Creating event network-vif-plugged:0dcfa0a1-3661-461d-9b13-7e314c359de9 for instance 5f304ff1-b05a-47e9-ad46-9655aef3545a on n-h1-852084-5 Aug 27 02:53:54.109574 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1328e18d-77e4-49f8-acbb-f845e80fc6db req-fc8b5aad-b862-4df8-95fb-a253584790c7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066595 Aug 27 02:53:54.111345 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2299/4395] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:54.121962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ecc175df-55e9-44a7-a82a-cc991b89b54f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:54.123256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ecc175df-55e9-44a7-a82a-cc991b89b54f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:54.137364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc175df-55e9-44a7-a82a-cc991b89b54f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.138527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc175df-55e9-44a7-a82a-cc991b89b54f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.139386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc175df-55e9-44a7-a82a-cc991b89b54f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.140596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc175df-55e9-44a7-a82a-cc991b89b54f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.142733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc175df-55e9-44a7-a82a-cc991b89b54f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.143486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecc175df-55e9-44a7-a82a-cc991b89b54f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.314918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ecc175df-55e9-44a7-a82a-cc991b89b54f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:54.357040 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ecc175df-55e9-44a7-a82a-cc991b89b54f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1285 microversion: 2.1 time: 0.243414 Aug 27 02:53:54.361212 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2300/4396] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:54 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1285 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:54.557394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fa172f46-780f-411d-84e0-9b743d2fa917 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:54.562511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fa172f46-780f-411d-84e0-9b743d2fa917 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:54.567105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6eb91d47-2471-4599-ba77-28431301f3df tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:54.580172 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6eb91d47-2471-4599-ba77-28431301f3df tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1673 microversion: 2.1 time: 0.635594 Aug 27 02:53:54.582440 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2097/4397] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:53 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1673 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:54.596454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa172f46-780f-411d-84e0-9b743d2fa917 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.601233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa172f46-780f-411d-84e0-9b743d2fa917 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.602164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa172f46-780f-411d-84e0-9b743d2fa917 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.603288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa172f46-780f-411d-84e0-9b743d2fa917 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.604037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa172f46-780f-411d-84e0-9b743d2fa917 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.605657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa172f46-780f-411d-84e0-9b743d2fa917 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.969002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-14d4e9d3-6f2a-4220-b8a6-eb97a18b9342 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:54.971236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-14d4e9d3-6f2a-4220-b8a6-eb97a18b9342 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:54.985470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14d4e9d3-6f2a-4220-b8a6-eb97a18b9342 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.987068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14d4e9d3-6f2a-4220-b8a6-eb97a18b9342 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.988472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14d4e9d3-6f2a-4220-b8a6-eb97a18b9342 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:54.990354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14d4e9d3-6f2a-4220-b8a6-eb97a18b9342 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:54.991679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14d4e9d3-6f2a-4220-b8a6-eb97a18b9342 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:54.992930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14d4e9d3-6f2a-4220-b8a6-eb97a18b9342 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:55.064190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:55.391034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fa172f46-780f-411d-84e0-9b743d2fa917 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:55.412246 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fa172f46-780f-411d-84e0-9b743d2fa917 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1609 microversion: 2.1 time: 0.867811 Aug 27 02:53:55.430062 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2301/4398] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:54 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1609 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:55.438643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ac464f40-8e97-4c31-b49b-da5743152bf3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:55.439556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ac464f40-8e97-4c31-b49b-da5743152bf3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:55.448987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac464f40-8e97-4c31-b49b-da5743152bf3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:55.450554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac464f40-8e97-4c31-b49b-da5743152bf3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:55.451965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac464f40-8e97-4c31-b49b-da5743152bf3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:55.453888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac464f40-8e97-4c31-b49b-da5743152bf3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:55.455005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac464f40-8e97-4c31-b49b-da5743152bf3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:55.455980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac464f40-8e97-4c31-b49b-da5743152bf3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:55.804428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-14d4e9d3-6f2a-4220-b8a6-eb97a18b9342 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:55.844995 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-14d4e9d3-6f2a-4220-b8a6-eb97a18b9342 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1523 microversion: 2.1 time: 0.884069 Aug 27 02:53:55.845612 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2098/4399] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:54 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1523 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:55.879029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f9923da1-0afd-4557-a7ba-3c9e92b24620 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:55.879854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f9923da1-0afd-4557-a7ba-3c9e92b24620 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:55.908045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9923da1-0afd-4557-a7ba-3c9e92b24620 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:55.912237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9923da1-0afd-4557-a7ba-3c9e92b24620 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:55.917130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9923da1-0afd-4557-a7ba-3c9e92b24620 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:55.919225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9923da1-0afd-4557-a7ba-3c9e92b24620 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:55.920649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9923da1-0afd-4557-a7ba-3c9e92b24620 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:55.922886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9923da1-0afd-4557-a7ba-3c9e92b24620 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.011697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ac464f40-8e97-4c31-b49b-da5743152bf3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:56.027734 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ac464f40-8e97-4c31-b49b-da5743152bf3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1314 microversion: 2.1 time: 0.591642 Aug 27 02:53:56.028859 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2302/4400] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:55 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:56.045646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8aa6704a-2e67-42a9-91b8-b3ee8f6d6ca7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:56.046690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8aa6704a-2e67-42a9-91b8-b3ee8f6d6ca7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:56.055663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8aa6704a-2e67-42a9-91b8-b3ee8f6d6ca7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.056468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8aa6704a-2e67-42a9-91b8-b3ee8f6d6ca7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.057082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8aa6704a-2e67-42a9-91b8-b3ee8f6d6ca7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.060766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8aa6704a-2e67-42a9-91b8-b3ee8f6d6ca7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.061477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8aa6704a-2e67-42a9-91b8-b3ee8f6d6ca7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.062120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8aa6704a-2e67-42a9-91b8-b3ee8f6d6ca7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.188660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f9923da1-0afd-4557-a7ba-3c9e92b24620 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:56.229122 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f9923da1-0afd-4557-a7ba-3c9e92b24620 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1285 microversion: 2.1 time: 0.370521 Aug 27 02:53:56.230288 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2099/4401] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:55 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1285 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:56.250736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-a2c8323f-c3b0-4025-9245-26a9f5dbd778 req-ca90aba4-d52e-481b-aedd-2511a5d17f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80abc4a0-849e-4542-8318-42dd3c227e53", "name": "network-vif-unplugged", "status": "completed", "tag": "7bf0553a-d66f-45ed-8f0b-087c727c1239"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:56.284274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a2c8323f-c3b0-4025-9245-26a9f5dbd778 req-ca90aba4-d52e-481b-aedd-2511a5d17f6d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.286024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a2c8323f-c3b0-4025-9245-26a9f5dbd778 req-ca90aba4-d52e-481b-aedd-2511a5d17f6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.286634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a2c8323f-c3b0-4025-9245-26a9f5dbd778 req-ca90aba4-d52e-481b-aedd-2511a5d17f6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.307156 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a2c8323f-c3b0-4025-9245-26a9f5dbd778 req-ca90aba4-d52e-481b-aedd-2511a5d17f6d service nova] Creating event network-vif-unplugged:7bf0553a-d66f-45ed-8f0b-087c727c1239 for instance 80abc4a0-849e-4542-8318-42dd3c227e53 on n-h1-852084-5 Aug 27 02:53:56.330808 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-a2c8323f-c3b0-4025-9245-26a9f5dbd778 req-ca90aba4-d52e-481b-aedd-2511a5d17f6d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088514 Aug 27 02:53:56.332901 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2100/4402] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:56.441623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-efe1a8e9-dd0b-4f46-abde-840a1289d2dd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:56.442414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-efe1a8e9-dd0b-4f46-abde-840a1289d2dd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:56.458960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efe1a8e9-dd0b-4f46-abde-840a1289d2dd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.459468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efe1a8e9-dd0b-4f46-abde-840a1289d2dd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.460783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efe1a8e9-dd0b-4f46-abde-840a1289d2dd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.462296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efe1a8e9-dd0b-4f46-abde-840a1289d2dd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.462794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efe1a8e9-dd0b-4f46-abde-840a1289d2dd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.463399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efe1a8e9-dd0b-4f46-abde-840a1289d2dd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.574816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8aa6704a-2e67-42a9-91b8-b3ee8f6d6ca7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:56.585953 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8aa6704a-2e67-42a9-91b8-b3ee8f6d6ca7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1605 microversion: 2.1 time: 0.553834 Aug 27 02:53:56.607537 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2303/4403] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:56 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1605 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:56.737254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-efe1a8e9-dd0b-4f46-abde-840a1289d2dd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:56.757885 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-efe1a8e9-dd0b-4f46-abde-840a1289d2dd tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1541 microversion: 2.1 time: 0.322876 Aug 27 02:53:56.764216 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2101/4404] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:56 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1541 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:56.870960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-419d32aa-7f12-4b52-80b3-f76f8a7c87c8 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:56.871824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-419d32aa-7f12-4b52-80b3-f76f8a7c87c8 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:56.886920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-419d32aa-7f12-4b52-80b3-f76f8a7c87c8 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.887905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-419d32aa-7f12-4b52-80b3-f76f8a7c87c8 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.889319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-419d32aa-7f12-4b52-80b3-f76f8a7c87c8 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:56.891505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-419d32aa-7f12-4b52-80b3-f76f8a7c87c8 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:56.894282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-419d32aa-7f12-4b52-80b3-f76f8a7c87c8 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:56.896356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-419d32aa-7f12-4b52-80b3-f76f8a7c87c8 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:57.063276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-24d51a0a-823e-4c69-b5b2-e4835a15bc9e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:57.064287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-24d51a0a-823e-4c69-b5b2-e4835a15bc9e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:57.073935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d51a0a-823e-4c69-b5b2-e4835a15bc9e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:57.074890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d51a0a-823e-4c69-b5b2-e4835a15bc9e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:57.075635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d51a0a-823e-4c69-b5b2-e4835a15bc9e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:57.076615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d51a0a-823e-4c69-b5b2-e4835a15bc9e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:57.077743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d51a0a-823e-4c69-b5b2-e4835a15bc9e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:57.078893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d51a0a-823e-4c69-b5b2-e4835a15bc9e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:57.349449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-419d32aa-7f12-4b52-80b3-f76f8a7c87c8 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:57.366762 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-419d32aa-7f12-4b52-80b3-f76f8a7c87c8 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1503 microversion: 2.1 time: 0.500070 Aug 27 02:53:57.367372 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2304/4405] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:56 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1503 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:53:57.389337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ede06f88-ffe6-4908-b952-298c59725b9f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:57.390465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ede06f88-ffe6-4908-b952-298c59725b9f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:57.398027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede06f88-ffe6-4908-b952-298c59725b9f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:57.398806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede06f88-ffe6-4908-b952-298c59725b9f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:57.399432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede06f88-ffe6-4908-b952-298c59725b9f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:57.400355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede06f88-ffe6-4908-b952-298c59725b9f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:57.400992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede06f88-ffe6-4908-b952-298c59725b9f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:57.402185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede06f88-ffe6-4908-b952-298c59725b9f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:57.826510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ede06f88-ffe6-4908-b952-298c59725b9f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:57.850865 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ede06f88-ffe6-4908-b952-298c59725b9f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1327 microversion: 2.1 time: 0.465601 Aug 27 02:53:57.851489 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2305/4406] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:57 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1327 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:57.903175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec34f0a9-0b87-47db-9c8e-f53850cfde78 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Action: 'create', calling method: .version_select at 0x7f4d28f4e310>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1472437288", "description": "tempest-description-1051725030"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:57.944309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-24d51a0a-823e-4c69-b5b2-e4835a15bc9e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:57.960225 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-24d51a0a-823e-4c69-b5b2-e4835a15bc9e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1499 microversion: 2.1 time: 0.905203 Aug 27 02:53:57.963484 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2102/4407] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:57 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1499 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:57.998889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9630b2fd-2a8a-400d-9b5a-502c92b10a61 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:58.002967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9630b2fd-2a8a-400d-9b5a-502c92b10a61 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:58.029253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9630b2fd-2a8a-400d-9b5a-502c92b10a61 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:58.032522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9630b2fd-2a8a-400d-9b5a-502c92b10a61 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:58.033075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9630b2fd-2a8a-400d-9b5a-502c92b10a61 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:58.033931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9630b2fd-2a8a-400d-9b5a-502c92b10a61 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:58.038239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9630b2fd-2a8a-400d-9b5a-502c92b10a61 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:58.041070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9630b2fd-2a8a-400d-9b5a-502c92b10a61 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:58.395821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9630b2fd-2a8a-400d-9b5a-502c92b10a61 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:58.404669 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9630b2fd-2a8a-400d-9b5a-502c92b10a61 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 200 len: 1323 microversion: 2.1 time: 0.438263 Aug 27 02:53:58.411864 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2103/4408] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:57 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 1323 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:58.433334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:58.434462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-addcab6a-495c-4913-8b42-54ee19548d4a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:58.435198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-addcab6a-495c-4913-8b42-54ee19548d4a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:58.463555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-addcab6a-495c-4913-8b42-54ee19548d4a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:58.464103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-addcab6a-495c-4913-8b42-54ee19548d4a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:58.464413 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec34f0a9-0b87-47db-9c8e-f53850cfde78 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.586781 Aug 27 02:53:58.464677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-addcab6a-495c-4913-8b42-54ee19548d4a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:58.465408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-addcab6a-495c-4913-8b42-54ee19548d4a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:58.465908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-addcab6a-495c-4913-8b42-54ee19548d4a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:58.466342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-addcab6a-495c-4913-8b42-54ee19548d4a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:58.478098 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2306/4409] 10.222.0.99 () {60 vars in 1180 bytes} [Sat Aug 27 02:53:57 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:58.785105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:58.788895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7f316dbb-faac-4035-b27c-e232a045f4a4 req-a262b0df-a977-45d6-a8d9-f745f8cb8391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80abc4a0-849e-4542-8318-42dd3c227e53", "name": "network-vif-deleted", "tag": "7bf0553a-d66f-45ed-8f0b-087c727c1239"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:58.813512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f316dbb-faac-4035-b27c-e232a045f4a4 req-a262b0df-a977-45d6-a8d9-f745f8cb8391 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:58.814195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f316dbb-faac-4035-b27c-e232a045f4a4 req-a262b0df-a977-45d6-a8d9-f745f8cb8391 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:58.814741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7f316dbb-faac-4035-b27c-e232a045f4a4 req-a262b0df-a977-45d6-a8d9-f745f8cb8391 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:58.846799 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7f316dbb-faac-4035-b27c-e232a045f4a4 req-a262b0df-a977-45d6-a8d9-f745f8cb8391 service nova] Creating event network-vif-deleted:7bf0553a-d66f-45ed-8f0b-087c727c1239 for instance 80abc4a0-849e-4542-8318-42dd3c227e53 on n-h1-852084-5 Aug 27 02:53:58.856596 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7f316dbb-faac-4035-b27c-e232a045f4a4 req-a262b0df-a977-45d6-a8d9-f745f8cb8391 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376737 Aug 27 02:53:58.857238 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2307/4410] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:53:58.868106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb90a2ad-4f12-432a-8faf-df5e40b174b7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:58.877425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb90a2ad-4f12-432a-8faf-df5e40b174b7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:58.894367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb90a2ad-4f12-432a-8faf-df5e40b174b7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:58.894910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb90a2ad-4f12-432a-8faf-df5e40b174b7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:58.895368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb90a2ad-4f12-432a-8faf-df5e40b174b7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:58.896183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb90a2ad-4f12-432a-8faf-df5e40b174b7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:58.896868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb90a2ad-4f12-432a-8faf-df5e40b174b7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:58.897462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb90a2ad-4f12-432a-8faf-df5e40b174b7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:59.075967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:53:59.092294 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb90a2ad-4f12-432a-8faf-df5e40b174b7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a/action" status: 202 len: 0 microversion: 2.1 time: 0.232396 Aug 27 02:53:59.094570 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2308/4411] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:53:58 2022] POST /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:53:59.120630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f60b7dd2-4253-4346-abe9-669a4e1427f5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1472437288"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:53:59.122211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f60b7dd2-4253-4346-abe9-669a4e1427f5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:59.146219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60b7dd2-4253-4346-abe9-669a4e1427f5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:59.147192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60b7dd2-4253-4346-abe9-669a4e1427f5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:59.147894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60b7dd2-4253-4346-abe9-669a4e1427f5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:59.148759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60b7dd2-4253-4346-abe9-669a4e1427f5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:59.149392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60b7dd2-4253-4346-abe9-669a4e1427f5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:59.150187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f60b7dd2-4253-4346-abe9-669a4e1427f5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:59.494752 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.network.security_group_api [None req-f60b7dd2-4253-4346-abe9-669a4e1427f5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Adding security group 8c2164d1-8149-40fc-985f-49c6b57084a2 to port e178da5f-6f2a-433b-a845-5c4706053351 Aug 27 02:53:59.658052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-addcab6a-495c-4913-8b42-54ee19548d4a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:53:59.709956 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-addcab6a-495c-4913-8b42-54ee19548d4a tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1252 microversion: 2.1 time: 1.296347 Aug 27 02:53:59.714159 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2104/4412] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:58 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1252 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:53:59.741459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-411108c3-0b4e-498c-9887-83c800a60220 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:53:59.744837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-411108c3-0b4e-498c-9887-83c800a60220 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:53:59.782529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-411108c3-0b4e-498c-9887-83c800a60220 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:59.785360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-411108c3-0b4e-498c-9887-83c800a60220 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:59.786751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-411108c3-0b4e-498c-9887-83c800a60220 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:59.791399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-411108c3-0b4e-498c-9887-83c800a60220 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:53:59.794505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-411108c3-0b4e-498c-9887-83c800a60220 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:53:59.796252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-411108c3-0b4e-498c-9887-83c800a60220 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:53:59.935811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:00.615879 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f60b7dd2-4253-4346-abe9-669a4e1427f5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "POST /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8/action" status: 202 len: 0 microversion: 2.1 time: 1.510560 Aug 27 02:54:00.617503 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2309/4413] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:53:59 2022] POST /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8/action => generated 0 bytes in 1514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:54:00.639007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0a4720fe-9fb0-4004-be49-dcb22c9e9706 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:00.648729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0a4720fe-9fb0-4004-be49-dcb22c9e9706 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:00.685137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a4720fe-9fb0-4004-be49-dcb22c9e9706 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.686974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a4720fe-9fb0-4004-be49-dcb22c9e9706 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.688238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a4720fe-9fb0-4004-be49-dcb22c9e9706 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:00.693514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a4720fe-9fb0-4004-be49-dcb22c9e9706 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.730596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a4720fe-9fb0-4004-be49-dcb22c9e9706 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.734341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a4720fe-9fb0-4004-be49-dcb22c9e9706 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:00.786852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-411108c3-0b4e-498c-9887-83c800a60220 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:00.822522 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-411108c3-0b4e-498c-9887-83c800a60220 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1327 microversion: 2.1 time: 1.094675 Aug 27 02:54:00.824511 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2105/4414] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:53:59 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1327 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:00.843346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:00.847742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:00.850266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:00.865427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.866890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.874119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:00.877257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.879969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.881707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:00.942368 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] HTTP exception thrown: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Request method failure captured: Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 HTTP/1.1 Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYZGh0D0YP_GLdVdQvlcUEp_UbStoIx5H11VeENXdtpctex2GQhIvbH0RJzet1-3vLWq-08vju8qPuFW0KMBvUQ7oTjpMP1Xb8sWU_5ujgaJeyRxUmITqqNTl7yAxJ1GPTAEVmNgjp5Sn_rGqTeoGE6zSnsUlGyU_Gyvxkr0lA28tWY Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d4399d0cd9ba4a16a4db45cf851a54f5"}]}] Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: bfefa59129eb427687ac388dbd000d25 Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2'} Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:00.944839 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:00.950764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:00.950764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:00.950764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:00.950764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:00.950764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:00.950764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:54:00.950764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:00.950764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Returning 404 to user: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:00.950764 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-230d28e3-8b18-42cc-8afd-010817837a5b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 404 len: 111 microversion: 2.1 time: 0.118897 Aug 27 02:54:00.950764 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2106/4415] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:00 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:00.954899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7ad997d-6407-4f52-815c-a117b604dbd1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1472437288"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:00.955498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b7ad997d-6407-4f52-815c-a117b604dbd1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:00.964215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ad997d-6407-4f52-815c-a117b604dbd1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.967852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ad997d-6407-4f52-815c-a117b604dbd1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.970643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ad997d-6407-4f52-815c-a117b604dbd1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:00.977547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ad997d-6407-4f52-815c-a117b604dbd1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:00.978509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ad997d-6407-4f52-815c-a117b604dbd1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:00.979334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ad997d-6407-4f52-815c-a117b604dbd1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:01.324165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0a4720fe-9fb0-4004-be49-dcb22c9e9706 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:01.352336 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0a4720fe-9fb0-4004-be49-dcb22c9e9706 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1484 microversion: 2.1 time: 0.726415 Aug 27 02:54:01.354018 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2310/4416] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:00 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1484 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:01.374492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7039d686-1d14-42fc-b652-c8940fe8b277 req-c5c3d02a-53d3-4e3d-8436-898b7274b5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb921ba2-f893-4131-a5e2-a51d05eabcd8", "tag": "e178da5f-6f2a-433b-a845-5c4706053351"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:01.408522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7039d686-1d14-42fc-b652-c8940fe8b277 req-c5c3d02a-53d3-4e3d-8436-898b7274b5f0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:01.409034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7039d686-1d14-42fc-b652-c8940fe8b277 req-c5c3d02a-53d3-4e3d-8436-898b7274b5f0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:01.410661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7039d686-1d14-42fc-b652-c8940fe8b277 req-c5c3d02a-53d3-4e3d-8436-898b7274b5f0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:01.449114 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7039d686-1d14-42fc-b652-c8940fe8b277 req-c5c3d02a-53d3-4e3d-8436-898b7274b5f0 service nova] Creating event network-changed:e178da5f-6f2a-433b-a845-5c4706053351 for instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 on n-h2-852084-5 Aug 27 02:54:01.479001 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7039d686-1d14-42fc-b652-c8940fe8b277 req-c5c3d02a-53d3-4e3d-8436-898b7274b5f0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122515 Aug 27 02:54:01.480313 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2311/4417] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:01.513310 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.network.security_group_api [None req-b7ad997d-6407-4f52-815c-a117b604dbd1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Removing security group 8c2164d1-8149-40fc-985f-49c6b57084a2 from port e178da5f-6f2a-433b-a845-5c4706053351 Aug 27 02:54:01.520349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0ca816a2-bdb2-4d4e-9483-11340adfcdd8 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:01.523725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0ca816a2-bdb2-4d4e-9483-11340adfcdd8 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:01.547097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ca816a2-bdb2-4d4e-9483-11340adfcdd8 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:01.550133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ca816a2-bdb2-4d4e-9483-11340adfcdd8 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:01.550609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ca816a2-bdb2-4d4e-9483-11340adfcdd8 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:01.556775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ca816a2-bdb2-4d4e-9483-11340adfcdd8 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:01.557296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ca816a2-bdb2-4d4e-9483-11340adfcdd8 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:01.557842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ca816a2-bdb2-4d4e-9483-11340adfcdd8 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:01.961750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0ca816a2-bdb2-4d4e-9483-11340adfcdd8 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:01.983407 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0ca816a2-bdb2-4d4e-9483-11340adfcdd8 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1252 microversion: 2.1 time: 0.492846 Aug 27 02:54:01.984810 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2312/4418] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:01 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1252 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:01.997426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-439d98bc-4dc6-4012-b2f8-f61a051f7b0d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '.version_select at 0x7f4d28fe3700>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:02.065446 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-439d98bc-4dc6-4012-b2f8-f61a051f7b0d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644386701" status: 202 len: 0 microversion: 2.1 time: 0.078242 Aug 27 02:54:02.072543 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2313/4419] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:54:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644386701 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:54:02.087612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-050468c8-6d88-4c99-91d4-a6d3eaf6b15e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:02.093350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-050468c8-6d88-4c99-91d4-a6d3eaf6b15e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:02.121868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-050468c8-6d88-4c99-91d4-a6d3eaf6b15e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:02.129744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-050468c8-6d88-4c99-91d4-a6d3eaf6b15e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:02.131145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-050468c8-6d88-4c99-91d4-a6d3eaf6b15e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:02.132618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-050468c8-6d88-4c99-91d4-a6d3eaf6b15e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:02.133728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-050468c8-6d88-4c99-91d4-a6d3eaf6b15e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:02.134671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-050468c8-6d88-4c99-91d4-a6d3eaf6b15e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:02.196282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-050468c8-6d88-4c99-91d4-a6d3eaf6b15e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:54:02.346440 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-050468c8-6d88-4c99-91d4-a6d3eaf6b15e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 204 len: 0 microversion: 2.1 time: 0.270462 Aug 27 02:54:02.348279 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2314/4420] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:54:02 2022] DELETE /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:54:02.367506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c39046d3-fd21-4047-b048-fe734720b289 req-49f2a897-8817-4624-826c-ed573b2c95f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2", "name": "network-vif-deleted", "tag": "cf665155-495a-4810-89f7-0f08309c79e8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:02.409998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c39046d3-fd21-4047-b048-fe734720b289 req-49f2a897-8817-4624-826c-ed573b2c95f7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:02.410519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c39046d3-fd21-4047-b048-fe734720b289 req-49f2a897-8817-4624-826c-ed573b2c95f7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:02.410965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c39046d3-fd21-4047-b048-fe734720b289 req-49f2a897-8817-4624-826c-ed573b2c95f7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:02.426443 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7ad997d-6407-4f52-815c-a117b604dbd1 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "POST /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8/action" status: 202 len: 0 microversion: 2.1 time: 1.477577 Aug 27 02:54:02.427329 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2107/4421] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:54:00 2022] POST /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8/action => generated 0 bytes in 1480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:54:02.440612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-63baf6ab-451f-49bc-9726-aed563abb588 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:02.441956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-63baf6ab-451f-49bc-9726-aed563abb588 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:02.444229 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c39046d3-fd21-4047-b048-fe734720b289 req-49f2a897-8817-4624-826c-ed573b2c95f7 service nova] Creating event network-vif-deleted:cf665155-495a-4810-89f7-0f08309c79e8 for instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 on n-h1-852084-5 Aug 27 02:54:02.458541 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c39046d3-fd21-4047-b048-fe734720b289 req-49f2a897-8817-4624-826c-ed573b2c95f7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108317 Aug 27 02:54:02.459507 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2315/4422] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:02.465628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-604e0b65-3896-4d1c-884c-7584afcab044 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:02.474750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-604e0b65-3896-4d1c-884c-7584afcab044 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:02.478029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63baf6ab-451f-49bc-9726-aed563abb588 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:02.480579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63baf6ab-451f-49bc-9726-aed563abb588 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:02.487433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63baf6ab-451f-49bc-9726-aed563abb588 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:02.492576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63baf6ab-451f-49bc-9726-aed563abb588 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:02.495800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-604e0b65-3896-4d1c-884c-7584afcab044 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:02.496042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63baf6ab-451f-49bc-9726-aed563abb588 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:02.496709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-604e0b65-3896-4d1c-884c-7584afcab044 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:02.497335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-604e0b65-3896-4d1c-884c-7584afcab044 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:02.498266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-604e0b65-3896-4d1c-884c-7584afcab044 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:02.501334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63baf6ab-451f-49bc-9726-aed563abb588 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:02.502360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-604e0b65-3896-4d1c-884c-7584afcab044 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:02.503012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-604e0b65-3896-4d1c-884c-7584afcab044 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:03.071023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-604e0b65-3896-4d1c-884c-7584afcab044 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:03.086579 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-604e0b65-3896-4d1c-884c-7584afcab044 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1490 microversion: 2.1 time: 0.625808 Aug 27 02:54:03.087508 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2316/4423] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:02 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1490 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:03.093303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab232315-9f13-4731-9f14-13261eeb77db tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Action: 'create', calling method: .version_select at 0x7f4d28f4a280>, body: {"pool": null} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:03.121196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-63baf6ab-451f-49bc-9726-aed563abb588 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:03.139836 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-63baf6ab-451f-49bc-9726-aed563abb588 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1327 microversion: 2.1 time: 0.711327 Aug 27 02:54:03.141117 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2108/4424] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:02 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1327 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:03.147260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb4944a3-165e-41c5-9aa5-f0e53063bd01 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:03.147967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb4944a3-165e-41c5-9aa5-f0e53063bd01 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:03.156308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb4944a3-165e-41c5-9aa5-f0e53063bd01 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:03.157253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb4944a3-165e-41c5-9aa5-f0e53063bd01 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:03.157924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb4944a3-165e-41c5-9aa5-f0e53063bd01 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:03.158858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb4944a3-165e-41c5-9aa5-f0e53063bd01 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:03.159620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb4944a3-165e-41c5-9aa5-f0e53063bd01 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:03.160245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb4944a3-165e-41c5-9aa5-f0e53063bd01 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:03.344319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb4944a3-165e-41c5-9aa5-f0e53063bd01 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:03.356638 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb4944a3-165e-41c5-9aa5-f0e53063bd01 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1252 microversion: 2.1 time: 0.213913 Aug 27 02:54:03.358023 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2109/4425] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:03 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1252 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:04.137522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b1cc914-a086-4251-9b6e-088173e1e39f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:04.140781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b1cc914-a086-4251-9b6e-088173e1e39f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:04.181727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1cc914-a086-4251-9b6e-088173e1e39f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:04.188686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1cc914-a086-4251-9b6e-088173e1e39f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:04.189237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1cc914-a086-4251-9b6e-088173e1e39f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:04.191615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1cc914-a086-4251-9b6e-088173e1e39f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:04.192226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1cc914-a086-4251-9b6e-088173e1e39f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:04.192594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b1cc914-a086-4251-9b6e-088173e1e39f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:04.845448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b1cc914-a086-4251-9b6e-088173e1e39f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:04.871327 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b1cc914-a086-4251-9b6e-088173e1e39f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1490 microversion: 2.1 time: 0.748697 Aug 27 02:54:04.872503 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2110/4426] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:04 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1490 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:04.891547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65ee99bb-9f46-4906-a9b6-6070be054b95 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:04.892829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65ee99bb-9f46-4906-a9b6-6070be054b95 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:04.915320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65ee99bb-9f46-4906-a9b6-6070be054b95 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:04.918000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65ee99bb-9f46-4906-a9b6-6070be054b95 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:04.922358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65ee99bb-9f46-4906-a9b6-6070be054b95 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:04.927033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65ee99bb-9f46-4906-a9b6-6070be054b95 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:04.928916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65ee99bb-9f46-4906-a9b6-6070be054b95 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:04.934917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65ee99bb-9f46-4906-a9b6-6070be054b95 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:05.573627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-65ee99bb-9f46-4906-a9b6-6070be054b95 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:05.601521 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65ee99bb-9f46-4906-a9b6-6070be054b95 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1327 microversion: 2.1 time: 0.717572 Aug 27 02:54:05.616936 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2111/4427] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:04 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1327 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:05.627896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1c17ed64-3b3a-41f7-9e94-11b677a25661 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:05.629718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1c17ed64-3b3a-41f7-9e94-11b677a25661 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:05.644297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c17ed64-3b3a-41f7-9e94-11b677a25661 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:05.646252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c17ed64-3b3a-41f7-9e94-11b677a25661 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:05.647294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c17ed64-3b3a-41f7-9e94-11b677a25661 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:05.648985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c17ed64-3b3a-41f7-9e94-11b677a25661 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:05.650222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c17ed64-3b3a-41f7-9e94-11b677a25661 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:05.651943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c17ed64-3b3a-41f7-9e94-11b677a25661 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:05.920697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1c17ed64-3b3a-41f7-9e94-11b677a25661 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:05.935938 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1c17ed64-3b3a-41f7-9e94-11b677a25661 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1252 microversion: 2.1 time: 0.316281 Aug 27 02:54:05.945753 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2112/4428] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:05 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1252 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:05.954859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c2794e8e-7c51-4294-b8bb-0032d7c7e5ca req-8785639d-0ff1-4c63-9247-8e750dca4663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb921ba2-f893-4131-a5e2-a51d05eabcd8", "tag": "e178da5f-6f2a-433b-a845-5c4706053351"}, {"name": "network-changed", "server_uuid": "9a03c88d-0721-4243-9b50-df3034dc0612", "tag": "75f9d789-5d28-42c0-af89-f70808adb6ba"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:05.987194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c2794e8e-7c51-4294-b8bb-0032d7c7e5ca req-8785639d-0ff1-4c63-9247-8e750dca4663 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:05.988019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c2794e8e-7c51-4294-b8bb-0032d7c7e5ca req-8785639d-0ff1-4c63-9247-8e750dca4663 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:05.988649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c2794e8e-7c51-4294-b8bb-0032d7c7e5ca req-8785639d-0ff1-4c63-9247-8e750dca4663 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:06.023659 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c2794e8e-7c51-4294-b8bb-0032d7c7e5ca req-8785639d-0ff1-4c63-9247-8e750dca4663 service nova] Creating event network-changed:e178da5f-6f2a-433b-a845-5c4706053351 for instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 on n-h2-852084-5 Aug 27 02:54:06.029863 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c2794e8e-7c51-4294-b8bb-0032d7c7e5ca req-8785639d-0ff1-4c63-9247-8e750dca4663 service nova] Creating event network-changed:75f9d789-5d28-42c0-af89-f70808adb6ba for instance 9a03c88d-0721-4243-9b50-df3034dc0612 on n-h1-852084-5 Aug 27 02:54:06.055357 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c2794e8e-7c51-4294-b8bb-0032d7c7e5ca req-8785639d-0ff1-4c63-9247-8e750dca4663 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.113218 Aug 27 02:54:06.061275 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2113/4429] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:06.077843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-deabf03a-1d2d-4f52-9179-e09148e0aa75 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:06.081583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-deabf03a-1d2d-4f52-9179-e09148e0aa75 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:06.104663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-deabf03a-1d2d-4f52-9179-e09148e0aa75 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:06.106025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-deabf03a-1d2d-4f52-9179-e09148e0aa75 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:06.109646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-deabf03a-1d2d-4f52-9179-e09148e0aa75 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:06.112919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-deabf03a-1d2d-4f52-9179-e09148e0aa75 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:06.113956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-deabf03a-1d2d-4f52-9179-e09148e0aa75 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:06.114644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-deabf03a-1d2d-4f52-9179-e09148e0aa75 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:06.155691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:06.349286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-deabf03a-1d2d-4f52-9179-e09148e0aa75 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:06.367728 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-deabf03a-1d2d-4f52-9179-e09148e0aa75 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 200 len: 1448 microversion: 2.1 time: 0.303342 Aug 27 02:54:06.368545 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2114/4430] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:06 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 1448 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:06.623853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-145d10c4-48e7-4f6c-8945-2f5f6354b58b tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:06.624520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-145d10c4-48e7-4f6c-8945-2f5f6354b58b tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:06.640877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-145d10c4-48e7-4f6c-8945-2f5f6354b58b tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:06.641329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-145d10c4-48e7-4f6c-8945-2f5f6354b58b tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:06.641825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-145d10c4-48e7-4f6c-8945-2f5f6354b58b tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:06.642585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-145d10c4-48e7-4f6c-8945-2f5f6354b58b tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:06.643047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-145d10c4-48e7-4f6c-8945-2f5f6354b58b tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:06.643500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-145d10c4-48e7-4f6c-8945-2f5f6354b58b tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:07.137860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-145d10c4-48e7-4f6c-8945-2f5f6354b58b tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:07.147328 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-145d10c4-48e7-4f6c-8945-2f5f6354b58b tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1327 microversion: 2.1 time: 0.527833 Aug 27 02:54:07.153158 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2115/4431] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:06 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1327 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:07.154413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb44375b-97b7-4242-8d54-1580d2db0800 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Action: 'create', calling method: .version_select at 0x7f4d2a6e6280>, body: {"keypair": {"name": "tempest-keypair-1129323033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcncczJ0freJp2VfRR8kd34HcSyd1PBtiUFrCMp1rPP5yClIktAV0+ahOjLomX2n7edrynOToDswhWK1Dw1LCM6WhZptnc39xv03jnt0hyAmdDfSeLbD1xV9u2CbR5iog=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:07.205991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-bb44375b-97b7-4242-8d54-1580d2db0800 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Getting quotas for project d4399d0cd9ba4a16a4db45cf851a54f5. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:07.222355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-bb44375b-97b7-4242-8d54-1580d2db0800 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Getting quotas for user bfefa59129eb427687ac388dbd000d25 and project d4399d0cd9ba4a16a4db45cf851a54f5. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:07.264978 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bb44375b-97b7-4242-8d54-1580d2db0800 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [be6cc275-542e-4ac3-b13b-2b433e370f04] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 02:54:08.282511 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [None req-bb44375b-97b7-4242-8d54-1580d2db0800 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [be6cc275-542e-4ac3-b13b-2b433e370f04] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 40666. Aug 27 02:54:08.332162 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bb44375b-97b7-4242-8d54-1580d2db0800 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.180461 Aug 27 02:54:08.353711 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2116/4432] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:54:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:08.365288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e49f9a4-7197-41dc-a8c0-617dd9ab9c63 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:08.366826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4e49f9a4-7197-41dc-a8c0-617dd9ab9c63 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:08.382676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e49f9a4-7197-41dc-a8c0-617dd9ab9c63 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.384259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e49f9a4-7197-41dc-a8c0-617dd9ab9c63 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.387639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e49f9a4-7197-41dc-a8c0-617dd9ab9c63 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.389985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e49f9a4-7197-41dc-a8c0-617dd9ab9c63 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.390550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e49f9a4-7197-41dc-a8c0-617dd9ab9c63 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.391012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e49f9a4-7197-41dc-a8c0-617dd9ab9c63 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.551826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4e49f9a4-7197-41dc-a8c0-617dd9ab9c63 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6debd1d81f0463c9daaa0168051ecee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3126c8641780451c8c6882179cce59d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:08.577619 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4e49f9a4-7197-41dc-a8c0-617dd9ab9c63 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 200 len: 1252 microversion: 2.1 time: 0.222333 Aug 27 02:54:08.582596 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2117/4433] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:08 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 1252 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:08.601249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:08.602724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:08.639618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.645763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.651486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.656255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.661870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.662825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.756927 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a HTTP/1.1 Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5f304ff1-b05a-47e9-ad46-9655aef3545a'} Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:08.773194 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:08.785600 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:08.785600 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:08.785600 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:08.785600 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:08.785600 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:08.785600 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:54:08.785600 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:08.785600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:08.788420 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-45537b6b-2793-4627-b8eb-eda2215502f1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 404 len: 111 microversion: 2.1 time: 0.203938 Aug 27 02:54:08.796441 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2118/4434] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:08 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:08.823017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8dbed883-be16-4b2f-834f-54698497af32 req-7c0f90e9-3387-47f7-b9ce-a78c09f841c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f304ff1-b05a-47e9-ad46-9655aef3545a", "name": "network-vif-deleted", "tag": "0dcfa0a1-3661-461d-9b13-7e314c359de9"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:08.871205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8dbed883-be16-4b2f-834f-54698497af32 req-7c0f90e9-3387-47f7-b9ce-a78c09f841c9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:08.878393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8dbed883-be16-4b2f-834f-54698497af32 req-7c0f90e9-3387-47f7-b9ce-a78c09f841c9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:08.880323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8dbed883-be16-4b2f-834f-54698497af32 req-7c0f90e9-3387-47f7-b9ce-a78c09f841c9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:08.945205 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8dbed883-be16-4b2f-834f-54698497af32 req-7c0f90e9-3387-47f7-b9ce-a78c09f841c9 service nova] Creating event network-vif-deleted:0dcfa0a1-3661-461d-9b13-7e314c359de9 for instance 5f304ff1-b05a-47e9-ad46-9655aef3545a on n-h1-852084-5 Aug 27 02:54:08.967268 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8dbed883-be16-4b2f-834f-54698497af32 req-7c0f90e9-3387-47f7-b9ce-a78c09f841c9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168091 Aug 27 02:54:08.973252 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2119/4435] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:09.000531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a3abb98c-d52e-41a1-8c63-2f7b98c979e6 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:09.004079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a3abb98c-d52e-41a1-8c63-2f7b98c979e6 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:09.048889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3abb98c-d52e-41a1-8c63-2f7b98c979e6 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.050512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3abb98c-d52e-41a1-8c63-2f7b98c979e6 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.054384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3abb98c-d52e-41a1-8c63-2f7b98c979e6 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.058695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3abb98c-d52e-41a1-8c63-2f7b98c979e6 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.077599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3abb98c-d52e-41a1-8c63-2f7b98c979e6 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.078910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3abb98c-d52e-41a1-8c63-2f7b98c979e6 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.187865 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab232315-9f13-4731-9f14-13261eeb77db tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.099219 Aug 27 02:54:09.189538 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2317/4436] 10.222.0.99 () {60 vars in 1170 bytes} [Sat Aug 27 02:54:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:09.209530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.148"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:09.212409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:09.224180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.226146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.231845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.233112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:09.233888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:09.234629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:09.321927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "refresh_cache-cb921ba2-f893-4131-a5e2-a51d05eabcd8" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:54:09.325196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquired lock "refresh_cache-cb921ba2-f893-4131-a5e2-a51d05eabcd8" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:54:10.202681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a3abb98c-d52e-41a1-8c63-2f7b98c979e6 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:10.220491 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a3abb98c-d52e-41a1-8c63-2f7b98c979e6 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1327 microversion: 2.1 time: 1.244017 Aug 27 02:54:10.222371 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2120/4437] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:08 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1327 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:10.233728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-654885382", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a3bbba16-ea21-41e9-a19d-afd74184c636"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:10.336594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] validate_networks() for [('a3bbba16-ea21-41e9-a19d-afd74184c636', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:54:13.032221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:13.033764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:13.034584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:13.035858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:13.037417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:13.066542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.070702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.073524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.081738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.082669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.083365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.096134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Building network info cache for instance {{(pid=122488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:54:13.140576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:13.172752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for user b508f2fe4b394f589b067f5b3de49a0e and project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:13.218500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:54:13.221139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:54:13.366515 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1928b6a3-3fc8-426c-963a-f8eb0eb941ff tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.142737 Aug 27 02:54:13.367591 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2121/4438] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:54:13.376565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:13.377457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] [instance: 80abc4a0-849e-4542-8318-42dd3c227e53] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:13.384980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.386013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.386802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.387760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.388541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.389284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.409406 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] HTTP exception thrown: Instance 80abc4a0-849e-4542-8318-42dd3c227e53 could not be found. Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Request method failure captured: Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 HTTP/1.1 Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYaxnpD3_FXPQDPEcSWS5oa3eD-eqVlqhufxX06DH-ObNWvRYouflyR-Q3V8sLUdQiEA5GSVWy4y5W1oTaiO9jiK-1UQWmsf8dsKPLFJ5pYIe_1xg6LZmB0Zhb7m7Qbk7SEgcz1-f9TlCzACk96Jo1bLOkQNV19p4yt-CDggRlfIT98 Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 3126c8641780451c8c6882179cce59d2 Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersTestBootFromVolume-765980019 Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3126c8641780451c8c6882179cce59d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3126c8641780451c8c6882179cce59d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3126c8641780451c8c6882179cce59d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3126c8641780451c8c6882179cce59d2"}]}] Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersTestBootFromVolume-765980019 Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 3126c8641780451c8c6882179cce59d2 Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersTestBootFromVolume-765980019 Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersTestBootFromVolume-765980019-project Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: e6debd1d81f0463c9daaa0168051ecee Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersTestBootFromVolume-765980019-project Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 80abc4a0-849e-4542-8318-42dd3c227e53 could not be found. Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '80abc4a0-849e-4542-8318-42dd3c227e53'} Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80abc4a0-849e-4542-8318-42dd3c227e53 could not be found. Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80abc4a0-849e-4542-8318-42dd3c227e53 could not be found. Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:13.411574 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:13.417101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:13.417101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:13.417101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:13.417101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:13.417101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:13.417101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80abc4a0-849e-4542-8318-42dd3c227e53 could not be found. Aug 27 02:54:13.417101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:13.427425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Returning 404 to user: Instance 80abc4a0-849e-4542-8318-42dd3c227e53 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:13.438784 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e8f0e07-af18-45f8-999a-d624ecb4af36 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53" status: 404 len: 111 microversion: 2.1 time: 0.067208 Aug 27 02:54:13.443135 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2122/4439] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:13 2022] GET /compute/v2.1/servers/80abc4a0-849e-4542-8318-42dd3c227e53 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:13.472129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-5cd251e3-e412-4440-b9e8-22ed410df3f4 req-ed719103-dd9b-4c68-9c00-4475e4dc0f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a03c88d-0721-4243-9b50-df3034dc0612", "name": "network-vif-plugged", "status": "completed", "tag": "75f9d789-5d28-42c0-af89-f70808adb6ba"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:13.521424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5cd251e3-e412-4440-b9e8-22ed410df3f4 req-ed719103-dd9b-4c68-9c00-4475e4dc0f52 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.523065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5cd251e3-e412-4440-b9e8-22ed410df3f4 req-ed719103-dd9b-4c68-9c00-4475e4dc0f52 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.524668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5cd251e3-e412-4440-b9e8-22ed410df3f4 req-ed719103-dd9b-4c68-9c00-4475e4dc0f52 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.556659 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-5cd251e3-e412-4440-b9e8-22ed410df3f4 req-ed719103-dd9b-4c68-9c00-4475e4dc0f52 service nova] Creating event network-vif-plugged:75f9d789-5d28-42c0-af89-f70808adb6ba for instance 9a03c88d-0721-4243-9b50-df3034dc0612 on n-h1-852084-5 Aug 27 02:54:13.573282 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-5cd251e3-e412-4440-b9e8-22ed410df3f4 req-ed719103-dd9b-4c68-9c00-4475e4dc0f52 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122534 Aug 27 02:54:13.574540 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2123/4440] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:13.589022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6adb2561-d6e0-4098-832e-ba2368a38f5f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:13.591141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6adb2561-d6e0-4098-832e-ba2368a38f5f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:13.619413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6adb2561-d6e0-4098-832e-ba2368a38f5f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.630492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6adb2561-d6e0-4098-832e-ba2368a38f5f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.635217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6adb2561-d6e0-4098-832e-ba2368a38f5f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:13.637585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6adb2561-d6e0-4098-832e-ba2368a38f5f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:13.638343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6adb2561-d6e0-4098-832e-ba2368a38f5f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:13.640492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6adb2561-d6e0-4098-832e-ba2368a38f5f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:14.799416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6adb2561-d6e0-4098-832e-ba2368a38f5f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:14.812789 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6adb2561-d6e0-4098-832e-ba2368a38f5f tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1327 microversion: 2.1 time: 1.236661 Aug 27 02:54:14.813797 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2124/4441] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:13 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1327 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:14.837062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-bf550618-3fc0-4ab1-b361-2f4e3756521e req-0e4267f3-a3ff-4076-8a08-bf3a9f50618f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb921ba2-f893-4131-a5e2-a51d05eabcd8", "tag": "e178da5f-6f2a-433b-a845-5c4706053351"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:14.888156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf550618-3fc0-4ab1-b361-2f4e3756521e req-0e4267f3-a3ff-4076-8a08-bf3a9f50618f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:14.893588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf550618-3fc0-4ab1-b361-2f4e3756521e req-0e4267f3-a3ff-4076-8a08-bf3a9f50618f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:14.894485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf550618-3fc0-4ab1-b361-2f4e3756521e req-0e4267f3-a3ff-4076-8a08-bf3a9f50618f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:14.934309 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-bf550618-3fc0-4ab1-b361-2f4e3756521e req-0e4267f3-a3ff-4076-8a08-bf3a9f50618f service nova] Creating event network-changed:e178da5f-6f2a-433b-a845-5c4706053351 for instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 on n-h2-852084-5 Aug 27 02:54:14.947136 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-bf550618-3fc0-4ab1-b361-2f4e3756521e req-0e4267f3-a3ff-4076-8a08-bf3a9f50618f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131501 Aug 27 02:54:14.951707 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2125/4442] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:14.968500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4f17ee03-cdbe-4224-9020-4efccd47bb0b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:14.969778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4f17ee03-cdbe-4224-9020-4efccd47bb0b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:14.991546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f17ee03-cdbe-4224-9020-4efccd47bb0b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:14.996933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f17ee03-cdbe-4224-9020-4efccd47bb0b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:14.998554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f17ee03-cdbe-4224-9020-4efccd47bb0b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:14.999526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f17ee03-cdbe-4224-9020-4efccd47bb0b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:15.002325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f17ee03-cdbe-4224-9020-4efccd47bb0b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:15.003258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f17ee03-cdbe-4224-9020-4efccd47bb0b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:15.274726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4f17ee03-cdbe-4224-9020-4efccd47bb0b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:15.321368 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4f17ee03-cdbe-4224-9020-4efccd47bb0b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1218 microversion: 2.1 time: 0.362281 Aug 27 02:54:15.327255 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2126/4443] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:14 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1218 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:15.352833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-94078ccf-287a-4ada-bde5-d70d8030b889 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] Calling method '.version_select at 0x7f4d29db8670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:15.419857 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-94078ccf-287a-4ada-bde5-d70d8030b889 tempest-ServersTestBootFromVolume-765980019 tempest-ServersTestBootFromVolume-765980019-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963302741" status: 202 len: 0 microversion: 2.1 time: 0.090514 Aug 27 02:54:15.426915 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2127/4444] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:54:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1963302741 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:54:15.819165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1882766007", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d099a3c-a92a-4c98-9b30-33ed6c21c726"}], "security_groups": [{"name": "tempest-securitygroup--558666386"}], "key_name": "tempest-keypair-1129323033", "user_data": "}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:16.665153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] validate_networks() for [('7d099a3c-a92a-4c98-9b30-33ed6c21c726', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:54:16.977465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Updating instance_info_cache with network_info: [{"id": "e178da5f-6f2a-433b-a845-5c4706053351", "address": "fa:16:3e:8b:25:a4", "network": {"id": "2d69ead8-af70-4ff6-884d-9014a0bf7a2a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-310963660-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1225f40d38245f88817d37929eb4273", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape178da5f-6f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:54:16.999087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Releasing lock "refresh_cache-cb921ba2-f893-4131-a5e2-a51d05eabcd8" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:54:17.000102 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1bc6f63f-9eb2-4e9d-878c-aae1c945001d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "POST /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8/action" status: 202 len: 0 microversion: 2.1 time: 7.796885 Aug 27 02:54:17.001291 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2318/4445] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:54:09 2022] POST /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8/action => generated 0 bytes in 7799 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 27 02:54:17.007843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f45014d-8b70-48e3-b9b3-a3e5f3f5e2c8 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:17.011810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6f45014d-8b70-48e3-b9b3-a3e5f3f5e2c8 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:17.035712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f45014d-8b70-48e3-b9b3-a3e5f3f5e2c8 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:17.036532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f45014d-8b70-48e3-b9b3-a3e5f3f5e2c8 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:17.037191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f45014d-8b70-48e3-b9b3-a3e5f3f5e2c8 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:17.037961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f45014d-8b70-48e3-b9b3-a3e5f3f5e2c8 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:17.038599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f45014d-8b70-48e3-b9b3-a3e5f3f5e2c8 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:17.039219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f45014d-8b70-48e3-b9b3-a3e5f3f5e2c8 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:17.781855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6f45014d-8b70-48e3-b9b3-a3e5f3f5e2c8 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:17.795812 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6f45014d-8b70-48e3-b9b3-a3e5f3f5e2c8 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1526 microversion: 2.1 time: 0.793045 Aug 27 02:54:17.800347 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2319/4446] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:17 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1526 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:17.805543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-053917f2-1e22-429f-a511-cf03736ad03b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:17.806426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-053917f2-1e22-429f-a511-cf03736ad03b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:17.815549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053917f2-1e22-429f-a511-cf03736ad03b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:17.816374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053917f2-1e22-429f-a511-cf03736ad03b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:17.816973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053917f2-1e22-429f-a511-cf03736ad03b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:17.817887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053917f2-1e22-429f-a511-cf03736ad03b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:17.818517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053917f2-1e22-429f-a511-cf03736ad03b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:17.819136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-053917f2-1e22-429f-a511-cf03736ad03b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:17.975104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-053917f2-1e22-429f-a511-cf03736ad03b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:17.987963 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-053917f2-1e22-429f-a511-cf03736ad03b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1272 microversion: 2.1 time: 0.186154 Aug 27 02:54:17.988998 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2320/4447] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:17 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:18.018231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.148"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:18.599455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:18.613843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:18.615826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:18.617953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:18.623359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:18.623965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:18.624484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:19.068026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "refresh_cache-cb921ba2-f893-4131-a5e2-a51d05eabcd8" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 27 02:54:19.068695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquired lock "refresh_cache-cb921ba2-f893-4131-a5e2-a51d05eabcd8" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 27 02:54:19.670791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:19.671895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:19.672560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:19.673902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:19.673902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:19.695574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:19.696088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:19.696551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:19.697401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:19.698436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:19.701855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:19.757987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Getting quotas for project d4399d0cd9ba4a16a4db45cf851a54f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:19.773769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Getting quotas for user bfefa59129eb427687ac388dbd000d25 and project d4399d0cd9ba4a16a4db45cf851a54f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:19.815259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:54:19.825051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:54:19.951190 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-637bdc35-d4a8-4e7b-a2a1-80a0df776883 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.132591 Aug 27 02:54:19.952707 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2128/4448] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:54:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 4144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:54:19.958181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b568cfc0-81bd-44cc-913e-3667dc141111 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:19.961022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b568cfc0-81bd-44cc-913e-3667dc141111 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:19.974101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b568cfc0-81bd-44cc-913e-3667dc141111 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:19.974602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b568cfc0-81bd-44cc-913e-3667dc141111 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:19.975048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b568cfc0-81bd-44cc-913e-3667dc141111 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:19.975790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b568cfc0-81bd-44cc-913e-3667dc141111 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:19.976283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b568cfc0-81bd-44cc-913e-3667dc141111 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:19.976721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b568cfc0-81bd-44cc-913e-3667dc141111 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:20.995036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b568cfc0-81bd-44cc-913e-3667dc141111 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:21.035035 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b568cfc0-81bd-44cc-913e-3667dc141111 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1526 microversion: 2.1 time: 1.080845 Aug 27 02:54:21.036445 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2129/4449] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:19 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1526 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:21.066553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d5bb5fad-e7d5-4d67-91ce-ea8f7b65b883 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:21.067502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d5bb5fad-e7d5-4d67-91ce-ea8f7b65b883 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:21.106558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5bb5fad-e7d5-4d67-91ce-ea8f7b65b883 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:21.107741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5bb5fad-e7d5-4d67-91ce-ea8f7b65b883 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:21.109259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5bb5fad-e7d5-4d67-91ce-ea8f7b65b883 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:21.110923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5bb5fad-e7d5-4d67-91ce-ea8f7b65b883 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:21.122925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5bb5fad-e7d5-4d67-91ce-ea8f7b65b883 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:21.124034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d5bb5fad-e7d5-4d67-91ce-ea8f7b65b883 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:21.439889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d5bb5fad-e7d5-4d67-91ce-ea8f7b65b883 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:21.472013 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d5bb5fad-e7d5-4d67-91ce-ea8f7b65b883 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1272 microversion: 2.1 time: 0.429761 Aug 27 02:54:21.493757 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2130/4450] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:21 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1272 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:21.538776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ed41e611-f7e5-4650-a1a4-2ac850e24e05 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:21.544064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ed41e611-f7e5-4650-a1a4-2ac850e24e05 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:21.569574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed41e611-f7e5-4650-a1a4-2ac850e24e05 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:21.576444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed41e611-f7e5-4650-a1a4-2ac850e24e05 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:21.579583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed41e611-f7e5-4650-a1a4-2ac850e24e05 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:21.581393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed41e611-f7e5-4650-a1a4-2ac850e24e05 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:21.582968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed41e611-f7e5-4650-a1a4-2ac850e24e05 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:21.584083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed41e611-f7e5-4650-a1a4-2ac850e24e05 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:22.192376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ed41e611-f7e5-4650-a1a4-2ac850e24e05 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:22.241521 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ed41e611-f7e5-4650-a1a4-2ac850e24e05 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1234 microversion: 2.1 time: 0.742070 Aug 27 02:54:22.246891 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2131/4451] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:21 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1234 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:22.604992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Building network info cache for instance {{(pid=122488) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 27 02:54:23.621585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:23.622510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:23.635687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:23.640194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:23.643137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:23.644351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:23.644956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:23.647040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:23.709486 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] HTTP exception thrown: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Request method failure captured: Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 HTTP/1.1 Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYc5G2cFFcShLIuyubQZXdMD2az2NQPkqLkcVmIL0pOLlMuuWWhWfAijsk1GOgMk6zYuLxIFvj3cMbEKLDMfnssvCwikK8_FmxXwj7HakuYAXzmjpAlxAYzyUE1vaiLPUAbE1R2JPT-mys1dBufHW7MS0aid-QEZgOfphF8pLGB5LiI Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b0fbc1cfbb2454fb54314d8abadbdb6 Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-62549236 Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b0fbc1cfbb2454fb54314d8abadbdb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b0fbc1cfbb2454fb54314d8abadbdb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b0fbc1cfbb2454fb54314d8abadbdb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b0fbc1cfbb2454fb54314d8abadbdb6"}]}] Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-62549236 Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b0fbc1cfbb2454fb54314d8abadbdb6 Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-62549236 Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestMultiTenantJSON-62549236-project Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c6f3639b3a3a450a8e8c1ed44ec68408 Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-62549236-project Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '9a03c88d-0721-4243-9b50-df3034dc0612'} Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:23.712528 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:23.716590 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:23.716590 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:23.716590 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:23.716590 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:23.716590 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:23.716590 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:23.716590 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:23.716590 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:23.716590 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:23.716590 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:23.716590 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:23.722372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Returning 404 to user: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:23.724861 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1ac76bca-daf0-4ef5-a96d-73739f5ca99d tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 404 len: 111 microversion: 2.1 time: 1.475918 Aug 27 02:54:23.727099 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2132/4452] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:54:22 2022] DELETE /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 111 bytes in 1479 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:23.737263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-abe9bfa7-a31a-46cd-ada7-db64a07de7d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:23.745173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-abe9bfa7-a31a-46cd-ada7-db64a07de7d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:23.749728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abe9bfa7-a31a-46cd-ada7-db64a07de7d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:23.756384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abe9bfa7-a31a-46cd-ada7-db64a07de7d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:23.757191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abe9bfa7-a31a-46cd-ada7-db64a07de7d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:23.758293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abe9bfa7-a31a-46cd-ada7-db64a07de7d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:23.760262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abe9bfa7-a31a-46cd-ada7-db64a07de7d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:23.762389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abe9bfa7-a31a-46cd-ada7-db64a07de7d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:25.464523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-abe9bfa7-a31a-46cd-ada7-db64a07de7d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:25.482932 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-abe9bfa7-a31a-46cd-ada7-db64a07de7d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1314 microversion: 2.1 time: 1.754019 Aug 27 02:54:25.487823 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2133/4453] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:23 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1314 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:25.495697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2ce71eea-dfd2-403f-bf0d-b0ef78fa77f2 req-1640851a-649a-40d5-90b9-7b8cf15e24f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb921ba2-f893-4131-a5e2-a51d05eabcd8", "tag": "e178da5f-6f2a-433b-a845-5c4706053351"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:25.511375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2ce71eea-dfd2-403f-bf0d-b0ef78fa77f2 req-1640851a-649a-40d5-90b9-7b8cf15e24f6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:25.512249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2ce71eea-dfd2-403f-bf0d-b0ef78fa77f2 req-1640851a-649a-40d5-90b9-7b8cf15e24f6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:25.512945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2ce71eea-dfd2-403f-bf0d-b0ef78fa77f2 req-1640851a-649a-40d5-90b9-7b8cf15e24f6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:25.531028 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2ce71eea-dfd2-403f-bf0d-b0ef78fa77f2 req-1640851a-649a-40d5-90b9-7b8cf15e24f6 service nova] Creating event network-changed:e178da5f-6f2a-433b-a845-5c4706053351 for instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 on n-h2-852084-5 Aug 27 02:54:25.546920 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2ce71eea-dfd2-403f-bf0d-b0ef78fa77f2 req-1640851a-649a-40d5-90b9-7b8cf15e24f6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049738 Aug 27 02:54:25.560730 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2134/4454] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:25.581281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cebcb453-17b6-43c1-9e5c-e34a75569330 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:25.583325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cebcb453-17b6-43c1-9e5c-e34a75569330 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:25.598399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:25.604215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cebcb453-17b6-43c1-9e5c-e34a75569330 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:25.608375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cebcb453-17b6-43c1-9e5c-e34a75569330 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:25.611400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cebcb453-17b6-43c1-9e5c-e34a75569330 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:25.612301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cebcb453-17b6-43c1-9e5c-e34a75569330 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:25.614074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cebcb453-17b6-43c1-9e5c-e34a75569330 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:25.614615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cebcb453-17b6-43c1-9e5c-e34a75569330 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:26.201827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cebcb453-17b6-43c1-9e5c-e34a75569330 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:26.216636 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cebcb453-17b6-43c1-9e5c-e34a75569330 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1296 microversion: 2.1 time: 0.652590 Aug 27 02:54:26.220568 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2135/4455] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:25 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1296 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:26.226384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48000c15-3360-4bb9-ac12-f99f8cb9011d tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:26.227396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-48000c15-3360-4bb9-ac12-f99f8cb9011d tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:26.245583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48000c15-3360-4bb9-ac12-f99f8cb9011d tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:26.249182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48000c15-3360-4bb9-ac12-f99f8cb9011d tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:26.251644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48000c15-3360-4bb9-ac12-f99f8cb9011d tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:26.260803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48000c15-3360-4bb9-ac12-f99f8cb9011d tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:26.262126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Updating instance_info_cache with network_info: [{"id": "e178da5f-6f2a-433b-a845-5c4706053351", "address": "fa:16:3e:8b:25:a4", "network": {"id": "2d69ead8-af70-4ff6-884d-9014a0bf7a2a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-310963660-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a1225f40d38245f88817d37929eb4273", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape178da5f-6f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:54:26.264288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48000c15-3360-4bb9-ac12-f99f8cb9011d tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:26.265392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48000c15-3360-4bb9-ac12-f99f8cb9011d tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:26.297851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Releasing lock "refresh_cache-cb921ba2-f893-4131-a5e2-a51d05eabcd8" {{(pid=122488) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 27 02:54:26.300876 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dd68f938-db6e-4edd-a9bc-b56b6dd253d6 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "POST /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8/action" status: 202 len: 0 microversion: 2.1 time: 8.310600 Aug 27 02:54:26.301930 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2321/4456] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:54:17 2022] POST /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8/action => generated 0 bytes in 8313 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 27 02:54:26.314503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5d44cc6d-47ac-4856-9c26-179ad43c84c5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '.version_select at 0x7f4d28f4b5e0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:27.540765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-48000c15-3360-4bb9-ac12-f99f8cb9011d tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:27.555656 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-48000c15-3360-4bb9-ac12-f99f8cb9011d tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1526 microversion: 2.1 time: 1.333620 Aug 27 02:54:27.566431 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2136/4457] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:26 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1526 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:27.579262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c01a9de-d278-4f14-868f-9c36b8b081d1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:27.583147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4c01a9de-d278-4f14-868f-9c36b8b081d1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:27.595138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01a9de-d278-4f14-868f-9c36b8b081d1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:27.596289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01a9de-d278-4f14-868f-9c36b8b081d1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:27.596933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01a9de-d278-4f14-868f-9c36b8b081d1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:27.598001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01a9de-d278-4f14-868f-9c36b8b081d1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:27.598671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01a9de-d278-4f14-868f-9c36b8b081d1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:27.599275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c01a9de-d278-4f14-868f-9c36b8b081d1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.608562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:28.863371 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5d44cc6d-47ac-4856-9c26-179ad43c84c5 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "DELETE /compute/v2.1/os-floating-ips/3d8ad9fb-ed04-43f2-a42c-f5911454e0c5" status: 202 len: 0 microversion: 2.1 time: 2.553292 Aug 27 02:54:28.865732 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2322/4458] 10.222.0.99 () {58 vars in 1263 bytes} [Sat Aug 27 02:54:26 2022] DELETE /compute/v2.1/os-floating-ips/3d8ad9fb-ed04-43f2-a42c-f5911454e0c5 => generated 0 bytes in 2557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:54:28.891330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dc66fb61-cbf8-41dd-b17a-e5d54143696b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:28.896795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dc66fb61-cbf8-41dd-b17a-e5d54143696b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:28.929249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc66fb61-cbf8-41dd-b17a-e5d54143696b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.930805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc66fb61-cbf8-41dd-b17a-e5d54143696b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.936899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc66fb61-cbf8-41dd-b17a-e5d54143696b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:28.942462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc66fb61-cbf8-41dd-b17a-e5d54143696b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:28.946221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc66fb61-cbf8-41dd-b17a-e5d54143696b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:28.948583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc66fb61-cbf8-41dd-b17a-e5d54143696b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:29.007133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4c01a9de-d278-4f14-868f-9c36b8b081d1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:29.056493 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4c01a9de-d278-4f14-868f-9c36b8b081d1 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1314 microversion: 2.1 time: 1.485896 Aug 27 02:54:29.075105 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2137/4459] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:27 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1314 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:29.100794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Action: 'update', calling method: >, body: {"server": {"name": "9a03c88d-0721-4243-9b50-df3034dc0612_new"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:29.108506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:29.130076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:29.136456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:29.138618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:29.157504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:29.158850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:29.160008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:29.194263 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] HTTP exception thrown: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Request method failure captured: Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: request: PUT /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 HTTP/1.1 Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 64 Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYc5G2cFFcShLIuyubQZXdMD2az2NQPkqLkcVmIL0pOLlMuuWWhWfAijsk1GOgMk6zYuLxIFvj3cMbEKLDMfnssvCwikK8_FmxXwj7HakuYAXzmjpAlxAYzyUE1vaiLPUAbE1R2JPT-mys1dBufHW7MS0aid-QEZgOfphF8pLGB5LiI Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b0fbc1cfbb2454fb54314d8abadbdb6 Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-62549236 Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b0fbc1cfbb2454fb54314d8abadbdb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b0fbc1cfbb2454fb54314d8abadbdb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b0fbc1cfbb2454fb54314d8abadbdb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b0fbc1cfbb2454fb54314d8abadbdb6"}]}] Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-62549236 Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b0fbc1cfbb2454fb54314d8abadbdb6 Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-62549236 Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestMultiTenantJSON-62549236-project Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c6f3639b3a3a450a8e8c1ed44ec68408 Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-62549236-project Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: {"server": {"name": "9a03c88d-0721-4243-9b50-df3034dc0612_new"}} Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '9a03c88d-0721-4243-9b50-df3034dc0612', 'body': {'server': {'name': '9a03c88d-0721-4243-9b50-df3034dc0612_new'}}} Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 27 02:54:29.199883 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] Returning 404 to user: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:29.208956 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1d1d7e0a-ba36-44b4-ade6-fe9ffb1a42ad tempest-ServersNegativeTestMultiTenantJSON-62549236 tempest-ServersNegativeTestMultiTenantJSON-62549236-project] 10.222.0.99 "PUT /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 404 len: 111 microversion: 2.1 time: 0.128925 Aug 27 02:54:29.214801 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2138/4460] 10.222.0.99 () {60 vars in 1256 bytes} [Sat Aug 27 02:54:29 2022] PUT /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:29.220230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-91e8ab62-b97e-4b3e-898c-a80a9d14e43f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '.version_select at 0x7f4d29dc9820>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:29.474373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dc66fb61-cbf8-41dd-b17a-e5d54143696b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:29.497928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:29.513246 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dc66fb61-cbf8-41dd-b17a-e5d54143696b tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1363 microversion: 2.1 time: 0.645372 Aug 27 02:54:29.518208 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2323/4461] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:28 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1363 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:29.533275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-415eb002-60d5-49a8-bf49-12d5ac9bada3 req-89f60e37-d702-48ec-9c76-68159d8754d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c66c64-3779-46eb-a94b-b6a11b2cc928", "tag": "399f7fb0-802d-4b26-8991-4d761e12a15b"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:29.555653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-415eb002-60d5-49a8-bf49-12d5ac9bada3 req-89f60e37-d702-48ec-9c76-68159d8754d2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:29.556141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-415eb002-60d5-49a8-bf49-12d5ac9bada3 req-89f60e37-d702-48ec-9c76-68159d8754d2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:29.557115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-415eb002-60d5-49a8-bf49-12d5ac9bada3 req-89f60e37-d702-48ec-9c76-68159d8754d2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:29.587030 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-415eb002-60d5-49a8-bf49-12d5ac9bada3 req-89f60e37-d702-48ec-9c76-68159d8754d2 service nova] Creating event network-changed:399f7fb0-802d-4b26-8991-4d761e12a15b for instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 on n-h2-852084-5 Aug 27 02:54:29.608140 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-415eb002-60d5-49a8-bf49-12d5ac9bada3 req-89f60e37-d702-48ec-9c76-68159d8754d2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088306 Aug 27 02:54:29.610304 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2324/4462] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:29.617985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-29669d8f-fdcd-45fb-8d0e-be7d0ecf9920 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:29.619532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-29669d8f-fdcd-45fb-8d0e-be7d0ecf9920 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:29.630841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29669d8f-fdcd-45fb-8d0e-be7d0ecf9920 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:29.632073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29669d8f-fdcd-45fb-8d0e-be7d0ecf9920 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:29.633357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29669d8f-fdcd-45fb-8d0e-be7d0ecf9920 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:29.634557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29669d8f-fdcd-45fb-8d0e-be7d0ecf9920 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:29.635703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29669d8f-fdcd-45fb-8d0e-be7d0ecf9920 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:29.636316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29669d8f-fdcd-45fb-8d0e-be7d0ecf9920 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:29.684553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-29669d8f-fdcd-45fb-8d0e-be7d0ecf9920 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:54:29.726578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:29.802915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=16 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:29.927334 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-29669d8f-fdcd-45fb-8d0e-be7d0ecf9920 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 204 len: 0 microversion: 2.1 time: 0.314147 Aug 27 02:54:29.932040 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2325/4463] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:54:29 2022] DELETE /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:54:29.941748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-93ad2d3d-e80b-432f-8be4-e12c2d020e7a req-4da959e1-2017-47d1-b7c3-966426482bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bda401e7-53e0-4698-b32b-031c49b5cf5f", "tag": "28051cef-d3f3-425c-b06a-97f68b4e2be2"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:29.953576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-93ad2d3d-e80b-432f-8be4-e12c2d020e7a req-4da959e1-2017-47d1-b7c3-966426482bbc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:29.954160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-93ad2d3d-e80b-432f-8be4-e12c2d020e7a req-4da959e1-2017-47d1-b7c3-966426482bbc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:29.954610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-93ad2d3d-e80b-432f-8be4-e12c2d020e7a req-4da959e1-2017-47d1-b7c3-966426482bbc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:29.978772 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-93ad2d3d-e80b-432f-8be4-e12c2d020e7a req-4da959e1-2017-47d1-b7c3-966426482bbc service nova] Creating event network-changed:28051cef-d3f3-425c-b06a-97f68b4e2be2 for instance bda401e7-53e0-4698-b32b-031c49b5cf5f on n-h1-852084-5 Aug 27 02:54:29.984445 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-93ad2d3d-e80b-432f-8be4-e12c2d020e7a req-4da959e1-2017-47d1-b7c3-966426482bbc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049996 Aug 27 02:54:29.985654 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2326/4464] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:29.992794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4ec158ac-1cca-4f00-954c-7b66518ded18 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:29.994504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4ec158ac-1cca-4f00-954c-7b66518ded18 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:30.002149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec158ac-1cca-4f00-954c-7b66518ded18 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:30.002954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec158ac-1cca-4f00-954c-7b66518ded18 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:30.003580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec158ac-1cca-4f00-954c-7b66518ded18 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:30.004527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec158ac-1cca-4f00-954c-7b66518ded18 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:30.005160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec158ac-1cca-4f00-954c-7b66518ded18 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:30.005860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ec158ac-1cca-4f00-954c-7b66518ded18 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:30.222539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4ec158ac-1cca-4f00-954c-7b66518ded18 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:30.261746 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4ec158ac-1cca-4f00-954c-7b66518ded18 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1532 microversion: 2.1 time: 0.273682 Aug 27 02:54:30.262677 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2327/4465] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:29 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1532 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:30.268180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6196ff67-cba5-4e15-9e50-b13a95e39ad2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:30.269077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6196ff67-cba5-4e15-9e50-b13a95e39ad2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:30.282587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6196ff67-cba5-4e15-9e50-b13a95e39ad2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:30.283633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6196ff67-cba5-4e15-9e50-b13a95e39ad2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:30.284288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6196ff67-cba5-4e15-9e50-b13a95e39ad2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:30.289506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6196ff67-cba5-4e15-9e50-b13a95e39ad2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:30.290329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6196ff67-cba5-4e15-9e50-b13a95e39ad2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:30.291133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6196ff67-cba5-4e15-9e50-b13a95e39ad2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:30.525809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6196ff67-cba5-4e15-9e50-b13a95e39ad2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:30.537771 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6196ff67-cba5-4e15-9e50-b13a95e39ad2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1314 microversion: 2.1 time: 0.272142 Aug 27 02:54:30.539089 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2328/4466] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:30 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:30.548378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad5d908e-d17a-457c-8deb-e27cea71f4e6 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:30.584151 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-91e8ab62-b97e-4b3e-898c-a80a9d14e43f tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "DELETE /compute/v2.1/os-security-groups/8c2164d1-8149-40fc-985f-49c6b57084a2" status: 202 len: 0 microversion: 2.1 time: 1.368971 Aug 27 02:54:30.584810 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2139/4467] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 02:54:29 2022] DELETE /compute/v2.1/os-security-groups/8c2164d1-8149-40fc-985f-49c6b57084a2 => generated 0 bytes in 1370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:54:30.596032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93160463-1b79-4f37-939e-e4bb0c622926 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:30.596559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93160463-1b79-4f37-939e-e4bb0c622926 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:30.614704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93160463-1b79-4f37-939e-e4bb0c622926 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:30.615540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93160463-1b79-4f37-939e-e4bb0c622926 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:30.616590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ad5d908e-d17a-457c-8deb-e27cea71f4e6 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:30.617396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93160463-1b79-4f37-939e-e4bb0c622926 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:30.624588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93160463-1b79-4f37-939e-e4bb0c622926 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:30.625362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93160463-1b79-4f37-939e-e4bb0c622926 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:30.626051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93160463-1b79-4f37-939e-e4bb0c622926 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:30.636646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad5d908e-d17a-457c-8deb-e27cea71f4e6 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:30.654523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad5d908e-d17a-457c-8deb-e27cea71f4e6 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:30.654993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad5d908e-d17a-457c-8deb-e27cea71f4e6 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:30.655776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad5d908e-d17a-457c-8deb-e27cea71f4e6 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:30.656200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad5d908e-d17a-457c-8deb-e27cea71f4e6 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:30.656634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad5d908e-d17a-457c-8deb-e27cea71f4e6 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:30.718957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93160463-1b79-4f37-939e-e4bb0c622926 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:54:30.722542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:30.905849 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-93160463-1b79-4f37-939e-e4bb0c622926 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "DELETE /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 204 len: 0 microversion: 2.1 time: 0.313381 Aug 27 02:54:30.905849 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2140/4468] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:54:30 2022] DELETE /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:54:30.917818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-40d6950b-c96d-427c-ab58-5a57f212c334 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:30.918144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-40d6950b-c96d-427c-ab58-5a57f212c334 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:30.937729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40d6950b-c96d-427c-ab58-5a57f212c334 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:30.938238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40d6950b-c96d-427c-ab58-5a57f212c334 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:30.938970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40d6950b-c96d-427c-ab58-5a57f212c334 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:30.939966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40d6950b-c96d-427c-ab58-5a57f212c334 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:30.940186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40d6950b-c96d-427c-ab58-5a57f212c334 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:30.940809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-40d6950b-c96d-427c-ab58-5a57f212c334 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:31.722659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-40d6950b-c96d-427c-ab58-5a57f212c334 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:31.758560 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-40d6950b-c96d-427c-ab58-5a57f212c334 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1509 microversion: 2.1 time: 0.847097 Aug 27 02:54:31.777711 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2141/4469] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:30 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1509 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:31.795182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-69af296a-fbe4-4913-972c-e698a66704a2 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:31.799044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-69af296a-fbe4-4913-972c-e698a66704a2 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:31.842133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69af296a-fbe4-4913-972c-e698a66704a2 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:31.846260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69af296a-fbe4-4913-972c-e698a66704a2 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:31.851683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69af296a-fbe4-4913-972c-e698a66704a2 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:31.853618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69af296a-fbe4-4913-972c-e698a66704a2 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:31.857744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69af296a-fbe4-4913-972c-e698a66704a2 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:31.860638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69af296a-fbe4-4913-972c-e698a66704a2 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:32.007520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad5d908e-d17a-457c-8deb-e27cea71f4e6 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:32.019935 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad5d908e-d17a-457c-8deb-e27cea71f4e6 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1363 microversion: 2.1 time: 1.479274 Aug 27 02:54:32.021367 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2329/4470] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:30 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1363 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:32.026537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1641ba3c-73d7-4b69-9003-65289f5f2ea6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:32.032907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1641ba3c-73d7-4b69-9003-65289f5f2ea6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:32.049778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1641ba3c-73d7-4b69-9003-65289f5f2ea6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:32.050287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1641ba3c-73d7-4b69-9003-65289f5f2ea6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:32.050736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1641ba3c-73d7-4b69-9003-65289f5f2ea6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:32.051480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1641ba3c-73d7-4b69-9003-65289f5f2ea6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:32.054201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1641ba3c-73d7-4b69-9003-65289f5f2ea6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:32.054756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1641ba3c-73d7-4b69-9003-65289f5f2ea6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:33.030098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1641ba3c-73d7-4b69-9003-65289f5f2ea6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:33.045987 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1641ba3c-73d7-4b69-9003-65289f5f2ea6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1314 microversion: 2.1 time: 1.023234 Aug 27 02:54:33.046606 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2330/4471] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:32 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1314 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:33.063188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-261561d7-2a1d-4604-877e-5e6bd4a861be tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:33.063831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-261561d7-2a1d-4604-877e-5e6bd4a861be tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:33.088203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-261561d7-2a1d-4604-877e-5e6bd4a861be tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:33.088750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-261561d7-2a1d-4604-877e-5e6bd4a861be tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:33.089212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-261561d7-2a1d-4604-877e-5e6bd4a861be tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:33.090004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-261561d7-2a1d-4604-877e-5e6bd4a861be tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:33.092929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-261561d7-2a1d-4604-877e-5e6bd4a861be tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:33.093523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-261561d7-2a1d-4604-877e-5e6bd4a861be tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:33.710327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-69af296a-fbe4-4913-972c-e698a66704a2 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:33.728666 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-69af296a-fbe4-4913-972c-e698a66704a2 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1532 microversion: 2.1 time: 1.957447 Aug 27 02:54:33.729343 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2142/4472] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:31 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1532 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:33.734162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a7bf261d-46b0-40b0-b01c-aab5c65145b1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:33.734783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a7bf261d-46b0-40b0-b01c-aab5c65145b1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:33.751720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bf261d-46b0-40b0-b01c-aab5c65145b1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:33.752219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bf261d-46b0-40b0-b01c-aab5c65145b1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:33.752661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bf261d-46b0-40b0-b01c-aab5c65145b1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:33.753384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bf261d-46b0-40b0-b01c-aab5c65145b1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:33.753877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bf261d-46b0-40b0-b01c-aab5c65145b1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:33.754310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bf261d-46b0-40b0-b01c-aab5c65145b1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:33.761692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-261561d7-2a1d-4604-877e-5e6bd4a861be tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:33.771017 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-261561d7-2a1d-4604-877e-5e6bd4a861be tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1509 microversion: 2.1 time: 0.723308 Aug 27 02:54:33.787923 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2331/4473] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:33 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1509 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:34.088302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb1a0a20-b518-49d9-bae1-7083bb9819df tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:34.089295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb1a0a20-b518-49d9-bae1-7083bb9819df tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:34.104204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1a0a20-b518-49d9-bae1-7083bb9819df tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.104791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1a0a20-b518-49d9-bae1-7083bb9819df tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.105250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1a0a20-b518-49d9-bae1-7083bb9819df tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.106056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1a0a20-b518-49d9-bae1-7083bb9819df tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.106697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1a0a20-b518-49d9-bae1-7083bb9819df tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.107127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1a0a20-b518-49d9-bae1-7083bb9819df tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.763147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a7bf261d-46b0-40b0-b01c-aab5c65145b1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:34.788898 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a7bf261d-46b0-40b0-b01c-aab5c65145b1 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1363 microversion: 2.1 time: 1.057239 Aug 27 02:54:34.792282 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2143/4474] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:33 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1363 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:34.816775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9849d643-b209-4834-b2b1-c345de997467 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:34.818245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9849d643-b209-4834-b2b1-c345de997467 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:34.835088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9849d643-b209-4834-b2b1-c345de997467 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.838798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9849d643-b209-4834-b2b1-c345de997467 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.841827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9849d643-b209-4834-b2b1-c345de997467 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.844678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9849d643-b209-4834-b2b1-c345de997467 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.847138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9849d643-b209-4834-b2b1-c345de997467 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.847860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9849d643-b209-4834-b2b1-c345de997467 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.850458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cb1a0a20-b518-49d9-bae1-7083bb9819df tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:34.894636 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb1a0a20-b518-49d9-bae1-7083bb9819df tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1314 microversion: 2.1 time: 0.802833 Aug 27 02:54:34.902193 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2332/4475] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:34 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:34.927892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-83963a31-19ad-4f5d-9377-74a3976e302d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:34.929445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-83963a31-19ad-4f5d-9377-74a3976e302d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:34.964672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83963a31-19ad-4f5d-9377-74a3976e302d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.974990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83963a31-19ad-4f5d-9377-74a3976e302d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.976204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83963a31-19ad-4f5d-9377-74a3976e302d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:34.977807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83963a31-19ad-4f5d-9377-74a3976e302d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:34.979512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83963a31-19ad-4f5d-9377-74a3976e302d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:34.984274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83963a31-19ad-4f5d-9377-74a3976e302d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:35.200935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-83963a31-19ad-4f5d-9377-74a3976e302d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:35.243079 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-83963a31-19ad-4f5d-9377-74a3976e302d tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1467 microversion: 2.1 time: 0.338570 Aug 27 02:54:35.244530 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2333/4476] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:34 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1467 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:35.415093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9849d643-b209-4834-b2b1-c345de997467 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:35.424166 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9849d643-b209-4834-b2b1-c345de997467 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1490 microversion: 2.1 time: 0.628749 Aug 27 02:54:35.424768 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2144/4477] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:34 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1490 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:35.690508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-adb957f3-36b9-46c0-93cf-90b398d2fb76 req-73502164-163a-4577-b6ef-52a0b20bf901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb921ba2-f893-4131-a5e2-a51d05eabcd8", "name": "network-vif-deleted", "tag": "e178da5f-6f2a-433b-a845-5c4706053351"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:35.764863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-adb957f3-36b9-46c0-93cf-90b398d2fb76 req-73502164-163a-4577-b6ef-52a0b20bf901 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:35.766029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-adb957f3-36b9-46c0-93cf-90b398d2fb76 req-73502164-163a-4577-b6ef-52a0b20bf901 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:35.766771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-adb957f3-36b9-46c0-93cf-90b398d2fb76 req-73502164-163a-4577-b6ef-52a0b20bf901 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:35.783982 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-adb957f3-36b9-46c0-93cf-90b398d2fb76 req-73502164-163a-4577-b6ef-52a0b20bf901 service nova] Creating event network-vif-deleted:e178da5f-6f2a-433b-a845-5c4706053351 for instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 on n-h2-852084-5 Aug 27 02:54:35.791190 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-adb957f3-36b9-46c0-93cf-90b398d2fb76 req-73502164-163a-4577-b6ef-52a0b20bf901 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105950 Aug 27 02:54:35.792554 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2334/4478] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:35.819713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c25a62d6-a421-4616-a8a8-bb8b9befb55f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:35.824706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c25a62d6-a421-4616-a8a8-bb8b9befb55f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:35.870114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c25a62d6-a421-4616-a8a8-bb8b9befb55f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:35.871029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c25a62d6-a421-4616-a8a8-bb8b9befb55f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:35.875751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c25a62d6-a421-4616-a8a8-bb8b9befb55f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:35.877077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c25a62d6-a421-4616-a8a8-bb8b9befb55f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:35.877934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c25a62d6-a421-4616-a8a8-bb8b9befb55f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:35.882859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c25a62d6-a421-4616-a8a8-bb8b9befb55f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:35.919890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c47b7a1-66d8-4f76-9d88-b07db4f3e971 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:35.920841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9c47b7a1-66d8-4f76-9d88-b07db4f3e971 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:35.952015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c47b7a1-66d8-4f76-9d88-b07db4f3e971 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:35.956522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c47b7a1-66d8-4f76-9d88-b07db4f3e971 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:35.957329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c47b7a1-66d8-4f76-9d88-b07db4f3e971 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:35.958371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c47b7a1-66d8-4f76-9d88-b07db4f3e971 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:35.966682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c47b7a1-66d8-4f76-9d88-b07db4f3e971 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:35.967427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c47b7a1-66d8-4f76-9d88-b07db4f3e971 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.383972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9c47b7a1-66d8-4f76-9d88-b07db4f3e971 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:36.394915 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9c47b7a1-66d8-4f76-9d88-b07db4f3e971 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1314 microversion: 2.1 time: 0.479710 Aug 27 02:54:36.396490 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2335/4479] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:35 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:36.411226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:36.418237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:36.434332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.436090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.437728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.444104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.446405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.448183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.578589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.582522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.583199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.583928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lazy-loading 'fault' on Instance uuid cb921ba2-f893-4131-a5e2-a51d05eabcd8 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:54:36.694368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdb295ee44ec41c782d161ed620d53a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1225f40d38245f88817d37929eb4273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:36.713296 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9bb7fad3-eeea-4829-9d8e-d9c288c454a2 tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 200 len: 1313 microversion: 2.1 time: 0.314398 Aug 27 02:54:36.727702 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2336/4480] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:36 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:36.740900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:36.741819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:36.753346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.754072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.754669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.755685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.756321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.756981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.812170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.812939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.813857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:36.814497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lazy-loading 'fault' on Instance uuid 9a03c88d-0721-4243-9b50-df3034dc0612 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:54:36.903354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8012fabe384a3aa26e9ca9d3dc6dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007b9e59d3344828fab7f5f6b42ea7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:36.921288 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d894078c-7ba3-4c29-9c1b-40ab0ca76e73 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 200 len: 1317 microversion: 2.1 time: 0.191490 Aug 27 02:54:36.925771 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2337/4481] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:36 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:36.945613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e2200d42-fa5c-4900-86e5-38059f699200 req-999af133-5a12-404d-96bb-c7805c2e7846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c66c64-3779-46eb-a94b-b6a11b2cc928", "name": "network-vif-plugged", "status": "completed", "tag": "399f7fb0-802d-4b26-8991-4d761e12a15b"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:36.980280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c25a62d6-a421-4616-a8a8-bb8b9befb55f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:36.986556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e2200d42-fa5c-4900-86e5-38059f699200 req-999af133-5a12-404d-96bb-c7805c2e7846 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:36.988703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e2200d42-fa5c-4900-86e5-38059f699200 req-999af133-5a12-404d-96bb-c7805c2e7846 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:36.989592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e2200d42-fa5c-4900-86e5-38059f699200 req-999af133-5a12-404d-96bb-c7805c2e7846 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:37.004216 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c25a62d6-a421-4616-a8a8-bb8b9befb55f tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1363 microversion: 2.1 time: 1.192824 Aug 27 02:54:37.008658 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2145/4482] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:35 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1363 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:37.039170 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e2200d42-fa5c-4900-86e5-38059f699200 req-999af133-5a12-404d-96bb-c7805c2e7846 service nova] Creating event network-vif-plugged:399f7fb0-802d-4b26-8991-4d761e12a15b for instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 on n-h2-852084-5 Aug 27 02:54:37.046728 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e2200d42-fa5c-4900-86e5-38059f699200 req-999af133-5a12-404d-96bb-c7805c2e7846 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118909 Aug 27 02:54:37.047613 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2338/4483] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:37.423731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f9262164-24fa-4b4f-b1ea-ff4139fd7899 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:37.424643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f9262164-24fa-4b4f-b1ea-ff4139fd7899 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:37.444787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9262164-24fa-4b4f-b1ea-ff4139fd7899 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:37.445467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9262164-24fa-4b4f-b1ea-ff4139fd7899 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:37.446043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9262164-24fa-4b4f-b1ea-ff4139fd7899 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:37.447529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9262164-24fa-4b4f-b1ea-ff4139fd7899 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:37.448309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9262164-24fa-4b4f-b1ea-ff4139fd7899 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:37.449024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9262164-24fa-4b4f-b1ea-ff4139fd7899 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:37.659132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f9262164-24fa-4b4f-b1ea-ff4139fd7899 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:37.668285 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f9262164-24fa-4b4f-b1ea-ff4139fd7899 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1314 microversion: 2.1 time: 0.253203 Aug 27 02:54:37.669069 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2146/4484] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:37 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:37.739377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:37.740101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] [instance: cb921ba2-f893-4131-a5e2-a51d05eabcd8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:37.755577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:37.755577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:37.755577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:37.755577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:37.755577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:37.755577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:37.808532 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] HTTP exception thrown: Instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 could not be found. Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Request method failure captured: Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 HTTP/1.1 Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYcIeZM-TIPP6hglfottNt49CenBJJY73uKi_nrJapDSYMqfulDdb5NKJqHvwU1KocdZI41wRB-2OdzrpV6aCmOd4mSkpFNd3x7Zc1DPnyl2aK9WotExa-lBUEqAjrULkJsfWWM4cmm5Xa42RorLheTzaYhvxELguNQDqiSuKOhx24c Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a1225f40d38245f88817d37929eb4273 Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-438968144 Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a1225f40d38245f88817d37929eb4273"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a1225f40d38245f88817d37929eb4273"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a1225f40d38245f88817d37929eb4273"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a1225f40d38245f88817d37929eb4273"}]}] Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-438968144 Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a1225f40d38245f88817d37929eb4273 Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-438968144 Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerRescueTestJSONUnderV235-438968144-project Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: cdb295ee44ec41c782d161ed620d53a8 Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-438968144-project Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 could not be found. Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'cb921ba2-f893-4131-a5e2-a51d05eabcd8'} Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 could not be found. Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 could not be found. Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:54:37.812004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:37.817255 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:54:37.817255 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:37.817255 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:37.817255 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:37.817255 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:37.817255 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:37.817255 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 could not be found. Aug 27 02:54:37.817255 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:54:37.819694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] Returning 404 to user: Instance cb921ba2-f893-4131-a5e2-a51d05eabcd8 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:37.821367 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-448e2681-104e-4abc-a5d8-4ca0f79db04c tempest-ServerRescueTestJSONUnderV235-438968144 tempest-ServerRescueTestJSONUnderV235-438968144-project] 10.222.0.99 "GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8" status: 404 len: 111 microversion: 2.1 time: 0.086458 Aug 27 02:54:37.822742 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2339/4485] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:37 2022] GET /compute/v2.1/servers/cb921ba2-f893-4131-a5e2-a51d05eabcd8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:37.910026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-be3ad934-4370-4dad-93b4-6572b39997be req-a297d06f-deda-4096-b379-82b468367e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a03c88d-0721-4243-9b50-df3034dc0612", "name": "network-vif-deleted", "tag": "75f9d789-5d28-42c0-af89-f70808adb6ba"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:37.943664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-be3ad934-4370-4dad-93b4-6572b39997be req-a297d06f-deda-4096-b379-82b468367e83 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:37.944160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-be3ad934-4370-4dad-93b4-6572b39997be req-a297d06f-deda-4096-b379-82b468367e83 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:37.944608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-be3ad934-4370-4dad-93b4-6572b39997be req-a297d06f-deda-4096-b379-82b468367e83 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:37.952398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:37.953080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] [instance: 9a03c88d-0721-4243-9b50-df3034dc0612] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:37.964688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:37.970332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:37.971139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:37.973071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:37.976828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:37.981540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.012001 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-be3ad934-4370-4dad-93b4-6572b39997be req-a297d06f-deda-4096-b379-82b468367e83 service nova] Creating event network-vif-deleted:75f9d789-5d28-42c0-af89-f70808adb6ba for instance 9a03c88d-0721-4243-9b50-df3034dc0612 on n-h1-852084-5 Aug 27 02:54:38.036310 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] HTTP exception thrown: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Request method failure captured: Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 HTTP/1.1 Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYcnvdpp_mKTNtmaeCkkxLLVMvj00NppsxhIyBDfD0SdEYVMwUOa2c-VNgKBrFUXqeonigRtdbkrAk277HOOmkAInk4cI9ef0VNGGhrc-s7-F88EopUHutq_PA6WI_1cW6wtBiiDiOc6NS9QdxxRrKooB1lKSJf-fZ316kanH7Wxnm4 Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 9007b9e59d3344828fab7f5f6b42ea7a Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1522323243 Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9007b9e59d3344828fab7f5f6b42ea7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9007b9e59d3344828fab7f5f6b42ea7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9007b9e59d3344828fab7f5f6b42ea7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9007b9e59d3344828fab7f5f6b42ea7a"}]}] Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1522323243 Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 9007b9e59d3344828fab7f5f6b42ea7a Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1522323243 Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1522323243-project Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: fa8012fabe384a3aa26e9ca9d3dc6dcf Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1522323243-project Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '9a03c88d-0721-4243-9b50-df3034dc0612'} Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:38.041807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.046402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:54:38.046402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.046402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:54:38.046402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:54:38.046402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:54:38.046402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:54:38.046402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:54:38.046402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. Aug 27 02:54:38.046402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:54:38.047264 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-be3ad934-4370-4dad-93b4-6572b39997be req-a297d06f-deda-4096-b379-82b468367e83 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137975 Aug 27 02:54:38.047264 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2147/4486] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:38.047914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] Returning 404 to user: Instance 9a03c88d-0721-4243-9b50-df3034dc0612 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:54:38.050120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3c8ca31e-9a69-45d8-89d5-cda9bd24dc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:38.050833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3c8ca31e-9a69-45d8-89d5-cda9bd24dc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:38.051900 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-af9eb323-5e93-4ebd-ac90-a0c0eb14df10 tempest-ServersNegativeTestMultiTenantJSON-1522323243 tempest-ServersNegativeTestMultiTenantJSON-1522323243-project] 10.222.0.99 "GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612" status: 404 len: 111 microversion: 2.1 time: 0.103372 Aug 27 02:54:38.055924 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2340/4487] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:37 2022] GET /compute/v2.1/servers/9a03c88d-0721-4243-9b50-df3034dc0612 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:54:38.075282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c8ca31e-9a69-45d8-89d5-cda9bd24dc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.075793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c8ca31e-9a69-45d8-89d5-cda9bd24dc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.076240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c8ca31e-9a69-45d8-89d5-cda9bd24dc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.076961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c8ca31e-9a69-45d8-89d5-cda9bd24dc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.081021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c8ca31e-9a69-45d8-89d5-cda9bd24dc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.082859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c8ca31e-9a69-45d8-89d5-cda9bd24dc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.693011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7defe60a-09bd-4ee9-b341-291de8217945 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:38.693488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7defe60a-09bd-4ee9-b341-291de8217945 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:38.704141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7defe60a-09bd-4ee9-b341-291de8217945 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.706340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7defe60a-09bd-4ee9-b341-291de8217945 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.710516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7defe60a-09bd-4ee9-b341-291de8217945 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:38.711742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7defe60a-09bd-4ee9-b341-291de8217945 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:38.713454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7defe60a-09bd-4ee9-b341-291de8217945 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:38.714888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7defe60a-09bd-4ee9-b341-291de8217945 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:39.107394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3c8ca31e-9a69-45d8-89d5-cda9bd24dc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:39.119937 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3c8ca31e-9a69-45d8-89d5-cda9bd24dc17 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1363 microversion: 2.1 time: 1.071027 Aug 27 02:54:39.120642 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2148/4488] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:38 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1363 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:39.293718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7defe60a-09bd-4ee9-b341-291de8217945 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:39.325529 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7defe60a-09bd-4ee9-b341-291de8217945 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1314 microversion: 2.1 time: 0.635649 Aug 27 02:54:39.329479 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2341/4489] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:38 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:40.141476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d4177d44-87ea-4a11-8d4d-270f9c3ae9b3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:40.142143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d4177d44-87ea-4a11-8d4d-270f9c3ae9b3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:40.153386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4177d44-87ea-4a11-8d4d-270f9c3ae9b3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:40.153892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4177d44-87ea-4a11-8d4d-270f9c3ae9b3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:40.155679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4177d44-87ea-4a11-8d4d-270f9c3ae9b3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:40.158020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4177d44-87ea-4a11-8d4d-270f9c3ae9b3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:40.158597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4177d44-87ea-4a11-8d4d-270f9c3ae9b3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:40.160272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4177d44-87ea-4a11-8d4d-270f9c3ae9b3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:40.360807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c6148fb4-2b7b-4a14-9dac-3e8b068a2243 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:40.365241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6148fb4-2b7b-4a14-9dac-3e8b068a2243 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:40.394761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6148fb4-2b7b-4a14-9dac-3e8b068a2243 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:40.395985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6148fb4-2b7b-4a14-9dac-3e8b068a2243 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:40.396970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6148fb4-2b7b-4a14-9dac-3e8b068a2243 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:40.419817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6148fb4-2b7b-4a14-9dac-3e8b068a2243 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:40.423393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6148fb4-2b7b-4a14-9dac-3e8b068a2243 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:40.423892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6148fb4-2b7b-4a14-9dac-3e8b068a2243 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:40.432604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:40.761161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c6148fb4-2b7b-4a14-9dac-3e8b068a2243 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:40.778569 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c6148fb4-2b7b-4a14-9dac-3e8b068a2243 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1314 microversion: 2.1 time: 0.426478 Aug 27 02:54:40.794701 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2342/4490] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:40 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:41.183155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d4177d44-87ea-4a11-8d4d-270f9c3ae9b3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:41.204835 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d4177d44-87ea-4a11-8d4d-270f9c3ae9b3 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1549 microversion: 2.1 time: 1.058419 Aug 27 02:54:41.205957 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2149/4491] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:40 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1549 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:41.255081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8ee7d4f-cae6-4840-816c-e5781c768584 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:41.266252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c8ee7d4f-cae6-4840-816c-e5781c768584 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:41.294381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ee7d4f-cae6-4840-816c-e5781c768584 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:41.301523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ee7d4f-cae6-4840-816c-e5781c768584 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:41.303804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ee7d4f-cae6-4840-816c-e5781c768584 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:41.308315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ee7d4f-cae6-4840-816c-e5781c768584 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:41.311123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ee7d4f-cae6-4840-816c-e5781c768584 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:41.314137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8ee7d4f-cae6-4840-816c-e5781c768584 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:41.535377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-411e4ac3-f8b0-4682-8b19-e3c84f665aae req-e146c5c0-5c94-4817-88c1-04a3bd94c7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda401e7-53e0-4698-b32b-031c49b5cf5f", "name": "network-vif-plugged", "status": "completed", "tag": "28051cef-d3f3-425c-b06a-97f68b4e2be2"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:41.562248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-411e4ac3-f8b0-4682-8b19-e3c84f665aae req-e146c5c0-5c94-4817-88c1-04a3bd94c7f6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:41.562512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-411e4ac3-f8b0-4682-8b19-e3c84f665aae req-e146c5c0-5c94-4817-88c1-04a3bd94c7f6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:41.565090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-411e4ac3-f8b0-4682-8b19-e3c84f665aae req-e146c5c0-5c94-4817-88c1-04a3bd94c7f6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:41.604247 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-411e4ac3-f8b0-4682-8b19-e3c84f665aae req-e146c5c0-5c94-4817-88c1-04a3bd94c7f6 service nova] Creating event network-vif-plugged:28051cef-d3f3-425c-b06a-97f68b4e2be2 for instance bda401e7-53e0-4698-b32b-031c49b5cf5f on n-h1-852084-5 Aug 27 02:54:41.614475 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-411e4ac3-f8b0-4682-8b19-e3c84f665aae req-e146c5c0-5c94-4817-88c1-04a3bd94c7f6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084569 Aug 27 02:54:41.617438 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2150/4492] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:41.640696 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c8ee7d4f-cae6-4840-816c-e5781c768584 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.402118 Aug 27 02:54:41.642003 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2343/4493] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:54:41 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-interface => generated 285 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:41.805690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-037b70e6-fab5-4ab0-8d39-d8dde537ae80 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:41.808472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-037b70e6-fab5-4ab0-8d39-d8dde537ae80 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:41.842420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-037b70e6-fab5-4ab0-8d39-d8dde537ae80 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:41.843549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-037b70e6-fab5-4ab0-8d39-d8dde537ae80 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:41.844698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-037b70e6-fab5-4ab0-8d39-d8dde537ae80 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:41.848193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-037b70e6-fab5-4ab0-8d39-d8dde537ae80 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:41.849261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-037b70e6-fab5-4ab0-8d39-d8dde537ae80 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:41.851319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-037b70e6-fab5-4ab0-8d39-d8dde537ae80 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:42.822231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-037b70e6-fab5-4ab0-8d39-d8dde537ae80 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:42.835142 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-037b70e6-fab5-4ab0-8d39-d8dde537ae80 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1314 microversion: 2.1 time: 1.039868 Aug 27 02:54:42.835757 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2151/4494] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:41 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1314 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:43.878339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-02f6b6c0-d567-47c6-89a6-21dce931b789 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:43.890534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-02f6b6c0-d567-47c6-89a6-21dce931b789 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:43.946090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02f6b6c0-d567-47c6-89a6-21dce931b789 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.954596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02f6b6c0-d567-47c6-89a6-21dce931b789 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.961095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02f6b6c0-d567-47c6-89a6-21dce931b789 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:43.971664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02f6b6c0-d567-47c6-89a6-21dce931b789 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:43.979494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02f6b6c0-d567-47c6-89a6-21dce931b789 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:43.983852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02f6b6c0-d567-47c6-89a6-21dce931b789 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:44.584322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-02f6b6c0-d567-47c6-89a6-21dce931b789 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:44.600613 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-02f6b6c0-d567-47c6-89a6-21dce931b789 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1499 microversion: 2.1 time: 0.741810 Aug 27 02:54:44.612625 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2344/4495] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:43 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1499 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:44.635032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d494ed5-0428-4b32-835e-8df140319a98 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:44.635595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4d494ed5-0428-4b32-835e-8df140319a98 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:44.654859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d494ed5-0428-4b32-835e-8df140319a98 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:44.657608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d494ed5-0428-4b32-835e-8df140319a98 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:44.660698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d494ed5-0428-4b32-835e-8df140319a98 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:44.664293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d494ed5-0428-4b32-835e-8df140319a98 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:44.664790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d494ed5-0428-4b32-835e-8df140319a98 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:44.668189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d494ed5-0428-4b32-835e-8df140319a98 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:44.778784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-4d494ed5-0428-4b32-835e-8df140319a98 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lazy-loading 'flavor' on Instance uuid bda401e7-53e0-4698-b32b-031c49b5cf5f {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:54:45.466065 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4d494ed5-0428-4b32-835e-8df140319a98 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f/action" status: 202 len: 0 microversion: 2.1 time: 0.832018 Aug 27 02:54:45.473688 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2152/4496] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:54:44 2022] POST /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f/action => generated 0 bytes in 842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:54:45.480185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b64a88a-4b15-47b5-a37f-0c11fd439c69 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:45.483733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9b64a88a-4b15-47b5-a37f-0c11fd439c69 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:45.502799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b64a88a-4b15-47b5-a37f-0c11fd439c69 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:45.505326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b64a88a-4b15-47b5-a37f-0c11fd439c69 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:45.506215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b64a88a-4b15-47b5-a37f-0c11fd439c69 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:45.508625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b64a88a-4b15-47b5-a37f-0c11fd439c69 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:45.511227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b64a88a-4b15-47b5-a37f-0c11fd439c69 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:45.511970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b64a88a-4b15-47b5-a37f-0c11fd439c69 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:46.341129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9b64a88a-4b15-47b5-a37f-0c11fd439c69 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:46.355495 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9b64a88a-4b15-47b5-a37f-0c11fd439c69 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 0.877271 Aug 27 02:54:46.356294 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2345/4497] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:45 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:47.418608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a73d1fad-bfac-43a3-8381-38e60c66a40b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:47.422616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a73d1fad-bfac-43a3-8381-38e60c66a40b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:47.454839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73d1fad-bfac-43a3-8381-38e60c66a40b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:47.457658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73d1fad-bfac-43a3-8381-38e60c66a40b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:47.458670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73d1fad-bfac-43a3-8381-38e60c66a40b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:47.460837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73d1fad-bfac-43a3-8381-38e60c66a40b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:47.462756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73d1fad-bfac-43a3-8381-38e60c66a40b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:47.463469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a73d1fad-bfac-43a3-8381-38e60c66a40b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:47.947633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-6f6c55c3-e107-49e4-b9bb-47a3dbb1b777 req-56678895-49d4-401f-b226-b22abd705de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c66c64-3779-46eb-a94b-b6a11b2cc928", "tag": "399f7fb0-802d-4b26-8991-4d761e12a15b"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:47.974163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6f6c55c3-e107-49e4-b9bb-47a3dbb1b777 req-56678895-49d4-401f-b226-b22abd705de1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:47.975524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6f6c55c3-e107-49e4-b9bb-47a3dbb1b777 req-56678895-49d4-401f-b226-b22abd705de1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:47.976593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6f6c55c3-e107-49e4-b9bb-47a3dbb1b777 req-56678895-49d4-401f-b226-b22abd705de1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:48.023605 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-6f6c55c3-e107-49e4-b9bb-47a3dbb1b777 req-56678895-49d4-401f-b226-b22abd705de1 service nova] Creating event network-changed:399f7fb0-802d-4b26-8991-4d761e12a15b for instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 on n-h2-852084-5 Aug 27 02:54:48.036190 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-6f6c55c3-e107-49e4-b9bb-47a3dbb1b777 req-56678895-49d4-401f-b226-b22abd705de1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090484 Aug 27 02:54:48.042335 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2346/4498] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:54:48.435757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a73d1fad-bfac-43a3-8381-38e60c66a40b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:48.448038 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a73d1fad-bfac-43a3-8381-38e60c66a40b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 1.067410 Aug 27 02:54:48.461762 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2153/4499] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:47 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:49.495259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-acc095ca-87ee-4fa1-9ce2-8d69aa35b305 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:49.499347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-acc095ca-87ee-4fa1-9ce2-8d69aa35b305 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:49.552315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acc095ca-87ee-4fa1-9ce2-8d69aa35b305 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:49.560382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acc095ca-87ee-4fa1-9ce2-8d69aa35b305 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:49.567641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acc095ca-87ee-4fa1-9ce2-8d69aa35b305 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:49.575159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acc095ca-87ee-4fa1-9ce2-8d69aa35b305 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:49.576160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acc095ca-87ee-4fa1-9ce2-8d69aa35b305 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:49.576947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acc095ca-87ee-4fa1-9ce2-8d69aa35b305 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:51.215054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-acc095ca-87ee-4fa1-9ce2-8d69aa35b305 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:51.231703 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-acc095ca-87ee-4fa1-9ce2-8d69aa35b305 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 1.743187 Aug 27 02:54:51.232986 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2347/4500] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:49 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:52.269495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c34d511-40e7-4286-8d27-21207c332301 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:52.270480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4c34d511-40e7-4286-8d27-21207c332301 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:52.288862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c34d511-40e7-4286-8d27-21207c332301 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:52.289379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c34d511-40e7-4286-8d27-21207c332301 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:52.290404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c34d511-40e7-4286-8d27-21207c332301 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:52.291172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c34d511-40e7-4286-8d27-21207c332301 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:52.291655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c34d511-40e7-4286-8d27-21207c332301 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:52.292103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c34d511-40e7-4286-8d27-21207c332301 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:53.144845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4c34d511-40e7-4286-8d27-21207c332301 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:53.201071 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4c34d511-40e7-4286-8d27-21207c332301 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 0.935238 Aug 27 02:54:53.236256 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2154/4501] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:52 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:54.252496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-52e55ebb-3c50-4067-bd4d-38d3714121bf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:54.260060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-52e55ebb-3c50-4067-bd4d-38d3714121bf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:54.298903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e55ebb-3c50-4067-bd4d-38d3714121bf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:54.300275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e55ebb-3c50-4067-bd4d-38d3714121bf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:54.302750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e55ebb-3c50-4067-bd4d-38d3714121bf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:54.307448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e55ebb-3c50-4067-bd4d-38d3714121bf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:54.308588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e55ebb-3c50-4067-bd4d-38d3714121bf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:54.309630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e55ebb-3c50-4067-bd4d-38d3714121bf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:55.020379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-52e55ebb-3c50-4067-bd4d-38d3714121bf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:55.063772 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-52e55ebb-3c50-4067-bd4d-38d3714121bf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 0.825304 Aug 27 02:54:55.079061 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2348/4502] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:54 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:54:56.135300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a81a87e-9a1f-41c0-b23c-d58026681a89 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:56.136685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4a81a87e-9a1f-41c0-b23c-d58026681a89 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:56.158764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a81a87e-9a1f-41c0-b23c-d58026681a89 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:56.160195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a81a87e-9a1f-41c0-b23c-d58026681a89 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:56.161169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a81a87e-9a1f-41c0-b23c-d58026681a89 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:56.162898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a81a87e-9a1f-41c0-b23c-d58026681a89 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:56.164935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a81a87e-9a1f-41c0-b23c-d58026681a89 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:56.166191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a81a87e-9a1f-41c0-b23c-d58026681a89 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:56.249019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1419165045", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": "none"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:56.278307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:56.401873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:56.402585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:56.403291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:56.404067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:56.404667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:56.420389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:56.421313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:56.422091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:56.423092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:56.423789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:56.424386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:56.433375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:56.458272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Getting quotas for project b6240b9595db46dbbda3bf3d8e28f983. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:56.468760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Getting quotas for user 59540eaad39a4787958f532529b91c5e and project b6240b9595db46dbbda3bf3d8e28f983. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:56.488643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:54:56.491577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: 0c7c42f2-6b88-4d35-ab34-de4cfae6623c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:54:56.617002 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4bb0f7d2-529d-4a50-bc73-3e68f71076d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.749883 Aug 27 02:54:56.633472 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2155/4503] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:54:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:54:56.645384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb899ef2-4202-4a28-8153-2a9c419e19be tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:56.648134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb899ef2-4202-4a28-8153-2a9c419e19be tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: 0c7c42f2-6b88-4d35-ab34-de4cfae6623c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:56.781149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb899ef2-4202-4a28-8153-2a9c419e19be tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:56.818217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb899ef2-4202-4a28-8153-2a9c419e19be tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:56.831622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb899ef2-4202-4a28-8153-2a9c419e19be tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:56.831622 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb899ef2-4202-4a28-8153-2a9c419e19be tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c" status: 200 len: 1278 microversion: 2.47 time: 0.196001 Aug 27 02:54:56.846232 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2156/4504] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:56 2022] GET /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:54:57.063475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1062876588", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": "none"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:57.307971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:54:57.309139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:54:57.309862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:54:57.310452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:54:57.312840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:54:57.356587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:57.365141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:57.370936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:57.374422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:57.375256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:57.379924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:57.480801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Getting quotas for project b6240b9595db46dbbda3bf3d8e28f983. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:54:57.498630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Getting quotas for user 59540eaad39a4787958f532529b91c5e and project b6240b9595db46dbbda3bf3d8e28f983. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:54:57.542811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:54:57.546948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:54:57.728224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4a81a87e-9a1f-41c0-b23c-d58026681a89 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:57.739014 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a81a87e-9a1f-41c0-b23c-d58026681a89 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 1.634486 Aug 27 02:54:57.739619 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2349/4505] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:56 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:57.758732 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-55a65ba3-9489-4713-a82b-73aa3a7cfee4 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.706980 Aug 27 02:54:57.766164 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2157/4506] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:54:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 02:54:57.778453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-092efdb4-b548-489f-bf98-c5cfcc50c266 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:54:57.781654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-092efdb4-b548-489f-bf98-c5cfcc50c266 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:57.982152 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-092efdb4-b548-489f-bf98-c5cfcc50c266 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "PUT /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 992 microversion: 2.47 time: 0.205746 Aug 27 02:54:58.000001 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2350/4507] 10.222.0.99 () {62 vars in 1297 bytes} [Sat Aug 27 02:54:57 2022] PUT /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 992 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:54:58.009468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2678a1c8-41d7-4f67-ae1a-d52fa160b797 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:58.010695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2678a1c8-41d7-4f67-ae1a-d52fa160b797 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:58.460909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2678a1c8-41d7-4f67-ae1a-d52fa160b797 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:58.497184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2678a1c8-41d7-4f67-ae1a-d52fa160b797 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:58.524111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2678a1c8-41d7-4f67-ae1a-d52fa160b797 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:58.534956 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2678a1c8-41d7-4f67-ae1a-d52fa160b797 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1278 microversion: 2.47 time: 0.533544 Aug 27 02:54:58.539536 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2158/4508] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:57 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1278 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:54:58.763569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c042e46d-8369-46b1-a98c-61805dc86ab3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:58.765246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c042e46d-8369-46b1-a98c-61805dc86ab3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:58.775331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:54:58.811094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c042e46d-8369-46b1-a98c-61805dc86ab3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:58.811599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c042e46d-8369-46b1-a98c-61805dc86ab3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:58.812054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c042e46d-8369-46b1-a98c-61805dc86ab3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:58.812806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c042e46d-8369-46b1-a98c-61805dc86ab3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:58.813279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c042e46d-8369-46b1-a98c-61805dc86ab3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:58.823652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c042e46d-8369-46b1-a98c-61805dc86ab3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:59.528269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c042e46d-8369-46b1-a98c-61805dc86ab3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:54:59.554658 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c042e46d-8369-46b1-a98c-61805dc86ab3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 0.796832 Aug 27 02:54:59.555739 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2351/4509] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:54:58 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:54:59.567272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:54:59.568805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:54:59.592052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:59.597235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:59.599875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:59.607343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:54:59.614435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:54:59.621870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:54:59.986370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:00.021388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:00.028100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:00.032070 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6a54b190-a4b9-405f-82c5-66121fdd372c tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1274 microversion: 2.47 time: 0.470143 Aug 27 02:55:00.037781 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2159/4510] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:54:59 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1274 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:00.598796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e6b9af37-c3c4-4c09-8c1f-edfffdb1f64f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:00.602121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e6b9af37-c3c4-4c09-8c1f-edfffdb1f64f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:00.613307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b9af37-c3c4-4c09-8c1f-edfffdb1f64f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:00.614499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b9af37-c3c4-4c09-8c1f-edfffdb1f64f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:00.615457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b9af37-c3c4-4c09-8c1f-edfffdb1f64f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:00.617233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b9af37-c3c4-4c09-8c1f-edfffdb1f64f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:00.618716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b9af37-c3c4-4c09-8c1f-edfffdb1f64f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:00.619650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6b9af37-c3c4-4c09-8c1f-edfffdb1f64f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:01.093232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:01.094909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:01.108856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:01.111993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:01.116148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:01.117360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:01.118148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:01.118828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:01.285260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:01.316313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:01.331445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:01.333036 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dda9bfba-d041-484e-8240-ca17d08e0c34 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1338 microversion: 2.47 time: 0.245258 Aug 27 02:55:01.342872 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2160/4511] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:01 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1338 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:01.461636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e6b9af37-c3c4-4c09-8c1f-edfffdb1f64f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:01.490415 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e6b9af37-c3c4-4c09-8c1f-edfffdb1f64f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 0.911597 Aug 27 02:55:01.491525 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2352/4512] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:00 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:02.361388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:02.362715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:02.384653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:02.385168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:02.385608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:02.386407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:02.386875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:02.387322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:02.519627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1f54e371-169f-4443-a8ac-2580e0ccec9b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:02.520810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1f54e371-169f-4443-a8ac-2580e0ccec9b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:02.546529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f54e371-169f-4443-a8ac-2580e0ccec9b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:02.547019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f54e371-169f-4443-a8ac-2580e0ccec9b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:02.547827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f54e371-169f-4443-a8ac-2580e0ccec9b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:02.558475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f54e371-169f-4443-a8ac-2580e0ccec9b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:02.559488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f54e371-169f-4443-a8ac-2580e0ccec9b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:02.560293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f54e371-169f-4443-a8ac-2580e0ccec9b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:02.585495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:02.601529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:02.604468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:02.607595 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-69c1652a-52a0-4614-a8d4-91b7485544cc tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1336 microversion: 2.47 time: 0.250275 Aug 27 02:55:02.608851 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2161/4513] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:02 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1336 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:03.648506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:03.649812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:03.663235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:03.663662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:03.665782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:03.668880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:03.669379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:03.669860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:03.848569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:03.887779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:03.889965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:03.904487 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c1d3b500-4511-4067-8c5b-779cd7c9a8ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1336 microversion: 2.47 time: 0.272262 Aug 27 02:55:03.906483 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2162/4514] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:03 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1336 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:04.154830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f54e371-169f-4443-a8ac-2580e0ccec9b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:04.215692 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1f54e371-169f-4443-a8ac-2580e0ccec9b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 1.702864 Aug 27 02:55:04.241511 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2353/4515] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:02 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:04.933229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:04.935278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:04.946076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:04.947005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:04.947644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:04.949102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:04.949839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:04.951132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:05.078591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:05.134826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:05.139503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:05.142243 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-791dbd97-3b26-42d8-a9d9-5214c7263747 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1336 microversion: 2.47 time: 0.215285 Aug 27 02:55:05.143973 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2163/4516] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:04 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1336 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:05.278481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff6c01da-983d-4be7-9ff0-6b2b4ccd5b52 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:05.280695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ff6c01da-983d-4be7-9ff0-6b2b4ccd5b52 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:05.331974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff6c01da-983d-4be7-9ff0-6b2b4ccd5b52 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:05.332721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff6c01da-983d-4be7-9ff0-6b2b4ccd5b52 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:05.333465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff6c01da-983d-4be7-9ff0-6b2b4ccd5b52 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:05.334819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff6c01da-983d-4be7-9ff0-6b2b4ccd5b52 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:05.335687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff6c01da-983d-4be7-9ff0-6b2b4ccd5b52 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:05.336937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff6c01da-983d-4be7-9ff0-6b2b4ccd5b52 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.035142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ff6c01da-983d-4be7-9ff0-6b2b4ccd5b52 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:06.049618 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff6c01da-983d-4be7-9ff0-6b2b4ccd5b52 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 0.787863 Aug 27 02:55:06.050957 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2354/4517] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:05 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:06.176169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:06.182972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:06.208601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.212396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.213265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.214226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.214702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.215217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.417569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:06.433095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:06.442538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:06.449333 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1582baed-43f4-42bc-8120-835f1755a226 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1357 microversion: 2.47 time: 0.282345 Aug 27 02:55:06.452113 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2164/4518] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:06 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1357 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:06.488365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:06.503065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:06.533613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.535408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.538502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.540190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.541416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.542856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.786275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:55:06.786899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:55:06.787789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:55:06.788472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:55:06.792856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:55:06.910067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:06.933477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.934104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.934629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.935439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:06.936856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:06.936856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:06.995885 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2f90b24b-b7dc-451f-a80b-462aae65f718 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "POST /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee/action" status: 202 len: 1079 microversion: 2.47 time: 0.522139 Aug 27 02:55:07.020195 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2355/4519] 10.222.0.99 () {62 vars in 1319 bytes} [Sat Aug 27 02:55:06 2022] POST /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee/action => generated 1079 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 27 02:55:07.037183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:07.049531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:07.075242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fcf85502-ddb8-4650-9d7e-7155d4d573c2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:07.076282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fcf85502-ddb8-4650-9d7e-7155d4d573c2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:07.084293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fcf85502-ddb8-4650-9d7e-7155d4d573c2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:07.089101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fcf85502-ddb8-4650-9d7e-7155d4d573c2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:07.094682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fcf85502-ddb8-4650-9d7e-7155d4d573c2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:07.095901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fcf85502-ddb8-4650-9d7e-7155d4d573c2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:07.098154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fcf85502-ddb8-4650-9d7e-7155d4d573c2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:07.099621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fcf85502-ddb8-4650-9d7e-7155d4d573c2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:07.102943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:07.105272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:07.109398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:07.112953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:07.113839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:07.114629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:07.402910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:07.651961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fcf85502-ddb8-4650-9d7e-7155d4d573c2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:07.694902 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fcf85502-ddb8-4650-9d7e-7155d4d573c2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 0.624025 Aug 27 02:55:07.702598 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2356/4520] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:07 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:08.148318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:08.157777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:08.168532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:08.169919 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f2fc5ee2-f265-4856-a644-55021c1deca7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 1.148359 Aug 27 02:55:08.175598 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2165/4521] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:07 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:08.725804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb63aad4-82c1-4ef8-b9a7-a58ca871a2f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:08.726362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb63aad4-82c1-4ef8-b9a7-a58ca871a2f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:08.772522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb63aad4-82c1-4ef8-b9a7-a58ca871a2f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:08.773366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb63aad4-82c1-4ef8-b9a7-a58ca871a2f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:08.774708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb63aad4-82c1-4ef8-b9a7-a58ca871a2f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:08.776021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb63aad4-82c1-4ef8-b9a7-a58ca871a2f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:08.776832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb63aad4-82c1-4ef8-b9a7-a58ca871a2f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:08.777590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb63aad4-82c1-4ef8-b9a7-a58ca871a2f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:09.198198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:09.199299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:09.220823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=16 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:09.222510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cb63aad4-82c1-4ef8-b9a7-a58ca871a2f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:09.231829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:09.233535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:09.234667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:09.236230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:09.236723 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb63aad4-82c1-4ef8-b9a7-a58ca871a2f7 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 0.515276 Aug 27 02:55:09.237657 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2357/4522] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:08 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:09.245136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:09.247119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:09.540479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:09.586973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:09.590646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:09.596527 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a71d0cb1-23f6-4c53-9a73-1062cc8067ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.406509 Aug 27 02:55:09.604554 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2166/4523] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:09 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:10.265254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d2b60e48-b75e-43dc-bf28-c56f9a009d05 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:10.268095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d2b60e48-b75e-43dc-bf28-c56f9a009d05 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:10.317394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b60e48-b75e-43dc-bf28-c56f9a009d05 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:10.318442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b60e48-b75e-43dc-bf28-c56f9a009d05 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:10.319598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b60e48-b75e-43dc-bf28-c56f9a009d05 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:10.321796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b60e48-b75e-43dc-bf28-c56f9a009d05 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:10.323076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b60e48-b75e-43dc-bf28-c56f9a009d05 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:10.324537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2b60e48-b75e-43dc-bf28-c56f9a009d05 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:10.627954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:10.628773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:10.645572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:10.650445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:10.651205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:10.652113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:10.652711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:10.653263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:10.780099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d2b60e48-b75e-43dc-bf28-c56f9a009d05 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:10.784074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:10.806852 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d2b60e48-b75e-43dc-bf28-c56f9a009d05 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1505 microversion: 2.1 time: 0.549242 Aug 27 02:55:10.808777 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2358/4524] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:10 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1505 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:10.868387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:10.877778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:10.879494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:10.880821 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-06260c5b-7b3a-49e5-8455-1e8e28273453 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.259052 Aug 27 02:55:10.881481 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2167/4525] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:10 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:11.866183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7329d12-f34d-486f-a5b5-568469a45149 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:11.869165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d7329d12-f34d-486f-a5b5-568469a45149 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:11.906728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7329d12-f34d-486f-a5b5-568469a45149 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:11.910936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7329d12-f34d-486f-a5b5-568469a45149 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:11.912829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7329d12-f34d-486f-a5b5-568469a45149 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:11.916549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:11.917351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:11.917642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7329d12-f34d-486f-a5b5-568469a45149 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:11.924876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7329d12-f34d-486f-a5b5-568469a45149 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:11.925347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7329d12-f34d-486f-a5b5-568469a45149 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:11.953413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:11.954805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:11.962865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:11.964013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:11.964788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:11.965520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:12.412642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:12.471196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:12.478577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:12.483303 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e3338dfb-95c5-40c4-a480-590c780162c2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.571439 Aug 27 02:55:12.497718 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2168/4526] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:11 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:12.783709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d7329d12-f34d-486f-a5b5-568469a45149 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:12.800824 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d7329d12-f34d-486f-a5b5-568469a45149 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1526 microversion: 2.1 time: 0.940602 Aug 27 02:55:12.816232 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2359/4527] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:11 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1526 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:13.532840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:13.533633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:13.560865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.563983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.564596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.567019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.567875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.569784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.802853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:13.825283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:13.833572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:13.838430 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d129934b-4e00-4304-8cec-718c910f48d8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.310840 Aug 27 02:55:13.851970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-89355149-4faa-46b0-bbd7-69b398d653db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:13.858042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-89355149-4faa-46b0-bbd7-69b398d653db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:13.885025 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2169/4528] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:13 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:13.950312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89355149-4faa-46b0-bbd7-69b398d653db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.951571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89355149-4faa-46b0-bbd7-69b398d653db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.952730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89355149-4faa-46b0-bbd7-69b398d653db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:13.972710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89355149-4faa-46b0-bbd7-69b398d653db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:13.973894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89355149-4faa-46b0-bbd7-69b398d653db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:13.974639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89355149-4faa-46b0-bbd7-69b398d653db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:14.633753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-89355149-4faa-46b0-bbd7-69b398d653db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:14.668764 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-89355149-4faa-46b0-bbd7-69b398d653db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.840074 Aug 27 02:55:14.672273 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2360/4529] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:13 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:14.907463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:14.908944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:14.933614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:14.959933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:14.961436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:14.968169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:14.975840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:14.995915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:15.590226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:15.630618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:15.672034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:15.696806 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-18ecacf1-9e30-4fa3-a6e1-150ce1322ef9 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.807959 Aug 27 02:55:15.698535 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2170/4530] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:14 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:15.718268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-23fae12e-d79f-4066-89d0-e0cc311f0e6a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:15.718884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-23fae12e-d79f-4066-89d0-e0cc311f0e6a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:15.753846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23fae12e-d79f-4066-89d0-e0cc311f0e6a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:15.754362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23fae12e-d79f-4066-89d0-e0cc311f0e6a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:15.754804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23fae12e-d79f-4066-89d0-e0cc311f0e6a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:15.755542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23fae12e-d79f-4066-89d0-e0cc311f0e6a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:15.761548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23fae12e-d79f-4066-89d0-e0cc311f0e6a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:15.764205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23fae12e-d79f-4066-89d0-e0cc311f0e6a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:16.353876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-23fae12e-d79f-4066-89d0-e0cc311f0e6a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:16.414491 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-23fae12e-d79f-4066-89d0-e0cc311f0e6a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.698523 Aug 27 02:55:16.416203 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2361/4531] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:15 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:16.760617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:16.761267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:16.795918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:16.798898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:16.800833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:16.808275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:16.808945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:16.809554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.452391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c53c5bc-6897-450d-aad9-1c95b7066ef9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:17.453174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3c53c5bc-6897-450d-aad9-1c95b7066ef9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:17.464994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c53c5bc-6897-450d-aad9-1c95b7066ef9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.465498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c53c5bc-6897-450d-aad9-1c95b7066ef9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.466229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c53c5bc-6897-450d-aad9-1c95b7066ef9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.471377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c53c5bc-6897-450d-aad9-1c95b7066ef9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:17.472329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c53c5bc-6897-450d-aad9-1c95b7066ef9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:17.472677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:17.472802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c53c5bc-6897-450d-aad9-1c95b7066ef9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:17.492522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:17.505376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:17.512671 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ca56c2e7-0db5-4342-a8c7-19ad0e2c8622 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.757250 Aug 27 02:55:17.524346 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2171/4532] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:16 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:18.958750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2034ad76-14e1-406d-b5d9-f94c933651d2 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:18.959413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2034ad76-14e1-406d-b5d9-f94c933651d2 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:18.982757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2034ad76-14e1-406d-b5d9-f94c933651d2 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:18.986881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2034ad76-14e1-406d-b5d9-f94c933651d2 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:18.987363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2034ad76-14e1-406d-b5d9-f94c933651d2 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:18.992337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2034ad76-14e1-406d-b5d9-f94c933651d2 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:18.998556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2034ad76-14e1-406d-b5d9-f94c933651d2 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.000288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2034ad76-14e1-406d-b5d9-f94c933651d2 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.046485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3c53c5bc-6897-450d-aad9-1c95b7066ef9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.069497 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3c53c5bc-6897-450d-aad9-1c95b7066ef9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 1.621487 Aug 27 02:55:19.075530 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2362/4533] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:17 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:19.083014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ba1ab178-d07c-4a2b-b8c4-4878853a443a req-5d08cd5c-8cd9-46a2-a58a-13572ad99248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda401e7-53e0-4698-b32b-031c49b5cf5f", "name": "network-vif-plugged", "status": "completed", "tag": "28051cef-d3f3-425c-b06a-97f68b4e2be2"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:19.119527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ba1ab178-d07c-4a2b-b8c4-4878853a443a req-5d08cd5c-8cd9-46a2-a58a-13572ad99248 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:19.121846 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2034ad76-14e1-406d-b5d9-f94c933651d2 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/ips" status: 200 len: 146 microversion: 2.1 time: 1.106267 Aug 27 02:55:19.122127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ba1ab178-d07c-4a2b-b8c4-4878853a443a req-5d08cd5c-8cd9-46a2-a58a-13572ad99248 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.126715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ba1ab178-d07c-4a2b-b8c4-4878853a443a req-5d08cd5c-8cd9-46a2-a58a-13572ad99248 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.140233 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2172/4534] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 02:55:18 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/ips => generated 146 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:55:19.151422 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ba1ab178-d07c-4a2b-b8c4-4878853a443a req-5d08cd5c-8cd9-46a2-a58a-13572ad99248 service nova] Creating event network-vif-plugged:28051cef-d3f3-425c-b06a-97f68b4e2be2 for instance bda401e7-53e0-4698-b32b-031c49b5cf5f on n-h1-852084-5 Aug 27 02:55:19.154551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:19.162759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:19.177095 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ba1ab178-d07c-4a2b-b8c4-4878853a443a req-5d08cd5c-8cd9-46a2-a58a-13572ad99248 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097143 Aug 27 02:55:19.188016 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2363/4535] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:19.193797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:19.204352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.205079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.209826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:19.212304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:19.216742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:19.430945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.455953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.465250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:19.467522 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-68571ee0-0086-4fdc-9236-740d45907006 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.326198 Aug 27 02:55:19.468964 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2173/4536] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:19 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:20.101153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-948d891e-dede-47df-91e9-97445b0a796f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:20.102440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-948d891e-dede-47df-91e9-97445b0a796f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:20.186509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-948d891e-dede-47df-91e9-97445b0a796f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.192519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-948d891e-dede-47df-91e9-97445b0a796f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.196915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-948d891e-dede-47df-91e9-97445b0a796f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.201595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-948d891e-dede-47df-91e9-97445b0a796f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.217385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-948d891e-dede-47df-91e9-97445b0a796f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.217920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-948d891e-dede-47df-91e9-97445b0a796f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.494234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:20.494925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:20.517108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.517625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.522447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:20.526318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:20.526840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:20.528821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:21.110614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-948d891e-dede-47df-91e9-97445b0a796f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:21.121181 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-948d891e-dede-47df-91e9-97445b0a796f tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 1.027643 Aug 27 02:55:21.138608 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2364/4537] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:20 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:21.242639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:21.280496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:21.290540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:21.292112 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ab21b46a-d518-4738-9541-31342f701df2 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.802251 Aug 27 02:55:21.318167 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2174/4538] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:20 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:22.171888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3466175a-df81-4d20-b074-04284f34dfb3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:22.172506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3466175a-df81-4d20-b074-04284f34dfb3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:22.194430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3466175a-df81-4d20-b074-04284f34dfb3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.200549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3466175a-df81-4d20-b074-04284f34dfb3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.203908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3466175a-df81-4d20-b074-04284f34dfb3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.205879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3466175a-df81-4d20-b074-04284f34dfb3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.213927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3466175a-df81-4d20-b074-04284f34dfb3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.223011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3466175a-df81-4d20-b074-04284f34dfb3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.336276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:22.337469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:22.362060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.365185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.368462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.373740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:22.376324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:22.376907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:22.476670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:23.575900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.595870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.607318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.613535 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-64d63708-b1ca-444a-810d-98504f4692ff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 1.281623 Aug 27 02:55:23.620501 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2175/4539] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:22 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:23.678999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-579884ca-a9ee-4de5-abf0-2b1560765194 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d13d2e09-0c7e-4c78-91b5-e8993339ee05"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:23.691810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-579884ca-a9ee-4de5-abf0-2b1560765194 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:23.693289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3466175a-df81-4d20-b074-04284f34dfb3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:23.741570 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3466175a-df81-4d20-b074-04284f34dfb3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 1.580555 Aug 27 02:55:23.747480 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2365/4540] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:22 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:23.766702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-579884ca-a9ee-4de5-abf0-2b1560765194 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.767215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-579884ca-a9ee-4de5-abf0-2b1560765194 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.767671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-579884ca-a9ee-4de5-abf0-2b1560765194 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:23.776939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-579884ca-a9ee-4de5-abf0-2b1560765194 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:23.777449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-579884ca-a9ee-4de5-abf0-2b1560765194 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:23.777940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-579884ca-a9ee-4de5-abf0-2b1560765194 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.661143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:24.664377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:24.722394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.724651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.730168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.741012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.748734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.753995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.803010 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-579884ca-a9ee-4de5-abf0-2b1560765194 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "POST /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.135813 Aug 27 02:55:24.805720 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2176/4541] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 02:55:23 2022] POST /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments => generated 194 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:24.888096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6c3518b4-1a56-4f13-83e8-7f8d0aea3ae8 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:24.889596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6c3518b4-1a56-4f13-83e8-7f8d0aea3ae8 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:24.958022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c3518b4-1a56-4f13-83e8-7f8d0aea3ae8 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.963984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c3518b4-1a56-4f13-83e8-7f8d0aea3ae8 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.974536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c3518b4-1a56-4f13-83e8-7f8d0aea3ae8 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:24.974536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c3518b4-1a56-4f13-83e8-7f8d0aea3ae8 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:24.974536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c3518b4-1a56-4f13-83e8-7f8d0aea3ae8 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:24.974869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c3518b4-1a56-4f13-83e8-7f8d0aea3ae8 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:25.286398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.313187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.325384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.329129 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-abc76405-841f-49f0-bfbb-c5ac275a7c49 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.687125 Aug 27 02:55:25.348314 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2366/4542] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:24 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:25.887269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6c3518b4-1a56-4f13-83e8-7f8d0aea3ae8 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:25.944192 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6c3518b4-1a56-4f13-83e8-7f8d0aea3ae8 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 1.106153 Aug 27 02:55:25.956110 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2177/4543] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:24 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:26.363030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:26.364082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:26.393877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:26.394392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:26.394842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:26.395662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:26.396028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:26.412583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:26.980470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-37b8bd3e-6d21-45bf-828d-595424993bad tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:26.982750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-37b8bd3e-6d21-45bf-828d-595424993bad tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:27.012195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:27.057051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37b8bd3e-6d21-45bf-828d-595424993bad tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:27.061747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37b8bd3e-6d21-45bf-828d-595424993bad tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:27.065781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37b8bd3e-6d21-45bf-828d-595424993bad tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:27.069474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37b8bd3e-6d21-45bf-828d-595424993bad tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:27.074675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37b8bd3e-6d21-45bf-828d-595424993bad tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:27.076857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37b8bd3e-6d21-45bf-828d-595424993bad tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:27.284628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:27.321390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:27.331726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:27.333056 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a816b5a3-d8da-45e3-8249-0c0c9d9d06d5 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.974250 Aug 27 02:55:27.359719 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2367/4544] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:26 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:28.115173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-37b8bd3e-6d21-45bf-828d-595424993bad tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:28.124789 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-37b8bd3e-6d21-45bf-828d-595424993bad tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 1.152377 Aug 27 02:55:28.134622 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2178/4545] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:26 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:28.358608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:28.359291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:28.381653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:28.382655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:28.400873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:28.401918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:28.410162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:28.411105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:29.111271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:29.138067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:29.139592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:29.140830 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8672b447-0cef-434e-ab6a-27f37b4349a1 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.786602 Aug 27 02:55:29.141526 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2368/4546] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:28 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:29.178364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b67b3d03-cb11-4d3d-b8b8-a285e74f3b87 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:29.179008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b67b3d03-cb11-4d3d-b8b8-a285e74f3b87 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:29.188344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b67b3d03-cb11-4d3d-b8b8-a285e74f3b87 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.193896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b67b3d03-cb11-4d3d-b8b8-a285e74f3b87 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.194423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b67b3d03-cb11-4d3d-b8b8-a285e74f3b87 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:29.195710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b67b3d03-cb11-4d3d-b8b8-a285e74f3b87 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:29.196192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b67b3d03-cb11-4d3d-b8b8-a285e74f3b87 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:29.196636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b67b3d03-cb11-4d3d-b8b8-a285e74f3b87 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.065778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c4c48f76-a272-442d-9991-e6f30de46c55 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:30.066541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c4c48f76-a272-442d-9991-e6f30de46c55 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:30.070653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=40 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:30.125291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4c48f76-a272-442d-9991-e6f30de46c55 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.125836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4c48f76-a272-442d-9991-e6f30de46c55 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.126311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4c48f76-a272-442d-9991-e6f30de46c55 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.127042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4c48f76-a272-442d-9991-e6f30de46c55 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.127516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4c48f76-a272-442d-9991-e6f30de46c55 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.127957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c4c48f76-a272-442d-9991-e6f30de46c55 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.249640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-c4c48f76-a272-442d-9991-e6f30de46c55 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lazy-loading 'services' on Instance uuid 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:30.427086 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c4c48f76-a272-442d-9991-e6f30de46c55 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a/os-volume_attachments/499373f4-e51d-4230-b299-98aff333dc0f" status: 202 len: 0 microversion: 2.1 time: 0.369477 Aug 27 02:55:30.428417 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2369/4547] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 02:55:30 2022] DELETE /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a/os-volume_attachments/499373f4-e51d-4230-b299-98aff333dc0f => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:55:30.446880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:30.449099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:30.474356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.481516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.482465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.484811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:30.486491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:30.489223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:30.512184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b67b3d03-cb11-4d3d-b8b8-a285e74f3b87 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.526332 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b67b3d03-cb11-4d3d-b8b8-a285e74f3b87 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 1.351764 Aug 27 02:55:30.544226 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2179/4548] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:29 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:30.712212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.736269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.746273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:30.750657 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3c643a9b-46b9-4e46-8b51-2d7cc31dfcb7 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.317313 Aug 27 02:55:30.751687 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2370/4549] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:30 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:31.551859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-81022a76-b7fb-41c9-9118-1b3bc153d2aa tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:31.552514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-81022a76-b7fb-41c9-9118-1b3bc153d2aa tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:31.579343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81022a76-b7fb-41c9-9118-1b3bc153d2aa tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.582424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81022a76-b7fb-41c9-9118-1b3bc153d2aa tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.584414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81022a76-b7fb-41c9-9118-1b3bc153d2aa tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:31.589755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81022a76-b7fb-41c9-9118-1b3bc153d2aa tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.593049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81022a76-b7fb-41c9-9118-1b3bc153d2aa tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.595155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-81022a76-b7fb-41c9-9118-1b3bc153d2aa tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:31.776387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:31.777577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:31.795682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.796191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.796849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:31.802889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:31.803673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:31.806330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:32.155040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:32.180475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:32.184438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:32.189284 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-02ee6b41-7cdd-4338-b6c2-4514c80e5b1e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.415984 Aug 27 02:55:32.191113 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2371/4550] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:31 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:32.300763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-81022a76-b7fb-41c9-9118-1b3bc153d2aa tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:32.319415 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-81022a76-b7fb-41c9-9118-1b3bc153d2aa tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.773026 Aug 27 02:55:32.343402 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2180/4551] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:31 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:33.227098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:33.229911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:33.248975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.254101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.255037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.263547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.264456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.266255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.356937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ccf2bc15-9952-4302-a5a8-53f2ef47b04c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:33.358343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ccf2bc15-9952-4302-a5a8-53f2ef47b04c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:33.395638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccf2bc15-9952-4302-a5a8-53f2ef47b04c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.401458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccf2bc15-9952-4302-a5a8-53f2ef47b04c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.406717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccf2bc15-9952-4302-a5a8-53f2ef47b04c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.410269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccf2bc15-9952-4302-a5a8-53f2ef47b04c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:33.412540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccf2bc15-9952-4302-a5a8-53f2ef47b04c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:33.415916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccf2bc15-9952-4302-a5a8-53f2ef47b04c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:33.544011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.564381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.569126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:33.570886 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a2f42855-92a1-43e1-b6f9-a5fd0f3a081e tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.349316 Aug 27 02:55:33.574705 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2372/4552] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:33 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:34.076566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ccf2bc15-9952-4302-a5a8-53f2ef47b04c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:34.108293 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ccf2bc15-9952-4302-a5a8-53f2ef47b04c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.749950 Aug 27 02:55:34.126642 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2181/4553] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:33 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:34.606726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:34.611274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:34.643762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:34.648664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:34.649499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:34.650956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:34.656294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:34.660033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:35.134997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3526ba85-77ab-477b-895a-a8a7ae12118d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:35.136255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3526ba85-77ab-477b-895a-a8a7ae12118d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:35.161193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3526ba85-77ab-477b-895a-a8a7ae12118d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:35.164349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3526ba85-77ab-477b-895a-a8a7ae12118d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:35.166696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3526ba85-77ab-477b-895a-a8a7ae12118d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:35.167720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3526ba85-77ab-477b-895a-a8a7ae12118d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:35.170185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3526ba85-77ab-477b-895a-a8a7ae12118d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:35.172101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3526ba85-77ab-477b-895a-a8a7ae12118d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:35.220892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:35.235315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:35.238585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:35.251114 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-09033c0c-6101-40f8-bb5d-8a676430758a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.652492 Aug 27 02:55:35.254537 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2373/4554] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:34 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:35.687466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3526ba85-77ab-477b-895a-a8a7ae12118d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:35.716140 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3526ba85-77ab-477b-895a-a8a7ae12118d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.588208 Aug 27 02:55:35.731142 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2182/4555] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:35 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:36.283420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:36.284764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:36.328699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.334480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.336195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.350740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.356146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.359011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.648708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:36.659361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:36.661241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:36.662719 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b8c6d027-d8ed-4a33-90b3-1d9e5e05b0a8 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.385897 Aug 27 02:55:36.674152 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2374/4556] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:36 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:36.739214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ad396f27-7249-46e5-b0f6-0f79c4ceb4c9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:36.740515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ad396f27-7249-46e5-b0f6-0f79c4ceb4c9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:36.748225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad396f27-7249-46e5-b0f6-0f79c4ceb4c9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.749564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad396f27-7249-46e5-b0f6-0f79c4ceb4c9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.752205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad396f27-7249-46e5-b0f6-0f79c4ceb4c9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:36.756773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad396f27-7249-46e5-b0f6-0f79c4ceb4c9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:36.758060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad396f27-7249-46e5-b0f6-0f79c4ceb4c9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:36.758672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad396f27-7249-46e5-b0f6-0f79c4ceb4c9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.058823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ad396f27-7249-46e5-b0f6-0f79c4ceb4c9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:37.070526 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ad396f27-7249-46e5-b0f6-0f79c4ceb4c9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.335806 Aug 27 02:55:37.075516 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2183/4557] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:36 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:37.700468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:37.704301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:37.762784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.764833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.767042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.772143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:37.773809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:37.778055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:37.876039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:38.096031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb7d5e38-088d-40df-9dac-5c26ab08a8ca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:38.097380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb7d5e38-088d-40df-9dac-5c26ab08a8ca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:38.099905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:38.115509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb7d5e38-088d-40df-9dac-5c26ab08a8ca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.116331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb7d5e38-088d-40df-9dac-5c26ab08a8ca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.116983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb7d5e38-088d-40df-9dac-5c26ab08a8ca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.117935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb7d5e38-088d-40df-9dac-5c26ab08a8ca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:38.118581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb7d5e38-088d-40df-9dac-5c26ab08a8ca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:38.119224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb7d5e38-088d-40df-9dac-5c26ab08a8ca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:38.152321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:38.155484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:38.169309 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-39f6b5e5-18ec-4820-b112-b10a39226a5a tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1366 microversion: 2.47 time: 0.484721 Aug 27 02:55:38.203388 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2375/4558] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:37 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1366 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:38.722098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb7d5e38-088d-40df-9dac-5c26ab08a8ca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:38.740358 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb7d5e38-088d-40df-9dac-5c26ab08a8ca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.649767 Aug 27 02:55:38.747258 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2184/4559] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:38 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:39.219487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:39.231281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:39.253030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:39.256157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:39.258773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:39.270361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:39.271602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:39.274544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:39.471110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:39.496338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:39.500313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:39.503903 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-285f96a8-301b-4642-bebc-8a8108c689ec tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1384 microversion: 2.47 time: 0.289759 Aug 27 02:55:39.507931 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2376/4560] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:39 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1384 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:39.788669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a4eb010-f70d-4fe8-bb11-42e5a274b153 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:39.791858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a4eb010-f70d-4fe8-bb11-42e5a274b153 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:39.806463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4eb010-f70d-4fe8-bb11-42e5a274b153 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:39.808378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4eb010-f70d-4fe8-bb11-42e5a274b153 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:39.811029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4eb010-f70d-4fe8-bb11-42e5a274b153 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:39.812746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4eb010-f70d-4fe8-bb11-42e5a274b153 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:39.814491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4eb010-f70d-4fe8-bb11-42e5a274b153 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:39.816050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4eb010-f70d-4fe8-bb11-42e5a274b153 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:40.258290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a4eb010-f70d-4fe8-bb11-42e5a274b153 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.266615 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a4eb010-f70d-4fe8-bb11-42e5a274b153 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.488186 Aug 27 02:55:40.267196 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2185/4561] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:39 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:40.529189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:40.530527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:40.549044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:40.553835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:40.564140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:40.566165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:40.572698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:40.572815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:40.782256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.797936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.803081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:40.811269 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6778638b-cf88-4951-8619-f3c6c434db88 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1372 microversion: 2.47 time: 0.285674 Aug 27 02:55:40.813076 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2377/4562] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:40 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1372 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:41.304532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-463c45a4-23f8-4362-8ee4-b92b9a83762e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:41.306326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-463c45a4-23f8-4362-8ee4-b92b9a83762e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:41.313644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463c45a4-23f8-4362-8ee4-b92b9a83762e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:41.323654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463c45a4-23f8-4362-8ee4-b92b9a83762e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:41.324288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463c45a4-23f8-4362-8ee4-b92b9a83762e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:41.325200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463c45a4-23f8-4362-8ee4-b92b9a83762e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:41.325701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463c45a4-23f8-4362-8ee4-b92b9a83762e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:41.326139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463c45a4-23f8-4362-8ee4-b92b9a83762e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:41.739967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-463c45a4-23f8-4362-8ee4-b92b9a83762e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:41.788580 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-463c45a4-23f8-4362-8ee4-b92b9a83762e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.486060 Aug 27 02:55:41.792230 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2186/4563] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:41 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:41.840598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:41.841479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:41.861250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:41.863444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:41.865736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:41.868173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:41.869576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:41.870377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.132176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.145347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.146902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.148722 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-86430828-97a2-40e7-98db-5e99361acf42 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1357 microversion: 2.47 time: 0.312213 Aug 27 02:55:42.149315 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2378/4564] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:41 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1357 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:42.174354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:42.188798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.189689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Searching by: {'deleted': False, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:55:42.227975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.228470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.228905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.229633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.230121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.230542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.486207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 02:55:42.679966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.706257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.707123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.708250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.728821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.730929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:42.802324 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-220c4d34-9e5d-49ae-9769-55020270acff tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.632039 Aug 27 02:55:42.805081 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2187/4565] 10.222.0.99 () {60 vars in 1187 bytes} [Sat Aug 27 02:55:42 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:42.836879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-82f88c87-0950-4391-a960-df87174e6d03 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:42.838498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-302f5583-f6e9-4d12-83cb-88b222f4738d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:42.839010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-302f5583-f6e9-4d12-83cb-88b222f4738d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:42.839540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-82f88c87-0950-4391-a960-df87174e6d03 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:42.848169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82f88c87-0950-4391-a960-df87174e6d03 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.849572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82f88c87-0950-4391-a960-df87174e6d03 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.850269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82f88c87-0950-4391-a960-df87174e6d03 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.851814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82f88c87-0950-4391-a960-df87174e6d03 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.852521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82f88c87-0950-4391-a960-df87174e6d03 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.852767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-302f5583-f6e9-4d12-83cb-88b222f4738d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.853271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-302f5583-f6e9-4d12-83cb-88b222f4738d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.853623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82f88c87-0950-4391-a960-df87174e6d03 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.853864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-302f5583-f6e9-4d12-83cb-88b222f4738d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.857597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-302f5583-f6e9-4d12-83cb-88b222f4738d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:42.858303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-302f5583-f6e9-4d12-83cb-88b222f4738d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:42.858911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-302f5583-f6e9-4d12-83cb-88b222f4738d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:42.894577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-302f5583-f6e9-4d12-83cb-88b222f4738d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:55:42.973458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:43.066495 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-302f5583-f6e9-4d12-83cb-88b222f4738d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 204 len: 0 microversion: 2.47 time: 0.225650 Aug 27 02:55:43.072564 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2188/4566] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:55:42 2022] DELETE /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:55:43.082039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:43.083182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:43.090423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:43.091595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:43.092202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:43.093179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:43.093910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:43.094507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:43.260003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:43.276157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:43.294257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:43.297879 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e36dc8b6-6be2-4e0b-b533-ccc92b492b4b tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1363 microversion: 2.47 time: 0.219907 Aug 27 02:55:43.298845 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2189/4567] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:43 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:43.433442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-82f88c87-0950-4391-a960-df87174e6d03 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:43.447384 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-82f88c87-0950-4391-a960-df87174e6d03 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.631134 Aug 27 02:55:43.447997 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2379/4568] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:42 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:44.326034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:44.326802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:44.335867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.336526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.337265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.339127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.340009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.340632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.425124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:44.435511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:44.438388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:44.439742 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4e1a6ba8-918e-4eb6-88c3-10f16737c6a0 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1363 microversion: 2.47 time: 0.118097 Aug 27 02:55:44.440753 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2190/4569] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:44 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1363 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:44.474070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5dca4a77-db8c-482b-9bd0-da0eb470d797 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:44.474753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5dca4a77-db8c-482b-9bd0-da0eb470d797 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:44.486789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dca4a77-db8c-482b-9bd0-da0eb470d797 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.487688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dca4a77-db8c-482b-9bd0-da0eb470d797 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.488351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dca4a77-db8c-482b-9bd0-da0eb470d797 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.489470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dca4a77-db8c-482b-9bd0-da0eb470d797 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.490323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dca4a77-db8c-482b-9bd0-da0eb470d797 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.491101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dca4a77-db8c-482b-9bd0-da0eb470d797 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:44.745389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5dca4a77-db8c-482b-9bd0-da0eb470d797 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:44.758089 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5dca4a77-db8c-482b-9bd0-da0eb470d797 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1521 microversion: 2.1 time: 0.288371 Aug 27 02:55:44.759329 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2380/4570] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:44 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:44.963410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c784d8d7-fb4e-417e-9ff0-eacede9affe6 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:44.969600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c784d8d7-fb4e-417e-9ff0-eacede9affe6 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:44.997174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c784d8d7-fb4e-417e-9ff0-eacede9affe6 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:44.998586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c784d8d7-fb4e-417e-9ff0-eacede9affe6 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:44.999617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c784d8d7-fb4e-417e-9ff0-eacede9affe6 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.001220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c784d8d7-fb4e-417e-9ff0-eacede9affe6 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.002372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c784d8d7-fb4e-417e-9ff0-eacede9affe6 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.005168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c784d8d7-fb4e-417e-9ff0-eacede9affe6 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.099589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c784d8d7-fb4e-417e-9ff0-eacede9affe6 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:55:45.381769 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c784d8d7-fb4e-417e-9ff0-eacede9affe6 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 204 len: 0 microversion: 2.1 time: 0.426815 Aug 27 02:55:45.382380 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2191/4571] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:44 2022] DELETE /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:55:45.392163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-39faa425-932c-4792-9a6e-3cd181599374 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:45.392957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-39faa425-932c-4792-9a6e-3cd181599374 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:45.406611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39faa425-932c-4792-9a6e-3cd181599374 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.407370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39faa425-932c-4792-9a6e-3cd181599374 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.407924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39faa425-932c-4792-9a6e-3cd181599374 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.413508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39faa425-932c-4792-9a6e-3cd181599374 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.414175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39faa425-932c-4792-9a6e-3cd181599374 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.414714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39faa425-932c-4792-9a6e-3cd181599374 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.471428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:45.472602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:45.494769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.495295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.495728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.496464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.497391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.502476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.625029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.638618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.640220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.641486 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba3f7ad1-90cf-4f9e-a951-aeace31c894f tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1363 microversion: 2.47 time: 0.182139 Aug 27 02:55:45.656201 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2192/4572] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:45 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:45.793074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65b9e436-1640-4d9e-a20e-1c07f51f7077 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:45.793919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65b9e436-1640-4d9e-a20e-1c07f51f7077 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:45.809015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65b9e436-1640-4d9e-a20e-1c07f51f7077 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.811355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65b9e436-1640-4d9e-a20e-1c07f51f7077 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.812402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65b9e436-1640-4d9e-a20e-1c07f51f7077 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.836985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65b9e436-1640-4d9e-a20e-1c07f51f7077 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:45.842557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65b9e436-1640-4d9e-a20e-1c07f51f7077 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:45.844807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65b9e436-1640-4d9e-a20e-1c07f51f7077 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:45.863162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-39faa425-932c-4792-9a6e-3cd181599374 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:45.880564 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-39faa425-932c-4792-9a6e-3cd181599374 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1468 microversion: 2.1 time: 0.492244 Aug 27 02:55:45.894123 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2381/4573] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:45 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1468 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:46.500707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-65b9e436-1640-4d9e-a20e-1c07f51f7077 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:46.511954 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65b9e436-1640-4d9e-a20e-1c07f51f7077 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1503 microversion: 2.1 time: 0.724154 Aug 27 02:55:46.513066 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2193/4574] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:45 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1503 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:46.668550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:46.669438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:46.703438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.706855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.709169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:46.717187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.723525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.725046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:46.911661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cc7dfd7e-3dc5-45b8-97e6-9c4c13654fa2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:46.912611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cc7dfd7e-3dc5-45b8-97e6-9c4c13654fa2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:46.923019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7dfd7e-3dc5-45b8-97e6-9c4c13654fa2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.923809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7dfd7e-3dc5-45b8-97e6-9c4c13654fa2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.923963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7dfd7e-3dc5-45b8-97e6-9c4c13654fa2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:46.929212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7dfd7e-3dc5-45b8-97e6-9c4c13654fa2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:46.930045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7dfd7e-3dc5-45b8-97e6-9c4c13654fa2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:46.930511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc7dfd7e-3dc5-45b8-97e6-9c4c13654fa2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:47.094052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:47.110170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:47.111968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:47.113208 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-87bb0f7d-3920-4c6b-b4b6-081dd4e91d1d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 200 len: 1363 microversion: 2.47 time: 0.448849 Aug 27 02:55:47.113813 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2382/4575] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:46 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 1363 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:47.251797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cc7dfd7e-3dc5-45b8-97e6-9c4c13654fa2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:47.263001 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cc7dfd7e-3dc5-45b8-97e6-9c4c13654fa2 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1468 microversion: 2.1 time: 0.356103 Aug 27 02:55:47.264451 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2194/4576] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:46 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1468 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:47.535462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-51f7ad49-02c6-4a16-a12d-4e02a98128b3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:47.536100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-51f7ad49-02c6-4a16-a12d-4e02a98128b3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:47.559195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f7ad49-02c6-4a16-a12d-4e02a98128b3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:47.563373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f7ad49-02c6-4a16-a12d-4e02a98128b3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:47.565247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f7ad49-02c6-4a16-a12d-4e02a98128b3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:47.569652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f7ad49-02c6-4a16-a12d-4e02a98128b3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:47.570463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f7ad49-02c6-4a16-a12d-4e02a98128b3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:47.570920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51f7ad49-02c6-4a16-a12d-4e02a98128b3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.141026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:48.143675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: b1943e18-d3a1-47cd-a691-f379ca1383ee] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:48.161359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-51f7ad49-02c6-4a16-a12d-4e02a98128b3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.175968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.178530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.186881 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-51f7ad49-02c6-4a16-a12d-4e02a98128b3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1503 microversion: 2.1 time: 0.654456 Aug 27 02:55:48.194965 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2383/4577] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:47 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1503 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:48.197530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.202417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.204247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.205648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.248360 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] HTTP exception thrown: Instance b1943e18-d3a1-47cd-a691-f379ca1383ee could not be found. Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Request method failure captured: Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee HTTP/1.1 Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYd_bWMA3indwUyXR7s9BI5nTRKie1xPAVcFuctDyf5mCbhQaC6m3R8XZAZStyzmoaK47oHNbGj2jLgSPmrjByl4CdG_O-2iGiU7eMTSpR9BUmefukXGcyo6qBwP04YMPHe6j9HZujSIRgf1hIzoy7FQ6SIuu0JUvxQGreRA8hfKMOI Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: b6240b9595db46dbbda3bf3d8e28f983 Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerShowV247Test-1418242143 Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b6240b9595db46dbbda3bf3d8e28f983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b6240b9595db46dbbda3bf3d8e28f983"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b6240b9595db46dbbda3bf3d8e28f983"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b6240b9595db46dbbda3bf3d8e28f983"}]}] Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerShowV247Test-1418242143 Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: b6240b9595db46dbbda3bf3d8e28f983 Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerShowV247Test-1418242143 Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerShowV247Test-1418242143-project Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 59540eaad39a4787958f532529b91c5e Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerShowV247Test-1418242143-project Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance b1943e18-d3a1-47cd-a691-f379ca1383ee could not be found. Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'b1943e18-d3a1-47cd-a691-f379ca1383ee'} Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1943e18-d3a1-47cd-a691-f379ca1383ee could not be found. Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1943e18-d3a1-47cd-a691-f379ca1383ee could not be found. Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:48.250179 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:48.254512 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:48.254512 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:48.254512 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:48.254512 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:48.254512 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:48.254512 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1943e18-d3a1-47cd-a691-f379ca1383ee could not be found. Aug 27 02:55:48.254512 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:48.254512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Returning 404 to user: Instance b1943e18-d3a1-47cd-a691-f379ca1383ee could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:48.254512 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-203e634f-ad0d-4fdd-b96b-9504ba8cef89 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee" status: 404 len: 111 microversion: 2.47 time: 0.117676 Aug 27 02:55:48.259562 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2195/4578] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:48 2022] GET /compute/v2.1/servers/b1943e18-d3a1-47cd-a691-f379ca1383ee => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:55:48.264485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1bf1c16d-df6e-4ee8-b58b-370ab53a3706 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:48.265207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1bf1c16d-df6e-4ee8-b58b-370ab53a3706 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: 0c7c42f2-6b88-4d35-ab34-de4cfae6623c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:48.295476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf1c16d-df6e-4ee8-b58b-370ab53a3706 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.296017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf1c16d-df6e-4ee8-b58b-370ab53a3706 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.296578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf1c16d-df6e-4ee8-b58b-370ab53a3706 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.302847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf1c16d-df6e-4ee8-b58b-370ab53a3706 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.303348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf1c16d-df6e-4ee8-b58b-370ab53a3706 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.303956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf1c16d-df6e-4ee8-b58b-370ab53a3706 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.314733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d6da3597-5385-4696-a17a-05f11ddb33de tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:48.315540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d6da3597-5385-4696-a17a-05f11ddb33de tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:48.329085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6da3597-5385-4696-a17a-05f11ddb33de tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.336163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6da3597-5385-4696-a17a-05f11ddb33de tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.336715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6da3597-5385-4696-a17a-05f11ddb33de tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.343443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6da3597-5385-4696-a17a-05f11ddb33de tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.344748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6da3597-5385-4696-a17a-05f11ddb33de tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.346407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6da3597-5385-4696-a17a-05f11ddb33de tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.456179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1bf1c16d-df6e-4ee8-b58b-370ab53a3706 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: 0c7c42f2-6b88-4d35-ab34-de4cfae6623c] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:55:48.589126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6da3597-5385-4696-a17a-05f11ddb33de tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.603120 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d6da3597-5385-4696-a17a-05f11ddb33de tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1426 microversion: 2.1 time: 0.293633 Aug 27 02:55:48.616285 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2196/4579] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:48 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1426 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:48.640595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-b7c2e338-4031-4172-8700-99764561fbf7 req-9036b871-a8fd-4399-b340-74b633b11863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a", "name": "network-vif-deleted", "tag": "35c22ead-5aad-415f-a079-665b8e261a4b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:48.661086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b7c2e338-4031-4172-8700-99764561fbf7 req-9036b871-a8fd-4399-b340-74b633b11863 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.661600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b7c2e338-4031-4172-8700-99764561fbf7 req-9036b871-a8fd-4399-b340-74b633b11863 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.662070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b7c2e338-4031-4172-8700-99764561fbf7 req-9036b871-a8fd-4399-b340-74b633b11863 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.669270 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1bf1c16d-df6e-4ee8-b58b-370ab53a3706 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "DELETE /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c" status: 204 len: 0 microversion: 2.47 time: 0.411333 Aug 27 02:55:48.671571 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2384/4580] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:55:48 2022] DELETE /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:55:48.687453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:48.689246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: 0c7c42f2-6b88-4d35-ab34-de4cfae6623c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:48.702334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.703772 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-b7c2e338-4031-4172-8700-99764561fbf7 req-9036b871-a8fd-4399-b340-74b633b11863 service nova] Creating event network-vif-deleted:35c22ead-5aad-415f-a079-665b8e261a4b for instance 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a on n-h2-852084-5 Aug 27 02:55:48.704585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.705612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.706833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:48.710671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:48.711735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:48.724376 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-b7c2e338-4031-4172-8700-99764561fbf7 req-9036b871-a8fd-4399-b340-74b633b11863 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081949 Aug 27 02:55:48.726064 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2197/4581] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:55:48.909916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.927283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.929159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:48.939195 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13da504b-0dab-4cb4-b546-3dde9ea59f8d tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c" status: 200 len: 1363 microversion: 2.47 time: 0.261795 Aug 27 02:55:48.960462 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2385/4582] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:48 2022] GET /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:55:49.166451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-89e52221-ea1a-4c58-ae80-653beeb6476d req-07add1f0-c797-4a6a-842a-b70820f06608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda401e7-53e0-4698-b32b-031c49b5cf5f", "name": "network-vif-unplugged", "status": "completed", "tag": "28051cef-d3f3-425c-b06a-97f68b4e2be2"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:49.219560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc41721f-805c-4309-8958-6c00c8ac6d1c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:49.220790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fc41721f-805c-4309-8958-6c00c8ac6d1c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:49.224025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-89e52221-ea1a-4c58-ae80-653beeb6476d req-07add1f0-c797-4a6a-842a-b70820f06608 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.226926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-89e52221-ea1a-4c58-ae80-653beeb6476d req-07add1f0-c797-4a6a-842a-b70820f06608 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.230521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-89e52221-ea1a-4c58-ae80-653beeb6476d req-07add1f0-c797-4a6a-842a-b70820f06608 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.242765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc41721f-805c-4309-8958-6c00c8ac6d1c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.243664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc41721f-805c-4309-8958-6c00c8ac6d1c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.244278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc41721f-805c-4309-8958-6c00c8ac6d1c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.245175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc41721f-805c-4309-8958-6c00c8ac6d1c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.245993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc41721f-805c-4309-8958-6c00c8ac6d1c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.246619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc41721f-805c-4309-8958-6c00c8ac6d1c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.257993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.compute.server_external_events [req-89e52221-ea1a-4c58-ae80-653beeb6476d req-07add1f0-c797-4a6a-842a-b70820f06608 service nova] Unable to find a host for instance bda401e7-53e0-4698-b32b-031c49b5cf5f. Dropping event network-vif-unplugged {{(pid=122487) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 02:55:49.261601 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-89e52221-ea1a-4c58-ae80-653beeb6476d req-07add1f0-c797-4a6a-842a-b70820f06608 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.109929 Aug 27 02:55:49.265436 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2198/4583] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 117 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 02:55:49.626367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:49.627142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:49.650094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.651005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.653326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.654116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.658194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.658383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fc41721f-805c-4309-8958-6c00c8ac6d1c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:49.659630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.672217 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fc41721f-805c-4309-8958-6c00c8ac6d1c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 200 len: 1446 microversion: 2.1 time: 0.456961 Aug 27 02:55:49.673776 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2386/4584] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:49 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 1446 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:49.702615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:49.706762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:49.741170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.754498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.760797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.762593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.767191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.768160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.769394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.771819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.773699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.775318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lazy-loading 'fault' on Instance uuid 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:49.863106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:55:49.887673 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.compute.api [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Working on deleting snapshot 8bbdcb26-07d1-43f9-ae94-bb3aa4024897 from shelved instance... Aug 27 02:55:49.900570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1bb177ca144a83b3d45a12cd6c87fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd36ee303d1d4f1eadcbcbf007362a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:49.929508 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-152022a2-6a6c-414e-b495-2ddf90cc2cd5 tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 200 len: 1303 microversion: 2.1 time: 0.297508 Aug 27 02:55:49.933117 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2199/4585] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:49 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 1303 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:55:49.968073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:49.968709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: 0c7c42f2-6b88-4d35-ab34-de4cfae6623c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:49.992494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.993184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.993793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:49.994573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:49.996554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:49.997206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:50.269246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:50.292400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:50.294161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:50.298336 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-30bba672-0fbb-4c49-b344-77fdf86fe9d3 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c" status: 200 len: 1363 microversion: 2.47 time: 0.334913 Aug 27 02:55:50.327884 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2200/4586] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:49 2022] GET /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:50.960469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:50.961737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] [instance: 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:50.977295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:50.978605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:50.979342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:50.980424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:50.981008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:50.981748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.007253 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] HTTP exception thrown: Instance 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a could not be found. Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Request method failure captured: Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a HTTP/1.1 Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYb0TAVGwRaHhF4x80oYtMUH0SzHQ24rK7UhqZpaKOJQzgUJ9F2RMZpR-TlL2qpg564HZLVr4TyTTFdBowb8w6W1_O8mSoZLsnkNf4FHIJZ6TnEsFv_P5goHxsJ04FzjVLFmXFTHxqjwovR_dPIeE0TkK5BE-6dqUbO1Ahn5jvMtyak Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: fd36ee303d1d4f1eadcbcbf007362a80 Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-VolumesBackupsTest-2002197007 Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_fd36ee303d1d4f1eadcbcbf007362a80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fd36ee303d1d4f1eadcbcbf007362a80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/fd36ee303d1d4f1eadcbcbf007362a80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/fd36ee303d1d4f1eadcbcbf007362a80"}]}] Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-VolumesBackupsTest-2002197007 Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: fd36ee303d1d4f1eadcbcbf007362a80 Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-VolumesBackupsTest-2002197007 Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-VolumesBackupsTest-2002197007-project Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 4e1bb177ca144a83b3d45a12cd6c87fe Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-VolumesBackupsTest-2002197007-project Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a could not be found. Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a'} Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a could not be found. Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a could not be found. Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:51.027026 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:51.033813 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:51.033813 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:51.033813 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:51.033813 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:51.033813 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:51.033813 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a could not be found. Aug 27 02:55:51.033813 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:51.042623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] Returning 404 to user: Instance 4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:51.044493 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-635d3dbd-fe07-4686-9e07-802a5efd488a tempest-VolumesBackupsTest-2002197007 tempest-VolumesBackupsTest-2002197007-project] 10.222.0.99 "GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a" status: 404 len: 111 microversion: 2.1 time: 0.090301 Aug 27 02:55:51.061928 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2201/4587] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:50 2022] GET /compute/v2.1/servers/4c2f213b-aa73-4a2d-8ad5-69b6ccb8645a => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 02:55:51.354380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:51.383175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: 0c7c42f2-6b88-4d35-ab34-de4cfae6623c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:51.477484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.478552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.481823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.488118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.489451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.491496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.615819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.616588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.617565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.618391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lazy-loading 'fault' on Instance uuid 0c7c42f2-6b88-4d35-ab34-de4cfae6623c {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:55:51.680860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Doing local delete in cell 8ef2b9ff-883a-43ea-9ea9-638fb5ee225c(cell1) {{(pid=122488) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 27 02:55:51.683434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:51.686244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:51.687060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:51.691528 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.compute.api [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 27 02:55:51.698107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] deallocate_for_instance() {{(pid=122488) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 27 02:55:51.853024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:51.882636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:51.885163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '59540eaad39a4787958f532529b91c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6240b9595db46dbbda3bf3d8e28f983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:51.891315 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2ac77c17-d775-40e0-9266-6f200b138121 tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c" status: 200 len: 1368 microversion: 2.47 time: 0.546165 Aug 27 02:55:51.909484 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2202/4588] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:51 2022] GET /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c => generated 1368 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:55:52.923865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:52.925166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] [instance: 0c7c42f2-6b88-4d35-ab34-de4cfae6623c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:52.929839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:52.941337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:52.964177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:52.966231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:52.968052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:52.972582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:52.976903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:52.980301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:53.028915 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] HTTP exception thrown: Instance 0c7c42f2-6b88-4d35-ab34-de4cfae6623c could not be found. Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Request method failure captured: Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c HTTP/1.1 Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYd_bWMA3indwUyXR7s9BI5nTRKie1xPAVcFuctDyf5mCbhQaC6m3R8XZAZStyzmoaK47oHNbGj2jLgSPmrjByl4CdG_O-2iGiU7eMTSpR9BUmefukXGcyo6qBwP04YMPHe6j9HZujSIRgf1hIzoy7FQ6SIuu0JUvxQGreRA8hfKMOI Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Openstack-Nova-Api-Version: 2.47 Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: b6240b9595db46dbbda3bf3d8e28f983 Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerShowV247Test-1418242143 Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b6240b9595db46dbbda3bf3d8e28f983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b6240b9595db46dbbda3bf3d8e28f983"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b6240b9595db46dbbda3bf3d8e28f983"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b6240b9595db46dbbda3bf3d8e28f983"}]}] Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerShowV247Test-1418242143 Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: b6240b9595db46dbbda3bf3d8e28f983 Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerShowV247Test-1418242143 Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerShowV247Test-1418242143-project Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 59540eaad39a4787958f532529b91c5e Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerShowV247Test-1418242143-project Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 0c7c42f2-6b88-4d35-ab34-de4cfae6623c could not be found. Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '0c7c42f2-6b88-4d35-ab34-de4cfae6623c'} Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7c42f2-6b88-4d35-ab34-de4cfae6623c could not be found. Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7c42f2-6b88-4d35-ab34-de4cfae6623c could not be found. Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:53.037357 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:53.042012 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:53.042012 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:53.042012 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:53.042012 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:53.042012 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:53.042012 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7c42f2-6b88-4d35-ab34-de4cfae6623c could not be found. Aug 27 02:55:53.042012 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:53.043861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] Returning 404 to user: Instance 0c7c42f2-6b88-4d35-ab34-de4cfae6623c could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:53.045975 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e2692ffa-2103-4a98-bbb0-ba0e4e86cada tempest-ServerShowV247Test-1418242143 tempest-ServerShowV247Test-1418242143-project] 10.222.0.99 "GET /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c" status: 404 len: 111 microversion: 2.47 time: 0.134377 Aug 27 02:55:53.050699 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2203/4589] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:55:52 2022] GET /compute/v2.1/servers/0c7c42f2-6b88-4d35-ab34-de4cfae6623c => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:55:53.125215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Updating instance_info_cache with network_info: [] {{(pid=122488) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 27 02:55:53.164131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2a9243cb-cdbc-48f7-8574-5b7ba4993d7c req-cfd65692-c30c-4613-a925-b96d16af6b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bda401e7-53e0-4698-b32b-031c49b5cf5f", "name": "network-vif-deleted", "tag": "28051cef-d3f3-425c-b06a-97f68b4e2be2"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:53.180163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:53.186808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2a9243cb-cdbc-48f7-8574-5b7ba4993d7c req-cfd65692-c30c-4613-a925-b96d16af6b4c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:53.188992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2a9243cb-cdbc-48f7-8574-5b7ba4993d7c req-cfd65692-c30c-4613-a925-b96d16af6b4c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:53.189456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2a9243cb-cdbc-48f7-8574-5b7ba4993d7c req-cfd65692-c30c-4613-a925-b96d16af6b4c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:53.220890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.compute.server_external_events [req-2a9243cb-cdbc-48f7-8574-5b7ba4993d7c req-cfd65692-c30c-4613-a925-b96d16af6b4c service nova] Unable to find a host for instance bda401e7-53e0-4698-b32b-031c49b5cf5f. Dropping event network-vif-deleted {{(pid=122487) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 02:55:53.228551 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2a9243cb-cdbc-48f7-8574-5b7ba4993d7c req-cfd65692-c30c-4613-a925-b96d16af6b4c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.066492 Aug 27 02:55:53.229502 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2204/4590] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 27 02:55:53.530373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-52fce60e-6dce-4705-ab87-6f58be8bed82 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 204 len: 0 microversion: 2.1 time: 3.835942 Aug 27 02:55:53.532681 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2387/4591] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:55:49 2022] DELETE /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 0 bytes in 3839 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:55:53.551217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:53.556908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:53.574190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:53.575357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:53.578708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:53.580057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:53.582369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:53.584842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:53.629751 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f HTTP/1.1 Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'bda401e7-53e0-4698-b32b-031c49b5cf5f'} Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:55:53.648498 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:53.653963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:55:53.653963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:55:53.653963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:55:53.653963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:55:53.653963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:55:53.653963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:55:53.653963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:55:53.667075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:55:53.670971 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1f83daeb-514c-4a54-ab06-06ad0bc8e66e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 404 len: 111 microversion: 2.1 time: 0.130929 Aug 27 02:55:53.674138 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2205/4592] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:53 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:55:53.880749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-548619df-6fe2-49d7-ac44-c22f8061f7c0 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:53.883812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-548619df-6fe2-49d7-ac44-c22f8061f7c0 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:53.907924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-548619df-6fe2-49d7-ac44-c22f8061f7c0 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:53.914510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-548619df-6fe2-49d7-ac44-c22f8061f7c0 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:53.915560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-548619df-6fe2-49d7-ac44-c22f8061f7c0 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:53.917825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-548619df-6fe2-49d7-ac44-c22f8061f7c0 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:53.920422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-548619df-6fe2-49d7-ac44-c22f8061f7c0 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:53.921194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-548619df-6fe2-49d7-ac44-c22f8061f7c0 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:54.051335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1664468171", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a3bbba16-ea21-41e9-a19d-afd74184c636"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:54.294877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] validate_networks() for [('a3bbba16-ea21-41e9-a19d-afd74184c636', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:55:54.882391 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-548619df-6fe2-49d7-ac44-c22f8061f7c0 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 1.005340 Aug 27 02:55:54.885621 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2388/4593] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:55:53 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments => generated 197 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:54.909079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5d65df31-d3f4-41e8-8d27-14676bc470e7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:54.910107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5d65df31-d3f4-41e8-8d27-14676bc470e7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:54.920337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d65df31-d3f4-41e8-8d27-14676bc470e7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.921382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d65df31-d3f4-41e8-8d27-14676bc470e7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.922289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d65df31-d3f4-41e8-8d27-14676bc470e7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:54.931595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d65df31-d3f4-41e8-8d27-14676bc470e7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:54.942690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d65df31-d3f4-41e8-8d27-14676bc470e7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:54.947861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d65df31-d3f4-41e8-8d27-14676bc470e7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:55.056847 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5d65df31-d3f4-41e8-8d27-14676bc470e7 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments/d13d2e09-0c7e-4c78-91b5-e8993339ee05" status: 200 len: 194 microversion: 2.1 time: 0.162351 Aug 27 02:55:55.059975 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2389/4594] 10.222.0.99 () {58 vars in 1413 bytes} [Sat Aug 27 02:55:54 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments/d13d2e09-0c7e-4c78-91b5-e8993339ee05 => generated 194 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:56.885511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:55:56.887379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:55:56.888255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:55:56.889234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:55:56.889865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:55:56.942883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:56.943507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:56.943901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:56.959330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:56.962406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:56.962968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:57.048629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:55:57.081010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for user b508f2fe4b394f589b067f5b3de49a0e and project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:55:57.102814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:57.107297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:55:57.112070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:55:57.219067 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a7bd53ca-f497-4412-88da-986b654c7482 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.172010 Aug 27 02:55:57.222948 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2206/4595] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:55:57.234025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-18dc42db-50a8-47f6-96ef-2da42df7bd44 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:57.234656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-18dc42db-50a8-47f6-96ef-2da42df7bd44 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:57.410971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-18dc42db-50a8-47f6-96ef-2da42df7bd44 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:57.423039 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-18dc42db-50a8-47f6-96ef-2da42df7bd44 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1215 microversion: 2.1 time: 0.192700 Aug 27 02:55:57.425326 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2390/4596] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:57 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:58.454270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c26c0402-fd20-4ccb-9914-e6bea9a1673c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:58.460982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c26c0402-fd20-4ccb-9914-e6bea9a1673c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:58.539790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c26c0402-fd20-4ccb-9914-e6bea9a1673c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:58.540838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c26c0402-fd20-4ccb-9914-e6bea9a1673c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:58.541714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c26c0402-fd20-4ccb-9914-e6bea9a1673c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:58.543121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c26c0402-fd20-4ccb-9914-e6bea9a1673c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:58.543854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c26c0402-fd20-4ccb-9914-e6bea9a1673c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:58.544641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c26c0402-fd20-4ccb-9914-e6bea9a1673c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:58.672003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c26c0402-fd20-4ccb-9914-e6bea9a1673c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:55:58.683380 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c26c0402-fd20-4ccb-9914-e6bea9a1673c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1219 microversion: 2.1 time: 0.237930 Aug 27 02:55:58.695989 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2207/4597] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:55:58 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1219 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:55:59.305721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6d14eecd-c210-4cf4-8252-e272f7b075cb tempest-QuotasTestJSON-389365934 tempest-QuotasTestJSON-389365934-project] Calling method '.version_select at 0x7f4d28f1bc10>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:55:59.400484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4ad317e-e45b-42df-99d1-6c34ccb7d04c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57d52b2d-1d4d-4118-bd57-a489a1a98cc5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:55:59.403855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c4ad317e-e45b-42df-99d1-6c34ccb7d04c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:55:59.416462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ad317e-e45b-42df-99d1-6c34ccb7d04c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:59.419814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ad317e-e45b-42df-99d1-6c34ccb7d04c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:59.421872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ad317e-e45b-42df-99d1-6c34ccb7d04c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:59.423458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ad317e-e45b-42df-99d1-6c34ccb7d04c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:55:59.426209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ad317e-e45b-42df-99d1-6c34ccb7d04c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:55:59.426974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ad317e-e45b-42df-99d1-6c34ccb7d04c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:55:59.482779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:55:59.522788 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6d14eecd-c210-4cf4-8252-e272f7b075cb tempest-QuotasTestJSON-389365934 tempest-QuotasTestJSON-389365934-project] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/49a4ef6ed94147738366341e9ebb946b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.764951 Aug 27 02:55:59.527051 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2391/4598] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:55:58 2022] GET /compute/v2.1/os-quota-sets/49a4ef6ed94147738366341e9ebb946b/defaults => generated 371 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:55:59.548870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f8af2f3c-f0a6-4a72-bff4-5147decc890f tempest-QuotasTestJSON-389365934 tempest-QuotasTestJSON-389365934-project] Calling method '.version_select at 0x7f4d28e821f0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:00.080458 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f8af2f3c-f0a6-4a72-bff4-5147decc890f tempest-QuotasTestJSON-389365934 tempest-QuotasTestJSON-389365934-project] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/49a4ef6ed94147738366341e9ebb946b" status: 200 len: 371 microversion: 2.1 time: 0.545871 Aug 27 02:56:00.089894 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2392/4599] 10.222.0.99 () {58 vars in 1242 bytes} [Sat Aug 27 02:55:59 2022] GET /compute/v2.1/os-quota-sets/49a4ef6ed94147738366341e9ebb946b => generated 371 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:00.117071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-59a66790-ab6d-4db5-a6d2-0afc134e606e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:00.118096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-59a66790-ab6d-4db5-a6d2-0afc134e606e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:00.121360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:00.134580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59a66790-ab6d-4db5-a6d2-0afc134e606e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:00.147678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59a66790-ab6d-4db5-a6d2-0afc134e606e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:00.148262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59a66790-ab6d-4db5-a6d2-0afc134e606e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:00.150129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59a66790-ab6d-4db5-a6d2-0afc134e606e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:00.151968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59a66790-ab6d-4db5-a6d2-0afc134e606e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:00.156371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59a66790-ab6d-4db5-a6d2-0afc134e606e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:00.329599 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c4ad317e-e45b-42df-99d1-6c34ccb7d04c tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "POST /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932746 Aug 27 02:56:00.332884 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2208/4600] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 02:55:59 2022] POST /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:56:00.358359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-15392260-d6f4-464a-bbcf-b94d2f4d1876 tempest-QuotasTestJSON-389365934 tempest-QuotasTestJSON-389365934-project] Calling method '.version_select at 0x7f4d29aab670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:00.529396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-59a66790-ab6d-4db5-a6d2-0afc134e606e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:00.559740 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-59a66790-ab6d-4db5-a6d2-0afc134e606e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1273 microversion: 2.1 time: 0.465885 Aug 27 02:56:00.561859 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2393/4601] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:00 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1273 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:00.980970 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-15392260-d6f4-464a-bbcf-b94d2f4d1876 tempest-QuotasTestJSON-389365934 tempest-QuotasTestJSON-389365934-project] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/49a4ef6ed94147738366341e9ebb946b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.645215 Aug 27 02:56:00.984186 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2209/4602] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 02:56:00 2022] GET /compute/v2.1/os-quota-sets/49a4ef6ed94147738366341e9ebb946b/defaults => generated 371 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:01.000398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bca53295-4e74-42cc-a9f5-572923d719d6 tempest-QuotasTestJSON-389365934 tempest-QuotasTestJSON-389365934-project] Calling method '.version_select at 0x7f4d28f4b1f0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:01.320906 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bca53295-4e74-42cc-a9f5-572923d719d6 tempest-QuotasTestJSON-389365934 tempest-QuotasTestJSON-389365934-project] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/49a4ef6ed94147738366341e9ebb946b" status: 200 len: 371 microversion: 2.1 time: 0.326393 Aug 27 02:56:01.321527 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2394/4603] 10.222.0.99 () {58 vars in 1242 bytes} [Sat Aug 27 02:56:00 2022] GET /compute/v2.1/os-quota-sets/49a4ef6ed94147738366341e9ebb946b => generated 371 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:01.337197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42c26441-e002-4876-8740-0df6a4bdf7ef tempest-QuotasTestJSON-389365934 tempest-QuotasTestJSON-389365934-project] Calling method '.version_select at 0x7f4d2a5c6700>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:01.517577 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42c26441-e002-4876-8740-0df6a4bdf7ef tempest-QuotasTestJSON-389365934 tempest-QuotasTestJSON-389365934-project] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/49a4ef6ed94147738366341e9ebb946b?user_id=fe3c2e85fa8a4b269ddf2c7655a7cc41" status: 200 len: 371 microversion: 2.1 time: 0.187999 Aug 27 02:56:01.518211 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2210/4604] 10.222.0.99 () {58 vars in 1323 bytes} [Sat Aug 27 02:56:01 2022] GET /compute/v2.1/os-quota-sets/49a4ef6ed94147738366341e9ebb946b?user_id=fe3c2e85fa8a4b269ddf2c7655a7cc41 => generated 371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:01.596813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bb3270ea-eefa-42a2-b9e1-0b6ec0c11eca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:01.597995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bb3270ea-eefa-42a2-b9e1-0b6ec0c11eca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:01.635415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb3270ea-eefa-42a2-b9e1-0b6ec0c11eca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:01.637112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb3270ea-eefa-42a2-b9e1-0b6ec0c11eca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:01.638138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb3270ea-eefa-42a2-b9e1-0b6ec0c11eca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:01.641506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb3270ea-eefa-42a2-b9e1-0b6ec0c11eca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:01.643069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb3270ea-eefa-42a2-b9e1-0b6ec0c11eca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:01.647434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb3270ea-eefa-42a2-b9e1-0b6ec0c11eca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:02.543133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb3270ea-eefa-42a2-b9e1-0b6ec0c11eca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:02.551950 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bb3270ea-eefa-42a2-b9e1-0b6ec0c11eca tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1315 microversion: 2.1 time: 0.964642 Aug 27 02:56:02.565552 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2395/4605] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:01 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:03.575718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2725aff1-c731-41ba-82c8-e2f83ad71c8d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:03.577497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2725aff1-c731-41ba-82c8-e2f83ad71c8d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:03.596624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2725aff1-c731-41ba-82c8-e2f83ad71c8d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:03.597794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2725aff1-c731-41ba-82c8-e2f83ad71c8d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:03.610184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2725aff1-c731-41ba-82c8-e2f83ad71c8d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:03.611448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2725aff1-c731-41ba-82c8-e2f83ad71c8d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:03.614086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2725aff1-c731-41ba-82c8-e2f83ad71c8d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:03.614751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2725aff1-c731-41ba-82c8-e2f83ad71c8d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:04.061658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-8337f4c7-a14b-4e84-bab6-21e10f568bdf req-641387f7-3517-4c86-82a2-a15db6e2f812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56145f6f-c258-480c-ab99-366c209b6d7c", "tag": "175531b5-85bf-4d83-8b4a-148d0f4041b4"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:04.087812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8337f4c7-a14b-4e84-bab6-21e10f568bdf req-641387f7-3517-4c86-82a2-a15db6e2f812 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:04.088951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8337f4c7-a14b-4e84-bab6-21e10f568bdf req-641387f7-3517-4c86-82a2-a15db6e2f812 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:04.089895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8337f4c7-a14b-4e84-bab6-21e10f568bdf req-641387f7-3517-4c86-82a2-a15db6e2f812 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:04.154985 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-8337f4c7-a14b-4e84-bab6-21e10f568bdf req-641387f7-3517-4c86-82a2-a15db6e2f812 service nova] Creating event network-changed:175531b5-85bf-4d83-8b4a-148d0f4041b4 for instance 56145f6f-c258-480c-ab99-366c209b6d7c on n-h1-852084-5 Aug 27 02:56:04.177089 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-8337f4c7-a14b-4e84-bab6-21e10f568bdf req-641387f7-3517-4c86-82a2-a15db6e2f812 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118276 Aug 27 02:56:04.184854 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2396/4606] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:04.318814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2725aff1-c731-41ba-82c8-e2f83ad71c8d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:04.343205 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2725aff1-c731-41ba-82c8-e2f83ad71c8d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1315 microversion: 2.1 time: 0.771208 Aug 27 02:56:04.346394 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2211/4607] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:03 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:05.386618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21b69611-9862-488e-a62c-01af5c7bade9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:05.388039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21b69611-9862-488e-a62c-01af5c7bade9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:05.402674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b69611-9862-488e-a62c-01af5c7bade9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:05.403485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b69611-9862-488e-a62c-01af5c7bade9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:05.405456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b69611-9862-488e-a62c-01af5c7bade9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:05.409572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b69611-9862-488e-a62c-01af5c7bade9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:05.410358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b69611-9862-488e-a62c-01af5c7bade9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:05.413351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21b69611-9862-488e-a62c-01af5c7bade9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:05.969250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-21b69611-9862-488e-a62c-01af5c7bade9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:05.997873 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21b69611-9862-488e-a62c-01af5c7bade9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1315 microversion: 2.1 time: 0.615790 Aug 27 02:56:06.002292 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2397/4608] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:05 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:07.025635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-78f5fddd-1f73-4318-b7e5-c99478ad2de2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:07.027691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-78f5fddd-1f73-4318-b7e5-c99478ad2de2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:07.041519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:07.047631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f5fddd-1f73-4318-b7e5-c99478ad2de2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:07.049248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f5fddd-1f73-4318-b7e5-c99478ad2de2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:07.050642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f5fddd-1f73-4318-b7e5-c99478ad2de2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:07.051706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f5fddd-1f73-4318-b7e5-c99478ad2de2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:07.052504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f5fddd-1f73-4318-b7e5-c99478ad2de2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:07.053214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f5fddd-1f73-4318-b7e5-c99478ad2de2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:07.736860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-78f5fddd-1f73-4318-b7e5-c99478ad2de2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:07.749121 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-78f5fddd-1f73-4318-b7e5-c99478ad2de2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1315 microversion: 2.1 time: 0.730633 Aug 27 02:56:07.753610 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2212/4609] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:07 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:08.780464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61637437-fdae-4fb0-b16f-143fb009b601 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:08.781204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-61637437-fdae-4fb0-b16f-143fb009b601 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:08.799868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61637437-fdae-4fb0-b16f-143fb009b601 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:08.800531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61637437-fdae-4fb0-b16f-143fb009b601 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:08.801465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61637437-fdae-4fb0-b16f-143fb009b601 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:08.802238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61637437-fdae-4fb0-b16f-143fb009b601 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:08.803259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61637437-fdae-4fb0-b16f-143fb009b601 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:08.803697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61637437-fdae-4fb0-b16f-143fb009b601 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:09.356689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-61637437-fdae-4fb0-b16f-143fb009b601 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:09.364018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-23cce8e4-903a-40f9-a99b-d21394fb0d5c tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] Calling method '.version_select at 0x7f4d2952fee0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:09.368095 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61637437-fdae-4fb0-b16f-143fb009b601 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1315 microversion: 2.1 time: 0.591385 Aug 27 02:56:09.397336 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2398/4610] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:08 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:09.480527 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-23cce8e4-903a-40f9-a99b-d21394fb0d5c tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/285ed2c8-c640-41d2-a074-18f3b3441509" status: 200 len: 350 microversion: 2.1 time: 0.121270 Aug 27 02:56:09.488302 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2213/4611] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 02:56:09 2022] GET /compute/v2.1/os-volumes/285ed2c8-c640-41d2-a074-18f3b3441509 => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:10.408672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cd6ecb72-44e8-4f98-9f6e-6c6b8c81d79b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:10.409312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cd6ecb72-44e8-4f98-9f6e-6c6b8c81d79b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:10.433150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd6ecb72-44e8-4f98-9f6e-6c6b8c81d79b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:10.436455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd6ecb72-44e8-4f98-9f6e-6c6b8c81d79b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:10.441825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd6ecb72-44e8-4f98-9f6e-6c6b8c81d79b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:10.442797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd6ecb72-44e8-4f98-9f6e-6c6b8c81d79b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:10.451076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd6ecb72-44e8-4f98-9f6e-6c6b8c81d79b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:10.451646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd6ecb72-44e8-4f98-9f6e-6c6b8c81d79b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:10.990172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cd6ecb72-44e8-4f98-9f6e-6c6b8c81d79b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:11.001041 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cd6ecb72-44e8-4f98-9f6e-6c6b8c81d79b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1315 microversion: 2.1 time: 0.599973 Aug 27 02:56:11.019769 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2399/4612] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:10 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:11.568671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:11.574665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-83a5c95e-1b40-4ff3-b8c6-3cc042c1ddcb req-68d39f0a-6594-49e3-9693-442e6a3cd73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56145f6f-c258-480c-ab99-366c209b6d7c", "name": "network-vif-plugged", "status": "completed", "tag": "175531b5-85bf-4d83-8b4a-148d0f4041b4"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:11.603019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-83a5c95e-1b40-4ff3-b8c6-3cc042c1ddcb req-68d39f0a-6594-49e3-9693-442e6a3cd73f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:11.606968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-83a5c95e-1b40-4ff3-b8c6-3cc042c1ddcb req-68d39f0a-6594-49e3-9693-442e6a3cd73f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:11.608208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-83a5c95e-1b40-4ff3-b8c6-3cc042c1ddcb req-68d39f0a-6594-49e3-9693-442e6a3cd73f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:11.663173 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-83a5c95e-1b40-4ff3-b8c6-3cc042c1ddcb req-68d39f0a-6594-49e3-9693-442e6a3cd73f service nova] Creating event network-vif-plugged:175531b5-85bf-4d83-8b4a-148d0f4041b4 for instance 56145f6f-c258-480c-ab99-366c209b6d7c on n-h1-852084-5 Aug 27 02:56:11.671714 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-83a5c95e-1b40-4ff3-b8c6-3cc042c1ddcb req-68d39f0a-6594-49e3-9693-442e6a3cd73f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104448 Aug 27 02:56:11.676008 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2214/4613] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:12.027411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-521d94e7-9fb6-444d-aaf5-fdff23a0e774 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:12.028979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-521d94e7-9fb6-444d-aaf5-fdff23a0e774 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:12.036866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:12.060220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521d94e7-9fb6-444d-aaf5-fdff23a0e774 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:12.061180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521d94e7-9fb6-444d-aaf5-fdff23a0e774 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:12.062076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521d94e7-9fb6-444d-aaf5-fdff23a0e774 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:12.065064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521d94e7-9fb6-444d-aaf5-fdff23a0e774 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:12.066265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521d94e7-9fb6-444d-aaf5-fdff23a0e774 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:12.069131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-521d94e7-9fb6-444d-aaf5-fdff23a0e774 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:12.742144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-521d94e7-9fb6-444d-aaf5-fdff23a0e774 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:12.758709 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-521d94e7-9fb6-444d-aaf5-fdff23a0e774 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1315 microversion: 2.1 time: 0.735802 Aug 27 02:56:12.770371 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2400/4614] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:12 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:13.798447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6996e928-1e48-437e-97a9-d6fc46b1a5ed tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] Calling method '.version_select at 0x7f4d28e939d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:13.804066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bf814efd-a3c0-4917-92dd-f5a998f193b2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:13.807417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bf814efd-a3c0-4917-92dd-f5a998f193b2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:13.842568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf814efd-a3c0-4917-92dd-f5a998f193b2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:13.848625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf814efd-a3c0-4917-92dd-f5a998f193b2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:13.850064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf814efd-a3c0-4917-92dd-f5a998f193b2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:13.851853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf814efd-a3c0-4917-92dd-f5a998f193b2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:13.852887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf814efd-a3c0-4917-92dd-f5a998f193b2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:13.854001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf814efd-a3c0-4917-92dd-f5a998f193b2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:14.032531 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6996e928-1e48-437e-97a9-d6fc46b1a5ed tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/ad6d8539-68a0-4756-bb25-d0fccf65a0c9" status: 200 len: 351 microversion: 2.1 time: 0.244348 Aug 27 02:56:14.033716 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2401/4615] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 02:56:13 2022] GET /compute/v2.1/os-volumes/ad6d8539-68a0-4756-bb25-d0fccf65a0c9 => generated 351 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:56:14.245019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bf814efd-a3c0-4917-92dd-f5a998f193b2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:14.257886 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bf814efd-a3c0-4917-92dd-f5a998f193b2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1315 microversion: 2.1 time: 0.478029 Aug 27 02:56:14.260479 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2215/4616] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:13 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:15.284726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f4078694-8891-4c72-a481-d3328f2b9341 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:15.286347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f4078694-8891-4c72-a481-d3328f2b9341 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:15.313098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4078694-8891-4c72-a481-d3328f2b9341 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:15.316456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4078694-8891-4c72-a481-d3328f2b9341 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:15.317227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4078694-8891-4c72-a481-d3328f2b9341 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:15.318772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4078694-8891-4c72-a481-d3328f2b9341 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:15.321962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4078694-8891-4c72-a481-d3328f2b9341 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:15.323561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4078694-8891-4c72-a481-d3328f2b9341 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:15.616343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f4078694-8891-4c72-a481-d3328f2b9341 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:15.631521 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f4078694-8891-4c72-a481-d3328f2b9341 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1500 microversion: 2.1 time: 0.349883 Aug 27 02:56:15.656267 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2402/4617] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:15 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1500 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:15.661581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-87778b69-b0e9-4cf2-84e9-74d6ee2fba85 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:15.672445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87778b69-b0e9-4cf2-84e9-74d6ee2fba85 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:15.674948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87778b69-b0e9-4cf2-84e9-74d6ee2fba85 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:15.677131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87778b69-b0e9-4cf2-84e9-74d6ee2fba85 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:15.753382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-87778b69-b0e9-4cf2-84e9-74d6ee2fba85 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Going to try to stop instance {{(pid=122487) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 02:56:15.855987 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-87778b69-b0e9-4cf2-84e9-74d6ee2fba85 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c/action" status: 202 len: 0 microversion: 2.1 time: 0.201708 Aug 27 02:56:15.861541 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2216/4618] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:56:15 2022] POST /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:56:15.875799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ee96767a-4d7d-4f8d-b650-1972613c7588 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:15.877569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ee96767a-4d7d-4f8d-b650-1972613c7588 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:15.916152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee96767a-4d7d-4f8d-b650-1972613c7588 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:15.920183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee96767a-4d7d-4f8d-b650-1972613c7588 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:15.922880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee96767a-4d7d-4f8d-b650-1972613c7588 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:15.926755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee96767a-4d7d-4f8d-b650-1972613c7588 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:15.928739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee96767a-4d7d-4f8d-b650-1972613c7588 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:15.931500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee96767a-4d7d-4f8d-b650-1972613c7588 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:16.396930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ee96767a-4d7d-4f8d-b650-1972613c7588 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:16.418833 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ee96767a-4d7d-4f8d-b650-1972613c7588 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.555159 Aug 27 02:56:16.433099 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2403/4619] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:15 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:17.127351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3e2e3409-5aad-4c30-97ed-462f574c04df tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] Calling method '.version_select at 0x7f4d295658b0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:17.252359 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3e2e3409-5aad-4c30-97ed-462f574c04df tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/9b23d37b-5d99-4e75-9e73-61fe0d774a8e" status: 200 len: 350 microversion: 2.1 time: 0.136719 Aug 27 02:56:17.254237 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2217/4620] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 02:56:17 2022] GET /compute/v2.1/os-volumes/9b23d37b-5d99-4e75-9e73-61fe0d774a8e => generated 350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:17.280448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-386f72dd-75a6-49db-87c3-a18e41174e0f tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] Calling method '.version_select at 0x7f4d28e28af0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:17.456930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5dab55b8-b700-4696-90c1-0053d2d2c55a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:17.458100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5dab55b8-b700-4696-90c1-0053d2d2c55a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:17.491259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5dab55b8-b700-4696-90c1-0053d2d2c55a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:17.491793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5dab55b8-b700-4696-90c1-0053d2d2c55a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:17.492248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5dab55b8-b700-4696-90c1-0053d2d2c55a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:17.493040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5dab55b8-b700-4696-90c1-0053d2d2c55a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:17.493575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5dab55b8-b700-4696-90c1-0053d2d2c55a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:17.501319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5dab55b8-b700-4696-90c1-0053d2d2c55a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:17.601006 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-386f72dd-75a6-49db-87c3-a18e41174e0f tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] 10.222.0.99 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.331661 Aug 27 02:56:17.602942 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2404/4621] 10.222.0.99 () {58 vars in 1134 bytes} [Sat Aug 27 02:56:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:17.631956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-65768195-f023-43a5-bd9e-51a2c7bd49c1 tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] Calling method '.version_select at 0x7f4d28fc5a60>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:17.854973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5dab55b8-b700-4696-90c1-0053d2d2c55a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:17.873587 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5dab55b8-b700-4696-90c1-0053d2d2c55a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.434438 Aug 27 02:56:17.875050 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2218/4622] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:17 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:17.902054 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-65768195-f023-43a5-bd9e-51a2c7bd49c1 tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] 10.222.0.99 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.288873 Aug 27 02:56:17.902717 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2405/4623] 10.222.0.99 () {58 vars in 1149 bytes} [Sat Aug 27 02:56:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:17.917022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88770013-860f-4b20-9c4e-4973227abfad tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] Calling method '.version_select at 0x7f4d295658b0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:18.032933 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-88770013-860f-4b20-9c4e-4973227abfad tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] 10.222.0.99 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.119610 Aug 27 02:56:18.047930 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2219/4624] 10.222.0.99 () {58 vars in 1134 bytes} [Sat Aug 27 02:56:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:18.060062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-77c30d35-f447-429c-b3d2-06628e5caba2 tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] Calling method '.version_select at 0x7f4d28e28040>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:18.225086 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-77c30d35-f447-429c-b3d2-06628e5caba2 tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] 10.222.0.99 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.167334 Aug 27 02:56:18.227116 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2406/4625] 10.222.0.99 () {58 vars in 1167 bytes} [Sat Aug 27 02:56:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:18.257926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e7be3bbf-ea36-4bcb-85f4-82e622c5b627 tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] Calling method '.version_select at 0x7f4d2952f1f0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:18.385737 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e7be3bbf-ea36-4bcb-85f4-82e622c5b627 tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.137348 Aug 27 02:56:18.386927 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2220/4626] 10.222.0.99 () {58 vars in 1170 bytes} [Sat Aug 27 02:56:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:18.404870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-862c4918-9ac2-47a7-ab84-9d44ec85e6e5 tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] Calling method '.version_select at 0x7f4d28fc59d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:18.565028 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-862c4918-9ac2-47a7-ab84-9d44ec85e6e5 tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.165206 Aug 27 02:56:18.566411 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2407/4627] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:56:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:18.601022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-52692e5e-1ca3-426a-beaa-36d2f24d86f9 tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] Calling method '.version_select at 0x7f4d29565a60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:18.753537 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-52692e5e-1ca3-426a-beaa-36d2f24d86f9 tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.164420 Aug 27 02:56:18.754594 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2221/4628] 10.222.0.99 () {58 vars in 1188 bytes} [Sat Aug 27 02:56:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:18.778462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-093e6459-d6de-48a5-bc9c-b2f41996491b tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] Calling method '.version_select at 0x7f4d2a7e53a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:18.925009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-523116f3-75ad-4811-a063-00521e0ec9fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:18.926220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-523116f3-75ad-4811-a063-00521e0ec9fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:18.974972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523116f3-75ad-4811-a063-00521e0ec9fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:18.980846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523116f3-75ad-4811-a063-00521e0ec9fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:18.981921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523116f3-75ad-4811-a063-00521e0ec9fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:18.986069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523116f3-75ad-4811-a063-00521e0ec9fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:18.990337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523116f3-75ad-4811-a063-00521e0ec9fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:18.993186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523116f3-75ad-4811-a063-00521e0ec9fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:19.002969 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-093e6459-d6de-48a5-bc9c-b2f41996491b tempest-VolumesTestJSON-758460387 tempest-VolumesTestJSON-758460387-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.232609 Aug 27 02:56:19.004579 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2408/4629] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 02:56:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:19.323246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-523116f3-75ad-4811-a063-00521e0ec9fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:19.370950 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-523116f3-75ad-4811-a063-00521e0ec9fb tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.448816 Aug 27 02:56:19.373287 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2222/4630] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:18 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:19.480800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f21106f-95a2-467b-a949-687162713a36 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:19.484408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8f21106f-95a2-467b-a949-687162713a36 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:19.503639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f21106f-95a2-467b-a949-687162713a36 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:19.504145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f21106f-95a2-467b-a949-687162713a36 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:19.504812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f21106f-95a2-467b-a949-687162713a36 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:19.507247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f21106f-95a2-467b-a949-687162713a36 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:19.511439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f21106f-95a2-467b-a949-687162713a36 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:19.512344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f21106f-95a2-467b-a949-687162713a36 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:19.627385 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f21106f-95a2-467b-a949-687162713a36 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.151478 Aug 27 02:56:19.628635 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2409/4631] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:56:19 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments => generated 371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:19.865208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4575ec75-862f-465c-a865-b334cda23705 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:19.866138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4575ec75-862f-465c-a865-b334cda23705 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:19.874994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4575ec75-862f-465c-a865-b334cda23705 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:19.876627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4575ec75-862f-465c-a865-b334cda23705 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:19.877501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4575ec75-862f-465c-a865-b334cda23705 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:19.879167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4575ec75-862f-465c-a865-b334cda23705 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:19.879971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4575ec75-862f-465c-a865-b334cda23705 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:19.881199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4575ec75-862f-465c-a865-b334cda23705 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:19.960987 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4575ec75-862f-465c-a865-b334cda23705 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments/d13d2e09-0c7e-4c78-91b5-e8993339ee05" status: 200 len: 194 microversion: 2.1 time: 0.119890 Aug 27 02:56:19.978121 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2223/4632] 10.222.0.99 () {58 vars in 1413 bytes} [Sat Aug 27 02:56:19 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments/d13d2e09-0c7e-4c78-91b5-e8993339ee05 => generated 194 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:19.978331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4bce1d45-fc9d-4f7c-92a4-4d26f8057300 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:19.979068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4bce1d45-fc9d-4f7c-92a4-4d26f8057300 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:20.001318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bce1d45-fc9d-4f7c-92a4-4d26f8057300 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:20.002854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bce1d45-fc9d-4f7c-92a4-4d26f8057300 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:20.004552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bce1d45-fc9d-4f7c-92a4-4d26f8057300 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:20.007941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bce1d45-fc9d-4f7c-92a4-4d26f8057300 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:20.009110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bce1d45-fc9d-4f7c-92a4-4d26f8057300 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:20.011035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bce1d45-fc9d-4f7c-92a4-4d26f8057300 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:20.163096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-4bce1d45-fc9d-4f7c-92a4-4d26f8057300 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lazy-loading 'services' on Instance uuid 78c66c64-3779-46eb-a94b-b6a11b2cc928 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:20.253263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=12,nova_cell1:DELETE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:20.270887 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4bce1d45-fc9d-4f7c-92a4-4d26f8057300 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "DELETE /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments/d13d2e09-0c7e-4c78-91b5-e8993339ee05" status: 202 len: 0 microversion: 2.1 time: 0.297345 Aug 27 02:56:20.272304 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2410/4633] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 02:56:19 2022] DELETE /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments/d13d2e09-0c7e-4c78-91b5-e8993339ee05 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:56:20.404382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-773a7d07-42f4-4727-b5ae-91b9faff8def tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:20.405020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-773a7d07-42f4-4727-b5ae-91b9faff8def tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:20.415857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-773a7d07-42f4-4727-b5ae-91b9faff8def tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:20.423353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-773a7d07-42f4-4727-b5ae-91b9faff8def tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:20.424105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-773a7d07-42f4-4727-b5ae-91b9faff8def tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:20.425201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-773a7d07-42f4-4727-b5ae-91b9faff8def tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:20.425896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-773a7d07-42f4-4727-b5ae-91b9faff8def tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:20.426521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-773a7d07-42f4-4727-b5ae-91b9faff8def tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:20.819230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-773a7d07-42f4-4727-b5ae-91b9faff8def tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:20.900670 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-773a7d07-42f4-4727-b5ae-91b9faff8def tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.499484 Aug 27 02:56:20.903033 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2224/4634] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:20 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:21.943548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c0e66352-2a5d-41b8-8c3c-3151eb0b8167 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:21.961540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c0e66352-2a5d-41b8-8c3c-3151eb0b8167 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:21.980427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0e66352-2a5d-41b8-8c3c-3151eb0b8167 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:21.981989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0e66352-2a5d-41b8-8c3c-3151eb0b8167 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:21.983083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0e66352-2a5d-41b8-8c3c-3151eb0b8167 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:21.984793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0e66352-2a5d-41b8-8c3c-3151eb0b8167 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:21.985819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0e66352-2a5d-41b8-8c3c-3151eb0b8167 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:21.986600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0e66352-2a5d-41b8-8c3c-3151eb0b8167 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:22.513468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c0e66352-2a5d-41b8-8c3c-3151eb0b8167 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:22.525507 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c0e66352-2a5d-41b8-8c3c-3151eb0b8167 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.592373 Aug 27 02:56:22.530077 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2411/4635] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:21 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:23.559763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-79e41f85-0b16-4e4d-b555-e62c9b7c4a95 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:23.561030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-79e41f85-0b16-4e4d-b555-e62c9b7c4a95 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:23.580487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79e41f85-0b16-4e4d-b555-e62c9b7c4a95 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:23.585486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79e41f85-0b16-4e4d-b555-e62c9b7c4a95 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:23.586469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79e41f85-0b16-4e4d-b555-e62c9b7c4a95 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:23.587596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79e41f85-0b16-4e4d-b555-e62c9b7c4a95 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:23.589644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79e41f85-0b16-4e4d-b555-e62c9b7c4a95 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:23.595728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79e41f85-0b16-4e4d-b555-e62c9b7c4a95 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:24.060599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-79e41f85-0b16-4e4d-b555-e62c9b7c4a95 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:24.096541 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-79e41f85-0b16-4e4d-b555-e62c9b7c4a95 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.542734 Aug 27 02:56:24.098299 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2225/4636] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:23 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:25.134122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-046d51f7-3d89-43aa-bb15-16bcbec0d68c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:25.135202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-046d51f7-3d89-43aa-bb15-16bcbec0d68c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:25.168552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-046d51f7-3d89-43aa-bb15-16bcbec0d68c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:25.169288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-046d51f7-3d89-43aa-bb15-16bcbec0d68c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:25.169827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-046d51f7-3d89-43aa-bb15-16bcbec0d68c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:25.170622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-046d51f7-3d89-43aa-bb15-16bcbec0d68c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:25.178635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-046d51f7-3d89-43aa-bb15-16bcbec0d68c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:25.188725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-046d51f7-3d89-43aa-bb15-16bcbec0d68c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:25.488418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-046d51f7-3d89-43aa-bb15-16bcbec0d68c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:25.503844 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-046d51f7-3d89-43aa-bb15-16bcbec0d68c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.380662 Aug 27 02:56:25.505102 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2412/4637] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:25 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:26.532732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-57f5c209-7e55-44dc-91c6-8dcd4856eef6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:26.533454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-57f5c209-7e55-44dc-91c6-8dcd4856eef6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:26.548801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f5c209-7e55-44dc-91c6-8dcd4856eef6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:26.549301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f5c209-7e55-44dc-91c6-8dcd4856eef6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:26.549812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f5c209-7e55-44dc-91c6-8dcd4856eef6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:26.550665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f5c209-7e55-44dc-91c6-8dcd4856eef6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:26.551134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f5c209-7e55-44dc-91c6-8dcd4856eef6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:26.551612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f5c209-7e55-44dc-91c6-8dcd4856eef6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:27.138181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-57f5c209-7e55-44dc-91c6-8dcd4856eef6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:27.150741 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-57f5c209-7e55-44dc-91c6-8dcd4856eef6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.621962 Aug 27 02:56:27.155476 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2226/4638] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:26 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:28.179540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-84dadd13-49bf-4a0e-9ccd-18727259de47 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:28.180178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-84dadd13-49bf-4a0e-9ccd-18727259de47 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:28.240324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84dadd13-49bf-4a0e-9ccd-18727259de47 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:28.242901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84dadd13-49bf-4a0e-9ccd-18727259de47 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:28.248473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84dadd13-49bf-4a0e-9ccd-18727259de47 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:28.251336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84dadd13-49bf-4a0e-9ccd-18727259de47 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:28.261814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84dadd13-49bf-4a0e-9ccd-18727259de47 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:28.261814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84dadd13-49bf-4a0e-9ccd-18727259de47 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:28.565378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-84dadd13-49bf-4a0e-9ccd-18727259de47 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:28.576981 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-84dadd13-49bf-4a0e-9ccd-18727259de47 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.401378 Aug 27 02:56:28.581802 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2413/4639] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:28 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:29.609394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8b199d1e-8c15-4def-8947-3b9da2fa83f5 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:29.610058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8b199d1e-8c15-4def-8947-3b9da2fa83f5 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:29.612325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:29.636939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b199d1e-8c15-4def-8947-3b9da2fa83f5 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:29.637462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b199d1e-8c15-4def-8947-3b9da2fa83f5 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:29.637952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b199d1e-8c15-4def-8947-3b9da2fa83f5 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:29.638700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b199d1e-8c15-4def-8947-3b9da2fa83f5 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:29.639165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b199d1e-8c15-4def-8947-3b9da2fa83f5 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:29.639606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b199d1e-8c15-4def-8947-3b9da2fa83f5 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:29.655056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:30.290369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8b199d1e-8c15-4def-8947-3b9da2fa83f5 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:30.312801 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8b199d1e-8c15-4def-8947-3b9da2fa83f5 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.709386 Aug 27 02:56:30.322100 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2227/4640] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:29 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:31.359078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aaf82cb3-5160-44be-a5a0-6cc66a4e5210 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:31.359990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aaf82cb3-5160-44be-a5a0-6cc66a4e5210 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:31.362813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=32 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:31.376634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaf82cb3-5160-44be-a5a0-6cc66a4e5210 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:31.376868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaf82cb3-5160-44be-a5a0-6cc66a4e5210 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:31.383560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaf82cb3-5160-44be-a5a0-6cc66a4e5210 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:31.392138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaf82cb3-5160-44be-a5a0-6cc66a4e5210 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:31.398702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaf82cb3-5160-44be-a5a0-6cc66a4e5210 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:31.399170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaf82cb3-5160-44be-a5a0-6cc66a4e5210 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:32.159666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aaf82cb3-5160-44be-a5a0-6cc66a4e5210 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:32.172182 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aaf82cb3-5160-44be-a5a0-6cc66a4e5210 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.817723 Aug 27 02:56:32.195280 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2414/4641] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:31 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:33.202076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8538c9e9-119c-43dc-87ff-31601392c6f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:33.202888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8538c9e9-119c-43dc-87ff-31601392c6f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:33.221489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8538c9e9-119c-43dc-87ff-31601392c6f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:33.222107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8538c9e9-119c-43dc-87ff-31601392c6f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:33.222635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8538c9e9-119c-43dc-87ff-31601392c6f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:33.223535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8538c9e9-119c-43dc-87ff-31601392c6f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:33.224011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8538c9e9-119c-43dc-87ff-31601392c6f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:33.233402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8538c9e9-119c-43dc-87ff-31601392c6f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:33.905877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8538c9e9-119c-43dc-87ff-31601392c6f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:33.919981 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8538c9e9-119c-43dc-87ff-31601392c6f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.720793 Aug 27 02:56:33.922312 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2228/4642] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:33 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:34.947040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-30d78a95-6969-44fb-ba8a-070dad70bd4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:34.948743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-30d78a95-6969-44fb-ba8a-070dad70bd4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:34.964686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d78a95-6969-44fb-ba8a-070dad70bd4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:34.975055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d78a95-6969-44fb-ba8a-070dad70bd4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:34.976150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d78a95-6969-44fb-ba8a-070dad70bd4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:34.983421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d78a95-6969-44fb-ba8a-070dad70bd4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:34.984806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d78a95-6969-44fb-ba8a-070dad70bd4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:34.986064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30d78a95-6969-44fb-ba8a-070dad70bd4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:35.884889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-30d78a95-6969-44fb-ba8a-070dad70bd4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:35.894034 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-30d78a95-6969-44fb-ba8a-070dad70bd4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.954507 Aug 27 02:56:35.904946 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2415/4643] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:34 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:36.919690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9cc984aa-7ab8-485f-8661-b470626eabec tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:36.921217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9cc984aa-7ab8-485f-8661-b470626eabec tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:36.942837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9cc984aa-7ab8-485f-8661-b470626eabec tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:36.943867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9cc984aa-7ab8-485f-8661-b470626eabec tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:36.944846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9cc984aa-7ab8-485f-8661-b470626eabec tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:36.946518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9cc984aa-7ab8-485f-8661-b470626eabec tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:36.951884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9cc984aa-7ab8-485f-8661-b470626eabec tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:36.952803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9cc984aa-7ab8-485f-8661-b470626eabec tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:36.960694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e468d1e4-54b4-49bd-af8d-bae85b29e23d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:36.962691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e468d1e4-54b4-49bd-af8d-bae85b29e23d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:36.984794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e468d1e4-54b4-49bd-af8d-bae85b29e23d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:36.987145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e468d1e4-54b4-49bd-af8d-bae85b29e23d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:36.987628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e468d1e4-54b4-49bd-af8d-bae85b29e23d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:36.991615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e468d1e4-54b4-49bd-af8d-bae85b29e23d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:36.993443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e468d1e4-54b4-49bd-af8d-bae85b29e23d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:36.999446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e468d1e4-54b4-49bd-af8d-bae85b29e23d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:37.142112 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e468d1e4-54b4-49bd-af8d-bae85b29e23d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments/57d52b2d-1d4d-4118-bd57-a489a1a98cc5" status: 200 len: 194 microversion: 2.1 time: 0.185877 Aug 27 02:56:37.146696 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2416/4644] 10.222.0.99 () {58 vars in 1413 bytes} [Sat Aug 27 02:56:36 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments/57d52b2d-1d4d-4118-bd57-a489a1a98cc5 => generated 194 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:56:37.167295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-356ebced-a0b5-4fc4-af96-d16fc72b7f2a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:37.167878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-356ebced-a0b5-4fc4-af96-d16fc72b7f2a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:37.174559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-356ebced-a0b5-4fc4-af96-d16fc72b7f2a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:37.177533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-356ebced-a0b5-4fc4-af96-d16fc72b7f2a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:37.180613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-356ebced-a0b5-4fc4-af96-d16fc72b7f2a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:37.181565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-356ebced-a0b5-4fc4-af96-d16fc72b7f2a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:37.182236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-356ebced-a0b5-4fc4-af96-d16fc72b7f2a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:37.187300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-356ebced-a0b5-4fc4-af96-d16fc72b7f2a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:37.402013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-356ebced-a0b5-4fc4-af96-d16fc72b7f2a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lazy-loading 'services' on Instance uuid 78c66c64-3779-46eb-a94b-b6a11b2cc928 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:37.584902 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-356ebced-a0b5-4fc4-af96-d16fc72b7f2a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "DELETE /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments/57d52b2d-1d4d-4118-bd57-a489a1a98cc5" status: 202 len: 0 microversion: 2.1 time: 0.432474 Aug 27 02:56:37.585436 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2417/4645] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 02:56:37 2022] DELETE /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments/57d52b2d-1d4d-4118-bd57-a489a1a98cc5 => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:56:37.591102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9cc984aa-7ab8-485f-8661-b470626eabec tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:37.605215 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9cc984aa-7ab8-485f-8661-b470626eabec tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.688371 Aug 27 02:56:37.622563 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2229/4646] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:36 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:38.631525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e725f097-e2b5-4d19-a56e-d3a2a45d6c4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:38.632473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e725f097-e2b5-4d19-a56e-d3a2a45d6c4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:38.650389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e725f097-e2b5-4d19-a56e-d3a2a45d6c4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:38.653579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e725f097-e2b5-4d19-a56e-d3a2a45d6c4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:38.655610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e725f097-e2b5-4d19-a56e-d3a2a45d6c4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:38.658146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e725f097-e2b5-4d19-a56e-d3a2a45d6c4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:38.660446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e725f097-e2b5-4d19-a56e-d3a2a45d6c4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:38.661861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e725f097-e2b5-4d19-a56e-d3a2a45d6c4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:38.995270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e725f097-e2b5-4d19-a56e-d3a2a45d6c4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:39.008660 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e725f097-e2b5-4d19-a56e-d3a2a45d6c4c tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.383390 Aug 27 02:56:39.014770 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2418/4647] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:38 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:40.041308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-db65c15d-2fa0-4440-8a00-0b3d612036da tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:40.045010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-db65c15d-2fa0-4440-8a00-0b3d612036da tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:40.078314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db65c15d-2fa0-4440-8a00-0b3d612036da tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:40.081387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db65c15d-2fa0-4440-8a00-0b3d612036da tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:40.094011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db65c15d-2fa0-4440-8a00-0b3d612036da tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:40.095956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db65c15d-2fa0-4440-8a00-0b3d612036da tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:40.102276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db65c15d-2fa0-4440-8a00-0b3d612036da tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:40.107935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db65c15d-2fa0-4440-8a00-0b3d612036da tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:41.002728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-db65c15d-2fa0-4440-8a00-0b3d612036da tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:41.016003 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-db65c15d-2fa0-4440-8a00-0b3d612036da tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1510 microversion: 2.1 time: 0.979882 Aug 27 02:56:41.041006 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2230/4648] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:40 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1510 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:42.046152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a42447f4-72a5-481a-8a66-0c655df95e38 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:42.048592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a42447f4-72a5-481a-8a66-0c655df95e38 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:42.068582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a42447f4-72a5-481a-8a66-0c655df95e38 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:42.070286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a42447f4-72a5-481a-8a66-0c655df95e38 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:42.070988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a42447f4-72a5-481a-8a66-0c655df95e38 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:42.072677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a42447f4-72a5-481a-8a66-0c655df95e38 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:42.075136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a42447f4-72a5-481a-8a66-0c655df95e38 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:42.079174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a42447f4-72a5-481a-8a66-0c655df95e38 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:42.576661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a42447f4-72a5-481a-8a66-0c655df95e38 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:42.625455 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a42447f4-72a5-481a-8a66-0c655df95e38 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1487 microversion: 2.1 time: 0.584038 Aug 27 02:56:42.645708 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2419/4649] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:42 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1487 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:42.660674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-38327f5f-efa5-485e-9eab-d59befa0b6d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:42.661301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-38327f5f-efa5-485e-9eab-d59befa0b6d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:42.690223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38327f5f-efa5-485e-9eab-d59befa0b6d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:42.690744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38327f5f-efa5-485e-9eab-d59befa0b6d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:42.699832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38327f5f-efa5-485e-9eab-d59befa0b6d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:42.700831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38327f5f-efa5-485e-9eab-d59befa0b6d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:42.703050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38327f5f-efa5-485e-9eab-d59befa0b6d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:42.704526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38327f5f-efa5-485e-9eab-d59befa0b6d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:42.823004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-38327f5f-efa5-485e-9eab-d59befa0b6d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:56:43.180309 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-38327f5f-efa5-485e-9eab-d59befa0b6d2 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 204 len: 0 microversion: 2.1 time: 0.526692 Aug 27 02:56:43.181013 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2231/4650] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:56:42 2022] DELETE /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 02:56:43.190072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d664065-8588-4556-ba4f-c6af3db92134 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:43.190689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d664065-8588-4556-ba4f-c6af3db92134 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:43.225970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d664065-8588-4556-ba4f-c6af3db92134 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:43.227619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d664065-8588-4556-ba4f-c6af3db92134 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:43.229464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d664065-8588-4556-ba4f-c6af3db92134 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:43.231371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d664065-8588-4556-ba4f-c6af3db92134 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:43.238499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d664065-8588-4556-ba4f-c6af3db92134 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:43.240678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d664065-8588-4556-ba4f-c6af3db92134 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:43.917756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2d664065-8588-4556-ba4f-c6af3db92134 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:43.948967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-388d6dc1-30d3-4eb0-afbe-cbfd65aa1c34 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Action: 'create', calling method: .version_select at 0x7f4d2952f5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1357131025", "metadata": {"Type": "work"}}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:43.964972 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2d664065-8588-4556-ba4f-c6af3db92134 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1493 microversion: 2.1 time: 0.779256 Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-388d6dc1-30d3-4eb0-afbe-cbfd65aa1c34 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Request method failure captured: Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 122 Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYfrdPpf01idLO9A8U-2okgzTwEPALJCqd1AXb921hYDWIzBph-YWUSMKkczEZuvUiYGbO-7-nqP3HB2BK6G3RmIUjl16faUdIs1Oge-dirtfuqu4JwzehpFWTfsTpDhDDb_YFSyiP4V_m0Msps9GDWGCyUT990rMKN5eaJrd-beVnU Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cd9fd91c26374d7182a26ffb8d164e62"}]}] Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 7da57fb390c14f87a8ed628ef639897c Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1357131025", "metadata": {"Type": "work"}}} Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1357131025', 'metadata': {'Type': 'work'}}}} Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi '#$%' Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:56:43.965693 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:56:43.969982 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 02:56:43.969982 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:43.969982 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:43.969982 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:43.969982 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:43.969982 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:43.969982 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:43.969982 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:56:43.969982 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:56:43.969982 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 27 02:56:43.969982 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:43.976684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-388d6dc1-30d3-4eb0-afbe-cbfd65aa1c34 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:43.977558 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2420/4651] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:43 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1493 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:43.978889 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-388d6dc1-30d3-4eb0-afbe-cbfd65aa1c34 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.425244 Aug 27 02:56:44.014190 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2232/4652] 10.222.0.99 () {60 vars in 1156 bytes} [Sat Aug 27 02:56:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 464 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 02:56:44.021607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5cab469-354f-4a21-8611-5ebd2805f6bc tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Action: 'create', calling method: .version_select at 0x7f4d28f1b040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-781000866", "metadata": {"Type": "work"}}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5cab469-354f-4a21-8611-5ebd2805f6bc tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Request method failure captured: Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 119 Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYfrdPpf01idLO9A8U-2okgzTwEPALJCqd1AXb921hYDWIzBph-YWUSMKkczEZuvUiYGbO-7-nqP3HB2BK6G3RmIUjl16faUdIs1Oge-dirtfuqu4JwzehpFWTfsTpDhDDb_YFSyiP4V_m0Msps9GDWGCyUT990rMKN5eaJrd-beVnU Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cd9fd91c26374d7182a26ffb8d164e62"}]}] Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 7da57fb390c14f87a8ed628ef639897c Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-781000866", "metadata": {"Type": "work"}}} Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-781000866', 'metadata': {'Type': 'work'}}}} Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi '0' Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:56:44.031608 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:56:44.036737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 02:56:44.036737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.036737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.036737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.036737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.036737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:44.036737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:44.036737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:56:44.036737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:56:44.036737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 27 02:56:44.036737 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.039602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5cab469-354f-4a21-8611-5ebd2805f6bc tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:44.041098 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e5cab469-354f-4a21-8611-5ebd2805f6bc tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028602 Aug 27 02:56:44.058736 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2421/4653] 10.222.0.99 () {60 vars in 1156 bytes} [Sat Aug 27 02:56:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:56:44.079387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-27424632-8c36-482c-9f32-5c7cab9be043 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Action: 'create', calling method: .version_select at 0x7f4d29565d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2073489297", "metadata": {"Type": "work"}}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-27424632-8c36-482c-9f32-5c7cab9be043 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Request method failure captured: Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 119 Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYfrdPpf01idLO9A8U-2okgzTwEPALJCqd1AXb921hYDWIzBph-YWUSMKkczEZuvUiYGbO-7-nqP3HB2BK6G3RmIUjl16faUdIs1Oge-dirtfuqu4JwzehpFWTfsTpDhDDb_YFSyiP4V_m0Msps9GDWGCyUT990rMKN5eaJrd-beVnU Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cd9fd91c26374d7182a26ffb8d164e62"}]}] Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 7da57fb390c14f87a8ed628ef639897c Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2073489297", "metadata": {"Type": "work"}}} Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2073489297', 'metadata': {'Type': 'work'}}}} Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise error Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi '' Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 02:56:44.099469 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-27424632-8c36-482c-9f32-5c7cab9be043 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:44.106212 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-27424632-8c36-482c-9f32-5c7cab9be043 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.035826 Aug 27 02:56:44.117421 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2233/4654] 10.222.0.99 () {60 vars in 1156 bytes} [Sat Aug 27 02:56:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:56:44.128348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-67a9baec-5911-4331-99bf-7181a57c3753 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Calling method '.version_select at 0x7f4d28e288b0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:44.202748 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-67a9baec-5911-4331-99bf-7181a57c3753 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] HTTP exception thrown: Volume tempest-invalid-636771103 could not be found. Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-67a9baec-5911-4331-99bf-7181a57c3753 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Request method failure captured: Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-636771103 HTTP/1.1 Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYfrdPpf01idLO9A8U-2okgzTwEPALJCqd1AXb921hYDWIzBph-YWUSMKkczEZuvUiYGbO-7-nqP3HB2BK6G3RmIUjl16faUdIs1Oge-dirtfuqu4JwzehpFWTfsTpDhDDb_YFSyiP4V_m0Msps9GDWGCyUT990rMKN5eaJrd-beVnU Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cd9fd91c26374d7182a26ffb8d164e62"}]}] Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 7da57fb390c14f87a8ed628ef639897c Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: exception: Volume tempest-invalid-636771103 could not be found. Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'tempest-invalid-636771103'} Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-636771103 could not be found. (HTTP 404) (Request-ID: req-14329011-9697-4d57-a243-54cfde41ed56) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:56:44.211807 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-636771103 could not be found. Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-636771103 could not be found. Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-636771103 could not be found. Aug 27 02:56:44.217113 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.222422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-67a9baec-5911-4331-99bf-7181a57c3753 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Returning 404 to user: Volume tempest-invalid-636771103 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:44.228686 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-67a9baec-5911-4331-99bf-7181a57c3753 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/tempest-invalid-636771103" status: 404 len: 98 microversion: 2.1 time: 0.100290 Aug 27 02:56:44.231011 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2422/4655] 10.222.0.99 () {58 vars in 1215 bytes} [Sat Aug 27 02:56:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-636771103 => generated 98 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 02:56:44.242923 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0adb673b-3cab-4f0e-94dc-86cd4c42e1b5 tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005454 Aug 27 02:56:44.243643 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2234/4656] 10.222.0.99 () {58 vars in 1140 bytes} [Sat Aug 27 02:56:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 02:56:44.280561 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4b0e9c86-0706-49b4-a196-2dda4c5f986f tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.029570 Aug 27 02:56:44.282090 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2423/4657] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 02:56:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 02:56:44.295739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b40339e9-0257-46e8-ba9e-1a1e529bc08f tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Calling method '.version_select at 0x7f4d2952f040>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:44.348448 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-b40339e9-0257-46e8-ba9e-1a1e529bc08f tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] HTTP exception thrown: Volume 09e5958a-f30e-4884-abd5-15210ca313e2 could not be found. Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b40339e9-0257-46e8-ba9e-1a1e529bc08f tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Request method failure captured: Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-volumes/09e5958a-f30e-4884-abd5-15210ca313e2 HTTP/1.1 Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYfrdPpf01idLO9A8U-2okgzTwEPALJCqd1AXb921hYDWIzBph-YWUSMKkczEZuvUiYGbO-7-nqP3HB2BK6G3RmIUjl16faUdIs1Oge-dirtfuqu4JwzehpFWTfsTpDhDDb_YFSyiP4V_m0Msps9GDWGCyUT990rMKN5eaJrd-beVnU Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cd9fd91c26374d7182a26ffb8d164e62"}]}] Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 7da57fb390c14f87a8ed628ef639897c Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: exception: Volume 09e5958a-f30e-4884-abd5-15210ca313e2 could not be found. Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '09e5958a-f30e-4884-abd5-15210ca313e2'} Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 09e5958a-f30e-4884-abd5-15210ca313e2 could not be found. (HTTP 404) (Request-ID: req-d9e0453d-3af8-4d5a-b290-32febba781f4) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:56:44.351731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 09e5958a-f30e-4884-abd5-15210ca313e2 could not be found. Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 09e5958a-f30e-4884-abd5-15210ca313e2 could not be found. Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 09e5958a-f30e-4884-abd5-15210ca313e2 could not be found. Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b40339e9-0257-46e8-ba9e-1a1e529bc08f tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Returning 404 to user: Volume 09e5958a-f30e-4884-abd5-15210ca313e2 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:44.357957 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b40339e9-0257-46e8-ba9e-1a1e529bc08f tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/09e5958a-f30e-4884-abd5-15210ca313e2" status: 404 len: 109 microversion: 2.1 time: 0.063878 Aug 27 02:56:44.365657 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2235/4658] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 02:56:44 2022] DELETE /compute/v2.1/os-volumes/09e5958a-f30e-4884-abd5-15210ca313e2 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:56:44.381458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-986ce729-558f-4a71-8507-ad779bc9835d tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Calling method '.version_select at 0x7f4d28fc5700>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:44.706371 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-986ce729-558f-4a71-8507-ad779bc9835d tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] HTTP exception thrown: Volume 9d578b0a-408f-45be-8346-431b34cb7b0a could not be found. Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-986ce729-558f-4a71-8507-ad779bc9835d tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Request method failure captured: Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-volumes/9d578b0a-408f-45be-8346-431b34cb7b0a HTTP/1.1 Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYfrdPpf01idLO9A8U-2okgzTwEPALJCqd1AXb921hYDWIzBph-YWUSMKkczEZuvUiYGbO-7-nqP3HB2BK6G3RmIUjl16faUdIs1Oge-dirtfuqu4JwzehpFWTfsTpDhDDb_YFSyiP4V_m0Msps9GDWGCyUT990rMKN5eaJrd-beVnU Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/cd9fd91c26374d7182a26ffb8d164e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/cd9fd91c26374d7182a26ffb8d164e62"}]}] Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: cd9fd91c26374d7182a26ffb8d164e62 Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-VolumesNegativeTest-633222201 Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 7da57fb390c14f87a8ed628ef639897c Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-VolumesNegativeTest-633222201-project Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: exception: Volume 9d578b0a-408f-45be-8346-431b34cb7b0a could not be found. Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '9d578b0a-408f-45be-8346-431b34cb7b0a'} Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d578b0a-408f-45be-8346-431b34cb7b0a could not be found. (HTTP 404) (Request-ID: req-d41995d5-2a2f-4586-a9c5-ef1e8e54e339) Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 02:56:44.718991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d578b0a-408f-45be-8346-431b34cb7b0a could not be found. Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d578b0a-408f-45be-8346-431b34cb7b0a could not be found. Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d578b0a-408f-45be-8346-431b34cb7b0a could not be found. Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-986ce729-558f-4a71-8507-ad779bc9835d tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] Returning 404 to user: Volume 9d578b0a-408f-45be-8346-431b34cb7b0a could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-986ce729-558f-4a71-8507-ad779bc9835d tempest-VolumesNegativeTest-633222201 tempest-VolumesNegativeTest-633222201-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/9d578b0a-408f-45be-8346-431b34cb7b0a" status: 404 len: 109 microversion: 2.1 time: 0.336347 Aug 27 02:56:44.727743 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2424/4659] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 02:56:44 2022] GET /compute/v2.1/os-volumes/9d578b0a-408f-45be-8346-431b34cb7b0a => generated 109 bytes in 338 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:56:45.010779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-18a9eeff-8323-4136-94d6-c2de9b186c13 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:45.011774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-18a9eeff-8323-4136-94d6-c2de9b186c13 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:45.031251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a9eeff-8323-4136-94d6-c2de9b186c13 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:45.034110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a9eeff-8323-4136-94d6-c2de9b186c13 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:45.036643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a9eeff-8323-4136-94d6-c2de9b186c13 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:45.039893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a9eeff-8323-4136-94d6-c2de9b186c13 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:45.040812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a9eeff-8323-4136-94d6-c2de9b186c13 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:45.042710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a9eeff-8323-4136-94d6-c2de9b186c13 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:45.607205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-18a9eeff-8323-4136-94d6-c2de9b186c13 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:45.618121 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-18a9eeff-8323-4136-94d6-c2de9b186c13 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1493 microversion: 2.1 time: 0.614822 Aug 27 02:56:45.627219 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2236/4660] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:45 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1493 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:46.483316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-8f5abb73-bc53-4650-8eee-5c666a89d947 req-dab2808d-1fa3-4472-aad7-3601d27b25e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56145f6f-c258-480c-ab99-366c209b6d7c", "name": "network-vif-deleted", "tag": "175531b5-85bf-4d83-8b4a-148d0f4041b4"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:46.544576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8f5abb73-bc53-4650-8eee-5c666a89d947 req-dab2808d-1fa3-4472-aad7-3601d27b25e4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:46.548832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8f5abb73-bc53-4650-8eee-5c666a89d947 req-dab2808d-1fa3-4472-aad7-3601d27b25e4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:46.551897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8f5abb73-bc53-4650-8eee-5c666a89d947 req-dab2808d-1fa3-4472-aad7-3601d27b25e4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:46.611490 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-8f5abb73-bc53-4650-8eee-5c666a89d947 req-dab2808d-1fa3-4472-aad7-3601d27b25e4 service nova] Creating event network-vif-deleted:175531b5-85bf-4d83-8b4a-148d0f4041b4 for instance 56145f6f-c258-480c-ab99-366c209b6d7c on n-h1-852084-5 Aug 27 02:56:46.631657 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-8f5abb73-bc53-4650-8eee-5c666a89d947 req-dab2808d-1fa3-4472-aad7-3601d27b25e4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154361 Aug 27 02:56:46.638021 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2425/4661] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:56:47.322308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:47.322308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:47.334184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:47.335233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:47.335878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:47.347459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:47.349362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:47.350239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:47.430267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:47.431200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:47.431910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:47.432627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lazy-loading 'fault' on Instance uuid 56145f6f-c258-480c-ab99-366c209b6d7c {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:56:47.630750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:47.643068 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-db5ce028-1d12-47ba-acec-26659283a3bc tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 200 len: 1305 microversion: 2.1 time: 0.958763 Aug 27 02:56:47.656279 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2237/4662] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:46 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 1305 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:48.678364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:48.686151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:48.705074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:48.706935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:48.708908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:48.711790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:48.712448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:48.714151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:48.768080 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c HTTP/1.1 Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '56145f6f-c258-480c-ab99-366c209b6d7c'} Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:56:48.772771 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:48.778784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:56:48.778784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:56:48.778784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:56:48.778784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:56:48.778784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:56:48.778784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:56:48.778784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:56:48.780206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:56:48.782041 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-735eb039-fc03-4e9c-955e-0b4748de07ed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 404 len: 111 microversion: 2.1 time: 0.111019 Aug 27 02:56:48.786209 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2426/4663] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:48 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:56:48.891270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-746726110", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a3bbba16-ea21-41e9-a19d-afd74184c636"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:56:49.078142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] validate_networks() for [('a3bbba16-ea21-41e9-a19d-afd74184c636', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:56:52.516425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:56:52.517510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:56:52.518264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:56:52.519257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:56:52.521431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:56:52.578886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:52.579686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:52.583221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:52.584719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:52.590533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:52.593569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:52.666509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:56:52.684415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Getting quotas for user b508f2fe4b394f589b067f5b3de49a0e and project 2b2a380b54544c8b910b5aba84d8d148. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:56:52.731618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:56:52.733476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:56:52.914795 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bccf23fd-3398-49ad-849c-d777d5594576 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.042606 Aug 27 02:56:52.917200 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2238/4664] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:56:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:56:52.928373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-552f2037-a9fb-43b1-afee-2465f5b250f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:52.929170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-552f2037-a9fb-43b1-afee-2465f5b250f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:53.071428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-552f2037-a9fb-43b1-afee-2465f5b250f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:53.089903 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-552f2037-a9fb-43b1-afee-2465f5b250f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1214 microversion: 2.1 time: 0.165506 Aug 27 02:56:53.108177 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2427/4665] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:52 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:54.138882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b2552fe-7d53-48bb-b2e2-792f14524b2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:54.145092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0b2552fe-7d53-48bb-b2e2-792f14524b2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:54.400969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0b2552fe-7d53-48bb-b2e2-792f14524b2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:54.413512 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0b2552fe-7d53-48bb-b2e2-792f14524b2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1214 microversion: 2.1 time: 0.299776 Aug 27 02:56:54.415965 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2239/4666] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:54 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1214 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:54.959657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2444cc8a-65a0-4e9d-bc5a-9796ae7bf573 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:54.962320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2444cc8a-65a0-4e9d-bc5a-9796ae7bf573 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:54.983801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2444cc8a-65a0-4e9d-bc5a-9796ae7bf573 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:54.984303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2444cc8a-65a0-4e9d-bc5a-9796ae7bf573 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:54.984755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2444cc8a-65a0-4e9d-bc5a-9796ae7bf573 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:54.985522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2444cc8a-65a0-4e9d-bc5a-9796ae7bf573 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:54.986026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2444cc8a-65a0-4e9d-bc5a-9796ae7bf573 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:54.986479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2444cc8a-65a0-4e9d-bc5a-9796ae7bf573 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:55.114084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=68 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:56:55.150121 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2444cc8a-65a0-4e9d-bc5a-9796ae7bf573 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.194118 Aug 27 02:56:55.177633 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2428/4667] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:56:54 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments => generated 25 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:56:55.436257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c71a6052-7c9a-4fe4-9fdf-87c5a29cf7a6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:55.436968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c71a6052-7c9a-4fe4-9fdf-87c5a29cf7a6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:55.457921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c71a6052-7c9a-4fe4-9fdf-87c5a29cf7a6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:55.458441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c71a6052-7c9a-4fe4-9fdf-87c5a29cf7a6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:55.458891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c71a6052-7c9a-4fe4-9fdf-87c5a29cf7a6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:55.459634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c71a6052-7c9a-4fe4-9fdf-87c5a29cf7a6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:55.460217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c71a6052-7c9a-4fe4-9fdf-87c5a29cf7a6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:55.460655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c71a6052-7c9a-4fe4-9fdf-87c5a29cf7a6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:55.587251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b96c764b-b49c-4293-a7de-858d56ea0742 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:55.591482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b96c764b-b49c-4293-a7de-858d56ea0742 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:55.625410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c764b-b49c-4293-a7de-858d56ea0742 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:55.627932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c764b-b49c-4293-a7de-858d56ea0742 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:55.636594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c764b-b49c-4293-a7de-858d56ea0742 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:55.637760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c764b-b49c-4293-a7de-858d56ea0742 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:55.640144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c764b-b49c-4293-a7de-858d56ea0742 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:55.641818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b96c764b-b49c-4293-a7de-858d56ea0742 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:55.662511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c71a6052-7c9a-4fe4-9fdf-87c5a29cf7a6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:55.697196 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c71a6052-7c9a-4fe4-9fdf-87c5a29cf7a6 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1266 microversion: 2.1 time: 0.244809 Aug 27 02:56:55.702455 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2240/4668] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:55 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:55.762954 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b96c764b-b49c-4293-a7de-858d56ea0742 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.183776 Aug 27 02:56:55.770630 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2429/4669] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 02:56:55 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928/os-volume_attachments => generated 25 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 02:56:55.962213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e160580a-7b0a-4710-ae2a-16419d545d46 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:55.963195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e160580a-7b0a-4710-ae2a-16419d545d46 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:56.008181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e160580a-7b0a-4710-ae2a-16419d545d46 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:56.025052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e160580a-7b0a-4710-ae2a-16419d545d46 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:56.025907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e160580a-7b0a-4710-ae2a-16419d545d46 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:56.027234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e160580a-7b0a-4710-ae2a-16419d545d46 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:56.027977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e160580a-7b0a-4710-ae2a-16419d545d46 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:56.028706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e160580a-7b0a-4710-ae2a-16419d545d46 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:56.139530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e160580a-7b0a-4710-ae2a-16419d545d46 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:56:56.599027 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e160580a-7b0a-4710-ae2a-16419d545d46 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "DELETE /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 204 len: 0 microversion: 2.1 time: 0.642998 Aug 27 02:56:56.604693 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2241/4670] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:56:55 2022] DELETE /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:56:56.620107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-abe4484a-2b5e-4011-95d4-234bd35a169d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:56.620989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-abe4484a-2b5e-4011-95d4-234bd35a169d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:56.655560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abe4484a-2b5e-4011-95d4-234bd35a169d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:56.663413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abe4484a-2b5e-4011-95d4-234bd35a169d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:56.664256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abe4484a-2b5e-4011-95d4-234bd35a169d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:56.665229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abe4484a-2b5e-4011-95d4-234bd35a169d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:56.665922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abe4484a-2b5e-4011-95d4-234bd35a169d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:56.670918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-abe4484a-2b5e-4011-95d4-234bd35a169d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:56.726445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d9b9525a-a7a8-4d1f-8fea-9015b98ccf97 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:56.729348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d9b9525a-a7a8-4d1f-8fea-9015b98ccf97 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:56.803180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9b9525a-a7a8-4d1f-8fea-9015b98ccf97 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:56.809801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9b9525a-a7a8-4d1f-8fea-9015b98ccf97 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:56.810554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9b9525a-a7a8-4d1f-8fea-9015b98ccf97 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:56.811718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9b9525a-a7a8-4d1f-8fea-9015b98ccf97 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:56.839168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9b9525a-a7a8-4d1f-8fea-9015b98ccf97 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:56.845468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9b9525a-a7a8-4d1f-8fea-9015b98ccf97 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:57.161227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d9b9525a-a7a8-4d1f-8fea-9015b98ccf97 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:57.174186 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d9b9525a-a7a8-4d1f-8fea-9015b98ccf97 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1272 microversion: 2.1 time: 0.457795 Aug 27 02:56:57.181297 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2242/4671] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:56 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1272 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:56:57.923434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-abe4484a-2b5e-4011-95d4-234bd35a169d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:57.947117 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-abe4484a-2b5e-4011-95d4-234bd35a169d tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1674 microversion: 2.1 time: 1.336128 Aug 27 02:56:57.950068 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2430/4672] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:56 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1674 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:58.223358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7513fde8-8833-4fe1-bee6-638766aeb625 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:58.223998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7513fde8-8833-4fe1-bee6-638766aeb625 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:58.260186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7513fde8-8833-4fe1-bee6-638766aeb625 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:58.260752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7513fde8-8833-4fe1-bee6-638766aeb625 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:58.261195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7513fde8-8833-4fe1-bee6-638766aeb625 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:58.261998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7513fde8-8833-4fe1-bee6-638766aeb625 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:58.262488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7513fde8-8833-4fe1-bee6-638766aeb625 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:58.262922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7513fde8-8833-4fe1-bee6-638766aeb625 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:58.955355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7513fde8-8833-4fe1-bee6-638766aeb625 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:56:58.973333 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7513fde8-8833-4fe1-bee6-638766aeb625 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1314 microversion: 2.1 time: 0.756095 Aug 27 02:56:58.979250 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2243/4673] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:58 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:56:58.979482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4be3f461-ec82-47e4-8d2a-965703d64323 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:56:58.981139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4be3f461-ec82-47e4-8d2a-965703d64323 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:56:59.006496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4be3f461-ec82-47e4-8d2a-965703d64323 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:59.010719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4be3f461-ec82-47e4-8d2a-965703d64323 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:59.019537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4be3f461-ec82-47e4-8d2a-965703d64323 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:56:59.020669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4be3f461-ec82-47e4-8d2a-965703d64323 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:56:59.024675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4be3f461-ec82-47e4-8d2a-965703d64323 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:56:59.026378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4be3f461-ec82-47e4-8d2a-965703d64323 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:00.001537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-16a6773a-fd0f-4f5a-bea8-47dba391cd15 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:00.003138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-16a6773a-fd0f-4f5a-bea8-47dba391cd15 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:00.010543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:00.039419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a6773a-fd0f-4f5a-bea8-47dba391cd15 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:00.039600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a6773a-fd0f-4f5a-bea8-47dba391cd15 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:00.041382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a6773a-fd0f-4f5a-bea8-47dba391cd15 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:00.043001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a6773a-fd0f-4f5a-bea8-47dba391cd15 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:00.044428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a6773a-fd0f-4f5a-bea8-47dba391cd15 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:00.045253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16a6773a-fd0f-4f5a-bea8-47dba391cd15 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:00.116522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:00.196450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4be3f461-ec82-47e4-8d2a-965703d64323 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:00.230607 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4be3f461-ec82-47e4-8d2a-965703d64323 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1674 microversion: 2.1 time: 1.255513 Aug 27 02:57:00.233316 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2431/4674] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:58 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1674 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:01.260187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d85006a8-a2f9-4fa4-b46d-cd1898f68c51 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:01.264469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d85006a8-a2f9-4fa4-b46d-cd1898f68c51 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:01.278116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d85006a8-a2f9-4fa4-b46d-cd1898f68c51 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:01.280935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d85006a8-a2f9-4fa4-b46d-cd1898f68c51 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:01.297866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d85006a8-a2f9-4fa4-b46d-cd1898f68c51 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:01.299117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d85006a8-a2f9-4fa4-b46d-cd1898f68c51 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:01.299844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d85006a8-a2f9-4fa4-b46d-cd1898f68c51 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:01.300532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d85006a8-a2f9-4fa4-b46d-cd1898f68c51 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:01.738261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16a6773a-fd0f-4f5a-bea8-47dba391cd15 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:01.765109 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-16a6773a-fd0f-4f5a-bea8-47dba391cd15 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1314 microversion: 2.1 time: 1.768006 Aug 27 02:57:01.765790 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2244/4675] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:56:59 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1314 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:01.783600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-06973c2d-af0d-469e-9ecd-3bc8bd3ded8d req-830f8fee-50bb-4c4c-9af3-4a68e5796d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ede2f7-922c-4907-aa78-80424284f494", "tag": "bbc48a33-dd3b-4e9f-a396-8c6b5e5fc4d9"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:01.816945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-06973c2d-af0d-469e-9ecd-3bc8bd3ded8d req-830f8fee-50bb-4c4c-9af3-4a68e5796d45 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:01.820751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-06973c2d-af0d-469e-9ecd-3bc8bd3ded8d req-830f8fee-50bb-4c4c-9af3-4a68e5796d45 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:01.822160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-06973c2d-af0d-469e-9ecd-3bc8bd3ded8d req-830f8fee-50bb-4c4c-9af3-4a68e5796d45 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:01.864822 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-06973c2d-af0d-469e-9ecd-3bc8bd3ded8d req-830f8fee-50bb-4c4c-9af3-4a68e5796d45 service nova] Creating event network-changed:bbc48a33-dd3b-4e9f-a396-8c6b5e5fc4d9 for instance 54ede2f7-922c-4907-aa78-80424284f494 on n-h1-852084-5 Aug 27 02:57:01.880884 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-06973c2d-af0d-469e-9ecd-3bc8bd3ded8d req-830f8fee-50bb-4c4c-9af3-4a68e5796d45 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113794 Aug 27 02:57:01.887394 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2245/4676] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:02.343208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d85006a8-a2f9-4fa4-b46d-cd1898f68c51 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:02.355751 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d85006a8-a2f9-4fa4-b46d-cd1898f68c51 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1674 microversion: 2.1 time: 1.099063 Aug 27 02:57:02.371272 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2432/4677] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:01 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1674 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:02.793326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-16e160f6-a1fa-4275-83ca-a689290c5cf9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:02.795213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-16e160f6-a1fa-4275-83ca-a689290c5cf9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:02.798394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:02.808565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16e160f6-a1fa-4275-83ca-a689290c5cf9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:02.809063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16e160f6-a1fa-4275-83ca-a689290c5cf9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:02.809495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16e160f6-a1fa-4275-83ca-a689290c5cf9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:02.810699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16e160f6-a1fa-4275-83ca-a689290c5cf9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:02.811607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16e160f6-a1fa-4275-83ca-a689290c5cf9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:02.812244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16e160f6-a1fa-4275-83ca-a689290c5cf9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.000251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16e160f6-a1fa-4275-83ca-a689290c5cf9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:03.010646 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-16e160f6-a1fa-4275-83ca-a689290c5cf9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1314 microversion: 2.1 time: 0.223663 Aug 27 02:57:03.013837 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2246/4678] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:02 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:03.380704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad369126-db6c-49e0-95c9-878e03480bae tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:03.382180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ad369126-db6c-49e0-95c9-878e03480bae tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:03.394684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:03.396424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=32 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:03.398398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad369126-db6c-49e0-95c9-878e03480bae tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.399134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad369126-db6c-49e0-95c9-878e03480bae tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.400052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad369126-db6c-49e0-95c9-878e03480bae tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.400943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad369126-db6c-49e0-95c9-878e03480bae tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:03.401509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad369126-db6c-49e0-95c9-878e03480bae tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:03.402101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad369126-db6c-49e0-95c9-878e03480bae tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:03.614060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad369126-db6c-49e0-95c9-878e03480bae tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:03.662934 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad369126-db6c-49e0-95c9-878e03480bae tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1607 microversion: 2.1 time: 0.286561 Aug 27 02:57:03.696462 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2433/4679] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:03 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1607 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:04.034557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e22ab2c6-c000-41f7-b241-5ee60d92c600 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:04.037181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e22ab2c6-c000-41f7-b241-5ee60d92c600 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:04.049028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e22ab2c6-c000-41f7-b241-5ee60d92c600 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:04.058499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e22ab2c6-c000-41f7-b241-5ee60d92c600 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:04.059271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e22ab2c6-c000-41f7-b241-5ee60d92c600 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:04.060297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e22ab2c6-c000-41f7-b241-5ee60d92c600 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:04.060961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e22ab2c6-c000-41f7-b241-5ee60d92c600 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:04.061868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e22ab2c6-c000-41f7-b241-5ee60d92c600 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:04.393115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9b56476e-b945-41db-9c1f-4ac03e20a30b req-a87a2666-6b18-4787-86a4-837c6179031b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c66c64-3779-46eb-a94b-b6a11b2cc928", "name": "network-vif-deleted", "tag": "399f7fb0-802d-4b26-8991-4d761e12a15b"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:04.409875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:04.433451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b56476e-b945-41db-9c1f-4ac03e20a30b req-a87a2666-6b18-4787-86a4-837c6179031b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:04.434293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b56476e-b945-41db-9c1f-4ac03e20a30b req-a87a2666-6b18-4787-86a4-837c6179031b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:04.434855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b56476e-b945-41db-9c1f-4ac03e20a30b req-a87a2666-6b18-4787-86a4-837c6179031b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:04.468891 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9b56476e-b945-41db-9c1f-4ac03e20a30b req-a87a2666-6b18-4787-86a4-837c6179031b service nova] Creating event network-vif-deleted:399f7fb0-802d-4b26-8991-4d761e12a15b for instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 on n-h2-852084-5 Aug 27 02:57:04.493113 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9b56476e-b945-41db-9c1f-4ac03e20a30b req-a87a2666-6b18-4787-86a4-837c6179031b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105505 Aug 27 02:57:04.494009 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2434/4680] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:57:04.709925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:04.710907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:04.724638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:04.726185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:04.728312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:04.736769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:04.737458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:04.738651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:04.863074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:04.864191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:04.865071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:04.870617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lazy-loading 'fault' on Instance uuid 78c66c64-3779-46eb-a94b-b6a11b2cc928 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:05.771761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfefa59129eb427687ac388dbd000d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4399d0cd9ba4a16a4db45cf851a54f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:05.780339 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ffc18897-a0f0-48ad-8459-75ee660a6282 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 200 len: 1328 microversion: 2.1 time: 1.074979 Aug 27 02:57:05.788308 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2435/4681] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:04 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 1328 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:06.043128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e22ab2c6-c000-41f7-b241-5ee60d92c600 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:06.055715 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e22ab2c6-c000-41f7-b241-5ee60d92c600 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1314 microversion: 2.1 time: 2.025381 Aug 27 02:57:06.059295 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2247/4682] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:04 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1314 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:06.809200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:06.810435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:06.824725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:06.830450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:06.831257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:06.832808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:06.833508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:06.834207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:06.866008 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] HTTP exception thrown: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Request method failure captured: Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 HTTP/1.1 Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYZGh0D0YP_GLdVdQvlcUEp_UbStoIx5H11VeENXdtpctex2GQhIvbH0RJzet1-3vLWq-08vju8qPuFW0KMBvUQ7oTjpMP1Xb8sWU_5ujgaJeyRxUmITqqNTl7yAxJ1GPTAEVmNgjp5Sn_rGqTeoGE6zSnsUlGyU_Gyvxkr0lA28tWY Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d4399d0cd9ba4a16a4db45cf851a54f5"}]}] Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: bfefa59129eb427687ac388dbd000d25 Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '78c66c64-3779-46eb-a94b-b6a11b2cc928'} Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:06.868394 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:06.872538 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:06.872538 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:06.872538 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:06.872538 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:06.872538 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:06.872538 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:06.872538 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:06.879728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Returning 404 to user: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:06.880878 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-72d2ca47-76c0-4b88-b5f6-003a73b6de12 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 404 len: 111 microversion: 2.1 time: 0.076499 Aug 27 02:57:06.884887 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2436/4683] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:06 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:06.895957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cd4aeba6-727f-4ba4-b487-a92959443b71 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '.version_select at 0x7f4d2942fee0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:06.929073 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cd4aeba6-727f-4ba4-b487-a92959443b71 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129323033" status: 202 len: 0 microversion: 2.1 time: 0.042051 Aug 27 02:57:06.930783 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2248/4684] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 02:57:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129323033 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 02:57:07.079623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-511f1d14-b2ea-41f0-873e-ecc90c625c2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:07.080276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-511f1d14-b2ea-41f0-873e-ecc90c625c2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:07.091655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-511f1d14-b2ea-41f0-873e-ecc90c625c2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:07.092160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-511f1d14-b2ea-41f0-873e-ecc90c625c2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:07.092616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-511f1d14-b2ea-41f0-873e-ecc90c625c2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:07.093354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-511f1d14-b2ea-41f0-873e-ecc90c625c2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:07.117994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-511f1d14-b2ea-41f0-873e-ecc90c625c2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:07.118583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-511f1d14-b2ea-41f0-873e-ecc90c625c2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:07.414446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-511f1d14-b2ea-41f0-873e-ecc90c625c2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:07.425925 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-511f1d14-b2ea-41f0-873e-ecc90c625c2e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1314 microversion: 2.1 time: 0.350048 Aug 27 02:57:07.428190 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2437/4685] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:07 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:08.448669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1b2c1d6b-b1c7-434e-93de-6374e481064e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:08.450225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b2c1d6b-b1c7-434e-93de-6374e481064e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:08.504278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b2c1d6b-b1c7-434e-93de-6374e481064e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:08.506192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b2c1d6b-b1c7-434e-93de-6374e481064e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:08.510237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b2c1d6b-b1c7-434e-93de-6374e481064e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:08.516235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b2c1d6b-b1c7-434e-93de-6374e481064e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:08.517591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b2c1d6b-b1c7-434e-93de-6374e481064e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:08.520602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b2c1d6b-b1c7-434e-93de-6374e481064e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:09.072724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1b2c1d6b-b1c7-434e-93de-6374e481064e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:09.083472 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1b2c1d6b-b1c7-434e-93de-6374e481064e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1314 microversion: 2.1 time: 0.638941 Aug 27 02:57:09.084362 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2249/4686] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:08 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:10.107182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d1051358-b8ed-4f48-9396-7fb2d16ec7f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:10.107821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d1051358-b8ed-4f48-9396-7fb2d16ec7f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:10.124814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1051358-b8ed-4f48-9396-7fb2d16ec7f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:10.125327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1051358-b8ed-4f48-9396-7fb2d16ec7f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:10.125816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1051358-b8ed-4f48-9396-7fb2d16ec7f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:10.126550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1051358-b8ed-4f48-9396-7fb2d16ec7f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:10.127020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1051358-b8ed-4f48-9396-7fb2d16ec7f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:10.139305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1051358-b8ed-4f48-9396-7fb2d16ec7f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:10.929876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d1051358-b8ed-4f48-9396-7fb2d16ec7f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:10.957369 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d1051358-b8ed-4f48-9396-7fb2d16ec7f9 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1314 microversion: 2.1 time: 0.856545 Aug 27 02:57:10.958302 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2438/4687] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:10 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:11.983463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0195b0cf-f165-41ac-9e5e-311345ae0001 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:11.984119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0195b0cf-f165-41ac-9e5e-311345ae0001 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:11.998245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0195b0cf-f165-41ac-9e5e-311345ae0001 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:12.005378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0195b0cf-f165-41ac-9e5e-311345ae0001 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:12.006447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0195b0cf-f165-41ac-9e5e-311345ae0001 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:12.007788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0195b0cf-f165-41ac-9e5e-311345ae0001 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:12.012727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0195b0cf-f165-41ac-9e5e-311345ae0001 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:12.017913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0195b0cf-f165-41ac-9e5e-311345ae0001 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:13.100916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0195b0cf-f165-41ac-9e5e-311345ae0001 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:13.114709 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0195b0cf-f165-41ac-9e5e-311345ae0001 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1314 microversion: 2.1 time: 1.135026 Aug 27 02:57:13.122556 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2250/4688] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:11 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1314 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:13.451225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e426c6a3-1a81-4b34-90a5-8e791b8aa6f7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Action: 'create', calling method: .version_select at 0x7f4d28fe3280>, body: {"keypair": {"name": "tempest-keypair-1394915717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOji29hNO7UjY85GKhwNfu6vumk1MvaJ6sSvm7kYoT7JLkHPri+B78mLlEOfhgzu2YbO1P/FkYMX8k4sKq5Z+hkVSrGbG7AF5g0xZe5TevBsLtI10Ms+xUiftf0dN4RC1A=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:13.525615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-e426c6a3-1a81-4b34-90a5-8e791b8aa6f7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Getting quotas for project f65a5ba69d8d45399945c01090626fef. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:57:13.540575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-e426c6a3-1a81-4b34-90a5-8e791b8aa6f7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Getting quotas for user 9c5eafff09dd462d89bbab3403bbc878 and project f65a5ba69d8d45399945c01090626fef. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:57:13.615609 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e426c6a3-1a81-4b34-90a5-8e791b8aa6f7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.166585 Aug 27 02:57:13.619617 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2439/4689] 10.222.0.99 () {62 vars in 1200 bytes} [Sat Aug 27 02:57:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 27 02:57:14.144757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-61516d8f-27ee-45d3-88f4-e0a1626d50a0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:14.145311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-61516d8f-27ee-45d3-88f4-e0a1626d50a0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:14.161497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61516d8f-27ee-45d3-88f4-e0a1626d50a0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:14.162109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61516d8f-27ee-45d3-88f4-e0a1626d50a0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:14.165080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61516d8f-27ee-45d3-88f4-e0a1626d50a0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:14.166750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61516d8f-27ee-45d3-88f4-e0a1626d50a0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:14.170078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61516d8f-27ee-45d3-88f4-e0a1626d50a0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:14.172299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61516d8f-27ee-45d3-88f4-e0a1626d50a0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:14.780331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-61516d8f-27ee-45d3-88f4-e0a1626d50a0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:14.794244 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-61516d8f-27ee-45d3-88f4-e0a1626d50a0 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1314 microversion: 2.1 time: 0.654303 Aug 27 02:57:14.795235 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2251/4690] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:14 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1314 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:15.820920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-77534ea0-2868-4084-ac2a-9b57e0facd49 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:15.822267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-77534ea0-2868-4084-ac2a-9b57e0facd49 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:15.849655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77534ea0-2868-4084-ac2a-9b57e0facd49 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:15.850508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77534ea0-2868-4084-ac2a-9b57e0facd49 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:15.851122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77534ea0-2868-4084-ac2a-9b57e0facd49 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:15.852531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77534ea0-2868-4084-ac2a-9b57e0facd49 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:15.853159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77534ea0-2868-4084-ac2a-9b57e0facd49 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:15.853776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77534ea0-2868-4084-ac2a-9b57e0facd49 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:15.865401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-15376401-c5af-4120-9e51-4521cc68b101 req-3c6bc129-172d-4493-a9a8-bd8c378b32e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ede2f7-922c-4907-aa78-80424284f494", "name": "network-vif-plugged", "status": "completed", "tag": "bbc48a33-dd3b-4e9f-a396-8c6b5e5fc4d9"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:15.902090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-15376401-c5af-4120-9e51-4521cc68b101 req-3c6bc129-172d-4493-a9a8-bd8c378b32e2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:15.903966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-15376401-c5af-4120-9e51-4521cc68b101 req-3c6bc129-172d-4493-a9a8-bd8c378b32e2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:15.907488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-15376401-c5af-4120-9e51-4521cc68b101 req-3c6bc129-172d-4493-a9a8-bd8c378b32e2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:15.958473 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-15376401-c5af-4120-9e51-4521cc68b101 req-3c6bc129-172d-4493-a9a8-bd8c378b32e2 service nova] Creating event network-vif-plugged:bbc48a33-dd3b-4e9f-a396-8c6b5e5fc4d9 for instance 54ede2f7-922c-4907-aa78-80424284f494 on n-h1-852084-5 Aug 27 02:57:15.984871 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-15376401-c5af-4120-9e51-4521cc68b101 req-3c6bc129-172d-4493-a9a8-bd8c378b32e2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122431 Aug 27 02:57:15.991479 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2252/4691] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:57:17.003034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-77534ea0-2868-4084-ac2a-9b57e0facd49 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:17.024746 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-77534ea0-2868-4084-ac2a-9b57e0facd49 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1314 microversion: 2.1 time: 1.208067 Aug 27 02:57:17.034692 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2440/4692] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:15 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1314 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:18.104958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42901e67-8b4c-4e42-ab66-7e9f79428fed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:18.106840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-42901e67-8b4c-4e42-ab66-7e9f79428fed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:18.192122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42901e67-8b4c-4e42-ab66-7e9f79428fed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:18.199920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42901e67-8b4c-4e42-ab66-7e9f79428fed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:18.205149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42901e67-8b4c-4e42-ab66-7e9f79428fed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:18.207406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42901e67-8b4c-4e42-ab66-7e9f79428fed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:18.212452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42901e67-8b4c-4e42-ab66-7e9f79428fed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:18.219549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42901e67-8b4c-4e42-ab66-7e9f79428fed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:18.997189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-42901e67-8b4c-4e42-ab66-7e9f79428fed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:19.040216 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42901e67-8b4c-4e42-ab66-7e9f79428fed tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1499 microversion: 2.1 time: 0.974554 Aug 27 02:57:19.043968 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2253/4693] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:18 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1499 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:19.068936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-98cd3401-7f1f-4d74-bc74-7649c5373846 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:19.069867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-98cd3401-7f1f-4d74-bc74-7649c5373846 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:19.087198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cd3401-7f1f-4d74-bc74-7649c5373846 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:19.087697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cd3401-7f1f-4d74-bc74-7649c5373846 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:19.088145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cd3401-7f1f-4d74-bc74-7649c5373846 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:19.088869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cd3401-7f1f-4d74-bc74-7649c5373846 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:19.089327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cd3401-7f1f-4d74-bc74-7649c5373846 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:19.089814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cd3401-7f1f-4d74-bc74-7649c5373846 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:19.218700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-98cd3401-7f1f-4d74-bc74-7649c5373846 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lazy-loading 'flavor' on Instance uuid 54ede2f7-922c-4907-aa78-80424284f494 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:19.375570 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-98cd3401-7f1f-4d74-bc74-7649c5373846 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "POST /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494/action" status: 202 len: 0 microversion: 2.1 time: 0.312034 Aug 27 02:57:19.376851 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2441/4694] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 02:57:19 2022] POST /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 02:57:19.389522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cbd7a499-7323-429a-ad6d-3cda3de3a32d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:19.392779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cbd7a499-7323-429a-ad6d-3cda3de3a32d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:19.454374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbd7a499-7323-429a-ad6d-3cda3de3a32d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:19.457483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbd7a499-7323-429a-ad6d-3cda3de3a32d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:19.459470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbd7a499-7323-429a-ad6d-3cda3de3a32d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:19.466758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbd7a499-7323-429a-ad6d-3cda3de3a32d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:19.472593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbd7a499-7323-429a-ad6d-3cda3de3a32d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:19.476760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbd7a499-7323-429a-ad6d-3cda3de3a32d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:20.235698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cbd7a499-7323-429a-ad6d-3cda3de3a32d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:20.250561 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cbd7a499-7323-429a-ad6d-3cda3de3a32d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1507 microversion: 2.1 time: 0.868685 Aug 27 02:57:20.255375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-293795999", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "46fac100-c7ba-4530-8820-a15775cff4dd"}, {"port": "6c17a27c-00fe-4329-bd88-3dc5472ea946", "tag": "port-1"}, {"port": "c28154bb-c273-436a-a667-e993cd82b114", "tag": "port-2"}, {"uuid": "0e6a6a31-ee91-41f8-8642-4934ffdcaa1c", "tag": "net-1"}, {"uuid": "0e6a6a31-ee91-41f8-8642-4934ffdcaa1c"}, {"uuid": "59432148-8ddd-448c-80de-02448029acf5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "59432148-8ddd-448c-80de-02448029acf5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "bfcd097e-645d-4399-80a9-cf5414537210", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f4c93066-dac0-4c11-bd82-76b7e534ceac", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1c37a2fc-b34c-4fe3-94a5-580877582819", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--46544204"}], "key_name": "tempest-keypair-1394915717", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:20.273234 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2254/4695] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:19 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1507 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:20.822591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] validate_networks() for [('46fac100-c7ba-4530-8820-a15775cff4dd', None, None, None, None, None), (None, None, '6c17a27c-00fe-4329-bd88-3dc5472ea946', None, None, None), (None, None, 'c28154bb-c273-436a-a667-e993cd82b114', None, None, None), ('0e6a6a31-ee91-41f8-8642-4934ffdcaa1c', None, None, None, None, None), ('0e6a6a31-ee91-41f8-8642-4934ffdcaa1c', None, None, None, None, None), ('59432148-8ddd-448c-80de-02448029acf5', '10.2.2.100', None, None, None, None), ('59432148-8ddd-448c-80de-02448029acf5', '10.2.2.200', None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:57:21.282136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f1ca5459-9c6f-494c-93c8-4356653fd93d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:21.283406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f1ca5459-9c6f-494c-93c8-4356653fd93d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:21.313831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1ca5459-9c6f-494c-93c8-4356653fd93d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:21.317055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1ca5459-9c6f-494c-93c8-4356653fd93d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:21.317543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1ca5459-9c6f-494c-93c8-4356653fd93d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:21.318325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1ca5459-9c6f-494c-93c8-4356653fd93d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:21.318794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1ca5459-9c6f-494c-93c8-4356653fd93d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:21.319235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1ca5459-9c6f-494c-93c8-4356653fd93d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:21.843912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f1ca5459-9c6f-494c-93c8-4356653fd93d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:21.858899 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f1ca5459-9c6f-494c-93c8-4356653fd93d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1490 microversion: 2.1 time: 0.580103 Aug 27 02:57:21.874138 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2255/4696] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:21 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1490 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:21.904315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-554bfa6f-8339-4a3e-b03f-d6b876070e7e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:21.906170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-554bfa6f-8339-4a3e-b03f-d6b876070e7e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:21.931335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-554bfa6f-8339-4a3e-b03f-d6b876070e7e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:21.934577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-554bfa6f-8339-4a3e-b03f-d6b876070e7e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:21.935124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-554bfa6f-8339-4a3e-b03f-d6b876070e7e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:21.938821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-554bfa6f-8339-4a3e-b03f-d6b876070e7e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:21.941328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-554bfa6f-8339-4a3e-b03f-d6b876070e7e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:21.941821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-554bfa6f-8339-4a3e-b03f-d6b876070e7e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:22.041759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-554bfa6f-8339-4a3e-b03f-d6b876070e7e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:57:22.335110 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-554bfa6f-8339-4a3e-b03f-d6b876070e7e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 204 len: 0 microversion: 2.1 time: 0.453371 Aug 27 02:57:22.340751 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2256/4697] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:57:21 2022] DELETE /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 02:57:22.349414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92df6bf2-2972-4f9a-b2ff-9d98f6ab1a0d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:22.359983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-92df6bf2-2972-4f9a-b2ff-9d98f6ab1a0d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:22.386231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92df6bf2-2972-4f9a-b2ff-9d98f6ab1a0d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:22.387269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92df6bf2-2972-4f9a-b2ff-9d98f6ab1a0d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:22.388154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92df6bf2-2972-4f9a-b2ff-9d98f6ab1a0d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:22.389970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92df6bf2-2972-4f9a-b2ff-9d98f6ab1a0d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:22.392179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92df6bf2-2972-4f9a-b2ff-9d98f6ab1a0d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:22.393661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92df6bf2-2972-4f9a-b2ff-9d98f6ab1a0d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:22.718690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-92df6bf2-2972-4f9a-b2ff-9d98f6ab1a0d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:22.744094 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-92df6bf2-2972-4f9a-b2ff-9d98f6ab1a0d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1496 microversion: 2.1 time: 0.399519 Aug 27 02:57:22.760833 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2257/4698] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:22 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1496 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:23.571775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:23.768031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4f4fdb49-2dce-4c03-9c24-d8fef0f0b0c3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:23.769510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4f4fdb49-2dce-4c03-9c24-d8fef0f0b0c3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:23.793238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f4fdb49-2dce-4c03-9c24-d8fef0f0b0c3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:23.802463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f4fdb49-2dce-4c03-9c24-d8fef0f0b0c3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:23.802950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f4fdb49-2dce-4c03-9c24-d8fef0f0b0c3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:23.803718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f4fdb49-2dce-4c03-9c24-d8fef0f0b0c3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:23.804201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f4fdb49-2dce-4c03-9c24-d8fef0f0b0c3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:23.810200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4f4fdb49-2dce-4c03-9c24-d8fef0f0b0c3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:25.641113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4f4fdb49-2dce-4c03-9c24-d8fef0f0b0c3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:25.668115 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4f4fdb49-2dce-4c03-9c24-d8fef0f0b0c3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1496 microversion: 2.1 time: 1.905046 Aug 27 02:57:25.668938 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2258/4699] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:23 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1496 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:57:26.724340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2e494d8-335f-4592-a0cc-6fbd87e36e0e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:26.731318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c2e494d8-335f-4592-a0cc-6fbd87e36e0e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:26.782424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2e494d8-335f-4592-a0cc-6fbd87e36e0e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:26.785421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2e494d8-335f-4592-a0cc-6fbd87e36e0e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:26.791351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2e494d8-335f-4592-a0cc-6fbd87e36e0e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:26.798532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2e494d8-335f-4592-a0cc-6fbd87e36e0e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:26.803014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2e494d8-335f-4592-a0cc-6fbd87e36e0e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:26.808217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2e494d8-335f-4592-a0cc-6fbd87e36e0e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.556038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c2e494d8-335f-4592-a0cc-6fbd87e36e0e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:28.608258 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c2e494d8-335f-4592-a0cc-6fbd87e36e0e tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1496 microversion: 2.1 time: 1.911252 Aug 27 02:57:28.617134 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2259/4700] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:26 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1496 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:28.677468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-f3bea967-32fa-4121-8f02-6b861c0ba772 req-8097c8bf-c071-43c2-92f0-194c499eb1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ede2f7-922c-4907-aa78-80424284f494", "name": "network-vif-deleted", "tag": "bbc48a33-dd3b-4e9f-a396-8c6b5e5fc4d9"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:57:28.789034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f3bea967-32fa-4121-8f02-6b861c0ba772 req-8097c8bf-c071-43c2-92f0-194c499eb1f3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:28.796747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f3bea967-32fa-4121-8f02-6b861c0ba772 req-8097c8bf-c071-43c2-92f0-194c499eb1f3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:28.805559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f3bea967-32fa-4121-8f02-6b861c0ba772 req-8097c8bf-c071-43c2-92f0-194c499eb1f3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:28.892756 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-f3bea967-32fa-4121-8f02-6b861c0ba772 req-8097c8bf-c071-43c2-92f0-194c499eb1f3 service nova] Creating event network-vif-deleted:bbc48a33-dd3b-4e9f-a396-8c6b5e5fc4d9 for instance 54ede2f7-922c-4907-aa78-80424284f494 on n-h1-852084-5 Aug 27 02:57:28.920369 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-f3bea967-32fa-4121-8f02-6b861c0ba772 req-8097c8bf-c071-43c2-92f0-194c499eb1f3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262612 Aug 27 02:57:28.926691 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2260/4701] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:57:29.360596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:29.640901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:29.644902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:29.662724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.663225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.663669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.664379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.673311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.678284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.816931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:29.819151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:29.819849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:29.823413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lazy-loading 'fault' on Instance uuid 54ede2f7-922c-4907-aa78-80424284f494 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 02:57:29.994693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b508f2fe4b394f589b067f5b3de49a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b2a380b54544c8b910b5aba84d8d148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:29.997908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:30.035190 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ca61f20e-825f-4e78-9def-3c20da12a40a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 200 len: 1304 microversion: 2.1 time: 0.398690 Aug 27 02:57:30.038556 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2261/4702] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:29 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 1304 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:57:31.063942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:31.064991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:31.088688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:31.101135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.108219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.110143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.116401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.118229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.119803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.209843 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 HTTP/1.1 Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '54ede2f7-922c-4907-aa78-80424284f494'} Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.214233 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.223865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.223865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.223865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.223865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:31.223865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:31.223865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.223865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.223865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:31.225292 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9096ba50-f9e6-43c2-8855-1765439bf123 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 404 len: 111 microversion: 2.1 time: 0.160885 Aug 27 02:57:31.227314 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2262/4703] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:31 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:31.239802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:31.240314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:31.248223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.248727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.249237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.249986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.250454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.250881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.273732 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 HTTP/1.1 Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '54ede2f7-922c-4907-aa78-80424284f494'} Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:31.276867 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:31.280905 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.280905 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.280905 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.280905 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.280905 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.280905 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.280905 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.280905 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:31.280905 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:31.280905 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.280905 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.286235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:31.287589 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d6ff7c99-fdcf-4e04-b0ce-45aa3236f9a3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 404 len: 111 microversion: 2.1 time: 0.051898 Aug 27 02:57:31.288800 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2263/4704] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:57:31 2022] DELETE /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:31.302568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:31.308407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 54ede2f7-922c-4907-aa78-80424284f494] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:31.316154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.317038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.318588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.319558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.320279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.320947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.350226 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 HTTP/1.1 Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '54ede2f7-922c-4907-aa78-80424284f494'} Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.352849 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.357086 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.357086 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.357086 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.357086 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:31.357086 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:31.357086 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. Aug 27 02:57:31.357086 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.361514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 54ede2f7-922c-4907-aa78-80424284f494 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:31.368194 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4a9ece9d-6f8c-4ae7-b54a-bd3d03dd46f3 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494" status: 404 len: 111 microversion: 2.1 time: 0.070329 Aug 27 02:57:31.369413 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2264/4705] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:31 2022] GET /compute/v2.1/servers/54ede2f7-922c-4907-aa78-80424284f494 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:31.400161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:31.400679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:31.433173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.433855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.434288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.435127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.435577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.436125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.475053 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c HTTP/1.1 Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '56145f6f-c258-480c-ab99-366c209b6d7c'} Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:31.481507 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-45621740-b089-4083-910c-faff6f027277 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 404 len: 111 microversion: 2.1 time: 0.101974 Aug 27 02:57:31.491518 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2265/4706] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:57:31 2022] DELETE /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:31.505566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:31.506552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 56145f6f-c258-480c-ab99-366c209b6d7c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:31.550541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.551460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.554497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.557070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.557777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.560670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.600213 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c HTTP/1.1 Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '56145f6f-c258-480c-ab99-366c209b6d7c'} Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.607325 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.613804 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.613804 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.613804 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.613804 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:31.613804 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:31.613804 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. Aug 27 02:57:31.613804 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.630703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 56145f6f-c258-480c-ab99-366c209b6d7c could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:31.631998 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5ffa2e28-6cad-4712-81e1-14b4a3e72493 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c" status: 404 len: 111 microversion: 2.1 time: 0.139787 Aug 27 02:57:31.635925 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2266/4707] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:31 2022] GET /compute/v2.1/servers/56145f6f-c258-480c-ab99-366c209b6d7c => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:31.645045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:31.653424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:31.665985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.666490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.667181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.678787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.679454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.686562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.744260 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] HTTP exception thrown: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Request method failure captured: Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 HTTP/1.1 Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYZGh0D0YP_GLdVdQvlcUEp_UbStoIx5H11VeENXdtpctex2GQhIvbH0RJzet1-3vLWq-08vju8qPuFW0KMBvUQ7oTjpMP1Xb8sWU_5ujgaJeyRxUmITqqNTl7yAxJ1GPTAEVmNgjp5Sn_rGqTeoGE6zSnsUlGyU_Gyvxkr0lA28tWY Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d4399d0cd9ba4a16a4db45cf851a54f5"}]}] Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: bfefa59129eb427687ac388dbd000d25 Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '78c66c64-3779-46eb-a94b-b6a11b2cc928'} Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:31.753531 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.757555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Returning 404 to user: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:31.763404 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5b9ff376-294f-4074-b7af-dd4a3b5b617a tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "DELETE /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 404 len: 111 microversion: 2.1 time: 0.121938 Aug 27 02:57:31.764151 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2267/4708] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:57:31 2022] DELETE /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:31.775422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:31.777422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:31.791566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.793579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.795596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.797010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.800849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.801544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.838744 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f HTTP/1.1 Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'bda401e7-53e0-4698-b32b-031c49b5cf5f'} Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:31.842566 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:31.849300 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:57:31.849300 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.849300 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:31.849300 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.849300 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:31.849300 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:31.849300 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:31.849300 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:31.849300 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:31.849300 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:57:31.849300 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:31.852104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:31.855516 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-db62d975-45a0-490d-8011-618108366d08 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 404 len: 111 microversion: 2.1 time: 0.085237 Aug 27 02:57:31.857566 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2268/4709] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:57:31 2022] DELETE /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:31.890318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:31.895338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 78c66c64-3779-46eb-a94b-b6a11b2cc928] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:31.910143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.911571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.912618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:31.914995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:31.917065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:31.919756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.001142 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] HTTP exception thrown: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Request method failure captured: Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 HTTP/1.1 Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYZGh0D0YP_GLdVdQvlcUEp_UbStoIx5H11VeENXdtpctex2GQhIvbH0RJzet1-3vLWq-08vju8qPuFW0KMBvUQ7oTjpMP1Xb8sWU_5ujgaJeyRxUmITqqNTl7yAxJ1GPTAEVmNgjp5Sn_rGqTeoGE6zSnsUlGyU_Gyvxkr0lA28tWY Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d4399d0cd9ba4a16a4db45cf851a54f5"}]}] Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: bfefa59129eb427687ac388dbd000d25 Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '78c66c64-3779-46eb-a94b-b6a11b2cc928'} Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.005211 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.010963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.010963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.010963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.010963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:32.010963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:32.010963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. Aug 27 02:57:32.010963 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.015988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Returning 404 to user: Instance 78c66c64-3779-46eb-a94b-b6a11b2cc928 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:32.017006 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bee81bfe-31f2-4666-98ae-0120ac7ec668 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928" status: 404 len: 111 microversion: 2.1 time: 0.156500 Aug 27 02:57:32.037924 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2269/4710] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:31 2022] GET /compute/v2.1/servers/78c66c64-3779-46eb-a94b-b6a11b2cc928 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:32.051295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:32.065322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: bda401e7-53e0-4698-b32b-031c49b5cf5f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:32.096652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.096652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.096652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.096968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.113221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.114217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.146668 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f HTTP/1.1 Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'bda401e7-53e0-4698-b32b-031c49b5cf5f'} Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.168728 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.173584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.173584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.173584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.173584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:32.173584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:32.173584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. Aug 27 02:57:32.173584 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.173584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance bda401e7-53e0-4698-b32b-031c49b5cf5f could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:32.173584 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b1922596-6b55-4abc-a94d-cfc73304559d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f" status: 404 len: 111 microversion: 2.1 time: 0.133107 Aug 27 02:57:32.178466 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2270/4711] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:32 2022] GET /compute/v2.1/servers/bda401e7-53e0-4698-b32b-031c49b5cf5f => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:32.193383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:32.194014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:32.213642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.216880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.217866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.220558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.221287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.223435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.271709 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a HTTP/1.1 Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5f304ff1-b05a-47e9-ad46-9655aef3545a'} Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:32.275814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.281433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:32.283000 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-21fe31fd-7fa2-4fb9-a136-9d14a39322af tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 404 len: 111 microversion: 2.1 time: 0.101644 Aug 27 02:57:32.286911 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2271/4712] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:57:32 2022] DELETE /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:32.296425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:32.331201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 5f304ff1-b05a-47e9-ad46-9655aef3545a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:32.351106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.356977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.358213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.365787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.368034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.368700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.416150 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a HTTP/1.1 Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5f304ff1-b05a-47e9-ad46-9655aef3545a'} Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.420990 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.426264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.426264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.426264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.426264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:32.426264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:32.426264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. Aug 27 02:57:32.426264 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.426264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 5f304ff1-b05a-47e9-ad46-9655aef3545a could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:32.432634 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-28e07dec-133c-40aa-8de4-be9771956e1d tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a" status: 404 len: 111 microversion: 2.1 time: 0.135106 Aug 27 02:57:32.437584 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2272/4713] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:32 2022] GET /compute/v2.1/servers/5f304ff1-b05a-47e9-ad46-9655aef3545a => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:32.448826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-377ff268-326f-4988-ba4b-b73eeb9ac8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:32.449342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-377ff268-326f-4988-ba4b-b73eeb9ac8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 73949063-b30f-4fe6-850f-920c49740738] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:32.467184 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-377ff268-326f-4988-ba4b-b73eeb9ac8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-377ff268-326f-4988-ba4b-b73eeb9ac8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738 HTTP/1.1 Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '73949063-b30f-4fe6-850f-920c49740738'} Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.479038 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.486073 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.486073 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.486073 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.486073 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.486073 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:32.486073 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:32.486073 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:57:32.486073 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.486073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-377ff268-326f-4988-ba4b-b73eeb9ac8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:32.486073 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-377ff268-326f-4988-ba4b-b73eeb9ac8cf tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738" status: 404 len: 111 microversion: 2.1 time: 0.041929 Aug 27 02:57:32.495322 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2273/4714] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:57:32 2022] DELETE /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:32.511892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8d8369bd-b6fe-4c10-a9d5-5441cca23316 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:32.513542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8d8369bd-b6fe-4c10-a9d5-5441cca23316 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 73949063-b30f-4fe6-850f-920c49740738] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:32.523928 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-8d8369bd-b6fe-4c10-a9d5-5441cca23316 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8d8369bd-b6fe-4c10-a9d5-5441cca23316 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738 HTTP/1.1 Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '73949063-b30f-4fe6-850f-920c49740738'} Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:32.526406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:32.530444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:32.530444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:32.530444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:32.530444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. Aug 27 02:57:32.530444 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:32.532582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8d8369bd-b6fe-4c10-a9d5-5441cca23316 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 73949063-b30f-4fe6-850f-920c49740738 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:32.534205 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8d8369bd-b6fe-4c10-a9d5-5441cca23316 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738" status: 404 len: 111 microversion: 2.1 time: 0.037378 Aug 27 02:57:32.535022 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2274/4715] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:32 2022] GET /compute/v2.1/servers/73949063-b30f-4fe6-850f-920c49740738 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:32.556670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:57:32.557222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:57:32.557640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:57:32.558037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:57:32.559204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:57:32.609131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.619228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.620415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.622192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:32.625222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:32.630979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:32.704941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Getting quotas for project f65a5ba69d8d45399945c01090626fef. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:57:32.717524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Getting quotas for user 9c5eafff09dd462d89bbab3403bbc878 and project f65a5ba69d8d45399945c01090626fef. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:57:33.134281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:57:33.138383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='bfcd097e-645d-4399-80a9-cf5414537210',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f4c93066-dac0-4c11-bd82-76b7e534ceac',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c37a2fc-b34c-4fe3-94a5-580877582819',volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:57:33.936629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:34.074826 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-244b2a3e-19c9-4cf0-88db-6ca4f41344cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 13.828271 Aug 27 02:57:34.078592 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2442/4716] 10.222.0.99 () {62 vars in 1189 bytes} [Sat Aug 27 02:57:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 13839 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 02:57:34.112634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d4a83e59-22d4-457a-90f1-fa40a875e3c3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:34.115620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d4a83e59-22d4-457a-90f1-fa40a875e3c3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:34.489850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d4a83e59-22d4-457a-90f1-fa40a875e3c3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:34.507213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d4a83e59-22d4-457a-90f1-fa40a875e3c3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:34.516641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d4a83e59-22d4-457a-90f1-fa40a875e3c3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:34.520588 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d4a83e59-22d4-457a-90f1-fa40a875e3c3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1285 microversion: 2.42 time: 0.420319 Aug 27 02:57:34.522921 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2275/4717] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:34 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1285 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:35.572374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a07f3b50-105f-45e6-85af-5866c4a19a31 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:35.574430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a07f3b50-105f-45e6-85af-5866c4a19a31 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:35.855411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a07f3b50-105f-45e6-85af-5866c4a19a31 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:35.887308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a07f3b50-105f-45e6-85af-5866c4a19a31 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:35.907167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a07f3b50-105f-45e6-85af-5866c4a19a31 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:35.919391 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a07f3b50-105f-45e6-85af-5866c4a19a31 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1285 microversion: 2.42 time: 0.353487 Aug 27 02:57:35.929017 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2443/4718] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:35 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1285 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:36.966452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:36.969025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:37.013783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:37.015228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:37.018501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:37.022018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:37.023047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:37.025306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:37.394961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:37.421778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:37.424849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:37.440264 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb05274a-e14f-40b9-92f4-f4ac788f7ee8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1527 microversion: 2.42 time: 0.488796 Aug 27 02:57:37.444262 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2276/4719] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:36 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1527 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:38.474905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:38.476263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:38.497871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:38.511160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:38.513816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:38.519948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:38.523313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:38.524095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:38.887298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:38.897718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:38.925132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:38.926910 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d4de8f8e-be16-4edc-9e4f-32db1ec33ceb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1583 microversion: 2.42 time: 0.456426 Aug 27 02:57:38.927087 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2444/4720] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:38 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1583 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:39.978213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:39.978961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:40.023044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:40.029366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:40.038187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:40.040126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:40.049804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:40.052321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:40.641503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:40.656204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:40.659525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:40.668919 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d106fcd0-982f-4285-a410-da751c03b6b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1593 microversion: 2.42 time: 0.696372 Aug 27 02:57:40.676672 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2277/4721] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:39 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1593 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:41.709860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:41.712105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:41.757231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:41.760839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:41.764570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:41.766409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:41.774896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:41.776244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:42.004401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:42.011687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:42.058559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:42.063817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:42.068236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:42.073880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:42.076947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:42.079577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:42.119784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:42.162530 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] HTTP exception thrown: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Request method failure captured: Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 HTTP/1.1 Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYZGh0D0YP_GLdVdQvlcUEp_UbStoIx5H11VeENXdtpctex2GQhIvbH0RJzet1-3vLWq-08vju8qPuFW0KMBvUQ7oTjpMP1Xb8sWU_5ujgaJeyRxUmITqqNTl7yAxJ1GPTAEVmNgjp5Sn_rGqTeoGE6zSnsUlGyU_Gyvxkr0lA28tWY Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d4399d0cd9ba4a16a4db45cf851a54f5"}]}] Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: bfefa59129eb427687ac388dbd000d25 Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2'} Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:42.174732 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:42.187322 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:57:42.187322 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:42.187322 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:42.187322 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:42.187322 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:42.187322 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:42.187322 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:42.187322 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:42.187322 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:42.187322 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:57:42.187322 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:42.191533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:42.194643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Returning 404 to user: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:42.201484 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-74e53085-49fe-4b32-be0a-ee0d4bd59621 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 404 len: 111 microversion: 2.1 time: 0.203826 Aug 27 02:57:42.203672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:42.205994 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-678b5fbf-0261-4c62-be2b-7e18b337d31b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1593 microversion: 2.42 time: 0.503042 Aug 27 02:57:42.206231 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2278/4722] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:57:41 2022] DELETE /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:42.213270 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2445/4723] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:41 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1593 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:57:42.233776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:42.235861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] [instance: 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:42.263373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:42.266608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:42.268185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:42.269473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:42.271221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:42.274054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:42.343891 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] HTTP exception thrown: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Request method failure captured: Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 HTTP/1.1 Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYZGh0D0YP_GLdVdQvlcUEp_UbStoIx5H11VeENXdtpctex2GQhIvbH0RJzet1-3vLWq-08vju8qPuFW0KMBvUQ7oTjpMP1Xb8sWU_5ujgaJeyRxUmITqqNTl7yAxJ1GPTAEVmNgjp5Sn_rGqTeoGE6zSnsUlGyU_Gyvxkr0lA28tWY Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d4399d0cd9ba4a16a4db45cf851a54f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d4399d0cd9ba4a16a4db45cf851a54f5"}]}] Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: d4399d0cd9ba4a16a4db45cf851a54f5 Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1060625674 Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: bfefa59129eb427687ac388dbd000d25 Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeTestJSON-1060625674-project Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2'} Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:42.350177 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:42.355821 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:42.355821 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:42.355821 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:42.355821 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:42.355821 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:42.355821 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. Aug 27 02:57:42.355821 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:42.355821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] Returning 404 to user: Instance 5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:42.359212 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-85d1f1db-6503-415f-b3b7-2f961c692003 tempest-AttachVolumeTestJSON-1060625674 tempest-AttachVolumeTestJSON-1060625674-project] 10.222.0.99 "GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2" status: 404 len: 111 microversion: 2.1 time: 0.141091 Aug 27 02:57:42.364304 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2279/4724] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:42 2022] GET /compute/v2.1/servers/5fae0b6a-4a24-4ff4-a7a3-ca41ce15adf2 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:43.245804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:43.255152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:43.264305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:43.312049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:43.312908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:43.313735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:43.324138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:43.324972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:43.325871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:45.254617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:45.333073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:45.336934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:45.358402 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-24f19bb3-5ae0-467c-9951-a80a2cb7c4b6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1659 microversion: 2.42 time: 2.114711 Aug 27 02:57:45.360788 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2446/4725] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:43 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1659 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:45.801876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:45.802654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:45.823825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:45.827959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:45.830152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:45.832594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:45.835814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:45.839129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:45.840098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:45.897556 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 HTTP/1.1 Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'e181b7bb-e89e-413d-9879-818eb731e6f5'} Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:45.899752 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:45.903820 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:57:45.903820 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:45.903820 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:45.903820 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:45.903820 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:45.903820 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:45.903820 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:45.903820 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:45.903820 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:45.903820 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:57:45.903820 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:45.909698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:45.912955 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-35503719-c607-41d6-af3b-8168a73bfc7b tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 404 len: 111 microversion: 2.1 time: 0.115672 Aug 27 02:57:45.918233 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2280/4726] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:57:45 2022] DELETE /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:45.926191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:45.927208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: e181b7bb-e89e-413d-9879-818eb731e6f5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:45.931125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:57:45.942099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:45.950622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:45.953384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:45.954550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:45.957170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:45.960582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.012710 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 HTTP/1.1 Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'e181b7bb-e89e-413d-9879-818eb731e6f5'} Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:46.023677 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.028350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:46.028350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:46.028350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:46.028350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:46.028350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:46.028350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. Aug 27 02:57:46.028350 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.029585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance e181b7bb-e89e-413d-9879-818eb731e6f5 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:46.032480 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-98cc12f5-13b5-4fc8-b1d6-6ee44526f0db tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5" status: 404 len: 111 microversion: 2.1 time: 0.108469 Aug 27 02:57:46.037112 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2447/4727] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:45 2022] GET /compute/v2.1/servers/e181b7bb-e89e-413d-9879-818eb731e6f5 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:46.042868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:46.043398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:46.060791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.062644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.065633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.066577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.068361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.069415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.119325 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 HTTP/1.1 Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '7a7a96de-d7d1-42d0-a191-cbd4d7f257c1'} Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:46.134814 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:46.139548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:57:46.139548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.139548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:46.139548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.139548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:46.139548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:46.139548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:46.139548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:46.139548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:46.139548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:57:46.139548 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.141331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:46.148416 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9e7865e5-934c-4d95-8b36-e9b50978d46a tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 404 len: 111 microversion: 2.1 time: 0.109623 Aug 27 02:57:46.149949 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2281/4728] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 02:57:46 2022] DELETE /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:46.159272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:46.159908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] [instance: 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:46.171311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.171852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.172359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.173050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.174040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.174560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.236160 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] HTTP exception thrown: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Request method failure captured: Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 HTTP/1.1 Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYa_Isq52BHJk7Ktj1_bqXd84mZv8G4q-NhhAXZX9Yi5Q7dOKYv6NSmBke-2-zFeVXrVe1MPb2P1ZNm87BqCpzOVegAFuL1rdFMtigskOkstkHlX_00CQbKeaKQyuTN3_w9QBygGrAxjN413j-dMOTieOQXbqcsaKP5rrJk2ZP0Xbz0 Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2b2a380b54544c8b910b5aba84d8d148"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2b2a380b54544c8b910b5aba84d8d148"}]}] Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 2b2a380b54544c8b910b5aba84d8d148 Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-DeleteServersTestJSON-2134076272 Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b508f2fe4b394f589b067f5b3de49a0e Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-DeleteServersTestJSON-2134076272-project Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '7a7a96de-d7d1-42d0-a191-cbd4d7f257c1'} Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:57:46.240402 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.256408 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:57:46.256408 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:57:46.256408 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:57:46.256408 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:57:46.256408 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:57:46.256408 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. Aug 27 02:57:46.256408 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:57:46.256408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] Returning 404 to user: Instance 7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:57:46.256408 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-623bc5d9-9dd3-4035-9906-c6bbdade5895 tempest-DeleteServersTestJSON-2134076272 tempest-DeleteServersTestJSON-2134076272-project] 10.222.0.99 "GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1" status: 404 len: 111 microversion: 2.1 time: 0.086783 Aug 27 02:57:46.256408 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2448/4729] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:57:46 2022] GET /compute/v2.1/servers/7a7a96de-d7d1-42d0-a191-cbd4d7f257c1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 02:57:46.391526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:46.392575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:46.404856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.405802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.407809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:46.409456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:46.413142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:46.417080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:48.091065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:48.108279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:48.109889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:48.118218 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ef41803-1f11-4fd7-a657-12ecfe8ce3c2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1704 microversion: 2.42 time: 1.724132 Aug 27 02:57:48.132479 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2282/4730] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:46 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1704 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:49.145333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:49.146481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:49.167306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:49.168184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:49.168912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:49.175912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:49.183630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:49.184637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:50.665224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:50.701348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:50.703617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:50.712263 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-da069a02-e914-41a9-860a-729401a2328d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1704 microversion: 2.42 time: 1.568625 Aug 27 02:57:50.718782 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2449/4731] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:49 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1704 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:51.745067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:51.746569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:51.762497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:51.763185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:51.763830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:51.764700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:51.765316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:51.765926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:53.021866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:53.110310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:53.129271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:53.138458 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0bfb4466-a023-419a-8fd4-b3d94cef4fda tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1749 microversion: 2.42 time: 1.392227 Aug 27 02:57:53.146807 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2283/4732] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:51 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1749 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:54.171154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:54.172127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:54.188608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:54.189864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:54.190321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:54.194956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:54.194956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:54.194956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:54.903504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:54.923201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:54.925286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:54.926815 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0915a1c3-7990-42b6-acc4-0bffdbee193a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1749 microversion: 2.42 time: 0.759748 Aug 27 02:57:54.945718 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2450/4733] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:54 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1749 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:55.955272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:55.956011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:55.982909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:55.984616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:55.994157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:55.996935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:56.001447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:56.002236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:57.056650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:57.129471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:57.139105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:57.140888 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c324936e-57f2-45f5-b5cf-9ded3b644e1c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1794 microversion: 2.42 time: 1.192023 Aug 27 02:57:57.143286 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2284/4734] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:55 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1794 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:57:58.188947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:57:58.189819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:57:58.211560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:58.214200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:58.215047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:58.217914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:57:58.218517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:57:58.219122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:57:59.226798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:59.248987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:59.250902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:57:59.252920 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-01ca4232-5463-4fee-9607-94d92d9e0df2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1794 microversion: 2.42 time: 1.068078 Aug 27 02:57:59.254082 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2451/4735] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:57:58 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1794 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:00.291596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:00.292872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:00.313303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:00.314860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:00.320256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:00.321252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:00.326151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:00.328488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:01.488890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:01.515510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=66 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:01.524074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:01.528679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:01.536886 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b845d02e-0688-4760-affb-b59d5d179819 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1839 microversion: 2.42 time: 1.248758 Aug 27 02:58:01.541767 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2285/4736] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:00 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1839 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:02.571005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:02.571823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:02.588646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:02.590335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:02.591415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:02.593191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:02.597907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:02.599103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:02.626354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=43 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:03.574103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:03.609754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:03.626723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:03.629254 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-837e2421-ef47-4571-a476-8cab9bf14765 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1839 microversion: 2.42 time: 1.063529 Aug 27 02:58:03.644178 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2452/4737] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:02 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1839 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:04.683909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:04.688198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:04.691967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=50 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:04.728425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:04.730854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:04.734958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:04.736743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:04.737718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:04.739892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:06.195271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:06.212291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:06.217821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:06.219842 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-560daab7-e501-4e0d-8edc-64e39a153a27 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1839 microversion: 2.42 time: 1.543804 Aug 27 02:58:06.234492 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2286/4738] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:04 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1839 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:07.249221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:07.250055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:07.253365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=23 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:07.272725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:07.273263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:07.273818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:07.274578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:07.275074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:07.275515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:07.417582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c7c5b796-94f4-4871-9516-d66a8fb24f3b req-83c55c69-ea7c-4fef-b1b9-5d9e10fc2592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "tag": "d9dd5177-12fc-4a5a-a699-90fef2125241"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:07.450972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7c5b796-94f4-4871-9516-d66a8fb24f3b req-83c55c69-ea7c-4fef-b1b9-5d9e10fc2592 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:07.451461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7c5b796-94f4-4871-9516-d66a8fb24f3b req-83c55c69-ea7c-4fef-b1b9-5d9e10fc2592 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:07.451905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7c5b796-94f4-4871-9516-d66a8fb24f3b req-83c55c69-ea7c-4fef-b1b9-5d9e10fc2592 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:07.504813 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c7c5b796-94f4-4871-9516-d66a8fb24f3b req-83c55c69-ea7c-4fef-b1b9-5d9e10fc2592 service nova] Creating event network-changed:d9dd5177-12fc-4a5a-a699-90fef2125241 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:58:07.523247 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c7c5b796-94f4-4871-9516-d66a8fb24f3b req-83c55c69-ea7c-4fef-b1b9-5d9e10fc2592 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109282 Aug 27 02:58:07.532357 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2287/4739] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:08.052643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:08.063225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:08.064773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:08.094129 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-048ffdbb-8e69-4be7-8b69-6b1f54439096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1839 microversion: 2.42 time: 0.820846 Aug 27 02:58:08.122331 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2453/4740] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:07 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1839 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:09.124191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:09.125147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:09.150440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:09.154786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:09.158184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:09.160969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:09.163992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:09.165398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:09.890780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:09.911146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:09.916523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:09.917640 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-76348d6f-8cf8-47e7-aa6e-a311df92456a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1839 microversion: 2.42 time: 0.799022 Aug 27 02:58:09.918228 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2288/4741] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:09 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1839 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:10.962421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:10.963476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:10.993187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:10.994130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:10.995181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:10.997712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:11.000314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:11.001863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:11.505430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:11.521887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:11.527816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:11.534641 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5412425d-3b48-4c3a-a12a-e586057d7d3a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1860 microversion: 2.42 time: 0.581603 Aug 27 02:58:11.535511 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2454/4742] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:10 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1860 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:12.565176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:12.571952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:12.600073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:12.602671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:12.605188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:12.606881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:12.610646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:12.611707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:13.051950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4a5f2956-70e7-421d-9801-6febf2b8a7d8 req-6eee4e0d-9717-4526-94ce-1197b1721c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "tag": "6c17a27c-00fe-4329-bd88-3dc5472ea946"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:13.078620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4a5f2956-70e7-421d-9801-6febf2b8a7d8 req-6eee4e0d-9717-4526-94ce-1197b1721c4a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:13.081212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4a5f2956-70e7-421d-9801-6febf2b8a7d8 req-6eee4e0d-9717-4526-94ce-1197b1721c4a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:13.082003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4a5f2956-70e7-421d-9801-6febf2b8a7d8 req-6eee4e0d-9717-4526-94ce-1197b1721c4a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:13.167079 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4a5f2956-70e7-421d-9801-6febf2b8a7d8 req-6eee4e0d-9717-4526-94ce-1197b1721c4a service nova] Creating event network-changed:6c17a27c-00fe-4329-bd88-3dc5472ea946 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:58:13.183592 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4a5f2956-70e7-421d-9801-6febf2b8a7d8 req-6eee4e0d-9717-4526-94ce-1197b1721c4a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136248 Aug 27 02:58:13.186916 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2455/4743] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:14.321997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:14.345627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:14.348429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:14.354150 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1167af11-e580-4c8e-8496-908fcf6ba245 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1860 microversion: 2.42 time: 1.793048 Aug 27 02:58:14.354804 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2289/4744] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:12 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1860 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:15.391818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:15.393400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:15.406440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.419790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.420758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:15.424466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:15.425343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:15.430706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:16.404932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:16.426539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:16.438295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:16.441604 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d3d54573-2957-4c47-8c54-eeb3d666f932 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1881 microversion: 2.42 time: 1.061778 Aug 27 02:58:16.442267 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2456/4745] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:15 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1881 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:17.465829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:17.466376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:17.492727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:17.493240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:17.493711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:17.501827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:17.502446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:17.502899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:18.054284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-bfd0e6d7-18c6-4816-bbc1-8ae7e23218b5 req-2ab57a0d-c293-4ec2-b31f-ae8e447012d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "tag": "c28154bb-c273-436a-a667-e993cd82b114"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:18.104663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bfd0e6d7-18c6-4816-bbc1-8ae7e23218b5 req-2ab57a0d-c293-4ec2-b31f-ae8e447012d1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:18.108426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bfd0e6d7-18c6-4816-bbc1-8ae7e23218b5 req-2ab57a0d-c293-4ec2-b31f-ae8e447012d1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:18.114348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bfd0e6d7-18c6-4816-bbc1-8ae7e23218b5 req-2ab57a0d-c293-4ec2-b31f-ae8e447012d1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:18.177868 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-bfd0e6d7-18c6-4816-bbc1-8ae7e23218b5 req-2ab57a0d-c293-4ec2-b31f-ae8e447012d1 service nova] Creating event network-changed:c28154bb-c273-436a-a667-e993cd82b114 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:58:18.202077 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-bfd0e6d7-18c6-4816-bbc1-8ae7e23218b5 req-2ab57a0d-c293-4ec2-b31f-ae8e447012d1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150451 Aug 27 02:58:18.206868 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2457/4746] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:18.646840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:18.672027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:18.682369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:18.700078 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6501443a-85b4-4b7c-b248-d15dd24fe2c5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1881 microversion: 2.42 time: 1.239256 Aug 27 02:58:18.710586 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2290/4747] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:17 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1881 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:19.755829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:19.759231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:19.787924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:19.788286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:19.788751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:19.792458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:19.793033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:19.793492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:21.334301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:21.365466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:21.367303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:21.370623 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2cc9f484-0321-4ff7-8d06-58e2beb2fdd3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1881 microversion: 2.42 time: 1.618550 Aug 27 02:58:21.399050 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2458/4748] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:19 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1881 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:22.412047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:22.413045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:22.445479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:22.446795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:22.447913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:22.452324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:22.454419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:22.457910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:24.152010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:24.165415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:24.184846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:24.188675 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-23a3d5fc-c5c2-4a95-98de-952f8a6ec7a3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1881 microversion: 2.42 time: 1.784138 Aug 27 02:58:24.198519 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2291/4749] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:22 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1881 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:24.438599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a68e9618-c2db-43c3-87ea-296600b7429c req-b11c973d-cf01-4008-9e08-990546767493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "tag": "ee47c975-6b0f-4e9f-89fd-d2e4b902ab10"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:24.506707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a68e9618-c2db-43c3-87ea-296600b7429c req-b11c973d-cf01-4008-9e08-990546767493 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:24.507224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a68e9618-c2db-43c3-87ea-296600b7429c req-b11c973d-cf01-4008-9e08-990546767493 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:24.507673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a68e9618-c2db-43c3-87ea-296600b7429c req-b11c973d-cf01-4008-9e08-990546767493 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:24.571921 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a68e9618-c2db-43c3-87ea-296600b7429c req-b11c973d-cf01-4008-9e08-990546767493 service nova] Creating event network-changed:ee47c975-6b0f-4e9f-89fd-d2e4b902ab10 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:58:24.592535 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a68e9618-c2db-43c3-87ea-296600b7429c req-b11c973d-cf01-4008-9e08-990546767493 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157462 Aug 27 02:58:24.595115 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2459/4750] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:25.238456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:25.239829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:25.270208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:25.271787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:25.272423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:25.276323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:25.276817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:25.277266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:26.992503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:27.007238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:27.011146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:27.020722 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e5cb538c-78d2-4c4c-893c-4d4a1bb95569 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1881 microversion: 2.42 time: 1.797057 Aug 27 02:58:27.035228 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2292/4751] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:25 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1881 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:28.049908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:28.050692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:28.068242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:28.070303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:28.071025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:28.074115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:28.074880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:28.076039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:28.804644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:28.824448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:28.827309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:28.835808 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58091646-65bc-4078-8c49-1b63b169698d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1881 microversion: 2.42 time: 0.791308 Aug 27 02:58:28.854948 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2460/4752] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:28 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1881 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:29.880412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:29.881227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:29.913454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:29.915234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:29.916234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:29.919311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:29.924221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:29.924868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.337385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4f7450b3-f629-4d6a-b167-f838d3e0a958 req-702aa61d-8dc3-4047-9d61-667285ea4262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "tag": "b5b5aa70-cca4-4531-90fd-70d30d297d0f"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:30.387237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4f7450b3-f629-4d6a-b167-f838d3e0a958 req-702aa61d-8dc3-4047-9d61-667285ea4262 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:30.395953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4f7450b3-f629-4d6a-b167-f838d3e0a958 req-702aa61d-8dc3-4047-9d61-667285ea4262 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:30.396410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4f7450b3-f629-4d6a-b167-f838d3e0a958 req-702aa61d-8dc3-4047-9d61-667285ea4262 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:30.440049 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4f7450b3-f629-4d6a-b167-f838d3e0a958 req-702aa61d-8dc3-4047-9d61-667285ea4262 service nova] Creating event network-changed:b5b5aa70-cca4-4531-90fd-70d30d297d0f for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:58:30.452311 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4f7450b3-f629-4d6a-b167-f838d3e0a958 req-702aa61d-8dc3-4047-9d61-667285ea4262 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122553 Aug 27 02:58:30.453350 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2461/4753] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:31.574661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:31.595503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:31.613150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:31.617903 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8d534051-deed-4e7b-9f99-39599d4e35cf tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.758405 Aug 27 02:58:31.620328 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2293/4754] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:29 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:32.647345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:32.648075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:32.660241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:32.660738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:32.676064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:32.682660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:32.683173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:32.683631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:32.688633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=44 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:33.967945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:33.994515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:33.996259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:33.997509 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-be5a07f1-b756-4147-a0bf-6bc3d656a1a2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.356194 Aug 27 02:58:33.998466 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2462/4755] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:32 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:34.399151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c7e37e23-6427-4999-ba1c-cb70e7d12340 req-9e42607e-a9bc-4ac1-8bf6-8c0f9b88a398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "tag": "8ec234de-143a-4f79-b7f0-2e9d4fc1bb54"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:34.424048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7e37e23-6427-4999-ba1c-cb70e7d12340 req-9e42607e-a9bc-4ac1-8bf6-8c0f9b88a398 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:34.425979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7e37e23-6427-4999-ba1c-cb70e7d12340 req-9e42607e-a9bc-4ac1-8bf6-8c0f9b88a398 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:34.429437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7e37e23-6427-4999-ba1c-cb70e7d12340 req-9e42607e-a9bc-4ac1-8bf6-8c0f9b88a398 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:34.462929 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c7e37e23-6427-4999-ba1c-cb70e7d12340 req-9e42607e-a9bc-4ac1-8bf6-8c0f9b88a398 service nova] Creating event network-changed:8ec234de-143a-4f79-b7f0-2e9d4fc1bb54 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:58:34.475128 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c7e37e23-6427-4999-ba1c-cb70e7d12340 req-9e42607e-a9bc-4ac1-8bf6-8c0f9b88a398 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079916 Aug 27 02:58:34.482288 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2294/4756] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:35.022604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:35.024036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:35.050123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:35.053477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:35.054654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:35.056352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:35.059336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:35.060158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:36.780338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:36.799135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:36.801245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:36.805208 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e6c71fdb-ad32-407f-b844-517f31d5d4f1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.787546 Aug 27 02:58:36.825190 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2463/4757] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:35 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:37.631822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c3173b82-496b-4faf-a051-24c9620e6f01 req-10f15cb2-608a-47f5-8961-e0766078b578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "tag": "a6bc5e26-e4da-451c-9c23-0f8babc733c6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:37.695552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=18 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:37.752709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c3173b82-496b-4faf-a051-24c9620e6f01 req-10f15cb2-608a-47f5-8961-e0766078b578 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:37.759431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c3173b82-496b-4faf-a051-24c9620e6f01 req-10f15cb2-608a-47f5-8961-e0766078b578 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:37.760389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c3173b82-496b-4faf-a051-24c9620e6f01 req-10f15cb2-608a-47f5-8961-e0766078b578 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:37.832235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=48 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:37.835605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:37.837109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:37.840997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=22 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:37.852291 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c3173b82-496b-4faf-a051-24c9620e6f01 req-10f15cb2-608a-47f5-8961-e0766078b578 service nova] Creating event network-changed:a6bc5e26-e4da-451c-9c23-0f8babc733c6 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:58:37.881027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:37.881987 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c3173b82-496b-4faf-a051-24c9620e6f01 req-10f15cb2-608a-47f5-8961-e0766078b578 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285146 Aug 27 02:58:37.882387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:37.883091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:37.884056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:37.884767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:37.885464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:37.891106 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2295/4758] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:39.178850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-20ea7c20-aae8-4769-ba2f-f8dc67231199 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: .version_select at 0x7f4d2939e310>, body: {"keypair": {"name": "tempest-keypair-1471835096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDq9pf22PTdsgyq0AMEzjxW3Cd/Kj2h5rwEz6MzFthoo5VqW+ma5gtaMTdWy50CVAssSfSOTRFo2FqFvuQA8VdmpUFkT9yjF7KRnSktz4dBDH8ysKNsOxKE7K3UKhu+iBw=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:39.244899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-20ea7c20-aae8-4769-ba2f-f8dc67231199 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:39.267170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-20ea7c20-aae8-4769-ba2f-f8dc67231199 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for user 59f857fc243b43379c9255e7b9ea1c3f and project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:39.306445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:39.320626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:39.332435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:39.334130 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4867fff9-9df5-4e25-b99c-fd80da8c049f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.502693 Aug 27 02:58:39.351314 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2464/4759] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:37 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:39.367348 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-20ea7c20-aae8-4769-ba2f-f8dc67231199 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.649451 Aug 27 02:58:39.369563 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2296/4760] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 02:58:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:58:40.365751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:40.370598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:40.397920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:40.400164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:40.401189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:40.405864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:40.408398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:40.409240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:40.560463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-661422821", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "c7116ae1-c23b-45e1-a138-8e75977960ed"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:40.664135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] validate_networks() for [('c7116ae1-c23b-45e1-a138-8e75977960ed', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:58:41.477510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:41.487484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:41.488949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:41.490190 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-69945010-c78e-41d5-9b59-e9c467cb1953 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.135491 Aug 27 02:58:41.490771 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2297/4761] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:40 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:41.942919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:58:41.943694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:58:41.944062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:58:41.944615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:58:41.945144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:58:41.974331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:41.975053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:41.975637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:41.976622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:41.977203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:41.977955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:42.042837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Getting quotas for project d81eddee670c4471ae49e92187ea71d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:42.060828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Getting quotas for user 71106df7ca2840c7b44382c59aa3186d and project d81eddee670c4471ae49e92187ea71d7. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:42.104782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:58:42.115568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:58:42.232688 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ea86fbbe-4130-46be-9c48-4c74e0ad6ea8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.886788 Aug 27 02:58:42.237461 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2465/4762] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 02:58:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 27 02:58:42.248285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b25dbe38-c40d-4c06-a8bd-2a93f836609d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:42.249957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b25dbe38-c40d-4c06-a8bd-2a93f836609d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:42.523953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:42.527453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:42.537537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b25dbe38-c40d-4c06-a8bd-2a93f836609d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:42.548244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:42.550847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:42.551323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:42.552087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:42.556203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b25dbe38-c40d-4c06-a8bd-2a93f836609d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:42.558292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:42.563437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:42.564851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b25dbe38-c40d-4c06-a8bd-2a93f836609d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:42.566704 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b25dbe38-c40d-4c06-a8bd-2a93f836609d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1258 microversion: 2.21 time: 0.322942 Aug 27 02:58:42.573997 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2298/4763] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:42 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1258 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:58:43.476009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:43.486853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:43.514937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:43.519843 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-27bb4ccd-4918-4753-a05c-5ecf937e2593 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.007215 Aug 27 02:58:43.546574 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2466/4764] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:42 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:58:43.595671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:43.596283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:43.627471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:43.627981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:43.628416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:43.629131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:43.629589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:43.630290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:43.808666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:43.856763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:43.863630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:43.869271 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-196e2040-6c86-4468-80cf-092112f3a66d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1262 microversion: 2.21 time: 0.278435 Aug 27 02:58:43.881123 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2299/4765] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:43 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1262 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:44.569003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:44.570283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:44.595472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:44.597171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:44.599745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:44.601104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:44.603013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:44.604283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:44.909182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:44.910008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:44.920892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:44.923188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:44.926320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:44.927953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:44.928560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:44.930392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:45.160218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:45.171929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:45.178102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:45.184349 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2aeac9e9-90ca-4eea-baba-8cdd7dcce95f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1328 microversion: 2.21 time: 0.279548 Aug 27 02:58:45.185606 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2300/4766] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:44 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1328 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:46.216980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:46.219196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:46.242052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:46.248038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:46.248846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:46.249699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:46.250208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:46.250654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:46.596123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:46.627916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:46.632071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:46.636643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ea3f1245-4b97-41ad-99bf-e67eea1d42f7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1316 microversion: 2.21 time: 0.430249 Aug 27 02:58:46.650554 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2301/4767] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:46 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:58:46.889511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:46.935038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:46.941740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:46.944343 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ad6ce03-da37-4ea9-89c8-0041fff92d38 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 2.379416 Aug 27 02:58:46.956539 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2467/4768] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:44 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 2392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:47.664311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:47.665662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:47.683113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:47.684405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:47.686076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:47.688571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:47.690046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:47.692191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:47.737216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-812811739", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "544183e0-192f-4c44-976f-41fb786d65a5"}], "security_groups": [{"name": "tempest-securitygroup--618701654"}], "key_name": "tempest-keypair-1471835096", "user_data": "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:48.065049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:48.097143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:48.102367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:48.104326 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-64bea32a-2aaa-49c6-86e6-f948a9c120e4 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1316 microversion: 2.21 time: 0.445955 Aug 27 02:58:48.106294 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2302/4769] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:47 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:48.115125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:48.116341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:48.149071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:48.152147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:48.152891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:48.153900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:48.157281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:48.157938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:49.420383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:49.433042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:49.451966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:49.459866 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b8662634-37c0-483d-b962-085c920622dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.352148 Aug 27 02:58:49.485865 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2303/4770] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:48 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:49.516285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:49.517418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:49.558843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:49.564673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:49.565322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:49.566153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:49.569210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:49.570305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:50.100344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] validate_networks() for [('544183e0-192f-4c44-976f-41fb786d65a5', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:58:50.180845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:50.197701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:50.203762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:50.205514 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9864f994-cb63-42f2-9485-dbb9e4e019cd tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1358 microversion: 2.21 time: 0.716408 Aug 27 02:58:50.206504 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2304/4771] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:49 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1358 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:50.487160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:50.488524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:50.504871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:50.507028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:50.512192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:50.516972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:50.517540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:50.518280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:51.663881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:51.680545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:51.684987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:51.693133 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d4ac6249-4c1f-4663-8bac-4d0154b59d97 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.210634 Aug 27 02:58:51.707235 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2305/4772] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:50 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:58:51.762206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:51.762992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:51.781631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:51.786986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:51.787913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:51.789236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:51.790304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:51.791627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:52.011497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:52.095053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:52.416730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:58:52.417919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:58:52.418412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:58:52.418841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:58:52.419278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:58:52.451093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:52.451604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:52.454945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:52.459217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:52.459737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:52.460199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:52.528284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:58:52.542790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for user 59f857fc243b43379c9255e7b9ea1c3f and project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:58:52.543689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:58:52.567496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:52.610780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:58:52.620725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:58:52.627821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:52.642109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:52.657591 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c0342191-f435-4534-9d64-409bac0caef6 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1358 microversion: 2.21 time: 0.948411 Aug 27 02:58:52.658897 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2306/4773] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:51 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1358 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:52.756090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:52.757499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:52.768184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:52.771447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:52.772250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:52.776173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:52.778596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:52.779440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:52.783551 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f03d66d0-7487-41af-b4b3-3eb5e5e6b443 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.052777 Aug 27 02:58:52.790423 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2468/4774] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:58:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 5060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 02:58:52.813919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ed7fa8ae-27dd-4dac-80ec-db2024ce8513 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:52.817005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ed7fa8ae-27dd-4dac-80ec-db2024ce8513 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:53.397279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ed7fa8ae-27dd-4dac-80ec-db2024ce8513 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:53.408143 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ed7fa8ae-27dd-4dac-80ec-db2024ce8513 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1241 microversion: 2.1 time: 0.616133 Aug 27 02:58:53.410417 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2469/4775] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:52 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1241 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:53.669929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:53.680783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:53.681416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:53.684946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:53.692730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:53.693238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:53.693904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:53.696727 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-01120371-88e7-47b1-aa55-3bb251402a39 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 0.945220 Aug 27 02:58:53.697507 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2307/4776] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:52 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:53.699869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:53.700937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:53.702588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:53.706147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:54.432327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d10198e3-8086-4816-85a4-d1d26f8fafc8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:54.433654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d10198e3-8086-4816-85a4-d1d26f8fafc8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:54.449323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d10198e3-8086-4816-85a4-d1d26f8fafc8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:54.461718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d10198e3-8086-4816-85a4-d1d26f8fafc8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:54.462620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d10198e3-8086-4816-85a4-d1d26f8fafc8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:54.463705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d10198e3-8086-4816-85a4-d1d26f8fafc8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:54.465654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d10198e3-8086-4816-85a4-d1d26f8fafc8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:54.468707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d10198e3-8086-4816-85a4-d1d26f8fafc8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:54.703345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d10198e3-8086-4816-85a4-d1d26f8fafc8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:54.732983 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d10198e3-8086-4816-85a4-d1d26f8fafc8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1237 microversion: 2.1 time: 0.305822 Aug 27 02:58:54.734678 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2308/4777] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:54 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1237 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:58:54.764559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:54.765481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:54.785068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:54.785812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:54.786442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:54.787342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:54.802454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:54.803127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:55.073640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:55.108549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:55.110073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:55.111265 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-021791c8-6ce2-461c-be4c-fa0db1dd9689 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1358 microversion: 2.21 time: 1.434576 Aug 27 02:58:55.118597 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2470/4778] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:53 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1358 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:55.300189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:55.369635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:55.377788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:55.385230 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8fde1cee-ab5d-48af-844c-89b1b7187d49 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 0.621495 Aug 27 02:58:55.388014 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2309/4779] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:54 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:55.757017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-90e6f2d2-4c38-404c-8bdc-ad07845a33a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:55.758420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-90e6f2d2-4c38-404c-8bdc-ad07845a33a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:55.775068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e6f2d2-4c38-404c-8bdc-ad07845a33a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:55.776989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e6f2d2-4c38-404c-8bdc-ad07845a33a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:55.780259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e6f2d2-4c38-404c-8bdc-ad07845a33a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:55.784656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e6f2d2-4c38-404c-8bdc-ad07845a33a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:55.785855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e6f2d2-4c38-404c-8bdc-ad07845a33a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:55.788710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e6f2d2-4c38-404c-8bdc-ad07845a33a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:55.946621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-90e6f2d2-4c38-404c-8bdc-ad07845a33a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:55.962454 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-90e6f2d2-4c38-404c-8bdc-ad07845a33a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1299 microversion: 2.1 time: 0.210331 Aug 27 02:58:55.982344 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2310/4780] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:55 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:56.035773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-5d598f33-7baa-4627-a8a8-681be8d2b24c req-22b0e50a-bc78-443f-a97e-34049f90c192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "899e5ff1-d70d-4ee5-8aae-85910bd36f0b", "tag": "a5758136-6786-4801-9cb6-6fa4ff270537"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:58:56.076028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5d598f33-7baa-4627-a8a8-681be8d2b24c req-22b0e50a-bc78-443f-a97e-34049f90c192 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:56.079754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5d598f33-7baa-4627-a8a8-681be8d2b24c req-22b0e50a-bc78-443f-a97e-34049f90c192 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:56.080879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5d598f33-7baa-4627-a8a8-681be8d2b24c req-22b0e50a-bc78-443f-a97e-34049f90c192 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:56.145919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:56.146826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:56.151855 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-5d598f33-7baa-4627-a8a8-681be8d2b24c req-22b0e50a-bc78-443f-a97e-34049f90c192 service nova] Creating event network-changed:a5758136-6786-4801-9cb6-6fa4ff270537 for instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b on n-h2-852084-5 Aug 27 02:58:56.173166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:56.177342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:56.179075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:56.180601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:56.181695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:56.185976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:56.190941 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-5d598f33-7baa-4627-a8a8-681be8d2b24c req-22b0e50a-bc78-443f-a97e-34049f90c192 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.549465 Aug 27 02:58:56.191617 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2471/4781] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:58:56.413232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:56.415881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:56.428186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:56.430253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:56.431800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:56.433361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:56.437707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:56.438310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:56.826451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:56.853727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:56.860443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:56.865513 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-78aacc99-2dc8-4a59-a809-667dc342a08a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1358 microversion: 2.21 time: 0.728054 Aug 27 02:58:56.883807 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2311/4782] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:56 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1358 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:57.008808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e245bb3-f5bc-4ce5-9937-2f8b7c1a60dc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:57.011731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2e245bb3-f5bc-4ce5-9937-2f8b7c1a60dc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:57.076834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e245bb3-f5bc-4ce5-9937-2f8b7c1a60dc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:57.079324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e245bb3-f5bc-4ce5-9937-2f8b7c1a60dc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:57.080407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e245bb3-f5bc-4ce5-9937-2f8b7c1a60dc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:57.082609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e245bb3-f5bc-4ce5-9937-2f8b7c1a60dc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:57.084156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e245bb3-f5bc-4ce5-9937-2f8b7c1a60dc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:57.085640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e245bb3-f5bc-4ce5-9937-2f8b7c1a60dc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:57.420557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:57.437225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:57.439042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:57.440328 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-60ca548c-cf15-4b24-bbea-b149181683d9 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.032475 Aug 27 02:58:57.454077 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2472/4783] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:56 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:58:57.913605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:57.914200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:57.924207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:57.924720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:57.925167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:57.925941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:57.937349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:57.938180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:58.030871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2e245bb3-f5bc-4ce5-9937-2f8b7c1a60dc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:58.079496 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e245bb3-f5bc-4ce5-9937-2f8b7c1a60dc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1366 microversion: 2.1 time: 1.097270 Aug 27 02:58:58.086277 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2312/4784] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:56 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1366 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:58:58.487519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:58.488452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:58.523171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:58.524167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:58.524920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:58.527853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:58.528790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:58.529597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:59.287227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:59.314859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:59.316854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:59.318421 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aa22bc80-301a-415c-9972-034f03ef259f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1358 microversion: 2.21 time: 1.409264 Aug 27 02:58:59.319605 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2473/4785] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:57 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1358 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:58:59.324827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0bb25265-e7a7-4228-b1b9-837f57ba272e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:58:59.325451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0bb25265-e7a7-4228-b1b9-837f57ba272e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:58:59.332685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bb25265-e7a7-4228-b1b9-837f57ba272e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:59.333462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bb25265-e7a7-4228-b1b9-837f57ba272e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:59.334908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bb25265-e7a7-4228-b1b9-837f57ba272e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:59.337503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bb25265-e7a7-4228-b1b9-837f57ba272e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:58:59.338385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bb25265-e7a7-4228-b1b9-837f57ba272e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:58:59.339356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bb25265-e7a7-4228-b1b9-837f57ba272e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:58:59.665466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0bb25265-e7a7-4228-b1b9-837f57ba272e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:58:59.674863 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0bb25265-e7a7-4228-b1b9-837f57ba272e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1366 microversion: 2.1 time: 0.353877 Aug 27 02:58:59.687874 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2474/4786] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:58:59 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:00.356819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:00.357586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:00.372385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:00.372781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:00.373246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:00.374098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:00.374572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:00.375008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:00.744565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:00.810801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:00.824794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:00.840831 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-224a87b2-b5b4-4409-9452-7e8facb1dd09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 2.351723 Aug 27 02:59:00.843394 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2313/4787] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:58:58 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:00.877607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c8e8a0e3-9709-487c-959e-7f2900587a69 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:00.880172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c8e8a0e3-9709-487c-959e-7f2900587a69 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:00.958937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8e8a0e3-9709-487c-959e-7f2900587a69 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:00.961902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8e8a0e3-9709-487c-959e-7f2900587a69 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:00.962400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8e8a0e3-9709-487c-959e-7f2900587a69 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:00.963175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8e8a0e3-9709-487c-959e-7f2900587a69 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:00.966359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8e8a0e3-9709-487c-959e-7f2900587a69 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:00.966813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8e8a0e3-9709-487c-959e-7f2900587a69 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:00.967394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:00.983434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:00.985228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:00.995267 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cc69a631-6c45-43dc-b324-855aec267681 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1358 microversion: 2.21 time: 0.642496 Aug 27 02:59:01.002818 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2475/4788] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:00 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1358 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:01.037611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:01.433929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c8e8a0e3-9709-487c-959e-7f2900587a69 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:01.447427 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c8e8a0e3-9709-487c-959e-7f2900587a69 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1366 microversion: 2.1 time: 0.597069 Aug 27 02:59:01.448378 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2314/4789] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:00 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1366 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:01.868452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:01.869435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:01.879512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:01.880584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:01.880584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:01.881284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:01.882062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:01.890078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:02.376811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-5e55369f-2438-4881-a44c-ebeacd000d49 req-c726e838-7515-4a0a-bf03-bc7f7b38e22d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f354f690-0290-4b99-bd08-961f97e09066", "tag": "5b0a7af6-0d96-47f0-8b28-6d161f5680fa"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:02.409023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5e55369f-2438-4881-a44c-ebeacd000d49 req-c726e838-7515-4a0a-bf03-bc7f7b38e22d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:02.413195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5e55369f-2438-4881-a44c-ebeacd000d49 req-c726e838-7515-4a0a-bf03-bc7f7b38e22d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:02.414902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5e55369f-2438-4881-a44c-ebeacd000d49 req-c726e838-7515-4a0a-bf03-bc7f7b38e22d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:02.454852 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-5e55369f-2438-4881-a44c-ebeacd000d49 req-c726e838-7515-4a0a-bf03-bc7f7b38e22d service nova] Creating event network-changed:5b0a7af6-0d96-47f0-8b28-6d161f5680fa for instance f354f690-0290-4b99-bd08-961f97e09066 on n-h2-852084-5 Aug 27 02:59:02.469558 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-5e55369f-2438-4881-a44c-ebeacd000d49 req-c726e838-7515-4a0a-bf03-bc7f7b38e22d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.621780 Aug 27 02:59:02.472828 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2476/4790] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:02.501724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:02.503464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:02.513758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:02.541714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:02.542733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:02.544410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:02.546896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:02.547992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:02.548958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:02.673949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:02.708560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:02.718839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:02.721051 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-060c6280-3a84-42c4-8be4-84264afbd1dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 0.857116 Aug 27 02:59:02.732484 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2315/4791] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:01 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:02.755020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-166543a7-8f96-480b-97e2-ca8f50a790b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:02.771055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-166543a7-8f96-480b-97e2-ca8f50a790b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:02.808702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-166543a7-8f96-480b-97e2-ca8f50a790b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:02.811629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-166543a7-8f96-480b-97e2-ca8f50a790b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:02.812732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-166543a7-8f96-480b-97e2-ca8f50a790b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:02.814427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-166543a7-8f96-480b-97e2-ca8f50a790b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:02.815997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-166543a7-8f96-480b-97e2-ca8f50a790b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:02.817065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-166543a7-8f96-480b-97e2-ca8f50a790b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:03.319023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:03.333686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=72 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:03.363891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:03.371560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:03.377732 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b82aee5c-4ff9-4b3c-b890-e0e3de38368d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1358 microversion: 2.21 time: 0.902241 Aug 27 02:59:03.381131 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2477/4792] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:02 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1358 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:03.776959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:03.781838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:03.788017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:03.807927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:03.817227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:03.821598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:03.823544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:03.824778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:03.826006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:04.058224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-166543a7-8f96-480b-97e2-ca8f50a790b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:04.086312 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-166543a7-8f96-480b-97e2-ca8f50a790b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1366 microversion: 2.1 time: 1.346272 Aug 27 02:59:04.102085 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2316/4793] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:02 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1366 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:04.420449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:04.422553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:04.455281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:04.456681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:04.457700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:04.461320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:04.462468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:04.463547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:04.963406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:04.991963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:04.993811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:04.999178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:05.005491 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e7a939ad-705d-4143-8d14-d6eac8cf1836 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.235893 Aug 27 02:59:05.008527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:05.008851 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2478/4794] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:03 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:05.028264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:05.030191 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-adeabc3b-9d6c-42d1-b6e6-a59e22f2dbd5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1358 microversion: 2.21 time: 0.616773 Aug 27 02:59:05.031489 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2317/4795] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:04 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1358 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:05.157464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-864b678c-d1d2-4f1e-bd6c-1da78e0d7feb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:05.163616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-864b678c-d1d2-4f1e-bd6c-1da78e0d7feb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:05.199222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864b678c-d1d2-4f1e-bd6c-1da78e0d7feb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:05.199823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864b678c-d1d2-4f1e-bd6c-1da78e0d7feb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:05.201710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864b678c-d1d2-4f1e-bd6c-1da78e0d7feb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:05.220097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864b678c-d1d2-4f1e-bd6c-1da78e0d7feb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:05.226938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864b678c-d1d2-4f1e-bd6c-1da78e0d7feb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:05.229849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864b678c-d1d2-4f1e-bd6c-1da78e0d7feb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:05.625547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-864b678c-d1d2-4f1e-bd6c-1da78e0d7feb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:05.637860 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-864b678c-d1d2-4f1e-bd6c-1da78e0d7feb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1366 microversion: 2.1 time: 0.489621 Aug 27 02:59:05.639446 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2479/4796] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:05 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1366 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:06.050966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:06.053234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:06.054120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:06.054746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:06.069100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:06.069632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:06.085864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:06.086988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:06.087482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:06.087938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:06.094758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:06.095664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:06.096328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:06.098422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:06.099135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:06.099761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:06.489640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:06.501586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:06.519673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:06.520867 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9234f01b-4123-4d00-b76f-537cb86f53ea tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1358 microversion: 2.21 time: 0.470778 Aug 27 02:59:06.521642 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2480/4797] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:06 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1358 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:06.663663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c50ded68-ae0e-475d-86a1-38272976f032 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:06.664686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c50ded68-ae0e-475d-86a1-38272976f032 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:06.703572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c50ded68-ae0e-475d-86a1-38272976f032 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:06.704396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c50ded68-ae0e-475d-86a1-38272976f032 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:06.705020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c50ded68-ae0e-475d-86a1-38272976f032 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:06.705972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c50ded68-ae0e-475d-86a1-38272976f032 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:06.707411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c50ded68-ae0e-475d-86a1-38272976f032 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:06.708171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c50ded68-ae0e-475d-86a1-38272976f032 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:07.350878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c50ded68-ae0e-475d-86a1-38272976f032 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:07.373151 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c50ded68-ae0e-475d-86a1-38272976f032 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1366 microversion: 2.1 time: 0.716392 Aug 27 02:59:07.380493 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2481/4798] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:06 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1366 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:07.623566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-35858353-25b4-48f7-8e00-ee1be2373b55 req-f6edf960-be08-4087-9102-7d98e2691309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899e5ff1-d70d-4ee5-8aae-85910bd36f0b", "name": "network-vif-plugged", "status": "completed", "tag": "a5758136-6786-4801-9cb6-6fa4ff270537"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:07.678088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-35858353-25b4-48f7-8e00-ee1be2373b55 req-f6edf960-be08-4087-9102-7d98e2691309 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:07.680151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-35858353-25b4-48f7-8e00-ee1be2373b55 req-f6edf960-be08-4087-9102-7d98e2691309 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:07.680657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-35858353-25b4-48f7-8e00-ee1be2373b55 req-f6edf960-be08-4087-9102-7d98e2691309 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:07.738036 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-35858353-25b4-48f7-8e00-ee1be2373b55 req-f6edf960-be08-4087-9102-7d98e2691309 service nova] Creating event network-vif-plugged:a5758136-6786-4801-9cb6-6fa4ff270537 for instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b on n-h2-852084-5 Aug 27 02:59:07.767532 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-35858353-25b4-48f7-8e00-ee1be2373b55 req-f6edf960-be08-4087-9102-7d98e2691309 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383702 Aug 27 02:59:07.772308 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2482/4799] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:07.789345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:07.793281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:07.818059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:07.822753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:07.823406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:07.827560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:07.828768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:07.829392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:08.081330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:08.107420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:08.115761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:08.118586 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ef15de99-be65-45c9-8470-0c361ab57ed7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 2.086703 Aug 27 02:59:08.122266 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2318/4800] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:06 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 2091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:08.403060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-af729991-1d01-4a0c-b0dd-4eed825a94f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:08.404038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-af729991-1d01-4a0c-b0dd-4eed825a94f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:08.411247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:08.422767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af729991-1d01-4a0c-b0dd-4eed825a94f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:08.423512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af729991-1d01-4a0c-b0dd-4eed825a94f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:08.424179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af729991-1d01-4a0c-b0dd-4eed825a94f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:08.424943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af729991-1d01-4a0c-b0dd-4eed825a94f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:08.425415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af729991-1d01-4a0c-b0dd-4eed825a94f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:08.425890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-af729991-1d01-4a0c-b0dd-4eed825a94f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:08.557705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:08.581011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:08.583047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:08.585990 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b7a69052-d489-4ef0-8b73-fc703b3cd3c7 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1358 microversion: 2.21 time: 0.811311 Aug 27 02:59:08.588000 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2483/4801] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:07 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1358 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:08.864495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-af729991-1d01-4a0c-b0dd-4eed825a94f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:08.892740 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-af729991-1d01-4a0c-b0dd-4eed825a94f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1366 microversion: 2.1 time: 0.493457 Aug 27 02:59:08.895598 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2319/4802] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:08 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:09.148653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:09.151481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:09.189311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:09.196132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:09.197028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:09.197973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:09.199668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:09.200835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:09.211475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:09.658717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:09.663056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:09.705232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:09.709124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:09.710310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:09.711109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:09.711587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:09.712029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:11.011652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.042535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.044195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.045456 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-506d09d7-0052-4ec3-a190-b163e5b60e03 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1358 microversion: 2.21 time: 1.424422 Aug 27 02:59:11.058362 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2320/4803] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:09 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1358 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:11.071849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-24b0ec6a-5316-4610-b264-19172bf23188 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:11.072479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-24b0ec6a-5316-4610-b264-19172bf23188 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:11.085683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24b0ec6a-5316-4610-b264-19172bf23188 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:11.096031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24b0ec6a-5316-4610-b264-19172bf23188 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:11.096806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24b0ec6a-5316-4610-b264-19172bf23188 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:11.103016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24b0ec6a-5316-4610-b264-19172bf23188 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:11.103861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24b0ec6a-5316-4610-b264-19172bf23188 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:11.108315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24b0ec6a-5316-4610-b264-19172bf23188 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:11.359437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.374675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.375994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.377258 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-18e7ccd7-377f-4815-b1df-aeec774a51b3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 2.235638 Aug 27 02:59:11.377877 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2484/4804] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:09 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:11.561161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-24b0ec6a-5316-4610-b264-19172bf23188 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:11.611589 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-24b0ec6a-5316-4610-b264-19172bf23188 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1366 microversion: 2.1 time: 0.551634 Aug 27 02:59:11.615263 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2321/4805] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:11 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1366 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:12.087201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:12.088119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:12.097634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:12.099309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:12.100234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:12.101366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:12.102703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:12.103361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:12.419175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:12.420429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:12.485803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:12.486315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:12.486846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:12.487690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:12.488169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:12.488680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:12.966749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:13.005210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:13.008603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:13.011145 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bb1d7b43-6b07-4c5b-9cf8-b8f378e9d7a8 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1550 microversion: 2.21 time: 0.927783 Aug 27 02:59:13.016274 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2485/4806] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:12 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1550 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:13.037458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-71db1708-8d01-44c3-bdf9-ef7be513f312 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:13.039009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-71db1708-8d01-44c3-bdf9-ef7be513f312 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:13.064752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71db1708-8d01-44c3-bdf9-ef7be513f312 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:13.070863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71db1708-8d01-44c3-bdf9-ef7be513f312 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:13.080770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71db1708-8d01-44c3-bdf9-ef7be513f312 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:13.086185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71db1708-8d01-44c3-bdf9-ef7be513f312 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:13.098713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71db1708-8d01-44c3-bdf9-ef7be513f312 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:13.114690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71db1708-8d01-44c3-bdf9-ef7be513f312 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:13.569222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-71db1708-8d01-44c3-bdf9-ef7be513f312 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:13.590626 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-71db1708-8d01-44c3-bdf9-ef7be513f312 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1366 microversion: 2.1 time: 0.572317 Aug 27 02:59:13.599109 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2486/4807] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:13 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:13.619116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc1d6587-0803-4abc-965d-ad593aed3e1a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:13.628963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fc1d6587-0803-4abc-965d-ad593aed3e1a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:13.647992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1d6587-0803-4abc-965d-ad593aed3e1a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:13.653047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1d6587-0803-4abc-965d-ad593aed3e1a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:13.660372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1d6587-0803-4abc-965d-ad593aed3e1a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:13.661439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1d6587-0803-4abc-965d-ad593aed3e1a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:13.662425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1d6587-0803-4abc-965d-ad593aed3e1a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:13.663153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1d6587-0803-4abc-965d-ad593aed3e1a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:13.687395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:13.701548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:13.703123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:13.704373 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-efb59bd1-e5f7-4bf9-92ab-253ca7b68c99 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.301096 Aug 27 02:59:13.724247 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2322/4808] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:12 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:13.762481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fc1d6587-0803-4abc-965d-ad593aed3e1a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 02:59:13.971325 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fc1d6587-0803-4abc-965d-ad593aed3e1a tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "DELETE /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 204 len: 0 microversion: 2.21 time: 0.370075 Aug 27 02:59:13.972962 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2487/4809] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:59:13 2022] DELETE /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 02:59:13.983806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:13.984442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:14.003814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.004158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.004605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.025555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.026194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.026795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.630319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ce7ad97a-ada5-4fe5-b2a7-d545f56de526 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:14.650300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ce7ad97a-ada5-4fe5-b2a7-d545f56de526 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:14.709914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce7ad97a-ada5-4fe5-b2a7-d545f56de526 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.710782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce7ad97a-ada5-4fe5-b2a7-d545f56de526 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.711524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce7ad97a-ada5-4fe5-b2a7-d545f56de526 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.712758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce7ad97a-ada5-4fe5-b2a7-d545f56de526 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.713767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:14.714684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce7ad97a-ada5-4fe5-b2a7-d545f56de526 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.714852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce7ad97a-ada5-4fe5-b2a7-d545f56de526 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.732025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:14.733805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:14.735061 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e23ecb6b-c6a3-4aa6-b891-d26f5f9e72b0 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1556 microversion: 2.21 time: 0.756155 Aug 27 02:59:14.750735 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2323/4810] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:13 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1556 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:14.750735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:14.750735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:14.750735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.750735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.750735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:14.760686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:14.760686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:14.760686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:15.610513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:15.620851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:15.622421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:15.624208 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-21b5f3cc-4ccf-4fbd-962a-08acd16cbcc3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 0.886434 Aug 27 02:59:15.624799 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2324/4811] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:14 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:15.709505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-9053aa00-da16-40cc-8217-fafedec01ac5 req-96bbe82a-ea6d-4dce-a9a9-b0f92dc535b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f354f690-0290-4b99-bd08-961f97e09066", "name": "network-vif-plugged", "status": "completed", "tag": "5b0a7af6-0d96-47f0-8b28-6d161f5680fa"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:15.746967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9053aa00-da16-40cc-8217-fafedec01ac5 req-96bbe82a-ea6d-4dce-a9a9-b0f92dc535b7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:15.754490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9053aa00-da16-40cc-8217-fafedec01ac5 req-96bbe82a-ea6d-4dce-a9a9-b0f92dc535b7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:15.755135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9053aa00-da16-40cc-8217-fafedec01ac5 req-96bbe82a-ea6d-4dce-a9a9-b0f92dc535b7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:15.801232 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-9053aa00-da16-40cc-8217-fafedec01ac5 req-96bbe82a-ea6d-4dce-a9a9-b0f92dc535b7 service nova] Creating event network-vif-plugged:5b0a7af6-0d96-47f0-8b28-6d161f5680fa for instance f354f690-0290-4b99-bd08-961f97e09066 on n-h2-852084-5 Aug 27 02:59:15.854787 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-9053aa00-da16-40cc-8217-fafedec01ac5 req-96bbe82a-ea6d-4dce-a9a9-b0f92dc535b7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149441 Aug 27 02:59:15.860798 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2325/4812] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:59:15.902297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:15.903081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:15.928149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:15.928658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:15.929112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:15.935314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:15.935972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:15.936439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:16.118078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ce7ad97a-ada5-4fe5-b2a7-d545f56de526 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:16.214499 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ce7ad97a-ada5-4fe5-b2a7-d545f56de526 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1366 microversion: 2.1 time: 1.578940 Aug 27 02:59:16.216533 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2488/4813] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:14 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1366 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:16.677471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:16.679298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:16.701976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:16.702626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:16.704511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:16.706114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:16.707998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:16.709799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:17.034049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:17.064473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:17.066318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:17.067839 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ac21f067-670c-4295-be77-3e349fed615d tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1556 microversion: 2.21 time: 1.205425 Aug 27 02:59:17.078164 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2326/4814] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:15 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1556 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:17.246426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-afd494e8-c923-47e9-9299-4bffa262003d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:17.247008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-afd494e8-c923-47e9-9299-4bffa262003d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:17.254404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afd494e8-c923-47e9-9299-4bffa262003d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:17.254902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afd494e8-c923-47e9-9299-4bffa262003d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:17.255352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afd494e8-c923-47e9-9299-4bffa262003d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:17.256089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afd494e8-c923-47e9-9299-4bffa262003d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:17.256649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afd494e8-c923-47e9-9299-4bffa262003d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:17.256972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afd494e8-c923-47e9-9299-4bffa262003d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:17.647712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:17.666264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:17.668097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:17.669584 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8d73cd5c-5d06-4c6c-b2b7-e455887e4d0b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.023350 Aug 27 02:59:17.670589 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2489/4815] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:16 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:17.979948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-afd494e8-c923-47e9-9299-4bffa262003d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:17.992056 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-afd494e8-c923-47e9-9299-4bffa262003d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1366 microversion: 2.1 time: 0.749677 Aug 27 02:59:18.010527 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2327/4816] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:17 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1366 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 02:59:18.117424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:18.121216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:18.158825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:18.165029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:18.166917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:18.173712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:18.178171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:18.180354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:18.725082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:18.726339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:18.751991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:18.754327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:18.757489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:18.758812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:18.761010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:18.767538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:19.177131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:19.202471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:19.210287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71106df7ca2840c7b44382c59aa3186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd81eddee670c4471ae49e92187ea71d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:19.213484 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f720f7d2-8e75-41a9-8117-2d5fa2efe0db tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 200 len: 1514 microversion: 2.21 time: 1.107607 Aug 27 02:59:19.217307 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2490/4817] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:18 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 1514 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:19.230173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-90a4cfb2-599f-447e-92be-09ad07bd8eab tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:19.232447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-90a4cfb2-599f-447e-92be-09ad07bd8eab tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:19.250799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90a4cfb2-599f-447e-92be-09ad07bd8eab tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:19.252870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90a4cfb2-599f-447e-92be-09ad07bd8eab tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:19.255038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90a4cfb2-599f-447e-92be-09ad07bd8eab tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:19.257335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90a4cfb2-599f-447e-92be-09ad07bd8eab tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:19.258105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90a4cfb2-599f-447e-92be-09ad07bd8eab tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:19.260963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90a4cfb2-599f-447e-92be-09ad07bd8eab tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:19.821705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:19.854761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:19.857300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:19.863723 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7631a75-a6f5-4cfd-898d-b9d87b4a4263 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.145265 Aug 27 02:59:19.893698 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2328/4818] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:18 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:19.894695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-a8cc7aec-9857-4ba9-967d-fea6207073f4 req-532a7473-6d1c-4b24-bf07-a35f64f6875e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899e5ff1-d70d-4ee5-8aae-85910bd36f0b", "name": "network-vif-deleted", "tag": "a5758136-6786-4801-9cb6-6fa4ff270537"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:19.922047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a8cc7aec-9857-4ba9-967d-fea6207073f4 req-532a7473-6d1c-4b24-bf07-a35f64f6875e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:19.922541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a8cc7aec-9857-4ba9-967d-fea6207073f4 req-532a7473-6d1c-4b24-bf07-a35f64f6875e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:19.922986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a8cc7aec-9857-4ba9-967d-fea6207073f4 req-532a7473-6d1c-4b24-bf07-a35f64f6875e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:19.960891 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a8cc7aec-9857-4ba9-967d-fea6207073f4 req-532a7473-6d1c-4b24-bf07-a35f64f6875e service nova] Creating event network-vif-deleted:a5758136-6786-4801-9cb6-6fa4ff270537 for instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b on n-h2-852084-5 Aug 27 02:59:19.981227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-90a4cfb2-599f-447e-92be-09ad07bd8eab tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:19.986300 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-a8cc7aec-9857-4ba9-967d-fea6207073f4 req-532a7473-6d1c-4b24-bf07-a35f64f6875e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102673 Aug 27 02:59:19.987276 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2329/4819] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:19.991501 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-90a4cfb2-599f-447e-92be-09ad07bd8eab tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1556 microversion: 2.1 time: 0.772743 Aug 27 02:59:20.006970 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2491/4820] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:19 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1556 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:20.017155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2f203fce-1099-4997-ba0d-25bb3811f05a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:20.017854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2f203fce-1099-4997-ba0d-25bb3811f05a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:20.024511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f203fce-1099-4997-ba0d-25bb3811f05a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.025404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f203fce-1099-4997-ba0d-25bb3811f05a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.026116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f203fce-1099-4997-ba0d-25bb3811f05a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.027118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f203fce-1099-4997-ba0d-25bb3811f05a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.028605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f203fce-1099-4997-ba0d-25bb3811f05a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.030002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f203fce-1099-4997-ba0d-25bb3811f05a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.240823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:20.241491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:20.264206 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2f203fce-1099-4997-ba0d-25bb3811f05a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.251757 Aug 27 02:59:20.264836 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2330/4821] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 02:59:20 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-interface => generated 284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:20.271629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.272445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.273701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.274911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.275591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.276205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.338367 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] HTTP exception thrown: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Request method failure captured: Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b HTTP/1.1 Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYhfYzIEA0He-6s8CZyewzmkFOs6ymq6SUt6gP2oy-wUm-ZfNPqqPzGSJCIGKmyh437ycmWVHQecWfbGRqIJ0JQ-t3zM1kA8lMfGn7lEvIxs7-NJyakFM1iy3Mrvt0lA6PoEidpdyiN1YOMBDrCEU5BkOcYCjraFZPUBLJKyRM7oc6A Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: d81eddee670c4471ae49e92187ea71d7 Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1226228906 Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d81eddee670c4471ae49e92187ea71d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d81eddee670c4471ae49e92187ea71d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d81eddee670c4471ae49e92187ea71d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d81eddee670c4471ae49e92187ea71d7"}]}] Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-InstanceActionsV221TestJSON-1226228906 Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: d81eddee670c4471ae49e92187ea71d7 Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1226228906 Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-InstanceActionsV221TestJSON-1226228906-project Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 71106df7ca2840c7b44382c59aa3186d Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-InstanceActionsV221TestJSON-1226228906-project Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '899e5ff1-d70d-4ee5-8aae-85910bd36f0b'} Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.342664 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:20.348254 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.348254 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:20.348254 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:20.348254 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:20.348254 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:20.348254 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:20.348254 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.348254 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.360433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Returning 404 to user: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:20.361657 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-24cc9060-fde4-491f-aa54-3aae0c82378c tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 404 len: 111 microversion: 2.21 time: 0.125037 Aug 27 02:59:20.362810 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2492/4822] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:20 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:59:20.373423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9db495dd-d448-4b52-bc25-c52f6f3eb7cc tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '.version_select at 0x7f4d292fc790>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:20.374786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9db495dd-d448-4b52-bc25-c52f6f3eb7cc tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:20.382276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db495dd-d448-4b52-bc25-c52f6f3eb7cc tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.383165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db495dd-d448-4b52-bc25-c52f6f3eb7cc tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.383796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db495dd-d448-4b52-bc25-c52f6f3eb7cc tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.384983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db495dd-d448-4b52-bc25-c52f6f3eb7cc tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.385703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db495dd-d448-4b52-bc25-c52f6f3eb7cc tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.386314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db495dd-d448-4b52-bc25-c52f6f3eb7cc tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.633759 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9db495dd-d448-4b52-bc25-c52f6f3eb7cc tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.264403 Aug 27 02:59:20.641717 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2331/4823] 10.222.0.99 () {60 vars in 1337 bytes} [Sat Aug 27 02:59:20 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b/os-instance-actions => generated 611 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 02:59:20.648220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:20.649310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:20.669627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.674392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.675298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.677572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.678321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.680861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.715727 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] HTTP exception thrown: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Request method failure captured: Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b HTTP/1.1 Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYhfYzIEA0He-6s8CZyewzmkFOs6ymq6SUt6gP2oy-wUm-ZfNPqqPzGSJCIGKmyh437ycmWVHQecWfbGRqIJ0JQ-t3zM1kA8lMfGn7lEvIxs7-NJyakFM1iy3Mrvt0lA6PoEidpdyiN1YOMBDrCEU5BkOcYCjraFZPUBLJKyRM7oc6A Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: d81eddee670c4471ae49e92187ea71d7 Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1226228906 Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d81eddee670c4471ae49e92187ea71d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d81eddee670c4471ae49e92187ea71d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d81eddee670c4471ae49e92187ea71d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d81eddee670c4471ae49e92187ea71d7"}]}] Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-InstanceActionsV221TestJSON-1226228906 Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: d81eddee670c4471ae49e92187ea71d7 Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1226228906 Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-InstanceActionsV221TestJSON-1226228906-project Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 71106df7ca2840c7b44382c59aa3186d Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-InstanceActionsV221TestJSON-1226228906-project Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '899e5ff1-d70d-4ee5-8aae-85910bd36f0b'} Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:20.718736 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Returning 404 to user: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:20.724185 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-906909c7-73c7-490d-8754-24881cbbcc6f tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "DELETE /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 404 len: 111 microversion: 2.21 time: 0.078827 Aug 27 02:59:20.726936 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2493/4824] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 02:59:20 2022] DELETE /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:59:20.735917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:20.736791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] [instance: 899e5ff1-d70d-4ee5-8aae-85910bd36f0b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:20.746560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.747349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.748526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.749508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.750155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.750898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.778653 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] HTTP exception thrown: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Request method failure captured: Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b HTTP/1.1 Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYhfYzIEA0He-6s8CZyewzmkFOs6ymq6SUt6gP2oy-wUm-ZfNPqqPzGSJCIGKmyh437ycmWVHQecWfbGRqIJ0JQ-t3zM1kA8lMfGn7lEvIxs7-NJyakFM1iy3Mrvt0lA6PoEidpdyiN1YOMBDrCEU5BkOcYCjraFZPUBLJKyRM7oc6A Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Openstack-Nova-Api-Version: 2.21 Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: d81eddee670c4471ae49e92187ea71d7 Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1226228906 Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d81eddee670c4471ae49e92187ea71d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d81eddee670c4471ae49e92187ea71d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d81eddee670c4471ae49e92187ea71d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d81eddee670c4471ae49e92187ea71d7"}]}] Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-InstanceActionsV221TestJSON-1226228906 Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: d81eddee670c4471ae49e92187ea71d7 Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1226228906 Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-InstanceActionsV221TestJSON-1226228906-project Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 71106df7ca2840c7b44382c59aa3186d Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-InstanceActionsV221TestJSON-1226228906-project Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '899e5ff1-d70d-4ee5-8aae-85910bd36f0b'} Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.782470 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 02:59:20.787403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.787403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 02:59:20.787403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 02:59:20.787403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 02:59:20.787403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 02:59:20.787403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 02:59:20.787403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. Aug 27 02:59:20.787403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 02:59:20.788879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] Returning 404 to user: Instance 899e5ff1-d70d-4ee5-8aae-85910bd36f0b could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 02:59:20.790514 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-48c0e34f-c5f1-4329-a44c-6ba83a16dbc5 tempest-InstanceActionsV221TestJSON-1226228906 tempest-InstanceActionsV221TestJSON-1226228906-project] 10.222.0.99 "GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b" status: 404 len: 111 microversion: 2.21 time: 0.061347 Aug 27 02:59:20.792656 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2332/4825] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:20 2022] GET /compute/v2.1/servers/899e5ff1-d70d-4ee5-8aae-85910bd36f0b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 02:59:20.910366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:20.912218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:20.948743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.950664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.953336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:20.962090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:20.963729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:20.968875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.107141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:22.110498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:22.134169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:22.137784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:22.143721 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2bba04b8-160d-402d-aebe-d3b62a0ae209 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.241472 Aug 27 02:59:22.144549 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2494/4826] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:20 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:22.529698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-512cc939-1ebd-454f-8e03-335bdd66fc64 req-a4a97475-0236-49f3-a6ed-e4c73c4b22a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f354f690-0290-4b99-bd08-961f97e09066", "tag": "5b0a7af6-0d96-47f0-8b28-6d161f5680fa"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:22.556380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-512cc939-1ebd-454f-8e03-335bdd66fc64 req-a4a97475-0236-49f3-a6ed-e4c73c4b22a9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:22.560252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-512cc939-1ebd-454f-8e03-335bdd66fc64 req-a4a97475-0236-49f3-a6ed-e4c73c4b22a9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:22.561879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-512cc939-1ebd-454f-8e03-335bdd66fc64 req-a4a97475-0236-49f3-a6ed-e4c73c4b22a9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:22.594020 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-512cc939-1ebd-454f-8e03-335bdd66fc64 req-a4a97475-0236-49f3-a6ed-e4c73c4b22a9 service nova] Creating event network-changed:5b0a7af6-0d96-47f0-8b28-6d161f5680fa for instance f354f690-0290-4b99-bd08-961f97e09066 on n-h2-852084-5 Aug 27 02:59:22.606067 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-512cc939-1ebd-454f-8e03-335bdd66fc64 req-a4a97475-0236-49f3-a6ed-e4c73c4b22a9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078650 Aug 27 02:59:22.609080 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2333/4827] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:23.177208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:23.178359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:23.211618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:23.212202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:23.212670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:23.216383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:23.220624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:23.220624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:26.307854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:26.330310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:26.339628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:26.342777 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4978f51e-37b9-46a3-b64f-df2c399ae3ec tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 3.174408 Aug 27 02:59:26.346252 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2495/4828] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:23 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 3178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:27.371542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:27.373022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:27.390293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:27.394607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:27.395318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:27.396617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:27.397961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:27.398441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:27.409114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:28.395968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:28.428644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:28.435375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:28.436711 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1a4f267-28ab-4f8f-9ad8-49043268a64e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.069858 Aug 27 02:59:28.442118 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2334/4829] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:27 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:29.470690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:29.471861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:29.495994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:29.497391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:29.510718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:29.511860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:29.512559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:29.517159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:30.113605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:30.124609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:30.138097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:30.139383 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-18eb7eba-548f-4e03-9f96-5b82f2b50774 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 0.674461 Aug 27 02:59:30.161644 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2496/4830] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:29 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:31.168499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:31.169134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:31.180132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:31.183393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:31.184037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:31.187017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:31.187596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:31.190407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:31.875692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:31.924712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:31.948838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:31.950560 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9f36fddf-0c36-4432-bdbd-d8b8e75e8442 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 0.785849 Aug 27 02:59:31.958346 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2335/4831] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:31 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:32.981707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:32.983021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:32.998266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:32.999193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.001165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.004577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.007862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.008597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.108146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-a73aa985-cd40-4640-a391-5cc0050f06ae req-d2c3ab59-5c94-499e-b355-b22da4a6a488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-plugged", "status": "completed", "tag": "d9dd5177-12fc-4a5a-a699-90fef2125241"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:33.130917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a73aa985-cd40-4640-a391-5cc0050f06ae req-d2c3ab59-5c94-499e-b355-b22da4a6a488 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:33.131842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a73aa985-cd40-4640-a391-5cc0050f06ae req-d2c3ab59-5c94-499e-b355-b22da4a6a488 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:33.132652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a73aa985-cd40-4640-a391-5cc0050f06ae req-d2c3ab59-5c94-499e-b355-b22da4a6a488 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:33.155578 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a73aa985-cd40-4640-a391-5cc0050f06ae req-d2c3ab59-5c94-499e-b355-b22da4a6a488 service nova] Creating event network-vif-plugged:d9dd5177-12fc-4a5a-a699-90fef2125241 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:59:33.176013 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-a73aa985-cd40-4640-a391-5cc0050f06ae req-d2c3ab59-5c94-499e-b355-b22da4a6a488 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074136 Aug 27 02:59:33.176745 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2336/4832] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 02:59:33.685856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:33.714952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:33.717187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:33.718449 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a5e8ba8f-b02a-4e49-bca1-f6bc83187c86 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 0.741755 Aug 27 02:59:33.754062 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2497/4833] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:32 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:34.748384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:34.749818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:34.761928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:34.769128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:34.769868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:34.770790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:34.771409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:34.772018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:35.319925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f0b15827-5d45-4415-b818-f76559f53031 req-6fa98968-1d3a-4e5f-a894-0cab7b46fd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-plugged", "status": "completed", "tag": "8ec234de-143a-4f79-b7f0-2e9d4fc1bb54"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:35.342791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f0b15827-5d45-4415-b818-f76559f53031 req-6fa98968-1d3a-4e5f-a894-0cab7b46fd5d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:35.343536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f0b15827-5d45-4415-b818-f76559f53031 req-6fa98968-1d3a-4e5f-a894-0cab7b46fd5d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:35.345336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f0b15827-5d45-4415-b818-f76559f53031 req-6fa98968-1d3a-4e5f-a894-0cab7b46fd5d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:35.376902 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f0b15827-5d45-4415-b818-f76559f53031 req-6fa98968-1d3a-4e5f-a894-0cab7b46fd5d service nova] Creating event network-vif-plugged:8ec234de-143a-4f79-b7f0-2e9d4fc1bb54 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:59:35.392828 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f0b15827-5d45-4415-b818-f76559f53031 req-6fa98968-1d3a-4e5f-a894-0cab7b46fd5d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075684 Aug 27 02:59:35.396148 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2498/4834] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:36.599006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:36.609937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:36.611381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:36.630890 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f1db32f4-c19b-48b9-aeae-7fd3296899b2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.885939 Aug 27 02:59:36.632727 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2337/4835] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:34 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:37.440949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-24cf589e-1afb-408d-8e6f-631eb0c82423 req-c8f34050-2681-4f49-b5ea-d779821adf7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-plugged", "status": "completed", "tag": "b5b5aa70-cca4-4531-90fd-70d30d297d0f"}, {"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-plugged", "status": "completed", "tag": "6c17a27c-00fe-4329-bd88-3dc5472ea946"}, {"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-plugged", "status": "completed", "tag": "ee47c975-6b0f-4e9f-89fd-d2e4b902ab10"}, {"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-plugged", "status": "completed", "tag": "a6bc5e26-e4da-451c-9c23-0f8babc733c6"}, {"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-plugged", "status": "completed", "tag": "c28154bb-c273-436a-a667-e993cd82b114"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:37.467057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-24cf589e-1afb-408d-8e6f-631eb0c82423 req-c8f34050-2681-4f49-b5ea-d779821adf7a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:37.467553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-24cf589e-1afb-408d-8e6f-631eb0c82423 req-c8f34050-2681-4f49-b5ea-d779821adf7a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:37.468022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-24cf589e-1afb-408d-8e6f-631eb0c82423 req-c8f34050-2681-4f49-b5ea-d779821adf7a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:37.481897 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-24cf589e-1afb-408d-8e6f-631eb0c82423 req-c8f34050-2681-4f49-b5ea-d779821adf7a service nova] Creating event network-vif-plugged:b5b5aa70-cca4-4531-90fd-70d30d297d0f for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:59:37.483032 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-24cf589e-1afb-408d-8e6f-631eb0c82423 req-c8f34050-2681-4f49-b5ea-d779821adf7a service nova] Creating event network-vif-plugged:6c17a27c-00fe-4329-bd88-3dc5472ea946 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:59:37.483972 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-24cf589e-1afb-408d-8e6f-631eb0c82423 req-c8f34050-2681-4f49-b5ea-d779821adf7a service nova] Creating event network-vif-plugged:ee47c975-6b0f-4e9f-89fd-d2e4b902ab10 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:59:37.484905 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-24cf589e-1afb-408d-8e6f-631eb0c82423 req-c8f34050-2681-4f49-b5ea-d779821adf7a service nova] Creating event network-vif-plugged:a6bc5e26-e4da-451c-9c23-0f8babc733c6 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:59:37.488911 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-24cf589e-1afb-408d-8e6f-631eb0c82423 req-c8f34050-2681-4f49-b5ea-d779821adf7a service nova] Creating event network-vif-plugged:c28154bb-c273-436a-a667-e993cd82b114 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:59:37.499276 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-24cf589e-1afb-408d-8e6f-631eb0c82423 req-c8f34050-2681-4f49-b5ea-d779821adf7a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.065273 Aug 27 02:59:37.499915 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2499/4836] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:37.659965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:37.661919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:37.674095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:37.674864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:37.675472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:37.676829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:37.677463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:37.682743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:38.714474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:38.729816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:38.731430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:38.733094 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f2a95586-9e92-4ed2-805f-0e16af96e7dd tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 1.077016 Aug 27 02:59:38.733742 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2338/4837] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:37 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:39.759051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:39.760532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:39.766389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:39.779736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:39.786228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:39.792634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:39.794020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:39.794745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:39.795421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:40.690744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:40.711838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:40.717294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:40.721424 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-06914bfb-1513-43be-94ce-ea33522defa2 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1869 microversion: 2.42 time: 0.968491 Aug 27 02:59:40.740550 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2500/4838] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:39 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1869 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 02:59:41.748507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:41.749119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:41.758580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=40 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:41.763202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:41.763757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:41.764206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:41.769480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:41.770016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:41.770463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:42.383193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:42.400444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:42.403000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:42.416099 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cffa2bbc-40b1-42d1-8ad1-879daba6a0e4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 2828 microversion: 2.42 time: 0.670315 Aug 27 02:59:42.417220 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2339/4839] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 02:59:41 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 2828 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:42.445174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4b49aef2-89d3-4f42-936c-0c736c0e79bb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:42.445828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4b49aef2-89d3-4f42-936c-0c736c0e79bb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:42.466694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b49aef2-89d3-4f42-936c-0c736c0e79bb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:42.467685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b49aef2-89d3-4f42-936c-0c736c0e79bb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:42.468344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b49aef2-89d3-4f42-936c-0c736c0e79bb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:42.469270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b49aef2-89d3-4f42-936c-0c736c0e79bb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:42.470800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b49aef2-89d3-4f42-936c-0c736c0e79bb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:42.471463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b49aef2-89d3-4f42-936c-0c736c0e79bb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:42.945742 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4b49aef2-89d3-4f42-936c-0c736c0e79bb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.505237 Aug 27 02:59:42.946886 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2501/4840] 10.222.0.99 () {60 vars in 1316 bytes} [Sat Aug 27 02:59:42 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a/os-interface => generated 1832 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 02:59:47.151954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-10bd04e1-7304-4a62-b08b-b448151a7f66 req-72b5ddf8-ab8f-4b7a-baad-622d3b0fff62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "tag": "d9dd5177-12fc-4a5a-a699-90fef2125241"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:47.170794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-10bd04e1-7304-4a62-b08b-b448151a7f66 req-72b5ddf8-ab8f-4b7a-baad-622d3b0fff62 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:47.171290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-10bd04e1-7304-4a62-b08b-b448151a7f66 req-72b5ddf8-ab8f-4b7a-baad-622d3b0fff62 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:47.179804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-10bd04e1-7304-4a62-b08b-b448151a7f66 req-72b5ddf8-ab8f-4b7a-baad-622d3b0fff62 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:47.206290 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-10bd04e1-7304-4a62-b08b-b448151a7f66 req-72b5ddf8-ab8f-4b7a-baad-622d3b0fff62 service nova] Creating event network-changed:d9dd5177-12fc-4a5a-a699-90fef2125241 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 02:59:47.222934 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-10bd04e1-7304-4a62-b08b-b448151a7f66 req-72b5ddf8-ab8f-4b7a-baad-622d3b0fff62 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074430 Aug 27 02:59:47.230440 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2340/4841] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 02:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:52.467168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:52.570142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=33 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:52.614276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-339395993", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "d520d283-a457-40f2-823c-5971b8e16ce8"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:52.719403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] validate_networks() for [('d520d283-a457-40f2-823c-5971b8e16ce8', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 02:59:54.334466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 02:59:54.335413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 02:59:54.335413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 02:59:54.335709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 02:59:54.336391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 02:59:54.370092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:54.370908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:54.371661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:54.373490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:54.377002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:54.377952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:54.433964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Getting quotas for project 7aad3a1e1a9b497fa3e4a8be2a7e85ca. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 02:59:54.470767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Getting quotas for user 76b759cd11864e8684eef82414a3710b and project 7aad3a1e1a9b497fa3e4a8be2a7e85ca. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 02:59:54.508965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Going to run 2 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 02:59:54.518850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 4f0ce0b2-fecc-4a35-87c4-d08cc8bba761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:59:54.608396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=4f0ce0b2-fecc-4a35-87c4-d08cc8bba761,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 02:59:54.783612 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a7773299-5d88-4f80-b30e-2e8aa8ddd214 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.450428 Aug 27 02:59:54.797195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ed0eb1f-3728-4eba-a912-d94f058b0d8f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:54.802509 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2502/4842] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 02:59:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 02:59:54.807949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ed0eb1f-3728-4eba-a912-d94f058b0d8f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:54.811917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ed0eb1f-3728-4eba-a912-d94f058b0d8f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Searching by: {'deleted': False, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 02:59:54.881851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ed0eb1f-3728-4eba-a912-d94f058b0d8f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:54.884724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ed0eb1f-3728-4eba-a912-d94f058b0d8f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:54.885388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ed0eb1f-3728-4eba-a912-d94f058b0d8f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:54.888689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ed0eb1f-3728-4eba-a912-d94f058b0d8f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:54.889355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ed0eb1f-3728-4eba-a912-d94f058b0d8f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:54.891560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ed0eb1f-3728-4eba-a912-d94f058b0d8f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:54.930226 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ed0eb1f-3728-4eba-a912-d94f058b0d8f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.138171 Aug 27 02:59:54.931795 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2341/4843] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 02:59:54 2022] GET /compute/v2.1/servers => generated 675 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:54.944683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f3b215d-991f-445d-aee5-19eb89d19d6e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:54.945327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8f3b215d-991f-445d-aee5-19eb89d19d6e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:55.130487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8f3b215d-991f-445d-aee5-19eb89d19d6e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:55.148821 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f3b215d-991f-445d-aee5-19eb89d19d6e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1219 microversion: 2.1 time: 0.208520 Aug 27 02:59:55.162120 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2503/4844] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:54 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1219 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:55.784279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-60c73dae-d9e2-4826-8c40-35e68e8d8ed0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:55.785697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-60c73dae-d9e2-4826-8c40-35e68e8d8ed0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:55.800039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60c73dae-d9e2-4826-8c40-35e68e8d8ed0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:55.804002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60c73dae-d9e2-4826-8c40-35e68e8d8ed0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:55.805037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60c73dae-d9e2-4826-8c40-35e68e8d8ed0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:55.806781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60c73dae-d9e2-4826-8c40-35e68e8d8ed0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:55.809231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60c73dae-d9e2-4826-8c40-35e68e8d8ed0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:55.814481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60c73dae-d9e2-4826-8c40-35e68e8d8ed0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:55.897559 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-60c73dae-d9e2-4826-8c40-35e68e8d8ed0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/ips" status: 200 len: 149 microversion: 2.1 time: 0.120078 Aug 27 02:59:55.902074 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2342/4845] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 02:59:55 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/ips => generated 149 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 02:59:56.176194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d95cbf25-858c-47f1-9dcc-b76f5daaebb6 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:56.176827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d95cbf25-858c-47f1-9dcc-b76f5daaebb6 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:56.659752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d95cbf25-858c-47f1-9dcc-b76f5daaebb6 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:56.677794 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d95cbf25-858c-47f1-9dcc-b76f5daaebb6 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1219 microversion: 2.1 time: 0.501813 Aug 27 02:59:56.691161 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2504/4846] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:56 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1219 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:57.713453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3b31a5d5-eb02-4a4e-b29e-c217aa9d06e9 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:57.715788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3b31a5d5-eb02-4a4e-b29e-c217aa9d06e9 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:57.746256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b31a5d5-eb02-4a4e-b29e-c217aa9d06e9 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:57.747857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b31a5d5-eb02-4a4e-b29e-c217aa9d06e9 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:57.748762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b31a5d5-eb02-4a4e-b29e-c217aa9d06e9 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:57.750065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b31a5d5-eb02-4a4e-b29e-c217aa9d06e9 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:57.750945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b31a5d5-eb02-4a4e-b29e-c217aa9d06e9 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:57.755858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3b31a5d5-eb02-4a4e-b29e-c217aa9d06e9 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:57.883069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=40 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:59:58.140417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3b31a5d5-eb02-4a4e-b29e-c217aa9d06e9 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:58.158667 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3b31a5d5-eb02-4a4e-b29e-c217aa9d06e9 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1271 microversion: 2.1 time: 0.442396 Aug 27 02:59:58.160235 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2343/4847] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:57 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1271 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:59.191630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0b6e1368-b282-4562-8fe7-4dc97dedc032 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 02:59:59.191630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0b6e1368-b282-4562-8fe7-4dc97dedc032 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:59.206039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8fde2dde-dd3a-48de-8da6-386cf4028a5b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5eb1de7e-7734-4559-b6d6-96ddc39715e5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 02:59:59.209685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8fde2dde-dd3a-48de-8da6-386cf4028a5b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 02:59:59.211286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b6e1368-b282-4562-8fe7-4dc97dedc032 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:59.211692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b6e1368-b282-4562-8fe7-4dc97dedc032 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:59.215886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b6e1368-b282-4562-8fe7-4dc97dedc032 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:59.216701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b6e1368-b282-4562-8fe7-4dc97dedc032 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:59.220203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b6e1368-b282-4562-8fe7-4dc97dedc032 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:59.223177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b6e1368-b282-4562-8fe7-4dc97dedc032 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:59.229341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde2dde-dd3a-48de-8da6-386cf4028a5b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:59.233132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde2dde-dd3a-48de-8da6-386cf4028a5b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:59.233973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde2dde-dd3a-48de-8da6-386cf4028a5b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:59.234993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde2dde-dd3a-48de-8da6-386cf4028a5b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 02:59:59.236958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde2dde-dd3a-48de-8da6-386cf4028a5b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 02:59:59.237795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fde2dde-dd3a-48de-8da6-386cf4028a5b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 02:59:59.471991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0b6e1368-b282-4562-8fe7-4dc97dedc032 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 02:59:59.497705 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0b6e1368-b282-4562-8fe7-4dc97dedc032 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1277 microversion: 2.1 time: 0.315496 Aug 27 02:59:59.498974 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2505/4848] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 02:59:59 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1277 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 02:59:59.890722 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8fde2dde-dd3a-48de-8da6-386cf4028a5b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689177 Aug 27 02:59:59.894789 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2344/4849] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 02:59:59 2022] POST /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 194 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:00:00.519965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a693588b-caf6-4a0a-9036-d65e6e3373ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:00.520903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a693588b-caf6-4a0a-9036-d65e6e3373ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:00.537558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a693588b-caf6-4a0a-9036-d65e6e3373ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:00.544424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a693588b-caf6-4a0a-9036-d65e6e3373ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:00.545819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a693588b-caf6-4a0a-9036-d65e6e3373ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:00.548208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a693588b-caf6-4a0a-9036-d65e6e3373ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:00.553358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a693588b-caf6-4a0a-9036-d65e6e3373ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:00.554079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a693588b-caf6-4a0a-9036-d65e6e3373ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:01.122276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a693588b-caf6-4a0a-9036-d65e6e3373ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:01.139873 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a693588b-caf6-4a0a-9036-d65e6e3373ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1277 microversion: 2.1 time: 0.624325 Aug 27 03:00:01.147136 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2506/4850] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:00 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1277 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:02.175114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ce3db084-f61c-4e53-9ed5-b7e80b1b6677 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:02.177439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ce3db084-f61c-4e53-9ed5-b7e80b1b6677 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:02.201704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce3db084-f61c-4e53-9ed5-b7e80b1b6677 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:02.206170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce3db084-f61c-4e53-9ed5-b7e80b1b6677 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:02.208428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce3db084-f61c-4e53-9ed5-b7e80b1b6677 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:02.215598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce3db084-f61c-4e53-9ed5-b7e80b1b6677 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:02.216369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce3db084-f61c-4e53-9ed5-b7e80b1b6677 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:02.217649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce3db084-f61c-4e53-9ed5-b7e80b1b6677 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:03.055709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ce3db084-f61c-4e53-9ed5-b7e80b1b6677 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:03.070643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ce3db084-f61c-4e53-9ed5-b7e80b1b6677 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1319 microversion: 2.1 time: 0.901912 Aug 27 03:00:03.073493 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2345/4851] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:02 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1319 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:04.102514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5da48e0-7f8e-4bd2-9e0b-6c62aca13656 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:04.103252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e5da48e0-7f8e-4bd2-9e0b-6c62aca13656 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:04.116280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5da48e0-7f8e-4bd2-9e0b-6c62aca13656 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:04.119239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5da48e0-7f8e-4bd2-9e0b-6c62aca13656 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:04.123250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5da48e0-7f8e-4bd2-9e0b-6c62aca13656 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:04.124153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5da48e0-7f8e-4bd2-9e0b-6c62aca13656 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:04.125156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5da48e0-7f8e-4bd2-9e0b-6c62aca13656 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:04.128973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e5da48e0-7f8e-4bd2-9e0b-6c62aca13656 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:04.408824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:05.192270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e5da48e0-7f8e-4bd2-9e0b-6c62aca13656 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:05.208980 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e5da48e0-7f8e-4bd2-9e0b-6c62aca13656 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1319 microversion: 2.1 time: 1.110686 Aug 27 03:00:05.210215 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2507/4852] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:04 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1319 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:05.561869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8f211433-d4ea-44e5-bfd3-a71e188862f4 req-d0870be4-f939-414e-8155-ed7348960ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3853d31c-8b3d-4f18-87b4-402ea24416b7", "tag": "056397b5-f7e8-4374-b6e7-ef728395879e"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:05.570414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:05.591323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8f211433-d4ea-44e5-bfd3-a71e188862f4 req-d0870be4-f939-414e-8155-ed7348960ec3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:05.592974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8f211433-d4ea-44e5-bfd3-a71e188862f4 req-d0870be4-f939-414e-8155-ed7348960ec3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:05.594659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8f211433-d4ea-44e5-bfd3-a71e188862f4 req-d0870be4-f939-414e-8155-ed7348960ec3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:05.630873 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8f211433-d4ea-44e5-bfd3-a71e188862f4 req-d0870be4-f939-414e-8155-ed7348960ec3 service nova] Creating event network-changed:056397b5-f7e8-4374-b6e7-ef728395879e for instance 3853d31c-8b3d-4f18-87b4-402ea24416b7 on n-h1-852084-5 Aug 27 03:00:05.644121 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8f211433-d4ea-44e5-bfd3-a71e188862f4 req-d0870be4-f939-414e-8155-ed7348960ec3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087483 Aug 27 03:00:05.646611 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2346/4853] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:05.734023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1043fe19-e912-495a-8498-63432a0cce92 req-12338985-a746-4af3-83f3-b869f8f2062b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0ce0b2-fecc-4a35-87c4-d08cc8bba761", "tag": "8f432fab-8b72-407c-bfcb-e78506869287"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:05.764779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1043fe19-e912-495a-8498-63432a0cce92 req-12338985-a746-4af3-83f3-b869f8f2062b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:05.765534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1043fe19-e912-495a-8498-63432a0cce92 req-12338985-a746-4af3-83f3-b869f8f2062b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:05.767208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1043fe19-e912-495a-8498-63432a0cce92 req-12338985-a746-4af3-83f3-b869f8f2062b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:05.808812 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1043fe19-e912-495a-8498-63432a0cce92 req-12338985-a746-4af3-83f3-b869f8f2062b service nova] Creating event network-changed:8f432fab-8b72-407c-bfcb-e78506869287 for instance 4f0ce0b2-fecc-4a35-87c4-d08cc8bba761 on n-h2-852084-5 Aug 27 03:00:05.821146 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1043fe19-e912-495a-8498-63432a0cce92 req-12338985-a746-4af3-83f3-b869f8f2062b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091514 Aug 27 03:00:05.826199 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2508/4854] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:06.233418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-347b7078-9a41-4ac8-b3ca-df0ef1de0e53 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:06.234191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-347b7078-9a41-4ac8-b3ca-df0ef1de0e53 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:06.259896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-347b7078-9a41-4ac8-b3ca-df0ef1de0e53 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:06.262393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-347b7078-9a41-4ac8-b3ca-df0ef1de0e53 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:06.263104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-347b7078-9a41-4ac8-b3ca-df0ef1de0e53 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:06.267913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-347b7078-9a41-4ac8-b3ca-df0ef1de0e53 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:06.268811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-347b7078-9a41-4ac8-b3ca-df0ef1de0e53 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:06.272167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-347b7078-9a41-4ac8-b3ca-df0ef1de0e53 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:07.245893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-347b7078-9a41-4ac8-b3ca-df0ef1de0e53 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:07.277116 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-347b7078-9a41-4ac8-b3ca-df0ef1de0e53 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1319 microversion: 2.1 time: 1.048383 Aug 27 03:00:07.290672 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2347/4855] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:06 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1319 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:08.305830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=10 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:08.321550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fa11ecd4-0df4-42c3-b0d2-0254a91dc9a1 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:08.325546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fa11ecd4-0df4-42c3-b0d2-0254a91dc9a1 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:08.341710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa11ecd4-0df4-42c3-b0d2-0254a91dc9a1 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:08.343908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa11ecd4-0df4-42c3-b0d2-0254a91dc9a1 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:08.344931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa11ecd4-0df4-42c3-b0d2-0254a91dc9a1 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:08.347854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa11ecd4-0df4-42c3-b0d2-0254a91dc9a1 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:08.363855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa11ecd4-0df4-42c3-b0d2-0254a91dc9a1 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:08.365951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fa11ecd4-0df4-42c3-b0d2-0254a91dc9a1 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:09.027090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fa11ecd4-0df4-42c3-b0d2-0254a91dc9a1 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:09.043239 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fa11ecd4-0df4-42c3-b0d2-0254a91dc9a1 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1319 microversion: 2.1 time: 0.737699 Aug 27 03:00:09.057992 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2509/4856] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:08 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1319 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:10.072848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b26426f-e871-4737-ba87-52b3cd3b1b3f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:10.074892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9b26426f-e871-4737-ba87-52b3cd3b1b3f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:10.095475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b26426f-e871-4737-ba87-52b3cd3b1b3f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:10.096793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b26426f-e871-4737-ba87-52b3cd3b1b3f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:10.097478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b26426f-e871-4737-ba87-52b3cd3b1b3f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:10.098450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b26426f-e871-4737-ba87-52b3cd3b1b3f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:10.099196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b26426f-e871-4737-ba87-52b3cd3b1b3f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:10.099907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b26426f-e871-4737-ba87-52b3cd3b1b3f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:11.338833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9b26426f-e871-4737-ba87-52b3cd3b1b3f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:11.347698 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9b26426f-e871-4737-ba87-52b3cd3b1b3f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1319 microversion: 2.1 time: 1.278715 Aug 27 03:00:11.362666 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2348/4857] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:10 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1319 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:12.377212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9bbb7934-cfb3-4482-b558-88e670749a79 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:12.378713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9bbb7934-cfb3-4482-b558-88e670749a79 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:12.388223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bbb7934-cfb3-4482-b558-88e670749a79 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:12.389001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bbb7934-cfb3-4482-b558-88e670749a79 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:12.389697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bbb7934-cfb3-4482-b558-88e670749a79 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:12.390657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bbb7934-cfb3-4482-b558-88e670749a79 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:12.392203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bbb7934-cfb3-4482-b558-88e670749a79 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:12.392873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bbb7934-cfb3-4482-b558-88e670749a79 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:13.164129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9bbb7934-cfb3-4482-b558-88e670749a79 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:13.179026 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9bbb7934-cfb3-4482-b558-88e670749a79 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1319 microversion: 2.1 time: 0.810525 Aug 27 03:00:13.184963 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2510/4858] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:12 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1319 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:14.205238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2d758137-27be-49f8-b727-cf748c8b06bc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:14.205898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2d758137-27be-49f8-b727-cf748c8b06bc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:14.217505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=20 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:14.230882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d758137-27be-49f8-b727-cf748c8b06bc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:14.231421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d758137-27be-49f8-b727-cf748c8b06bc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:14.231880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d758137-27be-49f8-b727-cf748c8b06bc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:14.232646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d758137-27be-49f8-b727-cf748c8b06bc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:14.233112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d758137-27be-49f8-b727-cf748c8b06bc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:14.233711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d758137-27be-49f8-b727-cf748c8b06bc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:15.296254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2d758137-27be-49f8-b727-cf748c8b06bc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:15.313220 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2d758137-27be-49f8-b727-cf748c8b06bc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1319 microversion: 2.1 time: 1.112177 Aug 27 03:00:15.314173 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2349/4859] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:14 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1319 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:15.672408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-646cb163-9d8e-4fbc-b67a-c31553f1695d req-e04bdfc9-4c3b-451d-b4c1-b5a38064d7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0ce0b2-fecc-4a35-87c4-d08cc8bba761", "name": "network-vif-plugged", "status": "completed", "tag": "8f432fab-8b72-407c-bfcb-e78506869287"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:15.690214 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:00:15.690351 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 03:00:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.99) !!! Aug 27 03:00:15.701265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-646cb163-9d8e-4fbc-b67a-c31553f1695d req-e04bdfc9-4c3b-451d-b4c1-b5a38064d7ae service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:15.701265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-646cb163-9d8e-4fbc-b67a-c31553f1695d req-e04bdfc9-4c3b-451d-b4c1-b5a38064d7ae service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:15.701265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-646cb163-9d8e-4fbc-b67a-c31553f1695d req-e04bdfc9-4c3b-451d-b4c1-b5a38064d7ae service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:15.788738 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-646cb163-9d8e-4fbc-b67a-c31553f1695d req-e04bdfc9-4c3b-451d-b4c1-b5a38064d7ae service nova] Creating event network-vif-plugged:8f432fab-8b72-407c-bfcb-e78506869287 for instance 4f0ce0b2-fecc-4a35-87c4-d08cc8bba761 on n-h2-852084-5 Aug 27 03:00:15.816494 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-646cb163-9d8e-4fbc-b67a-c31553f1695d req-e04bdfc9-4c3b-451d-b4c1-b5a38064d7ae service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141000 Aug 27 03:00:15.816494 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2511/4860] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:16.340567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d618f478-97ce-4f2b-b5e6-dcbd40374ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:16.342170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d618f478-97ce-4f2b-b5e6-dcbd40374ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:16.361631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d618f478-97ce-4f2b-b5e6-dcbd40374ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:16.362530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d618f478-97ce-4f2b-b5e6-dcbd40374ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:16.363210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d618f478-97ce-4f2b-b5e6-dcbd40374ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:16.365181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d618f478-97ce-4f2b-b5e6-dcbd40374ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:16.366265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d618f478-97ce-4f2b-b5e6-dcbd40374ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:16.366965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d618f478-97ce-4f2b-b5e6-dcbd40374ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:17.234671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d618f478-97ce-4f2b-b5e6-dcbd40374ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:17.246431 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d618f478-97ce-4f2b-b5e6-dcbd40374ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1319 microversion: 2.1 time: 0.911099 Aug 27 03:00:17.257646 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2350/4861] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:16 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1319 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:18.038728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-df343e60-5d40-4941-b152-0e1a1c1f1c1a req-00c88114-bb45-4cbc-b688-ab26e1606352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3853d31c-8b3d-4f18-87b4-402ea24416b7", "name": "network-vif-plugged", "status": "completed", "tag": "056397b5-f7e8-4374-b6e7-ef728395879e"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:18.066606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-df343e60-5d40-4941-b152-0e1a1c1f1c1a req-00c88114-bb45-4cbc-b688-ab26e1606352 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:18.068105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-df343e60-5d40-4941-b152-0e1a1c1f1c1a req-00c88114-bb45-4cbc-b688-ab26e1606352 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:18.069180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-df343e60-5d40-4941-b152-0e1a1c1f1c1a req-00c88114-bb45-4cbc-b688-ab26e1606352 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:18.104464 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-df343e60-5d40-4941-b152-0e1a1c1f1c1a req-00c88114-bb45-4cbc-b688-ab26e1606352 service nova] Creating event network-vif-plugged:056397b5-f7e8-4374-b6e7-ef728395879e for instance 3853d31c-8b3d-4f18-87b4-402ea24416b7 on n-h1-852084-5 Aug 27 03:00:18.142129 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-df343e60-5d40-4941-b152-0e1a1c1f1c1a req-00c88114-bb45-4cbc-b688-ab26e1606352 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106690 Aug 27 03:00:18.143385 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2512/4862] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:00:18.270915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d2b0061d-cbc1-47e4-85c5-1011cb422bad tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:18.271664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2b0061d-cbc1-47e4-85c5-1011cb422bad tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:18.294482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2b0061d-cbc1-47e4-85c5-1011cb422bad tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:18.294836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2b0061d-cbc1-47e4-85c5-1011cb422bad tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:18.295333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2b0061d-cbc1-47e4-85c5-1011cb422bad tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:18.296173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2b0061d-cbc1-47e4-85c5-1011cb422bad tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:18.302474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2b0061d-cbc1-47e4-85c5-1011cb422bad tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:18.303264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2b0061d-cbc1-47e4-85c5-1011cb422bad tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:20.755640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2b0061d-cbc1-47e4-85c5-1011cb422bad tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:20.783840 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d2b0061d-cbc1-47e4-85c5-1011cb422bad tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1319 microversion: 2.1 time: 2.516434 Aug 27 03:00:20.789187 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2351/4863] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:18 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1319 bytes in 2523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:21.813395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-35920e0a-07e1-4a43-8eee-61622fb95456 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:21.817964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-35920e0a-07e1-4a43-8eee-61622fb95456 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:21.878399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35920e0a-07e1-4a43-8eee-61622fb95456 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:21.887363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35920e0a-07e1-4a43-8eee-61622fb95456 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:21.888302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35920e0a-07e1-4a43-8eee-61622fb95456 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:21.891685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35920e0a-07e1-4a43-8eee-61622fb95456 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:21.903111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35920e0a-07e1-4a43-8eee-61622fb95456 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:21.904539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35920e0a-07e1-4a43-8eee-61622fb95456 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:22.409383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-35920e0a-07e1-4a43-8eee-61622fb95456 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:22.453206 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-35920e0a-07e1-4a43-8eee-61622fb95456 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 200 len: 1507 microversion: 2.1 time: 0.635947 Aug 27 03:00:22.454269 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2513/4864] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:21 2022] GET /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 1507 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:22.505631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9484a9f1-472b-4ebc-a59d-50cadd3f46d4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:22.506462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9484a9f1-472b-4ebc-a59d-50cadd3f46d4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 4f0ce0b2-fecc-4a35-87c4-d08cc8bba761] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:22.529534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9484a9f1-472b-4ebc-a59d-50cadd3f46d4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:22.530891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9484a9f1-472b-4ebc-a59d-50cadd3f46d4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:22.545446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9484a9f1-472b-4ebc-a59d-50cadd3f46d4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:22.568115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9484a9f1-472b-4ebc-a59d-50cadd3f46d4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:22.574749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9484a9f1-472b-4ebc-a59d-50cadd3f46d4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:22.593063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9484a9f1-472b-4ebc-a59d-50cadd3f46d4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:23.784883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9484a9f1-472b-4ebc-a59d-50cadd3f46d4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:23.812971 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9484a9f1-472b-4ebc-a59d-50cadd3f46d4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/4f0ce0b2-fecc-4a35-87c4-d08cc8bba761" status: 200 len: 1507 microversion: 2.1 time: 1.332045 Aug 27 03:00:23.814263 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2352/4865] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:22 2022] GET /compute/v2.1/servers/4f0ce0b2-fecc-4a35-87c4-d08cc8bba761 => generated 1507 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:23.872638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-96c4fdbd-c28d-413c-a6fb-b27560a5dfdc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:23.874749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-96c4fdbd-c28d-413c-a6fb-b27560a5dfdc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 4f0ce0b2-fecc-4a35-87c4-d08cc8bba761] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:23.883602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:23.912642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96c4fdbd-c28d-413c-a6fb-b27560a5dfdc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:23.913177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96c4fdbd-c28d-413c-a6fb-b27560a5dfdc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:23.913628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96c4fdbd-c28d-413c-a6fb-b27560a5dfdc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:23.925919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96c4fdbd-c28d-413c-a6fb-b27560a5dfdc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:23.927190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96c4fdbd-c28d-413c-a6fb-b27560a5dfdc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:23.931853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96c4fdbd-c28d-413c-a6fb-b27560a5dfdc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:24.024060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=45 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:24.034804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-96c4fdbd-c28d-413c-a6fb-b27560a5dfdc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 4f0ce0b2-fecc-4a35-87c4-d08cc8bba761] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:00:24.275067 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-96c4fdbd-c28d-413c-a6fb-b27560a5dfdc tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4f0ce0b2-fecc-4a35-87c4-d08cc8bba761" status: 204 len: 0 microversion: 2.1 time: 0.411167 Aug 27 03:00:24.279994 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2514/4866] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:00:23 2022] DELETE /compute/v2.1/servers/4f0ce0b2-fecc-4a35-87c4-d08cc8bba761 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:00:24.288757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a773029c-1858-4f2d-9dd5-c7fd78faf41b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:24.289520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a773029c-1858-4f2d-9dd5-c7fd78faf41b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:24.349564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a773029c-1858-4f2d-9dd5-c7fd78faf41b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:24.350704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a773029c-1858-4f2d-9dd5-c7fd78faf41b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:24.353209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a773029c-1858-4f2d-9dd5-c7fd78faf41b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:24.354277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a773029c-1858-4f2d-9dd5-c7fd78faf41b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:24.355298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a773029c-1858-4f2d-9dd5-c7fd78faf41b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:24.360350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a773029c-1858-4f2d-9dd5-c7fd78faf41b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:24.431040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a773029c-1858-4f2d-9dd5-c7fd78faf41b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3853d31c-8b3d-4f18-87b4-402ea24416b7] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:00:24.687480 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a773029c-1858-4f2d-9dd5-c7fd78faf41b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7" status: 204 len: 0 microversion: 2.1 time: 0.405891 Aug 27 03:00:24.690111 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2353/4867] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:00:24 2022] DELETE /compute/v2.1/servers/3853d31c-8b3d-4f18-87b4-402ea24416b7 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:00:25.080022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1293037415", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "d520d283-a457-40f2-823c-5971b8e16ce8"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:25.270543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] validate_networks() for [('d520d283-a457-40f2-823c-5971b8e16ce8', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:00:27.613361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:00:27.622284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:00:27.623704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:00:27.624589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:00:27.625542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:00:27.686310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:27.687453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:27.688704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:27.690559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:27.691781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:27.692770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:27.727449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Getting quotas for project 7aad3a1e1a9b497fa3e4a8be2a7e85ca. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:00:27.742382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Getting quotas for user 76b759cd11864e8684eef82414a3710b and project 7aad3a1e1a9b497fa3e4a8be2a7e85ca. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:00:27.756363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e513c62b-07c0-42ba-be18-c10990785322 req-d16a9f33-ab45-4641-a77a-692c3b89e522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0ce0b2-fecc-4a35-87c4-d08cc8bba761", "name": "network-vif-deleted", "tag": "8f432fab-8b72-407c-bfcb-e78506869287"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:27.821219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Going to run 2 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:00:27.826605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3130fe92-b0c1-436c-99fa-b6568eca1046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:00:27.872082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e513c62b-07c0-42ba-be18-c10990785322 req-d16a9f33-ab45-4641-a77a-692c3b89e522 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:27.873069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e513c62b-07c0-42ba-be18-c10990785322 req-d16a9f33-ab45-4641-a77a-692c3b89e522 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:27.873974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e513c62b-07c0-42ba-be18-c10990785322 req-d16a9f33-ab45-4641-a77a-692c3b89e522 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:27.906765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=3130fe92-b0c1-436c-99fa-b6568eca1046,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:00:28.015984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:28.043482 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e513c62b-07c0-42ba-be18-c10990785322 req-d16a9f33-ab45-4641-a77a-692c3b89e522 service nova] Creating event network-vif-deleted:8f432fab-8b72-407c-bfcb-e78506869287 for instance 4f0ce0b2-fecc-4a35-87c4-d08cc8bba761 on n-h2-852084-5 Aug 27 03:00:28.107862 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e513c62b-07c0-42ba-be18-c10990785322 req-d16a9f33-ab45-4641-a77a-692c3b89e522 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.352017 Aug 27 03:00:28.117698 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-60427486-aa1a-4421-8ab8-ce2fb340b8ac tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.054030 Aug 27 03:00:28.119141 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2515/4868] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:00:25 2022] POST /compute/v2.1/servers => generated 32 bytes in 3065 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 27 03:00:28.133024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f66bf53b-0de3-470a-bdb2-c48256038e78 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:28.149341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f66bf53b-0de3-470a-bdb2-c48256038e78 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:28.151388 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2354/4869] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:00:28.155364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f66bf53b-0de3-470a-bdb2-c48256038e78 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Searching by: {'deleted': False, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca'} {{(pid=122488) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:00:28.204781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f66bf53b-0de3-470a-bdb2-c48256038e78 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:28.209394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f66bf53b-0de3-470a-bdb2-c48256038e78 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:28.210724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f66bf53b-0de3-470a-bdb2-c48256038e78 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:28.212283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f66bf53b-0de3-470a-bdb2-c48256038e78 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:28.216823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f66bf53b-0de3-470a-bdb2-c48256038e78 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:28.217580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f66bf53b-0de3-470a-bdb2-c48256038e78 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:28.345358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.multi_cell_list [None req-f66bf53b-0de3-470a-bdb2-c48256038e78 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122488) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:00:28.415185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:28.426825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:28.520042 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f66bf53b-0de3-470a-bdb2-c48256038e78 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.394511 Aug 27 03:00:28.522612 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2516/4870] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 03:00:28 2022] GET /compute/v2.1/servers => generated 1335 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:28.535994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:28.546066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:28.547228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cc4c1cbb-8cd5-4baa-ad71-ea4ce57e75d2 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:28.548430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:28.551714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cc4c1cbb-8cd5-4baa-ad71-ea4ce57e75d2 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:28.552808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:28.555983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:28.557050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:28.982485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cc4c1cbb-8cd5-4baa-ad71-ea4ce57e75d2 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:29.023142 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cc4c1cbb-8cd5-4baa-ad71-ea4ce57e75d2 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1218 microversion: 2.1 time: 0.482826 Aug 27 03:00:29.029039 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2517/4871] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:28 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1218 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:29.820105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-77b46fb4-cb5d-44fc-a34e-cc1ccc2133ff tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: .version_select at 0x7f4d2a2c8700>, body: {"keypair": {"name": "tempest-keypair-864810996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNJeTmDGofszucMRRtDSReKx1aw2bHG4kK7c3ynvLhHa6TzHCPg82l5UJZzec3wilPPCFPvNu9NLsh1H3m+UrGYXkTvfGFIj/bOyfqIPHS5mbiuCiIoZ/HJtJp5APyevQ=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:29.941460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-77b46fb4-cb5d-44fc-a34e-cc1ccc2133ff tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:00:29.977260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-77b46fb4-cb5d-44fc-a34e-cc1ccc2133ff tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for user 59f857fc243b43379c9255e7b9ea1c3f and project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:00:30.066203 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-77b46fb4-cb5d-44fc-a34e-cc1ccc2133ff tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.254275 Aug 27 03:00:30.076855 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2518/4872] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:00:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:30.090582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a00096c9-b265-4349-865d-f9a59436e46a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:30.091224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a00096c9-b265-4349-865d-f9a59436e46a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:30.548156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a00096c9-b265-4349-865d-f9a59436e46a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:30.560768 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a00096c9-b265-4349-865d-f9a59436e46a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1218 microversion: 2.1 time: 0.482107 Aug 27 03:00:30.566371 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2519/4873] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:30 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1218 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:31.613754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2cf6ccce-3ce2-445d-9889-f9400147cb54 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:31.617598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2cf6ccce-3ce2-445d-9889-f9400147cb54 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:31.675853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cf6ccce-3ce2-445d-9889-f9400147cb54 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.676380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cf6ccce-3ce2-445d-9889-f9400147cb54 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.702610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cf6ccce-3ce2-445d-9889-f9400147cb54 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.706881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cf6ccce-3ce2-445d-9889-f9400147cb54 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:31.707809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cf6ccce-3ce2-445d-9889-f9400147cb54 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:31.709128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cf6ccce-3ce2-445d-9889-f9400147cb54 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:31.898821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:31.956178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:31.973427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:31.978545 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6ba06d18-b6eb-4e11-b5b9-43bdfa6a3cb7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 2946 microversion: 2.42 time: 3.576167 Aug 27 03:00:31.983769 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2355/4874] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:00:28 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 2946 bytes in 3586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:00:31.987971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2cf6ccce-3ce2-445d-9889-f9400147cb54 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:32.019903 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2cf6ccce-3ce2-445d-9889-f9400147cb54 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1270 microversion: 2.1 time: 0.428211 Aug 27 03:00:32.027674 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2520/4875] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:31 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1270 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:32.055321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0eea2ea5-d222-4e06-af11-405d79d3de0e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:32.056044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0eea2ea5-d222-4e06-af11-405d79d3de0e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:32.062754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ec2f1dfc-837d-4808-bcae-bc95e4531a50 req-df9408a7-1c86-497f-9a93-05e7f60aaec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3853d31c-8b3d-4f18-87b4-402ea24416b7", "name": "network-vif-unplugged", "status": "completed", "tag": "056397b5-f7e8-4374-b6e7-ef728395879e"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:32.103863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0eea2ea5-d222-4e06-af11-405d79d3de0e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:32.112415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0eea2ea5-d222-4e06-af11-405d79d3de0e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:32.113361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0eea2ea5-d222-4e06-af11-405d79d3de0e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:32.116931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0eea2ea5-d222-4e06-af11-405d79d3de0e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:32.117131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0eea2ea5-d222-4e06-af11-405d79d3de0e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:32.117601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0eea2ea5-d222-4e06-af11-405d79d3de0e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:32.269231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ec2f1dfc-837d-4808-bcae-bc95e4531a50 req-df9408a7-1c86-497f-9a93-05e7f60aaec8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:32.275548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ec2f1dfc-837d-4808-bcae-bc95e4531a50 req-df9408a7-1c86-497f-9a93-05e7f60aaec8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:32.276469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ec2f1dfc-837d-4808-bcae-bc95e4531a50 req-df9408a7-1c86-497f-9a93-05e7f60aaec8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:32.347891 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ec2f1dfc-837d-4808-bcae-bc95e4531a50 req-df9408a7-1c86-497f-9a93-05e7f60aaec8 service nova] Creating event network-vif-unplugged:056397b5-f7e8-4374-b6e7-ef728395879e for instance 3853d31c-8b3d-4f18-87b4-402ea24416b7 on n-h1-852084-5 Aug 27 03:00:32.371313 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ec2f1dfc-837d-4808-bcae-bc95e4531a50 req-df9408a7-1c86-497f-9a93-05e7f60aaec8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.377712 Aug 27 03:00:32.372018 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2356/4876] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:32.601591 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0eea2ea5-d222-4e06-af11-405d79d3de0e tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.565818 Aug 27 03:00:32.607389 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2521/4877] 10.222.0.99 () {60 vars in 1316 bytes} [Sat Aug 27 03:00:32 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a/os-interface => generated 1832 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:00:33.057159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eda8406e-eba3-48a6-871e-e822a7f5d0f0 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:33.078720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eda8406e-eba3-48a6-871e-e822a7f5d0f0 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:33.123860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eda8406e-eba3-48a6-871e-e822a7f5d0f0 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:33.124730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eda8406e-eba3-48a6-871e-e822a7f5d0f0 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:33.125632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eda8406e-eba3-48a6-871e-e822a7f5d0f0 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:33.136673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eda8406e-eba3-48a6-871e-e822a7f5d0f0 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:33.137464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eda8406e-eba3-48a6-871e-e822a7f5d0f0 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:33.138251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eda8406e-eba3-48a6-871e-e822a7f5d0f0 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:33.777069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eda8406e-eba3-48a6-871e-e822a7f5d0f0 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:33.790245 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eda8406e-eba3-48a6-871e-e822a7f5d0f0 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1288 microversion: 2.1 time: 0.744710 Aug 27 03:00:33.808735 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2357/4878] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:33 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1288 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:33.839412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1cf3949f-96b5-4bda-b3d2-3804ff25a642 req-cb70cc50-7ffc-4df7-9872-bf31d7bdf701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3853d31c-8b3d-4f18-87b4-402ea24416b7", "name": "network-vif-deleted", "tag": "056397b5-f7e8-4374-b6e7-ef728395879e"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:33.884186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1cf3949f-96b5-4bda-b3d2-3804ff25a642 req-cb70cc50-7ffc-4df7-9872-bf31d7bdf701 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:33.888657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1cf3949f-96b5-4bda-b3d2-3804ff25a642 req-cb70cc50-7ffc-4df7-9872-bf31d7bdf701 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:33.889775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1cf3949f-96b5-4bda-b3d2-3804ff25a642 req-cb70cc50-7ffc-4df7-9872-bf31d7bdf701 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:33.939031 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1cf3949f-96b5-4bda-b3d2-3804ff25a642 req-cb70cc50-7ffc-4df7-9872-bf31d7bdf701 service nova] Creating event network-vif-deleted:056397b5-f7e8-4374-b6e7-ef728395879e for instance 3853d31c-8b3d-4f18-87b4-402ea24416b7 on n-h1-852084-5 Aug 27 03:00:33.973431 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1cf3949f-96b5-4bda-b3d2-3804ff25a642 req-cb70cc50-7ffc-4df7-9872-bf31d7bdf701 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139999 Aug 27 03:00:33.995181 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2522/4879] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:34.829206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-261f9885-efed-4e5d-afc2-2e7022e52d03 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:34.840508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-261f9885-efed-4e5d-afc2-2e7022e52d03 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:34.902949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261f9885-efed-4e5d-afc2-2e7022e52d03 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:34.908141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261f9885-efed-4e5d-afc2-2e7022e52d03 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:34.911352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261f9885-efed-4e5d-afc2-2e7022e52d03 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:34.914924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261f9885-efed-4e5d-afc2-2e7022e52d03 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:34.917833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261f9885-efed-4e5d-afc2-2e7022e52d03 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:34.942883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-261f9885-efed-4e5d-afc2-2e7022e52d03 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:35.504033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-261f9885-efed-4e5d-afc2-2e7022e52d03 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:35.515748 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-261f9885-efed-4e5d-afc2-2e7022e52d03 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1276 microversion: 2.1 time: 0.704173 Aug 27 03:00:35.519388 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2358/4880] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:34 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1276 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:36.571694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0ac3955b-b239-4ee6-8641-b82f6c296662 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:36.572510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0ac3955b-b239-4ee6-8641-b82f6c296662 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:36.589798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ac3955b-b239-4ee6-8641-b82f6c296662 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:36.590316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ac3955b-b239-4ee6-8641-b82f6c296662 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:36.595423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ac3955b-b239-4ee6-8641-b82f6c296662 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:36.596477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ac3955b-b239-4ee6-8641-b82f6c296662 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:36.597183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ac3955b-b239-4ee6-8641-b82f6c296662 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:36.603325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ac3955b-b239-4ee6-8641-b82f6c296662 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:36.863886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0ac3955b-b239-4ee6-8641-b82f6c296662 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:36.911130 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0ac3955b-b239-4ee6-8641-b82f6c296662 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1276 microversion: 2.1 time: 0.347023 Aug 27 03:00:36.912772 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2523/4881] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:36 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1276 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:37.949486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b3df095f-5a75-4a4f-9151-597a58729abf tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:37.950193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b3df095f-5a75-4a4f-9151-597a58729abf tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:37.965734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df095f-5a75-4a4f-9151-597a58729abf tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:37.968547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df095f-5a75-4a4f-9151-597a58729abf tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:37.971065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df095f-5a75-4a4f-9151-597a58729abf tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:37.972147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df095f-5a75-4a4f-9151-597a58729abf tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:37.974395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df095f-5a75-4a4f-9151-597a58729abf tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:37.975097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3df095f-5a75-4a4f-9151-597a58729abf tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:38.826570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b3df095f-5a75-4a4f-9151-597a58729abf tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:38.872047 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b3df095f-5a75-4a4f-9151-597a58729abf tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1318 microversion: 2.1 time: 0.926619 Aug 27 03:00:38.888443 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2359/4882] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:37 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1318 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:39.907253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-525b91ef-f82a-4626-a147-bd79fd1b391e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:39.909190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-525b91ef-f82a-4626-a147-bd79fd1b391e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:39.916228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:39.926591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525b91ef-f82a-4626-a147-bd79fd1b391e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:39.927546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525b91ef-f82a-4626-a147-bd79fd1b391e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:39.928988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525b91ef-f82a-4626-a147-bd79fd1b391e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:39.930216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525b91ef-f82a-4626-a147-bd79fd1b391e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:39.931530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525b91ef-f82a-4626-a147-bd79fd1b391e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:39.932407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-525b91ef-f82a-4626-a147-bd79fd1b391e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:40.506062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-525b91ef-f82a-4626-a147-bd79fd1b391e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:40.515232 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-525b91ef-f82a-4626-a147-bd79fd1b391e tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1318 microversion: 2.1 time: 0.624742 Aug 27 03:00:40.526659 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2524/4883] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:39 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:41.039024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-657118700", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "544183e0-192f-4c44-976f-41fb786d65a5"}], "security_groups": [{"name": "tempest-securitygroup--697219209"}], "key_name": "tempest-keypair-864810996", "user_data": "}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:41.258537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-555a45e6-cdbe-4f76-977d-3c747db04eb1 req-2365ff87-f719-4fa8-9be6-0358b81ed0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0225fcc-1d53-44e2-83cd-cc20e0d0664b", "tag": "5347a23c-38d0-4279-9818-c7eb55d177c7"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:41.277498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=14 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:41.309520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-555a45e6-cdbe-4f76-977d-3c747db04eb1 req-2365ff87-f719-4fa8-9be6-0358b81ed0c1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:41.309923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-555a45e6-cdbe-4f76-977d-3c747db04eb1 req-2365ff87-f719-4fa8-9be6-0358b81ed0c1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:41.315527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-555a45e6-cdbe-4f76-977d-3c747db04eb1 req-2365ff87-f719-4fa8-9be6-0358b81ed0c1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:41.356262 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-555a45e6-cdbe-4f76-977d-3c747db04eb1 req-2365ff87-f719-4fa8-9be6-0358b81ed0c1 service nova] Creating event network-changed:5347a23c-38d0-4279-9818-c7eb55d177c7 for instance e0225fcc-1d53-44e2-83cd-cc20e0d0664b on n-h2-852084-5 Aug 27 03:00:41.363945 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-555a45e6-cdbe-4f76-977d-3c747db04eb1 req-2365ff87-f719-4fa8-9be6-0358b81ed0c1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110823 Aug 27 03:00:41.365684 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2525/4884] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:00:41.556438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-39fb2141-e4d1-4b95-8c67-ca47476a9a2d tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:41.557551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-39fb2141-e4d1-4b95-8c67-ca47476a9a2d tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:41.572176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39fb2141-e4d1-4b95-8c67-ca47476a9a2d tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:41.577082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39fb2141-e4d1-4b95-8c67-ca47476a9a2d tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:41.578112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39fb2141-e4d1-4b95-8c67-ca47476a9a2d tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:41.579121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39fb2141-e4d1-4b95-8c67-ca47476a9a2d tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:41.581065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39fb2141-e4d1-4b95-8c67-ca47476a9a2d tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:41.581825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39fb2141-e4d1-4b95-8c67-ca47476a9a2d tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:41.684164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] validate_networks() for [('544183e0-192f-4c44-976f-41fb786d65a5', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:00:42.378632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-39fb2141-e4d1-4b95-8c67-ca47476a9a2d tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:42.406502 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-39fb2141-e4d1-4b95-8c67-ca47476a9a2d tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1318 microversion: 2.1 time: 0.858195 Aug 27 03:00:42.415640 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2526/4885] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:41 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1318 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:43.434966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-542a6c20-3b7d-442d-89ab-bca8dfcd91f3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:43.435812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-542a6c20-3b7d-442d-89ab-bca8dfcd91f3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:43.494199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-542a6c20-3b7d-442d-89ab-bca8dfcd91f3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:43.494199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-542a6c20-3b7d-442d-89ab-bca8dfcd91f3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:43.494199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-542a6c20-3b7d-442d-89ab-bca8dfcd91f3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:43.496545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-542a6c20-3b7d-442d-89ab-bca8dfcd91f3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:43.501070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-542a6c20-3b7d-442d-89ab-bca8dfcd91f3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:43.505629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-542a6c20-3b7d-442d-89ab-bca8dfcd91f3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:44.072291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-542a6c20-3b7d-442d-89ab-bca8dfcd91f3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:44.098443 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-542a6c20-3b7d-442d-89ab-bca8dfcd91f3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1318 microversion: 2.1 time: 0.671229 Aug 27 03:00:44.100078 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2527/4886] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:43 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:44.898982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:00:44.899975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:00:44.900604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:00:44.901699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:00:44.904685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:00:44.912785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:44.922189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:44.923126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:44.923856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:44.925054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:44.925806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:44.926467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:44.953080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:00:44.960853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for user 59f857fc243b43379c9255e7b9ea1c3f and project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:00:44.992812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:00:45.002289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:00:45.121985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0b195dfb-6e7b-4d27-8591-03e222c9b93f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:45.122706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0b195dfb-6e7b-4d27-8591-03e222c9b93f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:45.137528 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-64c2a115-655c-457f-aa27-152869c4a795 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.105019 Aug 27 03:00:45.140867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b195dfb-6e7b-4d27-8591-03e222c9b93f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:45.141369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b195dfb-6e7b-4d27-8591-03e222c9b93f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:45.141857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b195dfb-6e7b-4d27-8591-03e222c9b93f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:45.142602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b195dfb-6e7b-4d27-8591-03e222c9b93f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:45.143071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b195dfb-6e7b-4d27-8591-03e222c9b93f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:45.143718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b195dfb-6e7b-4d27-8591-03e222c9b93f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:45.155488 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2360/4887] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:00:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 4124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:00:45.160622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b3e7b561-f27f-4959-a01c-de9f8f76ba8e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:45.161255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b3e7b561-f27f-4959-a01c-de9f8f76ba8e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:45.368830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b3e7b561-f27f-4959-a01c-de9f8f76ba8e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:45.386245 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b3e7b561-f27f-4959-a01c-de9f8f76ba8e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1240 microversion: 2.1 time: 0.229482 Aug 27 03:00:45.386844 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2361/4888] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:45 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1240 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:45.499049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-1a90fd3a-af0a-49c1-bb05-1903be57784d req-9c100ec6-3a30-4b70-9af1-e8d47afaca3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3130fe92-b0c1-436c-99fa-b6568eca1046", "tag": "edb00601-a023-4481-aa93-477bc04b7825"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:45.515049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1a90fd3a-af0a-49c1-bb05-1903be57784d req-9c100ec6-3a30-4b70-9af1-e8d47afaca3d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:45.520318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1a90fd3a-af0a-49c1-bb05-1903be57784d req-9c100ec6-3a30-4b70-9af1-e8d47afaca3d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:45.521046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1a90fd3a-af0a-49c1-bb05-1903be57784d req-9c100ec6-3a30-4b70-9af1-e8d47afaca3d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:45.550069 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1a90fd3a-af0a-49c1-bb05-1903be57784d req-9c100ec6-3a30-4b70-9af1-e8d47afaca3d service nova] Creating event network-changed:edb00601-a023-4481-aa93-477bc04b7825 for instance 3130fe92-b0c1-436c-99fa-b6568eca1046 on n-h2-852084-5 Aug 27 03:00:45.566302 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-1a90fd3a-af0a-49c1-bb05-1903be57784d req-9c100ec6-3a30-4b70-9af1-e8d47afaca3d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070430 Aug 27 03:00:45.567136 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2362/4889] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:46.428695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7a4f479a-899a-4581-8b2c-4718baa0dc09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:46.436443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7a4f479a-899a-4581-8b2c-4718baa0dc09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:46.460673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a4f479a-899a-4581-8b2c-4718baa0dc09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:46.477426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a4f479a-899a-4581-8b2c-4718baa0dc09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:46.478469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a4f479a-899a-4581-8b2c-4718baa0dc09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:46.486637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a4f479a-899a-4581-8b2c-4718baa0dc09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:46.502503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a4f479a-899a-4581-8b2c-4718baa0dc09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:46.505295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a4f479a-899a-4581-8b2c-4718baa0dc09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:46.799964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7a4f479a-899a-4581-8b2c-4718baa0dc09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:46.828453 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7a4f479a-899a-4581-8b2c-4718baa0dc09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1244 microversion: 2.1 time: 0.408042 Aug 27 03:00:46.829095 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2363/4890] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:46 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1244 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:46.840886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0b195dfb-6e7b-4d27-8591-03e222c9b93f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:46.851891 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0b195dfb-6e7b-4d27-8591-03e222c9b93f tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1318 microversion: 2.1 time: 1.733946 Aug 27 03:00:46.866166 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2528/4891] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:45 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1318 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:47.868982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4cd0ebe8-799d-466b-84ea-8cbf8b42b5be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:47.874979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4cd0ebe8-799d-466b-84ea-8cbf8b42b5be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:47.876279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-75ee998b-edee-4d98-b077-75feb0096390 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:47.876928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-75ee998b-edee-4d98-b077-75feb0096390 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:47.891442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75ee998b-edee-4d98-b077-75feb0096390 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:47.893791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75ee998b-edee-4d98-b077-75feb0096390 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:47.895533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75ee998b-edee-4d98-b077-75feb0096390 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:47.896622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75ee998b-edee-4d98-b077-75feb0096390 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:47.902561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75ee998b-edee-4d98-b077-75feb0096390 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:47.903511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75ee998b-edee-4d98-b077-75feb0096390 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:47.904902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd0ebe8-799d-466b-84ea-8cbf8b42b5be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:47.912875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd0ebe8-799d-466b-84ea-8cbf8b42b5be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:47.913119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd0ebe8-799d-466b-84ea-8cbf8b42b5be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:47.913948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd0ebe8-799d-466b-84ea-8cbf8b42b5be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:47.914428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd0ebe8-799d-466b-84ea-8cbf8b42b5be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:47.914990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4cd0ebe8-799d-466b-84ea-8cbf8b42b5be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:48.674547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-75ee998b-edee-4d98-b077-75feb0096390 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:48.687251 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-75ee998b-edee-4d98-b077-75feb0096390 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1318 microversion: 2.1 time: 0.816680 Aug 27 03:00:48.693779 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2529/4892] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:47 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:48.941827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4cd0ebe8-799d-466b-84ea-8cbf8b42b5be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:48.955378 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4cd0ebe8-799d-466b-84ea-8cbf8b42b5be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1300 microversion: 2.1 time: 1.102331 Aug 27 03:00:48.971645 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2364/4893] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:47 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1300 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:49.719637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0bd94854-dfca-47a1-b3c9-ed849a81e7e4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:49.720268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0bd94854-dfca-47a1-b3c9-ed849a81e7e4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:49.736701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bd94854-dfca-47a1-b3c9-ed849a81e7e4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:49.737223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bd94854-dfca-47a1-b3c9-ed849a81e7e4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:49.737633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bd94854-dfca-47a1-b3c9-ed849a81e7e4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:49.738573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bd94854-dfca-47a1-b3c9-ed849a81e7e4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:49.739330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bd94854-dfca-47a1-b3c9-ed849a81e7e4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:49.739926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0bd94854-dfca-47a1-b3c9-ed849a81e7e4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:49.981385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd7f8b07-009d-4c4f-ada7-a9379a646844 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:49.982073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd7f8b07-009d-4c4f-ada7-a9379a646844 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:49.997043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd7f8b07-009d-4c4f-ada7-a9379a646844 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:49.997558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd7f8b07-009d-4c4f-ada7-a9379a646844 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:49.998041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd7f8b07-009d-4c4f-ada7-a9379a646844 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:49.998896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd7f8b07-009d-4c4f-ada7-a9379a646844 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:49.999333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd7f8b07-009d-4c4f-ada7-a9379a646844 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:50.002496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd7f8b07-009d-4c4f-ada7-a9379a646844 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:50.199497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd7f8b07-009d-4c4f-ada7-a9379a646844 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:50.204175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0bd94854-dfca-47a1-b3c9-ed849a81e7e4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:50.209911 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd7f8b07-009d-4c4f-ada7-a9379a646844 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1298 microversion: 2.1 time: 0.232903 Aug 27 03:00:50.211187 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2365/4894] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:49 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1298 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:50.218170 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0bd94854-dfca-47a1-b3c9-ed849a81e7e4 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1318 microversion: 2.1 time: 0.500882 Aug 27 03:00:50.231958 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2530/4895] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:49 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:51.233079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-77b374f0-f9ff-4d00-9ab3-2054f7675475 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:51.233687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-77b374f0-f9ff-4d00-9ab3-2054f7675475 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:51.245561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e6648520-a8bb-4e99-b339-8bbe64f7349b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:51.246312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e6648520-a8bb-4e99-b339-8bbe64f7349b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:51.262897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6648520-a8bb-4e99-b339-8bbe64f7349b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:51.263826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6648520-a8bb-4e99-b339-8bbe64f7349b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:51.263826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6648520-a8bb-4e99-b339-8bbe64f7349b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:51.264568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6648520-a8bb-4e99-b339-8bbe64f7349b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:51.265033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6648520-a8bb-4e99-b339-8bbe64f7349b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:51.265471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6648520-a8bb-4e99-b339-8bbe64f7349b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:51.267177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b374f0-f9ff-4d00-9ab3-2054f7675475 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:51.267670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b374f0-f9ff-4d00-9ab3-2054f7675475 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:51.268803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b374f0-f9ff-4d00-9ab3-2054f7675475 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:51.269579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b374f0-f9ff-4d00-9ab3-2054f7675475 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:51.270087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b374f0-f9ff-4d00-9ab3-2054f7675475 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:51.270526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b374f0-f9ff-4d00-9ab3-2054f7675475 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:52.058733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-77b374f0-f9ff-4d00-9ab3-2054f7675475 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:52.078050 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-77b374f0-f9ff-4d00-9ab3-2054f7675475 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1365 microversion: 2.1 time: 0.849892 Aug 27 03:00:52.080002 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2366/4896] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:51 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1365 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:52.086351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8544d4ea-fec2-4ad2-8173-98ba1ee2cb6f req-de6d2585-723d-48f6-80c6-a158a5167f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0225fcc-1d53-44e2-83cd-cc20e0d0664b", "name": "network-vif-plugged", "status": "completed", "tag": "5347a23c-38d0-4279-9818-c7eb55d177c7"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:52.101521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8544d4ea-fec2-4ad2-8173-98ba1ee2cb6f req-de6d2585-723d-48f6-80c6-a158a5167f55 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:52.103361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8544d4ea-fec2-4ad2-8173-98ba1ee2cb6f req-de6d2585-723d-48f6-80c6-a158a5167f55 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:52.105422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8544d4ea-fec2-4ad2-8173-98ba1ee2cb6f req-de6d2585-723d-48f6-80c6-a158a5167f55 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:52.136410 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8544d4ea-fec2-4ad2-8173-98ba1ee2cb6f req-de6d2585-723d-48f6-80c6-a158a5167f55 service nova] Creating event network-vif-plugged:5347a23c-38d0-4279-9818-c7eb55d177c7 for instance e0225fcc-1d53-44e2-83cd-cc20e0d0664b on n-h2-852084-5 Aug 27 03:00:52.146824 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8544d4ea-fec2-4ad2-8173-98ba1ee2cb6f req-de6d2585-723d-48f6-80c6-a158a5167f55 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064779 Aug 27 03:00:52.149048 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2367/4897] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:52.193914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-52269b90-b012-494e-8e5d-f3c1927c1518 req-17bd86c3-35de-4042-ad63-ac4609102134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2e6970-f9ec-4f37-8324-1b539b1e7f47", "tag": "660ec89b-ddd1-48a9-b894-1843e882740d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:52.221115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-52269b90-b012-494e-8e5d-f3c1927c1518 req-17bd86c3-35de-4042-ad63-ac4609102134 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:52.221913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-52269b90-b012-494e-8e5d-f3c1927c1518 req-17bd86c3-35de-4042-ad63-ac4609102134 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:52.222529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-52269b90-b012-494e-8e5d-f3c1927c1518 req-17bd86c3-35de-4042-ad63-ac4609102134 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:52.255399 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-52269b90-b012-494e-8e5d-f3c1927c1518 req-17bd86c3-35de-4042-ad63-ac4609102134 service nova] Creating event network-changed:660ec89b-ddd1-48a9-b894-1843e882740d for instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 on n-h1-852084-5 Aug 27 03:00:52.272388 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-52269b90-b012-494e-8e5d-f3c1927c1518 req-17bd86c3-35de-4042-ad63-ac4609102134 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081517 Aug 27 03:00:52.274478 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2368/4898] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:00:52.434700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e6648520-a8bb-4e99-b339-8bbe64f7349b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:52.451146 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e6648520-a8bb-4e99-b339-8bbe64f7349b tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1318 microversion: 2.1 time: 1.210134 Aug 27 03:00:52.452075 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2531/4899] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:51 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1318 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:53.110814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c8594fe3-b9ff-4175-acf1-116d7a181edd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:53.116494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c8594fe3-b9ff-4175-acf1-116d7a181edd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:53.128456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8594fe3-b9ff-4175-acf1-116d7a181edd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:53.129298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8594fe3-b9ff-4175-acf1-116d7a181edd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:53.130089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8594fe3-b9ff-4175-acf1-116d7a181edd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:53.130869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8594fe3-b9ff-4175-acf1-116d7a181edd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:53.131562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8594fe3-b9ff-4175-acf1-116d7a181edd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:53.134642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8594fe3-b9ff-4175-acf1-116d7a181edd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:53.334756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c8594fe3-b9ff-4175-acf1-116d7a181edd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:53.350294 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c8594fe3-b9ff-4175-acf1-116d7a181edd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1365 microversion: 2.1 time: 0.245714 Aug 27 03:00:53.357826 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2369/4900] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:53 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:53.482586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4eb71f73-2522-42a4-b1cf-ed73d4491799 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:53.483812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4eb71f73-2522-42a4-b1cf-ed73d4491799 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:53.514142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eb71f73-2522-42a4-b1cf-ed73d4491799 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:53.517339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eb71f73-2522-42a4-b1cf-ed73d4491799 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:53.517842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eb71f73-2522-42a4-b1cf-ed73d4491799 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:53.518617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eb71f73-2522-42a4-b1cf-ed73d4491799 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:53.519075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eb71f73-2522-42a4-b1cf-ed73d4491799 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:53.519679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4eb71f73-2522-42a4-b1cf-ed73d4491799 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:53.985942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4eb71f73-2522-42a4-b1cf-ed73d4491799 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:54.033507 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4eb71f73-2522-42a4-b1cf-ed73d4491799 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1318 microversion: 2.1 time: 0.561039 Aug 27 03:00:54.039884 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2532/4901] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:53 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:54.367293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-a67ee9e6-7ca9-4f21-a402-9ff82cb071f4 req-d82fd764-f0af-49b2-a8a4-e4aa5f13a2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3130fe92-b0c1-436c-99fa-b6568eca1046", "name": "network-vif-plugged", "status": "completed", "tag": "edb00601-a023-4481-aa93-477bc04b7825"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:54.381570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da0d7413-1a36-4367-8e74-1ac2c90b4695 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:54.382373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-da0d7413-1a36-4367-8e74-1ac2c90b4695 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:54.385561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:54.407374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da0d7413-1a36-4367-8e74-1ac2c90b4695 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:54.411669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da0d7413-1a36-4367-8e74-1ac2c90b4695 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:54.413217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da0d7413-1a36-4367-8e74-1ac2c90b4695 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:54.414740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a67ee9e6-7ca9-4f21-a402-9ff82cb071f4 req-d82fd764-f0af-49b2-a8a4-e4aa5f13a2ae service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:54.419539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da0d7413-1a36-4367-8e74-1ac2c90b4695 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:54.420375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da0d7413-1a36-4367-8e74-1ac2c90b4695 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:54.422016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a67ee9e6-7ca9-4f21-a402-9ff82cb071f4 req-d82fd764-f0af-49b2-a8a4-e4aa5f13a2ae service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:54.423387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da0d7413-1a36-4367-8e74-1ac2c90b4695 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:54.424063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a67ee9e6-7ca9-4f21-a402-9ff82cb071f4 req-d82fd764-f0af-49b2-a8a4-e4aa5f13a2ae service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:54.469995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:54.478208 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a67ee9e6-7ca9-4f21-a402-9ff82cb071f4 req-d82fd764-f0af-49b2-a8a4-e4aa5f13a2ae service nova] Creating event network-vif-plugged:edb00601-a023-4481-aa93-477bc04b7825 for instance 3130fe92-b0c1-436c-99fa-b6568eca1046 on n-h2-852084-5 Aug 27 03:00:54.504981 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-a67ee9e6-7ca9-4f21-a402-9ff82cb071f4 req-d82fd764-f0af-49b2-a8a4-e4aa5f13a2ae service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135154 Aug 27 03:00:54.508292 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2370/4902] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:55.064726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d9a1b99d-3e5c-4778-92a2-be3ed45d816a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:55.066537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d9a1b99d-3e5c-4778-92a2-be3ed45d816a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:55.068936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:55.086828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9a1b99d-3e5c-4778-92a2-be3ed45d816a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:55.089976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9a1b99d-3e5c-4778-92a2-be3ed45d816a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:55.090522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9a1b99d-3e5c-4778-92a2-be3ed45d816a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:55.091282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9a1b99d-3e5c-4778-92a2-be3ed45d816a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:55.094764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9a1b99d-3e5c-4778-92a2-be3ed45d816a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:55.095483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9a1b99d-3e5c-4778-92a2-be3ed45d816a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:55.272806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-da0d7413-1a36-4367-8e74-1ac2c90b4695 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:55.287894 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-da0d7413-1a36-4367-8e74-1ac2c90b4695 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1365 microversion: 2.1 time: 0.911006 Aug 27 03:00:55.289723 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2533/4903] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:54 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1365 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:55.373930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:56.318705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a405be88-64cb-462e-b22e-01023abdae97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:56.319415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a405be88-64cb-462e-b22e-01023abdae97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:56.358090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a405be88-64cb-462e-b22e-01023abdae97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:56.360579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a405be88-64cb-462e-b22e-01023abdae97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:56.362514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a405be88-64cb-462e-b22e-01023abdae97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:56.363925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a405be88-64cb-462e-b22e-01023abdae97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:56.367445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a405be88-64cb-462e-b22e-01023abdae97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:56.367968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a405be88-64cb-462e-b22e-01023abdae97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:56.519295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d9a1b99d-3e5c-4778-92a2-be3ed45d816a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:56.526189 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d9a1b99d-3e5c-4778-92a2-be3ed45d816a tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 200 len: 1507 microversion: 2.1 time: 1.467268 Aug 27 03:00:56.526786 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2371/4904] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:55 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 1507 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:56.553241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a6803586-c965-4ce0-9f5f-40c225306627 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:56.554161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a6803586-c965-4ce0-9f5f-40c225306627 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3130fe92-b0c1-436c-99fa-b6568eca1046] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:56.566842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6803586-c965-4ce0-9f5f-40c225306627 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:56.567671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6803586-c965-4ce0-9f5f-40c225306627 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:56.568315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6803586-c965-4ce0-9f5f-40c225306627 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:56.570619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6803586-c965-4ce0-9f5f-40c225306627 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:56.571325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6803586-c965-4ce0-9f5f-40c225306627 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:56.576570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a6803586-c965-4ce0-9f5f-40c225306627 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:57.168555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a405be88-64cb-462e-b22e-01023abdae97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:57.187987 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a405be88-64cb-462e-b22e-01023abdae97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1365 microversion: 2.1 time: 0.877351 Aug 27 03:00:57.194252 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2534/4905] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:56 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1365 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:57.267447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a6803586-c965-4ce0-9f5f-40c225306627 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:57.281475 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a6803586-c965-4ce0-9f5f-40c225306627 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046" status: 200 len: 1506 microversion: 2.1 time: 0.732934 Aug 27 03:00:57.282124 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2372/4906] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:56 2022] GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046 => generated 1506 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:00:57.309757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dda28300-0daa-4d56-9159-3c842fff1ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:57.310780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dda28300-0daa-4d56-9159-3c842fff1ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3130fe92-b0c1-436c-99fa-b6568eca1046] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:57.327548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda28300-0daa-4d56-9159-3c842fff1ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.333188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda28300-0daa-4d56-9159-3c842fff1ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.336281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda28300-0daa-4d56-9159-3c842fff1ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:57.337425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda28300-0daa-4d56-9159-3c842fff1ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.338989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda28300-0daa-4d56-9159-3c842fff1ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.343744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dda28300-0daa-4d56-9159-3c842fff1ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:57.397962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dda28300-0daa-4d56-9159-3c842fff1ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3130fe92-b0c1-436c-99fa-b6568eca1046] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:00:57.544369 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dda28300-0daa-4d56-9159-3c842fff1ffa tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046" status: 204 len: 0 microversion: 2.1 time: 0.241974 Aug 27 03:00:57.545407 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2535/4907] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:00:57 2022] DELETE /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:00:57.553523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-21abdc14-fdbf-4c32-94b9-af0ae98b5e09 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:57.554123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-21abdc14-fdbf-4c32-94b9-af0ae98b5e09 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:57.563911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21abdc14-fdbf-4c32-94b9-af0ae98b5e09 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.564279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21abdc14-fdbf-4c32-94b9-af0ae98b5e09 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.564723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21abdc14-fdbf-4c32-94b9-af0ae98b5e09 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:57.565442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21abdc14-fdbf-4c32-94b9-af0ae98b5e09 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.566339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21abdc14-fdbf-4c32-94b9-af0ae98b5e09 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.579032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-21abdc14-fdbf-4c32-94b9-af0ae98b5e09 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:57.645461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-21abdc14-fdbf-4c32-94b9-af0ae98b5e09 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:00:57.870613 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-21abdc14-fdbf-4c32-94b9-af0ae98b5e09 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 204 len: 0 microversion: 2.1 time: 0.317916 Aug 27 03:00:57.875234 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2373/4908] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:00:57 2022] DELETE /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:00:57.882462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec1ab8c1-16cc-46a4-95e5-3866cbfdaf4c tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:57.883372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ec1ab8c1-16cc-46a4-95e5-3866cbfdaf4c tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3130fe92-b0c1-436c-99fa-b6568eca1046] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:57.894135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec1ab8c1-16cc-46a4-95e5-3866cbfdaf4c tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.894637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec1ab8c1-16cc-46a4-95e5-3866cbfdaf4c tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.895082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec1ab8c1-16cc-46a4-95e5-3866cbfdaf4c tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:57.895873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec1ab8c1-16cc-46a4-95e5-3866cbfdaf4c tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:57.896273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec1ab8c1-16cc-46a4-95e5-3866cbfdaf4c tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:57.896703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec1ab8c1-16cc-46a4-95e5-3866cbfdaf4c tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.223659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fc404daf-19e1-4201-830a-fc43491b77fd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:58.225007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fc404daf-19e1-4201-830a-fc43491b77fd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:58.237659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc404daf-19e1-4201-830a-fc43491b77fd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.238913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc404daf-19e1-4201-830a-fc43491b77fd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.239922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc404daf-19e1-4201-830a-fc43491b77fd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.241444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc404daf-19e1-4201-830a-fc43491b77fd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:58.242561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc404daf-19e1-4201-830a-fc43491b77fd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:58.245286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc404daf-19e1-4201-830a-fc43491b77fd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:58.362566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ec1ab8c1-16cc-46a4-95e5-3866cbfdaf4c tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:58.378164 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec1ab8c1-16cc-46a4-95e5-3866cbfdaf4c tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046" status: 200 len: 1512 microversion: 2.1 time: 0.499766 Aug 27 03:00:58.379997 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2536/4909] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:57 2022] GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046 => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:58.782821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fc404daf-19e1-4201-830a-fc43491b77fd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:00:58.796720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:00:58.810522 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fc404daf-19e1-4201-830a-fc43491b77fd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1365 microversion: 2.1 time: 0.595104 Aug 27 03:00:58.827369 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2374/4910] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:58 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1365 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:00:59.037296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-02a1760a-62b8-4032-9f55-da299a00a69a req-141c4515-8e71-429c-ae90-e4f9de35e140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2e6970-f9ec-4f37-8324-1b539b1e7f47", "name": "network-vif-plugged", "status": "completed", "tag": "660ec89b-ddd1-48a9-b894-1843e882740d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:00:59.078163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-02a1760a-62b8-4032-9f55-da299a00a69a req-141c4515-8e71-429c-ae90-e4f9de35e140 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:59.079013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-02a1760a-62b8-4032-9f55-da299a00a69a req-141c4515-8e71-429c-ae90-e4f9de35e140 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:59.081717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-02a1760a-62b8-4032-9f55-da299a00a69a req-141c4515-8e71-429c-ae90-e4f9de35e140 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:59.116781 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-02a1760a-62b8-4032-9f55-da299a00a69a req-141c4515-8e71-429c-ae90-e4f9de35e140 service nova] Creating event network-vif-plugged:660ec89b-ddd1-48a9-b894-1843e882740d for instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 on n-h1-852084-5 Aug 27 03:00:59.125740 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-02a1760a-62b8-4032-9f55-da299a00a69a req-141c4515-8e71-429c-ae90-e4f9de35e140 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094391 Aug 27 03:00:59.127244 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2537/4911] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:00:59.417240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-128ac41d-a4aa-43ca-8208-546e0a9225e3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:59.419125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-128ac41d-a4aa-43ca-8208-546e0a9225e3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3130fe92-b0c1-436c-99fa-b6568eca1046] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:59.436144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-128ac41d-a4aa-43ca-8208-546e0a9225e3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:59.438194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-128ac41d-a4aa-43ca-8208-546e0a9225e3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:59.438849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-128ac41d-a4aa-43ca-8208-546e0a9225e3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:59.453716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-128ac41d-a4aa-43ca-8208-546e0a9225e3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:59.455439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-128ac41d-a4aa-43ca-8208-546e0a9225e3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:59.456514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-128ac41d-a4aa-43ca-8208-546e0a9225e3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:59.844119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6930cf20-edea-45a2-adbc-46019b242cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:00:59.849367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6930cf20-edea-45a2-adbc-46019b242cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:00:59.868255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6930cf20-edea-45a2-adbc-46019b242cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:59.874112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6930cf20-edea-45a2-adbc-46019b242cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:59.877413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6930cf20-edea-45a2-adbc-46019b242cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:00:59.878469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6930cf20-edea-45a2-adbc-46019b242cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:00:59.879225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6930cf20-edea-45a2-adbc-46019b242cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:00:59.881161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6930cf20-edea-45a2-adbc-46019b242cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:00.864232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-128ac41d-a4aa-43ca-8208-546e0a9225e3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:00.873351 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-128ac41d-a4aa-43ca-8208-546e0a9225e3 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046" status: 200 len: 1512 microversion: 2.1 time: 1.476699 Aug 27 03:01:00.883514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6930cf20-edea-45a2-adbc-46019b242cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:00.892560 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2375/4912] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:59 2022] GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046 => generated 1512 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:00.926924 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6930cf20-edea-45a2-adbc-46019b242cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1365 microversion: 2.1 time: 1.089130 Aug 27 03:01:00.930591 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2538/4913] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:00:59 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1365 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:01.836597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-13ede803-e498-4acf-904f-c6b2f64cc5de req-e277bcc2-cdab-4b31-9c80-0d9993543e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0225fcc-1d53-44e2-83cd-cc20e0d0664b", "name": "network-vif-deleted", "tag": "5347a23c-38d0-4279-9818-c7eb55d177c7"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:01.865117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-13ede803-e498-4acf-904f-c6b2f64cc5de req-e277bcc2-cdab-4b31-9c80-0d9993543e24 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:01.867893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-13ede803-e498-4acf-904f-c6b2f64cc5de req-e277bcc2-cdab-4b31-9c80-0d9993543e24 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:01.869830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-13ede803-e498-4acf-904f-c6b2f64cc5de req-e277bcc2-cdab-4b31-9c80-0d9993543e24 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:01.904053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-66d4f1cb-37e9-4411-80db-7707183adace tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:01.909485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-66d4f1cb-37e9-4411-80db-7707183adace tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3130fe92-b0c1-436c-99fa-b6568eca1046] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:01.970675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d4f1cb-37e9-4411-80db-7707183adace tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:01.971199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d4f1cb-37e9-4411-80db-7707183adace tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:01.971653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d4f1cb-37e9-4411-80db-7707183adace tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:01.972418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d4f1cb-37e9-4411-80db-7707183adace tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:01.972903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d4f1cb-37e9-4411-80db-7707183adace tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:01.973345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d4f1cb-37e9-4411-80db-7707183adace tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:01.979339 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-13ede803-e498-4acf-904f-c6b2f64cc5de req-e277bcc2-cdab-4b31-9c80-0d9993543e24 service nova] Creating event network-vif-deleted:5347a23c-38d0-4279-9818-c7eb55d177c7 for instance e0225fcc-1d53-44e2-83cd-cc20e0d0664b on n-h2-852084-5 Aug 27 03:01:02.001600 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-13ede803-e498-4acf-904f-c6b2f64cc5de req-e277bcc2-cdab-4b31-9c80-0d9993543e24 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166861 Aug 27 03:01:02.005431 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2376/4914] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:02.031127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-47b33285-4247-4af9-ab6e-318855bf43ca tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:02.034277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-47b33285-4247-4af9-ab6e-318855bf43ca tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:02.062964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47b33285-4247-4af9-ab6e-318855bf43ca tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:02.071763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47b33285-4247-4af9-ab6e-318855bf43ca tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:02.076337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47b33285-4247-4af9-ab6e-318855bf43ca tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:02.077894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47b33285-4247-4af9-ab6e-318855bf43ca tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:02.079080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47b33285-4247-4af9-ab6e-318855bf43ca tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:02.082030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-47b33285-4247-4af9-ab6e-318855bf43ca tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:02.473125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-47b33285-4247-4af9-ab6e-318855bf43ca tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:02.484065 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-47b33285-4247-4af9-ab6e-318855bf43ca tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1555 microversion: 2.1 time: 0.474021 Aug 27 03:01:02.490340 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2377/4915] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:02 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1555 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:02.516410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2bf5df9b-1a59-436b-a835-610386fcc3c4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:02.517557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2bf5df9b-1a59-436b-a835-610386fcc3c4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:02.529395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bf5df9b-1a59-436b-a835-610386fcc3c4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:02.529910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bf5df9b-1a59-436b-a835-610386fcc3c4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:02.536718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bf5df9b-1a59-436b-a835-610386fcc3c4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:02.537496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bf5df9b-1a59-436b-a835-610386fcc3c4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:02.538034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bf5df9b-1a59-436b-a835-610386fcc3c4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:02.538415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2bf5df9b-1a59-436b-a835-610386fcc3c4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:03.020326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-66d4f1cb-37e9-4411-80db-7707183adace tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:03.052396 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-66d4f1cb-37e9-4411-80db-7707183adace tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046" status: 200 len: 1512 microversion: 2.1 time: 1.156312 Aug 27 03:01:03.070313 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2539/4916] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:01 2022] GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046 => generated 1512 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:03.090683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ff8c38ef-dcea-4ae9-ad69-38e017d8994d req-d9e6c8b5-1269-4b29-908d-45532354e049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3130fe92-b0c1-436c-99fa-b6568eca1046", "name": "network-vif-deleted", "tag": "edb00601-a023-4481-aa93-477bc04b7825"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:03.161156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ff8c38ef-dcea-4ae9-ad69-38e017d8994d req-d9e6c8b5-1269-4b29-908d-45532354e049 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:03.161897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ff8c38ef-dcea-4ae9-ad69-38e017d8994d req-d9e6c8b5-1269-4b29-908d-45532354e049 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:03.162402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ff8c38ef-dcea-4ae9-ad69-38e017d8994d req-d9e6c8b5-1269-4b29-908d-45532354e049 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:03.201568 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ff8c38ef-dcea-4ae9-ad69-38e017d8994d req-d9e6c8b5-1269-4b29-908d-45532354e049 service nova] Creating event network-vif-deleted:edb00601-a023-4481-aa93-477bc04b7825 for instance 3130fe92-b0c1-436c-99fa-b6568eca1046 on n-h2-852084-5 Aug 27 03:01:03.209910 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ff8c38ef-dcea-4ae9-ad69-38e017d8994d req-d9e6c8b5-1269-4b29-908d-45532354e049 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137976 Aug 27 03:01:03.210550 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2540/4917] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:03.343441 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2bf5df9b-1a59-436b-a835-610386fcc3c4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.831002 Aug 27 03:01:03.345091 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2378/4918] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 03:01:02 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47/os-interface => generated 284 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:04.095674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:04.096403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3130fe92-b0c1-436c-99fa-b6568eca1046] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:04.124605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:04.125424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:04.125649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:04.151470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:04.151995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:04.152472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:04.309985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:04.310573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:04.311039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:04.311510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lazy-loading 'fault' on Instance uuid 3130fe92-b0c1-436c-99fa-b6568eca1046 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:01:04.603779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b759cd11864e8684eef82414a3710b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aad3a1e1a9b497fa3e4a8be2a7e85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:04.619917 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9b6459d2-5c68-459f-8b70-4d4063705e41 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046" status: 200 len: 1308 microversion: 2.1 time: 0.528238 Aug 27 03:01:04.620692 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2541/4919] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:04 2022] GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046 => generated 1308 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:05.644605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:05.645311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: 3130fe92-b0c1-436c-99fa-b6568eca1046] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:05.659199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:05.661577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:05.663351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:05.664105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:05.664580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:05.665011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:05.706686 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] HTTP exception thrown: Instance 3130fe92-b0c1-436c-99fa-b6568eca1046 could not be found. Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Request method failure captured: Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046 HTTP/1.1 Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYioFnxQJYX4UKnkapBhKZ4DMvGeJmrv69jtl6MK86gnHiGpehfNRfI7KD7qCI1waxkB20RNhVbTDCa6KGxHCK9mMYOgqhOsYV9C5N6iKb6PVT5ia0Eo5OdWiiL1VeY7btMQhpgdoJ6j9o9CDnhlAsxxz4gdaEL8UoT3ZM1Ib_Ud7QI Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 7aad3a1e1a9b497fa3e4a8be2a7e85ca Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-MultipleCreateTestJSON-1933795202 Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7aad3a1e1a9b497fa3e4a8be2a7e85ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7aad3a1e1a9b497fa3e4a8be2a7e85ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7aad3a1e1a9b497fa3e4a8be2a7e85ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7aad3a1e1a9b497fa3e4a8be2a7e85ca"}]}] Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-MultipleCreateTestJSON-1933795202 Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 7aad3a1e1a9b497fa3e4a8be2a7e85ca Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1933795202 Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-MultipleCreateTestJSON-1933795202-project Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 76b759cd11864e8684eef82414a3710b Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-MultipleCreateTestJSON-1933795202-project Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 3130fe92-b0c1-436c-99fa-b6568eca1046 could not be found. Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '3130fe92-b0c1-436c-99fa-b6568eca1046'} Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3130fe92-b0c1-436c-99fa-b6568eca1046 could not be found. Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3130fe92-b0c1-436c-99fa-b6568eca1046 could not be found. Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:05.708170 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:05.711680 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:05.711680 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:05.711680 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:05.711680 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:01:05.711680 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:01:05.711680 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3130fe92-b0c1-436c-99fa-b6568eca1046 could not be found. Aug 27 03:01:05.711680 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:05.711680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Returning 404 to user: Instance 3130fe92-b0c1-436c-99fa-b6568eca1046 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:05.711680 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-57bf7c00-b8fb-45dc-b752-8c884f4bfaea tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046" status: 404 len: 111 microversion: 2.1 time: 0.070949 Aug 27 03:01:05.711680 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2379/4920] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:05 2022] GET /compute/v2.1/servers/3130fe92-b0c1-436c-99fa-b6568eca1046 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:01:05.721576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:05.722268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] [instance: e0225fcc-1d53-44e2-83cd-cc20e0d0664b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:05.738474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:05.739023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:05.740838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:05.741732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:05.742234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:05.742682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:05.790401 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] HTTP exception thrown: Instance e0225fcc-1d53-44e2-83cd-cc20e0d0664b could not be found. Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Request method failure captured: Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b HTTP/1.1 Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYioFnxQJYX4UKnkapBhKZ4DMvGeJmrv69jtl6MK86gnHiGpehfNRfI7KD7qCI1waxkB20RNhVbTDCa6KGxHCK9mMYOgqhOsYV9C5N6iKb6PVT5ia0Eo5OdWiiL1VeY7btMQhpgdoJ6j9o9CDnhlAsxxz4gdaEL8UoT3ZM1Ib_Ud7QI Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 7aad3a1e1a9b497fa3e4a8be2a7e85ca Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-MultipleCreateTestJSON-1933795202 Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_7aad3a1e1a9b497fa3e4a8be2a7e85ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7aad3a1e1a9b497fa3e4a8be2a7e85ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/7aad3a1e1a9b497fa3e4a8be2a7e85ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/7aad3a1e1a9b497fa3e4a8be2a7e85ca"}]}] Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-MultipleCreateTestJSON-1933795202 Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 7aad3a1e1a9b497fa3e4a8be2a7e85ca Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1933795202 Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-MultipleCreateTestJSON-1933795202-project Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 76b759cd11864e8684eef82414a3710b Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-MultipleCreateTestJSON-1933795202-project Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance e0225fcc-1d53-44e2-83cd-cc20e0d0664b could not be found. Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'e0225fcc-1d53-44e2-83cd-cc20e0d0664b'} Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0225fcc-1d53-44e2-83cd-cc20e0d0664b could not be found. Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0225fcc-1d53-44e2-83cd-cc20e0d0664b could not be found. Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:05.801306 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:01:05.804534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:05.804534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:05.804534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:05.804534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:01:05.804534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:01:05.804534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0225fcc-1d53-44e2-83cd-cc20e0d0664b could not be found. Aug 27 03:01:05.804534 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:01:05.804534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] Returning 404 to user: Instance e0225fcc-1d53-44e2-83cd-cc20e0d0664b could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:05.804534 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3cd34e1c-2772-482a-a4a2-c8ec04611fd7 tempest-MultipleCreateTestJSON-1933795202 tempest-MultipleCreateTestJSON-1933795202-project] 10.222.0.99 "GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b" status: 404 len: 111 microversion: 2.1 time: 0.087664 Aug 27 03:01:05.805013 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2542/4921] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:05 2022] GET /compute/v2.1/servers/e0225fcc-1d53-44e2-83cd-cc20e0d0664b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:01:11.703397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-1538cd78-b51a-4065-87db-49d0f202a68d req-10a8fea0-b1e8-422f-b9d9-94b7641b2bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2e6970-f9ec-4f37-8324-1b539b1e7f47", "tag": "660ec89b-ddd1-48a9-b894-1843e882740d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:11.727652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1538cd78-b51a-4065-87db-49d0f202a68d req-10a8fea0-b1e8-422f-b9d9-94b7641b2bfb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:11.729035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1538cd78-b51a-4065-87db-49d0f202a68d req-10a8fea0-b1e8-422f-b9d9-94b7641b2bfb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:11.729717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1538cd78-b51a-4065-87db-49d0f202a68d req-10a8fea0-b1e8-422f-b9d9-94b7641b2bfb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:11.758155 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1538cd78-b51a-4065-87db-49d0f202a68d req-10a8fea0-b1e8-422f-b9d9-94b7641b2bfb service nova] Creating event network-changed:660ec89b-ddd1-48a9-b894-1843e882740d for instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 on n-h1-852084-5 Aug 27 03:01:11.778919 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-1538cd78-b51a-4065-87db-49d0f202a68d req-10a8fea0-b1e8-422f-b9d9-94b7641b2bfb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079916 Aug 27 03:01:11.780238 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2380/4922] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:35.559359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dcff79af-31cb-41f2-878c-e4493997f819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:35.563463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dcff79af-31cb-41f2-878c-e4493997f819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:35.581782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:35.582743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:35.584292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcff79af-31cb-41f2-878c-e4493997f819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:35.584799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcff79af-31cb-41f2-878c-e4493997f819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:35.592669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcff79af-31cb-41f2-878c-e4493997f819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:35.593556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcff79af-31cb-41f2-878c-e4493997f819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:35.594032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcff79af-31cb-41f2-878c-e4493997f819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:35.594522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcff79af-31cb-41f2-878c-e4493997f819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:35.730144 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dcff79af-31cb-41f2-878c-e4493997f819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47/ips" status: 200 len: 150 microversion: 2.1 time: 0.178147 Aug 27 03:01:35.735009 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2543/4923] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 03:01:35 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47/ips => generated 150 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:35.743645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5eb1de7e-7734-4559-b6d6-96ddc39715e5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:35.747184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:35.764498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:35.765803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=23 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:35.792633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:35.793412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:35.794057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:35.796501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:35.797140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:35.803405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.124078 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Invalid volume: volume 5eb1de7e-7734-4559-b6d6-96ddc39715e5 is already attached to instances: f354f690-0290-4b99-bd08-961f97e09066 Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47/os-volume_attachments HTTP/1.1 Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 74 Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: {"volumeAttachment": {"volumeId": "5eb1de7e-7734-4559-b6d6-96ddc39715e5"}} Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: exception: Invalid volume: volume 5eb1de7e-7734-4559-b6d6-96ddc39715e5 is already attached to instances: f354f690-0290-4b99-bd08-961f97e09066 Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': '1b2e6970-f9ec-4f37-8324-1b539b1e7f47', 'body': {'volumeAttachment': {'volumeId': '5eb1de7e-7734-4559-b6d6-96ddc39715e5'}}} Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5eb1de7e-7734-4559-b6d6-96ddc39715e5 is already attached to instances: f354f690-0290-4b99-bd08-961f97e09066 Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:01:36.126030 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5eb1de7e-7734-4559-b6d6-96ddc39715e5 is already attached to instances: f354f690-0290-4b99-bd08-961f97e09066 Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5eb1de7e-7734-4559-b6d6-96ddc39715e5 is already attached to instances: f354f690-0290-4b99-bd08-961f97e09066 Aug 27 03:01:36.130121 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:36.142162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 400 to user: Invalid volume: volume 5eb1de7e-7734-4559-b6d6-96ddc39715e5 is already attached to instances: f354f690-0290-4b99-bd08-961f97e09066 {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:36.150865 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a49408d7-81a2-4096-b9b4-f5477219324b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.408933 Aug 27 03:01:36.151901 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2381/4924] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:01:35 2022] POST /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47/os-volume_attachments => generated 174 bytes in 414 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:01:36.161649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50cdef84-2806-4dee-bc51-597543e008b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:36.162180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-50cdef84-2806-4dee-bc51-597543e008b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:36.196253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50cdef84-2806-4dee-bc51-597543e008b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.196839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50cdef84-2806-4dee-bc51-597543e008b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.197343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50cdef84-2806-4dee-bc51-597543e008b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.198319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50cdef84-2806-4dee-bc51-597543e008b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.198919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50cdef84-2806-4dee-bc51-597543e008b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.199398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50cdef84-2806-4dee-bc51-597543e008b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.246316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-50cdef84-2806-4dee-bc51-597543e008b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:01:36.526286 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-50cdef84-2806-4dee-bc51-597543e008b1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 204 len: 0 microversion: 2.1 time: 0.369146 Aug 27 03:01:36.527055 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2544/4925] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:01:36 2022] DELETE /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:01:36.535604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b97b8f55-bd22-4fa1-8bdb-fa3f2018f901 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:36.536410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b97b8f55-bd22-4fa1-8bdb-fa3f2018f901 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:36.555014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b97b8f55-bd22-4fa1-8bdb-fa3f2018f901 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.563309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b97b8f55-bd22-4fa1-8bdb-fa3f2018f901 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.568423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b97b8f55-bd22-4fa1-8bdb-fa3f2018f901 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:36.576046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b97b8f55-bd22-4fa1-8bdb-fa3f2018f901 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:36.584655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b97b8f55-bd22-4fa1-8bdb-fa3f2018f901 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:36.585825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b97b8f55-bd22-4fa1-8bdb-fa3f2018f901 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:37.534134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b97b8f55-bd22-4fa1-8bdb-fa3f2018f901 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:37.544382 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b97b8f55-bd22-4fa1-8bdb-fa3f2018f901 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1680 microversion: 2.1 time: 1.012665 Aug 27 03:01:37.555317 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2382/4926] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:36 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1680 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:01:38.587186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-22e87066-5b2f-48d0-b116-3668ec11ede3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:38.592460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-22e87066-5b2f-48d0-b116-3668ec11ede3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:38.620699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e87066-5b2f-48d0-b116-3668ec11ede3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:38.622343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e87066-5b2f-48d0-b116-3668ec11ede3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:38.626892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e87066-5b2f-48d0-b116-3668ec11ede3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:38.628078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e87066-5b2f-48d0-b116-3668ec11ede3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:38.628859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e87066-5b2f-48d0-b116-3668ec11ede3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:38.638514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e87066-5b2f-48d0-b116-3668ec11ede3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:40.135359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-22e87066-5b2f-48d0-b116-3668ec11ede3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:40.155477 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-22e87066-5b2f-48d0-b116-3668ec11ede3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1680 microversion: 2.1 time: 1.578513 Aug 27 03:01:40.159665 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2545/4927] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:38 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1680 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:41.181386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-105c0a87-85d8-418a-9563-3147a5c7e46c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:41.182139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-105c0a87-85d8-418a-9563-3147a5c7e46c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:41.194025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-105c0a87-85d8-418a-9563-3147a5c7e46c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:41.196728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-105c0a87-85d8-418a-9563-3147a5c7e46c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:41.197521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-105c0a87-85d8-418a-9563-3147a5c7e46c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:41.198496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-105c0a87-85d8-418a-9563-3147a5c7e46c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:41.199132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-105c0a87-85d8-418a-9563-3147a5c7e46c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:41.199723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-105c0a87-85d8-418a-9563-3147a5c7e46c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:42.162694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-105c0a87-85d8-418a-9563-3147a5c7e46c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:42.173147 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-105c0a87-85d8-418a-9563-3147a5c7e46c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1680 microversion: 2.1 time: 0.995654 Aug 27 03:01:42.176494 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2383/4928] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:41 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1680 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:42.206836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4219f4c1-f43c-4ca3-bae3-505d8e31a32a req-d5d0f0af-2815-4a7f-86a2-2c95c965710a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2e6970-f9ec-4f37-8324-1b539b1e7f47", "name": "network-vif-unplugged", "status": "completed", "tag": "660ec89b-ddd1-48a9-b894-1843e882740d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:42.229413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4219f4c1-f43c-4ca3-bae3-505d8e31a32a req-d5d0f0af-2815-4a7f-86a2-2c95c965710a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:42.230007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4219f4c1-f43c-4ca3-bae3-505d8e31a32a req-d5d0f0af-2815-4a7f-86a2-2c95c965710a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:42.230585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4219f4c1-f43c-4ca3-bae3-505d8e31a32a req-d5d0f0af-2815-4a7f-86a2-2c95c965710a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:42.252097 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4219f4c1-f43c-4ca3-bae3-505d8e31a32a req-d5d0f0af-2815-4a7f-86a2-2c95c965710a service nova] Creating event network-vif-unplugged:660ec89b-ddd1-48a9-b894-1843e882740d for instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 on n-h1-852084-5 Aug 27 03:01:42.268469 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4219f4c1-f43c-4ca3-bae3-505d8e31a32a req-d5d0f0af-2815-4a7f-86a2-2c95c965710a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064689 Aug 27 03:01:42.269213 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2546/4929] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:43.202264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e6c68472-74f0-407b-b13c-45d2a7ed1af0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:43.203074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e6c68472-74f0-407b-b13c-45d2a7ed1af0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:43.229296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6c68472-74f0-407b-b13c-45d2a7ed1af0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:43.233161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6c68472-74f0-407b-b13c-45d2a7ed1af0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:43.237569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6c68472-74f0-407b-b13c-45d2a7ed1af0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:43.240439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6c68472-74f0-407b-b13c-45d2a7ed1af0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:43.241185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6c68472-74f0-407b-b13c-45d2a7ed1af0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:43.243607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6c68472-74f0-407b-b13c-45d2a7ed1af0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:44.302482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e6c68472-74f0-407b-b13c-45d2a7ed1af0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:44.333587 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e6c68472-74f0-407b-b13c-45d2a7ed1af0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1613 microversion: 2.1 time: 1.135661 Aug 27 03:01:44.338595 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2384/4930] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:43 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1613 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:44.875454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ad825092-40d2-41f6-91b8-f12863b321ed req-36698139-9f50-47b7-bb1f-c9846c6994aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2e6970-f9ec-4f37-8324-1b539b1e7f47", "name": "network-vif-deleted", "tag": "660ec89b-ddd1-48a9-b894-1843e882740d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:44.913052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ad825092-40d2-41f6-91b8-f12863b321ed req-36698139-9f50-47b7-bb1f-c9846c6994aa service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:44.913809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ad825092-40d2-41f6-91b8-f12863b321ed req-36698139-9f50-47b7-bb1f-c9846c6994aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:44.914973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ad825092-40d2-41f6-91b8-f12863b321ed req-36698139-9f50-47b7-bb1f-c9846c6994aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:44.957636 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ad825092-40d2-41f6-91b8-f12863b321ed req-36698139-9f50-47b7-bb1f-c9846c6994aa service nova] Creating event network-vif-deleted:660ec89b-ddd1-48a9-b894-1843e882740d for instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 on n-h1-852084-5 Aug 27 03:01:44.993327 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ad825092-40d2-41f6-91b8-f12863b321ed req-36698139-9f50-47b7-bb1f-c9846c6994aa service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130215 Aug 27 03:01:44.995264 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2547/4931] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:01:45.362258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:45.364078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:45.378811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:45.379549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:45.380147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:45.381024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:45.400242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:45.400943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:45.560118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:45.560728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:45.561191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:45.561694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lazy-loading 'fault' on Instance uuid 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:01:45.846527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:45.861232 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ed2e852c-af4f-4ede-a7f6-1f22903f009a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 200 len: 1330 microversion: 2.1 time: 0.502551 Aug 27 03:01:45.863987 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2385/4932] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:45 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 1330 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:01:46.022688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1475020856", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "fdf2e30b-efea-43e7-8640-c671b75e8af3"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:46.212954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] validate_networks() for [('fdf2e30b-efea-43e7-8640-c671b75e8af3', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:01:46.885487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:46.888236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:46.908652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:46.914607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:46.916239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:46.917158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:46.917784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:46.919296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:46.990024 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 HTTP/1.1 Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '1b2e6970-f9ec-4f37-8324-1b539b1e7f47'} Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:01:46.992938 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:46.996480 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:01:46.996480 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:01:46.996480 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:01:46.996480 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:01:46.996480 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:01:46.996480 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:01:46.996480 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:01:47.000126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:01:47.005393 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eba7918e-fc6b-44b3-80cd-f566952fef51 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 404 len: 111 microversion: 2.1 time: 0.124625 Aug 27 03:01:47.006708 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2386/4933] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:01:46 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:01:47.016773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-757a8342-f249-4008-8357-6e605b2f4dea tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '.version_select at 0x7f4d29ab0a60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:47.063583 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-757a8342-f249-4008-8357-6e605b2f4dea tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864810996" status: 202 len: 0 microversion: 2.1 time: 0.052026 Aug 27 03:01:47.065548 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2387/4934] 10.222.0.99 () {58 vars in 1218 bytes} [Sat Aug 27 03:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864810996 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:01:48.408612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:01:48.408992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:01:48.409959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:01:48.409959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:01:48.410228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:01:48.429489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:48.430049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:48.430490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:48.431216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:48.431673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:48.436768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:48.471050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Getting quotas for project bdfc329d9ad7460f81912ce1a11a2bd7. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:01:48.481456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Getting quotas for user 54cac25050ef42d18b3421338fa61572 and project bdfc329d9ad7460f81912ce1a11a2bd7. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:01:48.551819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:01:48.562794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:01:48.739000 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-68818838-9b76-4dcc-aa52-1a88fdecf25e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.098454 Aug 27 03:01:48.749283 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2548/4935] 10.222.0.99 () {62 vars in 1188 bytes} [Sat Aug 27 03:01:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3109 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 03:01:48.770037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b5309ad2-4f09-4569-992b-a9200b604a48 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:48.771360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b5309ad2-4f09-4569-992b-a9200b604a48 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:49.087933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b5309ad2-4f09-4569-992b-a9200b604a48 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:49.103784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b5309ad2-4f09-4569-992b-a9200b604a48 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:49.120096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b5309ad2-4f09-4569-992b-a9200b604a48 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:49.121357 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b5309ad2-4f09-4569-992b-a9200b604a48 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1262 microversion: 2.26 time: 0.374054 Aug 27 03:01:49.131685 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2388/4936] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:48 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1262 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:01:49.802042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb2d6de4-37af-4b10-8045-ff36d3c3daee tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:49.802647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fb2d6de4-37af-4b10-8045-ff36d3c3daee tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:49.827509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb2d6de4-37af-4b10-8045-ff36d3c3daee tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:49.833877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb2d6de4-37af-4b10-8045-ff36d3c3daee tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:49.834887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb2d6de4-37af-4b10-8045-ff36d3c3daee tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:49.836438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb2d6de4-37af-4b10-8045-ff36d3c3daee tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:49.840188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb2d6de4-37af-4b10-8045-ff36d3c3daee tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:49.840991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb2d6de4-37af-4b10-8045-ff36d3c3daee tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:50.104529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-fb2d6de4-37af-4b10-8045-ff36d3c3daee tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lazy-loading 'services' on Instance uuid f354f690-0290-4b99-bd08-961f97e09066 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:01:50.151037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:50.152302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:50.163941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:50.180651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:50.194332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:50.202712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:50.203490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:50.205442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:50.296208 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fb2d6de4-37af-4b10-8045-ff36d3c3daee tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments/5eb1de7e-7734-4559-b6d6-96ddc39715e5" status: 202 len: 0 microversion: 2.1 time: 0.500883 Aug 27 03:01:50.309947 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2549/4937] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:01:49 2022] DELETE /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments/5eb1de7e-7734-4559-b6d6-96ddc39715e5 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:01:50.324980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fd7877b3-a995-4a10-95db-bdd6a59976a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:50.333628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fd7877b3-a995-4a10-95db-bdd6a59976a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:50.351124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd7877b3-a995-4a10-95db-bdd6a59976a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:50.352264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd7877b3-a995-4a10-95db-bdd6a59976a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:50.352737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd7877b3-a995-4a10-95db-bdd6a59976a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:50.369916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd7877b3-a995-4a10-95db-bdd6a59976a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:50.370800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd7877b3-a995-4a10-95db-bdd6a59976a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:50.371406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd7877b3-a995-4a10-95db-bdd6a59976a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:50.396102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:50.408617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:50.413562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:50.421508 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-df44cb5e-46ab-4fb6-9be4-2534878a39b9 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1258 microversion: 2.26 time: 0.275156 Aug 27 03:01:50.453707 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2389/4938] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:50 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1258 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:50.468824 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fd7877b3-a995-4a10-95db-bdd6a59976a4 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157118 Aug 27 03:01:50.469319 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2550/4939] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:01:50 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:51.471317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:51.472723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:51.488624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21ba7b9f-5291-49da-887a-c67e98353714 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:51.494551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21ba7b9f-5291-49da-887a-c67e98353714 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:51.522526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba7b9f-5291-49da-887a-c67e98353714 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:51.522976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba7b9f-5291-49da-887a-c67e98353714 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:51.528903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:51.530125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:51.532277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:51.540119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:51.540956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba7b9f-5291-49da-887a-c67e98353714 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:51.544634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:51.545278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba7b9f-5291-49da-887a-c67e98353714 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:51.546579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:51.547282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba7b9f-5291-49da-887a-c67e98353714 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:51.549845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba7b9f-5291-49da-887a-c67e98353714 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:51.693170 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21ba7b9f-5291-49da-887a-c67e98353714 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209339 Aug 27 03:01:51.694427 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2551/4940] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:01:51 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:01:51.776334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:51.785581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:51.787070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:51.792861 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8b913ff9-6b23-4a6d-be84-6f05e001433d tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1322 microversion: 2.26 time: 0.325526 Aug 27 03:01:51.794298 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2390/4941] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:51 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:52.705416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b912fa66-94fb-4317-811a-9d19f91620d9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:52.708520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b912fa66-94fb-4317-811a-9d19f91620d9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:52.730539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b912fa66-94fb-4317-811a-9d19f91620d9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:52.735230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b912fa66-94fb-4317-811a-9d19f91620d9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:52.736802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b912fa66-94fb-4317-811a-9d19f91620d9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:52.737458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b912fa66-94fb-4317-811a-9d19f91620d9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:52.737967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b912fa66-94fb-4317-811a-9d19f91620d9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:52.739816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b912fa66-94fb-4317-811a-9d19f91620d9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:52.826148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:52.831371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:52.856632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:52.858939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:52.861017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:52.864293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:52.864954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:52.870569 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b912fa66-94fb-4317-811a-9d19f91620d9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169000 Aug 27 03:01:52.871236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:52.883501 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2552/4942] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:01:52 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:53.114282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:53.133990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:53.138824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:53.143305 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-357c331a-4ebf-4326-a084-cf10ce39cb78 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1320 microversion: 2.26 time: 0.325572 Aug 27 03:01:53.160407 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2391/4943] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:52 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1320 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:53.894274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a259c196-92f6-491a-bc4a-8c64eefadc61 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:53.898847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a259c196-92f6-491a-bc4a-8c64eefadc61 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:53.983240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a259c196-92f6-491a-bc4a-8c64eefadc61 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:53.986329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a259c196-92f6-491a-bc4a-8c64eefadc61 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:53.987687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a259c196-92f6-491a-bc4a-8c64eefadc61 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:53.988886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a259c196-92f6-491a-bc4a-8c64eefadc61 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:53.990157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a259c196-92f6-491a-bc4a-8c64eefadc61 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:53.993884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a259c196-92f6-491a-bc4a-8c64eefadc61 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:54.070004 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a259c196-92f6-491a-bc4a-8c64eefadc61 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181110 Aug 27 03:01:54.071996 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2553/4944] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:01:53 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:54.172957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:54.173587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:54.194429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:54.197021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:54.199849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:54.203354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:54.204084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:54.208711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:55.085010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-85f1ca4e-bd8e-43e4-9715-08033586d60b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:55.089632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-85f1ca4e-bd8e-43e4-9715-08033586d60b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:55.110689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f1ca4e-bd8e-43e4-9715-08033586d60b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:55.111189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f1ca4e-bd8e-43e4-9715-08033586d60b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:55.111634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f1ca4e-bd8e-43e4-9715-08033586d60b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:55.112359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f1ca4e-bd8e-43e4-9715-08033586d60b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:55.112819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f1ca4e-bd8e-43e4-9715-08033586d60b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:55.114122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f1ca4e-bd8e-43e4-9715-08033586d60b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:55.216754 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-85f1ca4e-bd8e-43e4-9715-08033586d60b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134579 Aug 27 03:01:55.223339 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2554/4945] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:01:55 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:55.848314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:55.867908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:55.876415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:55.879286 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-87b090de-dd5f-441b-8e70-95828f17ce6e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1320 microversion: 2.26 time: 1.709070 Aug 27 03:01:55.900863 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2392/4946] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:54 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1320 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:56.230708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-43437bbe-e0e0-4c11-ab90-10999be21857 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:56.233224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-43437bbe-e0e0-4c11-ab90-10999be21857 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:56.272860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43437bbe-e0e0-4c11-ab90-10999be21857 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:56.277902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43437bbe-e0e0-4c11-ab90-10999be21857 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:56.278703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43437bbe-e0e0-4c11-ab90-10999be21857 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:56.279615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43437bbe-e0e0-4c11-ab90-10999be21857 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:56.281648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43437bbe-e0e0-4c11-ab90-10999be21857 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:56.283997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43437bbe-e0e0-4c11-ab90-10999be21857 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:56.442068 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-43437bbe-e0e0-4c11-ab90-10999be21857 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215847 Aug 27 03:01:56.448055 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2555/4947] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:01:56 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:56.909164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:56.915784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:56.929235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:56.982030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:56.982712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.053s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:56.983501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:56.983988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:56.984427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:57.466050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-14b2e77f-030e-4ed8-a46d-75cc4b66fdac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:57.475609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-14b2e77f-030e-4ed8-a46d-75cc4b66fdac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:57.525715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14b2e77f-030e-4ed8-a46d-75cc4b66fdac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:57.536343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14b2e77f-030e-4ed8-a46d-75cc4b66fdac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:57.536844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14b2e77f-030e-4ed8-a46d-75cc4b66fdac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:57.537625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14b2e77f-030e-4ed8-a46d-75cc4b66fdac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:57.540857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14b2e77f-030e-4ed8-a46d-75cc4b66fdac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:57.541311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14b2e77f-030e-4ed8-a46d-75cc4b66fdac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:57.666602 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-14b2e77f-030e-4ed8-a46d-75cc4b66fdac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215112 Aug 27 03:01:57.674729 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2556/4948] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:01:57 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:58.003037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f2d95b63-3f18-48f3-8d9f-d014ab96d847 req-be45f7f6-50a3-48d7-8bce-3bc7374976ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac", "tag": "add95c32-6928-4115-af27-042680f2dd4d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:01:58.055007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f2d95b63-3f18-48f3-8d9f-d014ab96d847 req-be45f7f6-50a3-48d7-8bce-3bc7374976ce service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:58.056707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f2d95b63-3f18-48f3-8d9f-d014ab96d847 req-be45f7f6-50a3-48d7-8bce-3bc7374976ce service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:58.057166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f2d95b63-3f18-48f3-8d9f-d014ab96d847 req-be45f7f6-50a3-48d7-8bce-3bc7374976ce service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:58.091999 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f2d95b63-3f18-48f3-8d9f-d014ab96d847 req-be45f7f6-50a3-48d7-8bce-3bc7374976ce service nova] Creating event network-changed:add95c32-6928-4115-af27-042680f2dd4d for instance 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac on n-h2-852084-5 Aug 27 03:01:58.107266 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f2d95b63-3f18-48f3-8d9f-d014ab96d847 req-be45f7f6-50a3-48d7-8bce-3bc7374976ce service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116807 Aug 27 03:01:58.110327 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2557/4949] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:01:58.680973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c978d0d-cada-4a92-ab86-5ebc47f0a163 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:58.685288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4c978d0d-cada-4a92-ab86-5ebc47f0a163 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:58.715340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:58.721763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:58.741069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c978d0d-cada-4a92-ab86-5ebc47f0a163 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:58.749968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c978d0d-cada-4a92-ab86-5ebc47f0a163 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:58.751804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c978d0d-cada-4a92-ab86-5ebc47f0a163 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:58.770288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c978d0d-cada-4a92-ab86-5ebc47f0a163 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:58.796270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c978d0d-cada-4a92-ab86-5ebc47f0a163 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:58.798546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c978d0d-cada-4a92-ab86-5ebc47f0a163 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:58.839622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:58.853916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:58.855531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:01:58.870691 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-44ee9e51-9d73-443f-bb7c-5471dd073125 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1362 microversion: 2.26 time: 1.965828 Aug 27 03:01:58.873744 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2393/4950] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:56 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1362 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:01:58.921624 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4c978d0d-cada-4a92-ab86-5ebc47f0a163 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.242498 Aug 27 03:01:58.931017 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2558/4951] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:01:58 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:01:59.904390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:59.905790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:01:59.917697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:01:59.925837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:59.926412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:59.926870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:59.931639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:01:59.932253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:01:59.932724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:01:59.949448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21634130-3b31-420c-a3f1-f8ff97c31036 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:01:59.979465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21634130-3b31-420c-a3f1-f8ff97c31036 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:00.089767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21634130-3b31-420c-a3f1-f8ff97c31036 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:00.090269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21634130-3b31-420c-a3f1-f8ff97c31036 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:00.090873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21634130-3b31-420c-a3f1-f8ff97c31036 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:00.091733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21634130-3b31-420c-a3f1-f8ff97c31036 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:00.100526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21634130-3b31-420c-a3f1-f8ff97c31036 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:00.101763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21634130-3b31-420c-a3f1-f8ff97c31036 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:00.165762 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21634130-3b31-420c-a3f1-f8ff97c31036 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231638 Aug 27 03:02:00.168476 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2559/4952] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:01:59 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:00.752642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:00.761839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:00.767504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:00.771057 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a81c90c2-ab05-43eb-a5e9-da5d879be720 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1362 microversion: 2.26 time: 0.871491 Aug 27 03:02:00.771833 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2394/4953] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:01:59 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1362 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:01.179820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e54b4834-ffe2-437a-b8f7-2183015e6a54 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:01.192669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e54b4834-ffe2-437a-b8f7-2183015e6a54 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:01.200205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54b4834-ffe2-437a-b8f7-2183015e6a54 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:01.200935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54b4834-ffe2-437a-b8f7-2183015e6a54 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:01.202838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54b4834-ffe2-437a-b8f7-2183015e6a54 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:01.203780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54b4834-ffe2-437a-b8f7-2183015e6a54 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:01.213375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54b4834-ffe2-437a-b8f7-2183015e6a54 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:01.214107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e54b4834-ffe2-437a-b8f7-2183015e6a54 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:01.218756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:01.280372 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e54b4834-ffe2-437a-b8f7-2183015e6a54 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104580 Aug 27 03:02:01.281243 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2560/4954] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:02:01 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:01.800998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:01.803380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:01.821653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:01.822496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:01.823124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:01.824010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:01.824799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:01.825385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:02.292445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0b454e9f-af76-4ed2-96a2-92bb1ee75e62 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:02.296923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0b454e9f-af76-4ed2-96a2-92bb1ee75e62 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:02.315452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b454e9f-af76-4ed2-96a2-92bb1ee75e62 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:02.315951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b454e9f-af76-4ed2-96a2-92bb1ee75e62 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:02.316395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b454e9f-af76-4ed2-96a2-92bb1ee75e62 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:02.317118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b454e9f-af76-4ed2-96a2-92bb1ee75e62 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:02.317581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b454e9f-af76-4ed2-96a2-92bb1ee75e62 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:02.330898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0b454e9f-af76-4ed2-96a2-92bb1ee75e62 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:02.340210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:02.351533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:02.352999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:02.380473 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7eaa4c9-3a8f-4117-becf-5cbe186c7246 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1362 microversion: 2.26 time: 0.584165 Aug 27 03:02:02.400763 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2395/4955] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:01 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1362 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:02.443398 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0b454e9f-af76-4ed2-96a2-92bb1ee75e62 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154842 Aug 27 03:02:02.443994 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2561/4956] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:02:02 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:03.408598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:03.409266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:03.438849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:03.446389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:03.447003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:03.447892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:03.452618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:03.455892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:03.459503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-56dfc62e-b8a2-4aac-92dd-a04cecac98cd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:03.470121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-56dfc62e-b8a2-4aac-92dd-a04cecac98cd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:03.488978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dfc62e-b8a2-4aac-92dd-a04cecac98cd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:03.489483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dfc62e-b8a2-4aac-92dd-a04cecac98cd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:03.489959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dfc62e-b8a2-4aac-92dd-a04cecac98cd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:03.500264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dfc62e-b8a2-4aac-92dd-a04cecac98cd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:03.502084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dfc62e-b8a2-4aac-92dd-a04cecac98cd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:03.504357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dfc62e-b8a2-4aac-92dd-a04cecac98cd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:03.615992 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-56dfc62e-b8a2-4aac-92dd-a04cecac98cd tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163582 Aug 27 03:02:03.622183 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2562/4957] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:02:03 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:04.168958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:04.192040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:04.194190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:04.197620 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b097120c-4d9c-4518-9cba-131d1abed3ba tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1362 microversion: 2.26 time: 0.793366 Aug 27 03:02:04.202219 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2396/4958] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:03 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1362 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:04.633615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7388006a-72f8-40bb-835c-26f266c97efb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:04.636048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7388006a-72f8-40bb-835c-26f266c97efb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:04.655443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7388006a-72f8-40bb-835c-26f266c97efb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:04.655939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7388006a-72f8-40bb-835c-26f266c97efb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:04.656384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7388006a-72f8-40bb-835c-26f266c97efb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:04.657178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7388006a-72f8-40bb-835c-26f266c97efb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:04.657795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7388006a-72f8-40bb-835c-26f266c97efb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:04.658337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7388006a-72f8-40bb-835c-26f266c97efb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:04.739761 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7388006a-72f8-40bb-835c-26f266c97efb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110254 Aug 27 03:02:04.746614 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2563/4959] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:02:04 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:02:04.926649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3756f2d6-ec7e-4986-ac6f-2f8f0336d872 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:04.927190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3756f2d6-ec7e-4986-ac6f-2f8f0336d872 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:04.944171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3756f2d6-ec7e-4986-ac6f-2f8f0336d872 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:04.951654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3756f2d6-ec7e-4986-ac6f-2f8f0336d872 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:04.952853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3756f2d6-ec7e-4986-ac6f-2f8f0336d872 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:04.963262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3756f2d6-ec7e-4986-ac6f-2f8f0336d872 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:04.964000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3756f2d6-ec7e-4986-ac6f-2f8f0336d872 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:04.964605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3756f2d6-ec7e-4986-ac6f-2f8f0336d872 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:05.089922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3756f2d6-ec7e-4986-ac6f-2f8f0336d872 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:02:05.237604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:05.240274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:05.259818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:05.273503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:05.274013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:05.274784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:05.275260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:05.275694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:05.311043 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3756f2d6-ec7e-4986-ac6f-2f8f0336d872 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 204 len: 0 microversion: 2.1 time: 0.388452 Aug 27 03:02:05.314004 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2397/4960] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:02:04 2022] DELETE /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:02:05.333157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4708edf5-4742-4f2d-9179-c2461d0fb667 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:05.334350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4708edf5-4742-4f2d-9179-c2461d0fb667 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:05.352614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4708edf5-4742-4f2d-9179-c2461d0fb667 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:05.355845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4708edf5-4742-4f2d-9179-c2461d0fb667 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:05.357195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4708edf5-4742-4f2d-9179-c2461d0fb667 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:05.358555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4708edf5-4742-4f2d-9179-c2461d0fb667 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:05.360169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4708edf5-4742-4f2d-9179-c2461d0fb667 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:05.363497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4708edf5-4742-4f2d-9179-c2461d0fb667 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:05.399569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:05.930440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:05.941116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:05.958818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:05.964364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4708edf5-4742-4f2d-9179-c2461d0fb667 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:05.976380 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8c1d60fd-7ecc-45c9-a471-6349b617b156 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1362 microversion: 2.26 time: 0.739517 Aug 27 03:02:05.978672 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2564/4961] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:05 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1362 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:05.982776 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4708edf5-4742-4f2d-9179-c2461d0fb667 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1680 microversion: 2.1 time: 0.664076 Aug 27 03:02:05.984143 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2398/4962] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:05 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1680 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:07.027594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1bd964b1-5a22-4183-a3e7-6656728c1683 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:07.028238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1bd964b1-5a22-4183-a3e7-6656728c1683 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:07.032135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:07.033511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:07.038214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:07.047390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:07.058565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:07.061133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bd964b1-5a22-4183-a3e7-6656728c1683 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:07.063049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bd964b1-5a22-4183-a3e7-6656728c1683 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:07.063399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bd964b1-5a22-4183-a3e7-6656728c1683 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:07.064173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bd964b1-5a22-4183-a3e7-6656728c1683 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:07.064641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bd964b1-5a22-4183-a3e7-6656728c1683 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:07.065079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1bd964b1-5a22-4183-a3e7-6656728c1683 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:07.067069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:07.067713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:07.069293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:07.070956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:07.082243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:07.598235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1bd964b1-5a22-4183-a3e7-6656728c1683 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:07.617293 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1bd964b1-5a22-4183-a3e7-6656728c1683 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1680 microversion: 2.1 time: 0.597735 Aug 27 03:02:07.643490 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2399/4963] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:07 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1680 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:07.931242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:07.968796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:07.972034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:07.979745 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-07a4ea73-0f66-4df1-9869-fdceb3e414f7 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1362 microversion: 2.26 time: 0.968617 Aug 27 03:02:07.980530 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2565/4964] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:07 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1362 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:08.651665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e30df3d-97a4-4a19-84e0-a40b1a4a5769 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:08.652498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2e30df3d-97a4-4a19-84e0-a40b1a4a5769 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:08.671486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e30df3d-97a4-4a19-84e0-a40b1a4a5769 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:08.672136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e30df3d-97a4-4a19-84e0-a40b1a4a5769 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:08.672940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e30df3d-97a4-4a19-84e0-a40b1a4a5769 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:08.688667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e30df3d-97a4-4a19-84e0-a40b1a4a5769 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:08.689529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e30df3d-97a4-4a19-84e0-a40b1a4a5769 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:08.690136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e30df3d-97a4-4a19-84e0-a40b1a4a5769 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:08.870838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2e30df3d-97a4-4a19-84e0-a40b1a4a5769 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:08.887871 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e30df3d-97a4-4a19-84e0-a40b1a4a5769 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1613 microversion: 2.1 time: 0.240783 Aug 27 03:02:08.902299 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2400/4965] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:08 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1613 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:09.008774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:09.010022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:09.026009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:09.026567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:09.027018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:09.029254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:09.029762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:09.032815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:09.935786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c52ec7cc-456e-4e14-b01d-c8ad6d1eaab7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:09.936425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c52ec7cc-456e-4e14-b01d-c8ad6d1eaab7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:09.958265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:09.964884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c52ec7cc-456e-4e14-b01d-c8ad6d1eaab7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:09.965383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c52ec7cc-456e-4e14-b01d-c8ad6d1eaab7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:09.983774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c52ec7cc-456e-4e14-b01d-c8ad6d1eaab7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:09.984675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c52ec7cc-456e-4e14-b01d-c8ad6d1eaab7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:09.985358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:09.987325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c52ec7cc-456e-4e14-b01d-c8ad6d1eaab7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:09.987784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c52ec7cc-456e-4e14-b01d-c8ad6d1eaab7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:10.002383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:10.017558 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-123a9de9-94c6-439d-b6da-55059112ad0b tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1362 microversion: 2.26 time: 1.003097 Aug 27 03:02:10.036852 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2566/4966] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:09 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1362 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:10.075089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-59a4a96e-962f-4316-ba9d-6255925d710d req-da881e37-af57-4b1f-bf77-8739d4e69312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f354f690-0290-4b99-bd08-961f97e09066", "name": "network-vif-deleted", "tag": "5b0a7af6-0d96-47f0-8b28-6d161f5680fa"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:10.099748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-59a4a96e-962f-4316-ba9d-6255925d710d req-da881e37-af57-4b1f-bf77-8739d4e69312 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:10.102471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-59a4a96e-962f-4316-ba9d-6255925d710d req-da881e37-af57-4b1f-bf77-8739d4e69312 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:10.103121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-59a4a96e-962f-4316-ba9d-6255925d710d req-da881e37-af57-4b1f-bf77-8739d4e69312 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:10.139755 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-59a4a96e-962f-4316-ba9d-6255925d710d req-da881e37-af57-4b1f-bf77-8739d4e69312 service nova] Creating event network-vif-deleted:5b0a7af6-0d96-47f0-8b28-6d161f5680fa for instance f354f690-0290-4b99-bd08-961f97e09066 on n-h2-852084-5 Aug 27 03:02:10.160471 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-59a4a96e-962f-4316-ba9d-6255925d710d req-da881e37-af57-4b1f-bf77-8739d4e69312 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091205 Aug 27 03:02:10.169698 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2567/4967] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:10.308553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2e981da0-391b-435c-9510-a570d371838f req-847379e0-63bc-4226-a7b2-259997aac830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac", "name": "network-vif-plugged", "status": "completed", "tag": "add95c32-6928-4115-af27-042680f2dd4d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:10.339658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2e981da0-391b-435c-9510-a570d371838f req-847379e0-63bc-4226-a7b2-259997aac830 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:10.342046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2e981da0-391b-435c-9510-a570d371838f req-847379e0-63bc-4226-a7b2-259997aac830 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:10.342753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2e981da0-391b-435c-9510-a570d371838f req-847379e0-63bc-4226-a7b2-259997aac830 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:10.355835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c52ec7cc-456e-4e14-b01d-c8ad6d1eaab7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:10.364145 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c52ec7cc-456e-4e14-b01d-c8ad6d1eaab7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 200 len: 1613 microversion: 2.1 time: 0.440960 Aug 27 03:02:10.370977 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2e981da0-391b-435c-9510-a570d371838f req-847379e0-63bc-4226-a7b2-259997aac830 service nova] Creating event network-vif-plugged:add95c32-6928-4115-af27-042680f2dd4d for instance 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac on n-h2-852084-5 Aug 27 03:02:10.371684 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2401/4968] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:09 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 1613 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:10.399355 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2e981da0-391b-435c-9510-a570d371838f req-847379e0-63bc-4226-a7b2-259997aac830 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097506 Aug 27 03:02:10.400304 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2568/4969] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:11.042905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:11.043533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:11.058183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:11.063658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:11.064661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:11.066073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:11.067248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:11.067948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:11.396589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:11.398554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:11.423976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:11.426788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:11.428237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:11.430641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:11.432852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:11.435134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:11.505535 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 HTTP/1.1 Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f354f690-0290-4b99-bd08-961f97e09066'} Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:11.513652 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:11.518044 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:11.518044 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:11.518044 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:11.518044 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:11.518044 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:11.518044 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:02:11.518044 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:11.518044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:11.518044 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-78ce1060-ca90-47bf-95e7-98548c3901c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 404 len: 111 microversion: 2.1 time: 0.125635 Aug 27 03:02:11.525052 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2569/4970] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:11 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:02:11.545422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-038ab0d7-9a36-472a-be22-b9bd0d1e73b7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '.version_select at 0x7f4d2a6e1310>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:11.594998 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-038ab0d7-9a36-472a-be22-b9bd0d1e73b7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471835096" status: 202 len: 0 microversion: 2.1 time: 0.068584 Aug 27 03:02:11.596231 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2570/4971] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 03:02:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471835096 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:02:11.665630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:11.680038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:11.683926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:11.689282 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f06f0c23-e4cf-48dc-906e-e19b126e4edd tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1362 microversion: 2.26 time: 0.651098 Aug 27 03:02:11.692986 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2402/4972] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:11 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1362 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:12.717378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:12.718325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:12.748070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:12.761562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:12.762101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:12.762874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:12.763370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:12.763794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.207627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:13.224652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:13.231433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:13.233685 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1ef96f84-1937-4b1d-97f8-e03035387b74 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1545 microversion: 2.26 time: 0.521114 Aug 27 03:02:13.250885 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2571/4973] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:12 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1545 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:13.268762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d29b0a160>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:13.318884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:13.319491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:13.319957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.320458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:13.348370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:13.351153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:13.351630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.352389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:13.366027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:13.369463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.471414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:13.473718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:13.480154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.519485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:13.521912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:13.523254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.623963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:13.679281 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0f9b4c0e-b26f-4d94-9d2c-018172952575 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-881324703" status: 201 len: 0 microversion: 2.26 time: 0.414891 Aug 27 03:02:13.696284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd92c092-a772-4752-9ae2-6a4a9dc9df2e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d2e7cc670>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:13.700726 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2403/4974] 10.222.0.99 () {62 vars in 1377 bytes} [Sat Aug 27 03:02:13 2022] PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-881324703 => generated 0 bytes in 443 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 03:02:13.711136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd92c092-a772-4752-9ae2-6a4a9dc9df2e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:13.711847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd92c092-a772-4752-9ae2-6a4a9dc9df2e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:13.712934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd92c092-a772-4752-9ae2-6a4a9dc9df2e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.780252 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd92c092-a772-4752-9ae2-6a4a9dc9df2e tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-881324703" status: 204 len: 0 microversion: 2.26 time: 0.093704 Aug 27 03:02:13.780879 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2572/4975] 10.222.0.99 () {60 vars in 1358 bytes} [Sat Aug 27 03:02:13 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-881324703 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:02:13.790592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d297c4820>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:13.807009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:13.810660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:13.811315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.812027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:13.833012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:13.836974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:13.838669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.841428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:13.847043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:13.850081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.924050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:13.924545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:13.924983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:13.990879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:14.047391 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ef8d0cda-a6c0-4d86-abb4-9a99f3cfc845 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags" status: 204 len: 0 microversion: 2.26 time: 0.261496 Aug 27 03:02:14.060076 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2404/4976] 10.222.0.99 () {60 vars in 1295 bytes} [Sat Aug 27 03:02:13 2022] DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:02:14.065631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-193f633c-7d5d-49f2-973d-1b52bc000f09 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d2e8c0940>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:14.079141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-193f633c-7d5d-49f2-973d-1b52bc000f09 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.082452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-193f633c-7d5d-49f2-973d-1b52bc000f09 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.082948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-193f633c-7d5d-49f2-973d-1b52bc000f09 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.166536 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-193f633c-7d5d-49f2-973d-1b52bc000f09 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags" status: 200 len: 12 microversion: 2.26 time: 0.105197 Aug 27 03:02:14.169030 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2573/4977] 10.222.0.99 () {60 vars in 1292 bytes} [Sat Aug 27 03:02:14 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags => generated 12 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:14.180846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d29a35670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:14.197432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.210496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.210665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.215096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:14.244063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.244571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.245016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.245773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.250584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.251048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.317033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.317714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.317970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.365868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.366932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.367790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.442422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:14.470346 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-51ca776d-735a-4a1f-95ec-8ae7f26e02da tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-484504865" status: 201 len: 0 microversion: 2.26 time: 0.294619 Aug 27 03:02:14.483027 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2405/4978] 10.222.0.99 () {62 vars in 1377 bytes} [Sat Aug 27 03:02:14 2022] PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-484504865 => generated 0 bytes in 308 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 03:02:14.484254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba5392a7-ee4a-45ab-b763-96ad770cea59 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d2a0f6430>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:14.505879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba5392a7-ee4a-45ab-b763-96ad770cea59 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.506327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba5392a7-ee4a-45ab-b763-96ad770cea59 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.507499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba5392a7-ee4a-45ab-b763-96ad770cea59 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.523156 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ba5392a7-ee4a-45ab-b763-96ad770cea59 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags" status: 200 len: 35 microversion: 2.26 time: 0.042831 Aug 27 03:02:14.524362 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2574/4979] 10.222.0.99 () {60 vars in 1292 bytes} [Sat Aug 27 03:02:14 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags => generated 35 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:14.534745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d29dc9670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:14.548018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.548525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.548970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.549450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:14.568965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.570094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.570546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.571292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.571857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.572172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.634266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.634767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.635212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.673286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:14.711672 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ccd87b87-2aa0-4f3a-878c-c3bad0afcadb tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-484504865" status: 204 len: 0 microversion: 2.26 time: 0.181335 Aug 27 03:02:14.712319 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2406/4980] 10.222.0.99 () {60 vars in 1361 bytes} [Sat Aug 27 03:02:14 2022] DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-484504865 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:02:14.721848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-65090fbb-f522-4274-8dcb-6d38966d18f5 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d2a0f61f0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:14.737316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65090fbb-f522-4274-8dcb-6d38966d18f5 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.737904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65090fbb-f522-4274-8dcb-6d38966d18f5 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.738378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65090fbb-f522-4274-8dcb-6d38966d18f5 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.761821 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-65090fbb-f522-4274-8dcb-6d38966d18f5 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags" status: 200 len: 12 microversion: 2.26 time: 0.044128 Aug 27 03:02:14.774200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d296cd3a0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:14.778980 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2575/4981] 10.222.0.99 () {60 vars in 1292 bytes} [Sat Aug 27 03:02:14 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags => generated 12 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:14.782499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.792160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.797568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.801625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:14.823739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.824473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.826026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.828067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.829173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.833851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.883154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:14.893177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:14.894055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:14.963946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:15.016163 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eafe8d7c-3826-4889-83fd-d1a9937fff6f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags" status: 204 len: 0 microversion: 2.26 time: 0.246478 Aug 27 03:02:15.018755 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2407/4982] 10.222.0.99 () {60 vars in 1295 bytes} [Sat Aug 27 03:02:14 2022] DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:02:15.031223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d2a26de50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:15.072842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.073895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.076048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.086808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:15.099507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.103288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.104152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.105168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.118587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.121465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.197791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.202457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.202988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.231394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.232138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.232740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.283380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:15.323989 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-112d1f8f-de49-42fd-92e4-5245da4af7dc tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-856109734" status: 201 len: 0 microversion: 2.26 time: 0.298040 Aug 27 03:02:15.329789 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2576/4983] 10.222.0.99 () {62 vars in 1377 bytes} [Sat Aug 27 03:02:15 2022] PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-856109734 => generated 0 bytes in 304 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 27 03:02:15.341765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d297c4040>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:15.371072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.374997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.377357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.378038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:15.408723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.410587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.412152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.413166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.416266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.417164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.507675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.508444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.508985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.527599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.528466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.530243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.554721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:15.596291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:15.638206 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de33eacc-069c-4702-8929-cd20fa8fd377 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-547299595" status: 201 len: 0 microversion: 2.26 time: 0.300992 Aug 27 03:02:15.641281 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2408/4984] 10.222.0.99 () {62 vars in 1377 bytes} [Sat Aug 27 03:02:15 2022] PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-547299595 => generated 0 bytes in 305 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 03:02:15.650401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d2e8594c0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:15.660436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.661224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.661902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.662554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:15.670180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.670855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.671578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.672481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.673114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.673928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.702042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.703349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.704029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.728360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:15.762406 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dd2cb6fd-7cac-4424-816e-68f61dc8b435 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags" status: 204 len: 0 microversion: 2.26 time: 0.116610 Aug 27 03:02:15.763303 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2577/4985] 10.222.0.99 () {60 vars in 1295 bytes} [Sat Aug 27 03:02:15 2022] DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:02:15.772102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d31cf3b6-e806-41b0-a8a1-20a59e9f3e1a tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d29d108b0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:15.799544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d31cf3b6-e806-41b0-a8a1-20a59e9f3e1a tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.800239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d31cf3b6-e806-41b0-a8a1-20a59e9f3e1a tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.800887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d31cf3b6-e806-41b0-a8a1-20a59e9f3e1a tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.821094 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d31cf3b6-e806-41b0-a8a1-20a59e9f3e1a tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags" status: 200 len: 12 microversion: 2.26 time: 0.053145 Aug 27 03:02:15.822727 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2409/4986] 10.222.0.99 () {60 vars in 1292 bytes} [Sat Aug 27 03:02:15 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags => generated 12 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:15.839788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d2e8591f0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:15.870740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.871246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.871700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.883159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:15.889985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.890487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.890930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.891832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:15.892453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:15.909477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:15.995013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.021149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.021646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.089154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:16.143815 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b1aa1c6-724b-42af-b921-fe4607b40a8f tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags" status: 204 len: 0 microversion: 2.26 time: 0.313646 Aug 27 03:02:16.150584 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2578/4987] 10.222.0.99 () {60 vars in 1295 bytes} [Sat Aug 27 03:02:15 2022] DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:02:16.160826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d2975de50>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:16.194782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.195291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.195750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.196248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:16.243405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.243919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.244371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.245095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.251527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.252024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.326323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.326898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.327496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.353657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.354855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.355455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.445306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:16.513133 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d2543156-5cca-4b55-9b08-d648bf76c508 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-1505399514" status: 201 len: 0 microversion: 2.26 time: 0.356840 Aug 27 03:02:16.520872 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2410/4988] 10.222.0.99 () {62 vars in 1380 bytes} [Sat Aug 27 03:02:16 2022] PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-1505399514 => generated 0 bytes in 365 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 27 03:02:16.529954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d2a1c0a60>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:16.542454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.542958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.543404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.543897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:16.552887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.553606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.554573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.555454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.556678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.557746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.563671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:16.635690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.636633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.637820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.672316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.673097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.675728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.753238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:16.795743 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cbc21b03-ef01-4026-b59d-a65c3228cc61 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-157009524" status: 201 len: 0 microversion: 2.26 time: 0.273243 Aug 27 03:02:16.804649 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2579/4989] 10.222.0.99 () {62 vars in 1377 bytes} [Sat Aug 27 03:02:16 2022] PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags/tempest-tag-157009524 => generated 0 bytes in 280 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 27 03:02:16.813339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Action: 'update_all', calling method: .version_select at 0x7f4d29b1a1f0>, body: {"tags": ["tempest-tag-251876479", "tempest-tag-35655951"]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:16.827590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.828805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.829737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.830552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:16.842603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.844312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.846444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.847472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.851023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.855500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.900170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:16.900665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:16.901268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:16.944491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:16.976079 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dab2fa15-3a42-42e6-9119-500a1cc608c8 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags" status: 200 len: 59 microversion: 2.26 time: 0.166214 Aug 27 03:02:16.984996 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2411/4990] 10.222.0.99 () {62 vars in 1312 bytes} [Sat Aug 27 03:02:16 2022] PUT /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags => generated 59 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:16.996836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8148c215-de01-4bd7-a2ca-865c89f56029 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d2a7e5310>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:17.026777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8148c215-de01-4bd7-a2ca-865c89f56029 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:17.027602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8148c215-de01-4bd7-a2ca-865c89f56029 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:17.028376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8148c215-de01-4bd7-a2ca-865c89f56029 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:17.048490 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8148c215-de01-4bd7-a2ca-865c89f56029 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags" status: 200 len: 59 microversion: 2.26 time: 0.056551 Aug 27 03:02:17.052325 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2580/4991] 10.222.0.99 () {60 vars in 1292 bytes} [Sat Aug 27 03:02:16 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags => generated 59 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:17.063910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '.version_select at 0x7f4d29b1a3a0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:17.080671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:17.083870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:17.086938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:17.087971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:17.124763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:17.125408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:17.127457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:17.130404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:17.131087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:17.131567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:17.201911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:17.207900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:17.208736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:17.217555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-629a9e2d-3e6a-4fb8-bae4-0907f3a3bfaf tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: .version_select at 0x7f4d2a26d670>, body: {"keypair": {"name": "tempest-keypair-1141209407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRbhu7DMet7zyDvqOJncLbKw3cRkBWbFCHG0awKZh/3NJu4Kmb7pW/Ug9v19hZsGGwCmTckuJ+S3aP63yqgASlvjYsOz7UsJogOH89+etTFzA7g3tVcY2ceTigJwHfmoQ=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:17.262164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'flavor' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:17.274581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-629a9e2d-3e6a-4fb8-bae4-0907f3a3bfaf tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:02:17.289797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-629a9e2d-3e6a-4fb8-bae4-0907f3a3bfaf tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for user 59f857fc243b43379c9255e7b9ea1c3f and project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:02:17.297770 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-acfdada6-15f3-4c24-a853-e1c869061eea tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags" status: 204 len: 0 microversion: 2.26 time: 0.238375 Aug 27 03:02:17.299370 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2412/4992] 10.222.0.99 () {60 vars in 1295 bytes} [Sat Aug 27 03:02:17 2022] DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac/tags => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:02:17.312327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ee79c2ad-0639-47cd-b419-65ec8431c429 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:17.325528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ee79c2ad-0639-47cd-b419-65ec8431c429 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:17.355303 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-629a9e2d-3e6a-4fb8-bae4-0907f3a3bfaf tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143817 Aug 27 03:02:17.356920 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2581/4993] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:02:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:17.396979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee79c2ad-0639-47cd-b419-65ec8431c429 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:17.397750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee79c2ad-0639-47cd-b419-65ec8431c429 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:17.426788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee79c2ad-0639-47cd-b419-65ec8431c429 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:17.427611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee79c2ad-0639-47cd-b419-65ec8431c429 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:17.428102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee79c2ad-0639-47cd-b419-65ec8431c429 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:17.429096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee79c2ad-0639-47cd-b419-65ec8431c429 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:17.546811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ee79c2ad-0639-47cd-b419-65ec8431c429 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:02:17.747108 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ee79c2ad-0639-47cd-b419-65ec8431c429 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 204 len: 0 microversion: 2.26 time: 0.439090 Aug 27 03:02:17.750726 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2413/4994] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 03:02:17 2022] DELETE /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:02:17.776854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:17.777513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:17.795952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:17.796527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:17.807989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:17.808732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:17.809237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:17.809745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:18.161115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:18.175347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:18.177496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:18.180730 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8faa937c-5d9b-40f5-b1e2-362a8fdabf25 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1551 microversion: 2.26 time: 0.428280 Aug 27 03:02:18.182081 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2582/4995] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:17 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1551 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:19.208474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:19.209252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:19.240382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:19.254340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:19.254848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:19.255624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:19.256098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:19.262906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:19.792733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:19.804793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:19.809115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:19.810731 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bab56e9d-e3e0-4806-b820-a67c15de1459 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1551 microversion: 2.26 time: 0.607455 Aug 27 03:02:19.813308 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2414/4996] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:19 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1551 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:20.839257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:20.840687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:20.864889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:20.865878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:20.872659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:20.879460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:20.882481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:20.882946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:21.995434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:22.011614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:22.016307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:22.019587 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-14dbd71c-1d14-45cf-ad1b-0b6b9d7eba15 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1509 microversion: 2.26 time: 1.186009 Aug 27 03:02:22.029500 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2583/4997] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:20 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1509 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:22.698979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ffbff2ea-cd25-4448-bfa3-280fe4bdd906 req-f1a4088c-ece2-47c9-9934-701badd037b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac", "name": "network-vif-deleted", "tag": "add95c32-6928-4115-af27-042680f2dd4d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:22.736774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ffbff2ea-cd25-4448-bfa3-280fe4bdd906 req-f1a4088c-ece2-47c9-9934-701badd037b4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:22.741198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ffbff2ea-cd25-4448-bfa3-280fe4bdd906 req-f1a4088c-ece2-47c9-9934-701badd037b4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:22.742256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ffbff2ea-cd25-4448-bfa3-280fe4bdd906 req-f1a4088c-ece2-47c9-9934-701badd037b4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:22.807445 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ffbff2ea-cd25-4448-bfa3-280fe4bdd906 req-f1a4088c-ece2-47c9-9934-701badd037b4 service nova] Creating event network-vif-deleted:add95c32-6928-4115-af27-042680f2dd4d for instance 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac on n-h2-852084-5 Aug 27 03:02:22.828436 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ffbff2ea-cd25-4448-bfa3-280fe4bdd906 req-f1a4088c-ece2-47c9-9934-701badd037b4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135293 Aug 27 03:02:22.829107 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2415/4998] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:23.086868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:23.087778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:23.095442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:23.095946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:23.096407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:23.097152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:23.097624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:23.098094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:23.150355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:23.150883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:23.151340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:23.151811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lazy-loading 'fault' on Instance uuid 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:02:23.293680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:23.312910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:23.320280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54cac25050ef42d18b3421338fa61572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfc329d9ad7460f81912ce1a11a2bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:23.342443 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a34f6c27-3119-4898-9707-237d42ba27f0 tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 200 len: 1352 microversion: 2.26 time: 0.278257 Aug 27 03:02:23.346772 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2584/4999] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:23 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 1352 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:02:24.377550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:24.378290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] [instance: 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:24.420397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:24.420896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:24.421337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:24.440636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:24.441752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:24.445598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:24.492643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] HTTP exception thrown: Instance 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac could not be found. Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Request method failure captured: Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac HTTP/1.1 Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYkZ6MeEY9Ij23KsEPpJBBxJSZhp02TQ4-g79nawh4QoKFNuBBbpYOQeezxIpTgZmgup086XrEj-ZUPWLKvnnmtmVlOYN061gCbjs9IwdDscxXsIKFGAMoCTbpXFIMuXbLo1Kh7uvzXzJRe5G6hCn5uljBXKlKZU53wji4A2CWhfAMU Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Openstack-Nova-Api-Version: 2.26 Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: bdfc329d9ad7460f81912ce1a11a2bd7 Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerTagsTestJSON-1182405954 Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_bdfc329d9ad7460f81912ce1a11a2bd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bdfc329d9ad7460f81912ce1a11a2bd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/bdfc329d9ad7460f81912ce1a11a2bd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/bdfc329d9ad7460f81912ce1a11a2bd7"}]}] Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerTagsTestJSON-1182405954 Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: bdfc329d9ad7460f81912ce1a11a2bd7 Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerTagsTestJSON-1182405954 Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerTagsTestJSON-1182405954-project Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 54cac25050ef42d18b3421338fa61572 Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerTagsTestJSON-1182405954-project Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac could not be found. Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac'} Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac could not be found. Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac could not be found. Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:24.506380 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:24.511047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:24.511047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:24.511047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:24.511047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:24.511047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:24.511047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac could not be found. Aug 27 03:02:24.511047 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:24.513389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] Returning 404 to user: Instance 55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:24.514623 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-76d2804e-35ff-4429-b02d-b5a0719e9fda tempest-ServerTagsTestJSON-1182405954 tempest-ServerTagsTestJSON-1182405954-project] 10.222.0.99 "GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac" status: 404 len: 111 microversion: 2.26 time: 0.143446 Aug 27 03:02:24.515749 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2416/5000] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:24 2022] GET /compute/v2.1/servers/55ffbf7f-123a-4bdb-a93f-9ad01e5ea3ac => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:02:25.428432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1149284049", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "544183e0-192f-4c44-976f-41fb786d65a5"}], "security_groups": [{"name": "tempest-securitygroup--1920699998"}], "key_name": "tempest-keypair-1141209407", "user_data": "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:25.786885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] validate_networks() for [('544183e0-192f-4c44-976f-41fb786d65a5', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:02:27.124766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:02:27.126052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:02:27.127528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:02:27.128216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:02:27.128835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:02:27.166834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:27.168279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:27.170039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:27.172756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:27.173424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:27.175246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:27.219289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:02:27.233499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for user 59f857fc243b43379c9255e7b9ea1c3f and project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:02:27.262254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:02:27.270391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:02:27.444647 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cdf044e0-fc52-4e07-ba9c-e72f1670b038 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.020803 Aug 27 03:02:27.445997 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2585/5001] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:02:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:02:27.456960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0aa1ccce-fb6a-470d-9a31-cd9cb5cc6819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:27.458211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0aa1ccce-fb6a-470d-9a31-cd9cb5cc6819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:27.621315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0aa1ccce-fb6a-470d-9a31-cd9cb5cc6819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:27.644420 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0aa1ccce-fb6a-470d-9a31-cd9cb5cc6819 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1242 microversion: 2.1 time: 0.191578 Aug 27 03:02:27.645307 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2417/5002] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:27 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1242 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:28.669539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6850ffa-8476-4afe-a025-818686f286be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:28.670214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a6850ffa-8476-4afe-a025-818686f286be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:28.886358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a6850ffa-8476-4afe-a025-818686f286be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:28.903540 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6850ffa-8476-4afe-a025-818686f286be tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1242 microversion: 2.1 time: 0.234124 Aug 27 03:02:28.917781 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2586/5003] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:28 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1242 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:29.938344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e748a2aa-e8fa-46d2-b7cc-f6d66e3ad4a1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:29.939053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e748a2aa-e8fa-46d2-b7cc-f6d66e3ad4a1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:29.950936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748a2aa-e8fa-46d2-b7cc-f6d66e3ad4a1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:29.951444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748a2aa-e8fa-46d2-b7cc-f6d66e3ad4a1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:29.951895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748a2aa-e8fa-46d2-b7cc-f6d66e3ad4a1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:29.958219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748a2aa-e8fa-46d2-b7cc-f6d66e3ad4a1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:29.958831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748a2aa-e8fa-46d2-b7cc-f6d66e3ad4a1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:29.959371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e748a2aa-e8fa-46d2-b7cc-f6d66e3ad4a1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:30.405607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e748a2aa-e8fa-46d2-b7cc-f6d66e3ad4a1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:30.423370 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e748a2aa-e8fa-46d2-b7cc-f6d66e3ad4a1 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1294 microversion: 2.1 time: 0.489258 Aug 27 03:02:30.439942 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2418/5004] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:29 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1294 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:31.458613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5a2656b-2ac2-4847-a474-5dd18f3336a0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:31.464427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c5a2656b-2ac2-4847-a474-5dd18f3336a0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:31.534988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a2656b-2ac2-4847-a474-5dd18f3336a0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:31.536460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a2656b-2ac2-4847-a474-5dd18f3336a0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:31.538170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a2656b-2ac2-4847-a474-5dd18f3336a0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:31.540550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a2656b-2ac2-4847-a474-5dd18f3336a0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:31.544763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a2656b-2ac2-4847-a474-5dd18f3336a0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:31.546338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a2656b-2ac2-4847-a474-5dd18f3336a0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:31.963682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c5a2656b-2ac2-4847-a474-5dd18f3336a0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:31.996059 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c5a2656b-2ac2-4847-a474-5dd18f3336a0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1300 microversion: 2.1 time: 0.545996 Aug 27 03:02:31.998592 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2587/5005] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:31 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1300 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:33.025228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0e6701a1-b5f1-49fd-981e-17f429d5ff09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:33.026631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0e6701a1-b5f1-49fd-981e-17f429d5ff09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:33.036281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e6701a1-b5f1-49fd-981e-17f429d5ff09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:33.042476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e6701a1-b5f1-49fd-981e-17f429d5ff09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:33.042941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e6701a1-b5f1-49fd-981e-17f429d5ff09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:33.043694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e6701a1-b5f1-49fd-981e-17f429d5ff09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:33.044167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e6701a1-b5f1-49fd-981e-17f429d5ff09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:33.044598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e6701a1-b5f1-49fd-981e-17f429d5ff09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:33.515374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0e6701a1-b5f1-49fd-981e-17f429d5ff09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:33.529037 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0e6701a1-b5f1-49fd-981e-17f429d5ff09 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1300 microversion: 2.1 time: 0.506079 Aug 27 03:02:33.542327 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2419/5006] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:33 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1300 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:34.550573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-16af4872-2cb7-41c1-9a79-385ab4b21606 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:34.551217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-16af4872-2cb7-41c1-9a79-385ab4b21606 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:34.566681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16af4872-2cb7-41c1-9a79-385ab4b21606 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:34.567282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16af4872-2cb7-41c1-9a79-385ab4b21606 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:34.567943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16af4872-2cb7-41c1-9a79-385ab4b21606 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:34.569433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16af4872-2cb7-41c1-9a79-385ab4b21606 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:34.571790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16af4872-2cb7-41c1-9a79-385ab4b21606 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:34.574430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16af4872-2cb7-41c1-9a79-385ab4b21606 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:35.504499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-16af4872-2cb7-41c1-9a79-385ab4b21606 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:35.514303 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-16af4872-2cb7-41c1-9a79-385ab4b21606 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1368 microversion: 2.1 time: 0.967885 Aug 27 03:02:35.516416 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2588/5007] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:34 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1368 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:36.541558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b0878d0d-d71d-43c3-96df-279061c58145 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:36.542940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b0878d0d-d71d-43c3-96df-279061c58145 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:36.559951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0878d0d-d71d-43c3-96df-279061c58145 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:36.562946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0878d0d-d71d-43c3-96df-279061c58145 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:36.563771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0878d0d-d71d-43c3-96df-279061c58145 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:36.564716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0878d0d-d71d-43c3-96df-279061c58145 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:36.566847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0878d0d-d71d-43c3-96df-279061c58145 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:36.567474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0878d0d-d71d-43c3-96df-279061c58145 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:37.428379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b0878d0d-d71d-43c3-96df-279061c58145 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:37.447794 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b0878d0d-d71d-43c3-96df-279061c58145 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1368 microversion: 2.1 time: 0.912197 Aug 27 03:02:37.450533 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2420/5008] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:36 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1368 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:37.946873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:38.039980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-f1d20ad2-de48-4f75-8f6c-1fbd1996a9a9 req-f4f62198-f61f-4219-83d5-e762290d2bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b089d092-f6e1-4573-a5f2-ce55e2cf9b31", "tag": "6a7bcd2c-01a6-45b2-a618-3507c4c7dc42"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:38.064422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:38.067520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:38.092406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f1d20ad2-de48-4f75-8f6c-1fbd1996a9a9 req-f4f62198-f61f-4219-83d5-e762290d2bae service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.093277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f1d20ad2-de48-4f75-8f6c-1fbd1996a9a9 req-f4f62198-f61f-4219-83d5-e762290d2bae service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.095349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f1d20ad2-de48-4f75-8f6c-1fbd1996a9a9 req-f4f62198-f61f-4219-83d5-e762290d2bae service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.143869 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-f1d20ad2-de48-4f75-8f6c-1fbd1996a9a9 req-f4f62198-f61f-4219-83d5-e762290d2bae service nova] Creating event network-changed:6a7bcd2c-01a6-45b2-a618-3507c4c7dc42 for instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 on n-h2-852084-5 Aug 27 03:02:38.178917 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-f1d20ad2-de48-4f75-8f6c-1fbd1996a9a9 req-f4f62198-f61f-4219-83d5-e762290d2bae service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139608 Aug 27 03:02:38.181812 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2421/5009] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:38.472049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8093ad48-422f-4f38-956e-6080ff60ece6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:38.472775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8093ad48-422f-4f38-956e-6080ff60ece6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:38.483708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093ad48-422f-4f38-956e-6080ff60ece6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.486955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093ad48-422f-4f38-956e-6080ff60ece6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.487469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093ad48-422f-4f38-956e-6080ff60ece6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.488440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093ad48-422f-4f38-956e-6080ff60ece6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.491866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093ad48-422f-4f38-956e-6080ff60ece6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.492924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8093ad48-422f-4f38-956e-6080ff60ece6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.551363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:38.634514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c6a3d521-c8e2-475f-9122-135d9cb02d44 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:38.635094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6a3d521-c8e2-475f-9122-135d9cb02d44 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:38.637254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:38.645742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6a3d521-c8e2-475f-9122-135d9cb02d44 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.646616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6a3d521-c8e2-475f-9122-135d9cb02d44 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.648058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6a3d521-c8e2-475f-9122-135d9cb02d44 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.649176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6a3d521-c8e2-475f-9122-135d9cb02d44 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.649874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6a3d521-c8e2-475f-9122-135d9cb02d44 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.650510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6a3d521-c8e2-475f-9122-135d9cb02d44 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.692891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6a3d521-c8e2-475f-9122-135d9cb02d44 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:02:38.872270 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c6a3d521-c8e2-475f-9122-135d9cb02d44 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 204 len: 0 microversion: 2.42 time: 0.940449 Aug 27 03:02:38.875468 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2589/5010] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 03:02:37 2022] DELETE /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 0 bytes in 945 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:02:38.895350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:38.896155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:38.901924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=12 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:38.916843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.922512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.923005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:38.923771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:38.924247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:38.927191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:39.225201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8093ad48-422f-4f38-956e-6080ff60ece6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:39.242793 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8093ad48-422f-4f38-956e-6080ff60ece6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1368 microversion: 2.1 time: 0.775186 Aug 27 03:02:39.258325 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2422/5011] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:38 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1368 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:39.346102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:39.371160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:39.374361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:39.376382 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c7344037-fbdd-4734-8cc3-3214cb7b73fc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 2952 microversion: 2.42 time: 0.495124 Aug 27 03:02:39.377275 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2590/5012] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:38 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 2952 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:40.270671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1190a363-3e8d-4ef9-ab43-7592a9d11cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:40.272594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1190a363-3e8d-4ef9-ab43-7592a9d11cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:40.288294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1190a363-3e8d-4ef9-ab43-7592a9d11cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:40.288926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1190a363-3e8d-4ef9-ab43-7592a9d11cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:40.290644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1190a363-3e8d-4ef9-ab43-7592a9d11cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:40.292668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1190a363-3e8d-4ef9-ab43-7592a9d11cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:40.293237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1190a363-3e8d-4ef9-ab43-7592a9d11cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:40.294414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1190a363-3e8d-4ef9-ab43-7592a9d11cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:40.414603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:40.415234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:40.430986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:40.432428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:40.433801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:40.440130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:40.440854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:40.441590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:40.738842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1190a363-3e8d-4ef9-ab43-7592a9d11cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:40.748781 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1190a363-3e8d-4ef9-ab43-7592a9d11cda tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1368 microversion: 2.1 time: 0.482730 Aug 27 03:02:40.753385 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2423/5013] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:40 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1368 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:41.348000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb074169-ca76-4fde-8728-1b683514ab17 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Action: 'create', calling method: .version_select at 0x7f4d2e8c9040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-450710778"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:41.711388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:41.750575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:41.756747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:41.763699 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6a13f32d-7f58-4c72-9c38-a97b419238f8 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 2952 microversion: 2.42 time: 1.353500 Aug 27 03:02:41.764869 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2591/5014] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:40 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 2952 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:41.790061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bb0e7445-d99a-4ccb-8955-996afb08ff20 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:41.793715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bb0e7445-d99a-4ccb-8955-996afb08ff20 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:41.820051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb0e7445-d99a-4ccb-8955-996afb08ff20 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:41.821802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb0e7445-d99a-4ccb-8955-996afb08ff20 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:41.823274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb0e7445-d99a-4ccb-8955-996afb08ff20 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:41.829341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb0e7445-d99a-4ccb-8955-996afb08ff20 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:41.832286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb0e7445-d99a-4ccb-8955-996afb08ff20 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:41.832970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb0e7445-d99a-4ccb-8955-996afb08ff20 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:42.007037 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bb074169-ca76-4fde-8728-1b683514ab17 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.927294 Aug 27 03:02:42.007991 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2424/5015] 10.222.0.99 () {60 vars in 1155 bytes} [Sat Aug 27 03:02:41 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 929 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 03:02:42.020510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6f29eb01-c4b6-4e90-91db-a94550aa2368 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d29b30af0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:42.169940 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6f29eb01-c4b6-4e90-91db-a94550aa2368 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa" status: 200 len: 344 microversion: 2.1 time: 0.153474 Aug 27 03:02:42.170526 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2425/5016] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:02:42 2022] GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa => generated 344 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:42.691672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb0e7445-d99a-4ccb-8955-996afb08ff20 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:42.707011 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bb0e7445-d99a-4ccb-8955-996afb08ff20 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1368 microversion: 2.1 time: 0.935047 Aug 27 03:02:42.707680 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2592/5017] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:41 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1368 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:42.796823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:42.798366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:42.811963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:42.818875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:42.819967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:42.823261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:42.824109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:42.825060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:43.184842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be970b3a-19d6-49c7-bb10-215dcae5b229 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2a11a040>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:43.378028 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-be970b3a-19d6-49c7-bb10-215dcae5b229 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa" status: 200 len: 344 microversion: 2.1 time: 0.189315 Aug 27 03:02:43.396324 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2593/5018] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:02:43 2022] GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa => generated 344 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:43.468124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a0a27d77-bddb-4d62-84be-80fdb6cc730d req-180c90ad-637f-43b3-ad17-9bdb9ec1b1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b089d092-f6e1-4573-a5f2-ce55e2cf9b31", "name": "network-vif-plugged", "status": "completed", "tag": "6a7bcd2c-01a6-45b2-a618-3507c4c7dc42"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:43.503264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0a27d77-bddb-4d62-84be-80fdb6cc730d req-180c90ad-637f-43b3-ad17-9bdb9ec1b1cc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:43.509636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0a27d77-bddb-4d62-84be-80fdb6cc730d req-180c90ad-637f-43b3-ad17-9bdb9ec1b1cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:43.512196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0a27d77-bddb-4d62-84be-80fdb6cc730d req-180c90ad-637f-43b3-ad17-9bdb9ec1b1cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:43.548468 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a0a27d77-bddb-4d62-84be-80fdb6cc730d req-180c90ad-637f-43b3-ad17-9bdb9ec1b1cc service nova] Creating event network-vif-plugged:6a7bcd2c-01a6-45b2-a618-3507c4c7dc42 for instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 on n-h2-852084-5 Aug 27 03:02:43.566061 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a0a27d77-bddb-4d62-84be-80fdb6cc730d req-180c90ad-637f-43b3-ad17-9bdb9ec1b1cc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101613 Aug 27 03:02:43.596548 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2594/5019] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:43.733739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-18ce3a3f-a3f7-4228-a062-77b85659ac14 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:43.734683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-18ce3a3f-a3f7-4228-a062-77b85659ac14 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:43.745965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18ce3a3f-a3f7-4228-a062-77b85659ac14 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:43.746489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18ce3a3f-a3f7-4228-a062-77b85659ac14 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:43.759848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18ce3a3f-a3f7-4228-a062-77b85659ac14 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:43.760792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18ce3a3f-a3f7-4228-a062-77b85659ac14 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:43.763628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18ce3a3f-a3f7-4228-a062-77b85659ac14 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:43.766299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18ce3a3f-a3f7-4228-a062-77b85659ac14 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:44.174053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:44.190034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:44.191693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:44.193792 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eeb229d1-b712-4eb3-b51f-5f30fc1ef191 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 2952 microversion: 2.42 time: 1.401309 Aug 27 03:02:44.194312 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2426/5020] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:42 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 2952 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:44.411195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b02c5c49-25da-49a4-adca-d78d9e56bc9b tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2e74e670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:44.540827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-18ce3a3f-a3f7-4228-a062-77b85659ac14 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:44.549892 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-18ce3a3f-a3f7-4228-a062-77b85659ac14 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1368 microversion: 2.1 time: 0.821517 Aug 27 03:02:44.555611 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2595/5021] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:43 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1368 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:02:44.556097 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b02c5c49-25da-49a4-adca-d78d9e56bc9b tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa" status: 200 len: 345 microversion: 2.1 time: 0.149964 Aug 27 03:02:44.564540 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2427/5022] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:02:44 2022] GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa => generated 345 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:44.583321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b572482-9e06-4a7e-a7a0-01b025d3e9ae tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Action: 'create', calling method: .version_select at 0x7f4d298e8ee0>, body: {"snapshot": {"volume_id": "2e8d07b4-c127-4050-a0e4-27a3a9f198fa", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-795183110"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:44.913148 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b572482-9e06-4a7e-a7a0-01b025d3e9ae tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.346271 Aug 27 03:02:44.913832 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2596/5023] 10.222.0.99 () {60 vars in 1162 bytes} [Sat Aug 27 03:02:44 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:44.933215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-08f9cdbc-b50b-4d54-8944-5b82c57ab687 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2e75e5e0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:45.072136 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-08f9cdbc-b50b-4d54-8944-5b82c57ab687 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de" status: 200 len: 286 microversion: 2.1 time: 0.147703 Aug 27 03:02:45.072983 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2428/5024] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 03:02:44 2022] GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de => generated 286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:45.084430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ee557073-e3f7-4958-a282-72015fc08ea5 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2e863a60>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:45.172383 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ee557073-e3f7-4958-a282-72015fc08ea5 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.091953 Aug 27 03:02:45.179485 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2597/5025] 10.222.0.99 () {58 vars in 1140 bytes} [Sat Aug 27 03:02:45 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:45.185243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d77be6ea-3e09-4116-8b38-cfc16ea59a2d tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2e902ee0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:45.237977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:45.238588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:45.254931 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d77be6ea-3e09-4116-8b38-cfc16ea59a2d tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de" status: 200 len: 286 microversion: 2.1 time: 0.074033 Aug 27 03:02:45.256420 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2429/5026] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 03:02:45 2022] GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:45.283198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:45.285873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:45.288499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:45.298776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:45.299310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:45.299782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:45.575144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5eba93c3-a828-4640-8276-1fee193b3b97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:45.576065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5eba93c3-a828-4640-8276-1fee193b3b97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:45.589760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eba93c3-a828-4640-8276-1fee193b3b97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:45.598310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eba93c3-a828-4640-8276-1fee193b3b97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:45.599026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eba93c3-a828-4640-8276-1fee193b3b97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:45.600528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eba93c3-a828-4640-8276-1fee193b3b97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:45.602483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eba93c3-a828-4640-8276-1fee193b3b97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:45.605061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eba93c3-a828-4640-8276-1fee193b3b97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:45.790489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:45.797587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:02:45.801320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:45.803416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:45.804767 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e736c27c-bd34-47d1-a975-9a1d7da65869 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 2931 microversion: 2.42 time: 0.570925 Aug 27 03:02:45.818133 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2598/5027] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:45 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 2931 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:46.268833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-611e8068-8ae3-4e11-8d66-6f29d0118486 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2a228670>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:46.349373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-611e8068-8ae3-4e11-8d66-6f29d0118486 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de" status: 200 len: 286 microversion: 2.1 time: 0.084639 Aug 27 03:02:46.355850 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2599/5028] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 03:02:46 2022] GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:46.432770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-3cbb34e1-572b-4524-b286-3c6e3dfb4d38 req-fe2e59e5-ba10-4e94-9612-c00bd6097ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-unplugged", "status": "completed", "tag": "d9dd5177-12fc-4a5a-a699-90fef2125241"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:46.455134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3cbb34e1-572b-4524-b286-3c6e3dfb4d38 req-fe2e59e5-ba10-4e94-9612-c00bd6097ebd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:46.455925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3cbb34e1-572b-4524-b286-3c6e3dfb4d38 req-fe2e59e5-ba10-4e94-9612-c00bd6097ebd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:46.456549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3cbb34e1-572b-4524-b286-3c6e3dfb4d38 req-fe2e59e5-ba10-4e94-9612-c00bd6097ebd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:46.482158 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-3cbb34e1-572b-4524-b286-3c6e3dfb4d38 req-fe2e59e5-ba10-4e94-9612-c00bd6097ebd service nova] Creating event network-vif-unplugged:d9dd5177-12fc-4a5a-a699-90fef2125241 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 03:02:46.497830 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-3cbb34e1-572b-4524-b286-3c6e3dfb4d38 req-fe2e59e5-ba10-4e94-9612-c00bd6097ebd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068961 Aug 27 03:02:46.506864 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2600/5029] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:46.538663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5eba93c3-a828-4640-8276-1fee193b3b97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:46.548062 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5eba93c3-a828-4640-8276-1fee193b3b97 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1559 microversion: 2.1 time: 0.976806 Aug 27 03:02:46.558895 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2430/5030] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:02:45 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1559 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:02:46.587108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fe7890c8-c564-4c7c-a836-31194603d427 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:46.588168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fe7890c8-c564-4c7c-a836-31194603d427 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:46.607575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe7890c8-c564-4c7c-a836-31194603d427 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:46.608379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe7890c8-c564-4c7c-a836-31194603d427 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:46.609026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe7890c8-c564-4c7c-a836-31194603d427 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:46.611218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe7890c8-c564-4c7c-a836-31194603d427 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:46.612079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe7890c8-c564-4c7c-a836-31194603d427 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:46.614022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe7890c8-c564-4c7c-a836-31194603d427 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:46.805894 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fe7890c8-c564-4c7c-a836-31194603d427 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.224014 Aug 27 03:02:46.807311 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2601/5031] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 03:02:46 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:46.843056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:46.844447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:46.856213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:46.857791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:46.858347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:46.861569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:46.862291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:46.866631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:47.363806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2b9bf9de-53ea-4125-bb2c-b962140a65ee tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d28ea5550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:47.431741 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2b9bf9de-53ea-4125-bb2c-b962140a65ee tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de" status: 200 len: 286 microversion: 2.1 time: 0.073094 Aug 27 03:02:47.436813 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2602/5032] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 03:02:47 2022] GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:48.448048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-83f12cf6-6b6a-4f8c-be77-7ae8ec8e74c8 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2a1119d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:48.484383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:48.509335 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-83f12cf6-6b6a-4f8c-be77-7ae8ec8e74c8 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de" status: 200 len: 287 microversion: 2.1 time: 0.068588 Aug 27 03:02:48.515905 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2603/5033] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 03:02:48 2022] GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:48.523665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:48.525165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:48.526255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58dcaa1d-2aba-4b71-b330-a0a020b37e18 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2a100700>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:48.535217 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e55809ea-09b1-40b8-a6e2-54fc805c489c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 2910 microversion: 2.42 time: 1.696406 Aug 27 03:02:48.541188 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2431/5034] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:46 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 2910 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:48.552838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d99863c9-227a-40cf-8bf9-c68b420fd4cb req-efe9e3f0-759d-4499-839a-eea5c7065aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-unplugged", "status": "completed", "tag": "b5b5aa70-cca4-4531-90fd-70d30d297d0f"}, {"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-unplugged", "status": "completed", "tag": "8ec234de-143a-4f79-b7f0-2e9d4fc1bb54"}, {"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-unplugged", "status": "completed", "tag": "ee47c975-6b0f-4e9f-89fd-d2e4b902ab10"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:48.581163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d99863c9-227a-40cf-8bf9-c68b420fd4cb req-efe9e3f0-759d-4499-839a-eea5c7065aab service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:48.581575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d99863c9-227a-40cf-8bf9-c68b420fd4cb req-efe9e3f0-759d-4499-839a-eea5c7065aab service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:48.582051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d99863c9-227a-40cf-8bf9-c68b420fd4cb req-efe9e3f0-759d-4499-839a-eea5c7065aab service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:48.626748 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d99863c9-227a-40cf-8bf9-c68b420fd4cb req-efe9e3f0-759d-4499-839a-eea5c7065aab service nova] Creating event network-vif-unplugged:b5b5aa70-cca4-4531-90fd-70d30d297d0f for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 03:02:48.627416 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d99863c9-227a-40cf-8bf9-c68b420fd4cb req-efe9e3f0-759d-4499-839a-eea5c7065aab service nova] Creating event network-vif-unplugged:8ec234de-143a-4f79-b7f0-2e9d4fc1bb54 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 03:02:48.627945 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d99863c9-227a-40cf-8bf9-c68b420fd4cb req-efe9e3f0-759d-4499-839a-eea5c7065aab service nova] Creating event network-vif-unplugged:ee47c975-6b0f-4e9f-89fd-d2e4b902ab10 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 03:02:48.653038 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d99863c9-227a-40cf-8bf9-c68b420fd4cb req-efe9e3f0-759d-4499-839a-eea5c7065aab service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.110158 Aug 27 03:02:48.663384 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2432/5035] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:48.744238 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58dcaa1d-2aba-4b71-b330-a0a020b37e18 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "DELETE /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de" status: 202 len: 0 microversion: 2.1 time: 0.227047 Aug 27 03:02:48.744835 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2604/5036] 10.222.0.99 () {58 vars in 1254 bytes} [Sat Aug 27 03:02:48 2022] DELETE /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:02:48.754562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-941ce65c-911d-4d94-8d6c-2e9e0327ca4e tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d29565670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:48.833202 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-941ce65c-911d-4d94-8d6c-2e9e0327ca4e tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de" status: 200 len: 286 microversion: 2.1 time: 0.083661 Aug 27 03:02:48.840824 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2433/5037] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 03:02:48 2022] GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:49.565612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:49.566623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:49.584165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:49.584975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:49.585587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:49.586793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:49.587834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:49.588469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:49.848369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3d880985-9342-47f8-bc19-77d524605f3c req-0e18af85-52c0-4c79-9d96-5f3f8d960a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-deleted", "tag": "a6bc5e26-e4da-451c-9c23-0f8babc733c6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:49.869159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3d880985-9342-47f8-bc19-77d524605f3c req-0e18af85-52c0-4c79-9d96-5f3f8d960a50 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:49.869661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3d880985-9342-47f8-bc19-77d524605f3c req-0e18af85-52c0-4c79-9d96-5f3f8d960a50 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:49.870145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3d880985-9342-47f8-bc19-77d524605f3c req-0e18af85-52c0-4c79-9d96-5f3f8d960a50 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:49.912785 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3d880985-9342-47f8-bc19-77d524605f3c req-0e18af85-52c0-4c79-9d96-5f3f8d960a50 service nova] Creating event network-vif-deleted:a6bc5e26-e4da-451c-9c23-0f8babc733c6 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 03:02:49.919787 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3d880985-9342-47f8-bc19-77d524605f3c req-0e18af85-52c0-4c79-9d96-5f3f8d960a50 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076424 Aug 27 03:02:49.921584 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2434/5038] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:49.931949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aefb40af-8ac3-4525-b0cd-3f0e54c2fab7 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2e8fe040>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:50.011893 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aefb40af-8ac3-4525-b0cd-3f0e54c2fab7 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de" status: 200 len: 286 microversion: 2.1 time: 0.088953 Aug 27 03:02:50.012646 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2435/5039] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 03:02:49 2022] GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:50.962544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-72039670-ed8e-49f6-a064-306bd0b89525 req-6a7f279b-095e-4ac3-a825-ac50cd91e1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-unplugged", "status": "completed", "tag": "a6bc5e26-e4da-451c-9c23-0f8babc733c6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:50.992724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-72039670-ed8e-49f6-a064-306bd0b89525 req-6a7f279b-095e-4ac3-a825-ac50cd91e1ae service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:50.993563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-72039670-ed8e-49f6-a064-306bd0b89525 req-6a7f279b-095e-4ac3-a825-ac50cd91e1ae service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:50.994314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-72039670-ed8e-49f6-a064-306bd0b89525 req-6a7f279b-095e-4ac3-a825-ac50cd91e1ae service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:51.012788 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-72039670-ed8e-49f6-a064-306bd0b89525 req-6a7f279b-095e-4ac3-a825-ac50cd91e1ae service nova] Creating event network-vif-unplugged:a6bc5e26-e4da-451c-9c23-0f8babc733c6 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 03:02:51.023343 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-72039670-ed8e-49f6-a064-306bd0b89525 req-6a7f279b-095e-4ac3-a825-ac50cd91e1ae service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067693 Aug 27 03:02:51.029836 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2436/5040] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:51.037143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-71793e66-0e11-4254-b1c4-4ad217a07057 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2e8fee50>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:51.084711 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-71793e66-0e11-4254-b1c4-4ad217a07057 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de" status: 200 len: 286 microversion: 2.1 time: 0.051899 Aug 27 03:02:51.085834 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2437/5041] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 03:02:51 2022] GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:51.324714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:51.338594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:51.350879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:51.362593 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7d26dc96-db28-438d-a2f3-941a66e1ded6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 2865 microversion: 2.42 time: 1.801865 Aug 27 03:02:51.363170 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2605/5042] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:49 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 2865 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:51.955868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-9a885c3a-e051-4436-8852-5f1900f42d8f req-6bdad6e5-ffde-4445-bfcb-e3e37e967571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-deleted", "tag": "8ec234de-143a-4f79-b7f0-2e9d4fc1bb54"}, {"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-deleted", "tag": "b5b5aa70-cca4-4531-90fd-70d30d297d0f"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:51.983586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9a885c3a-e051-4436-8852-5f1900f42d8f req-6bdad6e5-ffde-4445-bfcb-e3e37e967571 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:51.985357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9a885c3a-e051-4436-8852-5f1900f42d8f req-6bdad6e5-ffde-4445-bfcb-e3e37e967571 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:51.986438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9a885c3a-e051-4436-8852-5f1900f42d8f req-6bdad6e5-ffde-4445-bfcb-e3e37e967571 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:52.021208 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-9a885c3a-e051-4436-8852-5f1900f42d8f req-6bdad6e5-ffde-4445-bfcb-e3e37e967571 service nova] Creating event network-vif-deleted:8ec234de-143a-4f79-b7f0-2e9d4fc1bb54 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 03:02:52.021818 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-9a885c3a-e051-4436-8852-5f1900f42d8f req-6bdad6e5-ffde-4445-bfcb-e3e37e967571 service nova] Creating event network-vif-deleted:b5b5aa70-cca4-4531-90fd-70d30d297d0f for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 03:02:52.034970 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-9a885c3a-e051-4436-8852-5f1900f42d8f req-6bdad6e5-ffde-4445-bfcb-e3e37e967571 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084399 Aug 27 03:02:52.038688 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2438/5043] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:52.100891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d44ce024-ee59-49be-8663-6903d06a3216 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2a1113a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:52.175137 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-d44ce024-ee59-49be-8663-6903d06a3216 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] HTTP exception thrown: Snapshot 0cb92337-3aff-4fff-8ca5-638734c403de could not be found. Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d44ce024-ee59-49be-8663-6903d06a3216 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Request method failure captured: Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de HTTP/1.1 Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYlQLhAudY-q1cR70m0lcZG9U3Z0nksNHvg65AphDRkoKSBq4rhQgWWticucETMt2N4DTO2zTM8pzMvWW-g4VKtQORIVFb4K9ii8JWhyMGD7aSrDrKWk_HEh3K6sOwO7bckIzw-B7tVbRR08Dul4-dKaucVHmhtF-1uUVfFp9-13B0I Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 5a09c3a9634645879e544128644ea36f Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5a09c3a9634645879e544128644ea36f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5a09c3a9634645879e544128644ea36f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5a09c3a9634645879e544128644ea36f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5a09c3a9634645879e544128644ea36f"}]}] Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 5a09c3a9634645879e544128644ea36f Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-VolumesSnapshotsTestJSON-1186742225-project Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 2d638eb77f6d45a1a73ff429c11e4665 Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1186742225-project Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: exception: Snapshot 0cb92337-3aff-4fff-8ca5-638734c403de could not be found. Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '0cb92337-3aff-4fff-8ca5-638734c403de'} Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0cb92337-3aff-4fff-8ca5-638734c403de could not be found. (HTTP 404) (Request-ID: req-b1319f51-d5a7-4a26-ad0a-375a8a7ce14d) Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:02:52.183966 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0cb92337-3aff-4fff-8ca5-638734c403de could not be found. Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0cb92337-3aff-4fff-8ca5-638734c403de could not be found. Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0cb92337-3aff-4fff-8ca5-638734c403de could not be found. Aug 27 03:02:52.188789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:02:52.194946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d44ce024-ee59-49be-8663-6903d06a3216 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Returning 404 to user: Snapshot 0cb92337-3aff-4fff-8ca5-638734c403de could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:52.196105 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d44ce024-ee59-49be-8663-6903d06a3216 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de" status: 404 len: 111 microversion: 2.1 time: 0.099329 Aug 27 03:02:52.197192 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2606/5044] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 03:02:52 2022] GET /compute/v2.1/os-snapshots/0cb92337-3aff-4fff-8ca5-638734c403de => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:02:52.208517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4cc6a67-6999-47a8-afd2-40100a8897ef tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2e8fe790>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:52.383742 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c4cc6a67-6999-47a8-afd2-40100a8897ef tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa" status: 202 len: 0 microversion: 2.1 time: 0.181985 Aug 27 03:02:52.384324 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2439/5045] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 03:02:52 2022] DELETE /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:02:52.399642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:52.400531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:52.401358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-09d6d4f3-9fc2-43f9-b3f5-17351ff86768 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2e6c74c0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:52.423160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:52.423667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:52.424128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:52.433498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:52.434076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:52.434537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:52.581843 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-09d6d4f3-9fc2-43f9-b3f5-17351ff86768 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa" status: 200 len: 344 microversion: 2.1 time: 0.190210 Aug 27 03:02:52.589816 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2440/5046] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:02:52 2022] GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa => generated 344 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:53.598285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-820ed36e-3964-4e71-ad72-9f4c61c968b3 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2e6c7b80>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:53.717766 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-820ed36e-3964-4e71-ad72-9f4c61c968b3 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa" status: 200 len: 344 microversion: 2.1 time: 0.124398 Aug 27 03:02:53.718361 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2441/5047] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:02:53 2022] GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa => generated 344 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:54.086826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c2893fd8-830e-466e-8ac5-5b9cd99dd0ea req-a7ccc877-7806-4e35-9817-01e1258bb2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-deleted", "tag": "ee47c975-6b0f-4e9f-89fd-d2e4b902ab10"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:54.128576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c2893fd8-830e-466e-8ac5-5b9cd99dd0ea req-a7ccc877-7806-4e35-9817-01e1258bb2ab service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:54.129535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c2893fd8-830e-466e-8ac5-5b9cd99dd0ea req-a7ccc877-7806-4e35-9817-01e1258bb2ab service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:54.130731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c2893fd8-830e-466e-8ac5-5b9cd99dd0ea req-a7ccc877-7806-4e35-9817-01e1258bb2ab service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:54.173091 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c2893fd8-830e-466e-8ac5-5b9cd99dd0ea req-a7ccc877-7806-4e35-9817-01e1258bb2ab service nova] Creating event network-vif-deleted:ee47c975-6b0f-4e9f-89fd-d2e4b902ab10 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 03:02:54.192666 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c2893fd8-830e-466e-8ac5-5b9cd99dd0ea req-a7ccc877-7806-4e35-9817-01e1258bb2ab service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112927 Aug 27 03:02:54.194030 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2442/5048] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:54.244537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:54.265737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:54.267196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:54.268508 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a8be017f-a438-4d88-b47e-bb4e175ebab3 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 2389 microversion: 2.42 time: 1.882123 Aug 27 03:02:54.299815 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2607/5049] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:52 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 2389 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:54.471446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ac53ec2c-fb4a-4b95-9056-2e7272292e69 req-c5db96e6-8d0e-4619-a1be-2b6349ebbf48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b089d092-f6e1-4573-a5f2-ce55e2cf9b31", "tag": "6a7bcd2c-01a6-45b2-a618-3507c4c7dc42"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:54.518287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ac53ec2c-fb4a-4b95-9056-2e7272292e69 req-c5db96e6-8d0e-4619-a1be-2b6349ebbf48 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:54.519663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ac53ec2c-fb4a-4b95-9056-2e7272292e69 req-c5db96e6-8d0e-4619-a1be-2b6349ebbf48 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:54.525798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ac53ec2c-fb4a-4b95-9056-2e7272292e69 req-c5db96e6-8d0e-4619-a1be-2b6349ebbf48 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:54.568925 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ac53ec2c-fb4a-4b95-9056-2e7272292e69 req-c5db96e6-8d0e-4619-a1be-2b6349ebbf48 service nova] Creating event network-changed:6a7bcd2c-01a6-45b2-a618-3507c4c7dc42 for instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 on n-h2-852084-5 Aug 27 03:02:54.590770 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ac53ec2c-fb4a-4b95-9056-2e7272292e69 req-c5db96e6-8d0e-4619-a1be-2b6349ebbf48 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132260 Aug 27 03:02:54.597948 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2443/5050] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:54.735261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-922a58bc-eae6-406f-9ea9-69601b0b0b92 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d29a63790>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:54.932717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-922a58bc-eae6-406f-9ea9-69601b0b0b92 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa" status: 200 len: 344 microversion: 2.1 time: 0.202981 Aug 27 03:02:54.939747 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2608/5051] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:02:54 2022] GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa => generated 344 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:02:55.310306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:55.315606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:55.357816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:55.361545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:55.362344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:55.366008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:55.367190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:55.372407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:55.631536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:55.652959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:55.654598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:55.655938 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e2776d5e-94e8-49ab-9f51-ea9a525d69af tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 2164 microversion: 2.42 time: 0.367105 Aug 27 03:02:55.663228 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2444/5052] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:55 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 2164 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:55.948133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-86d14213-e72a-4114-8d8c-c27f9e30971d tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2a72b160>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:56.092942 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-86d14213-e72a-4114-8d8c-c27f9e30971d tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa" status: 200 len: 344 microversion: 2.1 time: 0.149325 Aug 27 03:02:56.093430 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2609/5053] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:02:55 2022] GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa => generated 344 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:56.328249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-5dff4b10-e4f4-4a2b-8680-c64cf9bac95e req-4c830166-707b-4e25-a485-7c93a3827f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fcd0614-cd02-4b79-b75e-59a9be34d77a", "name": "network-vif-deleted", "tag": "d9dd5177-12fc-4a5a-a699-90fef2125241"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:02:56.353903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5dff4b10-e4f4-4a2b-8680-c64cf9bac95e req-4c830166-707b-4e25-a485-7c93a3827f64 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:56.354663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5dff4b10-e4f4-4a2b-8680-c64cf9bac95e req-4c830166-707b-4e25-a485-7c93a3827f64 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:56.359484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5dff4b10-e4f4-4a2b-8680-c64cf9bac95e req-4c830166-707b-4e25-a485-7c93a3827f64 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:56.419110 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-5dff4b10-e4f4-4a2b-8680-c64cf9bac95e req-4c830166-707b-4e25-a485-7c93a3827f64 service nova] Creating event network-vif-deleted:d9dd5177-12fc-4a5a-a699-90fef2125241 for instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a on n-h1-852084-5 Aug 27 03:02:56.435621 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-5dff4b10-e4f4-4a2b-8680-c64cf9bac95e req-4c830166-707b-4e25-a485-7c93a3827f64 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111759 Aug 27 03:02:56.439982 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2445/5054] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:02:56.719308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:56.721777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:56.748952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:56.752490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:56.754721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:56.757080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:56.760008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:56.762674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:57.112766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2fbd12fb-795d-4bfd-a063-653bd76412f4 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2e89a0d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:57.597816 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-2fbd12fb-795d-4bfd-a063-653bd76412f4 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] HTTP exception thrown: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2fbd12fb-795d-4bfd-a063-653bd76412f4 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Request method failure captured: Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa HTTP/1.1 Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYlQLhAudY-q1cR70m0lcZG9U3Z0nksNHvg65AphDRkoKSBq4rhQgWWticucETMt2N4DTO2zTM8pzMvWW-g4VKtQORIVFb4K9ii8JWhyMGD7aSrDrKWk_HEh3K6sOwO7bckIzw-B7tVbRR08Dul4-dKaucVHmhtF-1uUVfFp9-13B0I Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 5a09c3a9634645879e544128644ea36f Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5a09c3a9634645879e544128644ea36f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5a09c3a9634645879e544128644ea36f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5a09c3a9634645879e544128644ea36f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5a09c3a9634645879e544128644ea36f"}]}] Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 5a09c3a9634645879e544128644ea36f Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-VolumesSnapshotsTestJSON-1186742225-project Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 2d638eb77f6d45a1a73ff429c11e4665 Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1186742225-project Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: exception: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '2e8d07b4-c127-4050-a0e4-27a3a9f198fa'} Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. (HTTP 404) (Request-ID: req-90918a56-46f2-4f59-a84e-e38592e34adb) Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:02:57.600092 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2fbd12fb-795d-4bfd-a063-653bd76412f4 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Returning 404 to user: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:57.605016 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2fbd12fb-795d-4bfd-a063-653bd76412f4 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa" status: 404 len: 109 microversion: 2.1 time: 0.498582 Aug 27 03:02:57.608501 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2446/5055] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:02:57 2022] GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa => generated 109 bytes in 506 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:02:57.630477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0bc98e0b-be70-40d2-8409-3fc01cc32b96 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2a6d0ee0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:57.824113 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-0bc98e0b-be70-40d2-8409-3fc01cc32b96 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] HTTP exception thrown: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0bc98e0b-be70-40d2-8409-3fc01cc32b96 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Request method failure captured: Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa HTTP/1.1 Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYlQLhAudY-q1cR70m0lcZG9U3Z0nksNHvg65AphDRkoKSBq4rhQgWWticucETMt2N4DTO2zTM8pzMvWW-g4VKtQORIVFb4K9ii8JWhyMGD7aSrDrKWk_HEh3K6sOwO7bckIzw-B7tVbRR08Dul4-dKaucVHmhtF-1uUVfFp9-13B0I Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 5a09c3a9634645879e544128644ea36f Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5a09c3a9634645879e544128644ea36f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5a09c3a9634645879e544128644ea36f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5a09c3a9634645879e544128644ea36f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5a09c3a9634645879e544128644ea36f"}]}] Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 5a09c3a9634645879e544128644ea36f Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-VolumesSnapshotsTestJSON-1186742225-project Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 2d638eb77f6d45a1a73ff429c11e4665 Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1186742225-project Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: exception: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '2e8d07b4-c127-4050-a0e4-27a3a9f198fa'} Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. (HTTP 404) (Request-ID: req-352da423-cdf3-45e6-885b-820d32e9a508) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:02:57.827054 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:57.832019 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:57.836549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0bc98e0b-be70-40d2-8409-3fc01cc32b96 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Returning 404 to user: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:57.841269 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0bc98e0b-be70-40d2-8409-3fc01cc32b96 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa" status: 404 len: 109 microversion: 2.1 time: 0.231433 Aug 27 03:02:57.842069 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2447/5056] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 03:02:57 2022] DELETE /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa => generated 109 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:02:57.852657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88dd35d7-b55b-4a97-ae70-16328f321833 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Calling method '.version_select at 0x7f4d2e89a430>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:58.021646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:58.046095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:58.072731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:58.074488 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d19d73b7-1fe3-4ff1-a2de-7150777a3605 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 1.372333 Aug 27 03:02:58.078417 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2610/5057] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:56 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:02:58.092386 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-88dd35d7-b55b-4a97-ae70-16328f321833 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] HTTP exception thrown: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88dd35d7-b55b-4a97-ae70-16328f321833 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Request method failure captured: Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa HTTP/1.1 Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYlQLhAudY-q1cR70m0lcZG9U3Z0nksNHvg65AphDRkoKSBq4rhQgWWticucETMt2N4DTO2zTM8pzMvWW-g4VKtQORIVFb4K9ii8JWhyMGD7aSrDrKWk_HEh3K6sOwO7bckIzw-B7tVbRR08Dul4-dKaucVHmhtF-1uUVfFp9-13B0I Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 5a09c3a9634645879e544128644ea36f Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5a09c3a9634645879e544128644ea36f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5a09c3a9634645879e544128644ea36f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5a09c3a9634645879e544128644ea36f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5a09c3a9634645879e544128644ea36f"}]}] Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 5a09c3a9634645879e544128644ea36f Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1186742225 Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-VolumesSnapshotsTestJSON-1186742225-project Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 2d638eb77f6d45a1a73ff429c11e4665 Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1186742225-project Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: method: Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: exception: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '2e8d07b4-c127-4050-a0e4-27a3a9f198fa'} Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. (HTTP 404) (Request-ID: req-e747a1da-d75a-496a-9d07-1f09532fcd89) Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:02:58.096277 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. Aug 27 03:02:58.101366 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:02:58.106698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88dd35d7-b55b-4a97-ae70-16328f321833 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] Returning 404 to user: Volume 2e8d07b4-c127-4050-a0e4-27a3a9f198fa could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:02:58.108859 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-88dd35d7-b55b-4a97-ae70-16328f321833 tempest-VolumesSnapshotsTestJSON-1186742225 tempest-VolumesSnapshotsTestJSON-1186742225-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa" status: 404 len: 109 microversion: 2.1 time: 0.261272 Aug 27 03:02:58.110065 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2448/5058] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:02:57 2022] GET /compute/v2.1/os-volumes/2e8d07b4-c127-4050-a0e4-27a3a9f198fa => generated 109 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:02:59.109387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:02:59.110421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:02:59.140599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:59.143839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:59.146268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:59.147209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:02:59.148549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:02:59.150464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:02:59.572981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:59.596089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:59.598378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:02:59.599877 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-be157a69-58a1-42e3-a6e3-2a9322f6c3dc tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.494458 Aug 27 03:02:59.600615 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2611/5059] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:02:59 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:00.633612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:00.636412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:00.647726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:00.653144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:00.654163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:00.655248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:00.657098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:00.658636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:01.119031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:01.140841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:01.147491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:01.149260 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-19d7ae24-d2ac-4ad2-ba55-df84da119b2c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.521994 Aug 27 03:03:01.156795 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2449/5060] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:00 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:02.184613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:02.185242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:02.194329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:02.194832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:02.195275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:02.196001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:02.196480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:02.196896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:02.479129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:02.495931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:02.504580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:02.505935 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-243e6311-4a07-4aee-bbb8-beb7008c2cd1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.329721 Aug 27 03:03:02.506519 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2612/5061] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:02 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:03.546892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:03.547451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:03.562074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:03.562575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:03.572434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:03.575386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:03.576338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:03.577507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:03.751776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:03.777879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:03.783473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:03.787069 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f3b4e80c-0ad5-4157-8d70-8688fa72185d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.244614 Aug 27 03:03:03.790922 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2450/5062] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:03 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:04.816600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:04.817263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:04.846308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:04.847175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:04.847851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:04.850129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:04.851809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:04.853359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:04.986504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:05.006286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:05.007804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:05.009133 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5eec4081-495a-48c4-9739-75a21dc72147 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.196562 Aug 27 03:03:05.010091 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2613/5063] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:04 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:06.039627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:06.040395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:06.064966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:06.069996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:06.072303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:06.074534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:06.075222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:06.076805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:06.248331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:06.262082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:06.267309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:06.273646 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-198b2cfd-e797-4aff-adb4-fa90217e02cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.240106 Aug 27 03:03:06.274887 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2451/5064] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:06 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:07.311372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:07.314509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:07.336238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:07.336786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:07.337509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:07.343122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:07.343628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:07.349652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:07.581393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:07.609905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:07.618249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:07.620427 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ef8655cb-09d3-4cef-a8e8-65d4f0945d7c tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.322067 Aug 27 03:03:07.636127 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2614/5065] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:07 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:08.651221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:08.652434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:08.683480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=34 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:08.694831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:08.695839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:08.699754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:08.702260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:08.704438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:08.706104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:08.729528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=65 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:08.942890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:08.958864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:08.965054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:08.967775 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ce7ccf04-187d-4287-b3eb-be29315f3dd5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.322786 Aug 27 03:03:08.986739 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2452/5066] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:08 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:09.998827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:09.999466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:10.018283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:10.026487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:10.027498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:10.028226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:10.029158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:10.029817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:10.030408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:10.192983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:10.209155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:10.210978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:10.212585 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6e8d2a0b-26c5-4ee4-a86e-5279790e8137 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.217947 Aug 27 03:03:10.220078 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2615/5067] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:09 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:11.253270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:11.254662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:11.268953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:11.272206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:11.272918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:11.274191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:11.278356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:11.279194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:11.479258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:11.493896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:11.503182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:11.505290 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-370244d9-a33f-42d7-b8ca-3304b882d3b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.267663 Aug 27 03:03:11.506083 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2453/5068] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:11 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:12.535147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:12.536667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:12.554677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:12.556030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:12.557323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:12.560458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:12.561027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:12.567522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:12.726405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:12.742019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:12.746877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:12.749296 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2032ff14-7da5-4f4c-ab0d-b840e1b07cb4 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.219493 Aug 27 03:03:12.750917 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2616/5069] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:12 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:13.779833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:13.781144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:13.802062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:13.805182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:13.805946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:13.808860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:13.809599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:13.813922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:14.047324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:14.071796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:14.077323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:14.079569 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4d246304-2967-4ae8-ba90-d11251d31096 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.304428 Aug 27 03:03:14.081528 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2454/5070] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:13 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:15.115215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:15.115957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:15.144052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:15.144786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:15.146377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:15.149882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:15.152560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:15.154111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:15.579100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:15.598804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:15.600933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:15.642374 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8b00dc96-6c5a-4c80-9310-4de0026d56da tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.513330 Aug 27 03:03:15.647308 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2617/5071] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:15 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:16.678827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:16.679455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:16.719101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:16.727263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:16.729582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:16.744034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:16.746979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:16.751314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:17.015235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:17.026953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:17.034009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:17.035271 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e37904b2-9dba-49e4-ae84-0e4c6f5de11a tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.361579 Aug 27 03:03:17.039511 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2455/5072] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:16 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:18.071350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:18.072173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:18.093087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.094666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.096713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:18.097738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:18.099971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:18.102180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:18.110087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=68 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:18.250105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:18.278804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:18.288307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:18.289901 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c67fc480-357c-406d-9d06-7b41b7aac7cb tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.227057 Aug 27 03:03:18.338409 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2618/5073] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:18 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:19.339018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:19.339658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:19.363375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:19.364243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:19.364907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:19.365988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:19.367377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:19.370069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:19.584962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:19.635472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:19.655454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:19.677540 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6aa7564a-753f-4fad-b13b-279cd87c0cf7 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.342673 Aug 27 03:03:19.680778 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2456/5074] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:19 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:20.716613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:20.717237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:20.742134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:20.742914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:20.763831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:20.763831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:20.763831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:20.770921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:21.025486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:21.035906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:21.042884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:21.046010 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bffa7fbf-2f6d-4812-9e88-b94d24eefd6f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.334878 Aug 27 03:03:21.049149 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2619/5075] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:20 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:22.106367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:22.107273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:22.126313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:22.127010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:22.127563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:22.128415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:22.134362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:22.134969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:22.450586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:22.492472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:22.494726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:22.499181 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3c404211-b961-4cdd-97ee-1cd5817c1f93 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.398048 Aug 27 03:03:22.512624 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2457/5076] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:22 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:03:23.570981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:23.575557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:23.625600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:23.626685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:23.627502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:23.633187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:23.634594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:23.634838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:24.100090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f83b5934-3190-45e7-a22d-fd4739bdf37e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:24.101044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f83b5934-3190-45e7-a22d-fd4739bdf37e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:24.131092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f83b5934-3190-45e7-a22d-fd4739bdf37e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:24.132036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f83b5934-3190-45e7-a22d-fd4739bdf37e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:24.132686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f83b5934-3190-45e7-a22d-fd4739bdf37e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:24.133632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f83b5934-3190-45e7-a22d-fd4739bdf37e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:24.134344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f83b5934-3190-45e7-a22d-fd4739bdf37e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:24.134969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f83b5934-3190-45e7-a22d-fd4739bdf37e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:24.193402 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f83b5934-3190-45e7-a22d-fd4739bdf37e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/ips" status: 200 len: 150 microversion: 2.1 time: 0.101792 Aug 27 03:03:24.206349 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2458/5077] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 03:03:24 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/ips => generated 150 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:24.731538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:24.795193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:24.805993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:24.807327 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f851f18c-5299-41ba-9e21-c262621a9bb5 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 1.245449 Aug 27 03:03:24.814467 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2620/5078] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:23 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:25.857094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:25.857906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:25.872276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:25.872770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:25.884240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:25.885125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:25.885613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:25.886091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:26.558723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:26.581975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:26.594354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:26.600832 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-74841863-78f5-4ba7-956d-7edbdc8714b1 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.747600 Aug 27 03:03:26.610214 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2459/5079] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:25 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:27.629608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:27.630554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:27.645302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:27.646746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:27.647459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:27.648477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:27.649262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:27.650150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:27.909845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:27.927903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:27.941046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:27.942681 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-65628cee-a7a2-4b15-b149-a4bef8ba1a4b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.317955 Aug 27 03:03:27.946836 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2621/5080] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:27 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:28.624802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-739a2b69-7920-4702-a53d-af468a77005d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fd5483a-45b0-41af-9b30-e82d0299edf0"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:28.627680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-739a2b69-7920-4702-a53d-af468a77005d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:28.648993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739a2b69-7920-4702-a53d-af468a77005d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:28.669737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739a2b69-7920-4702-a53d-af468a77005d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:28.680621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739a2b69-7920-4702-a53d-af468a77005d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:28.681522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739a2b69-7920-4702-a53d-af468a77005d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:28.682045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739a2b69-7920-4702-a53d-af468a77005d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:28.682492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739a2b69-7920-4702-a53d-af468a77005d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:28.972509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:28.974578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:28.990289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:28.995660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:28.998687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:29.000746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:29.007777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:29.009805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:29.248787 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-739a2b69-7920-4702-a53d-af468a77005d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627836 Aug 27 03:03:29.251033 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2460/5081] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:03:28 2022] POST /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:03:29.311192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:29.332258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:29.337758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:29.346571 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4b7b74d2-713b-4767-9e5f-21a4fb428197 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.378282 Aug 27 03:03:29.347169 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2622/5082] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:28 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:30.374165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:30.374874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:30.422004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:30.427645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:30.428288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:30.453762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:30.455196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:30.460341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:31.431642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:31.449414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:31.451413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:31.452919 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-209e656d-658a-4243-b664-c6bb23254d09 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 1.083132 Aug 27 03:03:31.466692 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2461/5083] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:30 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:32.483136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:32.484042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:32.501185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:32.504354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:32.505066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:32.505993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:32.509254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:32.509930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:32.748241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:32.786153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:32.788922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:32.790970 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-84756c18-89b0-4da8-b7b3-7447819df314 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.315659 Aug 27 03:03:32.794016 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2623/5084] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:32 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:33.820962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:33.822151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:33.839921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:33.840293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:33.840752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:33.841597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:33.841992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:33.842434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:34.044534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:34.058009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:34.059626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:34.060706 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3e690584-7002-4055-8124-dcbf3e0db59d tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.245970 Aug 27 03:03:34.079431 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2462/5085] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:33 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:03:35.089963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:35.090725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:35.114368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:35.117800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:35.122409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:35.124783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:35.128075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:35.133238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:35.493817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:35.516574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:35.538087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:35.539435 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-044d151e-36e5-4fcf-a39b-0496b57d8b24 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.454408 Aug 27 03:03:35.550270 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2624/5086] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:35 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:36.565707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:36.566911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:36.580381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:36.580887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:36.581332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:36.582654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:36.583757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:36.584326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:36.709982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:36.727302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:36.729844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:36.734777 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e9b49d55-d55b-438b-ac41-3f541fa22274 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.174936 Aug 27 03:03:36.753925 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2463/5087] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:36 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:37.760623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:37.761238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:37.779658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:37.780477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:37.781113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:37.782068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:37.782734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:37.783332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:38.023506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:38.043498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:38.063407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:38.064693 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3796fa3f-dd84-4a3b-a764-62660cec4838 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1604 microversion: 2.42 time: 0.308066 Aug 27 03:03:38.077795 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2625/5088] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:37 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1604 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:39.117222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:39.117971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:39.148413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=24 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:39.155314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:39.159295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:39.161940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:39.164226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:39.168144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:39.171072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:39.198348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:39.368593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:39.369653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:39.377072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:39.377787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lazy-loading 'fault' on Instance uuid 5fcd0614-cd02-4b79-b75e-59a9be34d77a {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:03:39.527290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:39.561471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:39.570407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c5eafff09dd462d89bbab3403bbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65a5ba69d8d45399945c01090626fef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:03:39.578467 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c17d6ba2-e549-4e58-9752-26b0f8ed75ab tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 200 len: 1609 microversion: 2.42 time: 0.468918 Aug 27 03:03:39.579075 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2464/5089] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:39 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 1609 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:03:40.610966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:40.611691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:40.630364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=22 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:40.637038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:40.637476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:40.638009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:40.646423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:40.646970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:40.647434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:40.708185 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] HTTP exception thrown: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Request method failure captured: Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a HTTP/1.1 Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYeMnWRj-dKw5c-Wzb1Y4MHcXTXOQAtvcEVkuKrDy9VEDqbKEM4hD9Yfukl3ZRM9jFxWL1uXAaK1rgTcUSzn49oUj8HhEwCpcS5SWdL4Ucv0iCy3sfP7Uc75M4kdVTLUaDfr9jUkSTxXhViKltoM6HrvDWB5qGfKNdDp2rCAqR8ITVI Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: f65a5ba69d8d45399945c01090626fef Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2027250937 Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f65a5ba69d8d45399945c01090626fef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f65a5ba69d8d45399945c01090626fef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f65a5ba69d8d45399945c01090626fef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f65a5ba69d8d45399945c01090626fef"}]}] Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2027250937 Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: f65a5ba69d8d45399945c01090626fef Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2027250937 Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TaggedBootDevicesTest_v242-2027250937-project Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9c5eafff09dd462d89bbab3403bbc878 Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2027250937-project Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '5fcd0614-cd02-4b79-b75e-59a9be34d77a'} Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:40.713189 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:40.717761 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:40.717761 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:40.717761 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:40.717761 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:40.717761 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:03:40.717761 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:03:40.717761 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:40.717761 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:40.717761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Returning 404 to user: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:03:40.718534 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3c8daf58-f582-417b-b7e3-30e457682dae tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 404 len: 111 microversion: 2.42 time: 0.111029 Aug 27 03:03:40.723588 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2626/5090] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:40 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:03:40.733096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-18df4835-3df4-4b63-99e3-7ac271cf66a6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '.version_select at 0x7f4d29565b80>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:40.750568 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:03:40.750959 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:03:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1394915717 (ip 10.222.0.99) !!! Aug 27 03:03:40.796450 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-18df4835-3df4-4b63-99e3-7ac271cf66a6 tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394915717" status: 204 len: 0 microversion: 2.42 time: 0.067964 Aug 27 03:03:40.799022 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2465/5091] 10.222.0.99 () {60 vars in 1262 bytes} [Sat Aug 27 03:03:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394915717 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 03:03:52.694307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:52.695411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:52.707143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=49 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:52.708152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:52.714828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:52.717112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:52.717827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:52.718663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:52.720445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:52.725313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:52.762170 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] HTTP exception thrown: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Request method failure captured: Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a HTTP/1.1 Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYeMnWRj-dKw5c-Wzb1Y4MHcXTXOQAtvcEVkuKrDy9VEDqbKEM4hD9Yfukl3ZRM9jFxWL1uXAaK1rgTcUSzn49oUj8HhEwCpcS5SWdL4Ucv0iCy3sfP7Uc75M4kdVTLUaDfr9jUkSTxXhViKltoM6HrvDWB5qGfKNdDp2rCAqR8ITVI Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: f65a5ba69d8d45399945c01090626fef Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2027250937 Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f65a5ba69d8d45399945c01090626fef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f65a5ba69d8d45399945c01090626fef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f65a5ba69d8d45399945c01090626fef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f65a5ba69d8d45399945c01090626fef"}]}] Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2027250937 Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: f65a5ba69d8d45399945c01090626fef Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2027250937 Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TaggedBootDevicesTest_v242-2027250937-project Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9c5eafff09dd462d89bbab3403bbc878 Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2027250937-project Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '5fcd0614-cd02-4b79-b75e-59a9be34d77a'} Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:03:52.763905 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:03:52.770673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:52.770673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:52.770673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:52.770673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:52.770673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:52.770673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:52.770673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:52.770673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:03:52.770673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:03:52.770673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:52.770673 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:52.772346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Returning 404 to user: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:03:52.774821 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-317a5e32-3f70-4b6b-90ba-cee8ec91e84b tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 404 len: 111 microversion: 2.42 time: 0.085601 Aug 27 03:03:52.778384 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2627/5092] 10.222.0.99 () {60 vars in 1280 bytes} [Sat Aug 27 03:03:52 2022] DELETE /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:03:52.787769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:52.788603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] [instance: 5fcd0614-cd02-4b79-b75e-59a9be34d77a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:52.794322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=7 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:52.798777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:03:52.824600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:52.825151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:52.826769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:52.827736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:52.829881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:52.832436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:52.869931 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] HTTP exception thrown: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Request method failure captured: Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a HTTP/1.1 Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYeMnWRj-dKw5c-Wzb1Y4MHcXTXOQAtvcEVkuKrDy9VEDqbKEM4hD9Yfukl3ZRM9jFxWL1uXAaK1rgTcUSzn49oUj8HhEwCpcS5SWdL4Ucv0iCy3sfP7Uc75M4kdVTLUaDfr9jUkSTxXhViKltoM6HrvDWB5qGfKNdDp2rCAqR8ITVI Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Openstack-Nova-Api-Version: 2.42 Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: f65a5ba69d8d45399945c01090626fef Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2027250937 Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f65a5ba69d8d45399945c01090626fef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f65a5ba69d8d45399945c01090626fef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f65a5ba69d8d45399945c01090626fef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f65a5ba69d8d45399945c01090626fef"}]}] Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2027250937 Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: f65a5ba69d8d45399945c01090626fef Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2027250937 Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TaggedBootDevicesTest_v242-2027250937-project Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 9c5eafff09dd462d89bbab3403bbc878 Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2027250937-project Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5fcd0614-cd02-4b79-b75e-59a9be34d77a'} Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:03:52.875924 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:52.880764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:03:52.880764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:52.880764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:52.880764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:52.880764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:03:52.880764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:03:52.880764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. Aug 27 03:03:52.880764 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:03:52.880764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] Returning 404 to user: Instance 5fcd0614-cd02-4b79-b75e-59a9be34d77a could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:03:52.880764 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c0f80e33-a7a8-42ee-891f-ee926b0d021f tempest-TaggedBootDevicesTest_v242-2027250937 tempest-TaggedBootDevicesTest_v242-2027250937-project] 10.222.0.99 "GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a" status: 404 len: 111 microversion: 2.42 time: 0.095064 Aug 27 03:03:52.886261 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2466/5093] 10.222.0.99 () {60 vars in 1277 bytes} [Sat Aug 27 03:03:52 2022] GET /compute/v2.1/servers/5fcd0614-cd02-4b79-b75e-59a9be34d77a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:03:59.071245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fd5483a-45b0-41af-9b30-e82d0299edf0"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:03:59.073184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:59.098192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:59.098682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:59.099154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:59.099914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:59.100382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:59.100810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:59.372752 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Invalid volume: volume 0fd5483a-45b0-41af-9b30-e82d0299edf0 is already attached to instances: b089d092-f6e1-4573-a5f2-ce55e2cf9b31 Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments HTTP/1.1 Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 74 Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: {"volumeAttachment": {"volumeId": "0fd5483a-45b0-41af-9b30-e82d0299edf0"}} Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid volume: volume 0fd5483a-45b0-41af-9b30-e82d0299edf0 is already attached to instances: b089d092-f6e1-4573-a5f2-ce55e2cf9b31 Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'server_id': 'b089d092-f6e1-4573-a5f2-ce55e2cf9b31', 'body': {'volumeAttachment': {'volumeId': '0fd5483a-45b0-41af-9b30-e82d0299edf0'}}} Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0fd5483a-45b0-41af-9b30-e82d0299edf0 is already attached to instances: b089d092-f6e1-4573-a5f2-ce55e2cf9b31 Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:03:59.390422 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0fd5483a-45b0-41af-9b30-e82d0299edf0 is already attached to instances: b089d092-f6e1-4573-a5f2-ce55e2cf9b31 Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0fd5483a-45b0-41af-9b30-e82d0299edf0 is already attached to instances: b089d092-f6e1-4573-a5f2-ce55e2cf9b31 Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 400 to user: Invalid volume: volume 0fd5483a-45b0-41af-9b30-e82d0299edf0 is already attached to instances: b089d092-f6e1-4573-a5f2-ce55e2cf9b31 {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-307ab1e4-ce49-4716-8066-34a8f28bec42 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.322449 Aug 27 03:03:59.398171 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2628/5094] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:03:59 2022] POST /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 174 bytes in 324 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:03:59.533344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0e9d2e74-b078-4a1b-8d48-9d8063563fdc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:59.534350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0e9d2e74-b078-4a1b-8d48-9d8063563fdc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:59.543341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e9d2e74-b078-4a1b-8d48-9d8063563fdc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:59.544265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e9d2e74-b078-4a1b-8d48-9d8063563fdc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:59.545323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e9d2e74-b078-4a1b-8d48-9d8063563fdc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:59.546390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e9d2e74-b078-4a1b-8d48-9d8063563fdc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:59.547232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e9d2e74-b078-4a1b-8d48-9d8063563fdc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:59.547920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0e9d2e74-b078-4a1b-8d48-9d8063563fdc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:59.686004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-0e9d2e74-b078-4a1b-8d48-9d8063563fdc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lazy-loading 'services' on Instance uuid b089d092-f6e1-4573-a5f2-ce55e2cf9b31 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:03:59.855888 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0e9d2e74-b078-4a1b-8d48-9d8063563fdc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments/0fd5483a-45b0-41af-9b30-e82d0299edf0" status: 202 len: 0 microversion: 2.1 time: 0.329977 Aug 27 03:03:59.866444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fbd79e7c-2dc9-46a2-9509-3d9edf0c991d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:03:59.873575 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2467/5095] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:03:59 2022] DELETE /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments/0fd5483a-45b0-41af-9b30-e82d0299edf0 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:03:59.876080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fbd79e7c-2dc9-46a2-9509-3d9edf0c991d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:03:59.890102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd79e7c-2dc9-46a2-9509-3d9edf0c991d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:59.891512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd79e7c-2dc9-46a2-9509-3d9edf0c991d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:59.891966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd79e7c-2dc9-46a2-9509-3d9edf0c991d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:03:59.898315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd79e7c-2dc9-46a2-9509-3d9edf0c991d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:03:59.901023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd79e7c-2dc9-46a2-9509-3d9edf0c991d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:03:59.901523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd79e7c-2dc9-46a2-9509-3d9edf0c991d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:00.057754 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fbd79e7c-2dc9-46a2-9509-3d9edf0c991d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193158 Aug 27 03:04:00.062642 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2629/5096] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:03:59 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:04:01.077150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f4a50042-b923-46c2-8ae7-feeeb065400a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:01.080197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f4a50042-b923-46c2-8ae7-feeeb065400a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:01.121209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4a50042-b923-46c2-8ae7-feeeb065400a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:01.122036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4a50042-b923-46c2-8ae7-feeeb065400a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:01.122504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4a50042-b923-46c2-8ae7-feeeb065400a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:01.123261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4a50042-b923-46c2-8ae7-feeeb065400a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:01.123735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4a50042-b923-46c2-8ae7-feeeb065400a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:01.124174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4a50042-b923-46c2-8ae7-feeeb065400a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:01.251227 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f4a50042-b923-46c2-8ae7-feeeb065400a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180959 Aug 27 03:04:01.260142 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2468/5097] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:01 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:02.265733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61bfb7a5-9b40-4d22-955d-5e50e41c725e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:02.268022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-61bfb7a5-9b40-4d22-955d-5e50e41c725e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:02.289978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bfb7a5-9b40-4d22-955d-5e50e41c725e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:02.290479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bfb7a5-9b40-4d22-955d-5e50e41c725e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:02.290990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bfb7a5-9b40-4d22-955d-5e50e41c725e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:02.291721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bfb7a5-9b40-4d22-955d-5e50e41c725e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:02.292187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bfb7a5-9b40-4d22-955d-5e50e41c725e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:02.301134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61bfb7a5-9b40-4d22-955d-5e50e41c725e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:02.415160 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61bfb7a5-9b40-4d22-955d-5e50e41c725e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154452 Aug 27 03:04:02.422375 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2630/5098] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:02 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:03.433304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ed71b9f2-75a6-4adb-a59e-e48b3e0b472e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:03.435831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ed71b9f2-75a6-4adb-a59e-e48b3e0b472e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:03.474364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed71b9f2-75a6-4adb-a59e-e48b3e0b472e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:03.474868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed71b9f2-75a6-4adb-a59e-e48b3e0b472e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:03.482710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed71b9f2-75a6-4adb-a59e-e48b3e0b472e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:03.488094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed71b9f2-75a6-4adb-a59e-e48b3e0b472e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:03.488682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed71b9f2-75a6-4adb-a59e-e48b3e0b472e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:03.495834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed71b9f2-75a6-4adb-a59e-e48b3e0b472e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:03.608363 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ed71b9f2-75a6-4adb-a59e-e48b3e0b472e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173003 Aug 27 03:04:03.610625 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2469/5099] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:03 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:04.622364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c0121e28-749e-4448-9670-da2b224a9e87 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:04.624891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c0121e28-749e-4448-9670-da2b224a9e87 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:04.638761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0121e28-749e-4448-9670-da2b224a9e87 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:04.645974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0121e28-749e-4448-9670-da2b224a9e87 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:04.646527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0121e28-749e-4448-9670-da2b224a9e87 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:04.647310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0121e28-749e-4448-9670-da2b224a9e87 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:04.647797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0121e28-749e-4448-9670-da2b224a9e87 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:04.648235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c0121e28-749e-4448-9670-da2b224a9e87 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:04.747344 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c0121e28-749e-4448-9670-da2b224a9e87 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128956 Aug 27 03:04:04.747957 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2631/5100] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:04 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:05.759967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df95b98b-696c-498a-b555-1dce749f012c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:05.762459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-df95b98b-696c-498a-b555-1dce749f012c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:05.778522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df95b98b-696c-498a-b555-1dce749f012c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:05.779556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df95b98b-696c-498a-b555-1dce749f012c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:05.781540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df95b98b-696c-498a-b555-1dce749f012c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:05.782728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df95b98b-696c-498a-b555-1dce749f012c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:05.784905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df95b98b-696c-498a-b555-1dce749f012c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:05.785890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df95b98b-696c-498a-b555-1dce749f012c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:05.871075 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-df95b98b-696c-498a-b555-1dce749f012c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114906 Aug 27 03:04:05.871968 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2470/5101] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:05 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:06.885507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5de315ae-f605-47da-9649-e0ffd17df9a8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:06.893623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5de315ae-f605-47da-9649-e0ffd17df9a8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:06.918048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de315ae-f605-47da-9649-e0ffd17df9a8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:06.919142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de315ae-f605-47da-9649-e0ffd17df9a8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:06.920639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de315ae-f605-47da-9649-e0ffd17df9a8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:06.922405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de315ae-f605-47da-9649-e0ffd17df9a8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:06.928428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de315ae-f605-47da-9649-e0ffd17df9a8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:06.930813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de315ae-f605-47da-9649-e0ffd17df9a8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:07.032507 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5de315ae-f605-47da-9649-e0ffd17df9a8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150340 Aug 27 03:04:07.038560 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2632/5102] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:06 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:08.046675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fa2122ed-5f2a-4709-a776-d34188532a72 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:08.048890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fa2122ed-5f2a-4709-a776-d34188532a72 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:08.068311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa2122ed-5f2a-4709-a776-d34188532a72 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:08.068825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa2122ed-5f2a-4709-a776-d34188532a72 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:08.069259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa2122ed-5f2a-4709-a776-d34188532a72 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:08.070021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa2122ed-5f2a-4709-a776-d34188532a72 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:08.070486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa2122ed-5f2a-4709-a776-d34188532a72 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:08.070927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fa2122ed-5f2a-4709-a776-d34188532a72 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:08.118157 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fa2122ed-5f2a-4709-a776-d34188532a72 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075740 Aug 27 03:04:08.124246 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2471/5103] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:08 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:09.135627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3fb13228-a01f-4ec3-952e-f3aba5361b95 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:09.139366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3fb13228-a01f-4ec3-952e-f3aba5361b95 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:09.168691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fb13228-a01f-4ec3-952e-f3aba5361b95 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:09.189092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fb13228-a01f-4ec3-952e-f3aba5361b95 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:09.193125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fb13228-a01f-4ec3-952e-f3aba5361b95 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:09.195573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fb13228-a01f-4ec3-952e-f3aba5361b95 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:09.198034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fb13228-a01f-4ec3-952e-f3aba5361b95 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:09.198817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fb13228-a01f-4ec3-952e-f3aba5361b95 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:09.388656 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3fb13228-a01f-4ec3-952e-f3aba5361b95 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.259457 Aug 27 03:04:09.395970 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2633/5104] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:09 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 197 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:10.411506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bae0b0ab-7dea-4a97-a70c-6c2b4709f474 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:10.414035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bae0b0ab-7dea-4a97-a70c-6c2b4709f474 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:10.428031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bae0b0ab-7dea-4a97-a70c-6c2b4709f474 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:10.428628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bae0b0ab-7dea-4a97-a70c-6c2b4709f474 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:10.429266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bae0b0ab-7dea-4a97-a70c-6c2b4709f474 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:10.430417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bae0b0ab-7dea-4a97-a70c-6c2b4709f474 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:10.431050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bae0b0ab-7dea-4a97-a70c-6c2b4709f474 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:10.431654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bae0b0ab-7dea-4a97-a70c-6c2b4709f474 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:10.519399 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bae0b0ab-7dea-4a97-a70c-6c2b4709f474 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113429 Aug 27 03:04:10.520221 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2472/5105] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:10 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:11.536475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5b1fa84f-7293-4808-8a37-fbc9a32cec90 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:11.538853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5b1fa84f-7293-4808-8a37-fbc9a32cec90 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:11.569386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b1fa84f-7293-4808-8a37-fbc9a32cec90 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:11.570944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b1fa84f-7293-4808-8a37-fbc9a32cec90 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:11.574380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b1fa84f-7293-4808-8a37-fbc9a32cec90 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:11.576963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b1fa84f-7293-4808-8a37-fbc9a32cec90 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:11.595372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b1fa84f-7293-4808-8a37-fbc9a32cec90 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:11.596777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b1fa84f-7293-4808-8a37-fbc9a32cec90 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:11.771412 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5b1fa84f-7293-4808-8a37-fbc9a32cec90 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.243190 Aug 27 03:04:11.781971 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2634/5106] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:04:11 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31/os-volume_attachments => generated 25 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:04:11.899225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f5d78a50-e064-4f23-988f-49f7a9c9abbb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:11.899872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f5d78a50-e064-4f23-988f-49f7a9c9abbb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:11.908786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5d78a50-e064-4f23-988f-49f7a9c9abbb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:11.909294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5d78a50-e064-4f23-988f-49f7a9c9abbb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:11.909778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5d78a50-e064-4f23-988f-49f7a9c9abbb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:11.910523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5d78a50-e064-4f23-988f-49f7a9c9abbb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:11.910985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5d78a50-e064-4f23-988f-49f7a9c9abbb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:11.911425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5d78a50-e064-4f23-988f-49f7a9c9abbb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:11.941620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f5d78a50-e064-4f23-988f-49f7a9c9abbb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:04:12.210815 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f5d78a50-e064-4f23-988f-49f7a9c9abbb tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 204 len: 0 microversion: 2.1 time: 0.315588 Aug 27 03:04:12.215621 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2473/5107] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:04:11 2022] DELETE /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:04:12.224841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-56dc755d-81c3-46c1-b32b-531f781326c7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:12.225477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-56dc755d-81c3-46c1-b32b-531f781326c7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:12.238533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dc755d-81c3-46c1-b32b-531f781326c7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:12.239035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dc755d-81c3-46c1-b32b-531f781326c7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:12.239488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dc755d-81c3-46c1-b32b-531f781326c7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:12.240221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dc755d-81c3-46c1-b32b-531f781326c7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:12.240681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dc755d-81c3-46c1-b32b-531f781326c7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:12.241122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-56dc755d-81c3-46c1-b32b-531f781326c7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:12.964198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-56dc755d-81c3-46c1-b32b-531f781326c7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:12.983662 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-56dc755d-81c3-46c1-b32b-531f781326c7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1683 microversion: 2.1 time: 0.763498 Aug 27 03:04:12.988917 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2635/5108] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:12 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1683 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:14.009967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7b2cfbca-6e0e-41ce-8906-31eb805212df tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:14.010828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7b2cfbca-6e0e-41ce-8906-31eb805212df tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:14.027184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b2cfbca-6e0e-41ce-8906-31eb805212df tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:14.031674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b2cfbca-6e0e-41ce-8906-31eb805212df tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:14.032199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b2cfbca-6e0e-41ce-8906-31eb805212df tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:14.032959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b2cfbca-6e0e-41ce-8906-31eb805212df tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:14.034054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b2cfbca-6e0e-41ce-8906-31eb805212df tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:14.038248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b2cfbca-6e0e-41ce-8906-31eb805212df tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:14.497329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7b2cfbca-6e0e-41ce-8906-31eb805212df tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:14.506793 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7b2cfbca-6e0e-41ce-8906-31eb805212df tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1683 microversion: 2.1 time: 0.502050 Aug 27 03:04:14.509767 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2474/5109] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:14 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1683 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:15.528848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3b945f1d-3432-496e-844f-6cc8423a4b24 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:15.530023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3b945f1d-3432-496e-844f-6cc8423a4b24 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:15.547767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b945f1d-3432-496e-844f-6cc8423a4b24 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:15.548259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b945f1d-3432-496e-844f-6cc8423a4b24 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:15.565900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b945f1d-3432-496e-844f-6cc8423a4b24 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:15.566939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b945f1d-3432-496e-844f-6cc8423a4b24 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:15.568828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b945f1d-3432-496e-844f-6cc8423a4b24 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:15.571177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b945f1d-3432-496e-844f-6cc8423a4b24 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:15.831894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3b945f1d-3432-496e-844f-6cc8423a4b24 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:15.847460 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3b945f1d-3432-496e-844f-6cc8423a4b24 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1615 microversion: 2.1 time: 0.318265 Aug 27 03:04:15.851524 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2636/5110] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:15 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1615 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:16.874872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:16.875531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:16.891179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:16.891684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:16.892140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:16.893376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:16.904965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:16.905541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:17.017423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:17.018524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:17.018976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:17.019445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lazy-loading 'fault' on Instance uuid b089d092-f6e1-4573-a5f2-ce55e2cf9b31 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:04:17.045146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-fb431f8b-8ec3-4f53-afee-c7762acc1766 req-9a6be9d1-501a-42ce-8221-ec694b41106f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b089d092-f6e1-4573-a5f2-ce55e2cf9b31", "name": "network-vif-deleted", "tag": "6a7bcd2c-01a6-45b2-a618-3507c4c7dc42"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:17.080745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fb431f8b-8ec3-4f53-afee-c7762acc1766 req-9a6be9d1-501a-42ce-8221-ec694b41106f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:17.081259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fb431f8b-8ec3-4f53-afee-c7762acc1766 req-9a6be9d1-501a-42ce-8221-ec694b41106f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:17.085989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fb431f8b-8ec3-4f53-afee-c7762acc1766 req-9a6be9d1-501a-42ce-8221-ec694b41106f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:17.131494 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-fb431f8b-8ec3-4f53-afee-c7762acc1766 req-9a6be9d1-501a-42ce-8221-ec694b41106f service nova] Creating event network-vif-deleted:6a7bcd2c-01a6-45b2-a618-3507c4c7dc42 for instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 on n-h2-852084-5 Aug 27 03:04:17.145547 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-fb431f8b-8ec3-4f53-afee-c7762acc1766 req-9a6be9d1-501a-42ce-8221-ec694b41106f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.673218 Aug 27 03:04:17.155260 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2475/5111] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:17.306101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:17.319987 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-368e89af-e6fd-4558-a648-875096b9bfaa tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 200 len: 1332 microversion: 2.1 time: 0.446777 Aug 27 03:04:17.322032 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2637/5112] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:16 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 1332 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:04:18.344146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:18.345271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:18.367233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:18.367743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:18.368181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:18.374863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:18.377128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:18.377845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:18.484805 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 HTTP/1.1 Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'b089d092-f6e1-4573-a5f2-ce55e2cf9b31'} Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:04:18.493707 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:04:18.497863 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:04:18.497863 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:04:18.497863 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:04:18.497863 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:04:18.497863 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:04:18.497863 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:04:18.497863 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:04:18.500784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:04:18.511296 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-276f93f9-7750-46b1-a0cf-57dcedf1a007 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 404 len: 111 microversion: 2.1 time: 0.172285 Aug 27 03:04:18.513753 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2476/5113] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:18 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:04:18.523486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-829b77fd-8903-4551-9998-94cc4ca84e93 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '.version_select at 0x7f4d2949c8b0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:18.601186 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-829b77fd-8903-4551-9998-94cc4ca84e93 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141209407" status: 202 len: 0 microversion: 2.1 time: 0.081851 Aug 27 03:04:18.609029 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2638/5114] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 03:04:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141209407 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:04:21.326199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a6674aa9-eefb-47d1-9f4f-c863a6183c60 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: .version_select at 0x7f4d29a35670>, body: {"keypair": {"name": "tempest-keypair-357164596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2HYRS+rgvFHyZ+m65lpmHuKD34fZhpq9lTvnPEz7ofF/VkUd+Ml85cwVqt2ymKymVIstWIf0BD1AFoOGC75QK91BgkYBbmvEQ3kUQnEiJlyALoa2a8NIrvza9BYU683w=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:21.426150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a6674aa9-eefb-47d1-9f4f-c863a6183c60 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:04:21.466376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a6674aa9-eefb-47d1-9f4f-c863a6183c60 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for user 59f857fc243b43379c9255e7b9ea1c3f and project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:04:21.624059 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a6674aa9-eefb-47d1-9f4f-c863a6183c60 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.301099 Aug 27 03:04:21.627728 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2477/5115] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:04:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:26.299814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1823780076", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "544183e0-192f-4c44-976f-41fb786d65a5"}], "security_groups": [{"name": "tempest-securitygroup--1172565441"}], "key_name": "tempest-keypair-357164596", "user_data": "}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:26.329055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:26.587173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] validate_networks() for [('544183e0-192f-4c44-976f-41fb786d65a5', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:04:27.313470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=64 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:29.158212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:04:29.159042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:04:29.159728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:04:29.160611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:04:29.161286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:04:29.193553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:29.194331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:29.195001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:29.196125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:29.196840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:29.197491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:29.226737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:04:29.234401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Getting quotas for user 59f857fc243b43379c9255e7b9ea1c3f and project 86535f98bba34254aca1089f8a2ea8fb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:04:29.269274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:04:29.271674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:04:29.379993 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-482a16b1-2799-4f42-bc08-dcb7042f325a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.088240 Aug 27 03:04:29.386472 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2639/5116] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:04:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 3094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:04:29.398159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1354435-c83a-42c7-afd6-a82f600a23e7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:29.398835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d1354435-c83a-42c7-afd6-a82f600a23e7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:29.412855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:29.414597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:29.570900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1354435-c83a-42c7-afd6-a82f600a23e7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:29.595003 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1354435-c83a-42c7-afd6-a82f600a23e7 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1241 microversion: 2.1 time: 0.190555 Aug 27 03:04:29.603024 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2478/5117] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:29 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1241 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:30.623905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bf1a1832-a2e5-4280-b6ec-8f95ba0d2e16 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:30.624541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bf1a1832-a2e5-4280-b6ec-8f95ba0d2e16 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:30.935340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bf1a1832-a2e5-4280-b6ec-8f95ba0d2e16 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:30.943369 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bf1a1832-a2e5-4280-b6ec-8f95ba0d2e16 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1241 microversion: 2.1 time: 0.323565 Aug 27 03:04:30.943961 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2640/5118] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:30 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1241 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:31.966985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e14c5195-878a-4ca3-9e33-37272e8b2f31 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:31.967676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e14c5195-878a-4ca3-9e33-37272e8b2f31 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:31.990799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e14c5195-878a-4ca3-9e33-37272e8b2f31 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:31.991483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e14c5195-878a-4ca3-9e33-37272e8b2f31 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:31.992023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e14c5195-878a-4ca3-9e33-37272e8b2f31 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:31.992823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e14c5195-878a-4ca3-9e33-37272e8b2f31 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:31.993359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e14c5195-878a-4ca3-9e33-37272e8b2f31 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:31.993883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e14c5195-878a-4ca3-9e33-37272e8b2f31 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:32.182029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e14c5195-878a-4ca3-9e33-37272e8b2f31 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:32.197696 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e14c5195-878a-4ca3-9e33-37272e8b2f31 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1293 microversion: 2.1 time: 0.234658 Aug 27 03:04:32.199475 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2479/5119] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:31 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1293 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:33.226508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-92cbd8be-846a-4993-af7a-fe2497f4b82e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:33.227289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-92cbd8be-846a-4993-af7a-fe2497f4b82e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:33.248808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cbd8be-846a-4993-af7a-fe2497f4b82e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:33.250338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cbd8be-846a-4993-af7a-fe2497f4b82e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:33.251066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cbd8be-846a-4993-af7a-fe2497f4b82e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:33.252929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cbd8be-846a-4993-af7a-fe2497f4b82e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:33.254053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cbd8be-846a-4993-af7a-fe2497f4b82e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:33.254707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cbd8be-846a-4993-af7a-fe2497f4b82e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:33.449460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-92cbd8be-846a-4993-af7a-fe2497f4b82e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:33.472247 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-92cbd8be-846a-4993-af7a-fe2497f4b82e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1299 microversion: 2.1 time: 0.246532 Aug 27 03:04:33.474506 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2641/5120] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:33 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1299 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:34.498967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-27f19bd9-d9c3-41a6-8a45-768fedf791e8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:34.501422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-27f19bd9-d9c3-41a6-8a45-768fedf791e8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:34.520246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f19bd9-d9c3-41a6-8a45-768fedf791e8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:34.534547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f19bd9-d9c3-41a6-8a45-768fedf791e8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:34.535380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f19bd9-d9c3-41a6-8a45-768fedf791e8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:34.536406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f19bd9-d9c3-41a6-8a45-768fedf791e8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:34.537117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f19bd9-d9c3-41a6-8a45-768fedf791e8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:34.537845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27f19bd9-d9c3-41a6-8a45-768fedf791e8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:34.831533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-27f19bd9-d9c3-41a6-8a45-768fedf791e8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:34.842068 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-27f19bd9-d9c3-41a6-8a45-768fedf791e8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1299 microversion: 2.1 time: 0.349354 Aug 27 03:04:34.848824 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2480/5121] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:34 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1299 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:35.870618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-00b99eb0-9258-4e74-9011-83122ca12a7d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:35.871257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-00b99eb0-9258-4e74-9011-83122ca12a7d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:35.903471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00b99eb0-9258-4e74-9011-83122ca12a7d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:35.908005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00b99eb0-9258-4e74-9011-83122ca12a7d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:35.909027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00b99eb0-9258-4e74-9011-83122ca12a7d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:35.931448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00b99eb0-9258-4e74-9011-83122ca12a7d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:35.932203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00b99eb0-9258-4e74-9011-83122ca12a7d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:35.933715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00b99eb0-9258-4e74-9011-83122ca12a7d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:37.391079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-00b99eb0-9258-4e74-9011-83122ca12a7d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:37.416122 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-00b99eb0-9258-4e74-9011-83122ca12a7d tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1367 microversion: 2.1 time: 1.550058 Aug 27 03:04:37.417048 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2642/5122] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:35 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1367 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:38.437003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65bd649c-230a-4575-8af7-c97c8de432ac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:38.439401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65bd649c-230a-4575-8af7-c97c8de432ac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:38.455762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65bd649c-230a-4575-8af7-c97c8de432ac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:38.457794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65bd649c-230a-4575-8af7-c97c8de432ac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:38.461970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65bd649c-230a-4575-8af7-c97c8de432ac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:38.466613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65bd649c-230a-4575-8af7-c97c8de432ac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:38.467340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65bd649c-230a-4575-8af7-c97c8de432ac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:38.470161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65bd649c-230a-4575-8af7-c97c8de432ac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:39.082759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-65bd649c-230a-4575-8af7-c97c8de432ac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:39.134827 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65bd649c-230a-4575-8af7-c97c8de432ac tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1367 microversion: 2.1 time: 0.701483 Aug 27 03:04:39.162360 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2481/5123] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:38 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1367 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:39.769848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:40.165627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e6d69394-3465-425f-9238-733b23bd52f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:40.167056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e6d69394-3465-425f-9238-733b23bd52f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:40.186359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:40.195203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6d69394-3465-425f-9238-733b23bd52f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:40.198169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6d69394-3465-425f-9238-733b23bd52f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:40.203165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6d69394-3465-425f-9238-733b23bd52f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:40.204486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6d69394-3465-425f-9238-733b23bd52f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:40.205319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6d69394-3465-425f-9238-733b23bd52f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:40.206185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6d69394-3465-425f-9238-733b23bd52f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:40.344293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e424b961-a681-4102-8079-4639da6452ad req-130ff8a7-dbec-4af8-8107-309ce4fd25af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3532336-1c3d-4c13-9a8c-7009050f3677", "tag": "9229f16e-2d12-4c5a-83de-3ae112a3f782"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:40.369514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e424b961-a681-4102-8079-4639da6452ad req-130ff8a7-dbec-4af8-8107-309ce4fd25af service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:40.370907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e424b961-a681-4102-8079-4639da6452ad req-130ff8a7-dbec-4af8-8107-309ce4fd25af service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:40.371523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e424b961-a681-4102-8079-4639da6452ad req-130ff8a7-dbec-4af8-8107-309ce4fd25af service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:40.411721 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e424b961-a681-4102-8079-4639da6452ad req-130ff8a7-dbec-4af8-8107-309ce4fd25af service nova] Creating event network-changed:9229f16e-2d12-4c5a-83de-3ae112a3f782 for instance f3532336-1c3d-4c13-9a8c-7009050f3677 on n-h1-852084-5 Aug 27 03:04:40.427557 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e424b961-a681-4102-8079-4639da6452ad req-130ff8a7-dbec-4af8-8107-309ce4fd25af service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.659262 Aug 27 03:04:40.429991 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2643/5124] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:41.334299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e6d69394-3465-425f-9238-733b23bd52f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:41.354151 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e6d69394-3465-425f-9238-733b23bd52f9 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1367 microversion: 2.1 time: 1.193053 Aug 27 03:04:41.367527 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2482/5125] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:40 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1367 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:42.381918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ea92971-8e09-408e-a89f-ff1fb67eb784 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:42.383281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ea92971-8e09-408e-a89f-ff1fb67eb784 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:42.387667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:04:42.402976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea92971-8e09-408e-a89f-ff1fb67eb784 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:42.403850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea92971-8e09-408e-a89f-ff1fb67eb784 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:42.404561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea92971-8e09-408e-a89f-ff1fb67eb784 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:42.411870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea92971-8e09-408e-a89f-ff1fb67eb784 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:42.414931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea92971-8e09-408e-a89f-ff1fb67eb784 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:42.415698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ea92971-8e09-408e-a89f-ff1fb67eb784 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:43.374169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ea92971-8e09-408e-a89f-ff1fb67eb784 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:43.385424 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ea92971-8e09-408e-a89f-ff1fb67eb784 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1367 microversion: 2.1 time: 1.008046 Aug 27 03:04:43.390948 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2644/5126] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:42 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1367 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:44.411592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2add4f6-21d2-4aa3-993a-23fe5cace85a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:44.412500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e2add4f6-21d2-4aa3-993a-23fe5cace85a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:44.447326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2add4f6-21d2-4aa3-993a-23fe5cace85a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.464592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2add4f6-21d2-4aa3-993a-23fe5cace85a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.465546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2add4f6-21d2-4aa3-993a-23fe5cace85a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:44.471599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2add4f6-21d2-4aa3-993a-23fe5cace85a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:44.484287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2add4f6-21d2-4aa3-993a-23fe5cace85a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:44.491458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2add4f6-21d2-4aa3-993a-23fe5cace85a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:44.912814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e2add4f6-21d2-4aa3-993a-23fe5cace85a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:44.921217 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e2add4f6-21d2-4aa3-993a-23fe5cace85a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1367 microversion: 2.1 time: 0.514092 Aug 27 03:04:44.923146 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2483/5127] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:44 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1367 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:45.951122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-81492fc1-84f9-401b-9f5e-7ee842e98e07 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:45.951758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-81492fc1-84f9-401b-9f5e-7ee842e98e07 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:45.964564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81492fc1-84f9-401b-9f5e-7ee842e98e07 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:45.965066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81492fc1-84f9-401b-9f5e-7ee842e98e07 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:45.965521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81492fc1-84f9-401b-9f5e-7ee842e98e07 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:45.974635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81492fc1-84f9-401b-9f5e-7ee842e98e07 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:45.975176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81492fc1-84f9-401b-9f5e-7ee842e98e07 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:45.975780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-81492fc1-84f9-401b-9f5e-7ee842e98e07 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:46.684856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-81492fc1-84f9-401b-9f5e-7ee842e98e07 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:46.710746 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-81492fc1-84f9-401b-9f5e-7ee842e98e07 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1367 microversion: 2.1 time: 0.762926 Aug 27 03:04:46.712327 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2645/5128] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:45 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1367 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:47.743256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74da19bc-66fa-4a7f-80e4-1286309f86c3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:47.744750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-74da19bc-66fa-4a7f-80e4-1286309f86c3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:47.797028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74da19bc-66fa-4a7f-80e4-1286309f86c3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:47.819982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74da19bc-66fa-4a7f-80e4-1286309f86c3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:47.820997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74da19bc-66fa-4a7f-80e4-1286309f86c3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:47.822315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74da19bc-66fa-4a7f-80e4-1286309f86c3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:47.839128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74da19bc-66fa-4a7f-80e4-1286309f86c3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:47.840440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74da19bc-66fa-4a7f-80e4-1286309f86c3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:48.679645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9494ca38-9c75-472d-93fa-bf2a3bae37b3 req-7fd15400-0a7c-4597-8e38-f896017c64cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3532336-1c3d-4c13-9a8c-7009050f3677", "name": "network-vif-plugged", "status": "completed", "tag": "9229f16e-2d12-4c5a-83de-3ae112a3f782"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:04:48.716721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9494ca38-9c75-472d-93fa-bf2a3bae37b3 req-7fd15400-0a7c-4597-8e38-f896017c64cc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:48.717554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9494ca38-9c75-472d-93fa-bf2a3bae37b3 req-7fd15400-0a7c-4597-8e38-f896017c64cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:48.718036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9494ca38-9c75-472d-93fa-bf2a3bae37b3 req-7fd15400-0a7c-4597-8e38-f896017c64cc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:48.768180 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9494ca38-9c75-472d-93fa-bf2a3bae37b3 req-7fd15400-0a7c-4597-8e38-f896017c64cc service nova] Creating event network-vif-plugged:9229f16e-2d12-4c5a-83de-3ae112a3f782 for instance f3532336-1c3d-4c13-9a8c-7009050f3677 on n-h1-852084-5 Aug 27 03:04:48.791435 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9494ca38-9c75-472d-93fa-bf2a3bae37b3 req-7fd15400-0a7c-4597-8e38-f896017c64cc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.625890 Aug 27 03:04:48.792136 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2646/5129] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:04:49.292708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-74da19bc-66fa-4a7f-80e4-1286309f86c3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:49.347377 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-74da19bc-66fa-4a7f-80e4-1286309f86c3 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1367 microversion: 2.1 time: 1.610860 Aug 27 03:04:49.348400 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2484/5130] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:47 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1367 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:50.403608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5344a444-41b9-4e1b-97ec-943c78690466 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:50.404582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5344a444-41b9-4e1b-97ec-943c78690466 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:50.451047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5344a444-41b9-4e1b-97ec-943c78690466 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:50.457749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5344a444-41b9-4e1b-97ec-943c78690466 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:50.460597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5344a444-41b9-4e1b-97ec-943c78690466 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:50.471625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5344a444-41b9-4e1b-97ec-943c78690466 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:50.473081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5344a444-41b9-4e1b-97ec-943c78690466 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:50.480436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5344a444-41b9-4e1b-97ec-943c78690466 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:53.429984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5344a444-41b9-4e1b-97ec-943c78690466 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:53.475221 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5344a444-41b9-4e1b-97ec-943c78690466 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1367 microversion: 2.1 time: 3.076206 Aug 27 03:04:53.488644 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2647/5131] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:50 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1367 bytes in 3087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:54.496449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-98ad55f0-7d6c-4c2c-a642-33f745948d2a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:54.497085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-98ad55f0-7d6c-4c2c-a642-33f745948d2a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:54.518209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98ad55f0-7d6c-4c2c-a642-33f745948d2a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:54.518845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98ad55f0-7d6c-4c2c-a642-33f745948d2a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:54.519311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98ad55f0-7d6c-4c2c-a642-33f745948d2a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:54.520085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98ad55f0-7d6c-4c2c-a642-33f745948d2a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:54.520561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98ad55f0-7d6c-4c2c-a642-33f745948d2a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:54.521011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98ad55f0-7d6c-4c2c-a642-33f745948d2a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:55.307455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-98ad55f0-7d6c-4c2c-a642-33f745948d2a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:04:55.318767 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-98ad55f0-7d6c-4c2c-a642-33f745948d2a tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1558 microversion: 2.1 time: 0.826212 Aug 27 03:04:55.327035 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2485/5132] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:04:54 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1558 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:04:55.353455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5a8dddf-5fae-492d-8bb4-903c186534f8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:04:55.354121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c5a8dddf-5fae-492d-8bb4-903c186534f8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:04:55.368899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a8dddf-5fae-492d-8bb4-903c186534f8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:55.369441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a8dddf-5fae-492d-8bb4-903c186534f8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:55.369928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a8dddf-5fae-492d-8bb4-903c186534f8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:55.370697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a8dddf-5fae-492d-8bb4-903c186534f8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:04:55.371171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a8dddf-5fae-492d-8bb4-903c186534f8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:04:55.371608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5a8dddf-5fae-492d-8bb4-903c186534f8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:04:55.966409 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c5a8dddf-5fae-492d-8bb4-903c186534f8 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.617376 Aug 27 03:04:55.967052 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2648/5133] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 03:04:55 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-interface => generated 285 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:01.489523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d75bacdb-2a72-42fb-a40b-204d0652134b req-f2ea89f3-8817-4ee4-b54b-dd82a1fb51fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3532336-1c3d-4c13-9a8c-7009050f3677", "tag": "9229f16e-2d12-4c5a-83de-3ae112a3f782"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:01.506974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=18 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:01.525005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d75bacdb-2a72-42fb-a40b-204d0652134b req-f2ea89f3-8817-4ee4-b54b-dd82a1fb51fa service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:01.528172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d75bacdb-2a72-42fb-a40b-204d0652134b req-f2ea89f3-8817-4ee4-b54b-dd82a1fb51fa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:01.530648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d75bacdb-2a72-42fb-a40b-204d0652134b req-f2ea89f3-8817-4ee4-b54b-dd82a1fb51fa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:01.577351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=43 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:01.590709 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d75bacdb-2a72-42fb-a40b-204d0652134b req-f2ea89f3-8817-4ee4-b54b-dd82a1fb51fa service nova] Creating event network-changed:9229f16e-2d12-4c5a-83de-3ae112a3f782 for instance f3532336-1c3d-4c13-9a8c-7009050f3677 on n-h1-852084-5 Aug 27 03:05:01.611449 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d75bacdb-2a72-42fb-a40b-204d0652134b req-f2ea89f3-8817-4ee4-b54b-dd82a1fb51fa service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126048 Aug 27 03:05:01.612317 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2486/5134] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:14.387273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:14.388039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=40 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:14.879855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7618de4b-9eb8-4e96-9a43-1ae422fccd35 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Action: 'create', calling method: .version_select at 0x7f4d2a100c10>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1753459456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk2FzUsvjAljuXVkiG501GsJ625Ive7AoZHGuJo4ro81h/OpgUphTJB73SBKB2Nr+zhi6Lk0bazyJSeKA8vFAhlUWw+1+Wd5iBx9TojSkmxS8dvmpwiYbAAmAw7lQMj4g=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:14.920241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-7618de4b-9eb8-4e96-9a43-1ae422fccd35 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Getting quotas for project 1058306b2ba647478569f414afc09a07. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:05:14.938785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-7618de4b-9eb8-4e96-9a43-1ae422fccd35 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Getting quotas for user 0f5b25a85fff4c9b8c18845fb7acf620 and project 1058306b2ba647478569f414afc09a07. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:05:14.999378 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7618de4b-9eb8-4e96-9a43-1ae422fccd35 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.614486 Aug 27 03:05:15.007830 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2649/5135] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:05:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:18.909288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-451361082", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1753459456", "security_groups": [{"name": "tempest-secgroup-smoke-1812050584"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "69225a3c-60e1-409a-8797-14a99326156d"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:18.959371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:19.514373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] validate_networks() for [('69225a3c-60e1-409a-8797-14a99326156d', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:05:21.731927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Getting quotas for project 1058306b2ba647478569f414afc09a07. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:05:21.744365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Getting quotas for user 0f5b25a85fff4c9b8c18845fb7acf620 and project 1058306b2ba647478569f414afc09a07. Resources: dict_keys(['metadata_items']) {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:05:21.791453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:05:21.791888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:05:21.792371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:05:21.800228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:05:21.800642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:05:21.828112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:21.828620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:21.829061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:21.829835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:21.830302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:21.830737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:21.908337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Getting quotas for project 1058306b2ba647478569f414afc09a07. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:05:21.924456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Getting quotas for user 0f5b25a85fff4c9b8c18845fb7acf620 and project 1058306b2ba647478569f414afc09a07. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:05:21.956211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:05:21.963274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:05:22.156435 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fbecdee3-52d8-490f-bb2c-15c5caf53ab0 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.247874 Aug 27 03:05:22.162844 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2487/5136] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 3259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:05:22.169521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-13d11b71-0f90-429b-bebb-f85b8ff0ab69 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:22.170187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-13d11b71-0f90-429b-bebb-f85b8ff0ab69 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:22.388237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-13d11b71-0f90-429b-bebb-f85b8ff0ab69 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:22.402121 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-13d11b71-0f90-429b-bebb-f85b8ff0ab69 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1302 microversion: 2.1 time: 0.236367 Aug 27 03:05:22.403047 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2488/5137] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:22 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1302 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:22.492713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-696242020", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "544b49db-f1cc-4bd0-95d2-c54446ab1aed"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:22.644424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] validate_networks() for [('544b49db-f1cc-4bd0-95d2-c54446ab1aed', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:05:23.425442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0c5c2a2f-e797-464c-b007-acd6fdee8c6d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:23.426082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0c5c2a2f-e797-464c-b007-acd6fdee8c6d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:23.539229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0c5c2a2f-e797-464c-b007-acd6fdee8c6d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:23.552574 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0c5c2a2f-e797-464c-b007-acd6fdee8c6d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1302 microversion: 2.1 time: 0.129652 Aug 27 03:05:23.556253 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2489/5138] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:23 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1302 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:24.462117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b81bada3-996a-4455-af95-13ddd726e32b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:24.463282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b81bada3-996a-4455-af95-13ddd726e32b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:24.480559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b81bada3-996a-4455-af95-13ddd726e32b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:24.481119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b81bada3-996a-4455-af95-13ddd726e32b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:24.481570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b81bada3-996a-4455-af95-13ddd726e32b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:24.482348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b81bada3-996a-4455-af95-13ddd726e32b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:24.482804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b81bada3-996a-4455-af95-13ddd726e32b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:24.483226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b81bada3-996a-4455-af95-13ddd726e32b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:24.562489 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b81bada3-996a-4455-af95-13ddd726e32b tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/ips" status: 200 len: 151 microversion: 2.1 time: 0.104362 Aug 27 03:05:24.563655 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2490/5139] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 03:05:24 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/ips => generated 151 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:24.583339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b6ba355e-2713-43f2-b2d6-350415781ee9 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:24.584302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b6ba355e-2713-43f2-b2d6-350415781ee9 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:24.604399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6ba355e-2713-43f2-b2d6-350415781ee9 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:24.607718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6ba355e-2713-43f2-b2d6-350415781ee9 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:24.609613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6ba355e-2713-43f2-b2d6-350415781ee9 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:24.610593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6ba355e-2713-43f2-b2d6-350415781ee9 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:24.614148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6ba355e-2713-43f2-b2d6-350415781ee9 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:24.614833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6ba355e-2713-43f2-b2d6-350415781ee9 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:24.949021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b6ba355e-2713-43f2-b2d6-350415781ee9 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:24.963031 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b6ba355e-2713-43f2-b2d6-350415781ee9 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1354 microversion: 2.1 time: 0.388095 Aug 27 03:05:24.964894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:24.982306 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2491/5140] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:24 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1354 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:25.118912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:05:25.119759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:05:25.120518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:05:25.121436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:05:25.122171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:05:25.158118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:25.158781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:25.159342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:25.161782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:25.164000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:25.164609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:25.211563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Getting quotas for project c2930739b7dc4f26b34361ee100d76f3. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:05:25.221165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Getting quotas for user 9160defddd9f46969249fe5f2a2620e2 and project c2930739b7dc4f26b34361ee100d76f3. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:05:25.241937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:05:25.244819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:05:25.353992 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-19856958-1153-4f19-b373-74bfd9a9fba4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.761883 Aug 27 03:05:25.359495 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2650/5141] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:05:25.371069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7a484b4-2f4f-4cdb-bf73-02517b5e5b4f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:25.371696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b7a484b4-2f4f-4cdb-bf73-02517b5e5b4f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:25.587978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7a484b4-2f4f-4cdb-bf73-02517b5e5b4f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:25.607007 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7a484b4-2f4f-4cdb-bf73-02517b5e5b4f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1217 microversion: 2.1 time: 0.235811 Aug 27 03:05:25.607665 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2492/5142] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:25 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1217 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:25.995225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aaeadac4-9146-41d4-a8ca-0d38982c72f3 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:25.998603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aaeadac4-9146-41d4-a8ca-0d38982c72f3 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:26.008841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaeadac4-9146-41d4-a8ca-0d38982c72f3 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:26.011263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaeadac4-9146-41d4-a8ca-0d38982c72f3 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:26.017722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaeadac4-9146-41d4-a8ca-0d38982c72f3 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:26.025956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaeadac4-9146-41d4-a8ca-0d38982c72f3 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:26.028108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaeadac4-9146-41d4-a8ca-0d38982c72f3 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:26.028108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aaeadac4-9146-41d4-a8ca-0d38982c72f3 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:26.356346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aaeadac4-9146-41d4-a8ca-0d38982c72f3 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:26.373527 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aaeadac4-9146-41d4-a8ca-0d38982c72f3 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1360 microversion: 2.1 time: 0.383369 Aug 27 03:05:26.377974 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2651/5143] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:25 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1360 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:26.630556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dcb5e8b2-5d01-4ada-8d3a-29150be857f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:26.631801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dcb5e8b2-5d01-4ada-8d3a-29150be857f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:26.644675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb5e8b2-5d01-4ada-8d3a-29150be857f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:26.656902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb5e8b2-5d01-4ada-8d3a-29150be857f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:26.659704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb5e8b2-5d01-4ada-8d3a-29150be857f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:26.660773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb5e8b2-5d01-4ada-8d3a-29150be857f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:26.661486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb5e8b2-5d01-4ada-8d3a-29150be857f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:26.662208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb5e8b2-5d01-4ada-8d3a-29150be857f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:27.053499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dcb5e8b2-5d01-4ada-8d3a-29150be857f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:27.084895 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dcb5e8b2-5d01-4ada-8d3a-29150be857f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1213 microversion: 2.1 time: 0.460233 Aug 27 03:05:27.085526 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2493/5144] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:26 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1213 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:27.400138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-adeea41e-d4a8-4d0d-a66d-a28897673f37 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:27.400787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-adeea41e-d4a8-4d0d-a66d-a28897673f37 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:27.410156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adeea41e-d4a8-4d0d-a66d-a28897673f37 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:27.414152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adeea41e-d4a8-4d0d-a66d-a28897673f37 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:27.416655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adeea41e-d4a8-4d0d-a66d-a28897673f37 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:27.417622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adeea41e-d4a8-4d0d-a66d-a28897673f37 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:27.422457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adeea41e-d4a8-4d0d-a66d-a28897673f37 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:27.423181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adeea41e-d4a8-4d0d-a66d-a28897673f37 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:27.618057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f1cdcf17-25cf-4704-a00e-cb9ec3bb7544 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b3504e1-a1d3-45d4-897a-5a410b7e66ff"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:27.621955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f1cdcf17-25cf-4704-a00e-cb9ec3bb7544 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:27.638973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1cdcf17-25cf-4704-a00e-cb9ec3bb7544 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:27.641209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1cdcf17-25cf-4704-a00e-cb9ec3bb7544 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:27.643337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1cdcf17-25cf-4704-a00e-cb9ec3bb7544 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:27.645783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1cdcf17-25cf-4704-a00e-cb9ec3bb7544 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:27.647076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1cdcf17-25cf-4704-a00e-cb9ec3bb7544 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:27.649371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1cdcf17-25cf-4704-a00e-cb9ec3bb7544 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:27.710559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-adeea41e-d4a8-4d0d-a66d-a28897673f37 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:27.738053 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-adeea41e-d4a8-4d0d-a66d-a28897673f37 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1360 microversion: 2.1 time: 0.342241 Aug 27 03:05:27.750471 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2652/5145] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:27 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1360 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:28.114077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-edda941a-7bac-4c48-bb2e-441b851dd378 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:28.115904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-edda941a-7bac-4c48-bb2e-441b851dd378 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:28.171960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edda941a-7bac-4c48-bb2e-441b851dd378 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:28.179449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edda941a-7bac-4c48-bb2e-441b851dd378 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:28.189974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edda941a-7bac-4c48-bb2e-441b851dd378 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:28.189974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edda941a-7bac-4c48-bb2e-441b851dd378 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:28.191824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edda941a-7bac-4c48-bb2e-441b851dd378 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:28.195934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edda941a-7bac-4c48-bb2e-441b851dd378 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:28.492661 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f1cdcf17-25cf-4704-a00e-cb9ec3bb7544 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "POST /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880824 Aug 27 03:05:28.496733 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2494/5146] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:05:27 2022] POST /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments => generated 194 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:28.644789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-edda941a-7bac-4c48-bb2e-441b851dd378 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:28.672252 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-edda941a-7bac-4c48-bb2e-441b851dd378 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1275 microversion: 2.1 time: 0.558141 Aug 27 03:05:28.675170 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2653/5147] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:28 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1275 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:28.766416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-70f9ff1a-db2c-4fe3-8c66-e0c931bd69a4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:28.767320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-70f9ff1a-db2c-4fe3-8c66-e0c931bd69a4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:28.799425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f9ff1a-db2c-4fe3-8c66-e0c931bd69a4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:28.801790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f9ff1a-db2c-4fe3-8c66-e0c931bd69a4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:28.803874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f9ff1a-db2c-4fe3-8c66-e0c931bd69a4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:28.805751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f9ff1a-db2c-4fe3-8c66-e0c931bd69a4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:28.807807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f9ff1a-db2c-4fe3-8c66-e0c931bd69a4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:28.810273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-70f9ff1a-db2c-4fe3-8c66-e0c931bd69a4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:29.700077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-825a5693-0a2d-4c29-bf9b-57a9fc4372c1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:29.701009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-825a5693-0a2d-4c29-bf9b-57a9fc4372c1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:29.714745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-825a5693-0a2d-4c29-bf9b-57a9fc4372c1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:29.717306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-825a5693-0a2d-4c29-bf9b-57a9fc4372c1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:29.718529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-825a5693-0a2d-4c29-bf9b-57a9fc4372c1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:29.719299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-825a5693-0a2d-4c29-bf9b-57a9fc4372c1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:29.723705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-825a5693-0a2d-4c29-bf9b-57a9fc4372c1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:29.724231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-825a5693-0a2d-4c29-bf9b-57a9fc4372c1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:29.738963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-70f9ff1a-db2c-4fe3-8c66-e0c931bd69a4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:29.748759 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-70f9ff1a-db2c-4fe3-8c66-e0c931bd69a4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1428 microversion: 2.1 time: 0.988837 Aug 27 03:05:29.769781 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2495/5148] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:28 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1428 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:29.946731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-825a5693-0a2d-4c29-bf9b-57a9fc4372c1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:29.961511 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-825a5693-0a2d-4c29-bf9b-57a9fc4372c1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1275 microversion: 2.1 time: 0.265455 Aug 27 03:05:29.962473 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2654/5149] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:29 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1275 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:30.783715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-95547e1f-dd72-45eb-9048-aba810281d81 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:30.784485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-95547e1f-dd72-45eb-9048-aba810281d81 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:30.807943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95547e1f-dd72-45eb-9048-aba810281d81 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:30.810440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95547e1f-dd72-45eb-9048-aba810281d81 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:30.810895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95547e1f-dd72-45eb-9048-aba810281d81 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:30.811702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95547e1f-dd72-45eb-9048-aba810281d81 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:30.815081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95547e1f-dd72-45eb-9048-aba810281d81 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:30.815629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95547e1f-dd72-45eb-9048-aba810281d81 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:30.985594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ed5b648f-525b-4056-92e3-2cc840bab7b1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:30.986259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ed5b648f-525b-4056-92e3-2cc840bab7b1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:30.999988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5b648f-525b-4056-92e3-2cc840bab7b1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:31.010198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5b648f-525b-4056-92e3-2cc840bab7b1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:31.010655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5b648f-525b-4056-92e3-2cc840bab7b1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:31.011430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5b648f-525b-4056-92e3-2cc840bab7b1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:31.011883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5b648f-525b-4056-92e3-2cc840bab7b1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:31.012347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed5b648f-525b-4056-92e3-2cc840bab7b1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:31.508231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ed5b648f-525b-4056-92e3-2cc840bab7b1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:31.519525 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ed5b648f-525b-4056-92e3-2cc840bab7b1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1275 microversion: 2.1 time: 0.539913 Aug 27 03:05:31.534392 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2655/5150] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:30 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1275 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:31.890212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:32.383513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-95547e1f-dd72-45eb-9048-aba810281d81 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:32.417363 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-95547e1f-dd72-45eb-9048-aba810281d81 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1428 microversion: 2.1 time: 1.620446 Aug 27 03:05:32.424631 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2496/5151] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:30 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1428 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:32.548867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b6eb57da-06a0-4116-bf3c-06044bf6cbfc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:32.549710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b6eb57da-06a0-4116-bf3c-06044bf6cbfc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:32.584037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6eb57da-06a0-4116-bf3c-06044bf6cbfc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:32.584857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6eb57da-06a0-4116-bf3c-06044bf6cbfc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:32.594085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6eb57da-06a0-4116-bf3c-06044bf6cbfc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:32.594952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6eb57da-06a0-4116-bf3c-06044bf6cbfc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:32.595631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6eb57da-06a0-4116-bf3c-06044bf6cbfc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:32.596075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6eb57da-06a0-4116-bf3c-06044bf6cbfc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:33.046717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0b7d85ff-d8c0-4f54-a243-897167418f27 req-558e2eb7-96b9-4362-bea1-9a86555fbde3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3ffe8d-8412-4d9a-b563-7444dcb64ac0", "tag": "cf076202-9d30-4fb6-9be4-e65703281cf6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:33.068714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0b7d85ff-d8c0-4f54-a243-897167418f27 req-558e2eb7-96b9-4362-bea1-9a86555fbde3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:33.078979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0b7d85ff-d8c0-4f54-a243-897167418f27 req-558e2eb7-96b9-4362-bea1-9a86555fbde3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:33.079702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0b7d85ff-d8c0-4f54-a243-897167418f27 req-558e2eb7-96b9-4362-bea1-9a86555fbde3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:33.099709 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0b7d85ff-d8c0-4f54-a243-897167418f27 req-558e2eb7-96b9-4362-bea1-9a86555fbde3 service nova] Creating event network-changed:cf076202-9d30-4fb6-9be4-e65703281cf6 for instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 on n-h2-852084-5 Aug 27 03:05:33.115265 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0b7d85ff-d8c0-4f54-a243-897167418f27 req-558e2eb7-96b9-4362-bea1-9a86555fbde3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073077 Aug 27 03:05:33.119130 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2497/5152] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:33.369825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6eb57da-06a0-4116-bf3c-06044bf6cbfc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:33.400354 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b6eb57da-06a0-4116-bf3c-06044bf6cbfc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1317 microversion: 2.1 time: 0.862191 Aug 27 03:05:33.401807 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2656/5153] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:32 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1317 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:33.454497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-668b1b66-3a83-488d-9d10-4ab59665ebeb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:33.456549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-668b1b66-3a83-488d-9d10-4ab59665ebeb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:33.492573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668b1b66-3a83-488d-9d10-4ab59665ebeb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:33.494230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668b1b66-3a83-488d-9d10-4ab59665ebeb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:33.501619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668b1b66-3a83-488d-9d10-4ab59665ebeb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:33.506678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668b1b66-3a83-488d-9d10-4ab59665ebeb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:33.506678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668b1b66-3a83-488d-9d10-4ab59665ebeb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:33.515528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668b1b66-3a83-488d-9d10-4ab59665ebeb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:34.074731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-668b1b66-3a83-488d-9d10-4ab59665ebeb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:34.098406 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-668b1b66-3a83-488d-9d10-4ab59665ebeb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1428 microversion: 2.1 time: 0.644876 Aug 27 03:05:34.100625 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2498/5154] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:33 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1428 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:34.423827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8e49d589-54e8-4358-b4b8-4e169526994c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:34.424609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8e49d589-54e8-4358-b4b8-4e169526994c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:34.438349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e49d589-54e8-4358-b4b8-4e169526994c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:34.438883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e49d589-54e8-4358-b4b8-4e169526994c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:34.444058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e49d589-54e8-4358-b4b8-4e169526994c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:34.449791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e49d589-54e8-4358-b4b8-4e169526994c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:34.450370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e49d589-54e8-4358-b4b8-4e169526994c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:34.450838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e49d589-54e8-4358-b4b8-4e169526994c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:34.457916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1017364232", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "3aecc847-55b7-4227-9053-040599605053"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:34.598327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] validate_networks() for [('3aecc847-55b7-4227-9053-040599605053', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:05:34.930558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8e49d589-54e8-4358-b4b8-4e169526994c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:34.939595 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8e49d589-54e8-4358-b4b8-4e169526994c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1317 microversion: 2.1 time: 0.520979 Aug 27 03:05:34.942113 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2499/5155] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:34 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1317 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:34.984729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7f2975be-03ce-4f92-81eb-f39eb9f30b9f req-4a853a37-ddef-4d98-a558-5580b26c345f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd717b6a-4a99-4312-a369-a655d985f4a1", "tag": "cf14ece3-b282-4e8e-82a9-73445f360776"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:35.007154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7f2975be-03ce-4f92-81eb-f39eb9f30b9f req-4a853a37-ddef-4d98-a558-5580b26c345f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:35.010694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7f2975be-03ce-4f92-81eb-f39eb9f30b9f req-4a853a37-ddef-4d98-a558-5580b26c345f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:35.011440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7f2975be-03ce-4f92-81eb-f39eb9f30b9f req-4a853a37-ddef-4d98-a558-5580b26c345f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:35.047038 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7f2975be-03ce-4f92-81eb-f39eb9f30b9f req-4a853a37-ddef-4d98-a558-5580b26c345f service nova] Creating event network-changed:cf14ece3-b282-4e8e-82a9-73445f360776 for instance dd717b6a-4a99-4312-a369-a655d985f4a1 on n-h1-852084-5 Aug 27 03:05:35.053137 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7f2975be-03ce-4f92-81eb-f39eb9f30b9f req-4a853a37-ddef-4d98-a558-5580b26c345f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073156 Aug 27 03:05:35.054544 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2500/5156] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:05:35.126211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-30f47b45-16d8-4f96-a850-e386c397c2b8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:35.127067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-30f47b45-16d8-4f96-a850-e386c397c2b8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:35.144208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30f47b45-16d8-4f96-a850-e386c397c2b8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:35.147028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30f47b45-16d8-4f96-a850-e386c397c2b8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:35.147614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30f47b45-16d8-4f96-a850-e386c397c2b8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:35.148487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30f47b45-16d8-4f96-a850-e386c397c2b8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:35.150081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30f47b45-16d8-4f96-a850-e386c397c2b8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:35.153163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30f47b45-16d8-4f96-a850-e386c397c2b8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:35.199396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:35.233771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:35.594916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=16 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:35.635947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-30f47b45-16d8-4f96-a850-e386c397c2b8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:35.649377 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-30f47b45-16d8-4f96-a850-e386c397c2b8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1428 microversion: 2.1 time: 0.529970 Aug 27 03:05:35.650266 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2501/5157] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:35 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1428 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:35.970048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a3ebe73-7c7d-459e-8959-af263d8fd2ed tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:35.974982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4a3ebe73-7c7d-459e-8959-af263d8fd2ed tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:35.998296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3ebe73-7c7d-459e-8959-af263d8fd2ed tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:36.006890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3ebe73-7c7d-459e-8959-af263d8fd2ed tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:36.012293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3ebe73-7c7d-459e-8959-af263d8fd2ed tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:36.013333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3ebe73-7c7d-459e-8959-af263d8fd2ed tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:36.013953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3ebe73-7c7d-459e-8959-af263d8fd2ed tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:36.021287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a3ebe73-7c7d-459e-8959-af263d8fd2ed tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:36.643755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4a3ebe73-7c7d-459e-8959-af263d8fd2ed tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:36.661399 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4a3ebe73-7c7d-459e-8959-af263d8fd2ed tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1317 microversion: 2.1 time: 0.699533 Aug 27 03:05:36.669825 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2502/5158] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:35 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:36.675559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fc678734-1fce-4cc5-9ec1-6a78f9fcab86 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Action: 'create', calling method: .version_select at 0x7f4d2a71f310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1686777903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQZamccffgIlXjMhEPzvWfkh9aa8CJReG8Rf9mQQv7v0LyjGr3NTM0FprqcYMFfmjWDTPDI2cOqzFe6HrTmYYEU5H0pxnOc5oxC2CfjXE4tI2cwsQVEiHotwdHHrYM8bA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:36.695405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-fc678734-1fce-4cc5-9ec1-6a78f9fcab86 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:05:36.703188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-fc678734-1fce-4cc5-9ec1-6a78f9fcab86 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for user ccbd8cc1d59d412b8b7f8cdf5db759b2 and project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:05:36.740583 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fc678734-1fce-4cc5-9ec1-6a78f9fcab86 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.075621 Aug 27 03:05:36.741874 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2503/5159] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:05:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:36.753883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-08e142e0-3f7b-4a7e-b702-341a4563cafb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:36.756161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-08e142e0-3f7b-4a7e-b702-341a4563cafb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:36.771805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08e142e0-3f7b-4a7e-b702-341a4563cafb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:36.773116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08e142e0-3f7b-4a7e-b702-341a4563cafb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:36.775632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08e142e0-3f7b-4a7e-b702-341a4563cafb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:36.778873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08e142e0-3f7b-4a7e-b702-341a4563cafb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:36.779765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08e142e0-3f7b-4a7e-b702-341a4563cafb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:36.780267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-08e142e0-3f7b-4a7e-b702-341a4563cafb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:37.152750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:05:37.153371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:05:37.154210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:05:37.154975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:05:37.155534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:05:37.183788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:37.187828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:37.188979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:37.193515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:37.194468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:37.198071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:37.291053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Getting quotas for project 08bf2e17c663424da0d97c832aeffc78. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:05:37.308742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Getting quotas for user 7deda8ad3c8a4889b0eea21df713cdc6 and project 08bf2e17c663424da0d97c832aeffc78. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:05:37.380653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:05:37.388780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:05:37.524599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-08e142e0-3f7b-4a7e-b702-341a4563cafb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:37.535373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b833a6cb-317f-4a5f-ac7e-700fe6bb2bf7 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.395706 Aug 27 03:05:37.538160 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2657/5160] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:05:37.540337 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-08e142e0-3f7b-4a7e-b702-341a4563cafb tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1428 microversion: 2.1 time: 0.797224 Aug 27 03:05:37.540942 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2504/5161] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:36 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1428 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:37.557747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2c12ef41-3a45-4630-9518-b7907586d50e tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:37.558677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2c12ef41-3a45-4630-9518-b7907586d50e tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:37.683513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04952f22-642d-4430-8860-532cf1163e16 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:37.684998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-04952f22-642d-4430-8860-532cf1163e16 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:37.695861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04952f22-642d-4430-8860-532cf1163e16 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:37.696369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04952f22-642d-4430-8860-532cf1163e16 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:37.696813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04952f22-642d-4430-8860-532cf1163e16 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:37.697535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04952f22-642d-4430-8860-532cf1163e16 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:37.698034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04952f22-642d-4430-8860-532cf1163e16 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:37.698461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04952f22-642d-4430-8860-532cf1163e16 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:37.754490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2c12ef41-3a45-4630-9518-b7907586d50e tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:37.769313 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2c12ef41-3a45-4630-9518-b7907586d50e tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1214 microversion: 2.1 time: 0.221260 Aug 27 03:05:37.770007 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2658/5162] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:37 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:38.446774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-04952f22-642d-4430-8860-532cf1163e16 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:38.459957 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-04952f22-642d-4430-8860-532cf1163e16 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1317 microversion: 2.1 time: 0.777819 Aug 27 03:05:38.463232 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2505/5163] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:37 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:38.564930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f5493972-196d-4aaf-8258-70de88abb25e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:38.566261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f5493972-196d-4aaf-8258-70de88abb25e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:38.595109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5493972-196d-4aaf-8258-70de88abb25e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:38.595918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5493972-196d-4aaf-8258-70de88abb25e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:38.596535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5493972-196d-4aaf-8258-70de88abb25e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:38.600306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5493972-196d-4aaf-8258-70de88abb25e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:38.602042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5493972-196d-4aaf-8258-70de88abb25e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:38.602701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5493972-196d-4aaf-8258-70de88abb25e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:38.756095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-f5c80fef-e8a3-4b29-ab04-ef52a5f5a6e2 req-acce8243-33ac-44d7-81d9-5ebccc8f457b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3ffe8d-8412-4d9a-b563-7444dcb64ac0", "name": "network-vif-plugged", "status": "completed", "tag": "cf076202-9d30-4fb6-9be4-e65703281cf6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:38.786633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f5c80fef-e8a3-4b29-ab04-ef52a5f5a6e2 req-acce8243-33ac-44d7-81d9-5ebccc8f457b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:38.789535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f5c80fef-e8a3-4b29-ab04-ef52a5f5a6e2 req-acce8243-33ac-44d7-81d9-5ebccc8f457b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:38.790031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f5c80fef-e8a3-4b29-ab04-ef52a5f5a6e2 req-acce8243-33ac-44d7-81d9-5ebccc8f457b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:38.855454 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-f5c80fef-e8a3-4b29-ab04-ef52a5f5a6e2 req-acce8243-33ac-44d7-81d9-5ebccc8f457b service nova] Creating event network-vif-plugged:cf076202-9d30-4fb6-9be4-e65703281cf6 for instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 on n-h2-852084-5 Aug 27 03:05:38.883250 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-f5c80fef-e8a3-4b29-ab04-ef52a5f5a6e2 req-acce8243-33ac-44d7-81d9-5ebccc8f457b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126660 Aug 27 03:05:38.888512 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2506/5164] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:38.907991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-63a01f15-0e49-4338-82ed-c40f1a191292 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:38.910507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-63a01f15-0e49-4338-82ed-c40f1a191292 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:38.935642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63a01f15-0e49-4338-82ed-c40f1a191292 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:38.938590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63a01f15-0e49-4338-82ed-c40f1a191292 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:38.939095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63a01f15-0e49-4338-82ed-c40f1a191292 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:38.944909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63a01f15-0e49-4338-82ed-c40f1a191292 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:38.945915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63a01f15-0e49-4338-82ed-c40f1a191292 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:38.946558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63a01f15-0e49-4338-82ed-c40f1a191292 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.047676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f5493972-196d-4aaf-8258-70de88abb25e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:39.062885 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f5493972-196d-4aaf-8258-70de88abb25e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1428 microversion: 2.1 time: 0.505981 Aug 27 03:05:39.069181 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2659/5165] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:38 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1428 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:39.256545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-63a01f15-0e49-4338-82ed-c40f1a191292 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:39.266972 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-63a01f15-0e49-4338-82ed-c40f1a191292 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1218 microversion: 2.1 time: 0.374764 Aug 27 03:05:39.268546 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2507/5166] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:38 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1218 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:39.487855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9aae493a-9b68-41bc-bc12-54ce02ba4c67 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:39.488606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9aae493a-9b68-41bc-bc12-54ce02ba4c67 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:39.505076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aae493a-9b68-41bc-bc12-54ce02ba4c67 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:39.505628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aae493a-9b68-41bc-bc12-54ce02ba4c67 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:39.506106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aae493a-9b68-41bc-bc12-54ce02ba4c67 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.506847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aae493a-9b68-41bc-bc12-54ce02ba4c67 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:39.507396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aae493a-9b68-41bc-bc12-54ce02ba4c67 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:39.510842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9aae493a-9b68-41bc-bc12-54ce02ba4c67 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:39.832335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9aae493a-9b68-41bc-bc12-54ce02ba4c67 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:39.844285 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9aae493a-9b68-41bc-bc12-54ce02ba4c67 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1317 microversion: 2.1 time: 0.362460 Aug 27 03:05:39.864787 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2660/5167] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:39 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:40.091538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-72578a92-c48d-4f38-a57f-d089a069c137 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:40.093273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-72578a92-c48d-4f38-a57f-d089a069c137 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:40.103234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72578a92-c48d-4f38-a57f-d089a069c137 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:40.103977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72578a92-c48d-4f38-a57f-d089a069c137 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:40.104847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72578a92-c48d-4f38-a57f-d089a069c137 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:40.105819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72578a92-c48d-4f38-a57f-d089a069c137 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:40.107315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72578a92-c48d-4f38-a57f-d089a069c137 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:40.108548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72578a92-c48d-4f38-a57f-d089a069c137 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:40.288936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cabb08b0-31d9-4a11-8b57-08635491debb tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:40.289831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cabb08b0-31d9-4a11-8b57-08635491debb tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:40.325196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cabb08b0-31d9-4a11-8b57-08635491debb tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:40.326265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cabb08b0-31d9-4a11-8b57-08635491debb tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:40.328450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cabb08b0-31d9-4a11-8b57-08635491debb tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:40.355007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cabb08b0-31d9-4a11-8b57-08635491debb tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:40.357096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cabb08b0-31d9-4a11-8b57-08635491debb tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:40.362646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cabb08b0-31d9-4a11-8b57-08635491debb tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:40.495787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-72578a92-c48d-4f38-a57f-d089a069c137 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:40.509994 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-72578a92-c48d-4f38-a57f-d089a069c137 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1428 microversion: 2.1 time: 0.424271 Aug 27 03:05:40.526937 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2508/5168] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:40 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1428 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:40.530935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cabb08b0-31d9-4a11-8b57-08635491debb tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:40.548691 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cabb08b0-31d9-4a11-8b57-08635491debb tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1266 microversion: 2.1 time: 0.263345 Aug 27 03:05:40.550450 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2661/5169] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:40 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:40.572527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1395386932", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "1255f8a8-6db5-413a-96a7-f721ce4078ef"}], "key_name": "tempest-TestNetworkBasicOps-1686777903", "security_groups": [{"name": "tempest-secgroup-smoke-1728449675"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:40.869852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aad0b77e-c721-4d96-a1fa-8457c34e9904 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:40.871322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aad0b77e-c721-4d96-a1fa-8457c34e9904 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:40.887435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] validate_networks() for [('1255f8a8-6db5-413a-96a7-f721ce4078ef', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:05:40.889568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aad0b77e-c721-4d96-a1fa-8457c34e9904 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:40.894413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aad0b77e-c721-4d96-a1fa-8457c34e9904 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:40.900332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aad0b77e-c721-4d96-a1fa-8457c34e9904 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:40.901378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aad0b77e-c721-4d96-a1fa-8457c34e9904 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:40.903711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aad0b77e-c721-4d96-a1fa-8457c34e9904 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:40.904392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aad0b77e-c721-4d96-a1fa-8457c34e9904 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:41.240977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aad0b77e-c721-4d96-a1fa-8457c34e9904 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:41.254523 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aad0b77e-c721-4d96-a1fa-8457c34e9904 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1317 microversion: 2.1 time: 0.388591 Aug 27 03:05:41.256078 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2662/5170] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:40 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:41.539793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ecffdd1b-a74b-4097-ab72-ec448c346be8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:41.540808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ecffdd1b-a74b-4097-ab72-ec448c346be8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:41.549631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecffdd1b-a74b-4097-ab72-ec448c346be8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:41.550521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecffdd1b-a74b-4097-ab72-ec448c346be8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:41.551232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecffdd1b-a74b-4097-ab72-ec448c346be8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:41.552242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecffdd1b-a74b-4097-ab72-ec448c346be8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:41.552970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecffdd1b-a74b-4097-ab72-ec448c346be8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:41.553696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecffdd1b-a74b-4097-ab72-ec448c346be8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:41.779297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ecffdd1b-a74b-4097-ab72-ec448c346be8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:41.790696 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ecffdd1b-a74b-4097-ab72-ec448c346be8 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1609 microversion: 2.1 time: 0.255383 Aug 27 03:05:41.792211 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2663/5171] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:41 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1609 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:41.797573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e7800f3c-bd8c-4342-a122-e09ba9f2df56 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:41.798427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e7800f3c-bd8c-4342-a122-e09ba9f2df56 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:41.834611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7800f3c-bd8c-4342-a122-e09ba9f2df56 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:41.835400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7800f3c-bd8c-4342-a122-e09ba9f2df56 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:41.836269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7800f3c-bd8c-4342-a122-e09ba9f2df56 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:41.840300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7800f3c-bd8c-4342-a122-e09ba9f2df56 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:41.840934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7800f3c-bd8c-4342-a122-e09ba9f2df56 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:41.845615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7800f3c-bd8c-4342-a122-e09ba9f2df56 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:41.971939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:05:41.972812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:05:41.972926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:05:41.973293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:05:41.973730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:05:41.990060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:41.990542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:41.990993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:41.991730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:41.992182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:41.995487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.018553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:42.048751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:05:42.056080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for user ccbd8cc1d59d412b8b7f8cdf5db759b2 and project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:05:42.107547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:05:42.112599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:05:42.148301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:42.240317 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0de64b97-4297-423a-8d0f-7927fb301885 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.671906 Aug 27 03:05:42.247969 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2509/5172] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:05:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:05:42.254299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c5117b78-35c3-4399-8d0a-165b2c93589f tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:42.255167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c5117b78-35c3-4399-8d0a-165b2c93589f tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:42.266291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5117b78-35c3-4399-8d0a-165b2c93589f tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.267329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5117b78-35c3-4399-8d0a-165b2c93589f tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.268504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5117b78-35c3-4399-8d0a-165b2c93589f tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.269428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5117b78-35c3-4399-8d0a-165b2c93589f tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.270091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5117b78-35c3-4399-8d0a-165b2c93589f tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.270678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5117b78-35c3-4399-8d0a-165b2c93589f tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.596655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c5117b78-35c3-4399-8d0a-165b2c93589f tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:42.602045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e7800f3c-bd8c-4342-a122-e09ba9f2df56 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:42.625409 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c5117b78-35c3-4399-8d0a-165b2c93589f tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1609 microversion: 2.1 time: 0.374784 Aug 27 03:05:42.644795 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2510/5173] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:42 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1609 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:42.645037 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e7800f3c-bd8c-4342-a122-e09ba9f2df56 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1314 microversion: 2.1 time: 0.844029 Aug 27 03:05:42.645037 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2664/5174] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:41 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:42.653512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c8560cfb-c8a9-4775-9eaa-2823c0fa9cae req-ff2a7493-d022-4091-a0f9-959c31b24963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd717b6a-4a99-4312-a369-a655d985f4a1", "name": "network-vif-plugged", "status": "completed", "tag": "cf14ece3-b282-4e8e-82a9-73445f360776"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:42.679295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5ca3b594-e856-4796-ae7e-f83af8b143c3 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:42.683971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5ca3b594-e856-4796-ae7e-f83af8b143c3 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:42.709536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c8560cfb-c8a9-4775-9eaa-2823c0fa9cae req-ff2a7493-d022-4091-a0f9-959c31b24963 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.710237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c8560cfb-c8a9-4775-9eaa-2823c0fa9cae req-ff2a7493-d022-4091-a0f9-959c31b24963 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.711848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c8560cfb-c8a9-4775-9eaa-2823c0fa9cae req-ff2a7493-d022-4091-a0f9-959c31b24963 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.742416 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c8560cfb-c8a9-4775-9eaa-2823c0fa9cae req-ff2a7493-d022-4091-a0f9-959c31b24963 service nova] Creating event network-vif-plugged:cf14ece3-b282-4e8e-82a9-73445f360776 for instance dd717b6a-4a99-4312-a369-a655d985f4a1 on n-h1-852084-5 Aug 27 03:05:42.754071 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c8560cfb-c8a9-4775-9eaa-2823c0fa9cae req-ff2a7493-d022-4091-a0f9-959c31b24963 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117767 Aug 27 03:05:42.765618 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2511/5175] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:42.772007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf3f44be-5791-4117-ae52-2fd9214690f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:42.772792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf3f44be-5791-4117-ae52-2fd9214690f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:42.780376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf3f44be-5791-4117-ae52-2fd9214690f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.781304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf3f44be-5791-4117-ae52-2fd9214690f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.782020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf3f44be-5791-4117-ae52-2fd9214690f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.782978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf3f44be-5791-4117-ae52-2fd9214690f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.783677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf3f44be-5791-4117-ae52-2fd9214690f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.784331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf3f44be-5791-4117-ae52-2fd9214690f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.879643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5ca3b594-e856-4796-ae7e-f83af8b143c3 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:42.908302 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5ca3b594-e856-4796-ae7e-f83af8b143c3 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1249 microversion: 2.1 time: 0.265596 Aug 27 03:05:42.912878 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2665/5176] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:42 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1249 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:42.930500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2c4a991e-be4d-4736-974b-b4c7c0e65bdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:42.931698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2c4a991e-be4d-4736-974b-b4c7c0e65bdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:42.941253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4a991e-be4d-4736-974b-b4c7c0e65bdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.943221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4a991e-be4d-4736-974b-b4c7c0e65bdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.943683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4a991e-be4d-4736-974b-b4c7c0e65bdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:42.944434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4a991e-be4d-4736-974b-b4c7c0e65bdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:42.944901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4a991e-be4d-4736-974b-b4c7c0e65bdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:42.945341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4a991e-be4d-4736-974b-b4c7c0e65bdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.368604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf3f44be-5791-4117-ae52-2fd9214690f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:43.379182 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf3f44be-5791-4117-ae52-2fd9214690f6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1317 microversion: 2.1 time: 0.612097 Aug 27 03:05:43.384885 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2512/5177] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:42 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:43.451078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2c4a991e-be4d-4736-974b-b4c7c0e65bdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:43.465781 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2c4a991e-be4d-4736-974b-b4c7c0e65bdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1609 microversion: 2.1 time: 0.551033 Aug 27 03:05:43.482415 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2666/5178] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:42 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1609 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:43.674101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd38e2af-18a0-435c-812e-1193f5887076 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:43.675781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bd38e2af-18a0-435c-812e-1193f5887076 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:43.689915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd38e2af-18a0-435c-812e-1193f5887076 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:43.692419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd38e2af-18a0-435c-812e-1193f5887076 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:43.694131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd38e2af-18a0-435c-812e-1193f5887076 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.696303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd38e2af-18a0-435c-812e-1193f5887076 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:43.696303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd38e2af-18a0-435c-812e-1193f5887076 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:43.696303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd38e2af-18a0-435c-812e-1193f5887076 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.943585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fe67d350-085e-4bb8-94ac-407b4496896d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:43.944157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fe67d350-085e-4bb8-94ac-407b4496896d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:43.962029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe67d350-085e-4bb8-94ac-407b4496896d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:43.962526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe67d350-085e-4bb8-94ac-407b4496896d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:43.962977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe67d350-085e-4bb8-94ac-407b4496896d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:43.963688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe67d350-085e-4bb8-94ac-407b4496896d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:43.964326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe67d350-085e-4bb8-94ac-407b4496896d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:43.965301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe67d350-085e-4bb8-94ac-407b4496896d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:44.048885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd38e2af-18a0-435c-812e-1193f5887076 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:44.071030 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd38e2af-18a0-435c-812e-1193f5887076 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1314 microversion: 2.1 time: 0.405503 Aug 27 03:05:44.076406 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2513/5179] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:43 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:44.102657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-1f6948b8-3d18-4e72-a02f-6b663e00cb3e req-df511acd-325f-49b6-abd9-a638798dd2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c3d763-3ddc-43de-a4a1-3b5539d71585", "tag": "0fbb8c30-c27f-40b7-bb7f-a178fc302163"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:44.143607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1f6948b8-3d18-4e72-a02f-6b663e00cb3e req-df511acd-325f-49b6-abd9-a638798dd2fa service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:44.149364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1f6948b8-3d18-4e72-a02f-6b663e00cb3e req-df511acd-325f-49b6-abd9-a638798dd2fa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:44.150005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1f6948b8-3d18-4e72-a02f-6b663e00cb3e req-df511acd-325f-49b6-abd9-a638798dd2fa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:44.194922 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1f6948b8-3d18-4e72-a02f-6b663e00cb3e req-df511acd-325f-49b6-abd9-a638798dd2fa service nova] Creating event network-changed:0fbb8c30-c27f-40b7-bb7f-a178fc302163 for instance 23c3d763-3ddc-43de-a4a1-3b5539d71585 on n-h2-852084-5 Aug 27 03:05:44.201508 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-1f6948b8-3d18-4e72-a02f-6b663e00cb3e req-df511acd-325f-49b6-abd9-a638798dd2fa service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123211 Aug 27 03:05:44.202498 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2514/5180] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:44.317002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe67d350-085e-4bb8-94ac-407b4496896d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:44.351849 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fe67d350-085e-4bb8-94ac-407b4496896d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1245 microversion: 2.1 time: 0.410429 Aug 27 03:05:44.363488 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2667/5181] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:43 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1245 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:44.417726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-39c3bad5-1efa-442f-837c-9b31c3a602ae tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:44.418271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-39c3bad5-1efa-442f-837c-9b31c3a602ae tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:44.432820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39c3bad5-1efa-442f-837c-9b31c3a602ae tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:44.433331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39c3bad5-1efa-442f-837c-9b31c3a602ae tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:44.433799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39c3bad5-1efa-442f-837c-9b31c3a602ae tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:44.446968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39c3bad5-1efa-442f-837c-9b31c3a602ae tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:44.449143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39c3bad5-1efa-442f-837c-9b31c3a602ae tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:44.452585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39c3bad5-1efa-442f-837c-9b31c3a602ae tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:44.912052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-39c3bad5-1efa-442f-837c-9b31c3a602ae tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:44.930533 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-39c3bad5-1efa-442f-837c-9b31c3a602ae tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1317 microversion: 2.1 time: 0.517602 Aug 27 03:05:44.934097 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2515/5182] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:44 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:45.097392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6fa5e217-9862-4c4e-8ce7-ae696f026697 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:45.098173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6fa5e217-9862-4c4e-8ce7-ae696f026697 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:45.103623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:45.112938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fa5e217-9862-4c4e-8ce7-ae696f026697 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:45.114028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fa5e217-9862-4c4e-8ce7-ae696f026697 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:45.114261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fa5e217-9862-4c4e-8ce7-ae696f026697 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:45.114994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fa5e217-9862-4c4e-8ce7-ae696f026697 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:45.115769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fa5e217-9862-4c4e-8ce7-ae696f026697 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:45.116379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fa5e217-9862-4c4e-8ce7-ae696f026697 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:45.381974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-101b4105-a607-4141-8785-92fafd4c6366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:45.383103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-101b4105-a607-4141-8785-92fafd4c6366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:45.395713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-101b4105-a607-4141-8785-92fafd4c6366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:45.396569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-101b4105-a607-4141-8785-92fafd4c6366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:45.397794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-101b4105-a607-4141-8785-92fafd4c6366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:45.398840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-101b4105-a607-4141-8785-92fafd4c6366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:45.399538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-101b4105-a607-4141-8785-92fafd4c6366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:45.400448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-101b4105-a607-4141-8785-92fafd4c6366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:45.413241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6fa5e217-9862-4c4e-8ce7-ae696f026697 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:45.427101 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6fa5e217-9862-4c4e-8ce7-ae696f026697 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1314 microversion: 2.1 time: 0.334875 Aug 27 03:05:45.454292 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2668/5183] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:45 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:45.563923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-101b4105-a607-4141-8785-92fafd4c6366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:45.585703 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-101b4105-a607-4141-8785-92fafd4c6366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1301 microversion: 2.1 time: 0.197166 Aug 27 03:05:45.585703 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2516/5184] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:45 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1301 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:45.957291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-47969cfc-0c31-4b50-b75e-42f4b120ced3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:45.958228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-47969cfc-0c31-4b50-b75e-42f4b120ced3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:45.969127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47969cfc-0c31-4b50-b75e-42f4b120ced3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:45.970086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47969cfc-0c31-4b50-b75e-42f4b120ced3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:45.970767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47969cfc-0c31-4b50-b75e-42f4b120ced3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:45.971711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47969cfc-0c31-4b50-b75e-42f4b120ced3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:45.972539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47969cfc-0c31-4b50-b75e-42f4b120ced3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:45.973187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47969cfc-0c31-4b50-b75e-42f4b120ced3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.449337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6f39f060-7565-4904-8a63-62b80057d9fc tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:46.450314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6f39f060-7565-4904-8a63-62b80057d9fc tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:46.477388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f39f060-7565-4904-8a63-62b80057d9fc tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.479894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f39f060-7565-4904-8a63-62b80057d9fc tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.486812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f39f060-7565-4904-8a63-62b80057d9fc tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.498919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f39f060-7565-4904-8a63-62b80057d9fc tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.508715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f39f060-7565-4904-8a63-62b80057d9fc tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.510589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f39f060-7565-4904-8a63-62b80057d9fc tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.708767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-47969cfc-0c31-4b50-b75e-42f4b120ced3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:46.714076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:46.724584 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-47969cfc-0c31-4b50-b75e-42f4b120ced3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1507 microversion: 2.1 time: 0.771342 Aug 27 03:05:46.725520 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2669/5185] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:45 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1507 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:46.733559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1aa145a4-6a38-4dc6-be2f-14022a9bd244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:46.739895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1aa145a4-6a38-4dc6-be2f-14022a9bd244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:46.747424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa145a4-6a38-4dc6-be2f-14022a9bd244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.748025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa145a4-6a38-4dc6-be2f-14022a9bd244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.749303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa145a4-6a38-4dc6-be2f-14022a9bd244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.750552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa145a4-6a38-4dc6-be2f-14022a9bd244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.751437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa145a4-6a38-4dc6-be2f-14022a9bd244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.752753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa145a4-6a38-4dc6-be2f-14022a9bd244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.912982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1aa145a4-6a38-4dc6-be2f-14022a9bd244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:46.933252 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1aa145a4-6a38-4dc6-be2f-14022a9bd244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1307 microversion: 2.1 time: 0.203886 Aug 27 03:05:46.946496 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2670/5186] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:46 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:46.953739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-98b9ea56-1130-4890-bd99-236c714c17cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:46.954675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-98b9ea56-1130-4890-bd99-236c714c17cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:46.969586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98b9ea56-1130-4890-bd99-236c714c17cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.970464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98b9ea56-1130-4890-bd99-236c714c17cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.973744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98b9ea56-1130-4890-bd99-236c714c17cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:46.975762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98b9ea56-1130-4890-bd99-236c714c17cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:46.976874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98b9ea56-1130-4890-bd99-236c714c17cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:46.978649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-98b9ea56-1130-4890-bd99-236c714c17cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.050551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6f39f060-7565-4904-8a63-62b80057d9fc tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:47.061174 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6f39f060-7565-4904-8a63-62b80057d9fc tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1314 microversion: 2.1 time: 0.615859 Aug 27 03:05:47.066370 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2517/5187] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:46 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:47.083450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1cd3b4eb-68cb-4a96-93c4-b5607dfcefb0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:47.083955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1cd3b4eb-68cb-4a96-93c4-b5607dfcefb0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:47.114229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd3b4eb-68cb-4a96-93c4-b5607dfcefb0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.115888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd3b4eb-68cb-4a96-93c4-b5607dfcefb0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.118199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd3b4eb-68cb-4a96-93c4-b5607dfcefb0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.121200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd3b4eb-68cb-4a96-93c4-b5607dfcefb0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.121569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd3b4eb-68cb-4a96-93c4-b5607dfcefb0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.123888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1cd3b4eb-68cb-4a96-93c4-b5607dfcefb0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.253357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:47.331894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-1cd3b4eb-68cb-4a96-93c4-b5607dfcefb0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lazy-loading 'services' on Instance uuid f3532336-1c3d-4c13-9a8c-7009050f3677 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:05:47.473708 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1cd3b4eb-68cb-4a96-93c4-b5607dfcefb0 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments/3b3504e1-a1d3-45d4-897a-5a410b7e66ff" status: 202 len: 0 microversion: 2.1 time: 0.403486 Aug 27 03:05:47.477538 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2518/5188] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:05:47 2022] DELETE /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments/3b3504e1-a1d3-45d4-897a-5a410b7e66ff => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:05:47.487189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-763fa1a5-9bc0-4ab5-9515-b7caf437fdf6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:47.491126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-763fa1a5-9bc0-4ab5-9515-b7caf437fdf6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:47.509911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-763fa1a5-9bc0-4ab5-9515-b7caf437fdf6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.509911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-763fa1a5-9bc0-4ab5-9515-b7caf437fdf6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.509911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-763fa1a5-9bc0-4ab5-9515-b7caf437fdf6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.509911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-763fa1a5-9bc0-4ab5-9515-b7caf437fdf6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.510271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-763fa1a5-9bc0-4ab5-9515-b7caf437fdf6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.523843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-763fa1a5-9bc0-4ab5-9515-b7caf437fdf6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.637193 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-763fa1a5-9bc0-4ab5-9515-b7caf437fdf6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152834 Aug 27 03:05:47.644768 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2519/5189] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:05:47 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:47.709991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-98b9ea56-1130-4890-bd99-236c714c17cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:47.723665 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-98b9ea56-1130-4890-bd99-236c714c17cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1507 microversion: 2.1 time: 0.775453 Aug 27 03:05:47.727576 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2671/5190] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:46 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1507 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:47.749280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:47.752887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:47.760279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.761464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.762402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.764612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.765488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.767831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.963403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-453616f6-ce52-44d1-aeb9-fe5c7cf73244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:47.967779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-453616f6-ce52-44d1-aeb9-fe5c7cf73244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:47.984313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:05:47.984904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:05:47.985716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-453616f6-ce52-44d1-aeb9-fe5c7cf73244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.986438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-453616f6-ce52-44d1-aeb9-fe5c7cf73244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.987116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-453616f6-ce52-44d1-aeb9-fe5c7cf73244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:47.992729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-453616f6-ce52-44d1-aeb9-fe5c7cf73244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:47.994940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:05:47.996800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:05:47.997259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-453616f6-ce52-44d1-aeb9-fe5c7cf73244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:47.997421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:05:47.999251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-453616f6-ce52-44d1-aeb9-fe5c7cf73244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.165158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:48.187373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.187879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.190557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.192699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.194702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.196881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.272328 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b73570aa-5a19-4de2-8a15-63fa84742189 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "POST /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1/action" status: 202 len: 1109 microversion: 2.1 time: 0.528161 Aug 27 03:05:48.277659 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2520/5191] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:05:47 2022] POST /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1/action => generated 1109 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 03:05:48.305739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dae40dd3-d70d-4e21-90f7-1560e36578d9 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:48.308191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dae40dd3-d70d-4e21-90f7-1560e36578d9 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:48.330583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dae40dd3-d70d-4e21-90f7-1560e36578d9 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.332436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dae40dd3-d70d-4e21-90f7-1560e36578d9 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.333094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dae40dd3-d70d-4e21-90f7-1560e36578d9 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.335104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dae40dd3-d70d-4e21-90f7-1560e36578d9 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.336590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dae40dd3-d70d-4e21-90f7-1560e36578d9 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.347121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dae40dd3-d70d-4e21-90f7-1560e36578d9 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.554604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-453616f6-ce52-44d1-aeb9-fe5c7cf73244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:48.575570 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-453616f6-ce52-44d1-aeb9-fe5c7cf73244 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1375 microversion: 2.1 time: 0.619715 Aug 27 03:05:48.579342 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2672/5192] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:47 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1375 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:48.601693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b2a6ece0-86da-4637-a629-2450086fd451 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:48.604914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b2a6ece0-86da-4637-a629-2450086fd451 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:48.622325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2a6ece0-86da-4637-a629-2450086fd451 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.622903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2a6ece0-86da-4637-a629-2450086fd451 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.626158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2a6ece0-86da-4637-a629-2450086fd451 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.627379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2a6ece0-86da-4637-a629-2450086fd451 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:48.629480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2a6ece0-86da-4637-a629-2450086fd451 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:48.630644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2a6ece0-86da-4637-a629-2450086fd451 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:48.934683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b2a6ece0-86da-4637-a629-2450086fd451 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:48.969926 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b2a6ece0-86da-4637-a629-2450086fd451 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.370289 Aug 27 03:05:48.983675 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2673/5193] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:48 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:48.990502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e4f3ddab-cefe-46a5-a2c2-9eaa319304c6 req-1ff4ccb0-3eb4-483f-8812-c2ff0bfb208e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb3ffe8d-8412-4d9a-b563-7444dcb64ac0", "tag": "cf076202-9d30-4fb6-9be4-e65703281cf6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:49.014578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e4f3ddab-cefe-46a5-a2c2-9eaa319304c6 req-1ff4ccb0-3eb4-483f-8812-c2ff0bfb208e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.016810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e4f3ddab-cefe-46a5-a2c2-9eaa319304c6 req-1ff4ccb0-3eb4-483f-8812-c2ff0bfb208e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.018153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e4f3ddab-cefe-46a5-a2c2-9eaa319304c6 req-1ff4ccb0-3eb4-483f-8812-c2ff0bfb208e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.047021 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e4f3ddab-cefe-46a5-a2c2-9eaa319304c6 req-1ff4ccb0-3eb4-483f-8812-c2ff0bfb208e service nova] Creating event network-changed:cf076202-9d30-4fb6-9be4-e65703281cf6 for instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 on n-h2-852084-5 Aug 27 03:05:49.061601 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e4f3ddab-cefe-46a5-a2c2-9eaa319304c6 req-1ff4ccb0-3eb4-483f-8812-c2ff0bfb208e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084887 Aug 27 03:05:49.062474 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2674/5194] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:49.086510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f89dc1c1-43e7-4720-9726-9802f075d1e2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:49.089425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f89dc1c1-43e7-4720-9726-9802f075d1e2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:49.108992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f89dc1c1-43e7-4720-9726-9802f075d1e2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.109697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f89dc1c1-43e7-4720-9726-9802f075d1e2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.110385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f89dc1c1-43e7-4720-9726-9802f075d1e2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.115140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f89dc1c1-43e7-4720-9726-9802f075d1e2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.115802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f89dc1c1-43e7-4720-9726-9802f075d1e2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.116357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f89dc1c1-43e7-4720-9726-9802f075d1e2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.193179 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f89dc1c1-43e7-4720-9726-9802f075d1e2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127584 Aug 27 03:05:49.199108 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2675/5195] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:05:49 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:49.413244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dae40dd3-d70d-4e21-90f7-1560e36578d9 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:49.427942 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dae40dd3-d70d-4e21-90f7-1560e36578d9 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1314 microversion: 2.1 time: 1.148743 Aug 27 03:05:49.451405 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2521/5196] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:48 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1314 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:49.600098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-645f8320-0249-4b93-893d-77c76dc481a8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:49.601299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-645f8320-0249-4b93-893d-77c76dc481a8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:49.609987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-645f8320-0249-4b93-893d-77c76dc481a8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.615661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-645f8320-0249-4b93-893d-77c76dc481a8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.618259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-645f8320-0249-4b93-893d-77c76dc481a8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.622630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-645f8320-0249-4b93-893d-77c76dc481a8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.623583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-645f8320-0249-4b93-893d-77c76dc481a8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.624359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-645f8320-0249-4b93-893d-77c76dc481a8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.824233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2aef507d-6fd8-4b66-a7da-c00b26ecbc7a req-7b50d26c-7303-4344-a251-b5d63cc1d8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c51b5ce-4d4a-4a54-9e4b-a085176289aa", "tag": "61d2ce65-b4b6-4573-9c45-bc5c800f2e97"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:49.857860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2aef507d-6fd8-4b66-a7da-c00b26ecbc7a req-7b50d26c-7303-4344-a251-b5d63cc1d8d5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:49.860531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2aef507d-6fd8-4b66-a7da-c00b26ecbc7a req-7b50d26c-7303-4344-a251-b5d63cc1d8d5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:49.862382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2aef507d-6fd8-4b66-a7da-c00b26ecbc7a req-7b50d26c-7303-4344-a251-b5d63cc1d8d5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:49.893400 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2aef507d-6fd8-4b66-a7da-c00b26ecbc7a req-7b50d26c-7303-4344-a251-b5d63cc1d8d5 service nova] Creating event network-changed:61d2ce65-b4b6-4573-9c45-bc5c800f2e97 for instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa on n-h1-852084-5 Aug 27 03:05:49.912349 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2aef507d-6fd8-4b66-a7da-c00b26ecbc7a req-7b50d26c-7303-4344-a251-b5d63cc1d8d5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091990 Aug 27 03:05:49.915178 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2522/5197] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:05:49.993736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4045a3b6-c9b1-4f6a-b7c4-ccab33750e00 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:49.994765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4045a3b6-c9b1-4f6a-b7c4-ccab33750e00 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:50.018713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4045a3b6-c9b1-4f6a-b7c4-ccab33750e00 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:50.020849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4045a3b6-c9b1-4f6a-b7c4-ccab33750e00 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:50.022331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4045a3b6-c9b1-4f6a-b7c4-ccab33750e00 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:50.025144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4045a3b6-c9b1-4f6a-b7c4-ccab33750e00 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:50.033062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4045a3b6-c9b1-4f6a-b7c4-ccab33750e00 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:50.034583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4045a3b6-c9b1-4f6a-b7c4-ccab33750e00 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:50.121861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-645f8320-0249-4b93-893d-77c76dc481a8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:50.144471 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-645f8320-0249-4b93-893d-77c76dc481a8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1375 microversion: 2.1 time: 0.548681 Aug 27 03:05:50.152806 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2676/5198] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:49 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1375 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:50.208213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-38ee004e-04b1-4348-a10b-d8085f050031 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:50.211114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-38ee004e-04b1-4348-a10b-d8085f050031 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:50.232326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ee004e-04b1-4348-a10b-d8085f050031 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:50.232805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ee004e-04b1-4348-a10b-d8085f050031 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:50.233266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ee004e-04b1-4348-a10b-d8085f050031 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:50.234043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ee004e-04b1-4348-a10b-d8085f050031 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:50.234511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ee004e-04b1-4348-a10b-d8085f050031 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:50.241966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38ee004e-04b1-4348-a10b-d8085f050031 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:50.307879 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-38ee004e-04b1-4348-a10b-d8085f050031 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104719 Aug 27 03:05:50.312105 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2677/5199] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:05:50 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:50.458667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aa349c01-f89b-4992-9aa6-1453e3169a77 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:50.459306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aa349c01-f89b-4992-9aa6-1453e3169a77 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:50.468217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa349c01-f89b-4992-9aa6-1453e3169a77 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:50.468725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa349c01-f89b-4992-9aa6-1453e3169a77 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:50.469180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa349c01-f89b-4992-9aa6-1453e3169a77 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:50.469945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa349c01-f89b-4992-9aa6-1453e3169a77 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:50.470415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa349c01-f89b-4992-9aa6-1453e3169a77 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:50.470851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa349c01-f89b-4992-9aa6-1453e3169a77 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:50.524584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4045a3b6-c9b1-4f6a-b7c4-ccab33750e00 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:50.560482 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4045a3b6-c9b1-4f6a-b7c4-ccab33750e00 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.572360 Aug 27 03:05:50.562668 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2523/5200] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:49 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:50.774040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa349c01-f89b-4992-9aa6-1453e3169a77 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:50.790681 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aa349c01-f89b-4992-9aa6-1453e3169a77 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1314 microversion: 2.1 time: 0.337205 Aug 27 03:05:50.791872 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2678/5201] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:50 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:50.813514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-fe09dedc-8c58-4fe3-a70a-11f96b68bc7c req-0326af9c-68c0-4926-87b2-e0c700354a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c3d763-3ddc-43de-a4a1-3b5539d71585", "name": "network-vif-plugged", "status": "completed", "tag": "0fbb8c30-c27f-40b7-bb7f-a178fc302163"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:50.843831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fe09dedc-8c58-4fe3-a70a-11f96b68bc7c req-0326af9c-68c0-4926-87b2-e0c700354a1d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:50.844322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fe09dedc-8c58-4fe3-a70a-11f96b68bc7c req-0326af9c-68c0-4926-87b2-e0c700354a1d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:50.844768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fe09dedc-8c58-4fe3-a70a-11f96b68bc7c req-0326af9c-68c0-4926-87b2-e0c700354a1d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:50.871368 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-fe09dedc-8c58-4fe3-a70a-11f96b68bc7c req-0326af9c-68c0-4926-87b2-e0c700354a1d service nova] Creating event network-vif-plugged:0fbb8c30-c27f-40b7-bb7f-a178fc302163 for instance 23c3d763-3ddc-43de-a4a1-3b5539d71585 on n-h2-852084-5 Aug 27 03:05:50.885976 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-fe09dedc-8c58-4fe3-a70a-11f96b68bc7c req-0326af9c-68c0-4926-87b2-e0c700354a1d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077260 Aug 27 03:05:50.889442 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2524/5202] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:51.179455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7bf96b71-8b10-4956-a0c2-7bca37cd6e26 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:51.180141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7bf96b71-8b10-4956-a0c2-7bca37cd6e26 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:51.196821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf96b71-8b10-4956-a0c2-7bca37cd6e26 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.197468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf96b71-8b10-4956-a0c2-7bca37cd6e26 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.198156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf96b71-8b10-4956-a0c2-7bca37cd6e26 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.199086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf96b71-8b10-4956-a0c2-7bca37cd6e26 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.202740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf96b71-8b10-4956-a0c2-7bca37cd6e26 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.203782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf96b71-8b10-4956-a0c2-7bca37cd6e26 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.322150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-02b950c6-f187-47c2-ad36-958d6d70cb91 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:51.324694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-02b950c6-f187-47c2-ad36-958d6d70cb91 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:51.346301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02b950c6-f187-47c2-ad36-958d6d70cb91 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.347075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02b950c6-f187-47c2-ad36-958d6d70cb91 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.347725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02b950c6-f187-47c2-ad36-958d6d70cb91 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.348642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02b950c6-f187-47c2-ad36-958d6d70cb91 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.349521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02b950c6-f187-47c2-ad36-958d6d70cb91 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.350165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02b950c6-f187-47c2-ad36-958d6d70cb91 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.413046 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-02b950c6-f187-47c2-ad36-958d6d70cb91 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095602 Aug 27 03:05:51.418722 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2525/5203] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:05:51 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:51.444579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7bf96b71-8b10-4956-a0c2-7bca37cd6e26 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:51.453081 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7bf96b71-8b10-4956-a0c2-7bca37cd6e26 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1375 microversion: 2.1 time: 0.277638 Aug 27 03:05:51.454394 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2679/5204] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:51 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1375 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:51.583780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ce8f2a9-4121-409e-9d12-6ec3adc573bb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:51.584404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ce8f2a9-4121-409e-9d12-6ec3adc573bb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:51.593087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce8f2a9-4121-409e-9d12-6ec3adc573bb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.593585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce8f2a9-4121-409e-9d12-6ec3adc573bb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.594540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce8f2a9-4121-409e-9d12-6ec3adc573bb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.595377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce8f2a9-4121-409e-9d12-6ec3adc573bb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.596057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce8f2a9-4121-409e-9d12-6ec3adc573bb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.596500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce8f2a9-4121-409e-9d12-6ec3adc573bb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.616113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:51.790291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ce8f2a9-4121-409e-9d12-6ec3adc573bb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:51.800165 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ce8f2a9-4121-409e-9d12-6ec3adc573bb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.220637 Aug 27 03:05:51.801082 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2526/5205] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:51 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:51.817615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c24a7e3-a50b-40d2-8342-accb5f656c19 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:51.818271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c24a7e3-a50b-40d2-8342-accb5f656c19 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:51.825046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c24a7e3-a50b-40d2-8342-accb5f656c19 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.825928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c24a7e3-a50b-40d2-8342-accb5f656c19 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.826468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c24a7e3-a50b-40d2-8342-accb5f656c19 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.827413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c24a7e3-a50b-40d2-8342-accb5f656c19 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:51.828158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c24a7e3-a50b-40d2-8342-accb5f656c19 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:51.829131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c24a7e3-a50b-40d2-8342-accb5f656c19 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:51.997040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1c24a7e3-a50b-40d2-8342-accb5f656c19 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:52.006307 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c24a7e3-a50b-40d2-8342-accb5f656c19 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1314 microversion: 2.1 time: 0.193876 Aug 27 03:05:52.006996 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2680/5206] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:51 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:52.435216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-55288273-8e9e-413d-bbc4-814cfc561b13 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:52.437904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-55288273-8e9e-413d-bbc4-814cfc561b13 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:52.442176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:52.443729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:52.449293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55288273-8e9e-413d-bbc4-814cfc561b13 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:52.450362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55288273-8e9e-413d-bbc4-814cfc561b13 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:52.451132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55288273-8e9e-413d-bbc4-814cfc561b13 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:52.452520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55288273-8e9e-413d-bbc4-814cfc561b13 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:52.453223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55288273-8e9e-413d-bbc4-814cfc561b13 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:52.454138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55288273-8e9e-413d-bbc4-814cfc561b13 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:52.489319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ef3a17b-432d-4fa3-bd8b-43320c1d15e9 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:52.491454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ef3a17b-432d-4fa3-bd8b-43320c1d15e9 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:52.506149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ef3a17b-432d-4fa3-bd8b-43320c1d15e9 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:52.506985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ef3a17b-432d-4fa3-bd8b-43320c1d15e9 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:52.507623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ef3a17b-432d-4fa3-bd8b-43320c1d15e9 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:52.509584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ef3a17b-432d-4fa3-bd8b-43320c1d15e9 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:52.513181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ef3a17b-432d-4fa3-bd8b-43320c1d15e9 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:52.514350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ef3a17b-432d-4fa3-bd8b-43320c1d15e9 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:52.514753 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-55288273-8e9e-413d-bbc4-814cfc561b13 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080719 Aug 27 03:05:52.516232 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2527/5207] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:05:52 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:52.702918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ef3a17b-432d-4fa3-bd8b-43320c1d15e9 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:52.714200 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ef3a17b-432d-4fa3-bd8b-43320c1d15e9 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1375 microversion: 2.1 time: 0.229359 Aug 27 03:05:52.727479 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2681/5208] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:52 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1375 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:52.843021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-60693dc0-ed9a-4a50-b8f1-fe5dbf112456 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:52.846744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-60693dc0-ed9a-4a50-b8f1-fe5dbf112456 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:52.856825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60693dc0-ed9a-4a50-b8f1-fe5dbf112456 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:52.857895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60693dc0-ed9a-4a50-b8f1-fe5dbf112456 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:52.866235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60693dc0-ed9a-4a50-b8f1-fe5dbf112456 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:52.867123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60693dc0-ed9a-4a50-b8f1-fe5dbf112456 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:52.867619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60693dc0-ed9a-4a50-b8f1-fe5dbf112456 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:52.868076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60693dc0-ed9a-4a50-b8f1-fe5dbf112456 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:53.027854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-80e2a23b-401c-4ba3-9dcf-81485f675875 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:53.028854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-80e2a23b-401c-4ba3-9dcf-81485f675875 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:53.031618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=10 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:53.038729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e2a23b-401c-4ba3-9dcf-81485f675875 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.039630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e2a23b-401c-4ba3-9dcf-81485f675875 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.040303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e2a23b-401c-4ba3-9dcf-81485f675875 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:53.041498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e2a23b-401c-4ba3-9dcf-81485f675875 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.042294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e2a23b-401c-4ba3-9dcf-81485f675875 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.042946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e2a23b-401c-4ba3-9dcf-81485f675875 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:53.243427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-80e2a23b-401c-4ba3-9dcf-81485f675875 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:53.252786 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-80e2a23b-401c-4ba3-9dcf-81485f675875 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1498 microversion: 2.1 time: 0.228706 Aug 27 03:05:53.257878 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2682/5209] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:53 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1498 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:53.536203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9a03a8fb-bad3-4125-87e1-1a9fc7760e76 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:53.547668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9a03a8fb-bad3-4125-87e1-1a9fc7760e76 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:53.578543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a03a8fb-bad3-4125-87e1-1a9fc7760e76 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.579576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a03a8fb-bad3-4125-87e1-1a9fc7760e76 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.581786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a03a8fb-bad3-4125-87e1-1a9fc7760e76 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:53.583790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a03a8fb-bad3-4125-87e1-1a9fc7760e76 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.584698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a03a8fb-bad3-4125-87e1-1a9fc7760e76 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.586369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60693dc0-ed9a-4a50-b8f1-fe5dbf112456 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:53.587041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a03a8fb-bad3-4125-87e1-1a9fc7760e76 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:53.602449 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-60693dc0-ed9a-4a50-b8f1-fe5dbf112456 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.765297 Aug 27 03:05:53.604257 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2528/5210] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:52 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:53.705962 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9a03a8fb-bad3-4125-87e1-1a9fc7760e76 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180077 Aug 27 03:05:53.708665 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2683/5211] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:05:53 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:05:53.739180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b538a7e7-d50f-4e16-8092-302d4e89b26b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:53.740107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b538a7e7-d50f-4e16-8092-302d4e89b26b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:53.757338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b538a7e7-d50f-4e16-8092-302d4e89b26b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.758023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b538a7e7-d50f-4e16-8092-302d4e89b26b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.758475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b538a7e7-d50f-4e16-8092-302d4e89b26b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:53.759210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b538a7e7-d50f-4e16-8092-302d4e89b26b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:53.759666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b538a7e7-d50f-4e16-8092-302d4e89b26b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:53.760104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b538a7e7-d50f-4e16-8092-302d4e89b26b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:54.127009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b538a7e7-d50f-4e16-8092-302d4e89b26b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:54.144750 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b538a7e7-d50f-4e16-8092-302d4e89b26b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1375 microversion: 2.1 time: 0.406972 Aug 27 03:05:54.146633 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2529/5212] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:53 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1375 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:54.647097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a12b6210-28bd-40f5-9aa6-0e191dd5c2dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:54.649165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a12b6210-28bd-40f5-9aa6-0e191dd5c2dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:54.658933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12b6210-28bd-40f5-9aa6-0e191dd5c2dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:54.659820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12b6210-28bd-40f5-9aa6-0e191dd5c2dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:54.660558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12b6210-28bd-40f5-9aa6-0e191dd5c2dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:54.661638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12b6210-28bd-40f5-9aa6-0e191dd5c2dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:54.662419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12b6210-28bd-40f5-9aa6-0e191dd5c2dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:54.663210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a12b6210-28bd-40f5-9aa6-0e191dd5c2dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:54.735187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d751378d-5cf0-4177-8c47-b6e21de127c2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:54.739271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d751378d-5cf0-4177-8c47-b6e21de127c2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:54.759795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d751378d-5cf0-4177-8c47-b6e21de127c2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:54.762849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d751378d-5cf0-4177-8c47-b6e21de127c2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:54.765202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d751378d-5cf0-4177-8c47-b6e21de127c2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:54.766238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d751378d-5cf0-4177-8c47-b6e21de127c2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:54.767426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d751378d-5cf0-4177-8c47-b6e21de127c2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:54.768077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d751378d-5cf0-4177-8c47-b6e21de127c2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:54.819307 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d751378d-5cf0-4177-8c47-b6e21de127c2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102080 Aug 27 03:05:54.820594 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2530/5213] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:05:54 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:05:54.984883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a12b6210-28bd-40f5-9aa6-0e191dd5c2dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:54.997637 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a12b6210-28bd-40f5-9aa6-0e191dd5c2dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.358485 Aug 27 03:05:54.999813 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2684/5214] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:54 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:55.175405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c48fea87-d787-447f-b48d-ec5012efb1b2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:55.176637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c48fea87-d787-447f-b48d-ec5012efb1b2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:55.187685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48fea87-d787-447f-b48d-ec5012efb1b2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.188772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48fea87-d787-447f-b48d-ec5012efb1b2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.189391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48fea87-d787-447f-b48d-ec5012efb1b2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.190364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48fea87-d787-447f-b48d-ec5012efb1b2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.190996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48fea87-d787-447f-b48d-ec5012efb1b2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.191734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c48fea87-d787-447f-b48d-ec5012efb1b2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.401518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c48fea87-d787-447f-b48d-ec5012efb1b2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:55.411681 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c48fea87-d787-447f-b48d-ec5012efb1b2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1375 microversion: 2.1 time: 0.245765 Aug 27 03:05:55.413085 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2531/5215] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:55 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1375 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:55.832494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-16e0e2f6-0531-4b4f-9b5b-9474d4386826 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:55.836534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-16e0e2f6-0531-4b4f-9b5b-9474d4386826 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:55.845038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16e0e2f6-0531-4b4f-9b5b-9474d4386826 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.846050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16e0e2f6-0531-4b4f-9b5b-9474d4386826 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.846926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16e0e2f6-0531-4b4f-9b5b-9474d4386826 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.847698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16e0e2f6-0531-4b4f-9b5b-9474d4386826 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.848351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16e0e2f6-0531-4b4f-9b5b-9474d4386826 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.848969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16e0e2f6-0531-4b4f-9b5b-9474d4386826 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.890644 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-16e0e2f6-0531-4b4f-9b5b-9474d4386826 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062734 Aug 27 03:05:55.892866 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2685/5216] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:05:55 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:05:55.983531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-77fb76ae-904f-4686-9c64-187cc8650aa2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:55.983844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-77fb76ae-904f-4686-9c64-187cc8650aa2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:55.991718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77fb76ae-904f-4686-9c64-187cc8650aa2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.992539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77fb76ae-904f-4686-9c64-187cc8650aa2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.992993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77fb76ae-904f-4686-9c64-187cc8650aa2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:55.993747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77fb76ae-904f-4686-9c64-187cc8650aa2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:55.994218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77fb76ae-904f-4686-9c64-187cc8650aa2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:55.994945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77fb76ae-904f-4686-9c64-187cc8650aa2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.021064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-55b0db0b-dcfa-48ba-ace2-e4e9c89a5e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:56.021715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-55b0db0b-dcfa-48ba-ace2-e4e9c89a5e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:56.035860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55b0db0b-dcfa-48ba-ace2-e4e9c89a5e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.036466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55b0db0b-dcfa-48ba-ace2-e4e9c89a5e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.036928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55b0db0b-dcfa-48ba-ace2-e4e9c89a5e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.037698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55b0db0b-dcfa-48ba-ace2-e4e9c89a5e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.038170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55b0db0b-dcfa-48ba-ace2-e4e9c89a5e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.038609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55b0db0b-dcfa-48ba-ace2-e4e9c89a5e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.092988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-77fb76ae-904f-4686-9c64-187cc8650aa2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:05:56.298782 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-77fb76ae-904f-4686-9c64-187cc8650aa2 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 204 len: 0 microversion: 2.1 time: 0.319457 Aug 27 03:05:56.300139 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2532/5217] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:05:55 2022] DELETE /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:05:56.315666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b81c77a-22cb-4496-9380-cc7938565a0c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:56.321264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b81c77a-22cb-4496-9380-cc7938565a0c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:56.346339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b81c77a-22cb-4496-9380-cc7938565a0c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.346751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b81c77a-22cb-4496-9380-cc7938565a0c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.347198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b81c77a-22cb-4496-9380-cc7938565a0c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.347924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b81c77a-22cb-4496-9380-cc7938565a0c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.348386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b81c77a-22cb-4496-9380-cc7938565a0c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.348815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b81c77a-22cb-4496-9380-cc7938565a0c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.545886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-55b0db0b-dcfa-48ba-ace2-e4e9c89a5e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:56.559178 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-55b0db0b-dcfa-48ba-ace2-e4e9c89a5e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.542128 Aug 27 03:05:56.559791 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2686/5218] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:56 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:56.567996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-09aeccf6-51de-4604-b6c3-ebc9a6a814de tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:56.568683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-09aeccf6-51de-4604-b6c3-ebc9a6a814de tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:56.578167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09aeccf6-51de-4604-b6c3-ebc9a6a814de tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.578659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09aeccf6-51de-4604-b6c3-ebc9a6a814de tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.579579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09aeccf6-51de-4604-b6c3-ebc9a6a814de tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.581230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09aeccf6-51de-4604-b6c3-ebc9a6a814de tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:56.581935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09aeccf6-51de-4604-b6c3-ebc9a6a814de tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:56.583040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09aeccf6-51de-4604-b6c3-ebc9a6a814de tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:56.589949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:05:56.620207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b81c77a-22cb-4496-9380-cc7938565a0c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:56.633076 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b81c77a-22cb-4496-9380-cc7938565a0c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1683 microversion: 2.1 time: 0.327457 Aug 27 03:05:56.634043 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2533/5219] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:56 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1683 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:56.836940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-09aeccf6-51de-4604-b6c3-ebc9a6a814de tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:56.848373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-09aeccf6-51de-4604-b6c3-ebc9a6a814de tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1375 microversion: 2.1 time: 0.285212 Aug 27 03:05:56.849561 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2687/5220] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:56 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1375 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:57.528940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a9595fc3-aa29-4396-8f44-2503d92bc416 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:57.530739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a9595fc3-aa29-4396-8f44-2503d92bc416 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:57.539500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9595fc3-aa29-4396-8f44-2503d92bc416 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.540102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9595fc3-aa29-4396-8f44-2503d92bc416 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.540560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9595fc3-aa29-4396-8f44-2503d92bc416 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.541600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9595fc3-aa29-4396-8f44-2503d92bc416 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.542153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9595fc3-aa29-4396-8f44-2503d92bc416 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.542608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a9595fc3-aa29-4396-8f44-2503d92bc416 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.570528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a9595fc3-aa29-4396-8f44-2503d92bc416 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:05:57.584140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d95e70d4-b2cc-46d3-8d05-63953fdc9f38 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:57.585258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d95e70d4-b2cc-46d3-8d05-63953fdc9f38 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:57.594309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d95e70d4-b2cc-46d3-8d05-63953fdc9f38 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.595091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d95e70d4-b2cc-46d3-8d05-63953fdc9f38 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.595750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d95e70d4-b2cc-46d3-8d05-63953fdc9f38 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.596632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d95e70d4-b2cc-46d3-8d05-63953fdc9f38 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.597257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d95e70d4-b2cc-46d3-8d05-63953fdc9f38 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.597890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d95e70d4-b2cc-46d3-8d05-63953fdc9f38 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.692105 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a9595fc3-aa29-4396-8f44-2503d92bc416 tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "DELETE /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 204 len: 0 microversion: 2.1 time: 0.165276 Aug 27 03:05:57.698217 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2534/5221] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:05:57 2022] DELETE /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:05:57.708403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f46652a8-f28b-4a18-8de8-359fe1c2d937 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:57.709258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f46652a8-f28b-4a18-8de8-359fe1c2d937 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:57.726747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f46652a8-f28b-4a18-8de8-359fe1c2d937 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.727260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f46652a8-f28b-4a18-8de8-359fe1c2d937 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.729432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f46652a8-f28b-4a18-8de8-359fe1c2d937 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.730418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f46652a8-f28b-4a18-8de8-359fe1c2d937 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.732333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f46652a8-f28b-4a18-8de8-359fe1c2d937 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.733526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f46652a8-f28b-4a18-8de8-359fe1c2d937 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.788511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d95e70d4-b2cc-46d3-8d05-63953fdc9f38 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:57.798591 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d95e70d4-b2cc-46d3-8d05-63953fdc9f38 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.218915 Aug 27 03:05:57.799192 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2688/5222] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:57 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:57.804900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a3f17fea-43e3-45b0-b602-2cc817b9937a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:57.805847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a3f17fea-43e3-45b0-b602-2cc817b9937a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:57.813162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3f17fea-43e3-45b0-b602-2cc817b9937a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.814419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3f17fea-43e3-45b0-b602-2cc817b9937a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.815713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3f17fea-43e3-45b0-b602-2cc817b9937a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.816819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3f17fea-43e3-45b0-b602-2cc817b9937a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:57.817499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3f17fea-43e3-45b0-b602-2cc817b9937a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:57.818467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a3f17fea-43e3-45b0-b602-2cc817b9937a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:57.998698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f46652a8-f28b-4a18-8de8-359fe1c2d937 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:58.007627 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f46652a8-f28b-4a18-8de8-359fe1c2d937 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1683 microversion: 2.1 time: 0.306445 Aug 27 03:05:58.010486 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2535/5223] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:57 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1683 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:58.026149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a3f17fea-43e3-45b0-b602-2cc817b9937a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:58.026977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2b3ea66b-0e63-493a-bbb0-ecc168acc663 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:58.026977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2b3ea66b-0e63-493a-bbb0-ecc168acc663 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:58.027355 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a3f17fea-43e3-45b0-b602-2cc817b9937a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1504 microversion: 2.1 time: 0.224875 Aug 27 03:05:58.028168 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2689/5224] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:57 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:58.036722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b3ea66b-0e63-493a-bbb0-ecc168acc663 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:58.037278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b3ea66b-0e63-493a-bbb0-ecc168acc663 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:58.037772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b3ea66b-0e63-493a-bbb0-ecc168acc663 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:58.038583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b3ea66b-0e63-493a-bbb0-ecc168acc663 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:58.039208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b3ea66b-0e63-493a-bbb0-ecc168acc663 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:58.039648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b3ea66b-0e63-493a-bbb0-ecc168acc663 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:58.108479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-31413505-f0eb-4de2-bd7b-e667a68b7902 req-031a7068-2c16-4fca-9b4a-526d13010f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c51b5ce-4d4a-4a54-9e4b-a085176289aa", "name": "network-vif-plugged", "status": "completed", "tag": "61d2ce65-b4b6-4573-9c45-bc5c800f2e97"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:58.118765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-31413505-f0eb-4de2-bd7b-e667a68b7902 req-031a7068-2c16-4fca-9b4a-526d13010f12 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:58.119652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-31413505-f0eb-4de2-bd7b-e667a68b7902 req-031a7068-2c16-4fca-9b4a-526d13010f12 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:58.120325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-31413505-f0eb-4de2-bd7b-e667a68b7902 req-031a7068-2c16-4fca-9b4a-526d13010f12 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:58.135196 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-31413505-f0eb-4de2-bd7b-e667a68b7902 req-031a7068-2c16-4fca-9b4a-526d13010f12 service nova] Creating event network-vif-plugged:61d2ce65-b4b6-4573-9c45-bc5c800f2e97 for instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa on n-h1-852084-5 Aug 27 03:05:58.146703 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-31413505-f0eb-4de2-bd7b-e667a68b7902 req-031a7068-2c16-4fca-9b4a-526d13010f12 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041858 Aug 27 03:05:58.147980 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2690/5225] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:05:58.398675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2b3ea66b-0e63-493a-bbb0-ecc168acc663 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:58.407319 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2b3ea66b-0e63-493a-bbb0-ecc168acc663 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1375 microversion: 2.1 time: 0.395718 Aug 27 03:05:58.407908 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2536/5226] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:58 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1375 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:58.820226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d7db7df-3b9c-472f-9603-fb433d2a9ae0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:58.821238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d7db7df-3b9c-472f-9603-fb433d2a9ae0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:58.829323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d7db7df-3b9c-472f-9603-fb433d2a9ae0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:58.830138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d7db7df-3b9c-472f-9603-fb433d2a9ae0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:58.830761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d7db7df-3b9c-472f-9603-fb433d2a9ae0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:58.831641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d7db7df-3b9c-472f-9603-fb433d2a9ae0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:58.832268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d7db7df-3b9c-472f-9603-fb433d2a9ae0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:58.832884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d7db7df-3b9c-472f-9603-fb433d2a9ae0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.021649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2d7db7df-3b9c-472f-9603-fb433d2a9ae0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:59.030420 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2d7db7df-3b9c-472f-9603-fb433d2a9ae0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.214481 Aug 27 03:05:59.045840 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2691/5227] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:58 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:05:59.050562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-076177ea-0a6d-48a1-9716-11c059315090 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:59.051263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-076177ea-0a6d-48a1-9716-11c059315090 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:59.059558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-00a61cdd-040e-454c-95ab-0258b9805c7c tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:59.059754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-076177ea-0a6d-48a1-9716-11c059315090 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.060284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-076177ea-0a6d-48a1-9716-11c059315090 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.061369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-00a61cdd-040e-454c-95ab-0258b9805c7c tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:59.062517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-076177ea-0a6d-48a1-9716-11c059315090 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.063485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-076177ea-0a6d-48a1-9716-11c059315090 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.064187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-076177ea-0a6d-48a1-9716-11c059315090 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.064850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-076177ea-0a6d-48a1-9716-11c059315090 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.069164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00a61cdd-040e-454c-95ab-0258b9805c7c tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.069755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00a61cdd-040e-454c-95ab-0258b9805c7c tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.070491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00a61cdd-040e-454c-95ab-0258b9805c7c tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.071205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00a61cdd-040e-454c-95ab-0258b9805c7c tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.071724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00a61cdd-040e-454c-95ab-0258b9805c7c tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.072347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00a61cdd-040e-454c-95ab-0258b9805c7c tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.328612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-00a61cdd-040e-454c-95ab-0258b9805c7c tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:59.348116 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-00a61cdd-040e-454c-95ab-0258b9805c7c tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1504 microversion: 2.1 time: 0.292047 Aug 27 03:05:59.350139 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2692/5228] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:59 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:59.410673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-076177ea-0a6d-48a1-9716-11c059315090 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:59.420315 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-076177ea-0a6d-48a1-9716-11c059315090 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1683 microversion: 2.1 time: 0.373065 Aug 27 03:05:59.430133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d88fb476-edf4-41b6-b88d-aa0f5b0f73f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:05:59.430437 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2537/5229] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:59 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1683 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:59.434858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d88fb476-edf4-41b6-b88d-aa0f5b0f73f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:05:59.440466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d88fb476-edf4-41b6-b88d-aa0f5b0f73f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.441451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d88fb476-edf4-41b6-b88d-aa0f5b0f73f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.441875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d88fb476-edf4-41b6-b88d-aa0f5b0f73f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.442779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d88fb476-edf4-41b6-b88d-aa0f5b0f73f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.443406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d88fb476-edf4-41b6-b88d-aa0f5b0f73f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.444027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d88fb476-edf4-41b6-b88d-aa0f5b0f73f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.728097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d88fb476-edf4-41b6-b88d-aa0f5b0f73f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:05:59.740080 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d88fb476-edf4-41b6-b88d-aa0f5b0f73f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1375 microversion: 2.1 time: 0.317033 Aug 27 03:05:59.741209 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2693/5230] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:05:59 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1375 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:05:59.961958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ec514dd7-ddad-41a4-a64a-eab46cc4272a req-8fd01302-4a7f-4000-baf1-5c607cc5337c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c3d763-3ddc-43de-a4a1-3b5539d71585", "name": "network-vif-deleted", "tag": "0fbb8c30-c27f-40b7-bb7f-a178fc302163"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:05:59.975067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ec514dd7-ddad-41a4-a64a-eab46cc4272a req-8fd01302-4a7f-4000-baf1-5c607cc5337c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:05:59.975848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ec514dd7-ddad-41a4-a64a-eab46cc4272a req-8fd01302-4a7f-4000-baf1-5c607cc5337c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:05:59.976456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ec514dd7-ddad-41a4-a64a-eab46cc4272a req-8fd01302-4a7f-4000-baf1-5c607cc5337c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:05:59.992112 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ec514dd7-ddad-41a4-a64a-eab46cc4272a req-8fd01302-4a7f-4000-baf1-5c607cc5337c service nova] Creating event network-vif-deleted:0fbb8c30-c27f-40b7-bb7f-a178fc302163 for instance 23c3d763-3ddc-43de-a4a1-3b5539d71585 on n-h2-852084-5 Aug 27 03:05:59.998811 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ec514dd7-ddad-41a4-a64a-eab46cc4272a req-8fd01302-4a7f-4000-baf1-5c607cc5337c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042215 Aug 27 03:06:00.005386 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2538/5231] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:00.055816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2cfec92d-98c5-476c-986b-bd2c765f5f12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:00.056828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2cfec92d-98c5-476c-986b-bd2c765f5f12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:00.071805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cfec92d-98c5-476c-986b-bd2c765f5f12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.072522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cfec92d-98c5-476c-986b-bd2c765f5f12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.073216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cfec92d-98c5-476c-986b-bd2c765f5f12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.074231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cfec92d-98c5-476c-986b-bd2c765f5f12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.074703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cfec92d-98c5-476c-986b-bd2c765f5f12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.075170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cfec92d-98c5-476c-986b-bd2c765f5f12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.359858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2cfec92d-98c5-476c-986b-bd2c765f5f12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:00.374730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:00.376192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:00.398003 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2cfec92d-98c5-476c-986b-bd2c765f5f12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.347682 Aug 27 03:06:00.400190 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2694/5232] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:00 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:00.402793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.403791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.404520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.405521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.406325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.406983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.442992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cd950271-fff6-4632-b640-456b4870b71f tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:00.444462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cd950271-fff6-4632-b640-456b4870b71f tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:00.455871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd950271-fff6-4632-b640-456b4870b71f tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.456773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd950271-fff6-4632-b640-456b4870b71f tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.457519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd950271-fff6-4632-b640-456b4870b71f tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.459870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd950271-fff6-4632-b640-456b4870b71f tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.461119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd950271-fff6-4632-b640-456b4870b71f tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.463392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cd950271-fff6-4632-b640-456b4870b71f tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.470842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.471494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.472041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.472616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lazy-loading 'fault' on Instance uuid 23c3d763-3ddc-43de-a4a1-3b5539d71585 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:06:00.572231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cd950271-fff6-4632-b640-456b4870b71f tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:00.585228 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cd950271-fff6-4632-b640-456b4870b71f tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1615 microversion: 2.1 time: 0.145873 Aug 27 03:06:00.586136 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2695/5233] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:00 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1615 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:00.653104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a0ca761c-b635-4891-8b51-86a8c8e835c0 req-6f703462-32a1-45ec-8fc3-bb2954171d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3532336-1c3d-4c13-9a8c-7009050f3677", "name": "network-vif-deleted", "tag": "9229f16e-2d12-4c5a-83de-3ae112a3f782"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:00.677314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0ca761c-b635-4891-8b51-86a8c8e835c0 req-6f703462-32a1-45ec-8fc3-bb2954171d84 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.679407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0ca761c-b635-4891-8b51-86a8c8e835c0 req-6f703462-32a1-45ec-8fc3-bb2954171d84 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.680559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7deda8ad3c8a4889b0eea21df713cdc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bf2e17c663424da0d97c832aeffc78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:00.682870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0ca761c-b635-4891-8b51-86a8c8e835c0 req-6f703462-32a1-45ec-8fc3-bb2954171d84 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.691462 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-80d5556b-4a38-4661-be60-5d2efb5f1a4a tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 200 len: 1304 microversion: 2.1 time: 0.323429 Aug 27 03:06:00.696034 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2539/5234] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:00 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 1304 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:00.730934 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a0ca761c-b635-4891-8b51-86a8c8e835c0 req-6f703462-32a1-45ec-8fc3-bb2954171d84 service nova] Creating event network-vif-deleted:9229f16e-2d12-4c5a-83de-3ae112a3f782 for instance f3532336-1c3d-4c13-9a8c-7009050f3677 on n-h1-852084-5 Aug 27 03:06:00.764279 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a0ca761c-b635-4891-8b51-86a8c8e835c0 req-6f703462-32a1-45ec-8fc3-bb2954171d84 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116184 Aug 27 03:06:00.767444 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2696/5235] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:06:00.770134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e991e30f-e7b8-42be-8fb4-69cd7e193bf2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:00.771129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e991e30f-e7b8-42be-8fb4-69cd7e193bf2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:00.780284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e991e30f-e7b8-42be-8fb4-69cd7e193bf2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.781175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e991e30f-e7b8-42be-8fb4-69cd7e193bf2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.781863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e991e30f-e7b8-42be-8fb4-69cd7e193bf2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.782755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e991e30f-e7b8-42be-8fb4-69cd7e193bf2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:00.783535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e991e30f-e7b8-42be-8fb4-69cd7e193bf2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:00.784919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e991e30f-e7b8-42be-8fb4-69cd7e193bf2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:00.792664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:01.181408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e991e30f-e7b8-42be-8fb4-69cd7e193bf2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:01.190810 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e991e30f-e7b8-42be-8fb4-69cd7e193bf2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1547 microversion: 2.1 time: 0.427122 Aug 27 03:06:01.209147 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2540/5236] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:00 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1547 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:01.214342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aeac3e07-ed64-47a8-834c-d3919d8daf9b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:01.215705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aeac3e07-ed64-47a8-834c-d3919d8daf9b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:01.224751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeac3e07-ed64-47a8-834c-d3919d8daf9b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.225540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeac3e07-ed64-47a8-834c-d3919d8daf9b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.226172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeac3e07-ed64-47a8-834c-d3919d8daf9b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.227113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeac3e07-ed64-47a8-834c-d3919d8daf9b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.227736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeac3e07-ed64-47a8-834c-d3919d8daf9b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.228343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aeac3e07-ed64-47a8-834c-d3919d8daf9b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.420770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd1d8031-065e-4a39-a8f7-67d56f5a62df tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:01.422251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bd1d8031-065e-4a39-a8f7-67d56f5a62df tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:01.437510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd1d8031-065e-4a39-a8f7-67d56f5a62df tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.438469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd1d8031-065e-4a39-a8f7-67d56f5a62df tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.439558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd1d8031-065e-4a39-a8f7-67d56f5a62df tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.442011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd1d8031-065e-4a39-a8f7-67d56f5a62df tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.442746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd1d8031-065e-4a39-a8f7-67d56f5a62df tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.446109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd1d8031-065e-4a39-a8f7-67d56f5a62df tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.514383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aeac3e07-ed64-47a8-834c-d3919d8daf9b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:01.530715 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aeac3e07-ed64-47a8-834c-d3919d8daf9b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1547 microversion: 2.1 time: 0.321329 Aug 27 03:06:01.532530 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2697/5237] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:01 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1547 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:01.607127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:01.608404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:01.628158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.628561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.629020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.629823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.630367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.630982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.713190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.713792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.714338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.715253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lazy-loading 'fault' on Instance uuid f3532336-1c3d-4c13-9a8c-7009050f3677 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:06:01.771488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f857fc243b43379c9255e7b9ea1c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86535f98bba34254aca1089f8a2ea8fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:01.788159 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-acf2a1b7-eafc-46da-ba9a-1c8cee30e78e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 200 len: 1331 microversion: 2.1 time: 0.185029 Aug 27 03:06:01.789471 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2698/5238] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:01 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 1331 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:01.795519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:01.796156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] [instance: 23c3d763-3ddc-43de-a4a1-3b5539d71585] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:01.803844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.804430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.805063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.806192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:01.806875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:01.807466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:01.825880 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] HTTP exception thrown: Instance 23c3d763-3ddc-43de-a4a1-3b5539d71585 could not be found. Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Request method failure captured: Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 HTTP/1.1 Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYn4yM7pGpNg91wvydxNpOunNA6nUZDL9kpT2Co5RCpvW3Ou3crw4O5rUYFoAeRicBL_v8qcQkwV3KVj0BT4AMR_EGzmmAzpC0gZtUkBkABvHLzAl95Z6vM-f4KQYtSge2MManr5pijkGdzVkC3zWsFavBO0kfIep9rEaC7g9ljruvE Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 08bf2e17c663424da0d97c832aeffc78 Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-VolumesActionsTest-1728625789 Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_08bf2e17c663424da0d97c832aeffc78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/08bf2e17c663424da0d97c832aeffc78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/08bf2e17c663424da0d97c832aeffc78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/08bf2e17c663424da0d97c832aeffc78"}]}] Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-VolumesActionsTest-1728625789 Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 08bf2e17c663424da0d97c832aeffc78 Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-VolumesActionsTest-1728625789 Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-VolumesActionsTest-1728625789-project Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 7deda8ad3c8a4889b0eea21df713cdc6 Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-VolumesActionsTest-1728625789-project Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 23c3d763-3ddc-43de-a4a1-3b5539d71585 could not be found. Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '23c3d763-3ddc-43de-a4a1-3b5539d71585'} Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c3d763-3ddc-43de-a4a1-3b5539d71585 could not be found. Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c3d763-3ddc-43de-a4a1-3b5539d71585 could not be found. Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:01.828554 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:01.841237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:01.841237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:01.841237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:01.841237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:01.841237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:01.841237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c3d763-3ddc-43de-a4a1-3b5539d71585 could not be found. Aug 27 03:06:01.841237 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:01.844618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] Returning 404 to user: Instance 23c3d763-3ddc-43de-a4a1-3b5539d71585 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:01.845001 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d7c7cab8-94ae-47e7-978d-0b2fc6251aae tempest-VolumesActionsTest-1728625789 tempest-VolumesActionsTest-1728625789-project] 10.222.0.99 "GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585" status: 404 len: 111 microversion: 2.1 time: 0.054115 Aug 27 03:06:01.846933 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2699/5239] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:01 2022] GET /compute/v2.1/servers/23c3d763-3ddc-43de-a4a1-3b5539d71585 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:02.454081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd1d8031-065e-4a39-a8f7-67d56f5a62df tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:02.487608 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd1d8031-065e-4a39-a8f7-67d56f5a62df tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 1.063336 Aug 27 03:06:02.488874 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2541/5240] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:01 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:02.812181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:02.812920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:02.834762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:02.837841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:02.838447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:02.840888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:02.842436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:02.843162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:02.899499 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 HTTP/1.1 Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f3532336-1c3d-4c13-9a8c-7009050f3677'} Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:02.901531 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:02.908000 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:02.908000 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:02.908000 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:02.908000 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:02.908000 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:02.908000 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:02.908000 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:02.911546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:02.913398 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ea9139c-4f23-43b3-836a-159085f870c6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 404 len: 111 microversion: 2.1 time: 0.106773 Aug 27 03:06:02.915334 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2700/5241] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:02 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:02.925925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a0610a2-5a1c-4194-8390-d70116c5af83 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '.version_select at 0x7f4d2a7b30d0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:02.958134 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6a0610a2-5a1c-4194-8390-d70116c5af83 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-357164596" status: 202 len: 0 microversion: 2.1 time: 0.036593 Aug 27 03:06:02.959644 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2542/5242] 10.222.0.99 () {58 vars in 1218 bytes} [Sat Aug 27 03:06:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-357164596 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:06:03.511354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-24555c27-4824-4357-8485-b60210e5577f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:03.512122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-24555c27-4824-4357-8485-b60210e5577f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:03.545923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24555c27-4824-4357-8485-b60210e5577f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:03.545923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24555c27-4824-4357-8485-b60210e5577f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:03.545923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24555c27-4824-4357-8485-b60210e5577f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:03.545923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24555c27-4824-4357-8485-b60210e5577f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:03.545923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24555c27-4824-4357-8485-b60210e5577f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:03.545923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24555c27-4824-4357-8485-b60210e5577f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:03.907676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-24555c27-4824-4357-8485-b60210e5577f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:03.920198 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-24555c27-4824-4357-8485-b60210e5577f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.413537 Aug 27 03:06:03.931197 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2701/5243] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:03 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:04.946262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-84612e97-631c-47f7-8f48-a8e5fe3b2556 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:04.946903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-84612e97-631c-47f7-8f48-a8e5fe3b2556 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:04.966204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84612e97-631c-47f7-8f48-a8e5fe3b2556 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.967684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84612e97-631c-47f7-8f48-a8e5fe3b2556 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.968365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84612e97-631c-47f7-8f48-a8e5fe3b2556 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:04.972029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84612e97-631c-47f7-8f48-a8e5fe3b2556 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:04.974979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84612e97-631c-47f7-8f48-a8e5fe3b2556 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:04.975716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84612e97-631c-47f7-8f48-a8e5fe3b2556 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:05.268203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-84612e97-631c-47f7-8f48-a8e5fe3b2556 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:05.281327 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-84612e97-631c-47f7-8f48-a8e5fe3b2556 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.340071 Aug 27 03:06:05.285769 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2543/5244] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:04 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:05.876370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a8bb8209-6927-4202-ad29-666048a69dff req-e93098b8-ea25-499e-8eea-5be324b84940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c51b5ce-4d4a-4a54-9e4b-a085176289aa", "tag": "61d2ce65-b4b6-4573-9c45-bc5c800f2e97"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:05.892838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a8bb8209-6927-4202-ad29-666048a69dff req-e93098b8-ea25-499e-8eea-5be324b84940 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:05.893772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a8bb8209-6927-4202-ad29-666048a69dff req-e93098b8-ea25-499e-8eea-5be324b84940 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:05.895046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a8bb8209-6927-4202-ad29-666048a69dff req-e93098b8-ea25-499e-8eea-5be324b84940 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:05.913423 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a8bb8209-6927-4202-ad29-666048a69dff req-e93098b8-ea25-499e-8eea-5be324b84940 service nova] Creating event network-changed:61d2ce65-b4b6-4573-9c45-bc5c800f2e97 for instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa on n-h1-852084-5 Aug 27 03:06:05.920710 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a8bb8209-6927-4202-ad29-666048a69dff req-e93098b8-ea25-499e-8eea-5be324b84940 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051169 Aug 27 03:06:05.921619 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2702/5245] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:06.317050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-faa0ffb7-ed47-4574-84a4-bcb57b664bef tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:06.318711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-faa0ffb7-ed47-4574-84a4-bcb57b664bef tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:06.335962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-faa0ffb7-ed47-4574-84a4-bcb57b664bef tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.342230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-faa0ffb7-ed47-4574-84a4-bcb57b664bef tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.343066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-faa0ffb7-ed47-4574-84a4-bcb57b664bef tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:06.344091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-faa0ffb7-ed47-4574-84a4-bcb57b664bef tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:06.344826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-faa0ffb7-ed47-4574-84a4-bcb57b664bef tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:06.353053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-faa0ffb7-ed47-4574-84a4-bcb57b664bef tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:06.907266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-faa0ffb7-ed47-4574-84a4-bcb57b664bef tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:06.917504 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-faa0ffb7-ed47-4574-84a4-bcb57b664bef tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.604419 Aug 27 03:06:06.923544 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2544/5246] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:06 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:07.954150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-db919713-64db-4951-85a6-0a9a3283203b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:07.955096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-db919713-64db-4951-85a6-0a9a3283203b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:07.978564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db919713-64db-4951-85a6-0a9a3283203b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:07.980710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db919713-64db-4951-85a6-0a9a3283203b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:07.981411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db919713-64db-4951-85a6-0a9a3283203b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:07.986680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db919713-64db-4951-85a6-0a9a3283203b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:07.987928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db919713-64db-4951-85a6-0a9a3283203b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:07.989279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db919713-64db-4951-85a6-0a9a3283203b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:08.369515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-db919713-64db-4951-85a6-0a9a3283203b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:08.384867 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-db919713-64db-4951-85a6-0a9a3283203b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.436060 Aug 27 03:06:08.385479 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2703/5247] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:07 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:09.406558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7883370-f926-4219-b958-2995e4eae898 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:09.408213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c7883370-f926-4219-b958-2995e4eae898 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:09.417278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7883370-f926-4219-b958-2995e4eae898 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:09.420568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7883370-f926-4219-b958-2995e4eae898 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:09.430445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7883370-f926-4219-b958-2995e4eae898 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:09.432119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7883370-f926-4219-b958-2995e4eae898 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:09.432917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7883370-f926-4219-b958-2995e4eae898 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:09.433581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7883370-f926-4219-b958-2995e4eae898 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:09.870248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c7883370-f926-4219-b958-2995e4eae898 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:09.879910 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c7883370-f926-4219-b958-2995e4eae898 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.477551 Aug 27 03:06:09.880517 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2545/5248] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:09 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:10.821776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:10.822347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:10.834401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.834782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.835473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.838909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.842020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.843325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.860818 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 HTTP/1.1 Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f3532336-1c3d-4c13-9a8c-7009050f3677'} Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:10.863093 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fd4bf2b8-0bf4-42d7-952c-6b2ae469374c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 404 len: 111 microversion: 2.1 time: 0.051557 Aug 27 03:06:10.871088 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2704/5249] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:10 2022] DELETE /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:06:10.873042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:10.873980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f3532336-1c3d-4c13-9a8c-7009050f3677] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:10.883515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.884024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.886037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.887011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.887548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.888905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.903763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4dddcba4-fb4b-4b04-9514-06498fd187ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:10.905000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4dddcba4-fb4b-4b04-9514-06498fd187ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:10.929373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dddcba4-fb4b-4b04-9514-06498fd187ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.934629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dddcba4-fb4b-4b04-9514-06498fd187ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.945146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dddcba4-fb4b-4b04-9514-06498fd187ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.945978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dddcba4-fb4b-4b04-9514-06498fd187ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:10.946473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dddcba4-fb4b-4b04-9514-06498fd187ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:10.947077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dddcba4-fb4b-4b04-9514-06498fd187ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:10.948174 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 HTTP/1.1 Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f3532336-1c3d-4c13-9a8c-7009050f3677'} Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:10.956596 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.961029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:10.961029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:10.961029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:10.961029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:10.961029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:10.961029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. Aug 27 03:06:10.961029 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:10.961029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance f3532336-1c3d-4c13-9a8c-7009050f3677 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:10.961029 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1834e14e-34a9-4556-a0b7-26791c467bbc tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677" status: 404 len: 111 microversion: 2.1 time: 0.090857 Aug 27 03:06:10.967256 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2546/5250] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:10 2022] GET /compute/v2.1/servers/f3532336-1c3d-4c13-9a8c-7009050f3677 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:11.257845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4dddcba4-fb4b-4b04-9514-06498fd187ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:11.268088 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4dddcba4-fb4b-4b04-9514-06498fd187ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.368291 Aug 27 03:06:11.270147 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2705/5251] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:10 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:12.291322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ec555b2d-861b-49a2-ad5a-5ccedf0ba9d4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:12.292371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ec555b2d-861b-49a2-ad5a-5ccedf0ba9d4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:12.295726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:12.309449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec555b2d-861b-49a2-ad5a-5ccedf0ba9d4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:12.311633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec555b2d-861b-49a2-ad5a-5ccedf0ba9d4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:12.312313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec555b2d-861b-49a2-ad5a-5ccedf0ba9d4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:12.313639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec555b2d-861b-49a2-ad5a-5ccedf0ba9d4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:12.314391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec555b2d-861b-49a2-ad5a-5ccedf0ba9d4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:12.315056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec555b2d-861b-49a2-ad5a-5ccedf0ba9d4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:12.559604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ec555b2d-861b-49a2-ad5a-5ccedf0ba9d4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:12.592647 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ec555b2d-861b-49a2-ad5a-5ccedf0ba9d4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.286352 Aug 27 03:06:12.594237 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2547/5252] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:12 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:13.619200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6c418697-7b95-4376-97c1-a9e155e65a66 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:13.620719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6c418697-7b95-4376-97c1-a9e155e65a66 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:13.636999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c418697-7b95-4376-97c1-a9e155e65a66 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.640277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c418697-7b95-4376-97c1-a9e155e65a66 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.641729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c418697-7b95-4376-97c1-a9e155e65a66 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.643578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c418697-7b95-4376-97c1-a9e155e65a66 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:13.646356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c418697-7b95-4376-97c1-a9e155e65a66 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:13.647055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c418697-7b95-4376-97c1-a9e155e65a66 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:13.907693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6c418697-7b95-4376-97c1-a9e155e65a66 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:13.922310 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6c418697-7b95-4376-97c1-a9e155e65a66 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.309734 Aug 27 03:06:13.926702 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2706/5253] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:13 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:14.953362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de06e82a-8b08-43ca-87c1-bf1d4e1abe03 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:14.954196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de06e82a-8b08-43ca-87c1-bf1d4e1abe03 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:14.968892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de06e82a-8b08-43ca-87c1-bf1d4e1abe03 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:14.975174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de06e82a-8b08-43ca-87c1-bf1d4e1abe03 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:14.976269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de06e82a-8b08-43ca-87c1-bf1d4e1abe03 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:14.977150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de06e82a-8b08-43ca-87c1-bf1d4e1abe03 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:14.979619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de06e82a-8b08-43ca-87c1-bf1d4e1abe03 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:14.981251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de06e82a-8b08-43ca-87c1-bf1d4e1abe03 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.288812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de06e82a-8b08-43ca-87c1-bf1d4e1abe03 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:15.305621 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de06e82a-8b08-43ca-87c1-bf1d4e1abe03 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.357970 Aug 27 03:06:15.306689 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2548/5254] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:14 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:15.515024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:15.516503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:15.527602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=80 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:15.535366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.536968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.538579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.544004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.545009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.545695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.573602 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 HTTP/1.1 Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'b089d092-f6e1-4573-a5f2-ce55e2cf9b31'} Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:15.577266 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:15.583506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:06:15.583506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.583506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:15.583506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.583506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.583506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:15.583506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:15.583506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:15.583506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:15.583506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:06:15.583506 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.586699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:15.587881 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-23c7705b-c4c1-4666-9f6f-58366098e512 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 404 len: 111 microversion: 2.1 time: 0.079794 Aug 27 03:06:15.589096 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2707/5255] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:15 2022] DELETE /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:15.597927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:15.598620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: b089d092-f6e1-4573-a5f2-ce55e2cf9b31] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:15.606111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.606807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.607258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.608243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.608728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.609166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.625405 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 HTTP/1.1 Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'b089d092-f6e1-4573-a5f2-ce55e2cf9b31'} Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:15.627626 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.632254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.632254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:15.632254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:15.632254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:15.632254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:15.632254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. Aug 27 03:06:15.632254 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.633587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance b089d092-f6e1-4573-a5f2-ce55e2cf9b31 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:15.634665 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ad9633a8-d983-47cd-a271-6dae974a8351 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31" status: 404 len: 111 microversion: 2.1 time: 0.041578 Aug 27 03:06:15.635730 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2549/5256] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:15 2022] GET /compute/v2.1/servers/b089d092-f6e1-4573-a5f2-ce55e2cf9b31 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:15.645084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:15.645884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:15.657009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.658092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.658746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.660862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.661555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.662243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.680593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:15.682765 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 HTTP/1.1 Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '1b2e6970-f9ec-4f37-8324-1b539b1e7f47'} Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:15.685073 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:15.690018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:06:15.690018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.690018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:15.690018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.690018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.690018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:15.690018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:15.690018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:15.690018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:15.690018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:06:15.690018 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.692196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:15.693320 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-620d194f-4cd6-423e-babc-021edb95b64e tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 404 len: 111 microversion: 2.1 time: 0.053138 Aug 27 03:06:15.694802 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2708/5257] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:15 2022] DELETE /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:15.703920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:15.705007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: 1b2e6970-f9ec-4f37-8324-1b539b1e7f47] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:15.713162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.714103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.714725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.716458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:15.717133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:15.718091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:15.740892 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 HTTP/1.1 Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '1b2e6970-f9ec-4f37-8324-1b539b1e7f47'} Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:15.743540 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.748527 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:15.748527 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:15.748527 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:15.748527 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:15.748527 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:15.748527 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. Aug 27 03:06:15.748527 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:15.751555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance 1b2e6970-f9ec-4f37-8324-1b539b1e7f47 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:15.753169 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f54e01ce-9376-4efc-8eeb-10bc1869935c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47" status: 404 len: 111 microversion: 2.1 time: 0.053705 Aug 27 03:06:15.754300 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2550/5258] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:15 2022] GET /compute/v2.1/servers/1b2e6970-f9ec-4f37-8324-1b539b1e7f47 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:06:16.341613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-67e42862-ec05-4d6e-92cb-fbdb959c49f5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:16.346853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-67e42862-ec05-4d6e-92cb-fbdb959c49f5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:16.408489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e42862-ec05-4d6e-92cb-fbdb959c49f5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:16.415648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e42862-ec05-4d6e-92cb-fbdb959c49f5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:16.416232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e42862-ec05-4d6e-92cb-fbdb959c49f5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:16.420466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e42862-ec05-4d6e-92cb-fbdb959c49f5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:16.420968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e42862-ec05-4d6e-92cb-fbdb959c49f5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:16.421410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67e42862-ec05-4d6e-92cb-fbdb959c49f5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:16.801196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-67e42862-ec05-4d6e-92cb-fbdb959c49f5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:16.813863 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-67e42862-ec05-4d6e-92cb-fbdb959c49f5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.485008 Aug 27 03:06:16.815208 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2709/5259] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:16 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:17.846007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e6569184-0c92-4ffe-bb3d-463593cc4cce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:17.847130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e6569184-0c92-4ffe-bb3d-463593cc4cce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:17.864152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6569184-0c92-4ffe-bb3d-463593cc4cce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:17.865124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6569184-0c92-4ffe-bb3d-463593cc4cce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:17.865706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6569184-0c92-4ffe-bb3d-463593cc4cce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:17.866545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6569184-0c92-4ffe-bb3d-463593cc4cce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:17.867134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6569184-0c92-4ffe-bb3d-463593cc4cce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:17.868027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6569184-0c92-4ffe-bb3d-463593cc4cce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:18.227923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e6569184-0c92-4ffe-bb3d-463593cc4cce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:18.258795 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e6569184-0c92-4ffe-bb3d-463593cc4cce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.423027 Aug 27 03:06:18.260039 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2551/5260] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:17 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:18.705149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-15e56f78-3122-4c6c-b5f7-62fbe33458a7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:18.706409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-15e56f78-3122-4c6c-b5f7-62fbe33458a7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:18.714515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e56f78-3122-4c6c-b5f7-62fbe33458a7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:18.715777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e56f78-3122-4c6c-b5f7-62fbe33458a7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:18.717463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e56f78-3122-4c6c-b5f7-62fbe33458a7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:18.718873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e56f78-3122-4c6c-b5f7-62fbe33458a7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:18.719656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e56f78-3122-4c6c-b5f7-62fbe33458a7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:18.720378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15e56f78-3122-4c6c-b5f7-62fbe33458a7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:18.755210 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-15e56f78-3122-4c6c-b5f7-62fbe33458a7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.054069 Aug 27 03:06:18.756394 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2710/5261] 10.222.0.99 () {58 vars in 1293 bytes} [Sat Aug 27 03:06:18 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0/os-server-password => generated 116 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:19.287042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6760257b-0c4d-4289-95b4-9c1273ab8e33 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:19.288372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6760257b-0c4d-4289-95b4-9c1273ab8e33 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:19.298267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6760257b-0c4d-4289-95b4-9c1273ab8e33 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.299128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6760257b-0c4d-4289-95b4-9c1273ab8e33 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.299803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6760257b-0c4d-4289-95b4-9c1273ab8e33 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.300779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6760257b-0c4d-4289-95b4-9c1273ab8e33 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:19.301474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6760257b-0c4d-4289-95b4-9c1273ab8e33 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:19.302144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6760257b-0c4d-4289-95b4-9c1273ab8e33 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:19.665462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6760257b-0c4d-4289-95b4-9c1273ab8e33 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:19.695803 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6760257b-0c4d-4289-95b4-9c1273ab8e33 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1514 microversion: 2.1 time: 0.411294 Aug 27 03:06:19.698107 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2552/5262] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:19 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1514 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:20.334564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:20.335966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:20.353652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.358224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.375142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.376346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.391657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.392134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.434622 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 HTTP/1.1 Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f354f690-0290-4b99-bd08-961f97e09066'} Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:20.436458 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff30559d-8e73-4db9-94a1-4b0dfadc117c tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 404 len: 111 microversion: 2.1 time: 0.107297 Aug 27 03:06:20.444363 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2711/5263] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:20 2022] DELETE /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:20.452585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:20.454200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] [instance: f354f690-0290-4b99-bd08-961f97e09066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:20.463470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.464396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.465094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.466924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.467880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.468556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.487968 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] HTTP exception thrown: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Request method failure captured: Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 HTTP/1.1 Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYhe5D-0pxEn7-LcZSPUPlDi79GN27F0QOXCEsEcNnkyiyWPKlTcWHgOo73tjeNu_9XLk1tWkcP9HgVR7BqHt_pWYOiHM3zrEM0kayXSj2py_GlpArcBd_UPsCJzUSSxWNnhZW0aAd3aMvHL_NWXkE1lsZLrTO1nLFtBYNdasQH-vx4 Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/86535f98bba34254aca1089f8a2ea8fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/86535f98bba34254aca1089f8a2ea8fb"}]}] Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 86535f98bba34254aca1089f8a2ea8fb Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1379070169 Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 59f857fc243b43379c9255e7b9ea1c3f Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-AttachVolumeNegativeTest-1379070169-project Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f354f690-0290-4b99-bd08-961f97e09066'} Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:20.490918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:20.495228 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:20.495228 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:20.495228 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:20.495228 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:20.495228 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:20.495228 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. Aug 27 03:06:20.495228 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:06:20.499057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] Returning 404 to user: Instance f354f690-0290-4b99-bd08-961f97e09066 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:20.500276 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5c86a901-2b5b-4eaa-a879-a5f45e5f3bb6 tempest-AttachVolumeNegativeTest-1379070169 tempest-AttachVolumeNegativeTest-1379070169-project] 10.222.0.99 "GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066" status: 404 len: 111 microversion: 2.1 time: 0.052767 Aug 27 03:06:20.529226 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2553/5264] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:20 2022] GET /compute/v2.1/servers/f354f690-0290-4b99-bd08-961f97e09066 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:20.718778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b3be721c-9fda-42dc-9095-0bcdeb9e601e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:20.719595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b3be721c-9fda-42dc-9095-0bcdeb9e601e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:20.733973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3be721c-9fda-42dc-9095-0bcdeb9e601e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.734486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3be721c-9fda-42dc-9095-0bcdeb9e601e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.739848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3be721c-9fda-42dc-9095-0bcdeb9e601e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:20.741645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3be721c-9fda-42dc-9095-0bcdeb9e601e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:20.742172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3be721c-9fda-42dc-9095-0bcdeb9e601e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:20.742616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3be721c-9fda-42dc-9095-0bcdeb9e601e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:21.096855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b3be721c-9fda-42dc-9095-0bcdeb9e601e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:21.111827 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b3be721c-9fda-42dc-9095-0bcdeb9e601e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1520 microversion: 2.1 time: 0.392712 Aug 27 03:06:21.113793 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2712/5265] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:20 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:22.135867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-00bb816c-e4d9-4371-a8d8-a25b59a8d98b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:22.137327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-00bb816c-e4d9-4371-a8d8-a25b59a8d98b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:22.151049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb816c-e4d9-4371-a8d8-a25b59a8d98b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:22.153549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb816c-e4d9-4371-a8d8-a25b59a8d98b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:22.155009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb816c-e4d9-4371-a8d8-a25b59a8d98b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:22.157195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb816c-e4d9-4371-a8d8-a25b59a8d98b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:22.158236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb816c-e4d9-4371-a8d8-a25b59a8d98b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:22.159269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb816c-e4d9-4371-a8d8-a25b59a8d98b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:22.688284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-00bb816c-e4d9-4371-a8d8-a25b59a8d98b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:22.702748 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-00bb816c-e4d9-4371-a8d8-a25b59a8d98b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1520 microversion: 2.1 time: 0.566798 Aug 27 03:06:22.703766 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2554/5266] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:22 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1520 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:23.725525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-93500e77-bfc5-442e-be04-eabda6f72961 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:23.726127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-93500e77-bfc5-442e-be04-eabda6f72961 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:23.749041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93500e77-bfc5-442e-be04-eabda6f72961 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:23.750609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93500e77-bfc5-442e-be04-eabda6f72961 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:23.751197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93500e77-bfc5-442e-be04-eabda6f72961 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:23.753377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93500e77-bfc5-442e-be04-eabda6f72961 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:23.754000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93500e77-bfc5-442e-be04-eabda6f72961 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:23.756726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93500e77-bfc5-442e-be04-eabda6f72961 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:24.189374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-93500e77-bfc5-442e-be04-eabda6f72961 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:24.204646 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-93500e77-bfc5-442e-be04-eabda6f72961 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1520 microversion: 2.1 time: 0.480256 Aug 27 03:06:24.206898 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2713/5267] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:23 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1520 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:25.231436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c9358de-5dd6-484b-b38f-0761cfb91203 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:25.232840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c9358de-5dd6-484b-b38f-0761cfb91203 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:25.250394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c9358de-5dd6-484b-b38f-0761cfb91203 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.257098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c9358de-5dd6-484b-b38f-0761cfb91203 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.257804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c9358de-5dd6-484b-b38f-0761cfb91203 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.263292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c9358de-5dd6-484b-b38f-0761cfb91203 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:25.264024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c9358de-5dd6-484b-b38f-0761cfb91203 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:25.265369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c9358de-5dd6-484b-b38f-0761cfb91203 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:25.506279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2c9358de-5dd6-484b-b38f-0761cfb91203 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:25.528300 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c9358de-5dd6-484b-b38f-0761cfb91203 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1520 microversion: 2.1 time: 0.296919 Aug 27 03:06:25.531527 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2555/5268] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:25 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:26.367924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-12d046bc-387c-4109-8488-43bb1c7c9073 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:26.396935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-12d046bc-387c-4109-8488-43bb1c7c9073 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:26.429278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d046bc-387c-4109-8488-43bb1c7c9073 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:26.430714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d046bc-387c-4109-8488-43bb1c7c9073 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:26.431187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d046bc-387c-4109-8488-43bb1c7c9073 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:26.435128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d046bc-387c-4109-8488-43bb1c7c9073 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:26.435669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d046bc-387c-4109-8488-43bb1c7c9073 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:26.436152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12d046bc-387c-4109-8488-43bb1c7c9073 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:26.557820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-02de0c4c-eadd-4e62-8411-c2ee20bb90e4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:26.558458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-02de0c4c-eadd-4e62-8411-c2ee20bb90e4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:26.565321 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-12d046bc-387c-4109-8488-43bb1c7c9073 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "POST /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa/action" status: 200 len: 24571 microversion: 2.1 time: 0.202490 Aug 27 03:06:26.566674 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2714/5269] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:26 2022] POST /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa/action => generated 24571 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:06:26.574129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02de0c4c-eadd-4e62-8411-c2ee20bb90e4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:26.574961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02de0c4c-eadd-4e62-8411-c2ee20bb90e4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:26.578356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02de0c4c-eadd-4e62-8411-c2ee20bb90e4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:26.579373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02de0c4c-eadd-4e62-8411-c2ee20bb90e4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:26.580026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02de0c4c-eadd-4e62-8411-c2ee20bb90e4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:26.581914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02de0c4c-eadd-4e62-8411-c2ee20bb90e4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:26.647623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-bcc76954-3b9e-4e31-9684-3e7661f383c2 req-a934e1cb-e6f3-4ebf-97c7-01e4f1c0623b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd717b6a-4a99-4312-a369-a655d985f4a1", "name": "network-vif-plugged", "status": "completed", "tag": "cf14ece3-b282-4e8e-82a9-73445f360776"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:26.670959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bcc76954-3b9e-4e31-9684-3e7661f383c2 req-a934e1cb-e6f3-4ebf-97c7-01e4f1c0623b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:26.671510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bcc76954-3b9e-4e31-9684-3e7661f383c2 req-a934e1cb-e6f3-4ebf-97c7-01e4f1c0623b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:26.671924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bcc76954-3b9e-4e31-9684-3e7661f383c2 req-a934e1cb-e6f3-4ebf-97c7-01e4f1c0623b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:26.716385 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-bcc76954-3b9e-4e31-9684-3e7661f383c2 req-a934e1cb-e6f3-4ebf-97c7-01e4f1c0623b service nova] Creating event network-vif-plugged:cf14ece3-b282-4e8e-82a9-73445f360776 for instance dd717b6a-4a99-4312-a369-a655d985f4a1 on n-h1-852084-5 Aug 27 03:06:26.724230 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-bcc76954-3b9e-4e31-9684-3e7661f383c2 req-a934e1cb-e6f3-4ebf-97c7-01e4f1c0623b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079935 Aug 27 03:06:26.725601 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2715/5270] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:27.093063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-02de0c4c-eadd-4e62-8411-c2ee20bb90e4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:27.102855 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-02de0c4c-eadd-4e62-8411-c2ee20bb90e4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1520 microversion: 2.1 time: 0.551450 Aug 27 03:06:27.106639 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2556/5271] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:26 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1520 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:28.127482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0139dd06-b516-44cd-8175-9c38e55492ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:28.128329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0139dd06-b516-44cd-8175-9c38e55492ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:28.145280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0139dd06-b516-44cd-8175-9c38e55492ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:28.146079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0139dd06-b516-44cd-8175-9c38e55492ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:28.146770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0139dd06-b516-44cd-8175-9c38e55492ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.147706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0139dd06-b516-44cd-8175-9c38e55492ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:28.148458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0139dd06-b516-44cd-8175-9c38e55492ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:28.150275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0139dd06-b516-44cd-8175-9c38e55492ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:28.550452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0139dd06-b516-44cd-8175-9c38e55492ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:28.561697 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0139dd06-b516-44cd-8175-9c38e55492ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1520 microversion: 2.1 time: 0.438597 Aug 27 03:06:28.562362 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2716/5272] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:28 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1520 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:29.584215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-594a764d-97bf-4ddd-8574-1d3cc3af2515 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:29.584839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-594a764d-97bf-4ddd-8574-1d3cc3af2515 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:29.595189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-594a764d-97bf-4ddd-8574-1d3cc3af2515 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:29.596943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-594a764d-97bf-4ddd-8574-1d3cc3af2515 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:29.597395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-594a764d-97bf-4ddd-8574-1d3cc3af2515 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:29.598181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-594a764d-97bf-4ddd-8574-1d3cc3af2515 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:29.598932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-594a764d-97bf-4ddd-8574-1d3cc3af2515 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:29.599700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-594a764d-97bf-4ddd-8574-1d3cc3af2515 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:29.795697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-594a764d-97bf-4ddd-8574-1d3cc3af2515 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:29.808077 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-594a764d-97bf-4ddd-8574-1d3cc3af2515 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1505 microversion: 2.1 time: 0.228829 Aug 27 03:06:29.808851 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2557/5273] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:29 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:29.834681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fe255746-8b7e-43c6-9033-52397f0f4384 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:29.835725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fe255746-8b7e-43c6-9033-52397f0f4384 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:29.849941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe255746-8b7e-43c6-9033-52397f0f4384 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:29.851334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe255746-8b7e-43c6-9033-52397f0f4384 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:29.852110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe255746-8b7e-43c6-9033-52397f0f4384 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:29.853426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe255746-8b7e-43c6-9033-52397f0f4384 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:29.854064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe255746-8b7e-43c6-9033-52397f0f4384 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:29.854513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe255746-8b7e-43c6-9033-52397f0f4384 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.331327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-319e099e-7fa1-44de-b177-7b3a55ff13f8 tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] Action: 'create', calling method: .version_select at 0x7f4d2abec0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-290898084", "metadata": {"Type": "work"}}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:30.630754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe255746-8b7e-43c6-9033-52397f0f4384 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:30.645502 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fe255746-8b7e-43c6-9033-52397f0f4384 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 200 len: 1505 microversion: 2.1 time: 0.814816 Aug 27 03:06:30.647237 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2717/5274] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:29 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 1505 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:30.667900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a24e08e6-7036-46f9-9e8e-d9e5b5cb9ce5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:30.669369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a24e08e6-7036-46f9-9e8e-d9e5b5cb9ce5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:30.681095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24e08e6-7036-46f9-9e8e-d9e5b5cb9ce5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.684355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24e08e6-7036-46f9-9e8e-d9e5b5cb9ce5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.685084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24e08e6-7036-46f9-9e8e-d9e5b5cb9ce5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.689527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24e08e6-7036-46f9-9e8e-d9e5b5cb9ce5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:30.690388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24e08e6-7036-46f9-9e8e-d9e5b5cb9ce5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:30.690972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24e08e6-7036-46f9-9e8e-d9e5b5cb9ce5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:30.742245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a24e08e6-7036-46f9-9e8e-d9e5b5cb9ce5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:06:30.920523 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a24e08e6-7036-46f9-9e8e-d9e5b5cb9ce5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "DELETE /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 204 len: 0 microversion: 2.1 time: 0.257059 Aug 27 03:06:30.921542 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2718/5275] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:06:30 2022] DELETE /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:06:31.080837 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-319e099e-7fa1-44de-b177-7b3a55ff13f8 tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.981965 Aug 27 03:06:31.082392 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2558/5276] 10.222.0.99 () {60 vars in 1156 bytes} [Sat Aug 27 03:06:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 984 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 03:06:31.097346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e5354b51-7c67-46f3-8ed1-0b89ace9403e tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] Calling method '.version_select at 0x7f4d292a0c10>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:31.169335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1980690729", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "544b49db-f1cc-4bd0-95d2-c54446ab1aed"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:31.196652 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e5354b51-7c67-46f3-8ed1-0b89ace9403e tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb" status: 200 len: 352 microversion: 2.1 time: 0.103610 Aug 27 03:06:31.197814 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2719/5277] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:06:31 2022] GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:31.262951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] validate_networks() for [('544b49db-f1cc-4bd0-95d2-c54446ab1aed', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:06:32.142822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:06:32.143871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:06:32.144962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:06:32.145542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:06:32.146541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:06:32.162913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:32.163395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:32.163833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:32.164557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:32.165239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:32.165697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:32.175551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=86 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:32.188098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Getting quotas for project c2930739b7dc4f26b34361ee100d76f3. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:06:32.201905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Getting quotas for user 9160defddd9f46969249fe5f2a2620e2 and project c2930739b7dc4f26b34361ee100d76f3. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:06:32.212765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d4198cdd-496d-4f72-a463-d86b65770a2d tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] Calling method '.version_select at 0x7f4d29413280>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:32.236886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:06:32.244595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:06:32.294735 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d4198cdd-496d-4f72-a463-d86b65770a2d tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb" status: 200 len: 353 microversion: 2.1 time: 0.086882 Aug 27 03:06:32.303215 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2720/5278] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:06:32 2022] GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:32.311260 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-301575eb-c804-45d1-8e03-4adce678f150 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147279 Aug 27 03:06:32.312512 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2559/5279] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:06:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:06:32.321914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6dbc1857-a1af-4183-9868-1c8974ea110d tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] Calling method '.version_select at 0x7f4d292a0b80>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:32.323960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-71870924-c92c-47ef-b07a-e6df7bf44049 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:32.325403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-71870924-c92c-47ef-b07a-e6df7bf44049 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:32.389311 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6dbc1857-a1af-4183-9868-1c8974ea110d tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb" status: 200 len: 353 microversion: 2.1 time: 0.074490 Aug 27 03:06:32.397884 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2721/5280] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:06:32 2022] GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:32.402933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f00f4aa9-5a3d-4cd0-bc12-95cf3465cb66 tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] Calling method '.version_select at 0x7f4d292a0a60>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:32.409853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-71870924-c92c-47ef-b07a-e6df7bf44049 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:32.420557 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-71870924-c92c-47ef-b07a-e6df7bf44049 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1218 microversion: 2.1 time: 0.098700 Aug 27 03:06:32.422342 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2560/5281] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:32 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:32.540373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f00f4aa9-5a3d-4cd0-bc12-95cf3465cb66 tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb" status: 202 len: 0 microversion: 2.1 time: 0.141302 Aug 27 03:06:32.541135 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2722/5282] 10.222.0.99 () {58 vars in 1248 bytes} [Sat Aug 27 03:06:32 2022] DELETE /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:06:32.553085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c1de41e-0b9d-4ee0-85ac-85fc923e56ca tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] Calling method '.version_select at 0x7f4d29dc9670>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:32.682963 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4c1de41e-0b9d-4ee0-85ac-85fc923e56ca tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb" status: 200 len: 352 microversion: 2.1 time: 0.136896 Aug 27 03:06:32.683991 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2561/5283] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:06:32 2022] GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:06:33.375867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-62d81802-6278-4306-ab3f-5797130cf3c6 req-a7b5a635-c387-48cd-83d0-dc4c00079b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd717b6a-4a99-4312-a369-a655d985f4a1", "name": "network-vif-deleted", "tag": "cf14ece3-b282-4e8e-82a9-73445f360776"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:33.404321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-62d81802-6278-4306-ab3f-5797130cf3c6 req-a7b5a635-c387-48cd-83d0-dc4c00079b16 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:33.404811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-62d81802-6278-4306-ab3f-5797130cf3c6 req-a7b5a635-c387-48cd-83d0-dc4c00079b16 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:33.405358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-62d81802-6278-4306-ab3f-5797130cf3c6 req-a7b5a635-c387-48cd-83d0-dc4c00079b16 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:33.426269 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-62d81802-6278-4306-ab3f-5797130cf3c6 req-a7b5a635-c387-48cd-83d0-dc4c00079b16 service nova] Creating event network-vif-deleted:cf14ece3-b282-4e8e-82a9-73445f360776 for instance dd717b6a-4a99-4312-a369-a655d985f4a1 on n-h1-852084-5 Aug 27 03:06:33.436786 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-62d81802-6278-4306-ab3f-5797130cf3c6 req-a7b5a635-c387-48cd-83d0-dc4c00079b16 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086372 Aug 27 03:06:33.445377 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2723/5284] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:33.445616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3dca5d5a-1523-4a92-b984-2397e2936b21 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:33.446343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3dca5d5a-1523-4a92-b984-2397e2936b21 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:33.469097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dca5d5a-1523-4a92-b984-2397e2936b21 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:33.469921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dca5d5a-1523-4a92-b984-2397e2936b21 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:33.474997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dca5d5a-1523-4a92-b984-2397e2936b21 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:33.478011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dca5d5a-1523-4a92-b984-2397e2936b21 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:33.479700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dca5d5a-1523-4a92-b984-2397e2936b21 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:33.483772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dca5d5a-1523-4a92-b984-2397e2936b21 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:33.632613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3dca5d5a-1523-4a92-b984-2397e2936b21 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:33.647629 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3dca5d5a-1523-4a92-b984-2397e2936b21 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1270 microversion: 2.1 time: 0.208215 Aug 27 03:06:33.648552 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2562/5285] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:33 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1270 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:33.699049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0400e12d-a9df-4ed3-b70a-700602506aee tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] Calling method '.version_select at 0x7f4d28ed99d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:33.770652 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0400e12d-a9df-4ed3-b70a-700602506aee tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb" status: 200 len: 352 microversion: 2.1 time: 0.075938 Aug 27 03:06:33.771459 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2724/5286] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:06:33 2022] GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:06:34.673459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e19343ba-e608-445c-a021-4f85a2481668 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:34.674818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e19343ba-e608-445c-a021-4f85a2481668 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:34.688553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19343ba-e608-445c-a021-4f85a2481668 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:34.689760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19343ba-e608-445c-a021-4f85a2481668 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:34.691886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19343ba-e608-445c-a021-4f85a2481668 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:34.692992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19343ba-e608-445c-a021-4f85a2481668 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:34.695119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19343ba-e608-445c-a021-4f85a2481668 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:34.695869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e19343ba-e608-445c-a021-4f85a2481668 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:34.789556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a5eb938e-bd2b-46d8-a47e-5543139f2f8d tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] Calling method '.version_select at 0x7f4d292a0040>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:34.870054 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a5eb938e-bd2b-46d8-a47e-5543139f2f8d tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb" status: 200 len: 352 microversion: 2.1 time: 0.088098 Aug 27 03:06:34.878232 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2725/5287] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:06:34 2022] GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:34.914233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e19343ba-e608-445c-a021-4f85a2481668 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:34.926051 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e19343ba-e608-445c-a021-4f85a2481668 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1276 microversion: 2.1 time: 0.257303 Aug 27 03:06:34.926666 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2563/5288] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:34 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:35.885586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2185f437-ad98-478c-bd57-29f28244c415 tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] Calling method '.version_select at 0x7f4d294bd550>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:35.951130 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-2185f437-ad98-478c-bd57-29f28244c415 tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] HTTP exception thrown: Volume a9dad138-a13c-4bb3-be81-f204e27197fb could not be found. Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2185f437-ad98-478c-bd57-29f28244c415 tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] Request method failure captured: Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb HTTP/1.1 Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYo10TQWsyGiNd-FtTQeR0i39oL8hZAc9mGeY-ZN5o12XGCEShwEdWGeBPXhTt_QwNazzS8nfYX_fwCDp2Qw-gU4S6P5hVSgEVDlLkj1OWKWdqSBrmq5mbiWWQYtW3IAhwWJbZcWT3fnH1CWTAvsb2oAH6Cf-eqGvDpCMbWOwoApk9o Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 9fb51dd7a00141a7968a847a790b14f1 Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-VolumesGetTestJSON-646042391 Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9fb51dd7a00141a7968a847a790b14f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9fb51dd7a00141a7968a847a790b14f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9fb51dd7a00141a7968a847a790b14f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9fb51dd7a00141a7968a847a790b14f1"}]}] Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-VolumesGetTestJSON-646042391 Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 9fb51dd7a00141a7968a847a790b14f1 Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-VolumesGetTestJSON-646042391 Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-VolumesGetTestJSON-646042391-project Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 04026c783eca4abf86a6a7bcee1fa320 Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-VolumesGetTestJSON-646042391-project Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: method: Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: exception: Volume a9dad138-a13c-4bb3-be81-f204e27197fb could not be found. Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'a9dad138-a13c-4bb3-be81-f204e27197fb'} Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9dad138-a13c-4bb3-be81-f204e27197fb could not be found. (HTTP 404) (Request-ID: req-f361c64e-d85d-464f-97cc-6c060a5f9e23) Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 27 03:06:35.953814 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9dad138-a13c-4bb3-be81-f204e27197fb could not be found. Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9dad138-a13c-4bb3-be81-f204e27197fb could not be found. Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9dad138-a13c-4bb3-be81-f204e27197fb could not be found. Aug 27 03:06:35.961778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:06:35.968736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c5feaee7-7cae-44cf-9137-0750e93abd49 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:35.968736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c5feaee7-7cae-44cf-9137-0750e93abd49 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:35.971872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2185f437-ad98-478c-bd57-29f28244c415 tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] Returning 404 to user: Volume a9dad138-a13c-4bb3-be81-f204e27197fb could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:06:35.973047 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2185f437-ad98-478c-bd57-29f28244c415 tempest-VolumesGetTestJSON-646042391 tempest-VolumesGetTestJSON-646042391-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb" status: 404 len: 109 microversion: 2.1 time: 0.092009 Aug 27 03:06:35.974539 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2726/5289] 10.222.0.99 () {58 vars in 1245 bytes} [Sat Aug 27 03:06:35 2022] GET /compute/v2.1/os-volumes/a9dad138-a13c-4bb3-be81-f204e27197fb => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:06:35.986569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5feaee7-7cae-44cf-9137-0750e93abd49 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:35.990687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5feaee7-7cae-44cf-9137-0750e93abd49 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:35.991281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5feaee7-7cae-44cf-9137-0750e93abd49 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:35.992051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5feaee7-7cae-44cf-9137-0750e93abd49 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:35.992526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5feaee7-7cae-44cf-9137-0750e93abd49 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:35.993012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c5feaee7-7cae-44cf-9137-0750e93abd49 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:36.796174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c5feaee7-7cae-44cf-9137-0750e93abd49 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:36.805826 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c5feaee7-7cae-44cf-9137-0750e93abd49 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1318 microversion: 2.1 time: 0.843266 Aug 27 03:06:36.822120 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2564/5290] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:35 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1318 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:36.899745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-88f9e80b-edae-4fac-b132-dedeff035612 req-6f36bb3c-932d-451a-99b9-156fd3006662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff6a996-bb26-484e-a676-c5e63a4538aa", "tag": "5fb46a6a-67b0-4b69-91f2-960550291a55"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:36.956378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-88f9e80b-edae-4fac-b132-dedeff035612 req-6f36bb3c-932d-451a-99b9-156fd3006662 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:36.967837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-88f9e80b-edae-4fac-b132-dedeff035612 req-6f36bb3c-932d-451a-99b9-156fd3006662 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:36.968687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-88f9e80b-edae-4fac-b132-dedeff035612 req-6f36bb3c-932d-451a-99b9-156fd3006662 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:37.011219 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-88f9e80b-edae-4fac-b132-dedeff035612 req-6f36bb3c-932d-451a-99b9-156fd3006662 service nova] Creating event network-changed:5fb46a6a-67b0-4b69-91f2-960550291a55 for instance 0ff6a996-bb26-484e-a676-c5e63a4538aa on n-h2-852084-5 Aug 27 03:06:37.029411 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-88f9e80b-edae-4fac-b132-dedeff035612 req-6f36bb3c-932d-451a-99b9-156fd3006662 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142609 Aug 27 03:06:37.038391 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2727/5291] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:37.837447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1c2c2bbb-498e-4449-bb4b-9488d017d1d3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:37.839100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1c2c2bbb-498e-4449-bb4b-9488d017d1d3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:37.859133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c2c2bbb-498e-4449-bb4b-9488d017d1d3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:37.860844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c2c2bbb-498e-4449-bb4b-9488d017d1d3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:37.863535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c2c2bbb-498e-4449-bb4b-9488d017d1d3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:37.864448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c2c2bbb-498e-4449-bb4b-9488d017d1d3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:37.864935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c2c2bbb-498e-4449-bb4b-9488d017d1d3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:37.865456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c2c2bbb-498e-4449-bb4b-9488d017d1d3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:38.158675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1c2c2bbb-498e-4449-bb4b-9488d017d1d3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:38.169204 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1c2c2bbb-498e-4449-bb4b-9488d017d1d3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1318 microversion: 2.1 time: 0.340568 Aug 27 03:06:38.170320 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2565/5292] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:37 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:39.195148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-24b1d6e8-a8a5-4b1e-b042-63502cb5684a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:39.195926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-24b1d6e8-a8a5-4b1e-b042-63502cb5684a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:39.212230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b1d6e8-a8a5-4b1e-b042-63502cb5684a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:39.212737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b1d6e8-a8a5-4b1e-b042-63502cb5684a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:39.213258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b1d6e8-a8a5-4b1e-b042-63502cb5684a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:39.220565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b1d6e8-a8a5-4b1e-b042-63502cb5684a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:39.221317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b1d6e8-a8a5-4b1e-b042-63502cb5684a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:39.222013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b1d6e8-a8a5-4b1e-b042-63502cb5684a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:39.809784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-24b1d6e8-a8a5-4b1e-b042-63502cb5684a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:39.822622 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-24b1d6e8-a8a5-4b1e-b042-63502cb5684a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1318 microversion: 2.1 time: 0.633521 Aug 27 03:06:39.825687 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2728/5293] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:39 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:40.854294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4c217e8-ef16-4cac-a45f-f8fdd0520564 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:40.856480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c4c217e8-ef16-4cac-a45f-f8fdd0520564 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:40.870760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4c217e8-ef16-4cac-a45f-f8fdd0520564 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:40.872048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4c217e8-ef16-4cac-a45f-f8fdd0520564 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:40.875757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4c217e8-ef16-4cac-a45f-f8fdd0520564 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:40.876801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4c217e8-ef16-4cac-a45f-f8fdd0520564 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:40.878263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4c217e8-ef16-4cac-a45f-f8fdd0520564 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:40.886896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4c217e8-ef16-4cac-a45f-f8fdd0520564 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:41.710008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c4c217e8-ef16-4cac-a45f-f8fdd0520564 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:41.737600 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c4c217e8-ef16-4cac-a45f-f8fdd0520564 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1318 microversion: 2.1 time: 0.888482 Aug 27 03:06:41.756034 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2566/5294] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:40 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1318 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:42.766112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2f5d0bad-571e-4e4b-ad94-7fa683575da4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:42.767702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2f5d0bad-571e-4e4b-ad94-7fa683575da4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:42.798354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f5d0bad-571e-4e4b-ad94-7fa683575da4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:42.800304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f5d0bad-571e-4e4b-ad94-7fa683575da4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:42.801368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f5d0bad-571e-4e4b-ad94-7fa683575da4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:42.803695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f5d0bad-571e-4e4b-ad94-7fa683575da4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:42.806825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f5d0bad-571e-4e4b-ad94-7fa683575da4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:42.807604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f5d0bad-571e-4e4b-ad94-7fa683575da4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:43.536733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2f5d0bad-571e-4e4b-ad94-7fa683575da4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:43.557594 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2f5d0bad-571e-4e4b-ad94-7fa683575da4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1318 microversion: 2.1 time: 0.793813 Aug 27 03:06:43.560493 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2729/5295] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:42 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1318 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:43.712665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d46861f4-1795-40cd-9905-5bd02e882b97 req-4228d3fe-401b-441d-914f-49630dba4ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff6a996-bb26-484e-a676-c5e63a4538aa", "name": "network-vif-plugged", "status": "completed", "tag": "5fb46a6a-67b0-4b69-91f2-960550291a55"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:43.723164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:43.724554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:43.727759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:43.744114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d46861f4-1795-40cd-9905-5bd02e882b97 req-4228d3fe-401b-441d-914f-49630dba4ea6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:43.749443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d46861f4-1795-40cd-9905-5bd02e882b97 req-4228d3fe-401b-441d-914f-49630dba4ea6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:43.754252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d46861f4-1795-40cd-9905-5bd02e882b97 req-4228d3fe-401b-441d-914f-49630dba4ea6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:43.781084 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d46861f4-1795-40cd-9905-5bd02e882b97 req-4228d3fe-401b-441d-914f-49630dba4ea6 service nova] Creating event network-vif-plugged:5fb46a6a-67b0-4b69-91f2-960550291a55 for instance 0ff6a996-bb26-484e-a676-c5e63a4538aa on n-h2-852084-5 Aug 27 03:06:43.793750 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d46861f4-1795-40cd-9905-5bd02e882b97 req-4228d3fe-401b-441d-914f-49630dba4ea6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087727 Aug 27 03:06:43.796668 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2567/5296] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:06:44.582466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6c9e14ee-f4fe-48b1-b8f1-4c80e3973a42 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:44.583324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6c9e14ee-f4fe-48b1-b8f1-4c80e3973a42 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:44.603592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c9e14ee-f4fe-48b1-b8f1-4c80e3973a42 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:44.605363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c9e14ee-f4fe-48b1-b8f1-4c80e3973a42 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:44.609366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c9e14ee-f4fe-48b1-b8f1-4c80e3973a42 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:44.612830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c9e14ee-f4fe-48b1-b8f1-4c80e3973a42 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:44.613335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c9e14ee-f4fe-48b1-b8f1-4c80e3973a42 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:44.615398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c9e14ee-f4fe-48b1-b8f1-4c80e3973a42 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:45.154538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6c9e14ee-f4fe-48b1-b8f1-4c80e3973a42 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:45.199146 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6c9e14ee-f4fe-48b1-b8f1-4c80e3973a42 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1318 microversion: 2.1 time: 0.621686 Aug 27 03:06:45.199379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e843181-6629-4122-bb41-de9883daa17a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Action: 'create', calling method: .version_select at 0x7f4d297c4310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1061264558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7sbUaroRWoVcS+pbYgBxEM/5GyhwMi8JPNpvZFbxWBcSj2iV6hYTnyRAtzLlnXqchyWcL/0Mt+hB6omiy25UNdbxpwsGAMfPJfAL7e+6L82tVzeZGRByXTLJI29PhqIA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:45.200527 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2730/5297] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:44 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1318 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:45.243955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6e843181-6629-4122-bb41-de9883daa17a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:06:45.277909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6e843181-6629-4122-bb41-de9883daa17a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for user ccbd8cc1d59d412b8b7f8cdf5db759b2 and project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:06:45.374535 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e843181-6629-4122-bb41-de9883daa17a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.177358 Aug 27 03:06:45.374535 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2568/5298] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:06:45 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:46.222014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13857da1-5373-42c3-8cf3-9854e52757c0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:46.222806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13857da1-5373-42c3-8cf3-9854e52757c0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:46.226280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:46.236728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13857da1-5373-42c3-8cf3-9854e52757c0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:46.237219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13857da1-5373-42c3-8cf3-9854e52757c0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:46.246797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13857da1-5373-42c3-8cf3-9854e52757c0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:46.255412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13857da1-5373-42c3-8cf3-9854e52757c0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:46.255911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13857da1-5373-42c3-8cf3-9854e52757c0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:46.256362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13857da1-5373-42c3-8cf3-9854e52757c0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:46.814034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-13857da1-5373-42c3-8cf3-9854e52757c0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:46.825152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:46.865164 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13857da1-5373-42c3-8cf3-9854e52757c0 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1508 microversion: 2.1 time: 0.647803 Aug 27 03:06:46.871185 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2731/5299] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:46 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1508 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:46.894923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0a77344e-f62f-4874-a2d6-525226290f7c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:46.896830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0a77344e-f62f-4874-a2d6-525226290f7c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:46.912470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a77344e-f62f-4874-a2d6-525226290f7c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:46.914300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a77344e-f62f-4874-a2d6-525226290f7c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:46.915557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a77344e-f62f-4874-a2d6-525226290f7c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:46.916626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a77344e-f62f-4874-a2d6-525226290f7c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:46.917543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a77344e-f62f-4874-a2d6-525226290f7c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:46.918180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a77344e-f62f-4874-a2d6-525226290f7c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:47.326028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0a77344e-f62f-4874-a2d6-525226290f7c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:47.365495 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0a77344e-f62f-4874-a2d6-525226290f7c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1508 microversion: 2.1 time: 0.476427 Aug 27 03:06:47.371313 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2569/5300] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:46 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1508 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:47.391821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-520d6d2b-6d27-4b29-9a22-a15a87fc0c40 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:47.395810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-520d6d2b-6d27-4b29-9a22-a15a87fc0c40 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:47.425870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520d6d2b-6d27-4b29-9a22-a15a87fc0c40 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:47.427783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520d6d2b-6d27-4b29-9a22-a15a87fc0c40 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:47.432958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520d6d2b-6d27-4b29-9a22-a15a87fc0c40 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:47.435850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520d6d2b-6d27-4b29-9a22-a15a87fc0c40 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:47.436489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520d6d2b-6d27-4b29-9a22-a15a87fc0c40 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:47.438184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520d6d2b-6d27-4b29-9a22-a15a87fc0c40 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:47.608269 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-520d6d2b-6d27-4b29-9a22-a15a87fc0c40 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "PUT /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1080 microversion: 2.1 time: 0.220257 Aug 27 03:06:47.627277 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2732/5301] 10.222.0.99 () {60 vars in 1256 bytes} [Sat Aug 27 03:06:47 2022] PUT /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1080 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:47.629231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7859074-b9e0-4be1-9542-29252e288bf2 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:47.630014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b7859074-b9e0-4be1-9542-29252e288bf2 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:47.640331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7859074-b9e0-4be1-9542-29252e288bf2 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:47.643571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7859074-b9e0-4be1-9542-29252e288bf2 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:47.644164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7859074-b9e0-4be1-9542-29252e288bf2 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:47.645054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7859074-b9e0-4be1-9542-29252e288bf2 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:47.645657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7859074-b9e0-4be1-9542-29252e288bf2 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:47.647028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7859074-b9e0-4be1-9542-29252e288bf2 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:48.406311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7859074-b9e0-4be1-9542-29252e288bf2 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:48.468510 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7859074-b9e0-4be1-9542-29252e288bf2 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1506 microversion: 2.1 time: 0.842854 Aug 27 03:06:48.502135 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2570/5302] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:47 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1506 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:48.525933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6bba7be-0129-4387-98d0-b953f2f63c4e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:48.526766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a6bba7be-0129-4387-98d0-b953f2f63c4e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:48.546648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6bba7be-0129-4387-98d0-b953f2f63c4e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:48.549810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6bba7be-0129-4387-98d0-b953f2f63c4e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:48.551144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6bba7be-0129-4387-98d0-b953f2f63c4e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:48.553218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6bba7be-0129-4387-98d0-b953f2f63c4e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:48.554948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6bba7be-0129-4387-98d0-b953f2f63c4e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:48.558587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6bba7be-0129-4387-98d0-b953f2f63c4e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:49.307677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a6bba7be-0129-4387-98d0-b953f2f63c4e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:49.324909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6bba7be-0129-4387-98d0-b953f2f63c4e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1506 microversion: 2.1 time: 0.804201 Aug 27 03:06:49.325648 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2733/5303] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:48 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1506 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:49.350696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:49.354844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:49.381497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:49.382955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:49.383614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:49.384610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:49.385015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:49.385444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:49.817441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-877975836", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "dfeec6b9-261f-4cae-b3ba-79824cdd204e"}], "key_name": "tempest-TestNetworkBasicOps-1061264558", "security_groups": [{"name": "tempest-secgroup-smoke-221322641"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:49.869887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:06:49.870509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:06:49.870748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:06:49.874250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:06:49.874961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:06:50.047057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:50.066831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:50.067334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:50.067780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:50.068508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:50.068968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:50.082266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:50.144999 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5b79614f-2352-4885-b438-b9696fd00e82 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "POST /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa/action" status: 202 len: 1112 microversion: 2.1 time: 0.799007 Aug 27 03:06:50.146008 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2571/5304] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:06:49 2022] POST /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa/action => generated 1112 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 03:06:50.164401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7eb5213e-fd2e-48aa-befc-ba0f72f6b041 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:50.165234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7eb5213e-fd2e-48aa-befc-ba0f72f6b041 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:50.175999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7eb5213e-fd2e-48aa-befc-ba0f72f6b041 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:50.178022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7eb5213e-fd2e-48aa-befc-ba0f72f6b041 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:50.180043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7eb5213e-fd2e-48aa-befc-ba0f72f6b041 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:50.181159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7eb5213e-fd2e-48aa-befc-ba0f72f6b041 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:50.183191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7eb5213e-fd2e-48aa-befc-ba0f72f6b041 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:50.184441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7eb5213e-fd2e-48aa-befc-ba0f72f6b041 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:50.283591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] validate_networks() for [('dfeec6b9-261f-4cae-b3ba-79824cdd204e', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:06:50.625107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7eb5213e-fd2e-48aa-befc-ba0f72f6b041 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:50.638225 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7eb5213e-fd2e-48aa-befc-ba0f72f6b041 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.477881 Aug 27 03:06:50.638844 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2572/5305] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:50 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:51.666255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bfcc8f49-9765-48f9-b2f2-255f282e2fd6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:51.669111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bfcc8f49-9765-48f9-b2f2-255f282e2fd6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:51.677112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfcc8f49-9765-48f9-b2f2-255f282e2fd6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:51.678073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfcc8f49-9765-48f9-b2f2-255f282e2fd6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:51.678760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfcc8f49-9765-48f9-b2f2-255f282e2fd6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:51.679819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfcc8f49-9765-48f9-b2f2-255f282e2fd6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:51.680657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfcc8f49-9765-48f9-b2f2-255f282e2fd6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:51.681639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfcc8f49-9765-48f9-b2f2-255f282e2fd6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:51.934217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bfcc8f49-9765-48f9-b2f2-255f282e2fd6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:51.944732 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bfcc8f49-9765-48f9-b2f2-255f282e2fd6 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.287792 Aug 27 03:06:51.945455 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2573/5306] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:51 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:52.020072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:06:52.021153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:06:52.021893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:06:52.023235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:06:52.023888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:06:52.045386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:52.046104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:52.047525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:52.049612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:52.051516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:52.052043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:52.091834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:06:52.099051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for user ccbd8cc1d59d412b8b7f8cdf5db759b2 and project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:06:52.115889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:06:52.118728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:06:52.174828 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a410c7ab-6392-4b4b-b526-6a04298f9940 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.362261 Aug 27 03:06:52.175732 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2734/5307] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:06:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:06:52.186850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c015d18c-0fe5-4f0b-b862-cc15138d0289 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:52.187477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c015d18c-0fe5-4f0b-b862-cc15138d0289 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:52.282848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c015d18c-0fe5-4f0b-b862-cc15138d0289 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:52.292200 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c015d18c-0fe5-4f0b-b862-cc15138d0289 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1248 microversion: 2.1 time: 0.109291 Aug 27 03:06:52.293531 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2574/5308] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:52 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1248 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:52.971298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4a45383-6d5f-45e6-8e28-57da7388130e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:52.974201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b4a45383-6d5f-45e6-8e28-57da7388130e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:52.992211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4a45383-6d5f-45e6-8e28-57da7388130e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:52.993228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4a45383-6d5f-45e6-8e28-57da7388130e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:52.993754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4a45383-6d5f-45e6-8e28-57da7388130e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:52.995468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4a45383-6d5f-45e6-8e28-57da7388130e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:52.996742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4a45383-6d5f-45e6-8e28-57da7388130e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:52.997362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4a45383-6d5f-45e6-8e28-57da7388130e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:53.314696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d915d6e0-4801-4b88-bb4b-e432476c63af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:53.315400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d915d6e0-4801-4b88-bb4b-e432476c63af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:53.328089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d915d6e0-4801-4b88-bb4b-e432476c63af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:53.329912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d915d6e0-4801-4b88-bb4b-e432476c63af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:53.330989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d915d6e0-4801-4b88-bb4b-e432476c63af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:53.332695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d915d6e0-4801-4b88-bb4b-e432476c63af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:53.336040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d915d6e0-4801-4b88-bb4b-e432476c63af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:53.337201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d915d6e0-4801-4b88-bb4b-e432476c63af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:53.412711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d915d6e0-4801-4b88-bb4b-e432476c63af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:53.422507 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d915d6e0-4801-4b88-bb4b-e432476c63af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1244 microversion: 2.1 time: 0.111548 Aug 27 03:06:53.423469 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2575/5309] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:53 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1244 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:06:53.449851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b4a45383-6d5f-45e6-8e28-57da7388130e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:53.462893 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b4a45383-6d5f-45e6-8e28-57da7388130e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.498359 Aug 27 03:06:53.467482 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2735/5310] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:52 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:54.446061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-acd1aadc-eb7d-43ad-96e5-c5b644a948f8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:54.446966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-acd1aadc-eb7d-43ad-96e5-c5b644a948f8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:54.465499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd1aadc-eb7d-43ad-96e5-c5b644a948f8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:54.466139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd1aadc-eb7d-43ad-96e5-c5b644a948f8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:54.466672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd1aadc-eb7d-43ad-96e5-c5b644a948f8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:54.467477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd1aadc-eb7d-43ad-96e5-c5b644a948f8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:54.468014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd1aadc-eb7d-43ad-96e5-c5b644a948f8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:54.468516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-acd1aadc-eb7d-43ad-96e5-c5b644a948f8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:54.491198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2f6778e1-5799-4298-8f42-818a8147ba5e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:54.491833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2f6778e1-5799-4298-8f42-818a8147ba5e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:54.507651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f6778e1-5799-4298-8f42-818a8147ba5e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:54.508481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f6778e1-5799-4298-8f42-818a8147ba5e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:54.509114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f6778e1-5799-4298-8f42-818a8147ba5e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:54.511111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f6778e1-5799-4298-8f42-818a8147ba5e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:54.512379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f6778e1-5799-4298-8f42-818a8147ba5e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:54.515783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2f6778e1-5799-4298-8f42-818a8147ba5e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:54.620520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-acd1aadc-eb7d-43ad-96e5-c5b644a948f8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:54.632155 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-acd1aadc-eb7d-43ad-96e5-c5b644a948f8 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1306 microversion: 2.1 time: 0.189956 Aug 27 03:06:54.633186 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2576/5311] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:54 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1306 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:54.932872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2f6778e1-5799-4298-8f42-818a8147ba5e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:54.965331 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2f6778e1-5799-4298-8f42-818a8147ba5e tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.478447 Aug 27 03:06:54.971071 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2736/5312] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:54 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:55.661922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8d2b6909-30f2-42c6-80c3-c2068fede3cf tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:55.664477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8d2b6909-30f2-42c6-80c3-c2068fede3cf tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:55.679363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d2b6909-30f2-42c6-80c3-c2068fede3cf tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:55.680965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d2b6909-30f2-42c6-80c3-c2068fede3cf tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:55.682640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d2b6909-30f2-42c6-80c3-c2068fede3cf tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:55.687222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d2b6909-30f2-42c6-80c3-c2068fede3cf tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:55.689325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d2b6909-30f2-42c6-80c3-c2068fede3cf tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:55.690276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d2b6909-30f2-42c6-80c3-c2068fede3cf tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:55.807835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8d2b6909-30f2-42c6-80c3-c2068fede3cf tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:55.816963 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8d2b6909-30f2-42c6-80c3-c2068fede3cf tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1306 microversion: 2.1 time: 0.164501 Aug 27 03:06:55.817574 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2577/5313] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:55 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1306 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:56.005646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e6270727-7ceb-400b-abfb-9bf86b1ed700 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:56.006312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e6270727-7ceb-400b-abfb-9bf86b1ed700 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:56.016482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6270727-7ceb-400b-abfb-9bf86b1ed700 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:56.017273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6270727-7ceb-400b-abfb-9bf86b1ed700 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:56.017973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6270727-7ceb-400b-abfb-9bf86b1ed700 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:56.018900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6270727-7ceb-400b-abfb-9bf86b1ed700 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:56.019543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6270727-7ceb-400b-abfb-9bf86b1ed700 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:56.020166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6270727-7ceb-400b-abfb-9bf86b1ed700 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:56.399448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e6270727-7ceb-400b-abfb-9bf86b1ed700 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:56.416490 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e6270727-7ceb-400b-abfb-9bf86b1ed700 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.415843 Aug 27 03:06:56.421379 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2737/5314] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:55 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:56.839851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b488694a-a2f7-4c13-919b-8c3998ecea23 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:56.840441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b488694a-a2f7-4c13-919b-8c3998ecea23 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:56.854417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b488694a-a2f7-4c13-919b-8c3998ecea23 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:56.859253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b488694a-a2f7-4c13-919b-8c3998ecea23 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:56.860024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b488694a-a2f7-4c13-919b-8c3998ecea23 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:56.860997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b488694a-a2f7-4c13-919b-8c3998ecea23 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:56.861660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b488694a-a2f7-4c13-919b-8c3998ecea23 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:56.863068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b488694a-a2f7-4c13-919b-8c3998ecea23 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:57.359707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b488694a-a2f7-4c13-919b-8c3998ecea23 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:57.373129 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b488694a-a2f7-4c13-919b-8c3998ecea23 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1373 microversion: 2.1 time: 0.537736 Aug 27 03:06:57.374961 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2578/5315] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:56 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1373 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:57.442609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff2d4695-f3a3-45bf-af56-db90849b4993 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:57.443888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ff2d4695-f3a3-45bf-af56-db90849b4993 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:57.459791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2d4695-f3a3-45bf-af56-db90849b4993 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:57.460542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2d4695-f3a3-45bf-af56-db90849b4993 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:57.460989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2d4695-f3a3-45bf-af56-db90849b4993 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:57.461773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2d4695-f3a3-45bf-af56-db90849b4993 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:57.462269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2d4695-f3a3-45bf-af56-db90849b4993 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:57.462714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff2d4695-f3a3-45bf-af56-db90849b4993 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:57.899472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7ec23059-f49f-49f1-bf6a-178c85d990bf req-3a6cacb1-340c-4f7f-aed6-da2dc68c7040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0568e064-3202-429e-960a-a3beeb65150e", "tag": "2b1af944-1711-41de-a803-8407e5ed2112"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:06:57.925392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7ec23059-f49f-49f1-bf6a-178c85d990bf req-3a6cacb1-340c-4f7f-aed6-da2dc68c7040 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:57.926074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7ec23059-f49f-49f1-bf6a-178c85d990bf req-3a6cacb1-340c-4f7f-aed6-da2dc68c7040 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:57.926735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7ec23059-f49f-49f1-bf6a-178c85d990bf req-3a6cacb1-340c-4f7f-aed6-da2dc68c7040 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:57.931773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:06:57.953413 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7ec23059-f49f-49f1-bf6a-178c85d990bf req-3a6cacb1-340c-4f7f-aed6-da2dc68c7040 service nova] Creating event network-changed:2b1af944-1711-41de-a803-8407e5ed2112 for instance 0568e064-3202-429e-960a-a3beeb65150e on n-h1-852084-5 Aug 27 03:06:57.960494 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7ec23059-f49f-49f1-bf6a-178c85d990bf req-3a6cacb1-340c-4f7f-aed6-da2dc68c7040 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066138 Aug 27 03:06:57.962017 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2579/5316] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:06:58.031508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ff2d4695-f3a3-45bf-af56-db90849b4993 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:58.040508 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff2d4695-f3a3-45bf-af56-db90849b4993 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.601883 Aug 27 03:06:58.043865 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2738/5317] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:57 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:58.402507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf06e4e8-0c36-442c-a44e-65523dc3e1bc tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:58.408167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf06e4e8-0c36-442c-a44e-65523dc3e1bc tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:58.428946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf06e4e8-0c36-442c-a44e-65523dc3e1bc tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:58.436744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf06e4e8-0c36-442c-a44e-65523dc3e1bc tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:58.442254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf06e4e8-0c36-442c-a44e-65523dc3e1bc tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:58.447385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf06e4e8-0c36-442c-a44e-65523dc3e1bc tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:58.463818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf06e4e8-0c36-442c-a44e-65523dc3e1bc tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:58.465204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf06e4e8-0c36-442c-a44e-65523dc3e1bc tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:58.842520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf06e4e8-0c36-442c-a44e-65523dc3e1bc tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:58.862399 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf06e4e8-0c36-442c-a44e-65523dc3e1bc tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1373 microversion: 2.1 time: 0.467923 Aug 27 03:06:58.863666 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2580/5318] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:58 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1373 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:59.078189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-157f016c-7457-4f55-8d34-7b7fcbf8260a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:59.084114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-157f016c-7457-4f55-8d34-7b7fcbf8260a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:59.108490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-157f016c-7457-4f55-8d34-7b7fcbf8260a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.109012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-157f016c-7457-4f55-8d34-7b7fcbf8260a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.109469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-157f016c-7457-4f55-8d34-7b7fcbf8260a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:59.110249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-157f016c-7457-4f55-8d34-7b7fcbf8260a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.110842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-157f016c-7457-4f55-8d34-7b7fcbf8260a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.111285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-157f016c-7457-4f55-8d34-7b7fcbf8260a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:59.357618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-157f016c-7457-4f55-8d34-7b7fcbf8260a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:06:59.396091 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-157f016c-7457-4f55-8d34-7b7fcbf8260a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.318025 Aug 27 03:06:59.404846 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2739/5319] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:59 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:06:59.888218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-44d19d90-c8da-4207-aee8-d77578b92553 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:06:59.890519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-44d19d90-c8da-4207-aee8-d77578b92553 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:06:59.909115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44d19d90-c8da-4207-aee8-d77578b92553 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.913576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44d19d90-c8da-4207-aee8-d77578b92553 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.917859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44d19d90-c8da-4207-aee8-d77578b92553 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:06:59.918949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44d19d90-c8da-4207-aee8-d77578b92553 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:06:59.919624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44d19d90-c8da-4207-aee8-d77578b92553 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:06:59.920303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-44d19d90-c8da-4207-aee8-d77578b92553 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:00.421047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-efbaa45b-e215-4d7c-90e6-5af2da7d7a5a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:00.421707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-efbaa45b-e215-4d7c-90e6-5af2da7d7a5a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:00.441187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efbaa45b-e215-4d7c-90e6-5af2da7d7a5a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:00.441718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efbaa45b-e215-4d7c-90e6-5af2da7d7a5a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:00.442181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efbaa45b-e215-4d7c-90e6-5af2da7d7a5a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:00.442932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efbaa45b-e215-4d7c-90e6-5af2da7d7a5a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:00.443403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efbaa45b-e215-4d7c-90e6-5af2da7d7a5a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:00.443840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efbaa45b-e215-4d7c-90e6-5af2da7d7a5a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:00.445400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-44d19d90-c8da-4207-aee8-d77578b92553 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:00.466762 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-44d19d90-c8da-4207-aee8-d77578b92553 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1373 microversion: 2.1 time: 0.584659 Aug 27 03:07:00.482277 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2581/5320] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:06:59 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1373 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:01.135157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-efbaa45b-e215-4d7c-90e6-5af2da7d7a5a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:01.168894 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-efbaa45b-e215-4d7c-90e6-5af2da7d7a5a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.746451 Aug 27 03:07:01.169602 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2740/5321] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:00 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:01.491147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aab538a9-9e2f-4afa-8607-79d21127010b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:01.493457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aab538a9-9e2f-4afa-8607-79d21127010b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:01.507935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aab538a9-9e2f-4afa-8607-79d21127010b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:01.509197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aab538a9-9e2f-4afa-8607-79d21127010b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:01.510007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aab538a9-9e2f-4afa-8607-79d21127010b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:01.512056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aab538a9-9e2f-4afa-8607-79d21127010b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:01.513167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aab538a9-9e2f-4afa-8607-79d21127010b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:01.514260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aab538a9-9e2f-4afa-8607-79d21127010b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:02.029385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-aab538a9-9e2f-4afa-8607-79d21127010b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:02.039019 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aab538a9-9e2f-4afa-8607-79d21127010b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1373 microversion: 2.1 time: 0.554350 Aug 27 03:07:02.053707 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2582/5322] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:01 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1373 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:02.200473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0e5d921b-17a2-431f-9729-1fac2b7158be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:02.202042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0e5d921b-17a2-431f-9729-1fac2b7158be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:02.247986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:02.249655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:02.260036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e5d921b-17a2-431f-9729-1fac2b7158be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:02.262749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e5d921b-17a2-431f-9729-1fac2b7158be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:02.264515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e5d921b-17a2-431f-9729-1fac2b7158be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:02.269213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e5d921b-17a2-431f-9729-1fac2b7158be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:02.277198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e5d921b-17a2-431f-9729-1fac2b7158be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:02.287932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e5d921b-17a2-431f-9729-1fac2b7158be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:02.799843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0e5d921b-17a2-431f-9729-1fac2b7158be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:02.833306 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0e5d921b-17a2-431f-9729-1fac2b7158be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.639486 Aug 27 03:07:02.840595 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2741/5323] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:02 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:03.185323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de1d18c8-2989-4b3b-bf8b-211181f1d191 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:03.186048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de1d18c8-2989-4b3b-bf8b-211181f1d191 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:03.188377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:03.224912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de1d18c8-2989-4b3b-bf8b-211181f1d191 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:03.225582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de1d18c8-2989-4b3b-bf8b-211181f1d191 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:03.226148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de1d18c8-2989-4b3b-bf8b-211181f1d191 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:03.228160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de1d18c8-2989-4b3b-bf8b-211181f1d191 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:03.231649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de1d18c8-2989-4b3b-bf8b-211181f1d191 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:03.234546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de1d18c8-2989-4b3b-bf8b-211181f1d191 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:03.589547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de1d18c8-2989-4b3b-bf8b-211181f1d191 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:03.610259 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de1d18c8-2989-4b3b-bf8b-211181f1d191 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1373 microversion: 2.1 time: 0.425587 Aug 27 03:07:03.626421 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2583/5324] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:03 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1373 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:03.868237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a4b430b9-a710-4912-a990-a0c8edb4b16f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:03.868870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a4b430b9-a710-4912-a990-a0c8edb4b16f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:03.883893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b430b9-a710-4912-a990-a0c8edb4b16f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:03.884762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b430b9-a710-4912-a990-a0c8edb4b16f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:03.886905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b430b9-a710-4912-a990-a0c8edb4b16f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:03.887928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b430b9-a710-4912-a990-a0c8edb4b16f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:03.891251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b430b9-a710-4912-a990-a0c8edb4b16f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:03.892191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4b430b9-a710-4912-a990-a0c8edb4b16f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:04.634828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-299e25e4-3ff5-4176-92d4-18e9f8fdbaad tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:04.637106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-299e25e4-3ff5-4176-92d4-18e9f8fdbaad tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:04.653716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-299e25e4-3ff5-4176-92d4-18e9f8fdbaad tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:04.655710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-299e25e4-3ff5-4176-92d4-18e9f8fdbaad tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:04.657709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-299e25e4-3ff5-4176-92d4-18e9f8fdbaad tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:04.674120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-299e25e4-3ff5-4176-92d4-18e9f8fdbaad tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:04.675638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-299e25e4-3ff5-4176-92d4-18e9f8fdbaad tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:04.679621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-299e25e4-3ff5-4176-92d4-18e9f8fdbaad tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:05.217269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-299e25e4-3ff5-4176-92d4-18e9f8fdbaad tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:05.232853 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-299e25e4-3ff5-4176-92d4-18e9f8fdbaad tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1373 microversion: 2.1 time: 0.602515 Aug 27 03:07:05.253049 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2584/5325] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:04 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1373 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:05.265147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c3d7ab8c-2037-44ca-bbad-a28ea86b43c9 req-af696ac6-7a1c-438e-bcd7-e92703fafee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0568e064-3202-429e-960a-a3beeb65150e", "name": "network-vif-plugged", "status": "completed", "tag": "2b1af944-1711-41de-a803-8407e5ed2112"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:05.303088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c3d7ab8c-2037-44ca-bbad-a28ea86b43c9 req-af696ac6-7a1c-438e-bcd7-e92703fafee2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:05.306488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c3d7ab8c-2037-44ca-bbad-a28ea86b43c9 req-af696ac6-7a1c-438e-bcd7-e92703fafee2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:05.309110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c3d7ab8c-2037-44ca-bbad-a28ea86b43c9 req-af696ac6-7a1c-438e-bcd7-e92703fafee2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:05.343959 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c3d7ab8c-2037-44ca-bbad-a28ea86b43c9 req-af696ac6-7a1c-438e-bcd7-e92703fafee2 service nova] Creating event network-vif-plugged:2b1af944-1711-41de-a803-8407e5ed2112 for instance 0568e064-3202-429e-960a-a3beeb65150e on n-h1-852084-5 Aug 27 03:07:05.351097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a4b430b9-a710-4912-a990-a0c8edb4b16f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:05.357266 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c3d7ab8c-2037-44ca-bbad-a28ea86b43c9 req-af696ac6-7a1c-438e-bcd7-e92703fafee2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102782 Aug 27 03:07:05.362760 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2585/5326] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:05.365412 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a4b430b9-a710-4912-a990-a0c8edb4b16f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 1.502052 Aug 27 03:07:05.369534 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2742/5327] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:03 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:06.254709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-33d8cc58-6951-47d6-a2e8-5f51e5c1f60f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:06.256061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-33d8cc58-6951-47d6-a2e8-5f51e5c1f60f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:06.269306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33d8cc58-6951-47d6-a2e8-5f51e5c1f60f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:06.270475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33d8cc58-6951-47d6-a2e8-5f51e5c1f60f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:06.272691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33d8cc58-6951-47d6-a2e8-5f51e5c1f60f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.273605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33d8cc58-6951-47d6-a2e8-5f51e5c1f60f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:06.277411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33d8cc58-6951-47d6-a2e8-5f51e5c1f60f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:06.278081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33d8cc58-6951-47d6-a2e8-5f51e5c1f60f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.442238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ea7655f5-8dec-47d2-9379-c627ee8cde6f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:06.455860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ea7655f5-8dec-47d2-9379-c627ee8cde6f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:06.475682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea7655f5-8dec-47d2-9379-c627ee8cde6f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:06.478402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea7655f5-8dec-47d2-9379-c627ee8cde6f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:06.480864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea7655f5-8dec-47d2-9379-c627ee8cde6f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.482272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea7655f5-8dec-47d2-9379-c627ee8cde6f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:06.484919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea7655f5-8dec-47d2-9379-c627ee8cde6f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:06.485363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea7655f5-8dec-47d2-9379-c627ee8cde6f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:06.696218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-33d8cc58-6951-47d6-a2e8-5f51e5c1f60f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:06.720151 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-33d8cc58-6951-47d6-a2e8-5f51e5c1f60f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1373 microversion: 2.1 time: 0.469363 Aug 27 03:07:06.721889 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2586/5328] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:06 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1373 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:07.256658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ea7655f5-8dec-47d2-9379-c627ee8cde6f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:07.270125 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ea7655f5-8dec-47d2-9379-c627ee8cde6f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.871008 Aug 27 03:07:07.287635 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2743/5329] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:06 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:07.742296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-01239c91-5d31-4611-b886-b36df4287056 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:07.743073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-01239c91-5d31-4611-b886-b36df4287056 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:07.759236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01239c91-5d31-4611-b886-b36df4287056 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:07.761362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01239c91-5d31-4611-b886-b36df4287056 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:07.763185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01239c91-5d31-4611-b886-b36df4287056 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:07.764245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01239c91-5d31-4611-b886-b36df4287056 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:07.765181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01239c91-5d31-4611-b886-b36df4287056 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:07.775337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01239c91-5d31-4611-b886-b36df4287056 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.217971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-01239c91-5d31-4611-b886-b36df4287056 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:08.232967 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-01239c91-5d31-4611-b886-b36df4287056 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1546 microversion: 2.1 time: 0.494748 Aug 27 03:07:08.233905 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2587/5330] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:07 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1546 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:08.258107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2dd5e0ef-2b15-48dc-a282-ee256b594e70 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:08.260410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2dd5e0ef-2b15-48dc-a282-ee256b594e70 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:08.272338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2dd5e0ef-2b15-48dc-a282-ee256b594e70 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.273324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2dd5e0ef-2b15-48dc-a282-ee256b594e70 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.274075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2dd5e0ef-2b15-48dc-a282-ee256b594e70 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.277168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2dd5e0ef-2b15-48dc-a282-ee256b594e70 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.278051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2dd5e0ef-2b15-48dc-a282-ee256b594e70 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.279340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2dd5e0ef-2b15-48dc-a282-ee256b594e70 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.294508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-72d5c46b-abb2-46ec-a4a4-b460eea96e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:08.295419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-72d5c46b-abb2-46ec-a4a4-b460eea96e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:08.304106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72d5c46b-abb2-46ec-a4a4-b460eea96e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.307260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72d5c46b-abb2-46ec-a4a4-b460eea96e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.308505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72d5c46b-abb2-46ec-a4a4-b460eea96e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.310508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72d5c46b-abb2-46ec-a4a4-b460eea96e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:08.311705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72d5c46b-abb2-46ec-a4a4-b460eea96e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:08.316095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72d5c46b-abb2-46ec-a4a4-b460eea96e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:08.904124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2dd5e0ef-2b15-48dc-a282-ee256b594e70 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:08.916176 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2dd5e0ef-2b15-48dc-a282-ee256b594e70 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1546 microversion: 2.1 time: 0.664078 Aug 27 03:07:08.922085 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2744/5331] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:08 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1546 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:09.051115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-72d5c46b-abb2-46ec-a4a4-b460eea96e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:09.077288 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-72d5c46b-abb2-46ec-a4a4-b460eea96e9d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.786067 Aug 27 03:07:09.091478 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2588/5332] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:08 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:10.106797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21483685-a458-444f-8e97-6ca29e430ac1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:10.107368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21483685-a458-444f-8e97-6ca29e430ac1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:10.116490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21483685-a458-444f-8e97-6ca29e430ac1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:10.117066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21483685-a458-444f-8e97-6ca29e430ac1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:10.117843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21483685-a458-444f-8e97-6ca29e430ac1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:10.118789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21483685-a458-444f-8e97-6ca29e430ac1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:10.119466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21483685-a458-444f-8e97-6ca29e430ac1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:10.120428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21483685-a458-444f-8e97-6ca29e430ac1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:10.437860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-21483685-a458-444f-8e97-6ca29e430ac1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:10.459251 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21483685-a458-444f-8e97-6ca29e430ac1 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.356626 Aug 27 03:07:10.462177 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2745/5333] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:10 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:11.486281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7bbfcb54-8cce-4cb4-ba88-1a0b36991a12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:11.487789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7bbfcb54-8cce-4cb4-ba88-1a0b36991a12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:11.505640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bbfcb54-8cce-4cb4-ba88-1a0b36991a12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:11.506747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bbfcb54-8cce-4cb4-ba88-1a0b36991a12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:11.508321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bbfcb54-8cce-4cb4-ba88-1a0b36991a12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:11.512014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bbfcb54-8cce-4cb4-ba88-1a0b36991a12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:11.513743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bbfcb54-8cce-4cb4-ba88-1a0b36991a12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:11.515009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bbfcb54-8cce-4cb4-ba88-1a0b36991a12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:11.711642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7bbfcb54-8cce-4cb4-ba88-1a0b36991a12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:11.724433 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7bbfcb54-8cce-4cb4-ba88-1a0b36991a12 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.242868 Aug 27 03:07:11.729064 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2589/5334] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:11 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:12.751011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fbae2b8c-2240-4c4e-a0f6-fa9a0c668e25 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:12.751731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fbae2b8c-2240-4c4e-a0f6-fa9a0c668e25 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:12.767234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbae2b8c-2240-4c4e-a0f6-fa9a0c668e25 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:12.768491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbae2b8c-2240-4c4e-a0f6-fa9a0c668e25 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:12.769192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbae2b8c-2240-4c4e-a0f6-fa9a0c668e25 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:12.770403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbae2b8c-2240-4c4e-a0f6-fa9a0c668e25 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:12.771234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbae2b8c-2240-4c4e-a0f6-fa9a0c668e25 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:12.771920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbae2b8c-2240-4c4e-a0f6-fa9a0c668e25 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:13.159217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fbae2b8c-2240-4c4e-a0f6-fa9a0c668e25 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:13.167742 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fbae2b8c-2240-4c4e-a0f6-fa9a0c668e25 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.421620 Aug 27 03:07:13.178809 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2746/5335] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:12 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:14.199961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba9c6169-9284-4ba3-8e82-c611b0c65cc3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:14.200664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba9c6169-9284-4ba3-8e82-c611b0c65cc3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:14.215210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba9c6169-9284-4ba3-8e82-c611b0c65cc3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:14.215831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba9c6169-9284-4ba3-8e82-c611b0c65cc3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:14.216456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba9c6169-9284-4ba3-8e82-c611b0c65cc3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:14.217512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba9c6169-9284-4ba3-8e82-c611b0c65cc3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:14.218243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba9c6169-9284-4ba3-8e82-c611b0c65cc3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:14.218622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba9c6169-9284-4ba3-8e82-c611b0c65cc3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:14.624004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba9c6169-9284-4ba3-8e82-c611b0c65cc3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:14.657826 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba9c6169-9284-4ba3-8e82-c611b0c65cc3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.452853 Aug 27 03:07:14.661758 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2590/5336] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:14 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:15.681841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-73aeea72-eec1-4eef-9732-8016d11ac715 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:15.683043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-73aeea72-eec1-4eef-9732-8016d11ac715 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:15.694721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73aeea72-eec1-4eef-9732-8016d11ac715 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:15.699011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73aeea72-eec1-4eef-9732-8016d11ac715 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:15.702819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73aeea72-eec1-4eef-9732-8016d11ac715 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:15.704048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73aeea72-eec1-4eef-9732-8016d11ac715 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:15.704737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73aeea72-eec1-4eef-9732-8016d11ac715 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:15.705350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73aeea72-eec1-4eef-9732-8016d11ac715 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:16.901917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-73aeea72-eec1-4eef-9732-8016d11ac715 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:16.919255 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-73aeea72-eec1-4eef-9732-8016d11ac715 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 1.241793 Aug 27 03:07:16.920190 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2747/5337] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:15 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:17.945796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8b5d67a7-fb47-4bbb-9076-90a3496c7be9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:17.947079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8b5d67a7-fb47-4bbb-9076-90a3496c7be9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:17.951807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:17.963401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5d67a7-fb47-4bbb-9076-90a3496c7be9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.964657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5d67a7-fb47-4bbb-9076-90a3496c7be9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.965287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5d67a7-fb47-4bbb-9076-90a3496c7be9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:17.966190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5d67a7-fb47-4bbb-9076-90a3496c7be9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:17.971133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5d67a7-fb47-4bbb-9076-90a3496c7be9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:17.973745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5d67a7-fb47-4bbb-9076-90a3496c7be9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:18.554698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8b5d67a7-fb47-4bbb-9076-90a3496c7be9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:18.572703 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8b5d67a7-fb47-4bbb-9076-90a3496c7be9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.628190 Aug 27 03:07:18.574525 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2591/5338] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:17 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:19.600878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3d424fdb-bd8b-4204-9a61-4cddcd47144b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:19.606527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3d424fdb-bd8b-4204-9a61-4cddcd47144b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:19.612071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:19.627411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d424fdb-bd8b-4204-9a61-4cddcd47144b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:19.629061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d424fdb-bd8b-4204-9a61-4cddcd47144b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:19.632285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d424fdb-bd8b-4204-9a61-4cddcd47144b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:19.633354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d424fdb-bd8b-4204-9a61-4cddcd47144b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:19.634526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d424fdb-bd8b-4204-9a61-4cddcd47144b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:19.635606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d424fdb-bd8b-4204-9a61-4cddcd47144b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:19.652473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:20.068483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3d424fdb-bd8b-4204-9a61-4cddcd47144b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:20.079174 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3d424fdb-bd8b-4204-9a61-4cddcd47144b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.487233 Aug 27 03:07:20.087521 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2748/5339] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:19 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:21.101087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bece988a-4afa-4f45-85a7-c932d06ee8cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:21.102699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bece988a-4afa-4f45-85a7-c932d06ee8cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:21.111426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bece988a-4afa-4f45-85a7-c932d06ee8cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.113738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bece988a-4afa-4f45-85a7-c932d06ee8cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.114396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bece988a-4afa-4f45-85a7-c932d06ee8cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.116313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bece988a-4afa-4f45-85a7-c932d06ee8cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:21.121825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bece988a-4afa-4f45-85a7-c932d06ee8cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:21.122728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bece988a-4afa-4f45-85a7-c932d06ee8cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:21.327091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bece988a-4afa-4f45-85a7-c932d06ee8cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:21.345528 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bece988a-4afa-4f45-85a7-c932d06ee8cb tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1517 microversion: 2.1 time: 0.248595 Aug 27 03:07:21.359887 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2592/5340] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:21 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1517 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:22.369059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5f3ef5dd-7069-4444-a60e-13fd4f3aab6b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:22.370696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5f3ef5dd-7069-4444-a60e-13fd4f3aab6b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:22.395409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3ef5dd-7069-4444-a60e-13fd4f3aab6b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:22.397189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3ef5dd-7069-4444-a60e-13fd4f3aab6b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:22.399587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3ef5dd-7069-4444-a60e-13fd4f3aab6b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:22.401947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3ef5dd-7069-4444-a60e-13fd4f3aab6b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:22.402617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3ef5dd-7069-4444-a60e-13fd4f3aab6b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:22.403171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f3ef5dd-7069-4444-a60e-13fd4f3aab6b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:22.762954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5f3ef5dd-7069-4444-a60e-13fd4f3aab6b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:22.772708 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f3ef5dd-7069-4444-a60e-13fd4f3aab6b tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1523 microversion: 2.1 time: 0.408233 Aug 27 03:07:22.774248 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2749/5341] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:22 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:23.802605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb4e00f3-6c9d-495d-8261-288f58b142c3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:23.803244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fb4e00f3-6c9d-495d-8261-288f58b142c3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:23.815252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb4e00f3-6c9d-495d-8261-288f58b142c3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:23.815843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb4e00f3-6c9d-495d-8261-288f58b142c3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:23.822377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb4e00f3-6c9d-495d-8261-288f58b142c3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:23.823460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb4e00f3-6c9d-495d-8261-288f58b142c3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:23.824131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb4e00f3-6c9d-495d-8261-288f58b142c3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:23.824740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb4e00f3-6c9d-495d-8261-288f58b142c3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:24.417502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fb4e00f3-6c9d-495d-8261-288f58b142c3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:24.427257 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fb4e00f3-6c9d-495d-8261-288f58b142c3 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1523 microversion: 2.1 time: 0.634265 Aug 27 03:07:24.444864 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2593/5342] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:23 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1523 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:25.460007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a4d14963-8f2d-479e-bb5f-64af563a676a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:25.461699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a4d14963-8f2d-479e-bb5f-64af563a676a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:25.475316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d14963-8f2d-479e-bb5f-64af563a676a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:25.477960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d14963-8f2d-479e-bb5f-64af563a676a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:25.478653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d14963-8f2d-479e-bb5f-64af563a676a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:25.480187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d14963-8f2d-479e-bb5f-64af563a676a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:25.480541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d14963-8f2d-479e-bb5f-64af563a676a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:25.481202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d14963-8f2d-479e-bb5f-64af563a676a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:25.841258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a4d14963-8f2d-479e-bb5f-64af563a676a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:25.850886 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a4d14963-8f2d-479e-bb5f-64af563a676a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1523 microversion: 2.1 time: 0.400592 Aug 27 03:07:25.851748 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2750/5343] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:25 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1523 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:26.058234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-04ae5e46-bb90-4267-bc3c-2109f034451c req-d9e49d17-4963-4b70-9d52-1132728909d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff6a996-bb26-484e-a676-c5e63a4538aa", "name": "network-vif-unplugged", "status": "completed", "tag": "5fb46a6a-67b0-4b69-91f2-960550291a55"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:26.074969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-04ae5e46-bb90-4267-bc3c-2109f034451c req-d9e49d17-4963-4b70-9d52-1132728909d6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:26.075448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-04ae5e46-bb90-4267-bc3c-2109f034451c req-d9e49d17-4963-4b70-9d52-1132728909d6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:26.075871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-04ae5e46-bb90-4267-bc3c-2109f034451c req-d9e49d17-4963-4b70-9d52-1132728909d6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:26.105415 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-04ae5e46-bb90-4267-bc3c-2109f034451c req-d9e49d17-4963-4b70-9d52-1132728909d6 service nova] Creating event network-vif-unplugged:5fb46a6a-67b0-4b69-91f2-960550291a55 for instance 0ff6a996-bb26-484e-a676-c5e63a4538aa on n-h2-852084-5 Aug 27 03:07:26.112456 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-04ae5e46-bb90-4267-bc3c-2109f034451c req-d9e49d17-4963-4b70-9d52-1132728909d6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057253 Aug 27 03:07:26.114027 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2594/5344] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:26.878622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-90f4bd1d-d97f-4735-bf33-e239e11b3369 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:26.891279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-90f4bd1d-d97f-4735-bf33-e239e11b3369 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:26.918318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90f4bd1d-d97f-4735-bf33-e239e11b3369 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:26.919318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90f4bd1d-d97f-4735-bf33-e239e11b3369 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:26.920414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90f4bd1d-d97f-4735-bf33-e239e11b3369 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:26.926706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90f4bd1d-d97f-4735-bf33-e239e11b3369 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:26.927891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90f4bd1d-d97f-4735-bf33-e239e11b3369 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:26.929365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-90f4bd1d-d97f-4735-bf33-e239e11b3369 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:27.254932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-90f4bd1d-d97f-4735-bf33-e239e11b3369 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:27.266683 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-90f4bd1d-d97f-4735-bf33-e239e11b3369 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1523 microversion: 2.1 time: 0.397556 Aug 27 03:07:27.268259 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2751/5345] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:26 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:28.308773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bc57f516-2bc3-4369-ad38-d82f35cc2510 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:28.309569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bc57f516-2bc3-4369-ad38-d82f35cc2510 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:28.318539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc57f516-2bc3-4369-ad38-d82f35cc2510 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:28.325794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc57f516-2bc3-4369-ad38-d82f35cc2510 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:28.326320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc57f516-2bc3-4369-ad38-d82f35cc2510 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:28.327086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc57f516-2bc3-4369-ad38-d82f35cc2510 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:28.327536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc57f516-2bc3-4369-ad38-d82f35cc2510 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:28.327971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bc57f516-2bc3-4369-ad38-d82f35cc2510 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:28.663517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bc57f516-2bc3-4369-ad38-d82f35cc2510 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:28.707214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=88 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:28.724607 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bc57f516-2bc3-4369-ad38-d82f35cc2510 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1523 microversion: 2.1 time: 0.422212 Aug 27 03:07:28.746633 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2595/5346] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:28 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:29.153818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-0c58c7c6-5301-447f-a7e4-9e2703efe7bf req-c0d27d3b-fd41-4937-b651-bb7050d9ed1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff6a996-bb26-484e-a676-c5e63a4538aa", "name": "network-vif-plugged", "status": "completed", "tag": "5fb46a6a-67b0-4b69-91f2-960550291a55"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:29.194552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0c58c7c6-5301-447f-a7e4-9e2703efe7bf req-c0d27d3b-fd41-4937-b651-bb7050d9ed1e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:29.196654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0c58c7c6-5301-447f-a7e4-9e2703efe7bf req-c0d27d3b-fd41-4937-b651-bb7050d9ed1e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:29.199990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0c58c7c6-5301-447f-a7e4-9e2703efe7bf req-c0d27d3b-fd41-4937-b651-bb7050d9ed1e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:29.239527 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-0c58c7c6-5301-447f-a7e4-9e2703efe7bf req-c0d27d3b-fd41-4937-b651-bb7050d9ed1e service nova] Creating event network-vif-plugged:5fb46a6a-67b0-4b69-91f2-960550291a55 for instance 0ff6a996-bb26-484e-a676-c5e63a4538aa on n-h2-852084-5 Aug 27 03:07:29.250802 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-0c58c7c6-5301-447f-a7e4-9e2703efe7bf req-c0d27d3b-fd41-4937-b651-bb7050d9ed1e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110717 Aug 27 03:07:29.253691 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2752/5347] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:29.751577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c89bcf5-af22-4df7-bd41-33559e1304fa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:29.753563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c89bcf5-af22-4df7-bd41-33559e1304fa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:29.765620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c89bcf5-af22-4df7-bd41-33559e1304fa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:29.773226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c89bcf5-af22-4df7-bd41-33559e1304fa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:29.773902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c89bcf5-af22-4df7-bd41-33559e1304fa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:29.774896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c89bcf5-af22-4df7-bd41-33559e1304fa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:29.775389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c89bcf5-af22-4df7-bd41-33559e1304fa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:29.776392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c89bcf5-af22-4df7-bd41-33559e1304fa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:31.261123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2c89bcf5-af22-4df7-bd41-33559e1304fa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:31.295658 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c89bcf5-af22-4df7-bd41-33559e1304fa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1523 microversion: 2.1 time: 1.547936 Aug 27 03:07:31.310244 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2596/5348] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:29 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1523 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:32.319874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70d48553-b7d4-4701-888e-052d0638f6fd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:32.322020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-70d48553-b7d4-4701-888e-052d0638f6fd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:32.338053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70d48553-b7d4-4701-888e-052d0638f6fd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:32.344261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70d48553-b7d4-4701-888e-052d0638f6fd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:32.344980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70d48553-b7d4-4701-888e-052d0638f6fd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:32.345963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70d48553-b7d4-4701-888e-052d0638f6fd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:32.346611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70d48553-b7d4-4701-888e-052d0638f6fd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:32.347222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70d48553-b7d4-4701-888e-052d0638f6fd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:33.260484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-70d48553-b7d4-4701-888e-052d0638f6fd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:33.276125 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70d48553-b7d4-4701-888e-052d0638f6fd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1508 microversion: 2.1 time: 0.962304 Aug 27 03:07:33.292639 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2753/5349] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:32 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1508 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:33.319129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1fa9c91-5adf-4823-8fdb-e39a8a627ef5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:33.319750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d1fa9c91-5adf-4823-8fdb-e39a8a627ef5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:33.344751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c91-5adf-4823-8fdb-e39a8a627ef5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:33.345281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c91-5adf-4823-8fdb-e39a8a627ef5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:33.345813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c91-5adf-4823-8fdb-e39a8a627ef5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:33.346814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c91-5adf-4823-8fdb-e39a8a627ef5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:33.348502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c91-5adf-4823-8fdb-e39a8a627ef5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:33.351403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1fa9c91-5adf-4823-8fdb-e39a8a627ef5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:33.832544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1fa9c91-5adf-4823-8fdb-e39a8a627ef5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:33.856972 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1fa9c91-5adf-4823-8fdb-e39a8a627ef5 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 200 len: 1508 microversion: 2.1 time: 0.541612 Aug 27 03:07:33.870176 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2597/5350] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:33 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 1508 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:33.884470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-91c1be2f-1f44-4813-ab4d-e65d082537f7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:33.885634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-91c1be2f-1f44-4813-ab4d-e65d082537f7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:33.895934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91c1be2f-1f44-4813-ab4d-e65d082537f7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:33.896898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91c1be2f-1f44-4813-ab4d-e65d082537f7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:33.897538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91c1be2f-1f44-4813-ab4d-e65d082537f7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:33.898458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91c1be2f-1f44-4813-ab4d-e65d082537f7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:33.899098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91c1be2f-1f44-4813-ab4d-e65d082537f7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:33.899707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91c1be2f-1f44-4813-ab4d-e65d082537f7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:33.947411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-91c1be2f-1f44-4813-ab4d-e65d082537f7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:07:34.121234 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-91c1be2f-1f44-4813-ab4d-e65d082537f7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "DELETE /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 204 len: 0 microversion: 2.1 time: 0.242262 Aug 27 03:07:34.122245 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2754/5351] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:33 2022] DELETE /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:34.343500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1269518030", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "544b49db-f1cc-4bd0-95d2-c54446ab1aed"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:34.434900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] validate_networks() for [('544b49db-f1cc-4bd0-95d2-c54446ab1aed', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:07:34.647476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8829f8d4-8c27-4592-a805-de2ff60685c1 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-662042596", "availability_zone": "foo_zone"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:34.685539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.aggregate [None req-8829f8d4-8c27-4592-a805-de2ff60685c1 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Generated uuid 737658e9-1607-400e-aadd-b13fb2252485 for aggregate {{(pid=122487) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 27 03:07:34.742287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8829f8d4-8c27-4592-a805-de2ff60685c1 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.415106 Aug 27 03:07:34.745231 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2598/5352] 10.222.0.99 () {60 vars in 1164 bytes} [Sat Aug 27 03:07:34 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:34.756128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3b9418a9-fc96-48e5-adb7-7884ebd8ccdc tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:34.811182 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3b9418a9-fc96-48e5-adb7-7884ebd8ccdc tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.059233 Aug 27 03:07:34.819005 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2599/5353] 10.222.0.99 () {60 vars in 1194 bytes} [Sat Aug 27 03:07:34 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:34.824559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-434d622b-cc58-4625-aecb-8c6beee07f33 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:34.831118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-434d622b-cc58-4625-aecb-8c6beee07f33 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:34.831585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-434d622b-cc58-4625-aecb-8c6beee07f33 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:34.832364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-434d622b-cc58-4625-aecb-8c6beee07f33 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:34.833933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-434d622b-cc58-4625-aecb-8c6beee07f33 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:34.834611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-434d622b-cc58-4625-aecb-8c6beee07f33 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:34.835820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-434d622b-cc58-4625-aecb-8c6beee07f33 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:34.870797 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-434d622b-cc58-4625-aecb-8c6beee07f33 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] 10.222.0.99 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.050304 Aug 27 03:07:34.871966 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2600/5354] 10.222.0.99 () {58 vars in 1176 bytes} [Sat Aug 27 03:07:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:34.884689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d4e5a471-0f81-48de-8d78-a4425e14602d tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:34.895522 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d4e5a471-0f81-48de-8d78-a4425e14602d tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.014924 Aug 27 03:07:34.896304 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2601/5355] 10.222.0.99 () {58 vars in 1143 bytes} [Sat Aug 27 03:07:34 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:34.912982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-49d194f8-0af9-446a-a63c-460c0b745a02 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-5"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:34.930277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49d194f8-0af9-446a-a63c-460c0b745a02 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:34.931615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49d194f8-0af9-446a-a63c-460c0b745a02 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:34.932342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49d194f8-0af9-446a-a63c-460c0b745a02 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:35.530761 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-49d194f8-0af9-446a-a63c-460c0b745a02 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.623888 Aug 27 03:07:35.533333 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2602/5356] 10.222.0.99 () {60 vars in 1194 bytes} [Sat Aug 27 03:07:34 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:35.544970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ce139de-ac10-4ceb-b982-f9c2530d7ca0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:35.545503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ce139de-ac10-4ceb-b982-f9c2530d7ca0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:35.564277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce139de-ac10-4ceb-b982-f9c2530d7ca0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:35.564797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce139de-ac10-4ceb-b982-f9c2530d7ca0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:35.571522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce139de-ac10-4ceb-b982-f9c2530d7ca0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:35.578273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce139de-ac10-4ceb-b982-f9c2530d7ca0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:35.578894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce139de-ac10-4ceb-b982-f9c2530d7ca0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:35.583687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ce139de-ac10-4ceb-b982-f9c2530d7ca0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:35.686271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ce139de-ac10-4ceb-b982-f9c2530d7ca0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:07:35.940785 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ce139de-ac10-4ceb-b982-f9c2530d7ca0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "DELETE /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 204 len: 0 microversion: 2.1 time: 0.405675 Aug 27 03:07:35.949164 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2603/5357] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:35 2022] DELETE /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:35.967468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-167146e9-043d-4b6a-8909-c9ffa54e9780 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:35.998582 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-167146e9-043d-4b6a-8909-c9ffa54e9780 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.045757 Aug 27 03:07:36.001816 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2604/5358] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 03:07:35 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:36.007134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a28023a-e8b3-47f8-b218-0f8231437324 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:36.007881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a28023a-e8b3-47f8-b218-0f8231437324 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:36.029657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a28023a-e8b3-47f8-b218-0f8231437324 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:36.031410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a28023a-e8b3-47f8-b218-0f8231437324 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:36.031984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a28023a-e8b3-47f8-b218-0f8231437324 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:36.035943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a28023a-e8b3-47f8-b218-0f8231437324 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:36.036451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a28023a-e8b3-47f8-b218-0f8231437324 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:36.036909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a28023a-e8b3-47f8-b218-0f8231437324 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:36.493859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:07:36.494952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:07:36.495597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:07:36.496175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:07:36.496755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:07:36.514809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:36.515598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:36.516220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:36.517129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:36.517770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:36.518365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:36.563143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Getting quotas for project c2930739b7dc4f26b34361ee100d76f3. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:07:36.590111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Getting quotas for user 9160defddd9f46969249fe5f2a2620e2 and project c2930739b7dc4f26b34361ee100d76f3. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:07:36.624110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:07:36.626802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:07:36.765440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a28023a-e8b3-47f8-b218-0f8231437324 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:36.769853 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13534d61-ceff-4351-bc83-6d30e63a2a0c tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.431565 Aug 27 03:07:36.772103 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2755/5359] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:07:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:07:36.776481 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a28023a-e8b3-47f8-b218-0f8231437324 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1552 microversion: 2.1 time: 0.773235 Aug 27 03:07:36.783090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-88b48141-bc3c-43f1-a308-14688b3d6b80 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1239525338", "availability_zone": "foo_zone"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:36.802503 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2605/5360] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:36 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1552 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:36.812601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-860684df-656d-40ec-8c18-ce9986a8b02a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:36.824377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-860684df-656d-40ec-8c18-ce9986a8b02a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:36.884082 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-88b48141-bc3c-43f1-a308-14688b3d6b80 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] 10.222.0.99 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.109826 Aug 27 03:07:36.886272 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2756/5361] 10.222.0.99 () {60 vars in 1173 bytes} [Sat Aug 27 03:07:36 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:36.904285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b46d24f6-b25e-4a53-bb8e-edfad263dc56 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:36.986839 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b46d24f6-b25e-4a53-bb8e-edfad263dc56 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.072735 Aug 27 03:07:36.989355 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2757/5362] 10.222.0.99 () {60 vars in 1194 bytes} [Sat Aug 27 03:07:36 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:37.002669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c2d5598e-e474-467a-ac65-be1935af2f25 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:37.072063 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c2d5598e-e474-467a-ac65-be1935af2f25 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] 10.222.0.99 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.069112 Aug 27 03:07:37.074038 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2758/5363] 10.222.0.99 () {58 vars in 1152 bytes} [Sat Aug 27 03:07:36 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:37.086646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-860684df-656d-40ec-8c18-ce9986a8b02a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:37.101962 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-860684df-656d-40ec-8c18-ce9986a8b02a tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1218 microversion: 2.1 time: 0.297907 Aug 27 03:07:37.102254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4fc92ef4-476c-4071-8326-3e19e3def4e6 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:37.106159 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2606/5364] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:36 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1218 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:37.170779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fc92ef4-476c-4071-8326-3e19e3def4e6 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.171284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fc92ef4-476c-4071-8326-3e19e3def4e6 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.179089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4fc92ef4-476c-4071-8326-3e19e3def4e6 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.323574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7742fcbc-bf73-42e6-87d7-c2eb274336a3 req-75ea079b-9de2-40e5-bd95-9e812f511a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff6a996-bb26-484e-a676-c5e63a4538aa", "name": "network-vif-deleted", "tag": "5fb46a6a-67b0-4b69-91f2-960550291a55"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:37.380738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7742fcbc-bf73-42e6-87d7-c2eb274336a3 req-75ea079b-9de2-40e5-bd95-9e812f511a50 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.385059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7742fcbc-bf73-42e6-87d7-c2eb274336a3 req-75ea079b-9de2-40e5-bd95-9e812f511a50 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.386236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7742fcbc-bf73-42e6-87d7-c2eb274336a3 req-75ea079b-9de2-40e5-bd95-9e812f511a50 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.423138 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7742fcbc-bf73-42e6-87d7-c2eb274336a3 req-75ea079b-9de2-40e5-bd95-9e812f511a50 service nova] Creating event network-vif-deleted:5fb46a6a-67b0-4b69-91f2-960550291a55 for instance 0ff6a996-bb26-484e-a676-c5e63a4538aa on n-h2-852084-5 Aug 27 03:07:37.444634 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7742fcbc-bf73-42e6-87d7-c2eb274336a3 req-75ea079b-9de2-40e5-bd95-9e812f511a50 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128404 Aug 27 03:07:37.447698 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2607/5365] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:07:37.811439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b4dec069-2904-4a2b-b6e9-a1f2ff831251 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:37.813917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b4dec069-2904-4a2b-b6e9-a1f2ff831251 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:37.840379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4dec069-2904-4a2b-b6e9-a1f2ff831251 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.841353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4dec069-2904-4a2b-b6e9-a1f2ff831251 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.843754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4dec069-2904-4a2b-b6e9-a1f2ff831251 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.844651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4dec069-2904-4a2b-b6e9-a1f2ff831251 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:37.845128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4dec069-2904-4a2b-b6e9-a1f2ff831251 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:37.845567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4dec069-2904-4a2b-b6e9-a1f2ff831251 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:37.960594 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4fc92ef4-476c-4071-8326-3e19e3def4e6 tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] 10.222.0.99 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.875462 Aug 27 03:07:37.962436 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2759/5366] 10.222.0.99 () {60 vars in 1194 bytes} [Sat Aug 27 03:07:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:37.984630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-98e2bc2c-4d43-4a23-b617-1dd4ffb2486d tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:38.038476 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-98e2bc2c-4d43-4a23-b617-1dd4ffb2486d tempest-TestAggregatesBasicOps-144049674 tempest-TestAggregatesBasicOps-144049674-project-admin] 10.222.0.99 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.067039 Aug 27 03:07:38.041029 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2760/5367] 10.222.0.99 () {58 vars in 1155 bytes} [Sat Aug 27 03:07:37 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 27 03:07:38.131032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da1a188f-ac66-4cd3-8adf-3ad0ccfe1ffa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:38.132108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-da1a188f-ac66-4cd3-8adf-3ad0ccfe1ffa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:38.579673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-da1a188f-ac66-4cd3-8adf-3ad0ccfe1ffa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:38.592979 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-da1a188f-ac66-4cd3-8adf-3ad0ccfe1ffa tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1218 microversion: 2.1 time: 0.463339 Aug 27 03:07:38.594005 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2761/5368] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:38 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1218 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:38.670513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b4dec069-2904-4a2b-b6e9-a1f2ff831251 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:38.695353 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b4dec069-2904-4a2b-b6e9-a1f2ff831251 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1552 microversion: 2.1 time: 0.886919 Aug 27 03:07:38.696345 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2608/5369] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:37 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1552 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:39.618899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d6ce23cd-6e6c-42c7-adc2-a1f99c86b4ce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:39.622088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d6ce23cd-6e6c-42c7-adc2-a1f99c86b4ce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:39.650060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6ce23cd-6e6c-42c7-adc2-a1f99c86b4ce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.652767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6ce23cd-6e6c-42c7-adc2-a1f99c86b4ce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.654708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6ce23cd-6e6c-42c7-adc2-a1f99c86b4ce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.659448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6ce23cd-6e6c-42c7-adc2-a1f99c86b4ce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.662128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6ce23cd-6e6c-42c7-adc2-a1f99c86b4ce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.662873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d6ce23cd-6e6c-42c7-adc2-a1f99c86b4ce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.717029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a7cea4ed-2f41-4e24-a557-34ced80952ac tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:39.719076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a7cea4ed-2f41-4e24-a557-34ced80952ac tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:39.743408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7cea4ed-2f41-4e24-a557-34ced80952ac tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.746428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7cea4ed-2f41-4e24-a557-34ced80952ac tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.746890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7cea4ed-2f41-4e24-a557-34ced80952ac tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.753747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7cea4ed-2f41-4e24-a557-34ced80952ac tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:39.755105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7cea4ed-2f41-4e24-a557-34ced80952ac tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:39.755555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7cea4ed-2f41-4e24-a557-34ced80952ac tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:39.964153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d6ce23cd-6e6c-42c7-adc2-a1f99c86b4ce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:39.977633 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d6ce23cd-6e6c-42c7-adc2-a1f99c86b4ce tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1288 microversion: 2.1 time: 0.364848 Aug 27 03:07:39.980239 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2762/5370] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:39 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1288 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:40.016195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a7cea4ed-2f41-4e24-a557-34ced80952ac tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:40.045811 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a7cea4ed-2f41-4e24-a557-34ced80952ac tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 200 len: 1485 microversion: 2.1 time: 0.314677 Aug 27 03:07:40.049287 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2609/5371] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:39 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 1485 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:40.123830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4f46beca-a13c-4b86-8c2d-2bac18166828 req-2680d974-00a1-409f-90d8-f8f7635847f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0568e064-3202-429e-960a-a3beeb65150e", "name": "network-vif-deleted", "tag": "2b1af944-1711-41de-a803-8407e5ed2112"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:40.170782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4f46beca-a13c-4b86-8c2d-2bac18166828 req-2680d974-00a1-409f-90d8-f8f7635847f4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:40.173861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4f46beca-a13c-4b86-8c2d-2bac18166828 req-2680d974-00a1-409f-90d8-f8f7635847f4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:40.176027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4f46beca-a13c-4b86-8c2d-2bac18166828 req-2680d974-00a1-409f-90d8-f8f7635847f4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:40.192930 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4f46beca-a13c-4b86-8c2d-2bac18166828 req-2680d974-00a1-409f-90d8-f8f7635847f4 service nova] Creating event network-vif-deleted:2b1af944-1711-41de-a803-8407e5ed2112 for instance 0568e064-3202-429e-960a-a3beeb65150e on n-h1-852084-5 Aug 27 03:07:40.208173 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4f46beca-a13c-4b86-8c2d-2bac18166828 req-2680d974-00a1-409f-90d8-f8f7635847f4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095248 Aug 27 03:07:40.213956 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2763/5372] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:41.004018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bfb566ec-924f-4c66-a82d-fcfd2426b5bf tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:41.013389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bfb566ec-924f-4c66-a82d-fcfd2426b5bf tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:41.022392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfb566ec-924f-4c66-a82d-fcfd2426b5bf tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:41.023693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfb566ec-924f-4c66-a82d-fcfd2426b5bf tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:41.033966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfb566ec-924f-4c66-a82d-fcfd2426b5bf tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:41.036116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfb566ec-924f-4c66-a82d-fcfd2426b5bf tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:41.039330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfb566ec-924f-4c66-a82d-fcfd2426b5bf tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:41.040039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfb566ec-924f-4c66-a82d-fcfd2426b5bf tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:41.073515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:41.075067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 0568e064-3202-429e-960a-a3beeb65150e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:41.098329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:41.099302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:41.101862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:41.103707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:41.108279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:41.111237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:41.173183 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] HTTP exception thrown: Instance 0568e064-3202-429e-960a-a3beeb65150e could not be found. Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Request method failure captured: Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e HTTP/1.1 Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYneqYLu_uyP1Tp07PJMCLX90w2TOFbcQIbgR-RknTsabDkE2_-P6n-CKDv3imSUZ-YxviLXN5g8DO4tzH0YHUmvPD1eYkYc6tmax2ei9YEyLPaBfe3U3S1ygchrsDdXSPP97LHorWmhILHJsyajCn-7OjBLL4WjdzfDP3oumCk_CVs Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 54dbb52ebee9491ba10e591f7cbfddde Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestNetworkBasicOps-1241328853 Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_54dbb52ebee9491ba10e591f7cbfddde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/54dbb52ebee9491ba10e591f7cbfddde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/54dbb52ebee9491ba10e591f7cbfddde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/54dbb52ebee9491ba10e591f7cbfddde"}]}] Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestNetworkBasicOps-1241328853 Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 54dbb52ebee9491ba10e591f7cbfddde Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestNetworkBasicOps-1241328853 Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestNetworkBasicOps-1241328853-project Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ccbd8cc1d59d412b8b7f8cdf5db759b2 Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestNetworkBasicOps-1241328853-project Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 0568e064-3202-429e-960a-a3beeb65150e could not be found. Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '0568e064-3202-429e-960a-a3beeb65150e'} Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0568e064-3202-429e-960a-a3beeb65150e could not be found. Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0568e064-3202-429e-960a-a3beeb65150e could not be found. Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:41.175490 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:07:41.180729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:41.180729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:41.180729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:41.180729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:41.180729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:41.180729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0568e064-3202-429e-960a-a3beeb65150e could not be found. Aug 27 03:07:41.180729 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:07:41.186875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Returning 404 to user: Instance 0568e064-3202-429e-960a-a3beeb65150e could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:41.201066 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9d556157-8f5a-48b5-9cdf-3f6b7bd409af tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e" status: 404 len: 111 microversion: 2.1 time: 0.120989 Aug 27 03:07:41.203606 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2764/5373] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:41 2022] GET /compute/v2.1/servers/0568e064-3202-429e-960a-a3beeb65150e => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:07:41.483377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bfb566ec-924f-4c66-a82d-fcfd2426b5bf tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:41.493428 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bfb566ec-924f-4c66-a82d-fcfd2426b5bf tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1276 microversion: 2.1 time: 0.493213 Aug 27 03:07:41.502193 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2610/5374] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:40 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1276 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:41.813372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff4c7101-7b10-4aaf-8ca8-ff1c4702b099 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '.version_select at 0x7f4d292a0e50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:41.845135 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff4c7101-7b10-4aaf-8ca8-ff1c4702b099 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1061264558" status: 202 len: 0 microversion: 2.1 time: 0.035694 Aug 27 03:07:41.846053 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2765/5375] 10.222.0.99 () {58 vars in 1257 bytes} [Sat Aug 27 03:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1061264558 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:42.517060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c07c0fc0-2b4d-491c-97f1-f0cc30cb3938 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:42.517745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c07c0fc0-2b4d-491c-97f1-f0cc30cb3938 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:42.533185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c07c0fc0-2b4d-491c-97f1-f0cc30cb3938 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.534338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c07c0fc0-2b4d-491c-97f1-f0cc30cb3938 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.535824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c07c0fc0-2b4d-491c-97f1-f0cc30cb3938 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:42.536857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c07c0fc0-2b4d-491c-97f1-f0cc30cb3938 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:42.537568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c07c0fc0-2b4d-491c-97f1-f0cc30cb3938 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:42.538355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c07c0fc0-2b4d-491c-97f1-f0cc30cb3938 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:43.097368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c07c0fc0-2b4d-491c-97f1-f0cc30cb3938 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:43.143406 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c07c0fc0-2b4d-491c-97f1-f0cc30cb3938 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1318 microversion: 2.1 time: 0.631246 Aug 27 03:07:43.145550 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2611/5376] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:42 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:44.171697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-487316ef-c259-4df0-beb0-cea27a4713dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:44.172939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-487316ef-c259-4df0-beb0-cea27a4713dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:44.187371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-20c1cf2b-53dd-4bf0-bf2e-937397a7ef58 req-00a3aed8-92fb-41e1-9d09-6e107ef92bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17861e77-9ff3-4433-a587-0134622abeab", "tag": "e2590cae-7609-4e0f-a3a7-2908e4baecb6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:44.193607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-487316ef-c259-4df0-beb0-cea27a4713dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:44.194414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-487316ef-c259-4df0-beb0-cea27a4713dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:44.194867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-487316ef-c259-4df0-beb0-cea27a4713dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:44.195673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-487316ef-c259-4df0-beb0-cea27a4713dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:44.196142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-487316ef-c259-4df0-beb0-cea27a4713dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:44.196587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-487316ef-c259-4df0-beb0-cea27a4713dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:44.231615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-20c1cf2b-53dd-4bf0-bf2e-937397a7ef58 req-00a3aed8-92fb-41e1-9d09-6e107ef92bd4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:44.232353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-20c1cf2b-53dd-4bf0-bf2e-937397a7ef58 req-00a3aed8-92fb-41e1-9d09-6e107ef92bd4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:44.232960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-20c1cf2b-53dd-4bf0-bf2e-937397a7ef58 req-00a3aed8-92fb-41e1-9d09-6e107ef92bd4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:44.247918 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-20c1cf2b-53dd-4bf0-bf2e-937397a7ef58 req-00a3aed8-92fb-41e1-9d09-6e107ef92bd4 service nova] Creating event network-changed:e2590cae-7609-4e0f-a3a7-2908e4baecb6 for instance 17861e77-9ff3-4433-a587-0134622abeab on n-h1-852084-5 Aug 27 03:07:44.254823 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-20c1cf2b-53dd-4bf0-bf2e-937397a7ef58 req-00a3aed8-92fb-41e1-9d09-6e107ef92bd4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072095 Aug 27 03:07:44.256015 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2612/5377] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:07:44.815630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-487316ef-c259-4df0-beb0-cea27a4713dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:44.828727 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-487316ef-c259-4df0-beb0-cea27a4713dd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1318 microversion: 2.1 time: 0.663193 Aug 27 03:07:44.829455 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2766/5378] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:44 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1318 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:44.982408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:45.268759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a11a1e16-53f4-45b9-856b-a62fc617324c tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560-project-admin] Calling method '.version_select at 0x7f4d2b2cad30>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:45.271622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a11a1e16-53f4-45b9-856b-a62fc617324c tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:45.272858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a11a1e16-53f4-45b9-856b-a62fc617324c tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:45.274612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a11a1e16-53f4-45b9-856b-a62fc617324c tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:45.314214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a11a1e16-53f4-45b9-856b-a62fc617324c tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:45.319321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a11a1e16-53f4-45b9-856b-a62fc617324c tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:45.319941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a11a1e16-53f4-45b9-856b-a62fc617324c tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:45.351348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a11a1e16-53f4-45b9-856b-a62fc617324c tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:45.352515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a11a1e16-53f4-45b9-856b-a62fc617324c tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:45.354673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a11a1e16-53f4-45b9-856b-a62fc617324c tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:45.372843 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a11a1e16-53f4-45b9-856b-a62fc617324c tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560 tempest-PortsAdminExtendedAttrsIpV6TestJSON-96908560-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.395507 Aug 27 03:07:45.381794 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2613/5379] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 03:07:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:45.850770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eb9c0542-7c82-403b-a5da-b8087784e3be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:45.851391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eb9c0542-7c82-403b-a5da-b8087784e3be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:45.867981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb9c0542-7c82-403b-a5da-b8087784e3be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:45.870172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb9c0542-7c82-403b-a5da-b8087784e3be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:45.875591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb9c0542-7c82-403b-a5da-b8087784e3be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:45.877449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb9c0542-7c82-403b-a5da-b8087784e3be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:45.881365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb9c0542-7c82-403b-a5da-b8087784e3be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:45.882861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb9c0542-7c82-403b-a5da-b8087784e3be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:46.236227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eb9c0542-7c82-403b-a5da-b8087784e3be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:46.247556 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eb9c0542-7c82-403b-a5da-b8087784e3be tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1318 microversion: 2.1 time: 0.400986 Aug 27 03:07:46.250895 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2767/5380] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:45 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:46.934337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-09241270-c6f7-43d6-9a9b-2dcc91afc366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:46.934969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-09241270-c6f7-43d6-9a9b-2dcc91afc366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:46.944470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-73973d8f-7347-4176-bc07-51f7e5fb09d8 req-5e49f76b-f5c3-42aa-9acf-3ba90511e2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c51b5ce-4d4a-4a54-9e4b-a085176289aa", "tag": "61d2ce65-b4b6-4573-9c45-bc5c800f2e97"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:46.971553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:46.976709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09241270-c6f7-43d6-9a9b-2dcc91afc366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:46.977211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09241270-c6f7-43d6-9a9b-2dcc91afc366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:46.989809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09241270-c6f7-43d6-9a9b-2dcc91afc366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:46.995160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-73973d8f-7347-4176-bc07-51f7e5fb09d8 req-5e49f76b-f5c3-42aa-9acf-3ba90511e2fc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:46.996311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09241270-c6f7-43d6-9a9b-2dcc91afc366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:46.996841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09241270-c6f7-43d6-9a9b-2dcc91afc366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:46.997289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09241270-c6f7-43d6-9a9b-2dcc91afc366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:46.999380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-73973d8f-7347-4176-bc07-51f7e5fb09d8 req-5e49f76b-f5c3-42aa-9acf-3ba90511e2fc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:46.999905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-73973d8f-7347-4176-bc07-51f7e5fb09d8 req-5e49f76b-f5c3-42aa-9acf-3ba90511e2fc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.030891 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-73973d8f-7347-4176-bc07-51f7e5fb09d8 req-5e49f76b-f5c3-42aa-9acf-3ba90511e2fc service nova] Creating event network-changed:61d2ce65-b4b6-4573-9c45-bc5c800f2e97 for instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa on n-h1-852084-5 Aug 27 03:07:47.036416 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-73973d8f-7347-4176-bc07-51f7e5fb09d8 req-5e49f76b-f5c3-42aa-9acf-3ba90511e2fc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095841 Aug 27 03:07:47.037577 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2768/5381] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:07:47.066376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-09241270-c6f7-43d6-9a9b-2dcc91afc366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:07:47.139527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:47.263008 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-09241270-c6f7-43d6-9a9b-2dcc91afc366 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 204 len: 0 microversion: 2.1 time: 0.332995 Aug 27 03:07:47.266680 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2614/5382] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:46 2022] DELETE /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:47.274960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd9afb22-c0cc-40e5-968b-f04dca7f9e50 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:47.276793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd9afb22-c0cc-40e5-968b-f04dca7f9e50 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:47.284103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-59ef9afc-cf60-48d5-9ff9-13f88499023b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:47.285754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-59ef9afc-cf60-48d5-9ff9-13f88499023b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:47.287658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd9afb22-c0cc-40e5-968b-f04dca7f9e50 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.288168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd9afb22-c0cc-40e5-968b-f04dca7f9e50 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.288618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd9afb22-c0cc-40e5-968b-f04dca7f9e50 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.293540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd9afb22-c0cc-40e5-968b-f04dca7f9e50 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.294436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd9afb22-c0cc-40e5-968b-f04dca7f9e50 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.302647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59ef9afc-cf60-48d5-9ff9-13f88499023b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.303823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59ef9afc-cf60-48d5-9ff9-13f88499023b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.304505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59ef9afc-cf60-48d5-9ff9-13f88499023b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.305491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59ef9afc-cf60-48d5-9ff9-13f88499023b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:47.306783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59ef9afc-cf60-48d5-9ff9-13f88499023b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:47.307245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd9afb22-c0cc-40e5-968b-f04dca7f9e50 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.307674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59ef9afc-cf60-48d5-9ff9-13f88499023b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:47.742535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-59ef9afc-cf60-48d5-9ff9-13f88499023b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:47.755046 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-59ef9afc-cf60-48d5-9ff9-13f88499023b tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1672 microversion: 2.1 time: 0.475369 Aug 27 03:07:47.768963 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2615/5383] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:47 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1672 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:47.769432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd9afb22-c0cc-40e5-968b-f04dca7f9e50 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:47.788158 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd9afb22-c0cc-40e5-968b-f04dca7f9e50 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1318 microversion: 2.1 time: 0.520669 Aug 27 03:07:47.789106 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2769/5384] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:47 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:48.777293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e88e50ce-3536-4c9d-a767-5af69aba3f69 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:48.778828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e88e50ce-3536-4c9d-a767-5af69aba3f69 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:48.784202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:48.792415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88e50ce-3536-4c9d-a767-5af69aba3f69 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.797426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88e50ce-3536-4c9d-a767-5af69aba3f69 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.799261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88e50ce-3536-4c9d-a767-5af69aba3f69 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.801710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88e50ce-3536-4c9d-a767-5af69aba3f69 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.808841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88e50ce-3536-4c9d-a767-5af69aba3f69 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.809773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e88e50ce-3536-4c9d-a767-5af69aba3f69 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.814024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c474bd78-c4c6-4415-a6bb-b89887f9ce73 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:48.814725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c474bd78-c4c6-4415-a6bb-b89887f9ce73 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:48.818296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:48.832799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c474bd78-c4c6-4415-a6bb-b89887f9ce73 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.835425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c474bd78-c4c6-4415-a6bb-b89887f9ce73 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.838446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c474bd78-c4c6-4415-a6bb-b89887f9ce73 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.839370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c474bd78-c4c6-4415-a6bb-b89887f9ce73 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:48.840181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c474bd78-c4c6-4415-a6bb-b89887f9ce73 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:48.840780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c474bd78-c4c6-4415-a6bb-b89887f9ce73 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:48.863634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:49.239147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c474bd78-c4c6-4415-a6bb-b89887f9ce73 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:49.248834 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c474bd78-c4c6-4415-a6bb-b89887f9ce73 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1318 microversion: 2.1 time: 0.440274 Aug 27 03:07:49.249439 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2770/5385] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:48 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:50.144907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e88e50ce-3536-4c9d-a767-5af69aba3f69 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:50.161779 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e88e50ce-3536-4c9d-a767-5af69aba3f69 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1672 microversion: 2.1 time: 1.388134 Aug 27 03:07:50.163391 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2616/5386] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:48 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1672 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:50.273886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-51c4f354-3a30-4eb2-b091-1510d4b0d9e7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:50.278704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-51c4f354-3a30-4eb2-b091-1510d4b0d9e7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:50.284771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:50.303697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c4f354-3a30-4eb2-b091-1510d4b0d9e7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:50.304593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c4f354-3a30-4eb2-b091-1510d4b0d9e7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:50.305065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c4f354-3a30-4eb2-b091-1510d4b0d9e7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:50.308596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c4f354-3a30-4eb2-b091-1510d4b0d9e7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:50.309101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c4f354-3a30-4eb2-b091-1510d4b0d9e7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:50.309557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51c4f354-3a30-4eb2-b091-1510d4b0d9e7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:50.381579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:07:50.455367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-824cd4d1-8f52-46a5-b7a3-ef15f098a1c0 req-abc6f811-7b01-41b3-98c9-0e69774548c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c51b5ce-4d4a-4a54-9e4b-a085176289aa", "name": "network-vif-unplugged", "status": "completed", "tag": "61d2ce65-b4b6-4573-9c45-bc5c800f2e97"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:50.474667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-824cd4d1-8f52-46a5-b7a3-ef15f098a1c0 req-abc6f811-7b01-41b3-98c9-0e69774548c0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:50.478227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-824cd4d1-8f52-46a5-b7a3-ef15f098a1c0 req-abc6f811-7b01-41b3-98c9-0e69774548c0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:50.479074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-824cd4d1-8f52-46a5-b7a3-ef15f098a1c0 req-abc6f811-7b01-41b3-98c9-0e69774548c0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:50.513154 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-824cd4d1-8f52-46a5-b7a3-ef15f098a1c0 req-abc6f811-7b01-41b3-98c9-0e69774548c0 service nova] Creating event network-vif-unplugged:61d2ce65-b4b6-4573-9c45-bc5c800f2e97 for instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa on n-h1-852084-5 Aug 27 03:07:50.527990 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-824cd4d1-8f52-46a5-b7a3-ef15f098a1c0 req-abc6f811-7b01-41b3-98c9-0e69774548c0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076828 Aug 27 03:07:50.531078 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2617/5387] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:07:50.613490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-51c4f354-3a30-4eb2-b091-1510d4b0d9e7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:50.629581 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-51c4f354-3a30-4eb2-b091-1510d4b0d9e7 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1318 microversion: 2.1 time: 0.362433 Aug 27 03:07:50.631566 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2771/5388] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:50 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:51.189621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-34e9734a-9ab5-4ada-9a09-3db9bf5c6d92 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:51.191309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-34e9734a-9ab5-4ada-9a09-3db9bf5c6d92 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:51.204494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34e9734a-9ab5-4ada-9a09-3db9bf5c6d92 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.205712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34e9734a-9ab5-4ada-9a09-3db9bf5c6d92 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.206643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34e9734a-9ab5-4ada-9a09-3db9bf5c6d92 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.207989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34e9734a-9ab5-4ada-9a09-3db9bf5c6d92 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.208857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34e9734a-9ab5-4ada-9a09-3db9bf5c6d92 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.209760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34e9734a-9ab5-4ada-9a09-3db9bf5c6d92 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.383131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-34e9734a-9ab5-4ada-9a09-3db9bf5c6d92 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:51.392743 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-34e9734a-9ab5-4ada-9a09-3db9bf5c6d92 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 200 len: 1485 microversion: 2.1 time: 0.211830 Aug 27 03:07:51.393343 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2618/5389] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:51 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 1485 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:07:51.512272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-cb06b4b8-4306-49f5-bbab-1438c1aa78cb req-9e562f7f-c3c1-45a2-8220-381f30d5c0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c51b5ce-4d4a-4a54-9e4b-a085176289aa", "name": "network-vif-deleted", "tag": "61d2ce65-b4b6-4573-9c45-bc5c800f2e97"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:51.531783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cb06b4b8-4306-49f5-bbab-1438c1aa78cb req-9e562f7f-c3c1-45a2-8220-381f30d5c0b7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.533027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cb06b4b8-4306-49f5-bbab-1438c1aa78cb req-9e562f7f-c3c1-45a2-8220-381f30d5c0b7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.534029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cb06b4b8-4306-49f5-bbab-1438c1aa78cb req-9e562f7f-c3c1-45a2-8220-381f30d5c0b7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.555031 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-cb06b4b8-4306-49f5-bbab-1438c1aa78cb req-9e562f7f-c3c1-45a2-8220-381f30d5c0b7 service nova] Creating event network-vif-deleted:61d2ce65-b4b6-4573-9c45-bc5c800f2e97 for instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa on n-h1-852084-5 Aug 27 03:07:51.564488 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-cb06b4b8-4306-49f5-bbab-1438c1aa78cb req-9e562f7f-c3c1-45a2-8220-381f30d5c0b7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065597 Aug 27 03:07:51.565975 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2772/5390] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:51.651852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aa8e2778-5da7-4e72-b644-9c66c801c574 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:51.652548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aa8e2778-5da7-4e72-b644-9c66c801c574 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:51.663666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8e2778-5da7-4e72-b644-9c66c801c574 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.664273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8e2778-5da7-4e72-b644-9c66c801c574 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.665013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8e2778-5da7-4e72-b644-9c66c801c574 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:51.666624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8e2778-5da7-4e72-b644-9c66c801c574 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:51.667222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8e2778-5da7-4e72-b644-9c66c801c574 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:51.674000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8e2778-5da7-4e72-b644-9c66c801c574 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:52.334654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-aa8e2778-5da7-4e72-b644-9c66c801c574 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:52.349977 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aa8e2778-5da7-4e72-b644-9c66c801c574 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1318 microversion: 2.1 time: 0.702169 Aug 27 03:07:52.355697 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2619/5391] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:51 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1318 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:52.417478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:52.418244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 7c51b5ce-4d4a-4a54-9e4b-a085176289aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:52.435058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:52.435675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:52.436136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:52.436889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:52.437529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:52.439660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:52.504545 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] HTTP exception thrown: Instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa could not be found. Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Request method failure captured: Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa HTTP/1.1 Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYneqYLu_uyP1Tp07PJMCLX90w2TOFbcQIbgR-RknTsabDkE2_-P6n-CKDv3imSUZ-YxviLXN5g8DO4tzH0YHUmvPD1eYkYc6tmax2ei9YEyLPaBfe3U3S1ygchrsDdXSPP97LHorWmhILHJsyajCn-7OjBLL4WjdzfDP3oumCk_CVs Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 54dbb52ebee9491ba10e591f7cbfddde Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestNetworkBasicOps-1241328853 Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_54dbb52ebee9491ba10e591f7cbfddde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/54dbb52ebee9491ba10e591f7cbfddde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/54dbb52ebee9491ba10e591f7cbfddde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/54dbb52ebee9491ba10e591f7cbfddde"}]}] Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestNetworkBasicOps-1241328853 Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 54dbb52ebee9491ba10e591f7cbfddde Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestNetworkBasicOps-1241328853 Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestNetworkBasicOps-1241328853-project Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ccbd8cc1d59d412b8b7f8cdf5db759b2 Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestNetworkBasicOps-1241328853-project Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa could not be found. Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '7c51b5ce-4d4a-4a54-9e4b-a085176289aa'} Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa could not be found. Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa could not be found. Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:07:52.511952 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:07:52.520235 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:07:52.520235 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:07:52.520235 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:07:52.520235 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:07:52.520235 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:07:52.520235 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa could not be found. Aug 27 03:07:52.520235 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:07:52.523169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Returning 404 to user: Instance 7c51b5ce-4d4a-4a54-9e4b-a085176289aa could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:07:52.527279 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d2533ea4-b497-43b6-9516-e24420e29789 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa" status: 404 len: 111 microversion: 2.1 time: 0.115894 Aug 27 03:07:52.530893 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2773/5392] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:52 2022] GET /compute/v2.1/servers/7c51b5ce-4d4a-4a54-9e4b-a085176289aa => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:07:52.676224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-1ecae223-6408-48aa-84c4-b0fd06d082b0 req-1cbe9774-8cd9-43dc-8062-49ee3da5c26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17861e77-9ff3-4433-a587-0134622abeab", "name": "network-vif-plugged", "status": "completed", "tag": "e2590cae-7609-4e0f-a3a7-2908e4baecb6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:52.701077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1ecae223-6408-48aa-84c4-b0fd06d082b0 req-1cbe9774-8cd9-43dc-8062-49ee3da5c26c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:52.701699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1ecae223-6408-48aa-84c4-b0fd06d082b0 req-1cbe9774-8cd9-43dc-8062-49ee3da5c26c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:52.702146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1ecae223-6408-48aa-84c4-b0fd06d082b0 req-1cbe9774-8cd9-43dc-8062-49ee3da5c26c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:52.723634 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1ecae223-6408-48aa-84c4-b0fd06d082b0 req-1cbe9774-8cd9-43dc-8062-49ee3da5c26c service nova] Creating event network-vif-plugged:e2590cae-7609-4e0f-a3a7-2908e4baecb6 for instance 17861e77-9ff3-4433-a587-0134622abeab on n-h1-852084-5 Aug 27 03:07:52.748417 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-1ecae223-6408-48aa-84c4-b0fd06d082b0 req-1cbe9774-8cd9-43dc-8062-49ee3da5c26c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075736 Aug 27 03:07:52.749988 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2620/5393] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:07:52.958446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b1b3447a-79aa-44dd-b8cd-be9246c0432a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '.version_select at 0x7f4d292978b0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:53.017459 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b1b3447a-79aa-44dd-b8cd-be9246c0432a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1686777903" status: 202 len: 0 microversion: 2.1 time: 0.064705 Aug 27 03:07:53.024212 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2774/5394] 10.222.0.99 () {58 vars in 1257 bytes} [Sat Aug 27 03:07:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1686777903 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:07:53.392883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-817fbda3-b148-408b-9d83-db7475cbf382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:53.393747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-817fbda3-b148-408b-9d83-db7475cbf382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:53.409358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817fbda3-b148-408b-9d83-db7475cbf382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:53.410291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817fbda3-b148-408b-9d83-db7475cbf382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:53.411770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817fbda3-b148-408b-9d83-db7475cbf382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:53.412984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817fbda3-b148-408b-9d83-db7475cbf382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:53.414276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817fbda3-b148-408b-9d83-db7475cbf382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:53.414883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817fbda3-b148-408b-9d83-db7475cbf382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:54.036302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-817fbda3-b148-408b-9d83-db7475cbf382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:54.055658 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-817fbda3-b148-408b-9d83-db7475cbf382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1318 microversion: 2.1 time: 0.683986 Aug 27 03:07:54.060537 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2621/5395] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:53 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:55.080702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-af1ef2ed-aa92-4cff-b65e-9dbb57d1435f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:55.081423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-af1ef2ed-aa92-4cff-b65e-9dbb57d1435f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:55.090183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1ef2ed-aa92-4cff-b65e-9dbb57d1435f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.090953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1ef2ed-aa92-4cff-b65e-9dbb57d1435f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.091576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1ef2ed-aa92-4cff-b65e-9dbb57d1435f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.092458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1ef2ed-aa92-4cff-b65e-9dbb57d1435f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.093198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1ef2ed-aa92-4cff-b65e-9dbb57d1435f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.093890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af1ef2ed-aa92-4cff-b65e-9dbb57d1435f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.635406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-af1ef2ed-aa92-4cff-b65e-9dbb57d1435f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:55.652961 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-af1ef2ed-aa92-4cff-b65e-9dbb57d1435f tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1508 microversion: 2.1 time: 0.576716 Aug 27 03:07:55.666583 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2775/5396] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:55 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1508 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:55.687687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f5a45cb6-02b9-443c-93fe-b62eac658928 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:55.689677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f5a45cb6-02b9-443c-93fe-b62eac658928 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:55.699898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5a45cb6-02b9-443c-93fe-b62eac658928 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.700907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5a45cb6-02b9-443c-93fe-b62eac658928 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.701746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5a45cb6-02b9-443c-93fe-b62eac658928 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.703104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5a45cb6-02b9-443c-93fe-b62eac658928 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:55.703961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5a45cb6-02b9-443c-93fe-b62eac658928 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:55.704685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5a45cb6-02b9-443c-93fe-b62eac658928 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:55.990822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f5a45cb6-02b9-443c-93fe-b62eac658928 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:56.007826 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f5a45cb6-02b9-443c-93fe-b62eac658928 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1508 microversion: 2.1 time: 0.324683 Aug 27 03:07:56.009510 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2622/5397] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:55 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1508 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:56.030605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4837c305-5dca-485a-afe9-8a077c60d9a8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:56.034035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4837c305-5dca-485a-afe9-8a077c60d9a8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:56.041083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4837c305-5dca-485a-afe9-8a077c60d9a8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.041705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4837c305-5dca-485a-afe9-8a077c60d9a8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.042151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4837c305-5dca-485a-afe9-8a077c60d9a8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.042869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4837c305-5dca-485a-afe9-8a077c60d9a8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.043339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4837c305-5dca-485a-afe9-8a077c60d9a8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.043776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4837c305-5dca-485a-afe9-8a077c60d9a8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.129776 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4837c305-5dca-485a-afe9-8a077c60d9a8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "PUT /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1080 microversion: 2.1 time: 0.103513 Aug 27 03:07:56.133509 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2776/5398] 10.222.0.99 () {60 vars in 1256 bytes} [Sat Aug 27 03:07:56 2022] PUT /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1080 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:56.152903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-18a5d01a-bcdf-4bf8-98c4-dc0d41a86aa8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:56.153550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-18a5d01a-bcdf-4bf8-98c4-dc0d41a86aa8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:56.161343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a5d01a-bcdf-4bf8-98c4-dc0d41a86aa8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.161783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a5d01a-bcdf-4bf8-98c4-dc0d41a86aa8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.162246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a5d01a-bcdf-4bf8-98c4-dc0d41a86aa8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.165978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a5d01a-bcdf-4bf8-98c4-dc0d41a86aa8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.166492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a5d01a-bcdf-4bf8-98c4-dc0d41a86aa8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.168277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18a5d01a-bcdf-4bf8-98c4-dc0d41a86aa8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.439889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-18a5d01a-bcdf-4bf8-98c4-dc0d41a86aa8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:56.482313 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-18a5d01a-bcdf-4bf8-98c4-dc0d41a86aa8 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1506 microversion: 2.1 time: 0.332109 Aug 27 03:07:56.483640 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2623/5399] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:56 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:56.509602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aae51e20-5d81-4cb5-98d8-5bb3e47f1fac tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:56.510879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aae51e20-5d81-4cb5-98d8-5bb3e47f1fac tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:56.522229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aae51e20-5d81-4cb5-98d8-5bb3e47f1fac tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.523181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aae51e20-5d81-4cb5-98d8-5bb3e47f1fac tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.525008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aae51e20-5d81-4cb5-98d8-5bb3e47f1fac tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:56.526544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aae51e20-5d81-4cb5-98d8-5bb3e47f1fac tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:56.527455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aae51e20-5d81-4cb5-98d8-5bb3e47f1fac tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:56.528742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aae51e20-5d81-4cb5-98d8-5bb3e47f1fac tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.180620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aae51e20-5d81-4cb5-98d8-5bb3e47f1fac tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:57.202297 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aae51e20-5d81-4cb5-98d8-5bb3e47f1fac tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1506 microversion: 2.1 time: 0.698412 Aug 27 03:07:57.205113 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2777/5400] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:56 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1506 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:57.230638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-77b1e7cb-66ae-4016-aa4f-15d1106597ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:07:57.234976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-77b1e7cb-66ae-4016-aa4f-15d1106597ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:57.244225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b1e7cb-66ae-4016-aa4f-15d1106597ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.244725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b1e7cb-66ae-4016-aa4f-15d1106597ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.245222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b1e7cb-66ae-4016-aa4f-15d1106597ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.246038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b1e7cb-66ae-4016-aa4f-15d1106597ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.246502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b1e7cb-66ae-4016-aa4f-15d1106597ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.246993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-77b1e7cb-66ae-4016-aa4f-15d1106597ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.353527 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-77b1e7cb-66ae-4016-aa4f-15d1106597ab tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "PUT /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1082 microversion: 2.1 time: 0.127197 Aug 27 03:07:57.355380 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2624/5401] 10.222.0.99 () {60 vars in 1256 bytes} [Sat Aug 27 03:07:57 2022] PUT /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1082 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:57.372036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-695fde7b-498a-4887-b7eb-1a5e0b846915 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:57.372673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-695fde7b-498a-4887-b7eb-1a5e0b846915 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:57.379471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-695fde7b-498a-4887-b7eb-1a5e0b846915 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.380008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-695fde7b-498a-4887-b7eb-1a5e0b846915 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.380710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-695fde7b-498a-4887-b7eb-1a5e0b846915 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.381622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-695fde7b-498a-4887-b7eb-1a5e0b846915 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.382858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-695fde7b-498a-4887-b7eb-1a5e0b846915 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.383507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-695fde7b-498a-4887-b7eb-1a5e0b846915 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.693640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-695fde7b-498a-4887-b7eb-1a5e0b846915 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:57.706547 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-695fde7b-498a-4887-b7eb-1a5e0b846915 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1508 microversion: 2.1 time: 0.338914 Aug 27 03:07:57.722453 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2778/5402] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:57 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1508 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:57.744378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ce20840f-3b04-4747-ac63-f9111dbde4ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:57.745512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ce20840f-3b04-4747-ac63-f9111dbde4ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:57.752641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce20840f-3b04-4747-ac63-f9111dbde4ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.753427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce20840f-3b04-4747-ac63-f9111dbde4ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.754067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce20840f-3b04-4747-ac63-f9111dbde4ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:57.754966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce20840f-3b04-4747-ac63-f9111dbde4ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:57.755595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce20840f-3b04-4747-ac63-f9111dbde4ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:57.756195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce20840f-3b04-4747-ac63-f9111dbde4ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.066283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ce20840f-3b04-4747-ac63-f9111dbde4ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:58.081957 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ce20840f-3b04-4747-ac63-f9111dbde4ee tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1508 microversion: 2.1 time: 0.342282 Aug 27 03:07:58.083949 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2625/5403] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:57 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:07:58.106642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c5bc547-5705-47a9-bf5a-3696334c4679 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:58.107149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c5bc547-5705-47a9-bf5a-3696334c4679 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:58.115982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5bc547-5705-47a9-bf5a-3696334c4679 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.118591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5bc547-5705-47a9-bf5a-3696334c4679 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.121414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5bc547-5705-47a9-bf5a-3696334c4679 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.123456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5bc547-5705-47a9-bf5a-3696334c4679 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.124546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5bc547-5705-47a9-bf5a-3696334c4679 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.125635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c5bc547-5705-47a9-bf5a-3696334c4679 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.201733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c5bc547-5705-47a9-bf5a-3696334c4679 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:07:58.378704 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c5bc547-5705-47a9-bf5a-3696334c4679 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "DELETE /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 204 len: 0 microversion: 2.1 time: 0.276507 Aug 27 03:07:58.379465 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2779/5404] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:58 2022] DELETE /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:58.391669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e0a1bfd3-a3f1-4813-b67a-37cfda4173cd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:58.392862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e0a1bfd3-a3f1-4813-b67a-37cfda4173cd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:58.403545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0a1bfd3-a3f1-4813-b67a-37cfda4173cd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.404718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0a1bfd3-a3f1-4813-b67a-37cfda4173cd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.405461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0a1bfd3-a3f1-4813-b67a-37cfda4173cd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.406977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0a1bfd3-a3f1-4813-b67a-37cfda4173cd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.407724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0a1bfd3-a3f1-4813-b67a-37cfda4173cd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.408606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0a1bfd3-a3f1-4813-b67a-37cfda4173cd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.466380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e0a1bfd3-a3f1-4813-b67a-37cfda4173cd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:07:58.558825 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.compute.api [None req-e0a1bfd3-a3f1-4813-b67a-37cfda4173cd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Instance is already in deleting state, ignoring this request Aug 27 03:07:58.560552 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e0a1bfd3-a3f1-4813-b67a-37cfda4173cd tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "DELETE /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 204 len: 0 microversion: 2.1 time: 0.173440 Aug 27 03:07:58.564810 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2626/5405] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:07:58 2022] DELETE /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:07:58.570658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9abed958-e9cd-45b2-9763-3f459bac32f9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:07:58.572235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9abed958-e9cd-45b2-9763-3f459bac32f9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:07:58.587788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abed958-e9cd-45b2-9763-3f459bac32f9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.588462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abed958-e9cd-45b2-9763-3f459bac32f9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.589028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abed958-e9cd-45b2-9763-3f459bac32f9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:58.589897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abed958-e9cd-45b2-9763-3f459bac32f9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:07:58.590463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abed958-e9cd-45b2-9763-3f459bac32f9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:07:58.590989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abed958-e9cd-45b2-9763-3f459bac32f9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:07:59.248660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9abed958-e9cd-45b2-9763-3f459bac32f9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:07:59.270585 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9abed958-e9cd-45b2-9763-3f459bac32f9 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1514 microversion: 2.1 time: 0.704126 Aug 27 03:07:59.275039 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2780/5406] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:07:58 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1514 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:00.306129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-28c9e643-e180-4629-94cb-e0ec46063382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:00.307493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-28c9e643-e180-4629-94cb-e0ec46063382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:00.319338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28c9e643-e180-4629-94cb-e0ec46063382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.319956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28c9e643-e180-4629-94cb-e0ec46063382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.320407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28c9e643-e180-4629-94cb-e0ec46063382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:00.321069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28c9e643-e180-4629-94cb-e0ec46063382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:00.321556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28c9e643-e180-4629-94cb-e0ec46063382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:00.322050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28c9e643-e180-4629-94cb-e0ec46063382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:01.573175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-28c9e643-e180-4629-94cb-e0ec46063382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9160defddd9f46969249fe5f2a2620e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2930739b7dc4f26b34361ee100d76f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:01.611917 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-28c9e643-e180-4629-94cb-e0ec46063382 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 200 len: 1514 microversion: 2.1 time: 1.312388 Aug 27 03:08:01.635124 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2627/5407] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:00 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 1514 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:01.642708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-cff7de3a-0b41-4682-8799-c5e117f3d86c req-31c4ae5c-f0d0-493d-b341-ef9d635951bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17861e77-9ff3-4433-a587-0134622abeab", "name": "network-vif-deleted", "tag": "e2590cae-7609-4e0f-a3a7-2908e4baecb6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:01.676610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cff7de3a-0b41-4682-8799-c5e117f3d86c req-31c4ae5c-f0d0-493d-b341-ef9d635951bc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:01.677108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cff7de3a-0b41-4682-8799-c5e117f3d86c req-31c4ae5c-f0d0-493d-b341-ef9d635951bc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:01.677554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cff7de3a-0b41-4682-8799-c5e117f3d86c req-31c4ae5c-f0d0-493d-b341-ef9d635951bc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:01.697127 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-cff7de3a-0b41-4682-8799-c5e117f3d86c req-31c4ae5c-f0d0-493d-b341-ef9d635951bc service nova] Creating event network-vif-deleted:e2590cae-7609-4e0f-a3a7-2908e4baecb6 for instance 17861e77-9ff3-4433-a587-0134622abeab on n-h1-852084-5 Aug 27 03:08:01.716284 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-cff7de3a-0b41-4682-8799-c5e117f3d86c req-31c4ae5c-f0d0-493d-b341-ef9d635951bc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075847 Aug 27 03:08:01.719258 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2781/5408] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:02.638666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.639565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 17861e77-9ff3-4433-a587-0134622abeab] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:02.654675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.655329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.655599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.656617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.657248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.657899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.695461 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] HTTP exception thrown: Instance 17861e77-9ff3-4433-a587-0134622abeab could not be found. Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Request method failure captured: Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab HTTP/1.1 Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYnwuA5ieqU8gxE6qneyM1xGqEYJFlHoS1AIicH8CVPKJUGkRJDFJop8PTuDjTsoqYa2NVBV-sS6oN3euEN4x9dPg8OLO3SIJPw8m0hSijGC3FDTTLZOMrFlTu-2bAUyhePJg5Qokwc_BPFszp6pLgFwEmwKZ5QJyW6NVedWm_qPDnM Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c2930739b7dc4f26b34361ee100d76f3 Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c2930739b7dc4f26b34361ee100d76f3"}]}] Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c2930739b7dc4f26b34361ee100d76f3 Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerDiskConfigTestJSON-723319263-project Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9160defddd9f46969249fe5f2a2620e2 Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerDiskConfigTestJSON-723319263-project Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 17861e77-9ff3-4433-a587-0134622abeab could not be found. Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '17861e77-9ff3-4433-a587-0134622abeab'} Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17861e77-9ff3-4433-a587-0134622abeab could not be found. Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17861e77-9ff3-4433-a587-0134622abeab could not be found. Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.697462 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.702665 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.702665 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.702665 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.702665 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:02.702665 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:02.702665 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17861e77-9ff3-4433-a587-0134622abeab could not be found. Aug 27 03:08:02.702665 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.704919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Returning 404 to user: Instance 17861e77-9ff3-4433-a587-0134622abeab could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:02.708891 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3dd92bf4-b98e-437b-a1ee-7469949b635d tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab" status: 404 len: 111 microversion: 2.1 time: 0.074744 Aug 27 03:08:02.709716 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2782/5409] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:02 2022] GET /compute/v2.1/servers/17861e77-9ff3-4433-a587-0134622abeab => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:02.724954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.726042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:02.741870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.742358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.742840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.743652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.744108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.744536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.780177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-49e5d31c-ff60-44c7-ba6c-39cc198a3758 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'create', calling method: .version_select at 0x7f4d29be1940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-71932956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjM2fNWedWhsQ8opIyUiS3oKZdys8caXWetZ42HvslaB5HPbRnbkpCq3aZ7yt4DAGCfPeb9DdmCXC2UZ+6mA4rdQ5vK6VAtVluSWosoipw3O/lCagQJ6mzEloOiHQISLA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:02.782421 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] HTTP exception thrown: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Request method failure captured: Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa HTTP/1.1 Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYnwuA5ieqU8gxE6qneyM1xGqEYJFlHoS1AIicH8CVPKJUGkRJDFJop8PTuDjTsoqYa2NVBV-sS6oN3euEN4x9dPg8OLO3SIJPw8m0hSijGC3FDTTLZOMrFlTu-2bAUyhePJg5Qokwc_BPFszp6pLgFwEmwKZ5QJyW6NVedWm_qPDnM Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c2930739b7dc4f26b34361ee100d76f3 Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c2930739b7dc4f26b34361ee100d76f3"}]}] Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c2930739b7dc4f26b34361ee100d76f3 Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerDiskConfigTestJSON-723319263-project Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9160defddd9f46969249fe5f2a2620e2 Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerDiskConfigTestJSON-723319263-project Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '0ff6a996-bb26-484e-a676-c5e63a4538aa'} Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:02.787368 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:02.793353 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. Aug 27 03:08:02.793353 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.793353 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.793353 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.793353 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.793353 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.793353 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.793353 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:02.793353 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:02.793353 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. Aug 27 03:08:02.793353 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.804469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Returning 404 to user: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:02.805452 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3dbc4d8a-bd4f-4dc0-86cf-4df78dec02bc tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "DELETE /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 404 len: 111 microversion: 2.1 time: 0.090111 Aug 27 03:08:02.813737 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2783/5410] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:08:02 2022] DELETE /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:02.825815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-49e5d31c-ff60-44c7-ba6c-39cc198a3758 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:02.828884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.829538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: 0ff6a996-bb26-484e-a676-c5e63a4538aa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:02.838706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-49e5d31c-ff60-44c7-ba6c-39cc198a3758 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for user 86930a2f684449a5a228ea43a7ab5e23 and project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:02.847939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.848418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.849012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.849785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.850257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.850668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.873081 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-49e5d31c-ff60-44c7-ba6c-39cc198a3758 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.717413 Aug 27 03:08:02.877803 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] HTTP exception thrown: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Request method failure captured: Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa HTTP/1.1 Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYnwuA5ieqU8gxE6qneyM1xGqEYJFlHoS1AIicH8CVPKJUGkRJDFJop8PTuDjTsoqYa2NVBV-sS6oN3euEN4x9dPg8OLO3SIJPw8m0hSijGC3FDTTLZOMrFlTu-2bAUyhePJg5Qokwc_BPFszp6pLgFwEmwKZ5QJyW6NVedWm_qPDnM Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c2930739b7dc4f26b34361ee100d76f3 Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c2930739b7dc4f26b34361ee100d76f3"}]}] Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c2930739b7dc4f26b34361ee100d76f3 Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerDiskConfigTestJSON-723319263-project Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9160defddd9f46969249fe5f2a2620e2 Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerDiskConfigTestJSON-723319263-project Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '0ff6a996-bb26-484e-a676-c5e63a4538aa'} Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.880299 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.887151 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.887151 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.887151 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.887151 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:02.887151 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:02.887151 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. Aug 27 03:08:02.887151 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.888956 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2628/5411] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:08:02 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:02.890754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Returning 404 to user: Instance 0ff6a996-bb26-484e-a676-c5e63a4538aa could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:02.891955 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f705a0fd-71d8-41fa-9451-b470b7a6d562 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa" status: 404 len: 111 microversion: 2.1 time: 0.076734 Aug 27 03:08:02.893390 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2784/5412] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:02 2022] GET /compute/v2.1/servers/0ff6a996-bb26-484e-a676-c5e63a4538aa => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:02.907465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.907997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:02.915779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.916278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.917286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.918097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.919239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.919942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.943415 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] HTTP exception thrown: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Request method failure captured: Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 HTTP/1.1 Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYnwuA5ieqU8gxE6qneyM1xGqEYJFlHoS1AIicH8CVPKJUGkRJDFJop8PTuDjTsoqYa2NVBV-sS6oN3euEN4x9dPg8OLO3SIJPw8m0hSijGC3FDTTLZOMrFlTu-2bAUyhePJg5Qokwc_BPFszp6pLgFwEmwKZ5QJyW6NVedWm_qPDnM Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c2930739b7dc4f26b34361ee100d76f3 Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c2930739b7dc4f26b34361ee100d76f3"}]}] Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c2930739b7dc4f26b34361ee100d76f3 Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerDiskConfigTestJSON-723319263-project Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 9160defddd9f46969249fe5f2a2620e2 Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerDiskConfigTestJSON-723319263-project Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'dd717b6a-4a99-4312-a369-a655d985f4a1'} Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:02.946660 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:02.953843 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. Aug 27 03:08:02.953843 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.953843 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:02.953843 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.953843 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:02.953843 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:02.953843 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:02.953843 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:02.953843 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:02.953843 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. Aug 27 03:08:02.953843 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:02.957429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Returning 404 to user: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:02.959454 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da84d97b-441a-435c-85df-166d932839c4 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "DELETE /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 404 len: 111 microversion: 2.1 time: 0.061489 Aug 27 03:08:02.961276 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2629/5413] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:08:02 2022] DELETE /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:02.970283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:02.971077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] [instance: dd717b6a-4a99-4312-a369-a655d985f4a1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:02.980697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.983492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.984961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:02.986498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:02.987221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:02.988421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:03.015621 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] HTTP exception thrown: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Request method failure captured: Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 HTTP/1.1 Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYnwuA5ieqU8gxE6qneyM1xGqEYJFlHoS1AIicH8CVPKJUGkRJDFJop8PTuDjTsoqYa2NVBV-sS6oN3euEN4x9dPg8OLO3SIJPw8m0hSijGC3FDTTLZOMrFlTu-2bAUyhePJg5Qokwc_BPFszp6pLgFwEmwKZ5QJyW6NVedWm_qPDnM Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c2930739b7dc4f26b34361ee100d76f3 Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c2930739b7dc4f26b34361ee100d76f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c2930739b7dc4f26b34361ee100d76f3"}]}] Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c2930739b7dc4f26b34361ee100d76f3 Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-723319263 Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerDiskConfigTestJSON-723319263-project Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 9160defddd9f46969249fe5f2a2620e2 Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerDiskConfigTestJSON-723319263-project Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'dd717b6a-4a99-4312-a369-a655d985f4a1'} Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:03.021707 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.027892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:03.027892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:03.027892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:03.027892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:03.027892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:03.027892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. Aug 27 03:08:03.027892 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:08:03.029306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] Returning 404 to user: Instance dd717b6a-4a99-4312-a369-a655d985f4a1 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:03.031424 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1d77058d-31a7-4a47-b085-9a98f28f1877 tempest-ServerDiskConfigTestJSON-723319263 tempest-ServerDiskConfigTestJSON-723319263-project] 10.222.0.99 "GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1" status: 404 len: 111 microversion: 2.1 time: 0.064164 Aug 27 03:08:03.033136 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2785/5414] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:02 2022] GET /compute/v2.1/servers/dd717b6a-4a99-4312-a369-a655d985f4a1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:21.598309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2f97ec55-267d-4d04-9102-1229c151e239 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Action: 'create', calling method: .version_select at 0x7f4d29d16700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2145592902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRVs0TucOf5DH7K/h+LaREpYQuRnuHp//VOSIVOxA+2Ms9gFW0cNqd5lPhBcrKMS/p+dI45UlULTvaLoz8gxsA1KQis4U7weo4/WERPXq/oFusdoyb6P22dfiKDFPiAcg=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:21.622195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:21.623336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:21.624012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:21.667292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2f97ec55-267d-4d04-9102-1229c151e239 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:21.691531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-2f97ec55-267d-4d04-9102-1229c151e239 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for user ccbd8cc1d59d412b8b7f8cdf5db759b2 and project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:21.759792 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2f97ec55-267d-4d04-9102-1229c151e239 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.165455 Aug 27 03:08:21.760718 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2630/5415] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:08:21 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:26.639308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:26.644845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:26.849014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-608525711", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a7f149e5-3bf9-4728-ad5f-b673712c2f5f"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:26.965295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] validate_networks() for [('a7f149e5-3bf9-4728-ad5f-b673712c2f5f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:28.041817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1686937356", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "70638713-d549-4c59-883b-b1829eced5dd"}], "key_name": "tempest-TestNetworkBasicOps-2145592902", "security_groups": [{"name": "tempest-secgroup-smoke-1772993043"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:28.373164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] validate_networks() for [('70638713-d549-4c59-883b-b1829eced5dd', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:28.947035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:28.948247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:28.949008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:28.950312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:28.951024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:28.976299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.981278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.982276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:28.984001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:28.985961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:28.988192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:29.049518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:29.064102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for user 756fff89d19d41869dad9425eddd55c1 and project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:29.100878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:29.111818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:29.218852 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7d8bac0b-181f-4658-86b6-d2734b769d20 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.585971 Aug 27 03:08:29.220608 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2786/5416] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:08:29.238198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1079494208", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "883ea118-590c-42dc-9610-b52f3d2617ee"}], "key_name": "tempest-TestNetworkAdvancedServerOps-71932956", "security_groups": [{"name": "tempest-secgroup-smoke-256891441"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:29.479844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:29.479844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:29.480575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:29.480771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:29.481147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:29.499499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:29.500032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:29.500449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:29.501197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:29.511755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:29.512588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:29.586220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:29.610518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Getting quotas for user ccbd8cc1d59d412b8b7f8cdf5db759b2 and project 54dbb52ebee9491ba10e591f7cbfddde. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:29.665626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:29.668274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:29.882183 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e3f85aa-1422-45cd-a607-b300aebcf26a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.844284 Aug 27 03:08:29.887163 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2631/5417] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:08:29.908319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ff4409b1-fc1d-4b87-9e0e-99253b224982 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:29.908319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ff4409b1-fc1d-4b87-9e0e-99253b224982 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:30.087648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ff4409b1-fc1d-4b87-9e0e-99253b224982 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:30.096334 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ff4409b1-fc1d-4b87-9e0e-99253b224982 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1192 microversion: 2.1 time: 0.207720 Aug 27 03:08:30.103261 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2632/5418] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:29 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1192 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:30.113740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5ad8e99d-718f-4dfe-8116-a69b958b69d3 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:30.114529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5ad8e99d-718f-4dfe-8116-a69b958b69d3 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:30.450030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5ad8e99d-718f-4dfe-8116-a69b958b69d3 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:30.463531 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5ad8e99d-718f-4dfe-8116-a69b958b69d3 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1249 microversion: 2.1 time: 0.357279 Aug 27 03:08:30.466046 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2633/5419] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:30 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1249 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:31.124750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-df8122a9-7aa0-442a-8f51-502eec7cfe10 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:31.125409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-df8122a9-7aa0-442a-8f51-502eec7cfe10 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:31.139545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df8122a9-7aa0-442a-8f51-502eec7cfe10 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.140034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df8122a9-7aa0-442a-8f51-502eec7cfe10 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.140477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df8122a9-7aa0-442a-8f51-502eec7cfe10 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.152977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df8122a9-7aa0-442a-8f51-502eec7cfe10 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.153575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df8122a9-7aa0-442a-8f51-502eec7cfe10 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.154103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-df8122a9-7aa0-442a-8f51-502eec7cfe10 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.344659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] validate_networks() for [('883ea118-590c-42dc-9610-b52f3d2617ee', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:31.865525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-df8122a9-7aa0-442a-8f51-502eec7cfe10 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:31.874986 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-df8122a9-7aa0-442a-8f51-502eec7cfe10 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1244 microversion: 2.1 time: 0.754502 Aug 27 03:08:31.886061 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2634/5420] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:31 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1244 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:31.891449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-22867b9e-35c5-4fe1-920c-9b0e270206f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:31.892432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-22867b9e-35c5-4fe1-920c-9b0e270206f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:31.912463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22867b9e-35c5-4fe1-920c-9b0e270206f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.919335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22867b9e-35c5-4fe1-920c-9b0e270206f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.920491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22867b9e-35c5-4fe1-920c-9b0e270206f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:31.921469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22867b9e-35c5-4fe1-920c-9b0e270206f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:31.922168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22867b9e-35c5-4fe1-920c-9b0e270206f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:31.922811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-22867b9e-35c5-4fe1-920c-9b0e270206f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:32.228175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-22867b9e-35c5-4fe1-920c-9b0e270206f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:32.240590 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-22867b9e-35c5-4fe1-920c-9b0e270206f1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1301 microversion: 2.1 time: 0.352805 Aug 27 03:08:32.242932 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2635/5421] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:31 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1301 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:32.896455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3673bee1-6775-4429-883c-221a397dc161 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:32.897348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3673bee1-6775-4429-883c-221a397dc161 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:32.908637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3673bee1-6775-4429-883c-221a397dc161 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:32.913354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3673bee1-6775-4429-883c-221a397dc161 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:32.914316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3673bee1-6775-4429-883c-221a397dc161 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:32.915011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3673bee1-6775-4429-883c-221a397dc161 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:32.915470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3673bee1-6775-4429-883c-221a397dc161 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:32.915896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3673bee1-6775-4429-883c-221a397dc161 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:33.440987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:33.442595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:33.443604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:33.444469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:33.446013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:33.475533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:33.476880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:33.477513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:33.478534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:33.481324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:33.482852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:33.492851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3673bee1-6775-4429-883c-221a397dc161 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:33.505201 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3673bee1-6775-4429-883c-221a397dc161 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1250 microversion: 2.1 time: 0.612537 Aug 27 03:08:33.508844 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2636/5422] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:32 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1250 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:33.521235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1993bd59-9d30-40f3-9ea5-0262ae379dc5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:33.523661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1993bd59-9d30-40f3-9ea5-0262ae379dc5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:33.532239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:33.544188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for user 86930a2f684449a5a228ea43a7ab5e23 and project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:33.544705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1993bd59-9d30-40f3-9ea5-0262ae379dc5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:33.545333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1993bd59-9d30-40f3-9ea5-0262ae379dc5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:33.545824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1993bd59-9d30-40f3-9ea5-0262ae379dc5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:33.548412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1993bd59-9d30-40f3-9ea5-0262ae379dc5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:33.549221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1993bd59-9d30-40f3-9ea5-0262ae379dc5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:33.549695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1993bd59-9d30-40f3-9ea5-0262ae379dc5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:33.583286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:33.588500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:33.681178 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3f3f04f6-588a-4fe8-ab60-01689848a4b3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.459200 Aug 27 03:08:33.681868 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2787/5423] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 4461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:08:33.698657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-27834e95-be3a-4836-a836-0b0faf3ca613 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:33.699600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-27834e95-be3a-4836-a836-0b0faf3ca613 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:33.748911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1993bd59-9d30-40f3-9ea5-0262ae379dc5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:33.764804 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1993bd59-9d30-40f3-9ea5-0262ae379dc5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1307 microversion: 2.1 time: 0.251115 Aug 27 03:08:33.765852 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2637/5424] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:33 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1307 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:33.950399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-27834e95-be3a-4836-a836-0b0faf3ca613 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:33.959885 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-27834e95-be3a-4836-a836-0b0faf3ca613 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1265 microversion: 2.1 time: 0.265198 Aug 27 03:08:33.961422 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2788/5425] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:33 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:34.537315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3e0fdf1d-4203-44d4-be30-f22967661db4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:34.540323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3e0fdf1d-4203-44d4-be30-f22967661db4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:34.557195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0fdf1d-4203-44d4-be30-f22967661db4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:34.559215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0fdf1d-4203-44d4-be30-f22967661db4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:34.561088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0fdf1d-4203-44d4-be30-f22967661db4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:34.562205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0fdf1d-4203-44d4-be30-f22967661db4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:34.564662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0fdf1d-4203-44d4-be30-f22967661db4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:34.566888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e0fdf1d-4203-44d4-be30-f22967661db4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:34.792733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0c1566b8-2329-49ae-9d88-83f4b801c9c2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:34.794291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0c1566b8-2329-49ae-9d88-83f4b801c9c2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:34.808011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c1566b8-2329-49ae-9d88-83f4b801c9c2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:34.808855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c1566b8-2329-49ae-9d88-83f4b801c9c2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:34.809813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c1566b8-2329-49ae-9d88-83f4b801c9c2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:34.811019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c1566b8-2329-49ae-9d88-83f4b801c9c2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:34.811996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c1566b8-2329-49ae-9d88-83f4b801c9c2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:34.812446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c1566b8-2329-49ae-9d88-83f4b801c9c2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:34.923604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0c1566b8-2329-49ae-9d88-83f4b801c9c2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:34.937730 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0c1566b8-2329-49ae-9d88-83f4b801c9c2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1307 microversion: 2.1 time: 0.150331 Aug 27 03:08:34.944900 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2789/5426] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:34 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1307 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:34.987231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e4428db-aaaa-4d4f-ab37-b5b63fd118ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:34.987962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5e4428db-aaaa-4d4f-ab37-b5b63fd118ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:34.998541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e4428db-aaaa-4d4f-ab37-b5b63fd118ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:34.999103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e4428db-aaaa-4d4f-ab37-b5b63fd118ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:34.999557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e4428db-aaaa-4d4f-ab37-b5b63fd118ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:35.000439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e4428db-aaaa-4d4f-ab37-b5b63fd118ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:35.001044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e4428db-aaaa-4d4f-ab37-b5b63fd118ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:35.002137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e4428db-aaaa-4d4f-ab37-b5b63fd118ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:35.214823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5e4428db-aaaa-4d4f-ab37-b5b63fd118ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:35.237564 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e4428db-aaaa-4d4f-ab37-b5b63fd118ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1261 microversion: 2.1 time: 0.250463 Aug 27 03:08:35.246625 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2790/5427] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:34 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1261 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:35.261597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3e0fdf1d-4203-44d4-be30-f22967661db4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:35.275118 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3e0fdf1d-4203-44d4-be30-f22967661db4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1292 microversion: 2.1 time: 0.742079 Aug 27 03:08:35.275745 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2638/5428] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:34 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1292 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:35.969630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bfff5482-4b92-4634-8479-05cc8ce1b0c7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:35.971160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bfff5482-4b92-4634-8479-05cc8ce1b0c7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:35.985198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfff5482-4b92-4634-8479-05cc8ce1b0c7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:35.985773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfff5482-4b92-4634-8479-05cc8ce1b0c7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:35.986225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfff5482-4b92-4634-8479-05cc8ce1b0c7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:35.991484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfff5482-4b92-4634-8479-05cc8ce1b0c7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:36.000405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfff5482-4b92-4634-8479-05cc8ce1b0c7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:36.003269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bfff5482-4b92-4634-8479-05cc8ce1b0c7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:36.275133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-69a07b8b-131f-4ebe-9be1-7a6c81e8eb5c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:36.276822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-69a07b8b-131f-4ebe-9be1-7a6c81e8eb5c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:36.294067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69a07b8b-131f-4ebe-9be1-7a6c81e8eb5c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:36.297046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69a07b8b-131f-4ebe-9be1-7a6c81e8eb5c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:36.301202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69a07b8b-131f-4ebe-9be1-7a6c81e8eb5c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:36.302418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69a07b8b-131f-4ebe-9be1-7a6c81e8eb5c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:36.308350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69a07b8b-131f-4ebe-9be1-7a6c81e8eb5c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:36.309102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69a07b8b-131f-4ebe-9be1-7a6c81e8eb5c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:36.475896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-69a07b8b-131f-4ebe-9be1-7a6c81e8eb5c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:36.486153 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-69a07b8b-131f-4ebe-9be1-7a6c81e8eb5c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1323 microversion: 2.1 time: 0.215593 Aug 27 03:08:36.491660 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2639/5429] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:36 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:36.496425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-283fbce7-c6a9-48d8-815e-b0dc73e57622 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:36.497042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-283fbce7-c6a9-48d8-815e-b0dc73e57622 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:36.524685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-283fbce7-c6a9-48d8-815e-b0dc73e57622 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:36.525001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-283fbce7-c6a9-48d8-815e-b0dc73e57622 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:36.525695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-283fbce7-c6a9-48d8-815e-b0dc73e57622 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:36.526789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-283fbce7-c6a9-48d8-815e-b0dc73e57622 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:36.527431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-283fbce7-c6a9-48d8-815e-b0dc73e57622 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:36.528609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-283fbce7-c6a9-48d8-815e-b0dc73e57622 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:36.575824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bfff5482-4b92-4634-8479-05cc8ce1b0c7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:36.596201 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bfff5482-4b92-4634-8479-05cc8ce1b0c7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1307 microversion: 2.1 time: 0.630300 Aug 27 03:08:36.596864 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2791/5430] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:35 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1307 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:37.533470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33164c34-2720-4511-9a12-70e47ee3c9a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:37.536801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-33164c34-2720-4511-9a12-70e47ee3c9a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:37.576673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33164c34-2720-4511-9a12-70e47ee3c9a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:37.578634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33164c34-2720-4511-9a12-70e47ee3c9a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:37.580190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33164c34-2720-4511-9a12-70e47ee3c9a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:37.583228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33164c34-2720-4511-9a12-70e47ee3c9a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:37.583729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33164c34-2720-4511-9a12-70e47ee3c9a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:37.587065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33164c34-2720-4511-9a12-70e47ee3c9a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:37.760442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-283fbce7-c6a9-48d8-815e-b0dc73e57622 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:37.772117 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-283fbce7-c6a9-48d8-815e-b0dc73e57622 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1292 microversion: 2.1 time: 1.279218 Aug 27 03:08:37.773087 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2640/5431] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:36 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1292 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:37.782725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-275cd3dc-0771-4fa8-a098-95566777151a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:37.784435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-275cd3dc-0771-4fa8-a098-95566777151a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:37.794803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-275cd3dc-0771-4fa8-a098-95566777151a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:37.795574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-275cd3dc-0771-4fa8-a098-95566777151a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:37.796188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-275cd3dc-0771-4fa8-a098-95566777151a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:37.797087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-275cd3dc-0771-4fa8-a098-95566777151a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:37.797837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-275cd3dc-0771-4fa8-a098-95566777151a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:37.798733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-275cd3dc-0771-4fa8-a098-95566777151a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:37.900095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-33164c34-2720-4511-9a12-70e47ee3c9a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:37.915346 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-33164c34-2720-4511-9a12-70e47ee3c9a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1323 microversion: 2.1 time: 0.392434 Aug 27 03:08:37.915958 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2792/5432] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:37 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1323 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:38.634999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-275cd3dc-0771-4fa8-a098-95566777151a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:38.653313 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-275cd3dc-0771-4fa8-a098-95566777151a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1375 microversion: 2.1 time: 0.878810 Aug 27 03:08:38.653947 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2641/5433] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:37 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1375 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:38.794779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d5710dc7-c24d-4c1d-a6fc-1db5dccd4d39 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:38.795777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d5710dc7-c24d-4c1d-a6fc-1db5dccd4d39 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:38.805479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5710dc7-c24d-4c1d-a6fc-1db5dccd4d39 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:38.806468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5710dc7-c24d-4c1d-a6fc-1db5dccd4d39 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:38.807292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5710dc7-c24d-4c1d-a6fc-1db5dccd4d39 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:38.808415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5710dc7-c24d-4c1d-a6fc-1db5dccd4d39 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:38.809121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5710dc7-c24d-4c1d-a6fc-1db5dccd4d39 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:38.811254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5710dc7-c24d-4c1d-a6fc-1db5dccd4d39 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:38.943985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a0b99b10-14f5-47fb-89ef-b730362cf098 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:38.944637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a0b99b10-14f5-47fb-89ef-b730362cf098 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:38.967386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0b99b10-14f5-47fb-89ef-b730362cf098 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:38.968100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0b99b10-14f5-47fb-89ef-b730362cf098 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:38.968753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0b99b10-14f5-47fb-89ef-b730362cf098 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:38.969645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0b99b10-14f5-47fb-89ef-b730362cf098 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:38.970288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0b99b10-14f5-47fb-89ef-b730362cf098 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:38.970887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0b99b10-14f5-47fb-89ef-b730362cf098 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:39.437132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d5710dc7-c24d-4c1d-a6fc-1db5dccd4d39 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:39.456709 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d5710dc7-c24d-4c1d-a6fc-1db5dccd4d39 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1292 microversion: 2.1 time: 0.667016 Aug 27 03:08:39.458150 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2793/5434] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:38 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1292 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:39.467105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-25b963d6-dd1f-4130-bbc5-759d6f2cc015 req-002aecd1-3fd5-4887-82d3-95471b5c1b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b67ef45-5e14-458d-a30b-c126f3f6fc9f", "tag": "782d272b-7cd1-4d7b-8895-06b7e7b13067"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:39.489450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-25b963d6-dd1f-4130-bbc5-759d6f2cc015 req-002aecd1-3fd5-4887-82d3-95471b5c1b51 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:39.490030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-25b963d6-dd1f-4130-bbc5-759d6f2cc015 req-002aecd1-3fd5-4887-82d3-95471b5c1b51 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:39.490482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-25b963d6-dd1f-4130-bbc5-759d6f2cc015 req-002aecd1-3fd5-4887-82d3-95471b5c1b51 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:39.506640 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-25b963d6-dd1f-4130-bbc5-759d6f2cc015 req-002aecd1-3fd5-4887-82d3-95471b5c1b51 service nova] Creating event network-changed:782d272b-7cd1-4d7b-8895-06b7e7b13067 for instance 4b67ef45-5e14-458d-a30b-c126f3f6fc9f on n-h1-852084-5 Aug 27 03:08:39.523799 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-25b963d6-dd1f-4130-bbc5-759d6f2cc015 req-002aecd1-3fd5-4887-82d3-95471b5c1b51 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059302 Aug 27 03:08:39.525487 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2794/5435] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:39.542554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:39.550159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a0b99b10-14f5-47fb-89ef-b730362cf098 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:39.569261 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a0b99b10-14f5-47fb-89ef-b730362cf098 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1390 microversion: 2.1 time: 0.625551 Aug 27 03:08:39.570478 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2642/5436] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:38 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1390 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:39.677964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e837f9f5-69cb-4050-bacc-43c9b970be60 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:39.680314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e837f9f5-69cb-4050-bacc-43c9b970be60 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:39.710817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e837f9f5-69cb-4050-bacc-43c9b970be60 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:39.715544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e837f9f5-69cb-4050-bacc-43c9b970be60 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:39.717028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e837f9f5-69cb-4050-bacc-43c9b970be60 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:39.719352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e837f9f5-69cb-4050-bacc-43c9b970be60 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:39.719846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e837f9f5-69cb-4050-bacc-43c9b970be60 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:39.720294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e837f9f5-69cb-4050-bacc-43c9b970be60 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:40.196128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e837f9f5-69cb-4050-bacc-43c9b970be60 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:40.207169 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e837f9f5-69cb-4050-bacc-43c9b970be60 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1375 microversion: 2.1 time: 0.536517 Aug 27 03:08:40.227682 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2795/5437] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:39 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1375 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:40.479798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=14 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:40.498548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2efd8bea-5d90-4721-8207-a67c2107ef23 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:40.501642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2efd8bea-5d90-4721-8207-a67c2107ef23 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:40.515062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2efd8bea-5d90-4721-8207-a67c2107ef23 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:40.515560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2efd8bea-5d90-4721-8207-a67c2107ef23 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:40.517247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2efd8bea-5d90-4721-8207-a67c2107ef23 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:40.522399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2efd8bea-5d90-4721-8207-a67c2107ef23 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:40.530562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2efd8bea-5d90-4721-8207-a67c2107ef23 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:40.531727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2efd8bea-5d90-4721-8207-a67c2107ef23 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:40.596848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9415c11a-e526-4967-92b4-426e7ae740f6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:40.597964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9415c11a-e526-4967-92b4-426e7ae740f6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:40.608851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9415c11a-e526-4967-92b4-426e7ae740f6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:40.612394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9415c11a-e526-4967-92b4-426e7ae740f6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:40.613102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9415c11a-e526-4967-92b4-426e7ae740f6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:40.617710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9415c11a-e526-4967-92b4-426e7ae740f6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:40.618523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9415c11a-e526-4967-92b4-426e7ae740f6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:40.619147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9415c11a-e526-4967-92b4-426e7ae740f6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:40.860396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2efd8bea-5d90-4721-8207-a67c2107ef23 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:40.883917 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2efd8bea-5d90-4721-8207-a67c2107ef23 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1292 microversion: 2.1 time: 0.404349 Aug 27 03:08:40.887806 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2643/5438] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:40 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1292 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:41.099347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9415c11a-e526-4967-92b4-426e7ae740f6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:41.111308 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9415c11a-e526-4967-92b4-426e7ae740f6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1390 microversion: 2.1 time: 0.519912 Aug 27 03:08:41.112107 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2796/5439] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:40 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1390 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:41.234479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88106b00-bb4e-42cc-aa01-d73cb167b026 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:41.235401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-88106b00-bb4e-42cc-aa01-d73cb167b026 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:41.242878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88106b00-bb4e-42cc-aa01-d73cb167b026 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:41.243472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88106b00-bb4e-42cc-aa01-d73cb167b026 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:41.244165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88106b00-bb4e-42cc-aa01-d73cb167b026 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:41.245076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88106b00-bb4e-42cc-aa01-d73cb167b026 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:41.245536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88106b00-bb4e-42cc-aa01-d73cb167b026 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:41.246171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88106b00-bb4e-42cc-aa01-d73cb167b026 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:41.466697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-88106b00-bb4e-42cc-aa01-d73cb167b026 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:41.475857 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-88106b00-bb4e-42cc-aa01-d73cb167b026 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1375 microversion: 2.1 time: 0.245265 Aug 27 03:08:41.495008 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2644/5440] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:41 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1375 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:41.559387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-04594cd0-8ab7-4a9d-9034-2e011b73bda3 req-ab50ea1b-8ea4-461a-9a24-fe1925dc7dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e9087f3-e9e3-46ef-bb07-345b9308d1fa", "tag": "c616639e-5446-4839-a5bd-61feea81d16a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:41.576895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-04594cd0-8ab7-4a9d-9034-2e011b73bda3 req-ab50ea1b-8ea4-461a-9a24-fe1925dc7dfc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:41.577393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-04594cd0-8ab7-4a9d-9034-2e011b73bda3 req-ab50ea1b-8ea4-461a-9a24-fe1925dc7dfc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:41.578385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-04594cd0-8ab7-4a9d-9034-2e011b73bda3 req-ab50ea1b-8ea4-461a-9a24-fe1925dc7dfc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:41.598202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-04594cd0-8ab7-4a9d-9034-2e011b73bda3 req-ab50ea1b-8ea4-461a-9a24-fe1925dc7dfc service nova] Creating event network-changed:c616639e-5446-4839-a5bd-61feea81d16a for instance 2e9087f3-e9e3-46ef-bb07-345b9308d1fa on n-h1-852084-5 Aug 27 03:08:41.604720 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-04594cd0-8ab7-4a9d-9034-2e011b73bda3 req-ab50ea1b-8ea4-461a-9a24-fe1925dc7dfc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053084 Aug 27 03:08:41.605978 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2797/5441] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:41.908213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8a34185-2364-4c6d-9431-fc169f055ed4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:41.908847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e8a34185-2364-4c6d-9431-fc169f055ed4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:41.920691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8a34185-2364-4c6d-9431-fc169f055ed4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:41.921199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8a34185-2364-4c6d-9431-fc169f055ed4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:41.921659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8a34185-2364-4c6d-9431-fc169f055ed4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:41.922390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8a34185-2364-4c6d-9431-fc169f055ed4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:41.922839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8a34185-2364-4c6d-9431-fc169f055ed4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:41.923276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8a34185-2364-4c6d-9431-fc169f055ed4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.133692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec692994-26cc-4c32-a3d4-736cc926922c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:42.134860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ec692994-26cc-4c32-a3d4-736cc926922c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:42.143268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec692994-26cc-4c32-a3d4-736cc926922c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.144222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec692994-26cc-4c32-a3d4-736cc926922c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.144904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec692994-26cc-4c32-a3d4-736cc926922c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.145965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec692994-26cc-4c32-a3d4-736cc926922c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.146701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec692994-26cc-4c32-a3d4-736cc926922c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.147372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec692994-26cc-4c32-a3d4-736cc926922c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.469708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e8a34185-2364-4c6d-9431-fc169f055ed4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:42.479271 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e8a34185-2364-4c6d-9431-fc169f055ed4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1292 microversion: 2.1 time: 0.574560 Aug 27 03:08:42.484804 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2645/5442] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:41 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1292 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:42.485109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2c286863-d226-4d40-aaff-2e1f5c43a119 req-c86df73a-b0ce-4870-9082-626c0a015eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32747fe6-7436-4fc4-bc35-ae0f8495d2e3", "tag": "7982bae4-d6b1-46bd-8563-3151707a0e2a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:42.499776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2c286863-d226-4d40-aaff-2e1f5c43a119 req-c86df73a-b0ce-4870-9082-626c0a015eb3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.501164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2c286863-d226-4d40-aaff-2e1f5c43a119 req-c86df73a-b0ce-4870-9082-626c0a015eb3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.501825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2c286863-d226-4d40-aaff-2e1f5c43a119 req-c86df73a-b0ce-4870-9082-626c0a015eb3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.513973 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2c286863-d226-4d40-aaff-2e1f5c43a119 req-c86df73a-b0ce-4870-9082-626c0a015eb3 service nova] Creating event network-changed:7982bae4-d6b1-46bd-8563-3151707a0e2a for instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 on n-h2-852084-5 Aug 27 03:08:42.519893 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2c286863-d226-4d40-aaff-2e1f5c43a119 req-c86df73a-b0ce-4870-9082-626c0a015eb3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038588 Aug 27 03:08:42.522850 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2646/5443] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:42.529946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88c6454f-90ee-4cb0-b833-763df4af0276 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:42.531462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-88c6454f-90ee-4cb0-b833-763df4af0276 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:42.541730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88c6454f-90ee-4cb0-b833-763df4af0276 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.542684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88c6454f-90ee-4cb0-b833-763df4af0276 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.543339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88c6454f-90ee-4cb0-b833-763df4af0276 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.544357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88c6454f-90ee-4cb0-b833-763df4af0276 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:42.544991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88c6454f-90ee-4cb0-b833-763df4af0276 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:42.546002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88c6454f-90ee-4cb0-b833-763df4af0276 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:42.765617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ec692994-26cc-4c32-a3d4-736cc926922c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:42.782930 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec692994-26cc-4c32-a3d4-736cc926922c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1390 microversion: 2.1 time: 0.654330 Aug 27 03:08:42.784328 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2798/5444] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:42 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1390 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:43.229230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-88c6454f-90ee-4cb0-b833-763df4af0276 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:43.247734 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-88c6454f-90ee-4cb0-b833-763df4af0276 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1375 microversion: 2.1 time: 0.723566 Aug 27 03:08:43.252428 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2647/5445] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:42 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1375 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:43.500453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c6271f24-428d-4366-a7d4-62cbec893edb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:43.501836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6271f24-428d-4366-a7d4-62cbec893edb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:43.510879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6271f24-428d-4366-a7d4-62cbec893edb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:43.512022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6271f24-428d-4366-a7d4-62cbec893edb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:43.513396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6271f24-428d-4366-a7d4-62cbec893edb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:43.516061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6271f24-428d-4366-a7d4-62cbec893edb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:43.516750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6271f24-428d-4366-a7d4-62cbec893edb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:43.517867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6271f24-428d-4366-a7d4-62cbec893edb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:43.518701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:43.806136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-639fb324-b853-4490-8878-d4ea1645c965 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:43.807473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-639fb324-b853-4490-8878-d4ea1645c965 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:43.818220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639fb324-b853-4490-8878-d4ea1645c965 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:43.821631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639fb324-b853-4490-8878-d4ea1645c965 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:43.822215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639fb324-b853-4490-8878-d4ea1645c965 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:43.823073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639fb324-b853-4490-8878-d4ea1645c965 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:43.824379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639fb324-b853-4490-8878-d4ea1645c965 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:43.826265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639fb324-b853-4490-8878-d4ea1645c965 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:43.948118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c6271f24-428d-4366-a7d4-62cbec893edb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:43.955324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=14 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:43.965303 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c6271f24-428d-4366-a7d4-62cbec893edb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1292 microversion: 2.1 time: 0.468715 Aug 27 03:08:43.970462 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2799/5446] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:43 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1292 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:44.271802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-639fb324-b853-4490-8878-d4ea1645c965 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:44.277421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3179593a-aaf5-41c0-932f-a8a6da89661d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:44.278091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3179593a-aaf5-41c0-932f-a8a6da89661d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:44.291151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3179593a-aaf5-41c0-932f-a8a6da89661d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:44.291660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3179593a-aaf5-41c0-932f-a8a6da89661d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:44.292180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3179593a-aaf5-41c0-932f-a8a6da89661d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:44.293959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3179593a-aaf5-41c0-932f-a8a6da89661d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:44.294453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3179593a-aaf5-41c0-932f-a8a6da89661d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:44.294900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3179593a-aaf5-41c0-932f-a8a6da89661d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:44.296525 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-639fb324-b853-4490-8878-d4ea1645c965 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1390 microversion: 2.1 time: 0.495648 Aug 27 03:08:44.298060 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2648/5447] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:43 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1390 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:44.648945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3179593a-aaf5-41c0-932f-a8a6da89661d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:44.661115 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3179593a-aaf5-41c0-932f-a8a6da89661d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1375 microversion: 2.1 time: 0.388215 Aug 27 03:08:44.666478 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2800/5448] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:44 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1375 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:45.001610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e443d00d-6ebd-4499-a760-e5b79653c191 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:45.005503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e443d00d-6ebd-4499-a760-e5b79653c191 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:45.022969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e443d00d-6ebd-4499-a760-e5b79653c191 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:45.025278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e443d00d-6ebd-4499-a760-e5b79653c191 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:45.025991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e443d00d-6ebd-4499-a760-e5b79653c191 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:45.027482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e443d00d-6ebd-4499-a760-e5b79653c191 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:45.029106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e443d00d-6ebd-4499-a760-e5b79653c191 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:45.034909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e443d00d-6ebd-4499-a760-e5b79653c191 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:45.252272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e443d00d-6ebd-4499-a760-e5b79653c191 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:45.267062 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e443d00d-6ebd-4499-a760-e5b79653c191 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1292 microversion: 2.1 time: 0.270737 Aug 27 03:08:45.268414 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2649/5449] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:44 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1292 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:45.322388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fbd61d9b-f3d1-4360-b03d-972821ed648a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:45.322921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fbd61d9b-f3d1-4360-b03d-972821ed648a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:45.334954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd61d9b-f3d1-4360-b03d-972821ed648a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:45.335992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd61d9b-f3d1-4360-b03d-972821ed648a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:45.336434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd61d9b-f3d1-4360-b03d-972821ed648a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:45.337180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd61d9b-f3d1-4360-b03d-972821ed648a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:45.337642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd61d9b-f3d1-4360-b03d-972821ed648a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:45.343967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbd61d9b-f3d1-4360-b03d-972821ed648a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:45.689771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d0da136c-1933-4175-9154-9f442939f7d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:45.690125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d0da136c-1933-4175-9154-9f442939f7d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:45.706220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0da136c-1933-4175-9154-9f442939f7d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:45.707084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0da136c-1933-4175-9154-9f442939f7d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:45.707867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0da136c-1933-4175-9154-9f442939f7d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:45.709049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0da136c-1933-4175-9154-9f442939f7d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:45.709899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0da136c-1933-4175-9154-9f442939f7d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:45.711451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0da136c-1933-4175-9154-9f442939f7d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:45.868966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fbd61d9b-f3d1-4360-b03d-972821ed648a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:45.881849 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fbd61d9b-f3d1-4360-b03d-972821ed648a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1390 microversion: 2.1 time: 0.563445 Aug 27 03:08:45.903013 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2801/5450] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:45 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1390 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:45.908625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d0da136c-1933-4175-9154-9f442939f7d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:45.917260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:45.922109 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d0da136c-1933-4175-9154-9f442939f7d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1375 microversion: 2.1 time: 0.237150 Aug 27 03:08:45.923484 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2650/5451] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:45 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1375 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:46.289767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-af797282-6800-43ce-9192-7d4aba3970c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:46.290881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-af797282-6800-43ce-9192-7d4aba3970c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:46.309832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af797282-6800-43ce-9192-7d4aba3970c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:46.310342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af797282-6800-43ce-9192-7d4aba3970c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:46.310789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af797282-6800-43ce-9192-7d4aba3970c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:46.311515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af797282-6800-43ce-9192-7d4aba3970c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:46.311984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af797282-6800-43ce-9192-7d4aba3970c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:46.312853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-af797282-6800-43ce-9192-7d4aba3970c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:46.761069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-af797282-6800-43ce-9192-7d4aba3970c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:46.800669 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-af797282-6800-43ce-9192-7d4aba3970c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1292 microversion: 2.1 time: 0.512249 Aug 27 03:08:46.803529 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2802/5452] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:46 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1292 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:46.907215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9bf69f04-1c68-4bfb-b2cb-2aaa4f80f93f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:46.908670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9bf69f04-1c68-4bfb-b2cb-2aaa4f80f93f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:46.931924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9bf69f04-1c68-4bfb-b2cb-2aaa4f80f93f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:46.932877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9bf69f04-1c68-4bfb-b2cb-2aaa4f80f93f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:46.934619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9bf69f04-1c68-4bfb-b2cb-2aaa4f80f93f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:46.935629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9bf69f04-1c68-4bfb-b2cb-2aaa4f80f93f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:46.938876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9bf69f04-1c68-4bfb-b2cb-2aaa4f80f93f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:46.944320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-16028d60-1b07-4c70-8c63-5772bfba98a7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:46.945392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-16028d60-1b07-4c70-8c63-5772bfba98a7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:46.949485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9bf69f04-1c68-4bfb-b2cb-2aaa4f80f93f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:46.964422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16028d60-1b07-4c70-8c63-5772bfba98a7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:46.967382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16028d60-1b07-4c70-8c63-5772bfba98a7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:46.970651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16028d60-1b07-4c70-8c63-5772bfba98a7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:46.972935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16028d60-1b07-4c70-8c63-5772bfba98a7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:46.973733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16028d60-1b07-4c70-8c63-5772bfba98a7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:46.977338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16028d60-1b07-4c70-8c63-5772bfba98a7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:47.348659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-16028d60-1b07-4c70-8c63-5772bfba98a7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:47.363887 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-16028d60-1b07-4c70-8c63-5772bfba98a7 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1375 microversion: 2.1 time: 0.423219 Aug 27 03:08:47.364942 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2803/5453] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:46 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1375 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:47.776487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9bf69f04-1c68-4bfb-b2cb-2aaa4f80f93f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:47.787126 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9bf69f04-1c68-4bfb-b2cb-2aaa4f80f93f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1390 microversion: 2.1 time: 0.884229 Aug 27 03:08:47.792775 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2651/5454] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:46 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1390 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:47.828798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-55dcba48-7c2f-468c-a0cf-e6ff7fb4cc89 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:47.844430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-55dcba48-7c2f-468c-a0cf-e6ff7fb4cc89 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:47.879693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55dcba48-7c2f-468c-a0cf-e6ff7fb4cc89 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:47.880824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55dcba48-7c2f-468c-a0cf-e6ff7fb4cc89 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:47.881302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55dcba48-7c2f-468c-a0cf-e6ff7fb4cc89 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:47.883421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55dcba48-7c2f-468c-a0cf-e6ff7fb4cc89 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:47.884486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55dcba48-7c2f-468c-a0cf-e6ff7fb4cc89 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:47.884933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55dcba48-7c2f-468c-a0cf-e6ff7fb4cc89 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.243368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-797e2e6f-7dfd-4b46-9219-edb0f5a706aa req-913c628a-74d3-4de4-9653-efdb10cc0c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b67ef45-5e14-458d-a30b-c126f3f6fc9f", "name": "network-vif-plugged", "status": "completed", "tag": "782d272b-7cd1-4d7b-8895-06b7e7b13067"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:48.263829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-797e2e6f-7dfd-4b46-9219-edb0f5a706aa req-913c628a-74d3-4de4-9653-efdb10cc0c20 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.264320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-797e2e6f-7dfd-4b46-9219-edb0f5a706aa req-913c628a-74d3-4de4-9653-efdb10cc0c20 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.264766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-797e2e6f-7dfd-4b46-9219-edb0f5a706aa req-913c628a-74d3-4de4-9653-efdb10cc0c20 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.301347 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-797e2e6f-7dfd-4b46-9219-edb0f5a706aa req-913c628a-74d3-4de4-9653-efdb10cc0c20 service nova] Creating event network-vif-plugged:782d272b-7cd1-4d7b-8895-06b7e7b13067 for instance 4b67ef45-5e14-458d-a30b-c126f3f6fc9f on n-h1-852084-5 Aug 27 03:08:48.311616 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-797e2e6f-7dfd-4b46-9219-edb0f5a706aa req-913c628a-74d3-4de4-9653-efdb10cc0c20 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074147 Aug 27 03:08:48.312614 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2652/5455] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:48.394770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dac88f31-8952-4722-a192-cb29aaf060ee tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:48.395699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dac88f31-8952-4722-a192-cb29aaf060ee tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:48.409219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac88f31-8952-4722-a192-cb29aaf060ee tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.410140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac88f31-8952-4722-a192-cb29aaf060ee tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.410976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac88f31-8952-4722-a192-cb29aaf060ee tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.414273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac88f31-8952-4722-a192-cb29aaf060ee tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.414932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac88f31-8952-4722-a192-cb29aaf060ee tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.418774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac88f31-8952-4722-a192-cb29aaf060ee tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.627350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-55dcba48-7c2f-468c-a0cf-e6ff7fb4cc89 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:48.645608 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-55dcba48-7c2f-468c-a0cf-e6ff7fb4cc89 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1292 microversion: 2.1 time: 0.822406 Aug 27 03:08:48.649495 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2804/5456] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:47 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1292 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:48.669320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dac88f31-8952-4722-a192-cb29aaf060ee tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:48.689076 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dac88f31-8952-4722-a192-cb29aaf060ee tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1375 microversion: 2.1 time: 0.302333 Aug 27 03:08:48.690284 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2653/5457] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:48 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1375 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:48.815377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b9cf00ef-c0d8-46e2-bd24-89471ddf564c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:48.816008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b9cf00ef-c0d8-46e2-bd24-89471ddf564c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:48.823175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9cf00ef-c0d8-46e2-bd24-89471ddf564c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.823941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9cf00ef-c0d8-46e2-bd24-89471ddf564c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.824576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9cf00ef-c0d8-46e2-bd24-89471ddf564c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:48.826026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9cf00ef-c0d8-46e2-bd24-89471ddf564c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:48.826498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9cf00ef-c0d8-46e2-bd24-89471ddf564c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:48.827124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9cf00ef-c0d8-46e2-bd24-89471ddf564c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.213412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b9cf00ef-c0d8-46e2-bd24-89471ddf564c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:49.225079 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b9cf00ef-c0d8-46e2-bd24-89471ddf564c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1390 microversion: 2.1 time: 0.415855 Aug 27 03:08:49.232864 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2805/5458] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:48 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1390 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:49.669542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-caca7208-2958-4754-8a27-35742b51b852 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:49.670205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-caca7208-2958-4754-8a27-35742b51b852 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:49.689077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-caca7208-2958-4754-8a27-35742b51b852 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.689606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-caca7208-2958-4754-8a27-35742b51b852 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.690096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-caca7208-2958-4754-8a27-35742b51b852 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.690819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-caca7208-2958-4754-8a27-35742b51b852 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.702227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-caca7208-2958-4754-8a27-35742b51b852 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.707079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-caca7208-2958-4754-8a27-35742b51b852 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.712201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4212e7e3-ed65-4fe6-9fc6-8083f313ded0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:49.712831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4212e7e3-ed65-4fe6-9fc6-8083f313ded0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:49.727560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4212e7e3-ed65-4fe6-9fc6-8083f313ded0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.728009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4212e7e3-ed65-4fe6-9fc6-8083f313ded0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.734755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4212e7e3-ed65-4fe6-9fc6-8083f313ded0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.735534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4212e7e3-ed65-4fe6-9fc6-8083f313ded0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:49.736009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4212e7e3-ed65-4fe6-9fc6-8083f313ded0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:49.736446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4212e7e3-ed65-4fe6-9fc6-8083f313ded0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:49.761586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:50.030026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-caca7208-2958-4754-8a27-35742b51b852 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:50.044285 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-caca7208-2958-4754-8a27-35742b51b852 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1473 microversion: 2.1 time: 0.379451 Aug 27 03:08:50.046394 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2654/5459] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:49 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1473 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:50.212613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4212e7e3-ed65-4fe6-9fc6-8083f313ded0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:50.229360 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4212e7e3-ed65-4fe6-9fc6-8083f313ded0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1375 microversion: 2.1 time: 0.521734 Aug 27 03:08:50.230903 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2806/5460] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:49 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1375 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:50.255858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6fb70ec0-d435-45bc-9e6a-475c7f90b820 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:50.257425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6fb70ec0-d435-45bc-9e6a-475c7f90b820 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:50.266485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fb70ec0-d435-45bc-9e6a-475c7f90b820 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:50.266995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fb70ec0-d435-45bc-9e6a-475c7f90b820 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:50.267449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fb70ec0-d435-45bc-9e6a-475c7f90b820 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:50.268183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fb70ec0-d435-45bc-9e6a-475c7f90b820 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:50.268972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fb70ec0-d435-45bc-9e6a-475c7f90b820 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:50.269597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6fb70ec0-d435-45bc-9e6a-475c7f90b820 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:50.290176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1131750761", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:50.409906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] validate_networks() for [('a7f149e5-3bf9-4728-ad5f-b673712c2f5f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:50.618913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6fb70ec0-d435-45bc-9e6a-475c7f90b820 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:50.635163 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6fb70ec0-d435-45bc-9e6a-475c7f90b820 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1390 microversion: 2.1 time: 0.381823 Aug 27 03:08:50.650804 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2655/5461] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:50 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1390 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:50.662913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0f0f1732-e6d0-4f75-8567-33344a8141dd req-53ae9b2d-4bd5-464f-8b73-39379f665358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32747fe6-7436-4fc4-bc35-ae0f8495d2e3", "name": "network-vif-plugged", "status": "completed", "tag": "7982bae4-d6b1-46bd-8563-3151707a0e2a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:50.687655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0f0f1732-e6d0-4f75-8567-33344a8141dd req-53ae9b2d-4bd5-464f-8b73-39379f665358 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:50.691878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0f0f1732-e6d0-4f75-8567-33344a8141dd req-53ae9b2d-4bd5-464f-8b73-39379f665358 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:50.702071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0f0f1732-e6d0-4f75-8567-33344a8141dd req-53ae9b2d-4bd5-464f-8b73-39379f665358 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:50.724567 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0f0f1732-e6d0-4f75-8567-33344a8141dd req-53ae9b2d-4bd5-464f-8b73-39379f665358 service nova] Creating event network-vif-plugged:7982bae4-d6b1-46bd-8563-3151707a0e2a for instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 on n-h2-852084-5 Aug 27 03:08:50.742661 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0f0f1732-e6d0-4f75-8567-33344a8141dd req-53ae9b2d-4bd5-464f-8b73-39379f665358 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085662 Aug 27 03:08:50.744437 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2656/5462] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:51.252165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a3a511a1-771c-45c8-ae29-fa6aa6cf58ba tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:51.253155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a3a511a1-771c-45c8-ae29-fa6aa6cf58ba tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:51.269027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3a511a1-771c-45c8-ae29-fa6aa6cf58ba tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.269917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3a511a1-771c-45c8-ae29-fa6aa6cf58ba tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.270611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3a511a1-771c-45c8-ae29-fa6aa6cf58ba tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:51.271601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3a511a1-771c-45c8-ae29-fa6aa6cf58ba tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.272267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3a511a1-771c-45c8-ae29-fa6aa6cf58ba tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.272996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3a511a1-771c-45c8-ae29-fa6aa6cf58ba tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:51.737695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a3a511a1-771c-45c8-ae29-fa6aa6cf58ba tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:51.749416 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a3a511a1-771c-45c8-ae29-fa6aa6cf58ba tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1375 microversion: 2.1 time: 0.502027 Aug 27 03:08:51.750040 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2657/5463] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:51 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1375 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:51.766347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3d1f627e-1b10-4218-8385-9dfbc3c3090d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:51.766982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3d1f627e-1b10-4218-8385-9dfbc3c3090d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:51.774843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:51.776402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d1f627e-1b10-4218-8385-9dfbc3c3090d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.776898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d1f627e-1b10-4218-8385-9dfbc3c3090d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.777803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d1f627e-1b10-4218-8385-9dfbc3c3090d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:51.778622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d1f627e-1b10-4218-8385-9dfbc3c3090d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:51.779200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d1f627e-1b10-4218-8385-9dfbc3c3090d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:51.779635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3d1f627e-1b10-4218-8385-9dfbc3c3090d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.022385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3d1f627e-1b10-4218-8385-9dfbc3c3090d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:52.032916 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3d1f627e-1b10-4218-8385-9dfbc3c3090d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1390 microversion: 2.1 time: 0.279055 Aug 27 03:08:52.041684 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2658/5464] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:51 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1390 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:52.092730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:52.093770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:52.094488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:52.094917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:52.095340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:52.114110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.114615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.115066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.115819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.118668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.119160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.169275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:52.182592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for user 756fff89d19d41869dad9425eddd55c1 and project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:52.224350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:52.233263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: c4b962a7-433f-426d-bbaf-49e6824a5684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:52.315470 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b7eee5e3-86ae-4a2e-b25d-ce227491206e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.030064 Aug 27 03:08:52.316429 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2807/5465] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:08:52.329121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8029f91f-3c84-4d3c-91aa-0d7ba63a25e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:52.329999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8029f91f-3c84-4d3c-91aa-0d7ba63a25e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: c4b962a7-433f-426d-bbaf-49e6824a5684] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:52.371629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8029f91f-3c84-4d3c-91aa-0d7ba63a25e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: c4b962a7-433f-426d-bbaf-49e6824a5684] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:08:52.773543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-515038e0-0d3c-4941-9c43-0bfa07cb3a8f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:52.774879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-515038e0-0d3c-4941-9c43-0bfa07cb3a8f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:52.791991 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8029f91f-3c84-4d3c-91aa-0d7ba63a25e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/c4b962a7-433f-426d-bbaf-49e6824a5684" status: 204 len: 0 microversion: 2.1 time: 0.466889 Aug 27 03:08:52.792604 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2659/5466] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:08:52 2022] DELETE /compute/v2.1/servers/c4b962a7-433f-426d-bbaf-49e6824a5684 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:08:52.799900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-515038e0-0d3c-4941-9c43-0bfa07cb3a8f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.800634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-515038e0-0d3c-4941-9c43-0bfa07cb3a8f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.818939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-515038e0-0d3c-4941-9c43-0bfa07cb3a8f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.820036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-515038e0-0d3c-4941-9c43-0bfa07cb3a8f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.820690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-515038e0-0d3c-4941-9c43-0bfa07cb3a8f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.822571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-515038e0-0d3c-4941-9c43-0bfa07cb3a8f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.842108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d34a196c-b2fa-4a69-9e4b-2c1732805787 req-f93f5851-768e-4379-b4e8-e76d1e062f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e9087f3-e9e3-46ef-bb07-345b9308d1fa", "name": "network-vif-plugged", "status": "completed", "tag": "c616639e-5446-4839-a5bd-61feea81d16a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:52.878568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d34a196c-b2fa-4a69-9e4b-2c1732805787 req-f93f5851-768e-4379-b4e8-e76d1e062f3e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:52.879400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d34a196c-b2fa-4a69-9e4b-2c1732805787 req-f93f5851-768e-4379-b4e8-e76d1e062f3e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:52.880843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d34a196c-b2fa-4a69-9e4b-2c1732805787 req-f93f5851-768e-4379-b4e8-e76d1e062f3e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:52.909958 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d34a196c-b2fa-4a69-9e4b-2c1732805787 req-f93f5851-768e-4379-b4e8-e76d1e062f3e service nova] Creating event network-vif-plugged:c616639e-5446-4839-a5bd-61feea81d16a for instance 2e9087f3-e9e3-46ef-bb07-345b9308d1fa on n-h1-852084-5 Aug 27 03:08:52.919376 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d34a196c-b2fa-4a69-9e4b-2c1732805787 req-f93f5851-768e-4379-b4e8-e76d1e062f3e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125527 Aug 27 03:08:52.920269 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2660/5467] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:08:52.929358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e982212-9f40-4d42-984d-4412cbce50c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:52.930360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4e982212-9f40-4d42-984d-4412cbce50c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: c4b962a7-433f-426d-bbaf-49e6824a5684] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:52.968274 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-4e982212-9f40-4d42-984d-4412cbce50c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e982212-9f40-4d42-984d-4412cbce50c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/c4b962a7-433f-426d-bbaf-49e6824a5684 HTTP/1.1 Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'c4b962a7-433f-426d-bbaf-49e6824a5684'} Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance c4b962a7-433f-426d-bbaf-49e6824a5684 Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:52.984387 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e982212-9f40-4d42-984d-4412cbce50c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4e982212-9f40-4d42-984d-4412cbce50c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/c4b962a7-433f-426d-bbaf-49e6824a5684" status: 404 len: 111 microversion: 2.1 time: 0.063964 Aug 27 03:08:52.994403 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2661/5468] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:52 2022] GET /compute/v2.1/servers/c4b962a7-433f-426d-bbaf-49e6824a5684 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:08:53.063394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8606b36-be12-4321-9eb8-96794c434b1c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:53.064106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e8606b36-be12-4321-9eb8-96794c434b1c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:53.093302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8606b36-be12-4321-9eb8-96794c434b1c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:53.107127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8606b36-be12-4321-9eb8-96794c434b1c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:53.113955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8606b36-be12-4321-9eb8-96794c434b1c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:53.116333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8606b36-be12-4321-9eb8-96794c434b1c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:53.117605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8606b36-be12-4321-9eb8-96794c434b1c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:53.119635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8606b36-be12-4321-9eb8-96794c434b1c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:53.701060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e8606b36-be12-4321-9eb8-96794c434b1c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:53.711540 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e8606b36-be12-4321-9eb8-96794c434b1c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1562 microversion: 2.1 time: 0.652390 Aug 27 03:08:53.727788 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2662/5469] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:53 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1562 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:53.751163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1569199110", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "a7f149e5-3bf9-4728-ad5f-b673712c2f5f"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:08:53.858383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] validate_networks() for [('a7f149e5-3bf9-4728-ad5f-b673712c2f5f', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:08:54.061481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-515038e0-0d3c-4941-9c43-0bfa07cb3a8f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:54.074973 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-515038e0-0d3c-4941-9c43-0bfa07cb3a8f tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1375 microversion: 2.1 time: 1.306070 Aug 27 03:08:54.077459 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2808/5470] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:52 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1375 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:54.088872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-54eec926-5b1c-40ba-9110-b07976f5047c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:54.089554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-54eec926-5b1c-40ba-9110-b07976f5047c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:54.125839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54eec926-5b1c-40ba-9110-b07976f5047c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.126417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54eec926-5b1c-40ba-9110-b07976f5047c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.126902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54eec926-5b1c-40ba-9110-b07976f5047c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:54.127790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54eec926-5b1c-40ba-9110-b07976f5047c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:54.128441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54eec926-5b1c-40ba-9110-b07976f5047c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:54.128871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54eec926-5b1c-40ba-9110-b07976f5047c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:54.570444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-54eec926-5b1c-40ba-9110-b07976f5047c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:54.583320 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-54eec926-5b1c-40ba-9110-b07976f5047c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1562 microversion: 2.1 time: 0.502003 Aug 27 03:08:54.598686 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2809/5471] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:54 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1562 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:55.101911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-408580b7-326b-4b2b-a9dd-4e1b442a47a2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:55.103403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-408580b7-326b-4b2b-a9dd-4e1b442a47a2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:55.114796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-408580b7-326b-4b2b-a9dd-4e1b442a47a2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:55.118835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-408580b7-326b-4b2b-a9dd-4e1b442a47a2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:55.119339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-408580b7-326b-4b2b-a9dd-4e1b442a47a2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:55.120314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-408580b7-326b-4b2b-a9dd-4e1b442a47a2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:55.120794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-408580b7-326b-4b2b-a9dd-4e1b442a47a2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:55.121232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-408580b7-326b-4b2b-a9dd-4e1b442a47a2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:55.681779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-408580b7-326b-4b2b-a9dd-4e1b442a47a2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:55.695892 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-408580b7-326b-4b2b-a9dd-4e1b442a47a2 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1548 microversion: 2.1 time: 0.597226 Aug 27 03:08:55.696196 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2810/5472] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:55 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1548 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:55.720601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5577bde3-37da-40d2-96a2-31a2f1b6478d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:55.721534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5577bde3-37da-40d2-96a2-31a2f1b6478d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:55.734007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5577bde3-37da-40d2-96a2-31a2f1b6478d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:55.734809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5577bde3-37da-40d2-96a2-31a2f1b6478d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:55.735439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5577bde3-37da-40d2-96a2-31a2f1b6478d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:55.736569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5577bde3-37da-40d2-96a2-31a2f1b6478d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:55.737192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5577bde3-37da-40d2-96a2-31a2f1b6478d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:55.737836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5577bde3-37da-40d2-96a2-31a2f1b6478d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:55.800422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:08:55.801221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:08:55.801518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:08:55.802795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:08:55.803440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:08:55.857203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:55.857644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:55.862664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:55.864114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:55.865107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:55.865816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:55.979134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:08:55.995082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for user 756fff89d19d41869dad9425eddd55c1 and project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:08:56.028314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:08:56.031293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:08:56.142727 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a79eed12-5466-478e-a185-33ee0e2e23a9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.413406 Aug 27 03:08:56.143961 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2663/5473] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:08:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:08:56.156266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-37bc285f-b884-4c5b-bb18-3ef230a47480 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:56.157203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-37bc285f-b884-4c5b-bb18-3ef230a47480 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:56.317154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-37bc285f-b884-4c5b-bb18-3ef230a47480 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:56.328558 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-37bc285f-b884-4c5b-bb18-3ef230a47480 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1221 microversion: 2.1 time: 0.176797 Aug 27 03:08:56.332117 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2664/5474] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:56 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1221 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:56.572918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5577bde3-37da-40d2-96a2-31a2f1b6478d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:56.585208 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5577bde3-37da-40d2-96a2-31a2f1b6478d tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1548 microversion: 2.1 time: 0.867381 Aug 27 03:08:56.586307 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2811/5475] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:55 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1548 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:08:57.362920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c04875f3-fdde-4a05-a912-ea1456f960f8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:57.365066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c04875f3-fdde-4a05-a912-ea1456f960f8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:57.375484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c04875f3-fdde-4a05-a912-ea1456f960f8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.378502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c04875f3-fdde-4a05-a912-ea1456f960f8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.392047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c04875f3-fdde-4a05-a912-ea1456f960f8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.393245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c04875f3-fdde-4a05-a912-ea1456f960f8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:57.393933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c04875f3-fdde-4a05-a912-ea1456f960f8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:57.394618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c04875f3-fdde-4a05-a912-ea1456f960f8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:57.555569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c04875f3-fdde-4a05-a912-ea1456f960f8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:57.571415 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c04875f3-fdde-4a05-a912-ea1456f960f8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1217 microversion: 2.1 time: 0.216993 Aug 27 03:08:57.575872 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2665/5476] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:57 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1217 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:58.611105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3d68c111-3898-4a97-adc3-9edc7636beac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:58.612417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3d68c111-3898-4a97-adc3-9edc7636beac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:58.621879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:08:58.627689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d68c111-3898-4a97-adc3-9edc7636beac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:58.628561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d68c111-3898-4a97-adc3-9edc7636beac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:58.629887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d68c111-3898-4a97-adc3-9edc7636beac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:58.632216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d68c111-3898-4a97-adc3-9edc7636beac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:58.633063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d68c111-3898-4a97-adc3-9edc7636beac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:58.633701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d68c111-3898-4a97-adc3-9edc7636beac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:58.761005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3d68c111-3898-4a97-adc3-9edc7636beac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:58.778437 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3d68c111-3898-4a97-adc3-9edc7636beac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1279 microversion: 2.1 time: 0.175487 Aug 27 03:08:58.779643 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2812/5477] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:58 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:08:59.801661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de601bb6-8ebf-420f-93ee-6961d20899fe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:08:59.802360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de601bb6-8ebf-420f-93ee-6961d20899fe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:08:59.818470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de601bb6-8ebf-420f-93ee-6961d20899fe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:59.820256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de601bb6-8ebf-420f-93ee-6961d20899fe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:59.820917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de601bb6-8ebf-420f-93ee-6961d20899fe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:59.821903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de601bb6-8ebf-420f-93ee-6961d20899fe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:08:59.822601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de601bb6-8ebf-420f-93ee-6961d20899fe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:08:59.823204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de601bb6-8ebf-420f-93ee-6961d20899fe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:08:59.913713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de601bb6-8ebf-420f-93ee-6961d20899fe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:08:59.942683 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de601bb6-8ebf-420f-93ee-6961d20899fe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1279 microversion: 2.1 time: 0.145336 Aug 27 03:08:59.954014 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2666/5478] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:08:59 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:00.762339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-21972583-d125-41cf-b1f7-9757e5cf29fc req-f75e42b2-55df-47e8-97d2-bad2421f8928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e9087f3-e9e3-46ef-bb07-345b9308d1fa", "tag": "c616639e-5446-4839-a5bd-61feea81d16a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:00.784189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-21972583-d125-41cf-b1f7-9757e5cf29fc req-f75e42b2-55df-47e8-97d2-bad2421f8928 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:00.784669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-21972583-d125-41cf-b1f7-9757e5cf29fc req-f75e42b2-55df-47e8-97d2-bad2421f8928 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:00.785153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-21972583-d125-41cf-b1f7-9757e5cf29fc req-f75e42b2-55df-47e8-97d2-bad2421f8928 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:00.809648 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-21972583-d125-41cf-b1f7-9757e5cf29fc req-f75e42b2-55df-47e8-97d2-bad2421f8928 service nova] Creating event network-changed:c616639e-5446-4839-a5bd-61feea81d16a for instance 2e9087f3-e9e3-46ef-bb07-345b9308d1fa on n-h1-852084-5 Aug 27 03:09:00.827635 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-21972583-d125-41cf-b1f7-9757e5cf29fc req-f75e42b2-55df-47e8-97d2-bad2421f8928 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068963 Aug 27 03:09:00.828858 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2813/5479] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:00.985871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-488a6c37-d309-42f4-87fe-750982e63443 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:00.987527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-488a6c37-d309-42f4-87fe-750982e63443 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:01.007410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488a6c37-d309-42f4-87fe-750982e63443 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:01.012973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488a6c37-d309-42f4-87fe-750982e63443 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:01.014623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488a6c37-d309-42f4-87fe-750982e63443 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:01.015620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488a6c37-d309-42f4-87fe-750982e63443 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:01.016096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488a6c37-d309-42f4-87fe-750982e63443 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:01.016565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-488a6c37-d309-42f4-87fe-750982e63443 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:01.178839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-488a6c37-d309-42f4-87fe-750982e63443 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:01.189840 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-488a6c37-d309-42f4-87fe-750982e63443 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1279 microversion: 2.1 time: 0.212454 Aug 27 03:09:01.190371 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2667/5480] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:00 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:02.214450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:02.215251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:02.219796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b9496826-ec8f-45ed-8dcf-de2ff35f3184 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:02.220528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b9496826-ec8f-45ed-8dcf-de2ff35f3184 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:02.242414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9496826-ec8f-45ed-8dcf-de2ff35f3184 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.242926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9496826-ec8f-45ed-8dcf-de2ff35f3184 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.243378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9496826-ec8f-45ed-8dcf-de2ff35f3184 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.244111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9496826-ec8f-45ed-8dcf-de2ff35f3184 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.244714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9496826-ec8f-45ed-8dcf-de2ff35f3184 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.245151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9496826-ec8f-45ed-8dcf-de2ff35f3184 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.506408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-71ff67fd-92d8-4664-beab-a7a5bfa8d0b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:02.507679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-71ff67fd-92d8-4664-beab-a7a5bfa8d0b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:02.559893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff67fd-92d8-4664-beab-a7a5bfa8d0b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.565578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff67fd-92d8-4664-beab-a7a5bfa8d0b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.572852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff67fd-92d8-4664-beab-a7a5bfa8d0b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.573832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff67fd-92d8-4664-beab-a7a5bfa8d0b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.575357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff67fd-92d8-4664-beab-a7a5bfa8d0b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.575951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ff67fd-92d8-4664-beab-a7a5bfa8d0b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.772744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b9496826-ec8f-45ed-8dcf-de2ff35f3184 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:02.786491 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b9496826-ec8f-45ed-8dcf-de2ff35f3184 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1321 microversion: 2.1 time: 0.573761 Aug 27 03:09:02.788856 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2814/5481] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:02 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1321 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:02.796793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-6f4d5777-4cbb-469f-a53c-40ca8cc1bf49 req-c6a0b374-4532-43b7-8bdd-b486332969b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32747fe6-7436-4fc4-bc35-ae0f8495d2e3", "tag": "7982bae4-d6b1-46bd-8563-3151707a0e2a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:02.824832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6f4d5777-4cbb-469f-a53c-40ca8cc1bf49 req-c6a0b374-4532-43b7-8bdd-b486332969b2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:02.826752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6f4d5777-4cbb-469f-a53c-40ca8cc1bf49 req-c6a0b374-4532-43b7-8bdd-b486332969b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:02.829028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-6f4d5777-4cbb-469f-a53c-40ca8cc1bf49 req-c6a0b374-4532-43b7-8bdd-b486332969b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:02.869704 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-6f4d5777-4cbb-469f-a53c-40ca8cc1bf49 req-c6a0b374-4532-43b7-8bdd-b486332969b2 service nova] Creating event network-changed:7982bae4-d6b1-46bd-8563-3151707a0e2a for instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 on n-h2-852084-5 Aug 27 03:09:02.884153 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-6f4d5777-4cbb-469f-a53c-40ca8cc1bf49 req-c6a0b374-4532-43b7-8bdd-b486332969b2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092066 Aug 27 03:09:02.887257 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2815/5482] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:03.307677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-71ff67fd-92d8-4664-beab-a7a5bfa8d0b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:03.322048 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-71ff67fd-92d8-4664-beab-a7a5bfa8d0b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1562 microversion: 2.1 time: 0.819752 Aug 27 03:09:03.337731 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2668/5483] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:02 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1562 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:03.833800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-60da27af-6dd0-4f0f-a88c-d991b70ec3d9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:03.839498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-60da27af-6dd0-4f0f-a88c-d991b70ec3d9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:03.850872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60da27af-6dd0-4f0f-a88c-d991b70ec3d9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:03.851660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60da27af-6dd0-4f0f-a88c-d991b70ec3d9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:03.852399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60da27af-6dd0-4f0f-a88c-d991b70ec3d9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:03.853408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60da27af-6dd0-4f0f-a88c-d991b70ec3d9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:03.854190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60da27af-6dd0-4f0f-a88c-d991b70ec3d9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:03.854767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-60da27af-6dd0-4f0f-a88c-d991b70ec3d9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:04.316334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-60da27af-6dd0-4f0f-a88c-d991b70ec3d9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:04.331994 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-60da27af-6dd0-4f0f-a88c-d991b70ec3d9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1321 microversion: 2.1 time: 0.521050 Aug 27 03:09:04.332696 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2816/5484] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:03 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:04.931769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6ab2037d-2208-4c14-8bd5-fc617300238a req-509f9081-4db9-4009-9057-1ac57ff4e56c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fae5841-1db7-4f9b-a5df-ebf9714cfc43", "tag": "22d00e39-7a52-4175-98a3-29ab0d955baa"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:04.943539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6ab2037d-2208-4c14-8bd5-fc617300238a req-509f9081-4db9-4009-9057-1ac57ff4e56c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:04.944359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6ab2037d-2208-4c14-8bd5-fc617300238a req-509f9081-4db9-4009-9057-1ac57ff4e56c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:04.945019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6ab2037d-2208-4c14-8bd5-fc617300238a req-509f9081-4db9-4009-9057-1ac57ff4e56c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:04.957753 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6ab2037d-2208-4c14-8bd5-fc617300238a req-509f9081-4db9-4009-9057-1ac57ff4e56c service nova] Creating event network-changed:22d00e39-7a52-4175-98a3-29ab0d955baa for instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 on n-h2-852084-5 Aug 27 03:09:04.964008 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6ab2037d-2208-4c14-8bd5-fc617300238a req-509f9081-4db9-4009-9057-1ac57ff4e56c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036629 Aug 27 03:09:04.965206 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2669/5485] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:05.354053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-89b3d1dd-8d5a-46f5-9e94-12e346fc515d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:05.354854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-89b3d1dd-8d5a-46f5-9e94-12e346fc515d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:05.362870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89b3d1dd-8d5a-46f5-9e94-12e346fc515d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:05.370516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89b3d1dd-8d5a-46f5-9e94-12e346fc515d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:05.371087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89b3d1dd-8d5a-46f5-9e94-12e346fc515d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:05.372185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89b3d1dd-8d5a-46f5-9e94-12e346fc515d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:05.372785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89b3d1dd-8d5a-46f5-9e94-12e346fc515d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:05.373411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89b3d1dd-8d5a-46f5-9e94-12e346fc515d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:06.214367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-89b3d1dd-8d5a-46f5-9e94-12e346fc515d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:06.222899 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-89b3d1dd-8d5a-46f5-9e94-12e346fc515d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1321 microversion: 2.1 time: 0.873418 Aug 27 03:09:06.241700 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2817/5486] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:05 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1321 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:07.252511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:07.253524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:07.258974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68cc7590-7540-465e-bb03-67bfcb597731 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:07.261587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-68cc7590-7540-465e-bb03-67bfcb597731 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:07.280261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68cc7590-7540-465e-bb03-67bfcb597731 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:07.280767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68cc7590-7540-465e-bb03-67bfcb597731 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:07.281221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68cc7590-7540-465e-bb03-67bfcb597731 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:07.288137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68cc7590-7540-465e-bb03-67bfcb597731 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:07.288659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68cc7590-7540-465e-bb03-67bfcb597731 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:07.289114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68cc7590-7540-465e-bb03-67bfcb597731 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:08.249762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-68cc7590-7540-465e-bb03-67bfcb597731 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:08.264564 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-68cc7590-7540-465e-bb03-67bfcb597731 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1321 microversion: 2.1 time: 1.010778 Aug 27 03:09:08.266612 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2670/5487] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:07 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1321 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:09.288186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f5c3ceba-7367-4057-94cb-d75679d347c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:09.288824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f5c3ceba-7367-4057-94cb-d75679d347c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:09.309926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5c3ceba-7367-4057-94cb-d75679d347c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:09.310611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5c3ceba-7367-4057-94cb-d75679d347c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:09.311120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5c3ceba-7367-4057-94cb-d75679d347c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:09.311897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5c3ceba-7367-4057-94cb-d75679d347c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:09.312483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5c3ceba-7367-4057-94cb-d75679d347c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:09.312953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5c3ceba-7367-4057-94cb-d75679d347c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:09.520393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f5c3ceba-7367-4057-94cb-d75679d347c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:09.532886 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f5c3ceba-7367-4057-94cb-d75679d347c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1321 microversion: 2.1 time: 0.250041 Aug 27 03:09:09.547851 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2818/5488] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:09 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:10.557240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3ad9a551-a238-4baf-bf24-763edd1ba4c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:10.558105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3ad9a551-a238-4baf-bf24-763edd1ba4c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:10.566045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ad9a551-a238-4baf-bf24-763edd1ba4c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:10.566812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ad9a551-a238-4baf-bf24-763edd1ba4c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:10.567430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ad9a551-a238-4baf-bf24-763edd1ba4c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:10.568406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ad9a551-a238-4baf-bf24-763edd1ba4c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:10.568900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ad9a551-a238-4baf-bf24-763edd1ba4c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:10.569327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ad9a551-a238-4baf-bf24-763edd1ba4c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:11.000391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3ad9a551-a238-4baf-bf24-763edd1ba4c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:11.020001 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3ad9a551-a238-4baf-bf24-763edd1ba4c4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1321 microversion: 2.1 time: 0.467325 Aug 27 03:09:11.020600 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2671/5489] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:10 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:11.614519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a0e90b29-9b6a-431c-930a-f54105997c13 req-49a2ad53-9005-4aba-ba81-8abbe4633221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fae5841-1db7-4f9b-a5df-ebf9714cfc43", "name": "network-vif-plugged", "status": "completed", "tag": "22d00e39-7a52-4175-98a3-29ab0d955baa"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:11.653651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0e90b29-9b6a-431c-930a-f54105997c13 req-49a2ad53-9005-4aba-ba81-8abbe4633221 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:11.654902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0e90b29-9b6a-431c-930a-f54105997c13 req-49a2ad53-9005-4aba-ba81-8abbe4633221 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:11.655972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0e90b29-9b6a-431c-930a-f54105997c13 req-49a2ad53-9005-4aba-ba81-8abbe4633221 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:11.687970 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a0e90b29-9b6a-431c-930a-f54105997c13 req-49a2ad53-9005-4aba-ba81-8abbe4633221 service nova] Creating event network-vif-plugged:22d00e39-7a52-4175-98a3-29ab0d955baa for instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 on n-h2-852084-5 Aug 27 03:09:11.716262 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a0e90b29-9b6a-431c-930a-f54105997c13 req-49a2ad53-9005-4aba-ba81-8abbe4633221 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105675 Aug 27 03:09:11.719934 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2819/5490] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:12.046495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb775fd1-48f2-486d-b987-daf3323acc56 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:12.047686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb775fd1-48f2-486d-b987-daf3323acc56 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:12.058531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb775fd1-48f2-486d-b987-daf3323acc56 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:12.059517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb775fd1-48f2-486d-b987-daf3323acc56 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:12.060108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb775fd1-48f2-486d-b987-daf3323acc56 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:12.061117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb775fd1-48f2-486d-b987-daf3323acc56 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:12.061816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb775fd1-48f2-486d-b987-daf3323acc56 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:12.062395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb775fd1-48f2-486d-b987-daf3323acc56 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:12.239597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb775fd1-48f2-486d-b987-daf3323acc56 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:12.249803 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb775fd1-48f2-486d-b987-daf3323acc56 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1321 microversion: 2.1 time: 0.207347 Aug 27 03:09:12.260098 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2672/5491] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:12 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:13.273791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-744e6146-a938-480b-8c57-5c1ff707b6b4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:13.274517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-744e6146-a938-480b-8c57-5c1ff707b6b4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:13.293536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744e6146-a938-480b-8c57-5c1ff707b6b4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.294106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744e6146-a938-480b-8c57-5c1ff707b6b4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.294557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744e6146-a938-480b-8c57-5c1ff707b6b4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.301062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744e6146-a938-480b-8c57-5c1ff707b6b4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.303588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744e6146-a938-480b-8c57-5c1ff707b6b4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.305369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744e6146-a938-480b-8c57-5c1ff707b6b4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.729358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-744e6146-a938-480b-8c57-5c1ff707b6b4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:13.740554 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-744e6146-a938-480b-8c57-5c1ff707b6b4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1502 microversion: 2.1 time: 0.471691 Aug 27 03:09:13.741948 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2820/5492] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:13 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1502 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:13.766611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3f460d2-10e5-47b2-bd5d-4d6d4fbc5ba2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:13.767356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c3f460d2-10e5-47b2-bd5d-4d6d4fbc5ba2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:13.780984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f460d2-10e5-47b2-bd5d-4d6d4fbc5ba2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.783324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f460d2-10e5-47b2-bd5d-4d6d4fbc5ba2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.785493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f460d2-10e5-47b2-bd5d-4d6d4fbc5ba2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:13.786582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f460d2-10e5-47b2-bd5d-4d6d4fbc5ba2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:13.787812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f460d2-10e5-47b2-bd5d-4d6d4fbc5ba2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:13.790976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f460d2-10e5-47b2-bd5d-4d6d4fbc5ba2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.101842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c3f460d2-10e5-47b2-bd5d-4d6d4fbc5ba2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:14.108943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:14.119085 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c3f460d2-10e5-47b2-bd5d-4d6d4fbc5ba2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1502 microversion: 2.1 time: 0.358148 Aug 27 03:09:14.124940 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2673/5493] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:13 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1502 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:14.152161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-958911d1-c157-4b48-8a53-5d9531e26ac9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:14.154055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-958911d1-c157-4b48-8a53-5d9531e26ac9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:14.168844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-958911d1-c157-4b48-8a53-5d9531e26ac9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.172587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-958911d1-c157-4b48-8a53-5d9531e26ac9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.173045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-958911d1-c157-4b48-8a53-5d9531e26ac9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.175238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-958911d1-c157-4b48-8a53-5d9531e26ac9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.176820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-958911d1-c157-4b48-8a53-5d9531e26ac9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.178785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-958911d1-c157-4b48-8a53-5d9531e26ac9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.246437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-958911d1-c157-4b48-8a53-5d9531e26ac9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:09:14.394481 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-958911d1-c157-4b48-8a53-5d9531e26ac9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 204 len: 0 microversion: 2.1 time: 0.253586 Aug 27 03:09:14.397796 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2821/5494] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:09:14 2022] DELETE /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:09:14.404549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dab9239c-f769-45ec-a130-43ff028b247f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:14.404898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dab9239c-f769-45ec-a130-43ff028b247f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:14.413302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab9239c-f769-45ec-a130-43ff028b247f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.413826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab9239c-f769-45ec-a130-43ff028b247f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.414270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab9239c-f769-45ec-a130-43ff028b247f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.414984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab9239c-f769-45ec-a130-43ff028b247f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:14.430555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab9239c-f769-45ec-a130-43ff028b247f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:14.431098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dab9239c-f769-45ec-a130-43ff028b247f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:14.857129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dab9239c-f769-45ec-a130-43ff028b247f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:14.870902 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dab9239c-f769-45ec-a130-43ff028b247f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1508 microversion: 2.1 time: 0.469006 Aug 27 03:09:14.872769 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2674/5495] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:14 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1508 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:15.899794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-551eb5f6-6490-41b9-93c6-305e09831efa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:15.901917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-551eb5f6-6490-41b9-93c6-305e09831efa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:15.922220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-551eb5f6-6490-41b9-93c6-305e09831efa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:15.922959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-551eb5f6-6490-41b9-93c6-305e09831efa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:15.923787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-551eb5f6-6490-41b9-93c6-305e09831efa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:15.924687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-551eb5f6-6490-41b9-93c6-305e09831efa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:15.925392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-551eb5f6-6490-41b9-93c6-305e09831efa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:15.926350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-551eb5f6-6490-41b9-93c6-305e09831efa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:16.269312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-551eb5f6-6490-41b9-93c6-305e09831efa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:16.281198 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-551eb5f6-6490-41b9-93c6-305e09831efa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1508 microversion: 2.1 time: 0.391279 Aug 27 03:09:16.295797 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2822/5496] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:15 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1508 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:17.310055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8fec48bf-99be-4c0e-97f5-ce43614bc6cb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:17.313772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8fec48bf-99be-4c0e-97f5-ce43614bc6cb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:17.351327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-457c60f5-00cc-47a1-adf1-1354f178dc7a req-4e0cad48-908a-4d8b-99f4-19cbb0297aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fae5841-1db7-4f9b-a5df-ebf9714cfc43", "name": "network-vif-deleted", "tag": "22d00e39-7a52-4175-98a3-29ab0d955baa"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:17.362720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fec48bf-99be-4c0e-97f5-ce43614bc6cb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.363219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fec48bf-99be-4c0e-97f5-ce43614bc6cb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.364362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fec48bf-99be-4c0e-97f5-ce43614bc6cb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.367642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fec48bf-99be-4c0e-97f5-ce43614bc6cb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.368171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fec48bf-99be-4c0e-97f5-ce43614bc6cb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.370315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8fec48bf-99be-4c0e-97f5-ce43614bc6cb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.412138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-457c60f5-00cc-47a1-adf1-1354f178dc7a req-4e0cad48-908a-4d8b-99f4-19cbb0297aaf service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:17.415855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-457c60f5-00cc-47a1-adf1-1354f178dc7a req-4e0cad48-908a-4d8b-99f4-19cbb0297aaf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:17.416536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-457c60f5-00cc-47a1-adf1-1354f178dc7a req-4e0cad48-908a-4d8b-99f4-19cbb0297aaf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:17.456597 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-457c60f5-00cc-47a1-adf1-1354f178dc7a req-4e0cad48-908a-4d8b-99f4-19cbb0297aaf service nova] Creating event network-vif-deleted:22d00e39-7a52-4175-98a3-29ab0d955baa for instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 on n-h2-852084-5 Aug 27 03:09:17.476521 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-457c60f5-00cc-47a1-adf1-1354f178dc7a req-4e0cad48-908a-4d8b-99f4-19cbb0297aaf service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133857 Aug 27 03:09:17.479349 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2823/5497] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:09:17.644686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8fec48bf-99be-4c0e-97f5-ce43614bc6cb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:17.691552 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8fec48bf-99be-4c0e-97f5-ce43614bc6cb tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 200 len: 1306 microversion: 2.1 time: 0.385877 Aug 27 03:09:17.692407 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2675/5498] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:17 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 1306 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:18.722757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:18.723472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:18.738593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:18.739100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:18.739554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:18.745025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:18.745811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:18.746517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:18.767399 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 HTTP/1.1 Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '7fae5841-1db7-4f9b-a5df-ebf9714cfc43'} Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:09:18.769342 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:18.773625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:18.773625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:18.773625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:18.773625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:18.773625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:09:18.773625 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:09:18.773625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:18.773625 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-74c01dd9-5256-49fb-98da-6b8e4fecebf2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 404 len: 111 microversion: 2.1 time: 0.052488 Aug 27 03:09:18.780273 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2824/5499] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:18 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:09:18.784684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f320793f-7982-4f9f-9383-079bcaca30b0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'create', calling method: .version_select at 0x7f4d2931b9d0>, body: {"keypair": {"name": "tempest-key-687044470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8OCa4IUZZ09KQ0nUMBCVrZsFGbZKPFO4B5/dtU4460PqY7pOeBKv8PUNVhLnFgU8Z6uQcv8UR1UkINjIYKnIV21ws0ob7YKi9UoSkU3s6nARYa/0czc29JyVVzBDTFKA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:18.809047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-f320793f-7982-4f9f-9383-079bcaca30b0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for project 55a939dc355345c8b827ca4538afec54. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:18.816834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-f320793f-7982-4f9f-9383-079bcaca30b0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for user 756fff89d19d41869dad9425eddd55c1 and project 55a939dc355345c8b827ca4538afec54. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:18.850552 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f320793f-7982-4f9f-9383-079bcaca30b0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.069055 Aug 27 03:09:18.852249 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2676/5500] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:09:18 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:18.863264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-36b6abbd-b5bd-4229-90ec-733e076f4473 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '.version_select at 0x7f4d2916b430>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:18.867928 n-d-852084-5 devstack@n-api.service[122488]: WARNING oslo_db.sqlalchemy.utils [None req-36b6abbd-b5bd-4229-90ec-733e076f4473 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 27 03:09:18.885055 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-36b6abbd-b5bd-4229-90ec-733e076f4473 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.026237 Aug 27 03:09:18.900216 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2825/5501] 10.222.0.99 () {58 vars in 1137 bytes} [Sat Aug 27 03:09:18 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:18.948483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1353706092", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "key_name": "tempest-key-687044470", "networks": [{"uuid": "a7f149e5-3bf9-4728-ad5f-b673712c2f5f"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:18.976021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0fc5d090-42ce-4ac6-8efb-1f5934c62e6d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:18.992652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0fc5d090-42ce-4ac6-8efb-1f5934c62e6d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:19.011066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc5d090-42ce-4ac6-8efb-1f5934c62e6d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.011570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc5d090-42ce-4ac6-8efb-1f5934c62e6d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.012039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc5d090-42ce-4ac6-8efb-1f5934c62e6d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.012760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc5d090-42ce-4ac6-8efb-1f5934c62e6d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.013413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc5d090-42ce-4ac6-8efb-1f5934c62e6d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.013888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fc5d090-42ce-4ac6-8efb-1f5934c62e6d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.032906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] validate_networks() for [('a7f149e5-3bf9-4728-ad5f-b673712c2f5f', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:19.042868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:19.086394 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0fc5d090-42ce-4ac6-8efb-1f5934c62e6d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3/action" status: 200 len: 24569 microversion: 2.1 time: 0.115021 Aug 27 03:09:19.087571 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2826/5502] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:18 2022] POST /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3/action => generated 24569 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:19.251480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff0c2858-493d-4dbf-bd1e-46554231aab6 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:19.253871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ff0c2858-493d-4dbf-bd1e-46554231aab6 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:19.288224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff0c2858-493d-4dbf-bd1e-46554231aab6 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.288993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff0c2858-493d-4dbf-bd1e-46554231aab6 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.290343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff0c2858-493d-4dbf-bd1e-46554231aab6 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.291422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff0c2858-493d-4dbf-bd1e-46554231aab6 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.292724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff0c2858-493d-4dbf-bd1e-46554231aab6 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.295825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff0c2858-493d-4dbf-bd1e-46554231aab6 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.400534 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff0c2858-493d-4dbf-bd1e-46554231aab6 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "POST /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa/action" status: 200 len: 24560 microversion: 2.1 time: 0.153659 Aug 27 03:09:19.403416 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2827/5503] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:19 2022] POST /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa/action => generated 24560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:19.599266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:19.599733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:19.600524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:19.600611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:19.601182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:19.624403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.624887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.625325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.626071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:19.626525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:19.626948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:19.655982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:19.664128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for user 756fff89d19d41869dad9425eddd55c1 and project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:19.691366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:19.693838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:19.784967 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-824297b2-db7e-4b0e-9acd-74de01c37dac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839950 Aug 27 03:09:19.790229 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2677/5504] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:09:19.803828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b00b5abc-6e91-49b3-8c45-9d5884f2ae09 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:19.805541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b00b5abc-6e91-49b3-8c45-9d5884f2ae09 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:19.990642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b00b5abc-6e91-49b3-8c45-9d5884f2ae09 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:20.006808 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b00b5abc-6e91-49b3-8c45-9d5884f2ae09 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1228 microversion: 2.1 time: 0.209906 Aug 27 03:09:20.007418 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2828/5505] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:19 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1228 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:21.028311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f194fab0-6ee5-4fb5-a0a1-37a715b5e318 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:21.028941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f194fab0-6ee5-4fb5-a0a1-37a715b5e318 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:21.032874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:21.058138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f194fab0-6ee5-4fb5-a0a1-37a715b5e318 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.060498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f194fab0-6ee5-4fb5-a0a1-37a715b5e318 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.063057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f194fab0-6ee5-4fb5-a0a1-37a715b5e318 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.066463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f194fab0-6ee5-4fb5-a0a1-37a715b5e318 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:21.067091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f194fab0-6ee5-4fb5-a0a1-37a715b5e318 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:21.070103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f194fab0-6ee5-4fb5-a0a1-37a715b5e318 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:21.190877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f194fab0-6ee5-4fb5-a0a1-37a715b5e318 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:21.203462 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f194fab0-6ee5-4fb5-a0a1-37a715b5e318 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1280 microversion: 2.1 time: 0.178723 Aug 27 03:09:21.207814 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2678/5506] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:21 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1280 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:22.232393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-774b7202-2b28-47a4-b04a-23bd11349224 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:22.233858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-774b7202-2b28-47a4-b04a-23bd11349224 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:22.248269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-774b7202-2b28-47a4-b04a-23bd11349224 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.250122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-774b7202-2b28-47a4-b04a-23bd11349224 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.251929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-774b7202-2b28-47a4-b04a-23bd11349224 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:22.258421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-774b7202-2b28-47a4-b04a-23bd11349224 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:22.259533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-774b7202-2b28-47a4-b04a-23bd11349224 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:22.260198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-774b7202-2b28-47a4-b04a-23bd11349224 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:23.090950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-774b7202-2b28-47a4-b04a-23bd11349224 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:23.106612 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-774b7202-2b28-47a4-b04a-23bd11349224 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1286 microversion: 2.1 time: 0.880959 Aug 27 03:09:23.122542 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2829/5507] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:22 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1286 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:24.128508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-94956c62-7750-48ab-8dd0-f3eea10d800d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:24.129119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-94956c62-7750-48ab-8dd0-f3eea10d800d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:24.139221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94956c62-7750-48ab-8dd0-f3eea10d800d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:24.148446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94956c62-7750-48ab-8dd0-f3eea10d800d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:24.149042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94956c62-7750-48ab-8dd0-f3eea10d800d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.149971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94956c62-7750-48ab-8dd0-f3eea10d800d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:24.150588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94956c62-7750-48ab-8dd0-f3eea10d800d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:24.151149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94956c62-7750-48ab-8dd0-f3eea10d800d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:24.570448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-94956c62-7750-48ab-8dd0-f3eea10d800d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:24.578769 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-94956c62-7750-48ab-8dd0-f3eea10d800d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1328 microversion: 2.1 time: 0.454144 Aug 27 03:09:24.590070 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2679/5508] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:24 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1328 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:25.453484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec6f1a4d-1909-458c-b67d-90408f1ee72b tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:25.454309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ec6f1a4d-1909-458c-b67d-90408f1ee72b tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:25.467757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6f1a4d-1909-458c-b67d-90408f1ee72b tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.468683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6f1a4d-1909-458c-b67d-90408f1ee72b tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.470148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6f1a4d-1909-458c-b67d-90408f1ee72b tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.471671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6f1a4d-1909-458c-b67d-90408f1ee72b tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.475000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6f1a4d-1909-458c-b67d-90408f1ee72b tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.481145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec6f1a4d-1909-458c-b67d-90408f1ee72b tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.506521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-a38aa77d-86a4-49d8-a803-6f0792b94a5f req-7e300cc9-8eec-4f7b-99a5-dd95d727874f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f99082a4-a42d-435b-acc8-7b8310aeb1e9", "tag": "feec414a-0573-4681-a0c6-322267d08384"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:25.532789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a38aa77d-86a4-49d8-a803-6f0792b94a5f req-7e300cc9-8eec-4f7b-99a5-dd95d727874f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.535915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a38aa77d-86a4-49d8-a803-6f0792b94a5f req-7e300cc9-8eec-4f7b-99a5-dd95d727874f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.539376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a38aa77d-86a4-49d8-a803-6f0792b94a5f req-7e300cc9-8eec-4f7b-99a5-dd95d727874f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.570905 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a38aa77d-86a4-49d8-a803-6f0792b94a5f req-7e300cc9-8eec-4f7b-99a5-dd95d727874f service nova] Creating event network-changed:feec414a-0573-4681-a0c6-322267d08384 for instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 on n-h2-852084-5 Aug 27 03:09:25.580896 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-a38aa77d-86a4-49d8-a803-6f0792b94a5f req-7e300cc9-8eec-4f7b-99a5-dd95d727874f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079676 Aug 27 03:09:25.585849 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2680/5509] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:09:25.601894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a3f59ddb-21bb-4898-8b0d-d1f32ae59bdd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:25.603418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a3f59ddb-21bb-4898-8b0d-d1f32ae59bdd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:25.613577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3f59ddb-21bb-4898-8b0d-d1f32ae59bdd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.614416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3f59ddb-21bb-4898-8b0d-d1f32ae59bdd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.615639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3f59ddb-21bb-4898-8b0d-d1f32ae59bdd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:25.616576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3f59ddb-21bb-4898-8b0d-d1f32ae59bdd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:25.617267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3f59ddb-21bb-4898-8b0d-d1f32ae59bdd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:25.617937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3f59ddb-21bb-4898-8b0d-d1f32ae59bdd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:26.116305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a3f59ddb-21bb-4898-8b0d-d1f32ae59bdd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:26.128862 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a3f59ddb-21bb-4898-8b0d-d1f32ae59bdd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1328 microversion: 2.1 time: 0.532086 Aug 27 03:09:26.129453 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2681/5510] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:25 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1328 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:26.537446 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec6f1a4d-1909-458c-b67d-90408f1ee72b tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1832 microversion: 2.1 time: 1.087581 Aug 27 03:09:26.550290 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2830/5511] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:25 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1832 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:26.557655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-904fe0fc-744e-4baa-b6a4-74f916705ed0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:26.558384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-904fe0fc-744e-4baa-b6a4-74f916705ed0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:26.577006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-904fe0fc-744e-4baa-b6a4-74f916705ed0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:26.577544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-904fe0fc-744e-4baa-b6a4-74f916705ed0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:26.578028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-904fe0fc-744e-4baa-b6a4-74f916705ed0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:26.578761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-904fe0fc-744e-4baa-b6a4-74f916705ed0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:26.579225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-904fe0fc-744e-4baa-b6a4-74f916705ed0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:26.579663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-904fe0fc-744e-4baa-b6a4-74f916705ed0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:26.938494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-904fe0fc-744e-4baa-b6a4-74f916705ed0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:26.950844 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-904fe0fc-744e-4baa-b6a4-74f916705ed0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1681 microversion: 2.1 time: 0.396913 Aug 27 03:09:26.951465 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2682/5512] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:26 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1681 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:27.158307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b786d2ce-4d76-47ca-9720-025440b82994 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:27.175693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b786d2ce-4d76-47ca-9720-025440b82994 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:27.180376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aaced8da-c781-44b3-a604-f1bbc8a080df tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:27.186685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aaced8da-c781-44b3-a604-f1bbc8a080df tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:27.202509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b786d2ce-4d76-47ca-9720-025440b82994 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.207020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b786d2ce-4d76-47ca-9720-025440b82994 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.207709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b786d2ce-4d76-47ca-9720-025440b82994 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.209987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b786d2ce-4d76-47ca-9720-025440b82994 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.212114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaced8da-c781-44b3-a604-f1bbc8a080df tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.212488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b786d2ce-4d76-47ca-9720-025440b82994 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.213112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b786d2ce-4d76-47ca-9720-025440b82994 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.215305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaced8da-c781-44b3-a604-f1bbc8a080df tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.216228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaced8da-c781-44b3-a604-f1bbc8a080df tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.218919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaced8da-c781-44b3-a604-f1bbc8a080df tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:27.219636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaced8da-c781-44b3-a604-f1bbc8a080df tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:27.220232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaced8da-c781-44b3-a604-f1bbc8a080df tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:27.564688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b786d2ce-4d76-47ca-9720-025440b82994 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:27.580291 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b786d2ce-4d76-47ca-9720-025440b82994 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1328 microversion: 2.1 time: 0.426363 Aug 27 03:09:27.584330 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2831/5513] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:27 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1328 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:28.041510 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aaced8da-c781-44b3-a604-f1bbc8a080df tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3/action" status: 200 len: 32641 microversion: 2.1 time: 0.877544 Aug 27 03:09:28.043279 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2683/5514] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:27 2022] POST /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3/action => generated 32641 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:28.269622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:28.270589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:28.278579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.279245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.280030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.280895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.281594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.282195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.337018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6d0ee6b2eaf14c0087aebe90cc8b6fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7c51ebc36e409c96a5bde555823625', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:28.338684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] flavor_id is None. Assuming migration. {{(pid=122488) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 03:09:28.339338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122488) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:09:28.491105 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-203c127d-379f-4c47-9792-103ec758c328 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3/action" status: 202 len: 0 microversion: 2.1 time: 0.222699 Aug 27 03:09:28.496839 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2832/5515] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:28 2022] POST /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:09:28.504455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2b84c2b8-c631-49a7-87a0-81c50dd11acf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:28.505172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2b84c2b8-c631-49a7-87a0-81c50dd11acf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:28.515924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84c2b8-c631-49a7-87a0-81c50dd11acf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.516662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84c2b8-c631-49a7-87a0-81c50dd11acf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.517596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84c2b8-c631-49a7-87a0-81c50dd11acf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.519005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84c2b8-c631-49a7-87a0-81c50dd11acf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.520185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84c2b8-c631-49a7-87a0-81c50dd11acf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.521010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b84c2b8-c631-49a7-87a0-81c50dd11acf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.602053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f0b7a621-40c2-4369-8cc3-2da2c0c41085 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:28.602665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f0b7a621-40c2-4369-8cc3-2da2c0c41085 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:28.613848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b7a621-40c2-4369-8cc3-2da2c0c41085 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.616006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b7a621-40c2-4369-8cc3-2da2c0c41085 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.616751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b7a621-40c2-4369-8cc3-2da2c0c41085 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.618260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b7a621-40c2-4369-8cc3-2da2c0c41085 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:28.621626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b7a621-40c2-4369-8cc3-2da2c0c41085 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:28.622357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b7a621-40c2-4369-8cc3-2da2c0c41085 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:28.875689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2b84c2b8-c631-49a7-87a0-81c50dd11acf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:28.890866 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2b84c2b8-c631-49a7-87a0-81c50dd11acf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1690 microversion: 2.1 time: 0.391408 Aug 27 03:09:28.892513 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2684/5516] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:28 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1690 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:28.947349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f0b7a621-40c2-4369-8cc3-2da2c0c41085 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:28.956726 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f0b7a621-40c2-4369-8cc3-2da2c0c41085 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1328 microversion: 2.1 time: 0.358946 Aug 27 03:09:28.957632 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2833/5517] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:28 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1328 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:29.914907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3885af44-207c-43e2-9fc9-8ebe8bda32c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:29.926011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3885af44-207c-43e2-9fc9-8ebe8bda32c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:29.939126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:29.942432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:29.949105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3885af44-207c-43e2-9fc9-8ebe8bda32c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.949610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3885af44-207c-43e2-9fc9-8ebe8bda32c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.950416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3885af44-207c-43e2-9fc9-8ebe8bda32c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.951153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3885af44-207c-43e2-9fc9-8ebe8bda32c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:29.951618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3885af44-207c-43e2-9fc9-8ebe8bda32c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:29.952050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3885af44-207c-43e2-9fc9-8ebe8bda32c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:29.980388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3feb607e-3aee-4626-93dc-67d255df6df0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:29.981650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3feb607e-3aee-4626-93dc-67d255df6df0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:29.984075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:30.004248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:30.013128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3feb607e-3aee-4626-93dc-67d255df6df0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:30.015778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3feb607e-3aee-4626-93dc-67d255df6df0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:30.018310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3feb607e-3aee-4626-93dc-67d255df6df0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:30.022593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3feb607e-3aee-4626-93dc-67d255df6df0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:30.026359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3feb607e-3aee-4626-93dc-67d255df6df0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:30.030060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3feb607e-3aee-4626-93dc-67d255df6df0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:30.586397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3885af44-207c-43e2-9fc9-8ebe8bda32c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:30.604737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3feb607e-3aee-4626-93dc-67d255df6df0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:30.610728 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3885af44-207c-43e2-9fc9-8ebe8bda32c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1690 microversion: 2.1 time: 0.700936 Aug 27 03:09:30.611691 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2685/5518] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:29 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1690 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:30.616590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ef16eca-1d0d-4259-b953-ce3c8597fccb tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:30.622145 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3feb607e-3aee-4626-93dc-67d255df6df0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1328 microversion: 2.1 time: 0.647994 Aug 27 03:09:30.622738 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2834/5519] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:29 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1328 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:30.635112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9ef16eca-1d0d-4259-b953-ce3c8597fccb tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:30.655731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ef16eca-1d0d-4259-b953-ce3c8597fccb tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:30.656245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ef16eca-1d0d-4259-b953-ce3c8597fccb tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:30.666139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ef16eca-1d0d-4259-b953-ce3c8597fccb tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:30.667341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ef16eca-1d0d-4259-b953-ce3c8597fccb tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:30.668042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ef16eca-1d0d-4259-b953-ce3c8597fccb tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:30.669248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ef16eca-1d0d-4259-b953-ce3c8597fccb tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:30.769925 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9ef16eca-1d0d-4259-b953-ce3c8597fccb tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "POST /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa/action" status: 200 len: 32633 microversion: 2.1 time: 0.156754 Aug 27 03:09:30.772524 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2686/5520] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:09:30 2022] POST /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa/action => generated 32633 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:09:31.632934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8d35dc2d-536e-4738-9bc2-285868c9aa1b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:31.633613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8d35dc2d-536e-4738-9bc2-285868c9aa1b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:31.641782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d35dc2d-536e-4738-9bc2-285868c9aa1b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:31.642614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d35dc2d-536e-4738-9bc2-285868c9aa1b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:31.643312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d35dc2d-536e-4738-9bc2-285868c9aa1b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.644894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d35dc2d-536e-4738-9bc2-285868c9aa1b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:31.645609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d35dc2d-536e-4738-9bc2-285868c9aa1b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:31.646441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d35dc2d-536e-4738-9bc2-285868c9aa1b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.650880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d8981f7c-0258-49d9-9f27-3a3115cb0627 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:31.651684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d8981f7c-0258-49d9-9f27-3a3115cb0627 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:31.665135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8981f7c-0258-49d9-9f27-3a3115cb0627 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:31.666193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8981f7c-0258-49d9-9f27-3a3115cb0627 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:31.666965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8981f7c-0258-49d9-9f27-3a3115cb0627 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.667949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8981f7c-0258-49d9-9f27-3a3115cb0627 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:31.668703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8981f7c-0258-49d9-9f27-3a3115cb0627 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:31.669430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8981f7c-0258-49d9-9f27-3a3115cb0627 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:31.973445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8d35dc2d-536e-4738-9bc2-285868c9aa1b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:31.985473 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8d35dc2d-536e-4738-9bc2-285868c9aa1b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1690 microversion: 2.1 time: 0.357031 Aug 27 03:09:31.986903 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2835/5521] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:31 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1690 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:31.996463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ad3f4c8e-528d-48e2-961f-e347f869d9cd req-663dbf63-cce8-4b6e-b826-3aca47510f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99082a4-a42d-435b-acc8-7b8310aeb1e9", "name": "network-vif-plugged", "status": "completed", "tag": "feec414a-0573-4681-a0c6-322267d08384"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:32.007384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ad3f4c8e-528d-48e2-961f-e347f869d9cd req-663dbf63-cce8-4b6e-b826-3aca47510f6a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:32.008135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ad3f4c8e-528d-48e2-961f-e347f869d9cd req-663dbf63-cce8-4b6e-b826-3aca47510f6a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:32.008762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ad3f4c8e-528d-48e2-961f-e347f869d9cd req-663dbf63-cce8-4b6e-b826-3aca47510f6a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:32.034495 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ad3f4c8e-528d-48e2-961f-e347f869d9cd req-663dbf63-cce8-4b6e-b826-3aca47510f6a service nova] Creating event network-vif-plugged:feec414a-0573-4681-a0c6-322267d08384 for instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 on n-h2-852084-5 Aug 27 03:09:32.047390 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ad3f4c8e-528d-48e2-961f-e347f869d9cd req-663dbf63-cce8-4b6e-b826-3aca47510f6a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058240 Aug 27 03:09:32.050840 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2836/5522] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:32.254231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d8981f7c-0258-49d9-9f27-3a3115cb0627 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:32.263831 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d8981f7c-0258-49d9-9f27-3a3115cb0627 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1328 microversion: 2.1 time: 0.622939 Aug 27 03:09:32.270250 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2687/5523] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:31 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1328 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:33.013234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0ea7c9e4-40d4-48f8-be53-8bd214da76b7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:33.014130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0ea7c9e4-40d4-48f8-be53-8bd214da76b7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:33.023519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ea7c9e4-40d4-48f8-be53-8bd214da76b7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.024092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ea7c9e4-40d4-48f8-be53-8bd214da76b7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.024602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ea7c9e4-40d4-48f8-be53-8bd214da76b7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.025380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ea7c9e4-40d4-48f8-be53-8bd214da76b7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.025959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ea7c9e4-40d4-48f8-be53-8bd214da76b7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.026451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ea7c9e4-40d4-48f8-be53-8bd214da76b7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.227706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0ea7c9e4-40d4-48f8-be53-8bd214da76b7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:33.248676 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0ea7c9e4-40d4-48f8-be53-8bd214da76b7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1690 microversion: 2.1 time: 0.240691 Aug 27 03:09:33.249450 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2837/5524] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:33 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1690 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:33.298749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7827b064-d411-4639-8783-0f709cbe71ee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:33.300993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7827b064-d411-4639-8783-0f709cbe71ee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:33.318676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7827b064-d411-4639-8783-0f709cbe71ee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.319391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7827b064-d411-4639-8783-0f709cbe71ee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.319959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7827b064-d411-4639-8783-0f709cbe71ee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.320803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7827b064-d411-4639-8783-0f709cbe71ee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.321388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7827b064-d411-4639-8783-0f709cbe71ee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.321971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7827b064-d411-4639-8783-0f709cbe71ee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.827232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d9d09af-679f-4ec9-b566-996be6a009d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:33.828122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d9d09af-679f-4ec9-b566-996be6a009d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:33.842484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d9d09af-679f-4ec9-b566-996be6a009d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.845006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d9d09af-679f-4ec9-b566-996be6a009d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.845642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d9d09af-679f-4ec9-b566-996be6a009d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.849854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d9d09af-679f-4ec9-b566-996be6a009d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:33.850901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d9d09af-679f-4ec9-b566-996be6a009d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:33.851529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d9d09af-679f-4ec9-b566-996be6a009d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:33.922775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d9d09af-679f-4ec9-b566-996be6a009d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:09:33.947113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7827b064-d411-4639-8783-0f709cbe71ee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:33.964451 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7827b064-d411-4639-8783-0f709cbe71ee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1328 microversion: 2.1 time: 0.668834 Aug 27 03:09:33.966032 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2688/5525] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:33 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1328 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:33.993186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6b2a25b8-2ea2-4fef-9745-1f06c66672a8 req-4f99b06a-f3a0-43ee-bf7b-783d53a33a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e9087f3-e9e3-46ef-bb07-345b9308d1fa", "tag": "c616639e-5446-4839-a5bd-61feea81d16a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:34.036132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6b2a25b8-2ea2-4fef-9745-1f06c66672a8 req-4f99b06a-f3a0-43ee-bf7b-783d53a33a30 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.036644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6b2a25b8-2ea2-4fef-9745-1f06c66672a8 req-4f99b06a-f3a0-43ee-bf7b-783d53a33a30 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.037244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6b2a25b8-2ea2-4fef-9745-1f06c66672a8 req-4f99b06a-f3a0-43ee-bf7b-783d53a33a30 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.083051 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6b2a25b8-2ea2-4fef-9745-1f06c66672a8 req-4f99b06a-f3a0-43ee-bf7b-783d53a33a30 service nova] Creating event network-changed:c616639e-5446-4839-a5bd-61feea81d16a for instance 2e9087f3-e9e3-46ef-bb07-345b9308d1fa on n-h1-852084-5 Aug 27 03:09:34.118417 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6b2a25b8-2ea2-4fef-9745-1f06c66672a8 req-4f99b06a-f3a0-43ee-bf7b-783d53a33a30 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132214 Aug 27 03:09:34.121921 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2689/5526] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:34.163428 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2d9d09af-679f-4ec9-b566-996be6a009d1 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "DELETE /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 204 len: 0 microversion: 2.1 time: 0.340435 Aug 27 03:09:34.171391 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2838/5527] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:09:33 2022] DELETE /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:09:34.181189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5aa0da3c-71f3-4713-96b4-d4f2e2f13f5c tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:34.182370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5aa0da3c-71f3-4713-96b4-d4f2e2f13f5c tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:34.198494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0da3c-71f3-4713-96b4-d4f2e2f13f5c tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.199660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0da3c-71f3-4713-96b4-d4f2e2f13f5c tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.200872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0da3c-71f3-4713-96b4-d4f2e2f13f5c tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.201924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0da3c-71f3-4713-96b4-d4f2e2f13f5c tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.203511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0da3c-71f3-4713-96b4-d4f2e2f13f5c tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.204438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0da3c-71f3-4713-96b4-d4f2e2f13f5c tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.273957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-079a59e5-4337-4eb2-a52c-5830f635ce4e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:34.274921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-079a59e5-4337-4eb2-a52c-5830f635ce4e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:34.287448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-079a59e5-4337-4eb2-a52c-5830f635ce4e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.290059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-079a59e5-4337-4eb2-a52c-5830f635ce4e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.291326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-079a59e5-4337-4eb2-a52c-5830f635ce4e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.293502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-079a59e5-4337-4eb2-a52c-5830f635ce4e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.295449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-079a59e5-4337-4eb2-a52c-5830f635ce4e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.300184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-079a59e5-4337-4eb2-a52c-5830f635ce4e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:34.523302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-079a59e5-4337-4eb2-a52c-5830f635ce4e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:34.533856 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-079a59e5-4337-4eb2-a52c-5830f635ce4e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.266515 Aug 27 03:09:34.535512 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2839/5528] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:34 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:34.612457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5aa0da3c-71f3-4713-96b4-d4f2e2f13f5c tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:34.624270 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5aa0da3c-71f3-4713-96b4-d4f2e2f13f5c tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1673 microversion: 2.1 time: 0.448171 Aug 27 03:09:34.625263 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2690/5529] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:34 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1673 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:34.985065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-10fd2ec9-62fb-4ded-99ec-1a2a53ca554a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:34.985748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-10fd2ec9-62fb-4ded-99ec-1a2a53ca554a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:34.998036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fd2ec9-62fb-4ded-99ec-1a2a53ca554a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:34.998532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fd2ec9-62fb-4ded-99ec-1a2a53ca554a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:34.999041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fd2ec9-62fb-4ded-99ec-1a2a53ca554a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.000394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fd2ec9-62fb-4ded-99ec-1a2a53ca554a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.001045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fd2ec9-62fb-4ded-99ec-1a2a53ca554a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.001635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10fd2ec9-62fb-4ded-99ec-1a2a53ca554a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.259004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-10fd2ec9-62fb-4ded-99ec-1a2a53ca554a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:35.276086 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-10fd2ec9-62fb-4ded-99ec-1a2a53ca554a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1510 microversion: 2.1 time: 0.295564 Aug 27 03:09:35.276701 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2840/5530] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:34 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:35.307217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e92a5467-7eae-4573-a743-bda2f23bc1aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:35.307983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e92a5467-7eae-4573-a743-bda2f23bc1aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:35.320904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92a5467-7eae-4573-a743-bda2f23bc1aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.322150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92a5467-7eae-4573-a743-bda2f23bc1aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.322837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92a5467-7eae-4573-a743-bda2f23bc1aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.323818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92a5467-7eae-4573-a743-bda2f23bc1aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.324546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92a5467-7eae-4573-a743-bda2f23bc1aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.325339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e92a5467-7eae-4573-a743-bda2f23bc1aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.560368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eb4dc880-939a-4d13-a805-b405d420d8a7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:35.561289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eb4dc880-939a-4d13-a805-b405d420d8a7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:35.570515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4dc880-939a-4d13-a805-b405d420d8a7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.571516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4dc880-939a-4d13-a805-b405d420d8a7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.572351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4dc880-939a-4d13-a805-b405d420d8a7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.573285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4dc880-939a-4d13-a805-b405d420d8a7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.574284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4dc880-939a-4d13-a805-b405d420d8a7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.575042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4dc880-939a-4d13-a805-b405d420d8a7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.792943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eb4dc880-939a-4d13-a805-b405d420d8a7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:35.798225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:35.807399 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eb4dc880-939a-4d13-a805-b405d420d8a7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.253490 Aug 27 03:09:35.808355 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2841/5531] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:35 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:35.832818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-80c1381c-fe1b-4edc-926b-2bb002947d6e tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:35.834959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-80c1381c-fe1b-4edc-926b-2bb002947d6e tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:35.852626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80c1381c-fe1b-4edc-926b-2bb002947d6e tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.854418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80c1381c-fe1b-4edc-926b-2bb002947d6e tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.855050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80c1381c-fe1b-4edc-926b-2bb002947d6e tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:35.855900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80c1381c-fe1b-4edc-926b-2bb002947d6e tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:35.856605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80c1381c-fe1b-4edc-926b-2bb002947d6e tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:35.857209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80c1381c-fe1b-4edc-926b-2bb002947d6e tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.045946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-80c1381c-fe1b-4edc-926b-2bb002947d6e tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:36.056755 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-80c1381c-fe1b-4edc-926b-2bb002947d6e tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1673 microversion: 2.1 time: 0.231627 Aug 27 03:09:36.058649 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2842/5532] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:35 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1673 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:36.211654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e92a5467-7eae-4573-a743-bda2f23bc1aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:36.227818 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e92a5467-7eae-4573-a743-bda2f23bc1aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1510 microversion: 2.1 time: 0.930925 Aug 27 03:09:36.229164 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2691/5533] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:35 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1510 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:36.249783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1e116ea3-a9fa-4cfe-8ad2-442841cd440f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:36.250902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1e116ea3-a9fa-4cfe-8ad2-442841cd440f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:36.259355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e116ea3-a9fa-4cfe-8ad2-442841cd440f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.261025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e116ea3-a9fa-4cfe-8ad2-442841cd440f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.261698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e116ea3-a9fa-4cfe-8ad2-442841cd440f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.262974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e116ea3-a9fa-4cfe-8ad2-442841cd440f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.263893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e116ea3-a9fa-4cfe-8ad2-442841cd440f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.264576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e116ea3-a9fa-4cfe-8ad2-442841cd440f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.309362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1e116ea3-a9fa-4cfe-8ad2-442841cd440f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:09:36.466593 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1e116ea3-a9fa-4cfe-8ad2-442841cd440f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 204 len: 0 microversion: 2.1 time: 0.220253 Aug 27 03:09:36.468538 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2843/5534] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:09:36 2022] DELETE /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:09:36.481781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c9e68df2-11ad-4ab9-9a4b-263e1d3c9f42 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:36.482770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c9e68df2-11ad-4ab9-9a4b-263e1d3c9f42 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:36.494515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9e68df2-11ad-4ab9-9a4b-263e1d3c9f42 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.499497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9e68df2-11ad-4ab9-9a4b-263e1d3c9f42 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.500025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9e68df2-11ad-4ab9-9a4b-263e1d3c9f42 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.500872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9e68df2-11ad-4ab9-9a4b-263e1d3c9f42 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.501567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9e68df2-11ad-4ab9-9a4b-263e1d3c9f42 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.502447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9e68df2-11ad-4ab9-9a4b-263e1d3c9f42 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.833698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6ffa82a4-a387-4d5a-99d6-1c71d9fe1981 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:36.834505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6ffa82a4-a387-4d5a-99d6-1c71d9fe1981 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:36.840789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ffa82a4-a387-4d5a-99d6-1c71d9fe1981 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.841294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ffa82a4-a387-4d5a-99d6-1c71d9fe1981 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.841804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ffa82a4-a387-4d5a-99d6-1c71d9fe1981 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.842522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ffa82a4-a387-4d5a-99d6-1c71d9fe1981 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:36.842987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ffa82a4-a387-4d5a-99d6-1c71d9fe1981 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:36.843423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ffa82a4-a387-4d5a-99d6-1c71d9fe1981 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:36.996087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c9e68df2-11ad-4ab9-9a4b-263e1d3c9f42 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:37.015632 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c9e68df2-11ad-4ab9-9a4b-263e1d3c9f42 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1516 microversion: 2.1 time: 0.540376 Aug 27 03:09:37.016884 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2692/5535] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:36 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1516 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:37.079692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ab3e327-375e-4087-9bc6-cea2752016a5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:37.080317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ab3e327-375e-4087-9bc6-cea2752016a5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:37.089959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ab3e327-375e-4087-9bc6-cea2752016a5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:37.091241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ab3e327-375e-4087-9bc6-cea2752016a5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:37.092177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ab3e327-375e-4087-9bc6-cea2752016a5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:37.093282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6ffa82a4-a387-4d5a-99d6-1c71d9fe1981 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:37.094013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ab3e327-375e-4087-9bc6-cea2752016a5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:37.094846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ab3e327-375e-4087-9bc6-cea2752016a5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:37.095706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ab3e327-375e-4087-9bc6-cea2752016a5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:37.109924 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6ffa82a4-a387-4d5a-99d6-1c71d9fe1981 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.281021 Aug 27 03:09:37.119080 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2844/5536] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:36 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:37.478934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ab3e327-375e-4087-9bc6-cea2752016a5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbd8cc1d59d412b8b7f8cdf5db759b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54dbb52ebee9491ba10e591f7cbfddde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:37.499443 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ab3e327-375e-4087-9bc6-cea2752016a5 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 200 len: 1673 microversion: 2.1 time: 0.423581 Aug 27 03:09:37.499622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e78f4d9b-3b3c-42e6-bbc8-8b585363f1a8 req-4471eb37-723f-4a0f-a4f6-0b8d5205f3af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e9087f3-e9e3-46ef-bb07-345b9308d1fa", "name": "network-vif-deleted", "tag": "c616639e-5446-4839-a5bd-61feea81d16a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:37.508748 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2693/5537] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:37 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 1673 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:37.516832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e78f4d9b-3b3c-42e6-bbc8-8b585363f1a8 req-4471eb37-723f-4a0f-a4f6-0b8d5205f3af service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:37.519202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e78f4d9b-3b3c-42e6-bbc8-8b585363f1a8 req-4471eb37-723f-4a0f-a4f6-0b8d5205f3af service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:37.520026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e78f4d9b-3b3c-42e6-bbc8-8b585363f1a8 req-4471eb37-723f-4a0f-a4f6-0b8d5205f3af service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:37.538655 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e78f4d9b-3b3c-42e6-bbc8-8b585363f1a8 req-4471eb37-723f-4a0f-a4f6-0b8d5205f3af service nova] Creating event network-vif-deleted:c616639e-5446-4839-a5bd-61feea81d16a for instance 2e9087f3-e9e3-46ef-bb07-345b9308d1fa on n-h1-852084-5 Aug 27 03:09:37.545112 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e78f4d9b-3b3c-42e6-bbc8-8b585363f1a8 req-4471eb37-723f-4a0f-a4f6-0b8d5205f3af service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054004 Aug 27 03:09:37.545745 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2845/5538] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:09:38.037329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b4865b2-4682-48ca-98ac-4dbd1f2c2d58 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:38.054243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b4865b2-4682-48ca-98ac-4dbd1f2c2d58 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:38.070572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b4865b2-4682-48ca-98ac-4dbd1f2c2d58 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.071067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b4865b2-4682-48ca-98ac-4dbd1f2c2d58 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.071506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b4865b2-4682-48ca-98ac-4dbd1f2c2d58 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.072213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b4865b2-4682-48ca-98ac-4dbd1f2c2d58 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.072668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b4865b2-4682-48ca-98ac-4dbd1f2c2d58 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.073098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b4865b2-4682-48ca-98ac-4dbd1f2c2d58 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.077614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:38.141559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e50d3473-f77b-4dd4-9541-4fbbed8f52b1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:38.142352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e50d3473-f77b-4dd4-9541-4fbbed8f52b1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:38.154467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50d3473-f77b-4dd4-9541-4fbbed8f52b1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.155312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50d3473-f77b-4dd4-9541-4fbbed8f52b1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.156343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50d3473-f77b-4dd4-9541-4fbbed8f52b1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.157379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50d3473-f77b-4dd4-9541-4fbbed8f52b1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.158143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50d3473-f77b-4dd4-9541-4fbbed8f52b1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.158840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e50d3473-f77b-4dd4-9541-4fbbed8f52b1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.383215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e50d3473-f77b-4dd4-9541-4fbbed8f52b1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:38.394161 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e50d3473-f77b-4dd4-9541-4fbbed8f52b1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.257276 Aug 27 03:09:38.394985 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2846/5539] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:38 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:38.527310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:38.529175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] [instance: 2e9087f3-e9e3-46ef-bb07-345b9308d1fa] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:38.536387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.536961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.537863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.538822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:38.539389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:38.540146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:38.559421 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] HTTP exception thrown: Instance 2e9087f3-e9e3-46ef-bb07-345b9308d1fa could not be found. Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Request method failure captured: Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa HTTP/1.1 Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYneqYLu_uyP1Tp07PJMCLX90w2TOFbcQIbgR-RknTsabDkE2_-P6n-CKDv3imSUZ-YxviLXN5g8DO4tzH0YHUmvPD1eYkYc6tmax2ei9YEyLPaBfe3U3S1ygchrsDdXSPP97LHorWmhILHJsyajCn-7OjBLL4WjdzfDP3oumCk_CVs Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 54dbb52ebee9491ba10e591f7cbfddde Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestNetworkBasicOps-1241328853 Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_54dbb52ebee9491ba10e591f7cbfddde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/54dbb52ebee9491ba10e591f7cbfddde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/54dbb52ebee9491ba10e591f7cbfddde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/54dbb52ebee9491ba10e591f7cbfddde"}]}] Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestNetworkBasicOps-1241328853 Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 54dbb52ebee9491ba10e591f7cbfddde Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestNetworkBasicOps-1241328853 Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestNetworkBasicOps-1241328853-project Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: ccbd8cc1d59d412b8b7f8cdf5db759b2 Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestNetworkBasicOps-1241328853-project Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 2e9087f3-e9e3-46ef-bb07-345b9308d1fa could not be found. Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '2e9087f3-e9e3-46ef-bb07-345b9308d1fa'} Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e9087f3-e9e3-46ef-bb07-345b9308d1fa could not be found. Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e9087f3-e9e3-46ef-bb07-345b9308d1fa could not be found. Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:38.561285 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:09:38.564851 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:38.564851 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:38.564851 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:38.564851 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:38.564851 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:38.564851 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e9087f3-e9e3-46ef-bb07-345b9308d1fa could not be found. Aug 27 03:09:38.564851 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:09:38.564851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Returning 404 to user: Instance 2e9087f3-e9e3-46ef-bb07-345b9308d1fa could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:38.564851 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-33ba4a5d-597f-4078-9f9b-86fc6ad9eb5a tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa" status: 404 len: 111 microversion: 2.1 time: 0.040712 Aug 27 03:09:38.568412 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2847/5540] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:38 2022] GET /compute/v2.1/servers/2e9087f3-e9e3-46ef-bb07-345b9308d1fa => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:09:38.578355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b4865b2-4682-48ca-98ac-4dbd1f2c2d58 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:38.587382 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b4865b2-4682-48ca-98ac-4dbd1f2c2d58 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1516 microversion: 2.1 time: 0.553884 Aug 27 03:09:38.587930 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2694/5541] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:38 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1516 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:38.769780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d1abe05f-b3c9-4c06-88ed-b0f7cc93f8e0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] Calling method '.version_select at 0x7f4d290d6430>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:38.809272 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d1abe05f-b3c9-4c06-88ed-b0f7cc93f8e0 tempest-TestNetworkBasicOps-1241328853 tempest-TestNetworkBasicOps-1241328853-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2145592902" status: 202 len: 0 microversion: 2.1 time: 0.050896 Aug 27 03:09:38.815746 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2848/5542] 10.222.0.99 () {58 vars in 1257 bytes} [Sat Aug 27 03:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2145592902 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:09:39.416283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e8d88536-3e92-49a0-bf19-d302ca9877db tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:39.417414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e8d88536-3e92-49a0-bf19-d302ca9877db tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:39.427942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8d88536-3e92-49a0-bf19-d302ca9877db tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.428450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8d88536-3e92-49a0-bf19-d302ca9877db tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.432363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8d88536-3e92-49a0-bf19-d302ca9877db tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.434184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8d88536-3e92-49a0-bf19-d302ca9877db tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.434723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8d88536-3e92-49a0-bf19-d302ca9877db tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.435163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e8d88536-3e92-49a0-bf19-d302ca9877db tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.609761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-602f9c5a-d8dd-44af-a009-c89b19c44450 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:39.611174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-602f9c5a-d8dd-44af-a009-c89b19c44450 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:39.646824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-602f9c5a-d8dd-44af-a009-c89b19c44450 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.648280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-602f9c5a-d8dd-44af-a009-c89b19c44450 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.649311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-602f9c5a-d8dd-44af-a009-c89b19c44450 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.650616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-602f9c5a-d8dd-44af-a009-c89b19c44450 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.651282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-602f9c5a-d8dd-44af-a009-c89b19c44450 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.652095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-602f9c5a-d8dd-44af-a009-c89b19c44450 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.911947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e8d88536-3e92-49a0-bf19-d302ca9877db tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:39.913014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-602f9c5a-d8dd-44af-a009-c89b19c44450 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:39.927525 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e8d88536-3e92-49a0-bf19-d302ca9877db tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.510966 Aug 27 03:09:39.928529 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2695/5543] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:39 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:39.936649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-1380bbee-dc54-4313-99e6-08e1a35d6f7b req-36c91e3d-6771-425d-a7eb-cba492db02f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99082a4-a42d-435b-acc8-7b8310aeb1e9", "name": "network-vif-deleted", "tag": "feec414a-0573-4681-a0c6-322267d08384"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:39.955012 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-602f9c5a-d8dd-44af-a009-c89b19c44450 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 200 len: 1474 microversion: 2.1 time: 0.343265 Aug 27 03:09:39.956974 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2849/5544] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:39 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:39.967593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1380bbee-dc54-4313-99e6-08e1a35d6f7b req-36c91e3d-6771-425d-a7eb-cba492db02f2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:39.968556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1380bbee-dc54-4313-99e6-08e1a35d6f7b req-36c91e3d-6771-425d-a7eb-cba492db02f2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:39.969010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1380bbee-dc54-4313-99e6-08e1a35d6f7b req-36c91e3d-6771-425d-a7eb-cba492db02f2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:39.987371 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1380bbee-dc54-4313-99e6-08e1a35d6f7b req-36c91e3d-6771-425d-a7eb-cba492db02f2 service nova] Creating event network-vif-deleted:feec414a-0573-4681-a0c6-322267d08384 for instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 on n-h2-852084-5 Aug 27 03:09:39.997587 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-1380bbee-dc54-4313-99e6-08e1a35d6f7b req-36c91e3d-6771-425d-a7eb-cba492db02f2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066236 Aug 27 03:09:39.998524 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2696/5545] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:40.949874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-89e646f0-2cc1-4612-ad69-792d148ddf31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:40.950679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-89e646f0-2cc1-4612-ad69-792d148ddf31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:40.963919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89e646f0-2cc1-4612-ad69-792d148ddf31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:40.965102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89e646f0-2cc1-4612-ad69-792d148ddf31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:40.966112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89e646f0-2cc1-4612-ad69-792d148ddf31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:40.967523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89e646f0-2cc1-4612-ad69-792d148ddf31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:40.971947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89e646f0-2cc1-4612-ad69-792d148ddf31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:40.972542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89e646f0-2cc1-4612-ad69-792d148ddf31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:40.987568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:40.988287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:41.003764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.004342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.007006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.007773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:41.008249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:41.011559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:41.055596 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 HTTP/1.1 Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f99082a4-a42d-435b-acc8-7b8310aeb1e9'} Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.062663 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:09:41.066734 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:09:41.066734 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:09:41.066734 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:09:41.066734 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:09:41.066734 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:09:41.066734 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:09:41.069425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:09:41.070478 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8890ac20-f844-4671-861a-0f844ac94330 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 404 len: 111 microversion: 2.1 time: 0.096673 Aug 27 03:09:41.071359 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2697/5546] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:40 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:09:41.081319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-134cc46e-4693-43d4-b1a1-3ba7693232cf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '.version_select at 0x7f4d29485a60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:41.140598 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-134cc46e-4693-43d4-b1a1-3ba7693232cf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-key-687044470" status: 202 len: 0 microversion: 2.1 time: 0.063872 Aug 27 03:09:41.152114 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2698/5547] 10.222.0.99 () {58 vars in 1206 bytes} [Sat Aug 27 03:09:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-687044470 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:09:41.284634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1622702021", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a7f149e5-3bf9-4728-ad5f-b673712c2f5f"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:41.392542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] validate_networks() for [('a7f149e5-3bf9-4728-ad5f-b673712c2f5f', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:41.541966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-89e646f0-2cc1-4612-ad69-792d148ddf31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:41.550583 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-89e646f0-2cc1-4612-ad69-792d148ddf31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.604802 Aug 27 03:09:41.553977 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2850/5548] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:40 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:42.203919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:42.205202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:42.205941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:42.206519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:42.207016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:42.225591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.226480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.227140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.228964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.229709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.230449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.258650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:42.266784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for user 756fff89d19d41869dad9425eddd55c1 and project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:42.288637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:42.293109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:42.384955 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3ba063df-b403-414e-a218-1037afeb7fbc tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104171 Aug 27 03:09:42.395534 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2699/5549] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:09:42.405173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad6434af-de13-458c-b892-342524e9a33a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:42.408154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ad6434af-de13-458c-b892-342524e9a33a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:42.580068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ffbb4a57-9e65-4ea8-acd0-7fe8fbf259c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:42.581381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ffbb4a57-9e65-4ea8-acd0-7fe8fbf259c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:42.609950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbb4a57-9e65-4ea8-acd0-7fe8fbf259c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.612945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbb4a57-9e65-4ea8-acd0-7fe8fbf259c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.615853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbb4a57-9e65-4ea8-acd0-7fe8fbf259c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.616787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbb4a57-9e65-4ea8-acd0-7fe8fbf259c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:42.617577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbb4a57-9e65-4ea8-acd0-7fe8fbf259c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:42.618612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbb4a57-9e65-4ea8-acd0-7fe8fbf259c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:42.666810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad6434af-de13-458c-b892-342524e9a33a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:42.676086 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad6434af-de13-458c-b892-342524e9a33a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1209 microversion: 2.1 time: 0.280458 Aug 27 03:09:42.677738 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2851/5550] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:42 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1209 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:43.493574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ffbb4a57-9e65-4ea8-acd0-7fe8fbf259c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:43.525061 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ffbb4a57-9e65-4ea8-acd0-7fe8fbf259c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.941028 Aug 27 03:09:43.528360 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2700/5551] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:42 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:43.697918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5bda8303-e67e-4e49-a95e-4ef6760ee701 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:43.698700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5bda8303-e67e-4e49-a95e-4ef6760ee701 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:43.719167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bda8303-e67e-4e49-a95e-4ef6760ee701 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.719934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bda8303-e67e-4e49-a95e-4ef6760ee701 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.720717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bda8303-e67e-4e49-a95e-4ef6760ee701 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.721752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bda8303-e67e-4e49-a95e-4ef6760ee701 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:43.722475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bda8303-e67e-4e49-a95e-4ef6760ee701 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:43.724182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5bda8303-e67e-4e49-a95e-4ef6760ee701 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:43.879090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5bda8303-e67e-4e49-a95e-4ef6760ee701 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:43.902433 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5bda8303-e67e-4e49-a95e-4ef6760ee701 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1261 microversion: 2.1 time: 0.208780 Aug 27 03:09:43.903415 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2852/5552] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:43 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:44.558655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-82ceef39-9104-46f5-abee-0905f8c9fc38 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:44.560998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-82ceef39-9104-46f5-abee-0905f8c9fc38 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:44.580531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ceef39-9104-46f5-abee-0905f8c9fc38 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:44.590546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ceef39-9104-46f5-abee-0905f8c9fc38 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:44.591956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ceef39-9104-46f5-abee-0905f8c9fc38 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:44.594992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ceef39-9104-46f5-abee-0905f8c9fc38 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:44.597068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ceef39-9104-46f5-abee-0905f8c9fc38 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:44.597786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ceef39-9104-46f5-abee-0905f8c9fc38 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:44.925994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5a0fa305-19b1-4648-ba59-e73f055817aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:44.927680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5a0fa305-19b1-4648-ba59-e73f055817aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:44.935691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a0fa305-19b1-4648-ba59-e73f055817aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:44.936454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a0fa305-19b1-4648-ba59-e73f055817aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:44.937199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a0fa305-19b1-4648-ba59-e73f055817aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:44.938143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a0fa305-19b1-4648-ba59-e73f055817aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:44.938755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a0fa305-19b1-4648-ba59-e73f055817aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:44.939397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a0fa305-19b1-4648-ba59-e73f055817aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:45.117150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5a0fa305-19b1-4648-ba59-e73f055817aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:45.120265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-82ceef39-9104-46f5-abee-0905f8c9fc38 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:45.128023 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5a0fa305-19b1-4648-ba59-e73f055817aa tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1267 microversion: 2.1 time: 0.207226 Aug 27 03:09:45.129522 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2853/5553] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:44 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:45.130317 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-82ceef39-9104-46f5-abee-0905f8c9fc38 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.575016 Aug 27 03:09:45.144999 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2701/5554] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:44 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:46.161831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21053b58-0183-479a-9e02-20ed46142ac5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:46.165388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21053b58-0183-479a-9e02-20ed46142ac5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:46.173908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bf63bae7-1b67-4dca-bd67-6da409f9376e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:46.175146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bf63bae7-1b67-4dca-bd67-6da409f9376e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:46.189329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf63bae7-1b67-4dca-bd67-6da409f9376e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.191688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21053b58-0183-479a-9e02-20ed46142ac5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.192415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf63bae7-1b67-4dca-bd67-6da409f9376e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.193023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf63bae7-1b67-4dca-bd67-6da409f9376e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.193592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21053b58-0183-479a-9e02-20ed46142ac5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.194547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf63bae7-1b67-4dca-bd67-6da409f9376e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.196129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21053b58-0183-479a-9e02-20ed46142ac5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.197139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21053b58-0183-479a-9e02-20ed46142ac5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:46.197384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf63bae7-1b67-4dca-bd67-6da409f9376e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.197871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bf63bae7-1b67-4dca-bd67-6da409f9376e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.201937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21053b58-0183-479a-9e02-20ed46142ac5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:46.202705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21053b58-0183-479a-9e02-20ed46142ac5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:46.618146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bf63bae7-1b67-4dca-bd67-6da409f9376e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:46.628156 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bf63bae7-1b67-4dca-bd67-6da409f9376e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.462333 Aug 27 03:09:46.629498 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2702/5555] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:46 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:46.713014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-21053b58-0183-479a-9e02-20ed46142ac5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:46.725920 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21053b58-0183-479a-9e02-20ed46142ac5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1309 microversion: 2.1 time: 0.576446 Aug 27 03:09:46.728279 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2854/5556] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:46 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1309 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:47.648653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1e375dda-4494-4c7f-bd9c-a992ef089484 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:47.649271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1e375dda-4494-4c7f-bd9c-a992ef089484 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:47.674669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e375dda-4494-4c7f-bd9c-a992ef089484 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.675176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e375dda-4494-4c7f-bd9c-a992ef089484 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.681512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e375dda-4494-4c7f-bd9c-a992ef089484 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.688575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e375dda-4494-4c7f-bd9c-a992ef089484 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.689894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e375dda-4494-4c7f-bd9c-a992ef089484 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.690520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e375dda-4494-4c7f-bd9c-a992ef089484 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.751211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-072bd0fb-bbca-4302-a45a-e0d650b74766 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:47.751847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-072bd0fb-bbca-4302-a45a-e0d650b74766 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:47.765159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-072bd0fb-bbca-4302-a45a-e0d650b74766 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.765989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-072bd0fb-bbca-4302-a45a-e0d650b74766 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.766712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-072bd0fb-bbca-4302-a45a-e0d650b74766 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:47.773047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-072bd0fb-bbca-4302-a45a-e0d650b74766 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:47.775118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-072bd0fb-bbca-4302-a45a-e0d650b74766 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:47.776371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-072bd0fb-bbca-4302-a45a-e0d650b74766 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:48.029383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-072bd0fb-bbca-4302-a45a-e0d650b74766 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:48.038006 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-072bd0fb-bbca-4302-a45a-e0d650b74766 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1309 microversion: 2.1 time: 0.292355 Aug 27 03:09:48.039408 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2855/5557] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:47 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1309 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:48.153913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1e375dda-4494-4c7f-bd9c-a992ef089484 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:48.164231 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1e375dda-4494-4c7f-bd9c-a992ef089484 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.519455 Aug 27 03:09:48.164991 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2703/5558] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:47 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:49.061985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f4ec844-c8b2-46ac-8327-54636f5d3010 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:49.062770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5f4ec844-c8b2-46ac-8327-54636f5d3010 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:49.074569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f4ec844-c8b2-46ac-8327-54636f5d3010 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.075354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f4ec844-c8b2-46ac-8327-54636f5d3010 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.075988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f4ec844-c8b2-46ac-8327-54636f5d3010 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.078647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f4ec844-c8b2-46ac-8327-54636f5d3010 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.080828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f4ec844-c8b2-46ac-8327-54636f5d3010 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.081629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f4ec844-c8b2-46ac-8327-54636f5d3010 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.098201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-828fe885-56e7-40cb-886b-7f6869254d8a req-6c70528d-5985-43da-80cc-fec0bb5edba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27ffeac7-84af-4b89-ac5f-43bfe9ef1d62", "tag": "8b3d9961-a378-4a09-be66-e2703f30ed09"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:49.128776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-828fe885-56e7-40cb-886b-7f6869254d8a req-6c70528d-5985-43da-80cc-fec0bb5edba5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.132595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-828fe885-56e7-40cb-886b-7f6869254d8a req-6c70528d-5985-43da-80cc-fec0bb5edba5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.135085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-828fe885-56e7-40cb-886b-7f6869254d8a req-6c70528d-5985-43da-80cc-fec0bb5edba5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.162411 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-828fe885-56e7-40cb-886b-7f6869254d8a req-6c70528d-5985-43da-80cc-fec0bb5edba5 service nova] Creating event network-changed:8b3d9961-a378-4a09-be66-e2703f30ed09 for instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 on n-h2-852084-5 Aug 27 03:09:49.172498 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-828fe885-56e7-40cb-886b-7f6869254d8a req-6c70528d-5985-43da-80cc-fec0bb5edba5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.482495 Aug 27 03:09:49.175420 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2856/5559] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:09:49.189979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9721e7ce-bf4a-43b8-9e93-aae7b2f58439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:49.191060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9721e7ce-bf4a-43b8-9e93-aae7b2f58439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:49.201199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9721e7ce-bf4a-43b8-9e93-aae7b2f58439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.202162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9721e7ce-bf4a-43b8-9e93-aae7b2f58439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.202862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9721e7ce-bf4a-43b8-9e93-aae7b2f58439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.203828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9721e7ce-bf4a-43b8-9e93-aae7b2f58439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:49.204635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9721e7ce-bf4a-43b8-9e93-aae7b2f58439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:49.205282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9721e7ce-bf4a-43b8-9e93-aae7b2f58439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:49.475195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9721e7ce-bf4a-43b8-9e93-aae7b2f58439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:49.485200 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9721e7ce-bf4a-43b8-9e93-aae7b2f58439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.301723 Aug 27 03:09:49.485822 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2857/5560] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:49 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:49.670011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5f4ec844-c8b2-46ac-8327-54636f5d3010 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:49.681485 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5f4ec844-c8b2-46ac-8327-54636f5d3010 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1309 microversion: 2.1 time: 0.625593 Aug 27 03:09:49.686637 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2704/5561] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:49 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1309 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:50.509921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ad0d91a-f278-432f-af56-51359568ac1f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:50.510709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3ad0d91a-f278-432f-af56-51359568ac1f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:50.524352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad0d91a-f278-432f-af56-51359568ac1f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:50.525849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad0d91a-f278-432f-af56-51359568ac1f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:50.526672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad0d91a-f278-432f-af56-51359568ac1f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:50.528082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad0d91a-f278-432f-af56-51359568ac1f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:50.528875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad0d91a-f278-432f-af56-51359568ac1f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:50.529965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ad0d91a-f278-432f-af56-51359568ac1f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:50.705524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-95cb3e0a-9faf-4956-8127-2ab39224320b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:50.706189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-95cb3e0a-9faf-4956-8127-2ab39224320b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:50.721637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95cb3e0a-9faf-4956-8127-2ab39224320b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:50.722174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95cb3e0a-9faf-4956-8127-2ab39224320b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:50.722630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95cb3e0a-9faf-4956-8127-2ab39224320b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:50.728041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95cb3e0a-9faf-4956-8127-2ab39224320b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:50.728581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95cb3e0a-9faf-4956-8127-2ab39224320b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:50.729044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-95cb3e0a-9faf-4956-8127-2ab39224320b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:50.978537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3ad0d91a-f278-432f-af56-51359568ac1f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:50.987916 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ad0d91a-f278-432f-af56-51359568ac1f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.483934 Aug 27 03:09:51.002630 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2858/5562] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:50 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:51.086720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-95cb3e0a-9faf-4956-8127-2ab39224320b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:51.098169 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-95cb3e0a-9faf-4956-8127-2ab39224320b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1309 microversion: 2.1 time: 0.397569 Aug 27 03:09:51.099284 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2705/5563] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:50 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1309 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:52.012365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c7d7f256-8abb-40a8-81a1-4fe65c072370 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:52.012979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c7d7f256-8abb-40a8-81a1-4fe65c072370 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:52.025580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7d7f256-8abb-40a8-81a1-4fe65c072370 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.026388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7d7f256-8abb-40a8-81a1-4fe65c072370 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.027740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7d7f256-8abb-40a8-81a1-4fe65c072370 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.029068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7d7f256-8abb-40a8-81a1-4fe65c072370 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.030085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7d7f256-8abb-40a8-81a1-4fe65c072370 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.032128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7d7f256-8abb-40a8-81a1-4fe65c072370 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.120606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0a51a90e-45e2-4e30-a171-25ae3a4eb840 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:52.121142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0a51a90e-45e2-4e30-a171-25ae3a4eb840 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:52.123896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:52.136077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a51a90e-45e2-4e30-a171-25ae3a4eb840 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.146111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a51a90e-45e2-4e30-a171-25ae3a4eb840 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.148192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a51a90e-45e2-4e30-a171-25ae3a4eb840 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.152743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a51a90e-45e2-4e30-a171-25ae3a4eb840 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:52.153491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a51a90e-45e2-4e30-a171-25ae3a4eb840 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:52.155459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a51a90e-45e2-4e30-a171-25ae3a4eb840 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:52.246917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:52.281832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:52.461424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c7d7f256-8abb-40a8-81a1-4fe65c072370 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:52.472611 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c7d7f256-8abb-40a8-81a1-4fe65c072370 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1695 microversion: 2.1 time: 0.464665 Aug 27 03:09:52.473487 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2859/5564] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:52 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1695 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:52.900463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0a51a90e-45e2-4e30-a171-25ae3a4eb840 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:52.922597 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0a51a90e-45e2-4e30-a171-25ae3a4eb840 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1309 microversion: 2.1 time: 0.805711 Aug 27 03:09:52.923717 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2706/5565] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:52 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1309 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:53.497687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d5aaedb8-bd6a-4a10-a874-e78bd64184a8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:53.498498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d5aaedb8-bd6a-4a10-a874-e78bd64184a8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:53.506702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:53.512427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5aaedb8-bd6a-4a10-a874-e78bd64184a8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.513009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5aaedb8-bd6a-4a10-a874-e78bd64184a8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.514101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5aaedb8-bd6a-4a10-a874-e78bd64184a8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:53.517511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5aaedb8-bd6a-4a10-a874-e78bd64184a8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.518107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5aaedb8-bd6a-4a10-a874-e78bd64184a8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.518651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5aaedb8-bd6a-4a10-a874-e78bd64184a8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:53.944502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5d71db54-0b37-452a-b532-64bc3a21c4e4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:53.945762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5d71db54-0b37-452a-b532-64bc3a21c4e4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:53.960021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d5aaedb8-bd6a-4a10-a874-e78bd64184a8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:53.967364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:09:53.970206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d71db54-0b37-452a-b532-64bc3a21c4e4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.970745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d71db54-0b37-452a-b532-64bc3a21c4e4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.976542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d71db54-0b37-452a-b532-64bc3a21c4e4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:53.987882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d71db54-0b37-452a-b532-64bc3a21c4e4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:53.990824 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d5aaedb8-bd6a-4a10-a874-e78bd64184a8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1694 microversion: 2.1 time: 0.495153 Aug 27 03:09:53.992403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d71db54-0b37-452a-b532-64bc3a21c4e4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:53.994532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5d71db54-0b37-452a-b532-64bc3a21c4e4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:54.011359 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2860/5566] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:53 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1694 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:54.365964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-21cb55c6-fcd7-4688-93ee-288b801c92c8 req-83537c10-d4a4-47d0-9597-2cebfdaf7696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32747fe6-7436-4fc4-bc35-ae0f8495d2e3", "name": "network-vif-unplugged", "status": "completed", "tag": "7982bae4-d6b1-46bd-8563-3151707a0e2a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:54.389253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-21cb55c6-fcd7-4688-93ee-288b801c92c8 req-83537c10-d4a4-47d0-9597-2cebfdaf7696 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:54.390098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-21cb55c6-fcd7-4688-93ee-288b801c92c8 req-83537c10-d4a4-47d0-9597-2cebfdaf7696 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:54.390685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-21cb55c6-fcd7-4688-93ee-288b801c92c8 req-83537c10-d4a4-47d0-9597-2cebfdaf7696 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:54.420135 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-21cb55c6-fcd7-4688-93ee-288b801c92c8 req-83537c10-d4a4-47d0-9597-2cebfdaf7696 service nova] Creating event network-vif-unplugged:7982bae4-d6b1-46bd-8563-3151707a0e2a for instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 on n-h1-852084-5 Aug 27 03:09:54.428021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-21cb55c6-fcd7-4688-93ee-288b801c92c8 req-83537c10-d4a4-47d0-9597-2cebfdaf7696 service nova] Instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:09:54.452481 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-21cb55c6-fcd7-4688-93ee-288b801c92c8 req-83537c10-d4a4-47d0-9597-2cebfdaf7696 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099204 Aug 27 03:09:54.453795 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2861/5567] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:09:54.465524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5d71db54-0b37-452a-b532-64bc3a21c4e4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:54.476990 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5d71db54-0b37-452a-b532-64bc3a21c4e4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1309 microversion: 2.1 time: 0.536487 Aug 27 03:09:54.495121 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2707/5568] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:53 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1309 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:55.023575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2aa05152-ffbc-4650-939b-acab19fe404c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:55.024549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2aa05152-ffbc-4650-939b-acab19fe404c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:55.044503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa05152-ffbc-4650-939b-acab19fe404c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:55.045379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa05152-ffbc-4650-939b-acab19fe404c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:55.046240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa05152-ffbc-4650-939b-acab19fe404c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:55.048513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa05152-ffbc-4650-939b-acab19fe404c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:55.052145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa05152-ffbc-4650-939b-acab19fe404c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:55.052796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa05152-ffbc-4650-939b-acab19fe404c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:55.319904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-459159239", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "4a25e809-9e37-46f6-8b9d-0eb66149b649"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:55.392898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] validate_networks() for [('4a25e809-9e37-46f6-8b9d-0eb66149b649', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:09:55.435776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2aa05152-ffbc-4650-939b-acab19fe404c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:55.444634 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2aa05152-ffbc-4650-939b-acab19fe404c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1694 microversion: 2.1 time: 0.429012 Aug 27 03:09:55.445232 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2862/5569] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:55 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1694 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:55.500586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7603ab25-26ab-4a24-8abc-5a8cddab00e3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:55.501202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7603ab25-26ab-4a24-8abc-5a8cddab00e3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:55.513340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7603ab25-26ab-4a24-8abc-5a8cddab00e3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:55.515940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7603ab25-26ab-4a24-8abc-5a8cddab00e3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:55.516396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7603ab25-26ab-4a24-8abc-5a8cddab00e3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:55.517271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7603ab25-26ab-4a24-8abc-5a8cddab00e3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:55.517693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7603ab25-26ab-4a24-8abc-5a8cddab00e3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:55.520574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7603ab25-26ab-4a24-8abc-5a8cddab00e3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:55.847962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7603ab25-26ab-4a24-8abc-5a8cddab00e3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:55.870254 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7603ab25-26ab-4a24-8abc-5a8cddab00e3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1309 microversion: 2.1 time: 0.374109 Aug 27 03:09:55.871093 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2863/5570] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:55 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1309 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:56.021632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-dce48b0e-f099-4d76-a83f-e20a99b72be7 req-cd1dd45c-fa03-415d-8627-ab532acffd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ffeac7-84af-4b89-ac5f-43bfe9ef1d62", "name": "network-vif-plugged", "status": "completed", "tag": "8b3d9961-a378-4a09-be66-e2703f30ed09"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:56.034633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dce48b0e-f099-4d76-a83f-e20a99b72be7 req-cd1dd45c-fa03-415d-8627-ab532acffd43 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.035812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dce48b0e-f099-4d76-a83f-e20a99b72be7 req-cd1dd45c-fa03-415d-8627-ab532acffd43 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.036396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-dce48b0e-f099-4d76-a83f-e20a99b72be7 req-cd1dd45c-fa03-415d-8627-ab532acffd43 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.057778 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-dce48b0e-f099-4d76-a83f-e20a99b72be7 req-cd1dd45c-fa03-415d-8627-ab532acffd43 service nova] Creating event network-vif-plugged:8b3d9961-a378-4a09-be66-e2703f30ed09 for instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 on n-h2-852084-5 Aug 27 03:09:56.063354 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-dce48b0e-f099-4d76-a83f-e20a99b72be7 req-cd1dd45c-fa03-415d-8627-ab532acffd43 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190955 Aug 27 03:09:56.064373 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2864/5571] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:56.475193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ed8b097e-c4c1-43c6-80e8-95bc14d65c7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:56.477221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ed8b097e-c4c1-43c6-80e8-95bc14d65c7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:56.487015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed8b097e-c4c1-43c6-80e8-95bc14d65c7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.487869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed8b097e-c4c1-43c6-80e8-95bc14d65c7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.489040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed8b097e-c4c1-43c6-80e8-95bc14d65c7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.490049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed8b097e-c4c1-43c6-80e8-95bc14d65c7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.492033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed8b097e-c4c1-43c6-80e8-95bc14d65c7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.492730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ed8b097e-c4c1-43c6-80e8-95bc14d65c7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.631758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:09:56.633028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:09:56.634589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:09:56.635993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:09:56.636848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:09:56.649815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.650551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.651328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.652769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.653568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.654909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.689585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Getting quotas for project 6059b8939b27490ca5aaa95664f14d4b. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:09:56.696400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Getting quotas for user 6a5af818cf584c5f967eb549306ada91 and project 6059b8939b27490ca5aaa95664f14d4b. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:09:56.719823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:09:56.723675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:09:56.800817 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d888527c-484c-4977-b28c-b377b7dc0069 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.636926 Aug 27 03:09:56.806000 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2708/5572] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:09:56.822199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-60075c7a-9975-477f-bc79-0201a8f791d9 req-9380d8a4-f910-481b-9261-6c3cd07ca5ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32747fe6-7436-4fc4-bc35-ae0f8495d2e3", "tag": "7982bae4-d6b1-46bd-8563-3151707a0e2a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:56.879580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-60075c7a-9975-477f-bc79-0201a8f791d9 req-9380d8a4-f910-481b-9261-6c3cd07ca5ee service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:56.880359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-60075c7a-9975-477f-bc79-0201a8f791d9 req-9380d8a4-f910-481b-9261-6c3cd07ca5ee service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:56.884187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-60075c7a-9975-477f-bc79-0201a8f791d9 req-9380d8a4-f910-481b-9261-6c3cd07ca5ee service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:56.926604 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-60075c7a-9975-477f-bc79-0201a8f791d9 req-9380d8a4-f910-481b-9261-6c3cd07ca5ee service nova] Creating event network-changed:7982bae4-d6b1-46bd-8563-3151707a0e2a for instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 on n-h1-852084-5 Aug 27 03:09:56.941288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-60075c7a-9975-477f-bc79-0201a8f791d9 req-9380d8a4-f910-481b-9261-6c3cd07ca5ee service nova] Instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:09:56.972682 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-60075c7a-9975-477f-bc79-0201a8f791d9 req-9380d8a4-f910-481b-9261-6c3cd07ca5ee service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162386 Aug 27 03:09:56.975881 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2709/5573] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:09:56.994483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-417f8895-510e-4227-98cb-2faba49b577d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:56.997496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-417f8895-510e-4227-98cb-2faba49b577d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:57.053616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ed8b097e-c4c1-43c6-80e8-95bc14d65c7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:57.072163 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ed8b097e-c4c1-43c6-80e8-95bc14d65c7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1694 microversion: 2.1 time: 0.602470 Aug 27 03:09:57.075124 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2865/5574] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:56 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1694 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:57.081594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58b8526f-0c4f-4cae-993d-a39a5efcb41c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:57.083010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-58b8526f-0c4f-4cae-993d-a39a5efcb41c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:57.092029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b8526f-0c4f-4cae-993d-a39a5efcb41c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.092608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b8526f-0c4f-4cae-993d-a39a5efcb41c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.093282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b8526f-0c4f-4cae-993d-a39a5efcb41c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:57.094930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b8526f-0c4f-4cae-993d-a39a5efcb41c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:57.095643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b8526f-0c4f-4cae-993d-a39a5efcb41c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:57.096292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b8526f-0c4f-4cae-993d-a39a5efcb41c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:57.179997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-417f8895-510e-4227-98cb-2faba49b577d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:57.189442 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-417f8895-510e-4227-98cb-2faba49b577d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1214 microversion: 2.1 time: 0.211264 Aug 27 03:09:57.190068 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2710/5575] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:56 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1214 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:57.362401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58b8526f-0c4f-4cae-993d-a39a5efcb41c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:57.377830 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58b8526f-0c4f-4cae-993d-a39a5efcb41c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1309 microversion: 2.1 time: 0.301367 Aug 27 03:09:57.378670 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2866/5576] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:57 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1309 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:58.097158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f6910ff5-6cfc-4d36-a26a-93190c06b0d7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:58.097642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f6910ff5-6cfc-4d36-a26a-93190c06b0d7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:58.113066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6910ff5-6cfc-4d36-a26a-93190c06b0d7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:58.114125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6910ff5-6cfc-4d36-a26a-93190c06b0d7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:58.121468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6910ff5-6cfc-4d36-a26a-93190c06b0d7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:58.122294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6910ff5-6cfc-4d36-a26a-93190c06b0d7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:58.122774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6910ff5-6cfc-4d36-a26a-93190c06b0d7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:58.123941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6910ff5-6cfc-4d36-a26a-93190c06b0d7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:58.210281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-476f18a3-25ec-4749-84b5-ecddaa29d4bb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:58.210939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-476f18a3-25ec-4749-84b5-ecddaa29d4bb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:58.222604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-476f18a3-25ec-4749-84b5-ecddaa29d4bb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:58.223633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-476f18a3-25ec-4749-84b5-ecddaa29d4bb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:58.224080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-476f18a3-25ec-4749-84b5-ecddaa29d4bb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:58.224777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-476f18a3-25ec-4749-84b5-ecddaa29d4bb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:58.229500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-476f18a3-25ec-4749-84b5-ecddaa29d4bb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:58.230687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-476f18a3-25ec-4749-84b5-ecddaa29d4bb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:58.482564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f6910ff5-6cfc-4d36-a26a-93190c06b0d7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:58.503142 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f6910ff5-6cfc-4d36-a26a-93190c06b0d7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1692 microversion: 2.1 time: 0.410261 Aug 27 03:09:58.506604 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2711/5577] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:58 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1692 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:58.518604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-064d5c90-220e-4ae9-8f0e-de1acba4c138 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:58.519800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-064d5c90-220e-4ae9-8f0e-de1acba4c138 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:58.536100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064d5c90-220e-4ae9-8f0e-de1acba4c138 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:58.536766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064d5c90-220e-4ae9-8f0e-de1acba4c138 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:58.538925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064d5c90-220e-4ae9-8f0e-de1acba4c138 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:58.540356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064d5c90-220e-4ae9-8f0e-de1acba4c138 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:58.541044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064d5c90-220e-4ae9-8f0e-de1acba4c138 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:58.541984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-064d5c90-220e-4ae9-8f0e-de1acba4c138 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:58.722415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-476f18a3-25ec-4749-84b5-ecddaa29d4bb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:58.731976 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-476f18a3-25ec-4749-84b5-ecddaa29d4bb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1266 microversion: 2.1 time: 0.526080 Aug 27 03:09:58.733041 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2867/5578] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:58 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1266 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:09:59.328670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-064d5c90-220e-4ae9-8f0e-de1acba4c138 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:09:59.342400 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-064d5c90-220e-4ae9-8f0e-de1acba4c138 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1490 microversion: 2.1 time: 0.833442 Aug 27 03:09:59.358156 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2712/5579] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:58 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1490 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:09:59.533981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e79dbc6b-36a9-4230-a86b-3c958f781c53 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:09:59.534597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e79dbc6b-36a9-4230-a86b-3c958f781c53 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:09:59.544033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e79dbc6b-36a9-4230-a86b-3c958f781c53 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:59.544504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e79dbc6b-36a9-4230-a86b-3c958f781c53 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:59.544953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e79dbc6b-36a9-4230-a86b-3c958f781c53 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:59.545689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e79dbc6b-36a9-4230-a86b-3c958f781c53 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:09:59.546151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e79dbc6b-36a9-4230-a86b-3c958f781c53 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:09:59.546578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e79dbc6b-36a9-4230-a86b-3c958f781c53 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:09:59.584393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1622702021", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a7f149e5-3bf9-4728-ad5f-b673712c2f5f"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:09:59.704987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] validate_networks() for [('a7f149e5-3bf9-4728-ad5f-b673712c2f5f', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:10:00.180844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e79dbc6b-36a9-4230-a86b-3c958f781c53 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:00.189485 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e79dbc6b-36a9-4230-a86b-3c958f781c53 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1692 microversion: 2.1 time: 0.659429 Aug 27 03:10:00.205746 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2868/5580] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:09:59 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1692 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:00.213512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b2ff7dfa-ad24-4dc8-a5c8-61d31a64b857 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:00.223470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b2ff7dfa-ad24-4dc8-a5c8-61d31a64b857 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:00.243307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:00.247256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dfa-ad24-4dc8-a5c8-61d31a64b857 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:00.248320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dfa-ad24-4dc8-a5c8-61d31a64b857 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:00.249087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dfa-ad24-4dc8-a5c8-61d31a64b857 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:00.250946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dfa-ad24-4dc8-a5c8-61d31a64b857 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:00.253365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dfa-ad24-4dc8-a5c8-61d31a64b857 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:00.255371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff7dfa-ad24-4dc8-a5c8-61d31a64b857 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:00.449288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b2ff7dfa-ad24-4dc8-a5c8-61d31a64b857 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:00.465882 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b2ff7dfa-ad24-4dc8-a5c8-61d31a64b857 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1284 microversion: 2.1 time: 0.251424 Aug 27 03:10:00.467434 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2869/5581] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:00 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:01.044643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:01.046685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:01.047855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:01.048810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:01.049378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:01.071538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.072784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.073737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.075526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.078230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.079247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.122172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:01.132642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for user 756fff89d19d41869dad9425eddd55c1 and project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:01.164992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:01.167970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:01.242407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-97307805-c422-4643-a26f-09a8d0701b76 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:01.249157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-97307805-c422-4643-a26f-09a8d0701b76 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:01.278044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97307805-c422-4643-a26f-09a8d0701b76 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.284747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97307805-c422-4643-a26f-09a8d0701b76 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.288199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97307805-c422-4643-a26f-09a8d0701b76 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.291511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97307805-c422-4643-a26f-09a8d0701b76 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.297208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97307805-c422-4643-a26f-09a8d0701b76 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.298209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97307805-c422-4643-a26f-09a8d0701b76 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.315702 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba945697-39b3-4a39-af71-20674cffcb9d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.749419 Aug 27 03:10:01.323764 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2713/5582] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:09:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:10:01.347982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1c841def-75d9-497e-8d1f-677d55ab3186 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:01.350811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1c841def-75d9-497e-8d1f-677d55ab3186 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:01.644499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1c841def-75d9-497e-8d1f-677d55ab3186 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:01.663077 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1c841def-75d9-497e-8d1f-677d55ab3186 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1209 microversion: 2.1 time: 0.334398 Aug 27 03:10:01.666519 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2714/5583] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:01 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1209 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:01.688376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a15d488c-4b63-4439-9c38-793aa442b8a8 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:01.689103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a15d488c-4b63-4439-9c38-793aa442b8a8 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:01.717948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a15d488c-4b63-4439-9c38-793aa442b8a8 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.729017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a15d488c-4b63-4439-9c38-793aa442b8a8 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.731274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a15d488c-4b63-4439-9c38-793aa442b8a8 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.736314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a15d488c-4b63-4439-9c38-793aa442b8a8 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.738621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a15d488c-4b63-4439-9c38-793aa442b8a8 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.739396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a15d488c-4b63-4439-9c38-793aa442b8a8 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.880444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-97307805-c422-4643-a26f-09a8d0701b76 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:01.911272 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-97307805-c422-4643-a26f-09a8d0701b76 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1689 microversion: 2.1 time: 0.698656 Aug 27 03:10:01.912060 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2870/5584] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:01 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1689 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:01.948430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cdbffdea-e8ae-4d55-9d55-df1b19c702ea tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:01.949308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cdbffdea-e8ae-4d55-9d55-df1b19c702ea tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:01.979131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbffdea-e8ae-4d55-9d55-df1b19c702ea tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.982480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbffdea-e8ae-4d55-9d55-df1b19c702ea tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.984855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbffdea-e8ae-4d55-9d55-df1b19c702ea tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:01.988220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbffdea-e8ae-4d55-9d55-df1b19c702ea tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:01.989555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbffdea-e8ae-4d55-9d55-df1b19c702ea tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:01.993272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cdbffdea-e8ae-4d55-9d55-df1b19c702ea tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.072643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a15d488c-4b63-4439-9c38-793aa442b8a8 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:02.093152 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a15d488c-4b63-4439-9c38-793aa442b8a8 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1272 microversion: 2.1 time: 0.424006 Aug 27 03:10:02.111996 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2715/5585] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:01 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1272 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:02.258858 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cdbffdea-e8ae-4d55-9d55-df1b19c702ea tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3/action" status: 204 len: 0 microversion: 2.1 time: 0.324429 Aug 27 03:10:02.267724 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2871/5586] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:01 2022] POST /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3/action => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:02.273573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8863e834-a489-4322-963d-fb46065185d6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:02.274589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8863e834-a489-4322-963d-fb46065185d6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:02.296825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8863e834-a489-4322-963d-fb46065185d6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:02.299139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8863e834-a489-4322-963d-fb46065185d6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:02.310679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8863e834-a489-4322-963d-fb46065185d6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.313081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8863e834-a489-4322-963d-fb46065185d6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:02.315765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8863e834-a489-4322-963d-fb46065185d6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:02.317686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8863e834-a489-4322-963d-fb46065185d6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.693403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d033fd3d-8cee-4eff-b710-9adc6a71d4c2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:02.694196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d033fd3d-8cee-4eff-b710-9adc6a71d4c2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:02.710459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d033fd3d-8cee-4eff-b710-9adc6a71d4c2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:02.710827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d033fd3d-8cee-4eff-b710-9adc6a71d4c2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:02.711279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d033fd3d-8cee-4eff-b710-9adc6a71d4c2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.715716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d033fd3d-8cee-4eff-b710-9adc6a71d4c2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:02.716223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d033fd3d-8cee-4eff-b710-9adc6a71d4c2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:02.716676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d033fd3d-8cee-4eff-b710-9adc6a71d4c2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:02.881629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d033fd3d-8cee-4eff-b710-9adc6a71d4c2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:02.894376 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d033fd3d-8cee-4eff-b710-9adc6a71d4c2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1213 microversion: 2.1 time: 0.207299 Aug 27 03:10:02.897892 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2872/5587] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:02 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:03.118766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b32f5bd7-2fd3-40d5-8fa7-259b6bcf8dee tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:03.119754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b32f5bd7-2fd3-40d5-8fa7-259b6bcf8dee tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:03.127653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b32f5bd7-2fd3-40d5-8fa7-259b6bcf8dee tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.133384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b32f5bd7-2fd3-40d5-8fa7-259b6bcf8dee tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.134377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b32f5bd7-2fd3-40d5-8fa7-259b6bcf8dee tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.135300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b32f5bd7-2fd3-40d5-8fa7-259b6bcf8dee tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.135908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b32f5bd7-2fd3-40d5-8fa7-259b6bcf8dee tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.137077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b32f5bd7-2fd3-40d5-8fa7-259b6bcf8dee tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.262218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8863e834-a489-4322-963d-fb46065185d6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.275466 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8863e834-a489-4322-963d-fb46065185d6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1689 microversion: 2.1 time: 1.006640 Aug 27 03:10:03.279009 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2716/5588] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:02 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1689 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:03.860320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b32f5bd7-2fd3-40d5-8fa7-259b6bcf8dee tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:03.887533 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b32f5bd7-2fd3-40d5-8fa7-259b6bcf8dee tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1314 microversion: 2.1 time: 0.774275 Aug 27 03:10:03.907049 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2873/5589] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:03 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:03.919088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-560a417b-d564-42c2-ab0f-0cb8897e3154 req-ce5328cc-9a84-4146-85a2-67a0077a7704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32747fe6-7436-4fc4-bc35-ae0f8495d2e3", "name": "network-vif-plugged", "status": "completed", "tag": "7982bae4-d6b1-46bd-8563-3151707a0e2a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:03.936117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c22c44f2-9574-43e2-b274-ade1e641ba34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:03.938544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c22c44f2-9574-43e2-b274-ade1e641ba34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:03.956520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-560a417b-d564-42c2-ab0f-0cb8897e3154 req-ce5328cc-9a84-4146-85a2-67a0077a7704 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.959886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-560a417b-d564-42c2-ab0f-0cb8897e3154 req-ce5328cc-9a84-4146-85a2-67a0077a7704 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.960546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-560a417b-d564-42c2-ab0f-0cb8897e3154 req-ce5328cc-9a84-4146-85a2-67a0077a7704 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.965579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c22c44f2-9574-43e2-b274-ade1e641ba34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.966597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c22c44f2-9574-43e2-b274-ade1e641ba34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.969600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c22c44f2-9574-43e2-b274-ade1e641ba34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.970678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c22c44f2-9574-43e2-b274-ade1e641ba34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:03.972825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c22c44f2-9574-43e2-b274-ade1e641ba34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:03.978028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c22c44f2-9574-43e2-b274-ade1e641ba34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:03.994922 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-560a417b-d564-42c2-ab0f-0cb8897e3154 req-ce5328cc-9a84-4146-85a2-67a0077a7704 service nova] Creating event network-vif-plugged:7982bae4-d6b1-46bd-8563-3151707a0e2a for instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 on n-h1-852084-5 Aug 27 03:10:04.002051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:04.010300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-560a417b-d564-42c2-ab0f-0cb8897e3154 req-ce5328cc-9a84-4146-85a2-67a0077a7704 service nova] Instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:10:04.023413 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-560a417b-d564-42c2-ab0f-0cb8897e3154 req-ce5328cc-9a84-4146-85a2-67a0077a7704 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109899 Aug 27 03:10:04.024679 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2717/5590] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:04.030466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2141803244", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "bd21fd31-43fa-43fa-b78f-9df8b3e7ded8"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:04.106908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] validate_networks() for [('bd21fd31-43fa-43fa-b78f-9df8b3e7ded8', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:10:04.228125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c22c44f2-9574-43e2-b274-ade1e641ba34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:04.242068 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c22c44f2-9574-43e2-b274-ade1e641ba34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1205 microversion: 2.1 time: 0.318387 Aug 27 03:10:04.242689 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2874/5591] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:03 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1205 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:04.310341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a7a88716-e4ad-43f9-928c-a1e18062e166 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:04.310983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a7a88716-e4ad-43f9-928c-a1e18062e166 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:04.340970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7a88716-e4ad-43f9-928c-a1e18062e166 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.341483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7a88716-e4ad-43f9-928c-a1e18062e166 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.353251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7a88716-e4ad-43f9-928c-a1e18062e166 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.354193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7a88716-e4ad-43f9-928c-a1e18062e166 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.354695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7a88716-e4ad-43f9-928c-a1e18062e166 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.362049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7a88716-e4ad-43f9-928c-a1e18062e166 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.724325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a7a88716-e4ad-43f9-928c-a1e18062e166 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:04.740927 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a7a88716-e4ad-43f9-928c-a1e18062e166 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1689 microversion: 2.1 time: 0.434775 Aug 27 03:10:04.744901 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2875/5592] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:04 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1689 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:04.915801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7f23d1ef-5ff3-4687-8636-733beacd938e tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:04.916430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7f23d1ef-5ff3-4687-8636-733beacd938e tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:04.925213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f23d1ef-5ff3-4687-8636-733beacd938e tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.926455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f23d1ef-5ff3-4687-8636-733beacd938e tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.927304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f23d1ef-5ff3-4687-8636-733beacd938e tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:04.928457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f23d1ef-5ff3-4687-8636-733beacd938e tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:04.943432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f23d1ef-5ff3-4687-8636-733beacd938e tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:04.944433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7f23d1ef-5ff3-4687-8636-733beacd938e tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:05.503014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7f23d1ef-5ff3-4687-8636-733beacd938e tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:05.517077 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7f23d1ef-5ff3-4687-8636-733beacd938e tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1314 microversion: 2.1 time: 0.607399 Aug 27 03:10:05.537252 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2876/5593] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:04 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:05.545220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-30149da0-0920-45dc-9707-78e876de5e25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:05.547010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-30149da0-0920-45dc-9707-78e876de5e25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:05.554669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30149da0-0920-45dc-9707-78e876de5e25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:05.555477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30149da0-0920-45dc-9707-78e876de5e25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:05.556537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30149da0-0920-45dc-9707-78e876de5e25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:05.558024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30149da0-0920-45dc-9707-78e876de5e25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:05.558688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30149da0-0920-45dc-9707-78e876de5e25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:05.559323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30149da0-0920-45dc-9707-78e876de5e25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:05.585737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:06.000666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-30149da0-0920-45dc-9707-78e876de5e25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:06.010161 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-30149da0-0920-45dc-9707-78e876de5e25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1267 microversion: 2.1 time: 0.471231 Aug 27 03:10:06.010772 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2877/5594] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:05 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1267 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:06.021539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f8afdd1c-02c0-4bab-a04e-9fb24df54a2f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:06.022203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f8afdd1c-02c0-4bab-a04e-9fb24df54a2f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:06.040477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8afdd1c-02c0-4bab-a04e-9fb24df54a2f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.040985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8afdd1c-02c0-4bab-a04e-9fb24df54a2f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.041434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8afdd1c-02c0-4bab-a04e-9fb24df54a2f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.042204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8afdd1c-02c0-4bab-a04e-9fb24df54a2f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.042675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8afdd1c-02c0-4bab-a04e-9fb24df54a2f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.043112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8afdd1c-02c0-4bab-a04e-9fb24df54a2f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.344363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:06.345275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:06.345793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:06.346192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:06.346602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:06.358494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.359630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.360568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.362279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.363077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.363609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.415523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Getting quotas for project da217e12fb3f4722980397872caf49b4. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:06.444253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Getting quotas for user 13762a04c0b545d1bc45118446bf06df and project da217e12fb3f4722980397872caf49b4. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:06.452739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f8afdd1c-02c0-4bab-a04e-9fb24df54a2f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:06.486127 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f8afdd1c-02c0-4bab-a04e-9fb24df54a2f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1689 microversion: 2.1 time: 0.468437 Aug 27 03:10:06.487413 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2878/5595] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:06 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1689 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:06.497873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f33074a9-5f19-4bbc-8b11-9c8ac6bc1908 req-a21ecc22-fdb9-41a7-bb38-1df1e9ff4f09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a76cdc9d-ee9c-4ba5-a760-729910cb047c", "tag": "45677625-a380-499a-a2de-15095bfc567a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:06.500355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:06.507910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:06.540627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f33074a9-5f19-4bbc-8b11-9c8ac6bc1908 req-a21ecc22-fdb9-41a7-bb38-1df1e9ff4f09 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.542332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f33074a9-5f19-4bbc-8b11-9c8ac6bc1908 req-a21ecc22-fdb9-41a7-bb38-1df1e9ff4f09 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.543608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f33074a9-5f19-4bbc-8b11-9c8ac6bc1908 req-a21ecc22-fdb9-41a7-bb38-1df1e9ff4f09 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.571920 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f33074a9-5f19-4bbc-8b11-9c8ac6bc1908 req-a21ecc22-fdb9-41a7-bb38-1df1e9ff4f09 service nova] Creating event network-changed:45677625-a380-499a-a2de-15095bfc567a for instance a76cdc9d-ee9c-4ba5-a760-729910cb047c on n-h1-852084-5 Aug 27 03:10:06.584482 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f33074a9-5f19-4bbc-8b11-9c8ac6bc1908 req-a21ecc22-fdb9-41a7-bb38-1df1e9ff4f09 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094778 Aug 27 03:10:06.598158 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2879/5596] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:06.604094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-67f40b0c-0459-4364-90c1-131d5e914c76 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:06.605053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-67f40b0c-0459-4364-90c1-131d5e914c76 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:06.611749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67f40b0c-0459-4364-90c1-131d5e914c76 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.612248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67f40b0c-0459-4364-90c1-131d5e914c76 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.612692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67f40b0c-0459-4364-90c1-131d5e914c76 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.613449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67f40b0c-0459-4364-90c1-131d5e914c76 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:06.613936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67f40b0c-0459-4364-90c1-131d5e914c76 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:06.614372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-67f40b0c-0459-4364-90c1-131d5e914c76 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:06.615462 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-323a57f4-6b57-4b0f-a703-91f7f370d40e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.589318 Aug 27 03:10:06.623192 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2718/5597] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:10:06.628597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7798a296-b87f-4714-bf79-8c7752d85529 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:06.630030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7798a296-b87f-4714-bf79-8c7752d85529 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:06.840626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7798a296-b87f-4714-bf79-8c7752d85529 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:06.868690 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7798a296-b87f-4714-bf79-8c7752d85529 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1219 microversion: 2.1 time: 0.242908 Aug 27 03:10:06.913149 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2719/5598] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:06 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1219 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:06.922747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-67f40b0c-0459-4364-90c1-131d5e914c76 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:06.936380 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-67f40b0c-0459-4364-90c1-131d5e914c76 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1314 microversion: 2.1 time: 0.336481 Aug 27 03:10:06.955860 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2880/5599] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:06 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:07.033271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f9b1bcd6-30c8-4717-b83f-40b5bf271dd5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:07.035011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f9b1bcd6-30c8-4717-b83f-40b5bf271dd5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:07.048444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9b1bcd6-30c8-4717-b83f-40b5bf271dd5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.052130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9b1bcd6-30c8-4717-b83f-40b5bf271dd5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.054558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9b1bcd6-30c8-4717-b83f-40b5bf271dd5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.055912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9b1bcd6-30c8-4717-b83f-40b5bf271dd5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.056739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9b1bcd6-30c8-4717-b83f-40b5bf271dd5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.060786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9b1bcd6-30c8-4717-b83f-40b5bf271dd5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.429763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f9b1bcd6-30c8-4717-b83f-40b5bf271dd5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:07.450916 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f9b1bcd6-30c8-4717-b83f-40b5bf271dd5 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1309 microversion: 2.1 time: 0.412738 Aug 27 03:10:07.456764 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2720/5600] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:07 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1309 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:07.511355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-320b7464-aca5-4857-be9c-e82dfa5285e6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:07.512431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-320b7464-aca5-4857-be9c-e82dfa5285e6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:07.527287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-320b7464-aca5-4857-be9c-e82dfa5285e6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.528922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-320b7464-aca5-4857-be9c-e82dfa5285e6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.530131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-320b7464-aca5-4857-be9c-e82dfa5285e6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.532650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-320b7464-aca5-4857-be9c-e82dfa5285e6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.533277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-320b7464-aca5-4857-be9c-e82dfa5285e6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.535880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-320b7464-aca5-4857-be9c-e82dfa5285e6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.928584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2b696d5f-3303-4690-9fc9-14b2c8aaa771 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:07.930296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2b696d5f-3303-4690-9fc9-14b2c8aaa771 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:07.944723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b696d5f-3303-4690-9fc9-14b2c8aaa771 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.945407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b696d5f-3303-4690-9fc9-14b2c8aaa771 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.947226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b696d5f-3303-4690-9fc9-14b2c8aaa771 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:07.948314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b696d5f-3303-4690-9fc9-14b2c8aaa771 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:07.949169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b696d5f-3303-4690-9fc9-14b2c8aaa771 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:07.950015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b696d5f-3303-4690-9fc9-14b2c8aaa771 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.044431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-320b7464-aca5-4857-be9c-e82dfa5285e6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:08.055218 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-320b7464-aca5-4857-be9c-e82dfa5285e6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1681 microversion: 2.1 time: 0.551223 Aug 27 03:10:08.063271 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2881/5601] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:07 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1681 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:08.070335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2045f2f-07f1-4115-ba5b-60bb024ac757 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:08.071198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2045f2f-07f1-4115-ba5b-60bb024ac757 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:08.086705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2b696d5f-3303-4690-9fc9-14b2c8aaa771 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:08.091689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2045f2f-07f1-4115-ba5b-60bb024ac757 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.094069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2045f2f-07f1-4115-ba5b-60bb024ac757 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.094692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2045f2f-07f1-4115-ba5b-60bb024ac757 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.095838 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2b696d5f-3303-4690-9fc9-14b2c8aaa771 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1271 microversion: 2.1 time: 0.177277 Aug 27 03:10:08.096765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2045f2f-07f1-4115-ba5b-60bb024ac757 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.097988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2045f2f-07f1-4115-ba5b-60bb024ac757 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.099557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2045f2f-07f1-4115-ba5b-60bb024ac757 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.113333 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2721/5602] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:07 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:08.478052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-66fdd00d-1448-4ab9-afd1-d3b9b420d25b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:08.479409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-66fdd00d-1448-4ab9-afd1-d3b9b420d25b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:08.495150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fdd00d-1448-4ab9-afd1-d3b9b420d25b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.495982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fdd00d-1448-4ab9-afd1-d3b9b420d25b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.497208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fdd00d-1448-4ab9-afd1-d3b9b420d25b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.498573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fdd00d-1448-4ab9-afd1-d3b9b420d25b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:08.500811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fdd00d-1448-4ab9-afd1-d3b9b420d25b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:08.502260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fdd00d-1448-4ab9-afd1-d3b9b420d25b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:08.536566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e2045f2f-07f1-4115-ba5b-60bb024ac757 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:08.545333 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2045f2f-07f1-4115-ba5b-60bb024ac757 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1314 microversion: 2.1 time: 0.480572 Aug 27 03:10:08.545970 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2882/5603] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:08 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:09.087816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-66fdd00d-1448-4ab9-afd1-d3b9b420d25b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:09.099707 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-66fdd00d-1448-4ab9-afd1-d3b9b420d25b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1309 microversion: 2.1 time: 0.627011 Aug 27 03:10:09.102034 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2722/5604] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:08 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1309 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:09.120471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fe9cf7a2-ef37-4b58-a0b5-0f5cee41512c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:09.121293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fe9cf7a2-ef37-4b58-a0b5-0f5cee41512c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:09.128795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe9cf7a2-ef37-4b58-a0b5-0f5cee41512c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.129289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe9cf7a2-ef37-4b58-a0b5-0f5cee41512c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.130898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe9cf7a2-ef37-4b58-a0b5-0f5cee41512c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.135648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe9cf7a2-ef37-4b58-a0b5-0f5cee41512c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.136143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe9cf7a2-ef37-4b58-a0b5-0f5cee41512c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.136583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe9cf7a2-ef37-4b58-a0b5-0f5cee41512c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.301909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe9cf7a2-ef37-4b58-a0b5-0f5cee41512c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:09.322933 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fe9cf7a2-ef37-4b58-a0b5-0f5cee41512c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1277 microversion: 2.1 time: 0.206232 Aug 27 03:10:09.338247 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2883/5605] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:09 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1277 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:09.569369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f19b348c-1b4b-4d8c-b903-aafd9a25d254 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:09.571941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f19b348c-1b4b-4d8c-b903-aafd9a25d254 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:09.586661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19b348c-1b4b-4d8c-b903-aafd9a25d254 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.593768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19b348c-1b4b-4d8c-b903-aafd9a25d254 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.594699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19b348c-1b4b-4d8c-b903-aafd9a25d254 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.595922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19b348c-1b4b-4d8c-b903-aafd9a25d254 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.598931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19b348c-1b4b-4d8c-b903-aafd9a25d254 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.601373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f19b348c-1b4b-4d8c-b903-aafd9a25d254 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.622208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2d84f081-635e-497c-9d01-28ae317e5777 req-202ed45e-cd6e-4c18-a375-89e6041ea840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40517cd1-5505-42bc-8d7e-4d92b189a48f", "tag": "c55389d1-3017-4e3f-8775-c2b4244361f6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:09.634346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d84f081-635e-497c-9d01-28ae317e5777 req-202ed45e-cd6e-4c18-a375-89e6041ea840 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:09.635251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d84f081-635e-497c-9d01-28ae317e5777 req-202ed45e-cd6e-4c18-a375-89e6041ea840 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:09.635921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d84f081-635e-497c-9d01-28ae317e5777 req-202ed45e-cd6e-4c18-a375-89e6041ea840 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:09.649790 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2d84f081-635e-497c-9d01-28ae317e5777 req-202ed45e-cd6e-4c18-a375-89e6041ea840 service nova] Creating event network-changed:c55389d1-3017-4e3f-8775-c2b4244361f6 for instance 40517cd1-5505-42bc-8d7e-4d92b189a48f on n-h2-852084-5 Aug 27 03:10:09.656336 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2d84f081-635e-497c-9d01-28ae317e5777 req-202ed45e-cd6e-4c18-a375-89e6041ea840 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159753 Aug 27 03:10:09.657295 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2723/5606] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:10.126792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7c55e832-082e-4ea3-bf08-baa3fe6495a0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:10.129269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7c55e832-082e-4ea3-bf08-baa3fe6495a0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:10.142888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c55e832-082e-4ea3-bf08-baa3fe6495a0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.143672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c55e832-082e-4ea3-bf08-baa3fe6495a0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.145483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c55e832-082e-4ea3-bf08-baa3fe6495a0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.148578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c55e832-082e-4ea3-bf08-baa3fe6495a0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.152786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c55e832-082e-4ea3-bf08-baa3fe6495a0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.154159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c55e832-082e-4ea3-bf08-baa3fe6495a0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.263277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f19b348c-1b4b-4d8c-b903-aafd9a25d254 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:10.275301 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f19b348c-1b4b-4d8c-b903-aafd9a25d254 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1314 microversion: 2.1 time: 0.710464 Aug 27 03:10:10.276426 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2884/5607] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:09 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:10.355797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57a46c20-5aa1-40cc-94f6-fc6d1c12c1e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:10.356719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-57a46c20-5aa1-40cc-94f6-fc6d1c12c1e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:10.367099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57a46c20-5aa1-40cc-94f6-fc6d1c12c1e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.367943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57a46c20-5aa1-40cc-94f6-fc6d1c12c1e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.368983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57a46c20-5aa1-40cc-94f6-fc6d1c12c1e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.370590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57a46c20-5aa1-40cc-94f6-fc6d1c12c1e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:10.371345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57a46c20-5aa1-40cc-94f6-fc6d1c12c1e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:10.372105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57a46c20-5aa1-40cc-94f6-fc6d1c12c1e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:10.464773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7c55e832-082e-4ea3-bf08-baa3fe6495a0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:10.473030 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7c55e832-082e-4ea3-bf08-baa3fe6495a0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1309 microversion: 2.1 time: 0.354032 Aug 27 03:10:10.473920 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2724/5608] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:10 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1309 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:10.869467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-57a46c20-5aa1-40cc-94f6-fc6d1c12c1e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:10.883861 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-57a46c20-5aa1-40cc-94f6-fc6d1c12c1e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1319 microversion: 2.1 time: 0.534711 Aug 27 03:10:10.885315 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2885/5609] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:10 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:11.274697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-5878e4df-5bf5-4696-bbfa-6484400b2d90 req-0f6d9fd0-cbf9-43af-bcfa-c58a6cf7d29c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca52f03a-2251-41c0-94ab-4d447dfaa216", "tag": "58a78a94-0baf-4a30-b889-87659648ba1e"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:11.301132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-edbbc6a0-f7c1-4598-bc3f-b09e36661106 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:11.301781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-edbbc6a0-f7c1-4598-bc3f-b09e36661106 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:11.309278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edbbc6a0-f7c1-4598-bc3f-b09e36661106 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.310291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5878e4df-5bf5-4696-bbfa-6484400b2d90 req-0f6d9fd0-cbf9-43af-bcfa-c58a6cf7d29c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.310995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5878e4df-5bf5-4696-bbfa-6484400b2d90 req-0f6d9fd0-cbf9-43af-bcfa-c58a6cf7d29c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.312311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5878e4df-5bf5-4696-bbfa-6484400b2d90 req-0f6d9fd0-cbf9-43af-bcfa-c58a6cf7d29c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.319065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edbbc6a0-f7c1-4598-bc3f-b09e36661106 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.319880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edbbc6a0-f7c1-4598-bc3f-b09e36661106 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.320817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edbbc6a0-f7c1-4598-bc3f-b09e36661106 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.321449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edbbc6a0-f7c1-4598-bc3f-b09e36661106 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.321919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edbbc6a0-f7c1-4598-bc3f-b09e36661106 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.333645 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-5878e4df-5bf5-4696-bbfa-6484400b2d90 req-0f6d9fd0-cbf9-43af-bcfa-c58a6cf7d29c service nova] Creating event network-changed:58a78a94-0baf-4a30-b889-87659648ba1e for instance ca52f03a-2251-41c0-94ab-4d447dfaa216 on n-h2-852084-5 Aug 27 03:10:11.340773 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-5878e4df-5bf5-4696-bbfa-6484400b2d90 req-0f6d9fd0-cbf9-43af-bcfa-c58a6cf7d29c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071176 Aug 27 03:10:11.342045 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2725/5610] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:11.495436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04916e68-0eff-423b-b8e2-966a0c4d8791 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:11.496228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-04916e68-0eff-423b-b8e2-966a0c4d8791 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:11.510991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04916e68-0eff-423b-b8e2-966a0c4d8791 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.511828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04916e68-0eff-423b-b8e2-966a0c4d8791 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.512711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04916e68-0eff-423b-b8e2-966a0c4d8791 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.513643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04916e68-0eff-423b-b8e2-966a0c4d8791 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.517328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04916e68-0eff-423b-b8e2-966a0c4d8791 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.518212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04916e68-0eff-423b-b8e2-966a0c4d8791 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.596327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-edbbc6a0-f7c1-4598-bc3f-b09e36661106 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:11.609150 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-edbbc6a0-f7c1-4598-bc3f-b09e36661106 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1314 microversion: 2.1 time: 0.312739 Aug 27 03:10:11.610671 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2886/5611] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:11 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:11.812384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-04916e68-0eff-423b-b8e2-966a0c4d8791 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:11.822812 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-04916e68-0eff-423b-b8e2-966a0c4d8791 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1309 microversion: 2.1 time: 0.331359 Aug 27 03:10:11.824463 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2726/5612] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:11 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1309 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:11.905166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c78f4832-a7e0-49fe-9abb-e43cffb76436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:11.906109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c78f4832-a7e0-49fe-9abb-e43cffb76436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:11.915131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c78f4832-a7e0-49fe-9abb-e43cffb76436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.915636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c78f4832-a7e0-49fe-9abb-e43cffb76436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.916120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c78f4832-a7e0-49fe-9abb-e43cffb76436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:11.916835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c78f4832-a7e0-49fe-9abb-e43cffb76436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:11.918250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c78f4832-a7e0-49fe-9abb-e43cffb76436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:11.919389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c78f4832-a7e0-49fe-9abb-e43cffb76436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.513634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c78f4832-a7e0-49fe-9abb-e43cffb76436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:12.522466 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c78f4832-a7e0-49fe-9abb-e43cffb76436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1319 microversion: 2.1 time: 0.621821 Aug 27 03:10:12.538293 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2887/5613] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:11 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1319 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:12.640529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-55f4bdf1-122d-415b-aa2f-a0c540cb6bd6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:12.642624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-55f4bdf1-122d-415b-aa2f-a0c540cb6bd6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:12.658197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f4bdf1-122d-415b-aa2f-a0c540cb6bd6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.658865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f4bdf1-122d-415b-aa2f-a0c540cb6bd6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.661845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f4bdf1-122d-415b-aa2f-a0c540cb6bd6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.667289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f4bdf1-122d-415b-aa2f-a0c540cb6bd6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.668063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f4bdf1-122d-415b-aa2f-a0c540cb6bd6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.668615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55f4bdf1-122d-415b-aa2f-a0c540cb6bd6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.846459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1b5f6421-044f-428c-91eb-acc6ff05e6ac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:12.847913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1b5f6421-044f-428c-91eb-acc6ff05e6ac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:12.855206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b5f6421-044f-428c-91eb-acc6ff05e6ac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.855936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b5f6421-044f-428c-91eb-acc6ff05e6ac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.856525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b5f6421-044f-428c-91eb-acc6ff05e6ac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.857426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b5f6421-044f-428c-91eb-acc6ff05e6ac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:12.858060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b5f6421-044f-428c-91eb-acc6ff05e6ac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:12.858629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b5f6421-044f-428c-91eb-acc6ff05e6ac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:12.932789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-55f4bdf1-122d-415b-aa2f-a0c540cb6bd6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:12.944002 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-55f4bdf1-122d-415b-aa2f-a0c540cb6bd6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1314 microversion: 2.1 time: 0.315169 Aug 27 03:10:12.959086 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2727/5614] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:12 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:13.374236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1b5f6421-044f-428c-91eb-acc6ff05e6ac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:13.408156 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1b5f6421-044f-428c-91eb-acc6ff05e6ac tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1309 microversion: 2.1 time: 0.565192 Aug 27 03:10:13.424308 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2888/5615] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:12 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1309 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:13.548084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74a47113-7c85-4244-aa44-2eebb00fd0e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:13.548880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-74a47113-7c85-4244-aa44-2eebb00fd0e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:13.583023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74a47113-7c85-4244-aa44-2eebb00fd0e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:13.583522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74a47113-7c85-4244-aa44-2eebb00fd0e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:13.584481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74a47113-7c85-4244-aa44-2eebb00fd0e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:13.585432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74a47113-7c85-4244-aa44-2eebb00fd0e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:13.585999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74a47113-7c85-4244-aa44-2eebb00fd0e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:13.586669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74a47113-7c85-4244-aa44-2eebb00fd0e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:13.869838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-74a47113-7c85-4244-aa44-2eebb00fd0e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:13.885358 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-74a47113-7c85-4244-aa44-2eebb00fd0e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1319 microversion: 2.1 time: 0.344554 Aug 27 03:10:13.887222 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2728/5616] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:13 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:13.974940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-459c1e41-77c1-4831-a0aa-b9fa94b92d69 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:13.988351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-459c1e41-77c1-4831-a0aa-b9fa94b92d69 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:14.005444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-459c1e41-77c1-4831-a0aa-b9fa94b92d69 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.007514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-459c1e41-77c1-4831-a0aa-b9fa94b92d69 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.008493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-459c1e41-77c1-4831-a0aa-b9fa94b92d69 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.009647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-459c1e41-77c1-4831-a0aa-b9fa94b92d69 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.011060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-459c1e41-77c1-4831-a0aa-b9fa94b92d69 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.011761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-459c1e41-77c1-4831-a0aa-b9fa94b92d69 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.032706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7c4b071e-42d1-4baf-86f0-7887cb0c1c87 req-c54bdf7a-16ea-42cc-bf2c-5e22bfb1c270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a76cdc9d-ee9c-4ba5-a760-729910cb047c", "name": "network-vif-plugged", "status": "completed", "tag": "45677625-a380-499a-a2de-15095bfc567a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:14.050859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7c4b071e-42d1-4baf-86f0-7887cb0c1c87 req-c54bdf7a-16ea-42cc-bf2c-5e22bfb1c270 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.051345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7c4b071e-42d1-4baf-86f0-7887cb0c1c87 req-c54bdf7a-16ea-42cc-bf2c-5e22bfb1c270 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.051779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7c4b071e-42d1-4baf-86f0-7887cb0c1c87 req-c54bdf7a-16ea-42cc-bf2c-5e22bfb1c270 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.092701 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7c4b071e-42d1-4baf-86f0-7887cb0c1c87 req-c54bdf7a-16ea-42cc-bf2c-5e22bfb1c270 service nova] Creating event network-vif-plugged:45677625-a380-499a-a2de-15095bfc567a for instance a76cdc9d-ee9c-4ba5-a760-729910cb047c on n-h1-852084-5 Aug 27 03:10:14.123547 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7c4b071e-42d1-4baf-86f0-7887cb0c1c87 req-c54bdf7a-16ea-42cc-bf2c-5e22bfb1c270 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094606 Aug 27 03:10:14.124267 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2729/5617] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:14.400556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-459c1e41-77c1-4831-a0aa-b9fa94b92d69 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:14.412946 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-459c1e41-77c1-4831-a0aa-b9fa94b92d69 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1314 microversion: 2.1 time: 0.448800 Aug 27 03:10:14.432279 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2889/5618] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:13 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:14.448484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d9120ff3-2f0e-4778-b4b9-77b46597e7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:14.449231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d9120ff3-2f0e-4778-b4b9-77b46597e7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:14.461054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9120ff3-2f0e-4778-b4b9-77b46597e7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.461556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9120ff3-2f0e-4778-b4b9-77b46597e7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.462397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9120ff3-2f0e-4778-b4b9-77b46597e7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.462779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9120ff3-2f0e-4778-b4b9-77b46597e7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.463203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9120ff3-2f0e-4778-b4b9-77b46597e7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.463634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9120ff3-2f0e-4778-b4b9-77b46597e7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.908168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b2c468d-4fc6-4f7a-bebd-95d283793c95 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:14.908802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9b2c468d-4fc6-4f7a-bebd-95d283793c95 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:14.921619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2c468d-4fc6-4f7a-bebd-95d283793c95 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.922401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2c468d-4fc6-4f7a-bebd-95d283793c95 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.923387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2c468d-4fc6-4f7a-bebd-95d283793c95 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:14.924263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2c468d-4fc6-4f7a-bebd-95d283793c95 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:14.926478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2c468d-4fc6-4f7a-bebd-95d283793c95 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:14.926943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b2c468d-4fc6-4f7a-bebd-95d283793c95 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.109277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9b2c468d-4fc6-4f7a-bebd-95d283793c95 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:15.118388 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9b2c468d-4fc6-4f7a-bebd-95d283793c95 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1319 microversion: 2.1 time: 0.215218 Aug 27 03:10:15.119265 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2890/5619] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:14 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:15.293623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d9120ff3-2f0e-4778-b4b9-77b46597e7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:15.306540 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d9120ff3-2f0e-4778-b4b9-77b46597e7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1309 microversion: 2.1 time: 0.862454 Aug 27 03:10:15.307410 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2730/5620] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:14 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1309 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:15.438515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-24b9fa53-c084-4d8b-bc78-3792f2802887 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:15.439960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-24b9fa53-c084-4d8b-bc78-3792f2802887 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:15.448235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b9fa53-c084-4d8b-bc78-3792f2802887 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.448834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b9fa53-c084-4d8b-bc78-3792f2802887 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.449351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b9fa53-c084-4d8b-bc78-3792f2802887 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.450166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b9fa53-c084-4d8b-bc78-3792f2802887 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:15.451707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b9fa53-c084-4d8b-bc78-3792f2802887 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:15.452912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24b9fa53-c084-4d8b-bc78-3792f2802887 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:15.735416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-24b9fa53-c084-4d8b-bc78-3792f2802887 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:15.763294 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-24b9fa53-c084-4d8b-bc78-3792f2802887 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1314 microversion: 2.1 time: 0.328906 Aug 27 03:10:15.763911 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2891/5621] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:15 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:16.139750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a2e42669-2771-4d48-aa56-04dfabda82e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:16.140421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a2e42669-2771-4d48-aa56-04dfabda82e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:16.150530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2e42669-2771-4d48-aa56-04dfabda82e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.154328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2e42669-2771-4d48-aa56-04dfabda82e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.155315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2e42669-2771-4d48-aa56-04dfabda82e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.156461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2e42669-2771-4d48-aa56-04dfabda82e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.157318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2e42669-2771-4d48-aa56-04dfabda82e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.159136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2e42669-2771-4d48-aa56-04dfabda82e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.302146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9305d667-374c-4d41-905a-1a507add4143 req-1148b370-56ea-4f63-8806-1ccdedd1671d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40517cd1-5505-42bc-8d7e-4d92b189a48f", "name": "network-vif-plugged", "status": "completed", "tag": "c55389d1-3017-4e3f-8775-c2b4244361f6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:16.320474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9305d667-374c-4d41-905a-1a507add4143 req-1148b370-56ea-4f63-8806-1ccdedd1671d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.329535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9305d667-374c-4d41-905a-1a507add4143 req-1148b370-56ea-4f63-8806-1ccdedd1671d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.330364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9305d667-374c-4d41-905a-1a507add4143 req-1148b370-56ea-4f63-8806-1ccdedd1671d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.353392 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9305d667-374c-4d41-905a-1a507add4143 req-1148b370-56ea-4f63-8806-1ccdedd1671d service nova] Creating event network-vif-plugged:c55389d1-3017-4e3f-8775-c2b4244361f6 for instance 40517cd1-5505-42bc-8d7e-4d92b189a48f on n-h2-852084-5 Aug 27 03:10:16.360763 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9305d667-374c-4d41-905a-1a507add4143 req-1148b370-56ea-4f63-8806-1ccdedd1671d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064485 Aug 27 03:10:16.366022 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2892/5622] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:10:16.379810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:16.383084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8ef1e711-aca8-494f-98fa-4492f6368749 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:16.385424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8ef1e711-aca8-494f-98fa-4492f6368749 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:16.409430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ef1e711-aca8-494f-98fa-4492f6368749 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.415145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ef1e711-aca8-494f-98fa-4492f6368749 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.424136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a2e42669-2771-4d48-aa56-04dfabda82e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:16.429218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ef1e711-aca8-494f-98fa-4492f6368749 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.430357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ef1e711-aca8-494f-98fa-4492f6368749 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.434079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ef1e711-aca8-494f-98fa-4492f6368749 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.434760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ef1e711-aca8-494f-98fa-4492f6368749 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.437266 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a2e42669-2771-4d48-aa56-04dfabda82e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1319 microversion: 2.1 time: 0.298416 Aug 27 03:10:16.439271 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2731/5623] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:16 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:16.766268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8ef1e711-aca8-494f-98fa-4492f6368749 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:16.776835 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8ef1e711-aca8-494f-98fa-4492f6368749 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1309 microversion: 2.1 time: 0.408643 Aug 27 03:10:16.778092 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2893/5624] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:16 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1309 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:16.787472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93f97e0b-863a-4dac-a529-f57579a3cbe4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:16.788300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93f97e0b-863a-4dac-a529-f57579a3cbe4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:16.790918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:16.796610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93f97e0b-863a-4dac-a529-f57579a3cbe4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.797258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93f97e0b-863a-4dac-a529-f57579a3cbe4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.797828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93f97e0b-863a-4dac-a529-f57579a3cbe4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.798428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93f97e0b-863a-4dac-a529-f57579a3cbe4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:16.799588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93f97e0b-863a-4dac-a529-f57579a3cbe4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:16.799588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93f97e0b-863a-4dac-a529-f57579a3cbe4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:16.873756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=24 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:17.057329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-93f97e0b-863a-4dac-a529-f57579a3cbe4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:17.068385 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-93f97e0b-863a-4dac-a529-f57579a3cbe4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1501 microversion: 2.1 time: 0.285727 Aug 27 03:10:17.069660 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2732/5625] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:16 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1501 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:17.090477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd4107ef-8477-4986-9297-5da3959eff2f tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:17.091449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd4107ef-8477-4986-9297-5da3959eff2f tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:17.099440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd4107ef-8477-4986-9297-5da3959eff2f tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.100745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd4107ef-8477-4986-9297-5da3959eff2f tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.101571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd4107ef-8477-4986-9297-5da3959eff2f tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.102603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd4107ef-8477-4986-9297-5da3959eff2f tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.107191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd4107ef-8477-4986-9297-5da3959eff2f tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.107915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd4107ef-8477-4986-9297-5da3959eff2f tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.377230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd4107ef-8477-4986-9297-5da3959eff2f tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:17.391842 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd4107ef-8477-4986-9297-5da3959eff2f tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1501 microversion: 2.1 time: 0.305210 Aug 27 03:10:17.396898 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2894/5626] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:17 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1501 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:17.421027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d40954c-fc83-45b5-b962-a64715bd0e30 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:17.422261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4d40954c-fc83-45b5-b962-a64715bd0e30 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:17.439267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d40954c-fc83-45b5-b962-a64715bd0e30 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.440127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d40954c-fc83-45b5-b962-a64715bd0e30 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.440799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d40954c-fc83-45b5-b962-a64715bd0e30 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.444814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d40954c-fc83-45b5-b962-a64715bd0e30 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.445518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d40954c-fc83-45b5-b962-a64715bd0e30 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.446663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d40954c-fc83-45b5-b962-a64715bd0e30 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.459564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b668ff3-645d-40dd-9385-3dc013c09a9c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:17.460560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9b668ff3-645d-40dd-9385-3dc013c09a9c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:17.471991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b668ff3-645d-40dd-9385-3dc013c09a9c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.480020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b668ff3-645d-40dd-9385-3dc013c09a9c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.480683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b668ff3-645d-40dd-9385-3dc013c09a9c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.481884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b668ff3-645d-40dd-9385-3dc013c09a9c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.482759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b668ff3-645d-40dd-9385-3dc013c09a9c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.483395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9b668ff3-645d-40dd-9385-3dc013c09a9c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.524580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-4d40954c-fc83-45b5-b962-a64715bd0e30 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lazy-loading 'flavor' on Instance uuid a76cdc9d-ee9c-4ba5-a760-729910cb047c {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:17.535619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:17.692927 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4d40954c-fc83-45b5-b962-a64715bd0e30 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "POST /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c/action" status: 202 len: 0 microversion: 2.1 time: 0.275314 Aug 27 03:10:17.696397 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2733/5627] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:17 2022] POST /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:17.703870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-668951a0-8918-4e2b-858b-3cfac3d5e90d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:17.704584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-668951a0-8918-4e2b-858b-3cfac3d5e90d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:17.725003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668951a0-8918-4e2b-858b-3cfac3d5e90d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.725611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668951a0-8918-4e2b-858b-3cfac3d5e90d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.727083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668951a0-8918-4e2b-858b-3cfac3d5e90d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:17.729418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668951a0-8918-4e2b-858b-3cfac3d5e90d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:17.729928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668951a0-8918-4e2b-858b-3cfac3d5e90d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:17.731473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-668951a0-8918-4e2b-858b-3cfac3d5e90d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.025637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9b668ff3-645d-40dd-9385-3dc013c09a9c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:18.042035 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9b668ff3-645d-40dd-9385-3dc013c09a9c tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1319 microversion: 2.1 time: 0.586566 Aug 27 03:10:18.043364 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2895/5628] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:17 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1319 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:18.049114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7be1a971-e410-4ad0-9c92-765d5f0648e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:18.051629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7be1a971-e410-4ad0-9c92-765d5f0648e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:18.061492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7be1a971-e410-4ad0-9c92-765d5f0648e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.062315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7be1a971-e410-4ad0-9c92-765d5f0648e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.062932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7be1a971-e410-4ad0-9c92-765d5f0648e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.063912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7be1a971-e410-4ad0-9c92-765d5f0648e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.064664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7be1a971-e410-4ad0-9c92-765d5f0648e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.065242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7be1a971-e410-4ad0-9c92-765d5f0648e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.189168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-668951a0-8918-4e2b-858b-3cfac3d5e90d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:18.201759 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-668951a0-8918-4e2b-858b-3cfac3d5e90d tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1509 microversion: 2.1 time: 0.503444 Aug 27 03:10:18.209482 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2734/5629] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:17 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1509 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:18.314558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7be1a971-e410-4ad0-9c92-765d5f0648e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:18.325277 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7be1a971-e410-4ad0-9c92-765d5f0648e9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1490 microversion: 2.1 time: 0.280258 Aug 27 03:10:18.325922 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2896/5630] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:18 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1490 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:18.351249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7266a05-d6ce-4cf5-a3ef-610aed8dbc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:18.352388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b7266a05-d6ce-4cf5-a3ef-610aed8dbc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:18.367377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7266a05-d6ce-4cf5-a3ef-610aed8dbc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.367896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7266a05-d6ce-4cf5-a3ef-610aed8dbc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.368346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7266a05-d6ce-4cf5-a3ef-610aed8dbc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.369064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7266a05-d6ce-4cf5-a3ef-610aed8dbc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.369734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7266a05-d6ce-4cf5-a3ef-610aed8dbc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.370179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7266a05-d6ce-4cf5-a3ef-610aed8dbc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.423905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ff1294cf-9db7-4cc2-ab89-e4fef020381e req-ee24891f-7119-4d13-bc2c-73e0909561cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca52f03a-2251-41c0-94ab-4d447dfaa216", "name": "network-vif-plugged", "status": "completed", "tag": "58a78a94-0baf-4a30-b889-87659648ba1e"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:18.442489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ff1294cf-9db7-4cc2-ab89-e4fef020381e req-ee24891f-7119-4d13-bc2c-73e0909561cd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.443367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ff1294cf-9db7-4cc2-ab89-e4fef020381e req-ee24891f-7119-4d13-bc2c-73e0909561cd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.444417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ff1294cf-9db7-4cc2-ab89-e4fef020381e req-ee24891f-7119-4d13-bc2c-73e0909561cd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.459493 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ff1294cf-9db7-4cc2-ab89-e4fef020381e req-ee24891f-7119-4d13-bc2c-73e0909561cd service nova] Creating event network-vif-plugged:58a78a94-0baf-4a30-b889-87659648ba1e for instance ca52f03a-2251-41c0-94ab-4d447dfaa216 on n-h2-852084-5 Aug 27 03:10:18.465431 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ff1294cf-9db7-4cc2-ab89-e4fef020381e req-ee24891f-7119-4d13-bc2c-73e0909561cd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045289 Aug 27 03:10:18.466374 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2897/5631] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:10:18.716575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7266a05-d6ce-4cf5-a3ef-610aed8dbc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:18.746922 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7266a05-d6ce-4cf5-a3ef-610aed8dbc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1490 microversion: 2.1 time: 0.401681 Aug 27 03:10:18.762646 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2735/5632] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:18 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1490 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:18.778261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2b5e5d3f-dd12-4bbd-ad82-5ccfb1a94d8a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:18.783345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2b5e5d3f-dd12-4bbd-ad82-5ccfb1a94d8a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:18.792349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5e5d3f-dd12-4bbd-ad82-5ccfb1a94d8a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.793107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5e5d3f-dd12-4bbd-ad82-5ccfb1a94d8a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.793732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5e5d3f-dd12-4bbd-ad82-5ccfb1a94d8a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:18.794658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5e5d3f-dd12-4bbd-ad82-5ccfb1a94d8a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:18.795280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5e5d3f-dd12-4bbd-ad82-5ccfb1a94d8a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:18.795874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b5e5d3f-dd12-4bbd-ad82-5ccfb1a94d8a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.064279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-981c9fc8-8d14-4aac-a2c7-8f9b46ed39b0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:19.064908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-981c9fc8-8d14-4aac-a2c7-8f9b46ed39b0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:19.081935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981c9fc8-8d14-4aac-a2c7-8f9b46ed39b0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.082433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981c9fc8-8d14-4aac-a2c7-8f9b46ed39b0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.082877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981c9fc8-8d14-4aac-a2c7-8f9b46ed39b0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.083643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981c9fc8-8d14-4aac-a2c7-8f9b46ed39b0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.084368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981c9fc8-8d14-4aac-a2c7-8f9b46ed39b0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.084798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-981c9fc8-8d14-4aac-a2c7-8f9b46ed39b0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.122034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:19.276252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2b5e5d3f-dd12-4bbd-ad82-5ccfb1a94d8a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:19.290493 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2b5e5d3f-dd12-4bbd-ad82-5ccfb1a94d8a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1490 microversion: 2.1 time: 0.523146 Aug 27 03:10:19.292632 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2898/5633] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:18 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1490 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:19.307643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dcda5067-cb2d-4dc2-b642-36570edf6b28 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:19.318654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dcda5067-cb2d-4dc2-b642-36570edf6b28 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:19.327332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcda5067-cb2d-4dc2-b642-36570edf6b28 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.328205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcda5067-cb2d-4dc2-b642-36570edf6b28 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.328869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcda5067-cb2d-4dc2-b642-36570edf6b28 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.329919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcda5067-cb2d-4dc2-b642-36570edf6b28 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.330690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcda5067-cb2d-4dc2-b642-36570edf6b28 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.331401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcda5067-cb2d-4dc2-b642-36570edf6b28 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.496006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-981c9fc8-8d14-4aac-a2c7-8f9b46ed39b0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:19.531488 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-981c9fc8-8d14-4aac-a2c7-8f9b46ed39b0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1319 microversion: 2.1 time: 0.470861 Aug 27 03:10:19.551234 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2736/5634] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:19 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:19.559992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-660907cf-36e6-4bea-ab52-8b200ebe2220 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:19.561061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-660907cf-36e6-4bea-ab52-8b200ebe2220 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:19.573862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-660907cf-36e6-4bea-ab52-8b200ebe2220 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.574827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-660907cf-36e6-4bea-ab52-8b200ebe2220 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.575506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-660907cf-36e6-4bea-ab52-8b200ebe2220 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.576589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-660907cf-36e6-4bea-ab52-8b200ebe2220 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.577364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-660907cf-36e6-4bea-ab52-8b200ebe2220 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.578257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-660907cf-36e6-4bea-ab52-8b200ebe2220 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.621980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-660907cf-36e6-4bea-ab52-8b200ebe2220 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:10:19.642854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dcda5067-cb2d-4dc2-b642-36570edf6b28 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:19.660361 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dcda5067-cb2d-4dc2-b642-36570edf6b28 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1492 microversion: 2.1 time: 0.366270 Aug 27 03:10:19.675885 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2899/5635] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:19 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1492 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:19.682519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2452010c-9da8-40ed-b87d-2eb9dd42d2d9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:19.683296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2452010c-9da8-40ed-b87d-2eb9dd42d2d9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:19.691384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2452010c-9da8-40ed-b87d-2eb9dd42d2d9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.692650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2452010c-9da8-40ed-b87d-2eb9dd42d2d9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.693394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2452010c-9da8-40ed-b87d-2eb9dd42d2d9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.694503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2452010c-9da8-40ed-b87d-2eb9dd42d2d9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.695258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2452010c-9da8-40ed-b87d-2eb9dd42d2d9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.696252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2452010c-9da8-40ed-b87d-2eb9dd42d2d9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.832905 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-660907cf-36e6-4bea-ab52-8b200ebe2220 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 204 len: 0 microversion: 2.1 time: 0.279754 Aug 27 03:10:19.834694 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2737/5636] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:19 2022] DELETE /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:19.843351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-94bdf90a-40ef-4a23-8f78-c677c6498ed2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:19.848934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-94bdf90a-40ef-4a23-8f78-c677c6498ed2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:19.861354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94bdf90a-40ef-4a23-8f78-c677c6498ed2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.865067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94bdf90a-40ef-4a23-8f78-c677c6498ed2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.865855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94bdf90a-40ef-4a23-8f78-c677c6498ed2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.866818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94bdf90a-40ef-4a23-8f78-c677c6498ed2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.867429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94bdf90a-40ef-4a23-8f78-c677c6498ed2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.868352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-94bdf90a-40ef-4a23-8f78-c677c6498ed2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.897734 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2452010c-9da8-40ed-b87d-2eb9dd42d2d9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "POST /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c/action" status: 202 len: 0 microversion: 2.1 time: 0.218229 Aug 27 03:10:19.900437 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2900/5637] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:19 2022] POST /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:19.913349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e605d812-9262-4d47-9ec9-b158b22d8f84 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:19.914361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e605d812-9262-4d47-9ec9-b158b22d8f84 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:19.928812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e605d812-9262-4d47-9ec9-b158b22d8f84 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.929763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e605d812-9262-4d47-9ec9-b158b22d8f84 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.930422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e605d812-9262-4d47-9ec9-b158b22d8f84 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:19.931367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e605d812-9262-4d47-9ec9-b158b22d8f84 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:19.932067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e605d812-9262-4d47-9ec9-b158b22d8f84 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:19.932983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e605d812-9262-4d47-9ec9-b158b22d8f84 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.254971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e605d812-9262-4d47-9ec9-b158b22d8f84 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:20.265320 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e605d812-9262-4d47-9ec9-b158b22d8f84 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1498 microversion: 2.1 time: 0.361573 Aug 27 03:10:20.278351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-94bdf90a-40ef-4a23-8f78-c677c6498ed2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:20.279832 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2901/5638] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:19 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1498 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:20.305553 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-94bdf90a-40ef-4a23-8f78-c677c6498ed2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1496 microversion: 2.1 time: 0.466389 Aug 27 03:10:20.310609 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2738/5639] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:19 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1496 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:20.561499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c55e79d8-d9a4-4675-9236-e6bd428db00a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:20.562123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c55e79d8-d9a4-4675-9236-e6bd428db00a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:20.576809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c55e79d8-d9a4-4675-9236-e6bd428db00a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.577637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c55e79d8-d9a4-4675-9236-e6bd428db00a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.578336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c55e79d8-d9a4-4675-9236-e6bd428db00a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.579340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c55e79d8-d9a4-4675-9236-e6bd428db00a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:20.580408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c55e79d8-d9a4-4675-9236-e6bd428db00a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:20.581094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c55e79d8-d9a4-4675-9236-e6bd428db00a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:20.805363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c55e79d8-d9a4-4675-9236-e6bd428db00a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:20.815679 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c55e79d8-d9a4-4675-9236-e6bd428db00a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1319 microversion: 2.1 time: 0.257931 Aug 27 03:10:20.818029 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2902/5640] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:20 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:21.289366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-072efeba-6e81-49c0-b3a1-b9bb0abcb879 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:21.290600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-072efeba-6e81-49c0-b3a1-b9bb0abcb879 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:21.311557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-072efeba-6e81-49c0-b3a1-b9bb0abcb879 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.312061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-072efeba-6e81-49c0-b3a1-b9bb0abcb879 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.312505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-072efeba-6e81-49c0-b3a1-b9bb0abcb879 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.313321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-072efeba-6e81-49c0-b3a1-b9bb0abcb879 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.313938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-072efeba-6e81-49c0-b3a1-b9bb0abcb879 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.314373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-072efeba-6e81-49c0-b3a1-b9bb0abcb879 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.332045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c20bac87-1158-4502-aefd-4b15d169e22f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:21.332885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c20bac87-1158-4502-aefd-4b15d169e22f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:21.344171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c20bac87-1158-4502-aefd-4b15d169e22f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.344686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c20bac87-1158-4502-aefd-4b15d169e22f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.345138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c20bac87-1158-4502-aefd-4b15d169e22f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.345898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c20bac87-1158-4502-aefd-4b15d169e22f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.346356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c20bac87-1158-4502-aefd-4b15d169e22f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.354284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c20bac87-1158-4502-aefd-4b15d169e22f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.793112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c20bac87-1158-4502-aefd-4b15d169e22f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:21.809974 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c20bac87-1158-4502-aefd-4b15d169e22f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1496 microversion: 2.1 time: 0.481714 Aug 27 03:10:21.811042 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2903/5641] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:21 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1496 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:21.839847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-80224ba7-60b2-4b43-91d2-c58677045b5f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:21.840529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-80224ba7-60b2-4b43-91d2-c58677045b5f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:21.849902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80224ba7-60b2-4b43-91d2-c58677045b5f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.852730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80224ba7-60b2-4b43-91d2-c58677045b5f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.853390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80224ba7-60b2-4b43-91d2-c58677045b5f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.854973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80224ba7-60b2-4b43-91d2-c58677045b5f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:21.856640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80224ba7-60b2-4b43-91d2-c58677045b5f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:21.860028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80224ba7-60b2-4b43-91d2-c58677045b5f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:21.924565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-072efeba-6e81-49c0-b3a1-b9bb0abcb879 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:21.936125 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-072efeba-6e81-49c0-b3a1-b9bb0abcb879 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1498 microversion: 2.1 time: 0.652374 Aug 27 03:10:21.938187 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2739/5642] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:21 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1498 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:22.138479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-80224ba7-60b2-4b43-91d2-c58677045b5f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:22.154013 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-80224ba7-60b2-4b43-91d2-c58677045b5f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1509 microversion: 2.1 time: 0.318945 Aug 27 03:10:22.158252 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2904/5643] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:21 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:22.694533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b614e635-7409-44e2-ab69-2766e802cdee req-73fc48b2-a593-4975-b7b5-741eedb05b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40517cd1-5505-42bc-8d7e-4d92b189a48f", "name": "network-vif-deleted", "tag": "c55389d1-3017-4e3f-8775-c2b4244361f6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:22.724828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b614e635-7409-44e2-ab69-2766e802cdee req-73fc48b2-a593-4975-b7b5-741eedb05b14 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.725402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b614e635-7409-44e2-ab69-2766e802cdee req-73fc48b2-a593-4975-b7b5-741eedb05b14 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.725888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b614e635-7409-44e2-ab69-2766e802cdee req-73fc48b2-a593-4975-b7b5-741eedb05b14 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.771796 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b614e635-7409-44e2-ab69-2766e802cdee req-73fc48b2-a593-4975-b7b5-741eedb05b14 service nova] Creating event network-vif-deleted:c55389d1-3017-4e3f-8775-c2b4244361f6 for instance 40517cd1-5505-42bc-8d7e-4d92b189a48f on n-h2-852084-5 Aug 27 03:10:22.779342 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b614e635-7409-44e2-ab69-2766e802cdee req-73fc48b2-a593-4975-b7b5-741eedb05b14 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089822 Aug 27 03:10:22.780601 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2905/5644] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:22.835421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:22.836059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:22.873591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.875942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.876411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:22.884853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:22.887243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:22.887695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.012883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c4ef84b2-2176-43e0-a161-87c61031984d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:23.013414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c4ef84b2-2176-43e0-a161-87c61031984d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:23.017950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.019488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.024087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.024954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lazy-loading 'fault' on Instance uuid 40517cd1-5505-42bc-8d7e-4d92b189a48f {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:23.026267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ef84b2-2176-43e0-a161-87c61031984d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.026761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ef84b2-2176-43e0-a161-87c61031984d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.035354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ef84b2-2176-43e0-a161-87c61031984d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.036210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ef84b2-2176-43e0-a161-87c61031984d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.036709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ef84b2-2176-43e0-a161-87c61031984d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.037150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c4ef84b2-2176-43e0-a161-87c61031984d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.146387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c4ef84b2-2176-43e0-a161-87c61031984d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:10:23.225365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:23.238089 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9abf7de1-3d1a-4f80-91ce-e93194bf137d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1299 microversion: 2.1 time: 0.409323 Aug 27 03:10:23.241618 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2906/5645] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:22 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1299 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:23.248227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ff4f2980-3024-4718-90c7-65ae1410513b tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:23.249164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ff4f2980-3024-4718-90c7-65ae1410513b tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:23.285967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff4f2980-3024-4718-90c7-65ae1410513b tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.287728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff4f2980-3024-4718-90c7-65ae1410513b tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.288213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff4f2980-3024-4718-90c7-65ae1410513b tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.288976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff4f2980-3024-4718-90c7-65ae1410513b tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.298317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff4f2980-3024-4718-90c7-65ae1410513b tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.299002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ff4f2980-3024-4718-90c7-65ae1410513b tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.397575 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c4ef84b2-2176-43e0-a161-87c61031984d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "DELETE /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 204 len: 0 microversion: 2.1 time: 0.993450 Aug 27 03:10:23.401867 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2740/5646] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:22 2022] DELETE /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 0 bytes in 999 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:23.413458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dbf12277-b9a4-4713-ac35-b389e6219fdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:23.416242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dbf12277-b9a4-4713-ac35-b389e6219fdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:23.441500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbf12277-b9a4-4713-ac35-b389e6219fdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.442347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbf12277-b9a4-4713-ac35-b389e6219fdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.442983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbf12277-b9a4-4713-ac35-b389e6219fdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.443903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbf12277-b9a4-4713-ac35-b389e6219fdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.446850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbf12277-b9a4-4713-ac35-b389e6219fdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.447715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbf12277-b9a4-4713-ac35-b389e6219fdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.694220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ff4f2980-3024-4718-90c7-65ae1410513b tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:23.710202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ff4f2980-3024-4718-90c7-65ae1410513b tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1501 microversion: 2.1 time: 0.460789 Aug 27 03:10:23.716292 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2907/5647] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:23 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1501 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:23.735719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-809d11c2-036f-482f-a2a0-3a7c64601a08 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:23.737006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-809d11c2-036f-482f-a2a0-3a7c64601a08 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:23.746534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-809d11c2-036f-482f-a2a0-3a7c64601a08 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.747483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-809d11c2-036f-482f-a2a0-3a7c64601a08 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.748145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-809d11c2-036f-482f-a2a0-3a7c64601a08 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.749467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-809d11c2-036f-482f-a2a0-3a7c64601a08 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.750272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-809d11c2-036f-482f-a2a0-3a7c64601a08 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.750982 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-809d11c2-036f-482f-a2a0-3a7c64601a08 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.838656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-809d11c2-036f-482f-a2a0-3a7c64601a08 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lazy-loading 'flavor' on Instance uuid a76cdc9d-ee9c-4ba5-a760-729910cb047c {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:23.882074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dbf12277-b9a4-4713-ac35-b389e6219fdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:23.896707 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dbf12277-b9a4-4713-ac35-b389e6219fdd tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1734 microversion: 2.1 time: 0.485481 Aug 27 03:10:23.901541 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2741/5648] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:23 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1734 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:23.970072 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-809d11c2-036f-482f-a2a0-3a7c64601a08 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "POST /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c/action" status: 202 len: 0 microversion: 2.1 time: 0.239702 Aug 27 03:10:23.971598 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2908/5649] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:23 2022] POST /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:23.980094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1b8b2bbb-b608-4ac8-a371-df3805adc6e9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:23.981060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1b8b2bbb-b608-4ac8-a371-df3805adc6e9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:23.989725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8b2bbb-b608-4ac8-a371-df3805adc6e9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.991425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8b2bbb-b608-4ac8-a371-df3805adc6e9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.992234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8b2bbb-b608-4ac8-a371-df3805adc6e9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:23.993181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8b2bbb-b608-4ac8-a371-df3805adc6e9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:23.994921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8b2bbb-b608-4ac8-a371-df3805adc6e9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:23.995638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1b8b2bbb-b608-4ac8-a371-df3805adc6e9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.203438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1b8b2bbb-b608-4ac8-a371-df3805adc6e9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:24.217131 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1b8b2bbb-b608-4ac8-a371-df3805adc6e9 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1509 microversion: 2.1 time: 0.240278 Aug 27 03:10:24.219576 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2742/5650] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:23 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:24.263797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:24.269826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:24.278736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.279669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.280698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.282172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.282986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.283677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.337924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.338805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.339687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.340375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lazy-loading 'fault' on Instance uuid 40517cd1-5505-42bc-8d7e-4d92b189a48f {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:24.415356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:24.423247 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6e1d571f-477f-4a5d-af7b-2b4b6b8fe95f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 200 len: 1299 microversion: 2.1 time: 0.164796 Aug 27 03:10:24.424074 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2909/5651] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:24 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:24.922062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b3c71dec-4ea9-4746-9430-8322459a5dc2 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:24.922818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b3c71dec-4ea9-4746-9430-8322459a5dc2 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:24.942628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3c71dec-4ea9-4746-9430-8322459a5dc2 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.944934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3c71dec-4ea9-4746-9430-8322459a5dc2 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.946843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3c71dec-4ea9-4746-9430-8322459a5dc2 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:24.948694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3c71dec-4ea9-4746-9430-8322459a5dc2 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:24.951116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3c71dec-4ea9-4746-9430-8322459a5dc2 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:24.952522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3c71dec-4ea9-4746-9430-8322459a5dc2 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.227626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b3c71dec-4ea9-4746-9430-8322459a5dc2 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:25.242445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8db8fef-3fb4-4fb1-b50a-9cc8ee1fe31c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:25.243746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c8db8fef-3fb4-4fb1-b50a-9cc8ee1fe31c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:25.250801 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b3c71dec-4ea9-4746-9430-8322459a5dc2 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1734 microversion: 2.1 time: 0.333056 Aug 27 03:10:25.257776 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2743/5652] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:24 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1734 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:25.270952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8db8fef-3fb4-4fb1-b50a-9cc8ee1fe31c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.271863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8db8fef-3fb4-4fb1-b50a-9cc8ee1fe31c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.272519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8db8fef-3fb4-4fb1-b50a-9cc8ee1fe31c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.273470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8db8fef-3fb4-4fb1-b50a-9cc8ee1fe31c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.274601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8db8fef-3fb4-4fb1-b50a-9cc8ee1fe31c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.275495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8db8fef-3fb4-4fb1-b50a-9cc8ee1fe31c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.279383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:25.447151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:25.449531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:25.462838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.463711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.464601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.465762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.466652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.467502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.496337 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f HTTP/1.1 Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '40517cd1-5505-42bc-8d7e-4d92b189a48f'} Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:10:25.499577 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:25.503367 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:25.503367 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:25.503367 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:25.503367 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:25.503367 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:10:25.503367 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:10:25.506731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:25.509458 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-04824eff-bf7d-4f8d-b954-9fb48993952e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 404 len: 111 microversion: 2.1 time: 0.067504 Aug 27 03:10:25.510317 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2744/5653] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:25 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:10:25.523363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-882f10f8-230d-41ea-aa6d-617abdcd992c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:25.524260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-882f10f8-230d-41ea-aa6d-617abdcd992c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:25.539751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-882f10f8-230d-41ea-aa6d-617abdcd992c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.541928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-882f10f8-230d-41ea-aa6d-617abdcd992c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.542516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-882f10f8-230d-41ea-aa6d-617abdcd992c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.543634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-882f10f8-230d-41ea-aa6d-617abdcd992c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.544256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-882f10f8-230d-41ea-aa6d-617abdcd992c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.544759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-882f10f8-230d-41ea-aa6d-617abdcd992c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.583591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-882f10f8-230d-41ea-aa6d-617abdcd992c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:10:25.768780 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-882f10f8-230d-41ea-aa6d-617abdcd992c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 204 len: 0 microversion: 2.1 time: 0.252168 Aug 27 03:10:25.775666 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2745/5654] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:25 2022] DELETE /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:25.783728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a2871b9-3967-49a8-a659-90ca3f15a088 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:25.785021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6a2871b9-3967-49a8-a659-90ca3f15a088 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:25.801542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2871b9-3967-49a8-a659-90ca3f15a088 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.804913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2871b9-3967-49a8-a659-90ca3f15a088 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.806716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2871b9-3967-49a8-a659-90ca3f15a088 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:25.809767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2871b9-3967-49a8-a659-90ca3f15a088 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:25.814519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2871b9-3967-49a8-a659-90ca3f15a088 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:25.816614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2871b9-3967-49a8-a659-90ca3f15a088 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.200392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a2871b9-3967-49a8-a659-90ca3f15a088 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:26.213582 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6a2871b9-3967-49a8-a659-90ca3f15a088 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1496 microversion: 2.1 time: 0.432739 Aug 27 03:10:26.213984 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2746/5655] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:25 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1496 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:26.238279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c8db8fef-3fb4-4fb1-b50a-9cc8ee1fe31c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:26.251646 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c8db8fef-3fb4-4fb1-b50a-9cc8ee1fe31c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1492 microversion: 2.1 time: 1.015242 Aug 27 03:10:26.266502 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2910/5656] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:25 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1492 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:26.274606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-78f20d20-2245-4616-8980-aa4c131267cd tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:26.275146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-78f20d20-2245-4616-8980-aa4c131267cd tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:26.285599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f20d20-2245-4616-8980-aa4c131267cd tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.286130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f20d20-2245-4616-8980-aa4c131267cd tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.286598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f20d20-2245-4616-8980-aa4c131267cd tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.292872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-53afc377-5baf-4949-b11b-7d1fb5951eff tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:26.293508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-53afc377-5baf-4949-b11b-7d1fb5951eff tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:26.298470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f20d20-2245-4616-8980-aa4c131267cd tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.299031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f20d20-2245-4616-8980-aa4c131267cd tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.299484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78f20d20-2245-4616-8980-aa4c131267cd tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.314827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53afc377-5baf-4949-b11b-7d1fb5951eff tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.333266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53afc377-5baf-4949-b11b-7d1fb5951eff tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.334939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53afc377-5baf-4949-b11b-7d1fb5951eff tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.336288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53afc377-5baf-4949-b11b-7d1fb5951eff tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.337175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53afc377-5baf-4949-b11b-7d1fb5951eff tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.337895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-53afc377-5baf-4949-b11b-7d1fb5951eff tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.405643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:26.430205 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-78f20d20-2245-4616-8980-aa4c131267cd tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "POST /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c/action" status: 202 len: 0 microversion: 2.1 time: 0.159330 Aug 27 03:10:26.430920 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2747/5657] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:26 2022] POST /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:26.455748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b3243575-0f5b-4541-b017-bcd5ba162f24 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:26.458953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b3243575-0f5b-4541-b017-bcd5ba162f24 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:26.480548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3243575-0f5b-4541-b017-bcd5ba162f24 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.481128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3243575-0f5b-4541-b017-bcd5ba162f24 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.481746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3243575-0f5b-4541-b017-bcd5ba162f24 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.482550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3243575-0f5b-4541-b017-bcd5ba162f24 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.483004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3243575-0f5b-4541-b017-bcd5ba162f24 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.483819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3243575-0f5b-4541-b017-bcd5ba162f24 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.604761 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b3243575-0f5b-4541-b017-bcd5ba162f24 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3/action" status: 200 len: 24574 microversion: 2.1 time: 0.172181 Aug 27 03:10:26.611808 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2748/5658] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:10:26 2022] POST /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3/action => generated 24574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:10:26.613332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-82e908dc-8783-44e0-9f8a-d79f94904026 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:26.617336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-82e908dc-8783-44e0-9f8a-d79f94904026 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:26.641928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e908dc-8783-44e0-9f8a-d79f94904026 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.642486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e908dc-8783-44e0-9f8a-d79f94904026 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.642939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e908dc-8783-44e0-9f8a-d79f94904026 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.644459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e908dc-8783-44e0-9f8a-d79f94904026 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:26.644935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e908dc-8783-44e0-9f8a-d79f94904026 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:26.645373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82e908dc-8783-44e0-9f8a-d79f94904026 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:26.875181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-53afc377-5baf-4949-b11b-7d1fb5951eff tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:26.930959 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-53afc377-5baf-4949-b11b-7d1fb5951eff tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1734 microversion: 2.1 time: 0.642232 Aug 27 03:10:26.941081 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2911/5659] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:26 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1734 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:27.099403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-82e908dc-8783-44e0-9f8a-d79f94904026 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:27.121916 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-82e908dc-8783-44e0-9f8a-d79f94904026 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1498 microversion: 2.1 time: 0.514205 Aug 27 03:10:27.122525 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2749/5660] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:26 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1498 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:27.253952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6cc350ff-c0ab-4de9-aff2-8c747214abe8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:27.255264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6cc350ff-c0ab-4de9-aff2-8c747214abe8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:27.294865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cc350ff-c0ab-4de9-aff2-8c747214abe8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.296378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cc350ff-c0ab-4de9-aff2-8c747214abe8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.298855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cc350ff-c0ab-4de9-aff2-8c747214abe8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.301119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cc350ff-c0ab-4de9-aff2-8c747214abe8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.303355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cc350ff-c0ab-4de9-aff2-8c747214abe8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.305099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cc350ff-c0ab-4de9-aff2-8c747214abe8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.966267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-468f6c1e-815f-40fd-a666-379d2bd8c9c7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:27.967865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-468f6c1e-815f-40fd-a666-379d2bd8c9c7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:27.975995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-468f6c1e-815f-40fd-a666-379d2bd8c9c7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.976743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-468f6c1e-815f-40fd-a666-379d2bd8c9c7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.977394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-468f6c1e-815f-40fd-a666-379d2bd8c9c7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:27.978359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-468f6c1e-815f-40fd-a666-379d2bd8c9c7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:27.978989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-468f6c1e-815f-40fd-a666-379d2bd8c9c7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:27.979569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-468f6c1e-815f-40fd-a666-379d2bd8c9c7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.022366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6cc350ff-c0ab-4de9-aff2-8c747214abe8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:28.038971 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6cc350ff-c0ab-4de9-aff2-8c747214abe8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1496 microversion: 2.1 time: 0.803685 Aug 27 03:10:28.041798 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2912/5661] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:27 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1496 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:28.137197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-468f6c1e-815f-40fd-a666-379d2bd8c9c7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:28.143186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a198eeff-a82c-4fb6-9f5a-2ba36ec65e90 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:28.144885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a198eeff-a82c-4fb6-9f5a-2ba36ec65e90 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:28.146562 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-468f6c1e-815f-40fd-a666-379d2bd8c9c7 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1666 microversion: 2.1 time: 0.184514 Aug 27 03:10:28.147179 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2750/5662] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:27 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1666 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:28.158063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a198eeff-a82c-4fb6-9f5a-2ba36ec65e90 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.158931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a198eeff-a82c-4fb6-9f5a-2ba36ec65e90 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.160915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a198eeff-a82c-4fb6-9f5a-2ba36ec65e90 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.161941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a198eeff-a82c-4fb6-9f5a-2ba36ec65e90 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.165213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a198eeff-a82c-4fb6-9f5a-2ba36ec65e90 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.165974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a198eeff-a82c-4fb6-9f5a-2ba36ec65e90 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.524272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-b901d2a7-af01-493b-8961-9b64b0943f19 req-94bb0ff1-8fe8-4ed0-a9f2-b91a72bc6d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb3ffe8d-8412-4d9a-b563-7444dcb64ac0", "name": "network-vif-deleted", "tag": "cf076202-9d30-4fb6-9be4-e65703281cf6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:28.546003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b901d2a7-af01-493b-8961-9b64b0943f19 req-94bb0ff1-8fe8-4ed0-a9f2-b91a72bc6d6d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.553565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b901d2a7-af01-493b-8961-9b64b0943f19 req-94bb0ff1-8fe8-4ed0-a9f2-b91a72bc6d6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.554394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b901d2a7-af01-493b-8961-9b64b0943f19 req-94bb0ff1-8fe8-4ed0-a9f2-b91a72bc6d6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.578183 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-b901d2a7-af01-493b-8961-9b64b0943f19 req-94bb0ff1-8fe8-4ed0-a9f2-b91a72bc6d6d service nova] Creating event network-vif-deleted:cf076202-9d30-4fb6-9be4-e65703281cf6 for instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 on n-h2-852084-5 Aug 27 03:10:28.597188 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-b901d2a7-af01-493b-8961-9b64b0943f19 req-94bb0ff1-8fe8-4ed0-a9f2-b91a72bc6d6d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076045 Aug 27 03:10:28.598168 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2751/5663] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:10:28.616676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6746a5a1-018e-4de9-8388-3b1d038cb680 req-1cd012c8-b8b3-4206-bb0d-5faf33cf5150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27ffeac7-84af-4b89-ac5f-43bfe9ef1d62", "name": "network-vif-deleted", "tag": "8b3d9961-a378-4a09-be66-e2703f30ed09"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:28.628087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6746a5a1-018e-4de9-8388-3b1d038cb680 req-1cd012c8-b8b3-4206-bb0d-5faf33cf5150 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:28.628847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6746a5a1-018e-4de9-8388-3b1d038cb680 req-1cd012c8-b8b3-4206-bb0d-5faf33cf5150 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:28.629458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6746a5a1-018e-4de9-8388-3b1d038cb680 req-1cd012c8-b8b3-4206-bb0d-5faf33cf5150 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:28.652075 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6746a5a1-018e-4de9-8388-3b1d038cb680 req-1cd012c8-b8b3-4206-bb0d-5faf33cf5150 service nova] Creating event network-vif-deleted:8b3d9961-a378-4a09-be66-e2703f30ed09 for instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 on n-h2-852084-5 Aug 27 03:10:28.658939 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6746a5a1-018e-4de9-8388-3b1d038cb680 req-1cd012c8-b8b3-4206-bb0d-5faf33cf5150 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047316 Aug 27 03:10:28.660807 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2752/5664] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:28.985615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a198eeff-a82c-4fb6-9f5a-2ba36ec65e90 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:29.000474 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a198eeff-a82c-4fb6-9f5a-2ba36ec65e90 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1498 microversion: 2.1 time: 0.861453 Aug 27 03:10:29.004870 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2913/5665] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:28 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1498 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:29.061094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:29.061827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:29.080256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.082502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.082989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.089021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.089875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.090365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.159620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.160362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.160959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.161418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lazy-loading 'fault' on Instance uuid 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:29.168766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:29.169765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:29.179898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.184372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.189221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.193702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.194318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.194899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.225031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:29.237413 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9aee6df5-44ce-4e6c-ab48-29140e7d30c3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 200 len: 1299 microversion: 2.1 time: 0.180918 Aug 27 03:10:29.239505 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2753/5666] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:29 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 1299 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:29.311748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:29.322066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:29.323318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:29.327708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lazy-loading 'fault' on Instance uuid eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:29.436870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b25a85fff4c9b8c18845fb7acf620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1058306b2ba647478569f414afc09a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:29.466952 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2dc11f9-6d94-48dd-90b0-04ec8dd94a4d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 200 len: 1388 microversion: 2.1 time: 0.298788 Aug 27 03:10:29.470320 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2914/5667] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:29 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 1388 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:30.031535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-61d45296-84e9-4842-8027-f7abe6fbc1ea tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:30.033083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-61d45296-84e9-4842-8027-f7abe6fbc1ea tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:30.049496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d45296-84e9-4842-8027-f7abe6fbc1ea tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.050723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d45296-84e9-4842-8027-f7abe6fbc1ea tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.051190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d45296-84e9-4842-8027-f7abe6fbc1ea tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.051896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d45296-84e9-4842-8027-f7abe6fbc1ea tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.055155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d45296-84e9-4842-8027-f7abe6fbc1ea tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.056532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61d45296-84e9-4842-8027-f7abe6fbc1ea tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.264107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:30.264729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:30.275128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.275966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.277354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.283523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.284382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.284987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.306152 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 HTTP/1.1 Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '27ffeac7-84af-4b89-ac5f-43bfe9ef1d62'} Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:30.308095 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:30.313008 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:30.313008 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:30.313008 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:30.313008 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:30.313008 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:10:30.313008 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:30.316811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:30.318712 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ffbb5f99-30ec-4c02-88a2-17078fcbcdbe tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 404 len: 111 microversion: 2.1 time: 0.059262 Aug 27 03:10:30.319487 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2915/5668] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:30 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:10:30.491394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:30.493018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:30.496436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:30.505830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.506442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.507058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.507947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.508554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.509710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.517318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-61d45296-84e9-4842-8027-f7abe6fbc1ea tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:30.529534 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-61d45296-84e9-4842-8027-f7abe6fbc1ea tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1501 microversion: 2.1 time: 0.503392 Aug 27 03:10:30.530159 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2754/5669] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:30 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1501 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:30.542324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-361232689", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a7f149e5-3bf9-4728-ad5f-b673712c2f5f"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:30.551400 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] HTTP exception thrown: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Request method failure captured: Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 HTTP/1.1 Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYnVh2oGHEvW6Phet1xbNbOKnhmT8YaWXt8bf07o-T0RVH3CMTj6rnHlzajrBzb_Djtx4XzQ6I0iQYC6hJK_79cNdcU8Be-8KzoVhJwow71-py7jBxV1IZPIiY0hqdVsyG2czi1bVog8obTLkdYr8sYDG792kXzVdYiSqWz1GnmFBeU Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 1058306b2ba647478569f414afc09a07 Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestServerBasicOps-379337893 Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1058306b2ba647478569f414afc09a07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1058306b2ba647478569f414afc09a07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1058306b2ba647478569f414afc09a07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1058306b2ba647478569f414afc09a07"}]}] Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestServerBasicOps-379337893 Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 1058306b2ba647478569f414afc09a07 Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestServerBasicOps-379337893 Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestServerBasicOps-379337893-project Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0f5b25a85fff4c9b8c18845fb7acf620 Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestServerBasicOps-379337893-project Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'eb3ffe8d-8412-4d9a-b563-7444dcb64ac0'} Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:30.553302 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:30.556991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:30.556991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:30.556991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:30.556991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:30.556991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:30.556991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:30.556991 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:30.558977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Returning 404 to user: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:30.560031 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2fa81370-9280-4397-93e9-3af777697a0e tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 404 len: 111 microversion: 2.1 time: 0.073400 Aug 27 03:10:30.561429 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2916/5670] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:30 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:10:30.567391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ab56633-e1b3-4ece-b0a0-3ae6e338b118 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:30.568216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ab56633-e1b3-4ece-b0a0-3ae6e338b118 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:30.580331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ab56633-e1b3-4ece-b0a0-3ae6e338b118 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.581470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ab56633-e1b3-4ece-b0a0-3ae6e338b118 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.582992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ab56633-e1b3-4ece-b0a0-3ae6e338b118 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.584654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ab56633-e1b3-4ece-b0a0-3ae6e338b118 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.585389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ab56633-e1b3-4ece-b0a0-3ae6e338b118 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.586314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ab56633-e1b3-4ece-b0a0-3ae6e338b118 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.660777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ab56633-e1b3-4ece-b0a0-3ae6e338b118 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:10:30.683296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] validate_networks() for [('a7f149e5-3bf9-4728-ad5f-b673712c2f5f', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:10:30.859492 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ab56633-e1b3-4ece-b0a0-3ae6e338b118 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 204 len: 0 microversion: 2.1 time: 0.296210 Aug 27 03:10:30.863715 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2917/5671] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:30 2022] DELETE /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:30.876363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ecfe589f-9658-4a0c-a857-044564753aa4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:30.877461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ecfe589f-9658-4a0c-a857-044564753aa4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:30.897620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecfe589f-9658-4a0c-a857-044564753aa4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.901727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecfe589f-9658-4a0c-a857-044564753aa4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.902460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecfe589f-9658-4a0c-a857-044564753aa4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:30.903828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecfe589f-9658-4a0c-a857-044564753aa4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:30.905061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecfe589f-9658-4a0c-a857-044564753aa4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:30.911718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ecfe589f-9658-4a0c-a857-044564753aa4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.420576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ecfe589f-9658-4a0c-a857-044564753aa4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:31.428568 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ecfe589f-9658-4a0c-a857-044564753aa4 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1507 microversion: 2.1 time: 0.559317 Aug 27 03:10:31.429285 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2918/5672] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:30 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1507 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:31.786081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:31.786847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:31.795810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.796671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.797335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.798336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.799026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.799717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.817157 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] HTTP exception thrown: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Request method failure captured: Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 HTTP/1.1 Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYnVh2oGHEvW6Phet1xbNbOKnhmT8YaWXt8bf07o-T0RVH3CMTj6rnHlzajrBzb_Djtx4XzQ6I0iQYC6hJK_79cNdcU8Be-8KzoVhJwow71-py7jBxV1IZPIiY0hqdVsyG2czi1bVog8obTLkdYr8sYDG792kXzVdYiSqWz1GnmFBeU Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 1058306b2ba647478569f414afc09a07 Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestServerBasicOps-379337893 Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1058306b2ba647478569f414afc09a07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1058306b2ba647478569f414afc09a07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1058306b2ba647478569f414afc09a07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1058306b2ba647478569f414afc09a07"}]}] Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestServerBasicOps-379337893 Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 1058306b2ba647478569f414afc09a07 Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestServerBasicOps-379337893 Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestServerBasicOps-379337893-project Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0f5b25a85fff4c9b8c18845fb7acf620 Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestServerBasicOps-379337893-project Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'eb3ffe8d-8412-4d9a-b563-7444dcb64ac0'} Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:31.819025 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Returning 404 to user: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:31.822969 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c872f46-d1de-4b93-95e5-3de32a5fffd4 tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "DELETE /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 404 len: 111 microversion: 2.1 time: 0.040047 Aug 27 03:10:31.825146 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2919/5673] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:31 2022] DELETE /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:31.830571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:31.831975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] [instance: eb3ffe8d-8412-4d9a-b563-7444dcb64ac0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:31.839278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.840074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.840722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.841656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:31.842704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:31.843335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:31.861567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] HTTP exception thrown: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Request method failure captured: Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 HTTP/1.1 Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYnVh2oGHEvW6Phet1xbNbOKnhmT8YaWXt8bf07o-T0RVH3CMTj6rnHlzajrBzb_Djtx4XzQ6I0iQYC6hJK_79cNdcU8Be-8KzoVhJwow71-py7jBxV1IZPIiY0hqdVsyG2czi1bVog8obTLkdYr8sYDG792kXzVdYiSqWz1GnmFBeU Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 1058306b2ba647478569f414afc09a07 Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestServerBasicOps-379337893 Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1058306b2ba647478569f414afc09a07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1058306b2ba647478569f414afc09a07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1058306b2ba647478569f414afc09a07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1058306b2ba647478569f414afc09a07"}]}] Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestServerBasicOps-379337893 Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 1058306b2ba647478569f414afc09a07 Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestServerBasicOps-379337893 Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestServerBasicOps-379337893-project Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0f5b25a85fff4c9b8c18845fb7acf620 Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestServerBasicOps-379337893-project Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'eb3ffe8d-8412-4d9a-b563-7444dcb64ac0'} Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:31.863597 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.867835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:31.867835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:31.867835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:31.867835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:31.867835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:31.867835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. Aug 27 03:10:31.867835 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:31.869200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Returning 404 to user: Instance eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:31.870388 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-221a6de2-e4d8-4bb8-8bc0-8a07ed93f26c tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0" status: 404 len: 111 microversion: 2.1 time: 0.043840 Aug 27 03:10:31.871151 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2920/5674] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:31 2022] GET /compute/v2.1/servers/eb3ffe8d-8412-4d9a-b563-7444dcb64ac0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:32.165845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7d9c8fed-e2e2-470e-9e46-77e4b64c006d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] Calling method '.version_select at 0x7f4d28e23ca0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.207160 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7d9c8fed-e2e2-470e-9e46-77e4b64c006d tempest-TestServerBasicOps-379337893 tempest-TestServerBasicOps-379337893-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1753459456" status: 202 len: 0 microversion: 2.1 time: 0.054851 Aug 27 03:10:32.207768 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2921/5675] 10.222.0.99 () {58 vars in 1254 bytes} [Sat Aug 27 03:10:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1753459456 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:10:32.287489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:10:32.288593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:10:32.289231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:10:32.289835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:10:32.290410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:10:32.305446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.305964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.312670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.313594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.314146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.314791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.362042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:10:32.369397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for user 756fff89d19d41869dad9425eddd55c1 and project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:10:32.389274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:10:32.391755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:10:32.459423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f523168c-d909-4715-b83a-2e191ebd400c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.465195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f523168c-d909-4715-b83a-2e191ebd400c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:32.478189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f523168c-d909-4715-b83a-2e191ebd400c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.478789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f523168c-d909-4715-b83a-2e191ebd400c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.480854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f523168c-d909-4715-b83a-2e191ebd400c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.483323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f523168c-d909-4715-b83a-2e191ebd400c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.485493 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-91af3dc6-5d12-40a1-9701-ff4410f90c53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.951074 Aug 27 03:10:32.486704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f523168c-d909-4715-b83a-2e191ebd400c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.487638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f523168c-d909-4715-b83a-2e191ebd400c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.488579 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2755/5676] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:10:32.499997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dfc8c8af-36cc-4a43-9aeb-4bad7a404c62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.502203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dfc8c8af-36cc-4a43-9aeb-4bad7a404c62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:32.734156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dfc8c8af-36cc-4a43-9aeb-4bad7a404c62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:32.747945 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dfc8c8af-36cc-4a43-9aeb-4bad7a404c62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1208 microversion: 2.1 time: 0.252084 Aug 27 03:10:32.748839 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2756/5677] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:32 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1208 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:32.901284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f45f7fd-d726-49c2-a98f-cb59740594a4 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:32.902498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5f45f7fd-d726-49c2-a98f-cb59740594a4 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:32.923336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f45f7fd-d726-49c2-a98f-cb59740594a4 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.924190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f45f7fd-d726-49c2-a98f-cb59740594a4 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.926993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f45f7fd-d726-49c2-a98f-cb59740594a4 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.928131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f45f7fd-d726-49c2-a98f-cb59740594a4 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:32.930126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f45f7fd-d726-49c2-a98f-cb59740594a4 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:32.932878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f45f7fd-d726-49c2-a98f-cb59740594a4 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:32.954877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f523168c-d909-4715-b83a-2e191ebd400c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:32.964025 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f523168c-d909-4715-b83a-2e191ebd400c tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1507 microversion: 2.1 time: 0.513206 Aug 27 03:10:32.984019 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2922/5678] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:32 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1507 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:33.574131 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5f45f7fd-d726-49c2-a98f-cb59740594a4 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1832 microversion: 2.1 time: 0.677132 Aug 27 03:10:33.575654 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2757/5679] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:32 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1832 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:33.772850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ddaa7c8b-1797-4b66-87d9-619c1cc3c89c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:33.773467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ddaa7c8b-1797-4b66-87d9-619c1cc3c89c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:33.787323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddaa7c8b-1797-4b66-87d9-619c1cc3c89c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:33.788394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddaa7c8b-1797-4b66-87d9-619c1cc3c89c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:33.789262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddaa7c8b-1797-4b66-87d9-619c1cc3c89c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:33.798733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddaa7c8b-1797-4b66-87d9-619c1cc3c89c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:33.800474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddaa7c8b-1797-4b66-87d9-619c1cc3c89c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:33.803703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddaa7c8b-1797-4b66-87d9-619c1cc3c89c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:33.990839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-355989c9-e6e3-4fbf-8bda-00a6b28dcfb6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:33.991566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-355989c9-e6e3-4fbf-8bda-00a6b28dcfb6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:34.005618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355989c9-e6e3-4fbf-8bda-00a6b28dcfb6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:34.019404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355989c9-e6e3-4fbf-8bda-00a6b28dcfb6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:34.020159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355989c9-e6e3-4fbf-8bda-00a6b28dcfb6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:34.022390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355989c9-e6e3-4fbf-8bda-00a6b28dcfb6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:34.023942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355989c9-e6e3-4fbf-8bda-00a6b28dcfb6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:34.024459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-355989c9-e6e3-4fbf-8bda-00a6b28dcfb6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:34.027884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ddaa7c8b-1797-4b66-87d9-619c1cc3c89c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:34.047898 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ddaa7c8b-1797-4b66-87d9-619c1cc3c89c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1260 microversion: 2.1 time: 0.281513 Aug 27 03:10:34.054451 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2923/5680] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:33 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1260 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:34.550724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-355989c9-e6e3-4fbf-8bda-00a6b28dcfb6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:34.598439 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-355989c9-e6e3-4fbf-8bda-00a6b28dcfb6 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1507 microversion: 2.1 time: 0.613033 Aug 27 03:10:34.599126 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2758/5681] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:33 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1507 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:35.023001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-cba3651d-86aa-4b5f-a5ac-ff788c9523f2 req-5ab20e40-d43c-47fd-97a7-cd8afdb9ca40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a76cdc9d-ee9c-4ba5-a760-729910cb047c", "name": "network-vif-deleted", "tag": "45677625-a380-499a-a2de-15095bfc567a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:35.079071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-49600021-505a-49c7-baf4-819c30ab5762 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:35.080046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-49600021-505a-49c7-baf4-819c30ab5762 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:35.088886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cba3651d-86aa-4b5f-a5ac-ff788c9523f2 req-5ab20e40-d43c-47fd-97a7-cd8afdb9ca40 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.090631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cba3651d-86aa-4b5f-a5ac-ff788c9523f2 req-5ab20e40-d43c-47fd-97a7-cd8afdb9ca40 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.093916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cba3651d-86aa-4b5f-a5ac-ff788c9523f2 req-5ab20e40-d43c-47fd-97a7-cd8afdb9ca40 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.098486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49600021-505a-49c7-baf4-819c30ab5762 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.098881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49600021-505a-49c7-baf4-819c30ab5762 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.107790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49600021-505a-49c7-baf4-819c30ab5762 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.109023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49600021-505a-49c7-baf4-819c30ab5762 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.110078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49600021-505a-49c7-baf4-819c30ab5762 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.110671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49600021-505a-49c7-baf4-819c30ab5762 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.125331 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-cba3651d-86aa-4b5f-a5ac-ff788c9523f2 req-5ab20e40-d43c-47fd-97a7-cd8afdb9ca40 service nova] Creating event network-vif-deleted:45677625-a380-499a-a2de-15095bfc567a for instance a76cdc9d-ee9c-4ba5-a760-729910cb047c on n-h1-852084-5 Aug 27 03:10:35.140780 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-cba3651d-86aa-4b5f-a5ac-ff788c9523f2 req-5ab20e40-d43c-47fd-97a7-cd8afdb9ca40 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128200 Aug 27 03:10:35.142683 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2924/5682] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:35.251077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-49600021-505a-49c7-baf4-819c30ab5762 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:35.263242 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-49600021-505a-49c7-baf4-819c30ab5762 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1266 microversion: 2.1 time: 0.189435 Aug 27 03:10:35.283742 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2759/5683] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:35 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:10:35.632131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:35.633437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:35.649866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.654569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.656723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.659045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.661621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.663666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.790642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:35.794010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:35.794558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:35.795042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lazy-loading 'fault' on Instance uuid a76cdc9d-ee9c-4ba5-a760-729910cb047c {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:36.163336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a5af818cf584c5f967eb549306ada91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6059b8939b27490ca5aaa95664f14d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:36.173436 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1f783ae3-0601-4ea1-96e5-90684d1cd337 tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 200 len: 1304 microversion: 2.1 time: 0.546411 Aug 27 03:10:36.177212 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2925/5684] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:35 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 1304 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:36.292982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e0b024c8-aa4b-4549-b237-ab1358eed27a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:36.294696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e0b024c8-aa4b-4549-b237-ab1358eed27a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:36.315028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0b024c8-aa4b-4549-b237-ab1358eed27a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:36.317407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0b024c8-aa4b-4549-b237-ab1358eed27a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:36.318305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0b024c8-aa4b-4549-b237-ab1358eed27a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:36.319289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0b024c8-aa4b-4549-b237-ab1358eed27a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:36.320479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0b024c8-aa4b-4549-b237-ab1358eed27a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:36.321517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0b024c8-aa4b-4549-b237-ab1358eed27a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:36.874277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e0b024c8-aa4b-4549-b237-ab1358eed27a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:36.886181 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e0b024c8-aa4b-4549-b237-ab1358eed27a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1308 microversion: 2.1 time: 0.598670 Aug 27 03:10:36.886801 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2760/5685] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:36 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1308 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:37.202236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:37.210303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] [instance: a76cdc9d-ee9c-4ba5-a760-729910cb047c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:37.228507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:37.230241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:37.230955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:37.231948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:37.232591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:37.233190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:37.258914 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] HTTP exception thrown: Instance a76cdc9d-ee9c-4ba5-a760-729910cb047c could not be found. Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Request method failure captured: Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c HTTP/1.1 Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYr_nveTFtPh-1XGepPEv6-LE1-Zi2OJZcC2ypUqqo37G2dnb5El0VI9Owj-nGIvD3-5wDOkwFQpWILLFdFwqCK4gcX0jn9rlg6S8KSR4hWh49mx0USeK9i7LusKD0jWTI_YtcjZI21Y7HM3xlOmC6Ca3BNi1oWCHlsEm89d85PZ0v4 Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 6059b8939b27490ca5aaa95664f14d4b Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestServerAdvancedOps-1805676403 Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_6059b8939b27490ca5aaa95664f14d4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/6059b8939b27490ca5aaa95664f14d4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/6059b8939b27490ca5aaa95664f14d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/6059b8939b27490ca5aaa95664f14d4b"}]}] Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestServerAdvancedOps-1805676403 Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 6059b8939b27490ca5aaa95664f14d4b Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestServerAdvancedOps-1805676403 Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestServerAdvancedOps-1805676403-project Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 6a5af818cf584c5f967eb549306ada91 Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestServerAdvancedOps-1805676403-project Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance a76cdc9d-ee9c-4ba5-a760-729910cb047c could not be found. Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'a76cdc9d-ee9c-4ba5-a760-729910cb047c'} Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a76cdc9d-ee9c-4ba5-a760-729910cb047c could not be found. Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a76cdc9d-ee9c-4ba5-a760-729910cb047c could not be found. Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:37.261318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:37.265819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:37.265819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:37.265819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:37.265819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:37.265819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:37.265819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a76cdc9d-ee9c-4ba5-a760-729910cb047c could not be found. Aug 27 03:10:37.265819 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:37.267554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] Returning 404 to user: Instance a76cdc9d-ee9c-4ba5-a760-729910cb047c could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:37.268805 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9a7821a2-e251-4793-9c1b-341dd0545adb tempest-TestServerAdvancedOps-1805676403 tempest-TestServerAdvancedOps-1805676403-project] 10.222.0.99 "GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c" status: 404 len: 111 microversion: 2.1 time: 0.072251 Aug 27 03:10:37.270000 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2926/5686] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:37 2022] GET /compute/v2.1/servers/a76cdc9d-ee9c-4ba5-a760-729910cb047c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:37.911208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-397ad72f-29b1-4d32-8968-376f408fe1ea tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:37.911935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-397ad72f-29b1-4d32-8968-376f408fe1ea tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:37.940654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-397ad72f-29b1-4d32-8968-376f408fe1ea tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:37.943654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-397ad72f-29b1-4d32-8968-376f408fe1ea tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:37.946427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-397ad72f-29b1-4d32-8968-376f408fe1ea tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:37.947835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-397ad72f-29b1-4d32-8968-376f408fe1ea tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:37.949092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-397ad72f-29b1-4d32-8968-376f408fe1ea tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:37.955248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-397ad72f-29b1-4d32-8968-376f408fe1ea tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.108423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-71098f09-362a-44ec-9acf-5270bbe3aef2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:38.109114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-71098f09-362a-44ec-9acf-5270bbe3aef2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:38.122830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71098f09-362a-44ec-9acf-5270bbe3aef2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.127346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71098f09-362a-44ec-9acf-5270bbe3aef2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.130318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71098f09-362a-44ec-9acf-5270bbe3aef2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.131376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71098f09-362a-44ec-9acf-5270bbe3aef2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.133217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71098f09-362a-44ec-9acf-5270bbe3aef2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.133895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71098f09-362a-44ec-9acf-5270bbe3aef2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.185833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-71098f09-362a-44ec-9acf-5270bbe3aef2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:10:38.281949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:38.354349 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-71098f09-362a-44ec-9acf-5270bbe3aef2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "DELETE /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 204 len: 0 microversion: 2.1 time: 0.244231 Aug 27 03:10:38.359260 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2927/5687] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:38 2022] DELETE /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:10:38.383170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-bcdfc433-875e-489d-94fd-b9a79613cb1c req-7019b0c1-44bd-4acd-853b-db5ec8337f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32747fe6-7436-4fc4-bc35-ae0f8495d2e3", "tag": "7982bae4-d6b1-46bd-8563-3151707a0e2a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:38.416764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bcdfc433-875e-489d-94fd-b9a79613cb1c req-7019b0c1-44bd-4acd-853b-db5ec8337f61 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.417276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bcdfc433-875e-489d-94fd-b9a79613cb1c req-7019b0c1-44bd-4acd-853b-db5ec8337f61 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.420620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bcdfc433-875e-489d-94fd-b9a79613cb1c req-7019b0c1-44bd-4acd-853b-db5ec8337f61 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.453658 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-bcdfc433-875e-489d-94fd-b9a79613cb1c req-7019b0c1-44bd-4acd-853b-db5ec8337f61 service nova] Creating event network-changed:7982bae4-d6b1-46bd-8563-3151707a0e2a for instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 on n-h1-852084-5 Aug 27 03:10:38.465352 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-bcdfc433-875e-489d-94fd-b9a79613cb1c req-7019b0c1-44bd-4acd-853b-db5ec8337f61 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098049 Aug 27 03:10:38.467058 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2928/5688] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:38.477610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-72af30e9-7ea8-40c9-96da-39e9ed471550 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:38.483559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-72af30e9-7ea8-40c9-96da-39e9ed471550 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:38.497134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72af30e9-7ea8-40c9-96da-39e9ed471550 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.497639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72af30e9-7ea8-40c9-96da-39e9ed471550 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.498109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72af30e9-7ea8-40c9-96da-39e9ed471550 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.502652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72af30e9-7ea8-40c9-96da-39e9ed471550 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:38.504429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72af30e9-7ea8-40c9-96da-39e9ed471550 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:38.504895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72af30e9-7ea8-40c9-96da-39e9ed471550 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:38.960233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-72af30e9-7ea8-40c9-96da-39e9ed471550 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:38.975783 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-72af30e9-7ea8-40c9-96da-39e9ed471550 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1687 microversion: 2.1 time: 0.507457 Aug 27 03:10:38.976376 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2929/5689] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:38 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1687 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:39.414544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-397ad72f-29b1-4d32-8968-376f408fe1ea tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:39.425015 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-397ad72f-29b1-4d32-8968-376f408fe1ea tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1308 microversion: 2.1 time: 1.520583 Aug 27 03:10:39.431227 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2761/5690] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:37 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1308 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:40.003156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1f77035d-e3e0-4f49-969f-9215a5169c82 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:40.008660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1f77035d-e3e0-4f49-969f-9215a5169c82 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:40.042347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f77035d-e3e0-4f49-969f-9215a5169c82 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.043129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f77035d-e3e0-4f49-969f-9215a5169c82 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.043833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f77035d-e3e0-4f49-969f-9215a5169c82 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.044955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f77035d-e3e0-4f49-969f-9215a5169c82 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.061206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f77035d-e3e0-4f49-969f-9215a5169c82 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.062130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f77035d-e3e0-4f49-969f-9215a5169c82 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.394960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-99171e2a-c3a2-47b6-8cf7-9cd94e2dec50 req-262755e9-5277-4fc4-9b66-593b8e7966e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "938495d8-b417-4178-b9dc-746025756c12", "tag": "8a533512-eed7-4e62-b717-ec5a7070fcd7"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:40.426770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99171e2a-c3a2-47b6-8cf7-9cd94e2dec50 req-262755e9-5277-4fc4-9b66-593b8e7966e9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.427454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99171e2a-c3a2-47b6-8cf7-9cd94e2dec50 req-262755e9-5277-4fc4-9b66-593b8e7966e9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.427454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99171e2a-c3a2-47b6-8cf7-9cd94e2dec50 req-262755e9-5277-4fc4-9b66-593b8e7966e9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.484821 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-99171e2a-c3a2-47b6-8cf7-9cd94e2dec50 req-262755e9-5277-4fc4-9b66-593b8e7966e9 service nova] Creating event network-changed:8a533512-eed7-4e62-b717-ec5a7070fcd7 for instance 938495d8-b417-4178-b9dc-746025756c12 on n-h1-852084-5 Aug 27 03:10:40.496053 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-99171e2a-c3a2-47b6-8cf7-9cd94e2dec50 req-262755e9-5277-4fc4-9b66-593b8e7966e9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117154 Aug 27 03:10:40.497932 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2762/5691] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:40.508124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1aa325eb-eeb0-46a1-ab27-7a5572530f14 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:40.511238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1aa325eb-eeb0-46a1-ab27-7a5572530f14 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:40.538282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1aa325eb-eeb0-46a1-ab27-7a5572530f14 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.542682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1aa325eb-eeb0-46a1-ab27-7a5572530f14 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.544344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1aa325eb-eeb0-46a1-ab27-7a5572530f14 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.545555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1aa325eb-eeb0-46a1-ab27-7a5572530f14 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:40.546374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1aa325eb-eeb0-46a1-ab27-7a5572530f14 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:40.548261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1aa325eb-eeb0-46a1-ab27-7a5572530f14 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:40.787985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f77035d-e3e0-4f49-969f-9215a5169c82 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:40.842493 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1f77035d-e3e0-4f49-969f-9215a5169c82 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1687 microversion: 2.1 time: 0.838999 Aug 27 03:10:40.850637 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2930/5692] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:39 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1687 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:41.551764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1aa325eb-eeb0-46a1-ab27-7a5572530f14 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:41.567237 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1aa325eb-eeb0-46a1-ab27-7a5572530f14 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1308 microversion: 2.1 time: 1.067739 Aug 27 03:10:41.569983 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2763/5693] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:40 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1308 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:41.884950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4ddfdf45-ace3-4b23-9a51-6fdd17365204 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:41.889696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4ddfdf45-ace3-4b23-9a51-6fdd17365204 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:41.910938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ddfdf45-ace3-4b23-9a51-6fdd17365204 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:41.924442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ddfdf45-ace3-4b23-9a51-6fdd17365204 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:41.938001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ddfdf45-ace3-4b23-9a51-6fdd17365204 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:41.944855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ddfdf45-ace3-4b23-9a51-6fdd17365204 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:41.948922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ddfdf45-ace3-4b23-9a51-6fdd17365204 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:41.949487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ddfdf45-ace3-4b23-9a51-6fdd17365204 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.277839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4ddfdf45-ace3-4b23-9a51-6fdd17365204 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:42.291801 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4ddfdf45-ace3-4b23-9a51-6fdd17365204 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1687 microversion: 2.1 time: 0.423474 Aug 27 03:10:42.316180 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2931/5694] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:41 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1687 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:42.595824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-50d2e433-4ead-4da0-8929-a4ee32aa6c2e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:42.597182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-50d2e433-4ead-4da0-8929-a4ee32aa6c2e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:42.604155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:42.613008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:42.625971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50d2e433-4ead-4da0-8929-a4ee32aa6c2e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.626479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50d2e433-4ead-4da0-8929-a4ee32aa6c2e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.632568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50d2e433-4ead-4da0-8929-a4ee32aa6c2e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.633607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50d2e433-4ead-4da0-8929-a4ee32aa6c2e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.634120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50d2e433-4ead-4da0-8929-a4ee32aa6c2e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.634582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50d2e433-4ead-4da0-8929-a4ee32aa6c2e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.761614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:42.802290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-933c4001-5e9e-4bf8-9cc9-414558f6cced req-8c7b0179-27ee-4806-aed0-f3711fd2f9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32747fe6-7436-4fc4-bc35-ae0f8495d2e3", "name": "network-vif-deleted", "tag": "7982bae4-d6b1-46bd-8563-3151707a0e2a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:42.835931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-933c4001-5e9e-4bf8-9cc9-414558f6cced req-8c7b0179-27ee-4806-aed0-f3711fd2f9a2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:42.836881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-933c4001-5e9e-4bf8-9cc9-414558f6cced req-8c7b0179-27ee-4806-aed0-f3711fd2f9a2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:42.837616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-933c4001-5e9e-4bf8-9cc9-414558f6cced req-8c7b0179-27ee-4806-aed0-f3711fd2f9a2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:42.857089 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-933c4001-5e9e-4bf8-9cc9-414558f6cced req-8c7b0179-27ee-4806-aed0-f3711fd2f9a2 service nova] Creating event network-vif-deleted:7982bae4-d6b1-46bd-8563-3151707a0e2a for instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 on n-h1-852084-5 Aug 27 03:10:42.866442 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-933c4001-5e9e-4bf8-9cc9-414558f6cced req-8c7b0179-27ee-4806-aed0-f3711fd2f9a2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069746 Aug 27 03:10:42.867746 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2932/5695] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:10:43.198802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-50d2e433-4ead-4da0-8929-a4ee32aa6c2e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:43.215906 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-50d2e433-4ead-4da0-8929-a4ee32aa6c2e tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1308 microversion: 2.1 time: 0.625738 Aug 27 03:10:43.218581 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2764/5696] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:42 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1308 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:43.334824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fffb8e56-591a-4c8c-b1e7-c079fdcfed04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:43.338543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fffb8e56-591a-4c8c-b1e7-c079fdcfed04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:43.366908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fffb8e56-591a-4c8c-b1e7-c079fdcfed04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.371540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fffb8e56-591a-4c8c-b1e7-c079fdcfed04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.377124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fffb8e56-591a-4c8c-b1e7-c079fdcfed04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.378358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fffb8e56-591a-4c8c-b1e7-c079fdcfed04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:43.381715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fffb8e56-591a-4c8c-b1e7-c079fdcfed04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:43.387338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fffb8e56-591a-4c8c-b1e7-c079fdcfed04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:43.592809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fffb8e56-591a-4c8c-b1e7-c079fdcfed04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:43.613717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fffb8e56-591a-4c8c-b1e7-c079fdcfed04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1501 microversion: 2.1 time: 0.295707 Aug 27 03:10:43.637619 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2933/5697] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:43 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1501 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:44.242804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b0970671-2bbb-48c1-9d73-22371ebdd642 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:44.243435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b0970671-2bbb-48c1-9d73-22371ebdd642 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:44.253694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0970671-2bbb-48c1-9d73-22371ebdd642 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.254197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0970671-2bbb-48c1-9d73-22371ebdd642 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.254814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0970671-2bbb-48c1-9d73-22371ebdd642 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.255772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0970671-2bbb-48c1-9d73-22371ebdd642 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.256232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0970671-2bbb-48c1-9d73-22371ebdd642 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.256849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0970671-2bbb-48c1-9d73-22371ebdd642 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.641573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:44.642310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:44.660503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.661071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.663343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.664107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.664580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.665263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.713740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:44.714627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:44.715352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:44.716039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lazy-loading 'fault' on Instance uuid 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:44.778452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:44.788982 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bca4e225-71b7-4b97-8154-ff77b9c31ffc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 200 len: 1355 microversion: 2.1 time: 0.153580 Aug 27 03:10:44.812448 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2934/5698] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:44 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 1355 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:45.290142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b0970671-2bbb-48c1-9d73-22371ebdd642 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:45.320350 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b0970671-2bbb-48c1-9d73-22371ebdd642 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1308 microversion: 2.1 time: 1.083484 Aug 27 03:10:45.334129 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2765/5699] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:44 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1308 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:45.823801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:45.824558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 32747fe6-7436-4fc4-bc35-ae0f8495d2e3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:45.847697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:45.848212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:45.848673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:45.849436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:45.849960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:45.850400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:45.902237 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] HTTP exception thrown: Instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 could not be found. Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Request method failure captured: Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 HTTP/1.1 Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqQfBm6GS9xqnQK0kCaegkxtUGxBmgmlqSE3zjvPxF6xt1EIGwA_wROeCKLm5jKuicPFEf8dtAhztXrirum6yNgvTCeNAjM228kmH2Nzqe36R_uGkBJ85LsP_Ff542Y0N4IgZbqEya_XvrJ_7ujqHupudK2EUD953gaJkgcviDbsqs Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 08baa7977bed4278b5cacdb7f34ebf2f Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/08baa7977bed4278b5cacdb7f34ebf2f"}]}] Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 08baa7977bed4278b5cacdb7f34ebf2f Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestNetworkAdvancedServerOps-133114655-project Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 86930a2f684449a5a228ea43a7ab5e23 Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestNetworkAdvancedServerOps-133114655-project Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 could not be found. Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '32747fe6-7436-4fc4-bc35-ae0f8495d2e3'} Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 could not be found. Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 could not be found. Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:45.906784 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:45.910324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:45.910324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:45.910324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:45.910324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:45.910324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:45.910324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:45.910324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 could not be found. Aug 27 03:10:45.910324 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:10:45.910324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Returning 404 to user: Instance 32747fe6-7436-4fc4-bc35-ae0f8495d2e3 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:45.910324 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-744d66f1-24c3-4bd8-8445-479a9631c22f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3" status: 404 len: 111 microversion: 2.1 time: 0.089518 Aug 27 03:10:45.910324 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2935/5700] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:45 2022] GET /compute/v2.1/servers/32747fe6-7436-4fc4-bc35-ae0f8495d2e3 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:46.347915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e61e9118-41d9-4e5c-b270-116e35daf1f6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:46.348584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e61e9118-41d9-4e5c-b270-116e35daf1f6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:46.363579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e61e9118-41d9-4e5c-b270-116e35daf1f6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.364352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e61e9118-41d9-4e5c-b270-116e35daf1f6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.364879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e61e9118-41d9-4e5c-b270-116e35daf1f6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.365855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e61e9118-41d9-4e5c-b270-116e35daf1f6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:46.366907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e61e9118-41d9-4e5c-b270-116e35daf1f6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:46.367714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e61e9118-41d9-4e5c-b270-116e35daf1f6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:46.599316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e61e9118-41d9-4e5c-b270-116e35daf1f6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:46.628312 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e61e9118-41d9-4e5c-b270-116e35daf1f6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1308 microversion: 2.1 time: 0.286226 Aug 27 03:10:46.643445 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2766/5701] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:46 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:47.652730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f3b249c7-a22e-4edc-91a2-2c59f5ac50e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:47.653427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f3b249c7-a22e-4edc-91a2-2c59f5ac50e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:47.673515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3b249c7-a22e-4edc-91a2-2c59f5ac50e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:47.674080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3b249c7-a22e-4edc-91a2-2c59f5ac50e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:47.674532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3b249c7-a22e-4edc-91a2-2c59f5ac50e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:47.675253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3b249c7-a22e-4edc-91a2-2c59f5ac50e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:47.675714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3b249c7-a22e-4edc-91a2-2c59f5ac50e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:47.676151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f3b249c7-a22e-4edc-91a2-2c59f5ac50e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:48.116963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-44e3fae3-8acc-413f-b0fb-5f62409c5430 req-aea6df7c-cee3-41e2-b57b-66912f65e7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938495d8-b417-4178-b9dc-746025756c12", "name": "network-vif-plugged", "status": "completed", "tag": "8a533512-eed7-4e62-b717-ec5a7070fcd7"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:48.138302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-44e3fae3-8acc-413f-b0fb-5f62409c5430 req-aea6df7c-cee3-41e2-b57b-66912f65e7b2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:48.139395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-44e3fae3-8acc-413f-b0fb-5f62409c5430 req-aea6df7c-cee3-41e2-b57b-66912f65e7b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:48.140075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-44e3fae3-8acc-413f-b0fb-5f62409c5430 req-aea6df7c-cee3-41e2-b57b-66912f65e7b2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:48.155007 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-44e3fae3-8acc-413f-b0fb-5f62409c5430 req-aea6df7c-cee3-41e2-b57b-66912f65e7b2 service nova] Creating event network-vif-plugged:8a533512-eed7-4e62-b717-ec5a7070fcd7 for instance 938495d8-b417-4178-b9dc-746025756c12 on n-h1-852084-5 Aug 27 03:10:48.161102 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-44e3fae3-8acc-413f-b0fb-5f62409c5430 req-aea6df7c-cee3-41e2-b57b-66912f65e7b2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054309 Aug 27 03:10:48.162873 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2767/5702] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:48.660894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f3b249c7-a22e-4edc-91a2-2c59f5ac50e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:48.687377 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f3b249c7-a22e-4edc-91a2-2c59f5ac50e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1308 microversion: 2.1 time: 1.038776 Aug 27 03:10:48.693434 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2936/5703] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:47 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1308 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:49.721482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d570179b-fe9b-48c6-8cf3-a54292d4a7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:49.723041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d570179b-fe9b-48c6-8cf3-a54292d4a7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:49.758187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d570179b-fe9b-48c6-8cf3-a54292d4a7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:49.760092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d570179b-fe9b-48c6-8cf3-a54292d4a7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:49.760743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d570179b-fe9b-48c6-8cf3-a54292d4a7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:49.762966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d570179b-fe9b-48c6-8cf3-a54292d4a7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:49.764460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d570179b-fe9b-48c6-8cf3-a54292d4a7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:49.765115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d570179b-fe9b-48c6-8cf3-a54292d4a7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:50.506358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d570179b-fe9b-48c6-8cf3-a54292d4a7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:50.534429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:10:50.546817 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d570179b-fe9b-48c6-8cf3-a54292d4a7d4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1490 microversion: 2.1 time: 0.837380 Aug 27 03:10:50.547509 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2768/5704] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:49 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1490 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:50.571993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-45d93fc8-33c5-44f8-991e-9f94642b490b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:50.577494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-45d93fc8-33c5-44f8-991e-9f94642b490b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:50.589705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45d93fc8-33c5-44f8-991e-9f94642b490b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:50.590702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45d93fc8-33c5-44f8-991e-9f94642b490b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:50.592553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45d93fc8-33c5-44f8-991e-9f94642b490b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:50.594624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45d93fc8-33c5-44f8-991e-9f94642b490b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:50.597230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45d93fc8-33c5-44f8-991e-9f94642b490b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:50.597918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45d93fc8-33c5-44f8-991e-9f94642b490b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:50.782671 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-45d93fc8-33c5-44f8-991e-9f94642b490b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "PUT /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1085 microversion: 2.1 time: 0.214824 Aug 27 03:10:50.786747 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2937/5705] 10.222.0.99 () {60 vars in 1256 bytes} [Sat Aug 27 03:10:50 2022] PUT /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1085 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:50.810585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2a571c77-2aa8-4110-85c0-f6a39a47f5b6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:50.811576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2a571c77-2aa8-4110-85c0-f6a39a47f5b6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:50.822805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a571c77-2aa8-4110-85c0-f6a39a47f5b6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:50.835926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a571c77-2aa8-4110-85c0-f6a39a47f5b6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:50.838039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a571c77-2aa8-4110-85c0-f6a39a47f5b6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:50.838987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a571c77-2aa8-4110-85c0-f6a39a47f5b6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:50.840072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a571c77-2aa8-4110-85c0-f6a39a47f5b6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:50.840536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a571c77-2aa8-4110-85c0-f6a39a47f5b6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:51.625814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2a571c77-2aa8-4110-85c0-f6a39a47f5b6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:51.640784 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2a571c77-2aa8-4110-85c0-f6a39a47f5b6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1511 microversion: 2.1 time: 0.834800 Aug 27 03:10:51.654671 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2769/5706] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:50 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1511 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:51.670835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ae91b46-8805-4b89-bfea-8cadb9b60aee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:51.672221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ae91b46-8805-4b89-bfea-8cadb9b60aee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:51.686575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae91b46-8805-4b89-bfea-8cadb9b60aee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:51.687898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae91b46-8805-4b89-bfea-8cadb9b60aee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:51.688971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae91b46-8805-4b89-bfea-8cadb9b60aee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:51.690672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae91b46-8805-4b89-bfea-8cadb9b60aee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:51.691875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae91b46-8805-4b89-bfea-8cadb9b60aee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:51.692535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ae91b46-8805-4b89-bfea-8cadb9b60aee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.257268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ad71d0c-3e14-4795-b819-61e031242e19 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44e00635-7c9f-494e-bd29-8f02bc8e7a4a", "device": "/dev/sdb"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:52.260539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0ad71d0c-3e14-4795-b819-61e031242e19 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:52.272777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ad71d0c-3e14-4795-b819-61e031242e19 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.273286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ad71d0c-3e14-4795-b819-61e031242e19 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.273795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ad71d0c-3e14-4795-b819-61e031242e19 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.274499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ad71d0c-3e14-4795-b819-61e031242e19 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.274965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ad71d0c-3e14-4795-b819-61e031242e19 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.275402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ad71d0c-3e14-4795-b819-61e031242e19 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.518579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ae91b46-8805-4b89-bfea-8cadb9b60aee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:52.552259 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ae91b46-8805-4b89-bfea-8cadb9b60aee tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1511 microversion: 2.1 time: 0.886771 Aug 27 03:10:52.570537 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2938/5707] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:51 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1511 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:52.587016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-45f4c652-8a10-4636-b638-a18019d8eb85 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:52.590316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-45f4c652-8a10-4636-b638-a18019d8eb85 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:52.602375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45f4c652-8a10-4636-b638-a18019d8eb85 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.603147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45f4c652-8a10-4636-b638-a18019d8eb85 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.603952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45f4c652-8a10-4636-b638-a18019d8eb85 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.605008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45f4c652-8a10-4636-b638-a18019d8eb85 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.605635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45f4c652-8a10-4636-b638-a18019d8eb85 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.606296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-45f4c652-8a10-4636-b638-a18019d8eb85 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.681183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-45f4c652-8a10-4636-b638-a18019d8eb85 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:10:52.853034 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0ad71d0c-3e14-4795-b819-61e031242e19 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "POST /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.602619 Aug 27 03:10:52.859123 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2770/5708] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:10:52 2022] POST /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216/os-volume_attachments => generated 194 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:52.915755 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-45f4c652-8a10-4636-b638-a18019d8eb85 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 204 len: 0 microversion: 2.1 time: 0.338324 Aug 27 03:10:52.916954 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2939/5709] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:10:52 2022] DELETE /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:10:52.927040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a9c296a-2f27-4049-9401-94e8f507a049 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:52.927694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a9c296a-2f27-4049-9401-94e8f507a049 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:52.943716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a9c296a-2f27-4049-9401-94e8f507a049 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.944492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a9c296a-2f27-4049-9401-94e8f507a049 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.945265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a9c296a-2f27-4049-9401-94e8f507a049 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:52.946241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a9c296a-2f27-4049-9401-94e8f507a049 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:52.946915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a9c296a-2f27-4049-9401-94e8f507a049 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:52.952794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a9c296a-2f27-4049-9401-94e8f507a049 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:53.483160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a9c296a-2f27-4049-9401-94e8f507a049 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:53.494915 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a9c296a-2f27-4049-9401-94e8f507a049 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1517 microversion: 2.1 time: 0.572896 Aug 27 03:10:53.511991 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2771/5710] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:52 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1517 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:54.539554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-547f3db9-8ddd-4d8f-99f7-8006b269c34a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:54.539554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-547f3db9-8ddd-4d8f-99f7-8006b269c34a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:54.582049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-547f3db9-8ddd-4d8f-99f7-8006b269c34a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.584402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-547f3db9-8ddd-4d8f-99f7-8006b269c34a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.587969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-547f3db9-8ddd-4d8f-99f7-8006b269c34a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:54.590850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-547f3db9-8ddd-4d8f-99f7-8006b269c34a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:54.593359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-547f3db9-8ddd-4d8f-99f7-8006b269c34a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:54.594206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-547f3db9-8ddd-4d8f-99f7-8006b269c34a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.108327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-547f3db9-8ddd-4d8f-99f7-8006b269c34a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:56.136852 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-547f3db9-8ddd-4d8f-99f7-8006b269c34a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1517 microversion: 2.1 time: 1.607841 Aug 27 03:10:56.160437 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2940/5711] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:54 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1517 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:56.687413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2e0c38f4-c2a5-4212-8ad3-45190a3bb488 req-a9846352-5143-4768-8339-6c537ef2b5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938495d8-b417-4178-b9dc-746025756c12", "name": "network-vif-deleted", "tag": "8a533512-eed7-4e62-b717-ec5a7070fcd7"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:56.722080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2e0c38f4-c2a5-4212-8ad3-45190a3bb488 req-a9846352-5143-4768-8339-6c537ef2b5f1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:56.722996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2e0c38f4-c2a5-4212-8ad3-45190a3bb488 req-a9846352-5143-4768-8339-6c537ef2b5f1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:56.726190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2e0c38f4-c2a5-4212-8ad3-45190a3bb488 req-a9846352-5143-4768-8339-6c537ef2b5f1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:56.770187 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2e0c38f4-c2a5-4212-8ad3-45190a3bb488 req-a9846352-5143-4768-8339-6c537ef2b5f1 service nova] Creating event network-vif-deleted:8a533512-eed7-4e62-b717-ec5a7070fcd7 for instance 938495d8-b417-4178-b9dc-746025756c12 on n-h1-852084-5 Aug 27 03:10:56.790863 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2e0c38f4-c2a5-4212-8ad3-45190a3bb488 req-a9846352-5143-4768-8339-6c537ef2b5f1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110897 Aug 27 03:10:56.791498 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2772/5712] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:10:57.164729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:57.165349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:57.173557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.174612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.175061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.175769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.176228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.176660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.404836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:57.405755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:57.406408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:57.407248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lazy-loading 'fault' on Instance uuid 938495d8-b417-4178-b9dc-746025756c12 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:10:58.148860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:10:58.160828 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eb11ff0c-d3cf-4cc0-bee9-8bb475af3b6f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 200 len: 1319 microversion: 2.1 time: 0.996768 Aug 27 03:10:58.161720 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2941/5713] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:57 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 1319 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:10:59.184663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:10:59.185382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:10:59.210483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.216093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.216911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.217870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:10:59.218545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:10:59.219437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:10:59.260896 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 HTTP/1.1 Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '938495d8-b417-4178-b9dc-746025756c12'} Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.262671 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:10:59.266493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:10:59.266493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:10:59.266493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:10:59.266493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:10:59.266493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:10:59.266493 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:10:59.266493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:10:59.266493 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cdec6e8d-c065-492d-ad1c-5bf0e4079394 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 404 len: 111 microversion: 2.1 time: 0.084148 Aug 27 03:10:59.271937 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2773/5714] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:10:59 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:10:59.508747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-993417720", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a7f149e5-3bf9-4728-ad5f-b673712c2f5f"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:10:59.644057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] validate_networks() for [('a7f149e5-3bf9-4728-ad5f-b673712c2f5f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:03.087724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:03.088973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:03.089615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:03.090385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:03.091010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:03.097807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:03.119770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.122170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.125135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.141006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:03.148570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:03.149113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:03.224358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:03.237855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Getting quotas for user 756fff89d19d41869dad9425eddd55c1 and project 55a939dc355345c8b827ca4538afec54. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:03.278383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:03.287801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:03.431243 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-85f23c1f-4a0d-4ed3-addc-166b47e2b3bf tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.928689 Aug 27 03:11:03.438091 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2942/5715] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:10:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:11:03.443657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-973e92be-c5d9-4fee-a400-fbca68e5e9db tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:03.444694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-973e92be-c5d9-4fee-a400-fbca68e5e9db tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:03.569388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-973e92be-c5d9-4fee-a400-fbca68e5e9db tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:03.582587 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-973e92be-c5d9-4fee-a400-fbca68e5e9db tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1208 microversion: 2.1 time: 0.137970 Aug 27 03:11:03.583903 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2774/5716] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:03 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1208 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:04.605803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11b2d30a-bf9f-457b-80d7-deaee1f39c3f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:04.606403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-11b2d30a-bf9f-457b-80d7-deaee1f39c3f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:04.735912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a0f6b364-b2c0-4fec-96ba-2021763493f5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '.version_select at 0x7f4d2e75c4c0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:04.779550 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a0f6b364-b2c0-4fec-96ba-2021763493f5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-71932956" status: 202 len: 0 microversion: 2.1 time: 0.047757 Aug 27 03:11:04.780401 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2775/5717] 10.222.0.99 () {58 vars in 1278 bytes} [Sat Aug 27 03:11:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-71932956 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:11:04.817883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-28977e64-a882-462f-8d77-45cf04a7605a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'create', calling method: .version_select at 0x7f4d29485940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1881756802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgkk3Y/B550ot2NFmfG4rwYnNutlaFdt5LDSTz5SCwLd2o7gzSPtFen2kiz9hUh78+8DUKgNcL04z0USFSTmdsRns6bdpsmzDrdJBVt3zhbBGWKgNTX1j89TRhY05P2xA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:04.870140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-28977e64-a882-462f-8d77-45cf04a7605a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:04.885865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-28977e64-a882-462f-8d77-45cf04a7605a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for user 86930a2f684449a5a228ea43a7ab5e23 and project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:04.928450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-11b2d30a-bf9f-457b-80d7-deaee1f39c3f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:04.936967 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11b2d30a-bf9f-457b-80d7-deaee1f39c3f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1208 microversion: 2.1 time: 0.336471 Aug 27 03:11:04.938861 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2943/5718] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:04 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1208 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:04.995037 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-28977e64-a882-462f-8d77-45cf04a7605a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.180622 Aug 27 03:11:04.997060 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2776/5719] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:11:04 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:11:05.972575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-07eeccb8-fb47-4448-bb98-66f2f60542de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:05.973339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-07eeccb8-fb47-4448-bb98-66f2f60542de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:06.002052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07eeccb8-fb47-4448-bb98-66f2f60542de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:06.002570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07eeccb8-fb47-4448-bb98-66f2f60542de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:06.009565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07eeccb8-fb47-4448-bb98-66f2f60542de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:06.015266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07eeccb8-fb47-4448-bb98-66f2f60542de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:06.016115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07eeccb8-fb47-4448-bb98-66f2f60542de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:06.016719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-07eeccb8-fb47-4448-bb98-66f2f60542de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:06.424056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-07eeccb8-fb47-4448-bb98-66f2f60542de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:06.432787 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-07eeccb8-fb47-4448-bb98-66f2f60542de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1268 microversion: 2.1 time: 0.466872 Aug 27 03:11:06.433459 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2944/5720] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:05 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1268 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:07.469603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a632c84-850b-4164-9c47-f4c974b2bc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:07.471376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a632c84-850b-4164-9c47-f4c974b2bc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:07.489780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a632c84-850b-4164-9c47-f4c974b2bc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.501452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a632c84-850b-4164-9c47-f4c974b2bc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.504877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a632c84-850b-4164-9c47-f4c974b2bc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:07.506249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a632c84-850b-4164-9c47-f4c974b2bc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:07.507131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a632c84-850b-4164-9c47-f4c974b2bc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:07.515522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a632c84-850b-4164-9c47-f4c974b2bc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:08.512714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a632c84-850b-4164-9c47-f4c974b2bc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:08.531167 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a632c84-850b-4164-9c47-f4c974b2bc2f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1266 microversion: 2.1 time: 1.066961 Aug 27 03:11:08.547840 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2777/5721] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:07 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1266 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:09.562688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fbf71d99-2c23-4f3a-9816-0b391b14f390 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:09.565224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fbf71d99-2c23-4f3a-9816-0b391b14f390 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:09.582036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbf71d99-2c23-4f3a-9816-0b391b14f390 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.582650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbf71d99-2c23-4f3a-9816-0b391b14f390 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.583112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbf71d99-2c23-4f3a-9816-0b391b14f390 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.608292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbf71d99-2c23-4f3a-9816-0b391b14f390 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:09.609177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbf71d99-2c23-4f3a-9816-0b391b14f390 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:09.618876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbf71d99-2c23-4f3a-9816-0b391b14f390 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:09.624699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:09.967532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fbf71d99-2c23-4f3a-9816-0b391b14f390 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:09.978921 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fbf71d99-2c23-4f3a-9816-0b391b14f390 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1266 microversion: 2.1 time: 0.419997 Aug 27 03:11:09.981630 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2945/5722] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:09 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1266 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:11.007881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f5ed9713-1df0-48d2-a8d3-f350c240a2c9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:11.008567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f5ed9713-1df0-48d2-a8d3-f350c240a2c9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:11.027473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ed9713-1df0-48d2-a8d3-f350c240a2c9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:11.031290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ed9713-1df0-48d2-a8d3-f350c240a2c9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:11.032350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ed9713-1df0-48d2-a8d3-f350c240a2c9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:11.035463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ed9713-1df0-48d2-a8d3-f350c240a2c9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:11.038062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ed9713-1df0-48d2-a8d3-f350c240a2c9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:11.039787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f5ed9713-1df0-48d2-a8d3-f350c240a2c9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:11.556322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f5ed9713-1df0-48d2-a8d3-f350c240a2c9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:11.568348 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f5ed9713-1df0-48d2-a8d3-f350c240a2c9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1308 microversion: 2.1 time: 0.569332 Aug 27 03:11:11.569238 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2778/5723] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:10 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1308 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:11.930075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-04543e42-0e44-4e00-a320-9191553abc5f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:11.931801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04543e42-0e44-4e00-a320-9191553abc5f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:11.932287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04543e42-0e44-4e00-a320-9191553abc5f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:11.932917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04543e42-0e44-4e00-a320-9191553abc5f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:11.933864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04543e42-0e44-4e00-a320-9191553abc5f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:11.937281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04543e42-0e44-4e00-a320-9191553abc5f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:11.938321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-04543e42-0e44-4e00-a320-9191553abc5f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:11.999670 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-04543e42-0e44-4e00-a320-9191553abc5f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.305722 Aug 27 03:11:12.023115 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2946/5724] 10.222.0.99 () {58 vars in 1185 bytes} [Sat Aug 27 03:11:11 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:12.138765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1623875925", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "availability_zone": "nova:n-h1-852084-5", "networks": [{"uuid": "f996346e-f497-4041-9b87-181e1faf0ca7"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:12.251919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] validate_networks() for [('f996346e-f497-4041-9b87-181e1faf0ca7', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:12.593877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46fd467a-e468-4613-9a95-3a132564f1f2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:12.596111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-46fd467a-e468-4613-9a95-3a132564f1f2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:12.609875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46fd467a-e468-4613-9a95-3a132564f1f2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.612751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46fd467a-e468-4613-9a95-3a132564f1f2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.613534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46fd467a-e468-4613-9a95-3a132564f1f2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:12.616395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46fd467a-e468-4613-9a95-3a132564f1f2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:12.619754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46fd467a-e468-4613-9a95-3a132564f1f2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:12.620658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46fd467a-e468-4613-9a95-3a132564f1f2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.344701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-46fd467a-e468-4613-9a95-3a132564f1f2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:13.365704 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-46fd467a-e468-4613-9a95-3a132564f1f2 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1308 microversion: 2.1 time: 0.776189 Aug 27 03:11:13.380949 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2947/5725] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:12 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1308 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:13.391557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b485149e-fed8-40e1-aecf-27713a77d0bf req-38935535-ae17-4d27-b722-c0f322057045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3", "tag": "d2cc96bc-d8e2-4390-ac2d-f97d418fc641"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:13.428107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b485149e-fed8-40e1-aecf-27713a77d0bf req-38935535-ae17-4d27-b722-c0f322057045 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:13.431562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b485149e-fed8-40e1-aecf-27713a77d0bf req-38935535-ae17-4d27-b722-c0f322057045 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:13.432045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b485149e-fed8-40e1-aecf-27713a77d0bf req-38935535-ae17-4d27-b722-c0f322057045 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:13.464658 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b485149e-fed8-40e1-aecf-27713a77d0bf req-38935535-ae17-4d27-b722-c0f322057045 service nova] Creating event network-changed:d2cc96bc-d8e2-4390-ac2d-f97d418fc641 for instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 on n-h1-852084-5 Aug 27 03:11:13.472677 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b485149e-fed8-40e1-aecf-27713a77d0bf req-38935535-ae17-4d27-b722-c0f322057045 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101507 Aug 27 03:11:13.473378 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2948/5726] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:14.403861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-05d5a91e-f178-4abb-901a-61141566348c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:14.404606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-05d5a91e-f178-4abb-901a-61141566348c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:14.413941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05d5a91e-f178-4abb-901a-61141566348c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.414814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05d5a91e-f178-4abb-901a-61141566348c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.415481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05d5a91e-f178-4abb-901a-61141566348c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:14.416435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05d5a91e-f178-4abb-901a-61141566348c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:14.417148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05d5a91e-f178-4abb-901a-61141566348c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:14.417851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05d5a91e-f178-4abb-901a-61141566348c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:14.909724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-05d5a91e-f178-4abb-901a-61141566348c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:14.914697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:14.920297 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-05d5a91e-f178-4abb-901a-61141566348c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1308 microversion: 2.1 time: 0.529638 Aug 27 03:11:14.941624 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2949/5727] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:14 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1308 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:15.098807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:15.099627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:15.100319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:15.100957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:15.101649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:15.112483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:15.122006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.122919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.123586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.124784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.125577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.127161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.156245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Getting quotas for project 277f7b5dbdfb4c8d919e5e5943bac75e. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:15.165534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Getting quotas for user 37e0b7514c85409992af41ca5dc12191 and project 277f7b5dbdfb4c8d919e5e5943bac75e. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:15.190835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:15.193813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:15.347217 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-afafafc1-2a81-4144-9bbb-aa4d0524d25a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.211787 Aug 27 03:11:15.359049 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2779/5728] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:11:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:11:15.369076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37caee3b-21dd-4420-be4f-21962dedde88 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:15.369945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-37caee3b-21dd-4420-be4f-21962dedde88 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:15.372447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:15.752272 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-37caee3b-21dd-4420-be4f-21962dedde88 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1329 microversion: 2.1 time: 0.387929 Aug 27 03:11:15.771711 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2950/5729] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:15 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1329 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:15.943630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d73c883-b3ad-4879-9569-16ad066d3dd6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:15.944449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4d73c883-b3ad-4879-9569-16ad066d3dd6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:15.960238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d73c883-b3ad-4879-9569-16ad066d3dd6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.965014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d73c883-b3ad-4879-9569-16ad066d3dd6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.966774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d73c883-b3ad-4879-9569-16ad066d3dd6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:15.971503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d73c883-b3ad-4879-9569-16ad066d3dd6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:15.972381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d73c883-b3ad-4879-9569-16ad066d3dd6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:15.974307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d73c883-b3ad-4879-9569-16ad066d3dd6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:16.526318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4d73c883-b3ad-4879-9569-16ad066d3dd6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:16.541962 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4d73c883-b3ad-4879-9569-16ad066d3dd6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1308 microversion: 2.1 time: 0.602982 Aug 27 03:11:16.542745 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2780/5730] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:15 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1308 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:16.776576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-adee85e2-a04f-466b-ae35-8632119eb0e2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:16.780760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-adee85e2-a04f-466b-ae35-8632119eb0e2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:16.816998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adee85e2-a04f-466b-ae35-8632119eb0e2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:16.822349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adee85e2-a04f-466b-ae35-8632119eb0e2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:16.823990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adee85e2-a04f-466b-ae35-8632119eb0e2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:16.832649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adee85e2-a04f-466b-ae35-8632119eb0e2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:16.834637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adee85e2-a04f-466b-ae35-8632119eb0e2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:16.835890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-adee85e2-a04f-466b-ae35-8632119eb0e2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.106976 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-adee85e2-a04f-466b-ae35-8632119eb0e2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1338 microversion: 2.1 time: 0.332814 Aug 27 03:11:17.107621 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2951/5731] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:16 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1338 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:17.571002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-efbf4a65-29c5-4276-b534-c59f77ae9e18 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:17.572655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-efbf4a65-29c5-4276-b534-c59f77ae9e18 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:17.604225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efbf4a65-29c5-4276-b534-c59f77ae9e18 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.606122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efbf4a65-29c5-4276-b534-c59f77ae9e18 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.606801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efbf4a65-29c5-4276-b534-c59f77ae9e18 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:17.607804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efbf4a65-29c5-4276-b534-c59f77ae9e18 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:17.608650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efbf4a65-29c5-4276-b534-c59f77ae9e18 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:17.609315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-efbf4a65-29c5-4276-b534-c59f77ae9e18 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.130636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b5e3c88b-f075-4194-97a1-c7f97b999c1f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:18.132087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b5e3c88b-f075-4194-97a1-c7f97b999c1f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:18.149762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5e3c88b-f075-4194-97a1-c7f97b999c1f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.150670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5e3c88b-f075-4194-97a1-c7f97b999c1f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.151317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5e3c88b-f075-4194-97a1-c7f97b999c1f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.153827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5e3c88b-f075-4194-97a1-c7f97b999c1f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:18.154543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5e3c88b-f075-4194-97a1-c7f97b999c1f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:18.157049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5e3c88b-f075-4194-97a1-c7f97b999c1f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:18.182300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-efbf4a65-29c5-4276-b534-c59f77ae9e18 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:18.197040 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-efbf4a65-29c5-4276-b534-c59f77ae9e18 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1308 microversion: 2.1 time: 0.636673 Aug 27 03:11:18.217867 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2781/5732] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:17 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1308 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:18.318626 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b5e3c88b-f075-4194-97a1-c7f97b999c1f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1422 microversion: 2.1 time: 0.191777 Aug 27 03:11:18.319223 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2952/5733] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:18 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1422 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:19.226991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-90839637-fd14-436b-b174-2dd376853980 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:19.227614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-90839637-fd14-436b-b174-2dd376853980 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:19.239576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90839637-fd14-436b-b174-2dd376853980 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.240338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90839637-fd14-436b-b174-2dd376853980 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.241352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90839637-fd14-436b-b174-2dd376853980 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.242461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90839637-fd14-436b-b174-2dd376853980 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.243079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90839637-fd14-436b-b174-2dd376853980 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.243720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90839637-fd14-436b-b174-2dd376853980 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.346282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57ce8491-ecdd-4807-aef2-b9eef91c1961 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:19.348239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-57ce8491-ecdd-4807-aef2-b9eef91c1961 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:19.364094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57ce8491-ecdd-4807-aef2-b9eef91c1961 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.364633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57ce8491-ecdd-4807-aef2-b9eef91c1961 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.366433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57ce8491-ecdd-4807-aef2-b9eef91c1961 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.367483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57ce8491-ecdd-4807-aef2-b9eef91c1961 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:19.369943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57ce8491-ecdd-4807-aef2-b9eef91c1961 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:19.370396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57ce8491-ecdd-4807-aef2-b9eef91c1961 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:19.499147 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-57ce8491-ecdd-4807-aef2-b9eef91c1961 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1422 microversion: 2.1 time: 0.159242 Aug 27 03:11:19.513788 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2953/5734] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:19 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1422 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:19.807689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-90839637-fd14-436b-b174-2dd376853980 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:19.821896 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-90839637-fd14-436b-b174-2dd376853980 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1308 microversion: 2.1 time: 0.597056 Aug 27 03:11:19.824605 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2782/5735] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:19 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1308 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:20.521262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-68c8d159-61ae-4302-b85e-0e74ceaf4b4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:20.521914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-68c8d159-61ae-4302-b85e-0e74ceaf4b4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:20.539523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68c8d159-61ae-4302-b85e-0e74ceaf4b4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:20.540219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68c8d159-61ae-4302-b85e-0e74ceaf4b4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:20.540853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68c8d159-61ae-4302-b85e-0e74ceaf4b4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.541575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68c8d159-61ae-4302-b85e-0e74ceaf4b4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:20.542178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68c8d159-61ae-4302-b85e-0e74ceaf4b4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:20.542833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68c8d159-61ae-4302-b85e-0e74ceaf4b4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.845135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-69ac3c4e-63f2-4783-83b9-da44b3cb0f77 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:20.846480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-69ac3c4e-63f2-4783-83b9-da44b3cb0f77 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:20.858641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69ac3c4e-63f2-4783-83b9-da44b3cb0f77 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:20.861633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69ac3c4e-63f2-4783-83b9-da44b3cb0f77 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:20.873910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69ac3c4e-63f2-4783-83b9-da44b3cb0f77 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.884464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69ac3c4e-63f2-4783-83b9-da44b3cb0f77 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:20.886856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69ac3c4e-63f2-4783-83b9-da44b3cb0f77 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:20.887493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69ac3c4e-63f2-4783-83b9-da44b3cb0f77 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:20.901337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:21.073827 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-68c8d159-61ae-4302-b85e-0e74ceaf4b4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1464 microversion: 2.1 time: 0.556077 Aug 27 03:11:21.073827 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2954/5736] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:20 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1464 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:21.231345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2cd06ac1-9223-4cd2-a0a6-0634cfeb2bac req-951a2daf-7fba-4cc2-8366-d8a865921773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3", "name": "network-vif-plugged", "status": "completed", "tag": "d2cc96bc-d8e2-4390-ac2d-f97d418fc641"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:21.253856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2cd06ac1-9223-4cd2-a0a6-0634cfeb2bac req-951a2daf-7fba-4cc2-8366-d8a865921773 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.254766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2cd06ac1-9223-4cd2-a0a6-0634cfeb2bac req-951a2daf-7fba-4cc2-8366-d8a865921773 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.257244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2cd06ac1-9223-4cd2-a0a6-0634cfeb2bac req-951a2daf-7fba-4cc2-8366-d8a865921773 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.304567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2cd06ac1-9223-4cd2-a0a6-0634cfeb2bac req-951a2daf-7fba-4cc2-8366-d8a865921773 service nova] Creating event network-vif-plugged:d2cc96bc-d8e2-4390-ac2d-f97d418fc641 for instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 on n-h1-852084-5 Aug 27 03:11:21.331081 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2cd06ac1-9223-4cd2-a0a6-0634cfeb2bac req-951a2daf-7fba-4cc2-8366-d8a865921773 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103410 Aug 27 03:11:21.336478 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2955/5737] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:11:21.353384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-eec803d2-b003-47ba-92e6-61fa1214937f req-5efceabf-29a4-471a-8b18-b31c23fb3eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473c482f-6e41-4e0d-b4d8-c7899f687132", "tag": "25ac8f67-4134-4030-b358-f9a34a8941c3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:21.390668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-eec803d2-b003-47ba-92e6-61fa1214937f req-5efceabf-29a4-471a-8b18-b31c23fb3eb7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:21.399269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-eec803d2-b003-47ba-92e6-61fa1214937f req-5efceabf-29a4-471a-8b18-b31c23fb3eb7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:21.400262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-eec803d2-b003-47ba-92e6-61fa1214937f req-5efceabf-29a4-471a-8b18-b31c23fb3eb7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:21.429456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-69ac3c4e-63f2-4783-83b9-da44b3cb0f77 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:21.443948 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-eec803d2-b003-47ba-92e6-61fa1214937f req-5efceabf-29a4-471a-8b18-b31c23fb3eb7 service nova] Creating event network-changed:25ac8f67-4134-4030-b358-f9a34a8941c3 for instance 473c482f-6e41-4e0d-b4d8-c7899f687132 on n-h1-852084-5 Aug 27 03:11:21.448684 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-69ac3c4e-63f2-4783-83b9-da44b3cb0f77 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1308 microversion: 2.1 time: 0.608305 Aug 27 03:11:21.452385 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2783/5738] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:20 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1308 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:21.467674 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-eec803d2-b003-47ba-92e6-61fa1214937f req-5efceabf-29a4-471a-8b18-b31c23fb3eb7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127708 Aug 27 03:11:21.470887 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2956/5739] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:22.098177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-51cbd4d9-0595-4f47-aeb1-3a7fb19d2f13 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:22.098796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-51cbd4d9-0595-4f47-aeb1-3a7fb19d2f13 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:22.128831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cbd4d9-0595-4f47-aeb1-3a7fb19d2f13 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.129611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cbd4d9-0595-4f47-aeb1-3a7fb19d2f13 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.131446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cbd4d9-0595-4f47-aeb1-3a7fb19d2f13 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.137141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cbd4d9-0595-4f47-aeb1-3a7fb19d2f13 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.137921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cbd4d9-0595-4f47-aeb1-3a7fb19d2f13 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.138551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-51cbd4d9-0595-4f47-aeb1-3a7fb19d2f13 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.471574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:22.476140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-10e29930-373c-496f-806c-493204e64f62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:22.477124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-10e29930-373c-496f-806c-493204e64f62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:22.495568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10e29930-373c-496f-806c-493204e64f62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.498730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10e29930-373c-496f-806c-493204e64f62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.499460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10e29930-373c-496f-806c-493204e64f62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.500621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10e29930-373c-496f-806c-493204e64f62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:22.504313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10e29930-373c-496f-806c-493204e64f62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:22.505049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10e29930-373c-496f-806c-493204e64f62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:22.873961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-10e29930-373c-496f-806c-493204e64f62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:22.885308 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-10e29930-373c-496f-806c-493204e64f62 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1308 microversion: 2.1 time: 0.415675 Aug 27 03:11:22.888877 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2957/5740] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:22 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:22.996892 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-51cbd4d9-0595-4f47-aeb1-3a7fb19d2f13 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1464 microversion: 2.1 time: 0.905946 Aug 27 03:11:22.999117 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2784/5741] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:22 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1464 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:23.914594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11cf06de-bc3f-4dc8-92a4-d619fe784a34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:23.919002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-11cf06de-bc3f-4dc8-92a4-d619fe784a34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:23.932150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cf06de-bc3f-4dc8-92a4-d619fe784a34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:23.933381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cf06de-bc3f-4dc8-92a4-d619fe784a34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:23.935355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cf06de-bc3f-4dc8-92a4-d619fe784a34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:23.936377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cf06de-bc3f-4dc8-92a4-d619fe784a34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:23.937442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cf06de-bc3f-4dc8-92a4-d619fe784a34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:23.938275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11cf06de-bc3f-4dc8-92a4-d619fe784a34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.018991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4fc4b0b3-0924-4560-a5a4-d82529133ced tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:24.020220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4fc4b0b3-0924-4560-a5a4-d82529133ced tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:24.029359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fc4b0b3-0924-4560-a5a4-d82529133ced tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.030053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fc4b0b3-0924-4560-a5a4-d82529133ced tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.030648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fc4b0b3-0924-4560-a5a4-d82529133ced tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.031638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fc4b0b3-0924-4560-a5a4-d82529133ced tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.032888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fc4b0b3-0924-4560-a5a4-d82529133ced tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.033661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4fc4b0b3-0924-4560-a5a4-d82529133ced tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.331972 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4fc4b0b3-0924-4560-a5a4-d82529133ced tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1464 microversion: 2.1 time: 0.317325 Aug 27 03:11:24.334147 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2785/5742] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:24 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:24.356503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-11cf06de-bc3f-4dc8-92a4-d619fe784a34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:24.374054 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11cf06de-bc3f-4dc8-92a4-d619fe784a34 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1489 microversion: 2.1 time: 0.465598 Aug 27 03:11:24.374994 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2958/5743] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:23 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1489 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:24.414995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-55baee31-4a68-4ffe-bd4c-b7236e1a0cd9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1707282861"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:24.420782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-55baee31-4a68-4ffe-bd4c-b7236e1a0cd9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:24.449137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55baee31-4a68-4ffe-bd4c-b7236e1a0cd9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.449995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55baee31-4a68-4ffe-bd4c-b7236e1a0cd9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.458906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55baee31-4a68-4ffe-bd4c-b7236e1a0cd9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.462444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55baee31-4a68-4ffe-bd4c-b7236e1a0cd9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.463085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55baee31-4a68-4ffe-bd4c-b7236e1a0cd9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.463614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-55baee31-4a68-4ffe-bd4c-b7236e1a0cd9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.625342 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-55baee31-4a68-4ffe-bd4c-b7236e1a0cd9 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "PUT /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1075 microversion: 2.1 time: 0.229166 Aug 27 03:11:24.626710 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2786/5744] 10.222.0.99 () {60 vars in 1256 bytes} [Sat Aug 27 03:11:24 2022] PUT /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1075 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:24.646611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b3efb2fe-16a0-40e2-820e-6a5bbefe075a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:24.650252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b3efb2fe-16a0-40e2-820e-6a5bbefe075a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:24.656820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3efb2fe-16a0-40e2-820e-6a5bbefe075a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.657726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3efb2fe-16a0-40e2-820e-6a5bbefe075a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.658401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3efb2fe-16a0-40e2-820e-6a5bbefe075a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:24.660074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3efb2fe-16a0-40e2-820e-6a5bbefe075a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:24.660756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3efb2fe-16a0-40e2-820e-6a5bbefe075a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:24.661414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3efb2fe-16a0-40e2-820e-6a5bbefe075a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.176017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b3efb2fe-16a0-40e2-820e-6a5bbefe075a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.193427 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b3efb2fe-16a0-40e2-820e-6a5bbefe075a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1501 microversion: 2.1 time: 0.551440 Aug 27 03:11:25.194365 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2959/5745] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:24 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1501 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:25.214795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9dc63bf9-9355-4221-b7c0-fecb1b9d5829 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:25.215484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9dc63bf9-9355-4221-b7c0-fecb1b9d5829 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:25.218640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:25.219959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:25.233529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dc63bf9-9355-4221-b7c0-fecb1b9d5829 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.236851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dc63bf9-9355-4221-b7c0-fecb1b9d5829 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.237779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dc63bf9-9355-4221-b7c0-fecb1b9d5829 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.238762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dc63bf9-9355-4221-b7c0-fecb1b9d5829 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.241807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dc63bf9-9355-4221-b7c0-fecb1b9d5829 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.242467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dc63bf9-9355-4221-b7c0-fecb1b9d5829 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.362585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11904cb5-e04c-464f-add4-84380d1e11c4 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:25.363953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-11904cb5-e04c-464f-add4-84380d1e11c4 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:25.380223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11904cb5-e04c-464f-add4-84380d1e11c4 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.381278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11904cb5-e04c-464f-add4-84380d1e11c4 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.381762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11904cb5-e04c-464f-add4-84380d1e11c4 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.387606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11904cb5-e04c-464f-add4-84380d1e11c4 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.389279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11904cb5-e04c-464f-add4-84380d1e11c4 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.394447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11904cb5-e04c-464f-add4-84380d1e11c4 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.745425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:25.852676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9dc63bf9-9355-4221-b7c0-fecb1b9d5829 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:25.867795 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9dc63bf9-9355-4221-b7c0-fecb1b9d5829 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1501 microversion: 2.1 time: 0.650240 Aug 27 03:11:25.868794 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2787/5746] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:25 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1501 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:25.896533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-30f63324-52ac-491d-9a1d-05f9bd6dd5de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:25.909655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30f63324-52ac-491d-9a1d-05f9bd6dd5de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:25.909655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30f63324-52ac-491d-9a1d-05f9bd6dd5de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:25.910122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30f63324-52ac-491d-9a1d-05f9bd6dd5de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:25.981129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-30f63324-52ac-491d-9a1d-05f9bd6dd5de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Going to try to stop instance {{(pid=122487) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:11:26.041906 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11904cb5-e04c-464f-add4-84380d1e11c4 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1464 microversion: 2.1 time: 0.687431 Aug 27 03:11:26.049314 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2960/5747] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:25 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1464 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:26.084307 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-30f63324-52ac-491d-9a1d-05f9bd6dd5de tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "POST /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3/action" status: 202 len: 0 microversion: 2.1 time: 0.194481 Aug 27 03:11:26.085352 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2788/5748] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:11:25 2022] POST /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:11:26.094410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a2e9d397-998d-4d82-8c0f-35c4cd24f228 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:26.095353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a2e9d397-998d-4d82-8c0f-35c4cd24f228 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:26.108185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2e9d397-998d-4d82-8c0f-35c4cd24f228 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.109016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2e9d397-998d-4d82-8c0f-35c4cd24f228 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.111092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2e9d397-998d-4d82-8c0f-35c4cd24f228 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.112329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2e9d397-998d-4d82-8c0f-35c4cd24f228 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:26.114497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2e9d397-998d-4d82-8c0f-35c4cd24f228 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:26.115142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a2e9d397-998d-4d82-8c0f-35c4cd24f228 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:26.490727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a2e9d397-998d-4d82-8c0f-35c4cd24f228 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:26.508969 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a2e9d397-998d-4d82-8c0f-35c4cd24f228 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.417434 Aug 27 03:11:26.511510 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2961/5749] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:26 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:26.823866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-863809794", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "4996e3be-ca31-4c49-a37b-c35f45ab18bf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1881756802", "security_groups": [{"name": "tempest-secgroup-smoke-1842511706"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:27.064565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4789e8e-a070-4b55-9576-768ab018b299 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:27.065997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4789e8e-a070-4b55-9576-768ab018b299 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:27.079440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4789e8e-a070-4b55-9576-768ab018b299 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.080457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4789e8e-a070-4b55-9576-768ab018b299 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.082557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4789e8e-a070-4b55-9576-768ab018b299 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.084932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4789e8e-a070-4b55-9576-768ab018b299 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.089732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4789e8e-a070-4b55-9576-768ab018b299 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.092539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4789e8e-a070-4b55-9576-768ab018b299 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.125247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] validate_networks() for [('4996e3be-ca31-4c49-a37b-c35f45ab18bf', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:27.448813 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4789e8e-a070-4b55-9576-768ab018b299 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1464 microversion: 2.1 time: 0.388958 Aug 27 03:11:27.449442 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2962/5750] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:27 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1464 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:27.532052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6882a003-1455-4af4-b079-23c4f29dc063 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:27.532713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6882a003-1455-4af4-b079-23c4f29dc063 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:27.551254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6882a003-1455-4af4-b079-23c4f29dc063 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.551760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6882a003-1455-4af4-b079-23c4f29dc063 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.552205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6882a003-1455-4af4-b079-23c4f29dc063 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.552933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6882a003-1455-4af4-b079-23c4f29dc063 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.553392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6882a003-1455-4af4-b079-23c4f29dc063 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.553862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6882a003-1455-4af4-b079-23c4f29dc063 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.764129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:27.764561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:27.765047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:27.765950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:27.766937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:27.784569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.785317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.785969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.787633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:27.788296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:27.789124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:27.819282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:27.827231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for user 86930a2f684449a5a228ea43a7ab5e23 and project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:27.844863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6882a003-1455-4af4-b079-23c4f29dc063 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:27.864013 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6882a003-1455-4af4-b079-23c4f29dc063 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.331055 Aug 27 03:11:27.870717 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2963/5751] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:27 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:27.923384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:27.926197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:28.008068 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6818c100-d685-416e-bc2b-1e9df60e67b0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.188601 Aug 27 03:11:28.015118 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2789/5752] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:11:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:11:28.020472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bc19dfee-9873-4424-b489-f1fee7a75d4f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:28.021144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bc19dfee-9873-4424-b489-f1fee7a75d4f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:28.177619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bc19dfee-9873-4424-b489-f1fee7a75d4f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:28.194503 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bc19dfee-9873-4424-b489-f1fee7a75d4f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1266 microversion: 2.1 time: 0.172507 Aug 27 03:11:28.196978 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2964/5753] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:28 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:28.472793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a475538-b7fb-4c52-9230-196df2a0a75e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:28.473512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5a475538-b7fb-4c52-9230-196df2a0a75e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:28.483935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a475538-b7fb-4c52-9230-196df2a0a75e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:28.486709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a475538-b7fb-4c52-9230-196df2a0a75e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:28.487419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a475538-b7fb-4c52-9230-196df2a0a75e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.488361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a475538-b7fb-4c52-9230-196df2a0a75e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:28.492277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a475538-b7fb-4c52-9230-196df2a0a75e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:28.492900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a475538-b7fb-4c52-9230-196df2a0a75e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.743163 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a475538-b7fb-4c52-9230-196df2a0a75e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1464 microversion: 2.1 time: 0.275774 Aug 27 03:11:28.746369 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2790/5754] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:28 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1464 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:28.898059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4164164c-e809-48b9-a771-5a8df9883fa8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:28.898679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4164164c-e809-48b9-a771-5a8df9883fa8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:28.911875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4164164c-e809-48b9-a771-5a8df9883fa8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:28.912620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4164164c-e809-48b9-a771-5a8df9883fa8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:28.913220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4164164c-e809-48b9-a771-5a8df9883fa8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:28.914328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4164164c-e809-48b9-a771-5a8df9883fa8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:28.914946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4164164c-e809-48b9-a771-5a8df9883fa8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:28.916508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4164164c-e809-48b9-a771-5a8df9883fa8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.169733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4164164c-e809-48b9-a771-5a8df9883fa8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:29.198297 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4164164c-e809-48b9-a771-5a8df9883fa8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.303878 Aug 27 03:11:29.203485 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2965/5755] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:28 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:29.224843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c1828253-2a1c-4534-87bd-ca8853d623ba tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:29.228521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c1828253-2a1c-4534-87bd-ca8853d623ba tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:29.244310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1828253-2a1c-4534-87bd-ca8853d623ba tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.246796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1828253-2a1c-4534-87bd-ca8853d623ba tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.247560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1828253-2a1c-4534-87bd-ca8853d623ba tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.248401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1828253-2a1c-4534-87bd-ca8853d623ba tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.249101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1828253-2a1c-4534-87bd-ca8853d623ba tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.253412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1828253-2a1c-4534-87bd-ca8853d623ba tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.356605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c1828253-2a1c-4534-87bd-ca8853d623ba tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:29.365438 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c1828253-2a1c-4534-87bd-ca8853d623ba tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1262 microversion: 2.1 time: 0.148192 Aug 27 03:11:29.366900 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2791/5756] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:29 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1262 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:29.764008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-30b97f36-cc44-41b7-93fa-4b45949ec1e3 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:29.765082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-30b97f36-cc44-41b7-93fa-4b45949ec1e3 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:29.771957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30b97f36-cc44-41b7-93fa-4b45949ec1e3 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.772685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30b97f36-cc44-41b7-93fa-4b45949ec1e3 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.773291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30b97f36-cc44-41b7-93fa-4b45949ec1e3 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.775573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30b97f36-cc44-41b7-93fa-4b45949ec1e3 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:29.776210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30b97f36-cc44-41b7-93fa-4b45949ec1e3 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:29.777278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-30b97f36-cc44-41b7-93fa-4b45949ec1e3 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:29.803171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:30.128080 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-30b97f36-cc44-41b7-93fa-4b45949ec1e3 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1464 microversion: 2.1 time: 0.357718 Aug 27 03:11:30.131021 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2966/5757] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:29 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1464 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:30.171850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-26231b82-8448-4bc9-93ce-d793ea67d533 req-16807cef-06be-4871-9764-52115679721d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473c482f-6e41-4e0d-b4d8-c7899f687132", "name": "network-vif-plugged", "status": "completed", "tag": "25ac8f67-4134-4030-b358-f9a34a8941c3"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:30.185080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-26231b82-8448-4bc9-93ce-d793ea67d533 req-16807cef-06be-4871-9764-52115679721d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.185900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-26231b82-8448-4bc9-93ce-d793ea67d533 req-16807cef-06be-4871-9764-52115679721d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.186564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-26231b82-8448-4bc9-93ce-d793ea67d533 req-16807cef-06be-4871-9764-52115679721d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.201809 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-26231b82-8448-4bc9-93ce-d793ea67d533 req-16807cef-06be-4871-9764-52115679721d service nova] Creating event network-vif-plugged:25ac8f67-4134-4030-b358-f9a34a8941c3 for instance 473c482f-6e41-4e0d-b4d8-c7899f687132 on n-h1-852084-5 Aug 27 03:11:30.208916 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-26231b82-8448-4bc9-93ce-d793ea67d533 req-16807cef-06be-4871-9764-52115679721d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043077 Aug 27 03:11:30.210348 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2792/5758] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:30.229566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33e944e5-b307-4c56-9cc0-f6bbee9fcf53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:30.237827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-33e944e5-b307-4c56-9cc0-f6bbee9fcf53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:30.261503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33e944e5-b307-4c56-9cc0-f6bbee9fcf53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.262033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33e944e5-b307-4c56-9cc0-f6bbee9fcf53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.270395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33e944e5-b307-4c56-9cc0-f6bbee9fcf53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.271931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33e944e5-b307-4c56-9cc0-f6bbee9fcf53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.272649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33e944e5-b307-4c56-9cc0-f6bbee9fcf53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.273428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33e944e5-b307-4c56-9cc0-f6bbee9fcf53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.399664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ce7f258e-9061-4d58-a645-a08a3d84a2c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:30.400375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ce7f258e-9061-4d58-a645-a08a3d84a2c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:30.414876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7f258e-9061-4d58-a645-a08a3d84a2c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.430056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7f258e-9061-4d58-a645-a08a3d84a2c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.430757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7f258e-9061-4d58-a645-a08a3d84a2c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.431674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7f258e-9061-4d58-a645-a08a3d84a2c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:30.432295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7f258e-9061-4d58-a645-a08a3d84a2c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:30.433095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7f258e-9061-4d58-a645-a08a3d84a2c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:30.671745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-33e944e5-b307-4c56-9cc0-f6bbee9fcf53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:30.685237 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-33e944e5-b307-4c56-9cc0-f6bbee9fcf53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.460308 Aug 27 03:11:30.686155 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2967/5759] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:30 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:30.714491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ce7f258e-9061-4d58-a645-a08a3d84a2c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:30.729397 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ce7f258e-9061-4d58-a645-a08a3d84a2c1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1324 microversion: 2.1 time: 0.333274 Aug 27 03:11:30.730666 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2793/5760] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:30 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1324 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:31.155877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b334dd87-fa02-458d-8a4c-6a2512a76e23 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:31.157489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b334dd87-fa02-458d-8a4c-6a2512a76e23 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:31.179067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b334dd87-fa02-458d-8a4c-6a2512a76e23 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.180053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b334dd87-fa02-458d-8a4c-6a2512a76e23 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.184300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b334dd87-fa02-458d-8a4c-6a2512a76e23 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.185198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b334dd87-fa02-458d-8a4c-6a2512a76e23 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.187752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b334dd87-fa02-458d-8a4c-6a2512a76e23 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.188451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b334dd87-fa02-458d-8a4c-6a2512a76e23 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.624930 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b334dd87-fa02-458d-8a4c-6a2512a76e23 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1464 microversion: 2.1 time: 0.472844 Aug 27 03:11:31.634247 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2968/5761] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:31 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1464 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:31.707752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-20b93f0b-4647-4d68-b659-985c1b12a379 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:31.709466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-20b93f0b-4647-4d68-b659-985c1b12a379 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:31.724654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b93f0b-4647-4d68-b659-985c1b12a379 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.725505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b93f0b-4647-4d68-b659-985c1b12a379 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.726391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b93f0b-4647-4d68-b659-985c1b12a379 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.737047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b93f0b-4647-4d68-b659-985c1b12a379 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.737869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b93f0b-4647-4d68-b659-985c1b12a379 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.738502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-20b93f0b-4647-4d68-b659-985c1b12a379 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.752916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5af78116-a68e-4890-897f-9ddd98d95439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:31.754499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5af78116-a68e-4890-897f-9ddd98d95439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:31.775654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5af78116-a68e-4890-897f-9ddd98d95439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.776464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5af78116-a68e-4890-897f-9ddd98d95439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.777244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5af78116-a68e-4890-897f-9ddd98d95439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:31.778199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5af78116-a68e-4890-897f-9ddd98d95439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:31.778852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5af78116-a68e-4890-897f-9ddd98d95439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:31.779469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5af78116-a68e-4890-897f-9ddd98d95439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.134035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5af78116-a68e-4890-897f-9ddd98d95439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:32.152172 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5af78116-a68e-4890-897f-9ddd98d95439 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1392 microversion: 2.1 time: 0.402828 Aug 27 03:11:32.153168 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2969/5762] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:31 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1392 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:32.656752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-db795070-9a26-4771-9d23-d5d59098bd28 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:32.657489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-db795070-9a26-4771-9d23-d5d59098bd28 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:32.671339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db795070-9a26-4771-9d23-d5d59098bd28 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.673359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db795070-9a26-4771-9d23-d5d59098bd28 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.674312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db795070-9a26-4771-9d23-d5d59098bd28 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.675212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db795070-9a26-4771-9d23-d5d59098bd28 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.682547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db795070-9a26-4771-9d23-d5d59098bd28 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.683096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db795070-9a26-4771-9d23-d5d59098bd28 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.881847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-20b93f0b-4647-4d68-b659-985c1b12a379 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:32.894040 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-20b93f0b-4647-4d68-b659-985c1b12a379 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 1.191311 Aug 27 03:11:32.896209 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2794/5763] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:31 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:32.962166 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-db795070-9a26-4771-9d23-d5d59098bd28 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1648 microversion: 2.1 time: 0.306973 Aug 27 03:11:32.967616 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2970/5764] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:32 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1648 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:32.987637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7ba9593f-a1c7-4e15-93bd-4527a09fa72e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:32.988665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7ba9593f-a1c7-4e15-93bd-4527a09fa72e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:32.996485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ba9593f-a1c7-4e15-93bd-4527a09fa72e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:32.997254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ba9593f-a1c7-4e15-93bd-4527a09fa72e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:32.997967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ba9593f-a1c7-4e15-93bd-4527a09fa72e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:32.999314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ba9593f-a1c7-4e15-93bd-4527a09fa72e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.000211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ba9593f-a1c7-4e15-93bd-4527a09fa72e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.001243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ba9593f-a1c7-4e15-93bd-4527a09fa72e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.175663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1b66eb92-520b-42e8-b4dd-5690ad6b40ed tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:33.176585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1b66eb92-520b-42e8-b4dd-5690ad6b40ed tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:33.183735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b66eb92-520b-42e8-b4dd-5690ad6b40ed tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.184240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b66eb92-520b-42e8-b4dd-5690ad6b40ed tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.184978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b66eb92-520b-42e8-b4dd-5690ad6b40ed tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.185825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b66eb92-520b-42e8-b4dd-5690ad6b40ed tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.186427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b66eb92-520b-42e8-b4dd-5690ad6b40ed tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.186714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b66eb92-520b-42e8-b4dd-5690ad6b40ed tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.221629 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7ba9593f-a1c7-4e15-93bd-4527a09fa72e tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1648 microversion: 2.1 time: 0.239450 Aug 27 03:11:33.240220 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2795/5765] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:32 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1648 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:33.250329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74be0eca-22e3-466f-a399-bbd00815e8a9 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:33.253853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-74be0eca-22e3-466f-a399-bbd00815e8a9 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:33.269942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74be0eca-22e3-466f-a399-bbd00815e8a9 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.269942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74be0eca-22e3-466f-a399-bbd00815e8a9 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.269942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74be0eca-22e3-466f-a399-bbd00815e8a9 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.275903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74be0eca-22e3-466f-a399-bbd00815e8a9 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.276487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74be0eca-22e3-466f-a399-bbd00815e8a9 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.276940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74be0eca-22e3-466f-a399-bbd00815e8a9 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.405910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1b66eb92-520b-42e8-b4dd-5690ad6b40ed tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:33.417007 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1b66eb92-520b-42e8-b4dd-5690ad6b40ed tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1392 microversion: 2.1 time: 0.246569 Aug 27 03:11:33.433777 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2971/5766] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:33 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:33.507490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-49abae95-f0c4-4d9a-a309-e91b38171eed tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:33.508722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-49abae95-f0c4-4d9a-a309-e91b38171eed tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:33.520475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:33.523240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49abae95-f0c4-4d9a-a309-e91b38171eed tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.523966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49abae95-f0c4-4d9a-a309-e91b38171eed tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.524826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49abae95-f0c4-4d9a-a309-e91b38171eed tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.525923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49abae95-f0c4-4d9a-a309-e91b38171eed tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.526549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49abae95-f0c4-4d9a-a309-e91b38171eed tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.527181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-49abae95-f0c4-4d9a-a309-e91b38171eed tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.564565 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-74be0eca-22e3-466f-a399-bbd00815e8a9 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1648 microversion: 2.1 time: 0.322918 Aug 27 03:11:33.568041 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2796/5767] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:33 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1648 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:33.575021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-df025eb5-6b66-4a4a-ba26-bb0519499c1a req-3264f851-377d-41e6-a2c3-978b66029dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e139e1-f1cf-437c-a02d-acbd52fea8be", "tag": "42706765-ea3d-4a18-9703-6df239805dcc"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:33.600617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-df025eb5-6b66-4a4a-ba26-bb0519499c1a req-3264f851-377d-41e6-a2c3-978b66029dca service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.610978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-df025eb5-6b66-4a4a-ba26-bb0519499c1a req-3264f851-377d-41e6-a2c3-978b66029dca service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.612490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-df025eb5-6b66-4a4a-ba26-bb0519499c1a req-3264f851-377d-41e6-a2c3-978b66029dca service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.639489 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-df025eb5-6b66-4a4a-ba26-bb0519499c1a req-3264f851-377d-41e6-a2c3-978b66029dca service nova] Creating event network-changed:42706765-ea3d-4a18-9703-6df239805dcc for instance 39e139e1-f1cf-437c-a02d-acbd52fea8be on n-h2-852084-5 Aug 27 03:11:33.656202 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-df025eb5-6b66-4a4a-ba26-bb0519499c1a req-3264f851-377d-41e6-a2c3-978b66029dca service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086698 Aug 27 03:11:33.656921 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2797/5768] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:33.729234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-49abae95-f0c4-4d9a-a309-e91b38171eed tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lazy-loading 'services' on Instance uuid ca52f03a-2251-41c0-94ab-4d447dfaa216 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:33.746963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-428340884", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "availability_zone": "nova:n-h2-852084-5", "networks": [{"uuid": "f996346e-f497-4041-9b87-181e1faf0ca7"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:33.835504 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-49abae95-f0c4-4d9a-a309-e91b38171eed tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "DELETE /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216/os-volume_attachments/44e00635-7c9f-494e-bd29-8f02bc8e7a4a" status: 202 len: 0 microversion: 2.1 time: 0.334782 Aug 27 03:11:33.836114 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2972/5769] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:11:33 2022] DELETE /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216/os-volume_attachments/44e00635-7c9f-494e-bd29-8f02bc8e7a4a => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:11:33.885848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] validate_networks() for [('f996346e-f497-4041-9b87-181e1faf0ca7', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:33.921214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ca04909d-d5d0-425e-b060-8e7e966a2a3d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:33.922909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ca04909d-d5d0-425e-b060-8e7e966a2a3d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:33.936304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca04909d-d5d0-425e-b060-8e7e966a2a3d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.937185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca04909d-d5d0-425e-b060-8e7e966a2a3d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.938474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca04909d-d5d0-425e-b060-8e7e966a2a3d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:33.940047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca04909d-d5d0-425e-b060-8e7e966a2a3d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:33.940760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca04909d-d5d0-425e-b060-8e7e966a2a3d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:33.941423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca04909d-d5d0-425e-b060-8e7e966a2a3d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.119099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ca04909d-d5d0-425e-b060-8e7e966a2a3d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:34.136251 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ca04909d-d5d0-425e-b060-8e7e966a2a3d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.221321 Aug 27 03:11:34.138617 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2973/5770] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:33 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:34.444599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0ce3a5f5-b8db-4077-9444-487038003a07 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:34.446085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0ce3a5f5-b8db-4077-9444-487038003a07 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:34.455603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ce3a5f5-b8db-4077-9444-487038003a07 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.456404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ce3a5f5-b8db-4077-9444-487038003a07 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.457051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ce3a5f5-b8db-4077-9444-487038003a07 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.458602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ce3a5f5-b8db-4077-9444-487038003a07 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.460597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ce3a5f5-b8db-4077-9444-487038003a07 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.461272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0ce3a5f5-b8db-4077-9444-487038003a07 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.642415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0ce3a5f5-b8db-4077-9444-487038003a07 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:34.654012 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0ce3a5f5-b8db-4077-9444-487038003a07 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1392 microversion: 2.1 time: 0.213128 Aug 27 03:11:34.655467 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2974/5771] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:34 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1392 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:34.681085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:34.681799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:34.682545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:34.684605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:34.685260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:34.699673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.700409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.701051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.702037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:34.702741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:34.710341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:34.740316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Getting quotas for project 277f7b5dbdfb4c8d919e5e5943bac75e. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:34.746153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Getting quotas for user 37e0b7514c85409992af41ca5dc12191 and project 277f7b5dbdfb4c8d919e5e5943bac75e. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:34.760751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:34.775248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:34.838075 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4443e44b-5721-4863-acb9-2d6d6281f897 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.097091 Aug 27 03:11:34.840389 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2798/5772] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:11:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:11:34.852172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ae879e67-4d51-47b5-9171-41d11adb7d4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:34.854433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ae879e67-4d51-47b5-9171-41d11adb7d4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:34.948863 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ae879e67-4d51-47b5-9171-41d11adb7d4c tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1328 microversion: 2.1 time: 0.101961 Aug 27 03:11:34.952227 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2975/5773] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:34 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:35.161817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7461524f-821e-4538-a4d6-ca51b912adae tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:35.162497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7461524f-821e-4538-a4d6-ca51b912adae tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:35.177504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7461524f-821e-4538-a4d6-ca51b912adae tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.177938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7461524f-821e-4538-a4d6-ca51b912adae tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.178926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7461524f-821e-4538-a4d6-ca51b912adae tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.179943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7461524f-821e-4538-a4d6-ca51b912adae tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.180629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7461524f-821e-4538-a4d6-ca51b912adae tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.181387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7461524f-821e-4538-a4d6-ca51b912adae tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.421520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7461524f-821e-4538-a4d6-ca51b912adae tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:35.434929 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7461524f-821e-4538-a4d6-ca51b912adae tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.277205 Aug 27 03:11:35.435837 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2799/5774] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:35 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:35.677610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57bff473-dcb1-425b-9dcb-a27b7cce339f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:35.678423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-57bff473-dcb1-425b-9dcb-a27b7cce339f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:35.691765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57bff473-dcb1-425b-9dcb-a27b7cce339f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.692382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57bff473-dcb1-425b-9dcb-a27b7cce339f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.692908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57bff473-dcb1-425b-9dcb-a27b7cce339f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:35.693839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57bff473-dcb1-425b-9dcb-a27b7cce339f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:35.694432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57bff473-dcb1-425b-9dcb-a27b7cce339f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:35.695147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57bff473-dcb1-425b-9dcb-a27b7cce339f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.003114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5de5b534-6522-4a73-921c-406a95c94ead tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:36.003746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5de5b534-6522-4a73-921c-406a95c94ead tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:36.019601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5de5b534-6522-4a73-921c-406a95c94ead tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.020874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5de5b534-6522-4a73-921c-406a95c94ead tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.023566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5de5b534-6522-4a73-921c-406a95c94ead tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.024350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5de5b534-6522-4a73-921c-406a95c94ead tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.024865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5de5b534-6522-4a73-921c-406a95c94ead tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.025558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5de5b534-6522-4a73-921c-406a95c94ead tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.082488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-57bff473-dcb1-425b-9dcb-a27b7cce339f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:36.092949 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-57bff473-dcb1-425b-9dcb-a27b7cce339f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1392 microversion: 2.1 time: 0.420704 Aug 27 03:11:36.105288 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2976/5775] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:35 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1392 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:36.183165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:36.190967 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5de5b534-6522-4a73-921c-406a95c94ead tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1415 microversion: 2.1 time: 0.213302 Aug 27 03:11:36.192021 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2800/5776] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:35 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1415 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:36.461547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-954e8fdd-98b1-48a4-9aef-86863c52819a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:36.462213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-954e8fdd-98b1-48a4-9aef-86863c52819a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:36.474557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954e8fdd-98b1-48a4-9aef-86863c52819a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.475179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954e8fdd-98b1-48a4-9aef-86863c52819a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.475859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954e8fdd-98b1-48a4-9aef-86863c52819a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.480986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954e8fdd-98b1-48a4-9aef-86863c52819a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:36.480986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954e8fdd-98b1-48a4-9aef-86863c52819a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:36.480986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-954e8fdd-98b1-48a4-9aef-86863c52819a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:36.804214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-954e8fdd-98b1-48a4-9aef-86863c52819a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:36.820282 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-954e8fdd-98b1-48a4-9aef-86863c52819a tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.363321 Aug 27 03:11:36.827433 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2977/5777] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:36 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:37.122077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-11772ee3-b514-4d97-95dc-61de0d6182f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:37.122886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-11772ee3-b514-4d97-95dc-61de0d6182f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:37.135605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11772ee3-b514-4d97-95dc-61de0d6182f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.136114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11772ee3-b514-4d97-95dc-61de0d6182f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.136555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11772ee3-b514-4d97-95dc-61de0d6182f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.137284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11772ee3-b514-4d97-95dc-61de0d6182f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.137777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11772ee3-b514-4d97-95dc-61de0d6182f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.138216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11772ee3-b514-4d97-95dc-61de0d6182f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.212353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-79e4daa2-b890-4d1b-aa2f-c4b894ffa027 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:37.213552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-79e4daa2-b890-4d1b-aa2f-c4b894ffa027 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:37.221925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79e4daa2-b890-4d1b-aa2f-c4b894ffa027 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.222841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79e4daa2-b890-4d1b-aa2f-c4b894ffa027 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.223500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79e4daa2-b890-4d1b-aa2f-c4b894ffa027 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.224449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79e4daa2-b890-4d1b-aa2f-c4b894ffa027 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.225123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79e4daa2-b890-4d1b-aa2f-c4b894ffa027 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.225816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79e4daa2-b890-4d1b-aa2f-c4b894ffa027 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.509921 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-79e4daa2-b890-4d1b-aa2f-c4b894ffa027 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1463 microversion: 2.1 time: 0.301423 Aug 27 03:11:37.511180 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2978/5778] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:37 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1463 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:37.537269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-11772ee3-b514-4d97-95dc-61de0d6182f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:37.547891 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-11772ee3-b514-4d97-95dc-61de0d6182f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1392 microversion: 2.1 time: 0.429555 Aug 27 03:11:37.548495 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2801/5779] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:37 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1392 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:37.849159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b53f25cb-20cb-4850-9e83-7d7d9ff7713b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:37.850069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b53f25cb-20cb-4850-9e83-7d7d9ff7713b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:37.871282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b53f25cb-20cb-4850-9e83-7d7d9ff7713b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.871822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b53f25cb-20cb-4850-9e83-7d7d9ff7713b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.872275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b53f25cb-20cb-4850-9e83-7d7d9ff7713b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:37.873015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b53f25cb-20cb-4850-9e83-7d7d9ff7713b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:37.876708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b53f25cb-20cb-4850-9e83-7d7d9ff7713b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:37.877187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b53f25cb-20cb-4850-9e83-7d7d9ff7713b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.104607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b53f25cb-20cb-4850-9e83-7d7d9ff7713b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:38.116220 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b53f25cb-20cb-4850-9e83-7d7d9ff7713b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.270919 Aug 27 03:11:38.117446 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2979/5780] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:37 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:38.348081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-abc5dea1-2659-44a7-99c9-418b535cfc66 req-262cb2c2-3461-4782-82af-2bfb0f2cd88a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e139e1-f1cf-437c-a02d-acbd52fea8be", "name": "network-vif-plugged", "status": "completed", "tag": "42706765-ea3d-4a18-9703-6df239805dcc"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:38.373990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-abc5dea1-2659-44a7-99c9-418b535cfc66 req-262cb2c2-3461-4782-82af-2bfb0f2cd88a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.375257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-abc5dea1-2659-44a7-99c9-418b535cfc66 req-262cb2c2-3461-4782-82af-2bfb0f2cd88a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.376681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-abc5dea1-2659-44a7-99c9-418b535cfc66 req-262cb2c2-3461-4782-82af-2bfb0f2cd88a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.377506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c9609e4a-13b5-40e7-8f07-3c26ac1e82c4 req-81643bc2-37fe-4207-8fb0-8a6b23674f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce03990-8189-4bdf-9b6a-b8b09cb0e88c", "tag": "ac5e3276-091f-468e-89e8-5f4eca14e77d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:38.411140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9609e4a-13b5-40e7-8f07-3c26ac1e82c4 req-81643bc2-37fe-4207-8fb0-8a6b23674f53 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.411662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9609e4a-13b5-40e7-8f07-3c26ac1e82c4 req-81643bc2-37fe-4207-8fb0-8a6b23674f53 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.412108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c9609e4a-13b5-40e7-8f07-3c26ac1e82c4 req-81643bc2-37fe-4207-8fb0-8a6b23674f53 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.413452 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-abc5dea1-2659-44a7-99c9-418b535cfc66 req-262cb2c2-3461-4782-82af-2bfb0f2cd88a service nova] Creating event network-vif-plugged:42706765-ea3d-4a18-9703-6df239805dcc for instance 39e139e1-f1cf-437c-a02d-acbd52fea8be on n-h2-852084-5 Aug 27 03:11:38.420380 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-abc5dea1-2659-44a7-99c9-418b535cfc66 req-262cb2c2-3461-4782-82af-2bfb0f2cd88a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076187 Aug 27 03:11:38.421737 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2802/5781] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:38.441127 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c9609e4a-13b5-40e7-8f07-3c26ac1e82c4 req-81643bc2-37fe-4207-8fb0-8a6b23674f53 service nova] Creating event network-changed:ac5e3276-091f-468e-89e8-5f4eca14e77d for instance 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c on n-h2-852084-5 Aug 27 03:11:38.447013 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c9609e4a-13b5-40e7-8f07-3c26ac1e82c4 req-81643bc2-37fe-4207-8fb0-8a6b23674f53 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073516 Aug 27 03:11:38.448777 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2980/5782] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:11:38.532536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bfc542bf-50bf-43ad-8219-75b16f36cd96 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:38.533247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bfc542bf-50bf-43ad-8219-75b16f36cd96 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:38.545988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfc542bf-50bf-43ad-8219-75b16f36cd96 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.547373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfc542bf-50bf-43ad-8219-75b16f36cd96 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.547972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfc542bf-50bf-43ad-8219-75b16f36cd96 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.548847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfc542bf-50bf-43ad-8219-75b16f36cd96 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.549462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfc542bf-50bf-43ad-8219-75b16f36cd96 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.554685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfc542bf-50bf-43ad-8219-75b16f36cd96 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.572931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-84eff4ff-5707-4a6e-875a-61804d31fae5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:38.573655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-84eff4ff-5707-4a6e-875a-61804d31fae5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:38.589510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84eff4ff-5707-4a6e-875a-61804d31fae5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.590189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84eff4ff-5707-4a6e-875a-61804d31fae5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.600332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84eff4ff-5707-4a6e-875a-61804d31fae5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.601341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84eff4ff-5707-4a6e-875a-61804d31fae5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:38.602212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84eff4ff-5707-4a6e-875a-61804d31fae5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:38.604117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84eff4ff-5707-4a6e-875a-61804d31fae5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:38.935908 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bfc542bf-50bf-43ad-8219-75b16f36cd96 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1463 microversion: 2.1 time: 0.407964 Aug 27 03:11:38.936502 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2803/5783] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:38 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1463 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:38.949047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-84eff4ff-5707-4a6e-875a-61804d31fae5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:38.957183 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-84eff4ff-5707-4a6e-875a-61804d31fae5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1392 microversion: 2.1 time: 0.388416 Aug 27 03:11:38.957796 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2981/5784] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:38 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1392 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:39.139059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e197a9d6-e4d7-4556-8960-5a3a6f0a86e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:39.139960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e197a9d6-e4d7-4556-8960-5a3a6f0a86e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:39.149503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e197a9d6-e4d7-4556-8960-5a3a6f0a86e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.150259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e197a9d6-e4d7-4556-8960-5a3a6f0a86e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.151297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e197a9d6-e4d7-4556-8960-5a3a6f0a86e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:39.152688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e197a9d6-e4d7-4556-8960-5a3a6f0a86e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.153311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e197a9d6-e4d7-4556-8960-5a3a6f0a86e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.154437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e197a9d6-e4d7-4556-8960-5a3a6f0a86e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:39.354505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e197a9d6-e4d7-4556-8960-5a3a6f0a86e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:39.366082 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e197a9d6-e4d7-4556-8960-5a3a6f0a86e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.230232 Aug 27 03:11:39.378133 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2804/5785] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:39 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:39.956857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32c2aec8-b3c8-4242-abd0-16002b788ea5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:39.958517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-32c2aec8-b3c8-4242-abd0-16002b788ea5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:39.966815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32c2aec8-b3c8-4242-abd0-16002b788ea5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.967570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32c2aec8-b3c8-4242-abd0-16002b788ea5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.968234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32c2aec8-b3c8-4242-abd0-16002b788ea5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:39.969978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32c2aec8-b3c8-4242-abd0-16002b788ea5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:39.970664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32c2aec8-b3c8-4242-abd0-16002b788ea5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:39.971342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32c2aec8-b3c8-4242-abd0-16002b788ea5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:39.986154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2d29aba4-091a-48fe-8cc4-4681e7ea47f3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:39.986778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2d29aba4-091a-48fe-8cc4-4681e7ea47f3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:40.013068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d29aba4-091a-48fe-8cc4-4681e7ea47f3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.013903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d29aba4-091a-48fe-8cc4-4681e7ea47f3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.014514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d29aba4-091a-48fe-8cc4-4681e7ea47f3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.018887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d29aba4-091a-48fe-8cc4-4681e7ea47f3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.019539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d29aba4-091a-48fe-8cc4-4681e7ea47f3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.020147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d29aba4-091a-48fe-8cc4-4681e7ea47f3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.212800 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-32c2aec8-b3c8-4242-abd0-16002b788ea5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1463 microversion: 2.1 time: 0.260072 Aug 27 03:11:40.219886 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2982/5786] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:39 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1463 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:40.252458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2d29aba4-091a-48fe-8cc4-4681e7ea47f3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:40.261610 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2d29aba4-091a-48fe-8cc4-4681e7ea47f3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1392 microversion: 2.1 time: 0.286458 Aug 27 03:11:40.275098 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2805/5787] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:39 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1392 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:40.387287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3351f4a4-8f91-4d5a-b329-1646a886e195 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:40.387913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3351f4a4-8f91-4d5a-b329-1646a886e195 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:40.401764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3351f4a4-8f91-4d5a-b329-1646a886e195 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.403077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3351f4a4-8f91-4d5a-b329-1646a886e195 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.403851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3351f4a4-8f91-4d5a-b329-1646a886e195 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.405242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3351f4a4-8f91-4d5a-b329-1646a886e195 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:40.406203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3351f4a4-8f91-4d5a-b329-1646a886e195 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:40.410461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3351f4a4-8f91-4d5a-b329-1646a886e195 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:40.596754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3351f4a4-8f91-4d5a-b329-1646a886e195 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:40.609245 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3351f4a4-8f91-4d5a-b329-1646a886e195 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.225714 Aug 27 03:11:40.612008 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2983/5788] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:40 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:41.180503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ce34ef81-7da8-420e-bfa5-b03c0fea5880 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.181012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ce34ef81-7da8-420e-bfa5-b03c0fea5880 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.188296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce34ef81-7da8-420e-bfa5-b03c0fea5880 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.188879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce34ef81-7da8-420e-bfa5-b03c0fea5880 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.189358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce34ef81-7da8-420e-bfa5-b03c0fea5880 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.197154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce34ef81-7da8-420e-bfa5-b03c0fea5880 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.198623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce34ef81-7da8-420e-bfa5-b03c0fea5880 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.199266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce34ef81-7da8-420e-bfa5-b03c0fea5880 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.243079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ac4d7d1-18cf-4b6d-b5eb-7d3a05e699ae tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.243692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ac4d7d1-18cf-4b6d-b5eb-7d3a05e699ae tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.259085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ac4d7d1-18cf-4b6d-b5eb-7d3a05e699ae tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.261213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ac4d7d1-18cf-4b6d-b5eb-7d3a05e699ae tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.263459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ac4d7d1-18cf-4b6d-b5eb-7d3a05e699ae tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.264379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ac4d7d1-18cf-4b6d-b5eb-7d3a05e699ae tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.267151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ac4d7d1-18cf-4b6d-b5eb-7d3a05e699ae tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.270432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ac4d7d1-18cf-4b6d-b5eb-7d3a05e699ae tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.292699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ce34ef81-7da8-420e-bfa5-b03c0fea5880 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:11:41.326231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:41.424283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:41.445108 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ce34ef81-7da8-420e-bfa5-b03c0fea5880 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "DELETE /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 204 len: 0 microversion: 2.1 time: 0.267983 Aug 27 03:11:41.446167 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2806/5789] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:41 2022] DELETE /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:11:41.459634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-99d49615-3f21-4ec6-9c2e-ea9f1c40b86a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.461515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-99d49615-3f21-4ec6-9c2e-ea9f1c40b86a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.470034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d49615-3f21-4ec6-9c2e-ea9f1c40b86a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.471103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d49615-3f21-4ec6-9c2e-ea9f1c40b86a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.471560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d49615-3f21-4ec6-9c2e-ea9f1c40b86a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.472279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d49615-3f21-4ec6-9c2e-ea9f1c40b86a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.472744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d49615-3f21-4ec6-9c2e-ea9f1c40b86a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.473178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d49615-3f21-4ec6-9c2e-ea9f1c40b86a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.567529 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ac4d7d1-18cf-4b6d-b5eb-7d3a05e699ae tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1463 microversion: 2.1 time: 0.328195 Aug 27 03:11:41.569537 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2984/5790] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:41 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1463 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:41.583309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a17de82a-6484-4c94-9b8d-71cc9f238710 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.583309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a17de82a-6484-4c94-9b8d-71cc9f238710 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.597734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a17de82a-6484-4c94-9b8d-71cc9f238710 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.597973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a17de82a-6484-4c94-9b8d-71cc9f238710 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.598353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a17de82a-6484-4c94-9b8d-71cc9f238710 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.600738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a17de82a-6484-4c94-9b8d-71cc9f238710 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.601748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a17de82a-6484-4c94-9b8d-71cc9f238710 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.602191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a17de82a-6484-4c94-9b8d-71cc9f238710 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.704764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-99d49615-3f21-4ec6-9c2e-ea9f1c40b86a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:41.713828 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-99d49615-3f21-4ec6-9c2e-ea9f1c40b86a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1565 microversion: 2.1 time: 0.266292 Aug 27 03:11:41.714482 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2807/5791] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:41 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1565 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:41.719784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e95f1b4-4f06-43ee-a9b9-8d1c5ddba516 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.720447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2e95f1b4-4f06-43ee-a9b9-8d1c5ddba516 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.765348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e95f1b4-4f06-43ee-a9b9-8d1c5ddba516 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.766037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e95f1b4-4f06-43ee-a9b9-8d1c5ddba516 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.766642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e95f1b4-4f06-43ee-a9b9-8d1c5ddba516 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.767681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e95f1b4-4f06-43ee-a9b9-8d1c5ddba516 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.773507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e95f1b4-4f06-43ee-a9b9-8d1c5ddba516 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.773997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e95f1b4-4f06-43ee-a9b9-8d1c5ddba516 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.894074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a17de82a-6484-4c94-9b8d-71cc9f238710 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:41.906807 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a17de82a-6484-4c94-9b8d-71cc9f238710 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1515 microversion: 2.1 time: 0.335169 Aug 27 03:11:41.907677 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2985/5792] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:41 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1515 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:41.916325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-877abab5-6833-4e87-a660-390b2f05bbe8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:41.920643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-877abab5-6833-4e87-a660-390b2f05bbe8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:41.936320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877abab5-6833-4e87-a660-390b2f05bbe8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.936839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877abab5-6833-4e87-a660-390b2f05bbe8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.937291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877abab5-6833-4e87-a660-390b2f05bbe8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.938288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877abab5-6833-4e87-a660-390b2f05bbe8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:41.938766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877abab5-6833-4e87-a660-390b2f05bbe8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:41.940990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877abab5-6833-4e87-a660-390b2f05bbe8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:41.948997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2e95f1b4-4f06-43ee-a9b9-8d1c5ddba516 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:41.962408 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e95f1b4-4f06-43ee-a9b9-8d1c5ddba516 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.246723 Aug 27 03:11:41.978480 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2808/5793] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:41 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:42.133084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-877abab5-6833-4e87-a660-390b2f05bbe8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:42.145727 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-877abab5-6833-4e87-a660-390b2f05bbe8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1565 microversion: 2.1 time: 0.233097 Aug 27 03:11:42.146980 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2986/5794] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:41 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1565 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:42.591603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-35f4623d-96d8-4e7f-bf67-4d03dafe76e1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:42.592480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-35f4623d-96d8-4e7f-bf67-4d03dafe76e1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:42.601999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35f4623d-96d8-4e7f-bf67-4d03dafe76e1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.602750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35f4623d-96d8-4e7f-bf67-4d03dafe76e1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.603361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35f4623d-96d8-4e7f-bf67-4d03dafe76e1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.604304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35f4623d-96d8-4e7f-bf67-4d03dafe76e1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.604941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35f4623d-96d8-4e7f-bf67-4d03dafe76e1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.605562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35f4623d-96d8-4e7f-bf67-4d03dafe76e1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.882370 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-35f4623d-96d8-4e7f-bf67-4d03dafe76e1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1463 microversion: 2.1 time: 0.295101 Aug 27 03:11:42.884321 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2809/5795] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:42 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1463 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:42.929574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-74df9f8b-4be8-4f48-bfe2-ab98da739ebb tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:42.930483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-74df9f8b-4be8-4f48-bfe2-ab98da739ebb tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:42.940860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74df9f8b-4be8-4f48-bfe2-ab98da739ebb tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.941735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74df9f8b-4be8-4f48-bfe2-ab98da739ebb tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.942392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74df9f8b-4be8-4f48-bfe2-ab98da739ebb tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.943321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74df9f8b-4be8-4f48-bfe2-ab98da739ebb tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:42.944357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74df9f8b-4be8-4f48-bfe2-ab98da739ebb tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:42.944844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-74df9f8b-4be8-4f48-bfe2-ab98da739ebb tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:42.985648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-69bc83e5-d736-4c66-94f0-dd55103b5bcd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:42.999583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-69bc83e5-d736-4c66-94f0-dd55103b5bcd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:43.025373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69bc83e5-d736-4c66-94f0-dd55103b5bcd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.025907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69bc83e5-d736-4c66-94f0-dd55103b5bcd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.028775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69bc83e5-d736-4c66-94f0-dd55103b5bcd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.031904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69bc83e5-d736-4c66-94f0-dd55103b5bcd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.032570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69bc83e5-d736-4c66-94f0-dd55103b5bcd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.033910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69bc83e5-d736-4c66-94f0-dd55103b5bcd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.265316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-74df9f8b-4be8-4f48-bfe2-ab98da739ebb tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:43.275806 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-74df9f8b-4be8-4f48-bfe2-ab98da739ebb tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1515 microversion: 2.1 time: 0.352118 Aug 27 03:11:43.290934 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2987/5796] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:42 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1515 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:43.380783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-69bc83e5-d736-4c66-94f0-dd55103b5bcd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:43.389388 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-69bc83e5-d736-4c66-94f0-dd55103b5bcd tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.407610 Aug 27 03:11:43.391688 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2810/5797] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:42 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:43.904202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0dc04999-1c0a-437a-b92b-2d904c8c88c2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:43.904865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0dc04999-1c0a-437a-b92b-2d904c8c88c2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:43.915198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dc04999-1c0a-437a-b92b-2d904c8c88c2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.915702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dc04999-1c0a-437a-b92b-2d904c8c88c2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.916150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dc04999-1c0a-437a-b92b-2d904c8c88c2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.916878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dc04999-1c0a-437a-b92b-2d904c8c88c2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.917347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dc04999-1c0a-437a-b92b-2d904c8c88c2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.918846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0dc04999-1c0a-437a-b92b-2d904c8c88c2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.957910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d173c5f2-1888-4d93-b11b-3d48c15b7c8a req-311f732c-8c99-49e3-b157-a8a57ca2e6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca52f03a-2251-41c0-94ab-4d447dfaa216", "name": "network-vif-deleted", "tag": "58a78a94-0baf-4a30-b889-87659648ba1e"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:43.972787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d173c5f2-1888-4d93-b11b-3d48c15b7c8a req-311f732c-8c99-49e3-b157-a8a57ca2e6fb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:43.973274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d173c5f2-1888-4d93-b11b-3d48c15b7c8a req-311f732c-8c99-49e3-b157-a8a57ca2e6fb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:43.974016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d173c5f2-1888-4d93-b11b-3d48c15b7c8a req-311f732c-8c99-49e3-b157-a8a57ca2e6fb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:43.991120 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d173c5f2-1888-4d93-b11b-3d48c15b7c8a req-311f732c-8c99-49e3-b157-a8a57ca2e6fb service nova] Creating event network-vif-deleted:58a78a94-0baf-4a30-b889-87659648ba1e for instance ca52f03a-2251-41c0-94ab-4d447dfaa216 on n-h2-852084-5 Aug 27 03:11:43.999392 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d173c5f2-1888-4d93-b11b-3d48c15b7c8a req-311f732c-8c99-49e3-b157-a8a57ca2e6fb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047565 Aug 27 03:11:44.006011 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2811/5798] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:11:44.221324 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0dc04999-1c0a-437a-b92b-2d904c8c88c2 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1463 microversion: 2.1 time: 0.320743 Aug 27 03:11:44.225084 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2988/5799] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:43 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1463 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:44.301342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:44.302250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:44.336018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.337979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.339431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9b0b5d19-9d52-46e4-ab81-b64ad5bdf201 req-0d3cd45f-76e0-45eb-837e-74a26e03b7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce03990-8189-4bdf-9b6a-b8b09cb0e88c", "name": "network-vif-plugged", "status": "completed", "tag": "ac5e3276-091f-468e-89e8-5f4eca14e77d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:44.340187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.341024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.342969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.344193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.362082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b0b5d19-9d52-46e4-ab81-b64ad5bdf201 req-0d3cd45f-76e0-45eb-837e-74a26e03b7b7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.362447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b0b5d19-9d52-46e4-ab81-b64ad5bdf201 req-0d3cd45f-76e0-45eb-837e-74a26e03b7b7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.362930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9b0b5d19-9d52-46e4-ab81-b64ad5bdf201 req-0d3cd45f-76e0-45eb-837e-74a26e03b7b7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.389653 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9b0b5d19-9d52-46e4-ab81-b64ad5bdf201 req-0d3cd45f-76e0-45eb-837e-74a26e03b7b7 service nova] Creating event network-vif-plugged:ac5e3276-091f-468e-89e8-5f4eca14e77d for instance 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c on n-h2-852084-5 Aug 27 03:11:44.392066 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9b0b5d19-9d52-46e4-ab81-b64ad5bdf201 req-0d3cd45f-76e0-45eb-837e-74a26e03b7b7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057873 Aug 27 03:11:44.393828 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2989/5800] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:44.415659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.416634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.418557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.419476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lazy-loading 'fault' on Instance uuid ca52f03a-2251-41c0-94ab-4d447dfaa216 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:44.424187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-541a447d-4fd1-41b2-afed-602b29d3f352 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:44.425271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-541a447d-4fd1-41b2-afed-602b29d3f352 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:44.446199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-541a447d-4fd1-41b2-afed-602b29d3f352 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.453081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-541a447d-4fd1-41b2-afed-602b29d3f352 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.453551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-541a447d-4fd1-41b2-afed-602b29d3f352 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.454339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-541a447d-4fd1-41b2-afed-602b29d3f352 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:44.460553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-541a447d-4fd1-41b2-afed-602b29d3f352 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:44.461083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-541a447d-4fd1-41b2-afed-602b29d3f352 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:44.496192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:44.506859 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0309f3a3-5fa5-46e9-86ee-cfc9240dd06f tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 200 len: 1309 microversion: 2.1 time: 0.211080 Aug 27 03:11:44.519003 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2812/5801] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:44 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 1309 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:44.946215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:45.107533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-541a447d-4fd1-41b2-afed-602b29d3f352 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:45.117174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ee69d539-3117-4ef5-8ad8-f7f120953664 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:45.118028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ee69d539-3117-4ef5-8ad8-f7f120953664 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:45.120452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:45.120843 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-541a447d-4fd1-41b2-afed-602b29d3f352 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.710389 Aug 27 03:11:45.121281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=12 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:45.122534 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2990/5802] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:44 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:45.128452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b5f17de7-b6c7-4756-a6df-49c52949f73c req-8078bd20-4503-4161-b0dc-2da096222d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e139e1-f1cf-437c-a02d-acbd52fea8be", "tag": "42706765-ea3d-4a18-9703-6df239805dcc"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:45.148310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee69d539-3117-4ef5-8ad8-f7f120953664 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.148730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee69d539-3117-4ef5-8ad8-f7f120953664 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.149965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee69d539-3117-4ef5-8ad8-f7f120953664 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.150702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5f17de7-b6c7-4756-a6df-49c52949f73c req-8078bd20-4503-4161-b0dc-2da096222d15 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.150928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee69d539-3117-4ef5-8ad8-f7f120953664 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.151820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee69d539-3117-4ef5-8ad8-f7f120953664 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.152460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ee69d539-3117-4ef5-8ad8-f7f120953664 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.154065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5f17de7-b6c7-4756-a6df-49c52949f73c req-8078bd20-4503-4161-b0dc-2da096222d15 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.156180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b5f17de7-b6c7-4756-a6df-49c52949f73c req-8078bd20-4503-4161-b0dc-2da096222d15 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.184330 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b5f17de7-b6c7-4756-a6df-49c52949f73c req-8078bd20-4503-4161-b0dc-2da096222d15 service nova] Creating event network-changed:42706765-ea3d-4a18-9703-6df239805dcc for instance 39e139e1-f1cf-437c-a02d-acbd52fea8be on n-h2-852084-5 Aug 27 03:11:45.193094 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b5f17de7-b6c7-4756-a6df-49c52949f73c req-8078bd20-4503-4161-b0dc-2da096222d15 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067176 Aug 27 03:11:45.196165 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2991/5803] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:45.251700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-123cf6e7-29ad-4388-8676-931ec4b45ee6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:45.253030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-123cf6e7-29ad-4388-8676-931ec4b45ee6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:45.262315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123cf6e7-29ad-4388-8676-931ec4b45ee6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.262805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123cf6e7-29ad-4388-8676-931ec4b45ee6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.263243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123cf6e7-29ad-4388-8676-931ec4b45ee6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.266446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123cf6e7-29ad-4388-8676-931ec4b45ee6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.269192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123cf6e7-29ad-4388-8676-931ec4b45ee6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.269641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-123cf6e7-29ad-4388-8676-931ec4b45ee6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.407626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ee69d539-3117-4ef5-8ad8-f7f120953664 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:45.417392 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ee69d539-3117-4ef5-8ad8-f7f120953664 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1565 microversion: 2.1 time: 0.304799 Aug 27 03:11:45.431754 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2813/5804] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:45 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1565 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:45.533332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:45.534686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: ca52f03a-2251-41c0-94ab-4d447dfaa216] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:45.552079 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-123cf6e7-29ad-4388-8676-931ec4b45ee6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1463 microversion: 2.1 time: 0.305300 Aug 27 03:11:45.552079 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2992/5805] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:45 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1463 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:45.552237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.552418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.553025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.553925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:45.554534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:45.554958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:45.910110 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] HTTP exception thrown: Instance ca52f03a-2251-41c0-94ab-4d447dfaa216 could not be found. Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Request method failure captured: Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 HTTP/1.1 Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYq7DByIyocg5BBmR6ovEjSrCIgUsMH5ZnXFGCNRlVJYHps8SkQgmlsvD_8CFbiLJ_si_MSKV9ZWRb5gkLeyt2qpEoGn--MQ47SDdQvIY2UlMrvsq1fz7HDvdwb-xHChqeNkWSu8NUm4BfLGAAKGdazIPOvVzcuggWLOBLG1trf5Zqc Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: da217e12fb3f4722980397872caf49b4 Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1997264621 Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_da217e12fb3f4722980397872caf49b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/da217e12fb3f4722980397872caf49b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/da217e12fb3f4722980397872caf49b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/da217e12fb3f4722980397872caf49b4"}]}] Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-VolumesSnapshotTestJSON-1997264621 Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: da217e12fb3f4722980397872caf49b4 Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1997264621 Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-VolumesSnapshotTestJSON-1997264621-project Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 13762a04c0b545d1bc45118446bf06df Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-VolumesSnapshotTestJSON-1997264621-project Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance ca52f03a-2251-41c0-94ab-4d447dfaa216 could not be found. Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'ca52f03a-2251-41c0-94ab-4d447dfaa216'} Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca52f03a-2251-41c0-94ab-4d447dfaa216 could not be found. Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca52f03a-2251-41c0-94ab-4d447dfaa216 could not be found. Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:45.912418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:45.919285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:45.919285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:45.919285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:45.919285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:45.919285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:45.919285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca52f03a-2251-41c0-94ab-4d447dfaa216 could not be found. Aug 27 03:11:45.919285 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:45.919285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Returning 404 to user: Instance ca52f03a-2251-41c0-94ab-4d447dfaa216 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:45.919285 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e2b5e338-3461-4772-ae4b-fbcc83c3c436 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216" status: 404 len: 111 microversion: 2.1 time: 0.388601 Aug 27 03:11:45.924180 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2814/5806] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:45 2022] GET /compute/v2.1/servers/ca52f03a-2251-41c0-94ab-4d447dfaa216 => generated 111 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:11:46.147877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-72bae7e7-bb49-4c9f-b207-cafde974b44f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.148525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-72bae7e7-bb49-4c9f-b207-cafde974b44f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:46.166245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72bae7e7-bb49-4c9f-b207-cafde974b44f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.166245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72bae7e7-bb49-4c9f-b207-cafde974b44f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.166245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72bae7e7-bb49-4c9f-b207-cafde974b44f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.166245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72bae7e7-bb49-4c9f-b207-cafde974b44f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.166245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72bae7e7-bb49-4c9f-b207-cafde974b44f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.166245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72bae7e7-bb49-4c9f-b207-cafde974b44f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.379446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-72bae7e7-bb49-4c9f-b207-cafde974b44f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:46.401159 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-72bae7e7-bb49-4c9f-b207-cafde974b44f tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.257604 Aug 27 03:11:46.402357 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2993/5807] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:46 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:46.570629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-78ea307d-cffe-48d6-b383-66f433ea02bf tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.571380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-78ea307d-cffe-48d6-b383-66f433ea02bf tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:46.585457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78ea307d-cffe-48d6-b383-66f433ea02bf tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.592072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78ea307d-cffe-48d6-b383-66f433ea02bf tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.593080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78ea307d-cffe-48d6-b383-66f433ea02bf tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.595694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78ea307d-cffe-48d6-b383-66f433ea02bf tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.596472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78ea307d-cffe-48d6-b383-66f433ea02bf tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.604995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-78ea307d-cffe-48d6-b383-66f433ea02bf tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.876543 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-78ea307d-cffe-48d6-b383-66f433ea02bf tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1648 microversion: 2.1 time: 0.309772 Aug 27 03:11:46.891289 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2815/5808] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:46 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1648 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:46.899450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0193cf2b-32f2-4d58-b574-e7f895a75dcc tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:46.901152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0193cf2b-32f2-4d58-b574-e7f895a75dcc tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:46.909332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0193cf2b-32f2-4d58-b574-e7f895a75dcc tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.910205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0193cf2b-32f2-4d58-b574-e7f895a75dcc tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.911552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0193cf2b-32f2-4d58-b574-e7f895a75dcc tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:46.912399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0193cf2b-32f2-4d58-b574-e7f895a75dcc tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:46.912972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0193cf2b-32f2-4d58-b574-e7f895a75dcc tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:46.913499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0193cf2b-32f2-4d58-b574-e7f895a75dcc tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.135415 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0193cf2b-32f2-4d58-b574-e7f895a75dcc tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1648 microversion: 2.1 time: 0.239926 Aug 27 03:11:47.137334 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2994/5809] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:46 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1648 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:47.162011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-970c0bab-ab32-4aba-bbd6-3eac50815071 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.164644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-970c0bab-ab32-4aba-bbd6-3eac50815071 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:47.175271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970c0bab-ab32-4aba-bbd6-3eac50815071 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.175965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970c0bab-ab32-4aba-bbd6-3eac50815071 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.176499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970c0bab-ab32-4aba-bbd6-3eac50815071 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.177386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970c0bab-ab32-4aba-bbd6-3eac50815071 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.178223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970c0bab-ab32-4aba-bbd6-3eac50815071 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.179073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-970c0bab-ab32-4aba-bbd6-3eac50815071 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.396701 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-970c0bab-ab32-4aba-bbd6-3eac50815071 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1648 microversion: 2.1 time: 0.242137 Aug 27 03:11:47.401521 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2816/5810] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:47 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1648 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:47.422131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bf2ef98f-6066-45a5-89cf-acb1588b8e68 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.422699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-57e34c08-cdce-441d-9963-9b88c99ce419 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.422953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-57e34c08-cdce-441d-9963-9b88c99ce419 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:47.423690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bf2ef98f-6066-45a5-89cf-acb1588b8e68 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:47.430831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57e34c08-cdce-441d-9963-9b88c99ce419 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.431373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57e34c08-cdce-441d-9963-9b88c99ce419 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.432232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57e34c08-cdce-441d-9963-9b88c99ce419 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.432778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57e34c08-cdce-441d-9963-9b88c99ce419 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.433349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57e34c08-cdce-441d-9963-9b88c99ce419 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.433599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57e34c08-cdce-441d-9963-9b88c99ce419 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.453448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:47.456276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf2ef98f-6066-45a5-89cf-acb1588b8e68 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.458364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf2ef98f-6066-45a5-89cf-acb1588b8e68 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.460066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf2ef98f-6066-45a5-89cf-acb1588b8e68 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.462649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf2ef98f-6066-45a5-89cf-acb1588b8e68 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.464575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf2ef98f-6066-45a5-89cf-acb1588b8e68 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.474974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf2ef98f-6066-45a5-89cf-acb1588b8e68 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.523395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bf2ef98f-6066-45a5-89cf-acb1588b8e68 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:11:47.640124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-57e34c08-cdce-441d-9963-9b88c99ce419 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:47.652162 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-57e34c08-cdce-441d-9963-9b88c99ce419 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.233578 Aug 27 03:11:47.661710 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2817/5811] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:47 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:47.733014 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bf2ef98f-6066-45a5-89cf-acb1588b8e68 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "DELETE /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 204 len: 0 microversion: 2.1 time: 0.313579 Aug 27 03:11:47.740267 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2995/5812] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:47 2022] DELETE /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:11:47.743389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a1cbbda6-990f-4cf4-a222-f823dfc4a09a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:47.744183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a1cbbda6-990f-4cf4-a222-f823dfc4a09a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:47.755109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1cbbda6-990f-4cf4-a222-f823dfc4a09a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.757948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1cbbda6-990f-4cf4-a222-f823dfc4a09a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.759718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1cbbda6-990f-4cf4-a222-f823dfc4a09a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.761742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1cbbda6-990f-4cf4-a222-f823dfc4a09a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:47.762437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1cbbda6-990f-4cf4-a222-f823dfc4a09a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:47.765321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1cbbda6-990f-4cf4-a222-f823dfc4a09a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:47.988346 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a1cbbda6-990f-4cf4-a222-f823dfc4a09a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1654 microversion: 2.1 time: 0.249085 Aug 27 03:11:47.994620 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2818/5813] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:47 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1654 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:48.677573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5b602803-19f4-49f4-827d-383468ed0d25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:48.679011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5b602803-19f4-49f4-827d-383468ed0d25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:48.688040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b602803-19f4-49f4-827d-383468ed0d25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.689366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b602803-19f4-49f4-827d-383468ed0d25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.690270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b602803-19f4-49f4-827d-383468ed0d25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:48.691593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b602803-19f4-49f4-827d-383468ed0d25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:48.692382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b602803-19f4-49f4-827d-383468ed0d25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:48.693268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b602803-19f4-49f4-827d-383468ed0d25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.017416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-69e21730-4e98-406b-825b-2d530646765f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:49.018268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-69e21730-4e98-406b-825b-2d530646765f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:49.029613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69e21730-4e98-406b-825b-2d530646765f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.030738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69e21730-4e98-406b-825b-2d530646765f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.032790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69e21730-4e98-406b-825b-2d530646765f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.034010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69e21730-4e98-406b-825b-2d530646765f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:49.034725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69e21730-4e98-406b-825b-2d530646765f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:49.035324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69e21730-4e98-406b-825b-2d530646765f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:49.045473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5b602803-19f4-49f4-827d-383468ed0d25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:49.067955 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5b602803-19f4-49f4-827d-383468ed0d25 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.394357 Aug 27 03:11:49.068582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2996/5814] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:48 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:49.348059 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-69e21730-4e98-406b-825b-2d530646765f tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1654 microversion: 2.1 time: 0.335032 Aug 27 03:11:49.351199 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2819/5815] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:49 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1654 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:49.971263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-40432dbe-bb49-4626-bcfd-7e54675b667b req-66753e78-8f94-4155-8cb2-a9434305f0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce03990-8189-4bdf-9b6a-b8b09cb0e88c", "name": "network-vif-deleted", "tag": "ac5e3276-091f-468e-89e8-5f4eca14e77d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:50.014747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-40432dbe-bb49-4626-bcfd-7e54675b667b req-66753e78-8f94-4155-8cb2-a9434305f0d8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.016993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-40432dbe-bb49-4626-bcfd-7e54675b667b req-66753e78-8f94-4155-8cb2-a9434305f0d8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.017644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-40432dbe-bb49-4626-bcfd-7e54675b667b req-66753e78-8f94-4155-8cb2-a9434305f0d8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.044402 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-40432dbe-bb49-4626-bcfd-7e54675b667b req-66753e78-8f94-4155-8cb2-a9434305f0d8 service nova] Creating event network-vif-deleted:ac5e3276-091f-468e-89e8-5f4eca14e77d for instance 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c on n-h2-852084-5 Aug 27 03:11:50.077578 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-40432dbe-bb49-4626-bcfd-7e54675b667b req-66753e78-8f94-4155-8cb2-a9434305f0d8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120701 Aug 27 03:11:50.079026 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2997/5816] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:50.092449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5cdec993-45aa-49a0-be93-61b77ccf1fc0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:50.093109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5cdec993-45aa-49a0-be93-61b77ccf1fc0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:50.104395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdec993-45aa-49a0-be93-61b77ccf1fc0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.104901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdec993-45aa-49a0-be93-61b77ccf1fc0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.106717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdec993-45aa-49a0-be93-61b77ccf1fc0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.112281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdec993-45aa-49a0-be93-61b77ccf1fc0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.113890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdec993-45aa-49a0-be93-61b77ccf1fc0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.114545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdec993-45aa-49a0-be93-61b77ccf1fc0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.371500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:50.372210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:50.392380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.394005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.394675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.395589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.396241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.396857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.496296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:50.497856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:50.498620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:50.501696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lazy-loading 'fault' on Instance uuid 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:50.594503 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb364ef0-67bc-491d-9d13-6da22ba6d0e6 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 200 len: 1453 microversion: 2.1 time: 0.224422 Aug 27 03:11:50.596991 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2998/5817] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:50 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 1453 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:11:50.631631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5cdec993-45aa-49a0-be93-61b77ccf1fc0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:50.658689 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5cdec993-45aa-49a0-be93-61b77ccf1fc0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1511 microversion: 2.1 time: 0.570017 Aug 27 03:11:50.659947 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2820/5818] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:50 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1511 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:51.624597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:51.627491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:51.650804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.652553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.653539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.655179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.656185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.657353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.684444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-10727429-ca32-437b-9a11-1c4fd4f6492b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:51.686158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-10727429-ca32-437b-9a11-1c4fd4f6492b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:51.697155 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] HTTP exception thrown: Instance 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c could not be found. Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Request method failure captured: Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c HTTP/1.1 Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYtPcKhqPHVY5-iVCxu3w8YphB2WiPVekdooSFrh1eeS3ukaX4Y0ghyqP3UE02hsW34l_rqqMZ7J6aKOp9oR_IaVZPcpHCErdDRhdTzgFKIX4AKVckFxlCrX6hGdBRMjbckS7oD5HmkyR65_KGRlVQ9dQfnWhbf3aCmFV_WJe3-eKJQ Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 277f7b5dbdfb4c8d919e5e5943bac75e Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestServerMultinode-764057792 Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_277f7b5dbdfb4c8d919e5e5943bac75e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/277f7b5dbdfb4c8d919e5e5943bac75e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/277f7b5dbdfb4c8d919e5e5943bac75e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/277f7b5dbdfb4c8d919e5e5943bac75e"}]}] Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestServerMultinode-764057792 Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 277f7b5dbdfb4c8d919e5e5943bac75e Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestServerMultinode-764057792 Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestServerMultinode-764057792-project-admin Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 37e0b7514c85409992af41ca5dc12191 Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestServerMultinode-764057792-project-admin Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c could not be found. Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '7ce03990-8189-4bdf-9b6a-b8b09cb0e88c'} Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c could not be found. Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c could not be found. Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:51.701032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:51.707855 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:51.707855 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:51.707855 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:51.707855 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:51.707855 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:51.707855 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c could not be found. Aug 27 03:11:51.707855 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:51.712842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10727429-ca32-437b-9a11-1c4fd4f6492b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.712842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10727429-ca32-437b-9a11-1c4fd4f6492b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.712842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10727429-ca32-437b-9a11-1c4fd4f6492b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.712842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10727429-ca32-437b-9a11-1c4fd4f6492b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.712842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10727429-ca32-437b-9a11-1c4fd4f6492b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.712842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10727429-ca32-437b-9a11-1c4fd4f6492b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.717911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Returning 404 to user: Instance 7ce03990-8189-4bdf-9b6a-b8b09cb0e88c could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:51.717911 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-afdc3a5b-a573-470d-9a88-d10399f5dae1 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c" status: 404 len: 111 microversion: 2.1 time: 0.102919 Aug 27 03:11:51.719012 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 2999/5819] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:51 2022] GET /compute/v2.1/servers/7ce03990-8189-4bdf-9b6a-b8b09cb0e88c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:51.728389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-85c2ce2f-a86d-4ed3-9d3d-1e7ec271f12a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:51.729428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-85c2ce2f-a86d-4ed3-9d3d-1e7ec271f12a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:51.739954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85c2ce2f-a86d-4ed3-9d3d-1e7ec271f12a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.741147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85c2ce2f-a86d-4ed3-9d3d-1e7ec271f12a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.744863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85c2ce2f-a86d-4ed3-9d3d-1e7ec271f12a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.746031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85c2ce2f-a86d-4ed3-9d3d-1e7ec271f12a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.747559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85c2ce2f-a86d-4ed3-9d3d-1e7ec271f12a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.749423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85c2ce2f-a86d-4ed3-9d3d-1e7ec271f12a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.811951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-85c2ce2f-a86d-4ed3-9d3d-1e7ec271f12a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:11:51.854785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:51.943948 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-85c2ce2f-a86d-4ed3-9d3d-1e7ec271f12a tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "DELETE /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 204 len: 0 microversion: 2.1 time: 0.218781 Aug 27 03:11:51.946601 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3000/5820] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:51 2022] DELETE /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:11:51.968570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-16afd217-6b46-4687-b013-3aeacddfa2c5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:51.969900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-16afd217-6b46-4687-b013-3aeacddfa2c5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:51.977771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16afd217-6b46-4687-b013-3aeacddfa2c5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.978718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16afd217-6b46-4687-b013-3aeacddfa2c5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.980317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16afd217-6b46-4687-b013-3aeacddfa2c5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:51.981262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16afd217-6b46-4687-b013-3aeacddfa2c5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:51.982046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16afd217-6b46-4687-b013-3aeacddfa2c5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:51.982787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16afd217-6b46-4687-b013-3aeacddfa2c5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.213363 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-16afd217-6b46-4687-b013-3aeacddfa2c5 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1654 microversion: 2.1 time: 0.260694 Aug 27 03:11:52.223565 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3001/5821] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:51 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1654 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:52.287818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-10727429-ca32-437b-9a11-1c4fd4f6492b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:52.314940 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-10727429-ca32-437b-9a11-1c4fd4f6492b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1488 microversion: 2.1 time: 0.636510 Aug 27 03:11:52.316890 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2821/5822] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:51 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1488 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:52.344296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5012657d-ea61-4625-8469-252ce70f57e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-704198174"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:52.347730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5012657d-ea61-4625-8469-252ce70f57e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:52.354967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5012657d-ea61-4625-8469-252ce70f57e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.355672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5012657d-ea61-4625-8469-252ce70f57e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.356310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5012657d-ea61-4625-8469-252ce70f57e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.357169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5012657d-ea61-4625-8469-252ce70f57e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.357806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5012657d-ea61-4625-8469-252ce70f57e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.358545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5012657d-ea61-4625-8469-252ce70f57e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.487855 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5012657d-ea61-4625-8469-252ce70f57e7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "PUT /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1060 microversion: 2.1 time: 0.143423 Aug 27 03:11:52.488962 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3002/5823] 10.222.0.99 () {60 vars in 1256 bytes} [Sat Aug 27 03:11:52 2022] PUT /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1060 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:52.506100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-688d4c35-c798-4fb4-9262-ad0d95f1496c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:52.507078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-688d4c35-c798-4fb4-9262-ad0d95f1496c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:52.513778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688d4c35-c798-4fb4-9262-ad0d95f1496c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.514341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688d4c35-c798-4fb4-9262-ad0d95f1496c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.514841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688d4c35-c798-4fb4-9262-ad0d95f1496c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.516236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688d4c35-c798-4fb4-9262-ad0d95f1496c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.516756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688d4c35-c798-4fb4-9262-ad0d95f1496c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.517274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-688d4c35-c798-4fb4-9262-ad0d95f1496c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.779924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-688d4c35-c798-4fb4-9262-ad0d95f1496c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:52.793773 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-688d4c35-c798-4fb4-9262-ad0d95f1496c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1487 microversion: 2.1 time: 0.291434 Aug 27 03:11:52.813297 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2822/5824] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:52 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1487 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:52.817577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1ab90e89-6fd5-487f-839e-4ee1dcc6cf13 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:52.819040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1ab90e89-6fd5-487f-839e-4ee1dcc6cf13 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:52.847356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab90e89-6fd5-487f-839e-4ee1dcc6cf13 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.847855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab90e89-6fd5-487f-839e-4ee1dcc6cf13 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.848300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab90e89-6fd5-487f-839e-4ee1dcc6cf13 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:52.849014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab90e89-6fd5-487f-839e-4ee1dcc6cf13 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:52.849474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab90e89-6fd5-487f-839e-4ee1dcc6cf13 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:52.849944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1ab90e89-6fd5-487f-839e-4ee1dcc6cf13 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.081757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1ab90e89-6fd5-487f-839e-4ee1dcc6cf13 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:53.101969 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1ab90e89-6fd5-487f-839e-4ee1dcc6cf13 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1487 microversion: 2.1 time: 0.285063 Aug 27 03:11:53.121622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-079b452a-895c-4699-8318-777c1efadb08 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:53.124321 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3003/5825] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:52 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1487 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:53.125740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-079b452a-895c-4699-8318-777c1efadb08 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:53.140239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-079b452a-895c-4699-8318-777c1efadb08 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.145530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-079b452a-895c-4699-8318-777c1efadb08 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.146703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-079b452a-895c-4699-8318-777c1efadb08 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.149842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-079b452a-895c-4699-8318-777c1efadb08 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.150546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-079b452a-895c-4699-8318-777c1efadb08 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.150952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-079b452a-895c-4699-8318-777c1efadb08 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.214605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-079b452a-895c-4699-8318-777c1efadb08 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:11:53.239584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a10485ba-f10e-4e34-b627-f4fa99842fcd tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:53.241607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a10485ba-f10e-4e34-b627-f4fa99842fcd tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:53.253740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a10485ba-f10e-4e34-b627-f4fa99842fcd tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.255651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a10485ba-f10e-4e34-b627-f4fa99842fcd tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.256465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a10485ba-f10e-4e34-b627-f4fa99842fcd tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.257467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a10485ba-f10e-4e34-b627-f4fa99842fcd tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.258255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a10485ba-f10e-4e34-b627-f4fa99842fcd tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.258926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a10485ba-f10e-4e34-b627-f4fa99842fcd tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.385239 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-079b452a-895c-4699-8318-777c1efadb08 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 204 len: 0 microversion: 2.1 time: 0.267024 Aug 27 03:11:53.396722 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2823/5826] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:53 2022] DELETE /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:11:53.407889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-57a5daa4-3f07-45a8-b336-c58629900493 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:53.409318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-57a5daa4-3f07-45a8-b336-c58629900493 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:53.417583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57a5daa4-3f07-45a8-b336-c58629900493 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.418334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57a5daa4-3f07-45a8-b336-c58629900493 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.418982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57a5daa4-3f07-45a8-b336-c58629900493 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.422793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57a5daa4-3f07-45a8-b336-c58629900493 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:53.423687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57a5daa4-3f07-45a8-b336-c58629900493 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:53.424300 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57a5daa4-3f07-45a8-b336-c58629900493 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:53.685818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-57a5daa4-3f07-45a8-b336-c58629900493 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:53.695658 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-57a5daa4-3f07-45a8-b336-c58629900493 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1493 microversion: 2.1 time: 0.293915 Aug 27 03:11:53.696966 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2824/5827] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:53 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1493 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:53.936881 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a10485ba-f10e-4e34-b627-f4fa99842fcd tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1654 microversion: 2.1 time: 0.704707 Aug 27 03:11:53.945690 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3004/5828] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:53 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1654 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:54.728268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a2b4994-52a9-4604-8ddd-7e522366da68 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:54.728806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6a2b4994-52a9-4604-8ddd-7e522366da68 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:54.755361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2b4994-52a9-4604-8ddd-7e522366da68 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.756006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2b4994-52a9-4604-8ddd-7e522366da68 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.756467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2b4994-52a9-4604-8ddd-7e522366da68 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.763089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2b4994-52a9-4604-8ddd-7e522366da68 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.763612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2b4994-52a9-4604-8ddd-7e522366da68 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:54.767521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a2b4994-52a9-4604-8ddd-7e522366da68 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:54.965655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8012d3f-e785-4e02-926e-12cf2c78a2aa tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:54.966314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c8012d3f-e785-4e02-926e-12cf2c78a2aa tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:54.987147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8012d3f-e785-4e02-926e-12cf2c78a2aa tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:54.994653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8012d3f-e785-4e02-926e-12cf2c78a2aa tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.001496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8012d3f-e785-4e02-926e-12cf2c78a2aa tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.002395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8012d3f-e785-4e02-926e-12cf2c78a2aa tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:55.008341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8012d3f-e785-4e02-926e-12cf2c78a2aa tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:55.008909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8012d3f-e785-4e02-926e-12cf2c78a2aa tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:55.348415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a2b4994-52a9-4604-8ddd-7e522366da68 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:55.364532 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6a2b4994-52a9-4604-8ddd-7e522366da68 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1493 microversion: 2.1 time: 0.639613 Aug 27 03:11:55.366329 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2825/5829] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:54 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1493 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:55.487282 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c8012d3f-e785-4e02-926e-12cf2c78a2aa tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1654 microversion: 2.1 time: 0.525918 Aug 27 03:11:55.487997 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3005/5830] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:54 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1654 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:56.336521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e8dacb6a-8aa4-439c-85fc-1481c9a7e71e req-435aabdf-8258-4680-b3dc-6dfad25a9ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473c482f-6e41-4e0d-b4d8-c7899f687132", "name": "network-vif-deleted", "tag": "25ac8f67-4134-4030-b358-f9a34a8941c3"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:56.396432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-08caad1f-bc48-4aa8-aa62-e53d5b724f21 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:56.397062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-08caad1f-bc48-4aa8-aa62-e53d5b724f21 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:56.419263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08caad1f-bc48-4aa8-aa62-e53d5b724f21 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.422702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08caad1f-bc48-4aa8-aa62-e53d5b724f21 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.424312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e8dacb6a-8aa4-439c-85fc-1481c9a7e71e req-435aabdf-8258-4680-b3dc-6dfad25a9ff7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.426711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08caad1f-bc48-4aa8-aa62-e53d5b724f21 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.434738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08caad1f-bc48-4aa8-aa62-e53d5b724f21 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.435670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e8dacb6a-8aa4-439c-85fc-1481c9a7e71e req-435aabdf-8258-4680-b3dc-6dfad25a9ff7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.436329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08caad1f-bc48-4aa8-aa62-e53d5b724f21 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.436997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e8dacb6a-8aa4-439c-85fc-1481c9a7e71e req-435aabdf-8258-4680-b3dc-6dfad25a9ff7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.438121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-08caad1f-bc48-4aa8-aa62-e53d5b724f21 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.483504 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e8dacb6a-8aa4-439c-85fc-1481c9a7e71e req-435aabdf-8258-4680-b3dc-6dfad25a9ff7 service nova] Creating event network-vif-deleted:25ac8f67-4134-4030-b358-f9a34a8941c3 for instance 473c482f-6e41-4e0d-b4d8-c7899f687132 on n-h1-852084-5 Aug 27 03:11:56.496846 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e8dacb6a-8aa4-439c-85fc-1481c9a7e71e req-435aabdf-8258-4680-b3dc-6dfad25a9ff7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166309 Aug 27 03:11:56.498697 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2826/5831] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:56.514550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:56.515613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:56.531895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.537189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.538112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.539118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.542360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.543063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.663213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:56.667637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:56.668409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:56.669109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lazy-loading 'fault' on Instance uuid 473c482f-6e41-4e0d-b4d8-c7899f687132 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:11:56.820826 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d53ea1ca-cab7-4702-9028-516dab7453db tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 200 len: 1454 microversion: 2.1 time: 0.315894 Aug 27 03:11:56.837705 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2827/5832] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:56 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 1454 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:56.854298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-396845238", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "bd21fd31-43fa-43fa-b78f-9df8b3e7ded8"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:56.874923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-08caad1f-bc48-4aa8-aa62-e53d5b724f21 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:56.883758 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-08caad1f-bc48-4aa8-aa62-e53d5b724f21 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 200 len: 1451 microversion: 2.1 time: 0.491380 Aug 27 03:11:56.905263 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3006/5833] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:56 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 1451 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:57.010164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] validate_networks() for [('bd21fd31-43fa-43fa-b78f-9df8b3e7ded8', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:11:57.784875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:11:57.786078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:11:57.786988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:11:57.787591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:11:57.788451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:11:57.815233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.816590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.817603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.820024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.821158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.824050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.849050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:57.849699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] [instance: 473c482f-6e41-4e0d-b4d8-c7899f687132] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:57.864640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.873814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.874499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.878645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.879535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.880172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.882602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Getting quotas for project da217e12fb3f4722980397872caf49b4. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:11:57.908990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Getting quotas for user 13762a04c0b545d1bc45118446bf06df and project da217e12fb3f4722980397872caf49b4. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:11:57.911304 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] HTTP exception thrown: Instance 473c482f-6e41-4e0d-b4d8-c7899f687132 could not be found. Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Request method failure captured: Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 HTTP/1.1 Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYtPcKhqPHVY5-iVCxu3w8YphB2WiPVekdooSFrh1eeS3ukaX4Y0ghyqP3UE02hsW34l_rqqMZ7J6aKOp9oR_IaVZPcpHCErdDRhdTzgFKIX4AKVckFxlCrX6hGdBRMjbckS7oD5HmkyR65_KGRlVQ9dQfnWhbf3aCmFV_WJe3-eKJQ Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 277f7b5dbdfb4c8d919e5e5943bac75e Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestServerMultinode-764057792 Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_277f7b5dbdfb4c8d919e5e5943bac75e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/277f7b5dbdfb4c8d919e5e5943bac75e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/277f7b5dbdfb4c8d919e5e5943bac75e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/277f7b5dbdfb4c8d919e5e5943bac75e"}]}] Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestServerMultinode-764057792 Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 277f7b5dbdfb4c8d919e5e5943bac75e Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestServerMultinode-764057792 Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestServerMultinode-764057792-project-admin Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 37e0b7514c85409992af41ca5dc12191 Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestServerMultinode-764057792-project-admin Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 473c482f-6e41-4e0d-b4d8-c7899f687132 could not be found. Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '473c482f-6e41-4e0d-b4d8-c7899f687132'} Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473c482f-6e41-4e0d-b4d8-c7899f687132 could not be found. Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473c482f-6e41-4e0d-b4d8-c7899f687132 could not be found. Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:57.924179 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:57.928103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:57.928103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:57.928103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:57.928103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:57.928103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:57.928103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473c482f-6e41-4e0d-b4d8-c7899f687132 could not be found. Aug 27 03:11:57.928103 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:57.940010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] Returning 404 to user: Instance 473c482f-6e41-4e0d-b4d8-c7899f687132 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:57.941070 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a1e8fd73-8f17-4ed5-9e96-1f139fd78248 tempest-TestServerMultinode-764057792 tempest-TestServerMultinode-764057792-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132" status: 404 len: 111 microversion: 2.1 time: 0.096107 Aug 27 03:11:57.944176 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3007/5834] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:57 2022] GET /compute/v2.1/servers/473c482f-6e41-4e0d-b4d8-c7899f687132 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:11:57.951165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:11:57.957882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:57.959946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:57.960667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:11:57.975223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.976120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.976778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:57.978374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:57.979068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:57.980615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.020045 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 HTTP/1.1 Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3'} Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.026753 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.032124 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.032124 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.032124 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:58.032124 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:58.032124 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.032124 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.033446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:58.034485 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ca9577e-bc99-4cc1-a679-7a4690e319a4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 404 len: 111 microversion: 2.1 time: 0.088808 Aug 27 03:11:58.035163 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3008/5835] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:57 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:58.062956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.064161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.086636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.087555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.088230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.089322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.093093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.094684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.099304 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-34a2362f-c36f-406e-8b8e-c364794c810e tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.262650 Aug 27 03:11:58.107625 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2828/5836] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:11:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:11:58.120389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e73b44e4-8f67-4853-b6c4-2f47c1d57a91 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.123406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e73b44e4-8f67-4853-b6c4-2f47c1d57a91 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.157727 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 HTTP/1.1 Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3'} Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:58.159549 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.163406 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.163406 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.163406 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.163406 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.163406 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.163406 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.163406 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:58.163406 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:58.163406 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.163406 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.167815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:58.172036 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e44e8edd-f4bb-4499-a9a8-8e6655332cf3 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 404 len: 111 microversion: 2.1 time: 0.122631 Aug 27 03:11:58.172891 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3009/5837] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:58 2022] DELETE /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:58.199667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.203116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.226807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.227478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.228047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.230442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.231027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.232514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.264429 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 HTTP/1.1 Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3'} Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.267043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.272010 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.272010 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.272010 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:58.272010 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:58.272010 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. Aug 27 03:11:58.272010 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.273820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:58.276027 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-46c17df3-0032-4493-8bfe-1a0f43425d02 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3" status: 404 len: 111 microversion: 2.1 time: 0.096913 Aug 27 03:11:58.279346 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3010/5838] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:58 2022] GET /compute/v2.1/servers/e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:58.295291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.295993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.309006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.314203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.314844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.315764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.316376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.316959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.346065 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 HTTP/1.1 Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '938495d8-b417-4178-b9dc-746025756c12'} Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:58.349585 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:11:58.353901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.353901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.353901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.353901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.353901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.353901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.353901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:58.353901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:58.353901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:11:58.353901 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.356829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:58.363671 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd3ca13e-491e-498d-b13b-3cfccb03777d tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 404 len: 111 microversion: 2.1 time: 0.078686 Aug 27 03:11:58.364500 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3011/5839] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:58 2022] DELETE /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:58.372401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.374914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 938495d8-b417-4178-b9dc-746025756c12] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.392206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.393205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.393901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.396065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.398029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.399396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.429211 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 HTTP/1.1 Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '938495d8-b417-4178-b9dc-746025756c12'} Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.435441 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.439889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.439889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.439889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:58.439889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:58.439889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. Aug 27 03:11:58.439889 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.449490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 938495d8-b417-4178-b9dc-746025756c12 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:58.451014 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f33407c7-af68-4a2c-ac50-7b9a88835f53 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12" status: 404 len: 111 microversion: 2.1 time: 0.082114 Aug 27 03:11:58.451787 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3012/5840] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:58 2022] GET /compute/v2.1/servers/938495d8-b417-4178-b9dc-746025756c12 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:11:58.463123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.464069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.476946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.480204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.480673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.481413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.481914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.482347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.520176 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f HTTP/1.1 Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '40517cd1-5505-42bc-8d7e-4d92b189a48f'} Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:58.521988 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:58.528002 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-afde7de1-68ad-45d4-bfea-c50c047d9f7b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 404 len: 111 microversion: 2.1 time: 0.066928 Aug 27 03:11:58.528753 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3013/5841] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:58 2022] DELETE /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:11:58.536503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.537103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 40517cd1-5505-42bc-8d7e-4d92b189a48f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.551448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:11:58.559710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.560221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.560663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.561543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.562641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.563037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.590726 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f HTTP/1.1 Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '40517cd1-5505-42bc-8d7e-4d92b189a48f'} Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.592647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.598171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.598171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.598171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:58.598171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:58.598171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. Aug 27 03:11:58.598171 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.598171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 40517cd1-5505-42bc-8d7e-4d92b189a48f could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:58.598171 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d189540b-bdd3-4434-97a0-6931d52de71c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f" status: 404 len: 111 microversion: 2.1 time: 0.065276 Aug 27 03:11:58.598171 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3014/5842] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:58 2022] GET /compute/v2.1/servers/40517cd1-5505-42bc-8d7e-4d92b189a48f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:58.604317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.604899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.614801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.615379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.615833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.616574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.617039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.617473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.634129 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 HTTP/1.1 Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '27ffeac7-84af-4b89-ac5f-43bfe9ef1d62'} Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:58.636029 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:11:58.640946 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.640946 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.640946 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.640946 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.640946 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.640946 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.640946 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:58.640946 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:58.640946 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:11:58.640946 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.643384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:58.645587 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a25db39f-36e6-49fe-a606-234c0c9dcc78 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 404 len: 111 microversion: 2.1 time: 0.045026 Aug 27 03:11:58.649396 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3015/5843] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:58 2022] DELETE /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:11:58.654782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.655408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.662293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.662756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.663198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.663909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.664367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.664797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.710751 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 HTTP/1.1 Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '27ffeac7-84af-4b89-ac5f-43bfe9ef1d62'} Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.719088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.722979 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.722979 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.722979 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:58.722979 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:58.722979 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. Aug 27 03:11:58.722979 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.722979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:58.722979 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-577e8d18-d7ae-4e7a-9a40-83f1a9697d27 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62" status: 404 len: 111 microversion: 2.1 time: 0.070280 Aug 27 03:11:58.722979 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3016/5844] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:58 2022] GET /compute/v2.1/servers/27ffeac7-84af-4b89-ac5f-43bfe9ef1d62 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:58.738108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-3810bd2f-f090-41fc-8bd9-c7b39862a04b req-42bedb4c-0ab7-4963-a708-f21d31da8cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3", "name": "network-vif-deleted", "tag": "d2cc96bc-d8e2-4390-ac2d-f97d418fc641"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:11:58.763242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3810bd2f-f090-41fc-8bd9-c7b39862a04b req-42bedb4c-0ab7-4963-a708-f21d31da8cc3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.764246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3810bd2f-f090-41fc-8bd9-c7b39862a04b req-42bedb4c-0ab7-4963-a708-f21d31da8cc3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.767145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3810bd2f-f090-41fc-8bd9-c7b39862a04b req-42bedb4c-0ab7-4963-a708-f21d31da8cc3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.798456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e73b44e4-8f67-4853-b6c4-2f47c1d57a91 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:11:58.809767 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-3810bd2f-f090-41fc-8bd9-c7b39862a04b req-42bedb4c-0ab7-4963-a708-f21d31da8cc3 service nova] Creating event network-vif-deleted:d2cc96bc-d8e2-4390-ac2d-f97d418fc641 for instance e4c6ea4d-8b25-4f46-9ea3-6fd797ebb1f3 on n-h1-852084-5 Aug 27 03:11:58.846451 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e73b44e4-8f67-4853-b6c4-2f47c1d57a91 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1218 microversion: 2.1 time: 0.737507 Aug 27 03:11:58.847508 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2829/5845] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:58 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1218 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:11:58.852963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.853943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.869589 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-3810bd2f-f090-41fc-8bd9-c7b39862a04b req-42bedb4c-0ab7-4963-a708-f21d31da8cc3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133502 Aug 27 03:11:58.870301 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3017/5846] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:11:58.874502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.875509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.877060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.878379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.879038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.880142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:58.912595 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 HTTP/1.1 Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'f99082a4-a42d-435b-acc8-7b8310aeb1e9'} Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:58.914586 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:11:58.919442 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.919442 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:58.919442 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.919442 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:58.919442 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:58.919442 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:58.919442 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:58.919442 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:58.919442 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:11:58.919442 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:58.921618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:58.924646 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ea9e4d42-9d50-4b59-82b7-2d6cafdb34df tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 404 len: 111 microversion: 2.1 time: 0.074200 Aug 27 03:11:58.925820 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2830/5847] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:58 2022] DELETE /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:58.951013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:58.956325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: f99082a4-a42d-435b-acc8-7b8310aeb1e9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:58.990213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:58.993786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:58.999144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.000953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.001698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.002384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.053116 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 HTTP/1.1 Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'f99082a4-a42d-435b-acc8-7b8310aeb1e9'} Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.065147 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.069535 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:59.069535 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:59.069535 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:59.069535 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:59.069535 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. Aug 27 03:11:59.069535 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.071541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance f99082a4-a42d-435b-acc8-7b8310aeb1e9 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:59.075177 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-312ee406-3548-44a5-8407-c62edf33982b tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9" status: 404 len: 111 microversion: 2.1 time: 0.144387 Aug 27 03:11:59.076290 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3018/5848] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:58 2022] GET /compute/v2.1/servers/f99082a4-a42d-435b-acc8-7b8310aeb1e9 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:59.085712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.086364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.100922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.104011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.104745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.105750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.106489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.107148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.126922 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 HTTP/1.1 Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '7fae5841-1db7-4f9b-a5df-ebf9714cfc43'} Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:59.138406 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:11:59.142500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.142500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:59.142500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.142500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.142500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:59.142500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:59.142500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:59.142500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:59.142500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:11:59.142500 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.149913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:59.152933 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5f18ca4f-4a12-451a-a088-a2687945acc4 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 404 len: 111 microversion: 2.1 time: 0.071788 Aug 27 03:11:59.155006 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2831/5849] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:59 2022] DELETE /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:59.164760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.165398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 7fae5841-1db7-4f9b-a5df-ebf9714cfc43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.183894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.185211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.192094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.192870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.193348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.198139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.259611 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 HTTP/1.1 Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '7fae5841-1db7-4f9b-a5df-ebf9714cfc43'} Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.267481 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.272071 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:59.272071 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:59.272071 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:59.272071 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:59.272071 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. Aug 27 03:11:59.272071 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.275667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 7fae5841-1db7-4f9b-a5df-ebf9714cfc43 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:59.278110 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-32342943-d8a6-4f6b-9d75-e69caef0f2c7 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43" status: 404 len: 111 microversion: 2.1 time: 0.116971 Aug 27 03:11:59.285048 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3019/5850] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:59 2022] GET /compute/v2.1/servers/7fae5841-1db7-4f9b-a5df-ebf9714cfc43 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:59.290060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04072c42-b1e3-4979-9741-6a2ae6dc4e3c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.290742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-04072c42-b1e3-4979-9741-6a2ae6dc4e3c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: c4b962a7-433f-426d-bbaf-49e6824a5684] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.300903 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-04072c42-b1e3-4979-9741-6a2ae6dc4e3c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04072c42-b1e3-4979-9741-6a2ae6dc4e3c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/c4b962a7-433f-426d-bbaf-49e6824a5684 HTTP/1.1 Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'c4b962a7-433f-426d-bbaf-49e6824a5684'} Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:59.304097 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.308923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.308923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:59.308923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:59.308923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:59.308923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:59.308923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:11:59.308923 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.314136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-04072c42-b1e3-4979-9741-6a2ae6dc4e3c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:59.315463 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-04072c42-b1e3-4979-9741-6a2ae6dc4e3c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/c4b962a7-433f-426d-bbaf-49e6824a5684" status: 404 len: 111 microversion: 2.1 time: 0.031110 Aug 27 03:11:59.318792 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2832/5851] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:59 2022] DELETE /compute/v2.1/servers/c4b962a7-433f-426d-bbaf-49e6824a5684 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:11:59.325535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f610230f-2a8c-427c-842d-c8689f8cd4e8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.326445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f610230f-2a8c-427c-842d-c8689f8cd4e8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: c4b962a7-433f-426d-bbaf-49e6824a5684] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.340218 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f610230f-2a8c-427c-842d-c8689f8cd4e8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f610230f-2a8c-427c-842d-c8689f8cd4e8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/c4b962a7-433f-426d-bbaf-49e6824a5684 HTTP/1.1 Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'c4b962a7-433f-426d-bbaf-49e6824a5684'} Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:11:59.349820 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:11:59.356098 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:11:59.356098 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:11:59.356098 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. Aug 27 03:11:59.356098 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:11:59.356098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f610230f-2a8c-427c-842d-c8689f8cd4e8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance c4b962a7-433f-426d-bbaf-49e6824a5684 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:11:59.356098 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f610230f-2a8c-427c-842d-c8689f8cd4e8 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/c4b962a7-433f-426d-bbaf-49e6824a5684" status: 404 len: 111 microversion: 2.1 time: 0.029854 Aug 27 03:11:59.356098 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3020/5852] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:59 2022] GET /compute/v2.1/servers/c4b962a7-433f-426d-bbaf-49e6824a5684 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:11:59.360889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d8213af9-173d-4caf-a6fc-b0451ab7e1e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.361478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d8213af9-173d-4caf-a6fc-b0451ab7e1e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.385144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8213af9-173d-4caf-a6fc-b0451ab7e1e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.386140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8213af9-173d-4caf-a6fc-b0451ab7e1e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.389303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8213af9-173d-4caf-a6fc-b0451ab7e1e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.405307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8213af9-173d-4caf-a6fc-b0451ab7e1e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.408585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8213af9-173d-4caf-a6fc-b0451ab7e1e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.409308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8213af9-173d-4caf-a6fc-b0451ab7e1e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.479373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d8213af9-173d-4caf-a6fc-b0451ab7e1e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:11:59.685492 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d8213af9-173d-4caf-a6fc-b0451ab7e1e6 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 204 len: 0 microversion: 2.1 time: 0.329104 Aug 27 03:11:59.689778 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2833/5853] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:11:59 2022] DELETE /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:11:59.696834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-677b25a3-2128-4cca-828d-e3f13c7f9dd0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.698908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-677b25a3-2128-4cca-828d-e3f13c7f9dd0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.708192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-677b25a3-2128-4cca-828d-e3f13c7f9dd0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.709064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-677b25a3-2128-4cca-828d-e3f13c7f9dd0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.709804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-677b25a3-2128-4cca-828d-e3f13c7f9dd0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.711003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-677b25a3-2128-4cca-828d-e3f13c7f9dd0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.711708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-677b25a3-2128-4cca-828d-e3f13c7f9dd0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.714032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-677b25a3-2128-4cca-828d-e3f13c7f9dd0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.869980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-463fecc8-7c8f-4c79-8880-75453bb2ab5a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:11:59.870893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-463fecc8-7c8f-4c79-8880-75453bb2ab5a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:11:59.887463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463fecc8-7c8f-4c79-8880-75453bb2ab5a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.888043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463fecc8-7c8f-4c79-8880-75453bb2ab5a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.888504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463fecc8-7c8f-4c79-8880-75453bb2ab5a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:11:59.889267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463fecc8-7c8f-4c79-8880-75453bb2ab5a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:11:59.889758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463fecc8-7c8f-4c79-8880-75453bb2ab5a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:11:59.891715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-463fecc8-7c8f-4c79-8880-75453bb2ab5a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:00.076923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-677b25a3-2128-4cca-828d-e3f13c7f9dd0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:00.086391 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-677b25a3-2128-4cca-828d-e3f13c7f9dd0 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1479 microversion: 2.1 time: 0.394751 Aug 27 03:12:00.087689 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3021/5854] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:59 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1479 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:00.161161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-463fecc8-7c8f-4c79-8880-75453bb2ab5a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:00.172808 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-463fecc8-7c8f-4c79-8880-75453bb2ab5a tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1270 microversion: 2.1 time: 0.307765 Aug 27 03:12:00.176275 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2834/5855] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:11:59 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1270 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:01.107990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a4e7f48-f7aa-4a87-88d7-67e35efa0b95 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:01.109804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4a4e7f48-f7aa-4a87-88d7-67e35efa0b95 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:01.126186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4e7f48-f7aa-4a87-88d7-67e35efa0b95 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:01.126766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4e7f48-f7aa-4a87-88d7-67e35efa0b95 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:01.127206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4e7f48-f7aa-4a87-88d7-67e35efa0b95 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.127914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4e7f48-f7aa-4a87-88d7-67e35efa0b95 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:01.128618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4e7f48-f7aa-4a87-88d7-67e35efa0b95 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:01.129197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a4e7f48-f7aa-4a87-88d7-67e35efa0b95 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.200831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dac26d28-7acf-4dbb-83c1-24fb1bb08496 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:01.215771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dac26d28-7acf-4dbb-83c1-24fb1bb08496 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:01.232863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac26d28-7acf-4dbb-83c1-24fb1bb08496 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:01.233746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac26d28-7acf-4dbb-83c1-24fb1bb08496 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:01.235630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac26d28-7acf-4dbb-83c1-24fb1bb08496 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.236726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac26d28-7acf-4dbb-83c1-24fb1bb08496 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:01.237794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac26d28-7acf-4dbb-83c1-24fb1bb08496 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:01.238398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dac26d28-7acf-4dbb-83c1-24fb1bb08496 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:01.244454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:01.432262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dac26d28-7acf-4dbb-83c1-24fb1bb08496 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:01.451200 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dac26d28-7acf-4dbb-83c1-24fb1bb08496 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1270 microversion: 2.1 time: 0.255071 Aug 27 03:12:01.454665 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2835/5856] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:01 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1270 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:02.031874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4a4e7f48-f7aa-4a87-88d7-67e35efa0b95 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:02.045446 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a4e7f48-f7aa-4a87-88d7-67e35efa0b95 tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1479 microversion: 2.1 time: 0.941487 Aug 27 03:12:02.046114 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3022/5857] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:01 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1479 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:02.477474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8bfce07f-b425-4841-ac21-f0293b19c585 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:02.478801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8bfce07f-b425-4841-ac21-f0293b19c585 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:02.512858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8bfce07f-b425-4841-ac21-f0293b19c585 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:02.516172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8bfce07f-b425-4841-ac21-f0293b19c585 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:02.516807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8bfce07f-b425-4841-ac21-f0293b19c585 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:02.520138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8bfce07f-b425-4841-ac21-f0293b19c585 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:02.524812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8bfce07f-b425-4841-ac21-f0293b19c585 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:02.525146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8bfce07f-b425-4841-ac21-f0293b19c585 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:02.915293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-322767e2-0c88-4aaf-84fe-f72be725aaf6 req-a0d1cbc7-f123-42ce-bc6a-5bb51704d64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b67ef45-5e14-458d-a30b-c126f3f6fc9f", "name": "network-vif-deleted", "tag": "782d272b-7cd1-4d7b-8895-06b7e7b13067"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:02.955462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-322767e2-0c88-4aaf-84fe-f72be725aaf6 req-a0d1cbc7-f123-42ce-bc6a-5bb51704d64c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:02.958638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-322767e2-0c88-4aaf-84fe-f72be725aaf6 req-a0d1cbc7-f123-42ce-bc6a-5bb51704d64c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:02.959766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-322767e2-0c88-4aaf-84fe-f72be725aaf6 req-a0d1cbc7-f123-42ce-bc6a-5bb51704d64c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.002530 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-322767e2-0c88-4aaf-84fe-f72be725aaf6 req-a0d1cbc7-f123-42ce-bc6a-5bb51704d64c service nova] Creating event network-vif-deleted:782d272b-7cd1-4d7b-8895-06b7e7b13067 for instance 4b67ef45-5e14-458d-a30b-c126f3f6fc9f on n-h1-852084-5 Aug 27 03:12:03.014240 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-322767e2-0c88-4aaf-84fe-f72be725aaf6 req-a0d1cbc7-f123-42ce-bc6a-5bb51704d64c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104872 Aug 27 03:12:03.018084 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3023/5858] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:03.070638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:03.071767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:03.114404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:03.114865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:03.115324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.118975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:03.119532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:03.119984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.215777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8bfce07f-b425-4841-ac21-f0293b19c585 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:03.235108 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8bfce07f-b425-4841-ac21-f0293b19c585 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1276 microversion: 2.1 time: 0.762381 Aug 27 03:12:03.238868 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2836/5859] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:02 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1276 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:03.264301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:03.267275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:03.267967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:03.269163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lazy-loading 'fault' on Instance uuid 4b67ef45-5e14-458d-a30b-c126f3f6fc9f {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:03.646096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756fff89d19d41869dad9425eddd55c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a939dc355345c8b827ca4538afec54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:03.661724 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8cfb8d7a-296b-482e-b2fe-f4559fbea6ed tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 200 len: 1282 microversion: 2.1 time: 0.597105 Aug 27 03:12:03.664708 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3024/5860] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:03 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 1282 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:04.270784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f1d1e8b1-32fb-4298-809c-a774bdba4eb7 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:04.292313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f1d1e8b1-32fb-4298-809c-a774bdba4eb7 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:04.301927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d1e8b1-32fb-4298-809c-a774bdba4eb7 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:04.302421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d1e8b1-32fb-4298-809c-a774bdba4eb7 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:04.302878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d1e8b1-32fb-4298-809c-a774bdba4eb7 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:04.303585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d1e8b1-32fb-4298-809c-a774bdba4eb7 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:04.304043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d1e8b1-32fb-4298-809c-a774bdba4eb7 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:04.304467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1d1e8b1-32fb-4298-809c-a774bdba4eb7 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:04.545505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f1d1e8b1-32fb-4298-809c-a774bdba4eb7 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:04.584216 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f1d1e8b1-32fb-4298-809c-a774bdba4eb7 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1318 microversion: 2.1 time: 0.315227 Aug 27 03:12:04.604734 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2837/5861] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:04 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:04.686309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:04.688102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] [instance: 4b67ef45-5e14-458d-a30b-c126f3f6fc9f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:04.711642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:04.718993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:04.720816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:04.724783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:04.727132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:04.728347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:04.770844 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] HTTP exception thrown: Instance 4b67ef45-5e14-458d-a30b-c126f3f6fc9f could not be found. Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Request method failure captured: Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f HTTP/1.1 Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqqdn73P4j4BzqEJLfHGU_jBqCDwlxAkkUK23qDk4IuvhKnEM5t76cUll2UgJe6Kb1ByIXbbc7g2_ZlhbaOgdcYYMAHxMQz2Ezuw_z8igbtVcJzNq55hqehuh4AhfvbUYf3hJcRpDu9ea_RuvJ2OG2NcuxK5HX9LA2XUC595zhJwtg Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersTestJSON-334958753 Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a939dc355345c8b827ca4538afec54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a939dc355345c8b827ca4538afec54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a939dc355345c8b827ca4538afec54"}]}] Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersTestJSON-334958753 Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 55a939dc355345c8b827ca4538afec54 Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersTestJSON-334958753 Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersTestJSON-334958753-project Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 756fff89d19d41869dad9425eddd55c1 Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersTestJSON-334958753-project Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 4b67ef45-5e14-458d-a30b-c126f3f6fc9f could not be found. Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4b67ef45-5e14-458d-a30b-c126f3f6fc9f'} Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b67ef45-5e14-458d-a30b-c126f3f6fc9f could not be found. Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b67ef45-5e14-458d-a30b-c126f3f6fc9f could not be found. Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:12:04.782117 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:04.787064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:04.787064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:04.787064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:04.787064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:04.787064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b67ef45-5e14-458d-a30b-c126f3f6fc9f could not be found. Aug 27 03:12:04.787064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:12:04.787064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] Returning 404 to user: Instance 4b67ef45-5e14-458d-a30b-c126f3f6fc9f could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:04.787064 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c8d7bc27-d298-4e5a-b10c-e7f860f8785c tempest-ServersTestJSON-334958753 tempest-ServersTestJSON-334958753-project] 10.222.0.99 "GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f" status: 404 len: 111 microversion: 2.1 time: 0.105212 Aug 27 03:12:04.792052 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3025/5862] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:04 2022] GET /compute/v2.1/servers/4b67ef45-5e14-458d-a30b-c126f3f6fc9f => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:12:05.611647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0c12d50e-0981-4136-9152-272a3c8ffd47 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:05.612271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0c12d50e-0981-4136-9152-272a3c8ffd47 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:05.616628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:05.629839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c12d50e-0981-4136-9152-272a3c8ffd47 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:05.630355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c12d50e-0981-4136-9152-272a3c8ffd47 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:05.632271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c12d50e-0981-4136-9152-272a3c8ffd47 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:05.633415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c12d50e-0981-4136-9152-272a3c8ffd47 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:05.636141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c12d50e-0981-4136-9152-272a3c8ffd47 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:05.641067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c12d50e-0981-4136-9152-272a3c8ffd47 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.039619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-918adefc-8753-47ef-8dec-7f24c607d1bf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:06.043152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-918adefc-8753-47ef-8dec-7f24c607d1bf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:06.053964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-918adefc-8753-47ef-8dec-7f24c607d1bf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:06.054784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-918adefc-8753-47ef-8dec-7f24c607d1bf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:06.055463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-918adefc-8753-47ef-8dec-7f24c607d1bf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.056554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-918adefc-8753-47ef-8dec-7f24c607d1bf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:06.057457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-918adefc-8753-47ef-8dec-7f24c607d1bf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:06.058281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-918adefc-8753-47ef-8dec-7f24c607d1bf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.083108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:06.146174 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-918adefc-8753-47ef-8dec-7f24c607d1bf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be/action" status: 200 len: 24578 microversion: 2.1 time: 0.109869 Aug 27 03:12:06.147907 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3026/5863] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:12:06 2022] POST /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be/action => generated 24578 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:12:06.158618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ac6f59b7-724c-4073-bbd7-311384d31e69 req-1690adde-ab57-4938-bff8-73118cec0f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c9f438-4c95-4232-a2a3-f8262bac3c1b", "tag": "13b1ddf6-4bd1-4a01-bcd2-e9db4eaeec19"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:06.188503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ac6f59b7-724c-4073-bbd7-311384d31e69 req-1690adde-ab57-4938-bff8-73118cec0f90 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:06.189162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ac6f59b7-724c-4073-bbd7-311384d31e69 req-1690adde-ab57-4938-bff8-73118cec0f90 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:06.190543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ac6f59b7-724c-4073-bbd7-311384d31e69 req-1690adde-ab57-4938-bff8-73118cec0f90 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:06.213202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0c12d50e-0981-4136-9152-272a3c8ffd47 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:06.225752 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0c12d50e-0981-4136-9152-272a3c8ffd47 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1318 microversion: 2.1 time: 0.617903 Aug 27 03:12:06.229019 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ac6f59b7-724c-4073-bbd7-311384d31e69 req-1690adde-ab57-4938-bff8-73118cec0f90 service nova] Creating event network-changed:13b1ddf6-4bd1-4a01-bcd2-e9db4eaeec19 for instance 18c9f438-4c95-4232-a2a3-f8262bac3c1b on n-h1-852084-5 Aug 27 03:12:06.238163 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2838/5864] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:05 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1318 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:06.240153 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ac6f59b7-724c-4073-bbd7-311384d31e69 req-1690adde-ab57-4938-bff8-73118cec0f90 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090022 Aug 27 03:12:06.243141 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3027/5865] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:07.252085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a407221-5430-406a-90e2-289eee8781e8 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:07.252925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5a407221-5430-406a-90e2-289eee8781e8 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:07.271848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a407221-5430-406a-90e2-289eee8781e8 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:07.277208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a407221-5430-406a-90e2-289eee8781e8 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:07.282421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a407221-5430-406a-90e2-289eee8781e8 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:07.285915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a407221-5430-406a-90e2-289eee8781e8 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:07.287595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a407221-5430-406a-90e2-289eee8781e8 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:07.294734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a407221-5430-406a-90e2-289eee8781e8 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:07.855466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:07.940435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5a407221-5430-406a-90e2-289eee8781e8 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:07.953020 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a407221-5430-406a-90e2-289eee8781e8 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1318 microversion: 2.1 time: 0.706718 Aug 27 03:12:07.954995 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2839/5866] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:07 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1318 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:08.984231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-83d63271-123b-4a6a-ab6c-445dd56e96e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:08.985635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-83d63271-123b-4a6a-ab6c-445dd56e96e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:08.998347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83d63271-123b-4a6a-ab6c-445dd56e96e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:08.999197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83d63271-123b-4a6a-ab6c-445dd56e96e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:09.000097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83d63271-123b-4a6a-ab6c-445dd56e96e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:09.000974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83d63271-123b-4a6a-ab6c-445dd56e96e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:09.001584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83d63271-123b-4a6a-ab6c-445dd56e96e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:09.002264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83d63271-123b-4a6a-ab6c-445dd56e96e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:09.986779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-83d63271-123b-4a6a-ab6c-445dd56e96e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:09.995925 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-83d63271-123b-4a6a-ab6c-445dd56e96e6 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1318 microversion: 2.1 time: 1.023090 Aug 27 03:12:10.000352 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3028/5867] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:08 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1318 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:11.021689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e556b159-d632-4ab1-beb6-1aa4fdcaf9e0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:11.023002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e556b159-d632-4ab1-beb6-1aa4fdcaf9e0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:11.025929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:11.058135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e556b159-d632-4ab1-beb6-1aa4fdcaf9e0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:11.059551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e556b159-d632-4ab1-beb6-1aa4fdcaf9e0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:11.060019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e556b159-d632-4ab1-beb6-1aa4fdcaf9e0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.060977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e556b159-d632-4ab1-beb6-1aa4fdcaf9e0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:11.065237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e556b159-d632-4ab1-beb6-1aa4fdcaf9e0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:11.065984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e556b159-d632-4ab1-beb6-1aa4fdcaf9e0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:11.349799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e556b159-d632-4ab1-beb6-1aa4fdcaf9e0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:11.359545 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e556b159-d632-4ab1-beb6-1aa4fdcaf9e0 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1318 microversion: 2.1 time: 0.342341 Aug 27 03:12:11.360157 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2840/5868] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:11 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:12.382343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-19170107-34ca-46fc-8151-1b3c7d3053e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:12.384261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-19170107-34ca-46fc-8151-1b3c7d3053e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:12.406066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19170107-34ca-46fc-8151-1b3c7d3053e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.407786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19170107-34ca-46fc-8151-1b3c7d3053e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.408469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19170107-34ca-46fc-8151-1b3c7d3053e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.411818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19170107-34ca-46fc-8151-1b3c7d3053e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:12.412808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19170107-34ca-46fc-8151-1b3c7d3053e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:12.414412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19170107-34ca-46fc-8151-1b3c7d3053e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:12.897940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-19170107-34ca-46fc-8151-1b3c7d3053e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:12.910438 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-19170107-34ca-46fc-8151-1b3c7d3053e9 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1318 microversion: 2.1 time: 0.533095 Aug 27 03:12:12.914122 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3029/5869] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:12 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:13.941803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e3a8453-85cb-41c0-ab4a-e6bab7f00418 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:13.942208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5e3a8453-85cb-41c0-ab4a-e6bab7f00418 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:13.958356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e3a8453-85cb-41c0-ab4a-e6bab7f00418 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:13.959548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e3a8453-85cb-41c0-ab4a-e6bab7f00418 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:13.960652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e3a8453-85cb-41c0-ab4a-e6bab7f00418 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:13.961765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e3a8453-85cb-41c0-ab4a-e6bab7f00418 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:13.962643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e3a8453-85cb-41c0-ab4a-e6bab7f00418 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:13.963470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e3a8453-85cb-41c0-ab4a-e6bab7f00418 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.262364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5e3a8453-85cb-41c0-ab4a-e6bab7f00418 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:14.303010 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5e3a8453-85cb-41c0-ab4a-e6bab7f00418 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1318 microversion: 2.1 time: 0.366709 Aug 27 03:12:14.307958 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2841/5870] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:13 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:14.431528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d31ecfb5-4e0c-43de-b5ab-b8f871f60485 req-bcb0b6a7-bfec-449c-864d-032658111779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c9f438-4c95-4232-a2a3-f8262bac3c1b", "name": "network-vif-plugged", "status": "completed", "tag": "13b1ddf6-4bd1-4a01-bcd2-e9db4eaeec19"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:14.456866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d31ecfb5-4e0c-43de-b5ab-b8f871f60485 req-bcb0b6a7-bfec-449c-864d-032658111779 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:14.457358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d31ecfb5-4e0c-43de-b5ab-b8f871f60485 req-bcb0b6a7-bfec-449c-864d-032658111779 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:14.459311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d31ecfb5-4e0c-43de-b5ab-b8f871f60485 req-bcb0b6a7-bfec-449c-864d-032658111779 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:14.486978 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d31ecfb5-4e0c-43de-b5ab-b8f871f60485 req-bcb0b6a7-bfec-449c-864d-032658111779 service nova] Creating event network-vif-plugged:13b1ddf6-4bd1-4a01-bcd2-e9db4eaeec19 for instance 18c9f438-4c95-4232-a2a3-f8262bac3c1b on n-h1-852084-5 Aug 27 03:12:14.496152 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d31ecfb5-4e0c-43de-b5ab-b8f871f60485 req-bcb0b6a7-bfec-449c-864d-032658111779 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068593 Aug 27 03:12:14.497313 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3030/5871] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:15.328721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dc45eb08-9e50-4dd9-ab81-317cae6c1e88 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:15.329415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dc45eb08-9e50-4dd9-ab81-317cae6c1e88 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:15.345286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc45eb08-9e50-4dd9-ab81-317cae6c1e88 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:15.346381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc45eb08-9e50-4dd9-ab81-317cae6c1e88 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:15.348368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc45eb08-9e50-4dd9-ab81-317cae6c1e88 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:15.350060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc45eb08-9e50-4dd9-ab81-317cae6c1e88 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:15.360428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc45eb08-9e50-4dd9-ab81-317cae6c1e88 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:15.361304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc45eb08-9e50-4dd9-ab81-317cae6c1e88 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:15.623778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dc45eb08-9e50-4dd9-ab81-317cae6c1e88 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:15.635687 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dc45eb08-9e50-4dd9-ab81-317cae6c1e88 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1318 microversion: 2.1 time: 0.311515 Aug 27 03:12:15.638881 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2842/5872] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:15 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:16.664644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d4d7bad-95a8-4ecc-860f-82f656d727ae tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:16.665435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1d4d7bad-95a8-4ecc-860f-82f656d727ae tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:16.676757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4d7bad-95a8-4ecc-860f-82f656d727ae tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:16.676757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4d7bad-95a8-4ecc-860f-82f656d727ae tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:16.676757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4d7bad-95a8-4ecc-860f-82f656d727ae tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:16.677267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4d7bad-95a8-4ecc-860f-82f656d727ae tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:16.677937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4d7bad-95a8-4ecc-860f-82f656d727ae tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:16.678485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d4d7bad-95a8-4ecc-860f-82f656d727ae tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:16.861554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1d4d7bad-95a8-4ecc-860f-82f656d727ae tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:16.875311 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1d4d7bad-95a8-4ecc-860f-82f656d727ae tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1508 microversion: 2.1 time: 0.217331 Aug 27 03:12:16.878290 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3031/5873] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:16 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:16.915083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f27573d-bc81-4728-b30f-7b69f1ac23b5 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "598cbe42-9d7e-42c1-8f34-928e247e871a", "device": "/dev/sdb"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:16.919024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8f27573d-bc81-4728-b30f-7b69f1ac23b5 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:16.925701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f27573d-bc81-4728-b30f-7b69f1ac23b5 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:16.926306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f27573d-bc81-4728-b30f-7b69f1ac23b5 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:16.927040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f27573d-bc81-4728-b30f-7b69f1ac23b5 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:16.928174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f27573d-bc81-4728-b30f-7b69f1ac23b5 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:16.929130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f27573d-bc81-4728-b30f-7b69f1ac23b5 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:16.929760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f27573d-bc81-4728-b30f-7b69f1ac23b5 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.188396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ecd02d6a-59d2-4ab5-b85a-139fcebf1175 tempest-ExtensionsTest-311682883 tempest-ExtensionsTest-311682883-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:17.190611 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ecd02d6a-59d2-4ab5-b85a-139fcebf1175 tempest-ExtensionsTest-311682883 tempest-ExtensionsTest-311682883-project] 10.222.0.99 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.338836 Aug 27 03:12:17.191892 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2843/5874] 10.222.0.99 () {58 vars in 1170 bytes} [Sat Aug 27 03:12:16 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:17.200040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b8dec0b8-4cb3-4b55-b1d8-b9a6d2317440 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:17.200847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b8dec0b8-4cb3-4b55-b1d8-b9a6d2317440 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:17.211446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dec0b8-4cb3-4b55-b1d8-b9a6d2317440 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.212177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dec0b8-4cb3-4b55-b1d8-b9a6d2317440 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.212623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dec0b8-4cb3-4b55-b1d8-b9a6d2317440 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.213357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dec0b8-4cb3-4b55-b1d8-b9a6d2317440 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.213921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dec0b8-4cb3-4b55-b1d8-b9a6d2317440 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.214535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dec0b8-4cb3-4b55-b1d8-b9a6d2317440 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.269880 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f27573d-bc81-4728-b30f-7b69f1ac23b5 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "POST /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359084 Aug 27 03:12:17.271300 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3032/5875] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:12:16 2022] POST /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:17.284844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7588b6b7-7efe-4ae0-9f62-d5e679a3f3cf tempest-ExtensionsTest-311682883 tempest-ExtensionsTest-311682883-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:17.291649 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7588b6b7-7efe-4ae0-9f62-d5e679a3f3cf tempest-ExtensionsTest-311682883 tempest-ExtensionsTest-311682883-project] 10.222.0.99 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.016435 Aug 27 03:12:17.293905 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3033/5876] 10.222.0.99 () {58 vars in 1134 bytes} [Sat Aug 27 03:12:17 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:12:17.414102 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b8dec0b8-4cb3-4b55-b1d8-b9a6d2317440 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1834 microversion: 2.1 time: 0.220361 Aug 27 03:12:17.416197 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2844/5877] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:17 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1834 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:17.442059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c86a9339-c052-450f-bede-777d7c7b04ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:17.442806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c86a9339-c052-450f-bede-777d7c7b04ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:17.449937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c86a9339-c052-450f-bede-777d7c7b04ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.450723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c86a9339-c052-450f-bede-777d7c7b04ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.452388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c86a9339-c052-450f-bede-777d7c7b04ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.453567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c86a9339-c052-450f-bede-777d7c7b04ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.454429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c86a9339-c052-450f-bede-777d7c7b04ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.454882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c86a9339-c052-450f-bede-777d7c7b04ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.696474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c86a9339-c052-450f-bede-777d7c7b04ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:17.708729 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c86a9339-c052-450f-bede-777d7c7b04ca tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1683 microversion: 2.1 time: 0.270950 Aug 27 03:12:17.710231 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3034/5878] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:17 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1683 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:17.857292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd54765c-f823-4143-ad10-9cdda2ac3d74 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:17.861361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd54765c-f823-4143-ad10-9cdda2ac3d74 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:17.874967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd54765c-f823-4143-ad10-9cdda2ac3d74 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.875695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd54765c-f823-4143-ad10-9cdda2ac3d74 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.876475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd54765c-f823-4143-ad10-9cdda2ac3d74 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.878924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd54765c-f823-4143-ad10-9cdda2ac3d74 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:17.879664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd54765c-f823-4143-ad10-9cdda2ac3d74 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:17.880231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd54765c-f823-4143-ad10-9cdda2ac3d74 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:17.953770 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd54765c-f823-4143-ad10-9cdda2ac3d74 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be/action" status: 200 len: 32643 microversion: 2.1 time: 0.100204 Aug 27 03:12:17.955313 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2845/5879] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:12:17 2022] POST /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be/action => generated 32643 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:12:18.117662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:18.118262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:18.126804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:18.128206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:18.129760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:18.132101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:18.133816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:18.135404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:18.191075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6d0ee6b2eaf14c0087aebe90cc8b6fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7c51ebc36e409c96a5bde555823625', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:18.192028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] flavor_id is None. Assuming migration. {{(pid=122488) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 27 03:12:18.192483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122488) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:12:18.389802 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ae7d9256-9ac0-4866-85ea-bf6486277fee tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be/action" status: 202 len: 0 microversion: 2.1 time: 0.276238 Aug 27 03:12:18.392513 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3035/5880] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:12:18 2022] POST /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:12:18.402587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9aa957c5-c45f-45b4-a2a0-cc93d133382d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:18.403668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9aa957c5-c45f-45b4-a2a0-cc93d133382d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:18.411880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aa957c5-c45f-45b4-a2a0-cc93d133382d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:18.413269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aa957c5-c45f-45b4-a2a0-cc93d133382d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:18.414194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aa957c5-c45f-45b4-a2a0-cc93d133382d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:18.415398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aa957c5-c45f-45b4-a2a0-cc93d133382d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:18.416019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aa957c5-c45f-45b4-a2a0-cc93d133382d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:18.416608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9aa957c5-c45f-45b4-a2a0-cc93d133382d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:18.672433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9aa957c5-c45f-45b4-a2a0-cc93d133382d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:18.680953 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9aa957c5-c45f-45b4-a2a0-cc93d133382d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1692 microversion: 2.1 time: 0.284667 Aug 27 03:12:18.681539 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2846/5881] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:18 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1692 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:19.708502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-47427ccc-2436-4fd5-b780-d2828cf5a4a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:19.709912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-47427ccc-2436-4fd5-b780-d2828cf5a4a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:19.735729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47427ccc-2436-4fd5-b780-d2828cf5a4a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:19.736565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47427ccc-2436-4fd5-b780-d2828cf5a4a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:19.738846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47427ccc-2436-4fd5-b780-d2828cf5a4a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:19.757191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47427ccc-2436-4fd5-b780-d2828cf5a4a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:19.758946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47427ccc-2436-4fd5-b780-d2828cf5a4a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:19.760329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47427ccc-2436-4fd5-b780-d2828cf5a4a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:20.061648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-47427ccc-2436-4fd5-b780-d2828cf5a4a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:20.073012 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-47427ccc-2436-4fd5-b780-d2828cf5a4a3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1692 microversion: 2.1 time: 0.370622 Aug 27 03:12:20.080385 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3036/5882] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:19 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1692 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:21.112036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-442ff356-cb5b-4074-8f30-5b7c12e7a5de tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:21.112913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-442ff356-cb5b-4074-8f30-5b7c12e7a5de tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:21.129415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-442ff356-cb5b-4074-8f30-5b7c12e7a5de tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:21.132154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-442ff356-cb5b-4074-8f30-5b7c12e7a5de tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:21.132724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-442ff356-cb5b-4074-8f30-5b7c12e7a5de tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:21.133589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-442ff356-cb5b-4074-8f30-5b7c12e7a5de tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:21.134554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-442ff356-cb5b-4074-8f30-5b7c12e7a5de tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:21.136678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-442ff356-cb5b-4074-8f30-5b7c12e7a5de tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:21.486879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-442ff356-cb5b-4074-8f30-5b7c12e7a5de tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:21.499331 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-442ff356-cb5b-4074-8f30-5b7c12e7a5de tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1692 microversion: 2.1 time: 0.393832 Aug 27 03:12:21.513293 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2847/5883] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:21 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1692 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:22.522309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-835c0c38-976c-4ff0-9ac3-897fe5bc3147 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:22.523594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-835c0c38-976c-4ff0-9ac3-897fe5bc3147 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:22.538127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835c0c38-976c-4ff0-9ac3-897fe5bc3147 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:22.542390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835c0c38-976c-4ff0-9ac3-897fe5bc3147 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:22.546683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835c0c38-976c-4ff0-9ac3-897fe5bc3147 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.547520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835c0c38-976c-4ff0-9ac3-897fe5bc3147 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:22.552798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835c0c38-976c-4ff0-9ac3-897fe5bc3147 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:22.553326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-835c0c38-976c-4ff0-9ac3-897fe5bc3147 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:22.789516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-835c0c38-976c-4ff0-9ac3-897fe5bc3147 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:22.801537 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-835c0c38-976c-4ff0-9ac3-897fe5bc3147 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.283712 Aug 27 03:12:22.802974 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3037/5884] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:22 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:23.830268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-15698f5a-477d-4f15-90e7-c2afc8391090 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:23.831521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-15698f5a-477d-4f15-90e7-c2afc8391090 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:23.841014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15698f5a-477d-4f15-90e7-c2afc8391090 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:23.841393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15698f5a-477d-4f15-90e7-c2afc8391090 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:23.841880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15698f5a-477d-4f15-90e7-c2afc8391090 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:23.843108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15698f5a-477d-4f15-90e7-c2afc8391090 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:23.843581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15698f5a-477d-4f15-90e7-c2afc8391090 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:23.844022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15698f5a-477d-4f15-90e7-c2afc8391090 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:24.169584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-15698f5a-477d-4f15-90e7-c2afc8391090 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:24.186456 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-15698f5a-477d-4f15-90e7-c2afc8391090 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.359924 Aug 27 03:12:24.188578 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2848/5885] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:23 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:25.215040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2cb4409f-ae0b-465b-be72-4073dd0908f1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:25.216916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2cb4409f-ae0b-465b-be72-4073dd0908f1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:25.228745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4409f-ae0b-465b-be72-4073dd0908f1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.229879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4409f-ae0b-465b-be72-4073dd0908f1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.230647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4409f-ae0b-465b-be72-4073dd0908f1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.231653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4409f-ae0b-465b-be72-4073dd0908f1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:25.232345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4409f-ae0b-465b-be72-4073dd0908f1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:25.233620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cb4409f-ae0b-465b-be72-4073dd0908f1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:25.475129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2cb4409f-ae0b-465b-be72-4073dd0908f1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:25.487034 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2cb4409f-ae0b-465b-be72-4073dd0908f1 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.276680 Aug 27 03:12:25.487908 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3038/5886] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:25 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:26.509437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-46df5255-3875-4dba-803f-077f5a29532c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:26.511252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-46df5255-3875-4dba-803f-077f5a29532c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:26.523047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46df5255-3875-4dba-803f-077f5a29532c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:26.524681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46df5255-3875-4dba-803f-077f5a29532c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:26.525579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46df5255-3875-4dba-803f-077f5a29532c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:26.526576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46df5255-3875-4dba-803f-077f5a29532c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:26.528442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46df5255-3875-4dba-803f-077f5a29532c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:26.529121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-46df5255-3875-4dba-803f-077f5a29532c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:26.751541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-46df5255-3875-4dba-803f-077f5a29532c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:26.768822 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-46df5255-3875-4dba-803f-077f5a29532c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.263433 Aug 27 03:12:26.776349 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2849/5887] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:26 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:27.797374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0a26a519-3eff-4f92-8471-875c10ef7d31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:27.798053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0a26a519-3eff-4f92-8471-875c10ef7d31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:27.816398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a26a519-3eff-4f92-8471-875c10ef7d31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.816945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a26a519-3eff-4f92-8471-875c10ef7d31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.817396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a26a519-3eff-4f92-8471-875c10ef7d31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:27.818332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a26a519-3eff-4f92-8471-875c10ef7d31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:27.818797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a26a519-3eff-4f92-8471-875c10ef7d31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:27.819233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a26a519-3eff-4f92-8471-875c10ef7d31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:28.024104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0a26a519-3eff-4f92-8471-875c10ef7d31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:28.032641 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0a26a519-3eff-4f92-8471-875c10ef7d31 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.239798 Aug 27 03:12:28.035026 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3039/5888] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:27 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:29.055861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8dfeaec1-4dbe-41db-bf0a-39e7be4aa6da tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:29.056453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8dfeaec1-4dbe-41db-bf0a-39e7be4aa6da tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:29.063727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dfeaec1-4dbe-41db-bf0a-39e7be4aa6da tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.064223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dfeaec1-4dbe-41db-bf0a-39e7be4aa6da tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.064663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dfeaec1-4dbe-41db-bf0a-39e7be4aa6da tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.065373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dfeaec1-4dbe-41db-bf0a-39e7be4aa6da tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:29.071934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dfeaec1-4dbe-41db-bf0a-39e7be4aa6da tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:29.071934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8dfeaec1-4dbe-41db-bf0a-39e7be4aa6da tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:29.225613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8dfeaec1-4dbe-41db-bf0a-39e7be4aa6da tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:29.233745 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8dfeaec1-4dbe-41db-bf0a-39e7be4aa6da tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.181681 Aug 27 03:12:29.234314 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2850/5889] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:29 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:30.256354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1769c6a3-f723-4455-8ad8-f5ee0c1ccaaa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:30.257540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1769c6a3-f723-4455-8ad8-f5ee0c1ccaaa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:30.260588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=54 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:30.266583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1769c6a3-f723-4455-8ad8-f5ee0c1ccaaa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:30.270133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1769c6a3-f723-4455-8ad8-f5ee0c1ccaaa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:30.270989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1769c6a3-f723-4455-8ad8-f5ee0c1ccaaa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:30.272016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1769c6a3-f723-4455-8ad8-f5ee0c1ccaaa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:30.272752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1769c6a3-f723-4455-8ad8-f5ee0c1ccaaa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:30.273384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1769c6a3-f723-4455-8ad8-f5ee0c1ccaaa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:30.459440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1769c6a3-f723-4455-8ad8-f5ee0c1ccaaa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:30.469156 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1769c6a3-f723-4455-8ad8-f5ee0c1ccaaa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.218068 Aug 27 03:12:30.479759 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3040/5890] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:30 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:31.491788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-824b7a5c-aba8-41fd-9df9-a0b1296c4a0e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:31.492392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-824b7a5c-aba8-41fd-9df9-a0b1296c4a0e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:31.499755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824b7a5c-aba8-41fd-9df9-a0b1296c4a0e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.500243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824b7a5c-aba8-41fd-9df9-a0b1296c4a0e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.500680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824b7a5c-aba8-41fd-9df9-a0b1296c4a0e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.501390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824b7a5c-aba8-41fd-9df9-a0b1296c4a0e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:31.501870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824b7a5c-aba8-41fd-9df9-a0b1296c4a0e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:31.502295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-824b7a5c-aba8-41fd-9df9-a0b1296c4a0e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:31.505141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=88 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:31.699116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-824b7a5c-aba8-41fd-9df9-a0b1296c4a0e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:31.709144 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-824b7a5c-aba8-41fd-9df9-a0b1296c4a0e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.221296 Aug 27 03:12:31.722867 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2851/5891] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:31 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:32.735851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6f7f8e91-63eb-4397-b3ee-97af53785839 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:32.736480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6f7f8e91-63eb-4397-b3ee-97af53785839 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:32.748686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f7f8e91-63eb-4397-b3ee-97af53785839 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.749183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f7f8e91-63eb-4397-b3ee-97af53785839 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.756045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f7f8e91-63eb-4397-b3ee-97af53785839 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.757016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f7f8e91-63eb-4397-b3ee-97af53785839 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:32.757506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f7f8e91-63eb-4397-b3ee-97af53785839 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:32.758017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6f7f8e91-63eb-4397-b3ee-97af53785839 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:32.936704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6f7f8e91-63eb-4397-b3ee-97af53785839 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:32.953798 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6f7f8e91-63eb-4397-b3ee-97af53785839 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.221509 Aug 27 03:12:32.973760 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3041/5892] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:32 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:33.994853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e4e075bd-92af-4fdf-b317-083bbaaa60fb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:33.996330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e4e075bd-92af-4fdf-b317-083bbaaa60fb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:34.011775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e075bd-92af-4fdf-b317-083bbaaa60fb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:34.016193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e075bd-92af-4fdf-b317-083bbaaa60fb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:34.018490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e075bd-92af-4fdf-b317-083bbaaa60fb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:34.019561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e075bd-92af-4fdf-b317-083bbaaa60fb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:34.021376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e075bd-92af-4fdf-b317-083bbaaa60fb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:34.022301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4e075bd-92af-4fdf-b317-083bbaaa60fb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:34.308545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e4e075bd-92af-4fdf-b317-083bbaaa60fb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:34.319799 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e4e075bd-92af-4fdf-b317-083bbaaa60fb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.330580 Aug 27 03:12:34.342178 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2852/5893] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:33 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:35.356739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-02102187-5c57-459a-9a7a-c9045cda395f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:35.363628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-02102187-5c57-459a-9a7a-c9045cda395f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:35.379727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02102187-5c57-459a-9a7a-c9045cda395f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.380512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02102187-5c57-459a-9a7a-c9045cda395f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.381242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02102187-5c57-459a-9a7a-c9045cda395f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.382249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02102187-5c57-459a-9a7a-c9045cda395f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:35.382940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02102187-5c57-459a-9a7a-c9045cda395f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:35.383593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02102187-5c57-459a-9a7a-c9045cda395f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:35.611247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-02102187-5c57-459a-9a7a-c9045cda395f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:35.618613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:35.621226 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-02102187-5c57-459a-9a7a-c9045cda395f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.273651 Aug 27 03:12:35.622244 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3042/5894] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:35 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:36.645696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-974ea825-b267-4b07-9185-7ab202a354e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:36.647571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-974ea825-b267-4b07-9185-7ab202a354e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:36.664023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=28 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:36.669029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974ea825-b267-4b07-9185-7ab202a354e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.672160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974ea825-b267-4b07-9185-7ab202a354e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.673002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974ea825-b267-4b07-9185-7ab202a354e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.674055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974ea825-b267-4b07-9185-7ab202a354e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:36.675673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974ea825-b267-4b07-9185-7ab202a354e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:36.678981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974ea825-b267-4b07-9185-7ab202a354e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:36.953135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-974ea825-b267-4b07-9185-7ab202a354e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:36.962548 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-974ea825-b267-4b07-9185-7ab202a354e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.322994 Aug 27 03:12:36.978102 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2853/5895] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:36 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:37.988244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ac10bf14-afdf-404c-be3d-705d69b28840 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:37.989487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ac10bf14-afdf-404c-be3d-705d69b28840 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:38.015347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac10bf14-afdf-404c-be3d-705d69b28840 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.015843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac10bf14-afdf-404c-be3d-705d69b28840 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.016292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac10bf14-afdf-404c-be3d-705d69b28840 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.017014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac10bf14-afdf-404c-be3d-705d69b28840 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:38.019039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac10bf14-afdf-404c-be3d-705d69b28840 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:38.021354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac10bf14-afdf-404c-be3d-705d69b28840 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:38.342132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ac10bf14-afdf-404c-be3d-705d69b28840 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:38.353036 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ac10bf14-afdf-404c-be3d-705d69b28840 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1697 microversion: 2.1 time: 0.369107 Aug 27 03:12:38.368517 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3043/5896] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:37 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1697 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:39.375379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a28aa198-cf54-4941-bcae-df17d0df5680 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:39.376014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a28aa198-cf54-4941-bcae-df17d0df5680 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:39.383484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a28aa198-cf54-4941-bcae-df17d0df5680 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.383975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a28aa198-cf54-4941-bcae-df17d0df5680 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.384416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a28aa198-cf54-4941-bcae-df17d0df5680 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.385132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a28aa198-cf54-4941-bcae-df17d0df5680 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:39.385587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a28aa198-cf54-4941-bcae-df17d0df5680 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:39.386052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a28aa198-cf54-4941-bcae-df17d0df5680 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:39.819967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a28aa198-cf54-4941-bcae-df17d0df5680 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:39.854753 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a28aa198-cf54-4941-bcae-df17d0df5680 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1696 microversion: 2.1 time: 0.482994 Aug 27 03:12:39.856169 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2854/5897] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:39 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1696 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:40.225388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-cd24419f-ce4c-4bfa-92fa-b5b7c17aeee1 req-09f05555-2d1f-426d-b0bf-2ce70e78012c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e139e1-f1cf-437c-a02d-acbd52fea8be", "name": "network-vif-unplugged", "status": "completed", "tag": "42706765-ea3d-4a18-9703-6df239805dcc"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:40.261268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cd24419f-ce4c-4bfa-92fa-b5b7c17aeee1 req-09f05555-2d1f-426d-b0bf-2ce70e78012c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.261848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cd24419f-ce4c-4bfa-92fa-b5b7c17aeee1 req-09f05555-2d1f-426d-b0bf-2ce70e78012c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.262386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cd24419f-ce4c-4bfa-92fa-b5b7c17aeee1 req-09f05555-2d1f-426d-b0bf-2ce70e78012c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.318834 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-cd24419f-ce4c-4bfa-92fa-b5b7c17aeee1 req-09f05555-2d1f-426d-b0bf-2ce70e78012c service nova] Creating event network-vif-unplugged:42706765-ea3d-4a18-9703-6df239805dcc for instance 39e139e1-f1cf-437c-a02d-acbd52fea8be on n-h1-852084-5 Aug 27 03:12:40.330056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-cd24419f-ce4c-4bfa-92fa-b5b7c17aeee1 req-09f05555-2d1f-426d-b0bf-2ce70e78012c service nova] Instance 39e139e1-f1cf-437c-a02d-acbd52fea8be is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:12:40.351744 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-cd24419f-ce4c-4bfa-92fa-b5b7c17aeee1 req-09f05555-2d1f-426d-b0bf-2ce70e78012c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131926 Aug 27 03:12:40.353098 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3044/5898] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:40.882493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ed8395e5-6af7-4ba8-bc40-5a6d04ab699e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:40.887946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ed8395e5-6af7-4ba8-bc40-5a6d04ab699e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:40.917489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed8395e5-6af7-4ba8-bc40-5a6d04ab699e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.927117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed8395e5-6af7-4ba8-bc40-5a6d04ab699e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.928176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed8395e5-6af7-4ba8-bc40-5a6d04ab699e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:40.931736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed8395e5-6af7-4ba8-bc40-5a6d04ab699e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:40.932834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed8395e5-6af7-4ba8-bc40-5a6d04ab699e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:40.935569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed8395e5-6af7-4ba8-bc40-5a6d04ab699e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:41.469103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ed8395e5-6af7-4ba8-bc40-5a6d04ab699e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:41.490652 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ed8395e5-6af7-4ba8-bc40-5a6d04ab699e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1696 microversion: 2.1 time: 0.616236 Aug 27 03:12:41.495492 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2855/5899] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:40 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1696 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:42.384285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-8f80e5b0-2246-4e7f-8863-b3eb4cedf3ca req-1fdf70f2-551b-44d7-a1ef-08e17a0e5f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e139e1-f1cf-437c-a02d-acbd52fea8be", "tag": "42706765-ea3d-4a18-9703-6df239805dcc"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:42.404709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8f80e5b0-2246-4e7f-8863-b3eb4cedf3ca req-1fdf70f2-551b-44d7-a1ef-08e17a0e5f70 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.405507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8f80e5b0-2246-4e7f-8863-b3eb4cedf3ca req-1fdf70f2-551b-44d7-a1ef-08e17a0e5f70 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.405977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8f80e5b0-2246-4e7f-8863-b3eb4cedf3ca req-1fdf70f2-551b-44d7-a1ef-08e17a0e5f70 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.440771 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-8f80e5b0-2246-4e7f-8863-b3eb4cedf3ca req-1fdf70f2-551b-44d7-a1ef-08e17a0e5f70 service nova] Creating event network-changed:42706765-ea3d-4a18-9703-6df239805dcc for instance 39e139e1-f1cf-437c-a02d-acbd52fea8be on n-h1-852084-5 Aug 27 03:12:42.461154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-8f80e5b0-2246-4e7f-8863-b3eb4cedf3ca req-1fdf70f2-551b-44d7-a1ef-08e17a0e5f70 service nova] Instance 39e139e1-f1cf-437c-a02d-acbd52fea8be is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:12:42.486990 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-8f80e5b0-2246-4e7f-8863-b3eb4cedf3ca req-1fdf70f2-551b-44d7-a1ef-08e17a0e5f70 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114579 Aug 27 03:12:42.488100 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3045/5900] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:42.515301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-39f3a605-f1a4-4291-92ba-b6f812b62824 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:42.516494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-39f3a605-f1a4-4291-92ba-b6f812b62824 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:42.535453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39f3a605-f1a4-4291-92ba-b6f812b62824 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.537021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39f3a605-f1a4-4291-92ba-b6f812b62824 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.547038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39f3a605-f1a4-4291-92ba-b6f812b62824 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.547925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39f3a605-f1a4-4291-92ba-b6f812b62824 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:42.548930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39f3a605-f1a4-4291-92ba-b6f812b62824 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:42.550357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-39f3a605-f1a4-4291-92ba-b6f812b62824 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:42.839682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-39f3a605-f1a4-4291-92ba-b6f812b62824 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:42.864562 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-39f3a605-f1a4-4291-92ba-b6f812b62824 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1694 microversion: 2.1 time: 0.353719 Aug 27 03:12:42.873351 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2856/5901] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:42 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1694 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:43.228797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-908931776", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "113b30d2-2348-4909-820c-f27ad976dc02"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:43.335973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] validate_networks() for [('113b30d2-2348-4909-820c-f27ad976dc02', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:12:43.908974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-458a29e5-4919-49b9-99bf-3c1b0376c7d4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:43.910466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-458a29e5-4919-49b9-99bf-3c1b0376c7d4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:43.932238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-458a29e5-4919-49b9-99bf-3c1b0376c7d4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:43.936599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-458a29e5-4919-49b9-99bf-3c1b0376c7d4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:43.938396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-458a29e5-4919-49b9-99bf-3c1b0376c7d4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:43.941386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-458a29e5-4919-49b9-99bf-3c1b0376c7d4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:43.942135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-458a29e5-4919-49b9-99bf-3c1b0376c7d4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:43.943929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-458a29e5-4919-49b9-99bf-3c1b0376c7d4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.213257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:12:44.213804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:12:44.214496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:12:44.214872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:12:44.215291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:12:44.274101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.274731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.281444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.282479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.282978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.283413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.327937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Getting quotas for project a2bf5447377a4d8782d5183317c5dcb6. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:12:44.340624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Getting quotas for user c53ac25e0e5c4e72904eb5aa0f661411 and project a2bf5447377a4d8782d5183317c5dcb6. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:12:44.399726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:12:44.402418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:12:44.484630 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3aafd060-8a83-4926-a38c-bc261c46c694 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.260664 Aug 27 03:12:44.485325 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3046/5902] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:12:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:12:44.498505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-144788e9-8dd9-4f56-8baf-79b85de718d4 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:44.502501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-144788e9-8dd9-4f56-8baf-79b85de718d4 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:44.579541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-144788e9-8dd9-4f56-8baf-79b85de718d4 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:44.588137 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-144788e9-8dd9-4f56-8baf-79b85de718d4 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1213 microversion: 2.1 time: 0.095551 Aug 27 03:12:44.589232 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3047/5903] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:44 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:44.743698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-458a29e5-4919-49b9-99bf-3c1b0376c7d4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:44.758428 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-458a29e5-4919-49b9-99bf-3c1b0376c7d4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1691 microversion: 2.1 time: 0.859894 Aug 27 03:12:44.762273 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2857/5904] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:43 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1691 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:44.781334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e48890da-2f16-4db1-9dda-b5862f3df235 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:44.781911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e48890da-2f16-4db1-9dda-b5862f3df235 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:44.794447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e48890da-2f16-4db1-9dda-b5862f3df235 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.794953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e48890da-2f16-4db1-9dda-b5862f3df235 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.795398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e48890da-2f16-4db1-9dda-b5862f3df235 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.796107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e48890da-2f16-4db1-9dda-b5862f3df235 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.796563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e48890da-2f16-4db1-9dda-b5862f3df235 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.796991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e48890da-2f16-4db1-9dda-b5862f3df235 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.925446 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e48890da-2f16-4db1-9dda-b5862f3df235 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be/action" status: 202 len: 0 microversion: 2.1 time: 0.148382 Aug 27 03:12:44.926299 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3048/5905] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:12:44 2022] POST /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:12:44.938124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d551d5f3-37f9-4d9b-81f7-0b111e2d9c8f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:44.939764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d551d5f3-37f9-4d9b-81f7-0b111e2d9c8f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:44.946570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551d5f3-37f9-4d9b-81f7-0b111e2d9c8f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.947478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551d5f3-37f9-4d9b-81f7-0b111e2d9c8f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.947961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551d5f3-37f9-4d9b-81f7-0b111e2d9c8f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:44.948746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551d5f3-37f9-4d9b-81f7-0b111e2d9c8f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:44.949423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551d5f3-37f9-4d9b-81f7-0b111e2d9c8f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:44.950120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d551d5f3-37f9-4d9b-81f7-0b111e2d9c8f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.211866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d551d5f3-37f9-4d9b-81f7-0b111e2d9c8f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:45.240634 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d551d5f3-37f9-4d9b-81f7-0b111e2d9c8f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1690 microversion: 2.1 time: 0.307744 Aug 27 03:12:45.241397 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2858/5906] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:44 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1690 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:45.482031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-029290d8-d14d-4e71-99a0-c2a36163f598 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:45.483462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-029290d8-d14d-4e71-99a0-c2a36163f598 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:45.491170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-029290d8-d14d-4e71-99a0-c2a36163f598 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.491970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-029290d8-d14d-4e71-99a0-c2a36163f598 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.492608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-029290d8-d14d-4e71-99a0-c2a36163f598 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.493711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-029290d8-d14d-4e71-99a0-c2a36163f598 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.494359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-029290d8-d14d-4e71-99a0-c2a36163f598 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.494973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-029290d8-d14d-4e71-99a0-c2a36163f598 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.613465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-029290d8-d14d-4e71-99a0-c2a36163f598 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lazy-loading 'services' on Instance uuid 18c9f438-4c95-4232-a2a3-f8262bac3c1b {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:45.624062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e3e15ed3-1a6b-48e4-a073-8524b287ed35 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:45.625978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e3e15ed3-1a6b-48e4-a073-8524b287ed35 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:45.637867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e15ed3-1a6b-48e4-a073-8524b287ed35 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.639094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e15ed3-1a6b-48e4-a073-8524b287ed35 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.639968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e15ed3-1a6b-48e4-a073-8524b287ed35 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.641018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e15ed3-1a6b-48e4-a073-8524b287ed35 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:45.641897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e15ed3-1a6b-48e4-a073-8524b287ed35 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:45.642627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e15ed3-1a6b-48e4-a073-8524b287ed35 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:45.741568 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-029290d8-d14d-4e71-99a0-c2a36163f598 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "DELETE /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b/os-volume_attachments/598cbe42-9d7e-42c1-8f34-928e247e871a" status: 202 len: 0 microversion: 2.1 time: 0.280570 Aug 27 03:12:45.744468 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3049/5907] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:12:45 2022] DELETE /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b/os-volume_attachments/598cbe42-9d7e-42c1-8f34-928e247e871a => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:12:45.748655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e3e15ed3-1a6b-48e4-a073-8524b287ed35 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:45.757854 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e3e15ed3-1a6b-48e4-a073-8524b287ed35 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1265 microversion: 2.1 time: 0.140700 Aug 27 03:12:45.765602 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2859/5908] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:45 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:46.265308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-298570fc-6f64-474c-bd1d-89dc2c0a3496 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:46.266063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-298570fc-6f64-474c-bd1d-89dc2c0a3496 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:46.278338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-298570fc-6f64-474c-bd1d-89dc2c0a3496 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.290446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-298570fc-6f64-474c-bd1d-89dc2c0a3496 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.291508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-298570fc-6f64-474c-bd1d-89dc2c0a3496 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.292440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-298570fc-6f64-474c-bd1d-89dc2c0a3496 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.293082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-298570fc-6f64-474c-bd1d-89dc2c0a3496 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.293723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-298570fc-6f64-474c-bd1d-89dc2c0a3496 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.589564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-298570fc-6f64-474c-bd1d-89dc2c0a3496 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:46.609154 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-298570fc-6f64-474c-bd1d-89dc2c0a3496 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1690 microversion: 2.1 time: 0.348825 Aug 27 03:12:46.626679 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3050/5909] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:46 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1690 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:46.796035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-219f2cf8-037b-48ba-aa9f-21ff9d3c06c2 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:46.797326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-219f2cf8-037b-48ba-aa9f-21ff9d3c06c2 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:46.807043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-219f2cf8-037b-48ba-aa9f-21ff9d3c06c2 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.812136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-219f2cf8-037b-48ba-aa9f-21ff9d3c06c2 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.812800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-219f2cf8-037b-48ba-aa9f-21ff9d3c06c2 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:46.814649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-219f2cf8-037b-48ba-aa9f-21ff9d3c06c2 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:46.817261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-219f2cf8-037b-48ba-aa9f-21ff9d3c06c2 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:46.817749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-219f2cf8-037b-48ba-aa9f-21ff9d3c06c2 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.173239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-219f2cf8-037b-48ba-aa9f-21ff9d3c06c2 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:47.184924 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-219f2cf8-037b-48ba-aa9f-21ff9d3c06c2 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1271 microversion: 2.1 time: 0.399944 Aug 27 03:12:47.186227 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2860/5910] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:46 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1271 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:47.643498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d8741fb4-d2de-402f-8bf7-45a7d4df8a7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:47.645070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d8741fb4-d2de-402f-8bf7-45a7d4df8a7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:47.653917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8741fb4-d2de-402f-8bf7-45a7d4df8a7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.657004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8741fb4-d2de-402f-8bf7-45a7d4df8a7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.658641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8741fb4-d2de-402f-8bf7-45a7d4df8a7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.664406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8741fb4-d2de-402f-8bf7-45a7d4df8a7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:47.665104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8741fb4-d2de-402f-8bf7-45a7d4df8a7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:47.666043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8741fb4-d2de-402f-8bf7-45a7d4df8a7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:47.983954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d8741fb4-d2de-402f-8bf7-45a7d4df8a7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:47.995773 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d8741fb4-d2de-402f-8bf7-45a7d4df8a7c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1690 microversion: 2.1 time: 0.365060 Aug 27 03:12:48.006228 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3051/5911] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:47 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1690 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:48.210350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ade47708-a610-4460-927b-88e5abb3a712 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:48.211547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ade47708-a610-4460-927b-88e5abb3a712 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:48.224096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade47708-a610-4460-927b-88e5abb3a712 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.224854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade47708-a610-4460-927b-88e5abb3a712 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.231182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade47708-a610-4460-927b-88e5abb3a712 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.232728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade47708-a610-4460-927b-88e5abb3a712 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.234041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade47708-a610-4460-927b-88e5abb3a712 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.234648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ade47708-a610-4460-927b-88e5abb3a712 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.616119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-70732afe-d95a-41ac-a260-aea966b0eebc req-4d1c4335-c1fa-46d4-8735-78bd7d1b695c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e139e1-f1cf-437c-a02d-acbd52fea8be", "name": "network-vif-plugged", "status": "completed", "tag": "42706765-ea3d-4a18-9703-6df239805dcc"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:48.643928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ade47708-a610-4460-927b-88e5abb3a712 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:48.657958 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ade47708-a610-4460-927b-88e5abb3a712 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1313 microversion: 2.1 time: 0.452101 Aug 27 03:12:48.662320 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2861/5912] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:48 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:48.675264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8bac19bc-3a22-4144-a09f-9f52b4624ff5 req-e4a0ad52-f051-4b0b-ab00-7d677b14600f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7", "tag": "f9a88fcb-5915-497e-88c6-0034722b6d3b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:48.679349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-70732afe-d95a-41ac-a260-aea966b0eebc req-4d1c4335-c1fa-46d4-8735-78bd7d1b695c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.681697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-70732afe-d95a-41ac-a260-aea966b0eebc req-4d1c4335-c1fa-46d4-8735-78bd7d1b695c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.683730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-70732afe-d95a-41ac-a260-aea966b0eebc req-4d1c4335-c1fa-46d4-8735-78bd7d1b695c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.706089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8bac19bc-3a22-4144-a09f-9f52b4624ff5 req-e4a0ad52-f051-4b0b-ab00-7d677b14600f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:48.707001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8bac19bc-3a22-4144-a09f-9f52b4624ff5 req-e4a0ad52-f051-4b0b-ab00-7d677b14600f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:48.709999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8bac19bc-3a22-4144-a09f-9f52b4624ff5 req-e4a0ad52-f051-4b0b-ab00-7d677b14600f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:48.725526 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-70732afe-d95a-41ac-a260-aea966b0eebc req-4d1c4335-c1fa-46d4-8735-78bd7d1b695c service nova] Creating event network-vif-plugged:42706765-ea3d-4a18-9703-6df239805dcc for instance 39e139e1-f1cf-437c-a02d-acbd52fea8be on n-h1-852084-5 Aug 27 03:12:48.734825 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8bac19bc-3a22-4144-a09f-9f52b4624ff5 req-e4a0ad52-f051-4b0b-ab00-7d677b14600f service nova] Creating event network-changed:f9a88fcb-5915-497e-88c6-0034722b6d3b for instance a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 on n-h2-852084-5 Aug 27 03:12:48.748872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-70732afe-d95a-41ac-a260-aea966b0eebc req-4d1c4335-c1fa-46d4-8735-78bd7d1b695c service nova] Instance 39e139e1-f1cf-437c-a02d-acbd52fea8be is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:12:48.751976 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8bac19bc-3a22-4144-a09f-9f52b4624ff5 req-e4a0ad52-f051-4b0b-ab00-7d677b14600f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083589 Aug 27 03:12:48.752808 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2862/5913] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:48.788715 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-70732afe-d95a-41ac-a260-aea966b0eebc req-4d1c4335-c1fa-46d4-8735-78bd7d1b695c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184018 Aug 27 03:12:48.790807 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3052/5914] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:49.017362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-177ef291-3a93-4f45-8122-fba24e8c9c95 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:49.018297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-177ef291-3a93-4f45-8122-fba24e8c9c95 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:49.032425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-177ef291-3a93-4f45-8122-fba24e8c9c95 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.034324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-177ef291-3a93-4f45-8122-fba24e8c9c95 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.034796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-177ef291-3a93-4f45-8122-fba24e8c9c95 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.039003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-177ef291-3a93-4f45-8122-fba24e8c9c95 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.045637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-177ef291-3a93-4f45-8122-fba24e8c9c95 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.046216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-177ef291-3a93-4f45-8122-fba24e8c9c95 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.590010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-177ef291-3a93-4f45-8122-fba24e8c9c95 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:49.626226 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-177ef291-3a93-4f45-8122-fba24e8c9c95 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1690 microversion: 2.1 time: 0.613363 Aug 27 03:12:49.635227 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2863/5915] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:49 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1690 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:49.684855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-43e140f7-c124-4288-ac5d-f5ac3203abad tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:49.685625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-43e140f7-c124-4288-ac5d-f5ac3203abad tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:49.703460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43e140f7-c124-4288-ac5d-f5ac3203abad tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.704272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43e140f7-c124-4288-ac5d-f5ac3203abad tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.704903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43e140f7-c124-4288-ac5d-f5ac3203abad tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:49.706001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43e140f7-c124-4288-ac5d-f5ac3203abad tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:49.706755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43e140f7-c124-4288-ac5d-f5ac3203abad tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:49.707365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-43e140f7-c124-4288-ac5d-f5ac3203abad tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.086556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-43e140f7-c124-4288-ac5d-f5ac3203abad tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:50.098554 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-43e140f7-c124-4288-ac5d-f5ac3203abad tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1313 microversion: 2.1 time: 0.420177 Aug 27 03:12:50.101289 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3053/5916] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:49 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:50.204786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-12fb8532-78f0-4a47-b262-6fe659fc53ef req-10a74e7f-337e-41ce-9e12-c984adb09508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e139e1-f1cf-437c-a02d-acbd52fea8be", "name": "network-vif-unplugged", "status": "completed", "tag": "42706765-ea3d-4a18-9703-6df239805dcc"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:50.227348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-12fb8532-78f0-4a47-b262-6fe659fc53ef req-10a74e7f-337e-41ce-9e12-c984adb09508 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.228817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-12fb8532-78f0-4a47-b262-6fe659fc53ef req-10a74e7f-337e-41ce-9e12-c984adb09508 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.229599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-12fb8532-78f0-4a47-b262-6fe659fc53ef req-10a74e7f-337e-41ce-9e12-c984adb09508 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.252668 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-12fb8532-78f0-4a47-b262-6fe659fc53ef req-10a74e7f-337e-41ce-9e12-c984adb09508 service nova] Creating event network-vif-unplugged:42706765-ea3d-4a18-9703-6df239805dcc for instance 39e139e1-f1cf-437c-a02d-acbd52fea8be on n-h2-852084-5 Aug 27 03:12:50.260295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-12fb8532-78f0-4a47-b262-6fe659fc53ef req-10a74e7f-337e-41ce-9e12-c984adb09508 service nova] Instance 39e139e1-f1cf-437c-a02d-acbd52fea8be is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:12:50.277883 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-12fb8532-78f0-4a47-b262-6fe659fc53ef req-10a74e7f-337e-41ce-9e12-c984adb09508 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077837 Aug 27 03:12:50.279757 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2864/5917] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:50.656804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4ff5c4e9-7227-4a0f-a285-dd8e5922a0e7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:50.663942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4ff5c4e9-7227-4a0f-a285-dd8e5922a0e7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:50.684006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ff5c4e9-7227-4a0f-a285-dd8e5922a0e7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.692148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ff5c4e9-7227-4a0f-a285-dd8e5922a0e7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.695041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ff5c4e9-7227-4a0f-a285-dd8e5922a0e7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.697395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ff5c4e9-7227-4a0f-a285-dd8e5922a0e7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:50.699667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ff5c4e9-7227-4a0f-a285-dd8e5922a0e7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:50.700359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ff5c4e9-7227-4a0f-a285-dd8e5922a0e7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:50.929304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4ff5c4e9-7227-4a0f-a285-dd8e5922a0e7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:50.947097 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4ff5c4e9-7227-4a0f-a285-dd8e5922a0e7 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1690 microversion: 2.1 time: 0.291237 Aug 27 03:12:50.948102 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3054/5918] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:50 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1690 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:51.130775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8d8c8a51-dae9-427c-a0c6-d9000fe74cec tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:51.133163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8d8c8a51-dae9-427c-a0c6-d9000fe74cec tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:51.160681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d8c8a51-dae9-427c-a0c6-d9000fe74cec tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:51.163158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d8c8a51-dae9-427c-a0c6-d9000fe74cec tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:51.164482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d8c8a51-dae9-427c-a0c6-d9000fe74cec tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:51.167114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d8c8a51-dae9-427c-a0c6-d9000fe74cec tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:51.167650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d8c8a51-dae9-427c-a0c6-d9000fe74cec tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:51.168182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d8c8a51-dae9-427c-a0c6-d9000fe74cec tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:51.508516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8d8c8a51-dae9-427c-a0c6-d9000fe74cec tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:51.527472 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8d8c8a51-dae9-427c-a0c6-d9000fe74cec tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1313 microversion: 2.1 time: 0.407844 Aug 27 03:12:51.528471 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2865/5919] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:51 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:51.970300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b58dbcb7-65b0-44ef-a3c1-79b2a11b3af2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:51.971016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b58dbcb7-65b0-44ef-a3c1-79b2a11b3af2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:51.982845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b58dbcb7-65b0-44ef-a3c1-79b2a11b3af2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:51.986113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b58dbcb7-65b0-44ef-a3c1-79b2a11b3af2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:51.988166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b58dbcb7-65b0-44ef-a3c1-79b2a11b3af2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:51.989236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b58dbcb7-65b0-44ef-a3c1-79b2a11b3af2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:51.992276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b58dbcb7-65b0-44ef-a3c1-79b2a11b3af2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:51.992588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b58dbcb7-65b0-44ef-a3c1-79b2a11b3af2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:52.174789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b58dbcb7-65b0-44ef-a3c1-79b2a11b3af2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:52.184378 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b58dbcb7-65b0-44ef-a3c1-79b2a11b3af2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1690 microversion: 2.1 time: 0.219295 Aug 27 03:12:52.185949 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3055/5920] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:51 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1690 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:52.306053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-5ca661d8-b707-47d9-a0d1-4e9823ec8b09 req-ad7419f3-a521-4c0e-886e-0619d930b26d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e139e1-f1cf-437c-a02d-acbd52fea8be", "tag": "42706765-ea3d-4a18-9703-6df239805dcc"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:52.318185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5ca661d8-b707-47d9-a0d1-4e9823ec8b09 req-ad7419f3-a521-4c0e-886e-0619d930b26d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:52.318679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5ca661d8-b707-47d9-a0d1-4e9823ec8b09 req-ad7419f3-a521-4c0e-886e-0619d930b26d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:52.319122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5ca661d8-b707-47d9-a0d1-4e9823ec8b09 req-ad7419f3-a521-4c0e-886e-0619d930b26d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:52.334417 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-5ca661d8-b707-47d9-a0d1-4e9823ec8b09 req-ad7419f3-a521-4c0e-886e-0619d930b26d service nova] Creating event network-changed:42706765-ea3d-4a18-9703-6df239805dcc for instance 39e139e1-f1cf-437c-a02d-acbd52fea8be on n-h2-852084-5 Aug 27 03:12:52.340637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-5ca661d8-b707-47d9-a0d1-4e9823ec8b09 req-ad7419f3-a521-4c0e-886e-0619d930b26d service nova] Instance 39e139e1-f1cf-437c-a02d-acbd52fea8be is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:12:52.360894 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-5ca661d8-b707-47d9-a0d1-4e9823ec8b09 req-ad7419f3-a521-4c0e-886e-0619d930b26d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054463 Aug 27 03:12:52.364287 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2866/5921] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:52.578336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-219f49b2-fe94-4491-a182-5b5ebfc17213 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:52.588133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-219f49b2-fe94-4491-a182-5b5ebfc17213 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:52.613990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-219f49b2-fe94-4491-a182-5b5ebfc17213 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:52.615230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-219f49b2-fe94-4491-a182-5b5ebfc17213 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:52.616302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-219f49b2-fe94-4491-a182-5b5ebfc17213 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:52.617479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-219f49b2-fe94-4491-a182-5b5ebfc17213 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:52.618677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-219f49b2-fe94-4491-a182-5b5ebfc17213 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:52.621018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-219f49b2-fe94-4491-a182-5b5ebfc17213 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:52.864855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-219f49b2-fe94-4491-a182-5b5ebfc17213 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:52.875167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-219f49b2-fe94-4491-a182-5b5ebfc17213 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1313 microversion: 2.1 time: 0.327423 Aug 27 03:12:52.876213 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3056/5922] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:52 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:53.207118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b858e41b-0c93-498a-ba42-4af9c8629f34 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:53.208035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b858e41b-0c93-498a-ba42-4af9c8629f34 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:53.221659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b858e41b-0c93-498a-ba42-4af9c8629f34 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.222202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b858e41b-0c93-498a-ba42-4af9c8629f34 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.222668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b858e41b-0c93-498a-ba42-4af9c8629f34 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.223414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b858e41b-0c93-498a-ba42-4af9c8629f34 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.223879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b858e41b-0c93-498a-ba42-4af9c8629f34 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.224313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b858e41b-0c93-498a-ba42-4af9c8629f34 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.478798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b858e41b-0c93-498a-ba42-4af9c8629f34 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:53.491013 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b858e41b-0c93-498a-ba42-4af9c8629f34 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1690 microversion: 2.1 time: 0.288506 Aug 27 03:12:53.492263 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2867/5923] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:53 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1690 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:53.679297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b9eb7f7c-1940-4124-bfa8-39c6ff688313 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:53.680450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b9eb7f7c-1940-4124-bfa8-39c6ff688313 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:53.688390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9eb7f7c-1940-4124-bfa8-39c6ff688313 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.689193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9eb7f7c-1940-4124-bfa8-39c6ff688313 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.689849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9eb7f7c-1940-4124-bfa8-39c6ff688313 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.690771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9eb7f7c-1940-4124-bfa8-39c6ff688313 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.691403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9eb7f7c-1940-4124-bfa8-39c6ff688313 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.691995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9eb7f7c-1940-4124-bfa8-39c6ff688313 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.733542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b9eb7f7c-1940-4124-bfa8-39c6ff688313 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:53.820441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:53.855106 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b9eb7f7c-1940-4124-bfa8-39c6ff688313 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "DELETE /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 204 len: 0 microversion: 2.1 time: 0.179701 Aug 27 03:12:53.856513 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3057/5924] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:53 2022] DELETE /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:53.868374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f8cf95fd-ca5f-4d93-9235-719cae888aab tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:53.869416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f8cf95fd-ca5f-4d93-9235-719cae888aab tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:53.877136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8cf95fd-ca5f-4d93-9235-719cae888aab tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.877989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8cf95fd-ca5f-4d93-9235-719cae888aab tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.878736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8cf95fd-ca5f-4d93-9235-719cae888aab tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.879782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8cf95fd-ca5f-4d93-9235-719cae888aab tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.880429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8cf95fd-ca5f-4d93-9235-719cae888aab tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.881054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f8cf95fd-ca5f-4d93-9235-719cae888aab tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.897304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-deef9e33-b756-46f6-b699-dd1e994bd967 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:53.898509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-deef9e33-b756-46f6-b699-dd1e994bd967 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:53.906787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-deef9e33-b756-46f6-b699-dd1e994bd967 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.907571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-deef9e33-b756-46f6-b699-dd1e994bd967 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.908180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-deef9e33-b756-46f6-b699-dd1e994bd967 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:53.909225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-deef9e33-b756-46f6-b699-dd1e994bd967 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:53.910044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-deef9e33-b756-46f6-b699-dd1e994bd967 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:53.910652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-deef9e33-b756-46f6-b699-dd1e994bd967 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:54.158132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-deef9e33-b756-46f6-b699-dd1e994bd967 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:54.163762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f8cf95fd-ca5f-4d93-9235-719cae888aab tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:54.168607 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-deef9e33-b756-46f6-b699-dd1e994bd967 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1313 microversion: 2.1 time: 0.275878 Aug 27 03:12:54.169501 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3058/5925] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:53 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:54.185104 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f8cf95fd-ca5f-4d93-9235-719cae888aab tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1514 microversion: 2.1 time: 0.320514 Aug 27 03:12:54.202569 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2868/5926] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:53 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1514 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:54.517916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dc7a33e0-c77e-4a3d-804d-97bb42ad5fa4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:54.518782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dc7a33e0-c77e-4a3d-804d-97bb42ad5fa4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:54.520860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:54.535034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc7a33e0-c77e-4a3d-804d-97bb42ad5fa4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.536930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc7a33e0-c77e-4a3d-804d-97bb42ad5fa4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.538723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc7a33e0-c77e-4a3d-804d-97bb42ad5fa4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:54.551479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6610a229-0d6e-4af6-8ef0-d279d5416d8c req-5aa6057e-afae-4023-b65d-562eb5890e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7", "name": "network-vif-plugged", "status": "completed", "tag": "f9a88fcb-5915-497e-88c6-0034722b6d3b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:54.553903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc7a33e0-c77e-4a3d-804d-97bb42ad5fa4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.558762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc7a33e0-c77e-4a3d-804d-97bb42ad5fa4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.560378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc7a33e0-c77e-4a3d-804d-97bb42ad5fa4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:54.584906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6610a229-0d6e-4af6-8ef0-d279d5416d8c req-5aa6057e-afae-4023-b65d-562eb5890e80 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:54.585407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6610a229-0d6e-4af6-8ef0-d279d5416d8c req-5aa6057e-afae-4023-b65d-562eb5890e80 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:54.585996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6610a229-0d6e-4af6-8ef0-d279d5416d8c req-5aa6057e-afae-4023-b65d-562eb5890e80 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:54.602864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:54.605576 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6610a229-0d6e-4af6-8ef0-d279d5416d8c req-5aa6057e-afae-4023-b65d-562eb5890e80 service nova] Creating event network-vif-plugged:f9a88fcb-5915-497e-88c6-0034722b6d3b for instance a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 on n-h2-852084-5 Aug 27 03:12:54.606926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:12:54.616994 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6610a229-0d6e-4af6-8ef0-d279d5416d8c req-5aa6057e-afae-4023-b65d-562eb5890e80 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074105 Aug 27 03:12:54.618435 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2869/5927] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:54.943562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dc7a33e0-c77e-4a3d-804d-97bb42ad5fa4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:54.953684 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dc7a33e0-c77e-4a3d-804d-97bb42ad5fa4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1683 microversion: 2.1 time: 0.443316 Aug 27 03:12:54.954315 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3059/5928] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:54 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1683 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:55.194130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0378552d-4431-4459-b5c6-ab564755d35a tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:55.195036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0378552d-4431-4459-b5c6-ab564755d35a tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:55.202747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0378552d-4431-4459-b5c6-ab564755d35a tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.203590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0378552d-4431-4459-b5c6-ab564755d35a tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.204221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0378552d-4431-4459-b5c6-ab564755d35a tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.205288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0378552d-4431-4459-b5c6-ab564755d35a tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.205942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0378552d-4431-4459-b5c6-ab564755d35a tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.206543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0378552d-4431-4459-b5c6-ab564755d35a tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.228601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e9c1eb97-90ab-491f-804e-a4ea4e7baba3 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:55.229712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e9c1eb97-90ab-491f-804e-a4ea4e7baba3 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:55.241833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9c1eb97-90ab-491f-804e-a4ea4e7baba3 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.242335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9c1eb97-90ab-491f-804e-a4ea4e7baba3 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.242843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9c1eb97-90ab-491f-804e-a4ea4e7baba3 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.246407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9c1eb97-90ab-491f-804e-a4ea4e7baba3 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:55.247285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9c1eb97-90ab-491f-804e-a4ea4e7baba3 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:55.248130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9c1eb97-90ab-491f-804e-a4ea4e7baba3 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:55.409339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0378552d-4431-4459-b5c6-ab564755d35a tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:55.420580 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0378552d-4431-4459-b5c6-ab564755d35a tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1313 microversion: 2.1 time: 0.231965 Aug 27 03:12:55.429725 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2870/5929] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:55 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:55.456148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e9c1eb97-90ab-491f-804e-a4ea4e7baba3 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:55.467849 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e9c1eb97-90ab-491f-804e-a4ea4e7baba3 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1514 microversion: 2.1 time: 0.247183 Aug 27 03:12:55.481375 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3060/5930] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:55 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:56.092184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-5475eee7-4874-4f16-adb8-c9db5808568d req-e07b3710-3677-4ca9-945b-8945610a552c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c9f438-4c95-4232-a2a3-f8262bac3c1b", "name": "network-vif-deleted", "tag": "13b1ddf6-4bd1-4a01-bcd2-e9db4eaeec19"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:56.105752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5475eee7-4874-4f16-adb8-c9db5808568d req-e07b3710-3677-4ca9-945b-8945610a552c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.106598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5475eee7-4874-4f16-adb8-c9db5808568d req-e07b3710-3677-4ca9-945b-8945610a552c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.108397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5475eee7-4874-4f16-adb8-c9db5808568d req-e07b3710-3677-4ca9-945b-8945610a552c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.124771 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-5475eee7-4874-4f16-adb8-c9db5808568d req-e07b3710-3677-4ca9-945b-8945610a552c service nova] Creating event network-vif-deleted:13b1ddf6-4bd1-4a01-bcd2-e9db4eaeec19 for instance 18c9f438-4c95-4232-a2a3-f8262bac3c1b on n-h1-852084-5 Aug 27 03:12:56.132092 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-5475eee7-4874-4f16-adb8-c9db5808568d req-e07b3710-3677-4ca9-945b-8945610a552c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047798 Aug 27 03:12:56.133834 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2871/5931] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:56.443574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bb074d2b-8846-4cc9-a1cd-8a62e371813c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:56.444189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bb074d2b-8846-4cc9-a1cd-8a62e371813c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:56.452743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb074d2b-8846-4cc9-a1cd-8a62e371813c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.453390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb074d2b-8846-4cc9-a1cd-8a62e371813c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.453973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb074d2b-8846-4cc9-a1cd-8a62e371813c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.454972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb074d2b-8846-4cc9-a1cd-8a62e371813c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.455611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb074d2b-8846-4cc9-a1cd-8a62e371813c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.456284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb074d2b-8846-4cc9-a1cd-8a62e371813c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.490085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:56.491117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:56.499647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.500468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.501295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.502365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.503422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.504090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.586480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:56.587334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:56.590748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:56.593953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lazy-loading 'fault' on Instance uuid 18c9f438-4c95-4232-a2a3-f8262bac3c1b {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:12:56.686682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb074d2b-8846-4cc9-a1cd-8a62e371813c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:56.694944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13762a04c0b545d1bc45118446bf06df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da217e12fb3f4722980397872caf49b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:56.699503 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bb074d2b-8846-4cc9-a1cd-8a62e371813c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1496 microversion: 2.1 time: 0.260273 Aug 27 03:12:56.701631 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3061/5932] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:56 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1496 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:56.706725 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ef3278fc-eccd-43a2-9520-d19e1091afff tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 200 len: 1308 microversion: 2.1 time: 0.221589 Aug 27 03:12:56.711946 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2872/5933] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:56 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:57.298933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-85423c29-df26-432f-9145-00ceef7eba49 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:57.299482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-85423c29-df26-432f-9145-00ceef7eba49 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:57.306868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85423c29-df26-432f-9145-00ceef7eba49 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.307724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85423c29-df26-432f-9145-00ceef7eba49 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.308420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85423c29-df26-432f-9145-00ceef7eba49 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.309356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85423c29-df26-432f-9145-00ceef7eba49 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.309972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85423c29-df26-432f-9145-00ceef7eba49 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.310486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85423c29-df26-432f-9145-00ceef7eba49 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.340179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-85423c29-df26-432f-9145-00ceef7eba49 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:12:57.450813 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-85423c29-df26-432f-9145-00ceef7eba49 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 204 len: 0 microversion: 2.1 time: 0.155826 Aug 27 03:12:57.451716 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3062/5934] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:12:57 2022] DELETE /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:12:57.460328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b3f0cb6-d8c3-42fd-979a-e4bcd0026637 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:57.461170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4b3f0cb6-d8c3-42fd-979a-e4bcd0026637 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:57.469098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b3f0cb6-d8c3-42fd-979a-e4bcd0026637 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.469598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b3f0cb6-d8c3-42fd-979a-e4bcd0026637 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.470079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b3f0cb6-d8c3-42fd-979a-e4bcd0026637 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.470886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b3f0cb6-d8c3-42fd-979a-e4bcd0026637 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.471268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b3f0cb6-d8c3-42fd-979a-e4bcd0026637 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.471835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b3f0cb6-d8c3-42fd-979a-e4bcd0026637 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.620738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4b3f0cb6-d8c3-42fd-979a-e4bcd0026637 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:57.630722 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4b3f0cb6-d8c3-42fd-979a-e4bcd0026637 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1502 microversion: 2.1 time: 0.174568 Aug 27 03:12:57.631408 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2873/5935] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:57 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:12:57.742463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:57.743177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] [instance: 18c9f438-4c95-4232-a2a3-f8262bac3c1b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:57.751060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.751779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.752443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.753555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:57.754198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:57.754627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:57.771751 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] HTTP exception thrown: Instance 18c9f438-4c95-4232-a2a3-f8262bac3c1b could not be found. Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Request method failure captured: Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b HTTP/1.1 Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYq7DByIyocg5BBmR6ovEjSrCIgUsMH5ZnXFGCNRlVJYHps8SkQgmlsvD_8CFbiLJ_si_MSKV9ZWRb5gkLeyt2qpEoGn--MQ47SDdQvIY2UlMrvsq1fz7HDvdwb-xHChqeNkWSu8NUm4BfLGAAKGdazIPOvVzcuggWLOBLG1trf5Zqc Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: da217e12fb3f4722980397872caf49b4 Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1997264621 Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_da217e12fb3f4722980397872caf49b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/da217e12fb3f4722980397872caf49b4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/da217e12fb3f4722980397872caf49b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/da217e12fb3f4722980397872caf49b4"}]}] Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-VolumesSnapshotTestJSON-1997264621 Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: da217e12fb3f4722980397872caf49b4 Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1997264621 Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-VolumesSnapshotTestJSON-1997264621-project Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 13762a04c0b545d1bc45118446bf06df Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-VolumesSnapshotTestJSON-1997264621-project Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 18c9f438-4c95-4232-a2a3-f8262bac3c1b could not be found. Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '18c9f438-4c95-4232-a2a3-f8262bac3c1b'} Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c9f438-4c95-4232-a2a3-f8262bac3c1b could not be found. Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c9f438-4c95-4232-a2a3-f8262bac3c1b could not be found. Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:12:57.773751 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.777778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:12:57.777778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:12:57.777778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:12:57.777778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:12:57.777778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:12:57.777778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c9f438-4c95-4232-a2a3-f8262bac3c1b could not be found. Aug 27 03:12:57.777778 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:12:57.777778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] Returning 404 to user: Instance 18c9f438-4c95-4232-a2a3-f8262bac3c1b could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:12:57.777778 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0a2b1a64-26b6-46fe-b134-a5bfc121e886 tempest-VolumesSnapshotTestJSON-1997264621 tempest-VolumesSnapshotTestJSON-1997264621-project] 10.222.0.99 "GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b" status: 404 len: 111 microversion: 2.1 time: 0.037006 Aug 27 03:12:57.786525 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3063/5936] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:57 2022] GET /compute/v2.1/servers/18c9f438-4c95-4232-a2a3-f8262bac3c1b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:12:58.589861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e21b247b-521f-42df-9f97-5eb8e9752be2 req-96e44261-ea2d-4b2e-821f-b0e021fc9ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e139e1-f1cf-437c-a02d-acbd52fea8be", "name": "network-vif-plugged", "status": "completed", "tag": "42706765-ea3d-4a18-9703-6df239805dcc"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:58.625096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e21b247b-521f-42df-9f97-5eb8e9752be2 req-96e44261-ea2d-4b2e-821f-b0e021fc9ed0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:58.626907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e21b247b-521f-42df-9f97-5eb8e9752be2 req-96e44261-ea2d-4b2e-821f-b0e021fc9ed0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:58.628246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e21b247b-521f-42df-9f97-5eb8e9752be2 req-96e44261-ea2d-4b2e-821f-b0e021fc9ed0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:58.652903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-92f5e893-f97c-4806-b98f-57f5c55dbed8 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:58.654818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-92f5e893-f97c-4806-b98f-57f5c55dbed8 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:12:58.660952 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e21b247b-521f-42df-9f97-5eb8e9752be2 req-96e44261-ea2d-4b2e-821f-b0e021fc9ed0 service nova] Creating event network-vif-plugged:42706765-ea3d-4a18-9703-6df239805dcc for instance 39e139e1-f1cf-437c-a02d-acbd52fea8be on n-h2-852084-5 Aug 27 03:12:58.668547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92f5e893-f97c-4806-b98f-57f5c55dbed8 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:58.669190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92f5e893-f97c-4806-b98f-57f5c55dbed8 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:58.670176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92f5e893-f97c-4806-b98f-57f5c55dbed8 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:58.672033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92f5e893-f97c-4806-b98f-57f5c55dbed8 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:58.672688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92f5e893-f97c-4806-b98f-57f5c55dbed8 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:58.673283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92f5e893-f97c-4806-b98f-57f5c55dbed8 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:58.677190 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e21b247b-521f-42df-9f97-5eb8e9752be2 req-96e44261-ea2d-4b2e-821f-b0e021fc9ed0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090584 Aug 27 03:12:58.679710 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2874/5937] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:12:58.988601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-92f5e893-f97c-4806-b98f-57f5c55dbed8 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:12:59.000180 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-92f5e893-f97c-4806-b98f-57f5c55dbed8 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1502 microversion: 2.1 time: 0.348489 Aug 27 03:12:59.001493 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3064/5938] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:12:58 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1502 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:12:59.529780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e71d76f8-0579-47b4-9111-2def29981780 req-9e2b638b-7bb7-4870-a713-bd88f25e03cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7", "name": "network-vif-deleted", "tag": "f9a88fcb-5915-497e-88c6-0034722b6d3b"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:12:59.583404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e71d76f8-0579-47b4-9111-2def29981780 req-9e2b638b-7bb7-4870-a713-bd88f25e03cd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.584404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e71d76f8-0579-47b4-9111-2def29981780 req-9e2b638b-7bb7-4870-a713-bd88f25e03cd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.585141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e71d76f8-0579-47b4-9111-2def29981780 req-9e2b638b-7bb7-4870-a713-bd88f25e03cd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.611714 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e71d76f8-0579-47b4-9111-2def29981780 req-9e2b638b-7bb7-4870-a713-bd88f25e03cd service nova] Creating event network-vif-deleted:f9a88fcb-5915-497e-88c6-0034722b6d3b for instance a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 on n-h2-852084-5 Aug 27 03:12:59.621778 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e71d76f8-0579-47b4-9111-2def29981780 req-9e2b638b-7bb7-4870-a713-bd88f25e03cd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111508 Aug 27 03:12:59.631674 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2875/5939] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:12:59.724849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-976af076-2382-4434-9751-a89a650d4814 tempest-PortsAdminExtendedAttrsTestJSON-1866499330 tempest-PortsAdminExtendedAttrsTestJSON-1866499330-project-admin] Calling method '.version_select at 0x7f4d292a38b0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:12:59.726724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-976af076-2382-4434-9751-a89a650d4814 tempest-PortsAdminExtendedAttrsTestJSON-1866499330 tempest-PortsAdminExtendedAttrsTestJSON-1866499330-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.727422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-976af076-2382-4434-9751-a89a650d4814 tempest-PortsAdminExtendedAttrsTestJSON-1866499330 tempest-PortsAdminExtendedAttrsTestJSON-1866499330-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.727866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-976af076-2382-4434-9751-a89a650d4814 tempest-PortsAdminExtendedAttrsTestJSON-1866499330 tempest-PortsAdminExtendedAttrsTestJSON-1866499330-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.743051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-976af076-2382-4434-9751-a89a650d4814 tempest-PortsAdminExtendedAttrsTestJSON-1866499330 tempest-PortsAdminExtendedAttrsTestJSON-1866499330-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.743550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-976af076-2382-4434-9751-a89a650d4814 tempest-PortsAdminExtendedAttrsTestJSON-1866499330 tempest-PortsAdminExtendedAttrsTestJSON-1866499330-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.744067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-976af076-2382-4434-9751-a89a650d4814 tempest-PortsAdminExtendedAttrsTestJSON-1866499330 tempest-PortsAdminExtendedAttrsTestJSON-1866499330-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.756715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-976af076-2382-4434-9751-a89a650d4814 tempest-PortsAdminExtendedAttrsTestJSON-1866499330 tempest-PortsAdminExtendedAttrsTestJSON-1866499330-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:12:59.757211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-976af076-2382-4434-9751-a89a650d4814 tempest-PortsAdminExtendedAttrsTestJSON-1866499330 tempest-PortsAdminExtendedAttrsTestJSON-1866499330-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:12:59.757733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-976af076-2382-4434-9751-a89a650d4814 tempest-PortsAdminExtendedAttrsTestJSON-1866499330 tempest-PortsAdminExtendedAttrsTestJSON-1866499330-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:12:59.764819 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-976af076-2382-4434-9751-a89a650d4814 tempest-PortsAdminExtendedAttrsTestJSON-1866499330 tempest-PortsAdminExtendedAttrsTestJSON-1866499330-project-admin] 10.222.0.99 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.237829 Aug 27 03:12:59.765413 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3065/5940] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 03:12:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:00.026755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:00.027527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:00.043795 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:00.044634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:00.045266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:00.046205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:00.046825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:00.047406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:00.092541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:00.093393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:00.094037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:00.094620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lazy-loading 'fault' on Instance uuid a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:00.181386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:00.192990 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-69312f08-4cc9-4b4d-a549-142093d3e3c1 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 200 len: 1303 microversion: 2.1 time: 0.170503 Aug 27 03:13:00.194800 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2876/5941] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:00 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:01.217323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:01.218737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:01.221825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:01.249704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:01.251417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:01.252418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:01.254969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:01.255806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:01.256608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:01.277222 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] HTTP exception thrown: Instance a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 could not be found. Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Request method failure captured: Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 HTTP/1.1 Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYunx7aQiF8XtsTuRyRpDrXXOMcbtLSH1GyKIQ7JpdC8hnhYIdOEdi9UsNB4kC1zjS3LpBCWP5qhu64GX_5FVnagFL5R2eWjFw_kgqwUxvIf-Y8JVpG79h5TKxbmR3SQNw7cqKswFg_C0xkoT5QPP93S6dLndow3DFGUrOKOzAHifUw Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a2bf5447377a4d8782d5183317c5dcb6 Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-VolumesActionsTest-1668320182 Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a2bf5447377a4d8782d5183317c5dcb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a2bf5447377a4d8782d5183317c5dcb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a2bf5447377a4d8782d5183317c5dcb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a2bf5447377a4d8782d5183317c5dcb6"}]}] Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-VolumesActionsTest-1668320182 Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a2bf5447377a4d8782d5183317c5dcb6 Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-VolumesActionsTest-1668320182 Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-VolumesActionsTest-1668320182-project Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: c53ac25e0e5c4e72904eb5aa0f661411 Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-VolumesActionsTest-1668320182-project Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 could not be found. Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7'} Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 could not be found. Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 could not be found. Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:01.279331 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:13:01.284080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:01.284080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:01.284080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:01.284080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:01.284080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:01.284080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 could not be found. Aug 27 03:13:01.284080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:13:01.286534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Returning 404 to user: Instance a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:01.288168 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6db1bd47-216d-4153-ac0f-0a795844a859 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7" status: 404 len: 111 microversion: 2.1 time: 0.075495 Aug 27 03:13:01.301707 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3066/5942] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:01 2022] GET /compute/v2.1/servers/a5c6516c-4a9c-4bd3-9d94-55cf07c09fe7 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:01.421900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1989040811", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "113b30d2-2348-4909-820c-f27ad976dc02"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:01.489468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] validate_networks() for [('113b30d2-2348-4909-820c-f27ad976dc02', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:13:01.994799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:13:01.995582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:13:01.996785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:13:02.000324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:13:02.001433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:13:02.032227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.032928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.033581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.036958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:02.038410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:02.046441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:02.082336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Getting quotas for project a2bf5447377a4d8782d5183317c5dcb6. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:02.095836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Getting quotas for user c53ac25e0e5c4e72904eb5aa0f661411 and project a2bf5447377a4d8782d5183317c5dcb6. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:02.113366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:13:02.116695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:13:02.221790 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7656afdd-9908-4b71-b670-fad2ff3c912c tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803992 Aug 27 03:13:02.222959 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2877/5943] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:13:02.236337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4abf77d9-9153-4baf-be53-c145a01a0470 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:02.236986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4abf77d9-9153-4baf-be53-c145a01a0470 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:02.358790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4abf77d9-9153-4baf-be53-c145a01a0470 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:02.370492 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4abf77d9-9153-4baf-be53-c145a01a0470 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1214 microversion: 2.1 time: 0.137892 Aug 27 03:13:02.371101 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3067/5944] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:02 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:03.391890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-79cb74bf-8313-4908-a00b-8e9d7adab436 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:03.392558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-79cb74bf-8313-4908-a00b-8e9d7adab436 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:03.413381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79cb74bf-8313-4908-a00b-8e9d7adab436 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:03.414127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79cb74bf-8313-4908-a00b-8e9d7adab436 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:03.414856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79cb74bf-8313-4908-a00b-8e9d7adab436 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:03.415932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79cb74bf-8313-4908-a00b-8e9d7adab436 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:03.417911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79cb74bf-8313-4908-a00b-8e9d7adab436 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:03.418576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79cb74bf-8313-4908-a00b-8e9d7adab436 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:03.495597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-79cb74bf-8313-4908-a00b-8e9d7adab436 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:03.505147 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-79cb74bf-8313-4908-a00b-8e9d7adab436 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1266 microversion: 2.1 time: 0.117704 Aug 27 03:13:03.520118 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2878/5945] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:03 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:04.527414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-59dedfff-1484-47b2-af4e-de5069e9f538 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:04.529230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-59dedfff-1484-47b2-af4e-de5069e9f538 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:04.536677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59dedfff-1484-47b2-af4e-de5069e9f538 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.537481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59dedfff-1484-47b2-af4e-de5069e9f538 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.538182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59dedfff-1484-47b2-af4e-de5069e9f538 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.539115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59dedfff-1484-47b2-af4e-de5069e9f538 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:04.539810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59dedfff-1484-47b2-af4e-de5069e9f538 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:04.540448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59dedfff-1484-47b2-af4e-de5069e9f538 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:04.619276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-59dedfff-1484-47b2-af4e-de5069e9f538 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:04.634365 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-59dedfff-1484-47b2-af4e-de5069e9f538 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1272 microversion: 2.1 time: 0.110768 Aug 27 03:13:04.634980 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3068/5946] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:04 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:05.660673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cfa8893e-cdc6-4ae9-b445-012ec7914b24 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:05.662083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cfa8893e-cdc6-4ae9-b445-012ec7914b24 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:05.684393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfa8893e-cdc6-4ae9-b445-012ec7914b24 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.685493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfa8893e-cdc6-4ae9-b445-012ec7914b24 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.686526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfa8893e-cdc6-4ae9-b445-012ec7914b24 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:05.687425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfa8893e-cdc6-4ae9-b445-012ec7914b24 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:05.688418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfa8893e-cdc6-4ae9-b445-012ec7914b24 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:05.689001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfa8893e-cdc6-4ae9-b445-012ec7914b24 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.035391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cfa8893e-cdc6-4ae9-b445-012ec7914b24 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:06.046394 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cfa8893e-cdc6-4ae9-b445-012ec7914b24 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1314 microversion: 2.1 time: 0.390918 Aug 27 03:13:06.048282 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2879/5947] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:05 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:06.694782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ffdd29e7-33b3-474f-b5f1-f7c8d216c189 req-ca4f98ef-9d4e-49fa-87f5-606cabda5421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549796e5-1f46-49e7-9da0-de16fb1e7b7d", "tag": "5f7a081d-d36b-4b0b-bbea-4c410c241f8a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:06.721398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ffdd29e7-33b3-474f-b5f1-f7c8d216c189 req-ca4f98ef-9d4e-49fa-87f5-606cabda5421 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:06.721398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ffdd29e7-33b3-474f-b5f1-f7c8d216c189 req-ca4f98ef-9d4e-49fa-87f5-606cabda5421 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:06.721398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ffdd29e7-33b3-474f-b5f1-f7c8d216c189 req-ca4f98ef-9d4e-49fa-87f5-606cabda5421 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:06.744138 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ffdd29e7-33b3-474f-b5f1-f7c8d216c189 req-ca4f98ef-9d4e-49fa-87f5-606cabda5421 service nova] Creating event network-changed:5f7a081d-d36b-4b0b-bbea-4c410c241f8a for instance 549796e5-1f46-49e7-9da0-de16fb1e7b7d on n-h1-852084-5 Aug 27 03:13:06.751461 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ffdd29e7-33b3-474f-b5f1-f7c8d216c189 req-ca4f98ef-9d4e-49fa-87f5-606cabda5421 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060359 Aug 27 03:13:06.752106 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3069/5948] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:13:07.069243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-32dcc8d4-5dd4-4975-ae0d-fb7e4b9cda42 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:07.069899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-32dcc8d4-5dd4-4975-ae0d-fb7e4b9cda42 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:07.072968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:07.083678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32dcc8d4-5dd4-4975-ae0d-fb7e4b9cda42 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:07.089449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32dcc8d4-5dd4-4975-ae0d-fb7e4b9cda42 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:07.090156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32dcc8d4-5dd4-4975-ae0d-fb7e4b9cda42 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:07.091105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32dcc8d4-5dd4-4975-ae0d-fb7e4b9cda42 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:07.091743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32dcc8d4-5dd4-4975-ae0d-fb7e4b9cda42 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:07.096224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-32dcc8d4-5dd4-4975-ae0d-fb7e4b9cda42 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:07.577237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-32dcc8d4-5dd4-4975-ae0d-fb7e4b9cda42 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:07.603957 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-32dcc8d4-5dd4-4975-ae0d-fb7e4b9cda42 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1314 microversion: 2.1 time: 0.539107 Aug 27 03:13:07.604721 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2880/5949] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:07 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:08.628031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-10a38749-c5ff-4feb-b41e-161487d5547f tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:08.628993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-10a38749-c5ff-4feb-b41e-161487d5547f tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:08.646668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a38749-c5ff-4feb-b41e-161487d5547f tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:08.647691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a38749-c5ff-4feb-b41e-161487d5547f tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:08.651950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a38749-c5ff-4feb-b41e-161487d5547f tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:08.652896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a38749-c5ff-4feb-b41e-161487d5547f tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:08.654092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a38749-c5ff-4feb-b41e-161487d5547f tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:08.654678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-10a38749-c5ff-4feb-b41e-161487d5547f tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:08.985733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-10a38749-c5ff-4feb-b41e-161487d5547f tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:08.998061 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-10a38749-c5ff-4feb-b41e-161487d5547f tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1314 microversion: 2.1 time: 0.373140 Aug 27 03:13:08.998061 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3070/5950] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:08 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:10.025209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-27066a96-0652-452b-a13f-4292249755d7 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:10.025858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-27066a96-0652-452b-a13f-4292249755d7 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:10.034621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27066a96-0652-452b-a13f-4292249755d7 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:10.035110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27066a96-0652-452b-a13f-4292249755d7 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:10.035546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27066a96-0652-452b-a13f-4292249755d7 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:10.036240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27066a96-0652-452b-a13f-4292249755d7 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:10.036719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27066a96-0652-452b-a13f-4292249755d7 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:10.037149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27066a96-0652-452b-a13f-4292249755d7 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:10.250760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-27066a96-0652-452b-a13f-4292249755d7 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:10.259566 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-27066a96-0652-452b-a13f-4292249755d7 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1314 microversion: 2.1 time: 0.238141 Aug 27 03:13:10.275223 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2881/5951] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:10 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:11.282170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8bfd4fda-f18d-49e5-b9cc-c82d0eee8caa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:11.283157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8bfd4fda-f18d-49e5-b9cc-c82d0eee8caa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:11.290528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bfd4fda-f18d-49e5-b9cc-c82d0eee8caa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:11.291480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bfd4fda-f18d-49e5-b9cc-c82d0eee8caa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:11.292139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bfd4fda-f18d-49e5-b9cc-c82d0eee8caa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:11.294146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bfd4fda-f18d-49e5-b9cc-c82d0eee8caa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:11.294830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bfd4fda-f18d-49e5-b9cc-c82d0eee8caa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:11.295608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bfd4fda-f18d-49e5-b9cc-c82d0eee8caa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:11.588331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8bfd4fda-f18d-49e5-b9cc-c82d0eee8caa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:11.597721 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8bfd4fda-f18d-49e5-b9cc-c82d0eee8caa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1314 microversion: 2.1 time: 0.320115 Aug 27 03:13:11.606971 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3071/5952] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:11 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:12.635836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d7e089cf-da6f-4901-a86e-7a117bcd359d tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:12.636773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d7e089cf-da6f-4901-a86e-7a117bcd359d tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:12.640301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:12.642946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:12.652882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7e089cf-da6f-4901-a86e-7a117bcd359d tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:12.653390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7e089cf-da6f-4901-a86e-7a117bcd359d tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:12.653880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7e089cf-da6f-4901-a86e-7a117bcd359d tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:12.654610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7e089cf-da6f-4901-a86e-7a117bcd359d tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:12.655077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7e089cf-da6f-4901-a86e-7a117bcd359d tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:12.655508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7e089cf-da6f-4901-a86e-7a117bcd359d tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:12.887017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d7e089cf-da6f-4901-a86e-7a117bcd359d tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:12.897157 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d7e089cf-da6f-4901-a86e-7a117bcd359d tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1314 microversion: 2.1 time: 0.265277 Aug 27 03:13:12.898867 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2882/5953] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:12 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:12.918841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-582fc854-fd4e-42df-a064-2e436d644060 req-6ed3e742-8c91-4063-a7eb-a0d9a62f9cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549796e5-1f46-49e7-9da0-de16fb1e7b7d", "name": "network-vif-plugged", "status": "completed", "tag": "5f7a081d-d36b-4b0b-bbea-4c410c241f8a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:12.933144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:12.937119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-582fc854-fd4e-42df-a064-2e436d644060 req-6ed3e742-8c91-4063-a7eb-a0d9a62f9cda service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:12.938043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-582fc854-fd4e-42df-a064-2e436d644060 req-6ed3e742-8c91-4063-a7eb-a0d9a62f9cda service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:12.938648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-582fc854-fd4e-42df-a064-2e436d644060 req-6ed3e742-8c91-4063-a7eb-a0d9a62f9cda service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:12.959467 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-582fc854-fd4e-42df-a064-2e436d644060 req-6ed3e742-8c91-4063-a7eb-a0d9a62f9cda service nova] Creating event network-vif-plugged:5f7a081d-d36b-4b0b-bbea-4c410c241f8a for instance 549796e5-1f46-49e7-9da0-de16fb1e7b7d on n-h1-852084-5 Aug 27 03:13:12.975077 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-582fc854-fd4e-42df-a064-2e436d644060 req-6ed3e742-8c91-4063-a7eb-a0d9a62f9cda service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060423 Aug 27 03:13:12.977299 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3072/5954] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:13.922360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-10306f80-3b5e-4d9e-9877-816d160dd7aa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:13.924178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-10306f80-3b5e-4d9e-9877-816d160dd7aa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:13.935992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10306f80-3b5e-4d9e-9877-816d160dd7aa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:13.937112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10306f80-3b5e-4d9e-9877-816d160dd7aa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:13.937571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10306f80-3b5e-4d9e-9877-816d160dd7aa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:13.938389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10306f80-3b5e-4d9e-9877-816d160dd7aa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:13.939595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10306f80-3b5e-4d9e-9877-816d160dd7aa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:13.940231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10306f80-3b5e-4d9e-9877-816d160dd7aa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:14.122435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-10306f80-3b5e-4d9e-9877-816d160dd7aa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:14.133068 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-10306f80-3b5e-4d9e-9877-816d160dd7aa tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1314 microversion: 2.1 time: 0.217008 Aug 27 03:13:14.133702 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2883/5955] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:13 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:15.156080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ba08a75-ed87-4584-a496-3a971e4066ce tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:15.161611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ba08a75-ed87-4584-a496-3a971e4066ce tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:15.185613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ba08a75-ed87-4584-a496-3a971e4066ce tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:15.186337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ba08a75-ed87-4584-a496-3a971e4066ce tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:15.186809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ba08a75-ed87-4584-a496-3a971e4066ce tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:15.187582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ba08a75-ed87-4584-a496-3a971e4066ce tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:15.188048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ba08a75-ed87-4584-a496-3a971e4066ce tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:15.188485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ba08a75-ed87-4584-a496-3a971e4066ce tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:15.508190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ba08a75-ed87-4584-a496-3a971e4066ce tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:15.519552 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ba08a75-ed87-4584-a496-3a971e4066ce tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1497 microversion: 2.1 time: 0.369518 Aug 27 03:13:15.520829 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3073/5956] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:15 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1497 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:13:16.324520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ab421c7b-137a-4ce1-95ef-79820f0e2a7b tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:16.324520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ab421c7b-137a-4ce1-95ef-79820f0e2a7b tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:16.329832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab421c7b-137a-4ce1-95ef-79820f0e2a7b tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.330636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab421c7b-137a-4ce1-95ef-79820f0e2a7b tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.331266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab421c7b-137a-4ce1-95ef-79820f0e2a7b tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.332206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab421c7b-137a-4ce1-95ef-79820f0e2a7b tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.333129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab421c7b-137a-4ce1-95ef-79820f0e2a7b tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.333801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab421c7b-137a-4ce1-95ef-79820f0e2a7b tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.370030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ab421c7b-137a-4ce1-95ef-79820f0e2a7b tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:13:16.515674 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ab421c7b-137a-4ce1-95ef-79820f0e2a7b tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "DELETE /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 204 len: 0 microversion: 2.1 time: 0.197162 Aug 27 03:13:16.516915 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2884/5957] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:13:16 2022] DELETE /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:16.524757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c4faa65-08bd-4fcc-89a5-cd6f84707a37 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:16.526120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5c4faa65-08bd-4fcc-89a5-cd6f84707a37 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:16.534131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c4faa65-08bd-4fcc-89a5-cd6f84707a37 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.534945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c4faa65-08bd-4fcc-89a5-cd6f84707a37 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.535697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c4faa65-08bd-4fcc-89a5-cd6f84707a37 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.536623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c4faa65-08bd-4fcc-89a5-cd6f84707a37 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:16.537293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c4faa65-08bd-4fcc-89a5-cd6f84707a37 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:16.537957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c4faa65-08bd-4fcc-89a5-cd6f84707a37 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:16.802714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5c4faa65-08bd-4fcc-89a5-cd6f84707a37 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:16.812889 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5c4faa65-08bd-4fcc-89a5-cd6f84707a37 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1503 microversion: 2.1 time: 0.292015 Aug 27 03:13:16.818937 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3074/5958] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:16 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:17.836409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c357cff2-4613-465a-a1fa-748bbd787055 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:17.837803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c357cff2-4613-465a-a1fa-748bbd787055 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:17.849745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c357cff2-4613-465a-a1fa-748bbd787055 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.850772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c357cff2-4613-465a-a1fa-748bbd787055 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.851423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c357cff2-4613-465a-a1fa-748bbd787055 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:17.852550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c357cff2-4613-465a-a1fa-748bbd787055 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:17.853210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c357cff2-4613-465a-a1fa-748bbd787055 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:17.853963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c357cff2-4613-465a-a1fa-748bbd787055 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:18.682177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c357cff2-4613-465a-a1fa-748bbd787055 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:18.691638 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c357cff2-4613-465a-a1fa-748bbd787055 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1503 microversion: 2.1 time: 0.861045 Aug 27 03:13:18.692814 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2885/5959] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:17 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1503 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:19.055127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e63d36f1-5f07-4899-8fe9-d1cf638cf55d req-c1e294f5-392c-4187-9115-2a9a52cf6c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549796e5-1f46-49e7-9da0-de16fb1e7b7d", "name": "network-vif-deleted", "tag": "5f7a081d-d36b-4b0b-bbea-4c410c241f8a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:19.067985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e63d36f1-5f07-4899-8fe9-d1cf638cf55d req-c1e294f5-392c-4187-9115-2a9a52cf6c24 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.068473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e63d36f1-5f07-4899-8fe9-d1cf638cf55d req-c1e294f5-392c-4187-9115-2a9a52cf6c24 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.068909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e63d36f1-5f07-4899-8fe9-d1cf638cf55d req-c1e294f5-392c-4187-9115-2a9a52cf6c24 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.081553 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e63d36f1-5f07-4899-8fe9-d1cf638cf55d req-c1e294f5-392c-4187-9115-2a9a52cf6c24 service nova] Creating event network-vif-deleted:5f7a081d-d36b-4b0b-bbea-4c410c241f8a for instance 549796e5-1f46-49e7-9da0-de16fb1e7b7d on n-h1-852084-5 Aug 27 03:13:19.088196 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e63d36f1-5f07-4899-8fe9-d1cf638cf55d req-c1e294f5-392c-4187-9115-2a9a52cf6c24 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036496 Aug 27 03:13:19.091022 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3075/5960] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:19.507628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b0b878c1-8ea6-45e5-bac9-8f3d8a9f0621 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:19.510367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b0b878c1-8ea6-45e5-bac9-8f3d8a9f0621 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:19.523657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0b878c1-8ea6-45e5-bac9-8f3d8a9f0621 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.525231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0b878c1-8ea6-45e5-bac9-8f3d8a9f0621 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.526274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0b878c1-8ea6-45e5-bac9-8f3d8a9f0621 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.530246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0b878c1-8ea6-45e5-bac9-8f3d8a9f0621 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.530849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0b878c1-8ea6-45e5-bac9-8f3d8a9f0621 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.533298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b0b878c1-8ea6-45e5-bac9-8f3d8a9f0621 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.654865 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b0b878c1-8ea6-45e5-bac9-8f3d8a9f0621 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be/action" status: 200 len: 63176 microversion: 2.1 time: 0.463209 Aug 27 03:13:19.664322 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2886/5961] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:13:19 2022] POST /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be/action => generated 63176 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:13:19.713865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:19.714839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:19.728803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.729500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.730294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.731685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.732345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.732921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.771269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:19.771992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:19.772586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:19.773204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lazy-loading 'fault' on Instance uuid 549796e5-1f46-49e7-9da0-de16fb1e7b7d {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:19.846904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c53ac25e0e5c4e72904eb5aa0f661411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2bf5447377a4d8782d5183317c5dcb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:19.851494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:19.857486 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-afd2a17c-a08e-48fb-803e-4ecaff243072 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 200 len: 1304 microversion: 2.1 time: 0.148047 Aug 27 03:13:19.876154 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3076/5962] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:19 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:20.882867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:20.883572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] [instance: 549796e5-1f46-49e7-9da0-de16fb1e7b7d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:20.892463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:20.893146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:20.893818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:20.894817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:20.896419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:20.897015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:20.901625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:20.938656 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] HTTP exception thrown: Instance 549796e5-1f46-49e7-9da0-de16fb1e7b7d could not be found. Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Request method failure captured: Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d HTTP/1.1 Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYunx7aQiF8XtsTuRyRpDrXXOMcbtLSH1GyKIQ7JpdC8hnhYIdOEdi9UsNB4kC1zjS3LpBCWP5qhu64GX_5FVnagFL5R2eWjFw_kgqwUxvIf-Y8JVpG79h5TKxbmR3SQNw7cqKswFg_C0xkoT5QPP93S6dLndow3DFGUrOKOzAHifUw Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: a2bf5447377a4d8782d5183317c5dcb6 Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-VolumesActionsTest-1668320182 Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a2bf5447377a4d8782d5183317c5dcb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a2bf5447377a4d8782d5183317c5dcb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a2bf5447377a4d8782d5183317c5dcb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a2bf5447377a4d8782d5183317c5dcb6"}]}] Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-VolumesActionsTest-1668320182 Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: a2bf5447377a4d8782d5183317c5dcb6 Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-VolumesActionsTest-1668320182 Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-VolumesActionsTest-1668320182-project Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: c53ac25e0e5c4e72904eb5aa0f661411 Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-VolumesActionsTest-1668320182-project Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 549796e5-1f46-49e7-9da0-de16fb1e7b7d could not be found. Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '549796e5-1f46-49e7-9da0-de16fb1e7b7d'} Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549796e5-1f46-49e7-9da0-de16fb1e7b7d could not be found. Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549796e5-1f46-49e7-9da0-de16fb1e7b7d could not be found. Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:20.940920 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:13:20.946014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:20.946014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:20.946014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:20.946014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:20.946014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:20.946014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549796e5-1f46-49e7-9da0-de16fb1e7b7d could not be found. Aug 27 03:13:20.946014 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:13:20.947410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] Returning 404 to user: Instance 549796e5-1f46-49e7-9da0-de16fb1e7b7d could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:20.948499 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b955bc4e-2dfb-4755-8f1c-bfb7252c0e50 tempest-VolumesActionsTest-1668320182 tempest-VolumesActionsTest-1668320182-project] 10.222.0.99 "GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d" status: 404 len: 111 microversion: 2.1 time: 0.069958 Aug 27 03:13:20.950256 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2887/5963] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:20 2022] GET /compute/v2.1/servers/549796e5-1f46-49e7-9da0-de16fb1e7b7d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:26.038820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9a14fe42-123b-4241-903d-a14e5739b685 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:26.040077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9a14fe42-123b-4241-903d-a14e5739b685 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:26.047547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a14fe42-123b-4241-903d-a14e5739b685 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:26.048247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a14fe42-123b-4241-903d-a14e5739b685 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:26.048868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a14fe42-123b-4241-903d-a14e5739b685 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:26.049801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a14fe42-123b-4241-903d-a14e5739b685 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:26.050430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a14fe42-123b-4241-903d-a14e5739b685 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:26.051034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a14fe42-123b-4241-903d-a14e5739b685 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:26.490899 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9a14fe42-123b-4241-903d-a14e5739b685 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1834 microversion: 2.1 time: 0.655482 Aug 27 03:13:26.506533 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3077/5964] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:25 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1834 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:28.453610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-69b1f494-d737-4ea9-831b-d1a5906fb90a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:28.454863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-69b1f494-d737-4ea9-831b-d1a5906fb90a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:28.479832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69b1f494-d737-4ea9-831b-d1a5906fb90a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.483261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69b1f494-d737-4ea9-831b-d1a5906fb90a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.483760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69b1f494-d737-4ea9-831b-d1a5906fb90a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.484510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69b1f494-d737-4ea9-831b-d1a5906fb90a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.484988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69b1f494-d737-4ea9-831b-d1a5906fb90a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.485420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-69b1f494-d737-4ea9-831b-d1a5906fb90a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.497427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1b6a367d-1e6b-42ee-a0fe-0938ece2b48f req-8c4df946-8ed7-47c8-a6c6-cd46fa9284e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e139e1-f1cf-437c-a02d-acbd52fea8be", "tag": "42706765-ea3d-4a18-9703-6df239805dcc"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:28.538760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1b6a367d-1e6b-42ee-a0fe-0938ece2b48f req-8c4df946-8ed7-47c8-a6c6-cd46fa9284e6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.539460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1b6a367d-1e6b-42ee-a0fe-0938ece2b48f req-8c4df946-8ed7-47c8-a6c6-cd46fa9284e6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.541000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1b6a367d-1e6b-42ee-a0fe-0938ece2b48f req-8c4df946-8ed7-47c8-a6c6-cd46fa9284e6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.573837 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1b6a367d-1e6b-42ee-a0fe-0938ece2b48f req-8c4df946-8ed7-47c8-a6c6-cd46fa9284e6 service nova] Creating event network-changed:42706765-ea3d-4a18-9703-6df239805dcc for instance 39e139e1-f1cf-437c-a02d-acbd52fea8be on n-h2-852084-5 Aug 27 03:13:28.585836 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1b6a367d-1e6b-42ee-a0fe-0938ece2b48f req-8c4df946-8ed7-47c8-a6c6-cd46fa9284e6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092502 Aug 27 03:13:28.593148 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3078/5965] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:28.632758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-69b1f494-d737-4ea9-831b-d1a5906fb90a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:13:28.864507 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-69b1f494-d737-4ea9-831b-d1a5906fb90a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "DELETE /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 204 len: 0 microversion: 2.1 time: 0.414529 Aug 27 03:13:28.869265 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2888/5966] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:13:28 2022] DELETE /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:13:28.883759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dc573fd1-0e86-49e6-9d0c-d99de91870a9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:28.887278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dc573fd1-0e86-49e6-9d0c-d99de91870a9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:28.914672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc573fd1-0e86-49e6-9d0c-d99de91870a9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.931830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc573fd1-0e86-49e6-9d0c-d99de91870a9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.936190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc573fd1-0e86-49e6-9d0c-d99de91870a9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:28.939374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc573fd1-0e86-49e6-9d0c-d99de91870a9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:28.941770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc573fd1-0e86-49e6-9d0c-d99de91870a9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:28.948344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc573fd1-0e86-49e6-9d0c-d99de91870a9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:29.525281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dc573fd1-0e86-49e6-9d0c-d99de91870a9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:29.535796 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dc573fd1-0e86-49e6-9d0c-d99de91870a9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1689 microversion: 2.1 time: 0.664788 Aug 27 03:13:29.536408 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3079/5967] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:28 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1689 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:30.591167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3bd4d845-116e-4dc6-b4a4-07e829cc272a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:30.594516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3bd4d845-116e-4dc6-b4a4-07e829cc272a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:30.606830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bd4d845-116e-4dc6-b4a4-07e829cc272a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:30.617321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bd4d845-116e-4dc6-b4a4-07e829cc272a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:30.623215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bd4d845-116e-4dc6-b4a4-07e829cc272a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:30.627103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bd4d845-116e-4dc6-b4a4-07e829cc272a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:30.627749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bd4d845-116e-4dc6-b4a4-07e829cc272a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:30.628578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3bd4d845-116e-4dc6-b4a4-07e829cc272a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:31.333474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3bd4d845-116e-4dc6-b4a4-07e829cc272a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:31.347580 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3bd4d845-116e-4dc6-b4a4-07e829cc272a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1689 microversion: 2.1 time: 0.761093 Aug 27 03:13:31.350751 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2889/5968] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:30 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1689 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:31.926544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9996e755-084d-4378-8a6e-8d344e6a7a30 req-2ca5de25-fc7b-4de5-b25d-48c0b5778aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e139e1-f1cf-437c-a02d-acbd52fea8be", "name": "network-vif-deleted", "tag": "42706765-ea3d-4a18-9703-6df239805dcc"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:31.933626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=32 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:31.965565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9996e755-084d-4378-8a6e-8d344e6a7a30 req-2ca5de25-fc7b-4de5-b25d-48c0b5778aec service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:31.966310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9996e755-084d-4378-8a6e-8d344e6a7a30 req-2ca5de25-fc7b-4de5-b25d-48c0b5778aec service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:31.967009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9996e755-084d-4378-8a6e-8d344e6a7a30 req-2ca5de25-fc7b-4de5-b25d-48c0b5778aec service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:31.995539 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9996e755-084d-4378-8a6e-8d344e6a7a30 req-2ca5de25-fc7b-4de5-b25d-48c0b5778aec service nova] Creating event network-vif-deleted:42706765-ea3d-4a18-9703-6df239805dcc for instance 39e139e1-f1cf-437c-a02d-acbd52fea8be on n-h2-852084-5 Aug 27 03:13:32.005315 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9996e755-084d-4378-8a6e-8d344e6a7a30 req-2ca5de25-fc7b-4de5-b25d-48c0b5778aec service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082726 Aug 27 03:13:32.007609 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3080/5969] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:13:32.373547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:32.374259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:32.407015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:32.407526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:32.413491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:32.414524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:32.415742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:32.416987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:32.600987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:32.610685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:32.624964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:32.631990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lazy-loading 'fault' on Instance uuid 39e139e1-f1cf-437c-a02d-acbd52fea8be {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:13:32.717299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:13:32.775821 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e011a317-df20-4e10-8f16-f51eb9b02fd6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 200 len: 1356 microversion: 2.1 time: 0.403271 Aug 27 03:13:32.778111 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2890/5970] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:32 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 1356 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:13:33.803332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:33.804755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 39e139e1-f1cf-437c-a02d-acbd52fea8be] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:13:33.828620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:33.829400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:33.830086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:33.831085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:13:33.832562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:13:33.833183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:13:33.869395 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] HTTP exception thrown: Instance 39e139e1-f1cf-437c-a02d-acbd52fea8be could not be found. Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Request method failure captured: Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be HTTP/1.1 Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYqQfBm6GS9xqnQK0kCaegkxtUGxBmgmlqSE3zjvPxF6xt1EIGwA_wROeCKLm5jKuicPFEf8dtAhztXrirum6yNgvTCeNAjM228kmH2Nzqe36R_uGkBJ85LsP_Ff542Y0N4IgZbqEya_XvrJ_7ujqHupudK2EUD953gaJkgcviDbsqs Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 08baa7977bed4278b5cacdb7f34ebf2f Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/08baa7977bed4278b5cacdb7f34ebf2f"}]}] Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 08baa7977bed4278b5cacdb7f34ebf2f Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestNetworkAdvancedServerOps-133114655-project Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 86930a2f684449a5a228ea43a7ab5e23 Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestNetworkAdvancedServerOps-133114655-project Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 39e139e1-f1cf-437c-a02d-acbd52fea8be could not be found. Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '39e139e1-f1cf-437c-a02d-acbd52fea8be'} Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e139e1-f1cf-437c-a02d-acbd52fea8be could not be found. Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e139e1-f1cf-437c-a02d-acbd52fea8be could not be found. Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:13:33.875836 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:13:33.880602 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:13:33.880602 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:13:33.880602 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:13:33.880602 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:13:33.880602 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:13:33.880602 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:13:33.880602 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e139e1-f1cf-437c-a02d-acbd52fea8be could not be found. Aug 27 03:13:33.880602 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:13:33.880602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Returning 404 to user: Instance 39e139e1-f1cf-437c-a02d-acbd52fea8be could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:13:33.880602 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9a7e0b32-9bd8-439d-9ebd-c1ca4081eee9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be" status: 404 len: 111 microversion: 2.1 time: 0.078721 Aug 27 03:13:33.880602 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3081/5971] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:13:33 2022] GET /compute/v2.1/servers/39e139e1-f1cf-437c-a02d-acbd52fea8be => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:13:43.258875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cec41173-3245-4b48-8331-021d7f876072 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '.version_select at 0x7f4d2931bee0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:13:43.265032 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cec41173-3245-4b48-8331-021d7f876072 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [be6cc275-542e-4ac3-b13b-2b433e370f04] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:13:43.266584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:43.267361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:44.274113 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [None req-cec41173-3245-4b48-8331-021d7f876072 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [be6cc275-542e-4ac3-b13b-2b433e370f04] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 42286. Aug 27 03:13:44.325614 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cec41173-3245-4b48-8331-021d7f876072 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1881756802" status: 202 len: 0 microversion: 2.1 time: 1.070705 Aug 27 03:13:44.326445 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2891/5972] 10.222.0.99 () {58 vars in 1284 bytes} [Sat Aug 27 03:13:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1881756802 => generated 0 bytes in 1073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:13:44.369459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-766fc93c-2508-40c0-be40-df996cb67cf2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'create', calling method: .version_select at 0x7f4d292160d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1228483088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxtUWbJqIx9k2AFPZLoUx0c6Fm8w+Obwu2r0HIS32OIlRDaNF0+RAUE7R1x6wIfbFWWnCwmzsE17++nd6ZTEN8kFIUDh2ju+j2gI0P3Ys1fzLbJL+8fILr5w2SocDKZPg=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:13:44.405518 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:13:44.405837 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 03:13:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.99) !!! Aug 27 03:13:44.407472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:44.414829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=18 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:13:44.455363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-766fc93c-2508-40c0-be40-df996cb67cf2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:13:44.469362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-766fc93c-2508-40c0-be40-df996cb67cf2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for user 86930a2f684449a5a228ea43a7ab5e23 and project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:13:44.527188 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-766fc93c-2508-40c0-be40-df996cb67cf2 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.165153 Aug 27 03:13:44.534671 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3082/5973] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:13:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:01.004079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:01.011668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2062349379", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "2b1f4a5e-1676-4784-81b5-853d08b9f554"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1228483088", "security_groups": [{"name": "tempest-secgroup-smoke-267645356"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:01.395735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] validate_networks() for [('2b1f4a5e-1676-4784-81b5-853d08b9f554', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:14:02.401126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:14:02.401773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:14:02.402265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:14:02.402886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:14:02.403316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:14:02.426404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.427297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.427992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.433784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:02.434601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:02.435367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:02.493536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:14:02.501232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for user 86930a2f684449a5a228ea43a7ab5e23 and project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:14:02.522471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:14:02.532378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:14:02.627545 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-06303ed7-b698-4478-be4b-277aa574234c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.621682 Aug 27 03:14:02.643736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5f57d713-cee8-41d9-aaae-8050dd9c0924 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:02.645080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5f57d713-cee8-41d9-aaae-8050dd9c0924 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:02.653941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:02.654746 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2892/5974] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:14:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:14:02.659455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:02.877841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5f57d713-cee8-41d9-aaae-8050dd9c0924 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:02.901841 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f57d713-cee8-41d9-aaae-8050dd9c0924 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1267 microversion: 2.1 time: 0.263291 Aug 27 03:14:02.902267 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3083/5975] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:02 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:03.926057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9d9f3fdd-9ce3-4073-9dcf-6d7e5ef96fb4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:03.926681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9d9f3fdd-9ce3-4073-9dcf-6d7e5ef96fb4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:03.960572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d9f3fdd-9ce3-4073-9dcf-6d7e5ef96fb4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:03.965528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d9f3fdd-9ce3-4073-9dcf-6d7e5ef96fb4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:03.967357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d9f3fdd-9ce3-4073-9dcf-6d7e5ef96fb4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:03.969478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d9f3fdd-9ce3-4073-9dcf-6d7e5ef96fb4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:03.975382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d9f3fdd-9ce3-4073-9dcf-6d7e5ef96fb4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:03.976242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d9f3fdd-9ce3-4073-9dcf-6d7e5ef96fb4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:04.222618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9d9f3fdd-9ce3-4073-9dcf-6d7e5ef96fb4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:04.249208 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9d9f3fdd-9ce3-4073-9dcf-6d7e5ef96fb4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1271 microversion: 2.1 time: 0.326704 Aug 27 03:14:04.266071 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2893/5976] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:03 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1271 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:05.272566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78927f68-a96d-45ed-90a1-ef6cc34f177e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:05.273208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-78927f68-a96d-45ed-90a1-ef6cc34f177e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:05.292608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78927f68-a96d-45ed-90a1-ef6cc34f177e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:05.293226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78927f68-a96d-45ed-90a1-ef6cc34f177e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:05.293723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78927f68-a96d-45ed-90a1-ef6cc34f177e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:05.307797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78927f68-a96d-45ed-90a1-ef6cc34f177e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:05.308431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78927f68-a96d-45ed-90a1-ef6cc34f177e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:05.308898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78927f68-a96d-45ed-90a1-ef6cc34f177e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:05.472230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-78927f68-a96d-45ed-90a1-ef6cc34f177e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:05.490469 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-78927f68-a96d-45ed-90a1-ef6cc34f177e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1337 microversion: 2.1 time: 0.221812 Aug 27 03:14:05.491095 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3084/5977] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:05 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1337 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:06.520377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5749ee36-f3fb-49a8-9fa1-ad949deb6595 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:06.521015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5749ee36-f3fb-49a8-9fa1-ad949deb6595 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:06.549021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5749ee36-f3fb-49a8-9fa1-ad949deb6595 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:06.549571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5749ee36-f3fb-49a8-9fa1-ad949deb6595 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:06.550413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5749ee36-f3fb-49a8-9fa1-ad949deb6595 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:06.556054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5749ee36-f3fb-49a8-9fa1-ad949deb6595 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:06.557580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5749ee36-f3fb-49a8-9fa1-ad949deb6595 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:06.558663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5749ee36-f3fb-49a8-9fa1-ad949deb6595 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:06.739758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5749ee36-f3fb-49a8-9fa1-ad949deb6595 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:06.752088 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5749ee36-f3fb-49a8-9fa1-ad949deb6595 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1325 microversion: 2.1 time: 0.238883 Aug 27 03:14:06.755577 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2894/5978] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:06 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:07.782716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c73499e6-6cd9-4f18-9a6c-8fc75079e67d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:07.784339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c73499e6-6cd9-4f18-9a6c-8fc75079e67d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:07.813478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c73499e6-6cd9-4f18-9a6c-8fc75079e67d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:07.815484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c73499e6-6cd9-4f18-9a6c-8fc75079e67d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:07.817445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c73499e6-6cd9-4f18-9a6c-8fc75079e67d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:07.818382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c73499e6-6cd9-4f18-9a6c-8fc75079e67d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:07.831218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c73499e6-6cd9-4f18-9a6c-8fc75079e67d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:07.844061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c73499e6-6cd9-4f18-9a6c-8fc75079e67d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:08.072517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c73499e6-6cd9-4f18-9a6c-8fc75079e67d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:08.083127 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c73499e6-6cd9-4f18-9a6c-8fc75079e67d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1392 microversion: 2.1 time: 0.304655 Aug 27 03:14:08.084295 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3085/5979] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:07 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1392 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:09.103763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-19563141-eefa-422a-b62a-e6d268bcc9cd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:09.105633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-19563141-eefa-422a-b62a-e6d268bcc9cd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:09.114442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19563141-eefa-422a-b62a-e6d268bcc9cd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:09.115287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19563141-eefa-422a-b62a-e6d268bcc9cd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:09.115904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19563141-eefa-422a-b62a-e6d268bcc9cd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:09.116791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19563141-eefa-422a-b62a-e6d268bcc9cd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:09.118217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19563141-eefa-422a-b62a-e6d268bcc9cd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:09.118832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19563141-eefa-422a-b62a-e6d268bcc9cd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:09.511118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-19563141-eefa-422a-b62a-e6d268bcc9cd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:09.525650 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-19563141-eefa-422a-b62a-e6d268bcc9cd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1392 microversion: 2.1 time: 0.421379 Aug 27 03:14:09.527608 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2895/5980] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:09 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1392 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:09.796241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-36762801-347f-47f6-8416-5279d115570a req-5e804ae7-e6ea-45d8-aa71-1c6516b63afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e783f78e-4809-4e15-8916-8e550678f176", "tag": "856e3d51-6645-4699-a454-40644e835bc4"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:09.821765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-36762801-347f-47f6-8416-5279d115570a req-5e804ae7-e6ea-45d8-aa71-1c6516b63afe service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:09.826081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-36762801-347f-47f6-8416-5279d115570a req-5e804ae7-e6ea-45d8-aa71-1c6516b63afe service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:09.834098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-36762801-347f-47f6-8416-5279d115570a req-5e804ae7-e6ea-45d8-aa71-1c6516b63afe service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:09.863502 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-36762801-347f-47f6-8416-5279d115570a req-5e804ae7-e6ea-45d8-aa71-1c6516b63afe service nova] Creating event network-changed:856e3d51-6645-4699-a454-40644e835bc4 for instance e783f78e-4809-4e15-8916-8e550678f176 on n-h1-852084-5 Aug 27 03:14:09.874291 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-36762801-347f-47f6-8416-5279d115570a req-5e804ae7-e6ea-45d8-aa71-1c6516b63afe service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083911 Aug 27 03:14:09.881886 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3086/5981] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:10.547595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e68aea9e-382b-4b9e-a7bb-87a70e87f222 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:10.551143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e68aea9e-382b-4b9e-a7bb-87a70e87f222 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:10.579890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e68aea9e-382b-4b9e-a7bb-87a70e87f222 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.581496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e68aea9e-382b-4b9e-a7bb-87a70e87f222 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.582430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e68aea9e-382b-4b9e-a7bb-87a70e87f222 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.583287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e68aea9e-382b-4b9e-a7bb-87a70e87f222 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:10.583882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e68aea9e-382b-4b9e-a7bb-87a70e87f222 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:10.585369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e68aea9e-382b-4b9e-a7bb-87a70e87f222 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:10.832728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e68aea9e-382b-4b9e-a7bb-87a70e87f222 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:10.843628 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e68aea9e-382b-4b9e-a7bb-87a70e87f222 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1392 microversion: 2.1 time: 0.300298 Aug 27 03:14:10.844438 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2896/5982] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:10 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1392 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:11.865524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-802880bc-8ff9-4914-8bff-7d9160cc6253 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:11.866267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-802880bc-8ff9-4914-8bff-7d9160cc6253 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:11.877894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802880bc-8ff9-4914-8bff-7d9160cc6253 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:11.878634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802880bc-8ff9-4914-8bff-7d9160cc6253 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:11.879455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802880bc-8ff9-4914-8bff-7d9160cc6253 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:11.880386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802880bc-8ff9-4914-8bff-7d9160cc6253 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:11.881144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802880bc-8ff9-4914-8bff-7d9160cc6253 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:11.882107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802880bc-8ff9-4914-8bff-7d9160cc6253 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:12.150436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-802880bc-8ff9-4914-8bff-7d9160cc6253 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:12.163645 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-802880bc-8ff9-4914-8bff-7d9160cc6253 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1392 microversion: 2.1 time: 0.299961 Aug 27 03:14:12.164408 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3087/5983] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:11 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1392 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:13.190027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0562bd76-d241-4b7d-9725-1d1546a15ec3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:13.191116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0562bd76-d241-4b7d-9725-1d1546a15ec3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:13.194872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:13.196049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:13.205894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0562bd76-d241-4b7d-9725-1d1546a15ec3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:13.205894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0562bd76-d241-4b7d-9725-1d1546a15ec3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:13.205894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0562bd76-d241-4b7d-9725-1d1546a15ec3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:13.208267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0562bd76-d241-4b7d-9725-1d1546a15ec3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:13.209243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0562bd76-d241-4b7d-9725-1d1546a15ec3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:13.210727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0562bd76-d241-4b7d-9725-1d1546a15ec3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:13.400896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0562bd76-d241-4b7d-9725-1d1546a15ec3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:13.419724 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0562bd76-d241-4b7d-9725-1d1546a15ec3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1392 microversion: 2.1 time: 0.228856 Aug 27 03:14:13.420831 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2897/5984] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:13 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1392 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:14.453207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0083d242-f9fe-4197-bca8-1317a25df3eb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:14.453977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0083d242-f9fe-4197-bca8-1317a25df3eb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:14.463405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:14.466232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0083d242-f9fe-4197-bca8-1317a25df3eb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:14.466993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0083d242-f9fe-4197-bca8-1317a25df3eb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:14.467652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0083d242-f9fe-4197-bca8-1317a25df3eb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:14.468843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0083d242-f9fe-4197-bca8-1317a25df3eb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:14.470244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0083d242-f9fe-4197-bca8-1317a25df3eb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:14.470905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0083d242-f9fe-4197-bca8-1317a25df3eb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:14.669185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0083d242-f9fe-4197-bca8-1317a25df3eb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:14.679986 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0083d242-f9fe-4197-bca8-1317a25df3eb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1392 microversion: 2.1 time: 0.239656 Aug 27 03:14:14.690707 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3088/5985] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:14 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1392 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:15.704887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da89e9e7-79ef-41d5-b4d0-65a27bebe4fd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:15.706160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da89e9e7-79ef-41d5-b4d0-65a27bebe4fd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:15.730661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da89e9e7-79ef-41d5-b4d0-65a27bebe4fd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:15.734203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da89e9e7-79ef-41d5-b4d0-65a27bebe4fd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:15.735820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da89e9e7-79ef-41d5-b4d0-65a27bebe4fd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:15.736740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da89e9e7-79ef-41d5-b4d0-65a27bebe4fd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:15.738382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da89e9e7-79ef-41d5-b4d0-65a27bebe4fd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:15.740279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da89e9e7-79ef-41d5-b4d0-65a27bebe4fd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:15.951538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-da89e9e7-79ef-41d5-b4d0-65a27bebe4fd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:15.967620 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da89e9e7-79ef-41d5-b4d0-65a27bebe4fd tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1392 microversion: 2.1 time: 0.266982 Aug 27 03:14:15.969406 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2898/5986] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:15 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1392 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:17.001313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4ef6fefe-0607-4ab8-9150-5958b3ed4db0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:17.003417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-75462073-e929-4fa0-8d3e-00a159c819be req-a978a435-16c6-4f65-a27b-0b59a39df99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e783f78e-4809-4e15-8916-8e550678f176", "name": "network-vif-plugged", "status": "completed", "tag": "856e3d51-6645-4699-a454-40644e835bc4"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:17.005815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4ef6fefe-0607-4ab8-9150-5958b3ed4db0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:17.027720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef6fefe-0607-4ab8-9150-5958b3ed4db0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.028217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef6fefe-0607-4ab8-9150-5958b3ed4db0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.028663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef6fefe-0607-4ab8-9150-5958b3ed4db0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.029384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef6fefe-0607-4ab8-9150-5958b3ed4db0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.035632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef6fefe-0607-4ab8-9150-5958b3ed4db0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.036114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4ef6fefe-0607-4ab8-9150-5958b3ed4db0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.039737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-75462073-e929-4fa0-8d3e-00a159c819be req-a978a435-16c6-4f65-a27b-0b59a39df99e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:17.040242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-75462073-e929-4fa0-8d3e-00a159c819be req-a978a435-16c6-4f65-a27b-0b59a39df99e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:17.040674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-75462073-e929-4fa0-8d3e-00a159c819be req-a978a435-16c6-4f65-a27b-0b59a39df99e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:17.082012 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-75462073-e929-4fa0-8d3e-00a159c819be req-a978a435-16c6-4f65-a27b-0b59a39df99e service nova] Creating event network-vif-plugged:856e3d51-6645-4699-a454-40644e835bc4 for instance e783f78e-4809-4e15-8916-8e550678f176 on n-h1-852084-5 Aug 27 03:14:17.104618 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-75462073-e929-4fa0-8d3e-00a159c819be req-a978a435-16c6-4f65-a27b-0b59a39df99e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110797 Aug 27 03:14:17.107936 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2899/5987] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:14:17.327409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4ef6fefe-0607-4ab8-9150-5958b3ed4db0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:17.337628 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4ef6fefe-0607-4ab8-9150-5958b3ed4db0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1392 microversion: 2.1 time: 0.348944 Aug 27 03:14:17.339369 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3089/5988] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:16 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1392 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:18.361999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f3193472-01eb-4eb8-92d5-22b7883b8532 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:18.363333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f3193472-01eb-4eb8-92d5-22b7883b8532 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:18.382981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3193472-01eb-4eb8-92d5-22b7883b8532 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.393297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3193472-01eb-4eb8-92d5-22b7883b8532 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.393820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3193472-01eb-4eb8-92d5-22b7883b8532 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.394618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3193472-01eb-4eb8-92d5-22b7883b8532 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.395080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3193472-01eb-4eb8-92d5-22b7883b8532 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.398299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f3193472-01eb-4eb8-92d5-22b7883b8532 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.813963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f3193472-01eb-4eb8-92d5-22b7883b8532 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:18.823925 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f3193472-01eb-4eb8-92d5-22b7883b8532 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1564 microversion: 2.1 time: 0.467161 Aug 27 03:14:18.833879 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2900/5989] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:18 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1564 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:18.861256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-44036d85-c31d-494c-8bad-6f27f18ef0e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:18.863137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-44036d85-c31d-494c-8bad-6f27f18ef0e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:18.876128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44036d85-c31d-494c-8bad-6f27f18ef0e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.876888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44036d85-c31d-494c-8bad-6f27f18ef0e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.877569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44036d85-c31d-494c-8bad-6f27f18ef0e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:18.878676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44036d85-c31d-494c-8bad-6f27f18ef0e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:18.879305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44036d85-c31d-494c-8bad-6f27f18ef0e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:18.879909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44036d85-c31d-494c-8bad-6f27f18ef0e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:19.173528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-44036d85-c31d-494c-8bad-6f27f18ef0e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:19.185390 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-44036d85-c31d-494c-8bad-6f27f18ef0e5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1564 microversion: 2.1 time: 0.332630 Aug 27 03:14:19.201231 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3090/5990] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:18 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1564 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:24.012845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7c6ca2f6-6628-4d4b-8614-5da8ed63607d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:24.014064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7c6ca2f6-6628-4d4b-8614-5da8ed63607d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:24.021883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1f884888-adcf-48e4-9fc4-93b585cfaca9 req-f533c29d-e47c-44e0-bea6-c005c8f430d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e783f78e-4809-4e15-8916-8e550678f176", "tag": "856e3d51-6645-4699-a454-40644e835bc4"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:24.048947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c6ca2f6-6628-4d4b-8614-5da8ed63607d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:24.052507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c6ca2f6-6628-4d4b-8614-5da8ed63607d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:24.053150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c6ca2f6-6628-4d4b-8614-5da8ed63607d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:24.055214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c6ca2f6-6628-4d4b-8614-5da8ed63607d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:24.056810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1f884888-adcf-48e4-9fc4-93b585cfaca9 req-f533c29d-e47c-44e0-bea6-c005c8f430d8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:24.057512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c6ca2f6-6628-4d4b-8614-5da8ed63607d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:24.058170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c6ca2f6-6628-4d4b-8614-5da8ed63607d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:24.063379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1f884888-adcf-48e4-9fc4-93b585cfaca9 req-f533c29d-e47c-44e0-bea6-c005c8f430d8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:24.063836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1f884888-adcf-48e4-9fc4-93b585cfaca9 req-f533c29d-e47c-44e0-bea6-c005c8f430d8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:24.097773 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1f884888-adcf-48e4-9fc4-93b585cfaca9 req-f533c29d-e47c-44e0-bea6-c005c8f430d8 service nova] Creating event network-changed:856e3d51-6645-4699-a454-40644e835bc4 for instance e783f78e-4809-4e15-8916-8e550678f176 on n-h1-852084-5 Aug 27 03:14:24.115006 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1f884888-adcf-48e4-9fc4-93b585cfaca9 req-f533c29d-e47c-44e0-bea6-c005c8f430d8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096898 Aug 27 03:14:24.127425 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3091/5991] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:14:24.996028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7c6ca2f6-6628-4d4b-8614-5da8ed63607d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:25.009130 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7c6ca2f6-6628-4d4b-8614-5da8ed63607d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1564 microversion: 2.1 time: 1.000334 Aug 27 03:14:25.010065 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2901/5992] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:24 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1564 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:42.499887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=20 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:42.502012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=40 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:42.508471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c91c331-797e-471d-b908-6d6744a15685 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:42.511313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5c91c331-797e-471d-b908-6d6744a15685 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:42.519506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c91c331-797e-471d-b908-6d6744a15685 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:42.520395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c91c331-797e-471d-b908-6d6744a15685 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:42.521041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c91c331-797e-471d-b908-6d6744a15685 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:42.521955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c91c331-797e-471d-b908-6d6744a15685 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:42.522764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c91c331-797e-471d-b908-6d6744a15685 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:42.523361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c91c331-797e-471d-b908-6d6744a15685 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:42.603043 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5c91c331-797e-471d-b908-6d6744a15685 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176/action" status: 200 len: 24568 microversion: 2.1 time: 0.105227 Aug 27 03:14:42.611920 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3092/5993] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:14:42 2022] POST /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176/action => generated 24568 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:14:53.628538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-16cb449b-3d5c-4b4e-9b34-8557fd2273b9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:53.629288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-16cb449b-3d5c-4b4e-9b34-8557fd2273b9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:53.636575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:53.638227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=52 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:53.640052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16cb449b-3d5c-4b4e-9b34-8557fd2273b9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:53.640884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16cb449b-3d5c-4b4e-9b34-8557fd2273b9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:53.641616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16cb449b-3d5c-4b4e-9b34-8557fd2273b9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:53.642611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16cb449b-3d5c-4b4e-9b34-8557fd2273b9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:53.643514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16cb449b-3d5c-4b4e-9b34-8557fd2273b9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:53.644471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16cb449b-3d5c-4b4e-9b34-8557fd2273b9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:54.341705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16cb449b-3d5c-4b4e-9b34-8557fd2273b9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:14:54.353738 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-16cb449b-3d5c-4b4e-9b34-8557fd2273b9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1682 microversion: 2.1 time: 0.729829 Aug 27 03:14:54.354321 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2902/5994] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:53 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1682 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:54.532915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d0904315-d51c-409d-bb8d-39048ad86565 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:54.560986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d0904315-d51c-409d-bb8d-39048ad86565 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:54.578076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:54.596117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:14:54.669087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0904315-d51c-409d-bb8d-39048ad86565 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:54.669794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0904315-d51c-409d-bb8d-39048ad86565 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:54.670301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0904315-d51c-409d-bb8d-39048ad86565 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:54.671001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0904315-d51c-409d-bb8d-39048ad86565 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:54.671915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0904315-d51c-409d-bb8d-39048ad86565 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:54.679632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d0904315-d51c-409d-bb8d-39048ad86565 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:54.807116 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d0904315-d51c-409d-bb8d-39048ad86565 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176/action" status: 200 len: 32643 microversion: 2.1 time: 0.278419 Aug 27 03:14:54.807983 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3093/5995] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:14:54 2022] POST /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176/action => generated 32643 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:14:54.957321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0730cc6d-6fd1-41f3-a863-a4b6c1be8263 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:14:54.958246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0730cc6d-6fd1-41f3-a863-a4b6c1be8263 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:54.999989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0730cc6d-6fd1-41f3-a863-a4b6c1be8263 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:55.003103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0730cc6d-6fd1-41f3-a863-a4b6c1be8263 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:55.003869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0730cc6d-6fd1-41f3-a863-a4b6c1be8263 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.007931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0730cc6d-6fd1-41f3-a863-a4b6c1be8263 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:55.009439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0730cc6d-6fd1-41f3-a863-a4b6c1be8263 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:55.011666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0730cc6d-6fd1-41f3-a863-a4b6c1be8263 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.390190 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0730cc6d-6fd1-41f3-a863-a4b6c1be8263 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1833 microversion: 2.1 time: 0.438515 Aug 27 03:14:55.393429 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2903/5996] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:14:54 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1833 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:14:55.470824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:14:55.473907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:14:55.483328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:55.486422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:55.494119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.495196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:14:55.495839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:14:55.496446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:14:55.543467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lazy-loading 'flavor' on Instance uuid e783f78e-4809-4e15-8916-8e550678f176 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:14:55.588331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: e783f78e-4809-4e15-8916-8e550678f176] Going to try to live migrate instance to another host {{(pid=122488) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 27 03:14:55.809150 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [8b6afc38-b31e-4e9f-bc91-aae46f71aee6] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:14:56.825366 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [8b6afc38-b31e-4e9f-bc91-aae46f71aee6] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 43896. Aug 27 03:15:00.747604 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1aaf9e15-a478-409d-9cde-51e50f7358d0 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176/action" status: 202 len: 0 microversion: 2.1 time: 5.296056 Aug 27 03:15:00.748647 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3094/5997] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:14:55 2022] POST /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176/action => generated 0 bytes in 5303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:15:00.757367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4c7d283f-b031-4f0c-afce-7390b8330daa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:00.758244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4c7d283f-b031-4f0c-afce-7390b8330daa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:00.768122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c7d283f-b031-4f0c-afce-7390b8330daa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:00.768651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c7d283f-b031-4f0c-afce-7390b8330daa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:00.769087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c7d283f-b031-4f0c-afce-7390b8330daa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:00.769884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c7d283f-b031-4f0c-afce-7390b8330daa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:00.770359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c7d283f-b031-4f0c-afce-7390b8330daa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:00.770875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4c7d283f-b031-4f0c-afce-7390b8330daa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:01.309643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4c7d283f-b031-4f0c-afce-7390b8330daa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:01.330613 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4c7d283f-b031-4f0c-afce-7390b8330daa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1692 microversion: 2.1 time: 0.577259 Aug 27 03:15:01.346509 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2904/5998] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:00 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1692 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:02.364303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3f5e425b-6e89-4ae4-93a4-b6e27cd99c98 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:02.364975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3f5e425b-6e89-4ae4-93a4-b6e27cd99c98 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:02.387915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f5e425b-6e89-4ae4-93a4-b6e27cd99c98 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:02.388416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f5e425b-6e89-4ae4-93a4-b6e27cd99c98 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:02.388863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f5e425b-6e89-4ae4-93a4-b6e27cd99c98 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:02.389609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f5e425b-6e89-4ae4-93a4-b6e27cd99c98 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:02.390108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f5e425b-6e89-4ae4-93a4-b6e27cd99c98 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:02.390546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f5e425b-6e89-4ae4-93a4-b6e27cd99c98 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:02.740270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e724292-3cfc-42c1-afce-2f6ebae88dc3 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Action: 'create', calling method: .version_select at 0x7f4d293523a0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-152269922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6GSwWuq2bZz/6iIlxFwuUq4BYOB1/35rQEZG74Q5xmwYq1pLxvxxzY1cUCu6gTxX9eOgh4NM2b2o6QcJaI7ppkLtLM9VGVu4bXRKxPXZm23DzFT55faDf3rq+UDuvgkg=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:02.771139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-9e724292-3cfc-42c1-afce-2f6ebae88dc3 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Getting quotas for project f5ee79f69e564395a60352e0d81b9840. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:15:02.792675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-9e724292-3cfc-42c1-afce-2f6ebae88dc3 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Getting quotas for user 0045bf81a2b5458d8641a6a5cdb01056 and project f5ee79f69e564395a60352e0d81b9840. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:15:02.862287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9e724292-3cfc-42c1-afce-2f6ebae88dc3 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.131173 Aug 27 03:15:02.863520 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2905/5999] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:15:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:15:02.867154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3f5e425b-6e89-4ae4-93a4-b6e27cd99c98 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:02.885466 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3f5e425b-6e89-4ae4-93a4-b6e27cd99c98 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1692 microversion: 2.1 time: 0.529050 Aug 27 03:15:02.886762 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3095/6000] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:02 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1692 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:03.915869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-19fde1c4-c85d-46a8-a11c-ab16f6255e13 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:03.915869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-19fde1c4-c85d-46a8-a11c-ab16f6255e13 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:03.954422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fde1c4-c85d-46a8-a11c-ab16f6255e13 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.954937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fde1c4-c85d-46a8-a11c-ab16f6255e13 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.955383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fde1c4-c85d-46a8-a11c-ab16f6255e13 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:03.960413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fde1c4-c85d-46a8-a11c-ab16f6255e13 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:03.962900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fde1c4-c85d-46a8-a11c-ab16f6255e13 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:03.964616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19fde1c4-c85d-46a8-a11c-ab16f6255e13 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:04.559978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-200ba3bc-ffc9-4741-9b74-d7abc9fbebfa req-d02a4fcc-2c96-497d-a543-02ab10e3a756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e783f78e-4809-4e15-8916-8e550678f176", "name": "network-vif-unplugged", "status": "completed", "tag": "856e3d51-6645-4699-a454-40644e835bc4"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:04.586360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-19fde1c4-c85d-46a8-a11c-ab16f6255e13 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:04.588422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-200ba3bc-ffc9-4741-9b74-d7abc9fbebfa req-d02a4fcc-2c96-497d-a543-02ab10e3a756 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:04.590665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-200ba3bc-ffc9-4741-9b74-d7abc9fbebfa req-d02a4fcc-2c96-497d-a543-02ab10e3a756 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:04.591355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-200ba3bc-ffc9-4741-9b74-d7abc9fbebfa req-d02a4fcc-2c96-497d-a543-02ab10e3a756 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:04.606044 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-19fde1c4-c85d-46a8-a11c-ab16f6255e13 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1692 microversion: 2.1 time: 0.697526 Aug 27 03:15:04.606653 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2906/6001] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:03 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1692 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:04.630668 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-200ba3bc-ffc9-4741-9b74-d7abc9fbebfa req-d02a4fcc-2c96-497d-a543-02ab10e3a756 service nova] Creating event network-vif-unplugged:856e3d51-6645-4699-a454-40644e835bc4 for instance e783f78e-4809-4e15-8916-8e550678f176 on n-h1-852084-5 Aug 27 03:15:04.652608 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-200ba3bc-ffc9-4741-9b74-d7abc9fbebfa req-d02a4fcc-2c96-497d-a543-02ab10e3a756 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.413328 Aug 27 03:15:04.659130 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3096/6002] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:15:05.638035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3cf5fbe7-4f19-4922-a520-bd2818c30047 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:05.639356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3cf5fbe7-4f19-4922-a520-bd2818c30047 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:05.657466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf5fbe7-4f19-4922-a520-bd2818c30047 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:05.662586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf5fbe7-4f19-4922-a520-bd2818c30047 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:05.664933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf5fbe7-4f19-4922-a520-bd2818c30047 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:05.669066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf5fbe7-4f19-4922-a520-bd2818c30047 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:05.672592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf5fbe7-4f19-4922-a520-bd2818c30047 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:05.675168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3cf5fbe7-4f19-4922-a520-bd2818c30047 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.341480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3cf5fbe7-4f19-4922-a520-bd2818c30047 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:06.356698 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3cf5fbe7-4f19-4922-a520-bd2818c30047 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1692 microversion: 2.1 time: 0.723890 Aug 27 03:15:06.357299 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2907/6003] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:05 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1692 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:06.482981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1537993610", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fca3d7ad-8c8c-4f78-a202-2e13d9880162", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-152269922", "security_groups": [{"name": "tempest-secgroup-smoke-733160483"}], "networks": [{"uuid": "016c1988-ca74-4361-87c7-652945896b80"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:06.726498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-9e69e9bc-4a7b-4928-9f84-1dce0ba48694 req-dcdb1d74-3981-434c-b779-4180622f04af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e783f78e-4809-4e15-8916-8e550678f176", "tag": "856e3d51-6645-4699-a454-40644e835bc4"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:06.752377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9e69e9bc-4a7b-4928-9f84-1dce0ba48694 req-dcdb1d74-3981-434c-b779-4180622f04af service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:06.753125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9e69e9bc-4a7b-4928-9f84-1dce0ba48694 req-dcdb1d74-3981-434c-b779-4180622f04af service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:06.753971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9e69e9bc-4a7b-4928-9f84-1dce0ba48694 req-dcdb1d74-3981-434c-b779-4180622f04af service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:06.781370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] validate_networks() for [('016c1988-ca74-4361-87c7-652945896b80', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:15:06.807796 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-9e69e9bc-4a7b-4928-9f84-1dce0ba48694 req-dcdb1d74-3981-434c-b779-4180622f04af service nova] Creating event network-changed:856e3d51-6645-4699-a454-40644e835bc4 for instance e783f78e-4809-4e15-8916-8e550678f176 on n-h1-852084-5 Aug 27 03:15:06.820481 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-9e69e9bc-4a7b-4928-9f84-1dce0ba48694 req-dcdb1d74-3981-434c-b779-4180622f04af service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095606 Aug 27 03:15:06.821387 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2908/6004] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:07.381059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-57f19e64-f3e1-4999-b7df-5806efccf669 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:07.387021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-57f19e64-f3e1-4999-b7df-5806efccf669 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:07.397922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f19e64-f3e1-4999-b7df-5806efccf669 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:07.399016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f19e64-f3e1-4999-b7df-5806efccf669 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:07.400866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f19e64-f3e1-4999-b7df-5806efccf669 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:07.402578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f19e64-f3e1-4999-b7df-5806efccf669 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:07.403993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f19e64-f3e1-4999-b7df-5806efccf669 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:07.406309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57f19e64-f3e1-4999-b7df-5806efccf669 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:07.958862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-57f19e64-f3e1-4999-b7df-5806efccf669 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:07.975660 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-57f19e64-f3e1-4999-b7df-5806efccf669 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1692 microversion: 2.1 time: 0.598801 Aug 27 03:15:07.978799 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2909/6005] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:07 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1692 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:15:08.136621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:15:08.137092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:15:08.137469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:15:08.137924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:15:08.138355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:15:08.148998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:08.149506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:08.150032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:08.150784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:08.151254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:08.151688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:08.173073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Getting quotas for project f5ee79f69e564395a60352e0d81b9840. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:15:08.179649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Getting quotas for user 0045bf81a2b5458d8641a6a5cdb01056 and project f5ee79f69e564395a60352e0d81b9840. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:15:08.268936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:15:08.273088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fca3d7ad-8c8c-4f78-a202-2e13d9880162',volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:15:08.641252 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4d63cff8-3d9b-47fb-a851-b2ba3c033859 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.159992 Aug 27 03:15:08.645836 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3097/6006] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:15:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:15:08.659592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c1d640e7-6c7d-40f8-a524-25daaf027fce tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:08.660768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c1d640e7-6c7d-40f8-a524-25daaf027fce tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:08.965313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c1d640e7-6c7d-40f8-a524-25daaf027fce tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:08.983011 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c1d640e7-6c7d-40f8-a524-25daaf027fce tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1098 microversion: 2.1 time: 0.328809 Aug 27 03:15:09.001164 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2910/6007] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:08 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1098 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:09.007971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b62399f-c9cb-4aca-9e91-546a23a49433 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:09.008987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6b62399f-c9cb-4aca-9e91-546a23a49433 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:09.023210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b62399f-c9cb-4aca-9e91-546a23a49433 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:09.024482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b62399f-c9cb-4aca-9e91-546a23a49433 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:09.025645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b62399f-c9cb-4aca-9e91-546a23a49433 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:09.032407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b62399f-c9cb-4aca-9e91-546a23a49433 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:09.035382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b62399f-c9cb-4aca-9e91-546a23a49433 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:09.035859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b62399f-c9cb-4aca-9e91-546a23a49433 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:09.513580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6b62399f-c9cb-4aca-9e91-546a23a49433 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:09.528565 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b62399f-c9cb-4aca-9e91-546a23a49433 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1692 microversion: 2.1 time: 0.525758 Aug 27 03:15:09.529504 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3098/6008] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:09 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1692 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:10.016294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-79d1e36b-1484-4fde-90c1-2832a80aea1e tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:10.018452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-79d1e36b-1484-4fde-90c1-2832a80aea1e tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:10.040464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79d1e36b-1484-4fde-90c1-2832a80aea1e tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:10.041144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79d1e36b-1484-4fde-90c1-2832a80aea1e tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:10.041820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79d1e36b-1484-4fde-90c1-2832a80aea1e tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:10.042856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79d1e36b-1484-4fde-90c1-2832a80aea1e tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:10.043604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79d1e36b-1484-4fde-90c1-2832a80aea1e tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:10.044741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79d1e36b-1484-4fde-90c1-2832a80aea1e tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:10.277890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-79d1e36b-1484-4fde-90c1-2832a80aea1e tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:10.285984 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-79d1e36b-1484-4fde-90c1-2832a80aea1e tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1140 microversion: 2.1 time: 0.273319 Aug 27 03:15:10.287387 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2911/6009] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:10 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1140 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:15:10.554524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-16994bbc-65ff-4743-aff0-2facd90089c4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:10.557422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-16994bbc-65ff-4743-aff0-2facd90089c4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:10.570197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16994bbc-65ff-4743-aff0-2facd90089c4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:10.570993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16994bbc-65ff-4743-aff0-2facd90089c4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:10.573579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16994bbc-65ff-4743-aff0-2facd90089c4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:10.574614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16994bbc-65ff-4743-aff0-2facd90089c4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:10.575248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16994bbc-65ff-4743-aff0-2facd90089c4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:10.583791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16994bbc-65ff-4743-aff0-2facd90089c4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:10.889551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-16994bbc-65ff-4743-aff0-2facd90089c4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:10.907426 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-16994bbc-65ff-4743-aff0-2facd90089c4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1692 microversion: 2.1 time: 0.356689 Aug 27 03:15:10.908618 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3099/6010] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:10 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1692 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:15:11.310370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-abcaa066-2ec4-4f8d-bde6-032456e5b751 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:11.310985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-abcaa066-2ec4-4f8d-bde6-032456e5b751 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:11.322321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abcaa066-2ec4-4f8d-bde6-032456e5b751 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:11.323060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abcaa066-2ec4-4f8d-bde6-032456e5b751 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:11.323678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abcaa066-2ec4-4f8d-bde6-032456e5b751 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:11.324616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abcaa066-2ec4-4f8d-bde6-032456e5b751 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:11.325248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abcaa066-2ec4-4f8d-bde6-032456e5b751 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:11.325968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abcaa066-2ec4-4f8d-bde6-032456e5b751 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:11.575889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-abcaa066-2ec4-4f8d-bde6-032456e5b751 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:11.587589 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-abcaa066-2ec4-4f8d-bde6-032456e5b751 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1214 microversion: 2.1 time: 0.282048 Aug 27 03:15:11.604538 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2912/6011] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:11 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1214 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:11.931561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5cb6e45d-170e-4e15-a643-4dd6bbfee51a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:11.932885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5cb6e45d-170e-4e15-a643-4dd6bbfee51a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:11.944470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cb6e45d-170e-4e15-a643-4dd6bbfee51a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:11.945224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cb6e45d-170e-4e15-a643-4dd6bbfee51a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:11.950347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cb6e45d-170e-4e15-a643-4dd6bbfee51a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:11.951350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cb6e45d-170e-4e15-a643-4dd6bbfee51a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:11.952070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cb6e45d-170e-4e15-a643-4dd6bbfee51a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:11.952678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5cb6e45d-170e-4e15-a643-4dd6bbfee51a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:12.372433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5cb6e45d-170e-4e15-a643-4dd6bbfee51a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:12.400826 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5cb6e45d-170e-4e15-a643-4dd6bbfee51a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1692 microversion: 2.1 time: 0.472401 Aug 27 03:15:12.405052 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3100/6012] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:11 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1692 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:12.611434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-509e00a1-d810-4efd-9313-1d9239fea268 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:12.612897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-509e00a1-d810-4efd-9313-1d9239fea268 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:12.627411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-509e00a1-d810-4efd-9313-1d9239fea268 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:12.628366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-509e00a1-d810-4efd-9313-1d9239fea268 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:12.630963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-509e00a1-d810-4efd-9313-1d9239fea268 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:12.632909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-509e00a1-d810-4efd-9313-1d9239fea268 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:12.636937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-509e00a1-d810-4efd-9313-1d9239fea268 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:12.637798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-509e00a1-d810-4efd-9313-1d9239fea268 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:12.798070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-509e00a1-d810-4efd-9313-1d9239fea268 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:12.809352 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-509e00a1-d810-4efd-9313-1d9239fea268 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1214 microversion: 2.1 time: 0.202389 Aug 27 03:15:12.830656 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2913/6013] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:12 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1214 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:13.427650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-59e4a573-3a34-435b-93a2-d18dc542f1c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:13.428475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-59e4a573-3a34-435b-93a2-d18dc542f1c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:13.460727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59e4a573-3a34-435b-93a2-d18dc542f1c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:13.472188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59e4a573-3a34-435b-93a2-d18dc542f1c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:13.474306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59e4a573-3a34-435b-93a2-d18dc542f1c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:13.476532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59e4a573-3a34-435b-93a2-d18dc542f1c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:13.478310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59e4a573-3a34-435b-93a2-d18dc542f1c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:13.484990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59e4a573-3a34-435b-93a2-d18dc542f1c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:13.845566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a614f624-0371-45e5-aaab-d74719fbfacc tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:13.847022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a614f624-0371-45e5-aaab-d74719fbfacc tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:13.871242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a614f624-0371-45e5-aaab-d74719fbfacc tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:13.877813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a614f624-0371-45e5-aaab-d74719fbfacc tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:13.878422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a614f624-0371-45e5-aaab-d74719fbfacc tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:13.886020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a614f624-0371-45e5-aaab-d74719fbfacc tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:13.886818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a614f624-0371-45e5-aaab-d74719fbfacc tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:13.887392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a614f624-0371-45e5-aaab-d74719fbfacc tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:14.607533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a614f624-0371-45e5-aaab-d74719fbfacc tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:14.620209 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a614f624-0371-45e5-aaab-d74719fbfacc tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1281 microversion: 2.1 time: 0.780069 Aug 27 03:15:14.638178 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2914/6014] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:13 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1281 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:15:14.992852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-59e4a573-3a34-435b-93a2-d18dc542f1c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:15.008048 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-59e4a573-3a34-435b-93a2-d18dc542f1c8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1692 microversion: 2.1 time: 1.584399 Aug 27 03:15:15.021902 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3101/6015] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:13 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1692 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:15.165562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-f738d879-629a-421a-97f2-b44fb0da3360 req-c1ba2667-2820-4506-90de-05ec07c42d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b353842-13ac-47f9-a0e8-d69bab50a4ae", "tag": "60329d31-4df4-4224-a4b6-44132fdb5c24"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:15.192045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f738d879-629a-421a-97f2-b44fb0da3360 req-c1ba2667-2820-4506-90de-05ec07c42d50 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:15.194356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f738d879-629a-421a-97f2-b44fb0da3360 req-c1ba2667-2820-4506-90de-05ec07c42d50 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:15.194824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f738d879-629a-421a-97f2-b44fb0da3360 req-c1ba2667-2820-4506-90de-05ec07c42d50 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:15.238993 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-f738d879-629a-421a-97f2-b44fb0da3360 req-c1ba2667-2820-4506-90de-05ec07c42d50 service nova] Creating event network-changed:60329d31-4df4-4224-a4b6-44132fdb5c24 for instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae on n-h2-852084-5 Aug 27 03:15:15.252628 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-f738d879-629a-421a-97f2-b44fb0da3360 req-c1ba2667-2820-4506-90de-05ec07c42d50 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092942 Aug 27 03:15:15.254787 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2915/6016] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:15.644627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f02c6912-2dec-46db-8dc3-6828636a772a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:15.645432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f02c6912-2dec-46db-8dc3-6828636a772a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:15.669193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f02c6912-2dec-46db-8dc3-6828636a772a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:15.669725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f02c6912-2dec-46db-8dc3-6828636a772a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:15.670182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f02c6912-2dec-46db-8dc3-6828636a772a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:15.670925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f02c6912-2dec-46db-8dc3-6828636a772a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:15.671390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f02c6912-2dec-46db-8dc3-6828636a772a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:15.671829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f02c6912-2dec-46db-8dc3-6828636a772a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:16.048881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9374284f-bd95-4726-8c20-9271fc675778 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:16.049619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9374284f-bd95-4726-8c20-9271fc675778 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:16.063362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9374284f-bd95-4726-8c20-9271fc675778 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:16.068355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9374284f-bd95-4726-8c20-9271fc675778 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:16.069138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9374284f-bd95-4726-8c20-9271fc675778 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:16.070143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9374284f-bd95-4726-8c20-9271fc675778 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:16.070802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9374284f-bd95-4726-8c20-9271fc675778 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:16.075613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9374284f-bd95-4726-8c20-9271fc675778 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:16.650549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f02c6912-2dec-46db-8dc3-6828636a772a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:16.697712 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f02c6912-2dec-46db-8dc3-6828636a772a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1281 microversion: 2.1 time: 1.054587 Aug 27 03:15:16.715013 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3102/6017] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:15 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1281 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:16.789482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9374284f-bd95-4726-8c20-9271fc675778 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:16.811830 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9374284f-bd95-4726-8c20-9271fc675778 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1692 microversion: 2.1 time: 0.755316 Aug 27 03:15:16.822195 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2916/6018] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:16 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1692 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:17.725160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ebf3e671-c9b4-4e25-9dac-bb8bde0f3b0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:17.727402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ebf3e671-c9b4-4e25-9dac-bb8bde0f3b0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:17.765143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebf3e671-c9b4-4e25-9dac-bb8bde0f3b0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:17.767883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebf3e671-c9b4-4e25-9dac-bb8bde0f3b0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:17.770322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebf3e671-c9b4-4e25-9dac-bb8bde0f3b0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:17.775083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebf3e671-c9b4-4e25-9dac-bb8bde0f3b0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:17.777986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebf3e671-c9b4-4e25-9dac-bb8bde0f3b0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:17.780427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebf3e671-c9b4-4e25-9dac-bb8bde0f3b0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:17.837610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e1f1c074-0bbd-4dc8-b08b-f09aa952f908 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:17.839060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e1f1c074-0bbd-4dc8-b08b-f09aa952f908 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:17.870577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1f1c074-0bbd-4dc8-b08b-f09aa952f908 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:17.872868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1f1c074-0bbd-4dc8-b08b-f09aa952f908 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:17.873707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1f1c074-0bbd-4dc8-b08b-f09aa952f908 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:17.888066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1f1c074-0bbd-4dc8-b08b-f09aa952f908 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:17.888788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1f1c074-0bbd-4dc8-b08b-f09aa952f908 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:17.890876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1f1c074-0bbd-4dc8-b08b-f09aa952f908 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:18.162936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:18.190080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:18.535423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ebf3e671-c9b4-4e25-9dac-bb8bde0f3b0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:18.549268 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ebf3e671-c9b4-4e25-9dac-bb8bde0f3b0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1281 microversion: 2.1 time: 0.831259 Aug 27 03:15:18.554619 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3103/6019] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:17 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1281 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:18.585224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e1f1c074-0bbd-4dc8-b08b-f09aa952f908 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:18.594612 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e1f1c074-0bbd-4dc8-b08b-f09aa952f908 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1692 microversion: 2.1 time: 0.761518 Aug 27 03:15:18.606066 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2917/6020] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:17 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1692 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:15:19.572651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6da30b18-a97d-495c-bd5c-9860ceda355a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:19.574131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6da30b18-a97d-495c-bd5c-9860ceda355a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:19.600935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6da30b18-a97d-495c-bd5c-9860ceda355a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:19.608241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6da30b18-a97d-495c-bd5c-9860ceda355a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:19.612369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6da30b18-a97d-495c-bd5c-9860ceda355a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:19.614694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6da30b18-a97d-495c-bd5c-9860ceda355a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:19.615908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6da30b18-a97d-495c-bd5c-9860ceda355a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:19.620864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-845cfb21-91eb-4a00-8ebc-97a1a7efd7ae tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:19.622109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-845cfb21-91eb-4a00-8ebc-97a1a7efd7ae tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:19.622753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6da30b18-a97d-495c-bd5c-9860ceda355a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:19.627027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:19.644017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-845cfb21-91eb-4a00-8ebc-97a1a7efd7ae tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:19.644557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-845cfb21-91eb-4a00-8ebc-97a1a7efd7ae tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:19.644996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-845cfb21-91eb-4a00-8ebc-97a1a7efd7ae tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:19.645831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-845cfb21-91eb-4a00-8ebc-97a1a7efd7ae tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:19.646412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-845cfb21-91eb-4a00-8ebc-97a1a7efd7ae tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:19.646851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-845cfb21-91eb-4a00-8ebc-97a1a7efd7ae tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:19.986959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-845cfb21-91eb-4a00-8ebc-97a1a7efd7ae tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:20.023948 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-845cfb21-91eb-4a00-8ebc-97a1a7efd7ae tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1682 microversion: 2.1 time: 0.406345 Aug 27 03:15:20.027193 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2918/6021] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:19 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1682 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:15:20.036457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6da30b18-a97d-495c-bd5c-9860ceda355a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:20.045350 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6da30b18-a97d-495c-bd5c-9860ceda355a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1281 microversion: 2.1 time: 0.476735 Aug 27 03:15:20.045982 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3104/6022] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:19 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1281 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:20.060112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6293801f-9c96-4401-9c10-f1a797150b77 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:20.061003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6293801f-9c96-4401-9c10-f1a797150b77 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:20.069287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6293801f-9c96-4401-9c10-f1a797150b77 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:20.070014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6293801f-9c96-4401-9c10-f1a797150b77 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:20.070699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6293801f-9c96-4401-9c10-f1a797150b77 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:20.071829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6293801f-9c96-4401-9c10-f1a797150b77 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:20.072497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6293801f-9c96-4401-9c10-f1a797150b77 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:20.073134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6293801f-9c96-4401-9c10-f1a797150b77 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:20.449473 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6293801f-9c96-4401-9c10-f1a797150b77 tempest-TestNetworkAdvancedServerOps-983605400 tempest-TestNetworkAdvancedServerOps-983605400-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1833 microversion: 2.1 time: 0.405016 Aug 27 03:15:20.463137 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2919/6023] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:20 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1833 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:20.480373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f240ff8b-2f40-4f7d-886d-0a07b58c60d9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:20.480786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f240ff8b-2f40-4f7d-886d-0a07b58c60d9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:20.495806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f240ff8b-2f40-4f7d-886d-0a07b58c60d9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:20.496331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f240ff8b-2f40-4f7d-886d-0a07b58c60d9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:20.496780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f240ff8b-2f40-4f7d-886d-0a07b58c60d9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:20.497602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f240ff8b-2f40-4f7d-886d-0a07b58c60d9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:20.498322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f240ff8b-2f40-4f7d-886d-0a07b58c60d9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:20.498774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f240ff8b-2f40-4f7d-886d-0a07b58c60d9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:20.714296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f240ff8b-2f40-4f7d-886d-0a07b58c60d9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:20.727999 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f240ff8b-2f40-4f7d-886d-0a07b58c60d9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1682 microversion: 2.1 time: 0.256024 Aug 27 03:15:20.737818 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3105/6024] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:20 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1682 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:20.853180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-34cdf68e-5a7b-494d-b2d3-772d1ee8a584 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:20.856094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-34cdf68e-5a7b-494d-b2d3-772d1ee8a584 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:20.871439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34cdf68e-5a7b-494d-b2d3-772d1ee8a584 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:20.872429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34cdf68e-5a7b-494d-b2d3-772d1ee8a584 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:20.872573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34cdf68e-5a7b-494d-b2d3-772d1ee8a584 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:20.873211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34cdf68e-5a7b-494d-b2d3-772d1ee8a584 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:20.873698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34cdf68e-5a7b-494d-b2d3-772d1ee8a584 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:20.874137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-34cdf68e-5a7b-494d-b2d3-772d1ee8a584 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:20.943153 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-34cdf68e-5a7b-494d-b2d3-772d1ee8a584 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176/action" status: 200 len: 38561 microversion: 2.1 time: 0.092519 Aug 27 03:15:20.953799 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2920/6025] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:15:20 2022] POST /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176/action => generated 38561 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:15:21.069638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4436d67f-d1f2-468a-a10c-37f543720085 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:21.070295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4436d67f-d1f2-468a-a10c-37f543720085 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:21.085994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4436d67f-d1f2-468a-a10c-37f543720085 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:21.086518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4436d67f-d1f2-468a-a10c-37f543720085 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:21.087011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4436d67f-d1f2-468a-a10c-37f543720085 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:21.088805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4436d67f-d1f2-468a-a10c-37f543720085 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:21.088805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4436d67f-d1f2-468a-a10c-37f543720085 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:21.088805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4436d67f-d1f2-468a-a10c-37f543720085 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:21.717373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4436d67f-d1f2-468a-a10c-37f543720085 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:21.745805 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4436d67f-d1f2-468a-a10c-37f543720085 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1269 microversion: 2.1 time: 0.680003 Aug 27 03:15:21.759766 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3106/6026] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:21 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1269 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:22.773306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-60deec65-cdd0-4800-b735-e1943335c45a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:22.776353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-60deec65-cdd0-4800-b735-e1943335c45a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:22.796214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60deec65-cdd0-4800-b735-e1943335c45a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:22.808802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60deec65-cdd0-4800-b735-e1943335c45a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:22.809548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60deec65-cdd0-4800-b735-e1943335c45a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:22.811249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60deec65-cdd0-4800-b735-e1943335c45a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:22.811921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60deec65-cdd0-4800-b735-e1943335c45a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:22.812542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-60deec65-cdd0-4800-b735-e1943335c45a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:22.971173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21664413-c1a8-4075-9c2c-5eefb1d937c6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:22.972631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21664413-c1a8-4075-9c2c-5eefb1d937c6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:22.992773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21664413-c1a8-4075-9c2c-5eefb1d937c6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:22.994714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21664413-c1a8-4075-9c2c-5eefb1d937c6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:22.996208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21664413-c1a8-4075-9c2c-5eefb1d937c6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:22.997230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21664413-c1a8-4075-9c2c-5eefb1d937c6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:22.998055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21664413-c1a8-4075-9c2c-5eefb1d937c6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:22.999075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21664413-c1a8-4075-9c2c-5eefb1d937c6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:23.040274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21664413-c1a8-4075-9c2c-5eefb1d937c6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:15:23.143987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:23.231804 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21664413-c1a8-4075-9c2c-5eefb1d937c6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 204 len: 0 microversion: 2.1 time: 0.270319 Aug 27 03:15:23.235615 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3107/6027] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:15:22 2022] DELETE /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:15:23.422744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-60deec65-cdd0-4800-b735-e1943335c45a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:23.433070 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-60deec65-cdd0-4800-b735-e1943335c45a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1269 microversion: 2.1 time: 0.666767 Aug 27 03:15:23.445700 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2921/6028] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:22 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1269 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:23.445700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5eff2ac0-cc8d-4a38-9a12-371f5bcc3902 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:23.445700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5eff2ac0-cc8d-4a38-9a12-371f5bcc3902 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:23.476726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eff2ac0-cc8d-4a38-9a12-371f5bcc3902 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:23.477987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eff2ac0-cc8d-4a38-9a12-371f5bcc3902 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:23.478496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eff2ac0-cc8d-4a38-9a12-371f5bcc3902 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:23.479416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eff2ac0-cc8d-4a38-9a12-371f5bcc3902 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:23.479735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eff2ac0-cc8d-4a38-9a12-371f5bcc3902 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:23.482640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5eff2ac0-cc8d-4a38-9a12-371f5bcc3902 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:23.501640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:23.594746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a0078cd2-fd23-4b53-aa3c-a4545fe6288f req-cbfd71f2-18bc-4896-9355-e221cd8829c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e783f78e-4809-4e15-8916-8e550678f176", "tag": "856e3d51-6645-4699-a454-40644e835bc4"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:23.616903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0078cd2-fd23-4b53-aa3c-a4545fe6288f req-cbfd71f2-18bc-4896-9355-e221cd8829c1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:23.617765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0078cd2-fd23-4b53-aa3c-a4545fe6288f req-cbfd71f2-18bc-4896-9355-e221cd8829c1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:23.618477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a0078cd2-fd23-4b53-aa3c-a4545fe6288f req-cbfd71f2-18bc-4896-9355-e221cd8829c1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:23.647652 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a0078cd2-fd23-4b53-aa3c-a4545fe6288f req-cbfd71f2-18bc-4896-9355-e221cd8829c1 service nova] Creating event network-changed:856e3d51-6645-4699-a454-40644e835bc4 for instance e783f78e-4809-4e15-8916-8e550678f176 on n-h2-852084-5 Aug 27 03:15:23.661889 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a0078cd2-fd23-4b53-aa3c-a4545fe6288f req-cbfd71f2-18bc-4896-9355-e221cd8829c1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.426193 Aug 27 03:15:23.664650 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3108/6029] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:24.082365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5eff2ac0-cc8d-4a38-9a12-371f5bcc3902 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:24.098354 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5eff2ac0-cc8d-4a38-9a12-371f5bcc3902 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1688 microversion: 2.1 time: 0.656465 Aug 27 03:15:24.113241 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2922/6030] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:23 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1688 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:24.460963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a9144ca5-3075-4eca-a724-1471dd5215c8 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:24.462843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a9144ca5-3075-4eca-a724-1471dd5215c8 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:24.483303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9144ca5-3075-4eca-a724-1471dd5215c8 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:24.484254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9144ca5-3075-4eca-a724-1471dd5215c8 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:24.484710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9144ca5-3075-4eca-a724-1471dd5215c8 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:24.487204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9144ca5-3075-4eca-a724-1471dd5215c8 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:24.488546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9144ca5-3075-4eca-a724-1471dd5215c8 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:24.489361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9144ca5-3075-4eca-a724-1471dd5215c8 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:24.744732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-64f7e440-7e56-4df7-bf3a-7ec62f1f84e3 req-5a559616-7c1f-4a48-9339-46637ee2fdb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e783f78e-4809-4e15-8916-8e550678f176", "name": "network-vif-deleted", "tag": "856e3d51-6645-4699-a454-40644e835bc4"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:24.784110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:24.802538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-64f7e440-7e56-4df7-bf3a-7ec62f1f84e3 req-5a559616-7c1f-4a48-9339-46637ee2fdb2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:24.808918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-64f7e440-7e56-4df7-bf3a-7ec62f1f84e3 req-5a559616-7c1f-4a48-9339-46637ee2fdb2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:24.813052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-64f7e440-7e56-4df7-bf3a-7ec62f1f84e3 req-5a559616-7c1f-4a48-9339-46637ee2fdb2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:24.880043 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-64f7e440-7e56-4df7-bf3a-7ec62f1f84e3 req-5a559616-7c1f-4a48-9339-46637ee2fdb2 service nova] Creating event network-vif-deleted:856e3d51-6645-4699-a454-40644e835bc4 for instance e783f78e-4809-4e15-8916-8e550678f176 on n-h2-852084-5 Aug 27 03:15:24.902340 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-64f7e440-7e56-4df7-bf3a-7ec62f1f84e3 req-5a559616-7c1f-4a48-9339-46637ee2fdb2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167245 Aug 27 03:15:24.903007 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2923/6031] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:25.124011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:25.125035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:25.138074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:25.140777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:25.142378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:25.143162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:25.147841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:25.149761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:25.322719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:25.323212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:25.323858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:25.324492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lazy-loading 'fault' on Instance uuid e783f78e-4809-4e15-8916-8e550678f176 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:15:25.411057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:25.431309 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bde82075-7acc-4ada-9fe7-06fba2097a63 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 200 len: 1357 microversion: 2.1 time: 0.312638 Aug 27 03:15:25.447342 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2924/6032] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:25 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 1357 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:25.742054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a9144ca5-3075-4eca-a724-1471dd5215c8 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:25.752441 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a9144ca5-3075-4eca-a724-1471dd5215c8 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1269 microversion: 2.1 time: 1.297466 Aug 27 03:15:25.753075 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3109/6033] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:24 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1269 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:26.452825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:26.453711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: e783f78e-4809-4e15-8916-8e550678f176] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:26.464817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:26.465838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:26.466567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:26.468029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:26.468727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:26.469226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:26.487350 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] HTTP exception thrown: Instance e783f78e-4809-4e15-8916-8e550678f176 could not be found. Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Request method failure captured: Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 HTTP/1.1 Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYqQfBm6GS9xqnQK0kCaegkxtUGxBmgmlqSE3zjvPxF6xt1EIGwA_wROeCKLm5jKuicPFEf8dtAhztXrirum6yNgvTCeNAjM228kmH2Nzqe36R_uGkBJ85LsP_Ff542Y0N4IgZbqEya_XvrJ_7ujqHupudK2EUD953gaJkgcviDbsqs Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 08baa7977bed4278b5cacdb7f34ebf2f Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/08baa7977bed4278b5cacdb7f34ebf2f"}]}] Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 08baa7977bed4278b5cacdb7f34ebf2f Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestNetworkAdvancedServerOps-133114655-project Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 86930a2f684449a5a228ea43a7ab5e23 Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestNetworkAdvancedServerOps-133114655-project Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance e783f78e-4809-4e15-8916-8e550678f176 could not be found. Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'e783f78e-4809-4e15-8916-8e550678f176'} Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e783f78e-4809-4e15-8916-8e550678f176 could not be found. Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e783f78e-4809-4e15-8916-8e550678f176 could not be found. Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:15:26.489144 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:15:26.494927 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:15:26.494927 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:15:26.494927 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:15:26.494927 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:15:26.494927 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:15:26.494927 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:15:26.494927 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e783f78e-4809-4e15-8916-8e550678f176 could not be found. Aug 27 03:15:26.494927 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:15:26.494927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Returning 404 to user: Instance e783f78e-4809-4e15-8916-8e550678f176 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:15:26.494927 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f161fb26-3a05-443d-bf4b-8569898d0025 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176" status: 404 len: 111 microversion: 2.1 time: 0.042043 Aug 27 03:15:26.494927 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2925/6034] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:26 2022] GET /compute/v2.1/servers/e783f78e-4809-4e15-8916-8e550678f176 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:15:26.782644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c9e438c1-1de7-44be-a2a0-6af195bda6f9 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:26.783814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c9e438c1-1de7-44be-a2a0-6af195bda6f9 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:26.792262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:26.799304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9e438c1-1de7-44be-a2a0-6af195bda6f9 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:26.800271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9e438c1-1de7-44be-a2a0-6af195bda6f9 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:26.801474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9e438c1-1de7-44be-a2a0-6af195bda6f9 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:26.803078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9e438c1-1de7-44be-a2a0-6af195bda6f9 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:26.804370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9e438c1-1de7-44be-a2a0-6af195bda6f9 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:26.804988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9e438c1-1de7-44be-a2a0-6af195bda6f9 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:27.358488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c9e438c1-1de7-44be-a2a0-6af195bda6f9 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:27.379746 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c9e438c1-1de7-44be-a2a0-6af195bda6f9 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1269 microversion: 2.1 time: 0.605392 Aug 27 03:15:27.393480 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3110/6035] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:26 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1269 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:28.415109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5bc4d81e-85af-4293-8e9a-c8586422cfdb tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:28.415742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5bc4d81e-85af-4293-8e9a-c8586422cfdb tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:28.452043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bc4d81e-85af-4293-8e9a-c8586422cfdb tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:28.452553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bc4d81e-85af-4293-8e9a-c8586422cfdb tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:28.453222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bc4d81e-85af-4293-8e9a-c8586422cfdb tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:28.453997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bc4d81e-85af-4293-8e9a-c8586422cfdb tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:28.454651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bc4d81e-85af-4293-8e9a-c8586422cfdb tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:28.455256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bc4d81e-85af-4293-8e9a-c8586422cfdb tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:29.012431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5bc4d81e-85af-4293-8e9a-c8586422cfdb tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:29.027527 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5bc4d81e-85af-4293-8e9a-c8586422cfdb tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1269 microversion: 2.1 time: 0.616654 Aug 27 03:15:29.028391 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2926/6036] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:28 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1269 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:30.052162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a224271c-89a3-4816-9815-a86f58f63508 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:30.053421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a224271c-89a3-4816-9815-a86f58f63508 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:30.073190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a224271c-89a3-4816-9815-a86f58f63508 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:30.073718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a224271c-89a3-4816-9815-a86f58f63508 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:30.074173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a224271c-89a3-4816-9815-a86f58f63508 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:30.075000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a224271c-89a3-4816-9815-a86f58f63508 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:30.075392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a224271c-89a3-4816-9815-a86f58f63508 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:30.075826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a224271c-89a3-4816-9815-a86f58f63508 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:30.548095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a224271c-89a3-4816-9815-a86f58f63508 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:30.573988 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a224271c-89a3-4816-9815-a86f58f63508 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1269 microversion: 2.1 time: 0.518220 Aug 27 03:15:30.589311 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3111/6037] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:30 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1269 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:31.595605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2ab47f4b-8559-4a80-8b98-969df856c862 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:31.596231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2ab47f4b-8559-4a80-8b98-969df856c862 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:31.607695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ab47f4b-8559-4a80-8b98-969df856c862 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:31.611894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ab47f4b-8559-4a80-8b98-969df856c862 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:31.612618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ab47f4b-8559-4a80-8b98-969df856c862 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:31.616139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ab47f4b-8559-4a80-8b98-969df856c862 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:31.616629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ab47f4b-8559-4a80-8b98-969df856c862 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:31.617082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2ab47f4b-8559-4a80-8b98-969df856c862 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:32.159093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2ab47f4b-8559-4a80-8b98-969df856c862 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:32.169787 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2ab47f4b-8559-4a80-8b98-969df856c862 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1269 microversion: 2.1 time: 0.578787 Aug 27 03:15:32.182759 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2927/6038] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:31 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1269 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:32.270516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ae8c55e5-272f-465f-bd72-8146b05d0e51 req-1ae5ce02-3fe8-4a36-9da3-6acf9d9c86b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b353842-13ac-47f9-a0e8-d69bab50a4ae", "name": "network-vif-plugged", "status": "completed", "tag": "60329d31-4df4-4224-a4b6-44132fdb5c24"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:32.292327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ae8c55e5-272f-465f-bd72-8146b05d0e51 req-1ae5ce02-3fe8-4a36-9da3-6acf9d9c86b1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:32.292824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ae8c55e5-272f-465f-bd72-8146b05d0e51 req-1ae5ce02-3fe8-4a36-9da3-6acf9d9c86b1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:32.293270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ae8c55e5-272f-465f-bd72-8146b05d0e51 req-1ae5ce02-3fe8-4a36-9da3-6acf9d9c86b1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:32.323904 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ae8c55e5-272f-465f-bd72-8146b05d0e51 req-1ae5ce02-3fe8-4a36-9da3-6acf9d9c86b1 service nova] Creating event network-vif-plugged:60329d31-4df4-4224-a4b6-44132fdb5c24 for instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae on n-h2-852084-5 Aug 27 03:15:32.332632 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ae8c55e5-272f-465f-bd72-8146b05d0e51 req-1ae5ce02-3fe8-4a36-9da3-6acf9d9c86b1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207297 Aug 27 03:15:32.334135 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3112/6039] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:33.203231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ef0e48ba-b15c-4cce-a9b3-24413a5f3d56 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:33.204723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ef0e48ba-b15c-4cce-a9b3-24413a5f3d56 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:33.221700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef0e48ba-b15c-4cce-a9b3-24413a5f3d56 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:33.222194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef0e48ba-b15c-4cce-a9b3-24413a5f3d56 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:33.223031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef0e48ba-b15c-4cce-a9b3-24413a5f3d56 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:33.224138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef0e48ba-b15c-4cce-a9b3-24413a5f3d56 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:33.224774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef0e48ba-b15c-4cce-a9b3-24413a5f3d56 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:33.225369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ef0e48ba-b15c-4cce-a9b3-24413a5f3d56 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:33.719921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ef0e48ba-b15c-4cce-a9b3-24413a5f3d56 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:33.732894 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ef0e48ba-b15c-4cce-a9b3-24413a5f3d56 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1269 microversion: 2.1 time: 0.533419 Aug 27 03:15:33.747169 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2928/6040] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:33 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1269 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:34.755645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2490643-4031-45e1-bf18-355703a24bec tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:34.756934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f2490643-4031-45e1-bf18-355703a24bec tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:34.806017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2490643-4031-45e1-bf18-355703a24bec tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.811953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2490643-4031-45e1-bf18-355703a24bec tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.813168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2490643-4031-45e1-bf18-355703a24bec tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:34.817607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2490643-4031-45e1-bf18-355703a24bec tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:34.818384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2490643-4031-45e1-bf18-355703a24bec tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:34.819090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2490643-4031-45e1-bf18-355703a24bec tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:35.608089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f2490643-4031-45e1-bf18-355703a24bec tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:35.634088 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f2490643-4031-45e1-bf18-355703a24bec tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1458 microversion: 2.1 time: 0.876320 Aug 27 03:15:35.645217 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3113/6041] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:34 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1458 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:15:35.670547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1f44132c-d078-4d83-908a-02049c22f6dd tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:35.671856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1f44132c-d078-4d83-908a-02049c22f6dd tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:35.690177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f44132c-d078-4d83-908a-02049c22f6dd tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:35.693048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f44132c-d078-4d83-908a-02049c22f6dd tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:35.698120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f44132c-d078-4d83-908a-02049c22f6dd tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:35.701491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f44132c-d078-4d83-908a-02049c22f6dd tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:35.705195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f44132c-d078-4d83-908a-02049c22f6dd tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:35.707622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f44132c-d078-4d83-908a-02049c22f6dd tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:36.101384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1f44132c-d078-4d83-908a-02049c22f6dd tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:36.116572 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1f44132c-d078-4d83-908a-02049c22f6dd tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1458 microversion: 2.1 time: 0.450417 Aug 27 03:15:36.122360 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2929/6042] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:35 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1458 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:39.495592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-3c081c6d-6a9f-41d7-b1a4-228f88f83850 req-f742be51-97e3-46bf-91de-9326106b6234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b353842-13ac-47f9-a0e8-d69bab50a4ae", "tag": "60329d31-4df4-4224-a4b6-44132fdb5c24"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:39.518360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c081c6d-6a9f-41d7-b1a4-228f88f83850 req-f742be51-97e3-46bf-91de-9326106b6234 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:39.521016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c081c6d-6a9f-41d7-b1a4-228f88f83850 req-f742be51-97e3-46bf-91de-9326106b6234 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:39.521475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c081c6d-6a9f-41d7-b1a4-228f88f83850 req-f742be51-97e3-46bf-91de-9326106b6234 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:39.552707 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-3c081c6d-6a9f-41d7-b1a4-228f88f83850 req-f742be51-97e3-46bf-91de-9326106b6234 service nova] Creating event network-changed:60329d31-4df4-4224-a4b6-44132fdb5c24 for instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae on n-h2-852084-5 Aug 27 03:15:39.567942 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-3c081c6d-6a9f-41d7-b1a4-228f88f83850 req-f742be51-97e3-46bf-91de-9326106b6234 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077908 Aug 27 03:15:39.568589 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3114/6043] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:40.544521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8abfaf44-2f5c-4420-a0ab-7e9204fa8434 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '.version_select at 0x7f4d29d69550>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:40.599225 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8abfaf44-2f5c-4420-a0ab-7e9204fa8434 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1228483088" status: 202 len: 0 microversion: 2.1 time: 0.060457 Aug 27 03:15:40.600137 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2930/6044] 10.222.0.99 () {58 vars in 1284 bytes} [Sat Aug 27 03:15:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1228483088 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:15:40.643631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9832b5fa-91df-4519-b305-b08ed69c4af6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'create', calling method: .version_select at 0x7f4d2a270c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-871159141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGCHt0lo7Wv9vgTC5hPAKVB/6fJ4HHKuF90GIwwr4RNNYU+v93E2R72CfrycCYu9IOnV8QPur20e1kBNqHZn60+fuMrL9eHWx+ctItfqR+FG8yaSsrJMIiTHoKhE5enxw=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:40.686661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9832b5fa-91df-4519-b305-b08ed69c4af6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:15:40.701843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9832b5fa-91df-4519-b305-b08ed69c4af6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for user 86930a2f684449a5a228ea43a7ab5e23 and project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:15:40.750687 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9832b5fa-91df-4519-b305-b08ed69c4af6 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.115003 Aug 27 03:15:40.751657 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3115/6045] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:15:40 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:15:43.102204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c01e05dc-fb34-4cde-bc32-42c84a189ea6 req-3515df1a-037f-4620-8633-4cfca241703d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b353842-13ac-47f9-a0e8-d69bab50a4ae", "tag": "60329d31-4df4-4224-a4b6-44132fdb5c24"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:43.127811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c01e05dc-fb34-4cde-bc32-42c84a189ea6 req-3515df1a-037f-4620-8633-4cfca241703d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:43.130183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c01e05dc-fb34-4cde-bc32-42c84a189ea6 req-3515df1a-037f-4620-8633-4cfca241703d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:43.138911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c01e05dc-fb34-4cde-bc32-42c84a189ea6 req-3515df1a-037f-4620-8633-4cfca241703d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:43.158500 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c01e05dc-fb34-4cde-bc32-42c84a189ea6 req-3515df1a-037f-4620-8633-4cfca241703d service nova] Creating event network-changed:60329d31-4df4-4224-a4b6-44132fdb5c24 for instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae on n-h2-852084-5 Aug 27 03:15:43.164707 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c01e05dc-fb34-4cde-bc32-42c84a189ea6 req-3515df1a-037f-4620-8633-4cfca241703d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071033 Aug 27 03:15:43.166179 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2931/6046] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:15:45.278403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a3830e13-7e90-46ac-a9c0-e6d8b2937944 req-e985339e-3db2-41e2-b4a4-1e347deae64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b353842-13ac-47f9-a0e8-d69bab50a4ae", "tag": "60329d31-4df4-4224-a4b6-44132fdb5c24"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:45.306630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a3830e13-7e90-46ac-a9c0-e6d8b2937944 req-e985339e-3db2-41e2-b4a4-1e347deae64d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:45.307140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a3830e13-7e90-46ac-a9c0-e6d8b2937944 req-e985339e-3db2-41e2-b4a4-1e347deae64d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:45.307590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a3830e13-7e90-46ac-a9c0-e6d8b2937944 req-e985339e-3db2-41e2-b4a4-1e347deae64d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:45.359624 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a3830e13-7e90-46ac-a9c0-e6d8b2937944 req-e985339e-3db2-41e2-b4a4-1e347deae64d service nova] Creating event network-changed:60329d31-4df4-4224-a4b6-44132fdb5c24 for instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae on n-h2-852084-5 Aug 27 03:15:45.382541 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a3830e13-7e90-46ac-a9c0-e6d8b2937944 req-e985339e-3db2-41e2-b4a4-1e347deae64d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123837 Aug 27 03:15:45.385342 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3116/6047] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:15:51.604150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1348337722", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:51.697020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] validate_networks() for None {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:15:52.385234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:15:52.387963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:15:52.400867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:15:52.402661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:15:52.404652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:15:52.450492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:52.453641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:52.455513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:52.464790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:52.468255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:52.469863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:52.519586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Getting quotas for project 23b285c4b11e4d179b9a9502cf0e2fdd. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:15:52.536180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Getting quotas for user 72559d985a8549dfa8ce38efab4df960 and project 23b285c4b11e4d179b9a9502cf0e2fdd. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:15:52.573243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:15:52.576793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:15:52.730953 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-672101f7-6eb8-4764-afe4-63c269e003e5 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129753 Aug 27 03:15:52.734847 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2932/6048] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:15:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:15:52.743576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:52.748193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-393f4cd8-49d4-44c4-9b69-b1d486ab5361 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:52.748991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-393f4cd8-49d4-44c4-9b69-b1d486ab5361 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:52.855179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-393f4cd8-49d4-44c4-9b69-b1d486ab5361 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:52.862915 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-393f4cd8-49d4-44c4-9b69-b1d486ab5361 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1215 microversion: 2.1 time: 0.121898 Aug 27 03:15:52.863529 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3117/6049] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:52 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:53.886611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-043ff320-ccc3-46b5-aa7a-06f76e71fc4a tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:53.887940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-043ff320-ccc3-46b5-aa7a-06f76e71fc4a tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:53.904303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-043ff320-ccc3-46b5-aa7a-06f76e71fc4a tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:53.908603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-043ff320-ccc3-46b5-aa7a-06f76e71fc4a tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:53.910022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-043ff320-ccc3-46b5-aa7a-06f76e71fc4a tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:53.915276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-043ff320-ccc3-46b5-aa7a-06f76e71fc4a tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:53.916199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-043ff320-ccc3-46b5-aa7a-06f76e71fc4a tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:53.918164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-043ff320-ccc3-46b5-aa7a-06f76e71fc4a tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:53.921756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=45 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:54.550920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-043ff320-ccc3-46b5-aa7a-06f76e71fc4a tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:54.566799 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-043ff320-ccc3-46b5-aa7a-06f76e71fc4a tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1211 microversion: 2.1 time: 0.685257 Aug 27 03:15:54.571444 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2933/6050] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:53 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1211 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:54.888054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-953103509", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d3a11cfe-9ef7-49b1-8d95-81ad4c92eb66", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9f6cd27d-8b3c-456e-af66-44212888909f"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:15:55.039946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] validate_networks() for [('9f6cd27d-8b3c-456e-af66-44212888909f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:15:55.358815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=32 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:55.591212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-54693316-0fde-4cc5-95ab-e04ee6ae4a9c tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:55.591914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-54693316-0fde-4cc5-95ab-e04ee6ae4a9c tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:55.608900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:55.615326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54693316-0fde-4cc5-95ab-e04ee6ae4a9c tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:55.629401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54693316-0fde-4cc5-95ab-e04ee6ae4a9c tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:55.634192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54693316-0fde-4cc5-95ab-e04ee6ae4a9c tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:55.638761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54693316-0fde-4cc5-95ab-e04ee6ae4a9c tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:55.645925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54693316-0fde-4cc5-95ab-e04ee6ae4a9c tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:55.647188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-54693316-0fde-4cc5-95ab-e04ee6ae4a9c tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:55.682985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:15:55.683424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:15:55.684091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:15:55.684853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:15:55.685445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:15:55.706657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:55.707717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:55.707915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:55.708987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:55.709546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:55.712327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:55.763237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:15:55.773351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for user 0a78655bea27452faee67a7efd476175 and project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:15:55.914722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:15:55.919193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3a11cfe-9ef7-49b1-8d95-81ad4c92eb66',volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:15:56.035723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-54693316-0fde-4cc5-95ab-e04ee6ae4a9c tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:56.151091 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-54693316-0fde-4cc5-95ab-e04ee6ae4a9c tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1273 microversion: 2.1 time: 0.565557 Aug 27 03:15:56.152418 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2934/6051] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:55 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1273 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:56.290720 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9d1d7312-0d0c-4915-b5f6-4e39e48482ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.408826 Aug 27 03:15:56.301275 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3118/6052] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:15:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:15:56.309210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9d8a8062-36cd-4c6e-90a0-755c212ee9c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:56.309938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9d8a8062-36cd-4c6e-90a0-755c212ee9c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:56.625847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9d8a8062-36cd-4c6e-90a0-755c212ee9c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:56.650502 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9d8a8062-36cd-4c6e-90a0-755c212ee9c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1056 microversion: 2.1 time: 0.346843 Aug 27 03:15:56.671824 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2935/6053] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:56 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1056 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:57.173647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8a665884-8398-42b1-902c-50b8a274c4d8 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:57.174321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8a665884-8398-42b1-902c-50b8a274c4d8 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:57.177746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:15:57.222707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a665884-8398-42b1-902c-50b8a274c4d8 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:57.234727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a665884-8398-42b1-902c-50b8a274c4d8 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:57.235067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a665884-8398-42b1-902c-50b8a274c4d8 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:57.235857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a665884-8398-42b1-902c-50b8a274c4d8 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:57.236398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a665884-8398-42b1-902c-50b8a274c4d8 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:57.236776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a665884-8398-42b1-902c-50b8a274c4d8 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:57.492229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8a665884-8398-42b1-902c-50b8a274c4d8 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:57.502682 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8a665884-8398-42b1-902c-50b8a274c4d8 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1273 microversion: 2.1 time: 0.333618 Aug 27 03:15:57.505278 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3119/6054] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:57 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:57.698095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba7c724d-df64-4a26-8095-647aca855141 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:57.699088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba7c724d-df64-4a26-8095-647aca855141 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:57.724488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7c724d-df64-4a26-8095-647aca855141 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:57.725354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7c724d-df64-4a26-8095-647aca855141 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:57.729157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7c724d-df64-4a26-8095-647aca855141 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:57.730143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7c724d-df64-4a26-8095-647aca855141 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:57.730933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7c724d-df64-4a26-8095-647aca855141 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:57.731462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba7c724d-df64-4a26-8095-647aca855141 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:57.971357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba7c724d-df64-4a26-8095-647aca855141 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:58.012217 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba7c724d-df64-4a26-8095-647aca855141 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1098 microversion: 2.1 time: 0.313606 Aug 27 03:15:58.014620 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2936/6055] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:57 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1098 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:58.524580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-997ff0d1-3fc1-4b0d-9d6a-83fda88c14f1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:58.525349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-997ff0d1-3fc1-4b0d-9d6a-83fda88c14f1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:58.546840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-997ff0d1-3fc1-4b0d-9d6a-83fda88c14f1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:58.547397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-997ff0d1-3fc1-4b0d-9d6a-83fda88c14f1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:58.547881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-997ff0d1-3fc1-4b0d-9d6a-83fda88c14f1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:58.548659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-997ff0d1-3fc1-4b0d-9d6a-83fda88c14f1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:58.557246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-997ff0d1-3fc1-4b0d-9d6a-83fda88c14f1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:58.558523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-997ff0d1-3fc1-4b0d-9d6a-83fda88c14f1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:58.754494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-997ff0d1-3fc1-4b0d-9d6a-83fda88c14f1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:58.763970 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-997ff0d1-3fc1-4b0d-9d6a-83fda88c14f1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1273 microversion: 2.1 time: 0.244348 Aug 27 03:15:58.780427 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3120/6056] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:58 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:59.035589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b417aa32-8206-4c46-a9b4-746269bdef21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:59.055454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b417aa32-8206-4c46-a9b4-746269bdef21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:59.116302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b417aa32-8206-4c46-a9b4-746269bdef21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:59.118747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b417aa32-8206-4c46-a9b4-746269bdef21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:59.119782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b417aa32-8206-4c46-a9b4-746269bdef21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:59.121444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b417aa32-8206-4c46-a9b4-746269bdef21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:59.131204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b417aa32-8206-4c46-a9b4-746269bdef21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:59.133009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b417aa32-8206-4c46-a9b4-746269bdef21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:59.611552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b417aa32-8206-4c46-a9b4-746269bdef21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:15:59.627609 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b417aa32-8206-4c46-a9b4-746269bdef21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1172 microversion: 2.1 time: 0.596059 Aug 27 03:15:59.646375 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2937/6057] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:59 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1172 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:15:59.788334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-747a25a5-88de-463c-9499-1d02affe99d1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:15:59.789869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-747a25a5-88de-463c-9499-1d02affe99d1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:15:59.822247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-747a25a5-88de-463c-9499-1d02affe99d1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:59.824199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-747a25a5-88de-463c-9499-1d02affe99d1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:59.825818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-747a25a5-88de-463c-9499-1d02affe99d1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:15:59.827994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-747a25a5-88de-463c-9499-1d02affe99d1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:15:59.833972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-747a25a5-88de-463c-9499-1d02affe99d1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:15:59.835153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-747a25a5-88de-463c-9499-1d02affe99d1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:00.354641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-747a25a5-88de-463c-9499-1d02affe99d1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:00.364329 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-747a25a5-88de-463c-9499-1d02affe99d1 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1315 microversion: 2.1 time: 0.580849 Aug 27 03:16:00.369498 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3121/6058] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:15:59 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:00.663319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-64b438e4-4575-48dd-acc7-99ac7628635b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:00.665018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-64b438e4-4575-48dd-acc7-99ac7628635b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:00.685749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64b438e4-4575-48dd-acc7-99ac7628635b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:00.686632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64b438e4-4575-48dd-acc7-99ac7628635b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:00.687095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64b438e4-4575-48dd-acc7-99ac7628635b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:00.689377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64b438e4-4575-48dd-acc7-99ac7628635b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:00.689899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64b438e4-4575-48dd-acc7-99ac7628635b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:00.690341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-64b438e4-4575-48dd-acc7-99ac7628635b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:00.845514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-64b438e4-4575-48dd-acc7-99ac7628635b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:00.859309 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-64b438e4-4575-48dd-acc7-99ac7628635b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1172 microversion: 2.1 time: 0.202516 Aug 27 03:16:00.863017 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2938/6059] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:00 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1172 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:01.220265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-934507215", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "10eeaa11-51a0-45ca-9322-5d4f592e103f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-871159141", "security_groups": [{"name": "tempest-secgroup-smoke-915515978"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:01.386981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-15350956-9b63-4995-be42-35e903945eb0 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:01.387613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-15350956-9b63-4995-be42-35e903945eb0 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:01.399537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15350956-9b63-4995-be42-35e903945eb0 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:01.406692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15350956-9b63-4995-be42-35e903945eb0 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:01.407158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15350956-9b63-4995-be42-35e903945eb0 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:01.408008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15350956-9b63-4995-be42-35e903945eb0 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:01.408487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15350956-9b63-4995-be42-35e903945eb0 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:01.408929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15350956-9b63-4995-be42-35e903945eb0 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:01.753779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] validate_networks() for [('10eeaa11-51a0-45ca-9322-5d4f592e103f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:16:01.954297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-15350956-9b63-4995-be42-35e903945eb0 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:01.967738 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-15350956-9b63-4995-be42-35e903945eb0 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1315 microversion: 2.1 time: 0.585293 Aug 27 03:16:01.969543 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2939/6060] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:01 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:01.978381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b400dc71-90f1-42ee-8950-0542ce13bedf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:01.983299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b400dc71-90f1-42ee-8950-0542ce13bedf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:01.997416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b400dc71-90f1-42ee-8950-0542ce13bedf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:01.998258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b400dc71-90f1-42ee-8950-0542ce13bedf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:01.998886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b400dc71-90f1-42ee-8950-0542ce13bedf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:01.999779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b400dc71-90f1-42ee-8950-0542ce13bedf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:02.000413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b400dc71-90f1-42ee-8950-0542ce13bedf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:02.001014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b400dc71-90f1-42ee-8950-0542ce13bedf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:02.217945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b400dc71-90f1-42ee-8950-0542ce13bedf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:02.236585 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b400dc71-90f1-42ee-8950-0542ce13bedf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1172 microversion: 2.1 time: 0.264426 Aug 27 03:16:02.251966 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2940/6061] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:01 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1172 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:02.412852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-9e26e8c6-7ee6-42a4-9fec-d90f8f92fb93 req-638b4cf9-4649-4ba2-86e1-11d3db0c1738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392e72ae-6dd8-454b-8824-d5c854bb50c2", "tag": "5922c9e1-ab03-42a0-893b-c0a26493dbe7"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:02.432333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9e26e8c6-7ee6-42a4-9fec-d90f8f92fb93 req-638b4cf9-4649-4ba2-86e1-11d3db0c1738 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:02.438280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9e26e8c6-7ee6-42a4-9fec-d90f8f92fb93 req-638b4cf9-4649-4ba2-86e1-11d3db0c1738 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:02.438863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9e26e8c6-7ee6-42a4-9fec-d90f8f92fb93 req-638b4cf9-4649-4ba2-86e1-11d3db0c1738 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:02.481380 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-9e26e8c6-7ee6-42a4-9fec-d90f8f92fb93 req-638b4cf9-4649-4ba2-86e1-11d3db0c1738 service nova] Creating event network-changed:5922c9e1-ab03-42a0-893b-c0a26493dbe7 for instance 392e72ae-6dd8-454b-8824-d5c854bb50c2 on n-h1-852084-5 Aug 27 03:16:02.494432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:02.501861 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-9e26e8c6-7ee6-42a4-9fec-d90f8f92fb93 req-638b4cf9-4649-4ba2-86e1-11d3db0c1738 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092793 Aug 27 03:16:02.502937 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2941/6062] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:16:02.610897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:16:02.612171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:16:02.613039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:16:02.613837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:16:02.614463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:16:02.630459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:02.631507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:02.632172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:02.634098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:02.634782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:02.635647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:02.661129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:16:02.669890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Getting quotas for user 86930a2f684449a5a228ea43a7ab5e23 and project 08baa7977bed4278b5cacdb7f34ebf2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:16:02.685789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:16:02.689746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:16:02.783877 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a942026-68eb-43bb-b6f7-2896ce9b42e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.567781 Aug 27 03:16:02.790776 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3122/6063] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:16:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:16:02.798765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-22acf6f4-eb14-480a-af94-c02fcf76d0fc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:02.799843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-22acf6f4-eb14-480a-af94-c02fcf76d0fc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:02.989145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0175f483-0c7a-4db7-9b28-531351732e09 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:02.989988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0175f483-0c7a-4db7-9b28-531351732e09 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:03.003717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0175f483-0c7a-4db7-9b28-531351732e09 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:03.004227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0175f483-0c7a-4db7-9b28-531351732e09 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:03.004673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0175f483-0c7a-4db7-9b28-531351732e09 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:03.005391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0175f483-0c7a-4db7-9b28-531351732e09 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:03.005878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0175f483-0c7a-4db7-9b28-531351732e09 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:03.006319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0175f483-0c7a-4db7-9b28-531351732e09 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:03.087406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-22acf6f4-eb14-480a-af94-c02fcf76d0fc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:03.102319 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-22acf6f4-eb14-480a-af94-c02fcf76d0fc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1265 microversion: 2.1 time: 0.309279 Aug 27 03:16:03.120576 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2942/6064] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:02 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1265 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:03.262664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a3c63833-9e01-455f-b149-ff5ff74ec9fb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:03.263298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a3c63833-9e01-455f-b149-ff5ff74ec9fb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:03.278330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3c63833-9e01-455f-b149-ff5ff74ec9fb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:03.278836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3c63833-9e01-455f-b149-ff5ff74ec9fb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:03.282347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3c63833-9e01-455f-b149-ff5ff74ec9fb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:03.284156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3c63833-9e01-455f-b149-ff5ff74ec9fb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:03.284851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3c63833-9e01-455f-b149-ff5ff74ec9fb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:03.286047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3c63833-9e01-455f-b149-ff5ff74ec9fb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:03.385107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0175f483-0c7a-4db7-9b28-531351732e09 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:03.395712 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0175f483-0c7a-4db7-9b28-531351732e09 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1315 microversion: 2.1 time: 0.411095 Aug 27 03:16:03.407156 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3123/6065] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:02 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:03.807764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a3c63833-9e01-455f-b149-ff5ff74ec9fb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:03.825211 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a3c63833-9e01-455f-b149-ff5ff74ec9fb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1214 microversion: 2.1 time: 0.566897 Aug 27 03:16:03.825909 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2943/6066] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:03 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1214 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:04.128334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-917ce658-afbb-45f4-96cf-039d482b1c57 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:04.129592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-917ce658-afbb-45f4-96cf-039d482b1c57 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:04.144149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-917ce658-afbb-45f4-96cf-039d482b1c57 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:04.144803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-917ce658-afbb-45f4-96cf-039d482b1c57 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:04.145392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-917ce658-afbb-45f4-96cf-039d482b1c57 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:04.146294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-917ce658-afbb-45f4-96cf-039d482b1c57 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:04.151032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-917ce658-afbb-45f4-96cf-039d482b1c57 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:04.151815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-917ce658-afbb-45f4-96cf-039d482b1c57 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:04.281848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-917ce658-afbb-45f4-96cf-039d482b1c57 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:04.297936 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-917ce658-afbb-45f4-96cf-039d482b1c57 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1317 microversion: 2.1 time: 0.173354 Aug 27 03:16:04.299150 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3124/6067] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:04 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:04.420587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cabe7c06-5db1-4b9d-8fd2-7374db5fb497 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:04.421604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cabe7c06-5db1-4b9d-8fd2-7374db5fb497 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:04.441644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cabe7c06-5db1-4b9d-8fd2-7374db5fb497 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:04.442905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cabe7c06-5db1-4b9d-8fd2-7374db5fb497 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:04.443721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cabe7c06-5db1-4b9d-8fd2-7374db5fb497 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:04.444707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cabe7c06-5db1-4b9d-8fd2-7374db5fb497 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:04.445498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cabe7c06-5db1-4b9d-8fd2-7374db5fb497 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:04.450456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cabe7c06-5db1-4b9d-8fd2-7374db5fb497 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:04.784542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cabe7c06-5db1-4b9d-8fd2-7374db5fb497 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:04.800083 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cabe7c06-5db1-4b9d-8fd2-7374db5fb497 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1315 microversion: 2.1 time: 0.383785 Aug 27 03:16:04.810440 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2944/6068] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:04 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:04.849733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d9908d98-bcbb-447b-b386-cfdd71bc6d36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:04.850383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d9908d98-bcbb-447b-b386-cfdd71bc6d36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:04.857852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9908d98-bcbb-447b-b386-cfdd71bc6d36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:04.858364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9908d98-bcbb-447b-b386-cfdd71bc6d36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:04.858821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9908d98-bcbb-447b-b386-cfdd71bc6d36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:04.859566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9908d98-bcbb-447b-b386-cfdd71bc6d36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:04.860039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9908d98-bcbb-447b-b386-cfdd71bc6d36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:04.860482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9908d98-bcbb-447b-b386-cfdd71bc6d36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:04.896924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-bf01eaff-e007-487c-8352-cb26a808883a req-382e740a-f40d-4479-ba5d-e8a8d2a6d42d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65beae04-1a37-472b-b66b-44d4ace25124", "tag": "24f397cf-48a3-4f5b-8a83-a7335b55ed98"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:04.920192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf01eaff-e007-487c-8352-cb26a808883a req-382e740a-f40d-4479-ba5d-e8a8d2a6d42d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:04.921033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf01eaff-e007-487c-8352-cb26a808883a req-382e740a-f40d-4479-ba5d-e8a8d2a6d42d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:04.921696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf01eaff-e007-487c-8352-cb26a808883a req-382e740a-f40d-4479-ba5d-e8a8d2a6d42d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:04.966212 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-bf01eaff-e007-487c-8352-cb26a808883a req-382e740a-f40d-4479-ba5d-e8a8d2a6d42d service nova] Creating event network-changed:24f397cf-48a3-4f5b-8a83-a7335b55ed98 for instance 65beae04-1a37-472b-b66b-44d4ace25124 on n-h1-852084-5 Aug 27 03:16:04.988358 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-bf01eaff-e007-487c-8352-cb26a808883a req-382e740a-f40d-4479-ba5d-e8a8d2a6d42d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106993 Aug 27 03:16:04.994080 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2945/6069] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 27 03:16:05.326164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-99d39f52-f5f4-4d9c-ba86-b89013705f87 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:05.326814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-99d39f52-f5f4-4d9c-ba86-b89013705f87 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:05.343563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d39f52-f5f4-4d9c-ba86-b89013705f87 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:05.344393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d39f52-f5f4-4d9c-ba86-b89013705f87 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:05.345026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d39f52-f5f4-4d9c-ba86-b89013705f87 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:05.345953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d39f52-f5f4-4d9c-ba86-b89013705f87 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:05.346610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d39f52-f5f4-4d9c-ba86-b89013705f87 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:05.347214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99d39f52-f5f4-4d9c-ba86-b89013705f87 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:05.358521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d9908d98-bcbb-447b-b386-cfdd71bc6d36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:05.369121 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d9908d98-bcbb-447b-b386-cfdd71bc6d36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1214 microversion: 2.1 time: 0.524976 Aug 27 03:16:05.374108 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3125/6070] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:04 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1214 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:05.486992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-99d39f52-f5f4-4d9c-ba86-b89013705f87 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:05.503586 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-99d39f52-f5f4-4d9c-ba86-b89013705f87 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1323 microversion: 2.1 time: 0.181905 Aug 27 03:16:05.504315 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2946/6071] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:05 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1323 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:05.835185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7d9eaef7-243c-4168-9412-d47f6eb15e19 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:05.835783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d9eaef7-243c-4168-9412-d47f6eb15e19 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:05.851407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9eaef7-243c-4168-9412-d47f6eb15e19 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:05.851956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9eaef7-243c-4168-9412-d47f6eb15e19 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:05.852608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9eaef7-243c-4168-9412-d47f6eb15e19 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:05.853620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9eaef7-243c-4168-9412-d47f6eb15e19 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:05.854314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9eaef7-243c-4168-9412-d47f6eb15e19 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:05.854926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d9eaef7-243c-4168-9412-d47f6eb15e19 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:06.394043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d2be875d-7d39-4b12-b477-f09a8b802468 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:06.394488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2be875d-7d39-4b12-b477-f09a8b802468 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:06.438387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2be875d-7d39-4b12-b477-f09a8b802468 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:06.439436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2be875d-7d39-4b12-b477-f09a8b802468 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:06.441518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2be875d-7d39-4b12-b477-f09a8b802468 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:06.442925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2be875d-7d39-4b12-b477-f09a8b802468 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:06.445936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2be875d-7d39-4b12-b477-f09a8b802468 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:06.446809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2be875d-7d39-4b12-b477-f09a8b802468 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:06.802702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d9eaef7-243c-4168-9412-d47f6eb15e19 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:06.822879 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7d9eaef7-243c-4168-9412-d47f6eb15e19 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1315 microversion: 2.1 time: 0.990219 Aug 27 03:16:06.824753 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3126/6072] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:05 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1315 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:06.837001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a8eebe6e-60e6-4b5e-8531-1c9a74ddd575 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:06.842850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a8eebe6e-60e6-4b5e-8531-1c9a74ddd575 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:06.860218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8eebe6e-60e6-4b5e-8531-1c9a74ddd575 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:06.860676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8eebe6e-60e6-4b5e-8531-1c9a74ddd575 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:06.861138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8eebe6e-60e6-4b5e-8531-1c9a74ddd575 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:06.861946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8eebe6e-60e6-4b5e-8531-1c9a74ddd575 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:06.862417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8eebe6e-60e6-4b5e-8531-1c9a74ddd575 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:06.862914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a8eebe6e-60e6-4b5e-8531-1c9a74ddd575 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:07.113199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d2be875d-7d39-4b12-b477-f09a8b802468 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:07.115813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a8eebe6e-60e6-4b5e-8531-1c9a74ddd575 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:07.129484 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d2be875d-7d39-4b12-b477-f09a8b802468 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1214 microversion: 2.1 time: 0.741054 Aug 27 03:16:07.131602 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a8eebe6e-60e6-4b5e-8531-1c9a74ddd575 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1323 microversion: 2.1 time: 0.303515 Aug 27 03:16:07.133314 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3127/6073] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:06 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:07.170217 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2947/6074] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:06 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1214 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:07.844791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fbaa6aa1-7146-4ffd-b542-c2edbf34e8d4 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:07.845427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fbaa6aa1-7146-4ffd-b542-c2edbf34e8d4 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:07.870768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbaa6aa1-7146-4ffd-b542-c2edbf34e8d4 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:07.874884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbaa6aa1-7146-4ffd-b542-c2edbf34e8d4 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:07.883337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbaa6aa1-7146-4ffd-b542-c2edbf34e8d4 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:07.892959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbaa6aa1-7146-4ffd-b542-c2edbf34e8d4 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:07.893859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbaa6aa1-7146-4ffd-b542-c2edbf34e8d4 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:07.894408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbaa6aa1-7146-4ffd-b542-c2edbf34e8d4 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:08.160982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d9e9954d-1c13-43d9-81d3-c8d6b0b2f578 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:08.162385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d9e9954d-1c13-43d9-81d3-c8d6b0b2f578 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:08.175681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9e9954d-1c13-43d9-81d3-c8d6b0b2f578 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:08.177439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9e9954d-1c13-43d9-81d3-c8d6b0b2f578 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:08.183241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9e9954d-1c13-43d9-81d3-c8d6b0b2f578 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:08.185278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9e9954d-1c13-43d9-81d3-c8d6b0b2f578 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:08.185744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9e9954d-1c13-43d9-81d3-c8d6b0b2f578 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:08.188152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d9e9954d-1c13-43d9-81d3-c8d6b0b2f578 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:08.403609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fbaa6aa1-7146-4ffd-b542-c2edbf34e8d4 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:08.412144 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fbaa6aa1-7146-4ffd-b542-c2edbf34e8d4 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1315 microversion: 2.1 time: 0.571358 Aug 27 03:16:08.412765 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3128/6075] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:07 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:08.421716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78ce83f4-c37b-4f37-8e28-3265f5948a0d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:08.422598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-78ce83f4-c37b-4f37-8e28-3265f5948a0d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:08.442311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce83f4-c37b-4f37-8e28-3265f5948a0d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:08.446689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce83f4-c37b-4f37-8e28-3265f5948a0d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:08.447537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce83f4-c37b-4f37-8e28-3265f5948a0d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:08.448349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce83f4-c37b-4f37-8e28-3265f5948a0d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:08.448828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce83f4-c37b-4f37-8e28-3265f5948a0d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:08.450201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78ce83f4-c37b-4f37-8e28-3265f5948a0d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:08.707453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d9e9954d-1c13-43d9-81d3-c8d6b0b2f578 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:08.717695 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d9e9954d-1c13-43d9-81d3-c8d6b0b2f578 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1390 microversion: 2.1 time: 0.561377 Aug 27 03:16:08.718843 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2948/6076] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:08 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1390 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:08.779807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-78ce83f4-c37b-4f37-8e28-3265f5948a0d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:08.791820 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-78ce83f4-c37b-4f37-8e28-3265f5948a0d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1214 microversion: 2.1 time: 0.373797 Aug 27 03:16:08.794459 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3129/6077] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:08 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1214 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:09.225456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-24eddc3c-52cb-4850-be77-4e564842ba6a req-8a53833f-4638-494f-a438-1649919120b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f83ba1-2a61-4be3-a520-655e69ae8d2d", "tag": "07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:09.244503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-24eddc3c-52cb-4850-be77-4e564842ba6a req-8a53833f-4638-494f-a438-1649919120b5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.245634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-24eddc3c-52cb-4850-be77-4e564842ba6a req-8a53833f-4638-494f-a438-1649919120b5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.248097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-24eddc3c-52cb-4850-be77-4e564842ba6a req-8a53833f-4638-494f-a438-1649919120b5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:09.268655 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-24eddc3c-52cb-4850-be77-4e564842ba6a req-8a53833f-4638-494f-a438-1649919120b5 service nova] Creating event network-changed:07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0 for instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d on n-h2-852084-5 Aug 27 03:16:09.276255 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-24eddc3c-52cb-4850-be77-4e564842ba6a req-8a53833f-4638-494f-a438-1649919120b5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057477 Aug 27 03:16:09.277856 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2949/6078] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:09.437588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6cd04a2f-94d5-4b71-8d1a-420a38502db2 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:09.438946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6cd04a2f-94d5-4b71-8d1a-420a38502db2 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:09.446645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cd04a2f-94d5-4b71-8d1a-420a38502db2 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.447444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cd04a2f-94d5-4b71-8d1a-420a38502db2 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.448086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cd04a2f-94d5-4b71-8d1a-420a38502db2 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:09.449016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cd04a2f-94d5-4b71-8d1a-420a38502db2 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.449686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cd04a2f-94d5-4b71-8d1a-420a38502db2 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.450297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6cd04a2f-94d5-4b71-8d1a-420a38502db2 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:09.561359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-cfddd9f7-c1ce-4359-99cf-3ee16dcb058b req-61ac764f-6841-4578-a48e-f49010927664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392e72ae-6dd8-454b-8824-d5c854bb50c2", "name": "network-vif-plugged", "status": "completed", "tag": "5922c9e1-ab03-42a0-893b-c0a26493dbe7"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:09.578062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cfddd9f7-c1ce-4359-99cf-3ee16dcb058b req-61ac764f-6841-4578-a48e-f49010927664 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.578959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cfddd9f7-c1ce-4359-99cf-3ee16dcb058b req-61ac764f-6841-4578-a48e-f49010927664 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.579637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cfddd9f7-c1ce-4359-99cf-3ee16dcb058b req-61ac764f-6841-4578-a48e-f49010927664 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:09.593293 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-cfddd9f7-c1ce-4359-99cf-3ee16dcb058b req-61ac764f-6841-4578-a48e-f49010927664 service nova] Creating event network-vif-plugged:5922c9e1-ab03-42a0-893b-c0a26493dbe7 for instance 392e72ae-6dd8-454b-8824-d5c854bb50c2 on n-h1-852084-5 Aug 27 03:16:09.600610 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-cfddd9f7-c1ce-4359-99cf-3ee16dcb058b req-61ac764f-6841-4578-a48e-f49010927664 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043466 Aug 27 03:16:09.602441 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2950/6079] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:16:09.740480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9c5d6121-4b59-4121-bd9d-5a3e85d580e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:09.741208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9c5d6121-4b59-4121-bd9d-5a3e85d580e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:09.748837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c5d6121-4b59-4121-bd9d-5a3e85d580e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.749338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c5d6121-4b59-4121-bd9d-5a3e85d580e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.750045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c5d6121-4b59-4121-bd9d-5a3e85d580e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:09.750777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c5d6121-4b59-4121-bd9d-5a3e85d580e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.751238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c5d6121-4b59-4121-bd9d-5a3e85d580e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.751674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c5d6121-4b59-4121-bd9d-5a3e85d580e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:09.908123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9c5d6121-4b59-4121-bd9d-5a3e85d580e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:09.916798 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9c5d6121-4b59-4121-bd9d-5a3e85d580e0 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1390 microversion: 2.1 time: 0.181530 Aug 27 03:16:09.917392 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2951/6080] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:09 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1390 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:09.922816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-530fb196-d115-496f-8272-2fd8653e17fc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:09.923670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-530fb196-d115-496f-8272-2fd8653e17fc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:09.931045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-530fb196-d115-496f-8272-2fd8653e17fc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.932049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-530fb196-d115-496f-8272-2fd8653e17fc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.932493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-530fb196-d115-496f-8272-2fd8653e17fc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:09.933198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-530fb196-d115-496f-8272-2fd8653e17fc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:09.933747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-530fb196-d115-496f-8272-2fd8653e17fc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:09.934176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-530fb196-d115-496f-8272-2fd8653e17fc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:10.069587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-530fb196-d115-496f-8272-2fd8653e17fc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:10.077554 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-530fb196-d115-496f-8272-2fd8653e17fc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1202 microversion: 2.1 time: 0.158473 Aug 27 03:16:10.078189 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2952/6081] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:09 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:10.164670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6cd04a2f-94d5-4b71-8d1a-420a38502db2 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:10.173093 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6cd04a2f-94d5-4b71-8d1a-420a38502db2 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1315 microversion: 2.1 time: 0.739352 Aug 27 03:16:10.174003 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3130/6082] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:09 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:10.937606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dcf5cd7b-6eb2-4675-9f16-719552284775 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:10.938281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dcf5cd7b-6eb2-4675-9f16-719552284775 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:10.947560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf5cd7b-6eb2-4675-9f16-719552284775 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:10.948178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf5cd7b-6eb2-4675-9f16-719552284775 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:10.948861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf5cd7b-6eb2-4675-9f16-719552284775 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:10.949454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf5cd7b-6eb2-4675-9f16-719552284775 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:10.950023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf5cd7b-6eb2-4675-9f16-719552284775 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:10.950481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcf5cd7b-6eb2-4675-9f16-719552284775 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.100311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-251c36ad-7610-425f-ae3b-e3f8ef36beaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:11.100940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-251c36ad-7610-425f-ae3b-e3f8ef36beaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:11.115266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-251c36ad-7610-425f-ae3b-e3f8ef36beaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.116087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-251c36ad-7610-425f-ae3b-e3f8ef36beaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.116612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-251c36ad-7610-425f-ae3b-e3f8ef36beaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.117966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-251c36ad-7610-425f-ae3b-e3f8ef36beaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.118601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-251c36ad-7610-425f-ae3b-e3f8ef36beaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.119081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-251c36ad-7610-425f-ae3b-e3f8ef36beaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.302490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-251c36ad-7610-425f-ae3b-e3f8ef36beaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:11.312309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dcf5cd7b-6eb2-4675-9f16-719552284775 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:11.317896 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-251c36ad-7610-425f-ae3b-e3f8ef36beaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1202 microversion: 2.1 time: 0.221251 Aug 27 03:16:11.324097 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dcf5cd7b-6eb2-4675-9f16-719552284775 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1390 microversion: 2.1 time: 0.390683 Aug 27 03:16:11.325202 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2953/6083] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:10 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1390 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:11.332443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-66fadec4-a66a-442a-aebe-24356d2d64a6 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:11.333403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-66fadec4-a66a-442a-aebe-24356d2d64a6 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:11.335944 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3131/6084] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:11 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1202 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:11.349866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fadec4-a66a-442a-aebe-24356d2d64a6 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.350435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fadec4-a66a-442a-aebe-24356d2d64a6 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.352043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fadec4-a66a-442a-aebe-24356d2d64a6 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.356153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fadec4-a66a-442a-aebe-24356d2d64a6 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.356280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fadec4-a66a-442a-aebe-24356d2d64a6 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.356814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-66fadec4-a66a-442a-aebe-24356d2d64a6 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.377538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:11.525378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-66fadec4-a66a-442a-aebe-24356d2d64a6 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:11.534698 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-66fadec4-a66a-442a-aebe-24356d2d64a6 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1464 microversion: 2.1 time: 0.208274 Aug 27 03:16:11.535992 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2954/6085] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:11 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1464 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:11.615663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-12c3d524-d6f7-42fc-ae05-860664e2f773 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:11.616470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-12c3d524-d6f7-42fc-ae05-860664e2f773 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:11.627134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c3d524-d6f7-42fc-ae05-860664e2f773 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.628428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c3d524-d6f7-42fc-ae05-860664e2f773 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.629935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c3d524-d6f7-42fc-ae05-860664e2f773 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.630726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c3d524-d6f7-42fc-ae05-860664e2f773 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.634240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c3d524-d6f7-42fc-ae05-860664e2f773 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.634240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c3d524-d6f7-42fc-ae05-860664e2f773 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.662561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-12c3d524-d6f7-42fc-ae05-860664e2f773 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:16:11.762868 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-12c3d524-d6f7-42fc-ae05-860664e2f773 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "DELETE /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 204 len: 0 microversion: 2.1 time: 0.157429 Aug 27 03:16:11.763573 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3132/6086] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:16:11 2022] DELETE /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:16:11.773436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf2945e7-8085-4cbe-aba3-6be5eb99d370 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:11.774161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf2945e7-8085-4cbe-aba3-6be5eb99d370 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:11.780998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2945e7-8085-4cbe-aba3-6be5eb99d370 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.781499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2945e7-8085-4cbe-aba3-6be5eb99d370 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.782203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2945e7-8085-4cbe-aba3-6be5eb99d370 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.782971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2945e7-8085-4cbe-aba3-6be5eb99d370 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:11.783443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2945e7-8085-4cbe-aba3-6be5eb99d370 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:11.783885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf2945e7-8085-4cbe-aba3-6be5eb99d370 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:11.920772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf2945e7-8085-4cbe-aba3-6be5eb99d370 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:11.929267 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf2945e7-8085-4cbe-aba3-6be5eb99d370 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1470 microversion: 2.1 time: 0.160517 Aug 27 03:16:11.930712 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2955/6087] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:11 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:12.348053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-802249cf-37a3-42f6-a0c3-32a59cf31abc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:12.348892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-802249cf-37a3-42f6-a0c3-32a59cf31abc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:12.349047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e59ff3e1-8cde-45c7-b1d0-83462ff07175 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:12.349714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e59ff3e1-8cde-45c7-b1d0-83462ff07175 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:12.355998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802249cf-37a3-42f6-a0c3-32a59cf31abc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:12.356582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802249cf-37a3-42f6-a0c3-32a59cf31abc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:12.357104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802249cf-37a3-42f6-a0c3-32a59cf31abc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:12.358546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802249cf-37a3-42f6-a0c3-32a59cf31abc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:12.358879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e59ff3e1-8cde-45c7-b1d0-83462ff07175 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:12.359144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802249cf-37a3-42f6-a0c3-32a59cf31abc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:12.359379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e59ff3e1-8cde-45c7-b1d0-83462ff07175 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:12.359823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e59ff3e1-8cde-45c7-b1d0-83462ff07175 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:12.359935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-802249cf-37a3-42f6-a0c3-32a59cf31abc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:12.360534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e59ff3e1-8cde-45c7-b1d0-83462ff07175 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:12.361721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e59ff3e1-8cde-45c7-b1d0-83462ff07175 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:12.362171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e59ff3e1-8cde-45c7-b1d0-83462ff07175 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:12.505126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e59ff3e1-8cde-45c7-b1d0-83462ff07175 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:12.517109 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e59ff3e1-8cde-45c7-b1d0-83462ff07175 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1202 microversion: 2.1 time: 0.172613 Aug 27 03:16:12.518168 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2956/6088] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:12 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1202 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:12.608050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-802249cf-37a3-42f6-a0c3-32a59cf31abc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:12.616198 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-802249cf-37a3-42f6-a0c3-32a59cf31abc tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1390 microversion: 2.1 time: 0.273856 Aug 27 03:16:12.616791 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3133/6089] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:12 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1390 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:12.950739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-019a8d13-f997-4e94-b327-fd6e167905da tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:12.951623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-019a8d13-f997-4e94-b327-fd6e167905da tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:12.957989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-019a8d13-f997-4e94-b327-fd6e167905da tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:12.958491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-019a8d13-f997-4e94-b327-fd6e167905da tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:12.959200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-019a8d13-f997-4e94-b327-fd6e167905da tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:12.959912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-019a8d13-f997-4e94-b327-fd6e167905da tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:12.960373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-019a8d13-f997-4e94-b327-fd6e167905da tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:12.961521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-019a8d13-f997-4e94-b327-fd6e167905da tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:13.092970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:13.102454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-019a8d13-f997-4e94-b327-fd6e167905da tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:13.110685 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-019a8d13-f997-4e94-b327-fd6e167905da tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1470 microversion: 2.1 time: 0.163868 Aug 27 03:16:13.111604 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2957/6090] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:12 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:13.539627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0818c194-edc0-42f4-b955-2be7de0777cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:13.540277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0818c194-edc0-42f4-b955-2be7de0777cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:13.542362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:13.543042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=14 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:13.554144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0818c194-edc0-42f4-b955-2be7de0777cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:13.554534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0818c194-edc0-42f4-b955-2be7de0777cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:13.555029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0818c194-edc0-42f4-b955-2be7de0777cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:13.555744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0818c194-edc0-42f4-b955-2be7de0777cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:13.556200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0818c194-edc0-42f4-b955-2be7de0777cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:13.556631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0818c194-edc0-42f4-b955-2be7de0777cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:13.587847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:13.642293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e1d95b11-ac99-4303-b70c-654c7a9ee6e8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:13.643142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e1d95b11-ac99-4303-b70c-654c7a9ee6e8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:13.652067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1d95b11-ac99-4303-b70c-654c7a9ee6e8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:13.656670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1d95b11-ac99-4303-b70c-654c7a9ee6e8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:13.657162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1d95b11-ac99-4303-b70c-654c7a9ee6e8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:13.657958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1d95b11-ac99-4303-b70c-654c7a9ee6e8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:13.658949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1d95b11-ac99-4303-b70c-654c7a9ee6e8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:13.659602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e1d95b11-ac99-4303-b70c-654c7a9ee6e8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:13.837951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0818c194-edc0-42f4-b955-2be7de0777cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:13.848859 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0818c194-edc0-42f4-b955-2be7de0777cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1202 microversion: 2.1 time: 0.313646 Aug 27 03:16:13.854156 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3134/6091] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:13 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1202 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:13.870200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-376e5b81-072a-4930-9d9b-5540000e430b req-86092c44-95a8-4617-8664-b39e13437343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392e72ae-6dd8-454b-8824-d5c854bb50c2", "name": "network-vif-deleted", "tag": "5922c9e1-ab03-42a0-893b-c0a26493dbe7"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:13.892509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-376e5b81-072a-4930-9d9b-5540000e430b req-86092c44-95a8-4617-8664-b39e13437343 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:13.894463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-376e5b81-072a-4930-9d9b-5540000e430b req-86092c44-95a8-4617-8664-b39e13437343 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:13.895214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-376e5b81-072a-4930-9d9b-5540000e430b req-86092c44-95a8-4617-8664-b39e13437343 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:13.938257 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-376e5b81-072a-4930-9d9b-5540000e430b req-86092c44-95a8-4617-8664-b39e13437343 service nova] Creating event network-vif-deleted:5922c9e1-ab03-42a0-893b-c0a26493dbe7 for instance 392e72ae-6dd8-454b-8824-d5c854bb50c2 on n-h1-852084-5 Aug 27 03:16:13.946106 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-376e5b81-072a-4930-9d9b-5540000e430b req-86092c44-95a8-4617-8664-b39e13437343 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083537 Aug 27 03:16:13.947622 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3135/6092] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:16:13.998612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e1d95b11-ac99-4303-b70c-654c7a9ee6e8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:14.019906 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e1d95b11-ac99-4303-b70c-654c7a9ee6e8 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1390 microversion: 2.1 time: 0.383952 Aug 27 03:16:14.021015 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2958/6093] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:13 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1390 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:14.136653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:14.137346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:14.145788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:14.146443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:14.146907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:14.148029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:14.149903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:14.150581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:14.199617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:14.200388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:14.201006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:14.201776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lazy-loading 'fault' on Instance uuid 392e72ae-6dd8-454b-8824-d5c854bb50c2 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:16:14.283326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72559d985a8549dfa8ce38efab4df960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23b285c4b11e4d179b9a9502cf0e2fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:14.303781 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-29b3457e-8a85-4d25-a91d-fc2d8680b9b7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 200 len: 1305 microversion: 2.1 time: 0.174124 Aug 27 03:16:14.307647 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3136/6094] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:14 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 1305 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:14.879580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-820f2618-cb73-41ae-b403-555c22abb7e7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:14.881227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-820f2618-cb73-41ae-b403-555c22abb7e7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:14.894615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-820f2618-cb73-41ae-b403-555c22abb7e7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:14.895993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-820f2618-cb73-41ae-b403-555c22abb7e7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:14.897265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-820f2618-cb73-41ae-b403-555c22abb7e7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:14.899467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-820f2618-cb73-41ae-b403-555c22abb7e7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:14.900599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-820f2618-cb73-41ae-b403-555c22abb7e7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:14.901486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-820f2618-cb73-41ae-b403-555c22abb7e7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:15.045697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d5385ed3-9486-45c7-ba53-0893c5867783 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:15.046339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d5385ed3-9486-45c7-ba53-0893c5867783 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:15.054010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5385ed3-9486-45c7-ba53-0893c5867783 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:15.055341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5385ed3-9486-45c7-ba53-0893c5867783 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:15.056048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5385ed3-9486-45c7-ba53-0893c5867783 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:15.057271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5385ed3-9486-45c7-ba53-0893c5867783 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:15.057529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5385ed3-9486-45c7-ba53-0893c5867783 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:15.058741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d5385ed3-9486-45c7-ba53-0893c5867783 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:15.164462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-820f2618-cb73-41ae-b403-555c22abb7e7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:15.174822 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-820f2618-cb73-41ae-b403-555c22abb7e7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1202 microversion: 2.1 time: 0.299827 Aug 27 03:16:15.177170 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2959/6095] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:14 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1202 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:15.333839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:15.335009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] [instance: 392e72ae-6dd8-454b-8824-d5c854bb50c2] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:15.348942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:15.350692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:15.351936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:15.354145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:15.355344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:15.356451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:15.392626 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] HTTP exception thrown: Instance 392e72ae-6dd8-454b-8824-d5c854bb50c2 could not be found. Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Request method failure captured: Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 HTTP/1.1 Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYxjEBk7g8zVjGGGt2DjjE-2eXTRRox4bLf2wPMDeXfHnHv1mWdAK-6HCX-tdDc9ebvIKdLKb9HZHq8WMm2hGiToKa3luBT8KhjKyPuGhbCW_3mJaB9tDwzhtgUhiMJ7fK9xxgevo9fgS_wCFYSHBlC521N0gHi21MPxPtBZK15-TRE Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 23b285c4b11e4d179b9a9502cf0e2fdd Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-VolumesNegativeTest-2083944958 Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_23b285c4b11e4d179b9a9502cf0e2fdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/23b285c4b11e4d179b9a9502cf0e2fdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/23b285c4b11e4d179b9a9502cf0e2fdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/23b285c4b11e4d179b9a9502cf0e2fdd"}]}] Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-VolumesNegativeTest-2083944958 Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 23b285c4b11e4d179b9a9502cf0e2fdd Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-VolumesNegativeTest-2083944958 Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-VolumesNegativeTest-2083944958-project Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 72559d985a8549dfa8ce38efab4df960 Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-VolumesNegativeTest-2083944958-project Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 392e72ae-6dd8-454b-8824-d5c854bb50c2 could not be found. Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '392e72ae-6dd8-454b-8824-d5c854bb50c2'} Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392e72ae-6dd8-454b-8824-d5c854bb50c2 could not be found. Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392e72ae-6dd8-454b-8824-d5c854bb50c2 could not be found. Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:15.394780 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:16:15.400414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:15.400414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:15.400414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:15.400414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:16:15.400414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:16:15.400414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392e72ae-6dd8-454b-8824-d5c854bb50c2 could not be found. Aug 27 03:16:15.400414 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:16:15.402582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] Returning 404 to user: Instance 392e72ae-6dd8-454b-8824-d5c854bb50c2 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:15.403335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d5385ed3-9486-45c7-ba53-0893c5867783 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:15.405548 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bba0b1a6-46da-4e72-b8ac-ebb948ddbaf7 tempest-VolumesNegativeTest-2083944958 tempest-VolumesNegativeTest-2083944958-project] 10.222.0.99 "GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2" status: 404 len: 111 microversion: 2.1 time: 0.079479 Aug 27 03:16:15.418943 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2960/6096] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:15 2022] GET /compute/v2.1/servers/392e72ae-6dd8-454b-8824-d5c854bb50c2 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:16:15.423239 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d5385ed3-9486-45c7-ba53-0893c5867783 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1390 microversion: 2.1 time: 0.381464 Aug 27 03:16:15.423840 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3137/6097] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:15 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1390 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:15.534337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-5cb50a11-012d-48cb-aae1-683ae0d76051 req-e3050bd9-7ffb-481f-8a8d-afcffedddf29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f83ba1-2a61-4be3-a520-655e69ae8d2d", "name": "network-vif-plugged", "status": "completed", "tag": "07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:15.561567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5cb50a11-012d-48cb-aae1-683ae0d76051 req-e3050bd9-7ffb-481f-8a8d-afcffedddf29 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:15.562720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5cb50a11-012d-48cb-aae1-683ae0d76051 req-e3050bd9-7ffb-481f-8a8d-afcffedddf29 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:15.564394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-5cb50a11-012d-48cb-aae1-683ae0d76051 req-e3050bd9-7ffb-481f-8a8d-afcffedddf29 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:15.600454 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-5cb50a11-012d-48cb-aae1-683ae0d76051 req-e3050bd9-7ffb-481f-8a8d-afcffedddf29 service nova] Creating event network-vif-plugged:07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0 for instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d on n-h2-852084-5 Aug 27 03:16:15.624803 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-5cb50a11-012d-48cb-aae1-683ae0d76051 req-e3050bd9-7ffb-481f-8a8d-afcffedddf29 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101667 Aug 27 03:16:15.626836 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2961/6098] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:15.789952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-93d84765-f51a-46ac-874e-d800d594fe24 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:15.791285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c46a06cf-1625-4c8d-b33e-0c7f1d31a8b0 req-320759d4-d859-42f1-a3fc-ca278fcaadf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b353842-13ac-47f9-a0e8-d69bab50a4ae", "tag": "60329d31-4df4-4224-a4b6-44132fdb5c24"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:15.791950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-93d84765-f51a-46ac-874e-d800d594fe24 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:15.819506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93d84765-f51a-46ac-874e-d800d594fe24 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:15.821212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93d84765-f51a-46ac-874e-d800d594fe24 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:15.822257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93d84765-f51a-46ac-874e-d800d594fe24 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:15.827853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93d84765-f51a-46ac-874e-d800d594fe24 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:15.830162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c46a06cf-1625-4c8d-b33e-0c7f1d31a8b0 req-320759d4-d859-42f1-a3fc-ca278fcaadf9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:15.830889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93d84765-f51a-46ac-874e-d800d594fe24 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:15.832101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93d84765-f51a-46ac-874e-d800d594fe24 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:15.832521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c46a06cf-1625-4c8d-b33e-0c7f1d31a8b0 req-320759d4-d859-42f1-a3fc-ca278fcaadf9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:15.835197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c46a06cf-1625-4c8d-b33e-0c7f1d31a8b0 req-320759d4-d859-42f1-a3fc-ca278fcaadf9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:15.899232 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c46a06cf-1625-4c8d-b33e-0c7f1d31a8b0 req-320759d4-d859-42f1-a3fc-ca278fcaadf9 service nova] Creating event network-changed:60329d31-4df4-4224-a4b6-44132fdb5c24 for instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae on n-h2-852084-5 Aug 27 03:16:15.910280 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c46a06cf-1625-4c8d-b33e-0c7f1d31a8b0 req-320759d4-d859-42f1-a3fc-ca278fcaadf9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127583 Aug 27 03:16:15.911729 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2962/6099] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:16:15.948550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-93d84765-f51a-46ac-874e-d800d594fe24 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:16:16.094513 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-93d84765-f51a-46ac-874e-d800d594fe24 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "DELETE /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 204 len: 0 microversion: 2.1 time: 0.316527 Aug 27 03:16:16.095351 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3138/6100] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:16:15 2022] DELETE /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:16:16.107119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7759e6d1-7dee-42d8-92e0-8364d5a4f7a5 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:16.108442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7759e6d1-7dee-42d8-92e0-8364d5a4f7a5 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:16.137173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7759e6d1-7dee-42d8-92e0-8364d5a4f7a5 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.142598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7759e6d1-7dee-42d8-92e0-8364d5a4f7a5 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.142598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7759e6d1-7dee-42d8-92e0-8364d5a4f7a5 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.146248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7759e6d1-7dee-42d8-92e0-8364d5a4f7a5 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.146950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7759e6d1-7dee-42d8-92e0-8364d5a4f7a5 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.149583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7759e6d1-7dee-42d8-92e0-8364d5a4f7a5 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.204944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-72342f22-4c41-4915-9708-bd89607b382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:16.206431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-72342f22-4c41-4915-9708-bd89607b382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:16.221104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72342f22-4c41-4915-9708-bd89607b382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.221958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72342f22-4c41-4915-9708-bd89607b382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.222760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72342f22-4c41-4915-9708-bd89607b382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.224131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72342f22-4c41-4915-9708-bd89607b382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.225690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72342f22-4c41-4915-9708-bd89607b382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.231290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-72342f22-4c41-4915-9708-bd89607b382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.489208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7759e6d1-7dee-42d8-92e0-8364d5a4f7a5 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:16.520036 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7759e6d1-7dee-42d8-92e0-8364d5a4f7a5 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1583 microversion: 2.1 time: 0.415551 Aug 27 03:16:16.522360 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2963/6101] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:16 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1583 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:16.537753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-72342f22-4c41-4915-9708-bd89607b382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:16.545307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-87e5fc18-0b70-4987-9d81-a20a28135fdf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:16.548755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-87e5fc18-0b70-4987-9d81-a20a28135fdf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:16.569808 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-72342f22-4c41-4915-9708-bd89607b382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1202 microversion: 2.1 time: 0.369341 Aug 27 03:16:16.573345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87e5fc18-0b70-4987-9d81-a20a28135fdf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.588621 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3139/6102] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:16 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1202 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:16.589937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87e5fc18-0b70-4987-9d81-a20a28135fdf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.590761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87e5fc18-0b70-4987-9d81-a20a28135fdf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.592032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87e5fc18-0b70-4987-9d81-a20a28135fdf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:16.592846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87e5fc18-0b70-4987-9d81-a20a28135fdf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:16.593557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87e5fc18-0b70-4987-9d81-a20a28135fdf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:16.926997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-87e5fc18-0b70-4987-9d81-a20a28135fdf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:16.939916 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-87e5fc18-0b70-4987-9d81-a20a28135fdf tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1390 microversion: 2.1 time: 0.411873 Aug 27 03:16:16.941716 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2964/6103] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:16 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1390 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:17.555612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a4d3cb99-a8a4-4727-a766-ffce83b40f5b tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:17.558961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a4d3cb99-a8a4-4727-a766-ffce83b40f5b tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:17.577135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d3cb99-a8a4-4727-a766-ffce83b40f5b tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:17.578143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d3cb99-a8a4-4727-a766-ffce83b40f5b tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:17.578802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d3cb99-a8a4-4727-a766-ffce83b40f5b tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:17.581705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d3cb99-a8a4-4727-a766-ffce83b40f5b tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:17.588570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d3cb99-a8a4-4727-a766-ffce83b40f5b tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:17.589823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a4d3cb99-a8a4-4727-a766-ffce83b40f5b tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:17.607042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93064369-91d7-4327-b26f-75a5f0f75d99 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:17.607960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93064369-91d7-4327-b26f-75a5f0f75d99 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:17.644355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93064369-91d7-4327-b26f-75a5f0f75d99 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:17.646642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93064369-91d7-4327-b26f-75a5f0f75d99 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:17.648065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93064369-91d7-4327-b26f-75a5f0f75d99 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:17.650157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93064369-91d7-4327-b26f-75a5f0f75d99 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:17.652645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93064369-91d7-4327-b26f-75a5f0f75d99 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:17.653568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93064369-91d7-4327-b26f-75a5f0f75d99 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:17.918031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a4d3cb99-a8a4-4727-a766-ffce83b40f5b tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:17.926753 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a4d3cb99-a8a4-4727-a766-ffce83b40f5b tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1583 microversion: 2.1 time: 0.381094 Aug 27 03:16:17.942730 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3140/6104] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:17 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1583 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:17.971134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4dbc5dd6-cece-48f1-aae7-a5645d16de89 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:17.972279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4dbc5dd6-cece-48f1-aae7-a5645d16de89 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:17.985267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dbc5dd6-cece-48f1-aae7-a5645d16de89 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:17.986238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dbc5dd6-cece-48f1-aae7-a5645d16de89 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:17.986951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dbc5dd6-cece-48f1-aae7-a5645d16de89 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:17.988058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dbc5dd6-cece-48f1-aae7-a5645d16de89 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:17.988756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dbc5dd6-cece-48f1-aae7-a5645d16de89 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:17.989750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4dbc5dd6-cece-48f1-aae7-a5645d16de89 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:18.087276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-93064369-91d7-4327-b26f-75a5f0f75d99 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:18.113386 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-93064369-91d7-4327-b26f-75a5f0f75d99 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1202 microversion: 2.1 time: 0.509702 Aug 27 03:16:18.118354 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2965/6105] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:17 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1202 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:18.675954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4dbc5dd6-cece-48f1-aae7-a5645d16de89 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:18.694799 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4dbc5dd6-cece-48f1-aae7-a5645d16de89 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1390 microversion: 2.1 time: 0.729278 Aug 27 03:16:18.710319 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3141/6106] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:17 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1390 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:18.964311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-53052168-8cd8-4131-bdb7-6cae8ad5ee0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:18.966019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-53052168-8cd8-4131-bdb7-6cae8ad5ee0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:18.979655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53052168-8cd8-4131-bdb7-6cae8ad5ee0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:18.980372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53052168-8cd8-4131-bdb7-6cae8ad5ee0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:18.981117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53052168-8cd8-4131-bdb7-6cae8ad5ee0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:18.982250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53052168-8cd8-4131-bdb7-6cae8ad5ee0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:18.983181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53052168-8cd8-4131-bdb7-6cae8ad5ee0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:18.983970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-53052168-8cd8-4131-bdb7-6cae8ad5ee0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.141894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11dcd717-d053-4d1c-9670-a54522c670e1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:19.142843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-11dcd717-d053-4d1c-9670-a54522c670e1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:19.155787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11dcd717-d053-4d1c-9670-a54522c670e1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:19.157225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11dcd717-d053-4d1c-9670-a54522c670e1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:19.158062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11dcd717-d053-4d1c-9670-a54522c670e1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.160835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11dcd717-d053-4d1c-9670-a54522c670e1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:19.172508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11dcd717-d053-4d1c-9670-a54522c670e1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:19.173346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11dcd717-d053-4d1c-9670-a54522c670e1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.416492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-11dcd717-d053-4d1c-9670-a54522c670e1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:19.426383 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11dcd717-d053-4d1c-9670-a54522c670e1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1202 microversion: 2.1 time: 0.288526 Aug 27 03:16:19.426733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-53052168-8cd8-4131-bdb7-6cae8ad5ee0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:19.442078 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-53052168-8cd8-4131-bdb7-6cae8ad5ee0a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1464 microversion: 2.1 time: 0.486599 Aug 27 03:16:19.442223 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3142/6107] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:19 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1202 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:19.443857 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2966/6108] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:18 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1464 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:19.456613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-786aaf5f-b669-40a5-af68-37e8557903af req-d9f63719-dc96-4239-b784-4ba573b254e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b353842-13ac-47f9-a0e8-d69bab50a4ae", "name": "network-vif-deleted", "tag": "60329d31-4df4-4224-a4b6-44132fdb5c24"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:19.473558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-786aaf5f-b669-40a5-af68-37e8557903af req-d9f63719-dc96-4239-b784-4ba573b254e0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:19.474530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-786aaf5f-b669-40a5-af68-37e8557903af req-d9f63719-dc96-4239-b784-4ba573b254e0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:19.475853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-786aaf5f-b669-40a5-af68-37e8557903af req-d9f63719-dc96-4239-b784-4ba573b254e0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.499131 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-786aaf5f-b669-40a5-af68-37e8557903af req-d9f63719-dc96-4239-b784-4ba573b254e0 service nova] Creating event network-vif-deleted:60329d31-4df4-4224-a4b6-44132fdb5c24 for instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae on n-h2-852084-5 Aug 27 03:16:19.505300 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-786aaf5f-b669-40a5-af68-37e8557903af req-d9f63719-dc96-4239-b784-4ba573b254e0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055559 Aug 27 03:16:19.506359 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3143/6109] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:19.716913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fbbce4fd-6a6c-4398-80c3-83ad980e8e93 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:19.717582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fbbce4fd-6a6c-4398-80c3-83ad980e8e93 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:19.727471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbce4fd-6a6c-4398-80c3-83ad980e8e93 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:19.727977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbce4fd-6a6c-4398-80c3-83ad980e8e93 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:19.728416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbce4fd-6a6c-4398-80c3-83ad980e8e93 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:19.729137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbce4fd-6a6c-4398-80c3-83ad980e8e93 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:19.729596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbce4fd-6a6c-4398-80c3-83ad980e8e93 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:19.730062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbbce4fd-6a6c-4398-80c3-83ad980e8e93 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.044371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fbbce4fd-6a6c-4398-80c3-83ad980e8e93 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:20.056550 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fbbce4fd-6a6c-4398-80c3-83ad980e8e93 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1561 microversion: 2.1 time: 0.343705 Aug 27 03:16:20.061489 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2967/6110] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:19 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1561 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:20.086747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fdceb56c-7beb-4b3f-850d-dca165f74013 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:20.087464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fdceb56c-7beb-4b3f-850d-dca165f74013 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:20.104674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdceb56c-7beb-4b3f-850d-dca165f74013 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.105171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdceb56c-7beb-4b3f-850d-dca165f74013 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.105620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdceb56c-7beb-4b3f-850d-dca165f74013 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.106390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdceb56c-7beb-4b3f-850d-dca165f74013 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.108192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdceb56c-7beb-4b3f-850d-dca165f74013 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.108642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdceb56c-7beb-4b3f-850d-dca165f74013 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.454546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cbdef3c7-55c8-4475-8093-24dc41f9b099 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:20.456362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cbdef3c7-55c8-4475-8093-24dc41f9b099 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:20.491427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbdef3c7-55c8-4475-8093-24dc41f9b099 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.492419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbdef3c7-55c8-4475-8093-24dc41f9b099 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.493185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbdef3c7-55c8-4475-8093-24dc41f9b099 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.497164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbdef3c7-55c8-4475-8093-24dc41f9b099 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.500024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbdef3c7-55c8-4475-8093-24dc41f9b099 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.500967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cbdef3c7-55c8-4475-8093-24dc41f9b099 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.688950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fdceb56c-7beb-4b3f-850d-dca165f74013 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:20.698401 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fdceb56c-7beb-4b3f-850d-dca165f74013 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1561 microversion: 2.1 time: 0.617539 Aug 27 03:16:20.717317 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3144/6111] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:20 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1561 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:20.724066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1aa42889-164e-4ad9-8cf7-edfd0c4ff0c7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:20.725799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1aa42889-164e-4ad9-8cf7-edfd0c4ff0c7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:20.738328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa42889-164e-4ad9-8cf7-edfd0c4ff0c7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.739428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa42889-164e-4ad9-8cf7-edfd0c4ff0c7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.740680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa42889-164e-4ad9-8cf7-edfd0c4ff0c7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.744479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa42889-164e-4ad9-8cf7-edfd0c4ff0c7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:20.745183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa42889-164e-4ad9-8cf7-edfd0c4ff0c7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:20.746368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1aa42889-164e-4ad9-8cf7-edfd0c4ff0c7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:20.883690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cbdef3c7-55c8-4475-8093-24dc41f9b099 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:20.894463 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cbdef3c7-55c8-4475-8093-24dc41f9b099 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1202 microversion: 2.1 time: 0.448069 Aug 27 03:16:20.895290 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2968/6112] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:20 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1202 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:20.991580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1aa42889-164e-4ad9-8cf7-edfd0c4ff0c7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:21.002316 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1aa42889-164e-4ad9-8cf7-edfd0c4ff0c7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1229 microversion: 2.1 time: 0.283315 Aug 27 03:16:21.021400 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3145/6113] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:20 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1229 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:21.827644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-74d33f03-aeb7-4173-a50f-8a367665931e req-6aa9424b-8fb0-46db-b365-29691ebfa016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65beae04-1a37-472b-b66b-44d4ace25124", "name": "network-vif-plugged", "status": "completed", "tag": "24f397cf-48a3-4f5b-8a83-a7335b55ed98"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:21.850657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74d33f03-aeb7-4173-a50f-8a367665931e req-6aa9424b-8fb0-46db-b365-29691ebfa016 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:21.851206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74d33f03-aeb7-4173-a50f-8a367665931e req-6aa9424b-8fb0-46db-b365-29691ebfa016 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:21.852234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74d33f03-aeb7-4173-a50f-8a367665931e req-6aa9424b-8fb0-46db-b365-29691ebfa016 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:21.891072 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-74d33f03-aeb7-4173-a50f-8a367665931e req-6aa9424b-8fb0-46db-b365-29691ebfa016 service nova] Creating event network-vif-plugged:24f397cf-48a3-4f5b-8a83-a7335b55ed98 for instance 65beae04-1a37-472b-b66b-44d4ace25124 on n-h1-852084-5 Aug 27 03:16:21.900953 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-74d33f03-aeb7-4173-a50f-8a367665931e req-6aa9424b-8fb0-46db-b365-29691ebfa016 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077175 Aug 27 03:16:21.904040 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2969/6114] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:21.916315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2ae7b1b3-f821-4e06-97bd-6b239fec9df5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:21.916947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2ae7b1b3-f821-4e06-97bd-6b239fec9df5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:21.929640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ae7b1b3-f821-4e06-97bd-6b239fec9df5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:21.930190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ae7b1b3-f821-4e06-97bd-6b239fec9df5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:21.930644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ae7b1b3-f821-4e06-97bd-6b239fec9df5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:21.931386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ae7b1b3-f821-4e06-97bd-6b239fec9df5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:21.931855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ae7b1b3-f821-4e06-97bd-6b239fec9df5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:21.932298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ae7b1b3-f821-4e06-97bd-6b239fec9df5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:22.031042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88b095c8-4898-45c5-9f00-c653a42b9ff7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:22.032833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-88b095c8-4898-45c5-9f00-c653a42b9ff7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:22.062875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b095c8-4898-45c5-9f00-c653a42b9ff7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:22.063734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b095c8-4898-45c5-9f00-c653a42b9ff7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:22.065749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b095c8-4898-45c5-9f00-c653a42b9ff7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:22.068074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b095c8-4898-45c5-9f00-c653a42b9ff7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:22.086481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b095c8-4898-45c5-9f00-c653a42b9ff7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:22.087230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88b095c8-4898-45c5-9f00-c653a42b9ff7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:22.525248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-88b095c8-4898-45c5-9f00-c653a42b9ff7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:22.534437 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-88b095c8-4898-45c5-9f00-c653a42b9ff7 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1229 microversion: 2.1 time: 0.512984 Aug 27 03:16:22.545148 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2970/6115] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:22 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1229 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:22.714146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2ae7b1b3-f821-4e06-97bd-6b239fec9df5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:22.732396 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2ae7b1b3-f821-4e06-97bd-6b239fec9df5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1202 microversion: 2.1 time: 0.819875 Aug 27 03:16:22.737191 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3146/6116] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:21 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1202 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:23.570994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-50f6a9f3-be5d-4e51-8af1-9554837ee33a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:23.571824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-50f6a9f3-be5d-4e51-8af1-9554837ee33a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:23.591739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50f6a9f3-be5d-4e51-8af1-9554837ee33a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:23.597762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50f6a9f3-be5d-4e51-8af1-9554837ee33a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:23.600628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50f6a9f3-be5d-4e51-8af1-9554837ee33a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:23.602287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50f6a9f3-be5d-4e51-8af1-9554837ee33a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:23.613223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50f6a9f3-be5d-4e51-8af1-9554837ee33a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:23.614202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50f6a9f3-be5d-4e51-8af1-9554837ee33a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:23.759330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-46feaf69-37f6-453d-9693-f74b772cd1d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:23.761180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-46feaf69-37f6-453d-9693-f74b772cd1d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:23.787393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46feaf69-37f6-453d-9693-f74b772cd1d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:23.788468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46feaf69-37f6-453d-9693-f74b772cd1d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:23.789910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46feaf69-37f6-453d-9693-f74b772cd1d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:23.795170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46feaf69-37f6-453d-9693-f74b772cd1d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:23.796223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46feaf69-37f6-453d-9693-f74b772cd1d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:23.801404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-46feaf69-37f6-453d-9693-f74b772cd1d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:24.259280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-50f6a9f3-be5d-4e51-8af1-9554837ee33a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:24.271132 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-50f6a9f3-be5d-4e51-8af1-9554837ee33a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1229 microversion: 2.1 time: 0.705137 Aug 27 03:16:24.310061 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2971/6117] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:23 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1229 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:24.610219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-46feaf69-37f6-453d-9693-f74b772cd1d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:24.622855 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-46feaf69-37f6-453d-9693-f74b772cd1d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1202 microversion: 2.1 time: 0.868644 Aug 27 03:16:24.624097 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3147/6118] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:23 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1202 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:25.319519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ed594b3d-9e29-4793-9816-ec8beb7b8f2a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:25.320323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ed594b3d-9e29-4793-9816-ec8beb7b8f2a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:25.336327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed594b3d-9e29-4793-9816-ec8beb7b8f2a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.336850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed594b3d-9e29-4793-9816-ec8beb7b8f2a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.337318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed594b3d-9e29-4793-9816-ec8beb7b8f2a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.338263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed594b3d-9e29-4793-9816-ec8beb7b8f2a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.338751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed594b3d-9e29-4793-9816-ec8beb7b8f2a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.339199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed594b3d-9e29-4793-9816-ec8beb7b8f2a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.537756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ed594b3d-9e29-4793-9816-ec8beb7b8f2a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:25.563564 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ed594b3d-9e29-4793-9816-ec8beb7b8f2a tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1229 microversion: 2.1 time: 0.252684 Aug 27 03:16:25.587831 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2972/6119] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:25 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1229 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:25.658050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6c3ba244-1af9-4e8d-adc5-9df72a770255 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:25.660094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6c3ba244-1af9-4e8d-adc5-9df72a770255 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:25.678670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c3ba244-1af9-4e8d-adc5-9df72a770255 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.680047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c3ba244-1af9-4e8d-adc5-9df72a770255 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.680701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c3ba244-1af9-4e8d-adc5-9df72a770255 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.681611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c3ba244-1af9-4e8d-adc5-9df72a770255 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.682383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c3ba244-1af9-4e8d-adc5-9df72a770255 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.682998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c3ba244-1af9-4e8d-adc5-9df72a770255 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.861866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6c3ba244-1af9-4e8d-adc5-9df72a770255 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:25.874948 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6c3ba244-1af9-4e8d-adc5-9df72a770255 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1389 microversion: 2.1 time: 0.232319 Aug 27 03:16:25.878294 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3148/6120] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:25 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1389 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:25.901609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f4f1c3eb-2392-40b4-a32e-4c24067068b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:25.902334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f4f1c3eb-2392-40b4-a32e-4c24067068b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:25.914261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=82 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:25.916914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f1c3eb-2392-40b4-a32e-4c24067068b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.918245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f1c3eb-2392-40b4-a32e-4c24067068b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.919228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f1c3eb-2392-40b4-a32e-4c24067068b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:25.920419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f1c3eb-2392-40b4-a32e-4c24067068b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:25.921158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f1c3eb-2392-40b4-a32e-4c24067068b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:25.921784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f1c3eb-2392-40b4-a32e-4c24067068b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:26.489260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f4f1c3eb-2392-40b4-a32e-4c24067068b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:26.494463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:26.505897 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f4f1c3eb-2392-40b4-a32e-4c24067068b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1389 microversion: 2.1 time: 0.610630 Aug 27 03:16:26.506806 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2973/6121] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:25 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1389 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:26.545529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5db3b0d5-179a-40a6-a302-b59f37c64f47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:26.546670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5db3b0d5-179a-40a6-a302-b59f37c64f47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:26.556532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5db3b0d5-179a-40a6-a302-b59f37c64f47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:26.557050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5db3b0d5-179a-40a6-a302-b59f37c64f47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:26.557509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5db3b0d5-179a-40a6-a302-b59f37c64f47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:26.558268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5db3b0d5-179a-40a6-a302-b59f37c64f47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:26.558920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5db3b0d5-179a-40a6-a302-b59f37c64f47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:26.559656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5db3b0d5-179a-40a6-a302-b59f37c64f47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:26.604584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6968a76d-d722-4bfd-8a0f-aace4f861d37 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:26.605200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6968a76d-d722-4bfd-8a0f-aace4f861d37 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:26.627661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6968a76d-d722-4bfd-8a0f-aace4f861d37 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:26.628159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6968a76d-d722-4bfd-8a0f-aace4f861d37 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:26.628597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6968a76d-d722-4bfd-8a0f-aace4f861d37 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:26.629315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6968a76d-d722-4bfd-8a0f-aace4f861d37 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:26.630200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6968a76d-d722-4bfd-8a0f-aace4f861d37 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:26.630716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6968a76d-d722-4bfd-8a0f-aace4f861d37 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:26.835860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5db3b0d5-179a-40a6-a302-b59f37c64f47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:26.846898 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5db3b0d5-179a-40a6-a302-b59f37c64f47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1389 microversion: 2.1 time: 0.312099 Aug 27 03:16:26.848171 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3149/6122] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:26 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1389 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:26.853231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6968a76d-d722-4bfd-8a0f-aace4f861d37 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:26.872985 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6968a76d-d722-4bfd-8a0f-aace4f861d37 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1229 microversion: 2.1 time: 0.272693 Aug 27 03:16:26.874326 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2974/6123] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:26 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1229 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:26.875100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a711a6cf-2ffc-47c1-832e-1cbed2212941 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:26.875841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a711a6cf-2ffc-47c1-832e-1cbed2212941 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:26.884726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a711a6cf-2ffc-47c1-832e-1cbed2212941 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:26.885890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a711a6cf-2ffc-47c1-832e-1cbed2212941 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:26.886612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a711a6cf-2ffc-47c1-832e-1cbed2212941 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:26.887691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a711a6cf-2ffc-47c1-832e-1cbed2212941 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:26.888346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a711a6cf-2ffc-47c1-832e-1cbed2212941 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:26.889018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a711a6cf-2ffc-47c1-832e-1cbed2212941 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:26.895571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:26.934170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a711a6cf-2ffc-47c1-832e-1cbed2212941 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:16:27.114972 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a711a6cf-2ffc-47c1-832e-1cbed2212941 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 204 len: 0 microversion: 2.1 time: 0.243988 Aug 27 03:16:27.121238 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3150/6124] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:16:26 2022] DELETE /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:16:27.127113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd919255-3c39-4398-9ad4-0c4bf2ed245d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:27.128138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bd919255-3c39-4398-9ad4-0c4bf2ed245d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:27.139241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd919255-3c39-4398-9ad4-0c4bf2ed245d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.140976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd919255-3c39-4398-9ad4-0c4bf2ed245d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.142220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd919255-3c39-4398-9ad4-0c4bf2ed245d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.146073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd919255-3c39-4398-9ad4-0c4bf2ed245d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.146989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd919255-3c39-4398-9ad4-0c4bf2ed245d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.147706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd919255-3c39-4398-9ad4-0c4bf2ed245d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.156673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bbd5cf78-d440-4dbc-a748-309360c86adb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:27.158336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bbd5cf78-d440-4dbc-a748-309360c86adb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:27.174037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:27.178448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd5cf78-d440-4dbc-a748-309360c86adb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.179623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd5cf78-d440-4dbc-a748-309360c86adb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.180574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd5cf78-d440-4dbc-a748-309360c86adb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.181947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd5cf78-d440-4dbc-a748-309360c86adb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.182773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd5cf78-d440-4dbc-a748-309360c86adb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.183503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbd5cf78-d440-4dbc-a748-309360c86adb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.560916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bbd5cf78-d440-4dbc-a748-309360c86adb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:27.574766 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bbd5cf78-d440-4dbc-a748-309360c86adb tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1561 microversion: 2.1 time: 0.429969 Aug 27 03:16:27.575713 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3151/6125] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:27 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1561 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:27.597136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-3c1e0424-f661-4c7d-a755-61d01be2ed91 req-e00a2fa4-d78e-4a07-b480-c3d721b5ddd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f83ba1-2a61-4be3-a520-655e69ae8d2d", "tag": "07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:27.609424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c1e0424-f661-4c7d-a755-61d01be2ed91 req-e00a2fa4-d78e-4a07-b480-c3d721b5ddd6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.610053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c1e0424-f661-4c7d-a755-61d01be2ed91 req-e00a2fa4-d78e-4a07-b480-c3d721b5ddd6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.611036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c1e0424-f661-4c7d-a755-61d01be2ed91 req-e00a2fa4-d78e-4a07-b480-c3d721b5ddd6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.631715 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-3c1e0424-f661-4c7d-a755-61d01be2ed91 req-e00a2fa4-d78e-4a07-b480-c3d721b5ddd6 service nova] Creating event network-changed:07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0 for instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d on n-h2-852084-5 Aug 27 03:16:27.639397 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-3c1e0424-f661-4c7d-a755-61d01be2ed91 req-e00a2fa4-d78e-4a07-b480-c3d721b5ddd6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047589 Aug 27 03:16:27.640492 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3152/6126] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:27.906682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd919255-3c39-4398-9ad4-0c4bf2ed245d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:27.907749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8ff68a8a-569b-4d4e-8938-281f350f09a1 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:27.909828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8ff68a8a-569b-4d4e-8938-281f350f09a1 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:27.915352 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd919255-3c39-4398-9ad4-0c4bf2ed245d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1395 microversion: 2.1 time: 0.792507 Aug 27 03:16:27.929995 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2975/6127] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:27 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1395 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:27.930774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ff68a8a-569b-4d4e-8938-281f350f09a1 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.932144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ff68a8a-569b-4d4e-8938-281f350f09a1 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.933172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ff68a8a-569b-4d4e-8938-281f350f09a1 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:27.938326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ff68a8a-569b-4d4e-8938-281f350f09a1 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:27.938326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ff68a8a-569b-4d4e-8938-281f350f09a1 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:27.938326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8ff68a8a-569b-4d4e-8938-281f350f09a1 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.088996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8ff68a8a-569b-4d4e-8938-281f350f09a1 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0045bf81a2b5458d8641a6a5cdb01056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ee79f69e564395a60352e0d81b9840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:28.112609 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8ff68a8a-569b-4d4e-8938-281f350f09a1 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 200 len: 1229 microversion: 2.1 time: 0.217833 Aug 27 03:16:28.126492 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3153/6128] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:27 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 1229 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:28.947321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ca464c3b-0380-4c71-8817-4e2dd64efab5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:28.955681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ca464c3b-0380-4c71-8817-4e2dd64efab5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:28.974740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca464c3b-0380-4c71-8817-4e2dd64efab5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.975633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca464c3b-0380-4c71-8817-4e2dd64efab5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.976682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca464c3b-0380-4c71-8817-4e2dd64efab5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:28.977613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca464c3b-0380-4c71-8817-4e2dd64efab5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:28.978264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca464c3b-0380-4c71-8817-4e2dd64efab5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:28.978937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ca464c3b-0380-4c71-8817-4e2dd64efab5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:29.141475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:29.141475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] [instance: 2b353842-13ac-47f9-a0e8-d69bab50a4ae] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:29.158683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:29.158683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:29.158683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:29.158683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:29.170782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:29.171405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:29.210709 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] HTTP exception thrown: Instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae could not be found. Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Request method failure captured: Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae HTTP/1.1 Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYt4kn8XVzGaDTnvEkg6dPQ3Yrp04Mzqkbr9liWwkDXTHcD60YoJN1f0sOZuVyJIHHIVVSh2Gtt9gOMSy_4rQMr_oXb_GtR1qYJodZ2QW9Cy4XEsCuVNspM0mk3OAc9Y6-v7N79DD8GbFYDwvzva_MzPic9oIMhHM6qOiZiugahS8cA Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: f5ee79f69e564395a60352e0d81b9840 Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestVolumeBackupRestore-1266061310 Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_f5ee79f69e564395a60352e0d81b9840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f5ee79f69e564395a60352e0d81b9840"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/f5ee79f69e564395a60352e0d81b9840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/f5ee79f69e564395a60352e0d81b9840"}]}] Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestVolumeBackupRestore-1266061310 Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: f5ee79f69e564395a60352e0d81b9840 Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1266061310 Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestVolumeBackupRestore-1266061310-project Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0045bf81a2b5458d8641a6a5cdb01056 Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestVolumeBackupRestore-1266061310-project Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae could not be found. Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '2b353842-13ac-47f9-a0e8-d69bab50a4ae'} Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae could not be found. Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae could not be found. Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:29.215513 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:16:29.221372 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:29.221372 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:29.221372 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:29.221372 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:16:29.221372 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:16:29.221372 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae could not be found. Aug 27 03:16:29.221372 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:16:29.221372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Returning 404 to user: Instance 2b353842-13ac-47f9-a0e8-d69bab50a4ae could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:29.221372 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3fa5dfbe-f5de-4131-9ac4-99bcb7aba26c tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae" status: 404 len: 111 microversion: 2.1 time: 0.086937 Aug 27 03:16:29.221372 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3154/6129] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:29 2022] GET /compute/v2.1/servers/2b353842-13ac-47f9-a0e8-d69bab50a4ae => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:16:29.586514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1bf256d7-d21c-4f23-82c1-e2a6c26caf82 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] Calling method '.version_select at 0x7f4d2920cd30>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:29.620229 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1bf256d7-d21c-4f23-82c1-e2a6c26caf82 tempest-TestVolumeBackupRestore-1266061310 tempest-TestVolumeBackupRestore-1266061310-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-152269922" status: 202 len: 0 microversion: 2.1 time: 0.042073 Aug 27 03:16:29.625818 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3155/6130] 10.222.0.99 () {58 vars in 1266 bytes} [Sat Aug 27 03:16:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-152269922 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:16:30.426271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ca464c3b-0380-4c71-8817-4e2dd64efab5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:30.438446 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ca464c3b-0380-4c71-8817-4e2dd64efab5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1395 microversion: 2.1 time: 1.495320 Aug 27 03:16:30.438446 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2976/6131] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:28 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1395 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:30.996607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-bb5d0596-32cc-41aa-a957-e2a30aee1887 req-e5c816f5-8701-4aa8-9ab7-e332795be28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65beae04-1a37-472b-b66b-44d4ace25124", "name": "network-vif-deleted", "tag": "24f397cf-48a3-4f5b-8a83-a7335b55ed98"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:31.013970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bb5d0596-32cc-41aa-a957-e2a30aee1887 req-e5c816f5-8701-4aa8-9ab7-e332795be28e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.014784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bb5d0596-32cc-41aa-a957-e2a30aee1887 req-e5c816f5-8701-4aa8-9ab7-e332795be28e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.015682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bb5d0596-32cc-41aa-a957-e2a30aee1887 req-e5c816f5-8701-4aa8-9ab7-e332795be28e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.052702 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-bb5d0596-32cc-41aa-a957-e2a30aee1887 req-e5c816f5-8701-4aa8-9ab7-e332795be28e service nova] Creating event network-vif-deleted:24f397cf-48a3-4f5b-8a83-a7335b55ed98 for instance 65beae04-1a37-472b-b66b-44d4ace25124 on n-h1-852084-5 Aug 27 03:16:31.074573 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-bb5d0596-32cc-41aa-a957-e2a30aee1887 req-e5c816f5-8701-4aa8-9ab7-e332795be28e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090036 Aug 27 03:16:31.079520 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3156/6132] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:31.470155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-050481b4-027f-48a2-94d4-775cbef8f17b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:31.471447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-050481b4-027f-48a2-94d4-775cbef8f17b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:31.497347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050481b4-027f-48a2-94d4-775cbef8f17b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.498424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050481b4-027f-48a2-94d4-775cbef8f17b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.501025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050481b4-027f-48a2-94d4-775cbef8f17b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.502710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050481b4-027f-48a2-94d4-775cbef8f17b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:31.508385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050481b4-027f-48a2-94d4-775cbef8f17b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:31.508385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-050481b4-027f-48a2-94d4-775cbef8f17b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:31.645643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-050481b4-027f-48a2-94d4-775cbef8f17b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:31.678155 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-050481b4-027f-48a2-94d4-775cbef8f17b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1187 microversion: 2.1 time: 0.218023 Aug 27 03:16:31.678763 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2977/6133] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:31 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1187 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:32.604668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aad5a46f-c292-4963-b815-7ccc1af0e3f6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Action: 'create', calling method: .version_select at 0x7f4d2934e3a0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1894657716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/ic20CMO734xeaYgcZ/hRNfg+DAaMthVTXzj442tigAZBnI977jUQ3e4rdrECvV4PwuEb6K0eucuh+e9DM2Hb5I0mczIZUDW8BaSpkiy+8vm/fQrCZLgO2p634baREeg=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:32.649743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-aad5a46f-c292-4963-b815-7ccc1af0e3f6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Getting quotas for project a99e9f6cca3147f4a1797bbf7186dafe. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:16:32.660184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-aad5a46f-c292-4963-b815-7ccc1af0e3f6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Getting quotas for user 8844887e3d0947968a4cf6997a9e171c and project a99e9f6cca3147f4a1797bbf7186dafe. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:16:32.704046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-625e0e42-609b-4d56-b323-24ae75bb0958 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:32.704873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-625e0e42-609b-4d56-b323-24ae75bb0958 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:32.709474 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aad5a46f-c292-4963-b815-7ccc1af0e3f6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.724758 Aug 27 03:16:32.715189 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3157/6134] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:16:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:16:32.717305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625e0e42-609b-4d56-b323-24ae75bb0958 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:32.718104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625e0e42-609b-4d56-b323-24ae75bb0958 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:32.718728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625e0e42-609b-4d56-b323-24ae75bb0958 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:32.720313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625e0e42-609b-4d56-b323-24ae75bb0958 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:32.721130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625e0e42-609b-4d56-b323-24ae75bb0958 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:32.721781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-625e0e42-609b-4d56-b323-24ae75bb0958 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:32.925566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-625e0e42-609b-4d56-b323-24ae75bb0958 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:32.942180 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-625e0e42-609b-4d56-b323-24ae75bb0958 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1187 microversion: 2.1 time: 0.238352 Aug 27 03:16:32.953706 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2978/6135] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:32 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1187 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:33.968386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ff73f18-6053-4f97-af48-c45ecf7b8766 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:33.970002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ff73f18-6053-4f97-af48-c45ecf7b8766 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:34.006251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ff73f18-6053-4f97-af48-c45ecf7b8766 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:34.007120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ff73f18-6053-4f97-af48-c45ecf7b8766 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:34.008058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ff73f18-6053-4f97-af48-c45ecf7b8766 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:34.011404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ff73f18-6053-4f97-af48-c45ecf7b8766 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:34.016331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ff73f18-6053-4f97-af48-c45ecf7b8766 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:34.017154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ff73f18-6053-4f97-af48-c45ecf7b8766 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:34.348468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ff73f18-6053-4f97-af48-c45ecf7b8766 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:34.360639 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ff73f18-6053-4f97-af48-c45ecf7b8766 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1187 microversion: 2.1 time: 0.396620 Aug 27 03:16:34.381617 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3158/6136] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:33 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1187 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:35.416063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a182e3e9-e178-4335-a3d7-f53b2d9a5575 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:35.422452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a182e3e9-e178-4335-a3d7-f53b2d9a5575 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:35.456227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a182e3e9-e178-4335-a3d7-f53b2d9a5575 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:35.472876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a182e3e9-e178-4335-a3d7-f53b2d9a5575 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:35.477834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a182e3e9-e178-4335-a3d7-f53b2d9a5575 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:35.487487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a182e3e9-e178-4335-a3d7-f53b2d9a5575 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:35.492357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a182e3e9-e178-4335-a3d7-f53b2d9a5575 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:35.493437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a182e3e9-e178-4335-a3d7-f53b2d9a5575 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:35.740507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a182e3e9-e178-4335-a3d7-f53b2d9a5575 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:35.778527 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a182e3e9-e178-4335-a3d7-f53b2d9a5575 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1187 microversion: 2.1 time: 0.384146 Aug 27 03:16:35.784651 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2979/6137] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:35 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1187 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:36.823583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-82e0e779-42fd-43f1-9bdc-df86b2365c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:36.825530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-82e0e779-42fd-43f1-9bdc-df86b2365c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:36.868904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82e0e779-42fd-43f1-9bdc-df86b2365c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:36.874983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82e0e779-42fd-43f1-9bdc-df86b2365c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:36.876823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82e0e779-42fd-43f1-9bdc-df86b2365c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:36.887212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82e0e779-42fd-43f1-9bdc-df86b2365c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:36.890090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82e0e779-42fd-43f1-9bdc-df86b2365c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:36.891274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82e0e779-42fd-43f1-9bdc-df86b2365c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:37.220522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-82e0e779-42fd-43f1-9bdc-df86b2365c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:37.263473 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-82e0e779-42fd-43f1-9bdc-df86b2365c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1187 microversion: 2.1 time: 0.447567 Aug 27 03:16:37.264954 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3159/6138] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:36 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1187 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:38.308631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c264d7d7-3dee-46c0-b658-8b5b1f8db6b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:38.320938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c264d7d7-3dee-46c0-b658-8b5b1f8db6b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:38.354888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c264d7d7-3dee-46c0-b658-8b5b1f8db6b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:38.361365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c264d7d7-3dee-46c0-b658-8b5b1f8db6b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:38.363537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c264d7d7-3dee-46c0-b658-8b5b1f8db6b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:38.371048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c264d7d7-3dee-46c0-b658-8b5b1f8db6b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:38.375247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c264d7d7-3dee-46c0-b658-8b5b1f8db6b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:38.381827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c264d7d7-3dee-46c0-b658-8b5b1f8db6b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:38.796462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c264d7d7-3dee-46c0-b658-8b5b1f8db6b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:38.806352 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c264d7d7-3dee-46c0-b658-8b5b1f8db6b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1187 microversion: 2.1 time: 0.509370 Aug 27 03:16:38.811051 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2980/6139] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:38 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1187 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:39.831850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1002b03e-72e1-437a-938c-c9dc1e83aaf3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:39.832560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1002b03e-72e1-437a-938c-c9dc1e83aaf3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:39.843829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1002b03e-72e1-437a-938c-c9dc1e83aaf3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:39.851656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1002b03e-72e1-437a-938c-c9dc1e83aaf3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:39.852243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1002b03e-72e1-437a-938c-c9dc1e83aaf3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:39.853106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1002b03e-72e1-437a-938c-c9dc1e83aaf3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:39.853656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1002b03e-72e1-437a-938c-c9dc1e83aaf3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:39.861249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1002b03e-72e1-437a-938c-c9dc1e83aaf3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:40.008388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1002b03e-72e1-437a-938c-c9dc1e83aaf3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:40.026872 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1002b03e-72e1-437a-938c-c9dc1e83aaf3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1187 microversion: 2.1 time: 0.199445 Aug 27 03:16:40.040525 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3160/6140] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:39 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1187 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:41.058523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a0342fa9-3e44-4ff0-a651-2d7490582f10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:41.062234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a0342fa9-3e44-4ff0-a651-2d7490582f10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:41.088770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0342fa9-3e44-4ff0-a651-2d7490582f10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:41.093970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0342fa9-3e44-4ff0-a651-2d7490582f10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:41.094816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0342fa9-3e44-4ff0-a651-2d7490582f10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:41.102782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0342fa9-3e44-4ff0-a651-2d7490582f10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:41.107029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0342fa9-3e44-4ff0-a651-2d7490582f10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:41.123378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a0342fa9-3e44-4ff0-a651-2d7490582f10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:41.432871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a0342fa9-3e44-4ff0-a651-2d7490582f10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:41.449649 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a0342fa9-3e44-4ff0-a651-2d7490582f10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1187 microversion: 2.1 time: 0.403430 Aug 27 03:16:41.450451 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2981/6141] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:41 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1187 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:42.471906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3f6822d6-130a-47d2-a3f6-8852365cfb66 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:42.473602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3f6822d6-130a-47d2-a3f6-8852365cfb66 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:42.497516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f6822d6-130a-47d2-a3f6-8852365cfb66 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:42.498476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f6822d6-130a-47d2-a3f6-8852365cfb66 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:42.499207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f6822d6-130a-47d2-a3f6-8852365cfb66 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:42.500227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f6822d6-130a-47d2-a3f6-8852365cfb66 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:42.500955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f6822d6-130a-47d2-a3f6-8852365cfb66 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:42.501614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f6822d6-130a-47d2-a3f6-8852365cfb66 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:42.675529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:42.756613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3f6822d6-130a-47d2-a3f6-8852365cfb66 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:42.767065 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3f6822d6-130a-47d2-a3f6-8852365cfb66 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1187 microversion: 2.1 time: 0.299442 Aug 27 03:16:42.772115 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3161/6142] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:42 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1187 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:43.814587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:43.818750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:43.856641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:43.858908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:43.860294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:43.862067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:43.863227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:43.864276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:43.955025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:43.956109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:43.957774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:43.974213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lazy-loading 'fault' on Instance uuid 65beae04-1a37-472b-b66b-44d4ace25124 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:16:44.276681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:44.280958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-035e91f7-c479-40d4-b84b-bdc41f9b358c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:44.287986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-035e91f7-c479-40d4-b84b-bdc41f9b358c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:44.293292 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5da8a74e-1047-4aef-a896-fc877487637e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 200 len: 1146 microversion: 2.1 time: 0.507677 Aug 27 03:16:44.301862 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2982/6143] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:43 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 1146 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:44.314155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-035e91f7-c479-40d4-b84b-bdc41f9b358c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:44.314718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-035e91f7-c479-40d4-b84b-bdc41f9b358c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:44.315384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-035e91f7-c479-40d4-b84b-bdc41f9b358c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:44.316349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-035e91f7-c479-40d4-b84b-bdc41f9b358c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:44.317027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-035e91f7-c479-40d4-b84b-bdc41f9b358c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:44.317687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-035e91f7-c479-40d4-b84b-bdc41f9b358c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:44.423428 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-035e91f7-c479-40d4-b84b-bdc41f9b358c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d/action" status: 200 len: 24564 microversion: 2.1 time: 0.151787 Aug 27 03:16:44.434442 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3162/6144] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:16:44 2022] POST /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d/action => generated 24564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:16:45.329462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:45.331735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 65beae04-1a37-472b-b66b-44d4ace25124] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:45.349184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:45.350101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:45.353611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:45.354964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:45.355691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:45.362101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:45.396844 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance 65beae04-1a37-472b-b66b-44d4ace25124 could not be found. Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 HTTP/1.1 Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 65beae04-1a37-472b-b66b-44d4ace25124 could not be found. Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '65beae04-1a37-472b-b66b-44d4ace25124'} Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65beae04-1a37-472b-b66b-44d4ace25124 could not be found. Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65beae04-1a37-472b-b66b-44d4ace25124 could not be found. Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:16:45.401007 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:16:45.406948 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:16:45.406948 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:16:45.406948 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:16:45.406948 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:16:45.406948 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:16:45.406948 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65beae04-1a37-472b-b66b-44d4ace25124 could not be found. Aug 27 03:16:45.406948 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:16:45.416323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance 65beae04-1a37-472b-b66b-44d4ace25124 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:16:45.417576 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a8846328-3f69-4510-9937-11678801bb7c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124" status: 404 len: 111 microversion: 2.1 time: 0.096713 Aug 27 03:16:45.420164 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2983/6145] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:45 2022] GET /compute/v2.1/servers/65beae04-1a37-472b-b66b-44d4ace25124 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:16:47.956205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-355835762-access_point-470312018", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "a9397090-1ad5-44d3-af7e-51120cafb97b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1894657716", "security_groups": [{"name": "tempest-secgroup_access--1328677943"}, {"name": "tempest-secgroup_general--292784123"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:48.241387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] validate_networks() for [('a9397090-1ad5-44d3-af7e-51120cafb97b', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:16:49.155166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:16:49.155166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:16:49.156360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:16:49.156360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:16:49.156360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:16:49.174416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:49.177041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:49.177709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:49.180459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:49.180969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:49.181422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:49.234641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Getting quotas for project a99e9f6cca3147f4a1797bbf7186dafe. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:16:49.245881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Getting quotas for user 8844887e3d0947968a4cf6997a9e171c and project a99e9f6cca3147f4a1797bbf7186dafe. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:16:49.286632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:16:49.288075 n-d-852084-5 devstack@n-api.service[122488]: WARNING nova.utils [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-355835762-access_point-470312018 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-355835762-acc Aug 27 03:16:49.289023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:16:49.408099 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-587b0052-7ed8-49e3-b3c9-476c403a23f3 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.458752 Aug 27 03:16:49.422526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-edf8c798-1a09-41a5-a5c1-625b4bd517e1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:49.423963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-edf8c798-1a09-41a5-a5c1-625b4bd517e1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:49.429703 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3163/6146] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:16:47 2022] POST /compute/v2.1/servers => generated 457 bytes in 1481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:16:49.676647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-edf8c798-1a09-41a5-a5c1-625b4bd517e1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:49.706548 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-edf8c798-1a09-41a5-a5c1-625b4bd517e1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1293 microversion: 2.1 time: 0.286879 Aug 27 03:16:49.708292 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2984/6147] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:49 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1293 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:50.740517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-101ac7f1-0961-4229-8196-6d077c09bc86 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:50.751660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-101ac7f1-0961-4229-8196-6d077c09bc86 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:50.785602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101ac7f1-0961-4229-8196-6d077c09bc86 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:50.792024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101ac7f1-0961-4229-8196-6d077c09bc86 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:50.792519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101ac7f1-0961-4229-8196-6d077c09bc86 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:50.798356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101ac7f1-0961-4229-8196-6d077c09bc86 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:50.799540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101ac7f1-0961-4229-8196-6d077c09bc86 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:50.811909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-101ac7f1-0961-4229-8196-6d077c09bc86 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:50.848673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:50.856129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:50.887779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:50.889271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:50.892251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:50.896072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:50.896945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:50.901869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:51.062995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:16:51.074403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:16:51.075350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:16:51.076079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:16:51.078604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:16:51.276371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:51.309693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:51.310717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:51.312333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:51.314176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:51.317214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:51.337625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:51.393298 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-38dd021e-c61e-4f55-a420-56c870b4493d tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d/action" status: 202 len: 1135 microversion: 2.1 time: 0.548664 Aug 27 03:16:51.394836 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2985/6148] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:16:50 2022] POST /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d/action => generated 1135 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 27 03:16:51.416707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b11a8b8a-0646-46b6-8dea-911595148ed5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:51.419169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b11a8b8a-0646-46b6-8dea-911595148ed5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:51.448068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b11a8b8a-0646-46b6-8dea-911595148ed5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:51.449288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b11a8b8a-0646-46b6-8dea-911595148ed5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:51.457785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b11a8b8a-0646-46b6-8dea-911595148ed5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:51.459431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b11a8b8a-0646-46b6-8dea-911595148ed5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:51.460761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b11a8b8a-0646-46b6-8dea-911595148ed5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:51.461507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b11a8b8a-0646-46b6-8dea-911595148ed5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:51.681053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-101ac7f1-0961-4229-8196-6d077c09bc86 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:51.708825 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-101ac7f1-0961-4229-8196-6d077c09bc86 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1289 microversion: 2.1 time: 0.976535 Aug 27 03:16:51.724785 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3164/6149] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:50 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1289 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:52.043265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b11a8b8a-0646-46b6-8dea-911595148ed5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:52.063293 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b11a8b8a-0646-46b6-8dea-911595148ed5 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1688 microversion: 2.1 time: 0.653228 Aug 27 03:16:52.066766 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2986/6150] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:51 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1688 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:52.796293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c7fe39c-3912-4e97-9ffd-1083a2cf30ca tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:52.798647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9c7fe39c-3912-4e97-9ffd-1083a2cf30ca tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:52.818870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c7fe39c-3912-4e97-9ffd-1083a2cf30ca tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:52.820840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c7fe39c-3912-4e97-9ffd-1083a2cf30ca tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:52.823556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c7fe39c-3912-4e97-9ffd-1083a2cf30ca tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:52.826494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c7fe39c-3912-4e97-9ffd-1083a2cf30ca tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:52.828464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c7fe39c-3912-4e97-9ffd-1083a2cf30ca tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:52.829640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c7fe39c-3912-4e97-9ffd-1083a2cf30ca tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:53.009387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9c7fe39c-3912-4e97-9ffd-1083a2cf30ca tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:53.057208 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9c7fe39c-3912-4e97-9ffd-1083a2cf30ca tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1351 microversion: 2.1 time: 0.275311 Aug 27 03:16:53.061382 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3165/6151] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:52 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1351 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:53.093483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7548259-f042-4a5a-a658-35d5d41678e9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:53.099591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c7548259-f042-4a5a-a658-35d5d41678e9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:53.124853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7548259-f042-4a5a-a658-35d5d41678e9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:53.127393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7548259-f042-4a5a-a658-35d5d41678e9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:53.128751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7548259-f042-4a5a-a658-35d5d41678e9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:53.131109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7548259-f042-4a5a-a658-35d5d41678e9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:53.132377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7548259-f042-4a5a-a658-35d5d41678e9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:53.133629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7548259-f042-4a5a-a658-35d5d41678e9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:53.498103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c7548259-f042-4a5a-a658-35d5d41678e9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:53.509584 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c7548259-f042-4a5a-a658-35d5d41678e9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1688 microversion: 2.1 time: 0.427036 Aug 27 03:16:53.530277 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2987/6152] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:53 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1688 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:54.086408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ef3cdcad-0dd0-44e5-aa49-5013af4792e5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:54.088029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ef3cdcad-0dd0-44e5-aa49-5013af4792e5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:54.106871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef3cdcad-0dd0-44e5-aa49-5013af4792e5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:54.107936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef3cdcad-0dd0-44e5-aa49-5013af4792e5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:54.108773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef3cdcad-0dd0-44e5-aa49-5013af4792e5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:54.109842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef3cdcad-0dd0-44e5-aa49-5013af4792e5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:54.110539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef3cdcad-0dd0-44e5-aa49-5013af4792e5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:54.111572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef3cdcad-0dd0-44e5-aa49-5013af4792e5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:54.542680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-722f488b-1bbb-45fb-9417-2ca1a1b1edf3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:54.544164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-722f488b-1bbb-45fb-9417-2ca1a1b1edf3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:54.552287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-722f488b-1bbb-45fb-9417-2ca1a1b1edf3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:54.553127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-722f488b-1bbb-45fb-9417-2ca1a1b1edf3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:54.554344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-722f488b-1bbb-45fb-9417-2ca1a1b1edf3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:54.555361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-722f488b-1bbb-45fb-9417-2ca1a1b1edf3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:54.556166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-722f488b-1bbb-45fb-9417-2ca1a1b1edf3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:54.556821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-722f488b-1bbb-45fb-9417-2ca1a1b1edf3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:54.618598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef3cdcad-0dd0-44e5-aa49-5013af4792e5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:54.628709 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ef3cdcad-0dd0-44e5-aa49-5013af4792e5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1470 microversion: 2.1 time: 0.552074 Aug 27 03:16:54.630494 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3166/6153] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:54 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1470 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:54.815328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-722f488b-1bbb-45fb-9417-2ca1a1b1edf3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:54.827371 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-722f488b-1bbb-45fb-9417-2ca1a1b1edf3 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1688 microversion: 2.1 time: 0.288510 Aug 27 03:16:54.828807 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2988/6154] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:54 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1688 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:55.411037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d5e18419-0662-45ee-8848-bb61566b7913 req-8e4a84f9-05a1-4883-af1b-043ebe729030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b0c957-056f-43a4-b83f-fff9fcc2668a", "tag": "8d857810-d02d-43be-963b-c2c54d711838"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:55.439087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d5e18419-0662-45ee-8848-bb61566b7913 req-8e4a84f9-05a1-4883-af1b-043ebe729030 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:55.439846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d5e18419-0662-45ee-8848-bb61566b7913 req-8e4a84f9-05a1-4883-af1b-043ebe729030 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:55.441449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d5e18419-0662-45ee-8848-bb61566b7913 req-8e4a84f9-05a1-4883-af1b-043ebe729030 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:55.456100 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d5e18419-0662-45ee-8848-bb61566b7913 req-8e4a84f9-05a1-4883-af1b-043ebe729030 service nova] Creating event network-changed:8d857810-d02d-43be-963b-c2c54d711838 for instance b4b0c957-056f-43a4-b83f-fff9fcc2668a on n-h1-852084-5 Aug 27 03:16:55.462961 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d5e18419-0662-45ee-8848-bb61566b7913 req-8e4a84f9-05a1-4883-af1b-043ebe729030 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065695 Aug 27 03:16:55.467116 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3167/6155] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:16:55.545444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1557606600", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "081bcca7-8198-4a9d-8534-e8c28e871ad5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9f6cd27d-8b3c-456e-af66-44212888909f"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:16:55.626944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] validate_networks() for [('9f6cd27d-8b3c-456e-af66-44212888909f', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:16:55.655599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-87827dcd-bbea-4e93-b447-7d548deb28e6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:55.656825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-87827dcd-bbea-4e93-b447-7d548deb28e6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:55.665063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87827dcd-bbea-4e93-b447-7d548deb28e6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:55.665902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87827dcd-bbea-4e93-b447-7d548deb28e6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:55.666432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87827dcd-bbea-4e93-b447-7d548deb28e6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:55.667246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87827dcd-bbea-4e93-b447-7d548deb28e6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:55.667789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87827dcd-bbea-4e93-b447-7d548deb28e6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:55.668308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87827dcd-bbea-4e93-b447-7d548deb28e6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:55.960859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-87827dcd-bbea-4e93-b447-7d548deb28e6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:56.004157 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-87827dcd-bbea-4e93-b447-7d548deb28e6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1470 microversion: 2.1 time: 0.338608 Aug 27 03:16:56.006702 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3168/6156] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:55 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1470 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:56.026431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-12fa488a-3df7-482c-9d06-55e955e1590e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:56.027541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-12fa488a-3df7-482c-9d06-55e955e1590e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:56.077533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12fa488a-3df7-482c-9d06-55e955e1590e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:56.079147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12fa488a-3df7-482c-9d06-55e955e1590e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:56.080851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12fa488a-3df7-482c-9d06-55e955e1590e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:56.082800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12fa488a-3df7-482c-9d06-55e955e1590e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:56.084356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12fa488a-3df7-482c-9d06-55e955e1590e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:56.086993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12fa488a-3df7-482c-9d06-55e955e1590e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:56.460803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-12fa488a-3df7-482c-9d06-55e955e1590e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:56.477284 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-12fa488a-3df7-482c-9d06-55e955e1590e tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1688 microversion: 2.1 time: 0.468315 Aug 27 03:16:56.478232 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3169/6157] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:56 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1688 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:56.808995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:16:56.810539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:16:56.811790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:16:56.812521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:16:56.813988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:16:56.821638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=42 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:56.837099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:56.838311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:56.840108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:56.842542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:56.843425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:56.844533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:56.860964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:56.895232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:16:56.903861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for user 0a78655bea27452faee67a7efd476175 and project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:16:57.031686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-19fba1ee-0262-4131-87d9-be7da22862d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:57.032827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-19fba1ee-0262-4131-87d9-be7da22862d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:57.054639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:16:57.058688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='081bcca7-8198-4a9d-8534-e8c28e871ad5',volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:16:57.070957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19fba1ee-0262-4131-87d9-be7da22862d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:57.072535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19fba1ee-0262-4131-87d9-be7da22862d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:57.073829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19fba1ee-0262-4131-87d9-be7da22862d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:57.075796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19fba1ee-0262-4131-87d9-be7da22862d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:57.078752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19fba1ee-0262-4131-87d9-be7da22862d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:57.079770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-19fba1ee-0262-4131-87d9-be7da22862d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:57.091650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:57.331032 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-89f1b0cd-aa7e-4600-978f-535c5b867d9b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.789134 Aug 27 03:16:57.343926 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2989/6158] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:16:57.357100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d8875b61-5292-4875-b885-3703a92332e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:57.359549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d8875b61-5292-4875-b885-3703a92332e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:57.483070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d8875b61-5292-4875-b885-3703a92332e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:57.494728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-19fba1ee-0262-4131-87d9-be7da22862d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:57.521238 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d8875b61-5292-4875-b885-3703a92332e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1057 microversion: 2.1 time: 0.174978 Aug 27 03:16:57.522353 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2990/6159] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:57 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1057 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:57.554878 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-19fba1ee-0262-4131-87d9-be7da22862d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1470 microversion: 2.1 time: 0.526245 Aug 27 03:16:57.562194 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3170/6160] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:57 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1470 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:57.564901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aaa7667a-cf97-46c1-bec9-fdf5151d27aa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:57.566366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aaa7667a-cf97-46c1-bec9-fdf5151d27aa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:57.592764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaa7667a-cf97-46c1-bec9-fdf5151d27aa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:57.593593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaa7667a-cf97-46c1-bec9-fdf5151d27aa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:57.594420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaa7667a-cf97-46c1-bec9-fdf5151d27aa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:57.595711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaa7667a-cf97-46c1-bec9-fdf5151d27aa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:57.596524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaa7667a-cf97-46c1-bec9-fdf5151d27aa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:57.597252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aaa7667a-cf97-46c1-bec9-fdf5151d27aa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:58.143639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-aaa7667a-cf97-46c1-bec9-fdf5151d27aa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:58.156890 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aaa7667a-cf97-46c1-bec9-fdf5151d27aa tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1688 microversion: 2.1 time: 0.600224 Aug 27 03:16:58.158290 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2991/6161] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:57 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1688 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:58.568418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-00eda516-d4de-4a1e-9885-02964426fa3a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:58.569109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-00eda516-d4de-4a1e-9885-02964426fa3a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:58.580048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-549d90c2-0d9c-4984-84a8-94e951eaa369 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:58.581316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-549d90c2-0d9c-4984-84a8-94e951eaa369 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:58.581476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:58.588959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00eda516-d4de-4a1e-9885-02964426fa3a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:58.589464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00eda516-d4de-4a1e-9885-02964426fa3a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:58.589937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00eda516-d4de-4a1e-9885-02964426fa3a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:58.592747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-549d90c2-0d9c-4984-84a8-94e951eaa369 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:58.593045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00eda516-d4de-4a1e-9885-02964426fa3a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:58.593772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00eda516-d4de-4a1e-9885-02964426fa3a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:58.593941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-549d90c2-0d9c-4984-84a8-94e951eaa369 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:58.594528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-549d90c2-0d9c-4984-84a8-94e951eaa369 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:58.595166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-00eda516-d4de-4a1e-9885-02964426fa3a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:58.595583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-549d90c2-0d9c-4984-84a8-94e951eaa369 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:58.596112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-549d90c2-0d9c-4984-84a8-94e951eaa369 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:58.596956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-549d90c2-0d9c-4984-84a8-94e951eaa369 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:58.706508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-00eda516-d4de-4a1e-9885-02964426fa3a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:58.720373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-00eda516-d4de-4a1e-9885-02964426fa3a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1099 microversion: 2.1 time: 0.163513 Aug 27 03:16:58.724220 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3171/6162] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:58 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1099 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:16:58.865776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-549d90c2-0d9c-4984-84a8-94e951eaa369 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:58.874999 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-549d90c2-0d9c-4984-84a8-94e951eaa369 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1470 microversion: 2.1 time: 0.298855 Aug 27 03:16:58.875887 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2992/6163] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:58 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:59.183012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d339b0bd-e3fd-453c-9431-b011156fc24a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:59.183651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d339b0bd-e3fd-453c-9431-b011156fc24a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:59.190494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d339b0bd-e3fd-453c-9431-b011156fc24a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:59.190993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d339b0bd-e3fd-453c-9431-b011156fc24a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:59.191445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d339b0bd-e3fd-453c-9431-b011156fc24a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:59.192197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d339b0bd-e3fd-453c-9431-b011156fc24a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:59.192856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d339b0bd-e3fd-453c-9431-b011156fc24a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:59.193293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d339b0bd-e3fd-453c-9431-b011156fc24a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:59.211823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:59.269890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:16:59.397480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d339b0bd-e3fd-453c-9431-b011156fc24a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:16:59.427421 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d339b0bd-e3fd-453c-9431-b011156fc24a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1688 microversion: 2.1 time: 0.249242 Aug 27 03:16:59.428469 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3172/6164] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:59 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1688 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:16:59.747060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b5d5cf3-3603-4b3b-aeb0-27e0ec82fc01 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:59.747702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0b5d5cf3-3603-4b3b-aeb0-27e0ec82fc01 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:59.769926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b5d5cf3-3603-4b3b-aeb0-27e0ec82fc01 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:59.770450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b5d5cf3-3603-4b3b-aeb0-27e0ec82fc01 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:59.770956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b5d5cf3-3603-4b3b-aeb0-27e0ec82fc01 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:59.771717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b5d5cf3-3603-4b3b-aeb0-27e0ec82fc01 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:59.772217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b5d5cf3-3603-4b3b-aeb0-27e0ec82fc01 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:59.781609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b5d5cf3-3603-4b3b-aeb0-27e0ec82fc01 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:59.896625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-24557a39-463a-4eeb-8b97-7f52715cf7f7 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:16:59.899544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-24557a39-463a-4eeb-8b97-7f52715cf7f7 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:16:59.932680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24557a39-463a-4eeb-8b97-7f52715cf7f7 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:59.934017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24557a39-463a-4eeb-8b97-7f52715cf7f7 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:59.934626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24557a39-463a-4eeb-8b97-7f52715cf7f7 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:16:59.935500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24557a39-463a-4eeb-8b97-7f52715cf7f7 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:16:59.941534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24557a39-463a-4eeb-8b97-7f52715cf7f7 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:16:59.942520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-24557a39-463a-4eeb-8b97-7f52715cf7f7 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:00.016030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0b5d5cf3-3603-4b3b-aeb0-27e0ec82fc01 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:00.026996 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0b5d5cf3-3603-4b3b-aeb0-27e0ec82fc01 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1173 microversion: 2.1 time: 0.285500 Aug 27 03:17:00.027976 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2993/6165] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:59 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1173 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:00.257350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-24557a39-463a-4eeb-8b97-7f52715cf7f7 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:00.267090 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-24557a39-463a-4eeb-8b97-7f52715cf7f7 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1470 microversion: 2.1 time: 0.374447 Aug 27 03:17:00.268660 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3173/6166] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:16:59 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1470 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:00.458560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7984073f-a634-44d4-a2af-2849c7534912 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:00.460188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7984073f-a634-44d4-a2af-2849c7534912 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:00.471647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7984073f-a634-44d4-a2af-2849c7534912 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:00.472383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7984073f-a634-44d4-a2af-2849c7534912 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:00.473508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7984073f-a634-44d4-a2af-2849c7534912 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:00.478023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7984073f-a634-44d4-a2af-2849c7534912 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:00.478780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7984073f-a634-44d4-a2af-2849c7534912 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:00.479596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7984073f-a634-44d4-a2af-2849c7534912 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:00.824126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7984073f-a634-44d4-a2af-2849c7534912 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:00.837479 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7984073f-a634-44d4-a2af-2849c7534912 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1688 microversion: 2.1 time: 0.382196 Aug 27 03:17:00.838491 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2994/6167] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:00 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1688 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:01.051199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ede75396-f21f-406f-a862-49d41ff369d6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:01.052958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ede75396-f21f-406f-a862-49d41ff369d6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:01.063687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede75396-f21f-406f-a862-49d41ff369d6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:01.064599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede75396-f21f-406f-a862-49d41ff369d6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:01.065831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede75396-f21f-406f-a862-49d41ff369d6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:01.067523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede75396-f21f-406f-a862-49d41ff369d6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:01.068269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede75396-f21f-406f-a862-49d41ff369d6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:01.069794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ede75396-f21f-406f-a862-49d41ff369d6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:01.300711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ede75396-f21f-406f-a862-49d41ff369d6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:01.310114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05e0e4fd-5d54-4a0a-9622-12780a389f1a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:01.312227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-05e0e4fd-5d54-4a0a-9622-12780a389f1a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:01.351571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05e0e4fd-5d54-4a0a-9622-12780a389f1a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:01.353591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05e0e4fd-5d54-4a0a-9622-12780a389f1a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:01.354573 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ede75396-f21f-406f-a862-49d41ff369d6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1215 microversion: 2.1 time: 0.309806 Aug 27 03:17:01.355437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05e0e4fd-5d54-4a0a-9622-12780a389f1a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:01.356361 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3174/6168] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:01 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1215 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:01.357984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05e0e4fd-5d54-4a0a-9622-12780a389f1a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:01.358753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05e0e4fd-5d54-4a0a-9622-12780a389f1a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:01.359564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05e0e4fd-5d54-4a0a-9622-12780a389f1a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:01.652725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-689d39ce-16b8-4567-b8ef-1ce0b8ea8096 req-53d3708d-1110-4581-8891-e3be22a123dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b0c957-056f-43a4-b83f-fff9fcc2668a", "name": "network-vif-plugged", "status": "completed", "tag": "8d857810-d02d-43be-963b-c2c54d711838"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:01.662834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-689d39ce-16b8-4567-b8ef-1ce0b8ea8096 req-53d3708d-1110-4581-8891-e3be22a123dd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:01.667991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-689d39ce-16b8-4567-b8ef-1ce0b8ea8096 req-53d3708d-1110-4581-8891-e3be22a123dd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:01.668796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-689d39ce-16b8-4567-b8ef-1ce0b8ea8096 req-53d3708d-1110-4581-8891-e3be22a123dd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:01.689067 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-689d39ce-16b8-4567-b8ef-1ce0b8ea8096 req-53d3708d-1110-4581-8891-e3be22a123dd service nova] Creating event network-vif-plugged:8d857810-d02d-43be-963b-c2c54d711838 for instance b4b0c957-056f-43a4-b83f-fff9fcc2668a on n-h1-852084-5 Aug 27 03:17:01.696238 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-689d39ce-16b8-4567-b8ef-1ce0b8ea8096 req-53d3708d-1110-4581-8891-e3be22a123dd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047559 Aug 27 03:17:01.698218 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3175/6169] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:17:01.735041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-05e0e4fd-5d54-4a0a-9622-12780a389f1a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:01.748338 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-05e0e4fd-5d54-4a0a-9622-12780a389f1a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1470 microversion: 2.1 time: 0.443517 Aug 27 03:17:01.750017 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2995/6170] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:01 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1470 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:01.863019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-033787a4-cab5-4c48-b8fa-18018769037a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:01.864387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-033787a4-cab5-4c48-b8fa-18018769037a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:01.875701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-454346f9-dd30-4c67-897e-63e995be6736 req-2615afa0-00b1-47a1-938f-1f8bec5667e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aecdc28-2817-4cb9-8dc0-8d0b9988271f", "tag": "ce716e73-edac-4fae-99f0-51de4f18f9a3"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:01.898988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033787a4-cab5-4c48-b8fa-18018769037a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:01.900592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033787a4-cab5-4c48-b8fa-18018769037a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:01.903015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033787a4-cab5-4c48-b8fa-18018769037a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:01.910390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-454346f9-dd30-4c67-897e-63e995be6736 req-2615afa0-00b1-47a1-938f-1f8bec5667e3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:01.911101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-454346f9-dd30-4c67-897e-63e995be6736 req-2615afa0-00b1-47a1-938f-1f8bec5667e3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:01.912142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-454346f9-dd30-4c67-897e-63e995be6736 req-2615afa0-00b1-47a1-938f-1f8bec5667e3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:01.913233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033787a4-cab5-4c48-b8fa-18018769037a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:01.913800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033787a4-cab5-4c48-b8fa-18018769037a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:01.914261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033787a4-cab5-4c48-b8fa-18018769037a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:01.933974 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-454346f9-dd30-4c67-897e-63e995be6736 req-2615afa0-00b1-47a1-938f-1f8bec5667e3 service nova] Creating event network-changed:ce716e73-edac-4fae-99f0-51de4f18f9a3 for instance 4aecdc28-2817-4cb9-8dc0-8d0b9988271f on n-h1-852084-5 Aug 27 03:17:01.946599 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-454346f9-dd30-4c67-897e-63e995be6736 req-2615afa0-00b1-47a1-938f-1f8bec5667e3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078932 Aug 27 03:17:01.947210 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2996/6171] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:02.120150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-033787a4-cab5-4c48-b8fa-18018769037a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:02.130910 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-033787a4-cab5-4c48-b8fa-18018769037a tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1688 microversion: 2.1 time: 0.272816 Aug 27 03:17:02.132919 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3176/6172] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:01 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1688 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:02.382951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b38d28b-4851-4a1c-a02e-0a186a1c6978 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:02.384672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b38d28b-4851-4a1c-a02e-0a186a1c6978 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:02.394615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b38d28b-4851-4a1c-a02e-0a186a1c6978 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:02.395519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b38d28b-4851-4a1c-a02e-0a186a1c6978 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:02.396275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b38d28b-4851-4a1c-a02e-0a186a1c6978 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:02.397278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b38d28b-4851-4a1c-a02e-0a186a1c6978 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:02.398138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b38d28b-4851-4a1c-a02e-0a186a1c6978 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:02.399127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b38d28b-4851-4a1c-a02e-0a186a1c6978 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:02.774763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3163061d-8170-4620-8798-65efb1f83158 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:02.775976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3163061d-8170-4620-8798-65efb1f83158 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:02.788376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3163061d-8170-4620-8798-65efb1f83158 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:02.788892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3163061d-8170-4620-8798-65efb1f83158 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:02.790011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3163061d-8170-4620-8798-65efb1f83158 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:02.791171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3163061d-8170-4620-8798-65efb1f83158 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:02.791815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3163061d-8170-4620-8798-65efb1f83158 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:02.792415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3163061d-8170-4620-8798-65efb1f83158 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:03.029838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b38d28b-4851-4a1c-a02e-0a186a1c6978 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:03.043107 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b38d28b-4851-4a1c-a02e-0a186a1c6978 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1215 microversion: 2.1 time: 0.665843 Aug 27 03:17:03.046314 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2997/6173] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:02 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1215 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:03.061983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3163061d-8170-4620-8798-65efb1f83158 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:03.078582 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3163061d-8170-4620-8798-65efb1f83158 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1470 microversion: 2.1 time: 0.309699 Aug 27 03:17:03.082977 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3177/6174] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:02 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1470 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:03.156002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e65a5482-8999-41ce-99c9-735407e5349c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:03.156628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e65a5482-8999-41ce-99c9-735407e5349c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:03.164103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e65a5482-8999-41ce-99c9-735407e5349c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:03.164922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e65a5482-8999-41ce-99c9-735407e5349c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:03.165369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e65a5482-8999-41ce-99c9-735407e5349c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:03.166144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e65a5482-8999-41ce-99c9-735407e5349c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:03.166603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e65a5482-8999-41ce-99c9-735407e5349c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:03.167033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e65a5482-8999-41ce-99c9-735407e5349c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:03.437013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e65a5482-8999-41ce-99c9-735407e5349c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:03.448757 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e65a5482-8999-41ce-99c9-735407e5349c tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1688 microversion: 2.1 time: 0.296883 Aug 27 03:17:03.465103 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2998/6175] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:03 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1688 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:04.069762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-36916316-5085-404c-99c3-64e304742f3e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:04.071221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-36916316-5085-404c-99c3-64e304742f3e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:04.078506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36916316-5085-404c-99c3-64e304742f3e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.079241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36916316-5085-404c-99c3-64e304742f3e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.079690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36916316-5085-404c-99c3-64e304742f3e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.080410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36916316-5085-404c-99c3-64e304742f3e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.080874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36916316-5085-404c-99c3-64e304742f3e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.081310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-36916316-5085-404c-99c3-64e304742f3e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.100752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b4e9aad-0e8e-45ba-94df-35790321d6b6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:04.102644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b4e9aad-0e8e-45ba-94df-35790321d6b6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:04.112651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b4e9aad-0e8e-45ba-94df-35790321d6b6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.113509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b4e9aad-0e8e-45ba-94df-35790321d6b6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.119739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b4e9aad-0e8e-45ba-94df-35790321d6b6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.120501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b4e9aad-0e8e-45ba-94df-35790321d6b6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.121119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b4e9aad-0e8e-45ba-94df-35790321d6b6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.121559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b4e9aad-0e8e-45ba-94df-35790321d6b6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.271563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-36916316-5085-404c-99c3-64e304742f3e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:04.281024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5b4e9aad-0e8e-45ba-94df-35790321d6b6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:04.282094 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-36916316-5085-404c-99c3-64e304742f3e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1215 microversion: 2.1 time: 0.216803 Aug 27 03:17:04.283570 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3178/6176] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:04 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:04.291146 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5b4e9aad-0e8e-45ba-94df-35790321d6b6 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1642 microversion: 2.1 time: 0.195170 Aug 27 03:17:04.292389 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 2999/6177] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:04 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1642 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:04.315849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1a89cfcd-5edf-461b-bd92-c3414d8be307 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:04.316541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1a89cfcd-5edf-461b-bd92-c3414d8be307 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:04.324124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a89cfcd-5edf-461b-bd92-c3414d8be307 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.324550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a89cfcd-5edf-461b-bd92-c3414d8be307 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.325006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a89cfcd-5edf-461b-bd92-c3414d8be307 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.325818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a89cfcd-5edf-461b-bd92-c3414d8be307 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.326442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a89cfcd-5edf-461b-bd92-c3414d8be307 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.326880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a89cfcd-5edf-461b-bd92-c3414d8be307 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.472151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48da3fd4-d3ff-4f7e-8924-28ec8f82b4ad tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:04.473050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-48da3fd4-d3ff-4f7e-8924-28ec8f82b4ad tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:04.479535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48da3fd4-d3ff-4f7e-8924-28ec8f82b4ad tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.480271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48da3fd4-d3ff-4f7e-8924-28ec8f82b4ad tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.481067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48da3fd4-d3ff-4f7e-8924-28ec8f82b4ad tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.481916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48da3fd4-d3ff-4f7e-8924-28ec8f82b4ad tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.482388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48da3fd4-d3ff-4f7e-8924-28ec8f82b4ad tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.482845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48da3fd4-d3ff-4f7e-8924-28ec8f82b4ad tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.557787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1a89cfcd-5edf-461b-bd92-c3414d8be307 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:04.573441 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1a89cfcd-5edf-461b-bd92-c3414d8be307 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1642 microversion: 2.1 time: 0.257849 Aug 27 03:17:04.574100 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3179/6178] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:04 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1642 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:04.593545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-06318123-17a1-45fc-b537-6889c9eb412a tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:04.594214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-06318123-17a1-45fc-b537-6889c9eb412a tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:04.600986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06318123-17a1-45fc-b537-6889c9eb412a tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.601492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06318123-17a1-45fc-b537-6889c9eb412a tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.601972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06318123-17a1-45fc-b537-6889c9eb412a tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.602688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06318123-17a1-45fc-b537-6889c9eb412a tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:04.603353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06318123-17a1-45fc-b537-6889c9eb412a tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:04.603968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06318123-17a1-45fc-b537-6889c9eb412a tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:04.752520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-48da3fd4-d3ff-4f7e-8924-28ec8f82b4ad tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:04.764784 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-48da3fd4-d3ff-4f7e-8924-28ec8f82b4ad tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1694 microversion: 2.1 time: 0.296660 Aug 27 03:17:04.765393 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3000/6179] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:04 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1694 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:04.911452 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-06318123-17a1-45fc-b537-6889c9eb412a tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1793 microversion: 2.1 time: 0.321572 Aug 27 03:17:04.947192 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3180/6180] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:04 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1793 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:05.305249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2b1aaa75-66af-40a3-a8a8-8c041287842b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:05.306712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2b1aaa75-66af-40a3-a8a8-8c041287842b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:05.317756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b1aaa75-66af-40a3-a8a8-8c041287842b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:05.318830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b1aaa75-66af-40a3-a8a8-8c041287842b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:05.320089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b1aaa75-66af-40a3-a8a8-8c041287842b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:05.321198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b1aaa75-66af-40a3-a8a8-8c041287842b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:05.322269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b1aaa75-66af-40a3-a8a8-8c041287842b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:05.323071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b1aaa75-66af-40a3-a8a8-8c041287842b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:05.550154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2b1aaa75-66af-40a3-a8a8-8c041287842b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:05.562352 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2b1aaa75-66af-40a3-a8a8-8c041287842b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1215 microversion: 2.1 time: 0.261843 Aug 27 03:17:05.563512 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3001/6181] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:05 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1215 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:05.787959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0fffc555-ef4e-4afa-8afb-96997576b683 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:05.788646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0fffc555-ef4e-4afa-8afb-96997576b683 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:05.799085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fffc555-ef4e-4afa-8afb-96997576b683 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:05.799589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fffc555-ef4e-4afa-8afb-96997576b683 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:05.800180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fffc555-ef4e-4afa-8afb-96997576b683 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:05.801587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fffc555-ef4e-4afa-8afb-96997576b683 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:05.802080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fffc555-ef4e-4afa-8afb-96997576b683 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:05.802518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0fffc555-ef4e-4afa-8afb-96997576b683 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:05.965039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0fffc555-ef4e-4afa-8afb-96997576b683 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:05.973297 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0fffc555-ef4e-4afa-8afb-96997576b683 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1679 microversion: 2.1 time: 0.190175 Aug 27 03:17:05.977747 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3181/6182] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:05 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:06.584245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e93d3497-5573-4150-82e8-a99cdd656251 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:06.585011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e93d3497-5573-4150-82e8-a99cdd656251 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:06.592033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e93d3497-5573-4150-82e8-a99cdd656251 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:06.592624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e93d3497-5573-4150-82e8-a99cdd656251 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:06.593032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e93d3497-5573-4150-82e8-a99cdd656251 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:06.593838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e93d3497-5573-4150-82e8-a99cdd656251 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:06.594422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e93d3497-5573-4150-82e8-a99cdd656251 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:06.594881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e93d3497-5573-4150-82e8-a99cdd656251 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:06.851685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e93d3497-5573-4150-82e8-a99cdd656251 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:06.859511 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e93d3497-5573-4150-82e8-a99cdd656251 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1203 microversion: 2.1 time: 0.279757 Aug 27 03:17:06.860313 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3002/6183] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:06 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1203 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:07.089379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-00a7372f-d69b-48a7-be6e-8a5e5f0ad5ba req-f5373a8b-e192-434f-acd5-c7a41cf00505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b0c957-056f-43a4-b83f-fff9fcc2668a", "tag": "8d857810-d02d-43be-963b-c2c54d711838"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:07.103184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-00a7372f-d69b-48a7-be6e-8a5e5f0ad5ba req-f5373a8b-e192-434f-acd5-c7a41cf00505 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:07.104138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-00a7372f-d69b-48a7-be6e-8a5e5f0ad5ba req-f5373a8b-e192-434f-acd5-c7a41cf00505 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:07.104959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-00a7372f-d69b-48a7-be6e-8a5e5f0ad5ba req-f5373a8b-e192-434f-acd5-c7a41cf00505 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:07.118747 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-00a7372f-d69b-48a7-be6e-8a5e5f0ad5ba req-f5373a8b-e192-434f-acd5-c7a41cf00505 service nova] Creating event network-changed:8d857810-d02d-43be-963b-c2c54d711838 for instance b4b0c957-056f-43a4-b83f-fff9fcc2668a on n-h1-852084-5 Aug 27 03:17:07.123776 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-00a7372f-d69b-48a7-be6e-8a5e5f0ad5ba req-f5373a8b-e192-434f-acd5-c7a41cf00505 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038354 Aug 27 03:17:07.124597 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3182/6184] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:07.776878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2d74a349-840f-43e4-be32-6296634fbf97 req-8c92b8ad-b7e9-4a20-8811-46a440757731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f83ba1-2a61-4be3-a520-655e69ae8d2d", "name": "network-vif-unplugged", "status": "completed", "tag": "07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:07.787061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:07.794059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:07.801543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d74a349-840f-43e4-be32-6296634fbf97 req-8c92b8ad-b7e9-4a20-8811-46a440757731 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:07.809345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d74a349-840f-43e4-be32-6296634fbf97 req-8c92b8ad-b7e9-4a20-8811-46a440757731 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:07.809840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2d74a349-840f-43e4-be32-6296634fbf97 req-8c92b8ad-b7e9-4a20-8811-46a440757731 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:07.844210 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2d74a349-840f-43e4-be32-6296634fbf97 req-8c92b8ad-b7e9-4a20-8811-46a440757731 service nova] Creating event network-vif-unplugged:07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0 for instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d on n-h2-852084-5 Aug 27 03:17:07.849836 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2d74a349-840f-43e4-be32-6296634fbf97 req-8c92b8ad-b7e9-4a20-8811-46a440757731 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079745 Aug 27 03:17:07.850813 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3003/6185] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:17:07.881906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ac75bb47-0bcf-4aa0-bbba-54be1ef16fc5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:07.882939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ac75bb47-0bcf-4aa0-bbba-54be1ef16fc5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:07.889912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac75bb47-0bcf-4aa0-bbba-54be1ef16fc5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:07.890702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac75bb47-0bcf-4aa0-bbba-54be1ef16fc5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:07.891320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac75bb47-0bcf-4aa0-bbba-54be1ef16fc5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:07.892458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac75bb47-0bcf-4aa0-bbba-54be1ef16fc5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:07.893080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac75bb47-0bcf-4aa0-bbba-54be1ef16fc5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:07.893694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac75bb47-0bcf-4aa0-bbba-54be1ef16fc5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:08.063071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ac75bb47-0bcf-4aa0-bbba-54be1ef16fc5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:08.073366 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ac75bb47-0bcf-4aa0-bbba-54be1ef16fc5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1203 microversion: 2.1 time: 0.196498 Aug 27 03:17:08.074508 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3183/6186] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:07 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1203 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:09.102241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05cc930f-65a9-461b-958e-636160d792b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:09.102924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-05cc930f-65a9-461b-958e-636160d792b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:09.109890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05cc930f-65a9-461b-958e-636160d792b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:09.110533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05cc930f-65a9-461b-958e-636160d792b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:09.110990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05cc930f-65a9-461b-958e-636160d792b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:09.111710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05cc930f-65a9-461b-958e-636160d792b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:09.112176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05cc930f-65a9-461b-958e-636160d792b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:09.112928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05cc930f-65a9-461b-958e-636160d792b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:09.264496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-05cc930f-65a9-461b-958e-636160d792b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:09.272543 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-05cc930f-65a9-461b-958e-636160d792b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1203 microversion: 2.1 time: 0.176102 Aug 27 03:17:09.273126 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3004/6187] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:09 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:09.877115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-41cb6a54-e207-43a6-bec6-e38056617606 req-629a5809-6e08-4a66-abc1-55f19b75e35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f83ba1-2a61-4be3-a520-655e69ae8d2d", "name": "network-vif-plugged", "status": "completed", "tag": "07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:09.890093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-41cb6a54-e207-43a6-bec6-e38056617606 req-629a5809-6e08-4a66-abc1-55f19b75e35c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:09.890598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-41cb6a54-e207-43a6-bec6-e38056617606 req-629a5809-6e08-4a66-abc1-55f19b75e35c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:09.891026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-41cb6a54-e207-43a6-bec6-e38056617606 req-629a5809-6e08-4a66-abc1-55f19b75e35c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:09.905516 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-41cb6a54-e207-43a6-bec6-e38056617606 req-629a5809-6e08-4a66-abc1-55f19b75e35c service nova] Creating event network-vif-plugged:07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0 for instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d on n-h2-852084-5 Aug 27 03:17:09.921495 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-41cb6a54-e207-43a6-bec6-e38056617606 req-629a5809-6e08-4a66-abc1-55f19b75e35c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048216 Aug 27 03:17:09.922166 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3184/6188] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:10.297468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-664b6811-026a-4cdf-a2b4-cfb1f8b194e6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:10.298904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-664b6811-026a-4cdf-a2b4-cfb1f8b194e6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:10.310073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-664b6811-026a-4cdf-a2b4-cfb1f8b194e6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:10.310562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-664b6811-026a-4cdf-a2b4-cfb1f8b194e6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:10.311309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-664b6811-026a-4cdf-a2b4-cfb1f8b194e6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:10.311941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-664b6811-026a-4cdf-a2b4-cfb1f8b194e6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:10.312400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-664b6811-026a-4cdf-a2b4-cfb1f8b194e6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:10.313643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-664b6811-026a-4cdf-a2b4-cfb1f8b194e6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:10.468334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-664b6811-026a-4cdf-a2b4-cfb1f8b194e6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:10.476978 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-664b6811-026a-4cdf-a2b4-cfb1f8b194e6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1203 microversion: 2.1 time: 0.184578 Aug 27 03:17:10.477569 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3005/6189] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:10 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1203 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:11.499566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e8820190-e90e-4beb-a90d-019405088b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:11.500188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e8820190-e90e-4beb-a90d-019405088b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:11.507584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8820190-e90e-4beb-a90d-019405088b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:11.508082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8820190-e90e-4beb-a90d-019405088b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:11.508720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8820190-e90e-4beb-a90d-019405088b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:11.509653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8820190-e90e-4beb-a90d-019405088b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:11.510196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8820190-e90e-4beb-a90d-019405088b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:11.510654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e8820190-e90e-4beb-a90d-019405088b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:11.835029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e8820190-e90e-4beb-a90d-019405088b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:11.844457 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e8820190-e90e-4beb-a90d-019405088b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1203 microversion: 2.1 time: 0.350198 Aug 27 03:17:11.845150 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3185/6190] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:11 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1203 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:12.864657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2361c5b3-ba06-4290-a672-80ca2abc8614 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:12.865292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2361c5b3-ba06-4290-a672-80ca2abc8614 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:12.872808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2361c5b3-ba06-4290-a672-80ca2abc8614 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:12.873292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2361c5b3-ba06-4290-a672-80ca2abc8614 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:12.873763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2361c5b3-ba06-4290-a672-80ca2abc8614 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:12.874477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2361c5b3-ba06-4290-a672-80ca2abc8614 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:12.874925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2361c5b3-ba06-4290-a672-80ca2abc8614 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:12.875348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2361c5b3-ba06-4290-a672-80ca2abc8614 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:13.009148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2361c5b3-ba06-4290-a672-80ca2abc8614 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:13.017445 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2361c5b3-ba06-4290-a672-80ca2abc8614 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1203 microversion: 2.1 time: 0.156726 Aug 27 03:17:13.018081 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3006/6191] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:12 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:14.039398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2731fe9-ebc6-462f-958c-a262e874601e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:14.040318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f2731fe9-ebc6-462f-958c-a262e874601e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:14.047802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2731fe9-ebc6-462f-958c-a262e874601e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:14.048416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2731fe9-ebc6-462f-958c-a262e874601e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:14.048936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2731fe9-ebc6-462f-958c-a262e874601e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:14.050497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2731fe9-ebc6-462f-958c-a262e874601e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:14.051061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2731fe9-ebc6-462f-958c-a262e874601e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:14.051585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2731fe9-ebc6-462f-958c-a262e874601e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:14.207899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f2731fe9-ebc6-462f-958c-a262e874601e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:14.216761 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f2731fe9-ebc6-462f-958c-a262e874601e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1203 microversion: 2.1 time: 0.182110 Aug 27 03:17:14.217416 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3186/6192] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:14 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1203 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:15.238634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9301e553-8fd3-42c4-aa3c-3ca4ef2886c8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:15.239895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9301e553-8fd3-42c4-aa3c-3ca4ef2886c8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:15.247224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9301e553-8fd3-42c4-aa3c-3ca4ef2886c8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:15.247809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9301e553-8fd3-42c4-aa3c-3ca4ef2886c8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:15.248303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9301e553-8fd3-42c4-aa3c-3ca4ef2886c8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:15.249206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9301e553-8fd3-42c4-aa3c-3ca4ef2886c8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:15.249869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9301e553-8fd3-42c4-aa3c-3ca4ef2886c8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:15.250472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9301e553-8fd3-42c4-aa3c-3ca4ef2886c8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:15.395119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9301e553-8fd3-42c4-aa3c-3ca4ef2886c8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:15.404150 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9301e553-8fd3-42c4-aa3c-3ca4ef2886c8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1203 microversion: 2.1 time: 0.169616 Aug 27 03:17:15.404733 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3007/6193] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:15 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:15.752874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b89a683d-9615-41d4-80d2-441c82105a01 req-fabf3502-c916-499a-a194-2651ed57d42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aecdc28-2817-4cb9-8dc0-8d0b9988271f", "name": "network-vif-plugged", "status": "completed", "tag": "ce716e73-edac-4fae-99f0-51de4f18f9a3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:15.765432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b89a683d-9615-41d4-80d2-441c82105a01 req-fabf3502-c916-499a-a194-2651ed57d42f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:15.766357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b89a683d-9615-41d4-80d2-441c82105a01 req-fabf3502-c916-499a-a194-2651ed57d42f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:15.767076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b89a683d-9615-41d4-80d2-441c82105a01 req-fabf3502-c916-499a-a194-2651ed57d42f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:15.786680 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b89a683d-9615-41d4-80d2-441c82105a01 req-fabf3502-c916-499a-a194-2651ed57d42f service nova] Creating event network-vif-plugged:ce716e73-edac-4fae-99f0-51de4f18f9a3 for instance 4aecdc28-2817-4cb9-8dc0-8d0b9988271f on n-h1-852084-5 Aug 27 03:17:15.791947 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b89a683d-9615-41d4-80d2-441c82105a01 req-fabf3502-c916-499a-a194-2651ed57d42f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043020 Aug 27 03:17:15.793146 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3187/6194] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:16.424835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-59133fe9-25bb-4c25-ae0e-bcf856ef84f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:16.425481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-59133fe9-25bb-4c25-ae0e-bcf856ef84f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:16.433261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59133fe9-25bb-4c25-ae0e-bcf856ef84f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:16.433770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59133fe9-25bb-4c25-ae0e-bcf856ef84f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:16.434551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59133fe9-25bb-4c25-ae0e-bcf856ef84f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:16.435261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59133fe9-25bb-4c25-ae0e-bcf856ef84f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:16.435927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59133fe9-25bb-4c25-ae0e-bcf856ef84f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:16.436692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59133fe9-25bb-4c25-ae0e-bcf856ef84f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:16.594400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-59133fe9-25bb-4c25-ae0e-bcf856ef84f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:16.598141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=100 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:16.604222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-59133fe9-25bb-4c25-ae0e-bcf856ef84f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1203 microversion: 2.1 time: 0.183345 Aug 27 03:17:16.604828 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3008/6195] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:16 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1203 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:17.626860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e7c31331-0339-4f1b-a7ac-2c46feea91ed tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:17.627573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e7c31331-0339-4f1b-a7ac-2c46feea91ed tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:17.636274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7c31331-0339-4f1b-a7ac-2c46feea91ed tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.637453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7c31331-0339-4f1b-a7ac-2c46feea91ed tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.637772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7c31331-0339-4f1b-a7ac-2c46feea91ed tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:17.638944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7c31331-0339-4f1b-a7ac-2c46feea91ed tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.639816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7c31331-0339-4f1b-a7ac-2c46feea91ed tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.640268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e7c31331-0339-4f1b-a7ac-2c46feea91ed tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:17.784382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e7c31331-0339-4f1b-a7ac-2c46feea91ed tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:17.793028 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e7c31331-0339-4f1b-a7ac-2c46feea91ed tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1391 microversion: 2.1 time: 0.170777 Aug 27 03:17:17.797703 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3188/6196] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:17 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:17.814045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-91671d40-9096-4097-b9aa-7278cda5bcc1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:17.814648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-91671d40-9096-4097-b9aa-7278cda5bcc1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:17.822793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91671d40-9096-4097-b9aa-7278cda5bcc1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.823364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91671d40-9096-4097-b9aa-7278cda5bcc1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.823822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91671d40-9096-4097-b9aa-7278cda5bcc1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:17.824532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91671d40-9096-4097-b9aa-7278cda5bcc1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:17.825385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91671d40-9096-4097-b9aa-7278cda5bcc1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:17.825853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-91671d40-9096-4097-b9aa-7278cda5bcc1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.017649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-91671d40-9096-4097-b9aa-7278cda5bcc1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:18.026479 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-91671d40-9096-4097-b9aa-7278cda5bcc1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1391 microversion: 2.1 time: 0.216609 Aug 27 03:17:18.027159 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3009/6197] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:17 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:18.046149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11fc16ed-cfe3-43bc-8053-de710a066156 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:18.046797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-11fc16ed-cfe3-43bc-8053-de710a066156 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:18.053715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11fc16ed-cfe3-43bc-8053-de710a066156 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:18.054020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11fc16ed-cfe3-43bc-8053-de710a066156 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:18.054468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11fc16ed-cfe3-43bc-8053-de710a066156 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.055153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11fc16ed-cfe3-43bc-8053-de710a066156 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:18.055606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11fc16ed-cfe3-43bc-8053-de710a066156 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:18.058023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11fc16ed-cfe3-43bc-8053-de710a066156 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.072826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:18.202029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-11fc16ed-cfe3-43bc-8053-de710a066156 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:18.211728 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11fc16ed-cfe3-43bc-8053-de710a066156 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1391 microversion: 2.1 time: 0.169390 Aug 27 03:17:18.212331 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3189/6198] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:18 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:18.233052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b2553d5-f121-46fd-8c3b-2ef3ef4b2211 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:18.234012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b2553d5-f121-46fd-8c3b-2ef3ef4b2211 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:18.240421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2553d5-f121-46fd-8c3b-2ef3ef4b2211 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:18.241557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2553d5-f121-46fd-8c3b-2ef3ef4b2211 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:18.242142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2553d5-f121-46fd-8c3b-2ef3ef4b2211 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.242842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2553d5-f121-46fd-8c3b-2ef3ef4b2211 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:18.243297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2553d5-f121-46fd-8c3b-2ef3ef4b2211 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:18.243727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b2553d5-f121-46fd-8c3b-2ef3ef4b2211 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.270721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b2553d5-f121-46fd-8c3b-2ef3ef4b2211 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:17:18.354297 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5b2553d5-f121-46fd-8c3b-2ef3ef4b2211 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 204 len: 0 microversion: 2.1 time: 0.124933 Aug 27 03:17:18.355199 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3010/6199] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:17:18 2022] DELETE /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:17:18.365366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-984f0b81-f760-45fb-a847-f34a69d51669 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:18.367478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-984f0b81-f760-45fb-a847-f34a69d51669 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:18.374785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-984f0b81-f760-45fb-a847-f34a69d51669 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:18.375489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-984f0b81-f760-45fb-a847-f34a69d51669 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:18.375955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-984f0b81-f760-45fb-a847-f34a69d51669 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.376682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-984f0b81-f760-45fb-a847-f34a69d51669 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:18.377142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-984f0b81-f760-45fb-a847-f34a69d51669 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:18.377575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-984f0b81-f760-45fb-a847-f34a69d51669 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:18.521641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-984f0b81-f760-45fb-a847-f34a69d51669 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:18.531544 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-984f0b81-f760-45fb-a847-f34a69d51669 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1397 microversion: 2.1 time: 0.171716 Aug 27 03:17:18.532025 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3190/6200] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:18 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1397 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:19.553603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-12c90f88-0b5b-4bd2-8e45-7340c357b2fe tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:19.554328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-12c90f88-0b5b-4bd2-8e45-7340c357b2fe tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:19.561265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12c90f88-0b5b-4bd2-8e45-7340c357b2fe tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:19.561798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12c90f88-0b5b-4bd2-8e45-7340c357b2fe tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:19.562227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12c90f88-0b5b-4bd2-8e45-7340c357b2fe tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:19.562927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12c90f88-0b5b-4bd2-8e45-7340c357b2fe tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:19.563385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12c90f88-0b5b-4bd2-8e45-7340c357b2fe tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:19.563812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-12c90f88-0b5b-4bd2-8e45-7340c357b2fe tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:19.711136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-12c90f88-0b5b-4bd2-8e45-7340c357b2fe tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:19.719601 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-12c90f88-0b5b-4bd2-8e45-7340c357b2fe tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1397 microversion: 2.1 time: 0.170700 Aug 27 03:17:19.720448 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3011/6201] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:19 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1397 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:20.741868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f4cf5234-1cad-4ab3-a06f-885d4bfd2fc6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:20.742677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f4cf5234-1cad-4ab3-a06f-885d4bfd2fc6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:20.750557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4cf5234-1cad-4ab3-a06f-885d4bfd2fc6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:20.751050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4cf5234-1cad-4ab3-a06f-885d4bfd2fc6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:20.751503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4cf5234-1cad-4ab3-a06f-885d4bfd2fc6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:20.752228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4cf5234-1cad-4ab3-a06f-885d4bfd2fc6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:20.752694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4cf5234-1cad-4ab3-a06f-885d4bfd2fc6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:20.753127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4cf5234-1cad-4ab3-a06f-885d4bfd2fc6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:20.825908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f4cf5234-1cad-4ab3-a06f-885d4bfd2fc6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:20.835596 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f4cf5234-1cad-4ab3-a06f-885d4bfd2fc6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1355 microversion: 2.1 time: 0.098068 Aug 27 03:17:20.836193 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3191/6202] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:20 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1355 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:20.907865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3102c434-578b-4ed5-9bd1-dc290c587312 req-7c489b63-ea47-4621-9dc8-b8605a8e7b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aecdc28-2817-4cb9-8dc0-8d0b9988271f", "name": "network-vif-deleted", "tag": "ce716e73-edac-4fae-99f0-51de4f18f9a3"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:20.922623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3102c434-578b-4ed5-9bd1-dc290c587312 req-7c489b63-ea47-4621-9dc8-b8605a8e7b05 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:20.923364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3102c434-578b-4ed5-9bd1-dc290c587312 req-7c489b63-ea47-4621-9dc8-b8605a8e7b05 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:20.924040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3102c434-578b-4ed5-9bd1-dc290c587312 req-7c489b63-ea47-4621-9dc8-b8605a8e7b05 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:20.943156 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3102c434-578b-4ed5-9bd1-dc290c587312 req-7c489b63-ea47-4621-9dc8-b8605a8e7b05 service nova] Creating event network-vif-deleted:ce716e73-edac-4fae-99f0-51de4f18f9a3 for instance 4aecdc28-2817-4cb9-8dc0-8d0b9988271f on n-h1-852084-5 Aug 27 03:17:20.950088 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3102c434-578b-4ed5-9bd1-dc290c587312 req-7c489b63-ea47-4621-9dc8-b8605a8e7b05 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046153 Aug 27 03:17:20.950716 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3012/6203] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:21.858164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b641d596-23c1-44c1-95c0-9fdea1d9876f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:21.859573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b641d596-23c1-44c1-95c0-9fdea1d9876f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:21.868448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b641d596-23c1-44c1-95c0-9fdea1d9876f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:21.869359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b641d596-23c1-44c1-95c0-9fdea1d9876f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:21.871126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b641d596-23c1-44c1-95c0-9fdea1d9876f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:21.872229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b641d596-23c1-44c1-95c0-9fdea1d9876f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:21.872701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b641d596-23c1-44c1-95c0-9fdea1d9876f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:21.873497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b641d596-23c1-44c1-95c0-9fdea1d9876f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:21.943737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b641d596-23c1-44c1-95c0-9fdea1d9876f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:21.952201 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b641d596-23c1-44c1-95c0-9fdea1d9876f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1188 microversion: 2.1 time: 0.098142 Aug 27 03:17:21.965967 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3192/6204] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:21 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1188 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:22.974311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4ae7811a-8863-438d-82d2-d57987ff9e81 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:22.976626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4ae7811a-8863-438d-82d2-d57987ff9e81 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:22.983287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ae7811a-8863-438d-82d2-d57987ff9e81 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:22.983721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ae7811a-8863-438d-82d2-d57987ff9e81 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:22.984417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ae7811a-8863-438d-82d2-d57987ff9e81 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:22.985310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ae7811a-8863-438d-82d2-d57987ff9e81 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:22.985796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ae7811a-8863-438d-82d2-d57987ff9e81 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:22.986232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ae7811a-8863-438d-82d2-d57987ff9e81 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:23.053740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4ae7811a-8863-438d-82d2-d57987ff9e81 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:23.062544 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4ae7811a-8863-438d-82d2-d57987ff9e81 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1188 microversion: 2.1 time: 0.093753 Aug 27 03:17:23.063978 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3013/6205] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:22 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:24.085828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-09c6ddfb-a1dc-48ab-a5ed-6cca3fe08768 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:24.086515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-09c6ddfb-a1dc-48ab-a5ed-6cca3fe08768 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:24.094122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c6ddfb-a1dc-48ab-a5ed-6cca3fe08768 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:24.094608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c6ddfb-a1dc-48ab-a5ed-6cca3fe08768 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:24.095243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c6ddfb-a1dc-48ab-a5ed-6cca3fe08768 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:24.096291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c6ddfb-a1dc-48ab-a5ed-6cca3fe08768 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:24.096890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c6ddfb-a1dc-48ab-a5ed-6cca3fe08768 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:24.097333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c6ddfb-a1dc-48ab-a5ed-6cca3fe08768 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:24.207016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-09c6ddfb-a1dc-48ab-a5ed-6cca3fe08768 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:24.218093 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-09c6ddfb-a1dc-48ab-a5ed-6cca3fe08768 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1188 microversion: 2.1 time: 0.137124 Aug 27 03:17:24.218712 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3193/6206] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:24 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1188 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:25.239796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-01be9551-edf1-4732-8982-0bbd82ffc250 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:25.240864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-01be9551-edf1-4732-8982-0bbd82ffc250 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:25.249397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01be9551-edf1-4732-8982-0bbd82ffc250 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:25.249927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01be9551-edf1-4732-8982-0bbd82ffc250 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:25.250371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01be9551-edf1-4732-8982-0bbd82ffc250 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:25.251125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01be9551-edf1-4732-8982-0bbd82ffc250 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:25.251585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01be9551-edf1-4732-8982-0bbd82ffc250 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:25.252023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01be9551-edf1-4732-8982-0bbd82ffc250 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:25.327308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-01be9551-edf1-4732-8982-0bbd82ffc250 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:25.344542 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-01be9551-edf1-4732-8982-0bbd82ffc250 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 200 len: 1188 microversion: 2.1 time: 0.108502 Aug 27 03:17:25.345810 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3014/6207] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:25 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 1188 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:26.367213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:26.368061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 4aecdc28-2817-4cb9-8dc0-8d0b9988271f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:26.375221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:26.375788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:26.376297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:26.377098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:26.377599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:26.378234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:26.393879 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance 4aecdc28-2817-4cb9-8dc0-8d0b9988271f could not be found. Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f HTTP/1.1 Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 4aecdc28-2817-4cb9-8dc0-8d0b9988271f could not be found. Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '4aecdc28-2817-4cb9-8dc0-8d0b9988271f'} Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aecdc28-2817-4cb9-8dc0-8d0b9988271f could not be found. Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aecdc28-2817-4cb9-8dc0-8d0b9988271f could not be found. Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:26.394994 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:17:26.402298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:26.402298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:26.402298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:26.402298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:26.402298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:26.402298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aecdc28-2817-4cb9-8dc0-8d0b9988271f could not be found. Aug 27 03:17:26.402298 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:17:26.402298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance 4aecdc28-2817-4cb9-8dc0-8d0b9988271f could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:26.402298 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b8da27d0-2312-4c3e-98c1-c1865a56c154 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f" status: 404 len: 111 microversion: 2.1 time: 0.034529 Aug 27 03:17:26.402298 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3194/6208] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:26 2022] GET /compute/v2.1/servers/4aecdc28-2817-4cb9-8dc0-8d0b9988271f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:17:30.571661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5060afae-807d-476f-a7f0-597ccc38e28b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:30.573835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5060afae-807d-476f-a7f0-597ccc38e28b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:30.581340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:30.583953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5060afae-807d-476f-a7f0-597ccc38e28b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:30.585279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5060afae-807d-476f-a7f0-597ccc38e28b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:30.586136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5060afae-807d-476f-a7f0-597ccc38e28b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:30.587059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5060afae-807d-476f-a7f0-597ccc38e28b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:30.587770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5060afae-807d-476f-a7f0-597ccc38e28b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:30.588379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5060afae-807d-476f-a7f0-597ccc38e28b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:30.670631 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5060afae-807d-476f-a7f0-597ccc38e28b tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "POST /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d/action" status: 200 len: 24568 microversion: 2.1 time: 0.102908 Aug 27 03:17:30.671331 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3015/6209] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:17:30 2022] POST /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d/action => generated 24568 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:17:42.981116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ad05e877-5d24-409c-873a-98f682541866 req-60223e2d-7df8-4cb0-9635-f7f5b6436997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f83ba1-2a61-4be3-a520-655e69ae8d2d", "tag": "07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:42.981810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2343e813-2dc3-4f21-b50f-90fd1fe4cb22 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:42.982247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2343e813-2dc3-4f21-b50f-90fd1fe4cb22 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:42.985043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=47 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:42.987545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=29 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:42.996520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:42.997963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:17:43.000935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ad05e877-5d24-409c-873a-98f682541866 req-60223e2d-7df8-4cb0-9635-f7f5b6436997 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.002067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ad05e877-5d24-409c-873a-98f682541866 req-60223e2d-7df8-4cb0-9635-f7f5b6436997 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.003098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ad05e877-5d24-409c-873a-98f682541866 req-60223e2d-7df8-4cb0-9635-f7f5b6436997 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.008000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2343e813-2dc3-4f21-b50f-90fd1fe4cb22 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.010701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2343e813-2dc3-4f21-b50f-90fd1fe4cb22 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.011254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2343e813-2dc3-4f21-b50f-90fd1fe4cb22 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.012384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2343e813-2dc3-4f21-b50f-90fd1fe4cb22 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.012869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2343e813-2dc3-4f21-b50f-90fd1fe4cb22 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.013308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2343e813-2dc3-4f21-b50f-90fd1fe4cb22 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.025527 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ad05e877-5d24-409c-873a-98f682541866 req-60223e2d-7df8-4cb0-9635-f7f5b6436997 service nova] Creating event network-changed:07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0 for instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d on n-h2-852084-5 Aug 27 03:17:43.034010 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ad05e877-5d24-409c-873a-98f682541866 req-60223e2d-7df8-4cb0-9635-f7f5b6436997 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056459 Aug 27 03:17:43.039234 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3016/6210] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:17:43.100934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2343e813-2dc3-4f21-b50f-90fd1fe4cb22 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:17:43.294486 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2343e813-2dc3-4f21-b50f-90fd1fe4cb22 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "DELETE /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 204 len: 0 microversion: 2.1 time: 0.320402 Aug 27 03:17:43.298433 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3195/6211] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:17:42 2022] DELETE /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:17:43.310912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b8662b20-12e3-450b-ae9e-28e4a85f66f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:43.311982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b8662b20-12e3-450b-ae9e-28e4a85f66f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:43.331242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662b20-12e3-450b-ae9e-28e4a85f66f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.334274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662b20-12e3-450b-ae9e-28e4a85f66f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.335139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662b20-12e3-450b-ae9e-28e4a85f66f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.337819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662b20-12e3-450b-ae9e-28e4a85f66f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:43.339787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662b20-12e3-450b-ae9e-28e4a85f66f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:43.342879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8662b20-12e3-450b-ae9e-28e4a85f66f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:43.608352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b8662b20-12e3-450b-ae9e-28e4a85f66f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:43.622204 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b8662b20-12e3-450b-ae9e-28e4a85f66f4 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1685 microversion: 2.1 time: 0.315855 Aug 27 03:17:43.638172 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3017/6212] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:43 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1685 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:44.651937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-28e614f1-ce17-47c0-9612-162b733be3ec tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:44.653493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-28e614f1-ce17-47c0-9612-162b733be3ec tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:44.670517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28e614f1-ce17-47c0-9612-162b733be3ec tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:44.675064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28e614f1-ce17-47c0-9612-162b733be3ec tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:44.678665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28e614f1-ce17-47c0-9612-162b733be3ec tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:44.682137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28e614f1-ce17-47c0-9612-162b733be3ec tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:44.684650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28e614f1-ce17-47c0-9612-162b733be3ec tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:44.686309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28e614f1-ce17-47c0-9612-162b733be3ec tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:45.561449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-28e614f1-ce17-47c0-9612-162b733be3ec tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:45.577564 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-28e614f1-ce17-47c0-9612-162b733be3ec tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1685 microversion: 2.1 time: 0.932710 Aug 27 03:17:45.594101 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3196/6213] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:44 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1685 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:46.270061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-9d3e4eb8-4623-4ff7-893f-de5a5b33186b req-93c903f2-9d3f-40b7-91a4-82b0a7aa3073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f83ba1-2a61-4be3-a520-655e69ae8d2d", "name": "network-vif-deleted", "tag": "07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:46.297182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9d3e4eb8-4623-4ff7-893f-de5a5b33186b req-93c903f2-9d3f-40b7-91a4-82b0a7aa3073 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:46.300170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9d3e4eb8-4623-4ff7-893f-de5a5b33186b req-93c903f2-9d3f-40b7-91a4-82b0a7aa3073 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:46.301259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9d3e4eb8-4623-4ff7-893f-de5a5b33186b req-93c903f2-9d3f-40b7-91a4-82b0a7aa3073 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:46.326238 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-9d3e4eb8-4623-4ff7-893f-de5a5b33186b req-93c903f2-9d3f-40b7-91a4-82b0a7aa3073 service nova] Creating event network-vif-deleted:07e63d90-e6d9-4bdb-8234-ef5b0e3ba6f0 for instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d on n-h2-852084-5 Aug 27 03:17:46.340536 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-9d3e4eb8-4623-4ff7-893f-de5a5b33186b req-93c903f2-9d3f-40b7-91a4-82b0a7aa3073 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076291 Aug 27 03:17:46.346538 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3018/6214] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:17:46.606751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:46.607711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:46.621497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:46.626391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:46.627380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:46.631994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:46.635378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:46.636217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:46.704192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:46.705549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:46.706321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:46.708230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lazy-loading 'fault' on Instance uuid 35f83ba1-2a61-4be3-a520-655e69ae8d2d {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:17:46.785200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86930a2f684449a5a228ea43a7ab5e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08baa7977bed4278b5cacdb7f34ebf2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:46.810136 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9a2e3c92-f99e-4fbd-83d7-efba79e6920f tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 200 len: 1355 microversion: 2.1 time: 0.209435 Aug 27 03:17:46.821739 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3197/6215] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:46 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 1355 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:47.844226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:47.844822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] [instance: 35f83ba1-2a61-4be3-a520-655e69ae8d2d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:47.865438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:47.867632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:47.868865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:47.874375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:47.875915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:47.876476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:47.927265 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] HTTP exception thrown: Instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d could not be found. Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Request method failure captured: Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d HTTP/1.1 Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYqQfBm6GS9xqnQK0kCaegkxtUGxBmgmlqSE3zjvPxF6xt1EIGwA_wROeCKLm5jKuicPFEf8dtAhztXrirum6yNgvTCeNAjM228kmH2Nzqe36R_uGkBJ85LsP_Ff542Y0N4IgZbqEya_XvrJ_7ujqHupudK2EUD953gaJkgcviDbsqs Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 08baa7977bed4278b5cacdb7f34ebf2f Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/08baa7977bed4278b5cacdb7f34ebf2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/08baa7977bed4278b5cacdb7f34ebf2f"}]}] Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 08baa7977bed4278b5cacdb7f34ebf2f Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-133114655 Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestNetworkAdvancedServerOps-133114655-project Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 86930a2f684449a5a228ea43a7ab5e23 Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestNetworkAdvancedServerOps-133114655-project Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d could not be found. Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '35f83ba1-2a61-4be3-a520-655e69ae8d2d'} Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d could not be found. Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d could not be found. Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:17:47.941730 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:17:47.949304 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:17:47.949304 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:17:47.949304 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:17:47.949304 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:17:47.949304 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:17:47.949304 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:17:47.949304 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d could not be found. Aug 27 03:17:47.949304 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:17:47.949304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Returning 404 to user: Instance 35f83ba1-2a61-4be3-a520-655e69ae8d2d could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:17:47.950561 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8c73a4e7-84a7-4517-bcad-82683ce7fa04 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d" status: 404 len: 111 microversion: 2.1 time: 0.114655 Aug 27 03:17:47.954497 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3019/6216] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:47 2022] GET /compute/v2.1/servers/35f83ba1-2a61-4be3-a520-655e69ae8d2d => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:17:51.166033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1463414194", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "3870c36f-7cbf-48b3-acc0-30e26db07531"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1894657716", "security_groups": []}, "os:scheduler_hints": {"different_host": ["b4b0c957-056f-43a4-b83f-fff9fcc2668a"]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:51.344189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] validate_networks() for [('3870c36f-7cbf-48b3-acc0-30e26db07531', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:17:52.312302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:17:52.313517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:17:52.314303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:17:52.314997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:17:52.315663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:17:52.335461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:52.337288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:52.342955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:52.344468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:52.345381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:52.346667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:52.401897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Getting quotas for project a99e9f6cca3147f4a1797bbf7186dafe. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:52.417314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Getting quotas for user 8844887e3d0947968a4cf6997a9e171c and project a99e9f6cca3147f4a1797bbf7186dafe. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:52.436761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:17:52.440131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:17:52.534905 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-921350d1-be76-443f-9524-e6f924fea8ef tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.376307 Aug 27 03:17:52.537641 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3198/6217] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:51 2022] POST /compute/v2.1/servers => generated 361 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:17:52.551645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f94f213-0b6e-48b8-9289-7528f89e5101 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:52.552833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9f94f213-0b6e-48b8-9289-7528f89e5101 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:52.653000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9f94f213-0b6e-48b8-9289-7528f89e5101 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:52.668015 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9f94f213-0b6e-48b8-9289-7528f89e5101 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1242 microversion: 2.1 time: 0.122480 Aug 27 03:17:52.676931 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3020/6218] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:52 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1242 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:53.690381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-605687dd-b146-4f46-b0c4-1196784765ff tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:53.691033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-605687dd-b146-4f46-b0c4-1196784765ff tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:53.714329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605687dd-b146-4f46-b0c4-1196784765ff tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:53.715122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605687dd-b146-4f46-b0c4-1196784765ff tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:53.715753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605687dd-b146-4f46-b0c4-1196784765ff tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:53.726026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605687dd-b146-4f46-b0c4-1196784765ff tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:53.726797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605687dd-b146-4f46-b0c4-1196784765ff tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:53.728423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-605687dd-b146-4f46-b0c4-1196784765ff tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:53.928731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-605687dd-b146-4f46-b0c4-1196784765ff tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:53.941683 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-605687dd-b146-4f46-b0c4-1196784765ff tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1238 microversion: 2.1 time: 0.256646 Aug 27 03:17:53.942297 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3199/6219] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:53 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1238 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:54.976078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e00abefa-0013-4594-a921-2da72ea77fe1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:55.001804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e00abefa-0013-4594-a921-2da72ea77fe1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:55.015501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e00abefa-0013-4594-a921-2da72ea77fe1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.017428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e00abefa-0013-4594-a921-2da72ea77fe1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.018328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e00abefa-0013-4594-a921-2da72ea77fe1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:55.019263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e00abefa-0013-4594-a921-2da72ea77fe1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:55.020195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e00abefa-0013-4594-a921-2da72ea77fe1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:55.020814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e00abefa-0013-4594-a921-2da72ea77fe1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:55.118857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e00abefa-0013-4594-a921-2da72ea77fe1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:55.139017 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e00abefa-0013-4594-a921-2da72ea77fe1 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1300 microversion: 2.1 time: 0.177250 Aug 27 03:17:55.140907 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3021/6220] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:54 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:55.464070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c27ed309-c2d1-4097-87ec-808f8da74de9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] Calling method '.version_select at 0x7f4d2998f3a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:55.521994 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c27ed309-c2d1-4097-87ec-808f8da74de9 tempest-TestNetworkAdvancedServerOps-133114655 tempest-TestNetworkAdvancedServerOps-133114655-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-871159141" status: 202 len: 0 microversion: 2.1 time: 0.064347 Aug 27 03:17:55.524245 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3200/6221] 10.222.0.99 () {58 vars in 1281 bytes} [Sat Aug 27 03:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-871159141 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:17:56.143984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-453814648", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0003bc73-05d1-448f-a525-406b70b7404a", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9f6cd27d-8b3c-456e-af66-44212888909f"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:56.163803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f083a14-e4a7-4c2e-b13e-f37c71f062c9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:56.164860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8f083a14-e4a7-4c2e-b13e-f37c71f062c9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:56.174528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f083a14-e4a7-4c2e-b13e-f37c71f062c9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:56.175738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f083a14-e4a7-4c2e-b13e-f37c71f062c9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:56.177469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f083a14-e4a7-4c2e-b13e-f37c71f062c9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.178443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f083a14-e4a7-4c2e-b13e-f37c71f062c9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:56.179255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f083a14-e4a7-4c2e-b13e-f37c71f062c9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:56.179861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f083a14-e4a7-4c2e-b13e-f37c71f062c9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.323356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] validate_networks() for [('9f6cd27d-8b3c-456e-af66-44212888909f', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:17:56.341756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8f083a14-e4a7-4c2e-b13e-f37c71f062c9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:56.354567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f083a14-e4a7-4c2e-b13e-f37c71f062c9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1300 microversion: 2.1 time: 0.197691 Aug 27 03:17:56.359115 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3201/6222] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:56 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1300 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:56.869928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-5024a952-b103-4bb6-b91c-1718223f1204 req-a7c7d75e-d552-442e-937e-984a5d67d4cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1baa2378-c741-4322-8da7-b24b49e2ee06", "tag": "97f9b106-07a1-49f4-b616-f1c3d3c54e0f"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:17:56.891801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5024a952-b103-4bb6-b91c-1718223f1204 req-a7c7d75e-d552-442e-937e-984a5d67d4cb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:56.892432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5024a952-b103-4bb6-b91c-1718223f1204 req-a7c7d75e-d552-442e-937e-984a5d67d4cb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:56.892950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5024a952-b103-4bb6-b91c-1718223f1204 req-a7c7d75e-d552-442e-937e-984a5d67d4cb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.911310 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-5024a952-b103-4bb6-b91c-1718223f1204 req-a7c7d75e-d552-442e-937e-984a5d67d4cb service nova] Creating event network-changed:97f9b106-07a1-49f4-b616-f1c3d3c54e0f for instance 1baa2378-c741-4322-8da7-b24b49e2ee06 on n-h2-852084-5 Aug 27 03:17:56.917631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:17:56.918372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:17:56.919321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:17:56.919908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:17:56.920480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:17:56.920817 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-5024a952-b103-4bb6-b91c-1718223f1204 req-a7c7d75e-d552-442e-937e-984a5d67d4cb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055046 Aug 27 03:17:56.922246 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3202/6223] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:17:56.936124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:56.936920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:56.937522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.938886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:56.939930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:56.940776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:56.966623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:17:56.972404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for user 0a78655bea27452faee67a7efd476175 and project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:17:56.994573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:17:56.996886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='0003bc73-05d1-448f-a525-406b70b7404a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:17:57.100823 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-07f95cda-8aa9-4ce5-9998-34af26ad67d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962075 Aug 27 03:17:57.107108 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3022/6224] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:17:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:17:57.112782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3de27578-2170-4667-b2db-3c987a2105c6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:57.115436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3de27578-2170-4667-b2db-3c987a2105c6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:57.183004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3de27578-2170-4667-b2db-3c987a2105c6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:57.191584 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3de27578-2170-4667-b2db-3c987a2105c6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1056 microversion: 2.1 time: 0.081817 Aug 27 03:17:57.193801 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3203/6225] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:57 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1056 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:17:57.378929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3c9c0371-f691-41ae-9532-6c3fa1590339 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:57.379698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3c9c0371-f691-41ae-9532-6c3fa1590339 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:57.400900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c9c0371-f691-41ae-9532-6c3fa1590339 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.401477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c9c0371-f691-41ae-9532-6c3fa1590339 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.406867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c9c0371-f691-41ae-9532-6c3fa1590339 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:57.407978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c9c0371-f691-41ae-9532-6c3fa1590339 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:57.408959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c9c0371-f691-41ae-9532-6c3fa1590339 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:57.409581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c9c0371-f691-41ae-9532-6c3fa1590339 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:57.605419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3c9c0371-f691-41ae-9532-6c3fa1590339 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:57.616936 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3c9c0371-f691-41ae-9532-6c3fa1590339 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1300 microversion: 2.1 time: 0.244307 Aug 27 03:17:57.619906 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3023/6226] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:57 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1300 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:58.213406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-66534a99-7550-4c32-8d46-dac2412f03e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:58.214091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-66534a99-7550-4c32-8d46-dac2412f03e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:58.222924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66534a99-7550-4c32-8d46-dac2412f03e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:58.223436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66534a99-7550-4c32-8d46-dac2412f03e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:58.224054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66534a99-7550-4c32-8d46-dac2412f03e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:58.225187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66534a99-7550-4c32-8d46-dac2412f03e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:58.225689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66534a99-7550-4c32-8d46-dac2412f03e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:58.226380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66534a99-7550-4c32-8d46-dac2412f03e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:58.293953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-66534a99-7550-4c32-8d46-dac2412f03e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:58.305807 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-66534a99-7550-4c32-8d46-dac2412f03e9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1108 microversion: 2.1 time: 0.097079 Aug 27 03:17:58.307336 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3204/6227] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:58 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1108 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:58.640995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6c7a6c30-b43c-4130-9a2c-bf1aa03815d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:58.642011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6c7a6c30-b43c-4130-9a2c-bf1aa03815d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:58.654393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c7a6c30-b43c-4130-9a2c-bf1aa03815d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:58.654890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c7a6c30-b43c-4130-9a2c-bf1aa03815d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:58.655763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c7a6c30-b43c-4130-9a2c-bf1aa03815d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:58.656808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c7a6c30-b43c-4130-9a2c-bf1aa03815d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:58.657864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c7a6c30-b43c-4130-9a2c-bf1aa03815d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:58.658311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c7a6c30-b43c-4130-9a2c-bf1aa03815d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:58.816272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6c7a6c30-b43c-4130-9a2c-bf1aa03815d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:58.832563 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6c7a6c30-b43c-4130-9a2c-bf1aa03815d5 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1300 microversion: 2.1 time: 0.195982 Aug 27 03:17:58.834863 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3024/6228] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:58 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1300 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:59.333805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bf7d20c2-214f-4c21-b8c5-e88584d8d5d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:59.335395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bf7d20c2-214f-4c21-b8c5-e88584d8d5d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:59.343352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf7d20c2-214f-4c21-b8c5-e88584d8d5d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.343845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf7d20c2-214f-4c21-b8c5-e88584d8d5d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.344504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf7d20c2-214f-4c21-b8c5-e88584d8d5d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.345681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf7d20c2-214f-4c21-b8c5-e88584d8d5d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.346181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf7d20c2-214f-4c21-b8c5-e88584d8d5d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.346619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf7d20c2-214f-4c21-b8c5-e88584d8d5d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.592337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bf7d20c2-214f-4c21-b8c5-e88584d8d5d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:17:59.607549 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bf7d20c2-214f-4c21-b8c5-e88584d8d5d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.277471 Aug 27 03:17:59.609004 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3205/6229] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:59 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:17:59.857481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2330dee2-e216-4a70-bf88-59a4459f6f40 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:17:59.858871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2330dee2-e216-4a70-bf88-59a4459f6f40 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:17:59.876145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2330dee2-e216-4a70-bf88-59a4459f6f40 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.883509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2330dee2-e216-4a70-bf88-59a4459f6f40 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.884603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2330dee2-e216-4a70-bf88-59a4459f6f40 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:17:59.885829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2330dee2-e216-4a70-bf88-59a4459f6f40 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:17:59.889066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2330dee2-e216-4a70-bf88-59a4459f6f40 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:17:59.889805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2330dee2-e216-4a70-bf88-59a4459f6f40 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:00.005218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2330dee2-e216-4a70-bf88-59a4459f6f40 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:00.016521 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2330dee2-e216-4a70-bf88-59a4459f6f40 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1300 microversion: 2.1 time: 0.164647 Aug 27 03:18:00.018344 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3025/6230] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:17:59 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1300 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:00.410251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d844c253-a387-4c2b-ac81-8d610f10363a req-92ab7a84-2982-4ee6-b765-7fb8a904efce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92475dbd-71d9-459d-be61-e0c1e1e00682", "tag": "d9f2a33f-3270-416e-a46c-eff4c47f624a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:00.432037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d844c253-a387-4c2b-ac81-8d610f10363a req-92ab7a84-2982-4ee6-b765-7fb8a904efce service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:00.433121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d844c253-a387-4c2b-ac81-8d610f10363a req-92ab7a84-2982-4ee6-b765-7fb8a904efce service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:00.433802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d844c253-a387-4c2b-ac81-8d610f10363a req-92ab7a84-2982-4ee6-b765-7fb8a904efce service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:00.446514 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d844c253-a387-4c2b-ac81-8d610f10363a req-92ab7a84-2982-4ee6-b765-7fb8a904efce service nova] Creating event network-changed:d9f2a33f-3270-416e-a46c-eff4c47f624a for instance 92475dbd-71d9-459d-be61-e0c1e1e00682 on n-h1-852084-5 Aug 27 03:18:00.452535 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d844c253-a387-4c2b-ac81-8d610f10363a req-92ab7a84-2982-4ee6-b765-7fb8a904efce service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045892 Aug 27 03:18:00.453748 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3206/6231] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:00.632203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3f237152-fa8f-4a3f-b30d-86b4111517a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:00.633140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3f237152-fa8f-4a3f-b30d-86b4111517a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:00.640131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f237152-fa8f-4a3f-b30d-86b4111517a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:00.641212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f237152-fa8f-4a3f-b30d-86b4111517a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:00.642075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f237152-fa8f-4a3f-b30d-86b4111517a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:00.643417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f237152-fa8f-4a3f-b30d-86b4111517a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:00.644149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f237152-fa8f-4a3f-b30d-86b4111517a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:00.644844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f237152-fa8f-4a3f-b30d-86b4111517a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:01.037990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c70b84c5-aa41-43c5-b84a-ca9319ccda2c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:01.038746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c70b84c5-aa41-43c5-b84a-ca9319ccda2c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:01.051385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c70b84c5-aa41-43c5-b84a-ca9319ccda2c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:01.053123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c70b84c5-aa41-43c5-b84a-ca9319ccda2c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:01.056579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c70b84c5-aa41-43c5-b84a-ca9319ccda2c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:01.057931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c70b84c5-aa41-43c5-b84a-ca9319ccda2c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:01.058669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c70b84c5-aa41-43c5-b84a-ca9319ccda2c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:01.059584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c70b84c5-aa41-43c5-b84a-ca9319ccda2c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:01.180673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3f237152-fa8f-4a3f-b30d-86b4111517a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:01.195867 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3f237152-fa8f-4a3f-b30d-86b4111517a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.567890 Aug 27 03:18:01.198392 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3026/6232] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:00 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:01.204073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c70b84c5-aa41-43c5-b84a-ca9319ccda2c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:01.216062 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c70b84c5-aa41-43c5-b84a-ca9319ccda2c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1300 microversion: 2.1 time: 0.183042 Aug 27 03:18:01.219811 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3207/6233] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:01 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1300 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:01.962116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d09db442-cbd1-4c11-9490-b4734559fba1 req-df952643-3922-4c3f-a2d8-fc4d0c0a058b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1baa2378-c741-4322-8da7-b24b49e2ee06", "name": "network-vif-plugged", "status": "completed", "tag": "97f9b106-07a1-49f4-b616-f1c3d3c54e0f"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:01.984246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d09db442-cbd1-4c11-9490-b4734559fba1 req-df952643-3922-4c3f-a2d8-fc4d0c0a058b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:01.985429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d09db442-cbd1-4c11-9490-b4734559fba1 req-df952643-3922-4c3f-a2d8-fc4d0c0a058b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:01.986430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d09db442-cbd1-4c11-9490-b4734559fba1 req-df952643-3922-4c3f-a2d8-fc4d0c0a058b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:02.015020 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d09db442-cbd1-4c11-9490-b4734559fba1 req-df952643-3922-4c3f-a2d8-fc4d0c0a058b service nova] Creating event network-vif-plugged:97f9b106-07a1-49f4-b616-f1c3d3c54e0f for instance 1baa2378-c741-4322-8da7-b24b49e2ee06 on n-h2-852084-5 Aug 27 03:18:02.024221 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d09db442-cbd1-4c11-9490-b4734559fba1 req-df952643-3922-4c3f-a2d8-fc4d0c0a058b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066442 Aug 27 03:18:02.025460 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3027/6234] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:02.220953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cff088b0-7756-4bfb-a133-a9f7edfb878c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:02.221595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cff088b0-7756-4bfb-a133-a9f7edfb878c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:02.229839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff088b0-7756-4bfb-a133-a9f7edfb878c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:02.230352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff088b0-7756-4bfb-a133-a9f7edfb878c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:02.230885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff088b0-7756-4bfb-a133-a9f7edfb878c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:02.231676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff088b0-7756-4bfb-a133-a9f7edfb878c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:02.232381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff088b0-7756-4bfb-a133-a9f7edfb878c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:02.233009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cff088b0-7756-4bfb-a133-a9f7edfb878c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:02.258373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d773f1e4-7221-4c81-8ad7-c17cdb585782 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:02.263962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d773f1e4-7221-4c81-8ad7-c17cdb585782 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:02.272912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d773f1e4-7221-4c81-8ad7-c17cdb585782 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:02.274678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d773f1e4-7221-4c81-8ad7-c17cdb585782 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:02.275385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d773f1e4-7221-4c81-8ad7-c17cdb585782 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:02.276337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d773f1e4-7221-4c81-8ad7-c17cdb585782 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:02.277011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d773f1e4-7221-4c81-8ad7-c17cdb585782 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:02.277623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d773f1e4-7221-4c81-8ad7-c17cdb585782 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:02.377175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:02.401265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d773f1e4-7221-4c81-8ad7-c17cdb585782 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:02.409328 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d773f1e4-7221-4c81-8ad7-c17cdb585782 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1300 microversion: 2.1 time: 0.158612 Aug 27 03:18:02.411876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cff088b0-7756-4bfb-a133-a9f7edfb878c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:02.420381 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cff088b0-7756-4bfb-a133-a9f7edfb878c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.203491 Aug 27 03:18:02.422128 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3208/6235] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:02 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:02.423184 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3028/6236] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:02 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1300 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:03.431459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7d419d59-e1d0-45a3-abc1-ce1005e020a9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:03.432749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7d419d59-e1d0-45a3-abc1-ce1005e020a9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:03.443617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d419d59-e1d0-45a3-abc1-ce1005e020a9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.444359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d419d59-e1d0-45a3-abc1-ce1005e020a9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.444966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d419d59-e1d0-45a3-abc1-ce1005e020a9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.446298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d419d59-e1d0-45a3-abc1-ce1005e020a9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.446756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d419d59-e1d0-45a3-abc1-ce1005e020a9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.447294 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7d419d59-e1d0-45a3-abc1-ce1005e020a9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.469143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c00a8c1e-e560-4277-b21e-7f92f4260d0c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:03.471000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c00a8c1e-e560-4277-b21e-7f92f4260d0c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:03.482151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00a8c1e-e560-4277-b21e-7f92f4260d0c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.483022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00a8c1e-e560-4277-b21e-7f92f4260d0c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.483554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00a8c1e-e560-4277-b21e-7f92f4260d0c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.484888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00a8c1e-e560-4277-b21e-7f92f4260d0c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.485791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00a8c1e-e560-4277-b21e-7f92f4260d0c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.486465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c00a8c1e-e560-4277-b21e-7f92f4260d0c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.572194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7d419d59-e1d0-45a3-abc1-ce1005e020a9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:03.591993 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7d419d59-e1d0-45a3-abc1-ce1005e020a9 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1472 microversion: 2.1 time: 0.164534 Aug 27 03:18:03.593274 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3209/6237] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:03 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:03.626502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-880147f5-5b87-442b-b8f2-a24f2d6dba9a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:03.631767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-880147f5-5b87-442b-b8f2-a24f2d6dba9a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:03.638665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-880147f5-5b87-442b-b8f2-a24f2d6dba9a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.639537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-880147f5-5b87-442b-b8f2-a24f2d6dba9a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.640254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-880147f5-5b87-442b-b8f2-a24f2d6dba9a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.641052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-880147f5-5b87-442b-b8f2-a24f2d6dba9a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.641704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-880147f5-5b87-442b-b8f2-a24f2d6dba9a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.642289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-880147f5-5b87-442b-b8f2-a24f2d6dba9a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.701699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c00a8c1e-e560-4277-b21e-7f92f4260d0c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:03.726504 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c00a8c1e-e560-4277-b21e-7f92f4260d0c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.283809 Aug 27 03:18:03.729115 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3029/6238] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:03 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:03.772691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-880147f5-5b87-442b-b8f2-a24f2d6dba9a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:03.808427 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-880147f5-5b87-442b-b8f2-a24f2d6dba9a tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1472 microversion: 2.1 time: 0.185882 Aug 27 03:18:03.811796 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3210/6239] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:03 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:03.840644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e306cd9-c54f-4fe9-9d6b-ecc1389932b0 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:03.842363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2e306cd9-c54f-4fe9-9d6b-ecc1389932b0 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:03.859965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e306cd9-c54f-4fe9-9d6b-ecc1389932b0 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.860858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e306cd9-c54f-4fe9-9d6b-ecc1389932b0 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.861797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e306cd9-c54f-4fe9-9d6b-ecc1389932b0 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.862765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e306cd9-c54f-4fe9-9d6b-ecc1389932b0 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:03.864066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e306cd9-c54f-4fe9-9d6b-ecc1389932b0 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:03.864437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e306cd9-c54f-4fe9-9d6b-ecc1389932b0 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:03.973241 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e306cd9-c54f-4fe9-9d6b-ecc1389932b0 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1623 microversion: 2.1 time: 0.134377 Aug 27 03:18:03.973241 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3030/6240] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:03 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1623 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:04.000241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a7ff8d4d-56be-48b8-bd04-f5565841bf31 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:04.000943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a7ff8d4d-56be-48b8-bd04-f5565841bf31 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:04.010229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d4d-56be-48b8-bd04-f5565841bf31 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:04.010948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d4d-56be-48b8-bd04-f5565841bf31 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:04.011599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d4d-56be-48b8-bd04-f5565841bf31 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:04.012322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d4d-56be-48b8-bd04-f5565841bf31 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:04.012820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d4d-56be-48b8-bd04-f5565841bf31 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:04.013221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ff8d4d-56be-48b8-bd04-f5565841bf31 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:04.225626 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a7ff8d4d-56be-48b8-bd04-f5565841bf31 tempest-TestSecurityGroupsBasicOps-213298904 tempest-TestSecurityGroupsBasicOps-213298904-project-admin] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1912 microversion: 2.1 time: 0.229420 Aug 27 03:18:04.226684 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3211/6241] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:03 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1912 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:04.311269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-62a116c2-8ae9-4231-87bb-7f7ec21de82c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:04.311875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-62a116c2-8ae9-4231-87bb-7f7ec21de82c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:04.321391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62a116c2-8ae9-4231-87bb-7f7ec21de82c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:04.322040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62a116c2-8ae9-4231-87bb-7f7ec21de82c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:04.323784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62a116c2-8ae9-4231-87bb-7f7ec21de82c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:04.323784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62a116c2-8ae9-4231-87bb-7f7ec21de82c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:04.323784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62a116c2-8ae9-4231-87bb-7f7ec21de82c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:04.324662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62a116c2-8ae9-4231-87bb-7f7ec21de82c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:04.361910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-62a116c2-8ae9-4231-87bb-7f7ec21de82c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:04.533042 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-62a116c2-8ae9-4231-87bb-7f7ec21de82c tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 204 len: 0 microversion: 2.1 time: 0.225910 Aug 27 03:18:04.538482 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3031/6242] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:04 2022] DELETE /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:04.550290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-18c45e2b-107d-49ed-90d7-ffa4150f8ed8 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:04.555282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-18c45e2b-107d-49ed-90d7-ffa4150f8ed8 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:04.567701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18c45e2b-107d-49ed-90d7-ffa4150f8ed8 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:04.568818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18c45e2b-107d-49ed-90d7-ffa4150f8ed8 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:04.568994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18c45e2b-107d-49ed-90d7-ffa4150f8ed8 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:04.569640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18c45e2b-107d-49ed-90d7-ffa4150f8ed8 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:04.570144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18c45e2b-107d-49ed-90d7-ffa4150f8ed8 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:04.571121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-18c45e2b-107d-49ed-90d7-ffa4150f8ed8 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:04.724910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-18c45e2b-107d-49ed-90d7-ffa4150f8ed8 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:04.736050 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-18c45e2b-107d-49ed-90d7-ffa4150f8ed8 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1478 microversion: 2.1 time: 0.191185 Aug 27 03:18:04.749930 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3212/6243] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:04 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1478 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:04.750174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3dad78fb-fa5a-41b3-a94e-373e754dc8b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:04.750746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3dad78fb-fa5a-41b3-a94e-373e754dc8b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:04.760655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dad78fb-fa5a-41b3-a94e-373e754dc8b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:04.761338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dad78fb-fa5a-41b3-a94e-373e754dc8b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:04.762137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dad78fb-fa5a-41b3-a94e-373e754dc8b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:04.762961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dad78fb-fa5a-41b3-a94e-373e754dc8b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:04.763436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dad78fb-fa5a-41b3-a94e-373e754dc8b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:04.763870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3dad78fb-fa5a-41b3-a94e-373e754dc8b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:04.957350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3dad78fb-fa5a-41b3-a94e-373e754dc8b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:04.967365 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3dad78fb-fa5a-41b3-a94e-373e754dc8b3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.221935 Aug 27 03:18:04.967957 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3032/6244] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:04 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:05.759579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0d91886d-80c7-417a-9af0-9743b728820b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:05.760245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0d91886d-80c7-417a-9af0-9743b728820b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:05.775338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d91886d-80c7-417a-9af0-9743b728820b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:05.775925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d91886d-80c7-417a-9af0-9743b728820b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:05.776493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d91886d-80c7-417a-9af0-9743b728820b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:05.778727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d91886d-80c7-417a-9af0-9743b728820b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:05.780066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d91886d-80c7-417a-9af0-9743b728820b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:05.780550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d91886d-80c7-417a-9af0-9743b728820b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:05.815324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:05.932096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0d91886d-80c7-417a-9af0-9743b728820b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:05.945538 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0d91886d-80c7-417a-9af0-9743b728820b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1478 microversion: 2.1 time: 0.192082 Aug 27 03:18:05.946949 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3213/6245] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:05 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1478 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:06.007930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-974105e1-c719-43b5-a134-1257da42b4e3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:06.008672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-974105e1-c719-43b5-a134-1257da42b4e3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:06.021324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974105e1-c719-43b5-a134-1257da42b4e3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:06.021722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974105e1-c719-43b5-a134-1257da42b4e3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:06.027866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974105e1-c719-43b5-a134-1257da42b4e3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:06.038739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974105e1-c719-43b5-a134-1257da42b4e3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:06.039709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974105e1-c719-43b5-a134-1257da42b4e3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:06.040192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-974105e1-c719-43b5-a134-1257da42b4e3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:06.260040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-974105e1-c719-43b5-a134-1257da42b4e3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:06.278697 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-974105e1-c719-43b5-a134-1257da42b4e3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.279619 Aug 27 03:18:06.293616 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3033/6246] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:05 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:06.659369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e5ea05aa-daa6-4aff-9f80-135adccd5353 req-ec2422f0-5042-467b-a858-9a380315ae39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1baa2378-c741-4322-8da7-b24b49e2ee06", "name": "network-vif-deleted", "tag": "97f9b106-07a1-49f4-b616-f1c3d3c54e0f"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:06.681475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e5ea05aa-daa6-4aff-9f80-135adccd5353 req-ec2422f0-5042-467b-a858-9a380315ae39 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:06.685593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e5ea05aa-daa6-4aff-9f80-135adccd5353 req-ec2422f0-5042-467b-a858-9a380315ae39 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:06.687007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e5ea05aa-daa6-4aff-9f80-135adccd5353 req-ec2422f0-5042-467b-a858-9a380315ae39 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:06.723982 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e5ea05aa-daa6-4aff-9f80-135adccd5353 req-ec2422f0-5042-467b-a858-9a380315ae39 service nova] Creating event network-vif-deleted:97f9b106-07a1-49f4-b616-f1c3d3c54e0f for instance 1baa2378-c741-4322-8da7-b24b49e2ee06 on n-h2-852084-5 Aug 27 03:18:06.731789 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e5ea05aa-daa6-4aff-9f80-135adccd5353 req-ec2422f0-5042-467b-a858-9a380315ae39 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075157 Aug 27 03:18:06.738786 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3214/6247] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:06.972996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:06.975415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:06.977627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:06.981747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:06.987058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:06.988660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:06.988660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:06.988660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:06.990498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:06.990498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:07.029480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:07.030194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:07.030476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:07.030954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lazy-loading 'fault' on Instance uuid 1baa2378-c741-4322-8da7-b24b49e2ee06 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:18:07.124506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:07.131407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:07.145478 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba2b4cd1-32a3-4886-bb78-0ec38bed2d2e tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 200 len: 1332 microversion: 2.1 time: 0.176126 Aug 27 03:18:07.147753 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3034/6248] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:06 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 1332 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:07.305717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1e3dcdba-931a-4178-bf0a-961c0006fc34 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:07.306594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1e3dcdba-931a-4178-bf0a-961c0006fc34 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:07.309723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=8 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:07.338651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e3dcdba-931a-4178-bf0a-961c0006fc34 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:07.342877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e3dcdba-931a-4178-bf0a-961c0006fc34 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:07.343600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e3dcdba-931a-4178-bf0a-961c0006fc34 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:07.344677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e3dcdba-931a-4178-bf0a-961c0006fc34 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:07.346096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e3dcdba-931a-4178-bf0a-961c0006fc34 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:07.346096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e3dcdba-931a-4178-bf0a-961c0006fc34 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:07.586175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1e3dcdba-931a-4178-bf0a-961c0006fc34 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:07.603145 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1e3dcdba-931a-4178-bf0a-961c0006fc34 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.302351 Aug 27 03:18:07.617938 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3215/6249] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:07 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:08.180567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:08.181994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: 1baa2378-c741-4322-8da7-b24b49e2ee06] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:08.191599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:08.192560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:08.194172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:08.194714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:08.195911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:08.195911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:08.213009 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] HTTP exception thrown: Instance 1baa2378-c741-4322-8da7-b24b49e2ee06 could not be found. Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Request method failure captured: Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 HTTP/1.1 Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYyNF60bwNO4Kz18uV4eh72sw5tN3KvNw2w18VyblAk-8xTKQmMPg0dONmGSC9PX3Lq2miA42g-vf-t0axRoULzwsfw7jR63l2gwbvNncvNTqZR8zj7KfskGATm03n3JICBbTsFuSQfy-GrDkR8qXC6iGUUz9xzVzHUlNZGZc5-dZ0Q Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: a99e9f6cca3147f4a1797bbf7186dafe Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-355835762 Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a99e9f6cca3147f4a1797bbf7186dafe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a99e9f6cca3147f4a1797bbf7186dafe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a99e9f6cca3147f4a1797bbf7186dafe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a99e9f6cca3147f4a1797bbf7186dafe"}]}] Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestSecurityGroupsBasicOps-355835762 Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: a99e9f6cca3147f4a1797bbf7186dafe Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-355835762 Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestSecurityGroupsBasicOps-355835762-project Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 8844887e3d0947968a4cf6997a9e171c Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestSecurityGroupsBasicOps-355835762-project Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 1baa2378-c741-4322-8da7-b24b49e2ee06 could not be found. Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '1baa2378-c741-4322-8da7-b24b49e2ee06'} Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1baa2378-c741-4322-8da7-b24b49e2ee06 could not be found. Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1baa2378-c741-4322-8da7-b24b49e2ee06 could not be found. Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:08.215114 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:08.220311 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:08.220311 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:08.220311 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:08.220311 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:08.220311 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:08.220311 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1baa2378-c741-4322-8da7-b24b49e2ee06 could not be found. Aug 27 03:18:08.220311 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:08.222140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Returning 404 to user: Instance 1baa2378-c741-4322-8da7-b24b49e2ee06 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:08.223268 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eea4594c-86e6-4c9b-b614-59e9a4a5469d tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06" status: 404 len: 111 microversion: 2.1 time: 0.048955 Aug 27 03:18:08.224074 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3035/6250] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:08 2022] GET /compute/v2.1/servers/1baa2378-c741-4322-8da7-b24b49e2ee06 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:08.629711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7c17c77e-35b8-4ad3-a334-2525afddc10b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:08.631298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7c17c77e-35b8-4ad3-a334-2525afddc10b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:08.639348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c17c77e-35b8-4ad3-a334-2525afddc10b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:08.639850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c17c77e-35b8-4ad3-a334-2525afddc10b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:08.640665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c17c77e-35b8-4ad3-a334-2525afddc10b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:08.641482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c17c77e-35b8-4ad3-a334-2525afddc10b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:08.641984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c17c77e-35b8-4ad3-a334-2525afddc10b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:08.642571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7c17c77e-35b8-4ad3-a334-2525afddc10b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:08.940746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7c17c77e-35b8-4ad3-a334-2525afddc10b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:08.950673 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7c17c77e-35b8-4ad3-a334-2525afddc10b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.324492 Aug 27 03:18:08.950673 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3216/6251] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:08 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:09.971669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2623a34b-c63a-4d8c-b76d-f7d67b55bd3d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:09.972272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2623a34b-c63a-4d8c-b76d-f7d67b55bd3d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:09.980130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2623a34b-c63a-4d8c-b76d-f7d67b55bd3d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:09.980551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2623a34b-c63a-4d8c-b76d-f7d67b55bd3d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:09.981254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2623a34b-c63a-4d8c-b76d-f7d67b55bd3d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:09.982171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2623a34b-c63a-4d8c-b76d-f7d67b55bd3d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:09.982539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2623a34b-c63a-4d8c-b76d-f7d67b55bd3d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:09.983142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2623a34b-c63a-4d8c-b76d-f7d67b55bd3d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:10.136398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2623a34b-c63a-4d8c-b76d-f7d67b55bd3d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:10.146339 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2623a34b-c63a-4d8c-b76d-f7d67b55bd3d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.178252 Aug 27 03:18:10.154070 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3036/6252] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:09 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:11.173362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-247cee1f-89c2-4b51-b9f4-087e8cfe70d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:11.173860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-247cee1f-89c2-4b51-b9f4-087e8cfe70d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:11.194099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-247cee1f-89c2-4b51-b9f4-087e8cfe70d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:11.194991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-247cee1f-89c2-4b51-b9f4-087e8cfe70d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:11.196795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-247cee1f-89c2-4b51-b9f4-087e8cfe70d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:11.198619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-247cee1f-89c2-4b51-b9f4-087e8cfe70d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:11.199460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-247cee1f-89c2-4b51-b9f4-087e8cfe70d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:11.201289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-247cee1f-89c2-4b51-b9f4-087e8cfe70d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:11.387831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-247cee1f-89c2-4b51-b9f4-087e8cfe70d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:11.404830 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-247cee1f-89c2-4b51-b9f4-087e8cfe70d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.237554 Aug 27 03:18:11.406073 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3217/6253] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:11 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:12.426503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65f9048a-4b04-44ba-ae07-455aecd6a6a9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:12.428524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65f9048a-4b04-44ba-ae07-455aecd6a6a9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:12.435973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f9048a-4b04-44ba-ae07-455aecd6a6a9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:12.436718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f9048a-4b04-44ba-ae07-455aecd6a6a9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:12.437355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f9048a-4b04-44ba-ae07-455aecd6a6a9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:12.438417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f9048a-4b04-44ba-ae07-455aecd6a6a9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:12.439053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f9048a-4b04-44ba-ae07-455aecd6a6a9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:12.439766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f9048a-4b04-44ba-ae07-455aecd6a6a9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:12.600262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-65f9048a-4b04-44ba-ae07-455aecd6a6a9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:12.609134 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65f9048a-4b04-44ba-ae07-455aecd6a6a9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.186548 Aug 27 03:18:12.623676 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3037/6254] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:12 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:13.253333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0cec5c94-2d0b-4e0d-9e68-08a6eb7dc49b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:13.253880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0cec5c94-2d0b-4e0d-9e68-08a6eb7dc49b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:13.258164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ddd3881e-ad88-477f-8475-6a8d1c4f03ec req-2c75b4c3-4df6-4f35-929e-68606a4f137b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b0c957-056f-43a4-b83f-fff9fcc2668a", "tag": "8d857810-d02d-43be-963b-c2c54d711838"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:13.263603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:13.267143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cec5c94-2d0b-4e0d-9e68-08a6eb7dc49b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:13.267657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cec5c94-2d0b-4e0d-9e68-08a6eb7dc49b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:13.268115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cec5c94-2d0b-4e0d-9e68-08a6eb7dc49b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.268850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cec5c94-2d0b-4e0d-9e68-08a6eb7dc49b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:13.269323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cec5c94-2d0b-4e0d-9e68-08a6eb7dc49b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:13.269798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cec5c94-2d0b-4e0d-9e68-08a6eb7dc49b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.269929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:13.272722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ddd3881e-ad88-477f-8475-6a8d1c4f03ec req-2c75b4c3-4df6-4f35-929e-68606a4f137b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:13.273371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ddd3881e-ad88-477f-8475-6a8d1c4f03ec req-2c75b4c3-4df6-4f35-929e-68606a4f137b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:13.273859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ddd3881e-ad88-477f-8475-6a8d1c4f03ec req-2c75b4c3-4df6-4f35-929e-68606a4f137b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.290898 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ddd3881e-ad88-477f-8475-6a8d1c4f03ec req-2c75b4c3-4df6-4f35-929e-68606a4f137b service nova] Creating event network-changed:8d857810-d02d-43be-963b-c2c54d711838 for instance b4b0c957-056f-43a4-b83f-fff9fcc2668a on n-h1-852084-5 Aug 27 03:18:13.303861 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ddd3881e-ad88-477f-8475-6a8d1c4f03ec req-2c75b4c3-4df6-4f35-929e-68606a4f137b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049072 Aug 27 03:18:13.311421 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3038/6255] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:18:13.321298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0cec5c94-2d0b-4e0d-9e68-08a6eb7dc49b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:13.457534 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0cec5c94-2d0b-4e0d-9e68-08a6eb7dc49b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 204 len: 0 microversion: 2.1 time: 0.207548 Aug 27 03:18:13.458846 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3218/6256] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:13 2022] DELETE /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:13.470026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e06b1dba-5710-4d1f-9302-406ab4890c33 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:13.472390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e06b1dba-5710-4d1f-9302-406ab4890c33 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:13.484168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e06b1dba-5710-4d1f-9302-406ab4890c33 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:13.485088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e06b1dba-5710-4d1f-9302-406ab4890c33 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:13.485810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e06b1dba-5710-4d1f-9302-406ab4890c33 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.487085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e06b1dba-5710-4d1f-9302-406ab4890c33 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:13.487836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e06b1dba-5710-4d1f-9302-406ab4890c33 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:13.488700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e06b1dba-5710-4d1f-9302-406ab4890c33 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.642191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3140fbed-06d2-423c-8b79-ee6907003691 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:13.643521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3140fbed-06d2-423c-8b79-ee6907003691 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:13.661551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3140fbed-06d2-423c-8b79-ee6907003691 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:13.665298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3140fbed-06d2-423c-8b79-ee6907003691 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:13.666251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3140fbed-06d2-423c-8b79-ee6907003691 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.667470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3140fbed-06d2-423c-8b79-ee6907003691 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:13.669247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3140fbed-06d2-423c-8b79-ee6907003691 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:13.671843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3140fbed-06d2-423c-8b79-ee6907003691 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:13.759077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e06b1dba-5710-4d1f-9302-406ab4890c33 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:13.772092 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e06b1dba-5710-4d1f-9302-406ab4890c33 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1767 microversion: 2.1 time: 0.305548 Aug 27 03:18:13.774376 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3039/6257] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:13 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1767 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:13.980248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3140fbed-06d2-423c-8b79-ee6907003691 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:13.990318 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3140fbed-06d2-423c-8b79-ee6907003691 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.362921 Aug 27 03:18:13.991860 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3219/6258] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:13 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:14.797352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-89a9d73b-5d49-4cbc-a750-b21e7361c9d0 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:14.801194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-89a9d73b-5d49-4cbc-a750-b21e7361c9d0 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:14.811664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89a9d73b-5d49-4cbc-a750-b21e7361c9d0 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:14.812530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89a9d73b-5d49-4cbc-a750-b21e7361c9d0 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:14.813619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89a9d73b-5d49-4cbc-a750-b21e7361c9d0 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:14.815068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89a9d73b-5d49-4cbc-a750-b21e7361c9d0 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:14.817312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89a9d73b-5d49-4cbc-a750-b21e7361c9d0 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:14.817880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89a9d73b-5d49-4cbc-a750-b21e7361c9d0 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:15.014214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b6f7243c-e6de-4578-a008-36564e6e257d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:15.015096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b6f7243c-e6de-4578-a008-36564e6e257d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:15.024719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6f7243c-e6de-4578-a008-36564e6e257d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:15.026250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6f7243c-e6de-4578-a008-36564e6e257d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:15.026919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6f7243c-e6de-4578-a008-36564e6e257d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:15.027864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6f7243c-e6de-4578-a008-36564e6e257d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:15.028720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6f7243c-e6de-4578-a008-36564e6e257d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:15.030040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6f7243c-e6de-4578-a008-36564e6e257d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:15.213196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6f7243c-e6de-4578-a008-36564e6e257d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:15.222271 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b6f7243c-e6de-4578-a008-36564e6e257d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.214510 Aug 27 03:18:15.223471 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3220/6259] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:15 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:15.261858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-89a9d73b-5d49-4cbc-a750-b21e7361c9d0 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:15.272929 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-89a9d73b-5d49-4cbc-a750-b21e7361c9d0 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1767 microversion: 2.1 time: 0.480178 Aug 27 03:18:15.287547 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3040/6260] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:14 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1767 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:15.750073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9a27b830-ccef-4f82-8180-f6ec9f846ef5 req-c559e224-5ca0-46b5-a73b-91da4d9516cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b0c957-056f-43a4-b83f-fff9fcc2668a", "name": "network-vif-deleted", "tag": "8d857810-d02d-43be-963b-c2c54d711838"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:15.761700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9a27b830-ccef-4f82-8180-f6ec9f846ef5 req-c559e224-5ca0-46b5-a73b-91da4d9516cf service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:15.762522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9a27b830-ccef-4f82-8180-f6ec9f846ef5 req-c559e224-5ca0-46b5-a73b-91da4d9516cf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:15.762965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9a27b830-ccef-4f82-8180-f6ec9f846ef5 req-c559e224-5ca0-46b5-a73b-91da4d9516cf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:15.780609 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9a27b830-ccef-4f82-8180-f6ec9f846ef5 req-c559e224-5ca0-46b5-a73b-91da4d9516cf service nova] Creating event network-vif-deleted:8d857810-d02d-43be-963b-c2c54d711838 for instance b4b0c957-056f-43a4-b83f-fff9fcc2668a on n-h1-852084-5 Aug 27 03:18:15.790428 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9a27b830-ccef-4f82-8180-f6ec9f846ef5 req-c559e224-5ca0-46b5-a73b-91da4d9516cf service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044306 Aug 27 03:18:15.791142 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3221/6261] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:16.244638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f4f26f9a-534f-4055-95c0-3b09b206cd92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:16.245479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f4f26f9a-534f-4055-95c0-3b09b206cd92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:16.253281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f26f9a-534f-4055-95c0-3b09b206cd92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.253821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f26f9a-534f-4055-95c0-3b09b206cd92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.254274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f26f9a-534f-4055-95c0-3b09b206cd92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.255576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f26f9a-534f-4055-95c0-3b09b206cd92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.256036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f26f9a-534f-4055-95c0-3b09b206cd92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.256464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f4f26f9a-534f-4055-95c0-3b09b206cd92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.296840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:16.298195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:16.310965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.312997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.314618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.319653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.320270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.320998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.419152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:16.419649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:16.420169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:16.421004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lazy-loading 'fault' on Instance uuid b4b0c957-056f-43a4-b83f-fff9fcc2668a {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:18:16.474627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8844887e3d0947968a4cf6997a9e171c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99e9f6cca3147f4a1797bbf7186dafe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:16.487628 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-270f83f4-27aa-4a39-9d35-3e25b8723d28 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 200 len: 1383 microversion: 2.1 time: 0.195859 Aug 27 03:18:16.503377 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3222/6262] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:16 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 1383 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:16.518724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f4f26f9a-534f-4055-95c0-3b09b206cd92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:16.532688 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f4f26f9a-534f-4055-95c0-3b09b206cd92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1168 microversion: 2.1 time: 0.293180 Aug 27 03:18:16.536779 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3041/6263] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:16 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1168 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:17.523883 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:17.525418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] [instance: b4b0c957-056f-43a4-b83f-fff9fcc2668a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:17.533652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.534253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.534691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:17.535544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.536789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.537094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:17.552453 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] HTTP exception thrown: Instance b4b0c957-056f-43a4-b83f-fff9fcc2668a could not be found. Aug 27 03:18:17.558824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b5757b19-3adc-42c9-bf17-7e89671d47d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:17.559777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b5757b19-3adc-42c9-bf17-7e89671d47d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Request method failure captured: Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a HTTP/1.1 Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYyNF60bwNO4Kz18uV4eh72sw5tN3KvNw2w18VyblAk-8xTKQmMPg0dONmGSC9PX3Lq2miA42g-vf-t0axRoULzwsfw7jR63l2gwbvNncvNTqZR8zj7KfskGATm03n3JICBbTsFuSQfy-GrDkR8qXC6iGUUz9xzVzHUlNZGZc5-dZ0Q Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: a99e9f6cca3147f4a1797bbf7186dafe Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-355835762 Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a99e9f6cca3147f4a1797bbf7186dafe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a99e9f6cca3147f4a1797bbf7186dafe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a99e9f6cca3147f4a1797bbf7186dafe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a99e9f6cca3147f4a1797bbf7186dafe"}]}] Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestSecurityGroupsBasicOps-355835762 Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: a99e9f6cca3147f4a1797bbf7186dafe Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-355835762 Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestSecurityGroupsBasicOps-355835762-project Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 8844887e3d0947968a4cf6997a9e171c Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestSecurityGroupsBasicOps-355835762-project Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance b4b0c957-056f-43a4-b83f-fff9fcc2668a could not be found. Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'b4b0c957-056f-43a4-b83f-fff9fcc2668a'} Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b0c957-056f-43a4-b83f-fff9fcc2668a could not be found. Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b0c957-056f-43a4-b83f-fff9fcc2668a could not be found. Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:17.564978 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:18:17.573552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:17.573552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:17.573552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:17.573552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:17.573552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:17.573552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b0c957-056f-43a4-b83f-fff9fcc2668a could not be found. Aug 27 03:18:17.573552 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:18:17.573552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Returning 404 to user: Instance b4b0c957-056f-43a4-b83f-fff9fcc2668a could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:17.573552 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b9edee3d-a57b-4e47-b94b-4b39c8c54343 tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a" status: 404 len: 111 microversion: 2.1 time: 0.048969 Aug 27 03:18:17.573552 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3223/6264] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:17 2022] GET /compute/v2.1/servers/b4b0c957-056f-43a4-b83f-fff9fcc2668a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:17.576340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5757b19-3adc-42c9-bf17-7e89671d47d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.576340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5757b19-3adc-42c9-bf17-7e89671d47d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.576340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5757b19-3adc-42c9-bf17-7e89671d47d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:17.578067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5757b19-3adc-42c9-bf17-7e89671d47d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:17.578640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5757b19-3adc-42c9-bf17-7e89671d47d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:17.579102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5757b19-3adc-42c9-bf17-7e89671d47d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:17.809639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b5757b19-3adc-42c9-bf17-7e89671d47d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:17.821839 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b5757b19-3adc-42c9-bf17-7e89671d47d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1214 microversion: 2.1 time: 0.266935 Aug 27 03:18:17.822811 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3042/6265] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:17 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:18:18.843205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-698a8718-0c4b-4e17-a7cc-4a7c1e9b6af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:18.843906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-698a8718-0c4b-4e17-a7cc-4a7c1e9b6af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:18.851670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-698a8718-0c4b-4e17-a7cc-4a7c1e9b6af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:18.852341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-698a8718-0c4b-4e17-a7cc-4a7c1e9b6af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:18.852848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-698a8718-0c4b-4e17-a7cc-4a7c1e9b6af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:18.853622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-698a8718-0c4b-4e17-a7cc-4a7c1e9b6af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:18.854204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-698a8718-0c4b-4e17-a7cc-4a7c1e9b6af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:18.854698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-698a8718-0c4b-4e17-a7cc-4a7c1e9b6af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:19.094382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-698a8718-0c4b-4e17-a7cc-4a7c1e9b6af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:19.103474 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-698a8718-0c4b-4e17-a7cc-4a7c1e9b6af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1202 microversion: 2.1 time: 0.264164 Aug 27 03:18:19.104500 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3224/6266] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:18 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1202 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:20.130497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2a18ff00-4d6c-460b-88af-7f536cbdb127 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:20.132509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2a18ff00-4d6c-460b-88af-7f536cbdb127 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:20.146421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a18ff00-4d6c-460b-88af-7f536cbdb127 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:20.150865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a18ff00-4d6c-460b-88af-7f536cbdb127 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:20.166008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a18ff00-4d6c-460b-88af-7f536cbdb127 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:20.166008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a18ff00-4d6c-460b-88af-7f536cbdb127 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:20.166008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a18ff00-4d6c-460b-88af-7f536cbdb127 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:20.166008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a18ff00-4d6c-460b-88af-7f536cbdb127 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:20.414128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2a18ff00-4d6c-460b-88af-7f536cbdb127 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:20.429321 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2a18ff00-4d6c-460b-88af-7f536cbdb127 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1202 microversion: 2.1 time: 0.304641 Aug 27 03:18:20.430496 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3043/6267] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:20 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1202 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:21.453740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-326262ed-423f-4679-8f40-2fd755729af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:21.455302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-326262ed-423f-4679-8f40-2fd755729af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:21.477360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-326262ed-423f-4679-8f40-2fd755729af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:21.480699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-326262ed-423f-4679-8f40-2fd755729af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:21.481644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-326262ed-423f-4679-8f40-2fd755729af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:21.482763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-326262ed-423f-4679-8f40-2fd755729af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:21.483786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-326262ed-423f-4679-8f40-2fd755729af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:21.485600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-326262ed-423f-4679-8f40-2fd755729af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:21.760337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-326262ed-423f-4679-8f40-2fd755729af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:21.774643 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-326262ed-423f-4679-8f40-2fd755729af8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1202 microversion: 2.1 time: 0.326592 Aug 27 03:18:21.775633 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3225/6268] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:21 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1202 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:22.010422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-753a398a-5bbc-47b7-b349-07072ad1a96b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] Calling method '.version_select at 0x7f4d2a5c6040>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:22.066063 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-753a398a-5bbc-47b7-b349-07072ad1a96b tempest-TestSecurityGroupsBasicOps-355835762 tempest-TestSecurityGroupsBasicOps-355835762-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1894657716" status: 202 len: 0 microversion: 2.1 time: 0.059499 Aug 27 03:18:22.067034 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3044/6269] 10.222.0.99 () {58 vars in 1278 bytes} [Sat Aug 27 03:18:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1894657716 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:18:22.797166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8bd5e1a4-bd86-463a-959d-01e3805502a1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:22.797942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8bd5e1a4-bd86-463a-959d-01e3805502a1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:22.811614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bd5e1a4-bd86-463a-959d-01e3805502a1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.812408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bd5e1a4-bd86-463a-959d-01e3805502a1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.813033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bd5e1a4-bd86-463a-959d-01e3805502a1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:22.815879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bd5e1a4-bd86-463a-959d-01e3805502a1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:22.816581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bd5e1a4-bd86-463a-959d-01e3805502a1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:22.818239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8bd5e1a4-bd86-463a-959d-01e3805502a1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:23.032916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8bd5e1a4-bd86-463a-959d-01e3805502a1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:23.041465 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8bd5e1a4-bd86-463a-959d-01e3805502a1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1202 microversion: 2.1 time: 0.248586 Aug 27 03:18:23.042084 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3226/6270] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:22 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1202 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:24.063027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de6aa5df-c474-49ed-a409-7a95f55ee46b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:24.063648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de6aa5df-c474-49ed-a409-7a95f55ee46b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:24.074537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de6aa5df-c474-49ed-a409-7a95f55ee46b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:24.075007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de6aa5df-c474-49ed-a409-7a95f55ee46b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:24.075468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de6aa5df-c474-49ed-a409-7a95f55ee46b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:24.076181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de6aa5df-c474-49ed-a409-7a95f55ee46b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:24.076641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de6aa5df-c474-49ed-a409-7a95f55ee46b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:24.077073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de6aa5df-c474-49ed-a409-7a95f55ee46b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:24.291684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-de6aa5df-c474-49ed-a409-7a95f55ee46b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:24.300605 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de6aa5df-c474-49ed-a409-7a95f55ee46b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1202 microversion: 2.1 time: 0.241862 Aug 27 03:18:24.301227 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3045/6271] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:24 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1202 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:25.324333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d334659-de7c-4007-9ab0-1f99e66b3615 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:25.325082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1d334659-de7c-4007-9ab0-1f99e66b3615 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:25.332366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d334659-de7c-4007-9ab0-1f99e66b3615 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.333002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d334659-de7c-4007-9ab0-1f99e66b3615 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.333512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d334659-de7c-4007-9ab0-1f99e66b3615 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:25.334319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d334659-de7c-4007-9ab0-1f99e66b3615 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:25.335109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d334659-de7c-4007-9ab0-1f99e66b3615 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:25.335641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d334659-de7c-4007-9ab0-1f99e66b3615 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:25.473452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1d334659-de7c-4007-9ab0-1f99e66b3615 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:25.482093 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1d334659-de7c-4007-9ab0-1f99e66b3615 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1202 microversion: 2.1 time: 0.161586 Aug 27 03:18:25.482694 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3227/6272] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:25 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:26.507843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e06ca07-00f5-4391-a93f-dc87d46ccb5b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:26.509098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e06ca07-00f5-4391-a93f-dc87d46ccb5b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:26.521962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e06ca07-00f5-4391-a93f-dc87d46ccb5b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.523242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e06ca07-00f5-4391-a93f-dc87d46ccb5b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.524321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e06ca07-00f5-4391-a93f-dc87d46ccb5b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.525855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e06ca07-00f5-4391-a93f-dc87d46ccb5b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:26.526951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e06ca07-00f5-4391-a93f-dc87d46ccb5b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:26.528258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e06ca07-00f5-4391-a93f-dc87d46ccb5b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:26.710815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6e06ca07-00f5-4391-a93f-dc87d46ccb5b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:26.724418 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e06ca07-00f5-4391-a93f-dc87d46ccb5b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1202 microversion: 2.1 time: 0.224454 Aug 27 03:18:26.725049 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3046/6273] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:26 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1202 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:27.745696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b320852c-bb1f-46d3-a3cd-ad77a1d51e32 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:27.746352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b320852c-bb1f-46d3-a3cd-ad77a1d51e32 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:27.760301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b320852c-bb1f-46d3-a3cd-ad77a1d51e32 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.760881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b320852c-bb1f-46d3-a3cd-ad77a1d51e32 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.761761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b320852c-bb1f-46d3-a3cd-ad77a1d51e32 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.762707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b320852c-bb1f-46d3-a3cd-ad77a1d51e32 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:27.763609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b320852c-bb1f-46d3-a3cd-ad77a1d51e32 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:27.764489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b320852c-bb1f-46d3-a3cd-ad77a1d51e32 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:27.953177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b320852c-bb1f-46d3-a3cd-ad77a1d51e32 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:27.964530 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b320852c-bb1f-46d3-a3cd-ad77a1d51e32 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1202 microversion: 2.1 time: 0.222578 Aug 27 03:18:27.965432 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3228/6274] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:27 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1202 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:28.111461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8db157d9-425d-42db-b009-13ce8a3391fe req-b02aa813-ac08-4e76-8aad-0f9b4fd51b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92475dbd-71d9-459d-be61-e0c1e1e00682", "name": "network-vif-plugged", "status": "completed", "tag": "d9f2a33f-3270-416e-a46c-eff4c47f624a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:28.132626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8db157d9-425d-42db-b009-13ce8a3391fe req-b02aa813-ac08-4e76-8aad-0f9b4fd51b01 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:28.133470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8db157d9-425d-42db-b009-13ce8a3391fe req-b02aa813-ac08-4e76-8aad-0f9b4fd51b01 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:28.134162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8db157d9-425d-42db-b009-13ce8a3391fe req-b02aa813-ac08-4e76-8aad-0f9b4fd51b01 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:28.146827 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8db157d9-425d-42db-b009-13ce8a3391fe req-b02aa813-ac08-4e76-8aad-0f9b4fd51b01 service nova] Creating event network-vif-plugged:d9f2a33f-3270-416e-a46c-eff4c47f624a for instance 92475dbd-71d9-459d-be61-e0c1e1e00682 on n-h1-852084-5 Aug 27 03:18:28.152907 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8db157d9-425d-42db-b009-13ce8a3391fe req-b02aa813-ac08-4e76-8aad-0f9b4fd51b01 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046666 Aug 27 03:18:28.153844 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3047/6275] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:28.995823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e89b9680-c026-4e54-8aab-f0a501f7246d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:28.996424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e89b9680-c026-4e54-8aab-f0a501f7246d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:29.003680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e89b9680-c026-4e54-8aab-f0a501f7246d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.004168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e89b9680-c026-4e54-8aab-f0a501f7246d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.005244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e89b9680-c026-4e54-8aab-f0a501f7246d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.006028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e89b9680-c026-4e54-8aab-f0a501f7246d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:29.006483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e89b9680-c026-4e54-8aab-f0a501f7246d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:29.006910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e89b9680-c026-4e54-8aab-f0a501f7246d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:29.144135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e89b9680-c026-4e54-8aab-f0a501f7246d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:29.152323 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e89b9680-c026-4e54-8aab-f0a501f7246d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1202 microversion: 2.1 time: 0.160365 Aug 27 03:18:29.152944 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3229/6276] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:28 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:30.174218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-99515c97-f96b-4e90-be85-344173714b30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:30.174939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-99515c97-f96b-4e90-be85-344173714b30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:30.183550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99515c97-f96b-4e90-be85-344173714b30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.183938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99515c97-f96b-4e90-be85-344173714b30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.184408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99515c97-f96b-4e90-be85-344173714b30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.188014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99515c97-f96b-4e90-be85-344173714b30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.188014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99515c97-f96b-4e90-be85-344173714b30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.188014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-99515c97-f96b-4e90-be85-344173714b30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.330098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-99515c97-f96b-4e90-be85-344173714b30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:30.339766 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-99515c97-f96b-4e90-be85-344173714b30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1389 microversion: 2.1 time: 0.170828 Aug 27 03:18:30.340386 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3048/6277] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:30 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:30.361897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e655d92d-21a6-4c17-b3d6-24eb064ec9ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:30.362523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e655d92d-21a6-4c17-b3d6-24eb064ec9ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:30.369296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e655d92d-21a6-4c17-b3d6-24eb064ec9ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.370061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e655d92d-21a6-4c17-b3d6-24eb064ec9ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.370572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e655d92d-21a6-4c17-b3d6-24eb064ec9ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.371925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e655d92d-21a6-4c17-b3d6-24eb064ec9ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.372603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e655d92d-21a6-4c17-b3d6-24eb064ec9ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.373058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e655d92d-21a6-4c17-b3d6-24eb064ec9ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.377618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:30.516904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e655d92d-21a6-4c17-b3d6-24eb064ec9ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:30.525172 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e655d92d-21a6-4c17-b3d6-24eb064ec9ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1389 microversion: 2.1 time: 0.167959 Aug 27 03:18:30.525861 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3230/6278] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:30 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:30.545141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-23638929-4c38-4733-a0c2-1d6f0f7e4d52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:30.545964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-23638929-4c38-4733-a0c2-1d6f0f7e4d52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:30.552843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23638929-4c38-4733-a0c2-1d6f0f7e4d52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.553357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23638929-4c38-4733-a0c2-1d6f0f7e4d52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.553839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23638929-4c38-4733-a0c2-1d6f0f7e4d52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.554539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23638929-4c38-4733-a0c2-1d6f0f7e4d52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.554997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23638929-4c38-4733-a0c2-1d6f0f7e4d52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.555425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-23638929-4c38-4733-a0c2-1d6f0f7e4d52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.702505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-23638929-4c38-4733-a0c2-1d6f0f7e4d52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:30.711896 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-23638929-4c38-4733-a0c2-1d6f0f7e4d52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1389 microversion: 2.1 time: 0.170630 Aug 27 03:18:30.712591 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3049/6279] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:30 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:30.797213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c926186a-ad00-4ec4-9154-a1c42ed25b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:30.797846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c926186a-ad00-4ec4-9154-a1c42ed25b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:30.805501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c926186a-ad00-4ec4-9154-a1c42ed25b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.806149 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c926186a-ad00-4ec4-9154-a1c42ed25b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.806815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c926186a-ad00-4ec4-9154-a1c42ed25b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.807704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c926186a-ad00-4ec4-9154-a1c42ed25b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.808176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c926186a-ad00-4ec4-9154-a1c42ed25b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.808610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c926186a-ad00-4ec4-9154-a1c42ed25b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.837648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c926186a-ad00-4ec4-9154-a1c42ed25b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:18:30.927050 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c926186a-ad00-4ec4-9154-a1c42ed25b28 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 204 len: 0 microversion: 2.1 time: 0.133034 Aug 27 03:18:30.927695 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3231/6280] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:30 2022] DELETE /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:18:30.935942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8c25b8ed-cc85-4e75-b523-82f472310de3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:30.936624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8c25b8ed-cc85-4e75-b523-82f472310de3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:30.942922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c25b8ed-cc85-4e75-b523-82f472310de3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.943491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c25b8ed-cc85-4e75-b523-82f472310de3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.943886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c25b8ed-cc85-4e75-b523-82f472310de3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:30.944595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c25b8ed-cc85-4e75-b523-82f472310de3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:30.945060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c25b8ed-cc85-4e75-b523-82f472310de3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:30.945492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8c25b8ed-cc85-4e75-b523-82f472310de3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:31.099255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8c25b8ed-cc85-4e75-b523-82f472310de3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:31.108024 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8c25b8ed-cc85-4e75-b523-82f472310de3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1395 microversion: 2.1 time: 0.176080 Aug 27 03:18:31.108610 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3050/6281] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:30 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1395 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:32.130299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-44a44f7e-65b9-4462-a062-7f1ad8d967fd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:32.131046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-44a44f7e-65b9-4462-a062-7f1ad8d967fd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:32.138060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a44f7e-65b9-4462-a062-7f1ad8d967fd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.138559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a44f7e-65b9-4462-a062-7f1ad8d967fd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.139009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a44f7e-65b9-4462-a062-7f1ad8d967fd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.139805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a44f7e-65b9-4462-a062-7f1ad8d967fd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:32.140282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a44f7e-65b9-4462-a062-7f1ad8d967fd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:32.140718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-44a44f7e-65b9-4462-a062-7f1ad8d967fd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:32.283606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-44a44f7e-65b9-4462-a062-7f1ad8d967fd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:32.292353 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-44a44f7e-65b9-4462-a062-7f1ad8d967fd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1395 microversion: 2.1 time: 0.166311 Aug 27 03:18:32.292950 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3232/6282] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:32 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1395 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:33.037920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-cfd6032f-e04f-48b5-a504-1c369c04161b req-9a60380c-36dd-4b9d-8a57-bd88b9c477c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92475dbd-71d9-459d-be61-e0c1e1e00682", "name": "network-vif-deleted", "tag": "d9f2a33f-3270-416e-a46c-eff4c47f624a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:18:33.051058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cfd6032f-e04f-48b5-a504-1c369c04161b req-9a60380c-36dd-4b9d-8a57-bd88b9c477c1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.051544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cfd6032f-e04f-48b5-a504-1c369c04161b req-9a60380c-36dd-4b9d-8a57-bd88b9c477c1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.052203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cfd6032f-e04f-48b5-a504-1c369c04161b req-9a60380c-36dd-4b9d-8a57-bd88b9c477c1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.073326 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-cfd6032f-e04f-48b5-a504-1c369c04161b req-9a60380c-36dd-4b9d-8a57-bd88b9c477c1 service nova] Creating event network-vif-deleted:d9f2a33f-3270-416e-a46c-eff4c47f624a for instance 92475dbd-71d9-459d-be61-e0c1e1e00682 on n-h1-852084-5 Aug 27 03:18:33.079957 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-cfd6032f-e04f-48b5-a504-1c369c04161b req-9a60380c-36dd-4b9d-8a57-bd88b9c477c1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046364 Aug 27 03:18:33.080580 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3051/6283] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:18:33.312733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e6d8e82f-79b6-4f73-8ea2-9df1510dc33c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:33.313953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e6d8e82f-79b6-4f73-8ea2-9df1510dc33c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:33.322111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6d8e82f-79b6-4f73-8ea2-9df1510dc33c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.322617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6d8e82f-79b6-4f73-8ea2-9df1510dc33c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.323062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6d8e82f-79b6-4f73-8ea2-9df1510dc33c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.323789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6d8e82f-79b6-4f73-8ea2-9df1510dc33c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:33.324250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6d8e82f-79b6-4f73-8ea2-9df1510dc33c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:33.324680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e6d8e82f-79b6-4f73-8ea2-9df1510dc33c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:33.397789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e6d8e82f-79b6-4f73-8ea2-9df1510dc33c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:33.406370 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e6d8e82f-79b6-4f73-8ea2-9df1510dc33c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1187 microversion: 2.1 time: 0.097712 Aug 27 03:18:33.407105 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3233/6284] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:33 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:34.428161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8d308948-9f18-4ea1-bb4f-03a59e1c1402 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:34.429872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8d308948-9f18-4ea1-bb4f-03a59e1c1402 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:34.437264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d308948-9f18-4ea1-bb4f-03a59e1c1402 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.437875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d308948-9f18-4ea1-bb4f-03a59e1c1402 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.438388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d308948-9f18-4ea1-bb4f-03a59e1c1402 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.439366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d308948-9f18-4ea1-bb4f-03a59e1c1402 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:34.440078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d308948-9f18-4ea1-bb4f-03a59e1c1402 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:34.440585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8d308948-9f18-4ea1-bb4f-03a59e1c1402 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:34.510509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8d308948-9f18-4ea1-bb4f-03a59e1c1402 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:34.518690 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8d308948-9f18-4ea1-bb4f-03a59e1c1402 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1187 microversion: 2.1 time: 0.095136 Aug 27 03:18:34.519355 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3052/6285] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:34 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:35.541020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-285b8e5f-0612-4308-9966-f74f8e9d9d02 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:35.541579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-285b8e5f-0612-4308-9966-f74f8e9d9d02 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:35.549939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285b8e5f-0612-4308-9966-f74f8e9d9d02 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.550710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285b8e5f-0612-4308-9966-f74f8e9d9d02 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.552235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285b8e5f-0612-4308-9966-f74f8e9d9d02 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.553186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285b8e5f-0612-4308-9966-f74f8e9d9d02 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:35.553860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285b8e5f-0612-4308-9966-f74f8e9d9d02 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:35.554482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-285b8e5f-0612-4308-9966-f74f8e9d9d02 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:35.648563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-285b8e5f-0612-4308-9966-f74f8e9d9d02 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:35.659576 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-285b8e5f-0612-4308-9966-f74f8e9d9d02 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1187 microversion: 2.1 time: 0.122570 Aug 27 03:18:35.661524 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3234/6286] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:35 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1187 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:36.682154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-79860437-0f55-44ff-bd25-41c65596e64a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:36.683827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-79860437-0f55-44ff-bd25-41c65596e64a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:36.696932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79860437-0f55-44ff-bd25-41c65596e64a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:36.697914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79860437-0f55-44ff-bd25-41c65596e64a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:36.698555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79860437-0f55-44ff-bd25-41c65596e64a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:36.699465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79860437-0f55-44ff-bd25-41c65596e64a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:36.700199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79860437-0f55-44ff-bd25-41c65596e64a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:36.700804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79860437-0f55-44ff-bd25-41c65596e64a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:36.790420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-79860437-0f55-44ff-bd25-41c65596e64a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:36.811788 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-79860437-0f55-44ff-bd25-41c65596e64a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1187 microversion: 2.1 time: 0.130688 Aug 27 03:18:36.823491 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3053/6287] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:36 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1187 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:37.833817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:37.834364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:37.841835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:37.842345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:37.842794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:37.843516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:37.843983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:37.844420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:37.881225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:37.882183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:37.882632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:37.883187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lazy-loading 'fault' on Instance uuid 92475dbd-71d9-459d-be61-e0c1e1e00682 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:18:37.948088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:18:37.958612 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-862bc897-5d4b-4399-b7a5-8cd4d8d93f49 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 200 len: 1192 microversion: 2.1 time: 0.130062 Aug 27 03:18:37.974973 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3235/6288] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:37 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 1192 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:18:38.986388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:38.987315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:38.997262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:38.998987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:38.999643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.000540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:39.001172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:39.001942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:39.009640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=93 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:18:39.027925 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 HTTP/1.1 Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '92475dbd-71d9-459d-be61-e0c1e1e00682'} Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:39.030251 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:39.036369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:39.036369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:39.036369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:39.036369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:39.036369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:39.036369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:39.036369 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:39.039504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:39.040584 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2a06c85a-a796-42a7-b3cd-dd3f68470aaa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 404 len: 111 microversion: 2.1 time: 0.059564 Aug 27 03:18:39.044946 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3054/6289] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:38 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:41.218224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:41.218802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:41.226619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:41.227347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:41.228136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:41.229181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:41.229691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:41.230131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:41.249099 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 HTTP/1.1 Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '92475dbd-71d9-459d-be61-e0c1e1e00682'} Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:41.250838 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:41.256932 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-95c9c75d-5ec7-450d-9589-e09ff25c91cf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 404 len: 111 microversion: 2.1 time: 0.038064 Aug 27 03:18:41.258134 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3236/6290] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:18:41 2022] DELETE /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:18:41.261921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:18:41.262635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 92475dbd-71d9-459d-be61-e0c1e1e00682] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:18:41.269780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:41.270282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:41.270727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:41.271441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:18:41.271907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:18:41.272341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:18:41.286922 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 HTTP/1.1 Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '92475dbd-71d9-459d-be61-e0c1e1e00682'} Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:18:41.288683 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.294248 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:18:41.294248 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:18:41.294248 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:18:41.294248 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:18:41.294248 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:18:41.294248 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. Aug 27 03:18:41.294248 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:18:41.294248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance 92475dbd-71d9-459d-be61-e0c1e1e00682 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:18:41.294248 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-001bf728-3658-47a6-90b1-836a18cd1a03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682" status: 404 len: 111 microversion: 2.1 time: 0.032367 Aug 27 03:18:41.294248 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3055/6291] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:18:41 2022] GET /compute/v2.1/servers/92475dbd-71d9-459d-be61-e0c1e1e00682 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:19:03.488602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-835579745", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "72e85567-08ec-4cdc-abbb-8a196a71167a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "9f6cd27d-8b3c-456e-af66-44212888909f"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:03.513796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:03.515070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:03.587016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] validate_networks() for [('9f6cd27d-8b3c-456e-af66-44212888909f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:19:04.050050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:19:04.050742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:19:04.051332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:19:04.051818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:19:04.052302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:19:04.063580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.064070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.064516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.065240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:04.065717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:04.066679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:04.086694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:19:04.092514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for user 0a78655bea27452faee67a7efd476175 and project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:19:04.163844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:19:04.167482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72e85567-08ec-4cdc-abbb-8a196a71167a',volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:19:04.376816 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-86441edf-9b7b-485a-b6b7-ad33664e072a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895164 Aug 27 03:19:04.378262 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3237/6292] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:19:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:19:04.393407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-733d7241-c5e9-4b12-9b54-ea4637c154f0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:04.393407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-733d7241-c5e9-4b12-9b54-ea4637c154f0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:04.397773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:04.398853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:04.466727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-733d7241-c5e9-4b12-9b54-ea4637c154f0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:04.476886 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-733d7241-c5e9-4b12-9b54-ea4637c154f0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1070 microversion: 2.1 time: 0.088335 Aug 27 03:19:04.477624 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3056/6293] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:04 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1070 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:05.512024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-117daaaa-3cb8-4db0-814b-67ec88a17b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:05.513360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-117daaaa-3cb8-4db0-814b-67ec88a17b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:05.522383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-117daaaa-3cb8-4db0-814b-67ec88a17b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.522929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-117daaaa-3cb8-4db0-814b-67ec88a17b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.523303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-117daaaa-3cb8-4db0-814b-67ec88a17b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.524033 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-117daaaa-3cb8-4db0-814b-67ec88a17b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:05.524510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-117daaaa-3cb8-4db0-814b-67ec88a17b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:05.524920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-117daaaa-3cb8-4db0-814b-67ec88a17b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:05.647760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-117daaaa-3cb8-4db0-814b-67ec88a17b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:05.667211 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-117daaaa-3cb8-4db0-814b-67ec88a17b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1168 microversion: 2.1 time: 0.160771 Aug 27 03:19:05.668166 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3238/6294] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:05 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:06.696255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0f3ecc47-2096-4690-95aa-2a75f0dbcd52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:06.698573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0f3ecc47-2096-4690-95aa-2a75f0dbcd52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:06.720020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f3ecc47-2096-4690-95aa-2a75f0dbcd52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.721244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f3ecc47-2096-4690-95aa-2a75f0dbcd52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.723144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f3ecc47-2096-4690-95aa-2a75f0dbcd52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.724212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f3ecc47-2096-4690-95aa-2a75f0dbcd52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:06.724920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f3ecc47-2096-4690-95aa-2a75f0dbcd52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:06.725819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0f3ecc47-2096-4690-95aa-2a75f0dbcd52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:06.974278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0f3ecc47-2096-4690-95aa-2a75f0dbcd52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:06.982913 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0f3ecc47-2096-4690-95aa-2a75f0dbcd52 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1228 microversion: 2.1 time: 0.297245 Aug 27 03:19:06.985688 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3057/6295] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:06 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1228 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:07.235205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-42e9e26d-8218-4610-9482-42a218168130 req-83c173b0-e6d3-48d9-8019-6af8d17b4c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aea1028b-b6d8-490d-b892-68ea49cedd8b", "tag": "dbfc8d6d-cb0a-4b03-9ff8-12b278c36f73"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:07.247225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-42e9e26d-8218-4610-9482-42a218168130 req-83c173b0-e6d3-48d9-8019-6af8d17b4c47 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:07.248021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-42e9e26d-8218-4610-9482-42a218168130 req-83c173b0-e6d3-48d9-8019-6af8d17b4c47 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:07.248651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-42e9e26d-8218-4610-9482-42a218168130 req-83c173b0-e6d3-48d9-8019-6af8d17b4c47 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:07.261418 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-42e9e26d-8218-4610-9482-42a218168130 req-83c173b0-e6d3-48d9-8019-6af8d17b4c47 service nova] Creating event network-changed:dbfc8d6d-cb0a-4b03-9ff8-12b278c36f73 for instance aea1028b-b6d8-490d-b892-68ea49cedd8b on n-h2-852084-5 Aug 27 03:19:07.267834 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-42e9e26d-8218-4610-9482-42a218168130 req-83c173b0-e6d3-48d9-8019-6af8d17b4c47 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036271 Aug 27 03:19:07.268628 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3239/6296] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:08.009384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0064f74a-edd0-42f2-a68f-a7307e0c3d05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:08.011123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0064f74a-edd0-42f2-a68f-a7307e0c3d05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:08.019891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0064f74a-edd0-42f2-a68f-a7307e0c3d05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:08.020834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0064f74a-edd0-42f2-a68f-a7307e0c3d05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:08.021500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0064f74a-edd0-42f2-a68f-a7307e0c3d05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:08.023128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0064f74a-edd0-42f2-a68f-a7307e0c3d05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:08.023986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0064f74a-edd0-42f2-a68f-a7307e0c3d05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:08.024708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0064f74a-edd0-42f2-a68f-a7307e0c3d05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:08.274193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0064f74a-edd0-42f2-a68f-a7307e0c3d05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:08.284820 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0064f74a-edd0-42f2-a68f-a7307e0c3d05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1228 microversion: 2.1 time: 0.279756 Aug 27 03:19:08.309324 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3058/6297] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:08 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1228 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:09.313571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-743aaf21-0113-4a96-be93-74f10320e876 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:09.314739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-743aaf21-0113-4a96-be93-74f10320e876 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:09.325124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-743aaf21-0113-4a96-be93-74f10320e876 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:09.325970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-743aaf21-0113-4a96-be93-74f10320e876 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:09.326649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-743aaf21-0113-4a96-be93-74f10320e876 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:09.327760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-743aaf21-0113-4a96-be93-74f10320e876 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:09.328925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-743aaf21-0113-4a96-be93-74f10320e876 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:09.329611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-743aaf21-0113-4a96-be93-74f10320e876 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:09.563637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-743aaf21-0113-4a96-be93-74f10320e876 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:09.577876 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-743aaf21-0113-4a96-be93-74f10320e876 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1228 microversion: 2.1 time: 0.272900 Aug 27 03:19:09.579572 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3240/6298] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:09 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1228 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:10.616308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ccf9e64-7b13-4f63-993b-5c9ed4c8703a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:10.617156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ccf9e64-7b13-4f63-993b-5c9ed4c8703a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:10.625520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ccf9e64-7b13-4f63-993b-5c9ed4c8703a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:10.626072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ccf9e64-7b13-4f63-993b-5c9ed4c8703a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:10.626533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ccf9e64-7b13-4f63-993b-5c9ed4c8703a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:10.627273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ccf9e64-7b13-4f63-993b-5c9ed4c8703a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:10.628183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ccf9e64-7b13-4f63-993b-5c9ed4c8703a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:10.631538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ccf9e64-7b13-4f63-993b-5c9ed4c8703a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:10.814343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ccf9e64-7b13-4f63-993b-5c9ed4c8703a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:10.824279 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ccf9e64-7b13-4f63-993b-5c9ed4c8703a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1228 microversion: 2.1 time: 0.211936 Aug 27 03:19:10.825455 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3059/6299] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:10 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1228 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:11.847143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-16d60594-8fd2-4430-881c-9f5ac3d1f0f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:11.848496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-16d60594-8fd2-4430-881c-9f5ac3d1f0f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:11.859285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16d60594-8fd2-4430-881c-9f5ac3d1f0f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:11.860764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16d60594-8fd2-4430-881c-9f5ac3d1f0f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:11.861753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16d60594-8fd2-4430-881c-9f5ac3d1f0f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:11.862759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16d60594-8fd2-4430-881c-9f5ac3d1f0f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:11.863330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16d60594-8fd2-4430-881c-9f5ac3d1f0f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:11.863957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-16d60594-8fd2-4430-881c-9f5ac3d1f0f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:12.086585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-16d60594-8fd2-4430-881c-9f5ac3d1f0f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:12.102438 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-16d60594-8fd2-4430-881c-9f5ac3d1f0f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1228 microversion: 2.1 time: 0.259334 Aug 27 03:19:12.103051 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3241/6300] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:11 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1228 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:13.124744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c009793e-b8d8-4928-8276-1d855ce70ee5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:13.125559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c009793e-b8d8-4928-8276-1d855ce70ee5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:13.136120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c009793e-b8d8-4928-8276-1d855ce70ee5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:13.136977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c009793e-b8d8-4928-8276-1d855ce70ee5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:13.137766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c009793e-b8d8-4928-8276-1d855ce70ee5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:13.138980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c009793e-b8d8-4928-8276-1d855ce70ee5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:13.139816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c009793e-b8d8-4928-8276-1d855ce70ee5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:13.140676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c009793e-b8d8-4928-8276-1d855ce70ee5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:13.293944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c009793e-b8d8-4928-8276-1d855ce70ee5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:13.303324 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c009793e-b8d8-4928-8276-1d855ce70ee5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1216 microversion: 2.1 time: 0.182654 Aug 27 03:19:13.304182 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3060/6301] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:13 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1216 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:14.342252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aa64b724-7ae7-46f4-be6a-81df3bc59875 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:14.343588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aa64b724-7ae7-46f4-be6a-81df3bc59875 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:14.349412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:14.350712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:14.363309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa64b724-7ae7-46f4-be6a-81df3bc59875 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:14.364081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa64b724-7ae7-46f4-be6a-81df3bc59875 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:14.364908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa64b724-7ae7-46f4-be6a-81df3bc59875 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:14.366346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa64b724-7ae7-46f4-be6a-81df3bc59875 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:14.367266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa64b724-7ae7-46f4-be6a-81df3bc59875 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:14.368037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa64b724-7ae7-46f4-be6a-81df3bc59875 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:14.567540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa64b724-7ae7-46f4-be6a-81df3bc59875 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:14.581376 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aa64b724-7ae7-46f4-be6a-81df3bc59875 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1216 microversion: 2.1 time: 0.245646 Aug 27 03:19:14.582443 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3242/6302] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:14 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1216 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:15.615135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8b04d900-5672-4145-a4da-d6765d63158b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:15.616547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8b04d900-5672-4145-a4da-d6765d63158b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:15.619628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:15.626062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b04d900-5672-4145-a4da-d6765d63158b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:15.626566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b04d900-5672-4145-a4da-d6765d63158b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:15.627015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b04d900-5672-4145-a4da-d6765d63158b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:15.627741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b04d900-5672-4145-a4da-d6765d63158b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:15.628223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b04d900-5672-4145-a4da-d6765d63158b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:15.629207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b04d900-5672-4145-a4da-d6765d63158b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:15.813260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8b04d900-5672-4145-a4da-d6765d63158b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:15.824916 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8b04d900-5672-4145-a4da-d6765d63158b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1216 microversion: 2.1 time: 0.214442 Aug 27 03:19:15.825525 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3061/6303] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:15 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1216 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:16.851326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d1bd7ec1-545f-4961-b591-e6b886c60115 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:16.852810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d1bd7ec1-545f-4961-b591-e6b886c60115 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:16.862924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1bd7ec1-545f-4961-b591-e6b886c60115 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:16.863786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1bd7ec1-545f-4961-b591-e6b886c60115 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:16.864467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1bd7ec1-545f-4961-b591-e6b886c60115 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:16.865490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1bd7ec1-545f-4961-b591-e6b886c60115 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:16.866085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1bd7ec1-545f-4961-b591-e6b886c60115 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:16.866575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d1bd7ec1-545f-4961-b591-e6b886c60115 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:17.020096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d1bd7ec1-545f-4961-b591-e6b886c60115 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:17.033124 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d1bd7ec1-545f-4961-b591-e6b886c60115 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1216 microversion: 2.1 time: 0.188969 Aug 27 03:19:17.043263 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3243/6304] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:16 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1216 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:18.055778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bbe97d3f-37de-4e70-a15a-66d08e39e284 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:18.056460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bbe97d3f-37de-4e70-a15a-66d08e39e284 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:18.063861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbe97d3f-37de-4e70-a15a-66d08e39e284 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:18.064365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbe97d3f-37de-4e70-a15a-66d08e39e284 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:18.064798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbe97d3f-37de-4e70-a15a-66d08e39e284 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:18.065489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbe97d3f-37de-4e70-a15a-66d08e39e284 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:18.065985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbe97d3f-37de-4e70-a15a-66d08e39e284 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:18.066417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bbe97d3f-37de-4e70-a15a-66d08e39e284 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:18.245341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bbe97d3f-37de-4e70-a15a-66d08e39e284 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:18.258815 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bbe97d3f-37de-4e70-a15a-66d08e39e284 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1216 microversion: 2.1 time: 0.206737 Aug 27 03:19:18.259862 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3062/6305] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:18 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1216 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:19.280623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1bb8536-5b62-4543-8e6b-f9d9b76855db tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:19.281250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a1bb8536-5b62-4543-8e6b-f9d9b76855db tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:19.288536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1bb8536-5b62-4543-8e6b-f9d9b76855db tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:19.289030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1bb8536-5b62-4543-8e6b-f9d9b76855db tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:19.289479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1bb8536-5b62-4543-8e6b-f9d9b76855db tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:19.290293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1bb8536-5b62-4543-8e6b-f9d9b76855db tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:19.290756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1bb8536-5b62-4543-8e6b-f9d9b76855db tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:19.291192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1bb8536-5b62-4543-8e6b-f9d9b76855db tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:19.456674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a1bb8536-5b62-4543-8e6b-f9d9b76855db tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:19.465568 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a1bb8536-5b62-4543-8e6b-f9d9b76855db tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1216 microversion: 2.1 time: 0.188792 Aug 27 03:19:19.466228 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3244/6306] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:19 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1216 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:20.496117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3f2008a-e2ed-45b5-a561-66d4f39c8b2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:20.496881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c3f2008a-e2ed-45b5-a561-66d4f39c8b2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:20.504696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f2008a-e2ed-45b5-a561-66d4f39c8b2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:20.505845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f2008a-e2ed-45b5-a561-66d4f39c8b2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:20.505845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f2008a-e2ed-45b5-a561-66d4f39c8b2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:20.506536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f2008a-e2ed-45b5-a561-66d4f39c8b2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:20.506997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f2008a-e2ed-45b5-a561-66d4f39c8b2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:20.507427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c3f2008a-e2ed-45b5-a561-66d4f39c8b2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:20.665071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c3f2008a-e2ed-45b5-a561-66d4f39c8b2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:20.673797 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c3f2008a-e2ed-45b5-a561-66d4f39c8b2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1216 microversion: 2.1 time: 0.181409 Aug 27 03:19:20.674499 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3063/6307] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:20 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:21.697278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-54b26bf2-277d-4713-87b2-2d3d7243c81f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:21.698167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-54b26bf2-277d-4713-87b2-2d3d7243c81f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:21.705350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54b26bf2-277d-4713-87b2-2d3d7243c81f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:21.706101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54b26bf2-277d-4713-87b2-2d3d7243c81f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:21.706689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54b26bf2-277d-4713-87b2-2d3d7243c81f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:21.707488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54b26bf2-277d-4713-87b2-2d3d7243c81f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:21.708026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54b26bf2-277d-4713-87b2-2d3d7243c81f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:21.708610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-54b26bf2-277d-4713-87b2-2d3d7243c81f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:21.880826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-54b26bf2-277d-4713-87b2-2d3d7243c81f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:21.890109 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-54b26bf2-277d-4713-87b2-2d3d7243c81f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1216 microversion: 2.1 time: 0.197974 Aug 27 03:19:21.891549 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3245/6308] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:21 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1216 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:22.327366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7c0c1ee4-d50a-4344-989e-fb393100b5f9 req-b6501cc3-5ae2-474b-9cbe-8cbd23878be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea1028b-b6d8-490d-b892-68ea49cedd8b", "name": "network-vif-plugged", "status": "completed", "tag": "dbfc8d6d-cb0a-4b03-9ff8-12b278c36f73"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:22.343152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7c0c1ee4-d50a-4344-989e-fb393100b5f9 req-b6501cc3-5ae2-474b-9cbe-8cbd23878be2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:22.349400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7c0c1ee4-d50a-4344-989e-fb393100b5f9 req-b6501cc3-5ae2-474b-9cbe-8cbd23878be2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:22.350028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7c0c1ee4-d50a-4344-989e-fb393100b5f9 req-b6501cc3-5ae2-474b-9cbe-8cbd23878be2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:22.372985 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7c0c1ee4-d50a-4344-989e-fb393100b5f9 req-b6501cc3-5ae2-474b-9cbe-8cbd23878be2 service nova] Creating event network-vif-plugged:dbfc8d6d-cb0a-4b03-9ff8-12b278c36f73 for instance aea1028b-b6d8-490d-b892-68ea49cedd8b on n-h2-852084-5 Aug 27 03:19:22.379953 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7c0c1ee4-d50a-4344-989e-fb393100b5f9 req-b6501cc3-5ae2-474b-9cbe-8cbd23878be2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055779 Aug 27 03:19:22.382193 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3064/6309] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:22.911472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a7b8731-4676-4214-be25-2d941c98af30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:22.912066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4a7b8731-4676-4214-be25-2d941c98af30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:22.919281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a7b8731-4676-4214-be25-2d941c98af30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:22.919767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a7b8731-4676-4214-be25-2d941c98af30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:22.920208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a7b8731-4676-4214-be25-2d941c98af30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:22.920907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a7b8731-4676-4214-be25-2d941c98af30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:22.921366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a7b8731-4676-4214-be25-2d941c98af30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:22.921912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a7b8731-4676-4214-be25-2d941c98af30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:23.061843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4a7b8731-4676-4214-be25-2d941c98af30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:23.072568 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a7b8731-4676-4214-be25-2d941c98af30 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1216 microversion: 2.1 time: 0.164898 Aug 27 03:19:23.073289 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3246/6310] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:22 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:24.100784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-92e5276c-c695-4b99-85a1-99914ba49185 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:24.102315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-92e5276c-c695-4b99-85a1-99914ba49185 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:24.111629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92e5276c-c695-4b99-85a1-99914ba49185 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:24.112257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92e5276c-c695-4b99-85a1-99914ba49185 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:24.113310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92e5276c-c695-4b99-85a1-99914ba49185 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:24.114077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92e5276c-c695-4b99-85a1-99914ba49185 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:24.114542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92e5276c-c695-4b99-85a1-99914ba49185 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:24.114980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-92e5276c-c695-4b99-85a1-99914ba49185 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:24.302543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-92e5276c-c695-4b99-85a1-99914ba49185 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:24.312442 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-92e5276c-c695-4b99-85a1-99914ba49185 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1404 microversion: 2.1 time: 0.220601 Aug 27 03:19:24.313403 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3065/6311] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:24 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:24.336074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a55336b9-9505-44ed-913c-8eb5e87d97a0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:24.337150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a55336b9-9505-44ed-913c-8eb5e87d97a0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:24.345355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a55336b9-9505-44ed-913c-8eb5e87d97a0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:24.346089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a55336b9-9505-44ed-913c-8eb5e87d97a0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:24.346597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a55336b9-9505-44ed-913c-8eb5e87d97a0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:24.348027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a55336b9-9505-44ed-913c-8eb5e87d97a0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:24.348558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a55336b9-9505-44ed-913c-8eb5e87d97a0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:24.349049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a55336b9-9505-44ed-913c-8eb5e87d97a0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:24.529734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a55336b9-9505-44ed-913c-8eb5e87d97a0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:24.540679 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a55336b9-9505-44ed-913c-8eb5e87d97a0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1404 microversion: 2.1 time: 0.209582 Aug 27 03:19:24.541592 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3247/6312] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:24 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1404 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:24.562382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-120307829"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:24.564832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:24.571521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:24.572030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:24.572489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:24.573508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:24.573728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:24.574201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:24.681386 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.compute.api [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Attempting to quiesce instance before volume snapshot. Aug 27 03:19:24.743398 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.compute.api [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 27 03:19:24.822424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Creating snapshot from volume 72e85567-08ec-4cdc-abbb-8a196a71167a. {{(pid=122487) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 27 03:19:25.884008 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cd4118cc-3837-481e-aeca-490acd4c4fb6 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "POST /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b/action" status: 202 len: 0 microversion: 2.1 time: 1.325495 Aug 27 03:19:25.890212 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3066/6313] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:19:24 2022] POST /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b/action => generated 0 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 03:19:27.104350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-416468568", "imageRef": "f74e2646-de78-4f21-818f-f920d110fde2", "flavorRef": "452", "networks": [{"uuid": "9f6cd27d-8b3c-456e-af66-44212888909f"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:27.190620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] validate_networks() for [('9f6cd27d-8b3c-456e-af66-44212888909f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:19:27.694935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:19:27.695296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:19:27.695776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:19:27.696190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:19:27.696617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:19:27.707707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:27.708344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:27.708744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:27.709499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:27.710268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:27.710700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:27.732579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:19:27.740048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for user 0a78655bea27452faee67a7efd476175 and project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:19:27.755434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:19:27.758146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ef3fe905-1b61-41bb-9e4c-3860cd88e9c4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:19:27.844890 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4834fd78-6988-4f39-996b-7f881ff5885c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745192 Aug 27 03:19:27.845777 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3248/6314] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:19:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:19:27.859011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e8ffd84-64bd-45e5-88ef-86d88d18f2b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:27.860560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2e8ffd84-64bd-45e5-88ef-86d88d18f2b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:27.959800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2e8ffd84-64bd-45e5-88ef-86d88d18f2b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:27.979831 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e8ffd84-64bd-45e5-88ef-86d88d18f2b7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1229 microversion: 2.1 time: 0.125745 Aug 27 03:19:27.993403 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3067/6315] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:27 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1229 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:29.015720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f3a696f-0eaf-4a69-b7dc-6a205ccc0fd9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:29.016500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9f3a696f-0eaf-4a69-b7dc-6a205ccc0fd9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:29.030632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f3a696f-0eaf-4a69-b7dc-6a205ccc0fd9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:29.031132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f3a696f-0eaf-4a69-b7dc-6a205ccc0fd9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:29.031576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f3a696f-0eaf-4a69-b7dc-6a205ccc0fd9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:29.032327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f3a696f-0eaf-4a69-b7dc-6a205ccc0fd9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:29.032770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f3a696f-0eaf-4a69-b7dc-6a205ccc0fd9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:29.033203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f3a696f-0eaf-4a69-b7dc-6a205ccc0fd9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:29.114742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9f3a696f-0eaf-4a69-b7dc-6a205ccc0fd9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:29.125633 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9f3a696f-0eaf-4a69-b7dc-6a205ccc0fd9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1281 microversion: 2.1 time: 0.113729 Aug 27 03:19:29.126770 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3249/6316] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:29 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:30.148725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0456578c-cefa-49ec-b25a-f0a9d425dc36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:30.149524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0456578c-cefa-49ec-b25a-f0a9d425dc36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:30.169007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0456578c-cefa-49ec-b25a-f0a9d425dc36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:30.170113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0456578c-cefa-49ec-b25a-f0a9d425dc36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:30.170930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0456578c-cefa-49ec-b25a-f0a9d425dc36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:30.174256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0456578c-cefa-49ec-b25a-f0a9d425dc36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:30.175249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0456578c-cefa-49ec-b25a-f0a9d425dc36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:30.176103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0456578c-cefa-49ec-b25a-f0a9d425dc36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:30.579128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0456578c-cefa-49ec-b25a-f0a9d425dc36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:30.592609 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0456578c-cefa-49ec-b25a-f0a9d425dc36 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.447663 Aug 27 03:19:30.598054 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3068/6317] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:30 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:31.228535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-0f7dc00c-7068-4eee-b2d4-1c7382ebbfeb req-dbf29238-3541-4049-be30-c331049d5d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619c07ea-f854-49bf-a503-6769dfc106ba", "tag": "8c8c7c03-6130-408c-bcb6-990051d8fd03"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:31.246697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0f7dc00c-7068-4eee-b2d4-1c7382ebbfeb req-dbf29238-3541-4049-be30-c331049d5d2a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:31.247109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0f7dc00c-7068-4eee-b2d4-1c7382ebbfeb req-dbf29238-3541-4049-be30-c331049d5d2a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:31.247546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0f7dc00c-7068-4eee-b2d4-1c7382ebbfeb req-dbf29238-3541-4049-be30-c331049d5d2a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:31.259583 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-0f7dc00c-7068-4eee-b2d4-1c7382ebbfeb req-dbf29238-3541-4049-be30-c331049d5d2a service nova] Creating event network-changed:8c8c7c03-6130-408c-bcb6-990051d8fd03 for instance 619c07ea-f854-49bf-a503-6769dfc106ba on n-h1-852084-5 Aug 27 03:19:31.264498 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-0f7dc00c-7068-4eee-b2d4-1c7382ebbfeb req-dbf29238-3541-4049-be30-c331049d5d2a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039775 Aug 27 03:19:31.265116 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3250/6318] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:31.625992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-38a23723-b4ab-4224-bcbf-b2f32f76e2ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:31.626804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-38a23723-b4ab-4224-bcbf-b2f32f76e2ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:31.639806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38a23723-b4ab-4224-bcbf-b2f32f76e2ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:31.640318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38a23723-b4ab-4224-bcbf-b2f32f76e2ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:31.640787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38a23723-b4ab-4224-bcbf-b2f32f76e2ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:31.648091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38a23723-b4ab-4224-bcbf-b2f32f76e2ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:31.648854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38a23723-b4ab-4224-bcbf-b2f32f76e2ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:31.649331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38a23723-b4ab-4224-bcbf-b2f32f76e2ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:31.855931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-38a23723-b4ab-4224-bcbf-b2f32f76e2ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:31.869789 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-38a23723-b4ab-4224-bcbf-b2f32f76e2ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.247776 Aug 27 03:19:31.870520 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3069/6319] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:31 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:32.894995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb953b75-6398-452e-8787-5bc09db465de tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:32.895656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb953b75-6398-452e-8787-5bc09db465de tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:32.905856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb953b75-6398-452e-8787-5bc09db465de tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:32.907351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb953b75-6398-452e-8787-5bc09db465de tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:32.908145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb953b75-6398-452e-8787-5bc09db465de tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:32.910704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb953b75-6398-452e-8787-5bc09db465de tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:32.912152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb953b75-6398-452e-8787-5bc09db465de tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:32.912882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb953b75-6398-452e-8787-5bc09db465de tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:33.060782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cb953b75-6398-452e-8787-5bc09db465de tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:33.068647 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb953b75-6398-452e-8787-5bc09db465de tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.181329 Aug 27 03:19:33.069227 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3251/6320] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:32 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:34.099103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-82d1189b-977d-4267-86ea-cc692770141c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:34.100424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-82d1189b-977d-4267-86ea-cc692770141c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:34.114987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82d1189b-977d-4267-86ea-cc692770141c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:34.116372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82d1189b-977d-4267-86ea-cc692770141c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:34.117470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82d1189b-977d-4267-86ea-cc692770141c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:34.120361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82d1189b-977d-4267-86ea-cc692770141c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:34.122027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82d1189b-977d-4267-86ea-cc692770141c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:34.123147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82d1189b-977d-4267-86ea-cc692770141c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:34.352463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-82d1189b-977d-4267-86ea-cc692770141c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:34.378167 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-82d1189b-977d-4267-86ea-cc692770141c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.275311 Aug 27 03:19:34.378167 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3070/6321] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:34 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:35.396143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-05de4a31-547c-4d2c-85fe-7a4c0612cddf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:35.397336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-05de4a31-547c-4d2c-85fe-7a4c0612cddf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:35.401122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:35.411191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05de4a31-547c-4d2c-85fe-7a4c0612cddf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:35.412090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05de4a31-547c-4d2c-85fe-7a4c0612cddf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:35.412647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05de4a31-547c-4d2c-85fe-7a4c0612cddf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:35.413639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05de4a31-547c-4d2c-85fe-7a4c0612cddf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:35.414132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05de4a31-547c-4d2c-85fe-7a4c0612cddf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:35.414642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-05de4a31-547c-4d2c-85fe-7a4c0612cddf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:35.420887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=75 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:35.603582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-05de4a31-547c-4d2c-85fe-7a4c0612cddf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:35.621379 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-05de4a31-547c-4d2c-85fe-7a4c0612cddf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.230159 Aug 27 03:19:35.622113 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3252/6322] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:35 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:36.658633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6cc5fd0d-0449-4603-9abb-6d09c020d9b8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:36.658633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6cc5fd0d-0449-4603-9abb-6d09c020d9b8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:36.664869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=35 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:36.670740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cc5fd0d-0449-4603-9abb-6d09c020d9b8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:36.671570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cc5fd0d-0449-4603-9abb-6d09c020d9b8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:36.672113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cc5fd0d-0449-4603-9abb-6d09c020d9b8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:36.673117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cc5fd0d-0449-4603-9abb-6d09c020d9b8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:36.673694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cc5fd0d-0449-4603-9abb-6d09c020d9b8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:36.674302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6cc5fd0d-0449-4603-9abb-6d09c020d9b8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:36.682295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:36.910108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6cc5fd0d-0449-4603-9abb-6d09c020d9b8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:36.929126 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6cc5fd0d-0449-4603-9abb-6d09c020d9b8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.276478 Aug 27 03:19:36.941693 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3071/6323] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:36 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:37.954582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f7bc49f7-3a9a-4090-8576-afd4142a9c1b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:37.956808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f7bc49f7-3a9a-4090-8576-afd4142a9c1b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:37.964877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:37.966111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:37.970036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7bc49f7-3a9a-4090-8576-afd4142a9c1b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:37.970860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7bc49f7-3a9a-4090-8576-afd4142a9c1b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:37.972616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7bc49f7-3a9a-4090-8576-afd4142a9c1b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:37.973540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7bc49f7-3a9a-4090-8576-afd4142a9c1b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:37.974265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7bc49f7-3a9a-4090-8576-afd4142a9c1b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:37.975115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f7bc49f7-3a9a-4090-8576-afd4142a9c1b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:38.158016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f7bc49f7-3a9a-4090-8576-afd4142a9c1b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:38.168217 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f7bc49f7-3a9a-4090-8576-afd4142a9c1b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.218177 Aug 27 03:19:38.208463 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3253/6324] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:37 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:39.193517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a893220c-483c-43ff-9162-d8fb0c59d66f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:39.194779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a893220c-483c-43ff-9162-d8fb0c59d66f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:39.202130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:19:39.205168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a893220c-483c-43ff-9162-d8fb0c59d66f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.205923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a893220c-483c-43ff-9162-d8fb0c59d66f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.206517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a893220c-483c-43ff-9162-d8fb0c59d66f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.207394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a893220c-483c-43ff-9162-d8fb0c59d66f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:39.207956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a893220c-483c-43ff-9162-d8fb0c59d66f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:39.209459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a893220c-483c-43ff-9162-d8fb0c59d66f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:39.387357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a893220c-483c-43ff-9162-d8fb0c59d66f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:39.396691 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a893220c-483c-43ff-9162-d8fb0c59d66f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.207822 Aug 27 03:19:39.397420 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3072/6325] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:39 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:40.419299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7217fefb-7b9a-4e7c-bdd1-82ca15bdd968 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:40.419846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7217fefb-7b9a-4e7c-bdd1-82ca15bdd968 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:40.429106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7217fefb-7b9a-4e7c-bdd1-82ca15bdd968 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.429952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7217fefb-7b9a-4e7c-bdd1-82ca15bdd968 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.430427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7217fefb-7b9a-4e7c-bdd1-82ca15bdd968 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.431167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7217fefb-7b9a-4e7c-bdd1-82ca15bdd968 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:40.431634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7217fefb-7b9a-4e7c-bdd1-82ca15bdd968 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:40.432104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7217fefb-7b9a-4e7c-bdd1-82ca15bdd968 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:40.572177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7217fefb-7b9a-4e7c-bdd1-82ca15bdd968 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:40.586898 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7217fefb-7b9a-4e7c-bdd1-82ca15bdd968 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.171370 Aug 27 03:19:40.588124 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3254/6326] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:40 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:41.610774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e301f24-0f12-43af-ae81-7db4b340d94c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:41.611954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4e301f24-0f12-43af-ae81-7db4b340d94c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:41.619338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e301f24-0f12-43af-ae81-7db4b340d94c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.619842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e301f24-0f12-43af-ae81-7db4b340d94c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.620344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e301f24-0f12-43af-ae81-7db4b340d94c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.621072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e301f24-0f12-43af-ae81-7db4b340d94c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:41.621534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e301f24-0f12-43af-ae81-7db4b340d94c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:41.622287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e301f24-0f12-43af-ae81-7db4b340d94c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:41.772197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4e301f24-0f12-43af-ae81-7db4b340d94c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:41.781398 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4e301f24-0f12-43af-ae81-7db4b340d94c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.175117 Aug 27 03:19:41.782092 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3073/6327] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:41 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:42.809332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ae8fbf33-7ce5-44b2-9a42-060999607d27 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:42.810629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ae8fbf33-7ce5-44b2-9a42-060999607d27 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:42.823950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae8fbf33-7ce5-44b2-9a42-060999607d27 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.824479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae8fbf33-7ce5-44b2-9a42-060999607d27 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.824932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae8fbf33-7ce5-44b2-9a42-060999607d27 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.825735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae8fbf33-7ce5-44b2-9a42-060999607d27 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:42.826246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae8fbf33-7ce5-44b2-9a42-060999607d27 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:42.826688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae8fbf33-7ce5-44b2-9a42-060999607d27 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:42.994660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ae8fbf33-7ce5-44b2-9a42-060999607d27 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:43.006275 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ae8fbf33-7ce5-44b2-9a42-060999607d27 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.203085 Aug 27 03:19:43.007061 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3255/6328] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:42 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:44.043752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5c13cc86-497d-4095-94d6-aaec361c082a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:44.045140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5c13cc86-497d-4095-94d6-aaec361c082a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:44.054291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c13cc86-497d-4095-94d6-aaec361c082a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:44.054913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c13cc86-497d-4095-94d6-aaec361c082a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:44.055493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c13cc86-497d-4095-94d6-aaec361c082a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:44.056462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c13cc86-497d-4095-94d6-aaec361c082a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:44.057107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c13cc86-497d-4095-94d6-aaec361c082a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:44.058253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c13cc86-497d-4095-94d6-aaec361c082a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:44.200513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5c13cc86-497d-4095-94d6-aaec361c082a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:44.211568 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5c13cc86-497d-4095-94d6-aaec361c082a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.175973 Aug 27 03:19:44.212167 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3074/6329] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:44 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:45.232702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8c4d6030-9a6c-49c0-ab5f-1da8ed3aad80 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:45.233310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8c4d6030-9a6c-49c0-ab5f-1da8ed3aad80 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:45.242418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c4d6030-9a6c-49c0-ab5f-1da8ed3aad80 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:45.242915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c4d6030-9a6c-49c0-ab5f-1da8ed3aad80 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:45.243364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c4d6030-9a6c-49c0-ab5f-1da8ed3aad80 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:45.244087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c4d6030-9a6c-49c0-ab5f-1da8ed3aad80 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:45.244553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c4d6030-9a6c-49c0-ab5f-1da8ed3aad80 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:45.244985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8c4d6030-9a6c-49c0-ab5f-1da8ed3aad80 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:45.392551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8c4d6030-9a6c-49c0-ab5f-1da8ed3aad80 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:45.400924 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8c4d6030-9a6c-49c0-ab5f-1da8ed3aad80 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.172214 Aug 27 03:19:45.401703 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3256/6330] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:45 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:46.424249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b4056db5-7ca4-4af9-adee-04001e394de9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:46.424893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b4056db5-7ca4-4af9-adee-04001e394de9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:46.432366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4056db5-7ca4-4af9-adee-04001e394de9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:46.432881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4056db5-7ca4-4af9-adee-04001e394de9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:46.433345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4056db5-7ca4-4af9-adee-04001e394de9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:46.434118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4056db5-7ca4-4af9-adee-04001e394de9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:46.434595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4056db5-7ca4-4af9-adee-04001e394de9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:46.435043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b4056db5-7ca4-4af9-adee-04001e394de9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:46.574691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b4056db5-7ca4-4af9-adee-04001e394de9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:46.583528 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b4056db5-7ca4-4af9-adee-04001e394de9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1341 microversion: 2.1 time: 0.163191 Aug 27 03:19:46.584147 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3075/6331] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:46 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:47.604907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f937b309-4db3-4448-94f3-a1918f601994 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:47.605481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f937b309-4db3-4448-94f3-a1918f601994 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:47.613262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f937b309-4db3-4448-94f3-a1918f601994 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:47.613770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f937b309-4db3-4448-94f3-a1918f601994 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:47.614207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f937b309-4db3-4448-94f3-a1918f601994 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:47.614945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f937b309-4db3-4448-94f3-a1918f601994 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:47.615400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f937b309-4db3-4448-94f3-a1918f601994 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:47.615875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f937b309-4db3-4448-94f3-a1918f601994 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:47.757759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f937b309-4db3-4448-94f3-a1918f601994 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:47.765546 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f937b309-4db3-4448-94f3-a1918f601994 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1375 microversion: 2.1 time: 0.164773 Aug 27 03:19:47.766151 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3257/6332] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:47 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:48.788943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-87f9f047-9ff4-49a4-8939-de15566a907b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:48.789562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-87f9f047-9ff4-49a4-8939-de15566a907b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:48.796959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87f9f047-9ff4-49a4-8939-de15566a907b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:48.797458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87f9f047-9ff4-49a4-8939-de15566a907b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:48.797948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87f9f047-9ff4-49a4-8939-de15566a907b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:48.798732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87f9f047-9ff4-49a4-8939-de15566a907b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:48.799249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87f9f047-9ff4-49a4-8939-de15566a907b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:48.799700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87f9f047-9ff4-49a4-8939-de15566a907b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:48.948683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-87f9f047-9ff4-49a4-8939-de15566a907b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:48.958939 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-87f9f047-9ff4-49a4-8939-de15566a907b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1375 microversion: 2.1 time: 0.174823 Aug 27 03:19:48.959430 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3076/6333] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:48 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:49.982164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-264e7736-ab22-4850-bf88-f2c2dfbfd748 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:49.982885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-264e7736-ab22-4850-bf88-f2c2dfbfd748 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:49.989408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-264e7736-ab22-4850-bf88-f2c2dfbfd748 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:49.989967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-264e7736-ab22-4850-bf88-f2c2dfbfd748 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:49.990524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-264e7736-ab22-4850-bf88-f2c2dfbfd748 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:49.991317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-264e7736-ab22-4850-bf88-f2c2dfbfd748 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:49.991768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-264e7736-ab22-4850-bf88-f2c2dfbfd748 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:49.992197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-264e7736-ab22-4850-bf88-f2c2dfbfd748 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:50.138925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-264e7736-ab22-4850-bf88-f2c2dfbfd748 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:50.147577 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-264e7736-ab22-4850-bf88-f2c2dfbfd748 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1375 microversion: 2.1 time: 0.170854 Aug 27 03:19:50.148162 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3258/6334] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:49 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:51.168587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b666a88f-7881-46d3-99ff-3ecbd1b1a9e0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:51.169218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b666a88f-7881-46d3-99ff-3ecbd1b1a9e0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:51.177159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b666a88f-7881-46d3-99ff-3ecbd1b1a9e0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:51.177688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b666a88f-7881-46d3-99ff-3ecbd1b1a9e0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:51.178151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b666a88f-7881-46d3-99ff-3ecbd1b1a9e0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:51.178875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b666a88f-7881-46d3-99ff-3ecbd1b1a9e0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:51.179349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b666a88f-7881-46d3-99ff-3ecbd1b1a9e0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:51.179794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b666a88f-7881-46d3-99ff-3ecbd1b1a9e0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:51.311614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b666a88f-7881-46d3-99ff-3ecbd1b1a9e0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:51.320336 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b666a88f-7881-46d3-99ff-3ecbd1b1a9e0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1375 microversion: 2.1 time: 0.155715 Aug 27 03:19:51.320909 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3077/6335] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:51 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:19:52.344600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1c9a38c2-f62a-4118-b503-7ba88e1dbd74 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:52.345691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1c9a38c2-f62a-4118-b503-7ba88e1dbd74 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:52.354634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c9a38c2-f62a-4118-b503-7ba88e1dbd74 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:52.355210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c9a38c2-f62a-4118-b503-7ba88e1dbd74 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:52.355749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c9a38c2-f62a-4118-b503-7ba88e1dbd74 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:52.356682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c9a38c2-f62a-4118-b503-7ba88e1dbd74 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:52.357183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c9a38c2-f62a-4118-b503-7ba88e1dbd74 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:52.357763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1c9a38c2-f62a-4118-b503-7ba88e1dbd74 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:52.518421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1c9a38c2-f62a-4118-b503-7ba88e1dbd74 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:52.528880 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1c9a38c2-f62a-4118-b503-7ba88e1dbd74 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1375 microversion: 2.1 time: 0.189672 Aug 27 03:19:52.529536 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3259/6336] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:52 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:53.555332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1dc42fa-fb93-4d3e-abba-548ce5698781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:53.555969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d1dc42fa-fb93-4d3e-abba-548ce5698781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:53.563536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1dc42fa-fb93-4d3e-abba-548ce5698781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.564082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1dc42fa-fb93-4d3e-abba-548ce5698781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.564535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1dc42fa-fb93-4d3e-abba-548ce5698781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.565317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1dc42fa-fb93-4d3e-abba-548ce5698781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:53.565873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1dc42fa-fb93-4d3e-abba-548ce5698781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:53.566364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1dc42fa-fb93-4d3e-abba-548ce5698781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:53.712341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1dc42fa-fb93-4d3e-abba-548ce5698781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:53.720899 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1dc42fa-fb93-4d3e-abba-548ce5698781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1375 microversion: 2.1 time: 0.170256 Aug 27 03:19:53.721481 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3078/6337] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:53 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:54.744501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba207cad-2e88-4166-a4ff-127036fdb0ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:54.745310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ba207cad-2e88-4166-a4ff-127036fdb0ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:54.753365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba207cad-2e88-4166-a4ff-127036fdb0ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:54.754106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba207cad-2e88-4166-a4ff-127036fdb0ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:54.755277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba207cad-2e88-4166-a4ff-127036fdb0ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:54.756159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba207cad-2e88-4166-a4ff-127036fdb0ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:54.756739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba207cad-2e88-4166-a4ff-127036fdb0ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:54.757243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba207cad-2e88-4166-a4ff-127036fdb0ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:54.917024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ba207cad-2e88-4166-a4ff-127036fdb0ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:54.929773 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ba207cad-2e88-4166-a4ff-127036fdb0ee tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1375 microversion: 2.1 time: 0.189559 Aug 27 03:19:54.930385 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3260/6338] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:54 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:55.953979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7c1200b6-485c-471f-8ad7-0873d7afa3a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:55.954758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7c1200b6-485c-471f-8ad7-0873d7afa3a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:55.963536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c1200b6-485c-471f-8ad7-0873d7afa3a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:55.964065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c1200b6-485c-471f-8ad7-0873d7afa3a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:55.964544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c1200b6-485c-471f-8ad7-0873d7afa3a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:55.965358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c1200b6-485c-471f-8ad7-0873d7afa3a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:55.965876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c1200b6-485c-471f-8ad7-0873d7afa3a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:55.966419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7c1200b6-485c-471f-8ad7-0873d7afa3a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:56.134737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7c1200b6-485c-471f-8ad7-0873d7afa3a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:56.144627 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7c1200b6-485c-471f-8ad7-0873d7afa3a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1375 microversion: 2.1 time: 0.194821 Aug 27 03:19:56.145934 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3079/6339] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:55 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1375 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:56.503560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-9d05b894-0632-4a63-a587-fea7ce38c909 req-ea02d2f3-020f-4e19-b2e2-5e50df1f1f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619c07ea-f854-49bf-a503-6769dfc106ba", "name": "network-vif-plugged", "status": "completed", "tag": "8c8c7c03-6130-408c-bcb6-990051d8fd03"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:19:56.516686 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9d05b894-0632-4a63-a587-fea7ce38c909 req-ea02d2f3-020f-4e19-b2e2-5e50df1f1f19 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:56.517334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9d05b894-0632-4a63-a587-fea7ce38c909 req-ea02d2f3-020f-4e19-b2e2-5e50df1f1f19 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:56.517975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-9d05b894-0632-4a63-a587-fea7ce38c909 req-ea02d2f3-020f-4e19-b2e2-5e50df1f1f19 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:56.532612 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-9d05b894-0632-4a63-a587-fea7ce38c909 req-ea02d2f3-020f-4e19-b2e2-5e50df1f1f19 service nova] Creating event network-vif-plugged:8c8c7c03-6130-408c-bcb6-990051d8fd03 for instance 619c07ea-f854-49bf-a503-6769dfc106ba on n-h1-852084-5 Aug 27 03:19:56.538675 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-9d05b894-0632-4a63-a587-fea7ce38c909 req-ea02d2f3-020f-4e19-b2e2-5e50df1f1f19 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039126 Aug 27 03:19:56.539547 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3261/6340] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:19:57.167931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0636b8e4-491e-4269-bfd9-a90572633f0f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:57.169258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0636b8e4-491e-4269-bfd9-a90572633f0f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:57.182256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0636b8e4-491e-4269-bfd9-a90572633f0f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:57.183111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0636b8e4-491e-4269-bfd9-a90572633f0f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:57.183965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0636b8e4-491e-4269-bfd9-a90572633f0f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:57.185251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0636b8e4-491e-4269-bfd9-a90572633f0f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:57.186149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0636b8e4-491e-4269-bfd9-a90572633f0f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:57.186951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0636b8e4-491e-4269-bfd9-a90572633f0f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:57.353903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0636b8e4-491e-4269-bfd9-a90572633f0f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:57.362460 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0636b8e4-491e-4269-bfd9-a90572633f0f tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1375 microversion: 2.1 time: 0.198757 Aug 27 03:19:57.363062 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3080/6341] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:57 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1375 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:58.389541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-38a2f795-a581-4918-8045-f52a1662bbdd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:58.390931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-38a2f795-a581-4918-8045-f52a1662bbdd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:58.404493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38a2f795-a581-4918-8045-f52a1662bbdd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.405399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38a2f795-a581-4918-8045-f52a1662bbdd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.406256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38a2f795-a581-4918-8045-f52a1662bbdd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.407561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38a2f795-a581-4918-8045-f52a1662bbdd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.408395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38a2f795-a581-4918-8045-f52a1662bbdd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.409216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38a2f795-a581-4918-8045-f52a1662bbdd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.583913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-38a2f795-a581-4918-8045-f52a1662bbdd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:58.592340 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-38a2f795-a581-4918-8045-f52a1662bbdd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1562 microversion: 2.1 time: 0.211129 Aug 27 03:19:58.592945 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3262/6342] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:58 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1562 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:58.613061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-01fd859c-be38-406e-926c-77b98cb64f05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:58.614278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-01fd859c-be38-406e-926c-77b98cb64f05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:58.622019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01fd859c-be38-406e-926c-77b98cb64f05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.622525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01fd859c-be38-406e-926c-77b98cb64f05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.622981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01fd859c-be38-406e-926c-77b98cb64f05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.624010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01fd859c-be38-406e-926c-77b98cb64f05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.624477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01fd859c-be38-406e-926c-77b98cb64f05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.624926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-01fd859c-be38-406e-926c-77b98cb64f05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.763596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-01fd859c-be38-406e-926c-77b98cb64f05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:58.772038 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-01fd859c-be38-406e-926c-77b98cb64f05 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1562 microversion: 2.1 time: 0.162816 Aug 27 03:19:58.772652 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3081/6343] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:58 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:19:58.851512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9c95ff7b-d45f-4b44-9d11-d36731701f03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:58.852046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9c95ff7b-d45f-4b44-9d11-d36731701f03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:58.858244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c95ff7b-d45f-4b44-9d11-d36731701f03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.858738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c95ff7b-d45f-4b44-9d11-d36731701f03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.859185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c95ff7b-d45f-4b44-9d11-d36731701f03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.859911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c95ff7b-d45f-4b44-9d11-d36731701f03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.860356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c95ff7b-d45f-4b44-9d11-d36731701f03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.861393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9c95ff7b-d45f-4b44-9d11-d36731701f03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.888685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9c95ff7b-d45f-4b44-9d11-d36731701f03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:19:58.978329 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9c95ff7b-d45f-4b44-9d11-d36731701f03 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 204 len: 0 microversion: 2.1 time: 0.130404 Aug 27 03:19:58.978983 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3263/6344] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:19:58 2022] DELETE /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:19:58.987724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bfafdfca-38ee-4920-81b4-2c62a72b0329 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:19:58.988381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bfafdfca-38ee-4920-81b4-2c62a72b0329 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:19:58.995949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfafdfca-38ee-4920-81b4-2c62a72b0329 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.996472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfafdfca-38ee-4920-81b4-2c62a72b0329 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.996936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfafdfca-38ee-4920-81b4-2c62a72b0329 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:58.997690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfafdfca-38ee-4920-81b4-2c62a72b0329 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:19:58.998231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfafdfca-38ee-4920-81b4-2c62a72b0329 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:19:58.998725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfafdfca-38ee-4920-81b4-2c62a72b0329 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:19:59.141241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bfafdfca-38ee-4920-81b4-2c62a72b0329 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:19:59.151611 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bfafdfca-38ee-4920-81b4-2c62a72b0329 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1568 microversion: 2.1 time: 0.167784 Aug 27 03:19:59.152438 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3082/6345] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:19:58 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:00.175225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-030f5558-f95d-436c-9967-ca2fbf54cbe5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:00.176571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-030f5558-f95d-436c-9967-ca2fbf54cbe5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:00.183798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f5558-f95d-436c-9967-ca2fbf54cbe5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:00.184286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f5558-f95d-436c-9967-ca2fbf54cbe5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:00.184730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f5558-f95d-436c-9967-ca2fbf54cbe5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:00.185434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f5558-f95d-436c-9967-ca2fbf54cbe5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:00.185917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f5558-f95d-436c-9967-ca2fbf54cbe5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:00.186352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f5558-f95d-436c-9967-ca2fbf54cbe5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:00.319026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-030f5558-f95d-436c-9967-ca2fbf54cbe5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:00.328702 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-030f5558-f95d-436c-9967-ca2fbf54cbe5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1568 microversion: 2.1 time: 0.157383 Aug 27 03:20:00.329756 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3264/6346] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:00 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:01.055493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-32ee9a36-5f05-454d-ad0e-356378266663 req-6c738c28-66bd-4aa1-ab09-ef55150a0c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619c07ea-f854-49bf-a503-6769dfc106ba", "name": "network-vif-deleted", "tag": "8c8c7c03-6130-408c-bcb6-990051d8fd03"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:01.073809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-32ee9a36-5f05-454d-ad0e-356378266663 req-6c738c28-66bd-4aa1-ab09-ef55150a0c7e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.074579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-32ee9a36-5f05-454d-ad0e-356378266663 req-6c738c28-66bd-4aa1-ab09-ef55150a0c7e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.075223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-32ee9a36-5f05-454d-ad0e-356378266663 req-6c738c28-66bd-4aa1-ab09-ef55150a0c7e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.088134 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-32ee9a36-5f05-454d-ad0e-356378266663 req-6c738c28-66bd-4aa1-ab09-ef55150a0c7e service nova] Creating event network-vif-deleted:8c8c7c03-6130-408c-bcb6-990051d8fd03 for instance 619c07ea-f854-49bf-a503-6769dfc106ba on n-h1-852084-5 Aug 27 03:20:01.094221 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-32ee9a36-5f05-454d-ad0e-356378266663 req-6c738c28-66bd-4aa1-ab09-ef55150a0c7e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042296 Aug 27 03:20:01.095449 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3083/6347] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:01.351227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-175f81c2-8970-47b2-aafb-1ebef394bb17 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:01.351809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-175f81c2-8970-47b2-aafb-1ebef394bb17 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:01.358913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-175f81c2-8970-47b2-aafb-1ebef394bb17 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.359401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-175f81c2-8970-47b2-aafb-1ebef394bb17 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.359866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-175f81c2-8970-47b2-aafb-1ebef394bb17 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.360565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-175f81c2-8970-47b2-aafb-1ebef394bb17 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:01.361018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-175f81c2-8970-47b2-aafb-1ebef394bb17 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:01.361441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-175f81c2-8970-47b2-aafb-1ebef394bb17 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:01.431177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-175f81c2-8970-47b2-aafb-1ebef394bb17 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:01.441283 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-175f81c2-8970-47b2-aafb-1ebef394bb17 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1360 microversion: 2.1 time: 0.094039 Aug 27 03:20:01.442311 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3265/6348] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:01 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1360 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:02.466589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f281d1a8-b521-403a-ae55-62db41931596 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:02.467314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f281d1a8-b521-403a-ae55-62db41931596 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:02.474989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f281d1a8-b521-403a-ae55-62db41931596 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:02.475536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f281d1a8-b521-403a-ae55-62db41931596 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:02.476046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f281d1a8-b521-403a-ae55-62db41931596 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:02.476935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f281d1a8-b521-403a-ae55-62db41931596 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:02.477397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f281d1a8-b521-403a-ae55-62db41931596 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:02.478040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f281d1a8-b521-403a-ae55-62db41931596 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:02.549471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f281d1a8-b521-403a-ae55-62db41931596 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:02.559234 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f281d1a8-b521-403a-ae55-62db41931596 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1360 microversion: 2.1 time: 0.100205 Aug 27 03:20:02.559831 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3084/6349] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:02 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1360 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:03.580405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c3318262-f6a4-4fa9-b73b-b2d049442dd4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:03.581070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c3318262-f6a4-4fa9-b73b-b2d049442dd4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:03.589309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3318262-f6a4-4fa9-b73b-b2d049442dd4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:03.589703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3318262-f6a4-4fa9-b73b-b2d049442dd4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:03.590159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3318262-f6a4-4fa9-b73b-b2d049442dd4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:03.590895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3318262-f6a4-4fa9-b73b-b2d049442dd4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:03.591356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3318262-f6a4-4fa9-b73b-b2d049442dd4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:03.591792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c3318262-f6a4-4fa9-b73b-b2d049442dd4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:03.661185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c3318262-f6a4-4fa9-b73b-b2d049442dd4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:03.670229 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c3318262-f6a4-4fa9-b73b-b2d049442dd4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1360 microversion: 2.1 time: 0.093769 Aug 27 03:20:03.670942 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3266/6350] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:03 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1360 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:04.692455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d740cfe2-7753-4efe-b266-7ae36d4ca26c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:04.693658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d740cfe2-7753-4efe-b266-7ae36d4ca26c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:04.700750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d740cfe2-7753-4efe-b266-7ae36d4ca26c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:04.701254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d740cfe2-7753-4efe-b266-7ae36d4ca26c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:04.701816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d740cfe2-7753-4efe-b266-7ae36d4ca26c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:04.702586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d740cfe2-7753-4efe-b266-7ae36d4ca26c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:04.703062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d740cfe2-7753-4efe-b266-7ae36d4ca26c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:04.703508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d740cfe2-7753-4efe-b266-7ae36d4ca26c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:04.769131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d740cfe2-7753-4efe-b266-7ae36d4ca26c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:04.778357 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d740cfe2-7753-4efe-b266-7ae36d4ca26c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1360 microversion: 2.1 time: 0.090880 Aug 27 03:20:04.779055 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3085/6351] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:04 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1360 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:05.803918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:05.805003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:05.807782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:05.814471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:05.815062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:05.815594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:05.816970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:05.817659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:05.818120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:05.823504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:05.858689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:05.859168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:05.859751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:05.860216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lazy-loading 'fault' on Instance uuid 619c07ea-f854-49bf-a503-6769dfc106ba {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:20:05.918991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:05.929971 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e24c17d0-c973-40e6-af6a-9655ade0b7b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 200 len: 1365 microversion: 2.1 time: 0.133207 Aug 27 03:20:05.930794 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3267/6352] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:05 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:06.954664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:06.955218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:06.958481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=30 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:06.964209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:06.964711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:06.965172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:06.965926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:06.966401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:06.966848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:06.971594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=86 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:06.985948 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba HTTP/1.1 Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '619c07ea-f854-49bf-a503-6769dfc106ba'} Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:06.988006 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:06.993616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:06.993616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:06.993616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:06.993616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:06.993616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:06.993616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:06.993616 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:06.993616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:06.993616 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-61131c9d-31f9-470c-9dd4-113bb2d08c39 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 404 len: 111 microversion: 2.1 time: 0.039115 Aug 27 03:20:06.993616 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3086/6353] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:06 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:11.295795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d62d9a2-7092-43fa-8a37-cbf9bd3f3181 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:11.296285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d62d9a2-7092-43fa-8a37-cbf9bd3f3181 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:11.304882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d62d9a2-7092-43fa-8a37-cbf9bd3f3181 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.305368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d62d9a2-7092-43fa-8a37-cbf9bd3f3181 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.305841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d62d9a2-7092-43fa-8a37-cbf9bd3f3181 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.306547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d62d9a2-7092-43fa-8a37-cbf9bd3f3181 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.307002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d62d9a2-7092-43fa-8a37-cbf9bd3f3181 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.307426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d62d9a2-7092-43fa-8a37-cbf9bd3f3181 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.337713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d62d9a2-7092-43fa-8a37-cbf9bd3f3181 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:20:11.423130 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2d62d9a2-7092-43fa-8a37-cbf9bd3f3181 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 204 len: 0 microversion: 2.1 time: 0.131380 Aug 27 03:20:11.423773 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3268/6354] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:20:11 2022] DELETE /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:20:11.434902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-63f223d6-60ca-4ddf-ba55-a29f31b58f2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:11.435448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-63f223d6-60ca-4ddf-ba55-a29f31b58f2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:11.444096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63f223d6-60ca-4ddf-ba55-a29f31b58f2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.444597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63f223d6-60ca-4ddf-ba55-a29f31b58f2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.445047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63f223d6-60ca-4ddf-ba55-a29f31b58f2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.445926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63f223d6-60ca-4ddf-ba55-a29f31b58f2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:11.446416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63f223d6-60ca-4ddf-ba55-a29f31b58f2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:11.446850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63f223d6-60ca-4ddf-ba55-a29f31b58f2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:11.578900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-63f223d6-60ca-4ddf-ba55-a29f31b58f2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:11.587158 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-63f223d6-60ca-4ddf-ba55-a29f31b58f2d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1410 microversion: 2.1 time: 0.157268 Aug 27 03:20:11.587749 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3087/6355] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:11 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1410 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:12.609809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-01869133-f8b3-44e6-9b88-cb19e06f9e62 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:12.610555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-01869133-f8b3-44e6-9b88-cb19e06f9e62 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:12.617596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01869133-f8b3-44e6-9b88-cb19e06f9e62 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:12.618119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01869133-f8b3-44e6-9b88-cb19e06f9e62 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:12.618563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01869133-f8b3-44e6-9b88-cb19e06f9e62 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:12.619266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01869133-f8b3-44e6-9b88-cb19e06f9e62 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:12.619726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01869133-f8b3-44e6-9b88-cb19e06f9e62 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:12.620154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01869133-f8b3-44e6-9b88-cb19e06f9e62 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:12.754811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-01869133-f8b3-44e6-9b88-cb19e06f9e62 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:12.763133 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-01869133-f8b3-44e6-9b88-cb19e06f9e62 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1410 microversion: 2.1 time: 0.157664 Aug 27 03:20:12.763712 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3269/6356] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:12 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1410 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:13.785729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dfdc2159-603b-4b9b-afd9-289862f98657 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:13.786381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dfdc2159-603b-4b9b-afd9-289862f98657 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:13.793339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfdc2159-603b-4b9b-afd9-289862f98657 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:13.793883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfdc2159-603b-4b9b-afd9-289862f98657 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:13.794344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfdc2159-603b-4b9b-afd9-289862f98657 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:13.795073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfdc2159-603b-4b9b-afd9-289862f98657 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:13.795546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfdc2159-603b-4b9b-afd9-289862f98657 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:13.795989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dfdc2159-603b-4b9b-afd9-289862f98657 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:13.951681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dfdc2159-603b-4b9b-afd9-289862f98657 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:13.961849 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dfdc2159-603b-4b9b-afd9-289862f98657 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1410 microversion: 2.1 time: 0.181024 Aug 27 03:20:13.962447 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3088/6357] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:13 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1410 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:14.205236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-5eae7c48-e8e7-4d51-8ec5-f612925ad477 req-5a7e076b-2602-4095-a9f6-fc6547d3cf87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aea1028b-b6d8-490d-b892-68ea49cedd8b", "name": "network-vif-deleted", "tag": "dbfc8d6d-cb0a-4b03-9ff8-12b278c36f73"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:14.216880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5eae7c48-e8e7-4d51-8ec5-f612925ad477 req-5a7e076b-2602-4095-a9f6-fc6547d3cf87 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:14.217514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5eae7c48-e8e7-4d51-8ec5-f612925ad477 req-5a7e076b-2602-4095-a9f6-fc6547d3cf87 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:14.218037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5eae7c48-e8e7-4d51-8ec5-f612925ad477 req-5a7e076b-2602-4095-a9f6-fc6547d3cf87 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:14.229891 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-5eae7c48-e8e7-4d51-8ec5-f612925ad477 req-5a7e076b-2602-4095-a9f6-fc6547d3cf87 service nova] Creating event network-vif-deleted:dbfc8d6d-cb0a-4b03-9ff8-12b278c36f73 for instance aea1028b-b6d8-490d-b892-68ea49cedd8b on n-h2-852084-5 Aug 27 03:20:14.235048 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-5eae7c48-e8e7-4d51-8ec5-f612925ad477 req-5a7e076b-2602-4095-a9f6-fc6547d3cf87 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033632 Aug 27 03:20:14.235655 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3270/6358] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:14.984692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e32f0028-149a-4c33-8a79-504d58a15739 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:14.986140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e32f0028-149a-4c33-8a79-504d58a15739 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:14.999696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e32f0028-149a-4c33-8a79-504d58a15739 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:15.000215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e32f0028-149a-4c33-8a79-504d58a15739 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:15.000676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e32f0028-149a-4c33-8a79-504d58a15739 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:15.001417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e32f0028-149a-4c33-8a79-504d58a15739 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:15.001935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e32f0028-149a-4c33-8a79-504d58a15739 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:15.002385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e32f0028-149a-4c33-8a79-504d58a15739 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:15.067651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e32f0028-149a-4c33-8a79-504d58a15739 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:15.076177 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e32f0028-149a-4c33-8a79-504d58a15739 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1201 microversion: 2.1 time: 0.096174 Aug 27 03:20:15.076782 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3089/6359] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:14 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:16.099322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba863fef-7726-4491-8847-5944d49260d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:16.100020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ba863fef-7726-4491-8847-5944d49260d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:16.106527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba863fef-7726-4491-8847-5944d49260d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:16.107023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba863fef-7726-4491-8847-5944d49260d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:16.107494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba863fef-7726-4491-8847-5944d49260d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:16.108191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba863fef-7726-4491-8847-5944d49260d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:16.108657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba863fef-7726-4491-8847-5944d49260d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:16.109097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba863fef-7726-4491-8847-5944d49260d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:16.176112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ba863fef-7726-4491-8847-5944d49260d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:16.184756 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ba863fef-7726-4491-8847-5944d49260d0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1201 microversion: 2.1 time: 0.090803 Aug 27 03:20:16.185336 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3271/6360] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:16 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:17.204504 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-85dc4329-3142-4592-88ee-497f78cd0e7a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:17.205135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-85dc4329-3142-4592-88ee-497f78cd0e7a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:17.213327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85dc4329-3142-4592-88ee-497f78cd0e7a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:17.213983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85dc4329-3142-4592-88ee-497f78cd0e7a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:17.214438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85dc4329-3142-4592-88ee-497f78cd0e7a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:17.215162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85dc4329-3142-4592-88ee-497f78cd0e7a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:17.215662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85dc4329-3142-4592-88ee-497f78cd0e7a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:17.216104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85dc4329-3142-4592-88ee-497f78cd0e7a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:17.278506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-85dc4329-3142-4592-88ee-497f78cd0e7a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:17.287124 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-85dc4329-3142-4592-88ee-497f78cd0e7a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1201 microversion: 2.1 time: 0.086564 Aug 27 03:20:17.287700 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3090/6361] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:17 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:18.307913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b6d7ae97-8b25-411f-98c3-eab05ac16f82 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:18.308776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b6d7ae97-8b25-411f-98c3-eab05ac16f82 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:18.315525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d7ae97-8b25-411f-98c3-eab05ac16f82 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:18.316011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d7ae97-8b25-411f-98c3-eab05ac16f82 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:18.316457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d7ae97-8b25-411f-98c3-eab05ac16f82 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:18.317157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d7ae97-8b25-411f-98c3-eab05ac16f82 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:18.317648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d7ae97-8b25-411f-98c3-eab05ac16f82 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:18.318166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6d7ae97-8b25-411f-98c3-eab05ac16f82 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:18.416128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6d7ae97-8b25-411f-98c3-eab05ac16f82 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:18.425614 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b6d7ae97-8b25-411f-98c3-eab05ac16f82 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 200 len: 1201 microversion: 2.1 time: 0.121548 Aug 27 03:20:18.426253 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3272/6362] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:18 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 1201 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:19.446388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:19.446915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:19.453893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:19.454386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:19.454835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:19.455537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:19.456001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:19.456435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:19.471103 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b HTTP/1.1 Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'aea1028b-b6d8-490d-b892-68ea49cedd8b'} Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:19.472723 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:19.479975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:19.479975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:19.479975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:19.479975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:19.479975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:19.479975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:19.479975 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:19.479975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:19.479975 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4b7c3243-c000-4dee-88a6-a75054160a63 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 404 len: 111 microversion: 2.1 time: 0.031874 Aug 27 03:20:19.479975 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3091/6363] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:19 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:21.612666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:21.613152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:21.620554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:21.621045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:21.621485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:21.622215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:21.622679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:21.623109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:21.638836 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba HTTP/1.1 Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '619c07ea-f854-49bf-a503-6769dfc106ba'} Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:21.640574 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-78eb6ef9-116f-4829-a19c-eddf615e73ea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 404 len: 111 microversion: 2.1 time: 0.033261 Aug 27 03:20:21.647873 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3273/6364] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:20:21 2022] DELETE /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:21.651535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:21.652165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 619c07ea-f854-49bf-a503-6769dfc106ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:21.659369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:21.660342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:21.660342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:21.661167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:21.662012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:21.662199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:21.677247 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba HTTP/1.1 Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '619c07ea-f854-49bf-a503-6769dfc106ba'} Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:21.678918 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.685706 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:21.685706 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:21.685706 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:21.685706 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:21.685706 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:21.685706 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. Aug 27 03:20:21.685706 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:21.685706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance 619c07ea-f854-49bf-a503-6769dfc106ba could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:21.685706 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-93b1ca46-ad71-40d0-8f67-ecbe472f7925 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba" status: 404 len: 111 microversion: 2.1 time: 0.032793 Aug 27 03:20:21.685706 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3092/6365] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:21 2022] GET /compute/v2.1/servers/619c07ea-f854-49bf-a503-6769dfc106ba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:22.220734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:22.221248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:22.228283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:22.228779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:22.229230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:22.229966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:22.230434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:22.230874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:22.255787 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b HTTP/1.1 Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'aea1028b-b6d8-490d-b892-68ea49cedd8b'} Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:22.257363 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2da1f0b-92ff-4f6a-9ed2-38c300636ae8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 404 len: 111 microversion: 2.1 time: 0.042107 Aug 27 03:20:22.260790 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3274/6366] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:20:22 2022] DELETE /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:20:22.267548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:22.268174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: aea1028b-b6d8-490d-b892-68ea49cedd8b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:22.274293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:22.274786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:22.275413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:22.276138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:22.276615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:22.277051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:22.293014 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b HTTP/1.1 Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'aea1028b-b6d8-490d-b892-68ea49cedd8b'} Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:20:22.294667 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:22.298533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:20:22.298533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:20:22.298533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:20:22.298533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:20:22.298533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:20:22.298533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. Aug 27 03:20:22.298533 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:20:22.298533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance aea1028b-b6d8-490d-b892-68ea49cedd8b could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:20:22.298533 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a397aab2-b6b7-49ec-8c68-62677d0d6f21 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b" status: 404 len: 111 microversion: 2.1 time: 0.032474 Aug 27 03:20:22.298533 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3093/6367] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:22 2022] GET /compute/v2.1/servers/aea1028b-b6d8-490d-b892-68ea49cedd8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:20:22.380000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d911723c-0212-4581-9596-69313a912c04 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Action: 'create', calling method: .version_select at 0x7f4d2abaff70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-103287171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSpHhcEUl4lpLxq5fnLOo2j147aYJ2Tl1dnHbHudXVSsuUghwbT43HveEPg2dJqXKWD5s9xOIBXLX16J45uScUQFXbE+bITISkSQbHFEaquU3IFwsxhIs6B76Hf7/VkTw=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:22.397568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-d911723c-0212-4581-9596-69313a912c04 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:22.403043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-d911723c-0212-4581-9596-69313a912c04 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for user 0a78655bea27452faee67a7efd476175 and project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:22.428358 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d911723c-0212-4581-9596-69313a912c04 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.053430 Aug 27 03:20:22.428965 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3275/6368] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:20:22 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:38.695626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-125507440", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-103287171", "security_groups": [{"name": "tempest-secgroup-smoke-522862021"}], "block_device_mapping_v2": [{"uuid": "61d9e199-04cf-4b59-aaf9-5dbbeafb28f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9f6cd27d-8b3c-456e-af66-44212888909f"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:38.708551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=15 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:38.709352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=31 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:38.845084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] validate_networks() for [('9f6cd27d-8b3c-456e-af66-44212888909f', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:20:39.221425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:20:39.221937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:20:39.222419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:20:39.222836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:20:39.223258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:20:39.232394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:39.232885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:39.233330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:39.234095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:39.234564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:39.234998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:39.252029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:20:39.257194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for user 0a78655bea27452faee67a7efd476175 and project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:20:39.315954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:20:39.318132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61d9e199-04cf-4b59-aaf9-5dbbeafb28f3',volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:20:39.448519 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-512c06f8-9839-43b5-8f42-ca12850b1043 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.757586 Aug 27 03:20:39.449516 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3094/6369] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:20:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:20:39.457999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:39.458795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:39.459469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:39.464089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-269c9464-0f93-4196-9b7a-87f9075a3524 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:39.464717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-269c9464-0f93-4196-9b7a-87f9075a3524 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:39.524996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-269c9464-0f93-4196-9b7a-87f9075a3524 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:39.532298 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-269c9464-0f93-4196-9b7a-87f9075a3524 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1093 microversion: 2.1 time: 0.076169 Aug 27 03:20:39.533216 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3276/6370] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:39 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:40.555831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c1ab7f5d-2b57-41a4-9774-a090e7f91e2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:40.556470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c1ab7f5d-2b57-41a4-9774-a090e7f91e2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:40.563903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1ab7f5d-2b57-41a4-9774-a090e7f91e2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:40.564407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1ab7f5d-2b57-41a4-9774-a090e7f91e2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:40.564863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1ab7f5d-2b57-41a4-9774-a090e7f91e2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:40.565582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1ab7f5d-2b57-41a4-9774-a090e7f91e2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:40.566093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1ab7f5d-2b57-41a4-9774-a090e7f91e2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:40.566537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1ab7f5d-2b57-41a4-9774-a090e7f91e2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:40.633031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c1ab7f5d-2b57-41a4-9774-a090e7f91e2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:40.641554 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c1ab7f5d-2b57-41a4-9774-a090e7f91e2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1209 microversion: 2.1 time: 0.091624 Aug 27 03:20:40.642092 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3095/6371] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:40 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:41.664240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c347e90a-bba4-438a-81fd-1a97331e5277 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:41.665305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c347e90a-bba4-438a-81fd-1a97331e5277 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:41.673998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c347e90a-bba4-438a-81fd-1a97331e5277 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.674699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c347e90a-bba4-438a-81fd-1a97331e5277 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.675248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c347e90a-bba4-438a-81fd-1a97331e5277 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.676064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c347e90a-bba4-438a-81fd-1a97331e5277 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:41.676627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c347e90a-bba4-438a-81fd-1a97331e5277 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:41.677273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c347e90a-bba4-438a-81fd-1a97331e5277 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:41.894236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c347e90a-bba4-438a-81fd-1a97331e5277 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:41.903370 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c347e90a-bba4-438a-81fd-1a97331e5277 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1276 microversion: 2.1 time: 0.243951 Aug 27 03:20:41.904186 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3277/6372] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:41 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:42.093748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-560a3c83-8974-44aa-8e34-5f9b53d30f71 req-be7a4bee-8d96-4f05-9c4a-b5e0b85d4598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87e599e-5f9e-45e1-9106-e03389fcc190", "tag": "4457d0d4-761d-48ee-8c46-8b57c9d911a8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:42.103678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-560a3c83-8974-44aa-8e34-5f9b53d30f71 req-be7a4bee-8d96-4f05-9c4a-b5e0b85d4598 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:42.104440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-560a3c83-8974-44aa-8e34-5f9b53d30f71 req-be7a4bee-8d96-4f05-9c4a-b5e0b85d4598 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:42.105055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-560a3c83-8974-44aa-8e34-5f9b53d30f71 req-be7a4bee-8d96-4f05-9c4a-b5e0b85d4598 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:42.118144 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-560a3c83-8974-44aa-8e34-5f9b53d30f71 req-be7a4bee-8d96-4f05-9c4a-b5e0b85d4598 service nova] Creating event network-changed:4457d0d4-761d-48ee-8c46-8b57c9d911a8 for instance d87e599e-5f9e-45e1-9106-e03389fcc190 on n-h2-852084-5 Aug 27 03:20:42.123766 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-560a3c83-8974-44aa-8e34-5f9b53d30f71 req-be7a4bee-8d96-4f05-9c4a-b5e0b85d4598 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187955 Aug 27 03:20:42.125041 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3096/6373] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:20:42.923894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-552bba83-7817-40df-a487-41e93f191c6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:42.924631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-552bba83-7817-40df-a487-41e93f191c6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:42.932264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-552bba83-7817-40df-a487-41e93f191c6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:42.932766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-552bba83-7817-40df-a487-41e93f191c6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:42.933219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-552bba83-7817-40df-a487-41e93f191c6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:42.933995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-552bba83-7817-40df-a487-41e93f191c6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:42.934546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-552bba83-7817-40df-a487-41e93f191c6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:42.934918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-552bba83-7817-40df-a487-41e93f191c6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:43.077217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-552bba83-7817-40df-a487-41e93f191c6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:43.086384 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-552bba83-7817-40df-a487-41e93f191c6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1276 microversion: 2.1 time: 0.165666 Aug 27 03:20:43.086982 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3278/6374] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:42 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:44.109349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-56d958d9-1307-42e2-9940-2dc242f2bb2b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:44.109999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-56d958d9-1307-42e2-9940-2dc242f2bb2b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:44.118820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56d958d9-1307-42e2-9940-2dc242f2bb2b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:44.119732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56d958d9-1307-42e2-9940-2dc242f2bb2b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:44.120513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56d958d9-1307-42e2-9940-2dc242f2bb2b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:44.121765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56d958d9-1307-42e2-9940-2dc242f2bb2b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:44.122384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56d958d9-1307-42e2-9940-2dc242f2bb2b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:44.122838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56d958d9-1307-42e2-9940-2dc242f2bb2b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:44.262572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-56d958d9-1307-42e2-9940-2dc242f2bb2b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:44.270555 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-56d958d9-1307-42e2-9940-2dc242f2bb2b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1276 microversion: 2.1 time: 0.167086 Aug 27 03:20:44.271123 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3097/6375] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:44 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:45.292272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-92cc8fb0-1e6e-43b9-892c-7e0ad9139781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:45.293101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-92cc8fb0-1e6e-43b9-892c-7e0ad9139781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:45.301867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cc8fb0-1e6e-43b9-892c-7e0ad9139781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:45.302366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cc8fb0-1e6e-43b9-892c-7e0ad9139781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:45.302814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cc8fb0-1e6e-43b9-892c-7e0ad9139781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:45.303564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cc8fb0-1e6e-43b9-892c-7e0ad9139781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:45.304027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cc8fb0-1e6e-43b9-892c-7e0ad9139781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:45.304515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92cc8fb0-1e6e-43b9-892c-7e0ad9139781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:45.447707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-92cc8fb0-1e6e-43b9-892c-7e0ad9139781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:45.456012 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-92cc8fb0-1e6e-43b9-892c-7e0ad9139781 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1276 microversion: 2.1 time: 0.168200 Aug 27 03:20:45.456642 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3279/6376] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:45 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:46.477173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c82f45a-846e-447a-ad5a-7bb46fd7d2f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:46.478566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c82f45a-846e-447a-ad5a-7bb46fd7d2f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:46.485810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c82f45a-846e-447a-ad5a-7bb46fd7d2f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:46.486238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c82f45a-846e-447a-ad5a-7bb46fd7d2f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:46.486694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c82f45a-846e-447a-ad5a-7bb46fd7d2f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:46.487413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c82f45a-846e-447a-ad5a-7bb46fd7d2f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:46.487886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c82f45a-846e-447a-ad5a-7bb46fd7d2f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:46.488328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c82f45a-846e-447a-ad5a-7bb46fd7d2f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:46.624625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2c82f45a-846e-447a-ad5a-7bb46fd7d2f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:46.632581 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c82f45a-846e-447a-ad5a-7bb46fd7d2f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1264 microversion: 2.1 time: 0.159320 Aug 27 03:20:46.633173 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3098/6377] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:46 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:47.653543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a89b67ab-3940-4459-8e54-5719e52bd6c4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:47.654088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a89b67ab-3940-4459-8e54-5719e52bd6c4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:47.661237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a89b67ab-3940-4459-8e54-5719e52bd6c4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:47.661844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a89b67ab-3940-4459-8e54-5719e52bd6c4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:47.662290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a89b67ab-3940-4459-8e54-5719e52bd6c4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:47.662996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a89b67ab-3940-4459-8e54-5719e52bd6c4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:47.663494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a89b67ab-3940-4459-8e54-5719e52bd6c4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:47.664435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a89b67ab-3940-4459-8e54-5719e52bd6c4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:47.795955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a89b67ab-3940-4459-8e54-5719e52bd6c4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:47.803834 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a89b67ab-3940-4459-8e54-5719e52bd6c4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1264 microversion: 2.1 time: 0.154348 Aug 27 03:20:47.805034 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3280/6378] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:47 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:48.825252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-865e1b34-66fe-451c-92d8-c3f23d8d3093 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:48.825991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-865e1b34-66fe-451c-92d8-c3f23d8d3093 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:48.833554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-865e1b34-66fe-451c-92d8-c3f23d8d3093 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:48.834086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-865e1b34-66fe-451c-92d8-c3f23d8d3093 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:48.834546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-865e1b34-66fe-451c-92d8-c3f23d8d3093 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:48.835272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-865e1b34-66fe-451c-92d8-c3f23d8d3093 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:48.836099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-865e1b34-66fe-451c-92d8-c3f23d8d3093 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:48.836572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-865e1b34-66fe-451c-92d8-c3f23d8d3093 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:48.967302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-865e1b34-66fe-451c-92d8-c3f23d8d3093 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:48.975046 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-865e1b34-66fe-451c-92d8-c3f23d8d3093 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1264 microversion: 2.1 time: 0.153832 Aug 27 03:20:48.975618 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3099/6379] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:48 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:49.995937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f8be6b3f-33e0-4811-abda-77f316e5a8b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:49.996559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f8be6b3f-33e0-4811-abda-77f316e5a8b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:49.999587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:50.005305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8be6b3f-33e0-4811-abda-77f316e5a8b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:50.005828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8be6b3f-33e0-4811-abda-77f316e5a8b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:50.006280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8be6b3f-33e0-4811-abda-77f316e5a8b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:50.007026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8be6b3f-33e0-4811-abda-77f316e5a8b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:50.007986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8be6b3f-33e0-4811-abda-77f316e5a8b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:50.008419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8be6b3f-33e0-4811-abda-77f316e5a8b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:50.143942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f8be6b3f-33e0-4811-abda-77f316e5a8b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:50.152485 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f8be6b3f-33e0-4811-abda-77f316e5a8b0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1264 microversion: 2.1 time: 0.160545 Aug 27 03:20:50.153072 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3281/6380] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:49 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:51.174912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:51.176163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:20:51.231785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7917b34-f0d1-4f98-8cde-285d7aa925dc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:51.232458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7917b34-f0d1-4f98-8cde-285d7aa925dc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:51.238484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7917b34-f0d1-4f98-8cde-285d7aa925dc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:51.238986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7917b34-f0d1-4f98-8cde-285d7aa925dc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:51.239474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7917b34-f0d1-4f98-8cde-285d7aa925dc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:51.240191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7917b34-f0d1-4f98-8cde-285d7aa925dc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:51.240663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7917b34-f0d1-4f98-8cde-285d7aa925dc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:51.241109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7917b34-f0d1-4f98-8cde-285d7aa925dc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:51.376034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7917b34-f0d1-4f98-8cde-285d7aa925dc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:51.384243 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7917b34-f0d1-4f98-8cde-285d7aa925dc tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1264 microversion: 2.1 time: 0.213975 Aug 27 03:20:51.385009 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3100/6381] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:51 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:52.405326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3355270d-8dc8-4f00-9eed-f15660393df0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:52.405973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3355270d-8dc8-4f00-9eed-f15660393df0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:52.412974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3355270d-8dc8-4f00-9eed-f15660393df0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:52.413708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3355270d-8dc8-4f00-9eed-f15660393df0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:52.413931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3355270d-8dc8-4f00-9eed-f15660393df0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:52.414626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3355270d-8dc8-4f00-9eed-f15660393df0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:52.415075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3355270d-8dc8-4f00-9eed-f15660393df0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:52.415505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3355270d-8dc8-4f00-9eed-f15660393df0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:52.548878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3355270d-8dc8-4f00-9eed-f15660393df0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:52.557998 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3355270d-8dc8-4f00-9eed-f15660393df0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1264 microversion: 2.1 time: 0.155866 Aug 27 03:20:52.558798 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3282/6382] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:52 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:53.579565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5c99d47e-2180-4b01-9799-2c1ab39a1ce8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:53.580197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5c99d47e-2180-4b01-9799-2c1ab39a1ce8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:53.588167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c99d47e-2180-4b01-9799-2c1ab39a1ce8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:53.588672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c99d47e-2180-4b01-9799-2c1ab39a1ce8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:53.589131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c99d47e-2180-4b01-9799-2c1ab39a1ce8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:53.589906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c99d47e-2180-4b01-9799-2c1ab39a1ce8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:53.590377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c99d47e-2180-4b01-9799-2c1ab39a1ce8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:53.590824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c99d47e-2180-4b01-9799-2c1ab39a1ce8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:53.724565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5c99d47e-2180-4b01-9799-2c1ab39a1ce8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:53.732469 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5c99d47e-2180-4b01-9799-2c1ab39a1ce8 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1264 microversion: 2.1 time: 0.156881 Aug 27 03:20:53.733064 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3101/6383] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:53 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:54.753621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d227da2e-6acc-46dd-8c2a-bf078775ec46 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:54.754586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d227da2e-6acc-46dd-8c2a-bf078775ec46 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:54.767197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d227da2e-6acc-46dd-8c2a-bf078775ec46 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:54.768010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d227da2e-6acc-46dd-8c2a-bf078775ec46 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:54.768806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d227da2e-6acc-46dd-8c2a-bf078775ec46 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:54.769884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d227da2e-6acc-46dd-8c2a-bf078775ec46 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:54.770547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d227da2e-6acc-46dd-8c2a-bf078775ec46 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:54.771176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d227da2e-6acc-46dd-8c2a-bf078775ec46 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:54.847661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c31e9a27-bec1-492c-89f0-057b74e904cd req-73436218-fb27-41d0-bad4-2c91555ed2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87e599e-5f9e-45e1-9106-e03389fcc190", "name": "network-vif-plugged", "status": "completed", "tag": "4457d0d4-761d-48ee-8c46-8b57c9d911a8"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:54.857546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c31e9a27-bec1-492c-89f0-057b74e904cd req-73436218-fb27-41d0-bad4-2c91555ed2eb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:54.858060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c31e9a27-bec1-492c-89f0-057b74e904cd req-73436218-fb27-41d0-bad4-2c91555ed2eb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:54.858509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c31e9a27-bec1-492c-89f0-057b74e904cd req-73436218-fb27-41d0-bad4-2c91555ed2eb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:54.870731 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c31e9a27-bec1-492c-89f0-057b74e904cd req-73436218-fb27-41d0-bad4-2c91555ed2eb service nova] Creating event network-vif-plugged:4457d0d4-761d-48ee-8c46-8b57c9d911a8 for instance d87e599e-5f9e-45e1-9106-e03389fcc190 on n-h2-852084-5 Aug 27 03:20:54.875915 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c31e9a27-bec1-492c-89f0-057b74e904cd req-73436218-fb27-41d0-bad4-2c91555ed2eb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135993 Aug 27 03:20:54.876536 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3283/6384] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:20:54.919953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d227da2e-6acc-46dd-8c2a-bf078775ec46 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:54.928017 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d227da2e-6acc-46dd-8c2a-bf078775ec46 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1264 microversion: 2.1 time: 0.179363 Aug 27 03:20:54.928600 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3102/6385] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:54 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:20:55.950742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec75cddf-f367-4169-87ea-cb71ca163b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:55.951489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ec75cddf-f367-4169-87ea-cb71ca163b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:55.961771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec75cddf-f367-4169-87ea-cb71ca163b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:55.962485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec75cddf-f367-4169-87ea-cb71ca163b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:55.963010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec75cddf-f367-4169-87ea-cb71ca163b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:55.963900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec75cddf-f367-4169-87ea-cb71ca163b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:55.964633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec75cddf-f367-4169-87ea-cb71ca163b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:55.965320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec75cddf-f367-4169-87ea-cb71ca163b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:56.132738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ec75cddf-f367-4169-87ea-cb71ca163b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:56.140983 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec75cddf-f367-4169-87ea-cb71ca163b10 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1264 microversion: 2.1 time: 0.196149 Aug 27 03:20:56.141593 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3284/6386] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:55 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:57.162208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1dfcaf71-c0c8-4bf3-a107-f418f8171ea7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:57.162829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1dfcaf71-c0c8-4bf3-a107-f418f8171ea7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:57.169894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dfcaf71-c0c8-4bf3-a107-f418f8171ea7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.170389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dfcaf71-c0c8-4bf3-a107-f418f8171ea7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.170837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dfcaf71-c0c8-4bf3-a107-f418f8171ea7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.171541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dfcaf71-c0c8-4bf3-a107-f418f8171ea7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.172001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dfcaf71-c0c8-4bf3-a107-f418f8171ea7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.172439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1dfcaf71-c0c8-4bf3-a107-f418f8171ea7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.305990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1dfcaf71-c0c8-4bf3-a107-f418f8171ea7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:57.313864 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1dfcaf71-c0c8-4bf3-a107-f418f8171ea7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1451 microversion: 2.1 time: 0.155555 Aug 27 03:20:57.314431 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3103/6387] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:57 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:57.334286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5160e6a3-7867-42f1-b432-0f89e50004c2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:20:57.334914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5160e6a3-7867-42f1-b432-0f89e50004c2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:20:57.342841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5160e6a3-7867-42f1-b432-0f89e50004c2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.343332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5160e6a3-7867-42f1-b432-0f89e50004c2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.343777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5160e6a3-7867-42f1-b432-0f89e50004c2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.344493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5160e6a3-7867-42f1-b432-0f89e50004c2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:57.344957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5160e6a3-7867-42f1-b432-0f89e50004c2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:57.345400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5160e6a3-7867-42f1-b432-0f89e50004c2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:57.477781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5160e6a3-7867-42f1-b432-0f89e50004c2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:20:57.485937 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5160e6a3-7867-42f1-b432-0f89e50004c2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1451 microversion: 2.1 time: 0.155452 Aug 27 03:20:57.486458 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3285/6388] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:20:57 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:20:59.187933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-426346b6-6225-48de-98e2-526a5db9a2de req-f5413bb7-ac98-4f40-8801-83d9e4dd2dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87e599e-5f9e-45e1-9106-e03389fcc190", "tag": "4457d0d4-761d-48ee-8c46-8b57c9d911a8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:20:59.201020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-426346b6-6225-48de-98e2-526a5db9a2de req-f5413bb7-ac98-4f40-8801-83d9e4dd2dd5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:20:59.201859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-426346b6-6225-48de-98e2-526a5db9a2de req-f5413bb7-ac98-4f40-8801-83d9e4dd2dd5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:20:59.202555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-426346b6-6225-48de-98e2-526a5db9a2de req-f5413bb7-ac98-4f40-8801-83d9e4dd2dd5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:20:59.221078 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-426346b6-6225-48de-98e2-526a5db9a2de req-f5413bb7-ac98-4f40-8801-83d9e4dd2dd5 service nova] Creating event network-changed:4457d0d4-761d-48ee-8c46-8b57c9d911a8 for instance d87e599e-5f9e-45e1-9106-e03389fcc190 on n-h2-852084-5 Aug 27 03:20:59.228849 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-426346b6-6225-48de-98e2-526a5db9a2de req-f5413bb7-ac98-4f40-8801-83d9e4dd2dd5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044710 Aug 27 03:20:59.229835 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3104/6389] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:54.745807 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2a984f1-fecc-4493-b1c3-f7a871d4cd60] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:22:54.746678 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dce2f75-e4fe-43f3-8eba-2057b586517f] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:22:54.747545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=22 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:54.748321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=50 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:54.749170 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:22:54.749357 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 03:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 (ip 10.222.0.99) !!! Aug 27 03:22:54.750715 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:22:54.750830 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 03:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 (ip 10.222.0.99) !!! Aug 27 03:22:54.755301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3eddac70-148d-4024-b9ab-1720c3f5f17d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:54.755836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3eddac70-148d-4024-b9ab-1720c3f5f17d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:54.766594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eddac70-148d-4024-b9ab-1720c3f5f17d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:54.767798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eddac70-148d-4024-b9ab-1720c3f5f17d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:54.767798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eddac70-148d-4024-b9ab-1720c3f5f17d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:54.768295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eddac70-148d-4024-b9ab-1720c3f5f17d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:54.769174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eddac70-148d-4024-b9ab-1720c3f5f17d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:54.769174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eddac70-148d-4024-b9ab-1720c3f5f17d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:54.798616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3eddac70-148d-4024-b9ab-1720c3f5f17d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:22:54.880618 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3eddac70-148d-4024-b9ab-1720c3f5f17d tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 204 len: 0 microversion: 2.1 time: 0.137197 Aug 27 03:22:54.881234 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3286/6390] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:22:54 2022] DELETE /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:22:54.890234 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] AMQP server on 10.222.0.99:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 03:22:54.891318 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] AMQP server on 10.222.0.99:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 03:22:54.893436 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:22:54.893602 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 (ip 10.222.0.99) !!! Aug 27 03:22:54.895323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:54.895968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=54 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:22:54.896800 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:22:54.896927 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 (ip 10.222.0.99) !!! Aug 27 03:22:54.905252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0d1456be-69f0-44ce-a50a-391c8c0e49af tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:54.906022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0d1456be-69f0-44ce-a50a-391c8c0e49af tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:54.921776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1456be-69f0-44ce-a50a-391c8c0e49af tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:54.922281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1456be-69f0-44ce-a50a-391c8c0e49af tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:54.922739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1456be-69f0-44ce-a50a-391c8c0e49af tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:54.923473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1456be-69f0-44ce-a50a-391c8c0e49af tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:54.923941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1456be-69f0-44ce-a50a-391c8c0e49af tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:54.924375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0d1456be-69f0-44ce-a50a-391c8c0e49af tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:55.159398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0d1456be-69f0-44ce-a50a-391c8c0e49af tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:55.167899 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0d1456be-69f0-44ce-a50a-391c8c0e49af tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1575 microversion: 2.1 time: 0.280844 Aug 27 03:22:55.168502 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3105/6391] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:54 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1575 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:56.195362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-144110ae-a550-49bb-ba57-61d054bcf5a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:56.196080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-144110ae-a550-49bb-ba57-61d054bcf5a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:56.208041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-144110ae-a550-49bb-ba57-61d054bcf5a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:56.208535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-144110ae-a550-49bb-ba57-61d054bcf5a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:56.208974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-144110ae-a550-49bb-ba57-61d054bcf5a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:56.209720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-144110ae-a550-49bb-ba57-61d054bcf5a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:56.210182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-144110ae-a550-49bb-ba57-61d054bcf5a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:56.211003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-144110ae-a550-49bb-ba57-61d054bcf5a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:56.215819 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dce2f75-e4fe-43f3-8eba-2057b586517f] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 49624. Aug 27 03:22:56.219505 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2a984f1-fecc-4493-b1c3-f7a871d4cd60] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 49622. Aug 27 03:22:56.425761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-144110ae-a550-49bb-ba57-61d054bcf5a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:56.434662 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-144110ae-a550-49bb-ba57-61d054bcf5a4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1575 microversion: 2.1 time: 0.243597 Aug 27 03:22:56.435266 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3287/6392] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:56 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:57.412313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-43092c4a-1d02-4385-871d-0f39d6df7d88 req-45525521-c9ca-4808-be09-1d1a44d6baa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87e599e-5f9e-45e1-9106-e03389fcc190", "name": "network-vif-deleted", "tag": "4457d0d4-761d-48ee-8c46-8b57c9d911a8"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:22:57.437900 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 49632. Aug 27 03:22:57.449471 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 49630. Aug 27 03:22:57.452776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-43092c4a-1d02-4385-871d-0f39d6df7d88 req-45525521-c9ca-4808-be09-1d1a44d6baa7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:57.453282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-43092c4a-1d02-4385-871d-0f39d6df7d88 req-45525521-c9ca-4808-be09-1d1a44d6baa7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:57.453760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-43092c4a-1d02-4385-871d-0f39d6df7d88 req-45525521-c9ca-4808-be09-1d1a44d6baa7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:57.457760 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4f5e2e3-ea6d-4309-aec2-56248cdd8408 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:57.459206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b4f5e2e3-ea6d-4309-aec2-56248cdd8408 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:57.470076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4f5e2e3-ea6d-4309-aec2-56248cdd8408 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:57.471100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4f5e2e3-ea6d-4309-aec2-56248cdd8408 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:57.471764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4f5e2e3-ea6d-4309-aec2-56248cdd8408 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:57.473626 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-43092c4a-1d02-4385-871d-0f39d6df7d88 req-45525521-c9ca-4808-be09-1d1a44d6baa7 service nova] Creating event network-vif-deleted:4457d0d4-761d-48ee-8c46-8b57c9d911a8 for instance d87e599e-5f9e-45e1-9106-e03389fcc190 on n-h2-852084-5 Aug 27 03:22:57.476386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4f5e2e3-ea6d-4309-aec2-56248cdd8408 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:57.476924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4f5e2e3-ea6d-4309-aec2-56248cdd8408 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:57.477379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4f5e2e3-ea6d-4309-aec2-56248cdd8408 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:57.479675 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-43092c4a-1d02-4385-871d-0f39d6df7d88 req-45525521-c9ca-4808-be09-1d1a44d6baa7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076178 Aug 27 03:22:57.481107 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3106/6393] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:22:57.566471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b4f5e2e3-ea6d-4309-aec2-56248cdd8408 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:57.576403 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b4f5e2e3-ea6d-4309-aec2-56248cdd8408 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1224 microversion: 2.1 time: 0.123819 Aug 27 03:22:57.577001 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3288/6394] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:57 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1224 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:22:58.598215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c0e61eaf-d18a-4b36-a9c7-d6c67e4963c0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:58.598889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c0e61eaf-d18a-4b36-a9c7-d6c67e4963c0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:58.606815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0e61eaf-d18a-4b36-a9c7-d6c67e4963c0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:58.607350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0e61eaf-d18a-4b36-a9c7-d6c67e4963c0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:58.607803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0e61eaf-d18a-4b36-a9c7-d6c67e4963c0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:58.608523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0e61eaf-d18a-4b36-a9c7-d6c67e4963c0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:58.609030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0e61eaf-d18a-4b36-a9c7-d6c67e4963c0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:58.609477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0e61eaf-d18a-4b36-a9c7-d6c67e4963c0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:58.677019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c0e61eaf-d18a-4b36-a9c7-d6c67e4963c0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:58.685955 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c0e61eaf-d18a-4b36-a9c7-d6c67e4963c0 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1224 microversion: 2.1 time: 0.092241 Aug 27 03:22:58.686551 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3107/6395] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:58 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:22:59.707480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-84de9880-757b-403d-b6ff-2143a0b73953 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:22:59.708190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-84de9880-757b-403d-b6ff-2143a0b73953 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:22:59.715729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84de9880-757b-403d-b6ff-2143a0b73953 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:59.716228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84de9880-757b-403d-b6ff-2143a0b73953 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:59.716679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84de9880-757b-403d-b6ff-2143a0b73953 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:59.717650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84de9880-757b-403d-b6ff-2143a0b73953 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:22:59.718135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84de9880-757b-403d-b6ff-2143a0b73953 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:22:59.718574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84de9880-757b-403d-b6ff-2143a0b73953 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:22:59.788857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-84de9880-757b-403d-b6ff-2143a0b73953 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:22:59.797313 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-84de9880-757b-403d-b6ff-2143a0b73953 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1224 microversion: 2.1 time: 0.093876 Aug 27 03:22:59.797953 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3289/6396] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:22:59 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:00.819577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0745d7f2-2a8c-4ced-be46-be4884954ea3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:00.819955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0745d7f2-2a8c-4ced-be46-be4884954ea3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:00.828139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0745d7f2-2a8c-4ced-be46-be4884954ea3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:00.828658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0745d7f2-2a8c-4ced-be46-be4884954ea3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:00.829110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0745d7f2-2a8c-4ced-be46-be4884954ea3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:00.829889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0745d7f2-2a8c-4ced-be46-be4884954ea3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:00.830366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0745d7f2-2a8c-4ced-be46-be4884954ea3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:00.830811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0745d7f2-2a8c-4ced-be46-be4884954ea3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:00.905792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0745d7f2-2a8c-4ced-be46-be4884954ea3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:00.913718 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0745d7f2-2a8c-4ced-be46-be4884954ea3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1224 microversion: 2.1 time: 0.098409 Aug 27 03:23:00.914310 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3108/6397] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:00 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:01.934017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:01.934834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:01.942544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:01.943040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:01.943569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:01.944411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:01.944906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:01.945407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:01.978116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:01.978602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:01.979597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:01.980044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lazy-loading 'fault' on Instance uuid d87e599e-5f9e-45e1-9106-e03389fcc190 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:23:02.019719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:02.028297 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-360472e9-1dc3-4893-85b6-87abc416be41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 200 len: 1229 microversion: 2.1 time: 0.098253 Aug 27 03:23:02.028887 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3290/6398] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:01 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:03.048955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:03.049779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:03.056609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:03.057839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:03.058149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:03.058869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:03.059333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:03.059773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:03.073727 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 HTTP/1.1 Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'd87e599e-5f9e-45e1-9106-e03389fcc190'} Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:23:03.075418 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:23:03.079688 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:23:03.079688 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:23:03.079688 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:23:03.079688 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:23:03.079688 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:23:03.079688 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:23:03.079688 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:23:03.079688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:23:03.079688 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5b94778e-32fd-4dcd-90f4-18af875e7137 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 404 len: 111 microversion: 2.1 time: 0.032122 Aug 27 03:23:03.079688 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3109/6399] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:03 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:23:03.128852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1914813844", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-103287171", "security_groups": [{"name": "tempest-secgroup-smoke-522862021"}], "block_device_mapping_v2": [{"uuid": "61d9e199-04cf-4b59-aaf9-5dbbeafb28f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9f6cd27d-8b3c-456e-af66-44212888909f"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:03.246161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] validate_networks() for [('9f6cd27d-8b3c-456e-af66-44212888909f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:23:03.699911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:23:03.700348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:23:03.700862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:23:03.701312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:23:03.701755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:23:03.711634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:03.712118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:03.712564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:03.713992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:03.714459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:03.714894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:03.732236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:23:03.737564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for user 0a78655bea27452faee67a7efd476175 and project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:23:03.795973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:23:03.798151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61d9e199-04cf-4b59-aaf9-5dbbeafb28f3',volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:23:03.932706 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bc48deb5-d198-4aad-ab70-7393632d3afd tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.807150 Aug 27 03:23:03.934766 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3291/6400] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:23:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:23:03.944894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e51694b3-2fca-43ed-942c-18ecd4902117 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:03.945740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e51694b3-2fca-43ed-942c-18ecd4902117 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:04.004954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e51694b3-2fca-43ed-942c-18ecd4902117 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:04.018317 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e51694b3-2fca-43ed-942c-18ecd4902117 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1094 microversion: 2.1 time: 0.076934 Aug 27 03:23:04.026594 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3110/6401] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:03 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:05.040566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bf1d12da-00a9-450e-b11c-41754ca000be tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:05.041838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bf1d12da-00a9-450e-b11c-41754ca000be tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:05.048207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf1d12da-00a9-450e-b11c-41754ca000be tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:05.048703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf1d12da-00a9-450e-b11c-41754ca000be tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:05.049150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf1d12da-00a9-450e-b11c-41754ca000be tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:05.049904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf1d12da-00a9-450e-b11c-41754ca000be tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:05.050369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf1d12da-00a9-450e-b11c-41754ca000be tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:05.050834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf1d12da-00a9-450e-b11c-41754ca000be tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:05.122444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bf1d12da-00a9-450e-b11c-41754ca000be tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:05.131083 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bf1d12da-00a9-450e-b11c-41754ca000be tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1192 microversion: 2.1 time: 0.095396 Aug 27 03:23:05.145700 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3292/6402] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:05 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:06.155231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f6319fb6-30ad-444f-94a0-9fbcd53265ae tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:06.156604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f6319fb6-30ad-444f-94a0-9fbcd53265ae tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:06.166745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6319fb6-30ad-444f-94a0-9fbcd53265ae tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:06.167823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6319fb6-30ad-444f-94a0-9fbcd53265ae tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:06.168521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6319fb6-30ad-444f-94a0-9fbcd53265ae tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:06.169552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6319fb6-30ad-444f-94a0-9fbcd53265ae tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:06.170261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6319fb6-30ad-444f-94a0-9fbcd53265ae tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:06.170919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6319fb6-30ad-444f-94a0-9fbcd53265ae tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:06.408496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f6319fb6-30ad-444f-94a0-9fbcd53265ae tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:06.422883 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f6319fb6-30ad-444f-94a0-9fbcd53265ae tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1277 microversion: 2.1 time: 0.272386 Aug 27 03:23:06.424204 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3111/6403] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:06 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:06.855439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c0f23510-d484-4b0a-9dba-f514c47c47de req-5150100c-708d-4369-bd7d-aa6b62638024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1", "tag": "1a6d82d0-2a15-4bab-a8bf-96cf80536711"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:06.873833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c0f23510-d484-4b0a-9dba-f514c47c47de req-5150100c-708d-4369-bd7d-aa6b62638024 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:06.874457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c0f23510-d484-4b0a-9dba-f514c47c47de req-5150100c-708d-4369-bd7d-aa6b62638024 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:06.875131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c0f23510-d484-4b0a-9dba-f514c47c47de req-5150100c-708d-4369-bd7d-aa6b62638024 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:06.888373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c0f23510-d484-4b0a-9dba-f514c47c47de req-5150100c-708d-4369-bd7d-aa6b62638024 service nova] Creating event network-changed:1a6d82d0-2a15-4bab-a8bf-96cf80536711 for instance 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 on n-h1-852084-5 Aug 27 03:23:06.893791 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c0f23510-d484-4b0a-9dba-f514c47c47de req-5150100c-708d-4369-bd7d-aa6b62638024 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138969 Aug 27 03:23:06.894663 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3293/6404] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:23:07.446168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48cdcf1e-84c8-4449-a1bc-4815307f8a60 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:07.446800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-48cdcf1e-84c8-4449-a1bc-4815307f8a60 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:07.459099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48cdcf1e-84c8-4449-a1bc-4815307f8a60 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:07.459633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48cdcf1e-84c8-4449-a1bc-4815307f8a60 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:07.460092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48cdcf1e-84c8-4449-a1bc-4815307f8a60 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:07.460814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48cdcf1e-84c8-4449-a1bc-4815307f8a60 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:07.461298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48cdcf1e-84c8-4449-a1bc-4815307f8a60 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:07.461898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48cdcf1e-84c8-4449-a1bc-4815307f8a60 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:07.709039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-48cdcf1e-84c8-4449-a1bc-4815307f8a60 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:07.720002 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-48cdcf1e-84c8-4449-a1bc-4815307f8a60 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1277 microversion: 2.1 time: 0.277634 Aug 27 03:23:07.721279 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3112/6405] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:07 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1277 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:08.755074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-97b3041d-d75f-4760-8a3f-e9d5ead57e47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:08.755739 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-97b3041d-d75f-4760-8a3f-e9d5ead57e47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:08.762402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b3041d-d75f-4760-8a3f-e9d5ead57e47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:08.762890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b3041d-d75f-4760-8a3f-e9d5ead57e47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:08.763336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b3041d-d75f-4760-8a3f-e9d5ead57e47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:08.764047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b3041d-d75f-4760-8a3f-e9d5ead57e47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:08.764598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b3041d-d75f-4760-8a3f-e9d5ead57e47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:08.764936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97b3041d-d75f-4760-8a3f-e9d5ead57e47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:08.916767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-97b3041d-d75f-4760-8a3f-e9d5ead57e47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:08.925373 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-97b3041d-d75f-4760-8a3f-e9d5ead57e47 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1277 microversion: 2.1 time: 0.175690 Aug 27 03:23:08.926005 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3294/6406] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:08 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:09.950895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-024faa18-f840-4fbf-a4b2-ebbd1027ab69 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:09.951820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-024faa18-f840-4fbf-a4b2-ebbd1027ab69 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:09.964153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-024faa18-f840-4fbf-a4b2-ebbd1027ab69 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:09.964996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-024faa18-f840-4fbf-a4b2-ebbd1027ab69 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:09.965872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-024faa18-f840-4fbf-a4b2-ebbd1027ab69 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:09.967439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-024faa18-f840-4fbf-a4b2-ebbd1027ab69 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:09.968432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-024faa18-f840-4fbf-a4b2-ebbd1027ab69 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:09.969294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-024faa18-f840-4fbf-a4b2-ebbd1027ab69 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:10.120640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-024faa18-f840-4fbf-a4b2-ebbd1027ab69 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:10.129465 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-024faa18-f840-4fbf-a4b2-ebbd1027ab69 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1277 microversion: 2.1 time: 0.186713 Aug 27 03:23:10.144648 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3113/6407] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:09 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:11.152815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78b64a8e-51c0-446b-b5fb-e57369306b0a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:11.153438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-78b64a8e-51c0-446b-b5fb-e57369306b0a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:11.160902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b64a8e-51c0-446b-b5fb-e57369306b0a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:11.161422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b64a8e-51c0-446b-b5fb-e57369306b0a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:11.161903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b64a8e-51c0-446b-b5fb-e57369306b0a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:11.162624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b64a8e-51c0-446b-b5fb-e57369306b0a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:11.163088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b64a8e-51c0-446b-b5fb-e57369306b0a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:11.163522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78b64a8e-51c0-446b-b5fb-e57369306b0a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:11.303274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-78b64a8e-51c0-446b-b5fb-e57369306b0a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:11.315751 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-78b64a8e-51c0-446b-b5fb-e57369306b0a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1265 microversion: 2.1 time: 0.167450 Aug 27 03:23:11.316348 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3295/6408] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:11 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:12.337114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-63b9dfed-1a3c-46a9-a649-a69ac6b02a33 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:12.338314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-63b9dfed-1a3c-46a9-a649-a69ac6b02a33 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:12.346508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63b9dfed-1a3c-46a9-a649-a69ac6b02a33 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:12.347020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63b9dfed-1a3c-46a9-a649-a69ac6b02a33 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:12.347479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63b9dfed-1a3c-46a9-a649-a69ac6b02a33 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:12.348213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63b9dfed-1a3c-46a9-a649-a69ac6b02a33 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:12.348689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63b9dfed-1a3c-46a9-a649-a69ac6b02a33 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:12.349144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63b9dfed-1a3c-46a9-a649-a69ac6b02a33 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:12.502026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-63b9dfed-1a3c-46a9-a649-a69ac6b02a33 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:12.512870 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-63b9dfed-1a3c-46a9-a649-a69ac6b02a33 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1265 microversion: 2.1 time: 0.179731 Aug 27 03:23:12.513470 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3114/6409] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:12 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:13.534146 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b94dd871-fa57-4e27-af4e-087c9b69b863 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:13.534766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b94dd871-fa57-4e27-af4e-087c9b69b863 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:13.542395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b94dd871-fa57-4e27-af4e-087c9b69b863 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:13.542886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b94dd871-fa57-4e27-af4e-087c9b69b863 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:13.543334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b94dd871-fa57-4e27-af4e-087c9b69b863 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:13.544064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b94dd871-fa57-4e27-af4e-087c9b69b863 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:13.544530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b94dd871-fa57-4e27-af4e-087c9b69b863 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:13.544973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b94dd871-fa57-4e27-af4e-087c9b69b863 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:13.694641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b94dd871-fa57-4e27-af4e-087c9b69b863 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:13.703179 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b94dd871-fa57-4e27-af4e-087c9b69b863 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1265 microversion: 2.1 time: 0.172855 Aug 27 03:23:13.703810 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3296/6410] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:13 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:14.727622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3495c6b6-04c5-48e4-8d1f-58ebfa1bfc4b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:14.728926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3495c6b6-04c5-48e4-8d1f-58ebfa1bfc4b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:14.732161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:14.738406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3495c6b6-04c5-48e4-8d1f-58ebfa1bfc4b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:14.739010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3495c6b6-04c5-48e4-8d1f-58ebfa1bfc4b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:14.739654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3495c6b6-04c5-48e4-8d1f-58ebfa1bfc4b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:14.740370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3495c6b6-04c5-48e4-8d1f-58ebfa1bfc4b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:14.741074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3495c6b6-04c5-48e4-8d1f-58ebfa1bfc4b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:14.741631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3495c6b6-04c5-48e4-8d1f-58ebfa1bfc4b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:14.892429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3495c6b6-04c5-48e4-8d1f-58ebfa1bfc4b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:14.901435 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3495c6b6-04c5-48e4-8d1f-58ebfa1bfc4b tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1265 microversion: 2.1 time: 0.179909 Aug 27 03:23:14.902062 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3115/6411] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:14 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:15.928312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b5bcbdf8-c76c-4344-8e91-f07329c0de6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:15.928953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b5bcbdf8-c76c-4344-8e91-f07329c0de6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:15.930980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:15.932314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:23:15.940118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bcbdf8-c76c-4344-8e91-f07329c0de6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:15.940619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bcbdf8-c76c-4344-8e91-f07329c0de6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:15.941061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bcbdf8-c76c-4344-8e91-f07329c0de6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:15.941811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bcbdf8-c76c-4344-8e91-f07329c0de6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:15.942273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bcbdf8-c76c-4344-8e91-f07329c0de6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:15.942705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5bcbdf8-c76c-4344-8e91-f07329c0de6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:16.094981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b5bcbdf8-c76c-4344-8e91-f07329c0de6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:16.104019 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b5bcbdf8-c76c-4344-8e91-f07329c0de6a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1265 microversion: 2.1 time: 0.178956 Aug 27 03:23:16.104638 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3297/6412] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:15 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:17.124900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-243176e6-0764-41db-b626-c7856ff11c2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:17.125455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-243176e6-0764-41db-b626-c7856ff11c2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:17.132840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-243176e6-0764-41db-b626-c7856ff11c2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:17.133351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-243176e6-0764-41db-b626-c7856ff11c2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:17.133841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-243176e6-0764-41db-b626-c7856ff11c2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:17.135111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-243176e6-0764-41db-b626-c7856ff11c2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:17.135589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-243176e6-0764-41db-b626-c7856ff11c2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:17.136027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-243176e6-0764-41db-b626-c7856ff11c2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:17.553547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-243176e6-0764-41db-b626-c7856ff11c2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:17.563633 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-243176e6-0764-41db-b626-c7856ff11c2a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1265 microversion: 2.1 time: 0.442327 Aug 27 03:23:17.564311 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3116/6413] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:17 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1265 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:18.584815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-40deeac2-d8bf-4816-b9ff-feade7ab08c1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:18.585414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-40deeac2-d8bf-4816-b9ff-feade7ab08c1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:18.593287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40deeac2-d8bf-4816-b9ff-feade7ab08c1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:18.593899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40deeac2-d8bf-4816-b9ff-feade7ab08c1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:18.594340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40deeac2-d8bf-4816-b9ff-feade7ab08c1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:18.595048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40deeac2-d8bf-4816-b9ff-feade7ab08c1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:18.595678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40deeac2-d8bf-4816-b9ff-feade7ab08c1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:18.595912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40deeac2-d8bf-4816-b9ff-feade7ab08c1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:18.741063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-40deeac2-d8bf-4816-b9ff-feade7ab08c1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:18.749862 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-40deeac2-d8bf-4816-b9ff-feade7ab08c1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1265 microversion: 2.1 time: 0.168789 Aug 27 03:23:18.750553 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3298/6414] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:18 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:19.393572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0c0fb9a9-90b1-4a5a-b7c2-dfa3f0002a10 req-7ba2af14-b0c3-4516-aaae-064b156d3afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1", "name": "network-vif-plugged", "status": "completed", "tag": "1a6d82d0-2a15-4bab-a8bf-96cf80536711"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:19.405382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0c0fb9a9-90b1-4a5a-b7c2-dfa3f0002a10 req-7ba2af14-b0c3-4516-aaae-064b156d3afc service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:19.405994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0c0fb9a9-90b1-4a5a-b7c2-dfa3f0002a10 req-7ba2af14-b0c3-4516-aaae-064b156d3afc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:19.406450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0c0fb9a9-90b1-4a5a-b7c2-dfa3f0002a10 req-7ba2af14-b0c3-4516-aaae-064b156d3afc service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:19.419037 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0c0fb9a9-90b1-4a5a-b7c2-dfa3f0002a10 req-7ba2af14-b0c3-4516-aaae-064b156d3afc service nova] Creating event network-vif-plugged:1a6d82d0-2a15-4bab-a8bf-96cf80536711 for instance 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 on n-h1-852084-5 Aug 27 03:23:19.424385 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0c0fb9a9-90b1-4a5a-b7c2-dfa3f0002a10 req-7ba2af14-b0c3-4516-aaae-064b156d3afc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034556 Aug 27 03:23:19.425015 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3117/6415] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:23:19.771653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-77e85924-844b-4241-b622-49482fd5cd4e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:19.772274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-77e85924-844b-4241-b622-49482fd5cd4e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:19.779477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e85924-844b-4241-b622-49482fd5cd4e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:19.779965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e85924-844b-4241-b622-49482fd5cd4e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:19.780407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e85924-844b-4241-b622-49482fd5cd4e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:19.781142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e85924-844b-4241-b622-49482fd5cd4e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:19.781603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e85924-844b-4241-b622-49482fd5cd4e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:19.782063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-77e85924-844b-4241-b622-49482fd5cd4e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:19.927594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-77e85924-844b-4241-b622-49482fd5cd4e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:19.936730 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-77e85924-844b-4241-b622-49482fd5cd4e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1265 microversion: 2.1 time: 0.169204 Aug 27 03:23:19.937369 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3299/6416] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:19 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:20.961367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dd453578-bb53-4991-9698-24ce294485c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:20.962142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dd453578-bb53-4991-9698-24ce294485c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:20.969877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd453578-bb53-4991-9698-24ce294485c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:20.970381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd453578-bb53-4991-9698-24ce294485c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:20.970856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd453578-bb53-4991-9698-24ce294485c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:20.971585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd453578-bb53-4991-9698-24ce294485c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:20.972061 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd453578-bb53-4991-9698-24ce294485c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:20.972506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dd453578-bb53-4991-9698-24ce294485c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:21.120754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dd453578-bb53-4991-9698-24ce294485c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:21.129116 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dd453578-bb53-4991-9698-24ce294485c5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1453 microversion: 2.1 time: 0.173115 Aug 27 03:23:21.129750 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3118/6417] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:20 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:21.149499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95b85d54-67f5-4530-8cfa-e0a96805be84 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:23:21.150182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-95b85d54-67f5-4530-8cfa-e0a96805be84 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:23:21.157363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95b85d54-67f5-4530-8cfa-e0a96805be84 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:21.157917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95b85d54-67f5-4530-8cfa-e0a96805be84 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:21.158358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95b85d54-67f5-4530-8cfa-e0a96805be84 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:21.159063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95b85d54-67f5-4530-8cfa-e0a96805be84 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:21.159520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95b85d54-67f5-4530-8cfa-e0a96805be84 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:21.159947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95b85d54-67f5-4530-8cfa-e0a96805be84 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:21.315415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-95b85d54-67f5-4530-8cfa-e0a96805be84 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:23:21.324000 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-95b85d54-67f5-4530-8cfa-e0a96805be84 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1453 microversion: 2.1 time: 0.178282 Aug 27 03:23:21.324883 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3300/6418] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:23:21 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:23:23.177502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-15edbffc-17a6-400f-953e-0420b9787783 req-fd90e06e-6ea7-4592-bb45-57135c5070e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1", "tag": "1a6d82d0-2a15-4bab-a8bf-96cf80536711"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:23:23.189005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-15edbffc-17a6-400f-953e-0420b9787783 req-fd90e06e-6ea7-4592-bb45-57135c5070e6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:23:23.189511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-15edbffc-17a6-400f-953e-0420b9787783 req-fd90e06e-6ea7-4592-bb45-57135c5070e6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:23:23.189997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-15edbffc-17a6-400f-953e-0420b9787783 req-fd90e06e-6ea7-4592-bb45-57135c5070e6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:23:23.202255 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-15edbffc-17a6-400f-953e-0420b9787783 req-fd90e06e-6ea7-4592-bb45-57135c5070e6 service nova] Creating event network-changed:1a6d82d0-2a15-4bab-a8bf-96cf80536711 for instance 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 on n-h1-852084-5 Aug 27 03:23:23.207926 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-15edbffc-17a6-400f-953e-0420b9787783 req-fd90e06e-6ea7-4592-bb45-57135c5070e6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034219 Aug 27 03:23:23.209073 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3119/6419] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:02.786818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:02.787579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:02.792863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1690126018", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-103287171", "security_groups": [{"name": "tempest-secgroup-smoke-522862021"}], "block_device_mapping_v2": [{"uuid": "8520acb8-c4f3-4b0a-b018-1e5288b41a6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9f6cd27d-8b3c-456e-af66-44212888909f"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:03.133332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] validate_networks() for [('9f6cd27d-8b3c-456e-af66-44212888909f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:25:03.510633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:25:03.511088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:25:03.511575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:25:03.511992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:25:03.512444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:25:03.521434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:03.521956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:03.522404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:03.523134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:03.523597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:03.524030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:03.541527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:25:03.547682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Getting quotas for user 0a78655bea27452faee67a7efd476175 and project 45bcf3858f3c4e1c8c71842958d17bf1. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:25:03.605814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:25:03.608050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8520acb8-c4f3-4b0a-b018-1e5288b41a6f',volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:25:03.738717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-28cfd51f-2298-4739-84dc-a3330186e6a2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.953989 Aug 27 03:25:03.739428 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3301/6420] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:25:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:25:03.750754 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] AMQP server on 10.222.0.99:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 03:25:03.752689 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] AMQP server on 10.222.0.99:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 27 03:25:03.753884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=32 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:03.756303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=68 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:03.763361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cd55a611-c6b5-4aec-baef-c8472db4d39c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:03.764091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cd55a611-c6b5-4aec-baef-c8472db4d39c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:03.958636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cd55a611-c6b5-4aec-baef-c8472db4d39c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:03.968074 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cd55a611-c6b5-4aec-baef-c8472db4d39c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1094 microversion: 2.1 time: 0.220885 Aug 27 03:25:03.969428 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3120/6421] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:03 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1094 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:04.993126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0cd4c2b4-acf0-4b40-8f8e-1b458f53a425 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:04.993767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0cd4c2b4-acf0-4b40-8f8e-1b458f53a425 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:05.007831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd4c2b4-acf0-4b40-8f8e-1b458f53a425 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:05.008666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd4c2b4-acf0-4b40-8f8e-1b458f53a425 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:05.009100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd4c2b4-acf0-4b40-8f8e-1b458f53a425 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:05.010080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd4c2b4-acf0-4b40-8f8e-1b458f53a425 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:05.010610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd4c2b4-acf0-4b40-8f8e-1b458f53a425 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:05.011110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cd4c2b4-acf0-4b40-8f8e-1b458f53a425 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:05.093965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0cd4c2b4-acf0-4b40-8f8e-1b458f53a425 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:05.102408 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0cd4c2b4-acf0-4b40-8f8e-1b458f53a425 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1210 microversion: 2.1 time: 0.114541 Aug 27 03:25:05.103337 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3302/6422] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:04 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:06.125337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-805044ad-f72d-4c38-9088-be678c70b1a7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:06.126081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-805044ad-f72d-4c38-9088-be678c70b1a7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:06.139476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-805044ad-f72d-4c38-9088-be678c70b1a7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:06.140237 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-805044ad-f72d-4c38-9088-be678c70b1a7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:06.140690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-805044ad-f72d-4c38-9088-be678c70b1a7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:06.141939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-805044ad-f72d-4c38-9088-be678c70b1a7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:06.142597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-805044ad-f72d-4c38-9088-be678c70b1a7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:06.143029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-805044ad-f72d-4c38-9088-be678c70b1a7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:06.155841 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 49834. Aug 27 03:25:06.160850 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 49836. Aug 27 03:25:06.260563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-aec0e6f5-38b6-44eb-83fc-f54c44df58d7 req-ae217261-e825-4284-bf79-837152629690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6df6cc-a9ed-4125-b005-bc8748ff502f", "tag": "c86835ba-8aa4-4f53-b414-5b3f4f497ce6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:06.277400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-aec0e6f5-38b6-44eb-83fc-f54c44df58d7 req-ae217261-e825-4284-bf79-837152629690 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:06.279123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-aec0e6f5-38b6-44eb-83fc-f54c44df58d7 req-ae217261-e825-4284-bf79-837152629690 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:06.279783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-aec0e6f5-38b6-44eb-83fc-f54c44df58d7 req-ae217261-e825-4284-bf79-837152629690 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:06.295929 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-aec0e6f5-38b6-44eb-83fc-f54c44df58d7 req-ae217261-e825-4284-bf79-837152629690 service nova] Creating event network-changed:c86835ba-8aa4-4f53-b414-5b3f4f497ce6 for instance fd6df6cc-a9ed-4125-b005-bc8748ff502f on n-h2-852084-5 Aug 27 03:25:06.305038 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-aec0e6f5-38b6-44eb-83fc-f54c44df58d7 req-ae217261-e825-4284-bf79-837152629690 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049852 Aug 27 03:25:06.306423 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3303/6423] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:25:06.373824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-805044ad-f72d-4c38-9088-be678c70b1a7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:06.389167 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-805044ad-f72d-4c38-9088-be678c70b1a7 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1277 microversion: 2.1 time: 0.268509 Aug 27 03:25:06.403310 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3121/6424] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:06 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:07.413716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ea66ac8e-7136-4be0-8cee-abc02d993197 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:07.414939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ea66ac8e-7136-4be0-8cee-abc02d993197 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:07.421860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea66ac8e-7136-4be0-8cee-abc02d993197 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:07.422357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea66ac8e-7136-4be0-8cee-abc02d993197 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:07.422805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea66ac8e-7136-4be0-8cee-abc02d993197 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:07.423542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea66ac8e-7136-4be0-8cee-abc02d993197 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:07.424002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea66ac8e-7136-4be0-8cee-abc02d993197 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:07.424465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea66ac8e-7136-4be0-8cee-abc02d993197 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:07.566834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ea66ac8e-7136-4be0-8cee-abc02d993197 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:07.575370 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ea66ac8e-7136-4be0-8cee-abc02d993197 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1277 microversion: 2.1 time: 0.168468 Aug 27 03:25:07.575965 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3304/6425] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:07 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:08.596951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a1f17059-80e2-40ee-9fc3-5e0828fd14bb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:08.597565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a1f17059-80e2-40ee-9fc3-5e0828fd14bb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:08.604908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1f17059-80e2-40ee-9fc3-5e0828fd14bb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:08.605408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1f17059-80e2-40ee-9fc3-5e0828fd14bb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:08.605899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1f17059-80e2-40ee-9fc3-5e0828fd14bb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:08.606633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1f17059-80e2-40ee-9fc3-5e0828fd14bb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:08.607117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1f17059-80e2-40ee-9fc3-5e0828fd14bb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:08.607587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1f17059-80e2-40ee-9fc3-5e0828fd14bb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:08.758972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a1f17059-80e2-40ee-9fc3-5e0828fd14bb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:08.767370 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a1f17059-80e2-40ee-9fc3-5e0828fd14bb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1277 microversion: 2.1 time: 0.175251 Aug 27 03:25:08.767923 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3122/6426] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:08 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:09.788587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0c900743-01f6-44dd-ae38-6348f5d5a105 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:09.789139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0c900743-01f6-44dd-ae38-6348f5d5a105 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:09.797315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c900743-01f6-44dd-ae38-6348f5d5a105 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:09.797863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c900743-01f6-44dd-ae38-6348f5d5a105 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:09.798325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c900743-01f6-44dd-ae38-6348f5d5a105 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.799063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c900743-01f6-44dd-ae38-6348f5d5a105 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:09.799544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c900743-01f6-44dd-ae38-6348f5d5a105 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:09.800007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0c900743-01f6-44dd-ae38-6348f5d5a105 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:09.961342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0c900743-01f6-44dd-ae38-6348f5d5a105 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:09.970213 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0c900743-01f6-44dd-ae38-6348f5d5a105 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1277 microversion: 2.1 time: 0.185661 Aug 27 03:25:09.971259 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3305/6427] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:09 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:25:10.992836 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-492b18a5-90d8-4109-8d75-d53c03cd600a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:10.993469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-492b18a5-90d8-4109-8d75-d53c03cd600a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:11.000546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-492b18a5-90d8-4109-8d75-d53c03cd600a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:11.001050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-492b18a5-90d8-4109-8d75-d53c03cd600a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:11.001502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-492b18a5-90d8-4109-8d75-d53c03cd600a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:11.002248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-492b18a5-90d8-4109-8d75-d53c03cd600a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:11.002715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-492b18a5-90d8-4109-8d75-d53c03cd600a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:11.003158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-492b18a5-90d8-4109-8d75-d53c03cd600a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:11.141249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-492b18a5-90d8-4109-8d75-d53c03cd600a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:11.149567 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-492b18a5-90d8-4109-8d75-d53c03cd600a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1265 microversion: 2.1 time: 0.160558 Aug 27 03:25:11.150208 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3123/6428] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:10 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:12.170812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2230286-6687-47fc-a01a-2b56544c24b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:12.171930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2230286-6687-47fc-a01a-2b56544c24b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:12.179382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2230286-6687-47fc-a01a-2b56544c24b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:12.179881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2230286-6687-47fc-a01a-2b56544c24b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:12.180376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2230286-6687-47fc-a01a-2b56544c24b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:12.181089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2230286-6687-47fc-a01a-2b56544c24b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:12.181549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2230286-6687-47fc-a01a-2b56544c24b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:12.182009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2230286-6687-47fc-a01a-2b56544c24b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:12.333290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e2230286-6687-47fc-a01a-2b56544c24b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:12.348100 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2230286-6687-47fc-a01a-2b56544c24b4 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1265 microversion: 2.1 time: 0.181159 Aug 27 03:25:12.348711 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3306/6429] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:12 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:13.372333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3aaf5b37-963e-4eb0-8dfb-157ae9bd65a3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:13.372994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3aaf5b37-963e-4eb0-8dfb-157ae9bd65a3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:13.380588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3aaf5b37-963e-4eb0-8dfb-157ae9bd65a3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:13.381086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3aaf5b37-963e-4eb0-8dfb-157ae9bd65a3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:13.381538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3aaf5b37-963e-4eb0-8dfb-157ae9bd65a3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:13.382291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3aaf5b37-963e-4eb0-8dfb-157ae9bd65a3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:13.382766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3aaf5b37-963e-4eb0-8dfb-157ae9bd65a3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:13.383243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3aaf5b37-963e-4eb0-8dfb-157ae9bd65a3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:13.531885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3aaf5b37-963e-4eb0-8dfb-157ae9bd65a3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:13.541147 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3aaf5b37-963e-4eb0-8dfb-157ae9bd65a3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1265 microversion: 2.1 time: 0.172852 Aug 27 03:25:13.541872 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3124/6430] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:13 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:14.566131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bafb090a-8300-4088-a673-626d43b46687 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:14.566893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bafb090a-8300-4088-a673-626d43b46687 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:14.570223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:14.570931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:14.579028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bafb090a-8300-4088-a673-626d43b46687 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:14.579568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bafb090a-8300-4088-a673-626d43b46687 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:14.580120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bafb090a-8300-4088-a673-626d43b46687 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:14.580941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bafb090a-8300-4088-a673-626d43b46687 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:14.581411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bafb090a-8300-4088-a673-626d43b46687 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:14.581893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bafb090a-8300-4088-a673-626d43b46687 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:14.750228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bafb090a-8300-4088-a673-626d43b46687 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:14.758496 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bafb090a-8300-4088-a673-626d43b46687 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1265 microversion: 2.1 time: 0.196834 Aug 27 03:25:14.759093 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3307/6431] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:14 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:15.779977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf9e5a22-4085-49dc-92f0-c0641476c5d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:15.780569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf9e5a22-4085-49dc-92f0-c0641476c5d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:15.783121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:25:15.790015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf9e5a22-4085-49dc-92f0-c0641476c5d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:15.790530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf9e5a22-4085-49dc-92f0-c0641476c5d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:15.791021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf9e5a22-4085-49dc-92f0-c0641476c5d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:15.791893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf9e5a22-4085-49dc-92f0-c0641476c5d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:15.792625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf9e5a22-4085-49dc-92f0-c0641476c5d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:15.793078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf9e5a22-4085-49dc-92f0-c0641476c5d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:15.958742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf9e5a22-4085-49dc-92f0-c0641476c5d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:15.967287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf9e5a22-4085-49dc-92f0-c0641476c5d1 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1265 microversion: 2.1 time: 0.191109 Aug 27 03:25:15.967885 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3125/6432] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:15 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:16.989640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3eaaebdb-cfa8-44be-8a01-f167cb5fad41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:16.990273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3eaaebdb-cfa8-44be-8a01-f167cb5fad41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:16.999569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eaaebdb-cfa8-44be-8a01-f167cb5fad41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:17.000064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eaaebdb-cfa8-44be-8a01-f167cb5fad41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:17.000508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eaaebdb-cfa8-44be-8a01-f167cb5fad41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:17.001222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eaaebdb-cfa8-44be-8a01-f167cb5fad41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:17.001705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eaaebdb-cfa8-44be-8a01-f167cb5fad41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:17.002134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3eaaebdb-cfa8-44be-8a01-f167cb5fad41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:17.156946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3eaaebdb-cfa8-44be-8a01-f167cb5fad41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:17.165848 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3eaaebdb-cfa8-44be-8a01-f167cb5fad41 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1265 microversion: 2.1 time: 0.180099 Aug 27 03:25:17.166640 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3308/6433] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:16 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:25:18.188239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a7eb3ba6-88e0-4be8-9fee-9ec5afd4a6f5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:18.189019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a7eb3ba6-88e0-4be8-9fee-9ec5afd4a6f5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:18.196618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7eb3ba6-88e0-4be8-9fee-9ec5afd4a6f5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:18.197131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7eb3ba6-88e0-4be8-9fee-9ec5afd4a6f5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:18.197599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7eb3ba6-88e0-4be8-9fee-9ec5afd4a6f5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:18.198364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7eb3ba6-88e0-4be8-9fee-9ec5afd4a6f5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:18.198823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7eb3ba6-88e0-4be8-9fee-9ec5afd4a6f5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:18.199274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7eb3ba6-88e0-4be8-9fee-9ec5afd4a6f5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:18.610368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a7eb3ba6-88e0-4be8-9fee-9ec5afd4a6f5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:18.619893 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a7eb3ba6-88e0-4be8-9fee-9ec5afd4a6f5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1265 microversion: 2.1 time: 0.436396 Aug 27 03:25:18.620488 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3126/6434] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:18 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1265 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:19.642543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-538d1288-3aa6-49f1-a1e5-083e5f3e6533 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:19.643109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-538d1288-3aa6-49f1-a1e5-083e5f3e6533 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:19.650357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-538d1288-3aa6-49f1-a1e5-083e5f3e6533 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:19.650856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-538d1288-3aa6-49f1-a1e5-083e5f3e6533 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:19.651306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-538d1288-3aa6-49f1-a1e5-083e5f3e6533 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:19.652029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-538d1288-3aa6-49f1-a1e5-083e5f3e6533 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:19.652495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-538d1288-3aa6-49f1-a1e5-083e5f3e6533 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:19.652934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-538d1288-3aa6-49f1-a1e5-083e5f3e6533 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:19.804358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-538d1288-3aa6-49f1-a1e5-083e5f3e6533 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:19.813587 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-538d1288-3aa6-49f1-a1e5-083e5f3e6533 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1265 microversion: 2.1 time: 0.175093 Aug 27 03:25:19.814248 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3309/6435] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:19 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:20.107956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-63a089cf-d37b-4bf0-8b62-d5e432487e2e req-9b7536ce-02f1-4dae-9579-03414c983317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6df6cc-a9ed-4125-b005-bc8748ff502f", "name": "network-vif-plugged", "status": "completed", "tag": "c86835ba-8aa4-4f53-b414-5b3f4f497ce6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:20.120374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-63a089cf-d37b-4bf0-8b62-d5e432487e2e req-9b7536ce-02f1-4dae-9579-03414c983317 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:20.120871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-63a089cf-d37b-4bf0-8b62-d5e432487e2e req-9b7536ce-02f1-4dae-9579-03414c983317 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:20.121320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-63a089cf-d37b-4bf0-8b62-d5e432487e2e req-9b7536ce-02f1-4dae-9579-03414c983317 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:20.134824 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-63a089cf-d37b-4bf0-8b62-d5e432487e2e req-9b7536ce-02f1-4dae-9579-03414c983317 service nova] Creating event network-vif-plugged:c86835ba-8aa4-4f53-b414-5b3f4f497ce6 for instance fd6df6cc-a9ed-4125-b005-bc8748ff502f on n-h2-852084-5 Aug 27 03:25:20.142006 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-63a089cf-d37b-4bf0-8b62-d5e432487e2e req-9b7536ce-02f1-4dae-9579-03414c983317 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037964 Aug 27 03:25:20.143190 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3127/6436] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:25:20.840467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b138b40b-d9f7-46c0-94e4-0f54ce10bf92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:20.841565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b138b40b-d9f7-46c0-94e4-0f54ce10bf92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:20.855320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b138b40b-d9f7-46c0-94e4-0f54ce10bf92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:20.856217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b138b40b-d9f7-46c0-94e4-0f54ce10bf92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:20.856993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b138b40b-d9f7-46c0-94e4-0f54ce10bf92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:20.858289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b138b40b-d9f7-46c0-94e4-0f54ce10bf92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:20.859170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b138b40b-d9f7-46c0-94e4-0f54ce10bf92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:20.859961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b138b40b-d9f7-46c0-94e4-0f54ce10bf92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:21.023813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b138b40b-d9f7-46c0-94e4-0f54ce10bf92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:21.035011 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b138b40b-d9f7-46c0-94e4-0f54ce10bf92 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1265 microversion: 2.1 time: 0.202333 Aug 27 03:25:21.035636 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3310/6437] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:20 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:22.058625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2fe19e4-1327-4a9f-98ee-eafe0554fe7e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:22.059367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c2fe19e4-1327-4a9f-98ee-eafe0554fe7e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:22.073783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2fe19e4-1327-4a9f-98ee-eafe0554fe7e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.074895 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2fe19e4-1327-4a9f-98ee-eafe0554fe7e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.075840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2fe19e4-1327-4a9f-98ee-eafe0554fe7e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.077734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2fe19e4-1327-4a9f-98ee-eafe0554fe7e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.078834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2fe19e4-1327-4a9f-98ee-eafe0554fe7e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.079637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2fe19e4-1327-4a9f-98ee-eafe0554fe7e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.236078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c2fe19e4-1327-4a9f-98ee-eafe0554fe7e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:22.245206 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c2fe19e4-1327-4a9f-98ee-eafe0554fe7e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1453 microversion: 2.1 time: 0.192091 Aug 27 03:25:22.245957 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3128/6438] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:22 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:22.270178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-671ec17f-4b84-4d5c-bcbe-14f170631abb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:25:22.270814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-671ec17f-4b84-4d5c-bcbe-14f170631abb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:25:22.278216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-671ec17f-4b84-4d5c-bcbe-14f170631abb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.278713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-671ec17f-4b84-4d5c-bcbe-14f170631abb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.279164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-671ec17f-4b84-4d5c-bcbe-14f170631abb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.279884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-671ec17f-4b84-4d5c-bcbe-14f170631abb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:22.280346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-671ec17f-4b84-4d5c-bcbe-14f170631abb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:22.280779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-671ec17f-4b84-4d5c-bcbe-14f170631abb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:22.458613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-671ec17f-4b84-4d5c-bcbe-14f170631abb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:25:22.471850 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-671ec17f-4b84-4d5c-bcbe-14f170631abb tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1453 microversion: 2.1 time: 0.205422 Aug 27 03:25:22.473439 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3311/6439] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:25:22 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:25:24.738227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-090c1181-e855-41ea-9276-bf4a3b768466 req-efe73f7d-4c0a-40e0-b94c-75f1f612a066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6df6cc-a9ed-4125-b005-bc8748ff502f", "tag": "c86835ba-8aa4-4f53-b414-5b3f4f497ce6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:25:24.749624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-090c1181-e855-41ea-9276-bf4a3b768466 req-efe73f7d-4c0a-40e0-b94c-75f1f612a066 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:25:24.750445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-090c1181-e855-41ea-9276-bf4a3b768466 req-efe73f7d-4c0a-40e0-b94c-75f1f612a066 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:25:24.751085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-090c1181-e855-41ea-9276-bf4a3b768466 req-efe73f7d-4c0a-40e0-b94c-75f1f612a066 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:25:24.762981 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-090c1181-e855-41ea-9276-bf4a3b768466 req-efe73f7d-4c0a-40e0-b94c-75f1f612a066 service nova] Creating event network-changed:c86835ba-8aa4-4f53-b414-5b3f4f497ce6 for instance fd6df6cc-a9ed-4125-b005-bc8748ff502f on n-h2-852084-5 Aug 27 03:25:24.769091 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-090c1181-e855-41ea-9276-bf4a3b768466 req-efe73f7d-4c0a-40e0-b94c-75f1f612a066 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111837 Aug 27 03:25:24.770142 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3129/6440] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:26:52.959006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:52.960326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=58 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:52.963133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=22 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:52.964052 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:26:52.964396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=46 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:26:52.964850 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 03:26:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f (ip 10.222.0.99) !!! Aug 27 03:26:52.966272 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:26:52.966728 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:26:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.99) !!! Aug 27 03:26:52.969870 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:26:52.970792 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:26:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.99) !!! Aug 27 03:26:52.977422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f0716c75-348e-4874-86e9-70a678b1b7f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:52.978362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f0716c75-348e-4874-86e9-70a678b1b7f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:52.986561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8899b14a-3290-4a91-8ad1-53dcaaa688c4 req-111fd674-2478-48ea-82f8-6bd10f2f426a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6df6cc-a9ed-4125-b005-bc8748ff502f", "tag": "c86835ba-8aa4-4f53-b414-5b3f4f497ce6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:52.994536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0716c75-348e-4874-86e9-70a678b1b7f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:52.995430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0716c75-348e-4874-86e9-70a678b1b7f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:52.996978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0716c75-348e-4874-86e9-70a678b1b7f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:52.998496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0716c75-348e-4874-86e9-70a678b1b7f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:52.999337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0716c75-348e-4874-86e9-70a678b1b7f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:53.000129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0716c75-348e-4874-86e9-70a678b1b7f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:53.010826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8899b14a-3290-4a91-8ad1-53dcaaa688c4 req-111fd674-2478-48ea-82f8-6bd10f2f426a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:53.011627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8899b14a-3290-4a91-8ad1-53dcaaa688c4 req-111fd674-2478-48ea-82f8-6bd10f2f426a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:53.012085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8899b14a-3290-4a91-8ad1-53dcaaa688c4 req-111fd674-2478-48ea-82f8-6bd10f2f426a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:53.027245 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8899b14a-3290-4a91-8ad1-53dcaaa688c4 req-111fd674-2478-48ea-82f8-6bd10f2f426a service nova] Creating event network-changed:c86835ba-8aa4-4f53-b414-5b3f4f497ce6 for instance fd6df6cc-a9ed-4125-b005-bc8748ff502f on n-h2-852084-5 Aug 27 03:26:53.033640 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8899b14a-3290-4a91-8ad1-53dcaaa688c4 req-111fd674-2478-48ea-82f8-6bd10f2f426a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076856 Aug 27 03:26:53.034640 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3130/6441] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:53.051886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f0716c75-348e-4874-86e9-70a678b1b7f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:26:53.158707 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f0716c75-348e-4874-86e9-70a678b1b7f3 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 204 len: 0 microversion: 2.1 time: 0.203856 Aug 27 03:26:53.159350 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3312/6442] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:26:52 2022] DELETE /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:26:53.168710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1c9df5ef-ea3c-4d9c-a466-dea311e202d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:53.169436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1c9df5ef-ea3c-4d9c-a466-dea311e202d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:53.176486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9df5ef-ea3c-4d9c-a466-dea311e202d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:53.177093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9df5ef-ea3c-4d9c-a466-dea311e202d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:53.177538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9df5ef-ea3c-4d9c-a466-dea311e202d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:53.178865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9df5ef-ea3c-4d9c-a466-dea311e202d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:53.179517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9df5ef-ea3c-4d9c-a466-dea311e202d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:53.179963 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1c9df5ef-ea3c-4d9c-a466-dea311e202d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:53.336249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1c9df5ef-ea3c-4d9c-a466-dea311e202d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:53.349228 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1c9df5ef-ea3c-4d9c-a466-dea311e202d5 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1578 microversion: 2.1 time: 0.184360 Aug 27 03:26:53.350351 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3131/6443] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:53 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:54.372586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4cbcd139-4986-475e-baf1-3aeaac48523c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:54.373202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4cbcd139-4986-475e-baf1-3aeaac48523c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:54.380594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cbcd139-4986-475e-baf1-3aeaac48523c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:54.381245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cbcd139-4986-475e-baf1-3aeaac48523c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:54.381901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cbcd139-4986-475e-baf1-3aeaac48523c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:54.386593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cbcd139-4986-475e-baf1-3aeaac48523c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:54.387202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cbcd139-4986-475e-baf1-3aeaac48523c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:54.388006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4cbcd139-4986-475e-baf1-3aeaac48523c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:54.590629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4cbcd139-4986-475e-baf1-3aeaac48523c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:54.599096 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4cbcd139-4986-475e-baf1-3aeaac48523c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1578 microversion: 2.1 time: 0.230819 Aug 27 03:26:54.599724 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3313/6444] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:54 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1578 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:55.326486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-930e9fab-b043-4dad-ba94-82f1b98a98c2 req-9023b9c9-de88-4bc6-95d2-30198be6e8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6df6cc-a9ed-4125-b005-bc8748ff502f", "name": "network-vif-deleted", "tag": "c86835ba-8aa4-4f53-b414-5b3f4f497ce6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:26:55.340072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-930e9fab-b043-4dad-ba94-82f1b98a98c2 req-9023b9c9-de88-4bc6-95d2-30198be6e8ff service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:55.340746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-930e9fab-b043-4dad-ba94-82f1b98a98c2 req-9023b9c9-de88-4bc6-95d2-30198be6e8ff service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:55.341212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-930e9fab-b043-4dad-ba94-82f1b98a98c2 req-9023b9c9-de88-4bc6-95d2-30198be6e8ff service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:55.353998 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-930e9fab-b043-4dad-ba94-82f1b98a98c2 req-9023b9c9-de88-4bc6-95d2-30198be6e8ff service nova] Creating event network-vif-deleted:c86835ba-8aa4-4f53-b414-5b3f4f497ce6 for instance fd6df6cc-a9ed-4125-b005-bc8748ff502f on n-h2-852084-5 Aug 27 03:26:55.359387 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-930e9fab-b043-4dad-ba94-82f1b98a98c2 req-9023b9c9-de88-4bc6-95d2-30198be6e8ff service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096313 Aug 27 03:26:55.360015 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3132/6445] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:26:55.621189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b9d26abc-62ac-4939-8e38-f94735c30460 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:55.622045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b9d26abc-62ac-4939-8e38-f94735c30460 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:55.629824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9d26abc-62ac-4939-8e38-f94735c30460 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:55.630332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9d26abc-62ac-4939-8e38-f94735c30460 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:55.630813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9d26abc-62ac-4939-8e38-f94735c30460 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:55.632084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9d26abc-62ac-4939-8e38-f94735c30460 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:55.632560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9d26abc-62ac-4939-8e38-f94735c30460 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:55.633010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b9d26abc-62ac-4939-8e38-f94735c30460 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:55.707058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b9d26abc-62ac-4939-8e38-f94735c30460 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:55.715351 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b9d26abc-62ac-4939-8e38-f94735c30460 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1225 microversion: 2.1 time: 0.098073 Aug 27 03:26:55.715850 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3314/6446] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:55 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:26:56.739033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-622ef0aa-9370-47fa-8bee-9907a6b3087e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:56.739791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-622ef0aa-9370-47fa-8bee-9907a6b3087e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:56.746969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-622ef0aa-9370-47fa-8bee-9907a6b3087e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:56.747481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-622ef0aa-9370-47fa-8bee-9907a6b3087e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:56.747942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-622ef0aa-9370-47fa-8bee-9907a6b3087e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:56.748671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-622ef0aa-9370-47fa-8bee-9907a6b3087e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:56.749146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-622ef0aa-9370-47fa-8bee-9907a6b3087e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:56.749588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-622ef0aa-9370-47fa-8bee-9907a6b3087e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:56.815857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-622ef0aa-9370-47fa-8bee-9907a6b3087e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:56.824449 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-622ef0aa-9370-47fa-8bee-9907a6b3087e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1225 microversion: 2.1 time: 0.090899 Aug 27 03:26:56.825037 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3133/6447] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:56 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:57.850715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9250213f-c9fe-4ad7-9b75-53296b077805 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:57.851851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9250213f-c9fe-4ad7-9b75-53296b077805 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:57.862814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9250213f-c9fe-4ad7-9b75-53296b077805 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:57.863682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9250213f-c9fe-4ad7-9b75-53296b077805 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:57.864472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9250213f-c9fe-4ad7-9b75-53296b077805 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:57.865791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9250213f-c9fe-4ad7-9b75-53296b077805 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:57.866634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9250213f-c9fe-4ad7-9b75-53296b077805 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:57.867435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9250213f-c9fe-4ad7-9b75-53296b077805 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:57.945051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9250213f-c9fe-4ad7-9b75-53296b077805 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:57.953413 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9250213f-c9fe-4ad7-9b75-53296b077805 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1225 microversion: 2.1 time: 0.111233 Aug 27 03:26:57.954459 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3315/6448] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:57 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:26:58.977103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dcb88893-6319-436f-bd5f-ce3864eed3d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:26:58.977984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dcb88893-6319-436f-bd5f-ce3864eed3d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:26:58.991191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb88893-6319-436f-bd5f-ce3864eed3d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:58.992112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb88893-6319-436f-bd5f-ce3864eed3d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:58.992973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb88893-6319-436f-bd5f-ce3864eed3d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:58.994322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb88893-6319-436f-bd5f-ce3864eed3d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:26:58.995165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb88893-6319-436f-bd5f-ce3864eed3d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:26:58.995946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dcb88893-6319-436f-bd5f-ce3864eed3d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:26:59.069716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dcb88893-6319-436f-bd5f-ce3864eed3d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:26:59.078305 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dcb88893-6319-436f-bd5f-ce3864eed3d9 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 200 len: 1225 microversion: 2.1 time: 0.106835 Aug 27 03:26:59.079141 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3134/6449] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:26:58 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:00.100359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:00.100963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: fd6df6cc-a9ed-4125-b005-bc8748ff502f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:00.110491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:00.111056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:00.111497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:00.112282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:00.112742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:00.113242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:00.128208 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance fd6df6cc-a9ed-4125-b005-bc8748ff502f could not be found. Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f HTTP/1.1 Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance fd6df6cc-a9ed-4125-b005-bc8748ff502f could not be found. Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'fd6df6cc-a9ed-4125-b005-bc8748ff502f'} Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd6df6cc-a9ed-4125-b005-bc8748ff502f could not be found. Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd6df6cc-a9ed-4125-b005-bc8748ff502f could not be found. Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:00.130002 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:00.135064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:00.135064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:00.135064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:00.135064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:00.135064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:00.135064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd6df6cc-a9ed-4125-b005-bc8748ff502f could not be found. Aug 27 03:27:00.135064 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:00.135064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance fd6df6cc-a9ed-4125-b005-bc8748ff502f could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:00.135064 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b7742298-5ea2-4f2e-9e72-44169c9f36f2 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f" status: 404 len: 111 microversion: 2.1 time: 0.036140 Aug 27 03:27:00.135064 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3316/6450] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:00 2022] GET /compute/v2.1/servers/fd6df6cc-a9ed-4125-b005-bc8748ff502f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:06.646001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-57512cb3-a773-4ff8-8aad-3615dc02461a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:06.646831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d4d31d95-4975-43fc-8834-57c3699141e6 req-d6941518-fec3-4652-943a-5767f4141f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1", "tag": "1a6d82d0-2a15-4bab-a8bf-96cf80536711"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:06.648696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-57512cb3-a773-4ff8-8aad-3615dc02461a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:06.662396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d4d31d95-4975-43fc-8834-57c3699141e6 req-d6941518-fec3-4652-943a-5767f4141f6d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.662889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d4d31d95-4975-43fc-8834-57c3699141e6 req-d6941518-fec3-4652-943a-5767f4141f6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.663332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d4d31d95-4975-43fc-8834-57c3699141e6 req-d6941518-fec3-4652-943a-5767f4141f6d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.665015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57512cb3-a773-4ff8-8aad-3615dc02461a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.666356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57512cb3-a773-4ff8-8aad-3615dc02461a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.667256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57512cb3-a773-4ff8-8aad-3615dc02461a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.668224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57512cb3-a773-4ff8-8aad-3615dc02461a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.668935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57512cb3-a773-4ff8-8aad-3615dc02461a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.669587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-57512cb3-a773-4ff8-8aad-3615dc02461a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.679868 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d4d31d95-4975-43fc-8834-57c3699141e6 req-d6941518-fec3-4652-943a-5767f4141f6d service nova] Creating event network-changed:1a6d82d0-2a15-4bab-a8bf-96cf80536711 for instance 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 on n-h1-852084-5 Aug 27 03:27:06.685579 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d4d31d95-4975-43fc-8834-57c3699141e6 req-d6941518-fec3-4652-943a-5767f4141f6d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046599 Aug 27 03:27:06.686440 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3317/6451] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:06.704479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-57512cb3-a773-4ff8-8aad-3615dc02461a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:27:06.816010 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-57512cb3-a773-4ff8-8aad-3615dc02461a tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 204 len: 0 microversion: 2.1 time: 0.177382 Aug 27 03:27:06.822926 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3135/6452] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:27:06 2022] DELETE /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:27:06.830404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3d47b140-33dc-41b5-a018-3cc3c0b928ac tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:06.831301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3d47b140-33dc-41b5-a018-3cc3c0b928ac tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:06.839599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d47b140-33dc-41b5-a018-3cc3c0b928ac tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.840258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d47b140-33dc-41b5-a018-3cc3c0b928ac tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.840720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d47b140-33dc-41b5-a018-3cc3c0b928ac tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:06.841526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d47b140-33dc-41b5-a018-3cc3c0b928ac tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:06.842300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d47b140-33dc-41b5-a018-3cc3c0b928ac tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:06.842743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d47b140-33dc-41b5-a018-3cc3c0b928ac tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:07.001531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3d47b140-33dc-41b5-a018-3cc3c0b928ac tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:07.010587 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3d47b140-33dc-41b5-a018-3cc3c0b928ac tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1577 microversion: 2.1 time: 0.186145 Aug 27 03:27:07.011242 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3318/6453] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:06 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:08.044922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a2dc9df9-3d04-403c-bae0-2db15604caea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:08.045567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a2dc9df9-3d04-403c-bae0-2db15604caea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:08.053635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dc9df9-3d04-403c-bae0-2db15604caea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:08.054181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dc9df9-3d04-403c-bae0-2db15604caea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:08.054638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dc9df9-3d04-403c-bae0-2db15604caea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:08.055375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dc9df9-3d04-403c-bae0-2db15604caea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:08.055848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dc9df9-3d04-403c-bae0-2db15604caea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:08.056327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2dc9df9-3d04-403c-bae0-2db15604caea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:08.264950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a2dc9df9-3d04-403c-bae0-2db15604caea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:08.274746 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a2dc9df9-3d04-403c-bae0-2db15604caea tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1577 microversion: 2.1 time: 0.235203 Aug 27 03:27:08.275700 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3136/6454] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:08 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1577 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:09.207819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-548f00f2-47b1-4fc4-8d56-cebdef0d230d req-7223d88d-0e2a-4f00-9a9b-de443601895f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1", "name": "network-vif-deleted", "tag": "1a6d82d0-2a15-4bab-a8bf-96cf80536711"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:09.225043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-548f00f2-47b1-4fc4-8d56-cebdef0d230d req-7223d88d-0e2a-4f00-9a9b-de443601895f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.225913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-548f00f2-47b1-4fc4-8d56-cebdef0d230d req-7223d88d-0e2a-4f00-9a9b-de443601895f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.226673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-548f00f2-47b1-4fc4-8d56-cebdef0d230d req-7223d88d-0e2a-4f00-9a9b-de443601895f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.248320 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-548f00f2-47b1-4fc4-8d56-cebdef0d230d req-7223d88d-0e2a-4f00-9a9b-de443601895f service nova] Creating event network-vif-deleted:1a6d82d0-2a15-4bab-a8bf-96cf80536711 for instance 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 on n-h1-852084-5 Aug 27 03:27:09.255280 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-548f00f2-47b1-4fc4-8d56-cebdef0d230d req-7223d88d-0e2a-4f00-9a9b-de443601895f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054025 Aug 27 03:27:09.256288 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3319/6455] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:09.299641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-15efe34c-ff35-4d12-bac3-1a9c7f24fd48 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:09.300596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-15efe34c-ff35-4d12-bac3-1a9c7f24fd48 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:09.315212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15efe34c-ff35-4d12-bac3-1a9c7f24fd48 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.316240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15efe34c-ff35-4d12-bac3-1a9c7f24fd48 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.317145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15efe34c-ff35-4d12-bac3-1a9c7f24fd48 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.318596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15efe34c-ff35-4d12-bac3-1a9c7f24fd48 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:09.319560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15efe34c-ff35-4d12-bac3-1a9c7f24fd48 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:09.320476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15efe34c-ff35-4d12-bac3-1a9c7f24fd48 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:09.415652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-15efe34c-ff35-4d12-bac3-1a9c7f24fd48 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:09.424016 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-15efe34c-ff35-4d12-bac3-1a9c7f24fd48 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1225 microversion: 2.1 time: 0.130418 Aug 27 03:27:09.424617 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3137/6456] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:09 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:10.449297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7bf9925e-8308-46d5-80bf-ecace84d993e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:10.450071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7bf9925e-8308-46d5-80bf-ecace84d993e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:10.457082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf9925e-8308-46d5-80bf-ecace84d993e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:10.457573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf9925e-8308-46d5-80bf-ecace84d993e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:10.458051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf9925e-8308-46d5-80bf-ecace84d993e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:10.458766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf9925e-8308-46d5-80bf-ecace84d993e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:10.459232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf9925e-8308-46d5-80bf-ecace84d993e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:10.459892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7bf9925e-8308-46d5-80bf-ecace84d993e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:10.526427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7bf9925e-8308-46d5-80bf-ecace84d993e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:10.534624 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7bf9925e-8308-46d5-80bf-ecace84d993e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1225 microversion: 2.1 time: 0.091309 Aug 27 03:27:10.535315 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3320/6457] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:10 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:11.555414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d6e26646-9978-4ce9-888a-9bc3e24687aa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:11.556062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d6e26646-9978-4ce9-888a-9bc3e24687aa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:11.563292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6e26646-9978-4ce9-888a-9bc3e24687aa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:11.563876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6e26646-9978-4ce9-888a-9bc3e24687aa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:11.564235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6e26646-9978-4ce9-888a-9bc3e24687aa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:11.564981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6e26646-9978-4ce9-888a-9bc3e24687aa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:11.565426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6e26646-9978-4ce9-888a-9bc3e24687aa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:11.565901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d6e26646-9978-4ce9-888a-9bc3e24687aa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:11.632311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d6e26646-9978-4ce9-888a-9bc3e24687aa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:11.641491 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d6e26646-9978-4ce9-888a-9bc3e24687aa tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1225 microversion: 2.1 time: 0.090469 Aug 27 03:27:11.642037 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3138/6458] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:11 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:12.661231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-15f84d84-2560-4a68-924f-fc9331e39e4c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:12.661944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-15f84d84-2560-4a68-924f-fc9331e39e4c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:12.669324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15f84d84-2560-4a68-924f-fc9331e39e4c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:12.669871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15f84d84-2560-4a68-924f-fc9331e39e4c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:12.670399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15f84d84-2560-4a68-924f-fc9331e39e4c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:12.671113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15f84d84-2560-4a68-924f-fc9331e39e4c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:12.671578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15f84d84-2560-4a68-924f-fc9331e39e4c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:12.672018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15f84d84-2560-4a68-924f-fc9331e39e4c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:12.741592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-15f84d84-2560-4a68-924f-fc9331e39e4c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:12.749761 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-15f84d84-2560-4a68-924f-fc9331e39e4c tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1225 microversion: 2.1 time: 0.092437 Aug 27 03:27:12.761737 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3321/6459] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:12 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:13.775248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:13.775882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:13.782724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:13.783253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:13.783710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:13.784443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:13.784901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:13.785347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:13.819148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:13.819655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:13.820112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:13.820592 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lazy-loading 'fault' on Instance uuid 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:27:13.867391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a78655bea27452faee67a7efd476175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45bcf3858f3c4e1c8c71842958d17bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:13.880444 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1f8878ff-f8e2-43ac-ab4a-7a85b1512088 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 200 len: 1230 microversion: 2.1 time: 0.109020 Aug 27 03:27:13.881038 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3139/6460] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:13 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:14.901131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:14.901783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:14.908713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:14.909191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:14.909626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:14.910343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:14.910799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:14.911226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:14.927134 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 could not be found. Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 HTTP/1.1 Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 could not be found. Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1'} Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 could not be found. Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 could not be found. Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:14.929288 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:14.932700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:14.932700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:14.932700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:14.932700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:14.932700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:14.932700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 could not be found. Aug 27 03:27:14.932700 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:14.932700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance 1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:14.932700 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a24704ca-d528-4ded-8e01-012239ed382e tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1" status: 404 len: 111 microversion: 2.1 time: 0.033560 Aug 27 03:27:14.932700 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3322/6461] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:14 2022] GET /compute/v2.1/servers/1bb43598-1f56-4d8b-97f4-9ecd1a1a6ee1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:15.626254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:15.626778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:15.633822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:15.634333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:15.634793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:15.635517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:15.635993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:15.636441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:15.650987 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 HTTP/1.1 Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'd87e599e-5f9e-45e1-9106-e03389fcc190'} Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:15.652715 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f99856ef-d668-4210-b780-11801ce1f636 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 404 len: 111 microversion: 2.1 time: 0.031929 Aug 27 03:27:15.656526 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3140/6462] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:27:15 2022] DELETE /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:15.663649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:15.664295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] [instance: d87e599e-5f9e-45e1-9106-e03389fcc190] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:15.670333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:15.670818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:15.671259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:15.671954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:15.672414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:15.672844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:15.686630 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] HTTP exception thrown: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Request method failure captured: Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 HTTP/1.1 Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCYxafYbo4hpoEtnf0ygTj2ctelpN9Sd7mui0fmBSdJONsEHRnznvt_kOXF0bRv9CjhunAR15l8xbFNBX_IMsO98FtKbi-JarCTA_lF4bAGXw3gghH5SCCCv0kj7O3oBQRlClAh2gwAa7RfdBvdHk2jytWqQjQ4HyLabI5kF7-O2-E4Y Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/45bcf3858f3c4e1c8c71842958d17bf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/45bcf3858f3c4e1c8c71842958d17bf1"}]}] Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 45bcf3858f3c4e1c8c71842958d17bf1 Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestVolumeBootPattern-366232100 Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 0a78655bea27452faee67a7efd476175 Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestVolumeBootPattern-366232100-project Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd87e599e-5f9e-45e1-9106-e03389fcc190'} Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:15.688168 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:15.692345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:15.692345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:15.692345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:15.692345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:15.692345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:15.692345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. Aug 27 03:27:15.692345 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:15.692345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Returning 404 to user: Instance d87e599e-5f9e-45e1-9106-e03389fcc190 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:15.692345 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5dba87bd-c3b8-4a74-b5d7-879500916e18 tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190" status: 404 len: 111 microversion: 2.1 time: 0.030478 Aug 27 03:27:15.692345 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3323/6463] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:15 2022] GET /compute/v2.1/servers/d87e599e-5f9e-45e1-9106-e03389fcc190 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:19.112616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-62532852-458e-4b87-920c-cb3521c8eebf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] Calling method '.version_select at 0x7f4d29a35a60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:19.151428 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-62532852-458e-4b87-920c-cb3521c8eebf tempest-TestVolumeBootPattern-366232100 tempest-TestVolumeBootPattern-366232100-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-103287171" status: 202 len: 0 microversion: 2.1 time: 0.043187 Aug 27 03:27:19.152590 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3141/6464] 10.222.0.99 () {58 vars in 1260 bytes} [Sat Aug 27 03:27:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-103287171 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:27:37.506160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:37.506902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:37.627953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1396703778", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:37.680988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] validate_networks() for None {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:27:37.961064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:27:37.961486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:27:37.961993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:27:37.962406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:27:37.962817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:27:37.974766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:37.975246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:37.975679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:37.976406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:37.976859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:37.977284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:37.998165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Getting quotas for project d82c103d82c34f3b9e0dc9badf0f9cfb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:38.003720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Getting quotas for user ab9fa4f710034efa88c326ad22e609c1 and project d82c103d82c34f3b9e0dc9badf0f9cfb. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:38.016780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:27:38.019100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:27:38.063796 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-31e1a14a-16d6-48da-8ba6-5d5d6c3a49c8 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563317 Aug 27 03:27:38.064636 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3324/6465] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:27:38.076850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1da53aee-2134-4a74-9717-a6cb68d98f08 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:38.077487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1da53aee-2134-4a74-9717-a6cb68d98f08 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:38.081721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:38.082585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:38.141046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1da53aee-2134-4a74-9717-a6cb68d98f08 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9fa4f710034efa88c326ad22e609c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82c103d82c34f3b9e0dc9badf0f9cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:38.152256 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1da53aee-2134-4a74-9717-a6cb68d98f08 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 200 len: 1222 microversion: 2.1 time: 0.079530 Aug 27 03:27:38.153333 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3142/6466] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:38 2022] GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:39.174715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b4dc56ab-4f88-441b-8456-b5c0f3f63572 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:39.175335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b4dc56ab-4f88-441b-8456-b5c0f3f63572 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:39.182353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4dc56ab-4f88-441b-8456-b5c0f3f63572 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:39.182856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4dc56ab-4f88-441b-8456-b5c0f3f63572 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:39.183376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4dc56ab-4f88-441b-8456-b5c0f3f63572 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:39.184090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4dc56ab-4f88-441b-8456-b5c0f3f63572 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:39.184551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4dc56ab-4f88-441b-8456-b5c0f3f63572 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:39.185165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b4dc56ab-4f88-441b-8456-b5c0f3f63572 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:39.251355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b4dc56ab-4f88-441b-8456-b5c0f3f63572 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9fa4f710034efa88c326ad22e609c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82c103d82c34f3b9e0dc9badf0f9cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:39.259525 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b4dc56ab-4f88-441b-8456-b5c0f3f63572 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 200 len: 1292 microversion: 2.1 time: 0.089725 Aug 27 03:27:39.260383 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3325/6467] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:39 2022] GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:40.281027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4ca3e2d5-42cc-4171-9725-f4f3d59863c9 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:40.281550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4ca3e2d5-42cc-4171-9725-f4f3d59863c9 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:40.290783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ca3e2d5-42cc-4171-9725-f4f3d59863c9 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.291555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ca3e2d5-42cc-4171-9725-f4f3d59863c9 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.292190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ca3e2d5-42cc-4171-9725-f4f3d59863c9 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.293147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ca3e2d5-42cc-4171-9725-f4f3d59863c9 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.293631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ca3e2d5-42cc-4171-9725-f4f3d59863c9 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.294242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ca3e2d5-42cc-4171-9725-f4f3d59863c9 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.567331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4ca3e2d5-42cc-4171-9725-f4f3d59863c9 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9fa4f710034efa88c326ad22e609c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82c103d82c34f3b9e0dc9badf0f9cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:40.575189 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4ca3e2d5-42cc-4171-9725-f4f3d59863c9 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 200 len: 1322 microversion: 2.1 time: 0.298463 Aug 27 03:27:40.575771 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3143/6468] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:40 2022] GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:40.916103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-bbca9810-8c34-4c45-9a4e-f79728b2a810 req-51690885-676f-48e6-a6db-d72e684e8685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a62e7814-2910-45f0-8410-b1a74149968e", "tag": "8a4c337e-cb80-4bce-819d-d7bdde9f5bf2"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:40.929091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bbca9810-8c34-4c45-9a4e-f79728b2a810 req-51690885-676f-48e6-a6db-d72e684e8685 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:40.929571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bbca9810-8c34-4c45-9a4e-f79728b2a810 req-51690885-676f-48e6-a6db-d72e684e8685 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:40.930204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bbca9810-8c34-4c45-9a4e-f79728b2a810 req-51690885-676f-48e6-a6db-d72e684e8685 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:40.943734 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-bbca9810-8c34-4c45-9a4e-f79728b2a810 req-51690885-676f-48e6-a6db-d72e684e8685 service nova] Creating event network-changed:8a4c337e-cb80-4bce-819d-d7bdde9f5bf2 for instance a62e7814-2910-45f0-8410-b1a74149968e on n-h2-852084-5 Aug 27 03:27:40.949400 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-bbca9810-8c34-4c45-9a4e-f79728b2a810 req-51690885-676f-48e6-a6db-d72e684e8685 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037228 Aug 27 03:27:40.950052 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3326/6469] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:41.597013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cac1fc9f-594d-42e5-b97e-5c1a01e6423c tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:41.597568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cac1fc9f-594d-42e5-b97e-5c1a01e6423c tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:41.604497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cac1fc9f-594d-42e5-b97e-5c1a01e6423c tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:41.605000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cac1fc9f-594d-42e5-b97e-5c1a01e6423c tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:41.605487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cac1fc9f-594d-42e5-b97e-5c1a01e6423c tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:41.606235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cac1fc9f-594d-42e5-b97e-5c1a01e6423c tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:41.606708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cac1fc9f-594d-42e5-b97e-5c1a01e6423c tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:41.607157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cac1fc9f-594d-42e5-b97e-5c1a01e6423c tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:41.743164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cac1fc9f-594d-42e5-b97e-5c1a01e6423c tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9fa4f710034efa88c326ad22e609c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82c103d82c34f3b9e0dc9badf0f9cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:41.750829 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cac1fc9f-594d-42e5-b97e-5c1a01e6423c tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 200 len: 1322 microversion: 2.1 time: 0.157915 Aug 27 03:27:41.751393 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3144/6470] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:41 2022] GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:42.774206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d69d3cff-2897-4e7b-9f2e-332433ed9648 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:42.775638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d69d3cff-2897-4e7b-9f2e-332433ed9648 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:42.783068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d69d3cff-2897-4e7b-9f2e-332433ed9648 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:42.783822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d69d3cff-2897-4e7b-9f2e-332433ed9648 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:42.784269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d69d3cff-2897-4e7b-9f2e-332433ed9648 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:42.784967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d69d3cff-2897-4e7b-9f2e-332433ed9648 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:42.785420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d69d3cff-2897-4e7b-9f2e-332433ed9648 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:42.785878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d69d3cff-2897-4e7b-9f2e-332433ed9648 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:42.919243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d69d3cff-2897-4e7b-9f2e-332433ed9648 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9fa4f710034efa88c326ad22e609c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82c103d82c34f3b9e0dc9badf0f9cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:42.927014 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d69d3cff-2897-4e7b-9f2e-332433ed9648 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 200 len: 1322 microversion: 2.1 time: 0.158906 Aug 27 03:27:42.927584 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3327/6471] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:42 2022] GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:43.947984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d18cfc27-aa42-43f6-8ce6-058fcd2eb6da tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:43.948620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d18cfc27-aa42-43f6-8ce6-058fcd2eb6da tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:43.955530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d18cfc27-aa42-43f6-8ce6-058fcd2eb6da tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:43.956033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d18cfc27-aa42-43f6-8ce6-058fcd2eb6da tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:43.956493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d18cfc27-aa42-43f6-8ce6-058fcd2eb6da tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:43.957207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d18cfc27-aa42-43f6-8ce6-058fcd2eb6da tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:43.957708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d18cfc27-aa42-43f6-8ce6-058fcd2eb6da tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:43.958157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d18cfc27-aa42-43f6-8ce6-058fcd2eb6da tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:44.101555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d18cfc27-aa42-43f6-8ce6-058fcd2eb6da tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9fa4f710034efa88c326ad22e609c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82c103d82c34f3b9e0dc9badf0f9cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:44.109300 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d18cfc27-aa42-43f6-8ce6-058fcd2eb6da tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 200 len: 1322 microversion: 2.1 time: 0.165294 Aug 27 03:27:44.109920 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3145/6472] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:43 2022] GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:44.845894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-3e919757-fb3d-4c23-8009-070d1d08f6eb req-86a8cd30-54ca-443c-a02b-7458771735f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62e7814-2910-45f0-8410-b1a74149968e", "name": "network-vif-plugged", "status": "completed", "tag": "8a4c337e-cb80-4bce-819d-d7bdde9f5bf2"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:44.855354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3e919757-fb3d-4c23-8009-070d1d08f6eb req-86a8cd30-54ca-443c-a02b-7458771735f2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:44.855837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3e919757-fb3d-4c23-8009-070d1d08f6eb req-86a8cd30-54ca-443c-a02b-7458771735f2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:44.856273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3e919757-fb3d-4c23-8009-070d1d08f6eb req-86a8cd30-54ca-443c-a02b-7458771735f2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:44.867974 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-3e919757-fb3d-4c23-8009-070d1d08f6eb req-86a8cd30-54ca-443c-a02b-7458771735f2 service nova] Creating event network-vif-plugged:8a4c337e-cb80-4bce-819d-d7bdde9f5bf2 for instance a62e7814-2910-45f0-8410-b1a74149968e on n-h2-852084-5 Aug 27 03:27:44.872994 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-3e919757-fb3d-4c23-8009-070d1d08f6eb req-86a8cd30-54ca-443c-a02b-7458771735f2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080139 Aug 27 03:27:44.873645 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3328/6473] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:45.130135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c0ebae04-c161-41aa-9a43-2fd0364157f2 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:45.130760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c0ebae04-c161-41aa-9a43-2fd0364157f2 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:45.137616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0ebae04-c161-41aa-9a43-2fd0364157f2 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:45.138141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0ebae04-c161-41aa-9a43-2fd0364157f2 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:45.138591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0ebae04-c161-41aa-9a43-2fd0364157f2 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:45.139293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0ebae04-c161-41aa-9a43-2fd0364157f2 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:45.139758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0ebae04-c161-41aa-9a43-2fd0364157f2 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:45.140197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c0ebae04-c161-41aa-9a43-2fd0364157f2 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:45.271034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c0ebae04-c161-41aa-9a43-2fd0364157f2 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9fa4f710034efa88c326ad22e609c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82c103d82c34f3b9e0dc9badf0f9cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:45.278781 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c0ebae04-c161-41aa-9a43-2fd0364157f2 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 200 len: 1322 microversion: 2.1 time: 0.152587 Aug 27 03:27:45.279354 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3146/6474] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:45 2022] GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:46.301627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-135a547c-a6b0-485f-b4f4-f675db6689ee tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:46.302907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-135a547c-a6b0-485f-b4f4-f675db6689ee tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:46.309448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-135a547c-a6b0-485f-b4f4-f675db6689ee tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:46.309958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-135a547c-a6b0-485f-b4f4-f675db6689ee tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:46.310403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-135a547c-a6b0-485f-b4f4-f675db6689ee tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:46.311095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-135a547c-a6b0-485f-b4f4-f675db6689ee tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:46.311550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-135a547c-a6b0-485f-b4f4-f675db6689ee tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:46.311977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-135a547c-a6b0-485f-b4f4-f675db6689ee tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:46.442451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-135a547c-a6b0-485f-b4f4-f675db6689ee tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9fa4f710034efa88c326ad22e609c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82c103d82c34f3b9e0dc9badf0f9cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:46.450881 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-135a547c-a6b0-485f-b4f4-f675db6689ee tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 200 len: 1472 microversion: 2.1 time: 0.154397 Aug 27 03:27:46.451460 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3329/6475] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:46 2022] GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 1472 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:46.525754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a96bc25f-64b3-46d1-b5d6-468963908393 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Calling method '.version_select at 0x7f4d2e8851f0>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:46.589984 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a96bc25f-64b3-46d1-b5d6-468963908393 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/947a80dbe7d947f499657171c5293cd8" status: 200 len: 371 microversion: 2.1 time: 0.120209 Aug 27 03:27:46.590549 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3147/6476] 10.222.0.99 () {58 vars in 1242 bytes} [Sat Aug 27 03:27:46 2022] GET /compute/v2.1/os-quota-sets/947a80dbe7d947f499657171c5293cd8 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:46.603206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1cd93718-69a3-491d-8ce5-9141438fbcf9 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-447013817", "id": 1133693330, "os-flavor-access:is_public": "True"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:46.622049 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1cd93718-69a3-491d-8ce5-9141438fbcf9 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023144 Aug 27 03:27:46.622638 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3330/6477] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:27:46 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:46.634467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1133693330"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:46.636887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:46.643111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:46.643645 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:46.644117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:46.644844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:46.645227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:46.645682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:46.858530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b10af3662c914831a6219843e199f1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a80dbe7d947f499657171c5293cd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:46.866458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-447013817 {{(pid=122487) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:27:46.873697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:46.874213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:46.874691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:46.875432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:46.875906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:46.876333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:46.900881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Getting quotas for project d82c103d82c34f3b9e0dc9badf0f9cfb. Resources: {'cores', 'ram'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:46.906844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Getting quotas for user ab9fa4f710034efa88c326ad22e609c1 and project d82c103d82c34f3b9e0dc9badf0f9cfb. Resources: {'cores', 'ram'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:46.919820 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.compute.api [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] ram quota exceeded for 947a80dbe7d947f499657171c5293cd8, tried to resize instance. Aug 27 03:27:46.920367 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Request method failure captured: Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e/action HTTP/1.1 Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 39 Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY8pI7iXtkjPqzMVkNXzuIK9_tTtERpKok2BMXSiat1TZkm4r9ge86hdEfPUcuOINAQO7cVvurwI53BkYcpRBCiklNP4UefDiHwiN4mNHhsRCnj6Wu47aCMMh1lFYlswqGEYelrWKkKtV2D-n5fbWQy95_CfA5NX8Q-LzW6LNW0xEbc Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 947a80dbe7d947f499657171c5293cd8 Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1519059665 Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,admin,reader Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,admin,reader Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_947a80dbe7d947f499657171c5293cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/947a80dbe7d947f499657171c5293cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/947a80dbe7d947f499657171c5293cd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/947a80dbe7d947f499657171c5293cd8"}]}] Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1519059665 Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 947a80dbe7d947f499657171c5293cd8 Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1519059665 Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersAdminNegativeTestJSON-1519059665-project-admin Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b10af3662c914831a6219843e199f1a2 Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1519059665-project-admin Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: {"resize": {"flavorRef": "1133693330"}} Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'a62e7814-2910-45f0-8410-b1a74149968e', 'body': {'resize': {'flavorRef': '1133693330'}}} Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:27:46.922393 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a7f36323-461e-4910-96c3-19826a806471 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e/action" status: 403 len: 118 microversion: 2.1 time: 0.293316 Aug 27 03:27:46.927036 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3148/6478] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:27:46 2022] POST /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e/action => generated 118 bytes in 294 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:27:46.938674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b3c07572-f2b3-4bf5-87dd-9841abe31232 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:46.956853 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b3c07572-f2b3-4bf5-87dd-9841abe31232 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1133693330" status: 202 len: 0 microversion: 2.1 time: 0.021824 Aug 27 03:27:46.957441 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3331/6479] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 03:27:46 2022] DELETE /compute/v2.1/flavors/1133693330 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:27:46.966628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7dc39322-4f34-4e3c-81ef-64f06d08fe95 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:46.987982 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7dc39322-4f34-4e3c-81ef-64f06d08fe95 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025085 Aug 27 03:27:46.988575 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3149/6480] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 03:27:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:47.008547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9e21e886-13c7-4874-8e4e-bfaf64cc7707 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Calling method '.version_select at 0x7f4d2e859ee0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:47.077172 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9e21e886-13c7-4874-8e4e-bfaf64cc7707 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] 10.222.0.99 "GET /compute/v2.1/os-quota-sets/947a80dbe7d947f499657171c5293cd8" status: 200 len: 371 microversion: 2.1 time: 0.072287 Aug 27 03:27:47.077700 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3332/6481] 10.222.0.99 () {58 vars in 1242 bytes} [Sat Aug 27 03:27:47 2022] GET /compute/v2.1/os-quota-sets/947a80dbe7d947f499657171c5293cd8 => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:47.089878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-84d0f5e6-73fd-4326-b53f-7f3e88ae65b0 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2005821449", "id": 1424069178, "os-flavor-access:is_public": "True"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:47.107481 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-84d0f5e6-73fd-4326-b53f-7f3e88ae65b0 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021819 Aug 27 03:27:47.108067 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3150/6482] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:27:47 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:27:47.119635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1424069178"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:47.122194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:47.128399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.128890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.129367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.130103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.130570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.131463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.299609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b10af3662c914831a6219843e199f1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '947a80dbe7d947f499657171c5293cd8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:47.307164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2005821449 {{(pid=122488) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:27:47.313857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.314344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.314785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.315518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.315972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.316402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.339324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Getting quotas for project d82c103d82c34f3b9e0dc9badf0f9cfb. Resources: {'cores', 'ram'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:47.344908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Getting quotas for user ab9fa4f710034efa88c326ad22e609c1 and project d82c103d82c34f3b9e0dc9badf0f9cfb. Resources: {'cores', 'ram'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:47.359949 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.compute.api [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] cores quota exceeded for 947a80dbe7d947f499657171c5293cd8, tried to resize instance. Aug 27 03:27:47.360484 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Request method failure captured: Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e/action HTTP/1.1 Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 39 Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY8pI7iXtkjPqzMVkNXzuIK9_tTtERpKok2BMXSiat1TZkm4r9ge86hdEfPUcuOINAQO7cVvurwI53BkYcpRBCiklNP4UefDiHwiN4mNHhsRCnj6Wu47aCMMh1lFYlswqGEYelrWKkKtV2D-n5fbWQy95_CfA5NX8Q-LzW6LNW0xEbc Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 947a80dbe7d947f499657171c5293cd8 Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1519059665 Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,admin,reader Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,admin,reader Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_947a80dbe7d947f499657171c5293cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/947a80dbe7d947f499657171c5293cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/947a80dbe7d947f499657171c5293cd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/947a80dbe7d947f499657171c5293cd8"}]}] Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1519059665 Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 947a80dbe7d947f499657171c5293cd8 Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1519059665 Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersAdminNegativeTestJSON-1519059665-project-admin Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b10af3662c914831a6219843e199f1a2 Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1519059665-project-admin Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: {"resize": {"flavorRef": "1424069178"}} Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'a62e7814-2910-45f0-8410-b1a74149968e', 'body': {'resize': {'flavorRef': '1424069178'}}} Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:27:47.362635 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-55e3f2c1-7341-4ac8-b0e0-4b88491cf6fa tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] 10.222.0.99 "POST /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e/action" status: 403 len: 113 microversion: 2.1 time: 0.248448 Aug 27 03:27:47.366936 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3333/6483] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:27:47 2022] POST /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e/action => generated 113 bytes in 250 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:27:47.373000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c3a150ab-b396-4f5a-a517-f39557d42e88 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:47.391833 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c3a150ab-b396-4f5a-a517-f39557d42e88 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] 10.222.0.99 "DELETE /compute/v2.1/flavors/1424069178" status: 202 len: 0 microversion: 2.1 time: 0.022546 Aug 27 03:27:47.392443 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3151/6484] 10.222.0.99 () {58 vars in 1161 bytes} [Sat Aug 27 03:27:47 2022] DELETE /compute/v2.1/flavors/1424069178 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:27:47.400940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-29b75efb-286c-4ce4-96b7-c9c5e624dd80 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:47.420655 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-29b75efb-286c-4ce4-96b7-c9c5e624dd80 tempest-ServersAdminNegativeTestJSON-1519059665 tempest-ServersAdminNegativeTestJSON-1519059665-project-admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023337 Aug 27 03:27:47.421233 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3334/6485] 10.222.0.99 () {58 vars in 1146 bytes} [Sat Aug 27 03:27:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:47.440661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-041aa921-f15f-480a-9662-2df5f17070cb tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:47.441182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-041aa921-f15f-480a-9662-2df5f17070cb tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:47.447773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-041aa921-f15f-480a-9662-2df5f17070cb tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.448273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-041aa921-f15f-480a-9662-2df5f17070cb tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.448729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-041aa921-f15f-480a-9662-2df5f17070cb tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.449446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-041aa921-f15f-480a-9662-2df5f17070cb tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.449949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-041aa921-f15f-480a-9662-2df5f17070cb tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.450396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-041aa921-f15f-480a-9662-2df5f17070cb tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.477047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-041aa921-f15f-480a-9662-2df5f17070cb tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:27:47.556740 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-041aa921-f15f-480a-9662-2df5f17070cb tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 204 len: 0 microversion: 2.1 time: 0.119697 Aug 27 03:27:47.557502 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3152/6486] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:27:47 2022] DELETE /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:27:47.565786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4a084e0-961a-44e4-a2c2-1ef2e648e423 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:47.566506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4a084e0-961a-44e4-a2c2-1ef2e648e423 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:47.573244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4a084e0-961a-44e4-a2c2-1ef2e648e423 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.573797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4a084e0-961a-44e4-a2c2-1ef2e648e423 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.574252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4a084e0-961a-44e4-a2c2-1ef2e648e423 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.574954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4a084e0-961a-44e4-a2c2-1ef2e648e423 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:47.575417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4a084e0-961a-44e4-a2c2-1ef2e648e423 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:47.575854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4a084e0-961a-44e4-a2c2-1ef2e648e423 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:47.710101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4a084e0-961a-44e4-a2c2-1ef2e648e423 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9fa4f710034efa88c326ad22e609c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82c103d82c34f3b9e0dc9badf0f9cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:47.718875 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4a084e0-961a-44e4-a2c2-1ef2e648e423 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 200 len: 1478 microversion: 2.1 time: 0.157194 Aug 27 03:27:47.719468 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3335/6487] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:47 2022] GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 1478 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:48.741056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-400643a0-a19f-4d0b-9a35-7843497bfda0 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:48.741709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-400643a0-a19f-4d0b-9a35-7843497bfda0 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:48.748589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-400643a0-a19f-4d0b-9a35-7843497bfda0 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:48.749091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-400643a0-a19f-4d0b-9a35-7843497bfda0 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:48.749549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-400643a0-a19f-4d0b-9a35-7843497bfda0 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:48.750294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-400643a0-a19f-4d0b-9a35-7843497bfda0 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:48.750768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-400643a0-a19f-4d0b-9a35-7843497bfda0 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:48.751213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-400643a0-a19f-4d0b-9a35-7843497bfda0 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:48.922633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-400643a0-a19f-4d0b-9a35-7843497bfda0 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9fa4f710034efa88c326ad22e609c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd82c103d82c34f3b9e0dc9badf0f9cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:48.930602 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-400643a0-a19f-4d0b-9a35-7843497bfda0 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 200 len: 1478 microversion: 2.1 time: 0.194078 Aug 27 03:27:48.931186 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3153/6488] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:48 2022] GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 1478 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:49.338371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-796f2b8e-c9aa-4205-8f41-7939f9f4117d req-d175f010-9444-4dcf-9611-0b84713c61d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a62e7814-2910-45f0-8410-b1a74149968e", "name": "network-vif-deleted", "tag": "8a4c337e-cb80-4bce-819d-d7bdde9f5bf2"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:49.354763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-796f2b8e-c9aa-4205-8f41-7939f9f4117d req-d175f010-9444-4dcf-9611-0b84713c61d0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:49.355503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-796f2b8e-c9aa-4205-8f41-7939f9f4117d req-d175f010-9444-4dcf-9611-0b84713c61d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:49.356104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-796f2b8e-c9aa-4205-8f41-7939f9f4117d req-d175f010-9444-4dcf-9611-0b84713c61d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:49.375224 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-796f2b8e-c9aa-4205-8f41-7939f9f4117d req-d175f010-9444-4dcf-9611-0b84713c61d0 service nova] Creating event network-vif-deleted:8a4c337e-cb80-4bce-819d-d7bdde9f5bf2 for instance a62e7814-2910-45f0-8410-b1a74149968e on n-h2-852084-5 Aug 27 03:27:49.386201 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-796f2b8e-c9aa-4205-8f41-7939f9f4117d req-d175f010-9444-4dcf-9611-0b84713c61d0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052408 Aug 27 03:27:49.388235 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3336/6489] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:27:49.952035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:49.952667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] [instance: a62e7814-2910-45f0-8410-b1a74149968e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:49.959475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:49.960460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:49.960949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:49.961886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:49.962194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:49.962765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:49.977520 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] HTTP exception thrown: Instance a62e7814-2910-45f0-8410-b1a74149968e could not be found. Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Request method failure captured: Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e HTTP/1.1 Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY8o84uO3TaRT8SooZR6JpYJtjvbbDfskqQV4VctrMNBxVzDZMYGzMVKKWTvHmowqWdL25KlS0irGWmCVzfsrvSPQcujibHs1mDBH57rpQox0xqVkG83tVX0nUOLDeNrla5sErId2DtPemMocuuEAVpi-BMq_9GO4ZaRTyg2G-jE7gE Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: d82c103d82c34f3b9e0dc9badf0f9cfb Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-364489030 Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d82c103d82c34f3b9e0dc9badf0f9cfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d82c103d82c34f3b9e0dc9badf0f9cfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d82c103d82c34f3b9e0dc9badf0f9cfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d82c103d82c34f3b9e0dc9badf0f9cfb"}]}] Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersAdminNegativeTestJSON-364489030 Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: d82c103d82c34f3b9e0dc9badf0f9cfb Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-364489030 Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersAdminNegativeTestJSON-364489030-project Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: ab9fa4f710034efa88c326ad22e609c1 Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersAdminNegativeTestJSON-364489030-project Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance a62e7814-2910-45f0-8410-b1a74149968e could not be found. Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'a62e7814-2910-45f0-8410-b1a74149968e'} Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a62e7814-2910-45f0-8410-b1a74149968e could not be found. Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a62e7814-2910-45f0-8410-b1a74149968e could not be found. Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:49.979430 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:27:49.983632 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:49.983632 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:27:49.983632 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:27:49.983632 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:27:49.983632 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:27:49.983632 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:27:49.983632 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a62e7814-2910-45f0-8410-b1a74149968e could not be found. Aug 27 03:27:49.983632 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:27:49.983632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] Returning 404 to user: Instance a62e7814-2910-45f0-8410-b1a74149968e could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:27:49.983632 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-032d46ab-54e8-4c80-92f7-d1a4437a5759 tempest-ServersAdminNegativeTestJSON-364489030 tempest-ServersAdminNegativeTestJSON-364489030-project] 10.222.0.99 "GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e" status: 404 len: 111 microversion: 2.1 time: 0.032812 Aug 27 03:27:49.983632 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3154/6490] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:49 2022] GET /compute/v2.1/servers/a62e7814-2910-45f0-8410-b1a74149968e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:27:56.449751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1302635964", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "eadd4662-e2e6-4fc4-bdff-570735294ac2"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:56.505913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] validate_networks() for [('eadd4662-e2e6-4fc4-bdff-570735294ac2', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:27:56.939052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:27:56.939515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:27:56.939995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:27:56.940402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:27:56.941032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:27:56.951732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:56.952222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:56.952656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:56.953381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:56.953869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:56.954296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:56.978117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Getting quotas for project 8b6f786870be488197b2810c8ce5460d. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:27:56.988931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Getting quotas for user 51cbbafdfeb641f2ab8522ef7de3b74a and project 8b6f786870be488197b2810c8ce5460d. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:27:57.003989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:27:57.006309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:27:57.055317 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f144ebbb-9712-4075-a2af-8a34d8a61cbe tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748095 Aug 27 03:27:57.056186 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3337/6491] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:27:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:27:57.066974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-78d3f924-92bc-4335-a05a-1be59b26cfba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:57.067621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-78d3f924-92bc-4335-a05a-1be59b26cfba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:57.071354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:57.072249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:27:57.145750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-78d3f924-92bc-4335-a05a-1be59b26cfba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:57.154244 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-78d3f924-92bc-4335-a05a-1be59b26cfba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1215 microversion: 2.1 time: 0.090992 Aug 27 03:27:57.154909 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3155/6492] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:57 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:58.178618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fe969921-b648-424d-b006-07a5047ece7c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:58.180158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fe969921-b648-424d-b006-07a5047ece7c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:58.187053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe969921-b648-424d-b006-07a5047ece7c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:58.187543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe969921-b648-424d-b006-07a5047ece7c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:58.187990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe969921-b648-424d-b006-07a5047ece7c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:58.188701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe969921-b648-424d-b006-07a5047ece7c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:58.189312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe969921-b648-424d-b006-07a5047ece7c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:58.189768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fe969921-b648-424d-b006-07a5047ece7c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:58.255393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fe969921-b648-424d-b006-07a5047ece7c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:58.263246 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fe969921-b648-424d-b006-07a5047ece7c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1267 microversion: 2.1 time: 0.090661 Aug 27 03:27:58.263833 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3338/6493] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:58 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:59.284700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-407b2d60-17c3-4c39-af35-b5c8444d7b6e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:27:59.285344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-407b2d60-17c3-4c39-af35-b5c8444d7b6e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:27:59.295584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-407b2d60-17c3-4c39-af35-b5c8444d7b6e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:59.296105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-407b2d60-17c3-4c39-af35-b5c8444d7b6e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:59.296740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-407b2d60-17c3-4c39-af35-b5c8444d7b6e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:59.297646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-407b2d60-17c3-4c39-af35-b5c8444d7b6e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:59.298533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-407b2d60-17c3-4c39-af35-b5c8444d7b6e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:59.299260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-407b2d60-17c3-4c39-af35-b5c8444d7b6e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:59.563262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-407b2d60-17c3-4c39-af35-b5c8444d7b6e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:27:59.574081 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-407b2d60-17c3-4c39-af35-b5c8444d7b6e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1315 microversion: 2.1 time: 0.293183 Aug 27 03:27:59.585766 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3156/6494] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:27:59 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:27:59.905870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-777506aa-4bc3-499e-98ad-7998fed48153 req-8e2fc499-929b-41a7-8d98-d7be2b060be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25758171-9841-437d-af84-31f7c8c26066", "tag": "a872693e-ac33-4830-af07-e61eee2542c5"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:27:59.923171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-777506aa-4bc3-499e-98ad-7998fed48153 req-8e2fc499-929b-41a7-8d98-d7be2b060be7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:27:59.924645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-777506aa-4bc3-499e-98ad-7998fed48153 req-8e2fc499-929b-41a7-8d98-d7be2b060be7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:27:59.925588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-777506aa-4bc3-499e-98ad-7998fed48153 req-8e2fc499-929b-41a7-8d98-d7be2b060be7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:27:59.958196 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-777506aa-4bc3-499e-98ad-7998fed48153 req-8e2fc499-929b-41a7-8d98-d7be2b060be7 service nova] Creating event network-changed:a872693e-ac33-4830-af07-e61eee2542c5 for instance 25758171-9841-437d-af84-31f7c8c26066 on n-h2-852084-5 Aug 27 03:27:59.970726 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-777506aa-4bc3-499e-98ad-7998fed48153 req-8e2fc499-929b-41a7-8d98-d7be2b060be7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069767 Aug 27 03:27:59.972086 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3339/6495] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:00.596232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2ace02f-6855-44fc-bed7-32640f44c198 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:00.596742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e2ace02f-6855-44fc-bed7-32640f44c198 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:00.604350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ace02f-6855-44fc-bed7-32640f44c198 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:00.604861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ace02f-6855-44fc-bed7-32640f44c198 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:00.605319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ace02f-6855-44fc-bed7-32640f44c198 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:00.606078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ace02f-6855-44fc-bed7-32640f44c198 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:00.606580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ace02f-6855-44fc-bed7-32640f44c198 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:00.607025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ace02f-6855-44fc-bed7-32640f44c198 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:00.753699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e2ace02f-6855-44fc-bed7-32640f44c198 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:00.761583 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e2ace02f-6855-44fc-bed7-32640f44c198 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1315 microversion: 2.1 time: 0.169927 Aug 27 03:28:00.762196 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3157/6496] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:00 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:01.784758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-91f6778d-5c1a-4813-afa1-d3912f5ed8ca tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:01.785474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-91f6778d-5c1a-4813-afa1-d3912f5ed8ca tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:01.792456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f6778d-5c1a-4813-afa1-d3912f5ed8ca tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:01.792986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f6778d-5c1a-4813-afa1-d3912f5ed8ca tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:01.793428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f6778d-5c1a-4813-afa1-d3912f5ed8ca tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:01.794160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f6778d-5c1a-4813-afa1-d3912f5ed8ca tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:01.794611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f6778d-5c1a-4813-afa1-d3912f5ed8ca tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:01.795036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-91f6778d-5c1a-4813-afa1-d3912f5ed8ca tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:01.933650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-91f6778d-5c1a-4813-afa1-d3912f5ed8ca tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:01.941957 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-91f6778d-5c1a-4813-afa1-d3912f5ed8ca tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1315 microversion: 2.1 time: 0.162222 Aug 27 03:28:01.942554 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3340/6497] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:01 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:02.966318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3ca3fd31-86e0-4f44-9d48-f80dad41c667 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:02.967443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3ca3fd31-86e0-4f44-9d48-f80dad41c667 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:02.975579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ca3fd31-86e0-4f44-9d48-f80dad41c667 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:02.976681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ca3fd31-86e0-4f44-9d48-f80dad41c667 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:02.977134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ca3fd31-86e0-4f44-9d48-f80dad41c667 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:02.977889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ca3fd31-86e0-4f44-9d48-f80dad41c667 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:02.978358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ca3fd31-86e0-4f44-9d48-f80dad41c667 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:02.978797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3ca3fd31-86e0-4f44-9d48-f80dad41c667 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:03.110499 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3ca3fd31-86e0-4f44-9d48-f80dad41c667 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:03.118116 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3ca3fd31-86e0-4f44-9d48-f80dad41c667 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1315 microversion: 2.1 time: 0.158442 Aug 27 03:28:03.118697 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3158/6498] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:02 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:04.139537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b3c8ccf0-d44b-4208-957d-505dc67ec486 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:04.140165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b3c8ccf0-d44b-4208-957d-505dc67ec486 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:04.147127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3c8ccf0-d44b-4208-957d-505dc67ec486 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:04.147616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3c8ccf0-d44b-4208-957d-505dc67ec486 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:04.148060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3c8ccf0-d44b-4208-957d-505dc67ec486 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:04.148759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3c8ccf0-d44b-4208-957d-505dc67ec486 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:04.149219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3c8ccf0-d44b-4208-957d-505dc67ec486 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:04.149653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b3c8ccf0-d44b-4208-957d-505dc67ec486 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:04.291088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b3c8ccf0-d44b-4208-957d-505dc67ec486 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:04.299224 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b3c8ccf0-d44b-4208-957d-505dc67ec486 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1315 microversion: 2.1 time: 0.163616 Aug 27 03:28:04.299865 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3341/6499] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:04 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:04.831181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-34dc6768-0eb6-423a-86dd-54d5bb1eafca req-af896af5-748b-47f8-b528-a547feebc76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25758171-9841-437d-af84-31f7c8c26066", "name": "network-vif-plugged", "status": "completed", "tag": "a872693e-ac33-4830-af07-e61eee2542c5"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:04.844565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-34dc6768-0eb6-423a-86dd-54d5bb1eafca req-af896af5-748b-47f8-b528-a547feebc76b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:04.845071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-34dc6768-0eb6-423a-86dd-54d5bb1eafca req-af896af5-748b-47f8-b528-a547feebc76b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:04.845527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-34dc6768-0eb6-423a-86dd-54d5bb1eafca req-af896af5-748b-47f8-b528-a547feebc76b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:04.856909 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-34dc6768-0eb6-423a-86dd-54d5bb1eafca req-af896af5-748b-47f8-b528-a547feebc76b service nova] Creating event network-vif-plugged:a872693e-ac33-4830-af07-e61eee2542c5 for instance 25758171-9841-437d-af84-31f7c8c26066 on n-h2-852084-5 Aug 27 03:28:04.862074 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-34dc6768-0eb6-423a-86dd-54d5bb1eafca req-af896af5-748b-47f8-b528-a547feebc76b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034583 Aug 27 03:28:04.862685 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3159/6500] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:05.320779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8de0f0fb-3034-46ec-a39e-a8717fc351a6 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:05.321319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8de0f0fb-3034-46ec-a39e-a8717fc351a6 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:05.328496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8de0f0fb-3034-46ec-a39e-a8717fc351a6 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:05.328991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8de0f0fb-3034-46ec-a39e-a8717fc351a6 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:05.329437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8de0f0fb-3034-46ec-a39e-a8717fc351a6 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:05.330177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8de0f0fb-3034-46ec-a39e-a8717fc351a6 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:05.330643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8de0f0fb-3034-46ec-a39e-a8717fc351a6 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:05.331077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8de0f0fb-3034-46ec-a39e-a8717fc351a6 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:05.462351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8de0f0fb-3034-46ec-a39e-a8717fc351a6 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:05.470608 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8de0f0fb-3034-46ec-a39e-a8717fc351a6 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1315 microversion: 2.1 time: 0.153773 Aug 27 03:28:05.471294 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3342/6501] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:05 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:06.494909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3f6dcf51-7137-428f-8911-f4474e82f5e2 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:06.495654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3f6dcf51-7137-428f-8911-f4474e82f5e2 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:06.501890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f6dcf51-7137-428f-8911-f4474e82f5e2 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.502380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f6dcf51-7137-428f-8911-f4474e82f5e2 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.502845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f6dcf51-7137-428f-8911-f4474e82f5e2 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.503524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f6dcf51-7137-428f-8911-f4474e82f5e2 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.503987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f6dcf51-7137-428f-8911-f4474e82f5e2 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.504418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f6dcf51-7137-428f-8911-f4474e82f5e2 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.640381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3f6dcf51-7137-428f-8911-f4474e82f5e2 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:06.648097 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3f6dcf51-7137-428f-8911-f4474e82f5e2 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1502 microversion: 2.1 time: 0.159240 Aug 27 03:28:06.648722 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3160/6502] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:06 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:06.668615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:06.670897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:06.677772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.678259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.679186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.679958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.680417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.680850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.710550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:06.716589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Old instance type m1.heat2, new instance type m1.heat {{(pid=122488) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:28:06.723208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:28:06.723625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:28:06.724096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:28:06.724503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:28:06.724912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:28:06.789128 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-27e1e4c8-f3de-4c3d-a40c-7d08517e0053 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "POST /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066/action" status: 202 len: 0 microversion: 2.1 time: 0.124361 Aug 27 03:28:06.789892 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3343/6503] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:28:06 2022] POST /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:28:06.798086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1f27cb75-c02a-4451-9bbb-8712da284173 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:06.798900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1f27cb75-c02a-4451-9bbb-8712da284173 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:06.805804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f27cb75-c02a-4451-9bbb-8712da284173 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.806308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f27cb75-c02a-4451-9bbb-8712da284173 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.806786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f27cb75-c02a-4451-9bbb-8712da284173 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.807508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f27cb75-c02a-4451-9bbb-8712da284173 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:06.807984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f27cb75-c02a-4451-9bbb-8712da284173 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:06.808512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1f27cb75-c02a-4451-9bbb-8712da284173 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:06.957308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1f27cb75-c02a-4451-9bbb-8712da284173 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:06.965485 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1f27cb75-c02a-4451-9bbb-8712da284173 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1511 microversion: 2.1 time: 0.171145 Aug 27 03:28:06.966113 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3161/6504] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:06 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:07.985008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=7 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:07.986186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=14 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:07.992701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d8b12d39-a703-4e9d-913e-e310df741e02 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:07.993517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d8b12d39-a703-4e9d-913e-e310df741e02 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:07.995462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:08.004776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8b12d39-a703-4e9d-913e-e310df741e02 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:08.005423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8b12d39-a703-4e9d-913e-e310df741e02 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:08.006069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8b12d39-a703-4e9d-913e-e310df741e02 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:08.006793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8b12d39-a703-4e9d-913e-e310df741e02 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:08.007820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8b12d39-a703-4e9d-913e-e310df741e02 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:08.008258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8b12d39-a703-4e9d-913e-e310df741e02 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:08.013114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:08.150108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d8b12d39-a703-4e9d-913e-e310df741e02 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:08.158003 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d8b12d39-a703-4e9d-913e-e310df741e02 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1511 microversion: 2.1 time: 0.174008 Aug 27 03:28:08.158588 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3344/6505] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:07 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:09.179433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c4447ee-47d6-4aff-b1ef-ff2ae7ee9f60 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:09.180147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c4447ee-47d6-4aff-b1ef-ff2ae7ee9f60 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:09.182321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:09.183973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:09.190576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4447ee-47d6-4aff-b1ef-ff2ae7ee9f60 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.191085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4447ee-47d6-4aff-b1ef-ff2ae7ee9f60 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.191540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4447ee-47d6-4aff-b1ef-ff2ae7ee9f60 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.192263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4447ee-47d6-4aff-b1ef-ff2ae7ee9f60 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:09.192763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4447ee-47d6-4aff-b1ef-ff2ae7ee9f60 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:09.193210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c4447ee-47d6-4aff-b1ef-ff2ae7ee9f60 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:09.197188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:09.336619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2c4447ee-47d6-4aff-b1ef-ff2ae7ee9f60 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:09.345180 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c4447ee-47d6-4aff-b1ef-ff2ae7ee9f60 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.169739 Aug 27 03:28:09.345888 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3162/6506] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:09 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:10.366937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b8e9bfdd-420c-4054-aad8-e9124b51bc1e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:10.368171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b8e9bfdd-420c-4054-aad8-e9124b51bc1e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:10.375140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8e9bfdd-420c-4054-aad8-e9124b51bc1e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.375624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8e9bfdd-420c-4054-aad8-e9124b51bc1e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.376067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8e9bfdd-420c-4054-aad8-e9124b51bc1e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.376766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8e9bfdd-420c-4054-aad8-e9124b51bc1e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:10.377221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8e9bfdd-420c-4054-aad8-e9124b51bc1e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:10.377649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8e9bfdd-420c-4054-aad8-e9124b51bc1e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:10.514501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b8e9bfdd-420c-4054-aad8-e9124b51bc1e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:10.522519 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b8e9bfdd-420c-4054-aad8-e9124b51bc1e tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.159387 Aug 27 03:28:10.523111 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3345/6507] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:10 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:11.543987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0b7f5e94-4ea5-4293-9455-f756501d7cf5 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:11.544652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0b7f5e94-4ea5-4293-9455-f756501d7cf5 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:11.551605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b7f5e94-4ea5-4293-9455-f756501d7cf5 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:11.552106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b7f5e94-4ea5-4293-9455-f756501d7cf5 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:11.552572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b7f5e94-4ea5-4293-9455-f756501d7cf5 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:11.553281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b7f5e94-4ea5-4293-9455-f756501d7cf5 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:11.553791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b7f5e94-4ea5-4293-9455-f756501d7cf5 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:11.554240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0b7f5e94-4ea5-4293-9455-f756501d7cf5 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:11.692862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0b7f5e94-4ea5-4293-9455-f756501d7cf5 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:11.701958 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0b7f5e94-4ea5-4293-9455-f756501d7cf5 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.161689 Aug 27 03:28:11.702538 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3163/6508] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:11 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:12.724539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-25ad613d-1608-47fd-a62d-988aa4a4e4f4 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:12.725142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-25ad613d-1608-47fd-a62d-988aa4a4e4f4 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:12.732927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25ad613d-1608-47fd-a62d-988aa4a4e4f4 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.733409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25ad613d-1608-47fd-a62d-988aa4a4e4f4 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.733880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25ad613d-1608-47fd-a62d-988aa4a4e4f4 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.734579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25ad613d-1608-47fd-a62d-988aa4a4e4f4 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:12.735029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25ad613d-1608-47fd-a62d-988aa4a4e4f4 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:12.735451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-25ad613d-1608-47fd-a62d-988aa4a4e4f4 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:12.872394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-25ad613d-1608-47fd-a62d-988aa4a4e4f4 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:12.880207 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-25ad613d-1608-47fd-a62d-988aa4a4e4f4 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.159549 Aug 27 03:28:12.880780 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3346/6509] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:12 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:13.902474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-62f90e63-a191-4ccb-8f86-5123719ea874 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:13.903129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-62f90e63-a191-4ccb-8f86-5123719ea874 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:13.910012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62f90e63-a191-4ccb-8f86-5123719ea874 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:13.910507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62f90e63-a191-4ccb-8f86-5123719ea874 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:13.910961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62f90e63-a191-4ccb-8f86-5123719ea874 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:13.911675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62f90e63-a191-4ccb-8f86-5123719ea874 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:13.912145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62f90e63-a191-4ccb-8f86-5123719ea874 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:13.912586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62f90e63-a191-4ccb-8f86-5123719ea874 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:14.041635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-62f90e63-a191-4ccb-8f86-5123719ea874 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:14.049345 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-62f90e63-a191-4ccb-8f86-5123719ea874 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.151341 Aug 27 03:28:14.049942 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3164/6510] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:13 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:15.070743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc1b6cf2-4d05-468a-9c8f-3db2974bb493 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:15.071268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fc1b6cf2-4d05-468a-9c8f-3db2974bb493 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:15.078193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1b6cf2-4d05-468a-9c8f-3db2974bb493 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:15.078663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1b6cf2-4d05-468a-9c8f-3db2974bb493 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:15.079108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1b6cf2-4d05-468a-9c8f-3db2974bb493 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:15.079801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1b6cf2-4d05-468a-9c8f-3db2974bb493 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:15.080260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1b6cf2-4d05-468a-9c8f-3db2974bb493 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:15.080687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc1b6cf2-4d05-468a-9c8f-3db2974bb493 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:15.209536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fc1b6cf2-4d05-468a-9c8f-3db2974bb493 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:15.217688 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fc1b6cf2-4d05-468a-9c8f-3db2974bb493 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.150950 Aug 27 03:28:15.218267 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3347/6511] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:15 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:16.239099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-267a6760-dbb9-4dfe-8025-840a04830e6c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:16.239727 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-267a6760-dbb9-4dfe-8025-840a04830e6c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:16.246650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267a6760-dbb9-4dfe-8025-840a04830e6c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.247080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267a6760-dbb9-4dfe-8025-840a04830e6c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.247533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267a6760-dbb9-4dfe-8025-840a04830e6c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.248233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267a6760-dbb9-4dfe-8025-840a04830e6c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:16.248694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267a6760-dbb9-4dfe-8025-840a04830e6c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:16.249131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-267a6760-dbb9-4dfe-8025-840a04830e6c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:16.382819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-267a6760-dbb9-4dfe-8025-840a04830e6c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:16.390973 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-267a6760-dbb9-4dfe-8025-840a04830e6c tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.155717 Aug 27 03:28:16.391567 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3165/6512] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:16 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:17.412432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f125ef0e-d439-4e79-822f-809ca9fa577d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:17.413056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f125ef0e-d439-4e79-822f-809ca9fa577d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:17.420507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f125ef0e-d439-4e79-822f-809ca9fa577d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.420997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f125ef0e-d439-4e79-822f-809ca9fa577d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.421437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f125ef0e-d439-4e79-822f-809ca9fa577d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.422164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f125ef0e-d439-4e79-822f-809ca9fa577d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:17.422626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f125ef0e-d439-4e79-822f-809ca9fa577d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:17.423059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f125ef0e-d439-4e79-822f-809ca9fa577d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:17.558492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f125ef0e-d439-4e79-822f-809ca9fa577d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:17.566345 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f125ef0e-d439-4e79-822f-809ca9fa577d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.157771 Aug 27 03:28:17.567142 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3348/6513] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:17 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:18.587053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-954aba1c-dcf9-440e-b145-f03522fc7367 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:18.587692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-954aba1c-dcf9-440e-b145-f03522fc7367 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:18.594923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-954aba1c-dcf9-440e-b145-f03522fc7367 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:18.595422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-954aba1c-dcf9-440e-b145-f03522fc7367 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:18.595875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-954aba1c-dcf9-440e-b145-f03522fc7367 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:18.596585 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-954aba1c-dcf9-440e-b145-f03522fc7367 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:18.597057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-954aba1c-dcf9-440e-b145-f03522fc7367 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:18.597501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-954aba1c-dcf9-440e-b145-f03522fc7367 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:18.727058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-954aba1c-dcf9-440e-b145-f03522fc7367 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:18.734908 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-954aba1c-dcf9-440e-b145-f03522fc7367 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.151936 Aug 27 03:28:18.735695 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3166/6514] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:18 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:19.758455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a90802d3-7afd-44e2-a13a-0742b42df758 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:19.758996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a90802d3-7afd-44e2-a13a-0742b42df758 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:19.765969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a90802d3-7afd-44e2-a13a-0742b42df758 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.766459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a90802d3-7afd-44e2-a13a-0742b42df758 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.766905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a90802d3-7afd-44e2-a13a-0742b42df758 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.767605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a90802d3-7afd-44e2-a13a-0742b42df758 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:19.768062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a90802d3-7afd-44e2-a13a-0742b42df758 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:19.768491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a90802d3-7afd-44e2-a13a-0742b42df758 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:19.900312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a90802d3-7afd-44e2-a13a-0742b42df758 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:19.908130 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a90802d3-7afd-44e2-a13a-0742b42df758 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.154515 Aug 27 03:28:19.908711 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3349/6515] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:19 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:20.928544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ee1590b-404f-4437-9de3-bb5f159ccee0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:20.929083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1ee1590b-404f-4437-9de3-bb5f159ccee0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:20.936676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee1590b-404f-4437-9de3-bb5f159ccee0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.937177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee1590b-404f-4437-9de3-bb5f159ccee0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.937635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee1590b-404f-4437-9de3-bb5f159ccee0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:20.938365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee1590b-404f-4437-9de3-bb5f159ccee0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:20.938839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee1590b-404f-4437-9de3-bb5f159ccee0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:20.939315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ee1590b-404f-4437-9de3-bb5f159ccee0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:21.072891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1ee1590b-404f-4437-9de3-bb5f159ccee0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:21.080694 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1ee1590b-404f-4437-9de3-bb5f159ccee0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.156124 Aug 27 03:28:21.081272 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3167/6516] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:20 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:22.101470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1bf37e44-0739-4a0f-8d48-511214ff7b11 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:22.102176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1bf37e44-0739-4a0f-8d48-511214ff7b11 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:22.109384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf37e44-0739-4a0f-8d48-511214ff7b11 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:22.109903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf37e44-0739-4a0f-8d48-511214ff7b11 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:22.110350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf37e44-0739-4a0f-8d48-511214ff7b11 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:22.111055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf37e44-0739-4a0f-8d48-511214ff7b11 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:22.111518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf37e44-0739-4a0f-8d48-511214ff7b11 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:22.111968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bf37e44-0739-4a0f-8d48-511214ff7b11 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:22.255700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1bf37e44-0739-4a0f-8d48-511214ff7b11 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:22.264298 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1bf37e44-0739-4a0f-8d48-511214ff7b11 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.166696 Aug 27 03:28:22.264938 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3350/6517] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:22 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:23.285306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d7c24045-67ee-41a4-a842-14e7d8dc4558 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:23.285986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d7c24045-67ee-41a4-a842-14e7d8dc4558 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:23.292886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7c24045-67ee-41a4-a842-14e7d8dc4558 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.293380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7c24045-67ee-41a4-a842-14e7d8dc4558 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.293860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7c24045-67ee-41a4-a842-14e7d8dc4558 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.294567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7c24045-67ee-41a4-a842-14e7d8dc4558 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:23.295038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7c24045-67ee-41a4-a842-14e7d8dc4558 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:23.295481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d7c24045-67ee-41a4-a842-14e7d8dc4558 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:23.430722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d7c24045-67ee-41a4-a842-14e7d8dc4558 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:23.438443 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d7c24045-67ee-41a4-a842-14e7d8dc4558 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.157076 Aug 27 03:28:23.439008 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3168/6518] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:23 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:24.460050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c51cd957-47d8-47ff-ba14-1cfc6791b0ba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:24.460668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c51cd957-47d8-47ff-ba14-1cfc6791b0ba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:24.467885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c51cd957-47d8-47ff-ba14-1cfc6791b0ba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.472700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c51cd957-47d8-47ff-ba14-1cfc6791b0ba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.472700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c51cd957-47d8-47ff-ba14-1cfc6791b0ba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.472700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c51cd957-47d8-47ff-ba14-1cfc6791b0ba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:24.472700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c51cd957-47d8-47ff-ba14-1cfc6791b0ba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:24.472700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c51cd957-47d8-47ff-ba14-1cfc6791b0ba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:24.603900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c51cd957-47d8-47ff-ba14-1cfc6791b0ba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:24.611785 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c51cd957-47d8-47ff-ba14-1cfc6791b0ba tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.155630 Aug 27 03:28:24.612369 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3351/6519] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:24 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:25.633375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4211c39e-0535-44ae-a299-3645bb4e4283 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:25.634595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4211c39e-0535-44ae-a299-3645bb4e4283 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:25.641565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4211c39e-0535-44ae-a299-3645bb4e4283 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:25.642042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4211c39e-0535-44ae-a299-3645bb4e4283 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:25.642501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4211c39e-0535-44ae-a299-3645bb4e4283 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:25.643209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4211c39e-0535-44ae-a299-3645bb4e4283 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:25.643680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4211c39e-0535-44ae-a299-3645bb4e4283 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:25.644125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4211c39e-0535-44ae-a299-3645bb4e4283 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:25.774357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4211c39e-0535-44ae-a299-3645bb4e4283 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:25.782700 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4211c39e-0535-44ae-a299-3645bb4e4283 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.153315 Aug 27 03:28:25.783274 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3169/6520] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:25 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:26.804077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ebb74051-5023-4e2f-abb6-0c8c260bb73d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:26.804688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ebb74051-5023-4e2f-abb6-0c8c260bb73d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:26.811390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebb74051-5023-4e2f-abb6-0c8c260bb73d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.811869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebb74051-5023-4e2f-abb6-0c8c260bb73d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.812304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebb74051-5023-4e2f-abb6-0c8c260bb73d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.812991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebb74051-5023-4e2f-abb6-0c8c260bb73d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:26.813444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebb74051-5023-4e2f-abb6-0c8c260bb73d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:26.813906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ebb74051-5023-4e2f-abb6-0c8c260bb73d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:26.946039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ebb74051-5023-4e2f-abb6-0c8c260bb73d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:26.954616 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ebb74051-5023-4e2f-abb6-0c8c260bb73d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.154588 Aug 27 03:28:26.955212 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3352/6521] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:26 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:27.976212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-68a62954-a7f5-43f4-a967-e61b1d8e703d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:27.976876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-68a62954-a7f5-43f4-a967-e61b1d8e703d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:27.983712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68a62954-a7f5-43f4-a967-e61b1d8e703d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:27.984201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68a62954-a7f5-43f4-a967-e61b1d8e703d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:27.984654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68a62954-a7f5-43f4-a967-e61b1d8e703d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:27.985357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68a62954-a7f5-43f4-a967-e61b1d8e703d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:27.985858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68a62954-a7f5-43f4-a967-e61b1d8e703d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:27.986297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-68a62954-a7f5-43f4-a967-e61b1d8e703d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:28.135289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-68a62954-a7f5-43f4-a967-e61b1d8e703d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:28.143510 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-68a62954-a7f5-43f4-a967-e61b1d8e703d tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.171373 Aug 27 03:28:28.144122 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3170/6522] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:27 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:29.164582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bab01462-33de-4407-8509-3593dac8fd5a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:29.165790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bab01462-33de-4407-8509-3593dac8fd5a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:29.172655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab01462-33de-4407-8509-3593dac8fd5a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:29.173139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab01462-33de-4407-8509-3593dac8fd5a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:29.173583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab01462-33de-4407-8509-3593dac8fd5a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:29.174312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab01462-33de-4407-8509-3593dac8fd5a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:29.174776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab01462-33de-4407-8509-3593dac8fd5a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:29.175211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bab01462-33de-4407-8509-3593dac8fd5a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:29.311027 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bab01462-33de-4407-8509-3593dac8fd5a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:29.318850 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bab01462-33de-4407-8509-3593dac8fd5a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.158178 Aug 27 03:28:29.319429 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3353/6523] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:29 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:30.344075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-52b7c57c-90bd-4432-9948-c2ebd148c42f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:30.344714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-52b7c57c-90bd-4432-9948-c2ebd148c42f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:30.351595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52b7c57c-90bd-4432-9948-c2ebd148c42f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.352091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52b7c57c-90bd-4432-9948-c2ebd148c42f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.353031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52b7c57c-90bd-4432-9948-c2ebd148c42f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.353770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52b7c57c-90bd-4432-9948-c2ebd148c42f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:30.354249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52b7c57c-90bd-4432-9948-c2ebd148c42f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:30.354689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52b7c57c-90bd-4432-9948-c2ebd148c42f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:30.495899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-52b7c57c-90bd-4432-9948-c2ebd148c42f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:30.503641 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-52b7c57c-90bd-4432-9948-c2ebd148c42f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.163806 Aug 27 03:28:30.504237 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3171/6524] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:30 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:31.525320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9fadc8c0-a805-4a45-88db-58454ba54de0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:31.525923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9fadc8c0-a805-4a45-88db-58454ba54de0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:31.533154 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fadc8c0-a805-4a45-88db-58454ba54de0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.533645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fadc8c0-a805-4a45-88db-58454ba54de0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.534120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fadc8c0-a805-4a45-88db-58454ba54de0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.534819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fadc8c0-a805-4a45-88db-58454ba54de0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:31.535283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fadc8c0-a805-4a45-88db-58454ba54de0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:31.535717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fadc8c0-a805-4a45-88db-58454ba54de0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:31.665440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9fadc8c0-a805-4a45-88db-58454ba54de0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:31.673258 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9fadc8c0-a805-4a45-88db-58454ba54de0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.152587 Aug 27 03:28:31.673869 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3354/6525] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:31 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:32.694195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0c77c4de-cf47-40ef-91b3-ab7e02cf6c88 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:32.694816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0c77c4de-cf47-40ef-91b3-ab7e02cf6c88 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:32.702816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c77c4de-cf47-40ef-91b3-ab7e02cf6c88 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:32.703490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c77c4de-cf47-40ef-91b3-ab7e02cf6c88 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:32.704115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c77c4de-cf47-40ef-91b3-ab7e02cf6c88 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:32.705136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c77c4de-cf47-40ef-91b3-ab7e02cf6c88 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:32.705837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c77c4de-cf47-40ef-91b3-ab7e02cf6c88 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:32.706286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0c77c4de-cf47-40ef-91b3-ab7e02cf6c88 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:32.849241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0c77c4de-cf47-40ef-91b3-ab7e02cf6c88 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:32.858563 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0c77c4de-cf47-40ef-91b3-ab7e02cf6c88 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.168180 Aug 27 03:28:32.859149 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3172/6526] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:32 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:33.880393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f4f6dd6-edae-4fea-8ff1-6afadae82a6f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:33.880922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9f4f6dd6-edae-4fea-8ff1-6afadae82a6f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:33.888556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f4f6dd6-edae-4fea-8ff1-6afadae82a6f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:33.889036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f4f6dd6-edae-4fea-8ff1-6afadae82a6f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:33.889472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f4f6dd6-edae-4fea-8ff1-6afadae82a6f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:33.890184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f4f6dd6-edae-4fea-8ff1-6afadae82a6f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:33.890639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f4f6dd6-edae-4fea-8ff1-6afadae82a6f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:33.891089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f4f6dd6-edae-4fea-8ff1-6afadae82a6f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:34.025029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9f4f6dd6-edae-4fea-8ff1-6afadae82a6f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:34.032949 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9f4f6dd6-edae-4fea-8ff1-6afadae82a6f tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.156651 Aug 27 03:28:34.033527 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3355/6527] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:33 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:35.054133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fea03144-9f00-4eb4-99c3-92a9ef0e2f8b tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:35.054683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fea03144-9f00-4eb4-99c3-92a9ef0e2f8b tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:35.062861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fea03144-9f00-4eb4-99c3-92a9ef0e2f8b tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.063363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fea03144-9f00-4eb4-99c3-92a9ef0e2f8b tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.063817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fea03144-9f00-4eb4-99c3-92a9ef0e2f8b tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.064526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fea03144-9f00-4eb4-99c3-92a9ef0e2f8b tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:35.064998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fea03144-9f00-4eb4-99c3-92a9ef0e2f8b tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:35.065446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fea03144-9f00-4eb4-99c3-92a9ef0e2f8b tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:35.204117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fea03144-9f00-4eb4-99c3-92a9ef0e2f8b tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:35.212012 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fea03144-9f00-4eb4-99c3-92a9ef0e2f8b tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1516 microversion: 2.1 time: 0.161929 Aug 27 03:28:35.212602 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3173/6528] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:35 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:36.232774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d957f6f2-d97f-4153-91b2-9f9b206dae12 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:36.233308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d957f6f2-d97f-4153-91b2-9f9b206dae12 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:36.240699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d957f6f2-d97f-4153-91b2-9f9b206dae12 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.241090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d957f6f2-d97f-4153-91b2-9f9b206dae12 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.241542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d957f6f2-d97f-4153-91b2-9f9b206dae12 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.242278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d957f6f2-d97f-4153-91b2-9f9b206dae12 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.242743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d957f6f2-d97f-4153-91b2-9f9b206dae12 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.243179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d957f6f2-d97f-4153-91b2-9f9b206dae12 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.352605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-0611e684-40dc-46a3-a0ff-05450a761462 req-2101123b-107e-4922-af88-00a88eb58fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25758171-9841-437d-af84-31f7c8c26066", "name": "network-vif-unplugged", "status": "completed", "tag": "a872693e-ac33-4830-af07-e61eee2542c5"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:36.362296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0611e684-40dc-46a3-a0ff-05450a761462 req-2101123b-107e-4922-af88-00a88eb58fd3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:36.362790 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0611e684-40dc-46a3-a0ff-05450a761462 req-2101123b-107e-4922-af88-00a88eb58fd3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:36.363230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-0611e684-40dc-46a3-a0ff-05450a761462 req-2101123b-107e-4922-af88-00a88eb58fd3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:36.376852 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-0611e684-40dc-46a3-a0ff-05450a761462 req-2101123b-107e-4922-af88-00a88eb58fd3 service nova] Creating event network-vif-unplugged:a872693e-ac33-4830-af07-e61eee2542c5 for instance 25758171-9841-437d-af84-31f7c8c26066 on n-h1-852084-5 Aug 27 03:28:36.382771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d957f6f2-d97f-4153-91b2-9f9b206dae12 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:36.383321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-0611e684-40dc-46a3-a0ff-05450a761462 req-2101123b-107e-4922-af88-00a88eb58fd3 service nova] Instance 25758171-9841-437d-af84-31f7c8c26066 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:28:36.392624 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d957f6f2-d97f-4153-91b2-9f9b206dae12 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1515 microversion: 2.1 time: 0.163788 Aug 27 03:28:36.393605 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3356/6529] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:36 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:36.404772 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-0611e684-40dc-46a3-a0ff-05450a761462 req-2101123b-107e-4922-af88-00a88eb58fd3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056167 Aug 27 03:28:36.405709 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3174/6530] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:37.414776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-85f9a108-716f-4265-9e9f-12e4503a1ee8 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:37.416008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-85f9a108-716f-4265-9e9f-12e4503a1ee8 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:37.423132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f9a108-716f-4265-9e9f-12e4503a1ee8 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:37.423621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f9a108-716f-4265-9e9f-12e4503a1ee8 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:37.424066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f9a108-716f-4265-9e9f-12e4503a1ee8 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:37.424765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f9a108-716f-4265-9e9f-12e4503a1ee8 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:37.425223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f9a108-716f-4265-9e9f-12e4503a1ee8 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:37.425654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-85f9a108-716f-4265-9e9f-12e4503a1ee8 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:37.557579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-85f9a108-716f-4265-9e9f-12e4503a1ee8 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:37.565652 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-85f9a108-716f-4265-9e9f-12e4503a1ee8 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1513 microversion: 2.1 time: 0.154931 Aug 27 03:28:37.566978 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3357/6531] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:37 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:38.429846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c7da5288-d964-4279-974a-cb2315f9cfdd req-d00e57b6-2ded-46c4-9d31-4d5ef12b4ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25758171-9841-437d-af84-31f7c8c26066", "tag": "a872693e-ac33-4830-af07-e61eee2542c5"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:38.440049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7da5288-d964-4279-974a-cb2315f9cfdd req-d00e57b6-2ded-46c4-9d31-4d5ef12b4ced service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:38.440545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7da5288-d964-4279-974a-cb2315f9cfdd req-d00e57b6-2ded-46c4-9d31-4d5ef12b4ced service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:38.440999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c7da5288-d964-4279-974a-cb2315f9cfdd req-d00e57b6-2ded-46c4-9d31-4d5ef12b4ced service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.452504 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c7da5288-d964-4279-974a-cb2315f9cfdd req-d00e57b6-2ded-46c4-9d31-4d5ef12b4ced service nova] Creating event network-changed:a872693e-ac33-4830-af07-e61eee2542c5 for instance 25758171-9841-437d-af84-31f7c8c26066 on n-h1-852084-5 Aug 27 03:28:38.457734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-c7da5288-d964-4279-974a-cb2315f9cfdd req-d00e57b6-2ded-46c4-9d31-4d5ef12b4ced service nova] Instance 25758171-9841-437d-af84-31f7c8c26066 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:28:38.468821 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c7da5288-d964-4279-974a-cb2315f9cfdd req-d00e57b6-2ded-46c4-9d31-4d5ef12b4ced service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043945 Aug 27 03:28:38.469414 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3175/6532] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:38.588274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2b3f50a-3c4a-44db-af4f-31ee0ca3cdf0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:38.588902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2b3f50a-3c4a-44db-af4f-31ee0ca3cdf0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:38.601167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=28 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:38.605486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2b3f50a-3c4a-44db-af4f-31ee0ca3cdf0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:38.606290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2b3f50a-3c4a-44db-af4f-31ee0ca3cdf0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:38.606742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2b3f50a-3c4a-44db-af4f-31ee0ca3cdf0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.607669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2b3f50a-3c4a-44db-af4f-31ee0ca3cdf0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:38.608324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2b3f50a-3c4a-44db-af4f-31ee0ca3cdf0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:38.608934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2b3f50a-3c4a-44db-af4f-31ee0ca3cdf0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:38.613983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=84 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:38.776249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e2b3f50a-3c4a-44db-af4f-31ee0ca3cdf0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:38.786723 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2b3f50a-3c4a-44db-af4f-31ee0ca3cdf0 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1513 microversion: 2.1 time: 0.202583 Aug 27 03:28:38.800807 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3358/6533] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:38 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:39.810618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-873dc6c3-7bef-4d73-b4ef-50cb7636f574 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:39.811256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-873dc6c3-7bef-4d73-b4ef-50cb7636f574 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:39.813623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=28 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:39.819464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-873dc6c3-7bef-4d73-b4ef-50cb7636f574 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.819972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-873dc6c3-7bef-4d73-b4ef-50cb7636f574 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.820432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-873dc6c3-7bef-4d73-b4ef-50cb7636f574 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:39.821175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-873dc6c3-7bef-4d73-b4ef-50cb7636f574 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:39.821653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-873dc6c3-7bef-4d73-b4ef-50cb7636f574 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:39.822133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-873dc6c3-7bef-4d73-b4ef-50cb7636f574 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:39.827057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=80 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:40.035662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-873dc6c3-7bef-4d73-b4ef-50cb7636f574 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:40.044294 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-873dc6c3-7bef-4d73-b4ef-50cb7636f574 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1510 microversion: 2.1 time: 0.239375 Aug 27 03:28:40.045148 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3176/6534] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:39 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:40.069618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5f7ae5aa-a838-41a6-a05d-5fe0247dc7ac tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:40.070360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5f7ae5aa-a838-41a6-a05d-5fe0247dc7ac tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:40.078071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f7ae5aa-a838-41a6-a05d-5fe0247dc7ac tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:40.078593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f7ae5aa-a838-41a6-a05d-5fe0247dc7ac tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:40.079164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f7ae5aa-a838-41a6-a05d-5fe0247dc7ac tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:40.079948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f7ae5aa-a838-41a6-a05d-5fe0247dc7ac tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:40.080405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f7ae5aa-a838-41a6-a05d-5fe0247dc7ac tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:40.080853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5f7ae5aa-a838-41a6-a05d-5fe0247dc7ac tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:40.110030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5f7ae5aa-a838-41a6-a05d-5fe0247dc7ac tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:28:40.173959 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.compute.api [None req-5f7ae5aa-a838-41a6-a05d-5fe0247dc7ac tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Found an unconfirmed migration during delete, id: 16, status: finished Aug 27 03:28:40.809711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-00423180-98c9-45a6-b121-98574b9a9909 req-af54254c-0357-417f-b886-1ffed6ebcabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25758171-9841-437d-af84-31f7c8c26066", "name": "network-vif-plugged", "status": "completed", "tag": "a872693e-ac33-4830-af07-e61eee2542c5"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:40.821438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-00423180-98c9-45a6-b121-98574b9a9909 req-af54254c-0357-417f-b886-1ffed6ebcabd service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:40.822249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-00423180-98c9-45a6-b121-98574b9a9909 req-af54254c-0357-417f-b886-1ffed6ebcabd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:40.822549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-00423180-98c9-45a6-b121-98574b9a9909 req-af54254c-0357-417f-b886-1ffed6ebcabd service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:40.835953 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-00423180-98c9-45a6-b121-98574b9a9909 req-af54254c-0357-417f-b886-1ffed6ebcabd service nova] Creating event network-vif-plugged:a872693e-ac33-4830-af07-e61eee2542c5 for instance 25758171-9841-437d-af84-31f7c8c26066 on n-h1-852084-5 Aug 27 03:28:40.843759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-00423180-98c9-45a6-b121-98574b9a9909 req-af54254c-0357-417f-b886-1ffed6ebcabd service nova] Instance 25758171-9841-437d-af84-31f7c8c26066 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:28:40.858758 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-00423180-98c9-45a6-b121-98574b9a9909 req-af54254c-0357-417f-b886-1ffed6ebcabd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051799 Aug 27 03:28:40.861239 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3177/6535] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:28:41.768485 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5f7ae5aa-a838-41a6-a05d-5fe0247dc7ac tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "DELETE /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 204 len: 0 microversion: 2.1 time: 1.702370 Aug 27 03:28:41.769171 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3359/6536] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:28:40 2022] DELETE /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 0 bytes in 1708 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:28:41.778800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d3fe57ae-7df7-4fa3-bd86-46ed33a31fad tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:41.779553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d3fe57ae-7df7-4fa3-bd86-46ed33a31fad tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:41.786511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3fe57ae-7df7-4fa3-bd86-46ed33a31fad tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.787005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3fe57ae-7df7-4fa3-bd86-46ed33a31fad tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.787458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3fe57ae-7df7-4fa3-bd86-46ed33a31fad tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.788173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3fe57ae-7df7-4fa3-bd86-46ed33a31fad tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:41.788647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3fe57ae-7df7-4fa3-bd86-46ed33a31fad tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:41.789086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d3fe57ae-7df7-4fa3-bd86-46ed33a31fad tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:41.925060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d3fe57ae-7df7-4fa3-bd86-46ed33a31fad tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:41.933399 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d3fe57ae-7df7-4fa3-bd86-46ed33a31fad tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1502 microversion: 2.1 time: 0.159410 Aug 27 03:28:41.934026 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3178/6537] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:41 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:42.957112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d5b4a42-27aa-40e1-b0ff-e7d9fe03a894 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:42.957774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9d5b4a42-27aa-40e1-b0ff-e7d9fe03a894 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:42.964918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5b4a42-27aa-40e1-b0ff-e7d9fe03a894 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.965404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5b4a42-27aa-40e1-b0ff-e7d9fe03a894 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.965879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5b4a42-27aa-40e1-b0ff-e7d9fe03a894 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:42.966593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5b4a42-27aa-40e1-b0ff-e7d9fe03a894 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:42.967311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5b4a42-27aa-40e1-b0ff-e7d9fe03a894 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:42.967746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d5b4a42-27aa-40e1-b0ff-e7d9fe03a894 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:43.103770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9d5b4a42-27aa-40e1-b0ff-e7d9fe03a894 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51cbbafdfeb641f2ab8522ef7de3b74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b6f786870be488197b2810c8ce5460d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:43.111975 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9d5b4a42-27aa-40e1-b0ff-e7d9fe03a894 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 200 len: 1502 microversion: 2.1 time: 0.159254 Aug 27 03:28:43.112582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3360/6538] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:42 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:43.726685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7fc0f390-be14-491f-80e6-8576a061a9f2 req-4f9e0832-c918-4643-a080-b16520339653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25758171-9841-437d-af84-31f7c8c26066", "name": "network-vif-deleted", "tag": "a872693e-ac33-4830-af07-e61eee2542c5"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:43.738507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7fc0f390-be14-491f-80e6-8576a061a9f2 req-4f9e0832-c918-4643-a080-b16520339653 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:43.739188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7fc0f390-be14-491f-80e6-8576a061a9f2 req-4f9e0832-c918-4643-a080-b16520339653 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:43.739732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7fc0f390-be14-491f-80e6-8576a061a9f2 req-4f9e0832-c918-4643-a080-b16520339653 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:43.766486 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7fc0f390-be14-491f-80e6-8576a061a9f2 req-4f9e0832-c918-4643-a080-b16520339653 service nova] Creating event network-vif-deleted:a872693e-ac33-4830-af07-e61eee2542c5 for instance 25758171-9841-437d-af84-31f7c8c26066 on n-h1-852084-5 Aug 27 03:28:43.771950 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7fc0f390-be14-491f-80e6-8576a061a9f2 req-4f9e0832-c918-4643-a080-b16520339653 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049308 Aug 27 03:28:43.772958 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3179/6539] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:44.134364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:44.134974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:44.142153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.142654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.143104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.143825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.144289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.144723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.159613 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] HTTP exception thrown: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Request method failure captured: Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 HTTP/1.1 Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY88OyhwVUJpESleerPfoJ7tfPmW_rfztjNFKk45MSvpTDw2ufFQ4TBnbX36tq8abJmI6jpH4yS7jQp7UAu5jo6_nwZxjw-YPHFXMseMP-WAH5KdxN5szmuaJieafaLov2ycexBkGiAOQPiGe9wlblPH_i8Qaomh3ZruNPoxuoMqVCk Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 8b6f786870be488197b2810c8ce5460d Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-DeleteServersTestJSON-1636106089 Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8b6f786870be488197b2810c8ce5460d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8b6f786870be488197b2810c8ce5460d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8b6f786870be488197b2810c8ce5460d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8b6f786870be488197b2810c8ce5460d"}]}] Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-DeleteServersTestJSON-1636106089 Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 8b6f786870be488197b2810c8ce5460d Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1636106089 Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-DeleteServersTestJSON-1636106089-project Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 51cbbafdfeb641f2ab8522ef7de3b74a Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-DeleteServersTestJSON-1636106089-project Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '25758171-9841-437d-af84-31f7c8c26066'} Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:44.161318 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.165817 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:44.165817 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:44.165817 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:44.165817 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:28:44.165817 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:28:44.165817 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.165817 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.165817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Returning 404 to user: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:28:44.165817 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-caf73e70-0664-4572-86a8-6fb68e1da877 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 404 len: 111 microversion: 2.1 time: 0.033065 Aug 27 03:28:44.165817 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3361/6540] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:44 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:28:44.179634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:44.180712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:44.187221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.187724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.188184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.188909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.189410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.189886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.204787 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] HTTP exception thrown: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Request method failure captured: Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 HTTP/1.1 Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY88OyhwVUJpESleerPfoJ7tfPmW_rfztjNFKk45MSvpTDw2ufFQ4TBnbX36tq8abJmI6jpH4yS7jQp7UAu5jo6_nwZxjw-YPHFXMseMP-WAH5KdxN5szmuaJieafaLov2ycexBkGiAOQPiGe9wlblPH_i8Qaomh3ZruNPoxuoMqVCk Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 8b6f786870be488197b2810c8ce5460d Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-DeleteServersTestJSON-1636106089 Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8b6f786870be488197b2810c8ce5460d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8b6f786870be488197b2810c8ce5460d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8b6f786870be488197b2810c8ce5460d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8b6f786870be488197b2810c8ce5460d"}]}] Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-DeleteServersTestJSON-1636106089 Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 8b6f786870be488197b2810c8ce5460d Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-DeleteServersTestJSON-1636106089 Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-DeleteServersTestJSON-1636106089-project Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 51cbbafdfeb641f2ab8522ef7de3b74a Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-DeleteServersTestJSON-1636106089-project Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '25758171-9841-437d-af84-31f7c8c26066'} Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:28:44.206556 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Returning 404 to user: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:28:44.210358 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e42bac39-037c-4e61-8fad-e88780f3879a tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "DELETE /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 404 len: 111 microversion: 2.1 time: 0.032885 Aug 27 03:28:44.211529 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3180/6541] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:28:44 2022] DELETE /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:28:44.217696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:44.218363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] [instance: 25758171-9841-437d-af84-31f7c8c26066] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:44.224643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.225135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.225575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.226312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:44.226773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:44.227728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:44.242516 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] HTTP exception thrown: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Request method failure captured: Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 HTTP/1.1 Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY88OyhwVUJpESleerPfoJ7tfPmW_rfztjNFKk45MSvpTDw2ufFQ4TBnbX36tq8abJmI6jpH4yS7jQp7UAu5jo6_nwZxjw-YPHFXMseMP-WAH5KdxN5szmuaJieafaLov2ycexBkGiAOQPiGe9wlblPH_i8Qaomh3ZruNPoxuoMqVCk Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 8b6f786870be488197b2810c8ce5460d Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-DeleteServersTestJSON-1636106089 Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8b6f786870be488197b2810c8ce5460d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8b6f786870be488197b2810c8ce5460d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8b6f786870be488197b2810c8ce5460d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8b6f786870be488197b2810c8ce5460d"}]}] Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-DeleteServersTestJSON-1636106089 Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 8b6f786870be488197b2810c8ce5460d Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-DeleteServersTestJSON-1636106089 Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-DeleteServersTestJSON-1636106089-project Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 51cbbafdfeb641f2ab8522ef7de3b74a Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-DeleteServersTestJSON-1636106089-project Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '25758171-9841-437d-af84-31f7c8c26066'} Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:28:44.244734 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.249072 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:28:44.249072 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:28:44.249072 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:28:44.249072 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:28:44.249072 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:28:44.249072 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. Aug 27 03:28:44.249072 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:28:44.249072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] Returning 404 to user: Instance 25758171-9841-437d-af84-31f7c8c26066 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:28:44.249072 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5844f641-9ac7-4c31-9217-a2d2f3818a78 tempest-DeleteServersTestJSON-1636106089 tempest-DeleteServersTestJSON-1636106089-project] 10.222.0.99 "GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066" status: 404 len: 111 microversion: 2.1 time: 0.033391 Aug 27 03:28:44.249072 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3362/6542] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:44 2022] GET /compute/v2.1/servers/25758171-9841-437d-af84-31f7c8c26066 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:28:54.185500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=9 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:54.195864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=19 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:54.267987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-552098086", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "acfbb253-e83f-4383-bbb1-e91fcd4d1552"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:54.339773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] validate_networks() for [('acfbb253-e83f-4383-bbb1-e91fcd4d1552', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:28:54.792597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:28:54.793143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:28:54.793797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:28:54.794541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:28:54.795325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:28:54.816080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.817346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.818020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.819437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:54.819933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:54.820379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:54.850182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Getting quotas for project ed2175dca31a4e8a8cefe5108d1c6160. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:28:54.856886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Getting quotas for user 818395e689094ddc92a40d45e4b82796 and project ed2175dca31a4e8a8cefe5108d1c6160. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:28:54.872028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:28:54.875377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:28:54.938484 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1ec88e88-5e2b-4663-b462-225942c62623 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836457 Aug 27 03:28:54.950028 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3181/6543] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:28:54.970828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cad0d109-14ba-41ca-98cf-4701c3a9c4e9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:54.973185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cad0d109-14ba-41ca-98cf-4701c3a9c4e9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:54.988030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:54.988798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:28:55.057285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cad0d109-14ba-41ca-98cf-4701c3a9c4e9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:55.065548 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cad0d109-14ba-41ca-98cf-4701c3a9c4e9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1217 microversion: 2.1 time: 0.111854 Aug 27 03:28:55.074265 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3363/6544] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:54 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:56.091171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bcf2eddf-2246-441a-be2a-f3c47c1c2175 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:56.093389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bcf2eddf-2246-441a-be2a-f3c47c1c2175 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:56.101797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf2eddf-2246-441a-be2a-f3c47c1c2175 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.103107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf2eddf-2246-441a-be2a-f3c47c1c2175 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.103823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf2eddf-2246-441a-be2a-f3c47c1c2175 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.105060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf2eddf-2246-441a-be2a-f3c47c1c2175 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:56.105953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf2eddf-2246-441a-be2a-f3c47c1c2175 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:56.106746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcf2eddf-2246-441a-be2a-f3c47c1c2175 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:56.217752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bcf2eddf-2246-441a-be2a-f3c47c1c2175 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:56.235364 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bcf2eddf-2246-441a-be2a-f3c47c1c2175 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1269 microversion: 2.1 time: 0.152490 Aug 27 03:28:56.236498 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3182/6545] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:56 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:28:57.264574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a9c19179-06cc-46bc-af0c-078bcfaa2a06 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:57.265375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a9c19179-06cc-46bc-af0c-078bcfaa2a06 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:57.276889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9c19179-06cc-46bc-af0c-078bcfaa2a06 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.277397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9c19179-06cc-46bc-af0c-078bcfaa2a06 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.277880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9c19179-06cc-46bc-af0c-078bcfaa2a06 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.278618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9c19179-06cc-46bc-af0c-078bcfaa2a06 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:57.279094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9c19179-06cc-46bc-af0c-078bcfaa2a06 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:57.279535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9c19179-06cc-46bc-af0c-078bcfaa2a06 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:57.455372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a9c19179-06cc-46bc-af0c-078bcfaa2a06 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:57.471347 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a9c19179-06cc-46bc-af0c-078bcfaa2a06 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1317 microversion: 2.1 time: 0.216265 Aug 27 03:28:57.472302 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3364/6546] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:57 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:28:58.068558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-52d6120a-cae7-4a50-a92b-c596e07c21c7 req-0c5dcffc-2b47-45ce-a6cf-28daccf7a975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28951939-64cf-4b9c-bb90-6e90ab8cff43", "tag": "79924175-b01d-4f87-a897-424185a7dc09"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:28:58.094053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-52d6120a-cae7-4a50-a92b-c596e07c21c7 req-0c5dcffc-2b47-45ce-a6cf-28daccf7a975 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:58.095153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-52d6120a-cae7-4a50-a92b-c596e07c21c7 req-0c5dcffc-2b47-45ce-a6cf-28daccf7a975 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:58.095782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-52d6120a-cae7-4a50-a92b-c596e07c21c7 req-0c5dcffc-2b47-45ce-a6cf-28daccf7a975 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:58.110834 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-52d6120a-cae7-4a50-a92b-c596e07c21c7 req-0c5dcffc-2b47-45ce-a6cf-28daccf7a975 service nova] Creating event network-changed:79924175-b01d-4f87-a897-424185a7dc09 for instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 on n-h1-852084-5 Aug 27 03:28:58.118838 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-52d6120a-cae7-4a50-a92b-c596e07c21c7 req-0c5dcffc-2b47-45ce-a6cf-28daccf7a975 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058780 Aug 27 03:28:58.119825 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3183/6547] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:28:58.494998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ea8103ca-0cb9-4e1f-8a53-8e84450fd817 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:28:58.495856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ea8103ca-0cb9-4e1f-8a53-8e84450fd817 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:28:58.503453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea8103ca-0cb9-4e1f-8a53-8e84450fd817 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:58.503844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea8103ca-0cb9-4e1f-8a53-8e84450fd817 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:58.504297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea8103ca-0cb9-4e1f-8a53-8e84450fd817 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:58.505050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea8103ca-0cb9-4e1f-8a53-8e84450fd817 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:28:58.505536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea8103ca-0cb9-4e1f-8a53-8e84450fd817 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:28:58.506019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ea8103ca-0cb9-4e1f-8a53-8e84450fd817 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:28:59.045695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ea8103ca-0cb9-4e1f-8a53-8e84450fd817 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:28:59.054224 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ea8103ca-0cb9-4e1f-8a53-8e84450fd817 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1317 microversion: 2.1 time: 0.563916 Aug 27 03:28:59.054834 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3365/6548] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:28:58 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:00.076712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b2473a80-67ff-4eec-ad77-ae73d9901812 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:00.077524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b2473a80-67ff-4eec-ad77-ae73d9901812 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:00.084309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2473a80-67ff-4eec-ad77-ae73d9901812 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:00.084811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2473a80-67ff-4eec-ad77-ae73d9901812 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:00.085266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2473a80-67ff-4eec-ad77-ae73d9901812 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:00.086009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2473a80-67ff-4eec-ad77-ae73d9901812 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:00.086471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2473a80-67ff-4eec-ad77-ae73d9901812 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:00.086916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b2473a80-67ff-4eec-ad77-ae73d9901812 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:00.296010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b2473a80-67ff-4eec-ad77-ae73d9901812 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:00.304127 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b2473a80-67ff-4eec-ad77-ae73d9901812 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1317 microversion: 2.1 time: 0.233328 Aug 27 03:29:00.304827 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3184/6549] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:00 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:01.326737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bf5e99e8-3183-4a02-aa37-ae3bd6155b8b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:01.327483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bf5e99e8-3183-4a02-aa37-ae3bd6155b8b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:01.335292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5e99e8-3183-4a02-aa37-ae3bd6155b8b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:01.335916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5e99e8-3183-4a02-aa37-ae3bd6155b8b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:01.336363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5e99e8-3183-4a02-aa37-ae3bd6155b8b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:01.337084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5e99e8-3183-4a02-aa37-ae3bd6155b8b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:01.337543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5e99e8-3183-4a02-aa37-ae3bd6155b8b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:01.338017 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf5e99e8-3183-4a02-aa37-ae3bd6155b8b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:01.483866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bf5e99e8-3183-4a02-aa37-ae3bd6155b8b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:01.491594 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bf5e99e8-3183-4a02-aa37-ae3bd6155b8b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1317 microversion: 2.1 time: 0.168913 Aug 27 03:29:01.492853 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3366/6550] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:01 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:02.513225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd7db520-72f6-4855-ad39-4bfdfeb0da89 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:02.513875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bd7db520-72f6-4855-ad39-4bfdfeb0da89 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:02.520915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd7db520-72f6-4855-ad39-4bfdfeb0da89 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:02.521411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd7db520-72f6-4855-ad39-4bfdfeb0da89 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:02.521892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd7db520-72f6-4855-ad39-4bfdfeb0da89 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:02.522615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd7db520-72f6-4855-ad39-4bfdfeb0da89 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:02.523079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd7db520-72f6-4855-ad39-4bfdfeb0da89 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:02.524081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd7db520-72f6-4855-ad39-4bfdfeb0da89 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:02.666203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd7db520-72f6-4855-ad39-4bfdfeb0da89 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:02.674089 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd7db520-72f6-4855-ad39-4bfdfeb0da89 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1317 microversion: 2.1 time: 0.164681 Aug 27 03:29:02.674678 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3185/6551] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:02 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:02.890948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2b741cf5-7804-430c-9c0a-72c6645f8bc2 req-e1ef8827-f3e5-4862-b0bd-6c242241f3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28951939-64cf-4b9c-bb90-6e90ab8cff43", "name": "network-vif-plugged", "status": "completed", "tag": "79924175-b01d-4f87-a897-424185a7dc09"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:02.901263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b741cf5-7804-430c-9c0a-72c6645f8bc2 req-e1ef8827-f3e5-4862-b0bd-6c242241f3c8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:02.901816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b741cf5-7804-430c-9c0a-72c6645f8bc2 req-e1ef8827-f3e5-4862-b0bd-6c242241f3c8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:02.902244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b741cf5-7804-430c-9c0a-72c6645f8bc2 req-e1ef8827-f3e5-4862-b0bd-6c242241f3c8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:02.914295 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2b741cf5-7804-430c-9c0a-72c6645f8bc2 req-e1ef8827-f3e5-4862-b0bd-6c242241f3c8 service nova] Creating event network-vif-plugged:79924175-b01d-4f87-a897-424185a7dc09 for instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 on n-h1-852084-5 Aug 27 03:29:02.919200 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2b741cf5-7804-430c-9c0a-72c6645f8bc2 req-e1ef8827-f3e5-4862-b0bd-6c242241f3c8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032018 Aug 27 03:29:02.919805 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3367/6552] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:03.697232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9167cd83-81ce-4e85-8b51-d93957922ecc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:03.697943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9167cd83-81ce-4e85-8b51-d93957922ecc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:03.705360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9167cd83-81ce-4e85-8b51-d93957922ecc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.706020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9167cd83-81ce-4e85-8b51-d93957922ecc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.706603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9167cd83-81ce-4e85-8b51-d93957922ecc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.707317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9167cd83-81ce-4e85-8b51-d93957922ecc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:03.707881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9167cd83-81ce-4e85-8b51-d93957922ecc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:03.708384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9167cd83-81ce-4e85-8b51-d93957922ecc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:03.853418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9167cd83-81ce-4e85-8b51-d93957922ecc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:03.861155 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9167cd83-81ce-4e85-8b51-d93957922ecc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1317 microversion: 2.1 time: 0.168542 Aug 27 03:29:03.861749 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3186/6553] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:03 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:04.884332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5d0406fe-d9be-4758-be3d-9b279ee7327e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:04.885054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5d0406fe-d9be-4758-be3d-9b279ee7327e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:04.891761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d0406fe-d9be-4758-be3d-9b279ee7327e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:04.892252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d0406fe-d9be-4758-be3d-9b279ee7327e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:04.892735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d0406fe-d9be-4758-be3d-9b279ee7327e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:04.893441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d0406fe-d9be-4758-be3d-9b279ee7327e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:04.893944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d0406fe-d9be-4758-be3d-9b279ee7327e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:04.894374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5d0406fe-d9be-4758-be3d-9b279ee7327e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.043710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5d0406fe-d9be-4758-be3d-9b279ee7327e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:05.051653 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5d0406fe-d9be-4758-be3d-9b279ee7327e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1506 microversion: 2.1 time: 0.173088 Aug 27 03:29:05.052234 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3368/6554] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:04 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:05.073533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-451d8674-c456-469f-b32f-351eabd698d1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:05.074181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-451d8674-c456-469f-b32f-351eabd698d1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:05.077002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:05.077705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:05.083417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-451d8674-c456-469f-b32f-351eabd698d1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.083915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-451d8674-c456-469f-b32f-351eabd698d1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.084365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-451d8674-c456-469f-b32f-351eabd698d1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.085079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-451d8674-c456-469f-b32f-351eabd698d1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.085552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-451d8674-c456-469f-b32f-351eabd698d1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.086043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-451d8674-c456-469f-b32f-351eabd698d1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.226043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-451d8674-c456-469f-b32f-351eabd698d1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:05.235187 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-451d8674-c456-469f-b32f-351eabd698d1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1506 microversion: 2.1 time: 0.166088 Aug 27 03:29:05.235772 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3187/6555] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:05 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:05.255375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4bb46a9b-d7eb-439d-b3d0-51cf475ad8f0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:05.258162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4bb46a9b-d7eb-439d-b3d0-51cf475ad8f0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:05.260133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:05.265659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb46a9b-d7eb-439d-b3d0-51cf475ad8f0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.266173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb46a9b-d7eb-439d-b3d0-51cf475ad8f0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.266622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb46a9b-d7eb-439d-b3d0-51cf475ad8f0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.267319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb46a9b-d7eb-439d-b3d0-51cf475ad8f0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.267787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb46a9b-d7eb-439d-b3d0-51cf475ad8f0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.268218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4bb46a9b-d7eb-439d-b3d0-51cf475ad8f0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.337827 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4bb46a9b-d7eb-439d-b3d0-51cf475ad8f0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "PUT /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1078 microversion: 2.1 time: 0.086326 Aug 27 03:29:05.338491 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3369/6556] 10.222.0.99 () {60 vars in 1256 bytes} [Sat Aug 27 03:29:05 2022] PUT /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1078 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:05.356084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-35524cda-296b-4a94-9857-b79082218df9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:05.356750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-35524cda-296b-4a94-9857-b79082218df9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:05.362933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35524cda-296b-4a94-9857-b79082218df9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.363434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35524cda-296b-4a94-9857-b79082218df9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.363893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35524cda-296b-4a94-9857-b79082218df9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.364609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35524cda-296b-4a94-9857-b79082218df9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.365084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35524cda-296b-4a94-9857-b79082218df9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.365529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-35524cda-296b-4a94-9857-b79082218df9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.505942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-35524cda-296b-4a94-9857-b79082218df9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:05.514127 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-35524cda-296b-4a94-9857-b79082218df9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1504 microversion: 2.1 time: 0.161967 Aug 27 03:29:05.514707 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3188/6557] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:05 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:05.534433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-113bd7e7-a07e-4e64-8a2d-880347e07205 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:05.535057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-113bd7e7-a07e-4e64-8a2d-880347e07205 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:05.541055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-113bd7e7-a07e-4e64-8a2d-880347e07205 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.541541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-113bd7e7-a07e-4e64-8a2d-880347e07205 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.542019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-113bd7e7-a07e-4e64-8a2d-880347e07205 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.542722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-113bd7e7-a07e-4e64-8a2d-880347e07205 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.543177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-113bd7e7-a07e-4e64-8a2d-880347e07205 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.543608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-113bd7e7-a07e-4e64-8a2d-880347e07205 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.674664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-113bd7e7-a07e-4e64-8a2d-880347e07205 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:05.683167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-113bd7e7-a07e-4e64-8a2d-880347e07205 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1504 microversion: 2.1 time: 0.152617 Aug 27 03:29:05.683749 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3370/6558] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:05 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:05.704150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:05.707366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:05.713800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.714384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.714794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.715548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.716025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.716464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.751649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:05.758395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Old instance type m1.heat2, new instance type m1.heat {{(pid=122487) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:29:05.764854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:05.765295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:05.765818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:05.766249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:05.766678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:05.829756 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f71e3996-52e4-4b00-9752-cb213cc3c35b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "POST /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43/action" status: 202 len: 0 microversion: 2.1 time: 0.129132 Aug 27 03:29:05.830389 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3189/6559] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:05 2022] POST /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:29:05.839164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d2619f6-ce7d-481d-8398-4668fc267d17 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:05.839789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9d2619f6-ce7d-481d-8398-4668fc267d17 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:05.846761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d2619f6-ce7d-481d-8398-4668fc267d17 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.847441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d2619f6-ce7d-481d-8398-4668fc267d17 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.848048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d2619f6-ce7d-481d-8398-4668fc267d17 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:05.848882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d2619f6-ce7d-481d-8398-4668fc267d17 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:05.849408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d2619f6-ce7d-481d-8398-4668fc267d17 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:05.850037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d2619f6-ce7d-481d-8398-4668fc267d17 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:06.011902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9d2619f6-ce7d-481d-8398-4668fc267d17 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:06.019996 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9d2619f6-ce7d-481d-8398-4668fc267d17 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1515 microversion: 2.1 time: 0.184838 Aug 27 03:29:06.020635 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3371/6560] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:05 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:07.043013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fc10ec4a-cc13-411f-9758-809f4d30ab7c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:07.043951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fc10ec4a-cc13-411f-9758-809f4d30ab7c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:07.052150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc10ec4a-cc13-411f-9758-809f4d30ab7c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.052837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc10ec4a-cc13-411f-9758-809f4d30ab7c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.053486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc10ec4a-cc13-411f-9758-809f4d30ab7c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:07.054557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc10ec4a-cc13-411f-9758-809f4d30ab7c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:07.055035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc10ec4a-cc13-411f-9758-809f4d30ab7c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:07.055479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc10ec4a-cc13-411f-9758-809f4d30ab7c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:07.269691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fc10ec4a-cc13-411f-9758-809f4d30ab7c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:07.277582 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fc10ec4a-cc13-411f-9758-809f4d30ab7c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1515 microversion: 2.1 time: 0.239733 Aug 27 03:29:07.278192 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3190/6561] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:07 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:08.299681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-063c96a9-d9c7-49cd-85d8-cf88981955d6 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:08.300225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-063c96a9-d9c7-49cd-85d8-cf88981955d6 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:08.307641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063c96a9-d9c7-49cd-85d8-cf88981955d6 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:08.308135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063c96a9-d9c7-49cd-85d8-cf88981955d6 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:08.308581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063c96a9-d9c7-49cd-85d8-cf88981955d6 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:08.309291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063c96a9-d9c7-49cd-85d8-cf88981955d6 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:08.309795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063c96a9-d9c7-49cd-85d8-cf88981955d6 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:08.310232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-063c96a9-d9c7-49cd-85d8-cf88981955d6 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:08.453000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-063c96a9-d9c7-49cd-85d8-cf88981955d6 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:08.461759 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-063c96a9-d9c7-49cd-85d8-cf88981955d6 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.166055 Aug 27 03:29:08.462433 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3372/6562] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:08 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:09.484246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dbd18646-4e5e-4a20-9fc3-c4c32b24d61a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:09.484880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dbd18646-4e5e-4a20-9fc3-c4c32b24d61a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:09.492207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbd18646-4e5e-4a20-9fc3-c4c32b24d61a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:09.492719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbd18646-4e5e-4a20-9fc3-c4c32b24d61a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:09.493178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbd18646-4e5e-4a20-9fc3-c4c32b24d61a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:09.493957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbd18646-4e5e-4a20-9fc3-c4c32b24d61a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:09.494429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbd18646-4e5e-4a20-9fc3-c4c32b24d61a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:09.494882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbd18646-4e5e-4a20-9fc3-c4c32b24d61a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:09.635581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dbd18646-4e5e-4a20-9fc3-c4c32b24d61a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:09.644277 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dbd18646-4e5e-4a20-9fc3-c4c32b24d61a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.164207 Aug 27 03:29:09.644798 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3191/6563] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:09 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:10.669483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dcf464bf-443e-4b5d-a73c-671c2654258c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:10.670064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dcf464bf-443e-4b5d-a73c-671c2654258c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:10.676892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcf464bf-443e-4b5d-a73c-671c2654258c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:10.677377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcf464bf-443e-4b5d-a73c-671c2654258c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:10.677854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcf464bf-443e-4b5d-a73c-671c2654258c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:10.678559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcf464bf-443e-4b5d-a73c-671c2654258c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:10.679016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcf464bf-443e-4b5d-a73c-671c2654258c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:10.679535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcf464bf-443e-4b5d-a73c-671c2654258c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:10.812432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dcf464bf-443e-4b5d-a73c-671c2654258c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:10.821942 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dcf464bf-443e-4b5d-a73c-671c2654258c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.156404 Aug 27 03:29:10.822548 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3373/6564] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:10 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:11.844864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5e313cce-088a-49ae-9613-51fd01e84bd2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:11.845400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5e313cce-088a-49ae-9613-51fd01e84bd2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:11.852944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e313cce-088a-49ae-9613-51fd01e84bd2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:11.853495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e313cce-088a-49ae-9613-51fd01e84bd2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:11.853929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e313cce-088a-49ae-9613-51fd01e84bd2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:11.854669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e313cce-088a-49ae-9613-51fd01e84bd2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:11.855148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e313cce-088a-49ae-9613-51fd01e84bd2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:11.855593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5e313cce-088a-49ae-9613-51fd01e84bd2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:11.989691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5e313cce-088a-49ae-9613-51fd01e84bd2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:11.999730 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5e313cce-088a-49ae-9613-51fd01e84bd2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.158823 Aug 27 03:29:12.000339 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3192/6565] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:11 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:13.022264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50c428be-da71-4f69-bbd4-2e8f513fe0a3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:13.022781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-50c428be-da71-4f69-bbd4-2e8f513fe0a3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:13.029701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50c428be-da71-4f69-bbd4-2e8f513fe0a3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.030195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50c428be-da71-4f69-bbd4-2e8f513fe0a3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.030646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50c428be-da71-4f69-bbd4-2e8f513fe0a3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.031345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50c428be-da71-4f69-bbd4-2e8f513fe0a3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:13.031807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50c428be-da71-4f69-bbd4-2e8f513fe0a3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:13.032239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50c428be-da71-4f69-bbd4-2e8f513fe0a3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:13.163275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-50c428be-da71-4f69-bbd4-2e8f513fe0a3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:13.171796 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-50c428be-da71-4f69-bbd4-2e8f513fe0a3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.153929 Aug 27 03:29:13.172666 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3374/6566] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:13 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:14.192348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2e73cddf-bbed-4eaf-b74d-3c8339660088 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:14.193019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2e73cddf-bbed-4eaf-b74d-3c8339660088 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:14.200491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e73cddf-bbed-4eaf-b74d-3c8339660088 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:14.200996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e73cddf-bbed-4eaf-b74d-3c8339660088 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:14.201453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e73cddf-bbed-4eaf-b74d-3c8339660088 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:14.202192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e73cddf-bbed-4eaf-b74d-3c8339660088 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:14.202667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e73cddf-bbed-4eaf-b74d-3c8339660088 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:14.203147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2e73cddf-bbed-4eaf-b74d-3c8339660088 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:14.332761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2e73cddf-bbed-4eaf-b74d-3c8339660088 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:14.340860 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2e73cddf-bbed-4eaf-b74d-3c8339660088 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.152432 Aug 27 03:29:14.341452 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3193/6567] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:14 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:15.362862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bbc0267c-b7b7-4c08-843f-7b16358e2c4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:15.363483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bbc0267c-b7b7-4c08-843f-7b16358e2c4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:15.371267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc0267c-b7b7-4c08-843f-7b16358e2c4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:15.371758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc0267c-b7b7-4c08-843f-7b16358e2c4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:15.372208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc0267c-b7b7-4c08-843f-7b16358e2c4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:15.372921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc0267c-b7b7-4c08-843f-7b16358e2c4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:15.373375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc0267c-b7b7-4c08-843f-7b16358e2c4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:15.373841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bbc0267c-b7b7-4c08-843f-7b16358e2c4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:15.508129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bbc0267c-b7b7-4c08-843f-7b16358e2c4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:15.516705 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bbc0267c-b7b7-4c08-843f-7b16358e2c4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.157764 Aug 27 03:29:15.517285 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3375/6568] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:15 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:16.537728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-00196063-f1ba-4c58-bc0e-0c3b712342a4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:16.538395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-00196063-f1ba-4c58-bc0e-0c3b712342a4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:16.545514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00196063-f1ba-4c58-bc0e-0c3b712342a4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:16.546041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00196063-f1ba-4c58-bc0e-0c3b712342a4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:16.546500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00196063-f1ba-4c58-bc0e-0c3b712342a4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:16.547210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00196063-f1ba-4c58-bc0e-0c3b712342a4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:16.547680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00196063-f1ba-4c58-bc0e-0c3b712342a4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:16.548124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00196063-f1ba-4c58-bc0e-0c3b712342a4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:16.685445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-00196063-f1ba-4c58-bc0e-0c3b712342a4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:16.693709 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-00196063-f1ba-4c58-bc0e-0c3b712342a4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.159849 Aug 27 03:29:16.694308 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3194/6569] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:16 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:17.716089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-40ac1bad-602c-44dc-b49d-79d01323f88f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:17.716688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-40ac1bad-602c-44dc-b49d-79d01323f88f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:17.724588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40ac1bad-602c-44dc-b49d-79d01323f88f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.725122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40ac1bad-602c-44dc-b49d-79d01323f88f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.725534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40ac1bad-602c-44dc-b49d-79d01323f88f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.726288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40ac1bad-602c-44dc-b49d-79d01323f88f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:17.726749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40ac1bad-602c-44dc-b49d-79d01323f88f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:17.727182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-40ac1bad-602c-44dc-b49d-79d01323f88f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:17.863099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-40ac1bad-602c-44dc-b49d-79d01323f88f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:17.871615 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-40ac1bad-602c-44dc-b49d-79d01323f88f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.159612 Aug 27 03:29:17.872201 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3376/6570] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:17 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:18.892556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ff15125c-def2-4ba3-a091-42aa454f254f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:18.893188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ff15125c-def2-4ba3-a091-42aa454f254f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:18.900154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff15125c-def2-4ba3-a091-42aa454f254f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:18.901297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff15125c-def2-4ba3-a091-42aa454f254f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:18.901776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff15125c-def2-4ba3-a091-42aa454f254f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:18.902482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff15125c-def2-4ba3-a091-42aa454f254f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:18.902950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff15125c-def2-4ba3-a091-42aa454f254f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:18.903396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ff15125c-def2-4ba3-a091-42aa454f254f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:19.031632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ff15125c-def2-4ba3-a091-42aa454f254f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:19.039461 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ff15125c-def2-4ba3-a091-42aa454f254f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.150886 Aug 27 03:29:19.040041 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3195/6571] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:18 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:20.060651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6d66e820-19f7-482b-bbd9-25987a08d5fd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:20.061273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6d66e820-19f7-482b-bbd9-25987a08d5fd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:20.068345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d66e820-19f7-482b-bbd9-25987a08d5fd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.068793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d66e820-19f7-482b-bbd9-25987a08d5fd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.069231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d66e820-19f7-482b-bbd9-25987a08d5fd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.069953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d66e820-19f7-482b-bbd9-25987a08d5fd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:20.070408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d66e820-19f7-482b-bbd9-25987a08d5fd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:20.071584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d66e820-19f7-482b-bbd9-25987a08d5fd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:20.219380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6d66e820-19f7-482b-bbd9-25987a08d5fd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:20.227413 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6d66e820-19f7-482b-bbd9-25987a08d5fd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.171122 Aug 27 03:29:20.228005 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3377/6572] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:20 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:21.250486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9b7ccba6-2eff-4c4c-a61d-31008f3d30c5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:21.251126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9b7ccba6-2eff-4c4c-a61d-31008f3d30c5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:21.258088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b7ccba6-2eff-4c4c-a61d-31008f3d30c5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:21.258598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b7ccba6-2eff-4c4c-a61d-31008f3d30c5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:21.259057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b7ccba6-2eff-4c4c-a61d-31008f3d30c5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:21.260293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b7ccba6-2eff-4c4c-a61d-31008f3d30c5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:21.260754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b7ccba6-2eff-4c4c-a61d-31008f3d30c5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:21.261202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9b7ccba6-2eff-4c4c-a61d-31008f3d30c5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:21.399062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9b7ccba6-2eff-4c4c-a61d-31008f3d30c5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:21.407257 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9b7ccba6-2eff-4c4c-a61d-31008f3d30c5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.160712 Aug 27 03:29:21.407856 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3196/6573] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:21 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:22.428553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-293a94a8-c106-4349-9d93-2c2fe4954dfc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:22.429210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-293a94a8-c106-4349-9d93-2c2fe4954dfc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:22.436167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-293a94a8-c106-4349-9d93-2c2fe4954dfc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.436696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-293a94a8-c106-4349-9d93-2c2fe4954dfc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.437139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-293a94a8-c106-4349-9d93-2c2fe4954dfc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.437881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-293a94a8-c106-4349-9d93-2c2fe4954dfc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:22.438342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-293a94a8-c106-4349-9d93-2c2fe4954dfc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:22.438776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-293a94a8-c106-4349-9d93-2c2fe4954dfc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:22.574588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-293a94a8-c106-4349-9d93-2c2fe4954dfc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:22.582403 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-293a94a8-c106-4349-9d93-2c2fe4954dfc tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.157918 Aug 27 03:29:22.582987 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3378/6574] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:22 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:23.604466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-24506808-a07a-4d7c-8f75-d161361659e4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:23.605126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-24506808-a07a-4d7c-8f75-d161361659e4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:23.612022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24506808-a07a-4d7c-8f75-d161361659e4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:23.612528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24506808-a07a-4d7c-8f75-d161361659e4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:23.612983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24506808-a07a-4d7c-8f75-d161361659e4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:23.613717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24506808-a07a-4d7c-8f75-d161361659e4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:23.614193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24506808-a07a-4d7c-8f75-d161361659e4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:23.614641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24506808-a07a-4d7c-8f75-d161361659e4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:23.633015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:23.751551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-24506808-a07a-4d7c-8f75-d161361659e4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:23.759321 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-24506808-a07a-4d7c-8f75-d161361659e4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.158753 Aug 27 03:29:23.760519 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3197/6575] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:23 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:24.781661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ae4d8aa3-6c1d-4732-8b04-e9087d05ed78 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:24.782295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ae4d8aa3-6c1d-4732-8b04-e9087d05ed78 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:24.789209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d8aa3-6c1d-4732-8b04-e9087d05ed78 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:24.789694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d8aa3-6c1d-4732-8b04-e9087d05ed78 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:24.790145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d8aa3-6c1d-4732-8b04-e9087d05ed78 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:24.790832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d8aa3-6c1d-4732-8b04-e9087d05ed78 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:24.791282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d8aa3-6c1d-4732-8b04-e9087d05ed78 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:24.791703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ae4d8aa3-6c1d-4732-8b04-e9087d05ed78 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:24.921420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ae4d8aa3-6c1d-4732-8b04-e9087d05ed78 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:24.930306 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ae4d8aa3-6c1d-4732-8b04-e9087d05ed78 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.152580 Aug 27 03:29:24.930883 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3379/6576] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:24 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:25.952227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a469f59-fe0e-40e5-a553-6ca3b5398638 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:25.952860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5a469f59-fe0e-40e5-a553-6ca3b5398638 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:25.955589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:25.961145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a469f59-fe0e-40e5-a553-6ca3b5398638 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:25.961642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a469f59-fe0e-40e5-a553-6ca3b5398638 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:25.962118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a469f59-fe0e-40e5-a553-6ca3b5398638 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:25.962833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a469f59-fe0e-40e5-a553-6ca3b5398638 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:25.963301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a469f59-fe0e-40e5-a553-6ca3b5398638 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:25.963742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a469f59-fe0e-40e5-a553-6ca3b5398638 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:26.096646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5a469f59-fe0e-40e5-a553-6ca3b5398638 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:26.104475 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a469f59-fe0e-40e5-a553-6ca3b5398638 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.156164 Aug 27 03:29:26.105044 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3198/6577] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:25 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:27.125848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f0b98382-d129-441f-9bd2-7e806c074f70 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:27.126528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f0b98382-d129-441f-9bd2-7e806c074f70 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:27.128715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=37 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:27.135071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b98382-d129-441f-9bd2-7e806c074f70 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.135564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b98382-d129-441f-9bd2-7e806c074f70 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.136010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b98382-d129-441f-9bd2-7e806c074f70 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.136718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b98382-d129-441f-9bd2-7e806c074f70 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:27.137187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b98382-d129-441f-9bd2-7e806c074f70 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:27.137623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f0b98382-d129-441f-9bd2-7e806c074f70 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:27.140563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:27.281608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f0b98382-d129-441f-9bd2-7e806c074f70 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:27.289441 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f0b98382-d129-441f-9bd2-7e806c074f70 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.167871 Aug 27 03:29:27.290044 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3380/6578] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:27 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:28.310913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d40862d1-6d0b-4bf5-a9cb-693cf9264a37 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:28.311467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d40862d1-6d0b-4bf5-a9cb-693cf9264a37 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:28.318491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d40862d1-6d0b-4bf5-a9cb-693cf9264a37 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:28.318995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d40862d1-6d0b-4bf5-a9cb-693cf9264a37 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:28.319448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d40862d1-6d0b-4bf5-a9cb-693cf9264a37 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.320159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d40862d1-6d0b-4bf5-a9cb-693cf9264a37 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:28.320637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d40862d1-6d0b-4bf5-a9cb-693cf9264a37 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:28.321085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d40862d1-6d0b-4bf5-a9cb-693cf9264a37 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:28.456039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d40862d1-6d0b-4bf5-a9cb-693cf9264a37 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:28.464487 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d40862d1-6d0b-4bf5-a9cb-693cf9264a37 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.157635 Aug 27 03:29:28.465072 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3199/6579] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:28 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:29.488778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-83530414-be88-42d7-b182-b9dc50644ef1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:29.489818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-83530414-be88-42d7-b182-b9dc50644ef1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:29.501879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83530414-be88-42d7-b182-b9dc50644ef1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:29.502508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83530414-be88-42d7-b182-b9dc50644ef1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:29.502951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83530414-be88-42d7-b182-b9dc50644ef1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:29.503688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83530414-be88-42d7-b182-b9dc50644ef1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:29.504150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83530414-be88-42d7-b182-b9dc50644ef1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:29.504589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-83530414-be88-42d7-b182-b9dc50644ef1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:29.642864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-83530414-be88-42d7-b182-b9dc50644ef1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:29.651322 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-83530414-be88-42d7-b182-b9dc50644ef1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.168842 Aug 27 03:29:29.651929 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3381/6580] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:29 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:30.672724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-438c66ef-e673-456a-b3d3-30c774b2019a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:30.673307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-438c66ef-e673-456a-b3d3-30c774b2019a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:30.680448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-438c66ef-e673-456a-b3d3-30c774b2019a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:30.680940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-438c66ef-e673-456a-b3d3-30c774b2019a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:30.682062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-438c66ef-e673-456a-b3d3-30c774b2019a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:30.682764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-438c66ef-e673-456a-b3d3-30c774b2019a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:30.683232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-438c66ef-e673-456a-b3d3-30c774b2019a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:30.683668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-438c66ef-e673-456a-b3d3-30c774b2019a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:30.837063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-438c66ef-e673-456a-b3d3-30c774b2019a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:30.845261 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-438c66ef-e673-456a-b3d3-30c774b2019a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.176490 Aug 27 03:29:30.845896 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3200/6581] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:30 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:31.866678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-816a0753-6486-45ec-b25e-0b67890ecc0b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:31.867205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-816a0753-6486-45ec-b25e-0b67890ecc0b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:31.874622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-816a0753-6486-45ec-b25e-0b67890ecc0b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:31.875108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-816a0753-6486-45ec-b25e-0b67890ecc0b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:31.875551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-816a0753-6486-45ec-b25e-0b67890ecc0b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:31.876247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-816a0753-6486-45ec-b25e-0b67890ecc0b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:31.876706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-816a0753-6486-45ec-b25e-0b67890ecc0b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:31.877136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-816a0753-6486-45ec-b25e-0b67890ecc0b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:32.012039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-816a0753-6486-45ec-b25e-0b67890ecc0b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:32.019827 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-816a0753-6486-45ec-b25e-0b67890ecc0b tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.157192 Aug 27 03:29:32.020409 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3382/6582] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:31 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:33.040671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da783a3a-7e3b-46a9-b19e-8bb793089ca2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:33.041281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da783a3a-7e3b-46a9-b19e-8bb793089ca2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:33.048384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da783a3a-7e3b-46a9-b19e-8bb793089ca2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:33.048890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da783a3a-7e3b-46a9-b19e-8bb793089ca2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:33.049348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da783a3a-7e3b-46a9-b19e-8bb793089ca2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:33.050121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da783a3a-7e3b-46a9-b19e-8bb793089ca2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:33.050574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da783a3a-7e3b-46a9-b19e-8bb793089ca2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:33.051021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da783a3a-7e3b-46a9-b19e-8bb793089ca2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:33.187656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-da783a3a-7e3b-46a9-b19e-8bb793089ca2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:33.196051 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da783a3a-7e3b-46a9-b19e-8bb793089ca2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.159400 Aug 27 03:29:33.197142 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3201/6583] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:33 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:34.218967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3282ecb2-e100-438c-81f3-bad6ed85fda1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:34.219573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3282ecb2-e100-438c-81f3-bad6ed85fda1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:34.226579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3282ecb2-e100-438c-81f3-bad6ed85fda1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:34.227065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3282ecb2-e100-438c-81f3-bad6ed85fda1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:34.227509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3282ecb2-e100-438c-81f3-bad6ed85fda1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:34.228860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3282ecb2-e100-438c-81f3-bad6ed85fda1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:34.229319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3282ecb2-e100-438c-81f3-bad6ed85fda1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:34.229786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3282ecb2-e100-438c-81f3-bad6ed85fda1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:34.367414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3282ecb2-e100-438c-81f3-bad6ed85fda1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:34.375540 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3282ecb2-e100-438c-81f3-bad6ed85fda1 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.160635 Aug 27 03:29:34.376137 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3383/6584] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:34 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:35.397978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-84b02076-7b29-4c61-8a44-cc21f59519e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:35.398643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-84b02076-7b29-4c61-8a44-cc21f59519e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:35.405591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84b02076-7b29-4c61-8a44-cc21f59519e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:35.406257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84b02076-7b29-4c61-8a44-cc21f59519e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:35.406716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84b02076-7b29-4c61-8a44-cc21f59519e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:35.407434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84b02076-7b29-4c61-8a44-cc21f59519e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:35.407911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84b02076-7b29-4c61-8a44-cc21f59519e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:35.408359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84b02076-7b29-4c61-8a44-cc21f59519e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:35.541034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-84b02076-7b29-4c61-8a44-cc21f59519e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:35.548994 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-84b02076-7b29-4c61-8a44-cc21f59519e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.155112 Aug 27 03:29:35.549566 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3202/6585] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:35 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:36.570713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-58b705f8-ac6a-44e9-93e5-b6053a0179e8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:36.571333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-58b705f8-ac6a-44e9-93e5-b6053a0179e8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:36.578969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b705f8-ac6a-44e9-93e5-b6053a0179e8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:36.579455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b705f8-ac6a-44e9-93e5-b6053a0179e8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:36.579902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b705f8-ac6a-44e9-93e5-b6053a0179e8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:36.580601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b705f8-ac6a-44e9-93e5-b6053a0179e8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:36.581061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b705f8-ac6a-44e9-93e5-b6053a0179e8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:36.581492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-58b705f8-ac6a-44e9-93e5-b6053a0179e8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:36.714328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-58b705f8-ac6a-44e9-93e5-b6053a0179e8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:36.722369 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-58b705f8-ac6a-44e9-93e5-b6053a0179e8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.155590 Aug 27 03:29:36.722945 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3384/6586] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:36 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:37.744722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7da45bfa-ee5e-49af-964a-561f3e616e87 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:37.745254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7da45bfa-ee5e-49af-964a-561f3e616e87 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:37.751676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7da45bfa-ee5e-49af-964a-561f3e616e87 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:37.752185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7da45bfa-ee5e-49af-964a-561f3e616e87 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:37.752638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7da45bfa-ee5e-49af-964a-561f3e616e87 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:37.753352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7da45bfa-ee5e-49af-964a-561f3e616e87 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:37.753856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7da45bfa-ee5e-49af-964a-561f3e616e87 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:37.754305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7da45bfa-ee5e-49af-964a-561f3e616e87 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:37.883473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7da45bfa-ee5e-49af-964a-561f3e616e87 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:37.892188 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7da45bfa-ee5e-49af-964a-561f3e616e87 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.152134 Aug 27 03:29:37.892771 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3203/6587] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:37 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:38.913412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-232fa9e1-626c-4d37-9794-9edc18a5483c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:38.914060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-232fa9e1-626c-4d37-9794-9edc18a5483c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:38.921725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232fa9e1-626c-4d37-9794-9edc18a5483c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:38.922215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232fa9e1-626c-4d37-9794-9edc18a5483c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:38.922656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232fa9e1-626c-4d37-9794-9edc18a5483c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:38.923350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232fa9e1-626c-4d37-9794-9edc18a5483c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:38.923808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232fa9e1-626c-4d37-9794-9edc18a5483c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:38.924241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232fa9e1-626c-4d37-9794-9edc18a5483c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:39.054804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-232fa9e1-626c-4d37-9794-9edc18a5483c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:39.062641 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-232fa9e1-626c-4d37-9794-9edc18a5483c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1520 microversion: 2.1 time: 0.153186 Aug 27 03:29:39.063235 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3385/6588] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:38 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:40.084245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e58d7877-fb7d-401c-acf8-7664e99159ca tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:40.085064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e58d7877-fb7d-401c-acf8-7664e99159ca tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:40.094073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e58d7877-fb7d-401c-acf8-7664e99159ca tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:40.094073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e58d7877-fb7d-401c-acf8-7664e99159ca tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:40.094567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e58d7877-fb7d-401c-acf8-7664e99159ca tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:40.095296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e58d7877-fb7d-401c-acf8-7664e99159ca tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:40.095771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e58d7877-fb7d-401c-acf8-7664e99159ca tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:40.096243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e58d7877-fb7d-401c-acf8-7664e99159ca tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:40.315267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e58d7877-fb7d-401c-acf8-7664e99159ca tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:40.323232 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e58d7877-fb7d-401c-acf8-7664e99159ca tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1519 microversion: 2.1 time: 0.242865 Aug 27 03:29:40.324162 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3204/6589] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:40 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:40.601191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a7ebec80-ce93-4294-9477-f8b0e76aa214 req-3a54775a-d62f-477b-a602-230c6de1f783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28951939-64cf-4b9c-bb90-6e90ab8cff43", "name": "network-vif-unplugged", "status": "completed", "tag": "79924175-b01d-4f87-a897-424185a7dc09"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:40.613097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a7ebec80-ce93-4294-9477-f8b0e76aa214 req-3a54775a-d62f-477b-a602-230c6de1f783 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:40.613776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a7ebec80-ce93-4294-9477-f8b0e76aa214 req-3a54775a-d62f-477b-a602-230c6de1f783 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:40.614405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a7ebec80-ce93-4294-9477-f8b0e76aa214 req-3a54775a-d62f-477b-a602-230c6de1f783 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:40.627678 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a7ebec80-ce93-4294-9477-f8b0e76aa214 req-3a54775a-d62f-477b-a602-230c6de1f783 service nova] Creating event network-vif-unplugged:79924175-b01d-4f87-a897-424185a7dc09 for instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 on n-h2-852084-5 Aug 27 03:29:40.633613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-a7ebec80-ce93-4294-9477-f8b0e76aa214 req-3a54775a-d62f-477b-a602-230c6de1f783 service nova] Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:29:40.645403 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a7ebec80-ce93-4294-9477-f8b0e76aa214 req-3a54775a-d62f-477b-a602-230c6de1f783 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047920 Aug 27 03:29:40.646627 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3386/6590] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:41.345382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a1d59d4d-dd09-496e-b717-b2677e2600c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:41.346172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a1d59d4d-dd09-496e-b717-b2677e2600c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:41.353106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1d59d4d-dd09-496e-b717-b2677e2600c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:41.354142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1d59d4d-dd09-496e-b717-b2677e2600c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:41.354600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1d59d4d-dd09-496e-b717-b2677e2600c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:41.355323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1d59d4d-dd09-496e-b717-b2677e2600c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:41.355796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1d59d4d-dd09-496e-b717-b2677e2600c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:41.356239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a1d59d4d-dd09-496e-b717-b2677e2600c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:41.493603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a1d59d4d-dd09-496e-b717-b2677e2600c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:41.502175 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a1d59d4d-dd09-496e-b717-b2677e2600c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1519 microversion: 2.1 time: 0.161459 Aug 27 03:29:41.502790 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3205/6591] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:41 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:29:42.523756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94075216-5c47-4aad-b997-7f4e1ec9313d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:42.524464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-94075216-5c47-4aad-b997-7f4e1ec9313d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:42.531678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94075216-5c47-4aad-b997-7f4e1ec9313d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:42.532166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94075216-5c47-4aad-b997-7f4e1ec9313d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:42.532608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94075216-5c47-4aad-b997-7f4e1ec9313d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:42.533310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94075216-5c47-4aad-b997-7f4e1ec9313d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:42.533796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94075216-5c47-4aad-b997-7f4e1ec9313d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:42.534229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94075216-5c47-4aad-b997-7f4e1ec9313d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:42.660329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-9bd6b259-985b-4f12-9805-5fe78f625e3b req-2bf4979b-a9b2-43f2-bbef-62e021c4f1ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28951939-64cf-4b9c-bb90-6e90ab8cff43", "tag": "79924175-b01d-4f87-a897-424185a7dc09"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:42.667397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-94075216-5c47-4aad-b997-7f4e1ec9313d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:42.671215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9bd6b259-985b-4f12-9805-5fe78f625e3b req-2bf4979b-a9b2-43f2-bbef-62e021c4f1ee service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:42.671714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9bd6b259-985b-4f12-9805-5fe78f625e3b req-2bf4979b-a9b2-43f2-bbef-62e021c4f1ee service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:42.672166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9bd6b259-985b-4f12-9805-5fe78f625e3b req-2bf4979b-a9b2-43f2-bbef-62e021c4f1ee service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:42.675119 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-94075216-5c47-4aad-b997-7f4e1ec9313d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1517 microversion: 2.1 time: 0.155640 Aug 27 03:29:42.675693 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3387/6592] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:42 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:42.684477 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-9bd6b259-985b-4f12-9805-5fe78f625e3b req-2bf4979b-a9b2-43f2-bbef-62e021c4f1ee service nova] Creating event network-changed:79924175-b01d-4f87-a897-424185a7dc09 for instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 on n-h2-852084-5 Aug 27 03:29:42.691528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-9bd6b259-985b-4f12-9805-5fe78f625e3b req-2bf4979b-a9b2-43f2-bbef-62e021c4f1ee service nova] Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:29:42.702741 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-9bd6b259-985b-4f12-9805-5fe78f625e3b req-2bf4979b-a9b2-43f2-bbef-62e021c4f1ee service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046145 Aug 27 03:29:42.703439 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3206/6593] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:29:43.696595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e249cc98-957d-4a67-9265-c915b38277e2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:43.697134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e249cc98-957d-4a67-9265-c915b38277e2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:43.703928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e249cc98-957d-4a67-9265-c915b38277e2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:43.704459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e249cc98-957d-4a67-9265-c915b38277e2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:43.704859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e249cc98-957d-4a67-9265-c915b38277e2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:43.705560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e249cc98-957d-4a67-9265-c915b38277e2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:43.706066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e249cc98-957d-4a67-9265-c915b38277e2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:43.706497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e249cc98-957d-4a67-9265-c915b38277e2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:43.842871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e249cc98-957d-4a67-9265-c915b38277e2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:43.850647 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e249cc98-957d-4a67-9265-c915b38277e2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1514 microversion: 2.1 time: 0.158072 Aug 27 03:29:43.851227 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3388/6594] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:43 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:43.871830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-82a4ddac-8485-46e3-9332-85f9c406ac74 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:43.872467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-82a4ddac-8485-46e3-9332-85f9c406ac74 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:43.879503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82a4ddac-8485-46e3-9332-85f9c406ac74 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:43.880000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82a4ddac-8485-46e3-9332-85f9c406ac74 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:43.880454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82a4ddac-8485-46e3-9332-85f9c406ac74 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:43.881164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82a4ddac-8485-46e3-9332-85f9c406ac74 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:43.881636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82a4ddac-8485-46e3-9332-85f9c406ac74 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:43.882104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82a4ddac-8485-46e3-9332-85f9c406ac74 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:43.942640 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-82a4ddac-8485-46e3-9332-85f9c406ac74 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "POST /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43/action" status: 204 len: 0 microversion: 2.1 time: 0.074903 Aug 27 03:29:43.943368 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3207/6595] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:43 2022] POST /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:29:43.951568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e3846813-972b-4649-99d8-1533a7d40ed3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:43.952097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e3846813-972b-4649-99d8-1533a7d40ed3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:43.958177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3846813-972b-4649-99d8-1533a7d40ed3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:43.958691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3846813-972b-4649-99d8-1533a7d40ed3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:43.959165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3846813-972b-4649-99d8-1533a7d40ed3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:43.959926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3846813-972b-4649-99d8-1533a7d40ed3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:43.960439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3846813-972b-4649-99d8-1533a7d40ed3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:43.960929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3846813-972b-4649-99d8-1533a7d40ed3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:44.099994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e3846813-972b-4649-99d8-1533a7d40ed3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:44.109047 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e3846813-972b-4649-99d8-1533a7d40ed3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1514 microversion: 2.1 time: 0.161331 Aug 27 03:29:44.109640 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3389/6596] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:43 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:45.131390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8ca3eaac-6741-4e73-ae01-2687b906bc90 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:45.132093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8ca3eaac-6741-4e73-ae01-2687b906bc90 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:45.138305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ca3eaac-6741-4e73-ae01-2687b906bc90 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:45.138798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ca3eaac-6741-4e73-ae01-2687b906bc90 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:45.139246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ca3eaac-6741-4e73-ae01-2687b906bc90 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:45.139946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ca3eaac-6741-4e73-ae01-2687b906bc90 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:45.140417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ca3eaac-6741-4e73-ae01-2687b906bc90 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:45.140856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8ca3eaac-6741-4e73-ae01-2687b906bc90 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:45.278945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8ca3eaac-6741-4e73-ae01-2687b906bc90 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:45.290774 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8ca3eaac-6741-4e73-ae01-2687b906bc90 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1514 microversion: 2.1 time: 0.164114 Aug 27 03:29:45.292195 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3208/6597] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:45 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:45.363374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4b80d965-e2ec-4d06-88ce-04dd713d8190 req-2b8a36b9-55e4-4cfe-b8cd-6e0fc67b7622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28951939-64cf-4b9c-bb90-6e90ab8cff43", "name": "network-vif-plugged", "status": "completed", "tag": "79924175-b01d-4f87-a897-424185a7dc09"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:45.374673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4b80d965-e2ec-4d06-88ce-04dd713d8190 req-2b8a36b9-55e4-4cfe-b8cd-6e0fc67b7622 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:45.375178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4b80d965-e2ec-4d06-88ce-04dd713d8190 req-2b8a36b9-55e4-4cfe-b8cd-6e0fc67b7622 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:45.375610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4b80d965-e2ec-4d06-88ce-04dd713d8190 req-2b8a36b9-55e4-4cfe-b8cd-6e0fc67b7622 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:45.395750 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4b80d965-e2ec-4d06-88ce-04dd713d8190 req-2b8a36b9-55e4-4cfe-b8cd-6e0fc67b7622 service nova] Creating event network-vif-plugged:79924175-b01d-4f87-a897-424185a7dc09 for instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 on n-h2-852084-5 Aug 27 03:29:45.401421 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4b80d965-e2ec-4d06-88ce-04dd713d8190 req-2b8a36b9-55e4-4cfe-b8cd-6e0fc67b7622 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042512 Aug 27 03:29:45.402079 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3390/6598] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:46.318152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8b5b471a-7649-485d-81ac-b628e2908ae9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:46.318787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8b5b471a-7649-485d-81ac-b628e2908ae9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:46.326478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5b471a-7649-485d-81ac-b628e2908ae9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.326983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5b471a-7649-485d-81ac-b628e2908ae9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.327440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5b471a-7649-485d-81ac-b628e2908ae9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.328160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5b471a-7649-485d-81ac-b628e2908ae9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.328636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5b471a-7649-485d-81ac-b628e2908ae9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.329082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8b5b471a-7649-485d-81ac-b628e2908ae9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.458613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8b5b471a-7649-485d-81ac-b628e2908ae9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.466341 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8b5b471a-7649-485d-81ac-b628e2908ae9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1506 microversion: 2.1 time: 0.152258 Aug 27 03:29:46.467180 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3209/6599] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:46 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:46.488289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a081813-8dd8-4fff-b8db-e8481cdbd6da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:46.488993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a081813-8dd8-4fff-b8db-e8481cdbd6da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:46.496061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a081813-8dd8-4fff-b8db-e8481cdbd6da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.496628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a081813-8dd8-4fff-b8db-e8481cdbd6da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.497197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a081813-8dd8-4fff-b8db-e8481cdbd6da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.497926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a081813-8dd8-4fff-b8db-e8481cdbd6da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:46.498380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a081813-8dd8-4fff-b8db-e8481cdbd6da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:46.498805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a081813-8dd8-4fff-b8db-e8481cdbd6da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:46.632266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7a081813-8dd8-4fff-b8db-e8481cdbd6da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:46.639975 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a081813-8dd8-4fff-b8db-e8481cdbd6da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1506 microversion: 2.1 time: 0.156729 Aug 27 03:29:46.640543 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3391/6600] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:46 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:46.663258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d59d75dc-f092-4e4a-9d85-37496bcb26b0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Action: 'create', calling method: .version_select at 0x7f4d292db940>, body: {"keypair": {"name": "tempest-keypair-134674564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZjSNy46kOP3bIQDwZHfhCVHtRdDLRsTTsB1GzTAl61WBBAq3FvlF30Ez6n+WviIWDSml82LIvZQurDLGeFAMbux9khxulhxby4vIcTMGE8hqcFYxLMXCyljJ5EwXdy/w=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:46.678850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-d59d75dc-f092-4e4a-9d85-37496bcb26b0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Getting quotas for project ed2175dca31a4e8a8cefe5108d1c6160. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:29:46.684511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-d59d75dc-f092-4e4a-9d85-37496bcb26b0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Getting quotas for user 818395e689094ddc92a40d45e4b82796 and project ed2175dca31a4e8a8cefe5108d1c6160. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:29:46.709224 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d59d75dc-f092-4e4a-9d85-37496bcb26b0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049776 Aug 27 03:29:46.710075 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3210/6601] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:29:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:47.883800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-01b446a0-b9dc-4a16-b372-f62f61f75617 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:47.884422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-01b446a0-b9dc-4a16-b372-f62f61f75617 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:47.892378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01b446a0-b9dc-4a16-b372-f62f61f75617 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:47.892876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01b446a0-b9dc-4a16-b372-f62f61f75617 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:47.893326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01b446a0-b9dc-4a16-b372-f62f61f75617 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:47.894075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01b446a0-b9dc-4a16-b372-f62f61f75617 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:47.894544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01b446a0-b9dc-4a16-b372-f62f61f75617 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:47.894977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-01b446a0-b9dc-4a16-b372-f62f61f75617 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:48.029031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-01b446a0-b9dc-4a16-b372-f62f61f75617 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:48.037013 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-01b446a0-b9dc-4a16-b372-f62f61f75617 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 200 len: 1506 microversion: 2.1 time: 0.157156 Aug 27 03:29:48.037533 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3392/6602] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:47 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:48.059105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-26ef73da-9e74-414a-b6eb-06a2dde8b240 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:48.059801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26ef73da-9e74-414a-b6eb-06a2dde8b240 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:48.066263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26ef73da-9e74-414a-b6eb-06a2dde8b240 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:48.066767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26ef73da-9e74-414a-b6eb-06a2dde8b240 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:48.067223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26ef73da-9e74-414a-b6eb-06a2dde8b240 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:48.067940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26ef73da-9e74-414a-b6eb-06a2dde8b240 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:48.068423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26ef73da-9e74-414a-b6eb-06a2dde8b240 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:48.068861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26ef73da-9e74-414a-b6eb-06a2dde8b240 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:48.093589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26ef73da-9e74-414a-b6eb-06a2dde8b240 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:29:48.168175 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-26ef73da-9e74-414a-b6eb-06a2dde8b240 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "DELETE /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 204 len: 0 microversion: 2.1 time: 0.113871 Aug 27 03:29:48.168940 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3211/6603] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:29:48 2022] DELETE /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:29:48.224466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-666543845", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "acfbb253-e83f-4383-bbb1-e91fcd4d1552"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:48.279859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] validate_networks() for [('acfbb253-e83f-4383-bbb1-e91fcd4d1552', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:29:48.653453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:48.653922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:48.654413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:48.654835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:48.655259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:48.664230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:48.664722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:48.665170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:48.665945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:48.666412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:48.666871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:48.683666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Getting quotas for project ed2175dca31a4e8a8cefe5108d1c6160. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:29:48.688984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Getting quotas for user 818395e689094ddc92a40d45e4b82796 and project ed2175dca31a4e8a8cefe5108d1c6160. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:29:48.701895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:29:48.704263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:29:48.751887 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-da6d3b60-abd3-41e6-99c9-2bf9cbbc217d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531313 Aug 27 03:29:48.752551 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3393/6604] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:29:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:29:48.764566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3e2488d9-6110-4d80-9f84-57202ec5ff09 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:48.765540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3e2488d9-6110-4d80-9f84-57202ec5ff09 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:48.821049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3e2488d9-6110-4d80-9f84-57202ec5ff09 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:48.828782 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3e2488d9-6110-4d80-9f84-57202ec5ff09 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1217 microversion: 2.1 time: 0.069059 Aug 27 03:29:48.829785 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3212/6605] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:48 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:49.851935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-df0d4f2f-5561-45e7-b723-9a51d1ed2aa7 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:49.852616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-df0d4f2f-5561-45e7-b723-9a51d1ed2aa7 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:49.861710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df0d4f2f-5561-45e7-b723-9a51d1ed2aa7 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:49.862199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df0d4f2f-5561-45e7-b723-9a51d1ed2aa7 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:49.862646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df0d4f2f-5561-45e7-b723-9a51d1ed2aa7 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:49.863336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df0d4f2f-5561-45e7-b723-9a51d1ed2aa7 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:49.863786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df0d4f2f-5561-45e7-b723-9a51d1ed2aa7 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:49.864854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-df0d4f2f-5561-45e7-b723-9a51d1ed2aa7 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:49.935508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-df0d4f2f-5561-45e7-b723-9a51d1ed2aa7 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:49.943849 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-df0d4f2f-5561-45e7-b723-9a51d1ed2aa7 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1277 microversion: 2.1 time: 0.096884 Aug 27 03:29:49.951766 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3394/6606] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:49 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:50.267912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-74473dd6-3d72-4eee-9e0f-f55f156c95be req-91cd31f3-f46c-42fe-b3ad-5e746561974a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28951939-64cf-4b9c-bb90-6e90ab8cff43", "name": "network-vif-deleted", "tag": "79924175-b01d-4f87-a897-424185a7dc09"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:50.292815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74473dd6-3d72-4eee-9e0f-f55f156c95be req-91cd31f3-f46c-42fe-b3ad-5e746561974a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.293634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74473dd6-3d72-4eee-9e0f-f55f156c95be req-91cd31f3-f46c-42fe-b3ad-5e746561974a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.294281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74473dd6-3d72-4eee-9e0f-f55f156c95be req-91cd31f3-f46c-42fe-b3ad-5e746561974a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.310160 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-74473dd6-3d72-4eee-9e0f-f55f156c95be req-91cd31f3-f46c-42fe-b3ad-5e746561974a service nova] Creating event network-vif-deleted:79924175-b01d-4f87-a897-424185a7dc09 for instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 on n-h2-852084-5 Aug 27 03:29:50.315413 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-74473dd6-3d72-4eee-9e0f-f55f156c95be req-91cd31f3-f46c-42fe-b3ad-5e746561974a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051124 Aug 27 03:29:50.316350 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3213/6607] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:50.965723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5938e841-f595-49d3-acba-6d99bff53a94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:50.966281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5938e841-f595-49d3-acba-6d99bff53a94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:50.973589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5938e841-f595-49d3-acba-6d99bff53a94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.974397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5938e841-f595-49d3-acba-6d99bff53a94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.975155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5938e841-f595-49d3-acba-6d99bff53a94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:50.975877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5938e841-f595-49d3-acba-6d99bff53a94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:50.976501 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5938e841-f595-49d3-acba-6d99bff53a94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:50.977231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5938e841-f595-49d3-acba-6d99bff53a94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:51.111728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5938e841-f595-49d3-acba-6d99bff53a94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:51.119635 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5938e841-f595-49d3-acba-6d99bff53a94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1317 microversion: 2.1 time: 0.159094 Aug 27 03:29:51.120254 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3395/6608] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:50 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:52.142157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6a349901-fc3d-49c4-9c69-c09f1b961c94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:52.142874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6a349901-fc3d-49c4-9c69-c09f1b961c94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:52.149161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a349901-fc3d-49c4-9c69-c09f1b961c94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.149654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a349901-fc3d-49c4-9c69-c09f1b961c94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.150127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a349901-fc3d-49c4-9c69-c09f1b961c94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.150831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a349901-fc3d-49c4-9c69-c09f1b961c94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.151806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a349901-fc3d-49c4-9c69-c09f1b961c94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.152244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6a349901-fc3d-49c4-9c69-c09f1b961c94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.167884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:52.283773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6a349901-fc3d-49c4-9c69-c09f1b961c94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:52.291423 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6a349901-fc3d-49c4-9c69-c09f1b961c94 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1317 microversion: 2.1 time: 0.154520 Aug 27 03:29:52.292630 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3214/6609] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:52 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:52.335551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f9face1c-80e0-44c9-bcc9-7dc44edd90f7 req-e91d89e7-d067-4150-9e86-d2c92ed11e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf94df0-f0e9-4677-a4b4-1f0483392245", "tag": "13e088c4-3f39-499a-89be-b756f4b7d557"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:52.347283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f9face1c-80e0-44c9-bcc9-7dc44edd90f7 req-e91d89e7-d067-4150-9e86-d2c92ed11e7e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:52.347768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f9face1c-80e0-44c9-bcc9-7dc44edd90f7 req-e91d89e7-d067-4150-9e86-d2c92ed11e7e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:52.348206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f9face1c-80e0-44c9-bcc9-7dc44edd90f7 req-e91d89e7-d067-4150-9e86-d2c92ed11e7e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:52.360072 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f9face1c-80e0-44c9-bcc9-7dc44edd90f7 req-e91d89e7-d067-4150-9e86-d2c92ed11e7e service nova] Creating event network-changed:13e088c4-3f39-499a-89be-b756f4b7d557 for instance dbf94df0-f0e9-4677-a4b4-1f0483392245 on n-h1-852084-5 Aug 27 03:29:52.365033 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f9face1c-80e0-44c9-bcc9-7dc44edd90f7 req-e91d89e7-d067-4150-9e86-d2c92ed11e7e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033205 Aug 27 03:29:52.365631 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3396/6610] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:29:53.312803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0bcb20d4-e6b5-43f2-aa93-9df17a88f216 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:53.313469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0bcb20d4-e6b5-43f2-aa93-9df17a88f216 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:53.320555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bcb20d4-e6b5-43f2-aa93-9df17a88f216 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:53.321078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bcb20d4-e6b5-43f2-aa93-9df17a88f216 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:53.321534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bcb20d4-e6b5-43f2-aa93-9df17a88f216 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:53.322297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bcb20d4-e6b5-43f2-aa93-9df17a88f216 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:53.322768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bcb20d4-e6b5-43f2-aa93-9df17a88f216 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:53.323215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0bcb20d4-e6b5-43f2-aa93-9df17a88f216 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:53.464850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0bcb20d4-e6b5-43f2-aa93-9df17a88f216 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:53.473057 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0bcb20d4-e6b5-43f2-aa93-9df17a88f216 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1317 microversion: 2.1 time: 0.164261 Aug 27 03:29:53.473636 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3215/6611] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:53 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:54.497486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a506307-0690-405a-b93e-af7cf2e609d5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:54.498339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4a506307-0690-405a-b93e-af7cf2e609d5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:54.504961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a506307-0690-405a-b93e-af7cf2e609d5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:54.505447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a506307-0690-405a-b93e-af7cf2e609d5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:54.505914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a506307-0690-405a-b93e-af7cf2e609d5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:54.506610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a506307-0690-405a-b93e-af7cf2e609d5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:54.507067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a506307-0690-405a-b93e-af7cf2e609d5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:54.507490 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a506307-0690-405a-b93e-af7cf2e609d5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:54.646861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4a506307-0690-405a-b93e-af7cf2e609d5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:54.655450 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a506307-0690-405a-b93e-af7cf2e609d5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1317 microversion: 2.1 time: 0.164576 Aug 27 03:29:54.656042 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3397/6612] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:54 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:55.134851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2a0ef64d-0226-4d74-bd3a-1e2bd59e2803 req-c9d5406d-bff7-4a4e-94f4-a2e099e48564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf94df0-f0e9-4677-a4b4-1f0483392245", "name": "network-vif-plugged", "status": "completed", "tag": "13e088c4-3f39-499a-89be-b756f4b7d557"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:55.147757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2a0ef64d-0226-4d74-bd3a-1e2bd59e2803 req-c9d5406d-bff7-4a4e-94f4-a2e099e48564 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:55.148623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2a0ef64d-0226-4d74-bd3a-1e2bd59e2803 req-c9d5406d-bff7-4a4e-94f4-a2e099e48564 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:55.149088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2a0ef64d-0226-4d74-bd3a-1e2bd59e2803 req-c9d5406d-bff7-4a4e-94f4-a2e099e48564 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:55.160408 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2a0ef64d-0226-4d74-bd3a-1e2bd59e2803 req-c9d5406d-bff7-4a4e-94f4-a2e099e48564 service nova] Creating event network-vif-plugged:13e088c4-3f39-499a-89be-b756f4b7d557 for instance dbf94df0-f0e9-4677-a4b4-1f0483392245 on n-h1-852084-5 Aug 27 03:29:55.165448 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2a0ef64d-0226-4d74-bd3a-1e2bd59e2803 req-c9d5406d-bff7-4a4e-94f4-a2e099e48564 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034339 Aug 27 03:29:55.167252 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3216/6613] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:29:55.676281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-31709323-a35a-4491-ab84-6511731369ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:55.676899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-31709323-a35a-4491-ab84-6511731369ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:55.684305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31709323-a35a-4491-ab84-6511731369ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:55.684791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31709323-a35a-4491-ab84-6511731369ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:55.685237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31709323-a35a-4491-ab84-6511731369ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:55.685970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31709323-a35a-4491-ab84-6511731369ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:55.686430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31709323-a35a-4491-ab84-6511731369ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:55.686862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-31709323-a35a-4491-ab84-6511731369ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:55.816320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-31709323-a35a-4491-ab84-6511731369ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:55.824167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-31709323-a35a-4491-ab84-6511731369ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1317 microversion: 2.1 time: 0.151825 Aug 27 03:29:55.824751 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3398/6614] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:55 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:56.845447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e212dc86-0a54-48b0-88c9-db86bed5944a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:56.846189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e212dc86-0a54-48b0-88c9-db86bed5944a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:56.849003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:56.855957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e212dc86-0a54-48b0-88c9-db86bed5944a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:56.856566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e212dc86-0a54-48b0-88c9-db86bed5944a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:56.857026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e212dc86-0a54-48b0-88c9-db86bed5944a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:56.857768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e212dc86-0a54-48b0-88c9-db86bed5944a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:56.858238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e212dc86-0a54-48b0-88c9-db86bed5944a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:56.858682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e212dc86-0a54-48b0-88c9-db86bed5944a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.005305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e212dc86-0a54-48b0-88c9-db86bed5944a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.014885 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e212dc86-0a54-48b0-88c9-db86bed5944a tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1506 microversion: 2.1 time: 0.173877 Aug 27 03:29:57.015489 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3217/6615] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:56 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:57.036629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f5a7e88d-205e-4f46-a366-e36ab8b03656 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:57.037468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f5a7e88d-205e-4f46-a366-e36ab8b03656 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:57.044400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5a7e88d-205e-4f46-a366-e36ab8b03656 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.044892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5a7e88d-205e-4f46-a366-e36ab8b03656 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.045339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5a7e88d-205e-4f46-a366-e36ab8b03656 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.046096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5a7e88d-205e-4f46-a366-e36ab8b03656 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.046598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5a7e88d-205e-4f46-a366-e36ab8b03656 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.047218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f5a7e88d-205e-4f46-a366-e36ab8b03656 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.049810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=100 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:57.179273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f5a7e88d-205e-4f46-a366-e36ab8b03656 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.187907 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f5a7e88d-205e-4f46-a366-e36ab8b03656 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1506 microversion: 2.1 time: 0.155240 Aug 27 03:29:57.188494 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3399/6616] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:57 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:57.208025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:29:57.210344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:57.216391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.217147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.217607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.218345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.218819 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.219265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.248762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.254570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Old instance type m1.heat2, new instance type m1.heat {{(pid=122487) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:29:57.261088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:29:57.261528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:29:57.262049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:29:57.262478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:29:57.262913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:29:57.326422 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1d1c4886-6086-4d2a-bbbf-ad954afd2d4c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "POST /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245/action" status: 202 len: 0 microversion: 2.1 time: 0.122237 Aug 27 03:29:57.327320 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3218/6617] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:29:57 2022] POST /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:29:57.336450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b41ea0f7-5463-40a5-ab45-764b4d46ea93 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:57.337091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b41ea0f7-5463-40a5-ab45-764b4d46ea93 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:57.339697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:57.345851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b41ea0f7-5463-40a5-ab45-764b4d46ea93 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.346338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b41ea0f7-5463-40a5-ab45-764b4d46ea93 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.346776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b41ea0f7-5463-40a5-ab45-764b4d46ea93 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.347485 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b41ea0f7-5463-40a5-ab45-764b4d46ea93 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:57.347941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b41ea0f7-5463-40a5-ab45-764b4d46ea93 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:57.348361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b41ea0f7-5463-40a5-ab45-764b4d46ea93 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:57.510422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b41ea0f7-5463-40a5-ab45-764b4d46ea93 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:57.518432 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b41ea0f7-5463-40a5-ab45-764b4d46ea93 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1513 microversion: 2.1 time: 0.186559 Aug 27 03:29:57.520397 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3400/6618] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:57 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:58.542111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b079246a-5a9e-4acd-a731-4ad56631bf65 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:58.542742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b079246a-5a9e-4acd-a731-4ad56631bf65 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:58.548852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b079246a-5a9e-4acd-a731-4ad56631bf65 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.549356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b079246a-5a9e-4acd-a731-4ad56631bf65 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.549840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b079246a-5a9e-4acd-a731-4ad56631bf65 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.550556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b079246a-5a9e-4acd-a731-4ad56631bf65 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:58.551031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b079246a-5a9e-4acd-a731-4ad56631bf65 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:58.551478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b079246a-5a9e-4acd-a731-4ad56631bf65 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:58.727371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b079246a-5a9e-4acd-a731-4ad56631bf65 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:58.735970 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b079246a-5a9e-4acd-a731-4ad56631bf65 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1513 microversion: 2.1 time: 0.199154 Aug 27 03:29:58.736559 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3219/6619] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:58 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:29:59.758295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a4df073-e541-4309-b904-fdf0fae00a60 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:29:59.758916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a4df073-e541-4309-b904-fdf0fae00a60 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:29:59.764041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:59.764765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:29:59.770732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a4df073-e541-4309-b904-fdf0fae00a60 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:59.771228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a4df073-e541-4309-b904-fdf0fae00a60 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:59.771675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a4df073-e541-4309-b904-fdf0fae00a60 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:59.772387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a4df073-e541-4309-b904-fdf0fae00a60 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:29:59.772845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a4df073-e541-4309-b904-fdf0fae00a60 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:29:59.773281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a4df073-e541-4309-b904-fdf0fae00a60 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:29:59.909516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7a4df073-e541-4309-b904-fdf0fae00a60 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:29:59.917816 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a4df073-e541-4309-b904-fdf0fae00a60 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.163396 Aug 27 03:29:59.918394 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3401/6620] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:29:59 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:00.939120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-19b19168-8a96-49d7-9eaa-ab15ef18942f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:00.939691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-19b19168-8a96-49d7-9eaa-ab15ef18942f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:00.941559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:00.947840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19b19168-8a96-49d7-9eaa-ab15ef18942f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:00.948853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19b19168-8a96-49d7-9eaa-ab15ef18942f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:00.949298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19b19168-8a96-49d7-9eaa-ab15ef18942f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:00.950027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19b19168-8a96-49d7-9eaa-ab15ef18942f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:00.950489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19b19168-8a96-49d7-9eaa-ab15ef18942f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:00.950924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-19b19168-8a96-49d7-9eaa-ab15ef18942f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:01.084820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-19b19168-8a96-49d7-9eaa-ab15ef18942f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:01.093081 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-19b19168-8a96-49d7-9eaa-ab15ef18942f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.157985 Aug 27 03:30:01.093697 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3220/6621] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:00 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:02.114260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5b292d51-fbe4-45a3-91ef-d5c0276ea1da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:02.114893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5b292d51-fbe4-45a3-91ef-d5c0276ea1da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:02.121829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b292d51-fbe4-45a3-91ef-d5c0276ea1da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:02.122317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b292d51-fbe4-45a3-91ef-d5c0276ea1da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:02.122764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b292d51-fbe4-45a3-91ef-d5c0276ea1da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:02.123484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b292d51-fbe4-45a3-91ef-d5c0276ea1da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:02.123946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b292d51-fbe4-45a3-91ef-d5c0276ea1da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:02.124379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5b292d51-fbe4-45a3-91ef-d5c0276ea1da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:02.252143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5b292d51-fbe4-45a3-91ef-d5c0276ea1da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:02.260217 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5b292d51-fbe4-45a3-91ef-d5c0276ea1da tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.149823 Aug 27 03:30:02.261306 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3402/6622] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:02 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:03.281447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6f8b5836-f343-40a0-baa6-a76c16a40963 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:03.282138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6f8b5836-f343-40a0-baa6-a76c16a40963 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:03.289187 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f8b5836-f343-40a0-baa6-a76c16a40963 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:03.289704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f8b5836-f343-40a0-baa6-a76c16a40963 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:03.290166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f8b5836-f343-40a0-baa6-a76c16a40963 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:03.290867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f8b5836-f343-40a0-baa6-a76c16a40963 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:03.291339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f8b5836-f343-40a0-baa6-a76c16a40963 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:03.291779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6f8b5836-f343-40a0-baa6-a76c16a40963 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:03.430019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6f8b5836-f343-40a0-baa6-a76c16a40963 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:03.437862 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6f8b5836-f343-40a0-baa6-a76c16a40963 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.160783 Aug 27 03:30:03.438438 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3221/6623] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:03 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:04.459011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-79ed6cb9-0459-4699-8f8a-8f3f16e0d941 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:04.459632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-79ed6cb9-0459-4699-8f8a-8f3f16e0d941 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:04.467020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79ed6cb9-0459-4699-8f8a-8f3f16e0d941 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.467518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79ed6cb9-0459-4699-8f8a-8f3f16e0d941 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.467965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79ed6cb9-0459-4699-8f8a-8f3f16e0d941 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:04.468663 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79ed6cb9-0459-4699-8f8a-8f3f16e0d941 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:04.469123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79ed6cb9-0459-4699-8f8a-8f3f16e0d941 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:04.469555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79ed6cb9-0459-4699-8f8a-8f3f16e0d941 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:04.653552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-79ed6cb9-0459-4699-8f8a-8f3f16e0d941 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:04.661263 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-79ed6cb9-0459-4699-8f8a-8f3f16e0d941 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.206186 Aug 27 03:30:04.661864 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3403/6624] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:04 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:05.683012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a02e6b5-12d0-4ba5-9cc4-d3e346859782 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:05.683548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5a02e6b5-12d0-4ba5-9cc4-d3e346859782 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:05.690914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a02e6b5-12d0-4ba5-9cc4-d3e346859782 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.691405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a02e6b5-12d0-4ba5-9cc4-d3e346859782 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.691857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a02e6b5-12d0-4ba5-9cc4-d3e346859782 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.692556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a02e6b5-12d0-4ba5-9cc4-d3e346859782 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:05.693021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a02e6b5-12d0-4ba5-9cc4-d3e346859782 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:05.693451 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a02e6b5-12d0-4ba5-9cc4-d3e346859782 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:05.875680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5a02e6b5-12d0-4ba5-9cc4-d3e346859782 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:05.883457 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a02e6b5-12d0-4ba5-9cc4-d3e346859782 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.204393 Aug 27 03:30:05.884035 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3222/6625] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:05 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:06.905225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-35610f02-b92f-4813-b4c9-57ee89aad11c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:06.905875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-35610f02-b92f-4813-b4c9-57ee89aad11c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:06.912844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35610f02-b92f-4813-b4c9-57ee89aad11c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.913330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35610f02-b92f-4813-b4c9-57ee89aad11c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.913806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35610f02-b92f-4813-b4c9-57ee89aad11c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:06.914509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35610f02-b92f-4813-b4c9-57ee89aad11c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:06.914970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35610f02-b92f-4813-b4c9-57ee89aad11c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:06.915401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-35610f02-b92f-4813-b4c9-57ee89aad11c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:07.055548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-35610f02-b92f-4813-b4c9-57ee89aad11c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:07.063951 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-35610f02-b92f-4813-b4c9-57ee89aad11c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.163359 Aug 27 03:30:07.064529 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3404/6626] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:06 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:08.085228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a5f04137-34c9-4240-9a53-76eeb8fee106 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:08.086009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a5f04137-34c9-4240-9a53-76eeb8fee106 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:08.093170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f04137-34c9-4240-9a53-76eeb8fee106 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.093691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f04137-34c9-4240-9a53-76eeb8fee106 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.094148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f04137-34c9-4240-9a53-76eeb8fee106 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.094859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f04137-34c9-4240-9a53-76eeb8fee106 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:08.095332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f04137-34c9-4240-9a53-76eeb8fee106 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:08.095776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5f04137-34c9-4240-9a53-76eeb8fee106 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:08.230257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a5f04137-34c9-4240-9a53-76eeb8fee106 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:08.237977 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a5f04137-34c9-4240-9a53-76eeb8fee106 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.157038 Aug 27 03:30:08.238556 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3223/6627] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:08 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:09.259504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-41a84a4d-f6a5-4ef6-a5ca-32e9238756bd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:09.260129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-41a84a4d-f6a5-4ef6-a5ca-32e9238756bd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:09.267029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41a84a4d-f6a5-4ef6-a5ca-32e9238756bd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:09.267520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41a84a4d-f6a5-4ef6-a5ca-32e9238756bd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:09.267968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41a84a4d-f6a5-4ef6-a5ca-32e9238756bd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:09.268671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41a84a4d-f6a5-4ef6-a5ca-32e9238756bd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:09.269136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41a84a4d-f6a5-4ef6-a5ca-32e9238756bd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:09.269573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-41a84a4d-f6a5-4ef6-a5ca-32e9238756bd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:09.400079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-41a84a4d-f6a5-4ef6-a5ca-32e9238756bd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:09.408467 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-41a84a4d-f6a5-4ef6-a5ca-32e9238756bd tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.152862 Aug 27 03:30:09.409034 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3405/6628] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:09 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:10.430653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e6a8a15-c003-43c2-9f75-f3504ae55458 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:10.431287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e6a8a15-c003-43c2-9f75-f3504ae55458 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:10.438157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e6a8a15-c003-43c2-9f75-f3504ae55458 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:10.438658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e6a8a15-c003-43c2-9f75-f3504ae55458 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:10.439121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e6a8a15-c003-43c2-9f75-f3504ae55458 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:10.439830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e6a8a15-c003-43c2-9f75-f3504ae55458 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:10.440303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e6a8a15-c003-43c2-9f75-f3504ae55458 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:10.440746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e6a8a15-c003-43c2-9f75-f3504ae55458 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:10.570641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6e6a8a15-c003-43c2-9f75-f3504ae55458 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:10.578938 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e6a8a15-c003-43c2-9f75-f3504ae55458 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.152696 Aug 27 03:30:10.579505 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3224/6629] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:10 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:11.600973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1d0e2599-69ce-458c-8268-ea1bd5508ae3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:11.601621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1d0e2599-69ce-458c-8268-ea1bd5508ae3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:11.609353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d0e2599-69ce-458c-8268-ea1bd5508ae3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:11.609884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d0e2599-69ce-458c-8268-ea1bd5508ae3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:11.610331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d0e2599-69ce-458c-8268-ea1bd5508ae3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:11.611031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d0e2599-69ce-458c-8268-ea1bd5508ae3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:11.611494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d0e2599-69ce-458c-8268-ea1bd5508ae3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:11.611930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1d0e2599-69ce-458c-8268-ea1bd5508ae3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:11.745936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1d0e2599-69ce-458c-8268-ea1bd5508ae3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:11.753909 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1d0e2599-69ce-458c-8268-ea1bd5508ae3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.156848 Aug 27 03:30:11.754519 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3406/6630] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:11 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:12.774667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c2db66e-8b83-4279-99a5-9b11c57ecfa0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:12.775298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c2db66e-8b83-4279-99a5-9b11c57ecfa0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:12.782343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2db66e-8b83-4279-99a5-9b11c57ecfa0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:12.782934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2db66e-8b83-4279-99a5-9b11c57ecfa0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:12.783391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2db66e-8b83-4279-99a5-9b11c57ecfa0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:12.784100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2db66e-8b83-4279-99a5-9b11c57ecfa0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:12.784581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2db66e-8b83-4279-99a5-9b11c57ecfa0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:12.785026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2db66e-8b83-4279-99a5-9b11c57ecfa0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:12.923109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2c2db66e-8b83-4279-99a5-9b11c57ecfa0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:12.930943 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c2db66e-8b83-4279-99a5-9b11c57ecfa0 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.160170 Aug 27 03:30:12.931543 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3225/6631] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:12 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:13.953244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b006276f-dbef-44af-802f-6b2b2f50446f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:13.953916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b006276f-dbef-44af-802f-6b2b2f50446f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:13.957120 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:30:13.957293 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 03:30:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 (ip 10.222.0.99) !!! Aug 27 03:30:13.964449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b006276f-dbef-44af-802f-6b2b2f50446f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:13.964940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b006276f-dbef-44af-802f-6b2b2f50446f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:13.965384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b006276f-dbef-44af-802f-6b2b2f50446f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:13.966295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b006276f-dbef-44af-802f-6b2b2f50446f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:13.967028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b006276f-dbef-44af-802f-6b2b2f50446f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:13.967451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b006276f-dbef-44af-802f-6b2b2f50446f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:14.107285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b006276f-dbef-44af-802f-6b2b2f50446f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:14.115342 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b006276f-dbef-44af-802f-6b2b2f50446f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.166650 Aug 27 03:30:14.115943 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3407/6632] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:13 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:15.136843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b8dfe197-86f9-4870-99c6-13abced1fd31 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:15.137475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b8dfe197-86f9-4870-99c6-13abced1fd31 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:15.145351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dfe197-86f9-4870-99c6-13abced1fd31 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:15.145884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dfe197-86f9-4870-99c6-13abced1fd31 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:15.146330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dfe197-86f9-4870-99c6-13abced1fd31 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:15.147034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dfe197-86f9-4870-99c6-13abced1fd31 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:15.147503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dfe197-86f9-4870-99c6-13abced1fd31 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:15.147943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8dfe197-86f9-4870-99c6-13abced1fd31 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:15.281015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b8dfe197-86f9-4870-99c6-13abced1fd31 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:15.289215 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b8dfe197-86f9-4870-99c6-13abced1fd31 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.156271 Aug 27 03:30:15.289816 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3226/6633] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:15 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:16.310540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d15c5bc3-6e73-49b4-91c0-8904f8a8f447 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:16.311212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d15c5bc3-6e73-49b4-91c0-8904f8a8f447 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:16.318273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c5bc3-6e73-49b4-91c0-8904f8a8f447 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.318752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c5bc3-6e73-49b4-91c0-8904f8a8f447 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.319188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c5bc3-6e73-49b4-91c0-8904f8a8f447 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.319914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c5bc3-6e73-49b4-91c0-8904f8a8f447 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:16.320367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c5bc3-6e73-49b4-91c0-8904f8a8f447 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:16.320797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d15c5bc3-6e73-49b4-91c0-8904f8a8f447 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:16.458568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d15c5bc3-6e73-49b4-91c0-8904f8a8f447 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:16.468094 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d15c5bc3-6e73-49b4-91c0-8904f8a8f447 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.161543 Aug 27 03:30:16.468672 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3408/6634] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:16 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:17.489540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5732e8bd-7dfb-45d0-ae3d-2080dd07004f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:17.490193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5732e8bd-7dfb-45d0-ae3d-2080dd07004f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:17.497059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5732e8bd-7dfb-45d0-ae3d-2080dd07004f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.497546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5732e8bd-7dfb-45d0-ae3d-2080dd07004f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.498111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5732e8bd-7dfb-45d0-ae3d-2080dd07004f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.498809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5732e8bd-7dfb-45d0-ae3d-2080dd07004f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:17.499268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5732e8bd-7dfb-45d0-ae3d-2080dd07004f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:17.499702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5732e8bd-7dfb-45d0-ae3d-2080dd07004f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:17.634057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5732e8bd-7dfb-45d0-ae3d-2080dd07004f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:17.642172 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5732e8bd-7dfb-45d0-ae3d-2080dd07004f tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.156518 Aug 27 03:30:17.642689 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3227/6635] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:17 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:18.663688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c3e9892-c832-4f71-b639-dc798095174c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:18.664230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4c3e9892-c832-4f71-b639-dc798095174c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:18.671655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3e9892-c832-4f71-b639-dc798095174c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:18.672221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3e9892-c832-4f71-b639-dc798095174c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:18.672659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3e9892-c832-4f71-b639-dc798095174c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:18.673349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3e9892-c832-4f71-b639-dc798095174c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:18.673840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3e9892-c832-4f71-b639-dc798095174c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:18.674267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3e9892-c832-4f71-b639-dc798095174c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:18.804459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4c3e9892-c832-4f71-b639-dc798095174c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:18.812845 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4c3e9892-c832-4f71-b639-dc798095174c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.153122 Aug 27 03:30:18.813425 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3409/6636] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:18 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:19.833986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7e87b102-1755-4c49-8929-a9fde6bcacf4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:19.834618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7e87b102-1755-4c49-8929-a9fde6bcacf4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:19.841466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e87b102-1755-4c49-8929-a9fde6bcacf4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:19.842265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e87b102-1755-4c49-8929-a9fde6bcacf4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:19.842692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e87b102-1755-4c49-8929-a9fde6bcacf4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:19.843425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e87b102-1755-4c49-8929-a9fde6bcacf4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:19.843889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e87b102-1755-4c49-8929-a9fde6bcacf4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:19.844326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e87b102-1755-4c49-8929-a9fde6bcacf4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:19.979567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7e87b102-1755-4c49-8929-a9fde6bcacf4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:19.987587 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7e87b102-1755-4c49-8929-a9fde6bcacf4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.157540 Aug 27 03:30:19.988165 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3228/6637] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:19 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:21.010587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2965c949-038c-4571-8a56-6f0b314d4a0e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:21.011119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2965c949-038c-4571-8a56-6f0b314d4a0e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:21.019426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2965c949-038c-4571-8a56-6f0b314d4a0e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:21.019907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2965c949-038c-4571-8a56-6f0b314d4a0e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:21.020494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2965c949-038c-4571-8a56-6f0b314d4a0e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:21.021197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2965c949-038c-4571-8a56-6f0b314d4a0e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:21.021817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2965c949-038c-4571-8a56-6f0b314d4a0e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:21.022249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2965c949-038c-4571-8a56-6f0b314d4a0e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:21.164423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2965c949-038c-4571-8a56-6f0b314d4a0e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:21.172195 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2965c949-038c-4571-8a56-6f0b314d4a0e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.166422 Aug 27 03:30:21.172781 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3410/6638] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:21 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:22.193958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-89117c0d-d788-4593-864c-e4ca663c43f5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:22.194518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-89117c0d-d788-4593-864c-e4ca663c43f5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:22.201403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89117c0d-d788-4593-864c-e4ca663c43f5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:22.201930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89117c0d-d788-4593-864c-e4ca663c43f5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:22.202379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89117c0d-d788-4593-864c-e4ca663c43f5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:22.203082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89117c0d-d788-4593-864c-e4ca663c43f5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:22.203543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89117c0d-d788-4593-864c-e4ca663c43f5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:22.203978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-89117c0d-d788-4593-864c-e4ca663c43f5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:22.206657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:22.338859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-89117c0d-d788-4593-864c-e4ca663c43f5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:22.347688 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-89117c0d-d788-4593-864c-e4ca663c43f5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.157911 Aug 27 03:30:22.348277 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3229/6639] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:22 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:23.368986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b6e09efd-0572-48e7-be02-f9c719378ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:23.369617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b6e09efd-0572-48e7-be02-f9c719378ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:23.377552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6e09efd-0572-48e7-be02-f9c719378ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:23.378096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6e09efd-0572-48e7-be02-f9c719378ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:23.378539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6e09efd-0572-48e7-be02-f9c719378ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:23.379249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6e09efd-0572-48e7-be02-f9c719378ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:23.379707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6e09efd-0572-48e7-be02-f9c719378ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:23.380140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b6e09efd-0572-48e7-be02-f9c719378ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:23.512407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b6e09efd-0572-48e7-be02-f9c719378ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:23.520471 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b6e09efd-0572-48e7-be02-f9c719378ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.155438 Aug 27 03:30:23.521058 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3411/6640] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:23 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:24.542340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b56d048-491f-4c5b-9d17-d6f23ff5cdf3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:24.542976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b56d048-491f-4c5b-9d17-d6f23ff5cdf3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:24.550618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b56d048-491f-4c5b-9d17-d6f23ff5cdf3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:24.551128 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b56d048-491f-4c5b-9d17-d6f23ff5cdf3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:24.551587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b56d048-491f-4c5b-9d17-d6f23ff5cdf3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:24.552296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b56d048-491f-4c5b-9d17-d6f23ff5cdf3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:24.552769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b56d048-491f-4c5b-9d17-d6f23ff5cdf3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:24.553213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b56d048-491f-4c5b-9d17-d6f23ff5cdf3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:24.688833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b56d048-491f-4c5b-9d17-d6f23ff5cdf3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:24.696610 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b56d048-491f-4c5b-9d17-d6f23ff5cdf3 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.158288 Aug 27 03:30:24.697188 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3230/6641] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:24 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:25.719736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-73b491e3-0e61-440d-adf5-c1003025f506 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:25.720273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-73b491e3-0e61-440d-adf5-c1003025f506 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:25.727260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73b491e3-0e61-440d-adf5-c1003025f506 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:25.727746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73b491e3-0e61-440d-adf5-c1003025f506 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:25.728189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73b491e3-0e61-440d-adf5-c1003025f506 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:25.728881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73b491e3-0e61-440d-adf5-c1003025f506 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:25.729341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73b491e3-0e61-440d-adf5-c1003025f506 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:25.729806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-73b491e3-0e61-440d-adf5-c1003025f506 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:25.860319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-73b491e3-0e61-440d-adf5-c1003025f506 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:25.868382 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-73b491e3-0e61-440d-adf5-c1003025f506 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1518 microversion: 2.1 time: 0.153681 Aug 27 03:30:25.868956 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3412/6642] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:25 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:26.683332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-781c789d-38b2-4346-b7b2-b15eb9865931 req-3dd195f9-2cd9-408d-8e51-58ff53f256d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf94df0-f0e9-4677-a4b4-1f0483392245", "name": "network-vif-unplugged", "status": "completed", "tag": "13e088c4-3f39-499a-89be-b756f4b7d557"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:26.696133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-781c789d-38b2-4346-b7b2-b15eb9865931 req-3dd195f9-2cd9-408d-8e51-58ff53f256d0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:26.696637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-781c789d-38b2-4346-b7b2-b15eb9865931 req-3dd195f9-2cd9-408d-8e51-58ff53f256d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:26.697157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-781c789d-38b2-4346-b7b2-b15eb9865931 req-3dd195f9-2cd9-408d-8e51-58ff53f256d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:26.710460 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-781c789d-38b2-4346-b7b2-b15eb9865931 req-3dd195f9-2cd9-408d-8e51-58ff53f256d0 service nova] Creating event network-vif-unplugged:13e088c4-3f39-499a-89be-b756f4b7d557 for instance dbf94df0-f0e9-4677-a4b4-1f0483392245 on n-h2-852084-5 Aug 27 03:30:26.717367 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-781c789d-38b2-4346-b7b2-b15eb9865931 req-3dd195f9-2cd9-408d-8e51-58ff53f256d0 service nova] Instance dbf94df0-f0e9-4677-a4b4-1f0483392245 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:30:26.729279 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-781c789d-38b2-4346-b7b2-b15eb9865931 req-3dd195f9-2cd9-408d-8e51-58ff53f256d0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051402 Aug 27 03:30:26.729948 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3231/6643] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:26.889299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3f9bef32-5ad7-4597-895e-bfcc507203f4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:26.889965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3f9bef32-5ad7-4597-895e-bfcc507203f4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:26.896886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f9bef32-5ad7-4597-895e-bfcc507203f4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:26.897383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f9bef32-5ad7-4597-895e-bfcc507203f4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:26.897855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f9bef32-5ad7-4597-895e-bfcc507203f4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:26.898763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f9bef32-5ad7-4597-895e-bfcc507203f4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:26.899223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f9bef32-5ad7-4597-895e-bfcc507203f4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:26.899656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3f9bef32-5ad7-4597-895e-bfcc507203f4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:27.046781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3f9bef32-5ad7-4597-895e-bfcc507203f4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:27.055201 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3f9bef32-5ad7-4597-895e-bfcc507203f4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1517 microversion: 2.1 time: 0.169956 Aug 27 03:30:27.056381 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3413/6644] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:26 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:28.079707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-59905d76-9457-40a3-a9aa-86d80bf6c2df tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:28.080355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-59905d76-9457-40a3-a9aa-86d80bf6c2df tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:28.082373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=34 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:28.088136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59905d76-9457-40a3-a9aa-86d80bf6c2df tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:28.088643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59905d76-9457-40a3-a9aa-86d80bf6c2df tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:28.089099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59905d76-9457-40a3-a9aa-86d80bf6c2df tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:28.089860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59905d76-9457-40a3-a9aa-86d80bf6c2df tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:28.090336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59905d76-9457-40a3-a9aa-86d80bf6c2df tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:28.090821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59905d76-9457-40a3-a9aa-86d80bf6c2df tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:28.247032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-59905d76-9457-40a3-a9aa-86d80bf6c2df tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:28.255950 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-59905d76-9457-40a3-a9aa-86d80bf6c2df tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1515 microversion: 2.1 time: 0.181981 Aug 27 03:30:28.256675 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3232/6645] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:28 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:29.039985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a4ae6faf-8539-41f3-919e-43573b7f8f7b req-1c7823bf-03d6-41c3-bf7d-0cf9fd6717b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf94df0-f0e9-4677-a4b4-1f0483392245", "tag": "13e088c4-3f39-499a-89be-b756f4b7d557"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:29.046433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=28 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:29.052536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a4ae6faf-8539-41f3-919e-43573b7f8f7b req-1c7823bf-03d6-41c3-bf7d-0cf9fd6717b3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.053019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a4ae6faf-8539-41f3-919e-43573b7f8f7b req-1c7823bf-03d6-41c3-bf7d-0cf9fd6717b3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.053456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a4ae6faf-8539-41f3-919e-43573b7f8f7b req-1c7823bf-03d6-41c3-bf7d-0cf9fd6717b3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.056537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=90 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:29.069613 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a4ae6faf-8539-41f3-919e-43573b7f8f7b req-1c7823bf-03d6-41c3-bf7d-0cf9fd6717b3 service nova] Creating event network-changed:13e088c4-3f39-499a-89be-b756f4b7d557 for instance dbf94df0-f0e9-4677-a4b4-1f0483392245 on n-h2-852084-5 Aug 27 03:30:29.076577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-a4ae6faf-8539-41f3-919e-43573b7f8f7b req-1c7823bf-03d6-41c3-bf7d-0cf9fd6717b3 service nova] Instance dbf94df0-f0e9-4677-a4b4-1f0483392245 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:30:29.088467 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a4ae6faf-8539-41f3-919e-43573b7f8f7b req-1c7823bf-03d6-41c3-bf7d-0cf9fd6717b3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052171 Aug 27 03:30:29.089090 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3414/6646] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:29.279507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e7990d3-74a2-4909-9100-7851dacd6d59 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:29.281431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9e7990d3-74a2-4909-9100-7851dacd6d59 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:29.288505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7990d3-74a2-4909-9100-7851dacd6d59 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.289007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7990d3-74a2-4909-9100-7851dacd6d59 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.289464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7990d3-74a2-4909-9100-7851dacd6d59 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.290209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7990d3-74a2-4909-9100-7851dacd6d59 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.290675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7990d3-74a2-4909-9100-7851dacd6d59 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.291115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e7990d3-74a2-4909-9100-7851dacd6d59 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.644521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9e7990d3-74a2-4909-9100-7851dacd6d59 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:29.653237 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9e7990d3-74a2-4909-9100-7851dacd6d59 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1512 microversion: 2.1 time: 0.378175 Aug 27 03:30:29.654173 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3233/6647] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:29 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:29.674754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f9a30897-fd42-4616-b96d-845e1532f6ba tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:29.675474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f9a30897-fd42-4616-b96d-845e1532f6ba tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:29.686984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9a30897-fd42-4616-b96d-845e1532f6ba tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.687752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9a30897-fd42-4616-b96d-845e1532f6ba tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.688569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9a30897-fd42-4616-b96d-845e1532f6ba tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.689346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9a30897-fd42-4616-b96d-845e1532f6ba tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.689855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9a30897-fd42-4616-b96d-845e1532f6ba tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.690284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9a30897-fd42-4616-b96d-845e1532f6ba tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.757217 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f9a30897-fd42-4616-b96d-845e1532f6ba tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "POST /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245/action" status: 204 len: 0 microversion: 2.1 time: 0.086806 Aug 27 03:30:29.758545 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3415/6648] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:30:29 2022] POST /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:30:29.767430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-be431c76-975a-4cba-8b74-54d6bfc8b61d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:29.768073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-be431c76-975a-4cba-8b74-54d6bfc8b61d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:29.774565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be431c76-975a-4cba-8b74-54d6bfc8b61d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.775208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be431c76-975a-4cba-8b74-54d6bfc8b61d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.775812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be431c76-975a-4cba-8b74-54d6bfc8b61d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:29.776576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be431c76-975a-4cba-8b74-54d6bfc8b61d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:29.777052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be431c76-975a-4cba-8b74-54d6bfc8b61d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:29.777556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be431c76-975a-4cba-8b74-54d6bfc8b61d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:30.221057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-be431c76-975a-4cba-8b74-54d6bfc8b61d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:30.230153 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-be431c76-975a-4cba-8b74-54d6bfc8b61d tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1512 microversion: 2.1 time: 0.467434 Aug 27 03:30:30.230751 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3234/6649] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:29 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:31.254726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-39a53b5e-de4b-4875-b491-920654abd0e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:31.255423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-39a53b5e-de4b-4875-b491-920654abd0e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:31.262303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39a53b5e-de4b-4875-b491-920654abd0e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:31.262874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39a53b5e-de4b-4875-b491-920654abd0e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:31.264082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39a53b5e-de4b-4875-b491-920654abd0e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:31.264901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39a53b5e-de4b-4875-b491-920654abd0e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:31.265613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39a53b5e-de4b-4875-b491-920654abd0e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:31.266250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39a53b5e-de4b-4875-b491-920654abd0e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:31.430921 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-39a53b5e-de4b-4875-b491-920654abd0e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:31.441081 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-39a53b5e-de4b-4875-b491-920654abd0e5 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1512 microversion: 2.1 time: 0.191585 Aug 27 03:30:31.445788 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3416/6650] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:31 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1512 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:31.553584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-afe2836f-2f45-4e57-9e6d-c6c6b1b3e37c req-2ed38c03-0885-4c45-951c-5439463a4073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf94df0-f0e9-4677-a4b4-1f0483392245", "name": "network-vif-plugged", "status": "completed", "tag": "13e088c4-3f39-499a-89be-b756f4b7d557"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:31.569662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-afe2836f-2f45-4e57-9e6d-c6c6b1b3e37c req-2ed38c03-0885-4c45-951c-5439463a4073 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:31.570224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-afe2836f-2f45-4e57-9e6d-c6c6b1b3e37c req-2ed38c03-0885-4c45-951c-5439463a4073 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:31.570662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-afe2836f-2f45-4e57-9e6d-c6c6b1b3e37c req-2ed38c03-0885-4c45-951c-5439463a4073 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:31.582985 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-afe2836f-2f45-4e57-9e6d-c6c6b1b3e37c req-2ed38c03-0885-4c45-951c-5439463a4073 service nova] Creating event network-vif-plugged:13e088c4-3f39-499a-89be-b756f4b7d557 for instance dbf94df0-f0e9-4677-a4b4-1f0483392245 on n-h2-852084-5 Aug 27 03:30:31.589153 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-afe2836f-2f45-4e57-9e6d-c6c6b1b3e37c req-2ed38c03-0885-4c45-951c-5439463a4073 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040269 Aug 27 03:30:31.590347 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3235/6651] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:32.464904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7e61b5fe-f343-4376-84a9-5d89910945c9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:32.465519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7e61b5fe-f343-4376-84a9-5d89910945c9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:32.472832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e61b5fe-f343-4376-84a9-5d89910945c9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.473321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e61b5fe-f343-4376-84a9-5d89910945c9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.473794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e61b5fe-f343-4376-84a9-5d89910945c9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.474542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e61b5fe-f343-4376-84a9-5d89910945c9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.475028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e61b5fe-f343-4376-84a9-5d89910945c9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.475456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e61b5fe-f343-4376-84a9-5d89910945c9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.615029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7e61b5fe-f343-4376-84a9-5d89910945c9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:32.623755 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7e61b5fe-f343-4376-84a9-5d89910945c9 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1504 microversion: 2.1 time: 0.162705 Aug 27 03:30:32.624359 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3417/6652] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:32 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:32.647398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a83f82c6-f1cb-4e57-ae61-b995b285cee8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:32.648036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a83f82c6-f1cb-4e57-ae61-b995b285cee8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:32.655480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a83f82c6-f1cb-4e57-ae61-b995b285cee8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.655987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a83f82c6-f1cb-4e57-ae61-b995b285cee8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.656444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a83f82c6-f1cb-4e57-ae61-b995b285cee8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.657174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a83f82c6-f1cb-4e57-ae61-b995b285cee8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.657649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a83f82c6-f1cb-4e57-ae61-b995b285cee8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.658134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a83f82c6-f1cb-4e57-ae61-b995b285cee8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.819003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a83f82c6-f1cb-4e57-ae61-b995b285cee8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:32.828799 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a83f82c6-f1cb-4e57-ae61-b995b285cee8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1504 microversion: 2.1 time: 0.185699 Aug 27 03:30:32.829475 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3236/6653] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:32 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:32.849483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7e06b612-da18-4ef2-b165-def7d544bb18 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:32.850123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7e06b612-da18-4ef2-b165-def7d544bb18 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:32.856275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e06b612-da18-4ef2-b165-def7d544bb18 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.857280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e06b612-da18-4ef2-b165-def7d544bb18 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.857753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e06b612-da18-4ef2-b165-def7d544bb18 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.858446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e06b612-da18-4ef2-b165-def7d544bb18 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:32.858907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e06b612-da18-4ef2-b165-def7d544bb18 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:32.859826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7e06b612-da18-4ef2-b165-def7d544bb18 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:32.991792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7e06b612-da18-4ef2-b165-def7d544bb18 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:33.000231 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7e06b612-da18-4ef2-b165-def7d544bb18 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1504 microversion: 2.1 time: 0.154656 Aug 27 03:30:33.000812 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3418/6654] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:32 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:33.020056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a22069ca-3d33-4b49-9b4f-957b18abbef2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:33.020560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a22069ca-3d33-4b49-9b4f-957b18abbef2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:33.027096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22069ca-3d33-4b49-9b4f-957b18abbef2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.027595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22069ca-3d33-4b49-9b4f-957b18abbef2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.028043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22069ca-3d33-4b49-9b4f-957b18abbef2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.028778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22069ca-3d33-4b49-9b4f-957b18abbef2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.029242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22069ca-3d33-4b49-9b4f-957b18abbef2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.029689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a22069ca-3d33-4b49-9b4f-957b18abbef2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.055788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a22069ca-3d33-4b49-9b4f-957b18abbef2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:30:33.138795 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a22069ca-3d33-4b49-9b4f-957b18abbef2 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "DELETE /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 204 len: 0 microversion: 2.1 time: 0.122050 Aug 27 03:30:33.139565 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3237/6655] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:33 2022] DELETE /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:30:33.158748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4d849e4-a37f-45ac-92d6-616d514664c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:33.159253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4d849e4-a37f-45ac-92d6-616d514664c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:33.165353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4d849e4-a37f-45ac-92d6-616d514664c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.165887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4d849e4-a37f-45ac-92d6-616d514664c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.166340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4d849e4-a37f-45ac-92d6-616d514664c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.167048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4d849e4-a37f-45ac-92d6-616d514664c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.167511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4d849e4-a37f-45ac-92d6-616d514664c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.167957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4d849e4-a37f-45ac-92d6-616d514664c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.195783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4d849e4-a37f-45ac-92d6-616d514664c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:30:33.250578 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.compute.api [None req-e4d849e4-a37f-45ac-92d6-616d514664c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Instance is already in deleting state, ignoring this request Aug 27 03:30:33.252057 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4d849e4-a37f-45ac-92d6-616d514664c8 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "DELETE /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 204 len: 0 microversion: 2.1 time: 0.098080 Aug 27 03:30:33.253510 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3419/6656] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:33 2022] DELETE /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:30:33.268968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fc703b4a-c84f-4f30-9ed2-559e64cc512e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:33.270780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fc703b4a-c84f-4f30-9ed2-559e64cc512e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:33.282983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc703b4a-c84f-4f30-9ed2-559e64cc512e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.283840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc703b4a-c84f-4f30-9ed2-559e64cc512e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.284813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc703b4a-c84f-4f30-9ed2-559e64cc512e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.286314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc703b4a-c84f-4f30-9ed2-559e64cc512e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:33.287277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc703b4a-c84f-4f30-9ed2-559e64cc512e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:33.288055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc703b4a-c84f-4f30-9ed2-559e64cc512e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:33.444108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fc703b4a-c84f-4f30-9ed2-559e64cc512e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:33.452929 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fc703b4a-c84f-4f30-9ed2-559e64cc512e tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1510 microversion: 2.1 time: 0.192421 Aug 27 03:30:33.453431 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3238/6657] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:33 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:30:34.475194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a7ee4e5d-a377-450c-b60d-5152464018ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:34.475818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a7ee4e5d-a377-450c-b60d-5152464018ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:34.482861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ee4e5d-a377-450c-b60d-5152464018ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:34.483348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ee4e5d-a377-450c-b60d-5152464018ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:34.483794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ee4e5d-a377-450c-b60d-5152464018ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.484508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ee4e5d-a377-450c-b60d-5152464018ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:34.484968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ee4e5d-a377-450c-b60d-5152464018ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:34.485395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7ee4e5d-a377-450c-b60d-5152464018ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.616153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a7ee4e5d-a377-450c-b60d-5152464018ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '818395e689094ddc92a40d45e4b82796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2175dca31a4e8a8cefe5108d1c6160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:34.624874 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a7ee4e5d-a377-450c-b60d-5152464018ee tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 200 len: 1510 microversion: 2.1 time: 0.153508 Aug 27 03:30:34.637778 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3420/6658] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:34 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:34.962404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-74c255ba-db85-475a-b5b7-b2b45cc89861 req-fc2c7f68-6624-48d3-9920-0f5c087aab93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf94df0-f0e9-4677-a4b4-1f0483392245", "name": "network-vif-deleted", "tag": "13e088c4-3f39-499a-89be-b756f4b7d557"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:34.974086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74c255ba-db85-475a-b5b7-b2b45cc89861 req-fc2c7f68-6624-48d3-9920-0f5c087aab93 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:34.974503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74c255ba-db85-475a-b5b7-b2b45cc89861 req-fc2c7f68-6624-48d3-9920-0f5c087aab93 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:34.974962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-74c255ba-db85-475a-b5b7-b2b45cc89861 req-fc2c7f68-6624-48d3-9920-0f5c087aab93 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:34.987805 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-74c255ba-db85-475a-b5b7-b2b45cc89861 req-fc2c7f68-6624-48d3-9920-0f5c087aab93 service nova] Creating event network-vif-deleted:13e088c4-3f39-499a-89be-b756f4b7d557 for instance dbf94df0-f0e9-4677-a4b4-1f0483392245 on n-h2-852084-5 Aug 27 03:30:34.992565 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-74c255ba-db85-475a-b5b7-b2b45cc89861 req-fc2c7f68-6624-48d3-9920-0f5c087aab93 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034059 Aug 27 03:30:34.993169 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3239/6659] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:35.646641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:35.647263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: dbf94df0-f0e9-4677-a4b4-1f0483392245] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:35.654226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:35.655279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:35.655725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:35.656425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:35.656887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:35.657318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:35.671589 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] HTTP exception thrown: Instance dbf94df0-f0e9-4677-a4b4-1f0483392245 could not be found. Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Request method failure captured: Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 HTTP/1.1 Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY91cOVUtyZQxS1FNQjCbsHdGDRpQ8OL9emzSJmkeLMUEPBABhefQGbG_JNRLdveTPQFwvSNzn65gzr9EelZ0okmydn-tNuhtMHtu19jwDwjlt4T_JIdq6ida9V_JQTPJv2Sx5a5dPozxg61JlhTKwulVwymm4mTjMu28j12QXX59S4 Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: ed2175dca31a4e8a8cefe5108d1c6160 Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerDiskConfigTestJSON-932969671 Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ed2175dca31a4e8a8cefe5108d1c6160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed2175dca31a4e8a8cefe5108d1c6160"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed2175dca31a4e8a8cefe5108d1c6160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ed2175dca31a4e8a8cefe5108d1c6160"}]}] Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerDiskConfigTestJSON-932969671 Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: ed2175dca31a4e8a8cefe5108d1c6160 Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-932969671 Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerDiskConfigTestJSON-932969671-project Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 818395e689094ddc92a40d45e4b82796 Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerDiskConfigTestJSON-932969671-project Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance dbf94df0-f0e9-4677-a4b4-1f0483392245 could not be found. Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'dbf94df0-f0e9-4677-a4b4-1f0483392245'} Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf94df0-f0e9-4677-a4b4-1f0483392245 could not be found. Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf94df0-f0e9-4677-a4b4-1f0483392245 could not be found. Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:35.673248 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:30:35.677794 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:35.677794 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:35.677794 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:35.677794 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:35.677794 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:35.677794 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf94df0-f0e9-4677-a4b4-1f0483392245 could not be found. Aug 27 03:30:35.677794 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:30:35.677794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Returning 404 to user: Instance dbf94df0-f0e9-4677-a4b4-1f0483392245 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:35.677794 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0e2bad4f-6a46-4a22-8f51-cce1ef160ce4 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245" status: 404 len: 111 microversion: 2.1 time: 0.032291 Aug 27 03:30:35.677794 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3421/6660] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:35 2022] GET /compute/v2.1/servers/dbf94df0-f0e9-4677-a4b4-1f0483392245 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:35.685226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-17d22bc9-6da6-4a12-9820-6dc43714b120 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '.version_select at 0x7f4d292abb80>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:35.705314 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-17d22bc9-6da6-4a12-9820-6dc43714b120 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134674564" status: 202 len: 0 microversion: 2.1 time: 0.024378 Aug 27 03:30:35.705931 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3240/6661] 10.222.0.99 () {58 vars in 1218 bytes} [Sat Aug 27 03:30:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134674564 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:30:36.322380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:36.322887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:36.330182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:36.330676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:36.331124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:36.331834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:36.332300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:36.332737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:36.347328 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] HTTP exception thrown: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Request method failure captured: Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 HTTP/1.1 Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY91cOVUtyZQxS1FNQjCbsHdGDRpQ8OL9emzSJmkeLMUEPBABhefQGbG_JNRLdveTPQFwvSNzn65gzr9EelZ0okmydn-tNuhtMHtu19jwDwjlt4T_JIdq6ida9V_JQTPJv2Sx5a5dPozxg61JlhTKwulVwymm4mTjMu28j12QXX59S4 Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: ed2175dca31a4e8a8cefe5108d1c6160 Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerDiskConfigTestJSON-932969671 Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ed2175dca31a4e8a8cefe5108d1c6160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed2175dca31a4e8a8cefe5108d1c6160"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed2175dca31a4e8a8cefe5108d1c6160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ed2175dca31a4e8a8cefe5108d1c6160"}]}] Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerDiskConfigTestJSON-932969671 Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: ed2175dca31a4e8a8cefe5108d1c6160 Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-932969671 Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerDiskConfigTestJSON-932969671-project Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 818395e689094ddc92a40d45e4b82796 Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerDiskConfigTestJSON-932969671-project Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '28951939-64cf-4b9c-bb90-6e90ab8cff43'} Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:36.348995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Returning 404 to user: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7eabd123-6ed2-4846-bfbd-664994f00832 tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "DELETE /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 404 len: 111 microversion: 2.1 time: 0.032041 Aug 27 03:30:36.353043 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3422/6662] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:30:36 2022] DELETE /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:36.360095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:36.360853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] [instance: 28951939-64cf-4b9c-bb90-6e90ab8cff43] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:36.367659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:36.368157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:36.368616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:36.369322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:36.369822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:36.370265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:36.383966 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] HTTP exception thrown: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Request method failure captured: Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 HTTP/1.1 Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY91cOVUtyZQxS1FNQjCbsHdGDRpQ8OL9emzSJmkeLMUEPBABhefQGbG_JNRLdveTPQFwvSNzn65gzr9EelZ0okmydn-tNuhtMHtu19jwDwjlt4T_JIdq6ida9V_JQTPJv2Sx5a5dPozxg61JlhTKwulVwymm4mTjMu28j12QXX59S4 Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: ed2175dca31a4e8a8cefe5108d1c6160 Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerDiskConfigTestJSON-932969671 Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ed2175dca31a4e8a8cefe5108d1c6160"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed2175dca31a4e8a8cefe5108d1c6160"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ed2175dca31a4e8a8cefe5108d1c6160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ed2175dca31a4e8a8cefe5108d1c6160"}]}] Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerDiskConfigTestJSON-932969671 Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: ed2175dca31a4e8a8cefe5108d1c6160 Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-932969671 Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerDiskConfigTestJSON-932969671-project Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 818395e689094ddc92a40d45e4b82796 Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerDiskConfigTestJSON-932969671-project Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '28951939-64cf-4b9c-bb90-6e90ab8cff43'} Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:30:36.385694 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:30:36.391561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:30:36.391561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:30:36.391561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:30:36.391561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:30:36.391561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:30:36.391561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. Aug 27 03:30:36.391561 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:30:36.391561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] Returning 404 to user: Instance 28951939-64cf-4b9c-bb90-6e90ab8cff43 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:30:36.391561 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-74ac9433-dd7a-41d1-9922-ec8b6666325c tempest-ServerDiskConfigTestJSON-932969671 tempest-ServerDiskConfigTestJSON-932969671-project] 10.222.0.99 "GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43" status: 404 len: 111 microversion: 2.1 time: 0.031945 Aug 27 03:30:36.391561 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3241/6663] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:36 2022] GET /compute/v2.1/servers/28951939-64cf-4b9c-bb90-6e90ab8cff43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:30:45.043793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ebc04bbe-cccb-42e3-89fd-256fd0efc1fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'create', calling method: .version_select at 0x7f4d2a7e5a60>, body: {"keypair": {"name": "tempest-keypair-1456137094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcRPnjeqFBSlMaDFaS7hU5mHEF3a+tql4n9+FLpB+k9V2VJZRzvaqjoEXNzQZp+Hfvp7zJ9rZNPEhwl1TQV6wWY4NsEnp54vEXhLQY/ewUWo+uf5x2XO1EA6FflzMssLA=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:45.060906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-ebc04bbe-cccb-42e3-89fd-256fd0efc1fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for project c84ffdee816a4661b43c497f40c8e577. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:30:45.066772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-ebc04bbe-cccb-42e3-89fd-256fd0efc1fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for user d26902bb305a470087e529c5f3949f78 and project c84ffdee816a4661b43c497f40c8e577. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:30:45.096562 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ebc04bbe-cccb-42e3-89fd-256fd0efc1fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.201997 Aug 27 03:30:45.097515 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3423/6664] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:30:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:46.446732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1376177952", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2acb4e25-8d10-4cfa-8683-cb18988ffad8"}], "security_groups": [{"name": "tempest-securitygroup--1463600712"}], "key_name": "tempest-keypair-1456137094", "user_data": "}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:46.456997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:46.457719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:46.569556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] validate_networks() for [('2acb4e25-8d10-4cfa-8683-cb18988ffad8', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:30:46.980637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:30:46.981077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:30:46.981563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:30:46.982016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:30:46.982489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:30:46.992678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:46.993271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:46.993854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:46.994661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:46.995197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:46.995864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:47.018260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:30:47.024457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for user d26902bb305a470087e529c5f3949f78 and project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:30:47.045527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:30:47.048603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:30:47.097552 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c6d06e6c-0b1d-4d7c-b53e-a71436bdbdc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.655124 Aug 27 03:30:47.098422 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3242/6665] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:30:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:30:47.107023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:47.111534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ee84abd-7762-414e-a74f-72f3b5df822e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:47.112147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ee84abd-7762-414e-a74f-72f3b5df822e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:47.185164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ee84abd-7762-414e-a74f-72f3b5df822e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:47.193263 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ee84abd-7762-414e-a74f-72f3b5df822e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1239 microversion: 2.1 time: 0.087880 Aug 27 03:30:47.205718 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3424/6666] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:47 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:48.219075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6d11084d-10ee-4886-bcae-f1fbb03854a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:48.219908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6d11084d-10ee-4886-bcae-f1fbb03854a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:48.227139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d11084d-10ee-4886-bcae-f1fbb03854a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:48.227736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d11084d-10ee-4886-bcae-f1fbb03854a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:48.228258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d11084d-10ee-4886-bcae-f1fbb03854a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:48.229053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d11084d-10ee-4886-bcae-f1fbb03854a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:48.229595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d11084d-10ee-4886-bcae-f1fbb03854a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:48.230160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d11084d-10ee-4886-bcae-f1fbb03854a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:48.327266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6d11084d-10ee-4886-bcae-f1fbb03854a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:48.343162 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6d11084d-10ee-4886-bcae-f1fbb03854a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1299 microversion: 2.1 time: 0.131757 Aug 27 03:30:48.343946 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3243/6667] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:48 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:49.364443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-39bc6324-f5da-4622-bc3a-812ee90813d7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:49.365063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-39bc6324-f5da-4622-bc3a-812ee90813d7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:49.376871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39bc6324-f5da-4622-bc3a-812ee90813d7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:49.377407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39bc6324-f5da-4622-bc3a-812ee90813d7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:49.377900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39bc6324-f5da-4622-bc3a-812ee90813d7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:49.378627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39bc6324-f5da-4622-bc3a-812ee90813d7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:49.379100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39bc6324-f5da-4622-bc3a-812ee90813d7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:49.379538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39bc6324-f5da-4622-bc3a-812ee90813d7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:49.520181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-39bc6324-f5da-4622-bc3a-812ee90813d7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:49.528042 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-39bc6324-f5da-4622-bc3a-812ee90813d7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1365 microversion: 2.1 time: 0.167465 Aug 27 03:30:49.528622 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3425/6668] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:49 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:49.694991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-debec5d6-b1b3-4049-9131-051a70c999db req-c34c8d0f-5294-4f41-afaa-a43a6c8d48be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b224e9c-1379-4616-ac9e-058c65ea9cff", "tag": "56f2fa56-302e-47a8-a6d7-4a59f5e533f0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:49.706368 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-debec5d6-b1b3-4049-9131-051a70c999db req-c34c8d0f-5294-4f41-afaa-a43a6c8d48be service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:49.706786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-debec5d6-b1b3-4049-9131-051a70c999db req-c34c8d0f-5294-4f41-afaa-a43a6c8d48be service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:49.707240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-debec5d6-b1b3-4049-9131-051a70c999db req-c34c8d0f-5294-4f41-afaa-a43a6c8d48be service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:49.719372 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-debec5d6-b1b3-4049-9131-051a70c999db req-c34c8d0f-5294-4f41-afaa-a43a6c8d48be service nova] Creating event network-changed:56f2fa56-302e-47a8-a6d7-4a59f5e533f0 for instance 3b224e9c-1379-4616-ac9e-058c65ea9cff on n-h2-852084-5 Aug 27 03:30:49.724318 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-debec5d6-b1b3-4049-9131-051a70c999db req-c34c8d0f-5294-4f41-afaa-a43a6c8d48be service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033485 Aug 27 03:30:49.724931 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3244/6669] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:30:50.550515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-03d2a5fa-41a4-4451-b4b1-222cfe776bac tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:50.551047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-03d2a5fa-41a4-4451-b4b1-222cfe776bac tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:50.558137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03d2a5fa-41a4-4451-b4b1-222cfe776bac tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:50.558624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03d2a5fa-41a4-4451-b4b1-222cfe776bac tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:50.559094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03d2a5fa-41a4-4451-b4b1-222cfe776bac tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:50.559802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03d2a5fa-41a4-4451-b4b1-222cfe776bac tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:50.560263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03d2a5fa-41a4-4451-b4b1-222cfe776bac tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:50.560698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03d2a5fa-41a4-4451-b4b1-222cfe776bac tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:50.690988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-03d2a5fa-41a4-4451-b4b1-222cfe776bac tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:50.698842 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-03d2a5fa-41a4-4451-b4b1-222cfe776bac tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1365 microversion: 2.1 time: 0.152336 Aug 27 03:30:50.699424 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3426/6670] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:50 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:51.720714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-701b0f21-e40f-41ad-ac26-ddb38b91fb48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:51.721435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-701b0f21-e40f-41ad-ac26-ddb38b91fb48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:51.727660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-701b0f21-e40f-41ad-ac26-ddb38b91fb48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:51.728165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-701b0f21-e40f-41ad-ac26-ddb38b91fb48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:51.728623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-701b0f21-e40f-41ad-ac26-ddb38b91fb48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:51.729333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-701b0f21-e40f-41ad-ac26-ddb38b91fb48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:51.729845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-701b0f21-e40f-41ad-ac26-ddb38b91fb48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:51.730294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-701b0f21-e40f-41ad-ac26-ddb38b91fb48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:51.864753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-701b0f21-e40f-41ad-ac26-ddb38b91fb48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:51.872527 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-701b0f21-e40f-41ad-ac26-ddb38b91fb48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1365 microversion: 2.1 time: 0.157352 Aug 27 03:30:51.873747 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3245/6671] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:51 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:52.894057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0cf0865e-3fbc-4a0a-9c2d-e1492a827016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:52.894673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0cf0865e-3fbc-4a0a-9c2d-e1492a827016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:52.901894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cf0865e-3fbc-4a0a-9c2d-e1492a827016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:52.902386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cf0865e-3fbc-4a0a-9c2d-e1492a827016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:52.902831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cf0865e-3fbc-4a0a-9c2d-e1492a827016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:52.903539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cf0865e-3fbc-4a0a-9c2d-e1492a827016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:52.903993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cf0865e-3fbc-4a0a-9c2d-e1492a827016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:52.904450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0cf0865e-3fbc-4a0a-9c2d-e1492a827016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:53.038946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0cf0865e-3fbc-4a0a-9c2d-e1492a827016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:53.047378 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0cf0865e-3fbc-4a0a-9c2d-e1492a827016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1365 microversion: 2.1 time: 0.157279 Aug 27 03:30:53.047943 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3427/6672] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:52 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:54.068674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d0204d97-bfa5-48e5-b928-c4016f30764d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:54.069308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d0204d97-bfa5-48e5-b928-c4016f30764d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:54.076164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0204d97-bfa5-48e5-b928-c4016f30764d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:54.076669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0204d97-bfa5-48e5-b928-c4016f30764d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:54.077257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0204d97-bfa5-48e5-b928-c4016f30764d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:54.077998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0204d97-bfa5-48e5-b928-c4016f30764d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:54.078478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0204d97-bfa5-48e5-b928-c4016f30764d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:54.078925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0204d97-bfa5-48e5-b928-c4016f30764d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:54.212299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d0204d97-bfa5-48e5-b928-c4016f30764d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:54.220866 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d0204d97-bfa5-48e5-b928-c4016f30764d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1365 microversion: 2.1 time: 0.156072 Aug 27 03:30:54.221441 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3246/6673] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:54 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:55.242286 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-939cca13-de6f-45f8-8aed-45cadfed910d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:55.242912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-939cca13-de6f-45f8-8aed-45cadfed910d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:55.250615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-939cca13-de6f-45f8-8aed-45cadfed910d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:55.251109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-939cca13-de6f-45f8-8aed-45cadfed910d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:55.251554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-939cca13-de6f-45f8-8aed-45cadfed910d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:55.252254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-939cca13-de6f-45f8-8aed-45cadfed910d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:55.252712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-939cca13-de6f-45f8-8aed-45cadfed910d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:55.253145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-939cca13-de6f-45f8-8aed-45cadfed910d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:55.383758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-939cca13-de6f-45f8-8aed-45cadfed910d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:55.391670 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-939cca13-de6f-45f8-8aed-45cadfed910d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1365 microversion: 2.1 time: 0.153368 Aug 27 03:30:55.392270 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3428/6674] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:55 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:55.624242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e6d6ff2e-2700-4d0e-9386-5b2a7d89f611 req-a24032a2-ea35-4214-aafd-07d0d8ff948c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b224e9c-1379-4616-ac9e-058c65ea9cff", "name": "network-vif-plugged", "status": "completed", "tag": "56f2fa56-302e-47a8-a6d7-4a59f5e533f0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:55.635395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e6d6ff2e-2700-4d0e-9386-5b2a7d89f611 req-a24032a2-ea35-4214-aafd-07d0d8ff948c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:55.635910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e6d6ff2e-2700-4d0e-9386-5b2a7d89f611 req-a24032a2-ea35-4214-aafd-07d0d8ff948c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:55.636351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e6d6ff2e-2700-4d0e-9386-5b2a7d89f611 req-a24032a2-ea35-4214-aafd-07d0d8ff948c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:55.648462 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e6d6ff2e-2700-4d0e-9386-5b2a7d89f611 req-a24032a2-ea35-4214-aafd-07d0d8ff948c service nova] Creating event network-vif-plugged:56f2fa56-302e-47a8-a6d7-4a59f5e533f0 for instance 3b224e9c-1379-4616-ac9e-058c65ea9cff on n-h2-852084-5 Aug 27 03:30:55.653532 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e6d6ff2e-2700-4d0e-9386-5b2a7d89f611 req-a24032a2-ea35-4214-aafd-07d0d8ff948c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033066 Aug 27 03:30:55.654319 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3247/6675] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:56.411761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4f01dde2-f340-4af5-a60b-64bbb552b70f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:56.412386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4f01dde2-f340-4af5-a60b-64bbb552b70f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:56.418571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f01dde2-f340-4af5-a60b-64bbb552b70f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:56.419031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f01dde2-f340-4af5-a60b-64bbb552b70f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:56.419473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f01dde2-f340-4af5-a60b-64bbb552b70f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:56.420179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f01dde2-f340-4af5-a60b-64bbb552b70f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:56.420640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f01dde2-f340-4af5-a60b-64bbb552b70f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:56.421070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4f01dde2-f340-4af5-a60b-64bbb552b70f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:56.551664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4f01dde2-f340-4af5-a60b-64bbb552b70f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:56.559822 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4f01dde2-f340-4af5-a60b-64bbb552b70f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1365 microversion: 2.1 time: 0.152259 Aug 27 03:30:56.560400 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3429/6676] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:56 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:57.579329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:57.580124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:57.584605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a1ac59a-9b42-4166-add6-4f89d22c4599 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:57.585325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1a1ac59a-9b42-4166-add6-4f89d22c4599 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:57.592673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1ac59a-9b42-4166-add6-4f89d22c4599 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:57.593170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1ac59a-9b42-4166-add6-4f89d22c4599 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:57.593629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1ac59a-9b42-4166-add6-4f89d22c4599 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:57.594373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1ac59a-9b42-4166-add6-4f89d22c4599 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:57.594845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1ac59a-9b42-4166-add6-4f89d22c4599 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:57.595291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a1ac59a-9b42-4166-add6-4f89d22c4599 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:57.726814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1a1ac59a-9b42-4166-add6-4f89d22c4599 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:30:57.735192 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1a1ac59a-9b42-4166-add6-4f89d22c4599 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1553 microversion: 2.1 time: 0.157214 Aug 27 03:30:57.735765 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3248/6677] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:30:57 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:30:57.755782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e90f733a-5c10-4d6b-a629-c551de6c4720 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:30:57.756314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e90f733a-5c10-4d6b-a629-c551de6c4720 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:30:57.758199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:30:57.764313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e90f733a-5c10-4d6b-a629-c551de6c4720 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:57.764801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e90f733a-5c10-4d6b-a629-c551de6c4720 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:57.765247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e90f733a-5c10-4d6b-a629-c551de6c4720 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:57.766009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e90f733a-5c10-4d6b-a629-c551de6c4720 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:57.766472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e90f733a-5c10-4d6b-a629-c551de6c4720 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:57.766901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e90f733a-5c10-4d6b-a629-c551de6c4720 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:57.849129 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e90f733a-5c10-4d6b-a629-c551de6c4720 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097195 Aug 27 03:30:57.849776 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3430/6678] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 03:30:57 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:30:59.168567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ccb71af1-f0fa-4094-bca0-99c063c1eb3b req-e92c5f30-9cc5-476f-9183-d81583e00445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b224e9c-1379-4616-ac9e-058c65ea9cff", "tag": "56f2fa56-302e-47a8-a6d7-4a59f5e533f0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:30:59.179158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ccb71af1-f0fa-4094-bca0-99c063c1eb3b req-e92c5f30-9cc5-476f-9183-d81583e00445 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:30:59.179656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ccb71af1-f0fa-4094-bca0-99c063c1eb3b req-e92c5f30-9cc5-476f-9183-d81583e00445 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:30:59.180124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ccb71af1-f0fa-4094-bca0-99c063c1eb3b req-e92c5f30-9cc5-476f-9183-d81583e00445 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:30:59.193006 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ccb71af1-f0fa-4094-bca0-99c063c1eb3b req-e92c5f30-9cc5-476f-9183-d81583e00445 service nova] Creating event network-changed:56f2fa56-302e-47a8-a6d7-4a59f5e533f0 for instance 3b224e9c-1379-4616-ac9e-058c65ea9cff on n-h2-852084-5 Aug 27 03:30:59.198730 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ccb71af1-f0fa-4094-bca0-99c063c1eb3b req-e92c5f30-9cc5-476f-9183-d81583e00445 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093653 Aug 27 03:30:59.199355 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3249/6679] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:35.340299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:35.341114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=34 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:35.345899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5e616fed-2634-444d-9b38-c05514c1b7ae tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.346516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5e616fed-2634-444d-9b38-c05514c1b7ae tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:35.353688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e616fed-2634-444d-9b38-c05514c1b7ae tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.354217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e616fed-2634-444d-9b38-c05514c1b7ae tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.354621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e616fed-2634-444d-9b38-c05514c1b7ae tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.355330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e616fed-2634-444d-9b38-c05514c1b7ae tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.355778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e616fed-2634-444d-9b38-c05514c1b7ae tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.356203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5e616fed-2634-444d-9b38-c05514c1b7ae tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.489519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5e616fed-2634-444d-9b38-c05514c1b7ae tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:35.497315 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5e616fed-2634-444d-9b38-c05514c1b7ae tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1671 microversion: 2.1 time: 0.158944 Aug 27 03:31:35.497941 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3431/6680] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:35 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:35.518017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-26553361-a154-430f-9610-ca87a661bb70 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.518745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26553361-a154-430f-9610-ca87a661bb70 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:35.521197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:35.521897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=32 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:35.528125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26553361-a154-430f-9610-ca87a661bb70 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.528625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26553361-a154-430f-9610-ca87a661bb70 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.529081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26553361-a154-430f-9610-ca87a661bb70 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.529823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26553361-a154-430f-9610-ca87a661bb70 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.530294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26553361-a154-430f-9610-ca87a661bb70 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.530737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26553361-a154-430f-9610-ca87a661bb70 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.669391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-26553361-a154-430f-9610-ca87a661bb70 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:35.677348 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-26553361-a154-430f-9610-ca87a661bb70 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1671 microversion: 2.1 time: 0.163865 Aug 27 03:31:35.677979 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3250/6681] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:35 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:35.697058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c39ebc1f-68a9-4921-8357-d1c2cb54ada8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.697698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c39ebc1f-68a9-4921-8357-d1c2cb54ada8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:35.703823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c39ebc1f-68a9-4921-8357-d1c2cb54ada8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.704318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c39ebc1f-68a9-4921-8357-d1c2cb54ada8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.705270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c39ebc1f-68a9-4921-8357-d1c2cb54ada8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.706032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c39ebc1f-68a9-4921-8357-d1c2cb54ada8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.706497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c39ebc1f-68a9-4921-8357-d1c2cb54ada8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.706930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c39ebc1f-68a9-4921-8357-d1c2cb54ada8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.841168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c39ebc1f-68a9-4921-8357-d1c2cb54ada8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:35.849926 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c39ebc1f-68a9-4921-8357-d1c2cb54ada8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1671 microversion: 2.1 time: 0.156738 Aug 27 03:31:35.850511 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3432/6682] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:35 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:35.870758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:35.873009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:35.879064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.879558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.880010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.880716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:35.881184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:35.881622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:35.910670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:35.916377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Old instance type m1.heat2, new instance type m1.heat {{(pid=122487) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:31:35.922725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:31:35.923191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:31:35.923719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:31:35.924143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:31:35.924570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:31:35.988599 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9f79c930-5e95-48cf-bfe1-522110fe8abb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff/action" status: 202 len: 0 microversion: 2.1 time: 0.122539 Aug 27 03:31:35.989380 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3251/6683] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:31:35 2022] POST /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:31:35.997841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e1de359f-a5c7-4e81-9b99-e3480d0e2836 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:35.998457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e1de359f-a5c7-4e81-9b99-e3480d0e2836 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:36.005089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1de359f-a5c7-4e81-9b99-e3480d0e2836 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.005584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1de359f-a5c7-4e81-9b99-e3480d0e2836 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.006093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1de359f-a5c7-4e81-9b99-e3480d0e2836 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.006795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1de359f-a5c7-4e81-9b99-e3480d0e2836 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:36.007261 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1de359f-a5c7-4e81-9b99-e3480d0e2836 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:36.007692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e1de359f-a5c7-4e81-9b99-e3480d0e2836 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:36.169358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e1de359f-a5c7-4e81-9b99-e3480d0e2836 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:36.177594 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e1de359f-a5c7-4e81-9b99-e3480d0e2836 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1680 microversion: 2.1 time: 0.183670 Aug 27 03:31:36.178351 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3433/6684] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:35 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:37.200115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-10637c5d-b5e8-4be5-b0b0-8a173de74e76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:37.200772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-10637c5d-b5e8-4be5-b0b0-8a173de74e76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:37.207786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10637c5d-b5e8-4be5-b0b0-8a173de74e76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:37.208290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10637c5d-b5e8-4be5-b0b0-8a173de74e76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:37.208743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10637c5d-b5e8-4be5-b0b0-8a173de74e76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:37.209463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10637c5d-b5e8-4be5-b0b0-8a173de74e76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:37.209969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10637c5d-b5e8-4be5-b0b0-8a173de74e76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:37.210415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-10637c5d-b5e8-4be5-b0b0-8a173de74e76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:37.442076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-10637c5d-b5e8-4be5-b0b0-8a173de74e76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:37.449955 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-10637c5d-b5e8-4be5-b0b0-8a173de74e76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1680 microversion: 2.1 time: 0.253788 Aug 27 03:31:37.450629 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3252/6685] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:37 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1680 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:38.472833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ca9021c3-ac7b-41b2-b531-f55505c106c6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:38.473452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ca9021c3-ac7b-41b2-b531-f55505c106c6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:38.480433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca9021c3-ac7b-41b2-b531-f55505c106c6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:38.480918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca9021c3-ac7b-41b2-b531-f55505c106c6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:38.481388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca9021c3-ac7b-41b2-b531-f55505c106c6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:38.482113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca9021c3-ac7b-41b2-b531-f55505c106c6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:38.482576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca9021c3-ac7b-41b2-b531-f55505c106c6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:38.483004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ca9021c3-ac7b-41b2-b531-f55505c106c6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:38.614099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ca9021c3-ac7b-41b2-b531-f55505c106c6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:38.622010 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ca9021c3-ac7b-41b2-b531-f55505c106c6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1685 microversion: 2.1 time: 0.153510 Aug 27 03:31:38.622588 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3434/6686] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:38 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:39.644057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ed826b5c-2e80-44cf-9ba8-4f95ee48a592 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:39.644666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ed826b5c-2e80-44cf-9ba8-4f95ee48a592 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:39.651796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed826b5c-2e80-44cf-9ba8-4f95ee48a592 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:39.652305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed826b5c-2e80-44cf-9ba8-4f95ee48a592 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:39.652765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed826b5c-2e80-44cf-9ba8-4f95ee48a592 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:39.653482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed826b5c-2e80-44cf-9ba8-4f95ee48a592 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:39.653994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed826b5c-2e80-44cf-9ba8-4f95ee48a592 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:39.654443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed826b5c-2e80-44cf-9ba8-4f95ee48a592 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:39.791011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ed826b5c-2e80-44cf-9ba8-4f95ee48a592 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:39.799480 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ed826b5c-2e80-44cf-9ba8-4f95ee48a592 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1685 microversion: 2.1 time: 0.159469 Aug 27 03:31:39.800068 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3253/6687] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:39 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:40.823683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e9f3a234-afbb-41ed-ba85-a31cf34d83d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:40.824328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e9f3a234-afbb-41ed-ba85-a31cf34d83d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:40.831896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9f3a234-afbb-41ed-ba85-a31cf34d83d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:40.832384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9f3a234-afbb-41ed-ba85-a31cf34d83d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:40.832833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9f3a234-afbb-41ed-ba85-a31cf34d83d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:40.833533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9f3a234-afbb-41ed-ba85-a31cf34d83d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:40.834020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9f3a234-afbb-41ed-ba85-a31cf34d83d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:40.834455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e9f3a234-afbb-41ed-ba85-a31cf34d83d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:40.965259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e9f3a234-afbb-41ed-ba85-a31cf34d83d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:40.973619 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e9f3a234-afbb-41ed-ba85-a31cf34d83d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1685 microversion: 2.1 time: 0.154468 Aug 27 03:31:40.974243 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3435/6688] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:40 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:41.995687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c9263284-130f-44b0-8b9a-f477efe5b24c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:41.996319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c9263284-130f-44b0-8b9a-f477efe5b24c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:42.003680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9263284-130f-44b0-8b9a-f477efe5b24c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:42.004162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9263284-130f-44b0-8b9a-f477efe5b24c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:42.004614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9263284-130f-44b0-8b9a-f477efe5b24c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:42.005320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9263284-130f-44b0-8b9a-f477efe5b24c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:42.005830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9263284-130f-44b0-8b9a-f477efe5b24c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:42.006274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9263284-130f-44b0-8b9a-f477efe5b24c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:42.135564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c9263284-130f-44b0-8b9a-f477efe5b24c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:42.144131 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c9263284-130f-44b0-8b9a-f477efe5b24c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1685 microversion: 2.1 time: 0.152310 Aug 27 03:31:42.144704 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3254/6689] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:41 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:43.165216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ac54075b-f327-4f16-a41c-6cc1d9e3f729 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:43.165904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ac54075b-f327-4f16-a41c-6cc1d9e3f729 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:43.172737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac54075b-f327-4f16-a41c-6cc1d9e3f729 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:43.173223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac54075b-f327-4f16-a41c-6cc1d9e3f729 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:43.173662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac54075b-f327-4f16-a41c-6cc1d9e3f729 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:43.174377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac54075b-f327-4f16-a41c-6cc1d9e3f729 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:43.174834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac54075b-f327-4f16-a41c-6cc1d9e3f729 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:43.175315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ac54075b-f327-4f16-a41c-6cc1d9e3f729 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:43.319280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ac54075b-f327-4f16-a41c-6cc1d9e3f729 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:43.327333 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ac54075b-f327-4f16-a41c-6cc1d9e3f729 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1685 microversion: 2.1 time: 0.165963 Aug 27 03:31:43.327923 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3436/6690] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:43 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:44.353175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-38b0a11f-3082-40c8-b5bc-e5d2369e4778 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:44.353851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-38b0a11f-3082-40c8-b5bc-e5d2369e4778 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:44.360761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38b0a11f-3082-40c8-b5bc-e5d2369e4778 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:44.361258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38b0a11f-3082-40c8-b5bc-e5d2369e4778 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:44.361728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38b0a11f-3082-40c8-b5bc-e5d2369e4778 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:44.363100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38b0a11f-3082-40c8-b5bc-e5d2369e4778 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:44.363572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38b0a11f-3082-40c8-b5bc-e5d2369e4778 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:44.364015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-38b0a11f-3082-40c8-b5bc-e5d2369e4778 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:44.492077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-38b0a11f-3082-40c8-b5bc-e5d2369e4778 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:44.499901 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-38b0a11f-3082-40c8-b5bc-e5d2369e4778 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1685 microversion: 2.1 time: 0.150674 Aug 27 03:31:44.500487 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3255/6691] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:44 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:45.520547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8db5e023-15f5-4cae-827b-2da771ba06d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:45.521162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8db5e023-15f5-4cae-827b-2da771ba06d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:45.528265 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8db5e023-15f5-4cae-827b-2da771ba06d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:45.528923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8db5e023-15f5-4cae-827b-2da771ba06d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:45.529545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8db5e023-15f5-4cae-827b-2da771ba06d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:45.530603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8db5e023-15f5-4cae-827b-2da771ba06d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:45.531325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8db5e023-15f5-4cae-827b-2da771ba06d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:45.532116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8db5e023-15f5-4cae-827b-2da771ba06d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:45.663480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8db5e023-15f5-4cae-827b-2da771ba06d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:45.672854 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8db5e023-15f5-4cae-827b-2da771ba06d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1685 microversion: 2.1 time: 0.156241 Aug 27 03:31:45.673435 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3437/6692] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:45 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:46.695355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8f5f1231-a7bf-4e91-b936-837df7418bd8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:46.695929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8f5f1231-a7bf-4e91-b936-837df7418bd8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:46.703167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8f5f1231-a7bf-4e91-b936-837df7418bd8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:46.703660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8f5f1231-a7bf-4e91-b936-837df7418bd8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:46.704106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8f5f1231-a7bf-4e91-b936-837df7418bd8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:46.704805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8f5f1231-a7bf-4e91-b936-837df7418bd8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:46.705266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8f5f1231-a7bf-4e91-b936-837df7418bd8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:46.706382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8f5f1231-a7bf-4e91-b936-837df7418bd8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:46.846280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8f5f1231-a7bf-4e91-b936-837df7418bd8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:46.854118 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8f5f1231-a7bf-4e91-b936-837df7418bd8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1685 microversion: 2.1 time: 0.162750 Aug 27 03:31:46.854697 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3256/6693] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:46 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:47.875471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c896523-d42f-493c-8376-46911dad8555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:47.876188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4c896523-d42f-493c-8376-46911dad8555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:47.883354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c896523-d42f-493c-8376-46911dad8555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:47.883848 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c896523-d42f-493c-8376-46911dad8555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:47.884321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c896523-d42f-493c-8376-46911dad8555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:47.885857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c896523-d42f-493c-8376-46911dad8555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:47.885857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c896523-d42f-493c-8376-46911dad8555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:47.886064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c896523-d42f-493c-8376-46911dad8555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:48.033136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4c896523-d42f-493c-8376-46911dad8555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:48.041148 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4c896523-d42f-493c-8376-46911dad8555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1685 microversion: 2.1 time: 0.169431 Aug 27 03:31:48.041959 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3438/6694] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:47 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:49.062808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-764d1c25-c1f9-4b3a-a853-1e362e8addc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:49.063366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-764d1c25-c1f9-4b3a-a853-1e362e8addc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:49.074536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-764d1c25-c1f9-4b3a-a853-1e362e8addc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:49.075443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-764d1c25-c1f9-4b3a-a853-1e362e8addc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:49.075896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-764d1c25-c1f9-4b3a-a853-1e362e8addc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:49.076614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-764d1c25-c1f9-4b3a-a853-1e362e8addc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:49.077087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-764d1c25-c1f9-4b3a-a853-1e362e8addc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:49.077532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-764d1c25-c1f9-4b3a-a853-1e362e8addc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:49.211059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-764d1c25-c1f9-4b3a-a853-1e362e8addc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:49.220395 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-764d1c25-c1f9-4b3a-a853-1e362e8addc4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1685 microversion: 2.1 time: 0.161608 Aug 27 03:31:49.221149 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3257/6695] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:49 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:50.244889 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a949edc-cc4d-4733-b05c-a9d5804556e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:50.245520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4a949edc-cc4d-4733-b05c-a9d5804556e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:50.253282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a949edc-cc4d-4733-b05c-a9d5804556e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:50.253877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a949edc-cc4d-4733-b05c-a9d5804556e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:50.254415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a949edc-cc4d-4733-b05c-a9d5804556e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:50.255186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a949edc-cc4d-4733-b05c-a9d5804556e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:50.255679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a949edc-cc4d-4733-b05c-a9d5804556e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:50.256295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a949edc-cc4d-4733-b05c-a9d5804556e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:50.402762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ba72a189-12ad-49e6-9943-d8b9b1fef27b req-ef291227-b1ed-47b7-9a72-345667834ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b224e9c-1379-4616-ac9e-058c65ea9cff", "name": "network-vif-unplugged", "status": "completed", "tag": "56f2fa56-302e-47a8-a6d7-4a59f5e533f0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:50.408494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4a949edc-cc4d-4733-b05c-a9d5804556e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:50.417154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ba72a189-12ad-49e6-9943-d8b9b1fef27b req-ef291227-b1ed-47b7-9a72-345667834ce9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:50.417457 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a949edc-cc4d-4733-b05c-a9d5804556e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1684 microversion: 2.1 time: 0.178412 Aug 27 03:31:50.418116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ba72a189-12ad-49e6-9943-d8b9b1fef27b req-ef291227-b1ed-47b7-9a72-345667834ce9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:50.418705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ba72a189-12ad-49e6-9943-d8b9b1fef27b req-ef291227-b1ed-47b7-9a72-345667834ce9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:50.418828 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3439/6696] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:50 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:50.442677 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ba72a189-12ad-49e6-9943-d8b9b1fef27b req-ef291227-b1ed-47b7-9a72-345667834ce9 service nova] Creating event network-vif-unplugged:56f2fa56-302e-47a8-a6d7-4a59f5e533f0 for instance 3b224e9c-1379-4616-ac9e-058c65ea9cff on n-h1-852084-5 Aug 27 03:31:50.449350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-ba72a189-12ad-49e6-9943-d8b9b1fef27b req-ef291227-b1ed-47b7-9a72-345667834ce9 service nova] Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:31:50.461871 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ba72a189-12ad-49e6-9943-d8b9b1fef27b req-ef291227-b1ed-47b7-9a72-345667834ce9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064033 Aug 27 03:31:50.462490 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3258/6697] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:51.442184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2e007f19-df56-4a50-acdc-10d73c5a964b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:51.442796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2e007f19-df56-4a50-acdc-10d73c5a964b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:51.449774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e007f19-df56-4a50-acdc-10d73c5a964b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:51.450304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e007f19-df56-4a50-acdc-10d73c5a964b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:51.450702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e007f19-df56-4a50-acdc-10d73c5a964b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:51.451406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e007f19-df56-4a50-acdc-10d73c5a964b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:51.451864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e007f19-df56-4a50-acdc-10d73c5a964b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:51.452290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e007f19-df56-4a50-acdc-10d73c5a964b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:51.585557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2e007f19-df56-4a50-acdc-10d73c5a964b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:51.593710 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2e007f19-df56-4a50-acdc-10d73c5a964b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1684 microversion: 2.1 time: 0.155994 Aug 27 03:31:51.594291 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3440/6698] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:51 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:52.508381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3b0df8eb-1521-4ccb-abe5-cb474fb645d1 req-21173931-9b6d-469a-9246-976a00870a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b224e9c-1379-4616-ac9e-058c65ea9cff", "tag": "56f2fa56-302e-47a8-a6d7-4a59f5e533f0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:52.517862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3b0df8eb-1521-4ccb-abe5-cb474fb645d1 req-21173931-9b6d-469a-9246-976a00870a3e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:52.518365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3b0df8eb-1521-4ccb-abe5-cb474fb645d1 req-21173931-9b6d-469a-9246-976a00870a3e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:52.519457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3b0df8eb-1521-4ccb-abe5-cb474fb645d1 req-21173931-9b6d-469a-9246-976a00870a3e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:52.530838 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3b0df8eb-1521-4ccb-abe5-cb474fb645d1 req-21173931-9b6d-469a-9246-976a00870a3e service nova] Creating event network-changed:56f2fa56-302e-47a8-a6d7-4a59f5e533f0 for instance 3b224e9c-1379-4616-ac9e-058c65ea9cff on n-h1-852084-5 Aug 27 03:31:52.536088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-3b0df8eb-1521-4ccb-abe5-cb474fb645d1 req-21173931-9b6d-469a-9246-976a00870a3e service nova] Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:31:52.546745 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3b0df8eb-1521-4ccb-abe5-cb474fb645d1 req-21173931-9b6d-469a-9246-976a00870a3e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043778 Aug 27 03:31:52.547329 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3259/6699] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:52.614934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-50fd78be-a360-4675-927b-59d75c12e6ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:52.615566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-50fd78be-a360-4675-927b-59d75c12e6ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:52.622907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50fd78be-a360-4675-927b-59d75c12e6ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:52.623399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50fd78be-a360-4675-927b-59d75c12e6ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:52.623845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50fd78be-a360-4675-927b-59d75c12e6ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:52.624550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50fd78be-a360-4675-927b-59d75c12e6ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:52.625010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50fd78be-a360-4675-927b-59d75c12e6ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:52.625442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-50fd78be-a360-4675-927b-59d75c12e6ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:52.774204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-50fd78be-a360-4675-927b-59d75c12e6ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:52.784384 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-50fd78be-a360-4675-927b-59d75c12e6ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1682 microversion: 2.1 time: 0.173388 Aug 27 03:31:52.784975 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3441/6700] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:52 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:53.807220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3da40966-e2e7-4829-9083-dc856cb37378 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:53.808030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3da40966-e2e7-4829-9083-dc856cb37378 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:53.814739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3da40966-e2e7-4829-9083-dc856cb37378 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:53.815336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3da40966-e2e7-4829-9083-dc856cb37378 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:53.816401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3da40966-e2e7-4829-9083-dc856cb37378 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:53.817149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3da40966-e2e7-4829-9083-dc856cb37378 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:53.817630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3da40966-e2e7-4829-9083-dc856cb37378 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:53.818105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3da40966-e2e7-4829-9083-dc856cb37378 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:53.954069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3da40966-e2e7-4829-9083-dc856cb37378 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:53.962668 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3da40966-e2e7-4829-9083-dc856cb37378 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1679 microversion: 2.1 time: 0.160687 Aug 27 03:31:53.963247 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3260/6701] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:53 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:53.984603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2ec64bb-eb76-4a98-84e1-bf67830d8e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:53.985133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f2ec64bb-eb76-4a98-84e1-bf67830d8e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:53.994697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2ec64bb-eb76-4a98-84e1-bf67830d8e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:53.995188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2ec64bb-eb76-4a98-84e1-bf67830d8e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:53.995632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2ec64bb-eb76-4a98-84e1-bf67830d8e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:53.996335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2ec64bb-eb76-4a98-84e1-bf67830d8e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:53.996793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2ec64bb-eb76-4a98-84e1-bf67830d8e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:53.997221 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2ec64bb-eb76-4a98-84e1-bf67830d8e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:54.058344 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f2ec64bb-eb76-4a98-84e1-bf67830d8e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff/action" status: 204 len: 0 microversion: 2.1 time: 0.077321 Aug 27 03:31:54.059101 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3442/6702] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:31:53 2022] POST /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:31:54.067684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ca552bd-e6b0-4ca4-9db6-45f484b40d79 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:54.068320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9ca552bd-e6b0-4ca4-9db6-45f484b40d79 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:54.075582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ca552bd-e6b0-4ca4-9db6-45f484b40d79 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:54.076123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ca552bd-e6b0-4ca4-9db6-45f484b40d79 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:54.076647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ca552bd-e6b0-4ca4-9db6-45f484b40d79 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:54.077868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ca552bd-e6b0-4ca4-9db6-45f484b40d79 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:54.078416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ca552bd-e6b0-4ca4-9db6-45f484b40d79 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:54.079106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ca552bd-e6b0-4ca4-9db6-45f484b40d79 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:54.306235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9ca552bd-e6b0-4ca4-9db6-45f484b40d79 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:54.314362 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9ca552bd-e6b0-4ca4-9db6-45f484b40d79 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1679 microversion: 2.1 time: 0.250753 Aug 27 03:31:54.314939 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3261/6703] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:54 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1679 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:55.337963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3b485782-70e5-43cb-9838-456d522a74a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.339372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3b485782-70e5-43cb-9838-456d522a74a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:55.346506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b485782-70e5-43cb-9838-456d522a74a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.347001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b485782-70e5-43cb-9838-456d522a74a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.347454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b485782-70e5-43cb-9838-456d522a74a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.348177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b485782-70e5-43cb-9838-456d522a74a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.348641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b485782-70e5-43cb-9838-456d522a74a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.349128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3b485782-70e5-43cb-9838-456d522a74a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.498808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3b485782-70e5-43cb-9838-456d522a74a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:55.508287 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3b485782-70e5-43cb-9838-456d522a74a1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1671 microversion: 2.1 time: 0.174860 Aug 27 03:31:55.509024 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3443/6704] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:55 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1671 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:55.530782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eaeefaff-9503-488a-b7ab-7283866fa38c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.531720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eaeefaff-9503-488a-b7ab-7283866fa38c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:55.541990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaeefaff-9503-488a-b7ab-7283866fa38c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.542503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaeefaff-9503-488a-b7ab-7283866fa38c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.542970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaeefaff-9503-488a-b7ab-7283866fa38c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.543715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaeefaff-9503-488a-b7ab-7283866fa38c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.544184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaeefaff-9503-488a-b7ab-7283866fa38c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.544638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eaeefaff-9503-488a-b7ab-7283866fa38c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.697792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eaeefaff-9503-488a-b7ab-7283866fa38c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:55.706048 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eaeefaff-9503-488a-b7ab-7283866fa38c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1671 microversion: 2.1 time: 0.179643 Aug 27 03:31:55.706661 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3262/6705] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:55 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:55.727385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a7d21b7a-3d1e-490b-947f-4bd059703eb0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.728103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a7d21b7a-3d1e-490b-947f-4bd059703eb0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:55.734610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7d21b7a-3d1e-490b-947f-4bd059703eb0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.735279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7d21b7a-3d1e-490b-947f-4bd059703eb0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.735866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7d21b7a-3d1e-490b-947f-4bd059703eb0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.736587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7d21b7a-3d1e-490b-947f-4bd059703eb0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.737156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7d21b7a-3d1e-490b-947f-4bd059703eb0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.738173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7d21b7a-3d1e-490b-947f-4bd059703eb0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.878362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a7d21b7a-3d1e-490b-947f-4bd059703eb0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:55.886289 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a7d21b7a-3d1e-490b-947f-4bd059703eb0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1671 microversion: 2.1 time: 0.162936 Aug 27 03:31:55.886876 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3444/6706] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:55 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:55.907399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8e6fe6db-6af6-402e-8bd7-0b62e7b97b33 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:55.907968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8e6fe6db-6af6-402e-8bd7-0b62e7b97b33 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:55.914668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e6fe6db-6af6-402e-8bd7-0b62e7b97b33 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.915167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e6fe6db-6af6-402e-8bd7-0b62e7b97b33 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.915626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e6fe6db-6af6-402e-8bd7-0b62e7b97b33 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.916388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e6fe6db-6af6-402e-8bd7-0b62e7b97b33 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:55.916846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e6fe6db-6af6-402e-8bd7-0b62e7b97b33 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:55.917293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8e6fe6db-6af6-402e-8bd7-0b62e7b97b33 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:55.945032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8e6fe6db-6af6-402e-8bd7-0b62e7b97b33 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:31:56.026231 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8e6fe6db-6af6-402e-8bd7-0b62e7b97b33 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 204 len: 0 microversion: 2.1 time: 0.122928 Aug 27 03:31:56.031603 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3263/6707] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:31:55 2022] DELETE /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:31:56.038864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1b2d332c-2d31-4316-9077-3d7ae643b73f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:56.040474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1b2d332c-2d31-4316-9077-3d7ae643b73f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:56.047973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b2d332c-2d31-4316-9077-3d7ae643b73f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:56.048733 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b2d332c-2d31-4316-9077-3d7ae643b73f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:56.049857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b2d332c-2d31-4316-9077-3d7ae643b73f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:56.049857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b2d332c-2d31-4316-9077-3d7ae643b73f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:56.050582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b2d332c-2d31-4316-9077-3d7ae643b73f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:56.051078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1b2d332c-2d31-4316-9077-3d7ae643b73f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:56.195140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1b2d332c-2d31-4316-9077-3d7ae643b73f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:56.203176 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1b2d332c-2d31-4316-9077-3d7ae643b73f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1677 microversion: 2.1 time: 0.171160 Aug 27 03:31:56.203787 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3445/6708] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:56 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:31:57.225487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1824268d-f84f-4f8d-9064-66fe1246807b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:57.226242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1824268d-f84f-4f8d-9064-66fe1246807b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:57.233200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1824268d-f84f-4f8d-9064-66fe1246807b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:57.233732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1824268d-f84f-4f8d-9064-66fe1246807b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:57.234198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1824268d-f84f-4f8d-9064-66fe1246807b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:57.234912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1824268d-f84f-4f8d-9064-66fe1246807b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:57.235387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1824268d-f84f-4f8d-9064-66fe1246807b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:57.235830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1824268d-f84f-4f8d-9064-66fe1246807b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:57.240669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:57.376381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1824268d-f84f-4f8d-9064-66fe1246807b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:57.384424 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1824268d-f84f-4f8d-9064-66fe1246807b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1677 microversion: 2.1 time: 0.163632 Aug 27 03:31:57.385011 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3264/6709] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:57 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:57.648954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c3c7829a-39ae-4b64-b3cf-04a9379b83b7 req-8ac4b3ca-9610-4fd2-89a9-2d5c07d41d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b224e9c-1379-4616-ac9e-058c65ea9cff", "name": "network-vif-plugged", "status": "completed", "tag": "56f2fa56-302e-47a8-a6d7-4a59f5e533f0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:57.663825 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c3c7829a-39ae-4b64-b3cf-04a9379b83b7 req-8ac4b3ca-9610-4fd2-89a9-2d5c07d41d8e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:57.664503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c3c7829a-39ae-4b64-b3cf-04a9379b83b7 req-8ac4b3ca-9610-4fd2-89a9-2d5c07d41d8e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:57.665119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c3c7829a-39ae-4b64-b3cf-04a9379b83b7 req-8ac4b3ca-9610-4fd2-89a9-2d5c07d41d8e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:57.677541 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c3c7829a-39ae-4b64-b3cf-04a9379b83b7 req-8ac4b3ca-9610-4fd2-89a9-2d5c07d41d8e service nova] Creating event network-vif-plugged:56f2fa56-302e-47a8-a6d7-4a59f5e533f0 for instance 3b224e9c-1379-4616-ac9e-058c65ea9cff on n-h1-852084-5 Aug 27 03:31:57.682927 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c3c7829a-39ae-4b64-b3cf-04a9379b83b7 req-8ac4b3ca-9610-4fd2-89a9-2d5c07d41d8e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037723 Aug 27 03:31:57.683722 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3446/6710] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:31:58.407634 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2b85da81-7454-42be-8021-7572e3688194 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:58.408565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2b85da81-7454-42be-8021-7572e3688194 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:58.416158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b85da81-7454-42be-8021-7572e3688194 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.416891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b85da81-7454-42be-8021-7572e3688194 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.417535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b85da81-7454-42be-8021-7572e3688194 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.419040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b85da81-7454-42be-8021-7572e3688194 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.419532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b85da81-7454-42be-8021-7572e3688194 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.420155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2b85da81-7454-42be-8021-7572e3688194 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.503741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2b85da81-7454-42be-8021-7572e3688194 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:31:58.513553 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2b85da81-7454-42be-8021-7572e3688194 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 200 len: 1609 microversion: 2.1 time: 0.110199 Aug 27 03:31:58.514301 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3265/6711] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:58 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 1609 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:31:58.564069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d3d67e32-419a-49f1-a1a1-38b2e8a6daf7 req-646d2ce5-e63e-4d41-82e5-394888c081e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b224e9c-1379-4616-ac9e-058c65ea9cff", "name": "network-vif-deleted", "tag": "56f2fa56-302e-47a8-a6d7-4a59f5e533f0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:58.575465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d3d67e32-419a-49f1-a1a1-38b2e8a6daf7 req-646d2ce5-e63e-4d41-82e5-394888c081e7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:58.575933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d3d67e32-419a-49f1-a1a1-38b2e8a6daf7 req-646d2ce5-e63e-4d41-82e5-394888c081e7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:58.576366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d3d67e32-419a-49f1-a1a1-38b2e8a6daf7 req-646d2ce5-e63e-4d41-82e5-394888c081e7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:58.581570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:31:58.590054 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d3d67e32-419a-49f1-a1a1-38b2e8a6daf7 req-646d2ce5-e63e-4d41-82e5-394888c081e7 service nova] Creating event network-vif-deleted:56f2fa56-302e-47a8-a6d7-4a59f5e533f0 for instance 3b224e9c-1379-4616-ac9e-058c65ea9cff on n-h1-852084-5 Aug 27 03:31:58.595131 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d3d67e32-419a-49f1-a1a1-38b2e8a6daf7 req-646d2ce5-e63e-4d41-82e5-394888c081e7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136628 Aug 27 03:31:58.595737 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3447/6712] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:31:59.536467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:59.537098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:59.544054 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:59.544558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:59.545021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:59.545758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:59.546234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:59.546682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:59.560319 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff HTTP/1.1 Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '3b224e9c-1379-4616-ac9e-058c65ea9cff'} Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:59.562008 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:31:59.566505 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:59.566505 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:59.566505 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:59.566505 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:31:59.566505 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:31:59.566505 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:31:59.566505 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:31:59.566505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:31:59.566505 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1a930270-e9ab-45ab-99c7-19ecd6c1fb0c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 404 len: 111 microversion: 2.1 time: 0.031018 Aug 27 03:31:59.566505 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3266/6713] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:59 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:31:59.580547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:31:59.582011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:31:59.589989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:59.590420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:59.590866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:59.591566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:31:59.592278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:31:59.592710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:31:59.606318 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff HTTP/1.1 Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '3b224e9c-1379-4616-ac9e-058c65ea9cff'} Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:31:59.607949 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:31:59.612581 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:31:59.612581 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:31:59.612581 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:31:59.612581 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:31:59.612581 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:31:59.612581 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:31:59.612581 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:31:59.612581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:31:59.612581 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-92179e26-9101-4094-b9a5-d8938c4139c4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 404 len: 111 microversion: 2.1 time: 0.033968 Aug 27 03:31:59.612581 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3448/6714] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:31:59 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:31:59.658481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1763439683", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "2acb4e25-8d10-4cfa-8683-cb18988ffad8"}], "security_groups": [{"name": "tempest-securitygroup--1463600712"}], "key_name": "tempest-keypair-1456137094", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:31:59.766268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] validate_networks() for [('2acb4e25-8d10-4cfa-8683-cb18988ffad8', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:32:00.135506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:00.135970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:00.136460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:00.136886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:00.137341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:00.146312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:00.146813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:00.147280 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:00.148020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:00.148496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:00.148937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:00.166382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:32:00.171670 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for user d26902bb305a470087e529c5f3949f78 and project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:32:00.184808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:32:00.187176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:32:00.232906 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-665b8ed9-5e4d-41b8-b046-452125dc49ff tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.578259 Aug 27 03:32:00.233554 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3267/6715] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:31:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:32:00.245422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9b6ff6d2-13cd-4dda-a5af-4b89fcc7d860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:00.246083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9b6ff6d2-13cd-4dda-a5af-4b89fcc7d860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:00.304112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9b6ff6d2-13cd-4dda-a5af-4b89fcc7d860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:00.311393 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9b6ff6d2-13cd-4dda-a5af-4b89fcc7d860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1239 microversion: 2.1 time: 0.069784 Aug 27 03:32:00.312058 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3449/6716] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:00 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:01.333581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e915aa9d-0203-42bb-b5ff-25eac1034e4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:01.334919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e915aa9d-0203-42bb-b5ff-25eac1034e4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:01.343011 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e915aa9d-0203-42bb-b5ff-25eac1034e4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:01.343687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e915aa9d-0203-42bb-b5ff-25eac1034e4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:01.344409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e915aa9d-0203-42bb-b5ff-25eac1034e4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:01.345162 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e915aa9d-0203-42bb-b5ff-25eac1034e4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:01.345817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e915aa9d-0203-42bb-b5ff-25eac1034e4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:01.346264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e915aa9d-0203-42bb-b5ff-25eac1034e4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:01.423206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e915aa9d-0203-42bb-b5ff-25eac1034e4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:01.432708 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e915aa9d-0203-42bb-b5ff-25eac1034e4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1297 microversion: 2.1 time: 0.104044 Aug 27 03:32:01.433502 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3268/6717] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:01 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:02.454747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b12b2695-6c14-4763-b1d2-04aa842f95e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:02.455365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b12b2695-6c14-4763-b1d2-04aa842f95e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:02.464114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12b2695-6c14-4763-b1d2-04aa842f95e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:02.464612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12b2695-6c14-4763-b1d2-04aa842f95e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:02.465060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12b2695-6c14-4763-b1d2-04aa842f95e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:02.465813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12b2695-6c14-4763-b1d2-04aa842f95e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:02.466276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12b2695-6c14-4763-b1d2-04aa842f95e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:02.466974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b12b2695-6c14-4763-b1d2-04aa842f95e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:02.606134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b12b2695-6c14-4763-b1d2-04aa842f95e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:02.615958 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b12b2695-6c14-4763-b1d2-04aa842f95e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1365 microversion: 2.1 time: 0.165022 Aug 27 03:32:02.616558 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3450/6718] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:02 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:02.621118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-fb4b3abe-c01e-438f-9f15-3f4d417ed123 req-90df915f-23d5-493d-83cb-a956396f8171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25346632-2828-49aa-b8d6-8044101343d9", "tag": "d7753918-2042-4a2a-a5a7-75cd0b9bb32d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:02.632660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fb4b3abe-c01e-438f-9f15-3f4d417ed123 req-90df915f-23d5-493d-83cb-a956396f8171 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:02.633125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fb4b3abe-c01e-438f-9f15-3f4d417ed123 req-90df915f-23d5-493d-83cb-a956396f8171 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:02.633623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fb4b3abe-c01e-438f-9f15-3f4d417ed123 req-90df915f-23d5-493d-83cb-a956396f8171 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:02.646029 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-fb4b3abe-c01e-438f-9f15-3f4d417ed123 req-90df915f-23d5-493d-83cb-a956396f8171 service nova] Creating event network-changed:d7753918-2042-4a2a-a5a7-75cd0b9bb32d for instance 25346632-2828-49aa-b8d6-8044101343d9 on n-h2-852084-5 Aug 27 03:32:02.652513 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-fb4b3abe-c01e-438f-9f15-3f4d417ed123 req-90df915f-23d5-493d-83cb-a956396f8171 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037011 Aug 27 03:32:02.653831 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3269/6719] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:03.638298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9d43e58c-a7ed-4a0e-b8ca-01f3c1d2629c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:03.638968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9d43e58c-a7ed-4a0e-b8ca-01f3c1d2629c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:03.646550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d43e58c-a7ed-4a0e-b8ca-01f3c1d2629c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:03.647041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d43e58c-a7ed-4a0e-b8ca-01f3c1d2629c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:03.647488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d43e58c-a7ed-4a0e-b8ca-01f3c1d2629c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:03.648189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d43e58c-a7ed-4a0e-b8ca-01f3c1d2629c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:03.648650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d43e58c-a7ed-4a0e-b8ca-01f3c1d2629c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:03.649082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9d43e58c-a7ed-4a0e-b8ca-01f3c1d2629c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:03.778541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9d43e58c-a7ed-4a0e-b8ca-01f3c1d2629c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:03.786365 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9d43e58c-a7ed-4a0e-b8ca-01f3c1d2629c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1365 microversion: 2.1 time: 0.152062 Aug 27 03:32:03.786942 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3451/6720] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:03 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:04.810961 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a951188-95fe-4f97-af80-b0753a583575 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:04.812098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a951188-95fe-4f97-af80-b0753a583575 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:04.821569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a951188-95fe-4f97-af80-b0753a583575 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:04.822381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a951188-95fe-4f97-af80-b0753a583575 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:04.823068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a951188-95fe-4f97-af80-b0753a583575 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:04.824167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a951188-95fe-4f97-af80-b0753a583575 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:04.824894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a951188-95fe-4f97-af80-b0753a583575 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:04.825581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a951188-95fe-4f97-af80-b0753a583575 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:04.965282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a951188-95fe-4f97-af80-b0753a583575 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:04.975174 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a951188-95fe-4f97-af80-b0753a583575 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1365 microversion: 2.1 time: 0.170745 Aug 27 03:32:04.975990 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3270/6721] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:04 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:05.996372 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4e62b95-2473-4fac-a8fc-3de53131c16f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:05.996996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e4e62b95-2473-4fac-a8fc-3de53131c16f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:05.999966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=45 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:06.005961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4e62b95-2473-4fac-a8fc-3de53131c16f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:06.006466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4e62b95-2473-4fac-a8fc-3de53131c16f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:06.006916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4e62b95-2473-4fac-a8fc-3de53131c16f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:06.007634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4e62b95-2473-4fac-a8fc-3de53131c16f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:06.008099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4e62b95-2473-4fac-a8fc-3de53131c16f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:06.008537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e4e62b95-2473-4fac-a8fc-3de53131c16f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:06.147692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e4e62b95-2473-4fac-a8fc-3de53131c16f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:06.155465 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4e62b95-2473-4fac-a8fc-3de53131c16f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1365 microversion: 2.1 time: 0.163023 Aug 27 03:32:06.156051 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3452/6722] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:05 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:07.182466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ba92f06-2508-4e4b-b97f-5ee3c1fc37b5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:07.183093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9ba92f06-2508-4e4b-b97f-5ee3c1fc37b5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:07.185316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:07.191752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ba92f06-2508-4e4b-b97f-5ee3c1fc37b5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:07.192246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ba92f06-2508-4e4b-b97f-5ee3c1fc37b5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:07.192701 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ba92f06-2508-4e4b-b97f-5ee3c1fc37b5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:07.193403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ba92f06-2508-4e4b-b97f-5ee3c1fc37b5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:07.193903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ba92f06-2508-4e4b-b97f-5ee3c1fc37b5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:07.194347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ba92f06-2508-4e4b-b97f-5ee3c1fc37b5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:07.327424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9ba92f06-2508-4e4b-b97f-5ee3c1fc37b5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:07.335379 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9ba92f06-2508-4e4b-b97f-5ee3c1fc37b5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1365 microversion: 2.1 time: 0.156890 Aug 27 03:32:07.335966 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3271/6723] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:07 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:08.070211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-53d1e27e-ec20-4f05-b9e9-2135d19ea236 req-d9e5561f-cf01-4678-9e7a-80a7a780dc7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25346632-2828-49aa-b8d6-8044101343d9", "name": "network-vif-plugged", "status": "completed", "tag": "d7753918-2042-4a2a-a5a7-75cd0b9bb32d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:08.083370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-53d1e27e-ec20-4f05-b9e9-2135d19ea236 req-d9e5561f-cf01-4678-9e7a-80a7a780dc7f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.084079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-53d1e27e-ec20-4f05-b9e9-2135d19ea236 req-d9e5561f-cf01-4678-9e7a-80a7a780dc7f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.084582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-53d1e27e-ec20-4f05-b9e9-2135d19ea236 req-d9e5561f-cf01-4678-9e7a-80a7a780dc7f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.097341 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-53d1e27e-ec20-4f05-b9e9-2135d19ea236 req-d9e5561f-cf01-4678-9e7a-80a7a780dc7f service nova] Creating event network-vif-plugged:d7753918-2042-4a2a-a5a7-75cd0b9bb32d for instance 25346632-2828-49aa-b8d6-8044101343d9 on n-h2-852084-5 Aug 27 03:32:08.102547 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-53d1e27e-ec20-4f05-b9e9-2135d19ea236 req-d9e5561f-cf01-4678-9e7a-80a7a780dc7f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036140 Aug 27 03:32:08.103218 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3453/6724] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:08.356436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-363c315a-9264-409c-9cd4-027806d33872 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:08.357094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-363c315a-9264-409c-9cd4-027806d33872 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:08.363985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-363c315a-9264-409c-9cd4-027806d33872 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.364484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-363c315a-9264-409c-9cd4-027806d33872 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.364938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-363c315a-9264-409c-9cd4-027806d33872 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.365647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-363c315a-9264-409c-9cd4-027806d33872 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:08.366143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-363c315a-9264-409c-9cd4-027806d33872 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:08.366595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-363c315a-9264-409c-9cd4-027806d33872 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:08.493705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-363c315a-9264-409c-9cd4-027806d33872 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:08.501641 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-363c315a-9264-409c-9cd4-027806d33872 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1365 microversion: 2.1 time: 0.149146 Aug 27 03:32:08.502828 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3272/6725] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:08 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:09.525483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f8124582-715f-43f6-a0f4-f4e431b86c83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:09.526209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f8124582-715f-43f6-a0f4-f4e431b86c83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:09.532570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8124582-715f-43f6-a0f4-f4e431b86c83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:09.533061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8124582-715f-43f6-a0f4-f4e431b86c83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:09.534176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8124582-715f-43f6-a0f4-f4e431b86c83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:09.534884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8124582-715f-43f6-a0f4-f4e431b86c83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:09.535347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8124582-715f-43f6-a0f4-f4e431b86c83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:09.535778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8124582-715f-43f6-a0f4-f4e431b86c83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:09.672729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f8124582-715f-43f6-a0f4-f4e431b86c83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:09.680951 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f8124582-715f-43f6-a0f4-f4e431b86c83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1553 microversion: 2.1 time: 0.160585 Aug 27 03:32:09.681544 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3454/6726] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:09 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:09.702284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b990b003-9876-49b1-9059-d2aa23a3d19e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:09.702791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b990b003-9876-49b1-9059-d2aa23a3d19e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:09.710202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b990b003-9876-49b1-9059-d2aa23a3d19e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:09.710693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b990b003-9876-49b1-9059-d2aa23a3d19e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:09.711152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b990b003-9876-49b1-9059-d2aa23a3d19e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:09.711856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b990b003-9876-49b1-9059-d2aa23a3d19e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:09.712317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b990b003-9876-49b1-9059-d2aa23a3d19e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:09.712753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b990b003-9876-49b1-9059-d2aa23a3d19e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:09.795733 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b990b003-9876-49b1-9059-d2aa23a3d19e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097336 Aug 27 03:32:09.796335 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3273/6727] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 03:32:09 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:10.746802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-160f9901-f4f7-4cd3-8d16-d261f397c1ce req-81c924fd-1c46-4515-bc4a-d8baa3155f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25346632-2828-49aa-b8d6-8044101343d9", "tag": "d7753918-2042-4a2a-a5a7-75cd0b9bb32d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:10.751694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:10.758508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-160f9901-f4f7-4cd3-8d16-d261f397c1ce req-81c924fd-1c46-4515-bc4a-d8baa3155f58 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:10.758961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-160f9901-f4f7-4cd3-8d16-d261f397c1ce req-81c924fd-1c46-4515-bc4a-d8baa3155f58 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:10.759400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-160f9901-f4f7-4cd3-8d16-d261f397c1ce req-81c924fd-1c46-4515-bc4a-d8baa3155f58 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:10.770794 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-160f9901-f4f7-4cd3-8d16-d261f397c1ce req-81c924fd-1c46-4515-bc4a-d8baa3155f58 service nova] Creating event network-changed:d7753918-2042-4a2a-a5a7-75cd0b9bb32d for instance 25346632-2828-49aa-b8d6-8044101343d9 on n-h2-852084-5 Aug 27 03:32:10.776551 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-160f9901-f4f7-4cd3-8d16-d261f397c1ce req-81c924fd-1c46-4515-bc4a-d8baa3155f58 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033436 Aug 27 03:32:10.777166 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3455/6728] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:32:43.728912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:43.728912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:43.730804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=5 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:43.731638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=44 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:43.736426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5bed6b6d-f130-4586-acae-b8c763934f46 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:43.744350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bed6b6d-f130-4586-acae-b8c763934f46 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.744859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bed6b6d-f130-4586-acae-b8c763934f46 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.745319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5bed6b6d-f130-4586-acae-b8c763934f46 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.769446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5bed6b6d-f130-4586-acae-b8c763934f46 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Going to try to stop instance {{(pid=122487) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:32:43.814905 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5bed6b6d-f130-4586-acae-b8c763934f46 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9/action" status: 202 len: 0 microversion: 2.1 time: 0.087874 Aug 27 03:32:43.815522 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3274/6729] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:32:43 2022] POST /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:43.823123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=7 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:43.824446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=31 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:32:43.828773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-93531a58-848c-47ad-86fd-3be6f1c6c200 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:43.829497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-93531a58-848c-47ad-86fd-3be6f1c6c200 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:43.837520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93531a58-848c-47ad-86fd-3be6f1c6c200 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.838052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93531a58-848c-47ad-86fd-3be6f1c6c200 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.838499 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93531a58-848c-47ad-86fd-3be6f1c6c200 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.839250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93531a58-848c-47ad-86fd-3be6f1c6c200 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:43.839699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93531a58-848c-47ad-86fd-3be6f1c6c200 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:43.840131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-93531a58-848c-47ad-86fd-3be6f1c6c200 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:43.980720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-93531a58-848c-47ad-86fd-3be6f1c6c200 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:43.988564 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-93531a58-848c-47ad-86fd-3be6f1c6c200 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1681 microversion: 2.1 time: 0.167633 Aug 27 03:32:43.989189 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3456/6730] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:43 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:45.012077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-678f6cce-a2ce-4dd0-91da-4393832c0269 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:45.012793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-678f6cce-a2ce-4dd0-91da-4393832c0269 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:45.019333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-678f6cce-a2ce-4dd0-91da-4393832c0269 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:45.019834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-678f6cce-a2ce-4dd0-91da-4393832c0269 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:45.020294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-678f6cce-a2ce-4dd0-91da-4393832c0269 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:45.021008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-678f6cce-a2ce-4dd0-91da-4393832c0269 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:45.021475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-678f6cce-a2ce-4dd0-91da-4393832c0269 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:45.021932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-678f6cce-a2ce-4dd0-91da-4393832c0269 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:45.159677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-678f6cce-a2ce-4dd0-91da-4393832c0269 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:45.169020 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-678f6cce-a2ce-4dd0-91da-4393832c0269 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1681 microversion: 2.1 time: 0.162029 Aug 27 03:32:45.169603 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3275/6731] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:45 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:46.191486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21ba28f1-aab0-4550-9c44-37ec3f43ad6d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:46.192105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21ba28f1-aab0-4550-9c44-37ec3f43ad6d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:46.199137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba28f1-aab0-4550-9c44-37ec3f43ad6d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.199632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba28f1-aab0-4550-9c44-37ec3f43ad6d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.200077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba28f1-aab0-4550-9c44-37ec3f43ad6d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.200787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba28f1-aab0-4550-9c44-37ec3f43ad6d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:46.201254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba28f1-aab0-4550-9c44-37ec3f43ad6d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:46.201700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ba28f1-aab0-4550-9c44-37ec3f43ad6d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:46.337754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-21ba28f1-aab0-4550-9c44-37ec3f43ad6d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:46.346214 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21ba28f1-aab0-4550-9c44-37ec3f43ad6d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1681 microversion: 2.1 time: 0.159341 Aug 27 03:32:46.346816 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3457/6732] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:46 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:47.367042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6d8e104b-8312-4070-98f4-dcf8d6ac5b06 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:47.367659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6d8e104b-8312-4070-98f4-dcf8d6ac5b06 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:47.374709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d8e104b-8312-4070-98f4-dcf8d6ac5b06 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:47.375211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d8e104b-8312-4070-98f4-dcf8d6ac5b06 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:47.375666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d8e104b-8312-4070-98f4-dcf8d6ac5b06 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:47.376387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d8e104b-8312-4070-98f4-dcf8d6ac5b06 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:47.376854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d8e104b-8312-4070-98f4-dcf8d6ac5b06 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:47.377297 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d8e104b-8312-4070-98f4-dcf8d6ac5b06 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:47.520572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6d8e104b-8312-4070-98f4-dcf8d6ac5b06 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:47.528872 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6d8e104b-8312-4070-98f4-dcf8d6ac5b06 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1681 microversion: 2.1 time: 0.165684 Aug 27 03:32:47.530156 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3276/6733] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:47 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:48.552100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-520308c9-067a-4e09-9e38-feadf9c98140 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:48.552725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-520308c9-067a-4e09-9e38-feadf9c98140 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:48.560032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520308c9-067a-4e09-9e38-feadf9c98140 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.560525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520308c9-067a-4e09-9e38-feadf9c98140 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.560975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520308c9-067a-4e09-9e38-feadf9c98140 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.561709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520308c9-067a-4e09-9e38-feadf9c98140 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:48.562170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520308c9-067a-4e09-9e38-feadf9c98140 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:48.562607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-520308c9-067a-4e09-9e38-feadf9c98140 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:48.713359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-520308c9-067a-4e09-9e38-feadf9c98140 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:48.724178 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-520308c9-067a-4e09-9e38-feadf9c98140 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1681 microversion: 2.1 time: 0.175949 Aug 27 03:32:48.725061 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3458/6734] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:48 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:49.748694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3c63856b-2b0e-4730-a79b-3c96219e6c71 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:49.749266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3c63856b-2b0e-4730-a79b-3c96219e6c71 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:49.756369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c63856b-2b0e-4730-a79b-3c96219e6c71 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.756872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c63856b-2b0e-4730-a79b-3c96219e6c71 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.757330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c63856b-2b0e-4730-a79b-3c96219e6c71 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.758129 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c63856b-2b0e-4730-a79b-3c96219e6c71 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:49.758555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c63856b-2b0e-4730-a79b-3c96219e6c71 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:49.759031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c63856b-2b0e-4730-a79b-3c96219e6c71 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:49.915164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3c63856b-2b0e-4730-a79b-3c96219e6c71 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:49.923909 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3c63856b-2b0e-4730-a79b-3c96219e6c71 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1681 microversion: 2.1 time: 0.179121 Aug 27 03:32:49.924529 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3277/6735] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:49 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:50.945414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1e5c639c-c02e-462e-8cdd-c21b93c8c386 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:50.946060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1e5c639c-c02e-462e-8cdd-c21b93c8c386 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:50.953093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e5c639c-c02e-462e-8cdd-c21b93c8c386 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:50.953590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e5c639c-c02e-462e-8cdd-c21b93c8c386 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:50.954067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e5c639c-c02e-462e-8cdd-c21b93c8c386 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:50.954780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e5c639c-c02e-462e-8cdd-c21b93c8c386 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:50.955249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e5c639c-c02e-462e-8cdd-c21b93c8c386 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:50.955681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1e5c639c-c02e-462e-8cdd-c21b93c8c386 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:51.096251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1e5c639c-c02e-462e-8cdd-c21b93c8c386 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:51.105349 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1e5c639c-c02e-462e-8cdd-c21b93c8c386 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1681 microversion: 2.1 time: 0.163920 Aug 27 03:32:51.106004 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3459/6736] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:50 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:52.129568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-62481d2d-2d19-4423-a49d-80ed10a41ed1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:52.130218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-62481d2d-2d19-4423-a49d-80ed10a41ed1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:52.137050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62481d2d-2d19-4423-a49d-80ed10a41ed1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:52.137555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62481d2d-2d19-4423-a49d-80ed10a41ed1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:52.138043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62481d2d-2d19-4423-a49d-80ed10a41ed1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:52.138747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62481d2d-2d19-4423-a49d-80ed10a41ed1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:52.139251 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62481d2d-2d19-4423-a49d-80ed10a41ed1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:52.139693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62481d2d-2d19-4423-a49d-80ed10a41ed1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:52.280844 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-62481d2d-2d19-4423-a49d-80ed10a41ed1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:52.289343 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-62481d2d-2d19-4423-a49d-80ed10a41ed1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1681 microversion: 2.1 time: 0.163771 Aug 27 03:32:52.290041 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3278/6737] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:52 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:53.311855 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94bebd3b-4702-4535-82e2-88bd8f178c89 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:53.312528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-94bebd3b-4702-4535-82e2-88bd8f178c89 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:53.320717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bebd3b-4702-4535-82e2-88bd8f178c89 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:53.321280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bebd3b-4702-4535-82e2-88bd8f178c89 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:53.321827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bebd3b-4702-4535-82e2-88bd8f178c89 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:53.322642 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bebd3b-4702-4535-82e2-88bd8f178c89 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:53.323155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bebd3b-4702-4535-82e2-88bd8f178c89 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:53.323637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bebd3b-4702-4535-82e2-88bd8f178c89 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:53.472111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-94bebd3b-4702-4535-82e2-88bd8f178c89 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:53.480610 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-94bebd3b-4702-4535-82e2-88bd8f178c89 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1681 microversion: 2.1 time: 0.172593 Aug 27 03:32:53.481209 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3460/6738] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:53 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:54.503482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e4107663-6e2d-4a8d-9a98-e92c0c20fa3c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.504111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e4107663-6e2d-4a8d-9a98-e92c0c20fa3c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:54.511737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4107663-6e2d-4a8d-9a98-e92c0c20fa3c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.512262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4107663-6e2d-4a8d-9a98-e92c0c20fa3c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.512728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4107663-6e2d-4a8d-9a98-e92c0c20fa3c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.513484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4107663-6e2d-4a8d-9a98-e92c0c20fa3c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.514000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4107663-6e2d-4a8d-9a98-e92c0c20fa3c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.514454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e4107663-6e2d-4a8d-9a98-e92c0c20fa3c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.668077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e4107663-6e2d-4a8d-9a98-e92c0c20fa3c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.677171 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e4107663-6e2d-4a8d-9a98-e92c0c20fa3c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1658 microversion: 2.1 time: 0.178147 Aug 27 03:32:54.677788 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3279/6739] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:54 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1658 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:54.699250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:54.701574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:54.709590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.710119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.710580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.711321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.711793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.712225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.748864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:54.756070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Old instance type m1.heat2, new instance type m1.heat {{(pid=122488) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:32:54.763486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:32:54.763903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:32:54.764377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:32:54.764788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:32:54.765203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:32:54.841802 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d00eb7fd-063a-4f4a-8877-86f973e79330 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9/action" status: 202 len: 0 microversion: 2.1 time: 0.146160 Aug 27 03:32:54.842450 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3461/6740] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:32:54 2022] POST /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:32:54.854096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c8f18cf5-bd67-4102-8f2e-2d87f2d260ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:54.854373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c8f18cf5-bd67-4102-8f2e-2d87f2d260ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:54.860988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8f18cf5-bd67-4102-8f2e-2d87f2d260ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.861495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8f18cf5-bd67-4102-8f2e-2d87f2d260ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.861974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8f18cf5-bd67-4102-8f2e-2d87f2d260ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:54.862719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8f18cf5-bd67-4102-8f2e-2d87f2d260ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:54.863190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8f18cf5-bd67-4102-8f2e-2d87f2d260ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:54.863632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8f18cf5-bd67-4102-8f2e-2d87f2d260ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:55.027391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c8f18cf5-bd67-4102-8f2e-2d87f2d260ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:55.036828 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c8f18cf5-bd67-4102-8f2e-2d87f2d260ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1681 microversion: 2.1 time: 0.187628 Aug 27 03:32:55.037748 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3280/6741] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:54 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:56.072272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd47a442-1066-4f5a-abca-5ef9c93cddc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:56.072933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd47a442-1066-4f5a-abca-5ef9c93cddc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:56.080105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd47a442-1066-4f5a-abca-5ef9c93cddc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.080609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd47a442-1066-4f5a-abca-5ef9c93cddc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.081620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd47a442-1066-4f5a-abca-5ef9c93cddc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.082398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd47a442-1066-4f5a-abca-5ef9c93cddc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:56.082866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd47a442-1066-4f5a-abca-5ef9c93cddc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:56.083302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd47a442-1066-4f5a-abca-5ef9c93cddc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:56.233241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd47a442-1066-4f5a-abca-5ef9c93cddc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:56.256928 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd47a442-1066-4f5a-abca-5ef9c93cddc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1681 microversion: 2.1 time: 0.189657 Aug 27 03:32:56.258087 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3462/6742] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:56 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:57.281178 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-79680917-2fee-4360-ad9e-87d5d92d2e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:57.282315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-79680917-2fee-4360-ad9e-87d5d92d2e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:57.293939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79680917-2fee-4360-ad9e-87d5d92d2e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.294542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79680917-2fee-4360-ad9e-87d5d92d2e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.295012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79680917-2fee-4360-ad9e-87d5d92d2e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.296311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79680917-2fee-4360-ad9e-87d5d92d2e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:57.296912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79680917-2fee-4360-ad9e-87d5d92d2e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:57.297463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79680917-2fee-4360-ad9e-87d5d92d2e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:57.445021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-79680917-2fee-4360-ad9e-87d5d92d2e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:57.453477 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-79680917-2fee-4360-ad9e-87d5d92d2e1d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1686 microversion: 2.1 time: 0.178226 Aug 27 03:32:57.454146 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3281/6743] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:57 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:32:58.482455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9653a112-ed30-4719-bf15-9c783a172ccb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:58.483300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9653a112-ed30-4719-bf15-9c783a172ccb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:58.491828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9653a112-ed30-4719-bf15-9c783a172ccb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.492328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9653a112-ed30-4719-bf15-9c783a172ccb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.492776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9653a112-ed30-4719-bf15-9c783a172ccb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.493502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9653a112-ed30-4719-bf15-9c783a172ccb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:58.494003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9653a112-ed30-4719-bf15-9c783a172ccb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:58.494442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9653a112-ed30-4719-bf15-9c783a172ccb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:58.641046 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9653a112-ed30-4719-bf15-9c783a172ccb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:58.649258 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9653a112-ed30-4719-bf15-9c783a172ccb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1686 microversion: 2.1 time: 0.170843 Aug 27 03:32:58.649896 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3463/6744] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:58 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:32:59.331797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-cb9b9d54-73b7-4ad0-8119-265189556cf3 req-cd1b41a3-6a16-42e6-a658-3b89bc453818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25346632-2828-49aa-b8d6-8044101343d9", "name": "network-vif-unplugged", "status": "completed", "tag": "d7753918-2042-4a2a-a5a7-75cd0b9bb32d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:32:59.342997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cb9b9d54-73b7-4ad0-8119-265189556cf3 req-cd1b41a3-6a16-42e6-a658-3b89bc453818 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.343793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cb9b9d54-73b7-4ad0-8119-265189556cf3 req-cd1b41a3-6a16-42e6-a658-3b89bc453818 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.344245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-cb9b9d54-73b7-4ad0-8119-265189556cf3 req-cd1b41a3-6a16-42e6-a658-3b89bc453818 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.357449 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-cb9b9d54-73b7-4ad0-8119-265189556cf3 req-cd1b41a3-6a16-42e6-a658-3b89bc453818 service nova] Creating event network-vif-unplugged:d7753918-2042-4a2a-a5a7-75cd0b9bb32d for instance 25346632-2828-49aa-b8d6-8044101343d9 on n-h1-852084-5 Aug 27 03:32:59.364702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-cb9b9d54-73b7-4ad0-8119-265189556cf3 req-cd1b41a3-6a16-42e6-a658-3b89bc453818 service nova] Instance 25346632-2828-49aa-b8d6-8044101343d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:32:59.376291 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-cb9b9d54-73b7-4ad0-8119-265189556cf3 req-cd1b41a3-6a16-42e6-a658-3b89bc453818 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050231 Aug 27 03:32:59.376844 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3282/6745] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:32:59.671243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f4c57c86-a2b8-4990-aa18-eadf3a83d1e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:32:59.671971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f4c57c86-a2b8-4990-aa18-eadf3a83d1e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:32:59.679208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4c57c86-a2b8-4990-aa18-eadf3a83d1e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.679705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4c57c86-a2b8-4990-aa18-eadf3a83d1e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.680144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4c57c86-a2b8-4990-aa18-eadf3a83d1e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.680859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4c57c86-a2b8-4990-aa18-eadf3a83d1e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:32:59.681318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4c57c86-a2b8-4990-aa18-eadf3a83d1e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:32:59.681784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4c57c86-a2b8-4990-aa18-eadf3a83d1e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:32:59.826297 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f4c57c86-a2b8-4990-aa18-eadf3a83d1e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:32:59.835296 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f4c57c86-a2b8-4990-aa18-eadf3a83d1e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1685 microversion: 2.1 time: 0.167873 Aug 27 03:32:59.835900 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3464/6746] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:32:59 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:00.859379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5419d670-1749-4fc0-9efd-ed091dcc4a0f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:00.860101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5419d670-1749-4fc0-9efd-ed091dcc4a0f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:00.866833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5419d670-1749-4fc0-9efd-ed091dcc4a0f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:00.867353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5419d670-1749-4fc0-9efd-ed091dcc4a0f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:00.867796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5419d670-1749-4fc0-9efd-ed091dcc4a0f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:00.868513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5419d670-1749-4fc0-9efd-ed091dcc4a0f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:00.868988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5419d670-1749-4fc0-9efd-ed091dcc4a0f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:00.869435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5419d670-1749-4fc0-9efd-ed091dcc4a0f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.004596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5419d670-1749-4fc0-9efd-ed091dcc4a0f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:01.012353 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5419d670-1749-4fc0-9efd-ed091dcc4a0f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1683 microversion: 2.1 time: 0.158123 Aug 27 03:33:01.012931 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3283/6747] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:00 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:01.410633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-1ca1b858-4b6e-43b1-ab75-473b3ded157d req-03524def-af9d-452f-962c-5d0a2cf4c76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25346632-2828-49aa-b8d6-8044101343d9", "tag": "d7753918-2042-4a2a-a5a7-75cd0b9bb32d"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:01.421346 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1ca1b858-4b6e-43b1-ab75-473b3ded157d req-03524def-af9d-452f-962c-5d0a2cf4c76f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:01.421873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1ca1b858-4b6e-43b1-ab75-473b3ded157d req-03524def-af9d-452f-962c-5d0a2cf4c76f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:01.422318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-1ca1b858-4b6e-43b1-ab75-473b3ded157d req-03524def-af9d-452f-962c-5d0a2cf4c76f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:01.435951 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-1ca1b858-4b6e-43b1-ab75-473b3ded157d req-03524def-af9d-452f-962c-5d0a2cf4c76f service nova] Creating event network-changed:d7753918-2042-4a2a-a5a7-75cd0b9bb32d for instance 25346632-2828-49aa-b8d6-8044101343d9 on n-h1-852084-5 Aug 27 03:33:01.442180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-1ca1b858-4b6e-43b1-ab75-473b3ded157d req-03524def-af9d-452f-962c-5d0a2cf4c76f service nova] Instance 25346632-2828-49aa-b8d6-8044101343d9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:33:01.453284 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-1ca1b858-4b6e-43b1-ab75-473b3ded157d req-03524def-af9d-452f-962c-5d0a2cf4c76f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046962 Aug 27 03:33:01.454143 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3465/6748] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:02.034477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a43d994-38af-40c4-b27c-e9e3fcd47bec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.035142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4a43d994-38af-40c4-b27c-e9e3fcd47bec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:02.042223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a43d994-38af-40c4-b27c-e9e3fcd47bec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.042724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a43d994-38af-40c4-b27c-e9e3fcd47bec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.043179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a43d994-38af-40c4-b27c-e9e3fcd47bec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.043897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a43d994-38af-40c4-b27c-e9e3fcd47bec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.044365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a43d994-38af-40c4-b27c-e9e3fcd47bec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.044808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a43d994-38af-40c4-b27c-e9e3fcd47bec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.377926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4a43d994-38af-40c4-b27c-e9e3fcd47bec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.391123 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4a43d994-38af-40c4-b27c-e9e3fcd47bec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1679 microversion: 2.1 time: 0.361015 Aug 27 03:33:02.391736 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3284/6749] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:02 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1679 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:02.413768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ddd7f076-4c97-4559-9439-6d6c4c5dbc8b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:02.414427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ddd7f076-4c97-4559-9439-6d6c4c5dbc8b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:02.421781 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddd7f076-4c97-4559-9439-6d6c4c5dbc8b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.422279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddd7f076-4c97-4559-9439-6d6c4c5dbc8b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.422724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddd7f076-4c97-4559-9439-6d6c4c5dbc8b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.423426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddd7f076-4c97-4559-9439-6d6c4c5dbc8b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.423885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddd7f076-4c97-4559-9439-6d6c4c5dbc8b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.424312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddd7f076-4c97-4559-9439-6d6c4c5dbc8b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.486164 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ddd7f076-4c97-4559-9439-6d6c4c5dbc8b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9/action" status: 204 len: 0 microversion: 2.1 time: 0.077181 Aug 27 03:33:02.486972 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3466/6750] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:33:02 2022] POST /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:02.495127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-523f62d7-bf8d-43dc-bba4-ffd1f88569ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:02.495843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-523f62d7-bf8d-43dc-bba4-ffd1f88569ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:02.502327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523f62d7-bf8d-43dc-bba4-ffd1f88569ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.502913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523f62d7-bf8d-43dc-bba4-ffd1f88569ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.503362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523f62d7-bf8d-43dc-bba4-ffd1f88569ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.504179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523f62d7-bf8d-43dc-bba4-ffd1f88569ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:02.504653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523f62d7-bf8d-43dc-bba4-ffd1f88569ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:02.505196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-523f62d7-bf8d-43dc-bba4-ffd1f88569ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:02.722812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-523f62d7-bf8d-43dc-bba4-ffd1f88569ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:02.732596 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-523f62d7-bf8d-43dc-bba4-ffd1f88569ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1679 microversion: 2.1 time: 0.241338 Aug 27 03:33:02.733208 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3285/6751] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:02 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:03.755538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1bbdd62a-0183-4114-84ec-ae93a53da25a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:03.756245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1bbdd62a-0183-4114-84ec-ae93a53da25a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:03.762831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbdd62a-0183-4114-84ec-ae93a53da25a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.763314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbdd62a-0183-4114-84ec-ae93a53da25a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.763751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbdd62a-0183-4114-84ec-ae93a53da25a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.764448 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbdd62a-0183-4114-84ec-ae93a53da25a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.764904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbdd62a-0183-4114-84ec-ae93a53da25a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.765329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1bbdd62a-0183-4114-84ec-ae93a53da25a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.926629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1bbdd62a-0183-4114-84ec-ae93a53da25a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:03.934963 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1bbdd62a-0183-4114-84ec-ae93a53da25a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1658 microversion: 2.1 time: 0.185126 Aug 27 03:33:03.935609 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3467/6752] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:03 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1658 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:03.957199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b19b578f-d1c7-4e27-b357-c670cc922ad1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:03.957934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b19b578f-d1c7-4e27-b357-c670cc922ad1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:03.964980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b19b578f-d1c7-4e27-b357-c670cc922ad1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.965476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b19b578f-d1c7-4e27-b357-c670cc922ad1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.965954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b19b578f-d1c7-4e27-b357-c670cc922ad1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:03.966922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b19b578f-d1c7-4e27-b357-c670cc922ad1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:03.967400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b19b578f-d1c7-4e27-b357-c670cc922ad1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:03.967830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b19b578f-d1c7-4e27-b357-c670cc922ad1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.451392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b19b578f-d1c7-4e27-b357-c670cc922ad1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:04.460121 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b19b578f-d1c7-4e27-b357-c670cc922ad1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1658 microversion: 2.1 time: 0.507367 Aug 27 03:33:04.460720 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3286/6753] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:03 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1658 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:04.481707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-acdb88e8-24df-41fc-b0b7-7713bd1a21af tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:04.488197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acdb88e8-24df-41fc-b0b7-7713bd1a21af tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.488786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acdb88e8-24df-41fc-b0b7-7713bd1a21af tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.489195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-acdb88e8-24df-41fc-b0b7-7713bd1a21af tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.526741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-acdb88e8-24df-41fc-b0b7-7713bd1a21af tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Going to try to start instance {{(pid=122488) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 03:33:04.575099 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-acdb88e8-24df-41fc-b0b7-7713bd1a21af tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9/action" status: 202 len: 0 microversion: 2.1 time: 0.096689 Aug 27 03:33:04.576051 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3468/6754] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:33:04 2022] POST /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:04.589022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-152c8aae-6ee2-404c-bf04-81ad678d3d11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:04.589750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-152c8aae-6ee2-404c-bf04-81ad678d3d11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:04.598527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152c8aae-6ee2-404c-bf04-81ad678d3d11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.599032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152c8aae-6ee2-404c-bf04-81ad678d3d11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.599482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152c8aae-6ee2-404c-bf04-81ad678d3d11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.600198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152c8aae-6ee2-404c-bf04-81ad678d3d11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:04.600665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152c8aae-6ee2-404c-bf04-81ad678d3d11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:04.601101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-152c8aae-6ee2-404c-bf04-81ad678d3d11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:04.767937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-152c8aae-6ee2-404c-bf04-81ad678d3d11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:04.776408 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-152c8aae-6ee2-404c-bf04-81ad678d3d11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1667 microversion: 2.1 time: 0.191460 Aug 27 03:33:04.777193 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3287/6755] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:04 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1667 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:05.799992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a54f7b31-0977-4c93-b596-20a1e78136ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.800693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a54f7b31-0977-4c93-b596-20a1e78136ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:05.807212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a54f7b31-0977-4c93-b596-20a1e78136ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.807704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a54f7b31-0977-4c93-b596-20a1e78136ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.808141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a54f7b31-0977-4c93-b596-20a1e78136ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.808846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a54f7b31-0977-4c93-b596-20a1e78136ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:05.809307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a54f7b31-0977-4c93-b596-20a1e78136ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:05.809752 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a54f7b31-0977-4c93-b596-20a1e78136ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:05.826249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:05.963370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a54f7b31-0977-4c93-b596-20a1e78136ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:05.971688 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a54f7b31-0977-4c93-b596-20a1e78136ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1671 microversion: 2.1 time: 0.176942 Aug 27 03:33:05.972435 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3469/6756] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:05 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:05.996083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b5826e9a-01fc-4202-beef-3863b7267860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:05.996597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b5826e9a-01fc-4202-beef-3863b7267860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:06.003493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5826e9a-01fc-4202-beef-3863b7267860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.003992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5826e9a-01fc-4202-beef-3863b7267860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.004439 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5826e9a-01fc-4202-beef-3863b7267860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.005150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5826e9a-01fc-4202-beef-3863b7267860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.005845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5826e9a-01fc-4202-beef-3863b7267860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.006283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5826e9a-01fc-4202-beef-3863b7267860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.032931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b5826e9a-01fc-4202-beef-3863b7267860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:33:06.059821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-9c35d85a-ca75-4ecf-9581-675bd11da014 req-aa50bc08-a648-4e50-bdb4-d43e145a86a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25346632-2828-49aa-b8d6-8044101343d9", "name": "network-vif-plugged", "status": "completed", "tag": "d7753918-2042-4a2a-a5a7-75cd0b9bb32d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:06.071316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9c35d85a-ca75-4ecf-9581-675bd11da014 req-aa50bc08-a648-4e50-bdb4-d43e145a86a5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.071808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9c35d85a-ca75-4ecf-9581-675bd11da014 req-aa50bc08-a648-4e50-bdb4-d43e145a86a5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.072253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-9c35d85a-ca75-4ecf-9581-675bd11da014 req-aa50bc08-a648-4e50-bdb4-d43e145a86a5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.085646 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-9c35d85a-ca75-4ecf-9581-675bd11da014 req-aa50bc08-a648-4e50-bdb4-d43e145a86a5 service nova] Creating event network-vif-plugged:d7753918-2042-4a2a-a5a7-75cd0b9bb32d for instance 25346632-2828-49aa-b8d6-8044101343d9 on n-h1-852084-5 Aug 27 03:33:06.090980 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-9c35d85a-ca75-4ecf-9581-675bd11da014 req-aa50bc08-a648-4e50-bdb4-d43e145a86a5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106891 Aug 27 03:33:06.091814 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3288/6757] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:06.115300 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b5826e9a-01fc-4202-beef-3863b7267860 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "DELETE /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 204 len: 0 microversion: 2.1 time: 0.123180 Aug 27 03:33:06.115891 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3470/6758] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:33:05 2022] DELETE /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:33:06.124676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d269c7dc-904c-4c23-8bee-a4285124c8d3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:06.125404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d269c7dc-904c-4c23-8bee-a4285124c8d3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:06.132144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d269c7dc-904c-4c23-8bee-a4285124c8d3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.132637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d269c7dc-904c-4c23-8bee-a4285124c8d3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.133084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d269c7dc-904c-4c23-8bee-a4285124c8d3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.133818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d269c7dc-904c-4c23-8bee-a4285124c8d3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:06.134277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d269c7dc-904c-4c23-8bee-a4285124c8d3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:06.134710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d269c7dc-904c-4c23-8bee-a4285124c8d3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:06.273620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d269c7dc-904c-4c23-8bee-a4285124c8d3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:06.281602 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d269c7dc-904c-4c23-8bee-a4285124c8d3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1677 microversion: 2.1 time: 0.161140 Aug 27 03:33:06.282282 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3289/6759] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:06 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:07.304707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c5965805-b730-4bd5-aab2-66af8b724ae8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:07.305408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c5965805-b730-4bd5-aab2-66af8b724ae8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:07.319052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5965805-b730-4bd5-aab2-66af8b724ae8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.319543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5965805-b730-4bd5-aab2-66af8b724ae8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.319985 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5965805-b730-4bd5-aab2-66af8b724ae8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.320703 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5965805-b730-4bd5-aab2-66af8b724ae8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:07.321156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5965805-b730-4bd5-aab2-66af8b724ae8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:07.321582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c5965805-b730-4bd5-aab2-66af8b724ae8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:07.463831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c5965805-b730-4bd5-aab2-66af8b724ae8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:07.472412 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c5965805-b730-4bd5-aab2-66af8b724ae8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1677 microversion: 2.1 time: 0.171819 Aug 27 03:33:07.473007 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3471/6760] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:07 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:08.476249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-bf68332e-ae1d-4e45-80b0-dca6896498d8 req-1cea045e-391c-4c1c-9c8e-09251d44b9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25346632-2828-49aa-b8d6-8044101343d9", "name": "network-vif-deleted", "tag": "d7753918-2042-4a2a-a5a7-75cd0b9bb32d"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:08.488921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf68332e-ae1d-4e45-80b0-dca6896498d8 req-1cea045e-391c-4c1c-9c8e-09251d44b9e5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:08.488921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf68332e-ae1d-4e45-80b0-dca6896498d8 req-1cea045e-391c-4c1c-9c8e-09251d44b9e5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:08.488921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf68332e-ae1d-4e45-80b0-dca6896498d8 req-1cea045e-391c-4c1c-9c8e-09251d44b9e5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:08.494757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2cef7798-ddc2-4f5d-8afb-324d277f6a07 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:08.495373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2cef7798-ddc2-4f5d-8afb-324d277f6a07 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:08.500841 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-bf68332e-ae1d-4e45-80b0-dca6896498d8 req-1cea045e-391c-4c1c-9c8e-09251d44b9e5 service nova] Creating event network-vif-deleted:d7753918-2042-4a2a-a5a7-75cd0b9bb32d for instance 25346632-2828-49aa-b8d6-8044101343d9 on n-h1-852084-5 Aug 27 03:33:08.503193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cef7798-ddc2-4f5d-8afb-324d277f6a07 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:08.506072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cef7798-ddc2-4f5d-8afb-324d277f6a07 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:08.506239 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-bf68332e-ae1d-4e45-80b0-dca6896498d8 req-1cea045e-391c-4c1c-9c8e-09251d44b9e5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035045 Aug 27 03:33:08.506900 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3290/6761] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:33:08.507051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cef7798-ddc2-4f5d-8afb-324d277f6a07 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:08.508520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cef7798-ddc2-4f5d-8afb-324d277f6a07 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:08.509025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cef7798-ddc2-4f5d-8afb-324d277f6a07 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:08.509922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cef7798-ddc2-4f5d-8afb-324d277f6a07 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:08.597974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2cef7798-ddc2-4f5d-8afb-324d277f6a07 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:08.606560 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2cef7798-ddc2-4f5d-8afb-324d277f6a07 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 200 len: 1609 microversion: 2.1 time: 0.115767 Aug 27 03:33:08.607166 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3472/6762] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:08 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 1609 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:09.631071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:09.631926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:09.638578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.639173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.639763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.640434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.640823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.641257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.646572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:09.657960 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 HTTP/1.1 Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '25346632-2828-49aa-b8d6-8044101343d9'} Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:09.659691 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.664222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.664222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:09.664222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:09.664222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:09.664222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:09.664222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:33:09.664222 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.664222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:09.664222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b49b414e-d1f8-43bd-8a94-c6deddcf608c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 404 len: 111 microversion: 2.1 time: 0.036195 Aug 27 03:33:09.665357 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3291/6763] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:09 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:33:09.676992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:09.678120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:09.685570 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.686109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.686560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.687290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:09.687756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:09.688199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:09.706888 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 HTTP/1.1 Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '25346632-2828-49aa-b8d6-8044101343d9'} Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:33:09.708628 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.723323 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:33:09.723323 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:33:09.723323 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:33:09.723323 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:33:09.723323 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:33:09.723323 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:33:09.723323 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:33:09.723323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:33:09.723323 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ffd208e0-0a2f-4f88-a850-68d2bf9a547a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 404 len: 111 microversion: 2.1 time: 0.038013 Aug 27 03:33:09.723323 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3473/6764] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:09 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:33:09.763417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-936224832", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "2acb4e25-8d10-4cfa-8683-cb18988ffad8"}], "security_groups": [{"name": "tempest-securitygroup--1463600712"}], "key_name": "tempest-keypair-1456137094", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:09.911232 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] validate_networks() for [('2acb4e25-8d10-4cfa-8683-cb18988ffad8', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:33:10.354196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:33:10.354667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:33:10.355175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:33:10.355619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:33:10.356058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:33:10.365694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:10.366198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:10.366658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:10.367404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:10.367880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:10.368322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:10.385934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:33:10.391760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for user d26902bb305a470087e529c5f3949f78 and project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:33:10.405269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:33:10.407664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:33:10.456176 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d2e7f774-0d49-4532-8e56-f4c4779d6d91 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.696061 Aug 27 03:33:10.456823 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3292/6765] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:33:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 03:33:10.468013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dcc1b80a-84e3-4b81-8e03-fc5d34dd1337 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:10.468629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dcc1b80a-84e3-4b81-8e03-fc5d34dd1337 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:10.525256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dcc1b80a-84e3-4b81-8e03-fc5d34dd1337 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:10.532744 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dcc1b80a-84e3-4b81-8e03-fc5d34dd1337 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1238 microversion: 2.1 time: 0.068580 Aug 27 03:33:10.537738 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3474/6766] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:10 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:11.554434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e66051d9-0fd4-47ac-bf80-954b8c576560 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:11.555135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e66051d9-0fd4-47ac-bf80-954b8c576560 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:11.563076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e66051d9-0fd4-47ac-bf80-954b8c576560 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:11.563599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e66051d9-0fd4-47ac-bf80-954b8c576560 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:11.564113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e66051d9-0fd4-47ac-bf80-954b8c576560 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:11.565339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e66051d9-0fd4-47ac-bf80-954b8c576560 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:11.566147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e66051d9-0fd4-47ac-bf80-954b8c576560 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:11.566674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e66051d9-0fd4-47ac-bf80-954b8c576560 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:11.917823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e66051d9-0fd4-47ac-bf80-954b8c576560 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:11.927981 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e66051d9-0fd4-47ac-bf80-954b8c576560 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1296 microversion: 2.1 time: 0.378408 Aug 27 03:33:11.928567 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3293/6767] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:11 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1296 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:12.897121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f18396e0-7c70-4b1e-aee5-1be88a4eeb59 req-e1a2aa47-e127-4966-835e-64b5fc90b7bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e7098d-a3fb-4905-bb05-31076a6cdd3d", "tag": "31f78eb8-b0eb-4399-8729-fd95ef76ea29"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:12.912540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f18396e0-7c70-4b1e-aee5-1be88a4eeb59 req-e1a2aa47-e127-4966-835e-64b5fc90b7bb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:12.913545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f18396e0-7c70-4b1e-aee5-1be88a4eeb59 req-e1a2aa47-e127-4966-835e-64b5fc90b7bb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:12.914454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f18396e0-7c70-4b1e-aee5-1be88a4eeb59 req-e1a2aa47-e127-4966-835e-64b5fc90b7bb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:12.928562 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f18396e0-7c70-4b1e-aee5-1be88a4eeb59 req-e1a2aa47-e127-4966-835e-64b5fc90b7bb service nova] Creating event network-changed:31f78eb8-b0eb-4399-8729-fd95ef76ea29 for instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d on n-h2-852084-5 Aug 27 03:33:12.936081 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f18396e0-7c70-4b1e-aee5-1be88a4eeb59 req-e1a2aa47-e127-4966-835e-64b5fc90b7bb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044123 Aug 27 03:33:12.937253 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3475/6768] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:12.950575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1183d109-ac33-44c5-b873-5e7694f57331 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:12.951394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1183d109-ac33-44c5-b873-5e7694f57331 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:12.959442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1183d109-ac33-44c5-b873-5e7694f57331 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:12.960069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1183d109-ac33-44c5-b873-5e7694f57331 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:12.960614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1183d109-ac33-44c5-b873-5e7694f57331 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:12.962109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1183d109-ac33-44c5-b873-5e7694f57331 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:12.962711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1183d109-ac33-44c5-b873-5e7694f57331 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:12.963245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1183d109-ac33-44c5-b873-5e7694f57331 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:13.169522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1183d109-ac33-44c5-b873-5e7694f57331 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:13.178071 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1183d109-ac33-44c5-b873-5e7694f57331 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1364 microversion: 2.1 time: 0.231341 Aug 27 03:33:13.178638 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3294/6769] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:12 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:14.200492 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95a66340-c4a1-4df6-938e-df20b242b65b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:14.201411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-95a66340-c4a1-4df6-938e-df20b242b65b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:14.205289 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:14.212412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95a66340-c4a1-4df6-938e-df20b242b65b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.212910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95a66340-c4a1-4df6-938e-df20b242b65b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.213421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95a66340-c4a1-4df6-938e-df20b242b65b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.214302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95a66340-c4a1-4df6-938e-df20b242b65b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:14.214759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95a66340-c4a1-4df6-938e-df20b242b65b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:14.215183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95a66340-c4a1-4df6-938e-df20b242b65b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:14.353498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-95a66340-c4a1-4df6-938e-df20b242b65b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:14.362147 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-95a66340-c4a1-4df6-938e-df20b242b65b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1364 microversion: 2.1 time: 0.165465 Aug 27 03:33:14.362870 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3476/6770] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:14 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:15.385130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0825c10a-0364-4a60-b091-d89fb38764d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:15.385780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0825c10a-0364-4a60-b091-d89fb38764d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:15.387857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:15.393975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0825c10a-0364-4a60-b091-d89fb38764d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:15.394483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0825c10a-0364-4a60-b091-d89fb38764d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:15.394933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0825c10a-0364-4a60-b091-d89fb38764d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:15.395648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0825c10a-0364-4a60-b091-d89fb38764d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:15.396114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0825c10a-0364-4a60-b091-d89fb38764d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:15.396557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0825c10a-0364-4a60-b091-d89fb38764d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:15.523968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0825c10a-0364-4a60-b091-d89fb38764d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:15.531759 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0825c10a-0364-4a60-b091-d89fb38764d9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1364 microversion: 2.1 time: 0.151520 Aug 27 03:33:15.532327 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3295/6771] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:15 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:16.557557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0a145640-bea5-4e5a-b215-f5c81759bb4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:16.558326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0a145640-bea5-4e5a-b215-f5c81759bb4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:16.565862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a145640-bea5-4e5a-b215-f5c81759bb4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.566344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a145640-bea5-4e5a-b215-f5c81759bb4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.566780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a145640-bea5-4e5a-b215-f5c81759bb4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.567484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a145640-bea5-4e5a-b215-f5c81759bb4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:16.567938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a145640-bea5-4e5a-b215-f5c81759bb4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:16.568367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a145640-bea5-4e5a-b215-f5c81759bb4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:16.707009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0a145640-bea5-4e5a-b215-f5c81759bb4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:16.714873 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0a145640-bea5-4e5a-b215-f5c81759bb4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1364 microversion: 2.1 time: 0.161276 Aug 27 03:33:16.715428 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3477/6772] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:16 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:17.736799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4dff30ff-8c2f-4efa-b432-e7821b5da49e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:17.737354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4dff30ff-8c2f-4efa-b432-e7821b5da49e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:17.744282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dff30ff-8c2f-4efa-b432-e7821b5da49e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.744793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dff30ff-8c2f-4efa-b432-e7821b5da49e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.745252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dff30ff-8c2f-4efa-b432-e7821b5da49e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.746001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dff30ff-8c2f-4efa-b432-e7821b5da49e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:17.746477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dff30ff-8c2f-4efa-b432-e7821b5da49e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:17.746923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4dff30ff-8c2f-4efa-b432-e7821b5da49e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:17.880233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4dff30ff-8c2f-4efa-b432-e7821b5da49e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:17.888537 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4dff30ff-8c2f-4efa-b432-e7821b5da49e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1364 microversion: 2.1 time: 0.155744 Aug 27 03:33:17.889122 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3296/6773] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:17 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:18.480941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b49e6513-c5af-4846-9823-4f8d4f63f23e req-9cf484f7-da69-47db-ab79-e47f88d063c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e7098d-a3fb-4905-bb05-31076a6cdd3d", "name": "network-vif-plugged", "status": "completed", "tag": "31f78eb8-b0eb-4399-8729-fd95ef76ea29"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:18.492723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b49e6513-c5af-4846-9823-4f8d4f63f23e req-9cf484f7-da69-47db-ab79-e47f88d063c5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:18.494227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b49e6513-c5af-4846-9823-4f8d4f63f23e req-9cf484f7-da69-47db-ab79-e47f88d063c5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:18.494671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b49e6513-c5af-4846-9823-4f8d4f63f23e req-9cf484f7-da69-47db-ab79-e47f88d063c5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:18.506851 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b49e6513-c5af-4846-9823-4f8d4f63f23e req-9cf484f7-da69-47db-ab79-e47f88d063c5 service nova] Creating event network-vif-plugged:31f78eb8-b0eb-4399-8729-fd95ef76ea29 for instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d on n-h2-852084-5 Aug 27 03:33:18.512344 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b49e6513-c5af-4846-9823-4f8d4f63f23e req-9cf484f7-da69-47db-ab79-e47f88d063c5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035027 Aug 27 03:33:18.512950 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3478/6774] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:18.910639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e2ecef5d-4603-4af9-b113-d6528d6bd0ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:18.911271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e2ecef5d-4603-4af9-b113-d6528d6bd0ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:18.918233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ecef5d-4603-4af9-b113-d6528d6bd0ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:18.918737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ecef5d-4603-4af9-b113-d6528d6bd0ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:18.919197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ecef5d-4603-4af9-b113-d6528d6bd0ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:18.919911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ecef5d-4603-4af9-b113-d6528d6bd0ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:18.920385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ecef5d-4603-4af9-b113-d6528d6bd0ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:18.921375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e2ecef5d-4603-4af9-b113-d6528d6bd0ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:19.053426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e2ecef5d-4603-4af9-b113-d6528d6bd0ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:19.061678 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e2ecef5d-4603-4af9-b113-d6528d6bd0ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1364 microversion: 2.1 time: 0.155478 Aug 27 03:33:19.062269 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3297/6775] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:18 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:20.085132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dcdd81d0-3800-4e5f-bba5-a93dd66c6286 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:20.085800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dcdd81d0-3800-4e5f-bba5-a93dd66c6286 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:20.093236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcdd81d0-3800-4e5f-bba5-a93dd66c6286 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:20.093751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcdd81d0-3800-4e5f-bba5-a93dd66c6286 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:20.094210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcdd81d0-3800-4e5f-bba5-a93dd66c6286 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.094913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcdd81d0-3800-4e5f-bba5-a93dd66c6286 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:20.095399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcdd81d0-3800-4e5f-bba5-a93dd66c6286 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:20.096341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dcdd81d0-3800-4e5f-bba5-a93dd66c6286 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.226072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dcdd81d0-3800-4e5f-bba5-a93dd66c6286 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:20.233932 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dcdd81d0-3800-4e5f-bba5-a93dd66c6286 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1551 microversion: 2.1 time: 0.153846 Aug 27 03:33:20.234519 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3479/6776] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:20 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:20.256116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f585c169-4678-4eb8-9f4d-d6ff1df9806b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:20.256706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f585c169-4678-4eb8-9f4d-d6ff1df9806b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:20.263909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f585c169-4678-4eb8-9f4d-d6ff1df9806b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:20.264423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f585c169-4678-4eb8-9f4d-d6ff1df9806b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:20.264886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f585c169-4678-4eb8-9f4d-d6ff1df9806b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.265613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f585c169-4678-4eb8-9f4d-d6ff1df9806b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:20.266125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f585c169-4678-4eb8-9f4d-d6ff1df9806b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:20.266575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f585c169-4678-4eb8-9f4d-d6ff1df9806b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:20.359455 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f585c169-4678-4eb8-9f4d-d6ff1df9806b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108016 Aug 27 03:33:20.360059 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3298/6777] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 03:33:20 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:21.625638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-15a0325b-b4c0-47d5-a43e-50b7fc587372 req-7188e9a8-1d96-41d1-bfe2-b79209d65ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e7098d-a3fb-4905-bb05-31076a6cdd3d", "tag": "31f78eb8-b0eb-4399-8729-fd95ef76ea29"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:21.634625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:21.637474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-15a0325b-b4c0-47d5-a43e-50b7fc587372 req-7188e9a8-1d96-41d1-bfe2-b79209d65ae2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:21.638281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-15a0325b-b4c0-47d5-a43e-50b7fc587372 req-7188e9a8-1d96-41d1-bfe2-b79209d65ae2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:21.638961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-15a0325b-b4c0-47d5-a43e-50b7fc587372 req-7188e9a8-1d96-41d1-bfe2-b79209d65ae2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:21.657949 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-15a0325b-b4c0-47d5-a43e-50b7fc587372 req-7188e9a8-1d96-41d1-bfe2-b79209d65ae2 service nova] Creating event network-changed:31f78eb8-b0eb-4399-8729-fd95ef76ea29 for instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d on n-h2-852084-5 Aug 27 03:33:21.667765 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-15a0325b-b4c0-47d5-a43e-50b7fc587372 req-7188e9a8-1d96-41d1-bfe2-b79209d65ae2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045442 Aug 27 03:33:21.668904 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3480/6778] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:33:54.695362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:54.696109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:54.698366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=7 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:54.699331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=36 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:54.700930 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:33:54.701229 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:33:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d/action (ip 10.222.0.99) !!! Aug 27 03:33:54.706514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:33:54.708813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:54.718897 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:54.719402 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:54.720454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:54.721172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:54.721651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:54.722118 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:54.756862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:54.763788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Old instance type m1.heat2, new instance type m1.heat {{(pid=122487) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:33:54.770925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:33:54.771365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:33:54.771855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:33:54.772284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:33:54.772709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:33:54.840228 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f18c51a2-8fb8-463e-ae28-28d903a2585c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d/action" status: 202 len: 0 microversion: 2.1 time: 0.145543 Aug 27 03:33:54.841625 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3299/6779] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:33:54 2022] POST /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:33:54.848681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=9 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:54.849051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:33:54.850319 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:33:54.850482 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 03:33:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d (ip 10.222.0.99) !!! Aug 27 03:33:54.856192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ef5f8c2c-90a2-44a0-9d71-eefb2ab51a8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:54.856895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ef5f8c2c-90a2-44a0-9d71-eefb2ab51a8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:54.867023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5f8c2c-90a2-44a0-9d71-eefb2ab51a8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:54.867478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5f8c2c-90a2-44a0-9d71-eefb2ab51a8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:54.867976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5f8c2c-90a2-44a0-9d71-eefb2ab51a8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:54.868709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5f8c2c-90a2-44a0-9d71-eefb2ab51a8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:54.869171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5f8c2c-90a2-44a0-9d71-eefb2ab51a8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:54.869635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ef5f8c2c-90a2-44a0-9d71-eefb2ab51a8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:55.037285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ef5f8c2c-90a2-44a0-9d71-eefb2ab51a8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:55.045202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ef5f8c2c-90a2-44a0-9d71-eefb2ab51a8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1678 microversion: 2.1 time: 0.199084 Aug 27 03:33:55.045818 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3481/6780] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:54 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:56.066684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c7499e4e-d65c-4a83-af73-c40060e96005 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:56.067318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c7499e4e-d65c-4a83-af73-c40060e96005 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:56.073775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7499e4e-d65c-4a83-af73-c40060e96005 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:56.074245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7499e4e-d65c-4a83-af73-c40060e96005 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:56.074696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7499e4e-d65c-4a83-af73-c40060e96005 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:56.075413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7499e4e-d65c-4a83-af73-c40060e96005 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:56.075878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7499e4e-d65c-4a83-af73-c40060e96005 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:56.076318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c7499e4e-d65c-4a83-af73-c40060e96005 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:56.208869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c7499e4e-d65c-4a83-af73-c40060e96005 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:56.217056 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c7499e4e-d65c-4a83-af73-c40060e96005 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1678 microversion: 2.1 time: 0.155179 Aug 27 03:33:56.217624 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3300/6781] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:56 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:57.240014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f20ca108-87f0-4aca-ac18-72c5fccfd15b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:57.240615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f20ca108-87f0-4aca-ac18-72c5fccfd15b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:57.246885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f20ca108-87f0-4aca-ac18-72c5fccfd15b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.247381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f20ca108-87f0-4aca-ac18-72c5fccfd15b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.247820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f20ca108-87f0-4aca-ac18-72c5fccfd15b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.248579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f20ca108-87f0-4aca-ac18-72c5fccfd15b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:57.249060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f20ca108-87f0-4aca-ac18-72c5fccfd15b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:57.249513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f20ca108-87f0-4aca-ac18-72c5fccfd15b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:57.382325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f20ca108-87f0-4aca-ac18-72c5fccfd15b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:57.390304 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f20ca108-87f0-4aca-ac18-72c5fccfd15b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.155087 Aug 27 03:33:57.390904 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3482/6782] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:57 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:33:58.410869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b7ba0ddc-b839-426c-8f90-ecc84c10e52b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:58.411503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b7ba0ddc-b839-426c-8f90-ecc84c10e52b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:58.418658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ba0ddc-b839-426c-8f90-ecc84c10e52b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:58.419165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ba0ddc-b839-426c-8f90-ecc84c10e52b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:58.419625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ba0ddc-b839-426c-8f90-ecc84c10e52b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:58.420376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ba0ddc-b839-426c-8f90-ecc84c10e52b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:58.420854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ba0ddc-b839-426c-8f90-ecc84c10e52b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:58.421301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b7ba0ddc-b839-426c-8f90-ecc84c10e52b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:58.555576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b7ba0ddc-b839-426c-8f90-ecc84c10e52b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:58.564152 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b7ba0ddc-b839-426c-8f90-ecc84c10e52b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.156577 Aug 27 03:33:58.564724 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3301/6783] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:58 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:33:59.586823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a72147c9-f7b9-405c-aaa8-43ab0d33b29a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:33:59.587437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a72147c9-f7b9-405c-aaa8-43ab0d33b29a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:33:59.594583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a72147c9-f7b9-405c-aaa8-43ab0d33b29a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:59.595067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a72147c9-f7b9-405c-aaa8-43ab0d33b29a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:59.595503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a72147c9-f7b9-405c-aaa8-43ab0d33b29a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:59.596189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a72147c9-f7b9-405c-aaa8-43ab0d33b29a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:33:59.596640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a72147c9-f7b9-405c-aaa8-43ab0d33b29a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:33:59.597062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a72147c9-f7b9-405c-aaa8-43ab0d33b29a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:33:59.728842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a72147c9-f7b9-405c-aaa8-43ab0d33b29a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:33:59.738639 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a72147c9-f7b9-405c-aaa8-43ab0d33b29a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.155652 Aug 27 03:33:59.739244 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3483/6784] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:33:59 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:00.760638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ce7b9f27-68ab-4e2b-9770-d2bd1ad26cb5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:00.761170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ce7b9f27-68ab-4e2b-9770-d2bd1ad26cb5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:00.769883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7b9f27-68ab-4e2b-9770-d2bd1ad26cb5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:00.770396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7b9f27-68ab-4e2b-9770-d2bd1ad26cb5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:00.770857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7b9f27-68ab-4e2b-9770-d2bd1ad26cb5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:00.771577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7b9f27-68ab-4e2b-9770-d2bd1ad26cb5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:00.772053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7b9f27-68ab-4e2b-9770-d2bd1ad26cb5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:00.772501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce7b9f27-68ab-4e2b-9770-d2bd1ad26cb5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:00.902566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ce7b9f27-68ab-4e2b-9770-d2bd1ad26cb5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:00.911062 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ce7b9f27-68ab-4e2b-9770-d2bd1ad26cb5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.154500 Aug 27 03:34:00.911641 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3302/6785] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:00 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:01.932342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5fa73e73-eabf-4686-ae00-a8b4f277cc02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:01.932975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5fa73e73-eabf-4686-ae00-a8b4f277cc02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:01.939904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa73e73-eabf-4686-ae00-a8b4f277cc02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:01.940393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa73e73-eabf-4686-ae00-a8b4f277cc02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:01.940840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa73e73-eabf-4686-ae00-a8b4f277cc02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:01.941543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa73e73-eabf-4686-ae00-a8b4f277cc02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:01.942029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa73e73-eabf-4686-ae00-a8b4f277cc02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:01.942483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5fa73e73-eabf-4686-ae00-a8b4f277cc02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:02.074475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5fa73e73-eabf-4686-ae00-a8b4f277cc02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:02.082248 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5fa73e73-eabf-4686-ae00-a8b4f277cc02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.153881 Aug 27 03:34:02.082818 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3484/6786] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:01 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:03.104644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48b88628-75f8-47e4-aa04-6f1d40893582 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:03.105191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-48b88628-75f8-47e4-aa04-6f1d40893582 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:03.112872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b88628-75f8-47e4-aa04-6f1d40893582 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:03.113438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b88628-75f8-47e4-aa04-6f1d40893582 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:03.113880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b88628-75f8-47e4-aa04-6f1d40893582 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:03.114597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b88628-75f8-47e4-aa04-6f1d40893582 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:03.115071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b88628-75f8-47e4-aa04-6f1d40893582 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:03.115518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b88628-75f8-47e4-aa04-6f1d40893582 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:03.248259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-48b88628-75f8-47e4-aa04-6f1d40893582 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:03.257090 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-48b88628-75f8-47e4-aa04-6f1d40893582 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.156512 Aug 27 03:34:03.257696 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3303/6787] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:03 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:04.277953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eba4db33-3eb0-4b98-b410-df7fed50801f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:04.278576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eba4db33-3eb0-4b98-b410-df7fed50801f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:04.285611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eba4db33-3eb0-4b98-b410-df7fed50801f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:04.286128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eba4db33-3eb0-4b98-b410-df7fed50801f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:04.286572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eba4db33-3eb0-4b98-b410-df7fed50801f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:04.287267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eba4db33-3eb0-4b98-b410-df7fed50801f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:04.287726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eba4db33-3eb0-4b98-b410-df7fed50801f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:04.288155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eba4db33-3eb0-4b98-b410-df7fed50801f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:04.420719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eba4db33-3eb0-4b98-b410-df7fed50801f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:04.429161 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eba4db33-3eb0-4b98-b410-df7fed50801f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.155098 Aug 27 03:34:04.429773 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3485/6788] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:04 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:05.451126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58c30819-7b81-4fec-8a25-94faa30d77be tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:05.451752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-58c30819-7b81-4fec-8a25-94faa30d77be tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:05.459282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58c30819-7b81-4fec-8a25-94faa30d77be tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:05.459778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58c30819-7b81-4fec-8a25-94faa30d77be tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:05.460226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58c30819-7b81-4fec-8a25-94faa30d77be tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:05.460926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58c30819-7b81-4fec-8a25-94faa30d77be tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:05.461392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58c30819-7b81-4fec-8a25-94faa30d77be tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:05.461862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58c30819-7b81-4fec-8a25-94faa30d77be tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:05.605351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-58c30819-7b81-4fec-8a25-94faa30d77be tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:05.613526 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-58c30819-7b81-4fec-8a25-94faa30d77be tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.166302 Aug 27 03:34:05.614149 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3304/6789] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:05 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:06.635597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-db4ddf24-7422-4792-9390-1f825c1185fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:06.636214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-db4ddf24-7422-4792-9390-1f825c1185fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:06.643378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db4ddf24-7422-4792-9390-1f825c1185fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:06.643804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db4ddf24-7422-4792-9390-1f825c1185fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:06.644245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db4ddf24-7422-4792-9390-1f825c1185fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:06.644941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db4ddf24-7422-4792-9390-1f825c1185fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:06.645403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db4ddf24-7422-4792-9390-1f825c1185fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:06.645866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db4ddf24-7422-4792-9390-1f825c1185fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:06.775844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-db4ddf24-7422-4792-9390-1f825c1185fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:06.784473 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-db4ddf24-7422-4792-9390-1f825c1185fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.152752 Aug 27 03:34:06.785053 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3486/6790] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:06 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:07.806339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ae9328d1-0796-48a2-970c-280cb7af6de4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:07.806872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ae9328d1-0796-48a2-970c-280cb7af6de4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:07.813900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae9328d1-0796-48a2-970c-280cb7af6de4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:07.814406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae9328d1-0796-48a2-970c-280cb7af6de4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:07.814860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae9328d1-0796-48a2-970c-280cb7af6de4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:07.815575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae9328d1-0796-48a2-970c-280cb7af6de4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:07.816043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae9328d1-0796-48a2-970c-280cb7af6de4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:07.816486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ae9328d1-0796-48a2-970c-280cb7af6de4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:07.946653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ae9328d1-0796-48a2-970c-280cb7af6de4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:07.955313 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ae9328d1-0796-48a2-970c-280cb7af6de4 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.153056 Aug 27 03:34:07.955897 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3305/6791] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:07 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:08.976386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-96645a9d-088b-4eb2-9f23-8938d41306ce tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:08.977004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-96645a9d-088b-4eb2-9f23-8938d41306ce tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:08.983957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96645a9d-088b-4eb2-9f23-8938d41306ce tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.984444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96645a9d-088b-4eb2-9f23-8938d41306ce tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.984887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96645a9d-088b-4eb2-9f23-8938d41306ce tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:08.985580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96645a9d-088b-4eb2-9f23-8938d41306ce tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:08.986064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96645a9d-088b-4eb2-9f23-8938d41306ce tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:08.986495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-96645a9d-088b-4eb2-9f23-8938d41306ce tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:09.115774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-96645a9d-088b-4eb2-9f23-8938d41306ce tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:09.123675 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-96645a9d-088b-4eb2-9f23-8938d41306ce tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.151098 Aug 27 03:34:09.124253 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3487/6792] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:08 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:10.144942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7a8ef150-2bfa-4d9c-8912-5ca9ed7a6afb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:10.145574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7a8ef150-2bfa-4d9c-8912-5ca9ed7a6afb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:10.152443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a8ef150-2bfa-4d9c-8912-5ca9ed7a6afb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.152945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a8ef150-2bfa-4d9c-8912-5ca9ed7a6afb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.153408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a8ef150-2bfa-4d9c-8912-5ca9ed7a6afb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.154148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a8ef150-2bfa-4d9c-8912-5ca9ed7a6afb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:10.154626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a8ef150-2bfa-4d9c-8912-5ca9ed7a6afb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:10.155076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7a8ef150-2bfa-4d9c-8912-5ca9ed7a6afb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:10.291042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7a8ef150-2bfa-4d9c-8912-5ca9ed7a6afb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:10.300327 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7a8ef150-2bfa-4d9c-8912-5ca9ed7a6afb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.159384 Aug 27 03:34:10.300916 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3306/6793] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:10 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:11.321301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7941da49-b0a2-4a70-a9d5-1bfcaadb9030 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:11.321958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7941da49-b0a2-4a70-a9d5-1bfcaadb9030 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:11.329200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7941da49-b0a2-4a70-a9d5-1bfcaadb9030 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:11.329726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7941da49-b0a2-4a70-a9d5-1bfcaadb9030 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:11.330175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7941da49-b0a2-4a70-a9d5-1bfcaadb9030 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.330877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7941da49-b0a2-4a70-a9d5-1bfcaadb9030 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:11.331336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7941da49-b0a2-4a70-a9d5-1bfcaadb9030 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:11.331768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7941da49-b0a2-4a70-a9d5-1bfcaadb9030 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:11.473029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7941da49-b0a2-4a70-a9d5-1bfcaadb9030 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:11.480951 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7941da49-b0a2-4a70-a9d5-1bfcaadb9030 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.163553 Aug 27 03:34:11.481538 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3488/6794] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:11 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:12.503216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e5aa201a-d62c-4656-bb61-ffde3ece0042 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:12.503851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e5aa201a-d62c-4656-bb61-ffde3ece0042 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:12.510928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5aa201a-d62c-4656-bb61-ffde3ece0042 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.511436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5aa201a-d62c-4656-bb61-ffde3ece0042 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.511920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5aa201a-d62c-4656-bb61-ffde3ece0042 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:12.512817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5aa201a-d62c-4656-bb61-ffde3ece0042 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:12.513422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5aa201a-d62c-4656-bb61-ffde3ece0042 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:12.513952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e5aa201a-d62c-4656-bb61-ffde3ece0042 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:12.648888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e5aa201a-d62c-4656-bb61-ffde3ece0042 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:12.657137 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e5aa201a-d62c-4656-bb61-ffde3ece0042 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.158218 Aug 27 03:34:12.657743 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3307/6795] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:12 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:13.680225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5622dd98-547f-46e7-b5ea-ef2ff74757fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:13.681021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5622dd98-547f-46e7-b5ea-ef2ff74757fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:13.687975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5622dd98-547f-46e7-b5ea-ef2ff74757fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.688464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5622dd98-547f-46e7-b5ea-ef2ff74757fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.688907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5622dd98-547f-46e7-b5ea-ef2ff74757fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.689612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5622dd98-547f-46e7-b5ea-ef2ff74757fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:13.690102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5622dd98-547f-46e7-b5ea-ef2ff74757fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:13.690532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5622dd98-547f-46e7-b5ea-ef2ff74757fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:13.832260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5622dd98-547f-46e7-b5ea-ef2ff74757fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:13.840489 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5622dd98-547f-46e7-b5ea-ef2ff74757fd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1683 microversion: 2.1 time: 0.164918 Aug 27 03:34:13.841080 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3489/6796] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:13 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:14.221265 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-b2764d18-366b-4004-ab7e-777787aae10d req-214f5529-08c0-4cfa-b7c5-bdb5ed55372b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e7098d-a3fb-4905-bb05-31076a6cdd3d", "name": "network-vif-unplugged", "status": "completed", "tag": "31f78eb8-b0eb-4399-8729-fd95ef76ea29"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:14.232573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b2764d18-366b-4004-ab7e-777787aae10d req-214f5529-08c0-4cfa-b7c5-bdb5ed55372b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.233264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b2764d18-366b-4004-ab7e-777787aae10d req-214f5529-08c0-4cfa-b7c5-bdb5ed55372b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.234216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-b2764d18-366b-4004-ab7e-777787aae10d req-214f5529-08c0-4cfa-b7c5-bdb5ed55372b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.247567 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-b2764d18-366b-4004-ab7e-777787aae10d req-214f5529-08c0-4cfa-b7c5-bdb5ed55372b service nova] Creating event network-vif-unplugged:31f78eb8-b0eb-4399-8729-fd95ef76ea29 for instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d on n-h1-852084-5 Aug 27 03:34:14.254189 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-b2764d18-366b-4004-ab7e-777787aae10d req-214f5529-08c0-4cfa-b7c5-bdb5ed55372b service nova] Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:34:14.265537 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-b2764d18-366b-4004-ab7e-777787aae10d req-214f5529-08c0-4cfa-b7c5-bdb5ed55372b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048851 Aug 27 03:34:14.266358 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3308/6797] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:14.863203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1427bfe6-b0ab-4a02-8b88-28955c61b5f9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:14.863894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1427bfe6-b0ab-4a02-8b88-28955c61b5f9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:14.873939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1427bfe6-b0ab-4a02-8b88-28955c61b5f9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.874580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1427bfe6-b0ab-4a02-8b88-28955c61b5f9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.875375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1427bfe6-b0ab-4a02-8b88-28955c61b5f9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:14.876711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1427bfe6-b0ab-4a02-8b88-28955c61b5f9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:14.877553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1427bfe6-b0ab-4a02-8b88-28955c61b5f9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:14.878365 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1427bfe6-b0ab-4a02-8b88-28955c61b5f9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:15.033379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1427bfe6-b0ab-4a02-8b88-28955c61b5f9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:15.041906 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1427bfe6-b0ab-4a02-8b88-28955c61b5f9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1682 microversion: 2.1 time: 0.183337 Aug 27 03:34:15.042511 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3490/6798] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:14 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:16.065934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aecbc770-483e-46a2-8531-c566470ad4fe tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:16.066553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aecbc770-483e-46a2-8531-c566470ad4fe tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:16.073866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aecbc770-483e-46a2-8531-c566470ad4fe tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:16.074403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aecbc770-483e-46a2-8531-c566470ad4fe tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:16.074860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aecbc770-483e-46a2-8531-c566470ad4fe tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:16.075593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aecbc770-483e-46a2-8531-c566470ad4fe tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:16.076066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aecbc770-483e-46a2-8531-c566470ad4fe tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:16.076511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aecbc770-483e-46a2-8531-c566470ad4fe tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:16.215226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-aecbc770-483e-46a2-8531-c566470ad4fe tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:16.224170 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aecbc770-483e-46a2-8531-c566470ad4fe tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1680 microversion: 2.1 time: 0.164265 Aug 27 03:34:16.224755 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3309/6799] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:16 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:16.300811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-5734e2f0-7146-473c-80d2-be526d2c3371 req-f948ebb5-f614-42cd-8ee4-ff4bbec10cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e7098d-a3fb-4905-bb05-31076a6cdd3d", "tag": "31f78eb8-b0eb-4399-8729-fd95ef76ea29"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:16.311467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5734e2f0-7146-473c-80d2-be526d2c3371 req-f948ebb5-f614-42cd-8ee4-ff4bbec10cca service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:16.311952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5734e2f0-7146-473c-80d2-be526d2c3371 req-f948ebb5-f614-42cd-8ee4-ff4bbec10cca service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:16.312393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5734e2f0-7146-473c-80d2-be526d2c3371 req-f948ebb5-f614-42cd-8ee4-ff4bbec10cca service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:16.324718 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-5734e2f0-7146-473c-80d2-be526d2c3371 req-f948ebb5-f614-42cd-8ee4-ff4bbec10cca service nova] Creating event network-changed:31f78eb8-b0eb-4399-8729-fd95ef76ea29 for instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d on n-h1-852084-5 Aug 27 03:34:16.330362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-5734e2f0-7146-473c-80d2-be526d2c3371 req-f948ebb5-f614-42cd-8ee4-ff4bbec10cca service nova] Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:34:16.341589 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-5734e2f0-7146-473c-80d2-be526d2c3371 req-f948ebb5-f614-42cd-8ee4-ff4bbec10cca service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044785 Aug 27 03:34:16.342236 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3491/6800] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:17.246605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-18295885-6e3d-4ac5-9b1b-dcc965f1ddcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:17.247250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-18295885-6e3d-4ac5-9b1b-dcc965f1ddcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:17.256063 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18295885-6e3d-4ac5-9b1b-dcc965f1ddcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.256588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18295885-6e3d-4ac5-9b1b-dcc965f1ddcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.257049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18295885-6e3d-4ac5-9b1b-dcc965f1ddcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.257810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18295885-6e3d-4ac5-9b1b-dcc965f1ddcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.258322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18295885-6e3d-4ac5-9b1b-dcc965f1ddcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.259012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18295885-6e3d-4ac5-9b1b-dcc965f1ddcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.540606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-18295885-6e3d-4ac5-9b1b-dcc965f1ddcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:17.549360 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-18295885-6e3d-4ac5-9b1b-dcc965f1ddcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1677 microversion: 2.1 time: 0.306802 Aug 27 03:34:17.549979 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3310/6801] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:17 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1677 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:17.572892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:17.574424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:17.581219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.581741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.582186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.582930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.583391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.583973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.630693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.631761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.631761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.632357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.632819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.633258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.654564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:34:17.660303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for user d26902bb305a470087e529c5f3949f78 and project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:34:17.766659 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-873b4230-242a-4cff-b87d-d43904e0d11b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d/action" status: 202 len: 0 microversion: 2.1 time: 0.198998 Aug 27 03:34:17.767264 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3492/6802] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:34:17 2022] POST /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:34:17.776371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-765bb3f4-fd5f-4108-9b27-1d76d2e345ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:17.777009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-765bb3f4-fd5f-4108-9b27-1d76d2e345ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:17.783877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765bb3f4-fd5f-4108-9b27-1d76d2e345ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.784431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765bb3f4-fd5f-4108-9b27-1d76d2e345ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.784881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765bb3f4-fd5f-4108-9b27-1d76d2e345ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.785649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765bb3f4-fd5f-4108-9b27-1d76d2e345ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:17.786221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765bb3f4-fd5f-4108-9b27-1d76d2e345ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:17.786712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765bb3f4-fd5f-4108-9b27-1d76d2e345ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:17.992291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-765bb3f4-fd5f-4108-9b27-1d76d2e345ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:18.000363 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-765bb3f4-fd5f-4108-9b27-1d76d2e345ba tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1676 microversion: 2.1 time: 0.228748 Aug 27 03:34:18.000958 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3311/6803] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:17 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:19.023472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6c306aca-7990-4b71-9951-15df08f0e4e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:19.024182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6c306aca-7990-4b71-9951-15df08f0e4e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:19.031850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c306aca-7990-4b71-9951-15df08f0e4e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:19.032343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c306aca-7990-4b71-9951-15df08f0e4e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:19.032810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c306aca-7990-4b71-9951-15df08f0e4e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:19.033523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c306aca-7990-4b71-9951-15df08f0e4e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:19.034020 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c306aca-7990-4b71-9951-15df08f0e4e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:19.034449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c306aca-7990-4b71-9951-15df08f0e4e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:19.175863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6c306aca-7990-4b71-9951-15df08f0e4e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:19.184181 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6c306aca-7990-4b71-9951-15df08f0e4e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1676 microversion: 2.1 time: 0.165848 Aug 27 03:34:19.184797 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3493/6804] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:19 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:20.205922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cfee0483-c597-48bc-a43f-28fdf408d49c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:20.206648 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cfee0483-c597-48bc-a43f-28fdf408d49c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:20.213655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfee0483-c597-48bc-a43f-28fdf408d49c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:20.214195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfee0483-c597-48bc-a43f-28fdf408d49c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:20.214651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfee0483-c597-48bc-a43f-28fdf408d49c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:20.215379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfee0483-c597-48bc-a43f-28fdf408d49c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:20.215851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfee0483-c597-48bc-a43f-28fdf408d49c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:20.216550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cfee0483-c597-48bc-a43f-28fdf408d49c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:20.344601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4f7b2bdb-f912-4f16-9211-ddf451d99513 req-980f2bc7-e4e4-4c5a-8413-21373f9d44be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e7098d-a3fb-4905-bb05-31076a6cdd3d", "name": "network-vif-plugged", "status": "completed", "tag": "31f78eb8-b0eb-4399-8729-fd95ef76ea29"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:20.364984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4f7b2bdb-f912-4f16-9211-ddf451d99513 req-980f2bc7-e4e4-4c5a-8413-21373f9d44be service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:20.365818 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4f7b2bdb-f912-4f16-9211-ddf451d99513 req-980f2bc7-e4e4-4c5a-8413-21373f9d44be service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:20.366488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4f7b2bdb-f912-4f16-9211-ddf451d99513 req-980f2bc7-e4e4-4c5a-8413-21373f9d44be service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:20.380308 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4f7b2bdb-f912-4f16-9211-ddf451d99513 req-980f2bc7-e4e4-4c5a-8413-21373f9d44be service nova] Creating event network-vif-plugged:31f78eb8-b0eb-4399-8729-fd95ef76ea29 for instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d on n-h1-852084-5 Aug 27 03:34:20.393296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-4f7b2bdb-f912-4f16-9211-ddf451d99513 req-980f2bc7-e4e4-4c5a-8413-21373f9d44be service nova] Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:34:20.397467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cfee0483-c597-48bc-a43f-28fdf408d49c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:20.406123 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4f7b2bdb-f912-4f16-9211-ddf451d99513 req-980f2bc7-e4e4-4c5a-8413-21373f9d44be service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069887 Aug 27 03:34:20.407372 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3494/6805] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:20.412043 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cfee0483-c597-48bc-a43f-28fdf408d49c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1676 microversion: 2.1 time: 0.209872 Aug 27 03:34:20.412750 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3312/6806] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:20 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1676 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:21.422353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c2aa9350-1ad3-49dd-a68a-23a3745f8a49 req-d0cc91e4-4fd3-4942-b0b6-afadbde3538b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e7098d-a3fb-4905-bb05-31076a6cdd3d", "name": "network-vif-unplugged", "status": "completed", "tag": "31f78eb8-b0eb-4399-8729-fd95ef76ea29"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:21.433246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c2aa9350-1ad3-49dd-a68a-23a3745f8a49 req-d0cc91e4-4fd3-4942-b0b6-afadbde3538b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.433902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c2aa9350-1ad3-49dd-a68a-23a3745f8a49 req-d0cc91e4-4fd3-4942-b0b6-afadbde3538b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.434620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c2aa9350-1ad3-49dd-a68a-23a3745f8a49 req-d0cc91e4-4fd3-4942-b0b6-afadbde3538b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:21.446404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-26a80682-6a95-4889-a15e-cc96e2735b0a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:21.447655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26a80682-6a95-4889-a15e-cc96e2735b0a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:21.452012 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:21.456810 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c2aa9350-1ad3-49dd-a68a-23a3745f8a49 req-d0cc91e4-4fd3-4942-b0b6-afadbde3538b service nova] Creating event network-vif-unplugged:31f78eb8-b0eb-4399-8729-fd95ef76ea29 for instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d on n-h2-852084-5 Aug 27 03:34:21.465906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-c2aa9350-1ad3-49dd-a68a-23a3745f8a49 req-d0cc91e4-4fd3-4942-b0b6-afadbde3538b service nova] Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:34:21.466962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26a80682-6a95-4889-a15e-cc96e2735b0a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.468612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26a80682-6a95-4889-a15e-cc96e2735b0a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.473287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26a80682-6a95-4889-a15e-cc96e2735b0a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:21.475257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26a80682-6a95-4889-a15e-cc96e2735b0a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:21.477166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26a80682-6a95-4889-a15e-cc96e2735b0a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:21.478646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26a80682-6a95-4889-a15e-cc96e2735b0a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:21.482428 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c2aa9350-1ad3-49dd-a68a-23a3745f8a49 req-d0cc91e4-4fd3-4942-b0b6-afadbde3538b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066225 Aug 27 03:34:21.483938 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3495/6807] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:21.761824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-26a80682-6a95-4889-a15e-cc96e2735b0a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:21.771289 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-26a80682-6a95-4889-a15e-cc96e2735b0a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1676 microversion: 2.1 time: 0.339572 Aug 27 03:34:21.771881 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3313/6808] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:21 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1676 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:22.794054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8534704a-0d3b-4f20-84f9-6bb5baf5ac90 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:22.794770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8534704a-0d3b-4f20-84f9-6bb5baf5ac90 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:22.801168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8534704a-0d3b-4f20-84f9-6bb5baf5ac90 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:22.801643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8534704a-0d3b-4f20-84f9-6bb5baf5ac90 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:22.802119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8534704a-0d3b-4f20-84f9-6bb5baf5ac90 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:22.802945 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8534704a-0d3b-4f20-84f9-6bb5baf5ac90 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:22.803413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8534704a-0d3b-4f20-84f9-6bb5baf5ac90 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:22.803847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8534704a-0d3b-4f20-84f9-6bb5baf5ac90 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:22.954971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8534704a-0d3b-4f20-84f9-6bb5baf5ac90 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:22.963085 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8534704a-0d3b-4f20-84f9-6bb5baf5ac90 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1676 microversion: 2.1 time: 0.174164 Aug 27 03:34:22.963676 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3496/6809] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:22 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:23.518074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d3ecd8b4-7ac3-4830-9a0a-ce9f35efabf5 req-7c043220-4b80-4c23-a2d7-45d47b6b4e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e7098d-a3fb-4905-bb05-31076a6cdd3d", "tag": "31f78eb8-b0eb-4399-8729-fd95ef76ea29"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:23.529056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d3ecd8b4-7ac3-4830-9a0a-ce9f35efabf5 req-7c043220-4b80-4c23-a2d7-45d47b6b4e37 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:23.529560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d3ecd8b4-7ac3-4830-9a0a-ce9f35efabf5 req-7c043220-4b80-4c23-a2d7-45d47b6b4e37 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:23.530046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d3ecd8b4-7ac3-4830-9a0a-ce9f35efabf5 req-7c043220-4b80-4c23-a2d7-45d47b6b4e37 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:23.542856 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d3ecd8b4-7ac3-4830-9a0a-ce9f35efabf5 req-7c043220-4b80-4c23-a2d7-45d47b6b4e37 service nova] Creating event network-changed:31f78eb8-b0eb-4399-8729-fd95ef76ea29 for instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d on n-h2-852084-5 Aug 27 03:34:23.545921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:23.550610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-d3ecd8b4-7ac3-4830-9a0a-ce9f35efabf5 req-7c043220-4b80-4c23-a2d7-45d47b6b4e37 service nova] Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:34:23.563859 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d3ecd8b4-7ac3-4830-9a0a-ce9f35efabf5 req-7c043220-4b80-4c23-a2d7-45d47b6b4e37 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048494 Aug 27 03:34:23.564335 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3314/6810] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:23.984878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c388042-a864-4ab2-919f-427f6aed9ddf tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:23.986460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4c388042-a864-4ab2-919f-427f6aed9ddf tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:23.994107 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c388042-a864-4ab2-919f-427f6aed9ddf tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:23.994600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c388042-a864-4ab2-919f-427f6aed9ddf tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:23.995039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c388042-a864-4ab2-919f-427f6aed9ddf tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:23.995763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c388042-a864-4ab2-919f-427f6aed9ddf tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:23.996216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c388042-a864-4ab2-919f-427f6aed9ddf tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:23.996856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c388042-a864-4ab2-919f-427f6aed9ddf tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.161879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4c388042-a864-4ab2-919f-427f6aed9ddf tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.171315 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4c388042-a864-4ab2-919f-427f6aed9ddf tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1669 microversion: 2.1 time: 0.190718 Aug 27 03:34:24.172360 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3497/6811] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:23 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1669 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:24.193594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-43151b83-585b-41a9-ac38-35e160859f1c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:24.194419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-43151b83-585b-41a9-ac38-35e160859f1c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:24.202281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43151b83-585b-41a9-ac38-35e160859f1c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.202791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43151b83-585b-41a9-ac38-35e160859f1c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.203781 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43151b83-585b-41a9-ac38-35e160859f1c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.204508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43151b83-585b-41a9-ac38-35e160859f1c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.204977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43151b83-585b-41a9-ac38-35e160859f1c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.205414 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-43151b83-585b-41a9-ac38-35e160859f1c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.850981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-43151b83-585b-41a9-ac38-35e160859f1c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:24.860820 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-43151b83-585b-41a9-ac38-35e160859f1c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1669 microversion: 2.1 time: 0.672198 Aug 27 03:34:24.861441 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3315/6812] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:24 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1669 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:24.890873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a7219f6e-0d15-4475-8eab-1ae21e487db5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:24.892137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a7219f6e-0d15-4475-8eab-1ae21e487db5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:24.895700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:24.904839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7219f6e-0d15-4475-8eab-1ae21e487db5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.905771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7219f6e-0d15-4475-8eab-1ae21e487db5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.906347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7219f6e-0d15-4475-8eab-1ae21e487db5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:24.907126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7219f6e-0d15-4475-8eab-1ae21e487db5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:24.907638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7219f6e-0d15-4475-8eab-1ae21e487db5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:24.908530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7219f6e-0d15-4475-8eab-1ae21e487db5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:25.071864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a7219f6e-0d15-4475-8eab-1ae21e487db5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:25.081771 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a7219f6e-0d15-4475-8eab-1ae21e487db5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1669 microversion: 2.1 time: 0.198803 Aug 27 03:34:25.090467 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3498/6813] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:24 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1669 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:25.104523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-be33a23b-7d10-45bd-aec3-fdcbeafce237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:25.105152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-be33a23b-7d10-45bd-aec3-fdcbeafce237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:25.107525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=39 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:25.114259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be33a23b-7d10-45bd-aec3-fdcbeafce237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:25.114879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be33a23b-7d10-45bd-aec3-fdcbeafce237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:25.115450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be33a23b-7d10-45bd-aec3-fdcbeafce237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:25.116290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be33a23b-7d10-45bd-aec3-fdcbeafce237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:25.116849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be33a23b-7d10-45bd-aec3-fdcbeafce237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:25.117381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be33a23b-7d10-45bd-aec3-fdcbeafce237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:25.150149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-be33a23b-7d10-45bd-aec3-fdcbeafce237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:34:25.239827 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-be33a23b-7d10-45bd-aec3-fdcbeafce237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 204 len: 0 microversion: 2.1 time: 0.139188 Aug 27 03:34:25.240440 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3316/6814] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:34:25 2022] DELETE /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:34:25.250058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9e2bfbcd-698e-43f3-8740-237fd9eea237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:25.250619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9e2bfbcd-698e-43f3-8740-237fd9eea237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:25.257123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e2bfbcd-698e-43f3-8740-237fd9eea237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:25.257613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e2bfbcd-698e-43f3-8740-237fd9eea237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:25.258084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e2bfbcd-698e-43f3-8740-237fd9eea237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:25.258798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e2bfbcd-698e-43f3-8740-237fd9eea237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:25.259256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e2bfbcd-698e-43f3-8740-237fd9eea237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:25.259687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9e2bfbcd-698e-43f3-8740-237fd9eea237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:25.405991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9e2bfbcd-698e-43f3-8740-237fd9eea237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:25.418661 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9e2bfbcd-698e-43f3-8740-237fd9eea237 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1675 microversion: 2.1 time: 0.172997 Aug 27 03:34:25.419320 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3499/6815] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:25 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:26.445540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b6704fcf-4559-456f-a1c7-0df0da38abc2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:26.446422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b6704fcf-4559-456f-a1c7-0df0da38abc2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:26.453632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6704fcf-4559-456f-a1c7-0df0da38abc2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:26.454190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6704fcf-4559-456f-a1c7-0df0da38abc2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:26.454659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6704fcf-4559-456f-a1c7-0df0da38abc2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:26.455400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6704fcf-4559-456f-a1c7-0df0da38abc2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:26.455879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6704fcf-4559-456f-a1c7-0df0da38abc2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:26.456333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6704fcf-4559-456f-a1c7-0df0da38abc2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:26.675950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b6704fcf-4559-456f-a1c7-0df0da38abc2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:26.687739 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b6704fcf-4559-456f-a1c7-0df0da38abc2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1675 microversion: 2.1 time: 0.245731 Aug 27 03:34:26.687739 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3317/6816] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:26 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1675 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:27.473946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-71cf2e75-c7be-4bc8-8f90-91aaa24030bc req-75a0488e-93f4-44c7-9daa-fa3a7f31b03b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e7098d-a3fb-4905-bb05-31076a6cdd3d", "name": "network-vif-deleted", "tag": "31f78eb8-b0eb-4399-8729-fd95ef76ea29"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:27.492199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-71cf2e75-c7be-4bc8-8f90-91aaa24030bc req-75a0488e-93f4-44c7-9daa-fa3a7f31b03b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.493061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-71cf2e75-c7be-4bc8-8f90-91aaa24030bc req-75a0488e-93f4-44c7-9daa-fa3a7f31b03b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.493881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-71cf2e75-c7be-4bc8-8f90-91aaa24030bc req-75a0488e-93f4-44c7-9daa-fa3a7f31b03b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.518408 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-71cf2e75-c7be-4bc8-8f90-91aaa24030bc req-75a0488e-93f4-44c7-9daa-fa3a7f31b03b service nova] Creating event network-vif-deleted:31f78eb8-b0eb-4399-8729-fd95ef76ea29 for instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d on n-h2-852084-5 Aug 27 03:34:27.527316 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-71cf2e75-c7be-4bc8-8f90-91aaa24030bc req-75a0488e-93f4-44c7-9daa-fa3a7f31b03b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060809 Aug 27 03:34:27.528445 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3500/6817] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:27.708740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:27.709422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:27.717851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.718449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.718919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.719657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.720141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.720589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.759180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:27.759697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:27.760160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:27.760640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lazy-loading 'fault' on Instance uuid a5e7098d-a3fb-4905-bb05-31076a6cdd3d {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:34:27.803970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:27.814067 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7fdcd52a-d726-4101-9b24-0da4d046bf53 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 200 len: 1328 microversion: 2.1 time: 0.109214 Aug 27 03:34:27.825835 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3318/6818] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:27 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:28.833018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:28.838417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:28.839168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:28.846685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:28.847179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:28.847620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:28.848330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:28.848784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:28.849225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:28.863696 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d HTTP/1.1 Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'a5e7098d-a3fb-4905-bb05-31076a6cdd3d'} Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:28.865407 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:34:28.872804 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:28.872804 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:28.872804 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:28.872804 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:28.872804 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:28.872804 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:34:28.872804 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:34:28.872804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:28.872804 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f68a6bec-e151-48c1-8bf9-0caa361da8da tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 404 len: 111 microversion: 2.1 time: 0.034888 Aug 27 03:34:28.872804 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3501/6819] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:28 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:34:28.886583 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:28.887433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:28.895388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:28.895899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:28.896381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:28.897132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:28.897608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:28.898091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:28.913135 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d HTTP/1.1 Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'a5e7098d-a3fb-4905-bb05-31076a6cdd3d'} Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:34:28.914878 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:34:28.921321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:34:28.921321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:34:28.921321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:34:28.921321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:34:28.921321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:34:28.921321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:34:28.921321 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:34:28.921321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:34:28.921321 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e3faab41-7f13-446e-bcfd-69018b967cc9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 404 len: 111 microversion: 2.1 time: 0.033871 Aug 27 03:34:28.922602 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3319/6820] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:28 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:34:28.969141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2018749149", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "2acb4e25-8d10-4cfa-8683-cb18988ffad8"}], "security_groups": [{"name": "tempest-securitygroup--1463600712"}], "key_name": "tempest-keypair-1456137094", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:29.081768 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] validate_networks() for [('2acb4e25-8d10-4cfa-8683-cb18988ffad8', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:34:29.543750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:34:29.544197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:34:29.544674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:34:29.545086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:34:29.545500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:34:29.555255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:29.555741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:29.556179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:29.556909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:29.557367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:29.557819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:29.576266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:34:29.582168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for user d26902bb305a470087e529c5f3949f78 and project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:34:29.597551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:34:29.599920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:34:29.659467 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2171e17b-f28c-452b-bfbe-0941e316fec5 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.694440 Aug 27 03:34:29.660123 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3502/6821] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:34:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:34:29.677878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-27fee31f-5d16-4c69-a4ad-3c3fd3c031e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:29.678641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-27fee31f-5d16-4c69-a4ad-3c3fd3c031e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:29.736422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-27fee31f-5d16-4c69-a4ad-3c3fd3c031e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:29.746115 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-27fee31f-5d16-4c69-a4ad-3c3fd3c031e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1239 microversion: 2.1 time: 0.072149 Aug 27 03:34:29.746715 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3320/6822] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:29 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:30.770482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-934c7871-5a54-4911-8982-7d03e1730b48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:30.772124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-934c7871-5a54-4911-8982-7d03e1730b48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:30.786512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-934c7871-5a54-4911-8982-7d03e1730b48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:30.787169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-934c7871-5a54-4911-8982-7d03e1730b48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:30.787641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-934c7871-5a54-4911-8982-7d03e1730b48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:30.788374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-934c7871-5a54-4911-8982-7d03e1730b48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:30.788839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-934c7871-5a54-4911-8982-7d03e1730b48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:30.789274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-934c7871-5a54-4911-8982-7d03e1730b48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:30.892576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-934c7871-5a54-4911-8982-7d03e1730b48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:30.901893 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-934c7871-5a54-4911-8982-7d03e1730b48 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1299 microversion: 2.1 time: 0.137449 Aug 27 03:34:30.902826 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3503/6823] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:30 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:31.936149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0529b0b0-f73b-4813-b2ad-d8cd9226dcef tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:31.936997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0529b0b0-f73b-4813-b2ad-d8cd9226dcef tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:31.949921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0529b0b0-f73b-4813-b2ad-d8cd9226dcef tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:31.950954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0529b0b0-f73b-4813-b2ad-d8cd9226dcef tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:31.951873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0529b0b0-f73b-4813-b2ad-d8cd9226dcef tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:31.953377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0529b0b0-f73b-4813-b2ad-d8cd9226dcef tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:31.954329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0529b0b0-f73b-4813-b2ad-d8cd9226dcef tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:31.955150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0529b0b0-f73b-4813-b2ad-d8cd9226dcef tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:32.153422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0529b0b0-f73b-4813-b2ad-d8cd9226dcef tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:32.164643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0529b0b0-f73b-4813-b2ad-d8cd9226dcef tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1365 microversion: 2.1 time: 0.232422 Aug 27 03:34:32.165614 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3321/6824] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:31 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:32.649162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f13d5b78-01a0-4e9d-bc8e-c1f4584e0b8d req-1fcf3a5b-e89d-41b6-a1ae-3ea08430166a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79d3c1d-ef7d-4f4d-a34d-665908efddb0", "tag": "090efb55-7e0d-46ca-8084-54cda5db4eb1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:32.660700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f13d5b78-01a0-4e9d-bc8e-c1f4584e0b8d req-1fcf3a5b-e89d-41b6-a1ae-3ea08430166a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:32.661182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f13d5b78-01a0-4e9d-bc8e-c1f4584e0b8d req-1fcf3a5b-e89d-41b6-a1ae-3ea08430166a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:32.661625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f13d5b78-01a0-4e9d-bc8e-c1f4584e0b8d req-1fcf3a5b-e89d-41b6-a1ae-3ea08430166a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:32.676831 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f13d5b78-01a0-4e9d-bc8e-c1f4584e0b8d req-1fcf3a5b-e89d-41b6-a1ae-3ea08430166a service nova] Creating event network-changed:090efb55-7e0d-46ca-8084-54cda5db4eb1 for instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 on n-h2-852084-5 Aug 27 03:34:32.682115 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f13d5b78-01a0-4e9d-bc8e-c1f4584e0b8d req-1fcf3a5b-e89d-41b6-a1ae-3ea08430166a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037552 Aug 27 03:34:32.683150 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3504/6825] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:33.188668 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8721e92f-51a1-4378-8cdc-318e90effe02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:33.189562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8721e92f-51a1-4378-8cdc-318e90effe02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:33.199675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8721e92f-51a1-4378-8cdc-318e90effe02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:33.200458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8721e92f-51a1-4378-8cdc-318e90effe02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:33.201126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8721e92f-51a1-4378-8cdc-318e90effe02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:33.202295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8721e92f-51a1-4378-8cdc-318e90effe02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:33.203059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8721e92f-51a1-4378-8cdc-318e90effe02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:33.203768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8721e92f-51a1-4378-8cdc-318e90effe02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:33.360036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8721e92f-51a1-4378-8cdc-318e90effe02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:33.368628 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8721e92f-51a1-4378-8cdc-318e90effe02 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1365 microversion: 2.1 time: 0.184692 Aug 27 03:34:33.369220 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3322/6826] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:33 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:34.392037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9fa19a78-ed9e-49fe-9d7f-fc22d9517934 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:34.392782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9fa19a78-ed9e-49fe-9d7f-fc22d9517934 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:34.400832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa19a78-ed9e-49fe-9d7f-fc22d9517934 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:34.401331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa19a78-ed9e-49fe-9d7f-fc22d9517934 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:34.401849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa19a78-ed9e-49fe-9d7f-fc22d9517934 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:34.402576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa19a78-ed9e-49fe-9d7f-fc22d9517934 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:34.403193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa19a78-ed9e-49fe-9d7f-fc22d9517934 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:34.403634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa19a78-ed9e-49fe-9d7f-fc22d9517934 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:34.589083 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9fa19a78-ed9e-49fe-9d7f-fc22d9517934 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:34.598466 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9fa19a78-ed9e-49fe-9d7f-fc22d9517934 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1365 microversion: 2.1 time: 0.211391 Aug 27 03:34:34.599085 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3505/6827] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:34 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:35.620370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf23b157-74c5-4ea9-95dd-f9106524ce27 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:35.621015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf23b157-74c5-4ea9-95dd-f9106524ce27 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:35.628617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf23b157-74c5-4ea9-95dd-f9106524ce27 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:35.629132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf23b157-74c5-4ea9-95dd-f9106524ce27 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:35.629597 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf23b157-74c5-4ea9-95dd-f9106524ce27 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:35.630369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf23b157-74c5-4ea9-95dd-f9106524ce27 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:35.630847 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf23b157-74c5-4ea9-95dd-f9106524ce27 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:35.631295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf23b157-74c5-4ea9-95dd-f9106524ce27 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:35.772985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf23b157-74c5-4ea9-95dd-f9106524ce27 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:35.782793 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf23b157-74c5-4ea9-95dd-f9106524ce27 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1365 microversion: 2.1 time: 0.166364 Aug 27 03:34:35.783554 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3323/6828] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:35 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:36.804874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-09c64058-1c38-4ed8-987d-beef09f26713 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:36.805506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-09c64058-1c38-4ed8-987d-beef09f26713 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:36.813910 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c64058-1c38-4ed8-987d-beef09f26713 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:36.814491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c64058-1c38-4ed8-987d-beef09f26713 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:36.815102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c64058-1c38-4ed8-987d-beef09f26713 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:36.815861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c64058-1c38-4ed8-987d-beef09f26713 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:36.816339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c64058-1c38-4ed8-987d-beef09f26713 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:36.816782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-09c64058-1c38-4ed8-987d-beef09f26713 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:36.998390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-09c64058-1c38-4ed8-987d-beef09f26713 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:37.013844 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-09c64058-1c38-4ed8-987d-beef09f26713 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1365 microversion: 2.1 time: 0.212628 Aug 27 03:34:37.015144 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3506/6829] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:36 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:38.040123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-739898ed-8711-44c8-b134-0b954e2a1c80 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:38.041095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-739898ed-8711-44c8-b134-0b954e2a1c80 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:38.052025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739898ed-8711-44c8-b134-0b954e2a1c80 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:38.052846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739898ed-8711-44c8-b134-0b954e2a1c80 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:38.053550 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739898ed-8711-44c8-b134-0b954e2a1c80 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:38.054810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739898ed-8711-44c8-b134-0b954e2a1c80 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:38.055625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739898ed-8711-44c8-b134-0b954e2a1c80 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:38.056295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-739898ed-8711-44c8-b134-0b954e2a1c80 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:38.233404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-739898ed-8711-44c8-b134-0b954e2a1c80 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:38.242859 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-739898ed-8711-44c8-b134-0b954e2a1c80 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1365 microversion: 2.1 time: 0.209614 Aug 27 03:34:38.243462 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3324/6830] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:38 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:39.028183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-61f5a1a1-4bf2-4e48-90cb-00c61aa811a1 req-2baf7a53-333b-49ca-9b31-ea0f2f1fa48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79d3c1d-ef7d-4f4d-a34d-665908efddb0", "name": "network-vif-plugged", "status": "completed", "tag": "090efb55-7e0d-46ca-8084-54cda5db4eb1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:39.040666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-61f5a1a1-4bf2-4e48-90cb-00c61aa811a1 req-2baf7a53-333b-49ca-9b31-ea0f2f1fa48f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:39.041214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-61f5a1a1-4bf2-4e48-90cb-00c61aa811a1 req-2baf7a53-333b-49ca-9b31-ea0f2f1fa48f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:39.041754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-61f5a1a1-4bf2-4e48-90cb-00c61aa811a1 req-2baf7a53-333b-49ca-9b31-ea0f2f1fa48f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:39.053807 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-61f5a1a1-4bf2-4e48-90cb-00c61aa811a1 req-2baf7a53-333b-49ca-9b31-ea0f2f1fa48f service nova] Creating event network-vif-plugged:090efb55-7e0d-46ca-8084-54cda5db4eb1 for instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 on n-h2-852084-5 Aug 27 03:34:39.059034 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-61f5a1a1-4bf2-4e48-90cb-00c61aa811a1 req-2baf7a53-333b-49ca-9b31-ea0f2f1fa48f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034678 Aug 27 03:34:39.059811 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3507/6831] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:39.264848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dc3db754-7ebe-4551-8942-7d043ba52b32 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:39.266081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dc3db754-7ebe-4551-8942-7d043ba52b32 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:39.273595 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc3db754-7ebe-4551-8942-7d043ba52b32 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:39.274142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc3db754-7ebe-4551-8942-7d043ba52b32 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:39.274601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc3db754-7ebe-4551-8942-7d043ba52b32 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:39.275336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc3db754-7ebe-4551-8942-7d043ba52b32 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:39.275809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc3db754-7ebe-4551-8942-7d043ba52b32 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:39.276253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dc3db754-7ebe-4551-8942-7d043ba52b32 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:39.430973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dc3db754-7ebe-4551-8942-7d043ba52b32 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:39.439668 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dc3db754-7ebe-4551-8942-7d043ba52b32 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1365 microversion: 2.1 time: 0.178755 Aug 27 03:34:39.440284 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3325/6832] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:39 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:34:40.460602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:40.461744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:40.468352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eef49d64-f70b-407e-8192-d93813420d8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:40.469073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eef49d64-f70b-407e-8192-d93813420d8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:40.477263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eef49d64-f70b-407e-8192-d93813420d8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:40.477786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eef49d64-f70b-407e-8192-d93813420d8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:40.478342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eef49d64-f70b-407e-8192-d93813420d8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:40.479184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eef49d64-f70b-407e-8192-d93813420d8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:40.479675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eef49d64-f70b-407e-8192-d93813420d8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:40.480245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eef49d64-f70b-407e-8192-d93813420d8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:40.627738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eef49d64-f70b-407e-8192-d93813420d8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:34:40.639079 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eef49d64-f70b-407e-8192-d93813420d8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1552 microversion: 2.1 time: 0.179487 Aug 27 03:34:40.639587 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3508/6833] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:34:40 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1552 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:34:40.660149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-339af749-bdb3-46df-bffd-2d650b42f2c3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:34:40.660695 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-339af749-bdb3-46df-bffd-2d650b42f2c3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:34:40.662872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:34:40.669939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339af749-bdb3-46df-bffd-2d650b42f2c3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:40.670737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339af749-bdb3-46df-bffd-2d650b42f2c3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:40.671913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339af749-bdb3-46df-bffd-2d650b42f2c3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:40.672718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339af749-bdb3-46df-bffd-2d650b42f2c3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:40.673325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339af749-bdb3-46df-bffd-2d650b42f2c3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:40.674078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-339af749-bdb3-46df-bffd-2d650b42f2c3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:40.759511 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-339af749-bdb3-46df-bffd-2d650b42f2c3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103246 Aug 27 03:34:40.760109 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3326/6834] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 03:34:40 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:34:41.763597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-bba69b7a-9dfa-47a9-8c47-adabffe76221 req-92eaa27a-965e-4c40-94f1-5653528205a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79d3c1d-ef7d-4f4d-a34d-665908efddb0", "tag": "090efb55-7e0d-46ca-8084-54cda5db4eb1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:34:41.774722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bba69b7a-9dfa-47a9-8c47-adabffe76221 req-92eaa27a-965e-4c40-94f1-5653528205a0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:34:41.775209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bba69b7a-9dfa-47a9-8c47-adabffe76221 req-92eaa27a-965e-4c40-94f1-5653528205a0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:34:41.775639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-bba69b7a-9dfa-47a9-8c47-adabffe76221 req-92eaa27a-965e-4c40-94f1-5653528205a0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:34:41.787853 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-bba69b7a-9dfa-47a9-8c47-adabffe76221 req-92eaa27a-965e-4c40-94f1-5653528205a0 service nova] Creating event network-changed:090efb55-7e0d-46ca-8084-54cda5db4eb1 for instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 on n-h2-852084-5 Aug 27 03:34:41.793059 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-bba69b7a-9dfa-47a9-8c47-adabffe76221 req-92eaa27a-965e-4c40-94f1-5653528205a0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033437 Aug 27 03:34:41.793731 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3509/6835] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:18.043104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:18.044083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:18.048665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-16421e5a-5592-4b7d-84cf-80c8e42b012e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:18.049356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-16421e5a-5592-4b7d-84cf-80c8e42b012e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:18.059307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16421e5a-5592-4b7d-84cf-80c8e42b012e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:18.060127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16421e5a-5592-4b7d-84cf-80c8e42b012e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:18.060748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16421e5a-5592-4b7d-84cf-80c8e42b012e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:18.061482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16421e5a-5592-4b7d-84cf-80c8e42b012e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:18.062019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16421e5a-5592-4b7d-84cf-80c8e42b012e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:18.062463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-16421e5a-5592-4b7d-84cf-80c8e42b012e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:18.251872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-16421e5a-5592-4b7d-84cf-80c8e42b012e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:18.260448 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-16421e5a-5592-4b7d-84cf-80c8e42b012e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1670 microversion: 2.1 time: 0.219603 Aug 27 03:35:18.261029 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3327/6836] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:18 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1670 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:18.280193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:18.280935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=62 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:18.285368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da4d332d-9725-4c6a-b674-94b078d26be2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90628ef7-0104-4ff9-927d-3a2084db9912"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:18.288028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-da4d332d-9725-4c6a-b674-94b078d26be2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:18.296335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da4d332d-9725-4c6a-b674-94b078d26be2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:18.296832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da4d332d-9725-4c6a-b674-94b078d26be2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:18.297279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da4d332d-9725-4c6a-b674-94b078d26be2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:18.298062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da4d332d-9725-4c6a-b674-94b078d26be2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:18.298530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da4d332d-9725-4c6a-b674-94b078d26be2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:18.298964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da4d332d-9725-4c6a-b674-94b078d26be2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:18.720422 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-da4d332d-9725-4c6a-b674-94b078d26be2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.442277 Aug 27 03:35:18.721051 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3510/6837] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:35:18 2022] POST /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0/os-volume_attachments => generated 194 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:29.431905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:29.434338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:29.437161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:29.437936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:29.444424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:29.444932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:29.445390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.446135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:29.446605 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:29.447049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.475510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.481206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Old instance type m1.heat2, new instance type m1.heat {{(pid=122487) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:35:29.488875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:35:29.489315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:35:29.489863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:35:29.490293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:35:29.490720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:35:29.555115 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9dca9997-d3cc-4c10-aa64-65205498638c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0/action" status: 202 len: 0 microversion: 2.1 time: 0.127198 Aug 27 03:35:29.555737 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3328/6838] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:35:29 2022] POST /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:35:29.562314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:29.563197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:35:29.568160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-402133d5-413c-4dd8-aaee-f44baf3988ec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:29.568871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-402133d5-413c-4dd8-aaee-f44baf3988ec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:29.577357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-402133d5-413c-4dd8-aaee-f44baf3988ec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:29.577900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-402133d5-413c-4dd8-aaee-f44baf3988ec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:29.578349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-402133d5-413c-4dd8-aaee-f44baf3988ec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.579058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-402133d5-413c-4dd8-aaee-f44baf3988ec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:29.579517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-402133d5-413c-4dd8-aaee-f44baf3988ec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:29.579947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-402133d5-413c-4dd8-aaee-f44baf3988ec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:29.740097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-402133d5-413c-4dd8-aaee-f44baf3988ec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:29.749524 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-402133d5-413c-4dd8-aaee-f44baf3988ec tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1725 microversion: 2.1 time: 0.189188 Aug 27 03:35:29.750159 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3511/6839] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:29 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:30.773370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d8c3fa0f-3d26-4457-b1fa-398636c78c75 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:30.774131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d8c3fa0f-3d26-4457-b1fa-398636c78c75 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:30.781728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8c3fa0f-3d26-4457-b1fa-398636c78c75 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:30.782241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8c3fa0f-3d26-4457-b1fa-398636c78c75 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:30.783035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8c3fa0f-3d26-4457-b1fa-398636c78c75 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:30.783429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8c3fa0f-3d26-4457-b1fa-398636c78c75 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:30.783901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8c3fa0f-3d26-4457-b1fa-398636c78c75 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:30.784350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d8c3fa0f-3d26-4457-b1fa-398636c78c75 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:30.935183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d8c3fa0f-3d26-4457-b1fa-398636c78c75 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:30.944738 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d8c3fa0f-3d26-4457-b1fa-398636c78c75 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1725 microversion: 2.1 time: 0.175812 Aug 27 03:35:30.945328 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3329/6840] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:30 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:31.966991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dafbf01a-5e83-49a8-b3d3-b66e1fb5ca10 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:31.967586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dafbf01a-5e83-49a8-b3d3-b66e1fb5ca10 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:31.974540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dafbf01a-5e83-49a8-b3d3-b66e1fb5ca10 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:31.975659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dafbf01a-5e83-49a8-b3d3-b66e1fb5ca10 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:31.976096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dafbf01a-5e83-49a8-b3d3-b66e1fb5ca10 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:31.976793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dafbf01a-5e83-49a8-b3d3-b66e1fb5ca10 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:31.977250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dafbf01a-5e83-49a8-b3d3-b66e1fb5ca10 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:31.977694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dafbf01a-5e83-49a8-b3d3-b66e1fb5ca10 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:32.109705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dafbf01a-5e83-49a8-b3d3-b66e1fb5ca10 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:32.118234 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dafbf01a-5e83-49a8-b3d3-b66e1fb5ca10 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.155509 Aug 27 03:35:32.118821 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3512/6841] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:31 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:33.140407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65a6840b-a74d-4201-a213-386e2a372d7c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:33.141064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65a6840b-a74d-4201-a213-386e2a372d7c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:33.148409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65a6840b-a74d-4201-a213-386e2a372d7c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:33.148909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65a6840b-a74d-4201-a213-386e2a372d7c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:33.149356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65a6840b-a74d-4201-a213-386e2a372d7c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:33.150090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65a6840b-a74d-4201-a213-386e2a372d7c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:33.150558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65a6840b-a74d-4201-a213-386e2a372d7c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:33.151067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65a6840b-a74d-4201-a213-386e2a372d7c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:33.288230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-65a6840b-a74d-4201-a213-386e2a372d7c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:33.296599 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65a6840b-a74d-4201-a213-386e2a372d7c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.160133 Aug 27 03:35:33.297177 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3330/6842] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:33 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:34.318061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-649df31d-39f4-41dd-9243-8ef044fc0492 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:34.318592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-649df31d-39f4-41dd-9243-8ef044fc0492 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:34.325702 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-649df31d-39f4-41dd-9243-8ef044fc0492 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:34.326201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-649df31d-39f4-41dd-9243-8ef044fc0492 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:34.326646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-649df31d-39f4-41dd-9243-8ef044fc0492 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:34.327350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-649df31d-39f4-41dd-9243-8ef044fc0492 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:34.327807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-649df31d-39f4-41dd-9243-8ef044fc0492 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:34.328237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-649df31d-39f4-41dd-9243-8ef044fc0492 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:34.462116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-649df31d-39f4-41dd-9243-8ef044fc0492 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:34.470699 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-649df31d-39f4-41dd-9243-8ef044fc0492 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.156822 Aug 27 03:35:34.471283 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3513/6843] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:34 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:35.493218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a5e55f8c-59f8-4e04-b0cc-b6e120e5fa85 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:35.493907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a5e55f8c-59f8-4e04-b0cc-b6e120e5fa85 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:35.501940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5e55f8c-59f8-4e04-b0cc-b6e120e5fa85 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:35.502448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5e55f8c-59f8-4e04-b0cc-b6e120e5fa85 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:35.502909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5e55f8c-59f8-4e04-b0cc-b6e120e5fa85 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:35.503630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5e55f8c-59f8-4e04-b0cc-b6e120e5fa85 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:35.504110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5e55f8c-59f8-4e04-b0cc-b6e120e5fa85 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:35.504563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a5e55f8c-59f8-4e04-b0cc-b6e120e5fa85 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:35.641971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a5e55f8c-59f8-4e04-b0cc-b6e120e5fa85 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:35.650165 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a5e55f8c-59f8-4e04-b0cc-b6e120e5fa85 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.161481 Aug 27 03:35:35.650744 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3331/6844] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:35 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:36.671322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eae897f9-1c15-4f7c-9b3f-0f10499edff8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:36.671846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eae897f9-1c15-4f7c-9b3f-0f10499edff8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:36.679407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae897f9-1c15-4f7c-9b3f-0f10499edff8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:36.679893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae897f9-1c15-4f7c-9b3f-0f10499edff8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:36.680333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae897f9-1c15-4f7c-9b3f-0f10499edff8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:36.681026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae897f9-1c15-4f7c-9b3f-0f10499edff8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:36.681491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae897f9-1c15-4f7c-9b3f-0f10499edff8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:36.681964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eae897f9-1c15-4f7c-9b3f-0f10499edff8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:36.812782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eae897f9-1c15-4f7c-9b3f-0f10499edff8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:36.821564 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eae897f9-1c15-4f7c-9b3f-0f10499edff8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.154247 Aug 27 03:35:36.822172 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3514/6845] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:36 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:37.843852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-82ccdb38-13ff-44a9-b63e-627212ff2b55 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:37.844394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-82ccdb38-13ff-44a9-b63e-627212ff2b55 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:37.851757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ccdb38-13ff-44a9-b63e-627212ff2b55 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:37.852257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ccdb38-13ff-44a9-b63e-627212ff2b55 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:37.852715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ccdb38-13ff-44a9-b63e-627212ff2b55 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:37.853428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ccdb38-13ff-44a9-b63e-627212ff2b55 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:37.853931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ccdb38-13ff-44a9-b63e-627212ff2b55 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:37.854380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-82ccdb38-13ff-44a9-b63e-627212ff2b55 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:37.988095 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-82ccdb38-13ff-44a9-b63e-627212ff2b55 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:37.996854 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-82ccdb38-13ff-44a9-b63e-627212ff2b55 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.157310 Aug 27 03:35:37.997420 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3332/6846] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:37 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:39.019772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b1aa5e6b-7a52-4412-b343-a7afbb322f4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:39.020411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b1aa5e6b-7a52-4412-b343-a7afbb322f4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:39.027323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1aa5e6b-7a52-4412-b343-a7afbb322f4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:39.027819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1aa5e6b-7a52-4412-b343-a7afbb322f4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:39.028272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1aa5e6b-7a52-4412-b343-a7afbb322f4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:39.028974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1aa5e6b-7a52-4412-b343-a7afbb322f4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:39.029441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1aa5e6b-7a52-4412-b343-a7afbb322f4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:39.029904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1aa5e6b-7a52-4412-b343-a7afbb322f4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:39.164744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b1aa5e6b-7a52-4412-b343-a7afbb322f4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:39.173230 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b1aa5e6b-7a52-4412-b343-a7afbb322f4e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.157981 Aug 27 03:35:39.173834 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3515/6847] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:39 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:40.194908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f205ad3c-677e-4120-92cb-46e224409a8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:40.195490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f205ad3c-677e-4120-92cb-46e224409a8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:40.202557 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f205ad3c-677e-4120-92cb-46e224409a8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:40.203084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f205ad3c-677e-4120-92cb-46e224409a8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:40.203883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f205ad3c-677e-4120-92cb-46e224409a8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:40.204606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f205ad3c-677e-4120-92cb-46e224409a8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:40.205082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f205ad3c-677e-4120-92cb-46e224409a8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:40.205530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f205ad3c-677e-4120-92cb-46e224409a8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:40.343615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f205ad3c-677e-4120-92cb-46e224409a8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:40.352494 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f205ad3c-677e-4120-92cb-46e224409a8f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.162252 Aug 27 03:35:40.353083 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3333/6848] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:40 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:41.373539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-13f83433-7c29-4619-ad85-ab5af2d64a57 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:41.374226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-13f83433-7c29-4619-ad85-ab5af2d64a57 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:41.381599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f83433-7c29-4619-ad85-ab5af2d64a57 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:41.382716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f83433-7c29-4619-ad85-ab5af2d64a57 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:41.383178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f83433-7c29-4619-ad85-ab5af2d64a57 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:41.383906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f83433-7c29-4619-ad85-ab5af2d64a57 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:41.384374 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f83433-7c29-4619-ad85-ab5af2d64a57 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:41.384808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-13f83433-7c29-4619-ad85-ab5af2d64a57 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:41.517784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-13f83433-7c29-4619-ad85-ab5af2d64a57 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:41.526236 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-13f83433-7c29-4619-ad85-ab5af2d64a57 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.156590 Aug 27 03:35:41.526834 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3516/6849] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:41 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:42.547483 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4a57457a-fa76-470d-ba06-a93d7416baf1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:42.548108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4a57457a-fa76-470d-ba06-a93d7416baf1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:42.555539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a57457a-fa76-470d-ba06-a93d7416baf1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:42.556036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a57457a-fa76-470d-ba06-a93d7416baf1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:42.556482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a57457a-fa76-470d-ba06-a93d7416baf1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:42.557183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a57457a-fa76-470d-ba06-a93d7416baf1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:42.557653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a57457a-fa76-470d-ba06-a93d7416baf1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:42.558132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4a57457a-fa76-470d-ba06-a93d7416baf1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:42.686664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4a57457a-fa76-470d-ba06-a93d7416baf1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:42.694855 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4a57457a-fa76-470d-ba06-a93d7416baf1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.151258 Aug 27 03:35:42.695423 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3334/6850] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:42 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:43.716989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1f49232d-13c2-4933-be9a-fb542c774f11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:43.717608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1f49232d-13c2-4933-be9a-fb542c774f11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:43.724634 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f49232d-13c2-4933-be9a-fb542c774f11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:43.725131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f49232d-13c2-4933-be9a-fb542c774f11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:43.726267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f49232d-13c2-4933-be9a-fb542c774f11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:43.726974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f49232d-13c2-4933-be9a-fb542c774f11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:43.727434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f49232d-13c2-4933-be9a-fb542c774f11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:43.727869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f49232d-13c2-4933-be9a-fb542c774f11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:43.861601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f49232d-13c2-4933-be9a-fb542c774f11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:43.870101 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1f49232d-13c2-4933-be9a-fb542c774f11 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.157485 Aug 27 03:35:43.870684 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3517/6851] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:43 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:44.937048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7433ec26-af3b-4d7a-9079-7c261baa156f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:44.937690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7433ec26-af3b-4d7a-9079-7c261baa156f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:44.943738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7433ec26-af3b-4d7a-9079-7c261baa156f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:44.944734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7433ec26-af3b-4d7a-9079-7c261baa156f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:44.945193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7433ec26-af3b-4d7a-9079-7c261baa156f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:44.945975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7433ec26-af3b-4d7a-9079-7c261baa156f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:44.946404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7433ec26-af3b-4d7a-9079-7c261baa156f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:44.946851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7433ec26-af3b-4d7a-9079-7c261baa156f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:45.079323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7433ec26-af3b-4d7a-9079-7c261baa156f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:45.088343 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7433ec26-af3b-4d7a-9079-7c261baa156f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.200920 Aug 27 03:35:45.088924 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3335/6852] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:44 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:46.110341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8a2d32b9-48f8-4c39-8467-4c1d621c60e3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:46.110879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8a2d32b9-48f8-4c39-8467-4c1d621c60e3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:46.117868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a2d32b9-48f8-4c39-8467-4c1d621c60e3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:46.118355 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a2d32b9-48f8-4c39-8467-4c1d621c60e3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:46.118798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a2d32b9-48f8-4c39-8467-4c1d621c60e3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:46.119495 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a2d32b9-48f8-4c39-8467-4c1d621c60e3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:46.119956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a2d32b9-48f8-4c39-8467-4c1d621c60e3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:46.120384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a2d32b9-48f8-4c39-8467-4c1d621c60e3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:46.248553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8a2d32b9-48f8-4c39-8467-4c1d621c60e3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:46.257376 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8a2d32b9-48f8-4c39-8467-4c1d621c60e3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.150872 Aug 27 03:35:46.257989 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3518/6853] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:46 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:35:47.279312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e0036d83-a367-42af-9fbc-bc30197a83e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:47.279966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e0036d83-a367-42af-9fbc-bc30197a83e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:47.286877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0036d83-a367-42af-9fbc-bc30197a83e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:47.287375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0036d83-a367-42af-9fbc-bc30197a83e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:47.287851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0036d83-a367-42af-9fbc-bc30197a83e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:47.288560 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0036d83-a367-42af-9fbc-bc30197a83e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:47.289024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0036d83-a367-42af-9fbc-bc30197a83e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:47.289463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e0036d83-a367-42af-9fbc-bc30197a83e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:47.419831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e0036d83-a367-42af-9fbc-bc30197a83e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:47.428097 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e0036d83-a367-42af-9fbc-bc30197a83e9 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.152759 Aug 27 03:35:47.429155 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3336/6854] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:47 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:48.450746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b213b21b-26ce-44f9-aacd-75bcead39c26 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:48.451392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b213b21b-26ce-44f9-aacd-75bcead39c26 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:48.458625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b213b21b-26ce-44f9-aacd-75bcead39c26 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:48.459115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b213b21b-26ce-44f9-aacd-75bcead39c26 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:48.459569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b213b21b-26ce-44f9-aacd-75bcead39c26 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:48.460272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b213b21b-26ce-44f9-aacd-75bcead39c26 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:48.460737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b213b21b-26ce-44f9-aacd-75bcead39c26 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:48.461171 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b213b21b-26ce-44f9-aacd-75bcead39c26 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:48.590480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b213b21b-26ce-44f9-aacd-75bcead39c26 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:48.599882 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b213b21b-26ce-44f9-aacd-75bcead39c26 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.153080 Aug 27 03:35:48.600963 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3519/6855] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:48 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:49.623052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7bb276ce-0a82-4eff-a3c5-cbbbefdc7c52 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:49.623774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7bb276ce-0a82-4eff-a3c5-cbbbefdc7c52 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:49.631022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb276ce-0a82-4eff-a3c5-cbbbefdc7c52 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:49.632199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb276ce-0a82-4eff-a3c5-cbbbefdc7c52 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:49.632677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb276ce-0a82-4eff-a3c5-cbbbefdc7c52 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:49.633416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb276ce-0a82-4eff-a3c5-cbbbefdc7c52 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:49.633918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb276ce-0a82-4eff-a3c5-cbbbefdc7c52 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:49.634373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bb276ce-0a82-4eff-a3c5-cbbbefdc7c52 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:49.785719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7bb276ce-0a82-4eff-a3c5-cbbbefdc7c52 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:49.795124 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7bb276ce-0a82-4eff-a3c5-cbbbefdc7c52 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.175893 Aug 27 03:35:49.806207 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3337/6856] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:49 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:50.816517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-edcf12b1-779b-4cf6-bc57-3b31e224483a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:50.817131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-edcf12b1-779b-4cf6-bc57-3b31e224483a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:50.826145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edcf12b1-779b-4cf6-bc57-3b31e224483a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.826643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edcf12b1-779b-4cf6-bc57-3b31e224483a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.827079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edcf12b1-779b-4cf6-bc57-3b31e224483a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.827782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edcf12b1-779b-4cf6-bc57-3b31e224483a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:50.828235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edcf12b1-779b-4cf6-bc57-3b31e224483a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:50.828658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-edcf12b1-779b-4cf6-bc57-3b31e224483a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:50.977296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-edcf12b1-779b-4cf6-bc57-3b31e224483a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:50.986343 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-edcf12b1-779b-4cf6-bc57-3b31e224483a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1730 microversion: 2.1 time: 0.173736 Aug 27 03:35:50.986938 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3520/6857] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:50 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:51.344137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d74a4c25-54ac-46f0-85c4-2d6b5fea2a5b req-482fb13a-3510-46e1-b39c-336618da3f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79d3c1d-ef7d-4f4d-a34d-665908efddb0", "name": "network-vif-unplugged", "status": "completed", "tag": "090efb55-7e0d-46ca-8084-54cda5db4eb1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:51.355885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d74a4c25-54ac-46f0-85c4-2d6b5fea2a5b req-482fb13a-3510-46e1-b39c-336618da3f06 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:51.356396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d74a4c25-54ac-46f0-85c4-2d6b5fea2a5b req-482fb13a-3510-46e1-b39c-336618da3f06 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:51.356946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d74a4c25-54ac-46f0-85c4-2d6b5fea2a5b req-482fb13a-3510-46e1-b39c-336618da3f06 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:51.370471 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d74a4c25-54ac-46f0-85c4-2d6b5fea2a5b req-482fb13a-3510-46e1-b39c-336618da3f06 service nova] Creating event network-vif-unplugged:090efb55-7e0d-46ca-8084-54cda5db4eb1 for instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 on n-h1-852084-5 Aug 27 03:35:51.376053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-d74a4c25-54ac-46f0-85c4-2d6b5fea2a5b req-482fb13a-3510-46e1-b39c-336618da3f06 service nova] Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:35:51.387315 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d74a4c25-54ac-46f0-85c4-2d6b5fea2a5b req-482fb13a-3510-46e1-b39c-336618da3f06 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047169 Aug 27 03:35:51.387939 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3338/6858] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:35:52.009566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4de9ee04-98b4-4b23-a7b2-e5eb4ba3bf2b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:52.010241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4de9ee04-98b4-4b23-a7b2-e5eb4ba3bf2b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:52.017561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4de9ee04-98b4-4b23-a7b2-e5eb4ba3bf2b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:52.018087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4de9ee04-98b4-4b23-a7b2-e5eb4ba3bf2b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:52.018538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4de9ee04-98b4-4b23-a7b2-e5eb4ba3bf2b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.019285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4de9ee04-98b4-4b23-a7b2-e5eb4ba3bf2b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:52.019749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4de9ee04-98b4-4b23-a7b2-e5eb4ba3bf2b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:52.020316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4de9ee04-98b4-4b23-a7b2-e5eb4ba3bf2b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:52.158723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4de9ee04-98b4-4b23-a7b2-e5eb4ba3bf2b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:52.167153 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4de9ee04-98b4-4b23-a7b2-e5eb4ba3bf2b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1729 microversion: 2.1 time: 0.162074 Aug 27 03:35:52.167747 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3521/6859] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:52 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:53.189837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ac0755b1-ddf3-49db-b1a9-149072c05055 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:53.190574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac0755b1-ddf3-49db-b1a9-149072c05055 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:53.197448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac0755b1-ddf3-49db-b1a9-149072c05055 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.197974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac0755b1-ddf3-49db-b1a9-149072c05055 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.198429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac0755b1-ddf3-49db-b1a9-149072c05055 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.199143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac0755b1-ddf3-49db-b1a9-149072c05055 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.199615 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac0755b1-ddf3-49db-b1a9-149072c05055 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.200053 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac0755b1-ddf3-49db-b1a9-149072c05055 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.345505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac0755b1-ddf3-49db-b1a9-149072c05055 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:53.354166 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ac0755b1-ddf3-49db-b1a9-149072c05055 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1727 microversion: 2.1 time: 0.169427 Aug 27 03:35:53.354752 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3339/6860] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:53 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:53.401875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-07a737eb-bdd9-4133-8bd0-adc9f09cfd1f req-8a4262cc-5ccd-4f88-b96b-e246166f6b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79d3c1d-ef7d-4f4d-a34d-665908efddb0", "tag": "090efb55-7e0d-46ca-8084-54cda5db4eb1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:35:53.412496 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-07a737eb-bdd9-4133-8bd0-adc9f09cfd1f req-8a4262cc-5ccd-4f88-b96b-e246166f6b84 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:53.412979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-07a737eb-bdd9-4133-8bd0-adc9f09cfd1f req-8a4262cc-5ccd-4f88-b96b-e246166f6b84 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:53.413427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-07a737eb-bdd9-4133-8bd0-adc9f09cfd1f req-8a4262cc-5ccd-4f88-b96b-e246166f6b84 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:53.425255 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-07a737eb-bdd9-4133-8bd0-adc9f09cfd1f req-8a4262cc-5ccd-4f88-b96b-e246166f6b84 service nova] Creating event network-changed:090efb55-7e0d-46ca-8084-54cda5db4eb1 for instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 on n-h1-852084-5 Aug 27 03:35:53.431109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-07a737eb-bdd9-4133-8bd0-adc9f09cfd1f req-8a4262cc-5ccd-4f88-b96b-e246166f6b84 service nova] Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:35:53.441954 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-07a737eb-bdd9-4133-8bd0-adc9f09cfd1f req-8a4262cc-5ccd-4f88-b96b-e246166f6b84 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043811 Aug 27 03:35:53.442578 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3522/6861] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:35:54.376534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b9697c7c-1b9a-4461-ab50-b8c13fb70133 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:54.377249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b9697c7c-1b9a-4461-ab50-b8c13fb70133 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:54.385497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9697c7c-1b9a-4461-ab50-b8c13fb70133 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:54.386041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9697c7c-1b9a-4461-ab50-b8c13fb70133 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:54.386649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9697c7c-1b9a-4461-ab50-b8c13fb70133 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:54.387214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9697c7c-1b9a-4461-ab50-b8c13fb70133 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:54.387970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9697c7c-1b9a-4461-ab50-b8c13fb70133 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:54.388321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9697c7c-1b9a-4461-ab50-b8c13fb70133 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:54.520284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b9697c7c-1b9a-4461-ab50-b8c13fb70133 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:54.530048 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b9697c7c-1b9a-4461-ab50-b8c13fb70133 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1727 microversion: 2.1 time: 0.157289 Aug 27 03:35:54.531202 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3340/6862] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:54 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:55.554089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c9d6fcec-1126-4ba0-ad3a-33394c98e6bc tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:55.554808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c9d6fcec-1126-4ba0-ad3a-33394c98e6bc tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:55.561141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9d6fcec-1126-4ba0-ad3a-33394c98e6bc tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:55.561633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9d6fcec-1126-4ba0-ad3a-33394c98e6bc tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:55.562104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9d6fcec-1126-4ba0-ad3a-33394c98e6bc tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:55.562811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9d6fcec-1126-4ba0-ad3a-33394c98e6bc tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:55.563274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9d6fcec-1126-4ba0-ad3a-33394c98e6bc tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:55.563712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9d6fcec-1126-4ba0-ad3a-33394c98e6bc tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:55.702647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c9d6fcec-1126-4ba0-ad3a-33394c98e6bc tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:55.711120 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c9d6fcec-1126-4ba0-ad3a-33394c98e6bc tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1727 microversion: 2.1 time: 0.162223 Aug 27 03:35:55.711729 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3523/6863] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:55 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:56.732617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-457dd20d-f2d6-4008-8564-96277f37875e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:56.733231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-457dd20d-f2d6-4008-8564-96277f37875e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:56.741096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-457dd20d-f2d6-4008-8564-96277f37875e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:56.741779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-457dd20d-f2d6-4008-8564-96277f37875e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:56.742366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-457dd20d-f2d6-4008-8564-96277f37875e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:56.743253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-457dd20d-f2d6-4008-8564-96277f37875e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:56.743877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-457dd20d-f2d6-4008-8564-96277f37875e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:56.744364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-457dd20d-f2d6-4008-8564-96277f37875e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:56.877928 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-457dd20d-f2d6-4008-8564-96277f37875e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:56.887013 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-457dd20d-f2d6-4008-8564-96277f37875e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1727 microversion: 2.1 time: 0.158378 Aug 27 03:35:56.887592 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3341/6864] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:56 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:57.908549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ce140a63-a84c-4a04-8608-dd9641ae71a3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:57.909227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ce140a63-a84c-4a04-8608-dd9641ae71a3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:57.915689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce140a63-a84c-4a04-8608-dd9641ae71a3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.916178 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce140a63-a84c-4a04-8608-dd9641ae71a3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.916621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce140a63-a84c-4a04-8608-dd9641ae71a3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:57.917319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce140a63-a84c-4a04-8608-dd9641ae71a3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:57.917806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce140a63-a84c-4a04-8608-dd9641ae71a3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:57.918249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce140a63-a84c-4a04-8608-dd9641ae71a3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:58.049180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ce140a63-a84c-4a04-8608-dd9641ae71a3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:58.058136 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ce140a63-a84c-4a04-8608-dd9641ae71a3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1727 microversion: 2.1 time: 0.153494 Aug 27 03:35:58.058911 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3524/6865] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:57 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:35:59.081419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d09c9aef-aadd-4bd9-91fd-3b38b78d1f76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:35:59.082115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d09c9aef-aadd-4bd9-91fd-3b38b78d1f76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:35:59.089855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c9aef-aadd-4bd9-91fd-3b38b78d1f76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:59.090364 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c9aef-aadd-4bd9-91fd-3b38b78d1f76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:59.090827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c9aef-aadd-4bd9-91fd-3b38b78d1f76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:59.091803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c9aef-aadd-4bd9-91fd-3b38b78d1f76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:35:59.092279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c9aef-aadd-4bd9-91fd-3b38b78d1f76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:35:59.092729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d09c9aef-aadd-4bd9-91fd-3b38b78d1f76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:35:59.224984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d09c9aef-aadd-4bd9-91fd-3b38b78d1f76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:35:59.233384 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d09c9aef-aadd-4bd9-91fd-3b38b78d1f76 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1727 microversion: 2.1 time: 0.155920 Aug 27 03:35:59.234001 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3342/6866] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:35:59 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:00.254655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-322770de-769d-42f7-a992-4db6fae608e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:00.255206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-322770de-769d-42f7-a992-4db6fae608e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:00.258050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=29 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:00.263469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-322770de-769d-42f7-a992-4db6fae608e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:00.263957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-322770de-769d-42f7-a992-4db6fae608e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:00.264401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-322770de-769d-42f7-a992-4db6fae608e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:00.265100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-322770de-769d-42f7-a992-4db6fae608e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:00.265556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-322770de-769d-42f7-a992-4db6fae608e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:00.266121 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-322770de-769d-42f7-a992-4db6fae608e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:00.268838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=83 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:00.402943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-322770de-769d-42f7-a992-4db6fae608e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:00.411375 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-322770de-769d-42f7-a992-4db6fae608e1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1727 microversion: 2.1 time: 0.160735 Aug 27 03:36:00.411957 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3525/6867] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:00 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:01.433386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-765fa47c-5d44-4d56-b056-a38caae9d7b0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:01.434060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-765fa47c-5d44-4d56-b056-a38caae9d7b0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:01.436991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=35 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:01.442415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765fa47c-5d44-4d56-b056-a38caae9d7b0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:01.442919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765fa47c-5d44-4d56-b056-a38caae9d7b0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:01.443381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765fa47c-5d44-4d56-b056-a38caae9d7b0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:01.444105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765fa47c-5d44-4d56-b056-a38caae9d7b0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:01.444582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765fa47c-5d44-4d56-b056-a38caae9d7b0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:01.445029 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-765fa47c-5d44-4d56-b056-a38caae9d7b0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:01.447833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:01.577586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-765fa47c-5d44-4d56-b056-a38caae9d7b0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:01.586455 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-765fa47c-5d44-4d56-b056-a38caae9d7b0 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1727 microversion: 2.1 time: 0.156984 Aug 27 03:36:01.587020 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3343/6868] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:01 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:02.608596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3130349e-ae9c-4b1b-9d02-ffad199cc348 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:02.609213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3130349e-ae9c-4b1b-9d02-ffad199cc348 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:02.617030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3130349e-ae9c-4b1b-9d02-ffad199cc348 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:02.617515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3130349e-ae9c-4b1b-9d02-ffad199cc348 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:02.617971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3130349e-ae9c-4b1b-9d02-ffad199cc348 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:02.618660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3130349e-ae9c-4b1b-9d02-ffad199cc348 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:02.619111 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3130349e-ae9c-4b1b-9d02-ffad199cc348 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:02.619533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3130349e-ae9c-4b1b-9d02-ffad199cc348 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:02.751309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3130349e-ae9c-4b1b-9d02-ffad199cc348 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:02.759654 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3130349e-ae9c-4b1b-9d02-ffad199cc348 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1727 microversion: 2.1 time: 0.154982 Aug 27 03:36:02.760237 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3526/6869] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:02 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:03.782791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5c3ff403-0b27-4fe9-bf70-26927fab3711 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:03.783332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5c3ff403-0b27-4fe9-bf70-26927fab3711 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:03.790356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c3ff403-0b27-4fe9-bf70-26927fab3711 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:03.790858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c3ff403-0b27-4fe9-bf70-26927fab3711 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:03.791318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c3ff403-0b27-4fe9-bf70-26927fab3711 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:03.792038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c3ff403-0b27-4fe9-bf70-26927fab3711 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:03.792522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c3ff403-0b27-4fe9-bf70-26927fab3711 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:03.792973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5c3ff403-0b27-4fe9-bf70-26927fab3711 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:04.238275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5c3ff403-0b27-4fe9-bf70-26927fab3711 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:04.247836 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5c3ff403-0b27-4fe9-bf70-26927fab3711 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1727 microversion: 2.1 time: 0.470299 Aug 27 03:36:04.248716 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3344/6870] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:03 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1727 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:05.269185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f25693c6-5244-494a-8a05-9da340332c4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:05.269767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f25693c6-5244-494a-8a05-9da340332c4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:05.276564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f25693c6-5244-494a-8a05-9da340332c4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.277040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f25693c6-5244-494a-8a05-9da340332c4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.277473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f25693c6-5244-494a-8a05-9da340332c4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.278194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f25693c6-5244-494a-8a05-9da340332c4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.278648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f25693c6-5244-494a-8a05-9da340332c4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.279073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f25693c6-5244-494a-8a05-9da340332c4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.414820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f25693c6-5244-494a-8a05-9da340332c4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:05.423127 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f25693c6-5244-494a-8a05-9da340332c4d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1724 microversion: 2.1 time: 0.157888 Aug 27 03:36:05.423708 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3527/6871] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:05 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:05.444076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:05.444663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:05.451699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.452207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.452667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.453382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.453890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.454336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.492646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.493141 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.493601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.494377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.494852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.495328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.515326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:36:05.520576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Getting quotas for user d26902bb305a470087e529c5f3949f78 and project c84ffdee816a4661b43c497f40c8e577. Resources: {'cores', 'ram'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:36:05.621818 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-035ca9ea-65f2-48fa-a5a9-8596d027b36e tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "POST /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0/action" status: 202 len: 0 microversion: 2.1 time: 0.181747 Aug 27 03:36:05.622627 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3345/6872] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:36:05 2022] POST /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:05.630831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e47008bb-a5a1-4a34-8160-5bcf656ac4ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:05.631637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e47008bb-a5a1-4a34-8160-5bcf656ac4ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:05.645132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e47008bb-a5a1-4a34-8160-5bcf656ac4ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.645629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e47008bb-a5a1-4a34-8160-5bcf656ac4ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.646110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e47008bb-a5a1-4a34-8160-5bcf656ac4ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.647315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e47008bb-a5a1-4a34-8160-5bcf656ac4ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:05.647777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e47008bb-a5a1-4a34-8160-5bcf656ac4ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:05.648211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e47008bb-a5a1-4a34-8160-5bcf656ac4ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:05.786218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e47008bb-a5a1-4a34-8160-5bcf656ac4ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:05.795251 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e47008bb-a5a1-4a34-8160-5bcf656ac4ab tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.168206 Aug 27 03:36:05.796066 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3528/6873] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:05 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:06.818804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-49bcc930-d7d7-4d24-841c-14fa6048b0a8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:06.819516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-49bcc930-d7d7-4d24-841c-14fa6048b0a8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:06.826151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49bcc930-d7d7-4d24-841c-14fa6048b0a8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:06.826653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49bcc930-d7d7-4d24-841c-14fa6048b0a8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:06.827107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49bcc930-d7d7-4d24-841c-14fa6048b0a8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:06.827817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49bcc930-d7d7-4d24-841c-14fa6048b0a8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:06.828290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49bcc930-d7d7-4d24-841c-14fa6048b0a8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:06.828730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-49bcc930-d7d7-4d24-841c-14fa6048b0a8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:06.964374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-49bcc930-d7d7-4d24-841c-14fa6048b0a8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:06.972999 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-49bcc930-d7d7-4d24-841c-14fa6048b0a8 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.158806 Aug 27 03:36:06.973629 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3346/6874] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:06 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:07.995718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a9ac2ab1-6c04-47f9-b1c0-6cb5d3e91745 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:07.996331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a9ac2ab1-6c04-47f9-b1c0-6cb5d3e91745 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:08.003483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9ac2ab1-6c04-47f9-b1c0-6cb5d3e91745 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.003966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9ac2ab1-6c04-47f9-b1c0-6cb5d3e91745 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.004479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9ac2ab1-6c04-47f9-b1c0-6cb5d3e91745 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.005082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9ac2ab1-6c04-47f9-b1c0-6cb5d3e91745 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.005536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9ac2ab1-6c04-47f9-b1c0-6cb5d3e91745 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.005989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a9ac2ab1-6c04-47f9-b1c0-6cb5d3e91745 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.147538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a9ac2ab1-6c04-47f9-b1c0-6cb5d3e91745 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:08.155897 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a9ac2ab1-6c04-47f9-b1c0-6cb5d3e91745 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.164094 Aug 27 03:36:08.156670 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3529/6875] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:07 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:08.701228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-33cfd5b3-bb1f-4c05-9f9a-3d3bc49a09f7 req-e717d047-4d40-41a2-b571-ebf2e8c1126f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79d3c1d-ef7d-4f4d-a34d-665908efddb0", "name": "network-vif-plugged", "status": "completed", "tag": "090efb55-7e0d-46ca-8084-54cda5db4eb1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:08.714121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-33cfd5b3-bb1f-4c05-9f9a-3d3bc49a09f7 req-e717d047-4d40-41a2-b571-ebf2e8c1126f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:08.714638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-33cfd5b3-bb1f-4c05-9f9a-3d3bc49a09f7 req-e717d047-4d40-41a2-b571-ebf2e8c1126f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:08.715156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-33cfd5b3-bb1f-4c05-9f9a-3d3bc49a09f7 req-e717d047-4d40-41a2-b571-ebf2e8c1126f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:08.728945 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-33cfd5b3-bb1f-4c05-9f9a-3d3bc49a09f7 req-e717d047-4d40-41a2-b571-ebf2e8c1126f service nova] Creating event network-vif-plugged:090efb55-7e0d-46ca-8084-54cda5db4eb1 for instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 on n-h1-852084-5 Aug 27 03:36:08.735279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-33cfd5b3-bb1f-4c05-9f9a-3d3bc49a09f7 req-e717d047-4d40-41a2-b571-ebf2e8c1126f service nova] Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:36:08.748805 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-33cfd5b3-bb1f-4c05-9f9a-3d3bc49a09f7 req-e717d047-4d40-41a2-b571-ebf2e8c1126f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051754 Aug 27 03:36:08.750183 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3347/6876] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:09.178387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9198e71a-2c0a-48ab-a9c7-75f3dfe7a63a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:09.179159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9198e71a-2c0a-48ab-a9c7-75f3dfe7a63a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:09.186236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9198e71a-2c0a-48ab-a9c7-75f3dfe7a63a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.186719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9198e71a-2c0a-48ab-a9c7-75f3dfe7a63a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.187157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9198e71a-2c0a-48ab-a9c7-75f3dfe7a63a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.187854 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9198e71a-2c0a-48ab-a9c7-75f3dfe7a63a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:09.188326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9198e71a-2c0a-48ab-a9c7-75f3dfe7a63a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:09.188737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9198e71a-2c0a-48ab-a9c7-75f3dfe7a63a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:09.327433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9198e71a-2c0a-48ab-a9c7-75f3dfe7a63a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:09.336308 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9198e71a-2c0a-48ab-a9c7-75f3dfe7a63a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.162487 Aug 27 03:36:09.337015 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3530/6877] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:09 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:10.359629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-830b6425-b53e-425d-a3b7-188f4e46687b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:10.360358 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-830b6425-b53e-425d-a3b7-188f4e46687b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:10.366919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830b6425-b53e-425d-a3b7-188f4e46687b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:10.367424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830b6425-b53e-425d-a3b7-188f4e46687b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:10.367877 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830b6425-b53e-425d-a3b7-188f4e46687b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:10.368613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830b6425-b53e-425d-a3b7-188f4e46687b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:10.369051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830b6425-b53e-425d-a3b7-188f4e46687b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:10.369492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-830b6425-b53e-425d-a3b7-188f4e46687b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:10.517339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-830b6425-b53e-425d-a3b7-188f4e46687b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:10.526669 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-830b6425-b53e-425d-a3b7-188f4e46687b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.172423 Aug 27 03:36:10.527266 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3348/6878] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:10 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:10.972956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e8c7555b-71d2-4422-aa6b-44d63a591911 req-eb2f139c-b7f9-4886-bde4-e757a5397cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79d3c1d-ef7d-4f4d-a34d-665908efddb0", "name": "network-vif-unplugged", "status": "completed", "tag": "090efb55-7e0d-46ca-8084-54cda5db4eb1"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:10.983250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e8c7555b-71d2-4422-aa6b-44d63a591911 req-eb2f139c-b7f9-4886-bde4-e757a5397cf2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:10.983745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e8c7555b-71d2-4422-aa6b-44d63a591911 req-eb2f139c-b7f9-4886-bde4-e757a5397cf2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:10.984187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e8c7555b-71d2-4422-aa6b-44d63a591911 req-eb2f139c-b7f9-4886-bde4-e757a5397cf2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:10.996562 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-e8c7555b-71d2-4422-aa6b-44d63a591911 req-eb2f139c-b7f9-4886-bde4-e757a5397cf2 service nova] Creating event network-vif-unplugged:090efb55-7e0d-46ca-8084-54cda5db4eb1 for instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 on n-h2-852084-5 Aug 27 03:36:11.002044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-e8c7555b-71d2-4422-aa6b-44d63a591911 req-eb2f139c-b7f9-4886-bde4-e757a5397cf2 service nova] Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:36:11.013167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e8c7555b-71d2-4422-aa6b-44d63a591911 req-eb2f139c-b7f9-4886-bde4-e757a5397cf2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099583 Aug 27 03:36:11.013974 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3531/6879] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:11.547992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6bd79540-686b-412c-b86c-5322370b8bcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:11.548650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6bd79540-686b-412c-b86c-5322370b8bcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:11.555633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bd79540-686b-412c-b86c-5322370b8bcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.556143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bd79540-686b-412c-b86c-5322370b8bcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.556600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bd79540-686b-412c-b86c-5322370b8bcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:11.557320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bd79540-686b-412c-b86c-5322370b8bcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:11.557818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bd79540-686b-412c-b86c-5322370b8bcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:11.558266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bd79540-686b-412c-b86c-5322370b8bcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:11.693210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6bd79540-686b-412c-b86c-5322370b8bcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:11.701863 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6bd79540-686b-412c-b86c-5322370b8bcd tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.157774 Aug 27 03:36:11.702447 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3349/6880] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:11 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:12.725766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37efaf23-8a2a-4f00-87b5-0ea318babe83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:12.726402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-37efaf23-8a2a-4f00-87b5-0ea318babe83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:12.732744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37efaf23-8a2a-4f00-87b5-0ea318babe83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:12.733236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37efaf23-8a2a-4f00-87b5-0ea318babe83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:12.733707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37efaf23-8a2a-4f00-87b5-0ea318babe83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:12.734416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37efaf23-8a2a-4f00-87b5-0ea318babe83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:12.734879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37efaf23-8a2a-4f00-87b5-0ea318babe83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:12.735310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37efaf23-8a2a-4f00-87b5-0ea318babe83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:12.880692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-37efaf23-8a2a-4f00-87b5-0ea318babe83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:12.889633 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-37efaf23-8a2a-4f00-87b5-0ea318babe83 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.169665 Aug 27 03:36:12.890351 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3532/6881] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:12 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:13.032981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-52e453e7-f016-488b-be5c-2d2fb6dd7453 req-def657dc-8f64-4944-9ab4-af9ab6c64e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79d3c1d-ef7d-4f4d-a34d-665908efddb0", "tag": "090efb55-7e0d-46ca-8084-54cda5db4eb1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:13.044066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-52e453e7-f016-488b-be5c-2d2fb6dd7453 req-def657dc-8f64-4944-9ab4-af9ab6c64e86 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.044564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-52e453e7-f016-488b-be5c-2d2fb6dd7453 req-def657dc-8f64-4944-9ab4-af9ab6c64e86 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.045388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-52e453e7-f016-488b-be5c-2d2fb6dd7453 req-def657dc-8f64-4944-9ab4-af9ab6c64e86 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:13.060222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-52e453e7-f016-488b-be5c-2d2fb6dd7453 req-def657dc-8f64-4944-9ab4-af9ab6c64e86 service nova] Creating event network-changed:090efb55-7e0d-46ca-8084-54cda5db4eb1 for instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 on n-h2-852084-5 Aug 27 03:36:13.066286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-52e453e7-f016-488b-be5c-2d2fb6dd7453 req-def657dc-8f64-4944-9ab4-af9ab6c64e86 service nova] Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:36:13.077280 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-52e453e7-f016-488b-be5c-2d2fb6dd7453 req-def657dc-8f64-4944-9ab4-af9ab6c64e86 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048004 Aug 27 03:36:13.077924 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3350/6882] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:13.911558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-89a898f8-038c-4844-b238-ca11270c617a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:13.912925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-89a898f8-038c-4844-b238-ca11270c617a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:13.921086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89a898f8-038c-4844-b238-ca11270c617a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.921614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89a898f8-038c-4844-b238-ca11270c617a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.922114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89a898f8-038c-4844-b238-ca11270c617a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:13.923240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89a898f8-038c-4844-b238-ca11270c617a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:13.923706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89a898f8-038c-4844-b238-ca11270c617a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:13.924405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-89a898f8-038c-4844-b238-ca11270c617a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:14.065691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-89a898f8-038c-4844-b238-ca11270c617a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:14.074977 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-89a898f8-038c-4844-b238-ca11270c617a tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.167503 Aug 27 03:36:14.075566 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3533/6883] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:13 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:15.098137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b354b089-5a73-497b-b77a-f5971f54cb1f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:15.098859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b354b089-5a73-497b-b77a-f5971f54cb1f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:15.106004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b354b089-5a73-497b-b77a-f5971f54cb1f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.106519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b354b089-5a73-497b-b77a-f5971f54cb1f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.106983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b354b089-5a73-497b-b77a-f5971f54cb1f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:15.107708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b354b089-5a73-497b-b77a-f5971f54cb1f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:15.108211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b354b089-5a73-497b-b77a-f5971f54cb1f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:15.108662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b354b089-5a73-497b-b77a-f5971f54cb1f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:15.246506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b354b089-5a73-497b-b77a-f5971f54cb1f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:15.255349 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b354b089-5a73-497b-b77a-f5971f54cb1f tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.162264 Aug 27 03:36:15.255947 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3351/6884] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:15 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:16.276550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ffa3e06-e755-4014-9a29-ac267a840e8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:16.277177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ffa3e06-e755-4014-9a29-ac267a840e8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:16.284333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ffa3e06-e755-4014-9a29-ac267a840e8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:16.284827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ffa3e06-e755-4014-9a29-ac267a840e8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:16.285274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ffa3e06-e755-4014-9a29-ac267a840e8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:16.286132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ffa3e06-e755-4014-9a29-ac267a840e8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:16.286598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ffa3e06-e755-4014-9a29-ac267a840e8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:16.287572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ffa3e06-e755-4014-9a29-ac267a840e8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:16.419999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ffa3e06-e755-4014-9a29-ac267a840e8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:16.429074 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ffa3e06-e755-4014-9a29-ac267a840e8d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.156496 Aug 27 03:36:16.429661 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3534/6885] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:16 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:17.451756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c65ee092-a777-4d5e-a2ae-923ce1ace5ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:17.452416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c65ee092-a777-4d5e-a2ae-923ce1ace5ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:17.454510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:17.460680 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65ee092-a777-4d5e-a2ae-923ce1ace5ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:17.461182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65ee092-a777-4d5e-a2ae-923ce1ace5ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:17.461638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65ee092-a777-4d5e-a2ae-923ce1ace5ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:17.462374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65ee092-a777-4d5e-a2ae-923ce1ace5ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:17.462851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65ee092-a777-4d5e-a2ae-923ce1ace5ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:17.463295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c65ee092-a777-4d5e-a2ae-923ce1ace5ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:17.593450 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c65ee092-a777-4d5e-a2ae-923ce1ace5ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:17.601919 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c65ee092-a777-4d5e-a2ae-923ce1ace5ad tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.154105 Aug 27 03:36:17.602506 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3352/6886] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:17 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:18.623958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-267e2dcb-f26e-47de-a5bc-e9cedbf55301 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:18.624574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-267e2dcb-f26e-47de-a5bc-e9cedbf55301 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:18.632159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267e2dcb-f26e-47de-a5bc-e9cedbf55301 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:18.632644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267e2dcb-f26e-47de-a5bc-e9cedbf55301 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:18.633086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267e2dcb-f26e-47de-a5bc-e9cedbf55301 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:18.633819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267e2dcb-f26e-47de-a5bc-e9cedbf55301 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:18.634284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267e2dcb-f26e-47de-a5bc-e9cedbf55301 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:18.634717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-267e2dcb-f26e-47de-a5bc-e9cedbf55301 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:18.766609 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-267e2dcb-f26e-47de-a5bc-e9cedbf55301 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:18.775650 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-267e2dcb-f26e-47de-a5bc-e9cedbf55301 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.155716 Aug 27 03:36:18.776233 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3535/6887] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:18 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:19.797411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8094dbf9-4ded-43fc-877f-ed79e8901114 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:19.797994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8094dbf9-4ded-43fc-877f-ed79e8901114 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:19.805909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8094dbf9-4ded-43fc-877f-ed79e8901114 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:19.806421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8094dbf9-4ded-43fc-877f-ed79e8901114 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:19.806878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8094dbf9-4ded-43fc-877f-ed79e8901114 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:19.807599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8094dbf9-4ded-43fc-877f-ed79e8901114 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:19.808072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8094dbf9-4ded-43fc-877f-ed79e8901114 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:19.808528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8094dbf9-4ded-43fc-877f-ed79e8901114 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:19.946808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8094dbf9-4ded-43fc-877f-ed79e8901114 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:19.955231 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8094dbf9-4ded-43fc-877f-ed79e8901114 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.162130 Aug 27 03:36:19.956007 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3353/6888] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:19 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:20.976913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f73c43b7-7cd1-4c8b-b0c6-06862fc3f228 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:20.977535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f73c43b7-7cd1-4c8b-b0c6-06862fc3f228 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:20.984476 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f73c43b7-7cd1-4c8b-b0c6-06862fc3f228 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:20.984962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f73c43b7-7cd1-4c8b-b0c6-06862fc3f228 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:20.985410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f73c43b7-7cd1-4c8b-b0c6-06862fc3f228 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:20.986138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f73c43b7-7cd1-4c8b-b0c6-06862fc3f228 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:20.986603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f73c43b7-7cd1-4c8b-b0c6-06862fc3f228 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:20.987034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f73c43b7-7cd1-4c8b-b0c6-06862fc3f228 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:21.121878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f73c43b7-7cd1-4c8b-b0c6-06862fc3f228 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:21.130219 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f73c43b7-7cd1-4c8b-b0c6-06862fc3f228 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.157202 Aug 27 03:36:21.130811 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3536/6889] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:20 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:22.153146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-11a34493-12cd-48ef-a231-f09b0d1dfc82 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:22.153803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-11a34493-12cd-48ef-a231-f09b0d1dfc82 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:22.161196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11a34493-12cd-48ef-a231-f09b0d1dfc82 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:22.161689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11a34493-12cd-48ef-a231-f09b0d1dfc82 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:22.162145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11a34493-12cd-48ef-a231-f09b0d1dfc82 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:22.163526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11a34493-12cd-48ef-a231-f09b0d1dfc82 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:22.164017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11a34493-12cd-48ef-a231-f09b0d1dfc82 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:22.164495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11a34493-12cd-48ef-a231-f09b0d1dfc82 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:22.296948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-11a34493-12cd-48ef-a231-f09b0d1dfc82 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:22.305894 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-11a34493-12cd-48ef-a231-f09b0d1dfc82 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.156629 Aug 27 03:36:22.306492 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3354/6890] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:22 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:23.328035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a762b71-c054-45d6-a8f3-0f6910b1b6e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:23.328579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4a762b71-c054-45d6-a8f3-0f6910b1b6e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:23.336621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a762b71-c054-45d6-a8f3-0f6910b1b6e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:23.337029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a762b71-c054-45d6-a8f3-0f6910b1b6e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:23.337500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a762b71-c054-45d6-a8f3-0f6910b1b6e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:23.338583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a762b71-c054-45d6-a8f3-0f6910b1b6e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:23.338743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a762b71-c054-45d6-a8f3-0f6910b1b6e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:23.339145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a762b71-c054-45d6-a8f3-0f6910b1b6e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:23.766406 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4a762b71-c054-45d6-a8f3-0f6910b1b6e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:23.776752 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a762b71-c054-45d6-a8f3-0f6910b1b6e2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1723 microversion: 2.1 time: 0.452643 Aug 27 03:36:23.777319 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3537/6891] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:23 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:24.801846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7b314502-e537-4213-9d28-f63b47e42661 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:24.802436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7b314502-e537-4213-9d28-f63b47e42661 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:24.810100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b314502-e537-4213-9d28-f63b47e42661 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:24.810606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b314502-e537-4213-9d28-f63b47e42661 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:24.811066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b314502-e537-4213-9d28-f63b47e42661 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:24.811783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b314502-e537-4213-9d28-f63b47e42661 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:24.812258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b314502-e537-4213-9d28-f63b47e42661 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:24.812710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b314502-e537-4213-9d28-f63b47e42661 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:24.946901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7b314502-e537-4213-9d28-f63b47e42661 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:24.955274 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7b314502-e537-4213-9d28-f63b47e42661 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1716 microversion: 2.1 time: 0.157437 Aug 27 03:36:24.955852 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3355/6892] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:24 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:24.977153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1891ae27-cd23-4d5e-8f8a-285f36d2eb5b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:24.977786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1891ae27-cd23-4d5e-8f8a-285f36d2eb5b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:24.984630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1891ae27-cd23-4d5e-8f8a-285f36d2eb5b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:24.985110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1891ae27-cd23-4d5e-8f8a-285f36d2eb5b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:24.985545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1891ae27-cd23-4d5e-8f8a-285f36d2eb5b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:24.986285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1891ae27-cd23-4d5e-8f8a-285f36d2eb5b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:24.986737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1891ae27-cd23-4d5e-8f8a-285f36d2eb5b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:24.987159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1891ae27-cd23-4d5e-8f8a-285f36d2eb5b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:25.117887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1891ae27-cd23-4d5e-8f8a-285f36d2eb5b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:25.126272 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1891ae27-cd23-4d5e-8f8a-285f36d2eb5b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1716 microversion: 2.1 time: 0.153482 Aug 27 03:36:25.126860 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3538/6893] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:24 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:25.148991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cd28ce34-95d2-4e0a-89ed-e60b9e301fd1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:25.149621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cd28ce34-95d2-4e0a-89ed-e60b9e301fd1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:25.156082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd28ce34-95d2-4e0a-89ed-e60b9e301fd1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:25.156580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd28ce34-95d2-4e0a-89ed-e60b9e301fd1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:25.157024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd28ce34-95d2-4e0a-89ed-e60b9e301fd1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:25.157774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd28ce34-95d2-4e0a-89ed-e60b9e301fd1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:25.158250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd28ce34-95d2-4e0a-89ed-e60b9e301fd1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:25.158686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd28ce34-95d2-4e0a-89ed-e60b9e301fd1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:25.299430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cd28ce34-95d2-4e0a-89ed-e60b9e301fd1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:25.307945 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cd28ce34-95d2-4e0a-89ed-e60b9e301fd1 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1716 microversion: 2.1 time: 0.163386 Aug 27 03:36:25.308524 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3356/6894] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:25 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:25.328533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fbe337e3-bd24-44fd-9957-918ef8e85e7b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:25.328940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fbe337e3-bd24-44fd-9957-918ef8e85e7b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:25.335592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbe337e3-bd24-44fd-9957-918ef8e85e7b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:25.336078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbe337e3-bd24-44fd-9957-918ef8e85e7b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:25.338043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbe337e3-bd24-44fd-9957-918ef8e85e7b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:25.338043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbe337e3-bd24-44fd-9957-918ef8e85e7b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:25.338043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbe337e3-bd24-44fd-9957-918ef8e85e7b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:25.338356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbe337e3-bd24-44fd-9957-918ef8e85e7b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:25.364435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fbe337e3-bd24-44fd-9957-918ef8e85e7b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:36:25.446893 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fbe337e3-bd24-44fd-9957-918ef8e85e7b tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 204 len: 0 microversion: 2.1 time: 0.121502 Aug 27 03:36:25.447800 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3539/6895] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:36:25 2022] DELETE /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:36:25.460869 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7d476bde-59a0-4abf-bc75-c01a08e54a7d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:25.461861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7d476bde-59a0-4abf-bc75-c01a08e54a7d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:25.471083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d476bde-59a0-4abf-bc75-c01a08e54a7d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:25.471905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d476bde-59a0-4abf-bc75-c01a08e54a7d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:25.472155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d476bde-59a0-4abf-bc75-c01a08e54a7d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:25.472802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d476bde-59a0-4abf-bc75-c01a08e54a7d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:25.473283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d476bde-59a0-4abf-bc75-c01a08e54a7d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:25.473770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7d476bde-59a0-4abf-bc75-c01a08e54a7d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:25.492955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:25.614644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7d476bde-59a0-4abf-bc75-c01a08e54a7d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:25.623861 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7d476bde-59a0-4abf-bc75-c01a08e54a7d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1722 microversion: 2.1 time: 0.170126 Aug 27 03:36:25.624445 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3357/6896] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:25 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:26.646164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2cc9eba4-e8f2-46e5-a951-3ef8a5909617 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:26.647377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2cc9eba4-e8f2-46e5-a951-3ef8a5909617 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:26.653822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9eba4-e8f2-46e5-a951-3ef8a5909617 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:26.654313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9eba4-e8f2-46e5-a951-3ef8a5909617 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:26.654761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9eba4-e8f2-46e5-a951-3ef8a5909617 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:26.655497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9eba4-e8f2-46e5-a951-3ef8a5909617 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:26.655960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9eba4-e8f2-46e5-a951-3ef8a5909617 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:26.656422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2cc9eba4-e8f2-46e5-a951-3ef8a5909617 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:26.672268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:26.793389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2cc9eba4-e8f2-46e5-a951-3ef8a5909617 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:26.802235 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2cc9eba4-e8f2-46e5-a951-3ef8a5909617 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1722 microversion: 2.1 time: 0.160497 Aug 27 03:36:26.802819 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3540/6897] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:26 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:27.444708 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-931cf970-9213-4f65-8be9-241c9fe3e567 req-a9762e4d-1196-4e88-a0ab-5190f2ea2a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79d3c1d-ef7d-4f4d-a34d-665908efddb0", "name": "network-vif-plugged", "status": "completed", "tag": "090efb55-7e0d-46ca-8084-54cda5db4eb1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:27.458017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-931cf970-9213-4f65-8be9-241c9fe3e567 req-a9762e4d-1196-4e88-a0ab-5190f2ea2a6e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:27.458637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-931cf970-9213-4f65-8be9-241c9fe3e567 req-a9762e4d-1196-4e88-a0ab-5190f2ea2a6e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:27.459340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-931cf970-9213-4f65-8be9-241c9fe3e567 req-a9762e4d-1196-4e88-a0ab-5190f2ea2a6e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:27.472747 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-931cf970-9213-4f65-8be9-241c9fe3e567 req-a9762e4d-1196-4e88-a0ab-5190f2ea2a6e service nova] Creating event network-vif-plugged:090efb55-7e0d-46ca-8084-54cda5db4eb1 for instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 on n-h2-852084-5 Aug 27 03:36:27.479198 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-931cf970-9213-4f65-8be9-241c9fe3e567 req-a9762e4d-1196-4e88-a0ab-5190f2ea2a6e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039023 Aug 27 03:36:27.480140 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3358/6898] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:27.824183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-030f592b-a336-46fc-a7c8-9480bc82f336 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:27.824749 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-030f592b-a336-46fc-a7c8-9480bc82f336 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:27.833103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f592b-a336-46fc-a7c8-9480bc82f336 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:27.833611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f592b-a336-46fc-a7c8-9480bc82f336 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:27.834581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f592b-a336-46fc-a7c8-9480bc82f336 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:27.835340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f592b-a336-46fc-a7c8-9480bc82f336 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:27.835809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f592b-a336-46fc-a7c8-9480bc82f336 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:27.836240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-030f592b-a336-46fc-a7c8-9480bc82f336 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:27.911984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-030f592b-a336-46fc-a7c8-9480bc82f336 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:27.921200 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-030f592b-a336-46fc-a7c8-9480bc82f336 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1654 microversion: 2.1 time: 0.101066 Aug 27 03:36:27.921816 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3541/6899] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:27 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1654 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:28.028132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-2a1fb47b-031a-43ba-92e4-7306ee4fbcc1 req-3cbc0c83-da4f-4f4e-b748-c5c8539d9e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79d3c1d-ef7d-4f4d-a34d-665908efddb0", "name": "network-vif-deleted", "tag": "090efb55-7e0d-46ca-8084-54cda5db4eb1"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:28.039702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2a1fb47b-031a-43ba-92e4-7306ee4fbcc1 req-3cbc0c83-da4f-4f4e-b748-c5c8539d9e5c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:28.040210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2a1fb47b-031a-43ba-92e4-7306ee4fbcc1 req-3cbc0c83-da4f-4f4e-b748-c5c8539d9e5c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:28.040697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-2a1fb47b-031a-43ba-92e4-7306ee4fbcc1 req-3cbc0c83-da4f-4f4e-b748-c5c8539d9e5c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:28.053361 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-2a1fb47b-031a-43ba-92e4-7306ee4fbcc1 req-3cbc0c83-da4f-4f4e-b748-c5c8539d9e5c service nova] Creating event network-vif-deleted:090efb55-7e0d-46ca-8084-54cda5db4eb1 for instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 on n-h2-852084-5 Aug 27 03:36:28.058746 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-2a1fb47b-031a-43ba-92e4-7306ee4fbcc1 req-3cbc0c83-da4f-4f4e-b748-c5c8539d9e5c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034827 Aug 27 03:36:28.059763 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3359/6900] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:28.944064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6facf457-2763-436f-8243-326e41ef8154 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:28.944685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6facf457-2763-436f-8243-326e41ef8154 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:28.951913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6facf457-2763-436f-8243-326e41ef8154 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:28.952397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6facf457-2763-436f-8243-326e41ef8154 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:28.952836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6facf457-2763-436f-8243-326e41ef8154 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:28.953543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6facf457-2763-436f-8243-326e41ef8154 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:28.954023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6facf457-2763-436f-8243-326e41ef8154 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:28.954450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6facf457-2763-436f-8243-326e41ef8154 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:29.026801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6facf457-2763-436f-8243-326e41ef8154 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:29.035865 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6facf457-2763-436f-8243-326e41ef8154 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1370 microversion: 2.1 time: 0.096493 Aug 27 03:36:29.036461 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3542/6901] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:28 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:30.059303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-039e6a71-3aa2-4384-894f-18708283f3d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:30.059931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-039e6a71-3aa2-4384-894f-18708283f3d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:30.066374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039e6a71-3aa2-4384-894f-18708283f3d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:30.066880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039e6a71-3aa2-4384-894f-18708283f3d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:30.067343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039e6a71-3aa2-4384-894f-18708283f3d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:30.068065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039e6a71-3aa2-4384-894f-18708283f3d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:30.069035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039e6a71-3aa2-4384-894f-18708283f3d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:30.069489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-039e6a71-3aa2-4384-894f-18708283f3d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:30.135336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-039e6a71-3aa2-4384-894f-18708283f3d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:30.143798 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-039e6a71-3aa2-4384-894f-18708283f3d6 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1370 microversion: 2.1 time: 0.090044 Aug 27 03:36:30.144379 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3360/6902] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:30 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:31.165196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bedfa03c-469d-4f9d-a660-4076a4a76e78 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:31.165882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bedfa03c-469d-4f9d-a660-4076a4a76e78 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:31.168913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:31.174252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedfa03c-469d-4f9d-a660-4076a4a76e78 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:31.174748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedfa03c-469d-4f9d-a660-4076a4a76e78 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:31.175196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedfa03c-469d-4f9d-a660-4076a4a76e78 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:31.175904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedfa03c-469d-4f9d-a660-4076a4a76e78 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:31.176367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedfa03c-469d-4f9d-a660-4076a4a76e78 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:31.176799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bedfa03c-469d-4f9d-a660-4076a4a76e78 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:31.244636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bedfa03c-469d-4f9d-a660-4076a4a76e78 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:31.253532 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bedfa03c-469d-4f9d-a660-4076a4a76e78 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1370 microversion: 2.1 time: 0.092740 Aug 27 03:36:31.254195 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3543/6903] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:31 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:32.275623 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:32.276264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:32.279214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:32.285387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:32.285912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:32.286373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:32.287647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:32.288123 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:32.288568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:32.321784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:32.322289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:32.324176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:32.324176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lazy-loading 'fault' on Instance uuid e79d3c1d-ef7d-4f4d-a34d-665908efddb0 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:36:32.365353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd26902bb305a470087e529c5f3949f78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84ffdee816a4661b43c497f40c8e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:32.373622 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-86d92b92-0527-46a8-afec-64ae77efd555 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 200 len: 1375 microversion: 2.1 time: 0.101931 Aug 27 03:36:32.374225 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3361/6904] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:32 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 1375 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:33.394232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:33.394902 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:33.401929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:33.402412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:33.402856 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:33.403547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:33.404005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:33.404434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:33.417865 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 HTTP/1.1 Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'e79d3c1d-ef7d-4f4d-a34d-665908efddb0'} Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:33.419510 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:33.424366 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:33.424366 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:33.424366 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:33.424366 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:33.424366 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:33.424366 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:33.424366 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:33.424366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:33.424366 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4d016df2-753e-4784-b4af-113a2f1369c7 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 404 len: 111 microversion: 2.1 time: 0.030567 Aug 27 03:36:33.424366 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3544/6905] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:33 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:33.481142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:33.483406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:33.490939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:33.491449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:33.491913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:33.492635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:33.493112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:33.493561 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:33.506314 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0/os-volume_attachments HTTP/1.1 Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': 'e79d3c1d-ef7d-4f4d-a34d-665908efddb0'} Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:33.508027 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-184353d3-8656-47e7-8aa8-805dcb4b875c tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032461 Aug 27 03:36:33.511865 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3362/6906] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:36:33 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:36.829379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:36.829915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:36.837657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.838177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.838662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.839449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.839922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.840362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.855401 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 HTTP/1.1 Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'e79d3c1d-ef7d-4f4d-a34d-665908efddb0'} Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:36.856995 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9cd7cb3c-fa6b-4fde-a413-aa6e7ca4c150 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 404 len: 111 microversion: 2.1 time: 0.033037 Aug 27 03:36:36.861321 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3545/6907] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:36:36 2022] DELETE /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:36.867745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:36.868314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: e79d3c1d-ef7d-4f4d-a34d-665908efddb0] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:36.874791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.875288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.875740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.876455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.876933 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.877401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.891026 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 HTTP/1.1 Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'e79d3c1d-ef7d-4f4d-a34d-665908efddb0'} Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:36.892598 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.897484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.897484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:36.897484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:36.897484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:36.897484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:36.897484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. Aug 27 03:36:36.897484 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.897484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance e79d3c1d-ef7d-4f4d-a34d-665908efddb0 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:36.897484 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-045cc265-11e5-4b2b-9651-8d2a325d7990 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0" status: 404 len: 111 microversion: 2.1 time: 0.030680 Aug 27 03:36:36.897484 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3363/6908] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:36 2022] GET /compute/v2.1/servers/e79d3c1d-ef7d-4f4d-a34d-665908efddb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:36:36.903201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:36.903713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:36.909998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.910491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.910963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.911658 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.912729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.913158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.926816 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d HTTP/1.1 Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'a5e7098d-a3fb-4905-bb05-31076a6cdd3d'} Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:36.928426 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-64119879-d76e-4ef4-8e01-0bacfff836fa tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 404 len: 111 microversion: 2.1 time: 0.030558 Aug 27 03:36:36.932414 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3546/6909] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:36:36 2022] DELETE /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:36.939953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:36.940596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: a5e7098d-a3fb-4905-bb05-31076a6cdd3d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:36.947290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.947807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.948275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.949026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.949514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.949994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.966445 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d HTTP/1.1 Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'a5e7098d-a3fb-4905-bb05-31076a6cdd3d'} Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:36.968064 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.972281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:36.972281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:36.972281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:36.972281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:36.972281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:36.972281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. Aug 27 03:36:36.972281 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:36.972281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance a5e7098d-a3fb-4905-bb05-31076a6cdd3d could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:36.972281 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a3835f50-8ebe-44ba-b9d4-f9cc3986c0a2 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d" status: 404 len: 111 microversion: 2.1 time: 0.033683 Aug 27 03:36:36.972281 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3364/6910] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:36 2022] GET /compute/v2.1/servers/a5e7098d-a3fb-4905-bb05-31076a6cdd3d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:36.979077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:36.979669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:36.986124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.986707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.987216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:36.988009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:36.988535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:36.989062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:37.004220 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 HTTP/1.1 Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '25346632-2828-49aa-b8d6-8044101343d9'} Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:37.005971 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:37.010548 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab7b5bef-d3fe-440b-94fc-d73d48b1c933 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "DELETE /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 404 len: 111 microversion: 2.1 time: 0.034786 Aug 27 03:36:37.011751 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3547/6911] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:36:36 2022] DELETE /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:37.018852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:37.019717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 25346632-2828-49aa-b8d6-8044101343d9] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:37.026445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:37.026952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:37.027411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:37.028132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:37.028608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:37.029057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:37.043592 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 HTTP/1.1 Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '25346632-2828-49aa-b8d6-8044101343d9'} Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:37.045165 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.049041 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.049041 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:37.049041 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:37.049041 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:37.049041 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:37.049041 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. Aug 27 03:36:37.049041 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.049041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance 25346632-2828-49aa-b8d6-8044101343d9 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:37.049041 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5aa0098b-9fbe-48b2-9be5-cd92e69d48b3 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9" status: 404 len: 111 microversion: 2.1 time: 0.031857 Aug 27 03:36:37.049041 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3365/6912] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:37 2022] GET /compute/v2.1/servers/25346632-2828-49aa-b8d6-8044101343d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:37.055441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:37.055946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:37.062299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:37.062793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:37.063296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:37.064003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:37.064458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:37.064932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:37.078814 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff HTTP/1.1 Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '3b224e9c-1379-4616-ac9e-058c65ea9cff'} Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:37.080386 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:37.084827 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5feda507-0bcb-404d-89e0-b45d8ac0f016 tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 404 len: 111 microversion: 2.1 time: 0.030397 Aug 27 03:36:37.085970 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3548/6913] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:36:37 2022] DELETE /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:37.091327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:37.091950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] [instance: 3b224e9c-1379-4616-ac9e-058c65ea9cff] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:37.098163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:37.098663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:37.099109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:37.100377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:37.100846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:37.101287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:37.117340 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] HTTP exception thrown: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Request method failure captured: Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff HTTP/1.1 Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCY_kDC_TrIaBqnxcIeRgrceh6D4qlo96neCEwhjH8JPw-Kfk90EBGla6wbIZ5IliEDBJY-4Udm1UxgIKlLcQSGcDL0WG_hFle7gtm_2ihD3ocA7nbq8dicIjHotVwycwJecVX6xm8A6Mkd8IlIMO2IZbztJvcpGla0jlcPEAnVd0HJg Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c84ffdee816a4661b43c497f40c8e577"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c84ffdee816a4661b43c497f40c8e577"}]}] Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: c84ffdee816a4661b43c497f40c8e577 Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServerActionsTestJSON-290574201 Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d26902bb305a470087e529c5f3949f78 Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServerActionsTestJSON-290574201-project Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '3b224e9c-1379-4616-ac9e-058c65ea9cff'} Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:36:37.119046 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.123767 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:36:37.123767 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:36:37.123767 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:36:37.123767 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:36:37.123767 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:36:37.123767 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. Aug 27 03:36:37.123767 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:36:37.123767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Returning 404 to user: Instance 3b224e9c-1379-4616-ac9e-058c65ea9cff could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:36:37.123767 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-71a488b4-1aad-44fd-ac98-4b5e4e02c00d tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff" status: 404 len: 111 microversion: 2.1 time: 0.033239 Aug 27 03:36:37.123767 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3366/6914] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:37 2022] GET /compute/v2.1/servers/3b224e9c-1379-4616-ac9e-058c65ea9cff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:36:37.129364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f9541ef0-9bb4-492e-a81f-a387658591eb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] Calling method '.version_select at 0x7f4d28ed9e50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:37.154362 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f9541ef0-9bb4-492e-a81f-a387658591eb tempest-ServerActionsTestJSON-290574201 tempest-ServerActionsTestJSON-290574201-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456137094" status: 202 len: 0 microversion: 2.1 time: 0.028815 Aug 27 03:36:37.154954 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3549/6915] 10.222.0.99 () {58 vars in 1221 bytes} [Sat Aug 27 03:36:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456137094 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:36:46.580951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-144768829", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "c3dd6054-35f4-4116-a546-8d46229a51ec"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:46.640035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] validate_networks() for [('c3dd6054-35f4-4116-a546-8d46229a51ec', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:36:47.106934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=31 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:47.325365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:36:47.325960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:36:47.326346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:36:47.327026 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:36:47.328018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:36:47.341329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:47.342025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:47.342688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:47.343883 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:47.344485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:47.346219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:47.365199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Getting quotas for project 231ba57740d8456dbfabb511c0950d48. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:36:47.370702 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Getting quotas for user 613b0d08f81842bab6ea2ee0a54daa68 and project 231ba57740d8456dbfabb511c0950d48. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:36:47.383443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:36:47.385832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:36:47.437284 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f6da81c0-7c9c-4795-a2ab-548337c37aa1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989269 Aug 27 03:36:47.443980 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3367/6916] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:36:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:36:47.450987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-07e7b66f-d82a-411a-b11d-137dfd88fe15 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:47.452317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-07e7b66f-d82a-411a-b11d-137dfd88fe15 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:47.456635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=31 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:47.457685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:47.517948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-07e7b66f-d82a-411a-b11d-137dfd88fe15 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:47.527363 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-07e7b66f-d82a-411a-b11d-137dfd88fe15 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1216 microversion: 2.1 time: 0.080353 Aug 27 03:36:47.528259 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3550/6917] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:47 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1216 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:48.550640 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cbfbc309-580d-47fb-9f16-6449d7eeadec tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:48.551295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cbfbc309-580d-47fb-9f16-6449d7eeadec tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:48.605947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cbfbc309-580d-47fb-9f16-6449d7eeadec tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:48.614022 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cbfbc309-580d-47fb-9f16-6449d7eeadec tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1216 microversion: 2.1 time: 0.069453 Aug 27 03:36:48.614672 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3368/6918] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:48 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:49.635767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9dd4a801-bce6-4f06-a95a-2ec1f9927a18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:49.636471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9dd4a801-bce6-4f06-a95a-2ec1f9927a18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:49.698975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9dd4a801-bce6-4f06-a95a-2ec1f9927a18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:49.706381 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9dd4a801-bce6-4f06-a95a-2ec1f9927a18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1216 microversion: 2.1 time: 0.074561 Aug 27 03:36:49.706965 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3551/6919] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:49 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:50.727542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d8c75f15-6881-4b17-9adc-7d236b79702d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:50.728090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d8c75f15-6881-4b17-9adc-7d236b79702d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:50.791416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d8c75f15-6881-4b17-9adc-7d236b79702d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:50.798825 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d8c75f15-6881-4b17-9adc-7d236b79702d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1216 microversion: 2.1 time: 0.075166 Aug 27 03:36:50.799428 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3369/6920] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:50 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:51.820087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-33b40969-7de4-4264-9ddd-0b239fb1f04f tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:51.820748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-33b40969-7de4-4264-9ddd-0b239fb1f04f tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:51.828300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33b40969-7de4-4264-9ddd-0b239fb1f04f tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:51.828790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33b40969-7de4-4264-9ddd-0b239fb1f04f tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:51.829236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33b40969-7de4-4264-9ddd-0b239fb1f04f tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:51.829966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33b40969-7de4-4264-9ddd-0b239fb1f04f tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:51.830429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33b40969-7de4-4264-9ddd-0b239fb1f04f tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:51.830901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-33b40969-7de4-4264-9ddd-0b239fb1f04f tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:51.892505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-33b40969-7de4-4264-9ddd-0b239fb1f04f tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:51.900869 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-33b40969-7de4-4264-9ddd-0b239fb1f04f tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1220 microversion: 2.1 time: 0.084800 Aug 27 03:36:51.901442 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3552/6921] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:51 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:52.922477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-90e37c61-9b8e-4aa1-af71-b069c6e548d3 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:52.923136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-90e37c61-9b8e-4aa1-af71-b069c6e548d3 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:52.931418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e37c61-9b8e-4aa1-af71-b069c6e548d3 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:52.931925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e37c61-9b8e-4aa1-af71-b069c6e548d3 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:52.932380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e37c61-9b8e-4aa1-af71-b069c6e548d3 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:52.933102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e37c61-9b8e-4aa1-af71-b069c6e548d3 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:52.933566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e37c61-9b8e-4aa1-af71-b069c6e548d3 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:52.934037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90e37c61-9b8e-4aa1-af71-b069c6e548d3 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:53.012306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-90e37c61-9b8e-4aa1-af71-b069c6e548d3 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:53.020577 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-90e37c61-9b8e-4aa1-af71-b069c6e548d3 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1274 microversion: 2.1 time: 0.102308 Aug 27 03:36:53.021175 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3370/6922] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:52 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:53.977685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ad7168f6-4278-4015-8bf1-99413d65f198 req-3f93a488-0ede-43c4-b740-d8a7fc96e3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d20b50-056c-40a2-b4c2-7e1b3b123b4e", "tag": "fa03c089-b0ac-4f1b-ad1f-684b7e563ffe"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:53.988863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ad7168f6-4278-4015-8bf1-99413d65f198 req-3f93a488-0ede-43c4-b740-d8a7fc96e3ed service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:53.989347 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ad7168f6-4278-4015-8bf1-99413d65f198 req-3f93a488-0ede-43c4-b740-d8a7fc96e3ed service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:53.989815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ad7168f6-4278-4015-8bf1-99413d65f198 req-3f93a488-0ede-43c4-b740-d8a7fc96e3ed service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:54.003167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ad7168f6-4278-4015-8bf1-99413d65f198 req-3f93a488-0ede-43c4-b740-d8a7fc96e3ed service nova] Creating event network-changed:fa03c089-b0ac-4f1b-ad1f-684b7e563ffe for instance 85d20b50-056c-40a2-b4c2-7e1b3b123b4e on n-h1-852084-5 Aug 27 03:36:54.008901 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ad7168f6-4278-4015-8bf1-99413d65f198 req-3f93a488-0ede-43c4-b740-d8a7fc96e3ed service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034978 Aug 27 03:36:54.011095 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3553/6923] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:54.044302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-09cefa6d-5aef-488b-accb-f1b99fefb3ef tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:54.044938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-09cefa6d-5aef-488b-accb-f1b99fefb3ef tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:54.052075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cefa6d-5aef-488b-accb-f1b99fefb3ef tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:54.052586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cefa6d-5aef-488b-accb-f1b99fefb3ef tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:54.053042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cefa6d-5aef-488b-accb-f1b99fefb3ef tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:54.053801 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cefa6d-5aef-488b-accb-f1b99fefb3ef tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:54.054792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cefa6d-5aef-488b-accb-f1b99fefb3ef tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:54.055242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-09cefa6d-5aef-488b-accb-f1b99fefb3ef tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:54.296312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-09cefa6d-5aef-488b-accb-f1b99fefb3ef tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:54.304549 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-09cefa6d-5aef-488b-accb-f1b99fefb3ef tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1316 microversion: 2.1 time: 0.264130 Aug 27 03:36:54.305138 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3371/6924] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:54 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:55.326935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-db0104da-4ece-44ce-93c4-3d02a2559546 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:55.327568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-db0104da-4ece-44ce-93c4-3d02a2559546 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:55.333976 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0104da-4ece-44ce-93c4-3d02a2559546 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:55.334473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0104da-4ece-44ce-93c4-3d02a2559546 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:55.334923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0104da-4ece-44ce-93c4-3d02a2559546 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:55.335708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0104da-4ece-44ce-93c4-3d02a2559546 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:55.336173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0104da-4ece-44ce-93c4-3d02a2559546 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:55.336602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db0104da-4ece-44ce-93c4-3d02a2559546 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:55.471376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-db0104da-4ece-44ce-93c4-3d02a2559546 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:55.479747 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-db0104da-4ece-44ce-93c4-3d02a2559546 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1316 microversion: 2.1 time: 0.158512 Aug 27 03:36:55.480332 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3554/6925] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:55 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:36:56.500531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b6bb2b1f-3e40-4b4e-994a-b264b60aa2b6 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:56.501165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b6bb2b1f-3e40-4b4e-994a-b264b60aa2b6 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:56.508703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6bb2b1f-3e40-4b4e-994a-b264b60aa2b6 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:56.509201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6bb2b1f-3e40-4b4e-994a-b264b60aa2b6 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:56.509659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6bb2b1f-3e40-4b4e-994a-b264b60aa2b6 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:56.510405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6bb2b1f-3e40-4b4e-994a-b264b60aa2b6 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:56.511744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6bb2b1f-3e40-4b4e-994a-b264b60aa2b6 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:56.511744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6bb2b1f-3e40-4b4e-994a-b264b60aa2b6 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:56.649052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b6bb2b1f-3e40-4b4e-994a-b264b60aa2b6 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:56.656930 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b6bb2b1f-3e40-4b4e-994a-b264b60aa2b6 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1316 microversion: 2.1 time: 0.160388 Aug 27 03:36:56.657506 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3372/6926] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:56 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:57.678674 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bd6bc30c-4057-46c7-af0d-7c110f7fe64c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:57.679268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bd6bc30c-4057-46c7-af0d-7c110f7fe64c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:57.685900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd6bc30c-4057-46c7-af0d-7c110f7fe64c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:57.686388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd6bc30c-4057-46c7-af0d-7c110f7fe64c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:57.686834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd6bc30c-4057-46c7-af0d-7c110f7fe64c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:57.687539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd6bc30c-4057-46c7-af0d-7c110f7fe64c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:57.687999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd6bc30c-4057-46c7-af0d-7c110f7fe64c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:57.688431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bd6bc30c-4057-46c7-af0d-7c110f7fe64c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:57.829162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bd6bc30c-4057-46c7-af0d-7c110f7fe64c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:57.837012 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bd6bc30c-4057-46c7-af0d-7c110f7fe64c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1316 microversion: 2.1 time: 0.162441 Aug 27 03:36:57.837583 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3555/6927] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:57 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:36:58.858042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-76346089-19e5-4f2c-b7d5-36391e3b6083 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:36:58.859383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-76346089-19e5-4f2c-b7d5-36391e3b6083 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:36:58.861386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:36:58.868087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76346089-19e5-4f2c-b7d5-36391e3b6083 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:58.868600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76346089-19e5-4f2c-b7d5-36391e3b6083 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:58.869066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76346089-19e5-4f2c-b7d5-36391e3b6083 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:58.869825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76346089-19e5-4f2c-b7d5-36391e3b6083 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:58.870305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76346089-19e5-4f2c-b7d5-36391e3b6083 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:58.870754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-76346089-19e5-4f2c-b7d5-36391e3b6083 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:58.937585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-167e7403-70c9-4d68-ac92-f6cd563a9379 req-33b01cce-ecc5-4cb5-9e2d-a09823181114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d20b50-056c-40a2-b4c2-7e1b3b123b4e", "name": "network-vif-plugged", "status": "completed", "tag": "fa03c089-b0ac-4f1b-ad1f-684b7e563ffe"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:36:58.950676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-167e7403-70c9-4d68-ac92-f6cd563a9379 req-33b01cce-ecc5-4cb5-9e2d-a09823181114 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:36:58.951239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-167e7403-70c9-4d68-ac92-f6cd563a9379 req-33b01cce-ecc5-4cb5-9e2d-a09823181114 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:36:58.951729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-167e7403-70c9-4d68-ac92-f6cd563a9379 req-33b01cce-ecc5-4cb5-9e2d-a09823181114 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:36:58.964623 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-167e7403-70c9-4d68-ac92-f6cd563a9379 req-33b01cce-ecc5-4cb5-9e2d-a09823181114 service nova] Creating event network-vif-plugged:fa03c089-b0ac-4f1b-ad1f-684b7e563ffe for instance 85d20b50-056c-40a2-b4c2-7e1b3b123b4e on n-h1-852084-5 Aug 27 03:36:58.970199 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-167e7403-70c9-4d68-ac92-f6cd563a9379 req-33b01cce-ecc5-4cb5-9e2d-a09823181114 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036823 Aug 27 03:36:58.971024 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3556/6928] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:36:59.021124 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-76346089-19e5-4f2c-b7d5-36391e3b6083 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:36:59.030681 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-76346089-19e5-4f2c-b7d5-36391e3b6083 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1316 microversion: 2.1 time: 0.176882 Aug 27 03:36:59.031528 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3373/6929] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:36:58 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:00.049099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:00.054211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba348d33-239c-450c-bc61-40a538803bb0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:00.054952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ba348d33-239c-450c-bc61-40a538803bb0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:00.061593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba348d33-239c-450c-bc61-40a538803bb0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:00.062113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba348d33-239c-450c-bc61-40a538803bb0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:00.062561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba348d33-239c-450c-bc61-40a538803bb0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:00.063262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba348d33-239c-450c-bc61-40a538803bb0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:00.063725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba348d33-239c-450c-bc61-40a538803bb0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:00.064159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba348d33-239c-450c-bc61-40a538803bb0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:00.197463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ba348d33-239c-450c-bc61-40a538803bb0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:00.206052 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ba348d33-239c-450c-bc61-40a538803bb0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1316 microversion: 2.1 time: 0.157818 Aug 27 03:37:00.206640 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3557/6930] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:00 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:01.228190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a5cd6e4-a090-43da-888e-283cf0ba5436 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:01.228826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5a5cd6e4-a090-43da-888e-283cf0ba5436 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:01.231559 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=10 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:01.237292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a5cd6e4-a090-43da-888e-283cf0ba5436 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:01.237828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a5cd6e4-a090-43da-888e-283cf0ba5436 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:01.238293 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a5cd6e4-a090-43da-888e-283cf0ba5436 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:01.239023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a5cd6e4-a090-43da-888e-283cf0ba5436 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:01.239488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a5cd6e4-a090-43da-888e-283cf0ba5436 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:01.239939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a5cd6e4-a090-43da-888e-283cf0ba5436 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:01.376324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5a5cd6e4-a090-43da-888e-283cf0ba5436 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:01.384149 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a5cd6e4-a090-43da-888e-283cf0ba5436 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1506 microversion: 2.1 time: 0.160421 Aug 27 03:37:01.384743 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3374/6931] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:01 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:01.444373 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1395978697", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "c3dd6054-35f4-4116-a546-8d46229a51ec"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:01.498450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] validate_networks() for [('c3dd6054-35f4-4116-a546-8d46229a51ec', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:37:01.869726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:37:01.870162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:37:01.870647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:37:01.871066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:37:01.871521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:37:01.880543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:01.881034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:01.881478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:01.882252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:01.882716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:01.883151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:01.900502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Getting quotas for project 231ba57740d8456dbfabb511c0950d48. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:37:01.906267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Getting quotas for user 613b0d08f81842bab6ea2ee0a54daa68 and project 231ba57740d8456dbfabb511c0950d48. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:37:01.920819 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:37:01.922666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:37:01.971808 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [8b6afc38-b31e-4e9f-bc91-aae46f71aee6] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:37:02.981283 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [8b6afc38-b31e-4e9f-bc91-aae46f71aee6] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 51884. Aug 27 03:37:02.986222 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9091417a-0a1d-4c4b-a3f0-37769cb80316 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545548 Aug 27 03:37:02.987093 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3558/6932] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:37:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:37:03.002881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8419a404-a1b9-413e-9b93-842129620f8a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:03.003532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8419a404-a1b9-413e-9b93-842129620f8a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:03.006470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:03.065048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8419a404-a1b9-413e-9b93-842129620f8a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:03.073515 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8419a404-a1b9-413e-9b93-842129620f8a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1217 microversion: 2.1 time: 0.077935 Aug 27 03:37:03.074281 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3375/6933] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:02 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:04.097757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d7b00acd-87fb-44e4-a766-98238d17d21d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:04.098647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d7b00acd-87fb-44e4-a766-98238d17d21d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:04.107804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7b00acd-87fb-44e4-a766-98238d17d21d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.108512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7b00acd-87fb-44e4-a766-98238d17d21d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.109245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7b00acd-87fb-44e4-a766-98238d17d21d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.110015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7b00acd-87fb-44e4-a766-98238d17d21d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:04.110478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7b00acd-87fb-44e4-a766-98238d17d21d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:04.110914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d7b00acd-87fb-44e4-a766-98238d17d21d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:04.196878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d7b00acd-87fb-44e4-a766-98238d17d21d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:04.208504 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d7b00acd-87fb-44e4-a766-98238d17d21d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1269 microversion: 2.1 time: 0.115248 Aug 27 03:37:04.209123 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3559/6934] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:04 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1269 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:05.238837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2495e44-2cf7-4dbf-84ec-1198425c1759 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:05.239479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c2495e44-2cf7-4dbf-84ec-1198425c1759 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:05.249154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2495e44-2cf7-4dbf-84ec-1198425c1759 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:05.249711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2495e44-2cf7-4dbf-84ec-1198425c1759 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:05.250167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2495e44-2cf7-4dbf-84ec-1198425c1759 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:05.250903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2495e44-2cf7-4dbf-84ec-1198425c1759 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:05.251375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2495e44-2cf7-4dbf-84ec-1198425c1759 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:05.251903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2495e44-2cf7-4dbf-84ec-1198425c1759 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:05.423518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c2495e44-2cf7-4dbf-84ec-1198425c1759 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:05.432600 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c2495e44-2cf7-4dbf-84ec-1198425c1759 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1317 microversion: 2.1 time: 0.197917 Aug 27 03:37:05.433198 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3376/6935] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:05 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:05.723094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-094219ce-6ae9-4e0d-b09c-05972e630860 req-28016b6f-37cd-448e-8734-64103e4c7903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5", "tag": "019143dd-a831-45df-a66c-722397123bdb"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:05.742626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-094219ce-6ae9-4e0d-b09c-05972e630860 req-28016b6f-37cd-448e-8734-64103e4c7903 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:05.743685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-094219ce-6ae9-4e0d-b09c-05972e630860 req-28016b6f-37cd-448e-8734-64103e4c7903 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:05.744518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-094219ce-6ae9-4e0d-b09c-05972e630860 req-28016b6f-37cd-448e-8734-64103e4c7903 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:05.765377 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-094219ce-6ae9-4e0d-b09c-05972e630860 req-28016b6f-37cd-448e-8734-64103e4c7903 service nova] Creating event network-changed:019143dd-a831-45df-a66c-722397123bdb for instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 on n-h2-852084-5 Aug 27 03:37:05.770425 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-094219ce-6ae9-4e0d-b09c-05972e630860 req-28016b6f-37cd-448e-8734-64103e4c7903 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054080 Aug 27 03:37:05.771058 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3560/6936] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:06.456387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b326e4d-451c-4812-978d-23c9ae6bf7b0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:06.457298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b326e4d-451c-4812-978d-23c9ae6bf7b0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:06.464997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b326e4d-451c-4812-978d-23c9ae6bf7b0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:06.465536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b326e4d-451c-4812-978d-23c9ae6bf7b0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:06.466311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b326e4d-451c-4812-978d-23c9ae6bf7b0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:06.467047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b326e4d-451c-4812-978d-23c9ae6bf7b0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:06.467525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b326e4d-451c-4812-978d-23c9ae6bf7b0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:06.467965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b326e4d-451c-4812-978d-23c9ae6bf7b0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:06.621294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b326e4d-451c-4812-978d-23c9ae6bf7b0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:06.629472 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b326e4d-451c-4812-978d-23c9ae6bf7b0 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1317 microversion: 2.1 time: 0.177758 Aug 27 03:37:06.630115 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3377/6937] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:06 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:07.656084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c404d3a4-643a-4713-aee2-144917fa54ae tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:07.657299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c404d3a4-643a-4713-aee2-144917fa54ae tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:07.666801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c404d3a4-643a-4713-aee2-144917fa54ae tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:07.667630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c404d3a4-643a-4713-aee2-144917fa54ae tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:07.668364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c404d3a4-643a-4713-aee2-144917fa54ae tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:07.669534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c404d3a4-643a-4713-aee2-144917fa54ae tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:07.670371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c404d3a4-643a-4713-aee2-144917fa54ae tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:07.671110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c404d3a4-643a-4713-aee2-144917fa54ae tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:07.837184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c404d3a4-643a-4713-aee2-144917fa54ae tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:07.851907 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c404d3a4-643a-4713-aee2-144917fa54ae tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1317 microversion: 2.1 time: 0.204053 Aug 27 03:37:07.852973 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3561/6938] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:07 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:08.877779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a066477e-aa1a-402c-b0c3-44d2ab7cbc06 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:08.878321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a066477e-aa1a-402c-b0c3-44d2ab7cbc06 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:08.886183 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a066477e-aa1a-402c-b0c3-44d2ab7cbc06 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:08.886665 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a066477e-aa1a-402c-b0c3-44d2ab7cbc06 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:08.887145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a066477e-aa1a-402c-b0c3-44d2ab7cbc06 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:08.887863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a066477e-aa1a-402c-b0c3-44d2ab7cbc06 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:08.888327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a066477e-aa1a-402c-b0c3-44d2ab7cbc06 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:08.888765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a066477e-aa1a-402c-b0c3-44d2ab7cbc06 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:09.045478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a066477e-aa1a-402c-b0c3-44d2ab7cbc06 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:09.054082 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a066477e-aa1a-402c-b0c3-44d2ab7cbc06 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1317 microversion: 2.1 time: 0.179697 Aug 27 03:37:09.054698 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3378/6939] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:08 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:10.086122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bf70b70f-e821-441d-b539-c274dbbe4c97 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:10.086882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bf70b70f-e821-441d-b539-c274dbbe4c97 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:10.096196 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf70b70f-e821-441d-b539-c274dbbe4c97 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:10.096699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf70b70f-e821-441d-b539-c274dbbe4c97 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:10.097140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf70b70f-e821-441d-b539-c274dbbe4c97 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:10.097894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf70b70f-e821-441d-b539-c274dbbe4c97 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:10.098361 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf70b70f-e821-441d-b539-c274dbbe4c97 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:10.098814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bf70b70f-e821-441d-b539-c274dbbe4c97 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:10.240239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bf70b70f-e821-441d-b539-c274dbbe4c97 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:10.249161 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bf70b70f-e821-441d-b539-c274dbbe4c97 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1317 microversion: 2.1 time: 0.167011 Aug 27 03:37:10.250171 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3562/6940] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:10 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:11.269320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-27fc55b1-efa9-4f0b-a9e4-811a20160442 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:11.269868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-27fc55b1-efa9-4f0b-a9e4-811a20160442 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:11.278181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27fc55b1-efa9-4f0b-a9e4-811a20160442 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:11.278696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27fc55b1-efa9-4f0b-a9e4-811a20160442 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:11.279157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27fc55b1-efa9-4f0b-a9e4-811a20160442 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:11.279899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27fc55b1-efa9-4f0b-a9e4-811a20160442 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:11.280375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27fc55b1-efa9-4f0b-a9e4-811a20160442 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:11.280827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-27fc55b1-efa9-4f0b-a9e4-811a20160442 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:11.429980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-27fc55b1-efa9-4f0b-a9e4-811a20160442 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:11.437986 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-27fc55b1-efa9-4f0b-a9e4-811a20160442 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1317 microversion: 2.1 time: 0.172657 Aug 27 03:37:11.440090 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3379/6941] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:11 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:11.646737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ee14011b-126e-433f-8763-08f8e071fec4 req-298355ed-5dac-4e36-90b2-9af7196b3db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5", "name": "network-vif-plugged", "status": "completed", "tag": "019143dd-a831-45df-a66c-722397123bdb"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:11.664493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee14011b-126e-433f-8763-08f8e071fec4 req-298355ed-5dac-4e36-90b2-9af7196b3db2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:11.664978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee14011b-126e-433f-8763-08f8e071fec4 req-298355ed-5dac-4e36-90b2-9af7196b3db2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:11.665431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ee14011b-126e-433f-8763-08f8e071fec4 req-298355ed-5dac-4e36-90b2-9af7196b3db2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:11.678771 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ee14011b-126e-433f-8763-08f8e071fec4 req-298355ed-5dac-4e36-90b2-9af7196b3db2 service nova] Creating event network-vif-plugged:019143dd-a831-45df-a66c-722397123bdb for instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 on n-h2-852084-5 Aug 27 03:37:11.684044 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ee14011b-126e-433f-8763-08f8e071fec4 req-298355ed-5dac-4e36-90b2-9af7196b3db2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044354 Aug 27 03:37:11.684480 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3563/6942] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:12.460694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1ae80fc-38a3-4217-884a-73494e9fae24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:12.461330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d1ae80fc-38a3-4217-884a-73494e9fae24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:12.468535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ae80fc-38a3-4217-884a-73494e9fae24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.469036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ae80fc-38a3-4217-884a-73494e9fae24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.469500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ae80fc-38a3-4217-884a-73494e9fae24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.470242 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ae80fc-38a3-4217-884a-73494e9fae24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:12.470720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ae80fc-38a3-4217-884a-73494e9fae24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:12.471167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1ae80fc-38a3-4217-884a-73494e9fae24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:12.614867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1ae80fc-38a3-4217-884a-73494e9fae24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:12.623585 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1ae80fc-38a3-4217-884a-73494e9fae24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1317 microversion: 2.1 time: 0.166846 Aug 27 03:37:12.624175 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3380/6943] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:12 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:13.642444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:13.643231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:13.648853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-32684293-bd6b-4e3b-ab24-ccd14e77c8d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:13.649571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-32684293-bd6b-4e3b-ab24-ccd14e77c8d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:13.656762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32684293-bd6b-4e3b-ab24-ccd14e77c8d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:13.657253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32684293-bd6b-4e3b-ab24-ccd14e77c8d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:13.657731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32684293-bd6b-4e3b-ab24-ccd14e77c8d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:13.658430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32684293-bd6b-4e3b-ab24-ccd14e77c8d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:13.658926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32684293-bd6b-4e3b-ab24-ccd14e77c8d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:13.659359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-32684293-bd6b-4e3b-ab24-ccd14e77c8d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:13.789096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-32684293-bd6b-4e3b-ab24-ccd14e77c8d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:13.797007 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-32684293-bd6b-4e3b-ab24-ccd14e77c8d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1506 microversion: 2.1 time: 0.155566 Aug 27 03:37:13.797578 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3564/6944] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:13 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:13.817286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d2a50531-1c4e-4501-95b2-8addee116e49 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:13.817884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2a50531-1c4e-4501-95b2-8addee116e49 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:13.820412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:13.826753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a50531-1c4e-4501-95b2-8addee116e49 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:13.827262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a50531-1c4e-4501-95b2-8addee116e49 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:13.827722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a50531-1c4e-4501-95b2-8addee116e49 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:13.828446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a50531-1c4e-4501-95b2-8addee116e49 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:13.828924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a50531-1c4e-4501-95b2-8addee116e49 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:13.829371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d2a50531-1c4e-4501-95b2-8addee116e49 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:13.856121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d2a50531-1c4e-4501-95b2-8addee116e49 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:37:13.936461 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d2a50531-1c4e-4501-95b2-8addee116e49 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 204 len: 0 microversion: 2.1 time: 0.122763 Aug 27 03:37:13.937186 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3381/6945] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:13 2022] DELETE /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:37:13.945596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e3b3a972-769d-44d1-a9f5-63a5babb67b2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:13.946249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e3b3a972-769d-44d1-a9f5-63a5babb67b2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:13.952517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3b3a972-769d-44d1-a9f5-63a5babb67b2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:13.952999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3b3a972-769d-44d1-a9f5-63a5babb67b2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:13.953449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3b3a972-769d-44d1-a9f5-63a5babb67b2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:13.954185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3b3a972-769d-44d1-a9f5-63a5babb67b2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:13.954651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3b3a972-769d-44d1-a9f5-63a5babb67b2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:13.955085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e3b3a972-769d-44d1-a9f5-63a5babb67b2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:14.090022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e3b3a972-769d-44d1-a9f5-63a5babb67b2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:14.098139 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e3b3a972-769d-44d1-a9f5-63a5babb67b2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1512 microversion: 2.1 time: 0.156471 Aug 27 03:37:14.098724 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3565/6946] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:13 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:15.121110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9092fa48-632b-41df-a243-889b9359237a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:15.121880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9092fa48-632b-41df-a243-889b9359237a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:15.129000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9092fa48-632b-41df-a243-889b9359237a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:15.129515 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9092fa48-632b-41df-a243-889b9359237a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:15.130002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9092fa48-632b-41df-a243-889b9359237a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:15.130776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9092fa48-632b-41df-a243-889b9359237a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:15.131215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9092fa48-632b-41df-a243-889b9359237a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:15.132259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9092fa48-632b-41df-a243-889b9359237a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:15.274705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9092fa48-632b-41df-a243-889b9359237a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:15.283653 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9092fa48-632b-41df-a243-889b9359237a tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1512 microversion: 2.1 time: 0.167543 Aug 27 03:37:15.284252 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3382/6947] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:15 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:16.070157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-cb124bb2-07cc-46c5-b29d-49a44d40d92c req-ba74d89d-98b4-457a-8d44-b9e9bc6cae70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5", "name": "network-vif-deleted", "tag": "019143dd-a831-45df-a66c-722397123bdb"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:16.082220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cb124bb2-07cc-46c5-b29d-49a44d40d92c req-ba74d89d-98b4-457a-8d44-b9e9bc6cae70 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:16.092530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cb124bb2-07cc-46c5-b29d-49a44d40d92c req-ba74d89d-98b4-457a-8d44-b9e9bc6cae70 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:16.096720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-cb124bb2-07cc-46c5-b29d-49a44d40d92c req-ba74d89d-98b4-457a-8d44-b9e9bc6cae70 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:16.119566 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-cb124bb2-07cc-46c5-b29d-49a44d40d92c req-ba74d89d-98b4-457a-8d44-b9e9bc6cae70 service nova] Creating event network-vif-deleted:019143dd-a831-45df-a66c-722397123bdb for instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 on n-h2-852084-5 Aug 27 03:37:16.126168 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-cb124bb2-07cc-46c5-b29d-49a44d40d92c req-ba74d89d-98b4-457a-8d44-b9e9bc6cae70 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059659 Aug 27 03:37:16.127263 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3566/6948] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:16.304386 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:37:16.304934 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:37:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 (ip 10.222.0.99) !!! Aug 27 03:37:16.311762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:16.312408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:16.323589 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:16.324133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:16.324622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:16.325898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:16.325898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:16.326305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:16.361212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:16.361739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:16.362199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:16.362672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lazy-loading 'fault' on Instance uuid 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:37:16.404725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:16.413120 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b205c84d-7206-48c1-8706-a45677a3f130 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 200 len: 1307 microversion: 2.1 time: 0.110661 Aug 27 03:37:16.413805 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3383/6949] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:16 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:17.436528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:17.437224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:17.444450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.444928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.445370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.446082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.446531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.446950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.460199 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] HTTP exception thrown: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Request method failure captured: Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 HTTP/1.1 Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZFOOuwEtJuuhFXOYlduhqEgTG9eaNxA0t7XgDR4lbz87rBN8Ij9ZkbUH_5aylesf0g-xIY7XLEzSXRdKcjB2UtsaWPu4itIdDnUtSrgKCzRZxQ7OuKBmjzVRNHEN41i4lbWSwPQJU5D94fJy_CvztZy3krqudqkwgIl2Uz-dudmGNI Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_231ba57740d8456dbfabb511c0950d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/231ba57740d8456dbfabb511c0950d48"}]}] Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 613b0d08f81842bab6ea2ee0a54daa68 Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5'} Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:17.461891 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:17.467213 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:17.467213 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:17.467213 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:17.467213 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:17.467213 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:17.467213 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:17.467213 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:17.467213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Returning 404 to user: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:17.467213 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-78c8415b-d533-4707-b451-da34aa736a47 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 404 len: 111 microversion: 2.1 time: 0.032388 Aug 27 03:37:17.467213 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3567/6950] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:17 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:17.473058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d1cae79b-e2f2-42b2-bfb0-cc1a2d43be96 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:17.473745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d1cae79b-e2f2-42b2-bfb0-cc1a2d43be96 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:17.480771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1cae79b-e2f2-42b2-bfb0-cc1a2d43be96 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.481270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1cae79b-e2f2-42b2-bfb0-cc1a2d43be96 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.481752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1cae79b-e2f2-42b2-bfb0-cc1a2d43be96 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.482460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1cae79b-e2f2-42b2-bfb0-cc1a2d43be96 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.482931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1cae79b-e2f2-42b2-bfb0-cc1a2d43be96 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.483377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d1cae79b-e2f2-42b2-bfb0-cc1a2d43be96 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.487404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:17.630741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d1cae79b-e2f2-42b2-bfb0-cc1a2d43be96 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:17.639672 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d1cae79b-e2f2-42b2-bfb0-cc1a2d43be96 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1506 microversion: 2.1 time: 0.170525 Aug 27 03:37:17.640191 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3384/6951] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:17 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:17.659878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f69b08d9-5dc7-434c-aebb-a52732d17b17 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:17.662143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f69b08d9-5dc7-434c-aebb-a52732d17b17 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 9501cee0-fbe1-49ba-a512-1f530bc7b37c] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:17.664750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:17.669779 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-f69b08d9-5dc7-434c-aebb-a52732d17b17 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] HTTP exception thrown: Instance 9501cee0-fbe1-49ba-a512-1f530bc7b37c could not be found. Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f69b08d9-5dc7-434c-aebb-a52732d17b17 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Request method failure captured: Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/9501cee0-fbe1-49ba-a512-1f530bc7b37c/action HTTP/1.1 Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 32 Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZFOOuwEtJuuhFXOYlduhqEgTG9eaNxA0t7XgDR4lbz87rBN8Ij9ZkbUH_5aylesf0g-xIY7XLEzSXRdKcjB2UtsaWPu4itIdDnUtSrgKCzRZxQ7OuKBmjzVRNHEN41i4lbWSwPQJU5D94fJy_CvztZy3krqudqkwgIl2Uz-dudmGNI Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_231ba57740d8456dbfabb511c0950d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/231ba57740d8456dbfabb511c0950d48"}]}] Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 613b0d08f81842bab6ea2ee0a54daa68 Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: {"resize": {"flavorRef": "452"}} Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 9501cee0-fbe1-49ba-a512-1f530bc7b37c could not be found. Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '9501cee0-fbe1-49ba-a512-1f530bc7b37c', 'body': {'resize': {'flavorRef': '452'}}} Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9501cee0-fbe1-49ba-a512-1f530bc7b37c could not be found. Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:17.671364 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9501cee0-fbe1-49ba-a512-1f530bc7b37c could not be found. Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9501cee0-fbe1-49ba-a512-1f530bc7b37c could not be found. Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f69b08d9-5dc7-434c-aebb-a52732d17b17 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Returning 404 to user: Instance 9501cee0-fbe1-49ba-a512-1f530bc7b37c could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f69b08d9-5dc7-434c-aebb-a52732d17b17 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "POST /compute/v2.1/servers/9501cee0-fbe1-49ba-a512-1f530bc7b37c/action" status: 404 len: 111 microversion: 2.1 time: 0.016906 Aug 27 03:37:17.675419 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3568/6952] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:37:17 2022] POST /compute/v2.1/servers/9501cee0-fbe1-49ba-a512-1f530bc7b37c/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:17.682166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6d39bde8-ef56-4e99-aaea-7585de1a1c20 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:17.682840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6d39bde8-ef56-4e99-aaea-7585de1a1c20 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:17.689004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d39bde8-ef56-4e99-aaea-7585de1a1c20 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.689512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d39bde8-ef56-4e99-aaea-7585de1a1c20 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.690004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d39bde8-ef56-4e99-aaea-7585de1a1c20 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.690732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d39bde8-ef56-4e99-aaea-7585de1a1c20 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.691215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d39bde8-ef56-4e99-aaea-7585de1a1c20 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.691666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6d39bde8-ef56-4e99-aaea-7585de1a1c20 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.828971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6d39bde8-ef56-4e99-aaea-7585de1a1c20 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:17.837391 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6d39bde8-ef56-4e99-aaea-7585de1a1c20 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1506 microversion: 2.1 time: 0.159682 Aug 27 03:37:17.838027 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3385/6953] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:17 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:17.860184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-295381ae-2563-484c-83f2-e4d081feb2d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:17.860802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-295381ae-2563-484c-83f2-e4d081feb2d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:17.869155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-295381ae-2563-484c-83f2-e4d081feb2d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.869656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-295381ae-2563-484c-83f2-e4d081feb2d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.870132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-295381ae-2563-484c-83f2-e4d081feb2d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.870860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-295381ae-2563-484c-83f2-e4d081feb2d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:17.871324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-295381ae-2563-484c-83f2-e4d081feb2d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:17.871761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-295381ae-2563-484c-83f2-e4d081feb2d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:17.874816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=69 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:18.010030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-295381ae-2563-484c-83f2-e4d081feb2d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:18.018156 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-295381ae-2563-484c-83f2-e4d081feb2d1 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1506 microversion: 2.1 time: 0.162806 Aug 27 03:37:18.018733 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3569/6954] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:17 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:18.039970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "907f6ba7-f476-4d04-89b1-1382d520fd43"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:18.042395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:18.048692 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.049202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.049658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.050406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.050878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.051324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.080163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:18.086401 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] HTTP exception thrown: Flavor 907f6ba7-f476-4d04-89b1-1382d520fd43 could not be found. Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Request method failure captured: Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: request: POST /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e/action HTTP/1.1 Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 65 Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZFOOuwEtJuuhFXOYlduhqEgTG9eaNxA0t7XgDR4lbz87rBN8Ij9ZkbUH_5aylesf0g-xIY7XLEzSXRdKcjB2UtsaWPu4itIdDnUtSrgKCzRZxQ7OuKBmjzVRNHEN41i4lbWSwPQJU5D94fJy_CvztZy3krqudqkwgIl2Uz-dudmGNI Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_231ba57740d8456dbfabb511c0950d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/231ba57740d8456dbfabb511c0950d48"}]}] Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 613b0d08f81842bab6ea2ee0a54daa68 Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: {"resize": {"flavorRef": "907f6ba7-f476-4d04-89b1-1382d520fd43"}} Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: exception: Flavor 907f6ba7-f476-4d04-89b1-1382d520fd43 could not be found. Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '85d20b50-056c-40a2-b4c2-7e1b3b123b4e', 'body': {'resize': {'flavorRef': '907f6ba7-f476-4d04-89b1-1382d520fd43'}}} Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:18.095629 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 907f6ba7-f476-4d04-89b1-1382d520fd43 could not be found. Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 907f6ba7-f476-4d04-89b1-1382d520fd43 could not be found. Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 907f6ba7-f476-4d04-89b1-1382d520fd43 could not be found. Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Returning 400 to user: Flavor 907f6ba7-f476-4d04-89b1-1382d520fd43 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2f8d2135-1355-46b9-a013-723156d22de5 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "POST /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e/action" status: 400 len: 107 microversion: 2.1 time: 0.061945 Aug 27 03:37:18.099646 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3386/6955] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:37:18 2022] POST /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e/action => generated 107 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:37:18.106613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7aa8e97d-2682-4cc0-98aa-ab7e6ce736dc tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.107275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7aa8e97d-2682-4cc0-98aa-ab7e6ce736dc tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:18.114093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7aa8e97d-2682-4cc0-98aa-ab7e6ce736dc tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.114583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7aa8e97d-2682-4cc0-98aa-ab7e6ce736dc tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.115022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7aa8e97d-2682-4cc0-98aa-ab7e6ce736dc tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.115778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7aa8e97d-2682-4cc0-98aa-ab7e6ce736dc tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.116232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7aa8e97d-2682-4cc0-98aa-ab7e6ce736dc tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.116659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7aa8e97d-2682-4cc0-98aa-ab7e6ce736dc tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.252252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7aa8e97d-2682-4cc0-98aa-ab7e6ce736dc tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:18.260205 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7aa8e97d-2682-4cc0-98aa-ab7e6ce736dc tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1506 microversion: 2.1 time: 0.157473 Aug 27 03:37:18.260806 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3570/6956] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:18 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:18.281721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b265e60-0781-4be7-9411-1c77cb0aee18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.282850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4b265e60-0781-4be7-9411-1c77cb0aee18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:18.289888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b265e60-0781-4be7-9411-1c77cb0aee18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.290120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b265e60-0781-4be7-9411-1c77cb0aee18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.290584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b265e60-0781-4be7-9411-1c77cb0aee18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.291582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b265e60-0781-4be7-9411-1c77cb0aee18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.291911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b265e60-0781-4be7-9411-1c77cb0aee18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.292369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b265e60-0781-4be7-9411-1c77cb0aee18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.434523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4b265e60-0781-4be7-9411-1c77cb0aee18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:18.442337 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4b265e60-0781-4be7-9411-1c77cb0aee18 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1506 microversion: 2.1 time: 0.164604 Aug 27 03:37:18.442915 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3387/6957] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:18 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:18.465309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4f4aa91-bcff-4f13-81bc-d728de36a4f2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4f4aa91-bcff-4f13-81bc-d728de36a4f2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Request method failure captured: Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: request: POST /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e/action HTTP/1.1 Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 29 Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZFOOuwEtJuuhFXOYlduhqEgTG9eaNxA0t7XgDR4lbz87rBN8Ij9ZkbUH_5aylesf0g-xIY7XLEzSXRdKcjB2UtsaWPu4itIdDnUtSrgKCzRZxQ7OuKBmjzVRNHEN41i4lbWSwPQJU5D94fJy_CvztZy3krqudqkwgIl2Uz-dudmGNI Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_231ba57740d8456dbfabb511c0950d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/231ba57740d8456dbfabb511c0950d48"}]}] Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 613b0d08f81842bab6ea2ee0a54daa68 Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: {"resize": {"flavorRef": ""}} Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '85d20b50-056c-40a2-b4c2-7e1b3b123b4e', 'body': {'resize': {'flavorRef': ''}}} Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise error Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi '' Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.478329 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:18.483080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.483080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.483080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:18.483080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:18.483080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 27 03:37:18.483080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 27 03:37:18.483080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 27 03:37:18.483080 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.483080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e4f4aa91-bcff-4f13-81bc-d728de36a4f2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:18.483080 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e4f4aa91-bcff-4f13-81bc-d728de36a4f2 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "POST /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e/action" status: 400 len: 113 microversion: 2.1 time: 0.020569 Aug 27 03:37:18.483080 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3571/6958] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:37:18 2022] POST /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e/action => generated 113 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 03:37:18.488949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb18fe8b-26a0-44bb-9dcb-65aed489eb24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.489584 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fb18fe8b-26a0-44bb-9dcb-65aed489eb24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:18.496591 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb18fe8b-26a0-44bb-9dcb-65aed489eb24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.497096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb18fe8b-26a0-44bb-9dcb-65aed489eb24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.497551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb18fe8b-26a0-44bb-9dcb-65aed489eb24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.498294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb18fe8b-26a0-44bb-9dcb-65aed489eb24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.498787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb18fe8b-26a0-44bb-9dcb-65aed489eb24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.499205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb18fe8b-26a0-44bb-9dcb-65aed489eb24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.637342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fb18fe8b-26a0-44bb-9dcb-65aed489eb24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:18.645220 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fb18fe8b-26a0-44bb-9dcb-65aed489eb24 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1506 microversion: 2.1 time: 0.160174 Aug 27 03:37:18.645806 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3388/6959] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:18 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:18.670483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.670989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:18.678394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.678886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.679436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.680155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.680612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.681047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.695368 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] HTTP exception thrown: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Request method failure captured: Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 HTTP/1.1 Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZFOOuwEtJuuhFXOYlduhqEgTG9eaNxA0t7XgDR4lbz87rBN8Ij9ZkbUH_5aylesf0g-xIY7XLEzSXRdKcjB2UtsaWPu4itIdDnUtSrgKCzRZxQ7OuKBmjzVRNHEN41i4lbWSwPQJU5D94fJy_CvztZy3krqudqkwgIl2Uz-dudmGNI Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_231ba57740d8456dbfabb511c0950d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/231ba57740d8456dbfabb511c0950d48"}]}] Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: 613b0d08f81842bab6ea2ee0a54daa68 Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5'} Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:18.696983 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Returning 404 to user: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0980a4a0-a999-4708-9975-9df7f375457c tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 404 len: 111 microversion: 2.1 time: 0.032917 Aug 27 03:37:18.701088 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3572/6960] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:18 2022] DELETE /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 03:37:18.707525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.708136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:18.714983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.715487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.716203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.716924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.717399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.717875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.732089 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] HTTP exception thrown: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Request method failure captured: Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 HTTP/1.1 Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZFOOuwEtJuuhFXOYlduhqEgTG9eaNxA0t7XgDR4lbz87rBN8Ij9ZkbUH_5aylesf0g-xIY7XLEzSXRdKcjB2UtsaWPu4itIdDnUtSrgKCzRZxQ7OuKBmjzVRNHEN41i4lbWSwPQJU5D94fJy_CvztZy3krqudqkwgIl2Uz-dudmGNI Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_231ba57740d8456dbfabb511c0950d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/231ba57740d8456dbfabb511c0950d48"}]}] Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 613b0d08f81842bab6ea2ee0a54daa68 Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5'} Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:18.733731 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.738056 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:18.738056 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:18.738056 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:18.738056 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:18.738056 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:18.738056 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. Aug 27 03:37:18.738056 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:18.738056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Returning 404 to user: Instance 3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:18.738056 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-604f8755-5f0e-49ca-a51f-af85765c62b7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5" status: 404 len: 111 microversion: 2.1 time: 0.031648 Aug 27 03:37:18.738056 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3389/6961] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:18 2022] GET /compute/v2.1/servers/3c5a62ec-0d63-4c09-b8ba-36f56a3a05d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:18.744604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3e471887-9a99-45c5-8bc1-d4a760bbaa52 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.745109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3e471887-9a99-45c5-8bc1-d4a760bbaa52 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:18.752859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e471887-9a99-45c5-8bc1-d4a760bbaa52 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.753416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e471887-9a99-45c5-8bc1-d4a760bbaa52 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.754139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e471887-9a99-45c5-8bc1-d4a760bbaa52 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.754884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e471887-9a99-45c5-8bc1-d4a760bbaa52 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.755408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e471887-9a99-45c5-8bc1-d4a760bbaa52 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.755771 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e471887-9a99-45c5-8bc1-d4a760bbaa52 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.784212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3e471887-9a99-45c5-8bc1-d4a760bbaa52 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:37:18.867744 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3e471887-9a99-45c5-8bc1-d4a760bbaa52 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "DELETE /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 204 len: 0 microversion: 2.1 time: 0.126773 Aug 27 03:37:18.868359 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3573/6962] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:37:18 2022] DELETE /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:37:18.878181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-03e005da-8fca-4cd2-b8fd-c94787a21176 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:18.878815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-03e005da-8fca-4cd2-b8fd-c94787a21176 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:18.885491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e005da-8fca-4cd2-b8fd-c94787a21176 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.886031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e005da-8fca-4cd2-b8fd-c94787a21176 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.886486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e005da-8fca-4cd2-b8fd-c94787a21176 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:18.887208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e005da-8fca-4cd2-b8fd-c94787a21176 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:18.887677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e005da-8fca-4cd2-b8fd-c94787a21176 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:18.888121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03e005da-8fca-4cd2-b8fd-c94787a21176 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:19.026131 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-03e005da-8fca-4cd2-b8fd-c94787a21176 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:19.034247 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-03e005da-8fca-4cd2-b8fd-c94787a21176 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1512 microversion: 2.1 time: 0.160026 Aug 27 03:37:19.034836 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3390/6963] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:18 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:37:20.056949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4a15aab7-f33e-4707-ae3b-e3d673230fb7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:20.057769 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4a15aab7-f33e-4707-ae3b-e3d673230fb7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:20.065322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a15aab7-f33e-4707-ae3b-e3d673230fb7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:20.065857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a15aab7-f33e-4707-ae3b-e3d673230fb7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:20.066307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a15aab7-f33e-4707-ae3b-e3d673230fb7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:20.067022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a15aab7-f33e-4707-ae3b-e3d673230fb7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:20.067477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a15aab7-f33e-4707-ae3b-e3d673230fb7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:20.067900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4a15aab7-f33e-4707-ae3b-e3d673230fb7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:20.238525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4a15aab7-f33e-4707-ae3b-e3d673230fb7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:20.248013 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4a15aab7-f33e-4707-ae3b-e3d673230fb7 tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1512 microversion: 2.1 time: 0.195653 Aug 27 03:37:20.248697 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3574/6964] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:20 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:20.981158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c85222f4-46c9-4078-aaac-efff9ebdc293 req-87d22b21-04eb-4677-90cd-9f3a92e959c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d20b50-056c-40a2-b4c2-7e1b3b123b4e", "name": "network-vif-deleted", "tag": "fa03c089-b0ac-4f1b-ad1f-684b7e563ffe"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:20.995909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c85222f4-46c9-4078-aaac-efff9ebdc293 req-87d22b21-04eb-4677-90cd-9f3a92e959c4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:20.996566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c85222f4-46c9-4078-aaac-efff9ebdc293 req-87d22b21-04eb-4677-90cd-9f3a92e959c4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:20.997111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c85222f4-46c9-4078-aaac-efff9ebdc293 req-87d22b21-04eb-4677-90cd-9f3a92e959c4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:21.015715 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c85222f4-46c9-4078-aaac-efff9ebdc293 req-87d22b21-04eb-4677-90cd-9f3a92e959c4 service nova] Creating event network-vif-deleted:fa03c089-b0ac-4f1b-ad1f-684b7e563ffe for instance 85d20b50-056c-40a2-b4c2-7e1b3b123b4e on n-h1-852084-5 Aug 27 03:37:21.022641 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c85222f4-46c9-4078-aaac-efff9ebdc293 req-87d22b21-04eb-4677-90cd-9f3a92e959c4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152924 Aug 27 03:37:21.024701 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3391/6965] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:21.269603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:21.270202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:21.278194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:21.278687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:21.279132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:21.279846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:21.280301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:21.280732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:21.324043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:21.324529 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:21.324964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:21.325423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lazy-loading 'fault' on Instance uuid 85d20b50-056c-40a2-b4c2-7e1b3b123b4e {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:37:21.387123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613b0d08f81842bab6ea2ee0a54daa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '231ba57740d8456dbfabb511c0950d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:21.398674 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e53b9da6-c181-4b98-b376-fc6b2964a64d tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 200 len: 1306 microversion: 2.1 time: 0.133033 Aug 27 03:37:21.399284 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3575/6966] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:21 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 1306 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:22.424039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:22.425379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] [instance: 85d20b50-056c-40a2-b4c2-7e1b3b123b4e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:22.436168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:22.437004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:22.437812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:22.439005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:22.439803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:22.440540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:22.457607 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] HTTP exception thrown: Instance 85d20b50-056c-40a2-b4c2-7e1b3b123b4e could not be found. Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Request method failure captured: Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e HTTP/1.1 Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZFOOuwEtJuuhFXOYlduhqEgTG9eaNxA0t7XgDR4lbz87rBN8Ij9ZkbUH_5aylesf0g-xIY7XLEzSXRdKcjB2UtsaWPu4itIdDnUtSrgKCzRZxQ7OuKBmjzVRNHEN41i4lbWSwPQJU5D94fJy_CvztZy3krqudqkwgIl2Uz-dudmGNI Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_231ba57740d8456dbfabb511c0950d48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/231ba57740d8456dbfabb511c0950d48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/231ba57740d8456dbfabb511c0950d48"}]}] Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 231ba57740d8456dbfabb511c0950d48 Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1352670509 Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 613b0d08f81842bab6ea2ee0a54daa68 Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-ServersNegativeTestJSON-1352670509-project Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 85d20b50-056c-40a2-b4c2-7e1b3b123b4e could not be found. Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '85d20b50-056c-40a2-b4c2-7e1b3b123b4e'} Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d20b50-056c-40a2-b4c2-7e1b3b123b4e could not be found. Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d20b50-056c-40a2-b4c2-7e1b3b123b4e could not be found. Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:37:22.459378 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:22.463911 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:37:22.463911 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:37:22.463911 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:37:22.463911 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:37:22.463911 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:37:22.463911 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d20b50-056c-40a2-b4c2-7e1b3b123b4e could not be found. Aug 27 03:37:22.463911 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:37:22.463911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] Returning 404 to user: Instance 85d20b50-056c-40a2-b4c2-7e1b3b123b4e could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:37:22.463911 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-90863fb0-2357-4db5-aad2-151cdb01c4cf tempest-ServersNegativeTestJSON-1352670509 tempest-ServersNegativeTestJSON-1352670509-project] 10.222.0.99 "GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e" status: 404 len: 111 microversion: 2.1 time: 0.044886 Aug 27 03:37:22.463911 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3392/6967] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:22 2022] GET /compute/v2.1/servers/85d20b50-056c-40a2-b4c2-7e1b3b123b4e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:37:56.892797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:56.894019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:57.106213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70fdfacb-d555-4ce5-8ad4-a413dff13732 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Action: 'create', calling method: .version_select at 0x7f4d28e93dc0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1634114920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCII7uigiq/1psA8CWFV5DGN9x/otSPy8ADzCrukM/AAiBFw+8DbMF+uiBjVCGxWyVA6U0SMbNIKdoDZMXxdQQ2SW7AssCCz3OOKvAJ+bylE3l2Zhls6yGMjc0lPLRvWtQ=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:57.123344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-70fdfacb-d555-4ce5-8ad4-a413dff13732 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:37:57.129281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-70fdfacb-d555-4ce5-8ad4-a413dff13732 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for user de985326903a48f39209053431d18855 and project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:37:57.165316 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70fdfacb-d555-4ce5-8ad4-a413dff13732 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.277678 Aug 27 03:37:57.166245 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3576/6968] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:37:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:37:57.242600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-983512296", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1634114920", "networks": [{"uuid": "bf9312f5-bb22-45ea-ad72-364d0c813341"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:37:57.251400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:57.252097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=39 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:37:57.311149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] validate_networks() for [('bf9312f5-bb22-45ea-ad72-364d0c813341', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:37:57.726631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:37:57.727107 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:37:57.727662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:37:57.728100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:37:57.728538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:37:57.737377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:57.737926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:57.738385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:57.739137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:57.739609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:57.740057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:57.760447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:37:57.765806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for user de985326903a48f39209053431d18855 and project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:37:57.779355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:37:57.781745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:37:57.829440 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-674868f6-efef-45c4-905c-8a610c40f9be tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596575 Aug 27 03:37:57.830035 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3393/6969] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:37:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:37:57.840607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e7ed3773-5692-40ae-bea2-f594ae156792 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:57.841478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e7ed3773-5692-40ae-bea2-f594ae156792 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:57.896112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e7ed3773-5692-40ae-bea2-f594ae156792 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:57.904273 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e7ed3773-5692-40ae-bea2-f594ae156792 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1262 microversion: 2.1 time: 0.067391 Aug 27 03:37:57.904688 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3577/6970] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:57 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:37:58.928048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-abf57422-4819-4679-b047-23553d1d5b59 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:37:58.928705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-abf57422-4819-4679-b047-23553d1d5b59 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:37:58.935444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abf57422-4819-4679-b047-23553d1d5b59 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:58.935956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abf57422-4819-4679-b047-23553d1d5b59 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:58.936415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abf57422-4819-4679-b047-23553d1d5b59 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:58.937151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abf57422-4819-4679-b047-23553d1d5b59 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:37:58.937624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abf57422-4819-4679-b047-23553d1d5b59 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:37:58.938286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-abf57422-4819-4679-b047-23553d1d5b59 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:37:59.041741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-abf57422-4819-4679-b047-23553d1d5b59 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:37:59.061197 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-abf57422-4819-4679-b047-23553d1d5b59 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1322 microversion: 2.1 time: 0.138412 Aug 27 03:37:59.062893 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3394/6971] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:37:58 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:00.084359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ee93819b-7d39-44ca-86e0-ca1dd9209719 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:00.085722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ee93819b-7d39-44ca-86e0-ca1dd9209719 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:00.093596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee93819b-7d39-44ca-86e0-ca1dd9209719 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:00.094125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee93819b-7d39-44ca-86e0-ca1dd9209719 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:00.094581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee93819b-7d39-44ca-86e0-ca1dd9209719 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:00.095677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee93819b-7d39-44ca-86e0-ca1dd9209719 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:00.096148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee93819b-7d39-44ca-86e0-ca1dd9209719 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:00.096623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ee93819b-7d39-44ca-86e0-ca1dd9209719 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:00.306190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ee93819b-7d39-44ca-86e0-ca1dd9209719 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:00.318688 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ee93819b-7d39-44ca-86e0-ca1dd9209719 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1362 microversion: 2.1 time: 0.238800 Aug 27 03:38:00.319693 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3578/6972] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:00 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:00.377204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-bf416d57-4853-48d7-b7a6-22bcbb7dd175 req-60913e77-27f4-4339-9624-46a767a4ed5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0c9f136-3067-4980-a86b-38687044a2f4", "tag": "325c1424-9f41-474a-acfd-70e1e0d68482"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:00.393853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf416d57-4853-48d7-b7a6-22bcbb7dd175 req-60913e77-27f4-4339-9624-46a767a4ed5a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:00.394431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf416d57-4853-48d7-b7a6-22bcbb7dd175 req-60913e77-27f4-4339-9624-46a767a4ed5a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:00.402968 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-bf416d57-4853-48d7-b7a6-22bcbb7dd175 req-60913e77-27f4-4339-9624-46a767a4ed5a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:00.422674 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-bf416d57-4853-48d7-b7a6-22bcbb7dd175 req-60913e77-27f4-4339-9624-46a767a4ed5a service nova] Creating event network-changed:325c1424-9f41-474a-acfd-70e1e0d68482 for instance a0c9f136-3067-4980-a86b-38687044a2f4 on n-h2-852084-5 Aug 27 03:38:00.431433 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-bf416d57-4853-48d7-b7a6-22bcbb7dd175 req-60913e77-27f4-4339-9624-46a767a4ed5a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058095 Aug 27 03:38:00.432971 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3395/6973] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:01.341559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7af71e36-c4ec-4b7b-a790-1e08dbb78f1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:01.342849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7af71e36-c4ec-4b7b-a790-1e08dbb78f1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:01.349550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7af71e36-c4ec-4b7b-a790-1e08dbb78f1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:01.350085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7af71e36-c4ec-4b7b-a790-1e08dbb78f1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:01.350521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7af71e36-c4ec-4b7b-a790-1e08dbb78f1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:01.351228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7af71e36-c4ec-4b7b-a790-1e08dbb78f1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:01.351685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7af71e36-c4ec-4b7b-a790-1e08dbb78f1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:01.352652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7af71e36-c4ec-4b7b-a790-1e08dbb78f1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:01.514366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7af71e36-c4ec-4b7b-a790-1e08dbb78f1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:01.522975 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7af71e36-c4ec-4b7b-a790-1e08dbb78f1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1362 microversion: 2.1 time: 0.186289 Aug 27 03:38:01.523566 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3579/6974] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:01 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:02.545481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-48b787b1-7fac-4d85-a199-c0f0be793eea tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:02.546261 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-48b787b1-7fac-4d85-a199-c0f0be793eea tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:02.553200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b787b1-7fac-4d85-a199-c0f0be793eea tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:02.553721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b787b1-7fac-4d85-a199-c0f0be793eea tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:02.554180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b787b1-7fac-4d85-a199-c0f0be793eea tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:02.554890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b787b1-7fac-4d85-a199-c0f0be793eea tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:02.555360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b787b1-7fac-4d85-a199-c0f0be793eea tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:02.555805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-48b787b1-7fac-4d85-a199-c0f0be793eea tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:02.692691 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-48b787b1-7fac-4d85-a199-c0f0be793eea tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:02.701178 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-48b787b1-7fac-4d85-a199-c0f0be793eea tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1362 microversion: 2.1 time: 0.160776 Aug 27 03:38:02.701791 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3396/6975] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:02 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:03.722306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4976bc32-0013-459e-a48d-c0ed889eac49 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:03.722861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4976bc32-0013-459e-a48d-c0ed889eac49 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:03.729925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4976bc32-0013-459e-a48d-c0ed889eac49 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:03.730417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4976bc32-0013-459e-a48d-c0ed889eac49 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:03.730866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4976bc32-0013-459e-a48d-c0ed889eac49 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:03.731567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4976bc32-0013-459e-a48d-c0ed889eac49 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:03.732036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4976bc32-0013-459e-a48d-c0ed889eac49 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:03.732468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4976bc32-0013-459e-a48d-c0ed889eac49 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:03.866514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4976bc32-0013-459e-a48d-c0ed889eac49 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:03.874367 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4976bc32-0013-459e-a48d-c0ed889eac49 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1362 microversion: 2.1 time: 0.156069 Aug 27 03:38:03.885865 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3580/6976] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:03 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:04.896611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2cddb51e-a19d-4d8a-b4fc-596eb7892a21 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:04.897296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2cddb51e-a19d-4d8a-b4fc-596eb7892a21 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:04.904283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cddb51e-a19d-4d8a-b4fc-596eb7892a21 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:04.904788 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cddb51e-a19d-4d8a-b4fc-596eb7892a21 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:04.905875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cddb51e-a19d-4d8a-b4fc-596eb7892a21 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:04.906614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cddb51e-a19d-4d8a-b4fc-596eb7892a21 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:04.907093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cddb51e-a19d-4d8a-b4fc-596eb7892a21 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:04.907549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2cddb51e-a19d-4d8a-b4fc-596eb7892a21 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:05.040439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2cddb51e-a19d-4d8a-b4fc-596eb7892a21 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:05.048669 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2cddb51e-a19d-4d8a-b4fc-596eb7892a21 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1362 microversion: 2.1 time: 0.156717 Aug 27 03:38:05.049250 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3397/6977] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:04 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:06.012283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-445a72ce-9e51-4cb0-bafd-a49f892a88b1 req-fc8c256a-da15-45c9-9665-26524d2dbd99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c9f136-3067-4980-a86b-38687044a2f4", "name": "network-vif-plugged", "status": "completed", "tag": "325c1424-9f41-474a-acfd-70e1e0d68482"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:06.023230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-445a72ce-9e51-4cb0-bafd-a49f892a88b1 req-fc8c256a-da15-45c9-9665-26524d2dbd99 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:06.023857 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-445a72ce-9e51-4cb0-bafd-a49f892a88b1 req-fc8c256a-da15-45c9-9665-26524d2dbd99 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:06.024302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-445a72ce-9e51-4cb0-bafd-a49f892a88b1 req-fc8c256a-da15-45c9-9665-26524d2dbd99 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:06.035990 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-445a72ce-9e51-4cb0-bafd-a49f892a88b1 req-fc8c256a-da15-45c9-9665-26524d2dbd99 service nova] Creating event network-vif-plugged:325c1424-9f41-474a-acfd-70e1e0d68482 for instance a0c9f136-3067-4980-a86b-38687044a2f4 on n-h2-852084-5 Aug 27 03:38:06.041456 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-445a72ce-9e51-4cb0-bafd-a49f892a88b1 req-fc8c256a-da15-45c9-9665-26524d2dbd99 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090073 Aug 27 03:38:06.042099 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3581/6978] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:06.068808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-342de7db-d6fe-416d-b513-0b5fae88df02 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:06.069576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-342de7db-d6fe-416d-b513-0b5fae88df02 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:06.076532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342de7db-d6fe-416d-b513-0b5fae88df02 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:06.077035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342de7db-d6fe-416d-b513-0b5fae88df02 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:06.077497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342de7db-d6fe-416d-b513-0b5fae88df02 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:06.078263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342de7db-d6fe-416d-b513-0b5fae88df02 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:06.078739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342de7db-d6fe-416d-b513-0b5fae88df02 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:06.079216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-342de7db-d6fe-416d-b513-0b5fae88df02 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:06.217726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-342de7db-d6fe-416d-b513-0b5fae88df02 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:06.226172 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-342de7db-d6fe-416d-b513-0b5fae88df02 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1362 microversion: 2.1 time: 0.161312 Aug 27 03:38:06.226750 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3398/6979] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:06 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:07.247912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d09f2aa8-20d9-497d-99f8-90d48af64ef5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:07.248608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d09f2aa8-20d9-497d-99f8-90d48af64ef5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:07.255260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d09f2aa8-20d9-497d-99f8-90d48af64ef5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:07.255925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d09f2aa8-20d9-497d-99f8-90d48af64ef5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:07.256366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d09f2aa8-20d9-497d-99f8-90d48af64ef5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:07.257054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d09f2aa8-20d9-497d-99f8-90d48af64ef5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:07.257520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d09f2aa8-20d9-497d-99f8-90d48af64ef5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:07.257962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d09f2aa8-20d9-497d-99f8-90d48af64ef5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:07.393600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d09f2aa8-20d9-497d-99f8-90d48af64ef5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:07.401608 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d09f2aa8-20d9-497d-99f8-90d48af64ef5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1554 microversion: 2.1 time: 0.158865 Aug 27 03:38:07.402256 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3582/6980] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:07 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:07.422612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c8b027f8-da71-4933-8879-9aa7e1256473 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:07.423253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c8b027f8-da71-4933-8879-9aa7e1256473 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:07.430853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8b027f8-da71-4933-8879-9aa7e1256473 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:07.431360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8b027f8-da71-4933-8879-9aa7e1256473 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:07.431820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8b027f8-da71-4933-8879-9aa7e1256473 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:07.432565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8b027f8-da71-4933-8879-9aa7e1256473 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:07.433049 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8b027f8-da71-4933-8879-9aa7e1256473 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:07.433493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8b027f8-da71-4933-8879-9aa7e1256473 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:07.566837 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c8b027f8-da71-4933-8879-9aa7e1256473 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:07.574691 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c8b027f8-da71-4933-8879-9aa7e1256473 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1554 microversion: 2.1 time: 0.155978 Aug 27 03:38:07.575263 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3399/6981] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:07 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:09.178568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c9afa680-383b-409c-88f4-ee604aee7b0f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "486532dc-b5ba-4713-8db6-f14f28bdaa34"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:09.181081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c9afa680-383b-409c-88f4-ee604aee7b0f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:09.183114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:09.189469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9afa680-383b-409c-88f4-ee604aee7b0f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:09.189989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9afa680-383b-409c-88f4-ee604aee7b0f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:09.190433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9afa680-383b-409c-88f4-ee604aee7b0f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:09.191140 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9afa680-383b-409c-88f4-ee604aee7b0f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:09.191601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9afa680-383b-409c-88f4-ee604aee7b0f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:09.192034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c9afa680-383b-409c-88f4-ee604aee7b0f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:09.438283 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c9afa680-383b-409c-88f4-ee604aee7b0f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "POST /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264032 Aug 27 03:38:09.438958 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3583/6982] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:38:09 2022] POST /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:20.143622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f0dd5fd3-46bc-4727-aad7-e26adb4bf9b9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:20.144143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f0dd5fd3-46bc-4727-aad7-e26adb4bf9b9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:20.146707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:20.147396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:20.148958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:20.149647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=34 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:20.157151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0dd5fd3-46bc-4727-aad7-e26adb4bf9b9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:20.157656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0dd5fd3-46bc-4727-aad7-e26adb4bf9b9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:20.158135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0dd5fd3-46bc-4727-aad7-e26adb4bf9b9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:20.158851 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0dd5fd3-46bc-4727-aad7-e26adb4bf9b9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:20.159323 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0dd5fd3-46bc-4727-aad7-e26adb4bf9b9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:20.159766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0dd5fd3-46bc-4727-aad7-e26adb4bf9b9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:20.240709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-f0dd5fd3-46bc-4727-aad7-e26adb4bf9b9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lazy-loading 'services' on Instance uuid a0c9f136-3067-4980-a86b-38687044a2f4 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:38:20.318203 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f0dd5fd3-46bc-4727-aad7-e26adb4bf9b9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments/486532dc-b5ba-4713-8db6-f14f28bdaa34" status: 202 len: 0 microversion: 2.1 time: 0.177269 Aug 27 03:38:20.318475 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3400/6983] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:38:20 2022] DELETE /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments/486532dc-b5ba-4713-8db6-f14f28bdaa34 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 03:38:20.327296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c61bd7a7-e166-41ad-a88e-7595a5bf5c9a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:20.329821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c61bd7a7-e166-41ad-a88e-7595a5bf5c9a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:20.332997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:20.333777 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:20.340210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c61bd7a7-e166-41ad-a88e-7595a5bf5c9a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:20.341210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c61bd7a7-e166-41ad-a88e-7595a5bf5c9a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:20.341657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c61bd7a7-e166-41ad-a88e-7595a5bf5c9a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:20.342675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c61bd7a7-e166-41ad-a88e-7595a5bf5c9a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:20.342869 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c61bd7a7-e166-41ad-a88e-7595a5bf5c9a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:20.343295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c61bd7a7-e166-41ad-a88e-7595a5bf5c9a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:20.380702 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c61bd7a7-e166-41ad-a88e-7595a5bf5c9a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057648 Aug 27 03:38:20.381433 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3584/6984] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:20 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:21.393957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-085fb312-e800-42fd-864f-0bb55e783934 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:21.397028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-085fb312-e800-42fd-864f-0bb55e783934 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:21.403441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-085fb312-e800-42fd-864f-0bb55e783934 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:21.403935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-085fb312-e800-42fd-864f-0bb55e783934 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:21.404382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-085fb312-e800-42fd-864f-0bb55e783934 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:21.405085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-085fb312-e800-42fd-864f-0bb55e783934 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:21.405551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-085fb312-e800-42fd-864f-0bb55e783934 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:21.406008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-085fb312-e800-42fd-864f-0bb55e783934 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:21.438101 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-085fb312-e800-42fd-864f-0bb55e783934 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049136 Aug 27 03:38:21.443279 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3401/6985] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:21 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:22.450807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-308e301a-2639-4674-a36e-8a02efe5cd76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:22.453011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-308e301a-2639-4674-a36e-8a02efe5cd76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:22.460314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308e301a-2639-4674-a36e-8a02efe5cd76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:22.460882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308e301a-2639-4674-a36e-8a02efe5cd76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:22.461326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308e301a-2639-4674-a36e-8a02efe5cd76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:22.462068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308e301a-2639-4674-a36e-8a02efe5cd76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:22.462534 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308e301a-2639-4674-a36e-8a02efe5cd76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:22.462968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-308e301a-2639-4674-a36e-8a02efe5cd76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:22.495044 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-308e301a-2639-4674-a36e-8a02efe5cd76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048532 Aug 27 03:38:22.495901 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3585/6986] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:22 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:23.507184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d19a075b-dd7c-4879-bc6e-a6b874ebc354 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:23.509294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d19a075b-dd7c-4879-bc6e-a6b874ebc354 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:23.516286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d19a075b-dd7c-4879-bc6e-a6b874ebc354 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:23.516785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d19a075b-dd7c-4879-bc6e-a6b874ebc354 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:23.517238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d19a075b-dd7c-4879-bc6e-a6b874ebc354 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:23.517976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d19a075b-dd7c-4879-bc6e-a6b874ebc354 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:23.518445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d19a075b-dd7c-4879-bc6e-a6b874ebc354 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:23.518885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d19a075b-dd7c-4879-bc6e-a6b874ebc354 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:23.552398 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d19a075b-dd7c-4879-bc6e-a6b874ebc354 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049897 Aug 27 03:38:23.552976 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3402/6987] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:23 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:24.564637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6251149-80ec-41b7-b49c-27d6fbf5de55 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:24.566891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a6251149-80ec-41b7-b49c-27d6fbf5de55 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:24.573954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6251149-80ec-41b7-b49c-27d6fbf5de55 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:24.574452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6251149-80ec-41b7-b49c-27d6fbf5de55 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:24.574900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6251149-80ec-41b7-b49c-27d6fbf5de55 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:24.575619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6251149-80ec-41b7-b49c-27d6fbf5de55 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:24.576086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6251149-80ec-41b7-b49c-27d6fbf5de55 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:24.576523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6251149-80ec-41b7-b49c-27d6fbf5de55 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:24.608519 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6251149-80ec-41b7-b49c-27d6fbf5de55 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047856 Aug 27 03:38:24.609502 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3586/6988] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:24 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:25.621181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-58d6c060-092a-4060-ba6d-042fe6330b4d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:25.623433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-58d6c060-092a-4060-ba6d-042fe6330b4d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:25.630925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d6c060-092a-4060-ba6d-042fe6330b4d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:25.631459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d6c060-092a-4060-ba6d-042fe6330b4d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:25.632001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d6c060-092a-4060-ba6d-042fe6330b4d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:25.632731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d6c060-092a-4060-ba6d-042fe6330b4d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:25.633206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d6c060-092a-4060-ba6d-042fe6330b4d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:25.633655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-58d6c060-092a-4060-ba6d-042fe6330b4d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:25.663443 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-58d6c060-092a-4060-ba6d-042fe6330b4d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046192 Aug 27 03:38:25.663926 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3403/6989] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:25 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:38:25.674399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:25.674893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:25.682352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:25.682845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:25.683288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:25.683981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:25.684435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:25.684864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:25.762187 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] HTTP exception thrown: Instance a0c9f136-3067-4980-a86b-38687044a2f4 is not attached to volume 486532dc-b5ba-4713-8db6-f14f28bdaa34 Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Request method failure captured: Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments/486532dc-b5ba-4713-8db6-f14f28bdaa34 HTTP/1.1 Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZGPcqzERaHrzDj1iLy76BUgNUcb1o3XPppFazvpgxH7qpvr6R6D7Lh9plFRFbhAYKr7UHq_cGU6UznbGlZaQpogGCI6k01CU1sn-PYjpdFxcAXHmjPP812op0hjf2RYjfj8bWdjAaNP7ah7036dQ9OKXZhq_G-S9iynGvvnZJ3xQLU Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}] Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: de985326903a48f39209053431d18855 Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance a0c9f136-3067-4980-a86b-38687044a2f4 is not attached to volume 486532dc-b5ba-4713-8db6-f14f28bdaa34 Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'server_id': 'a0c9f136-3067-4980-a86b-38687044a2f4', 'id': '486532dc-b5ba-4713-8db6-f14f28bdaa34'} Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 486532dc-b5ba-4713-8db6-f14f28bdaa34. Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c9f136-3067-4980-a86b-38687044a2f4 is not attached to volume 486532dc-b5ba-4713-8db6-f14f28bdaa34 Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:25.769024 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:25.773639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:25.773639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:25.773639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c9f136-3067-4980-a86b-38687044a2f4 is not attached to volume 486532dc-b5ba-4713-8db6-f14f28bdaa34 Aug 27 03:38:25.773639 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:38:25.773639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Returning 404 to user: Instance a0c9f136-3067-4980-a86b-38687044a2f4 is not attached to volume 486532dc-b5ba-4713-8db6-f14f28bdaa34 {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:25.773639 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c10b755c-c4e6-4b55-a31d-098f0ef35464 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments/486532dc-b5ba-4713-8db6-f14f28bdaa34" status: 404 len: 154 microversion: 2.1 time: 0.100154 Aug 27 03:38:25.773639 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3587/6990] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:38:25 2022] DELETE /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4/os-volume_attachments/486532dc-b5ba-4713-8db6-f14f28bdaa34 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:29.152718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e3e85fff-ee5f-4165-8879-344e836a494e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:29.153342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e3e85fff-ee5f-4165-8879-344e836a494e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:29.160576 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e85fff-ee5f-4165-8879-344e836a494e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:29.161069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e85fff-ee5f-4165-8879-344e836a494e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:29.161528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e85fff-ee5f-4165-8879-344e836a494e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:29.162306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e85fff-ee5f-4165-8879-344e836a494e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:29.162775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e85fff-ee5f-4165-8879-344e836a494e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:29.163217 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e3e85fff-ee5f-4165-8879-344e836a494e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:29.190336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e3e85fff-ee5f-4165-8879-344e836a494e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:38:29.276924 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e3e85fff-ee5f-4165-8879-344e836a494e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 204 len: 0 microversion: 2.1 time: 0.127181 Aug 27 03:38:29.277466 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3404/6991] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:38:29 2022] DELETE /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 03:38:29.286463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-38e04520-9cd9-4d75-8acc-8d08d5f176e2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:29.287091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-38e04520-9cd9-4d75-8acc-8d08d5f176e2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:29.293849 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38e04520-9cd9-4d75-8acc-8d08d5f176e2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:29.294341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38e04520-9cd9-4d75-8acc-8d08d5f176e2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:29.294973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38e04520-9cd9-4d75-8acc-8d08d5f176e2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:29.295689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38e04520-9cd9-4d75-8acc-8d08d5f176e2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:29.296162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38e04520-9cd9-4d75-8acc-8d08d5f176e2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:29.296596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-38e04520-9cd9-4d75-8acc-8d08d5f176e2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:29.440456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-38e04520-9cd9-4d75-8acc-8d08d5f176e2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:29.449256 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-38e04520-9cd9-4d75-8acc-8d08d5f176e2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1560 microversion: 2.1 time: 0.167037 Aug 27 03:38:29.449822 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3588/6992] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:29 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:38:30.472023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9c1ec2a8-0422-4aff-b20e-1b51bbe39fac tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:30.473572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9c1ec2a8-0422-4aff-b20e-1b51bbe39fac tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:30.481010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c1ec2a8-0422-4aff-b20e-1b51bbe39fac tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:30.481514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c1ec2a8-0422-4aff-b20e-1b51bbe39fac tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:30.482005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c1ec2a8-0422-4aff-b20e-1b51bbe39fac tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:30.482728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c1ec2a8-0422-4aff-b20e-1b51bbe39fac tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:30.483205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c1ec2a8-0422-4aff-b20e-1b51bbe39fac tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:30.483654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9c1ec2a8-0422-4aff-b20e-1b51bbe39fac tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:30.619288 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9c1ec2a8-0422-4aff-b20e-1b51bbe39fac tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:30.627188 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9c1ec2a8-0422-4aff-b20e-1b51bbe39fac tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1560 microversion: 2.1 time: 0.160032 Aug 27 03:38:30.627772 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3405/6993] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:30 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:31.428288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-67ed4c48-f292-4524-a721-d73c43a1eed5 req-18fee5df-5a0c-438e-b820-2b3f20e7f405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0c9f136-3067-4980-a86b-38687044a2f4", "name": "network-vif-deleted", "tag": "325c1424-9f41-474a-acfd-70e1e0d68482"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:31.438992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-67ed4c48-f292-4524-a721-d73c43a1eed5 req-18fee5df-5a0c-438e-b820-2b3f20e7f405 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:31.439482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-67ed4c48-f292-4524-a721-d73c43a1eed5 req-18fee5df-5a0c-438e-b820-2b3f20e7f405 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:31.439926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-67ed4c48-f292-4524-a721-d73c43a1eed5 req-18fee5df-5a0c-438e-b820-2b3f20e7f405 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:31.454407 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-67ed4c48-f292-4524-a721-d73c43a1eed5 req-18fee5df-5a0c-438e-b820-2b3f20e7f405 service nova] Creating event network-vif-deleted:325c1424-9f41-474a-acfd-70e1e0d68482 for instance a0c9f136-3067-4980-a86b-38687044a2f4 on n-h2-852084-5 Aug 27 03:38:31.460434 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-67ed4c48-f292-4524-a721-d73c43a1eed5 req-18fee5df-5a0c-438e-b820-2b3f20e7f405 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036605 Aug 27 03:38:31.461055 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3589/6994] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:31.648760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:31.649393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:31.656308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:31.656808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:31.657267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:31.658012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:31.658487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:31.658934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:31.690537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:31.691038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:31.691494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:31.691967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lazy-loading 'fault' on Instance uuid a0c9f136-3067-4980-a86b-38687044a2f4 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:38:31.738843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:31.746716 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9db707bc-6e33-4fd6-a628-fd9783f07bfd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 200 len: 1352 microversion: 2.1 time: 0.102467 Aug 27 03:38:31.747288 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3406/6995] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:31 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:32.769161 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:32.769815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: a0c9f136-3067-4980-a86b-38687044a2f4] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:32.776071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:32.776561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:32.777003 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:32.777721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:32.778184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:32.778618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:32.792709 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] HTTP exception thrown: Instance a0c9f136-3067-4980-a86b-38687044a2f4 could not be found. Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Request method failure captured: Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 HTTP/1.1 Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZGPcqzERaHrzDj1iLy76BUgNUcb1o3XPppFazvpgxH7qpvr6R6D7Lh9plFRFbhAYKr7UHq_cGU6UznbGlZaQpogGCI6k01CU1sn-PYjpdFxcAXHmjPP812op0hjf2RYjfj8bWdjAaNP7ah7036dQ9OKXZhq_G-S9iynGvvnZJ3xQLU Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}] Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: de985326903a48f39209053431d18855 Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance a0c9f136-3067-4980-a86b-38687044a2f4 could not be found. Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'a0c9f136-3067-4980-a86b-38687044a2f4'} Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0c9f136-3067-4980-a86b-38687044a2f4 could not be found. Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0c9f136-3067-4980-a86b-38687044a2f4 could not be found. Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:38:32.794442 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:38:32.799225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:38:32.799225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:38:32.799225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:38:32.799225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:38:32.799225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:38:32.799225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0c9f136-3067-4980-a86b-38687044a2f4 could not be found. Aug 27 03:38:32.799225 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:38:32.799225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Returning 404 to user: Instance a0c9f136-3067-4980-a86b-38687044a2f4 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:38:32.799225 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9f526ef3-107d-42b3-b5fd-3a876695dac4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4" status: 404 len: 111 microversion: 2.1 time: 0.031955 Aug 27 03:38:32.799225 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3590/6996] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:32 2022] GET /compute/v2.1/servers/a0c9f136-3067-4980-a86b-38687044a2f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:38:32.806452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-130c8675-ccc8-49b6-9e65-dd9d52974487 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '.version_select at 0x7f4d293c1b80>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:32.830868 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-130c8675-ccc8-49b6-9e65-dd9d52974487 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1634114920" status: 202 len: 0 microversion: 2.1 time: 0.028270 Aug 27 03:38:32.831452 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3407/6997] 10.222.0.99 () {58 vars in 1278 bytes} [Sat Aug 27 03:38:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1634114920 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:38:32.850135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61620971-c011-43ce-9714-e7a03e776d5b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Action: 'create', calling method: .version_select at 0x7f4d28d43670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-366147693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPR1TAaNmqPSuBAXDcoMCl9zPFJt1PA95Xy7kRKA3HxawQllcwKo3kzPx/9VUSkM6/PprPnZU183gV2Qk3JPevY25t9J+xdGpNduMMJblQLk0FFSplla4WV2yIu0UwEgbA=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:32.866393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-61620971-c011-43ce-9714-e7a03e776d5b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:38:32.872371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-61620971-c011-43ce-9714-e7a03e776d5b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for user de985326903a48f39209053431d18855 and project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:38:32.896614 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61620971-c011-43ce-9714-e7a03e776d5b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051025 Aug 27 03:38:32.897228 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3591/6998] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:38:32 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:32.949310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2041072762", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-366147693", "networks": [{"uuid": "bf9312f5-bb22-45ea-ad72-364d0c813341"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:33.003415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] validate_networks() for [('bf9312f5-bb22-45ea-ad72-364d0c813341', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:38:33.463556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:38:33.464000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:38:33.464503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:38:33.464935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:38:33.465387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:38:33.474685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:33.475181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:33.475637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:33.476386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:33.476860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:33.477306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:33.495473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:38:33.500774 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for user de985326903a48f39209053431d18855 and project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:38:33.513779 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:38:33.516133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:38:33.563053 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c72a4215-4cfd-41ab-9c21-bee278a91002 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618434 Aug 27 03:38:33.563712 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3408/6999] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:38:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:38:33.574963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-96c473a5-e8e0-405b-9d08-88982dc812bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:33.575577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-96c473a5-e8e0-405b-9d08-88982dc812bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:33.635649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-96c473a5-e8e0-405b-9d08-88982dc812bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:33.642614 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-96c473a5-e8e0-405b-9d08-88982dc812bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1262 microversion: 2.1 time: 0.071504 Aug 27 03:38:33.643204 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3592/7000] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:33 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:34.665396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a3ef9259-9218-4b14-b9ee-0d0d9eb2a5ba tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:34.666015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a3ef9259-9218-4b14-b9ee-0d0d9eb2a5ba tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:34.676905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3ef9259-9218-4b14-b9ee-0d0d9eb2a5ba tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:34.677419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3ef9259-9218-4b14-b9ee-0d0d9eb2a5ba tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:34.677902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3ef9259-9218-4b14-b9ee-0d0d9eb2a5ba tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:34.678626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3ef9259-9218-4b14-b9ee-0d0d9eb2a5ba tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:34.679267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3ef9259-9218-4b14-b9ee-0d0d9eb2a5ba tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:34.679710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3ef9259-9218-4b14-b9ee-0d0d9eb2a5ba tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:34.759273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a3ef9259-9218-4b14-b9ee-0d0d9eb2a5ba tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:34.768422 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a3ef9259-9218-4b14-b9ee-0d0d9eb2a5ba tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1322 microversion: 2.1 time: 0.107866 Aug 27 03:38:34.769026 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3409/7001] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:34 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1322 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:35.801510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b99ef35c-f2e9-4f96-81ef-ded1aa785681 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:35.802227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b99ef35c-f2e9-4f96-81ef-ded1aa785681 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:35.809913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b99ef35c-f2e9-4f96-81ef-ded1aa785681 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:35.810524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b99ef35c-f2e9-4f96-81ef-ded1aa785681 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:35.811230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b99ef35c-f2e9-4f96-81ef-ded1aa785681 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:35.812010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b99ef35c-f2e9-4f96-81ef-ded1aa785681 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:35.812474 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b99ef35c-f2e9-4f96-81ef-ded1aa785681 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:35.813212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b99ef35c-f2e9-4f96-81ef-ded1aa785681 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:35.967414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b99ef35c-f2e9-4f96-81ef-ded1aa785681 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:35.975872 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b99ef35c-f2e9-4f96-81ef-ded1aa785681 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1362 microversion: 2.1 time: 0.188901 Aug 27 03:38:35.976483 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3593/7002] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:35 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:36.049345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8b61082c-e193-4d5c-8c01-5ac10b3bbbea req-3006fd52-ddb3-402b-8a4d-18330d3c1491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e07b07-f827-4aed-9fd9-9aff51eacf6d", "tag": "53e4d1e1-c49b-49e2-be5c-b8ed1c816ef0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:36.062034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8b61082c-e193-4d5c-8c01-5ac10b3bbbea req-3006fd52-ddb3-402b-8a4d-18330d3c1491 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:36.062667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8b61082c-e193-4d5c-8c01-5ac10b3bbbea req-3006fd52-ddb3-402b-8a4d-18330d3c1491 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:36.063267 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8b61082c-e193-4d5c-8c01-5ac10b3bbbea req-3006fd52-ddb3-402b-8a4d-18330d3c1491 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:36.076890 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8b61082c-e193-4d5c-8c01-5ac10b3bbbea req-3006fd52-ddb3-402b-8a4d-18330d3c1491 service nova] Creating event network-changed:53e4d1e1-c49b-49e2-be5c-b8ed1c816ef0 for instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d on n-h1-852084-5 Aug 27 03:38:36.082747 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8b61082c-e193-4d5c-8c01-5ac10b3bbbea req-3006fd52-ddb3-402b-8a4d-18330d3c1491 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037377 Aug 27 03:38:36.083525 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3410/7003] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:36.998293 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2fa2a21d-3312-4a03-9505-549692c58ae4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:36.998835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2fa2a21d-3312-4a03-9505-549692c58ae4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:37.006445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa2a21d-3312-4a03-9505-549692c58ae4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:37.006936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa2a21d-3312-4a03-9505-549692c58ae4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:37.007379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa2a21d-3312-4a03-9505-549692c58ae4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:37.008078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa2a21d-3312-4a03-9505-549692c58ae4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:37.008540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa2a21d-3312-4a03-9505-549692c58ae4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:37.008971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fa2a21d-3312-4a03-9505-549692c58ae4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:37.138568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2fa2a21d-3312-4a03-9505-549692c58ae4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:37.146724 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2fa2a21d-3312-4a03-9505-549692c58ae4 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1362 microversion: 2.1 time: 0.152516 Aug 27 03:38:37.147623 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3594/7004] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:36 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:38.168569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-171e5269-c43c-4191-91c8-64d5ca1a6c96 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:38.169296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-171e5269-c43c-4191-91c8-64d5ca1a6c96 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:38.175669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171e5269-c43c-4191-91c8-64d5ca1a6c96 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:38.176173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171e5269-c43c-4191-91c8-64d5ca1a6c96 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:38.176633 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171e5269-c43c-4191-91c8-64d5ca1a6c96 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:38.177347 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171e5269-c43c-4191-91c8-64d5ca1a6c96 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:38.177858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171e5269-c43c-4191-91c8-64d5ca1a6c96 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:38.178310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-171e5269-c43c-4191-91c8-64d5ca1a6c96 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:38.306797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-171e5269-c43c-4191-91c8-64d5ca1a6c96 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:38.314556 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-171e5269-c43c-4191-91c8-64d5ca1a6c96 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1362 microversion: 2.1 time: 0.151248 Aug 27 03:38:38.315137 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3411/7005] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:38 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:39.336558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c8cbf87f-40e6-4f1c-ad6d-480f65583745 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:39.337267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c8cbf87f-40e6-4f1c-ad6d-480f65583745 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:39.344919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8cbf87f-40e6-4f1c-ad6d-480f65583745 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:39.345422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8cbf87f-40e6-4f1c-ad6d-480f65583745 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:39.345901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8cbf87f-40e6-4f1c-ad6d-480f65583745 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:39.346666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8cbf87f-40e6-4f1c-ad6d-480f65583745 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:39.347151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8cbf87f-40e6-4f1c-ad6d-480f65583745 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:39.347591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c8cbf87f-40e6-4f1c-ad6d-480f65583745 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:39.501738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c8cbf87f-40e6-4f1c-ad6d-480f65583745 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:39.510192 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c8cbf87f-40e6-4f1c-ad6d-480f65583745 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1362 microversion: 2.1 time: 0.178064 Aug 27 03:38:39.510741 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3595/7006] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:39 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:40.531730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-613c056b-900a-4420-858f-ae20cc5af8bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:40.532366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-613c056b-900a-4420-858f-ae20cc5af8bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:40.540081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-613c056b-900a-4420-858f-ae20cc5af8bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:40.540587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-613c056b-900a-4420-858f-ae20cc5af8bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:40.541047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-613c056b-900a-4420-858f-ae20cc5af8bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:40.541780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-613c056b-900a-4420-858f-ae20cc5af8bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:40.542258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-613c056b-900a-4420-858f-ae20cc5af8bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:40.542705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-613c056b-900a-4420-858f-ae20cc5af8bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:40.674348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-613c056b-900a-4420-858f-ae20cc5af8bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:40.682149 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-613c056b-900a-4420-858f-ae20cc5af8bc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1362 microversion: 2.1 time: 0.154372 Aug 27 03:38:40.682729 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3412/7007] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:40 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:41.435102 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-5b7e82cd-4992-4019-b69a-31dd7dd87987 req-9ec6f74d-7a99-47db-9f14-f795769f3ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e07b07-f827-4aed-9fd9-9aff51eacf6d", "name": "network-vif-plugged", "status": "completed", "tag": "53e4d1e1-c49b-49e2-be5c-b8ed1c816ef0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:41.446573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5b7e82cd-4992-4019-b69a-31dd7dd87987 req-9ec6f74d-7a99-47db-9f14-f795769f3ad5 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:41.448113 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5b7e82cd-4992-4019-b69a-31dd7dd87987 req-9ec6f74d-7a99-47db-9f14-f795769f3ad5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:41.448560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5b7e82cd-4992-4019-b69a-31dd7dd87987 req-9ec6f74d-7a99-47db-9f14-f795769f3ad5 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:41.461032 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-5b7e82cd-4992-4019-b69a-31dd7dd87987 req-9ec6f74d-7a99-47db-9f14-f795769f3ad5 service nova] Creating event network-vif-plugged:53e4d1e1-c49b-49e2-be5c-b8ed1c816ef0 for instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d on n-h1-852084-5 Aug 27 03:38:41.466568 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-5b7e82cd-4992-4019-b69a-31dd7dd87987 req-9ec6f74d-7a99-47db-9f14-f795769f3ad5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035153 Aug 27 03:38:41.467189 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3596/7008] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:41.703078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fbc5e2ae-a841-4374-8da9-bd8d976a7edb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:41.703707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fbc5e2ae-a841-4374-8da9-bd8d976a7edb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:41.710725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc5e2ae-a841-4374-8da9-bd8d976a7edb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:41.711226 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc5e2ae-a841-4374-8da9-bd8d976a7edb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:41.711679 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc5e2ae-a841-4374-8da9-bd8d976a7edb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:41.712394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc5e2ae-a841-4374-8da9-bd8d976a7edb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:41.712867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc5e2ae-a841-4374-8da9-bd8d976a7edb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:41.713309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fbc5e2ae-a841-4374-8da9-bd8d976a7edb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:41.844541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fbc5e2ae-a841-4374-8da9-bd8d976a7edb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:41.852898 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fbc5e2ae-a841-4374-8da9-bd8d976a7edb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1362 microversion: 2.1 time: 0.153847 Aug 27 03:38:41.853481 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3413/7009] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:41 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:42.874502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dc1c9db1-0e90-4220-9427-809a204b19f0 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:42.875230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dc1c9db1-0e90-4220-9427-809a204b19f0 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:42.883064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc1c9db1-0e90-4220-9427-809a204b19f0 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:42.883530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc1c9db1-0e90-4220-9427-809a204b19f0 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:42.883968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc1c9db1-0e90-4220-9427-809a204b19f0 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:42.884661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc1c9db1-0e90-4220-9427-809a204b19f0 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:42.885112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc1c9db1-0e90-4220-9427-809a204b19f0 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:42.885532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc1c9db1-0e90-4220-9427-809a204b19f0 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:43.021827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dc1c9db1-0e90-4220-9427-809a204b19f0 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:43.029652 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dc1c9db1-0e90-4220-9427-809a204b19f0 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1554 microversion: 2.1 time: 0.159377 Aug 27 03:38:43.030251 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3597/7010] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:42 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:43.050152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6b74cb21-fa45-40d7-a085-9487323afd66 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:43.051294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6b74cb21-fa45-40d7-a085-9487323afd66 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:43.058304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b74cb21-fa45-40d7-a085-9487323afd66 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:43.058800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b74cb21-fa45-40d7-a085-9487323afd66 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:43.059253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b74cb21-fa45-40d7-a085-9487323afd66 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:43.059960 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b74cb21-fa45-40d7-a085-9487323afd66 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:43.060406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b74cb21-fa45-40d7-a085-9487323afd66 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:43.060846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6b74cb21-fa45-40d7-a085-9487323afd66 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:43.189268 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6b74cb21-fa45-40d7-a085-9487323afd66 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:38:43.197134 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6b74cb21-fa45-40d7-a085-9487323afd66 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1554 microversion: 2.1 time: 0.150910 Aug 27 03:38:43.197766 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3414/7011] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:38:43 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:38:44.684341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c6e8b2bc-919d-4468-ae74-333c234a914c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:38:44.686726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c6e8b2bc-919d-4468-ae74-333c234a914c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:44.688700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:44.694722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e8b2bc-919d-4468-ae74-333c234a914c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:44.695202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e8b2bc-919d-4468-ae74-333c234a914c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:44.695657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e8b2bc-919d-4468-ae74-333c234a914c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:44.696322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e8b2bc-919d-4468-ae74-333c234a914c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:44.696778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e8b2bc-919d-4468-ae74-333c234a914c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:44.697201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c6e8b2bc-919d-4468-ae74-333c234a914c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:44.967416 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c6e8b2bc-919d-4468-ae74-333c234a914c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "POST /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286835 Aug 27 03:38:44.968143 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3598/7012] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:38:44 2022] POST /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:55.851677 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-443a10eb-d58d-428c-9325-cf551033cc70 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:55.852198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-443a10eb-d58d-428c-9325-cf551033cc70 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:55.854191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:55.854997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:55.856448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:55.857172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:55.864484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-443a10eb-d58d-428c-9325-cf551033cc70 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:55.865032 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-443a10eb-d58d-428c-9325-cf551033cc70 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:55.865497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-443a10eb-d58d-428c-9325-cf551033cc70 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:55.866264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-443a10eb-d58d-428c-9325-cf551033cc70 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:55.866722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-443a10eb-d58d-428c-9325-cf551033cc70 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:55.867165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-443a10eb-d58d-428c-9325-cf551033cc70 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:55.954694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-443a10eb-d58d-428c-9325-cf551033cc70 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lazy-loading 'services' on Instance uuid d7e07b07-f827-4aed-9fd9-9aff51eacf6d {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:38:56.024818 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-443a10eb-d58d-428c-9325-cf551033cc70 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments/0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5" status: 202 len: 0 microversion: 2.1 time: 0.177590 Aug 27 03:38:56.025451 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3415/7013] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:38:55 2022] DELETE /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments/0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:38:56.032094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:56.033391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:38:56.038250 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-302c4337-c336-4853-9750-97bb7e054670 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:56.040628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-302c4337-c336-4853-9750-97bb7e054670 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:56.050045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-302c4337-c336-4853-9750-97bb7e054670 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:56.050544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-302c4337-c336-4853-9750-97bb7e054670 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:56.050993 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-302c4337-c336-4853-9750-97bb7e054670 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:56.051709 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-302c4337-c336-4853-9750-97bb7e054670 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:56.052175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-302c4337-c336-4853-9750-97bb7e054670 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:56.052611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-302c4337-c336-4853-9750-97bb7e054670 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:56.090876 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-302c4337-c336-4853-9750-97bb7e054670 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060379 Aug 27 03:38:56.091550 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3599/7014] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:56 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:57.105721 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b8249d6a-cce8-4f5c-8ee6-466d6e58e230 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:57.108229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b8249d6a-cce8-4f5c-8ee6-466d6e58e230 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:57.115045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8249d6a-cce8-4f5c-8ee6-466d6e58e230 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:57.115632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8249d6a-cce8-4f5c-8ee6-466d6e58e230 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:57.116155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8249d6a-cce8-4f5c-8ee6-466d6e58e230 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:57.116938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8249d6a-cce8-4f5c-8ee6-466d6e58e230 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:57.117635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8249d6a-cce8-4f5c-8ee6-466d6e58e230 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:57.118082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b8249d6a-cce8-4f5c-8ee6-466d6e58e230 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:57.149989 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b8249d6a-cce8-4f5c-8ee6-466d6e58e230 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049939 Aug 27 03:38:57.150560 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3416/7015] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:57 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:38:58.163251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8831ee2e-6468-48a7-9994-7c57c091af3f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:58.165519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8831ee2e-6468-48a7-9994-7c57c091af3f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:58.173069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8831ee2e-6468-48a7-9994-7c57c091af3f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:58.173565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8831ee2e-6468-48a7-9994-7c57c091af3f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:58.174123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8831ee2e-6468-48a7-9994-7c57c091af3f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:58.174841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8831ee2e-6468-48a7-9994-7c57c091af3f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:58.175306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8831ee2e-6468-48a7-9994-7c57c091af3f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:58.175746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8831ee2e-6468-48a7-9994-7c57c091af3f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:58.207752 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8831ee2e-6468-48a7-9994-7c57c091af3f tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049087 Aug 27 03:38:58.208333 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3600/7016] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:58 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:38:59.220392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bcd6c045-8713-4526-b096-1cacc568d21c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:38:59.222619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bcd6c045-8713-4526-b096-1cacc568d21c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:38:59.229939 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcd6c045-8713-4526-b096-1cacc568d21c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:59.230462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcd6c045-8713-4526-b096-1cacc568d21c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:59.230888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcd6c045-8713-4526-b096-1cacc568d21c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:59.231606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcd6c045-8713-4526-b096-1cacc568d21c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:38:59.232076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcd6c045-8713-4526-b096-1cacc568d21c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:38:59.232513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bcd6c045-8713-4526-b096-1cacc568d21c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:38:59.264788 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bcd6c045-8713-4526-b096-1cacc568d21c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048478 Aug 27 03:38:59.265369 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3417/7017] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:38:59 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:00.277187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1095eeaa-102a-4f43-906c-f8fcfe835a1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:00.279433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1095eeaa-102a-4f43-906c-f8fcfe835a1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:00.287120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1095eeaa-102a-4f43-906c-f8fcfe835a1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:00.287608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1095eeaa-102a-4f43-906c-f8fcfe835a1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:00.288051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1095eeaa-102a-4f43-906c-f8fcfe835a1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:00.288757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1095eeaa-102a-4f43-906c-f8fcfe835a1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:00.289220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1095eeaa-102a-4f43-906c-f8fcfe835a1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:00.289647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1095eeaa-102a-4f43-906c-f8fcfe835a1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:00.323750 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1095eeaa-102a-4f43-906c-f8fcfe835a1e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050478 Aug 27 03:39:00.324356 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3601/7018] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:39:00 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:01.336278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-02f037d7-5fc2-4c7a-a282-cfef6161b031 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:01.338443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-02f037d7-5fc2-4c7a-a282-cfef6161b031 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:01.345875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f037d7-5fc2-4c7a-a282-cfef6161b031 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:01.346384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f037d7-5fc2-4c7a-a282-cfef6161b031 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:01.346845 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f037d7-5fc2-4c7a-a282-cfef6161b031 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:01.347563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f037d7-5fc2-4c7a-a282-cfef6161b031 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:01.348533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f037d7-5fc2-4c7a-a282-cfef6161b031 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:01.348981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f037d7-5fc2-4c7a-a282-cfef6161b031 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:01.379553 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-02f037d7-5fc2-4c7a-a282-cfef6161b031 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047238 Aug 27 03:39:01.380786 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3418/7019] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:39:01 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:39:01.390899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:01.391669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:01.398912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:01.399689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:01.400147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:01.400890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:01.401352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:01.401842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:01.478371 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] HTTP exception thrown: Instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d is not attached to volume 0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5 Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Request method failure captured: Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments/0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5 HTTP/1.1 Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZGPcqzERaHrzDj1iLy76BUgNUcb1o3XPppFazvpgxH7qpvr6R6D7Lh9plFRFbhAYKr7UHq_cGU6UznbGlZaQpogGCI6k01CU1sn-PYjpdFxcAXHmjPP812op0hjf2RYjfj8bWdjAaNP7ah7036dQ9OKXZhq_G-S9iynGvvnZJ3xQLU Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}] Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: de985326903a48f39209053431d18855 Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d is not attached to volume 0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5 Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'server_id': 'd7e07b07-f827-4aed-9fd9-9aff51eacf6d', 'id': '0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5'} Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5. Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d is not attached to volume 0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5 Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:01.480004 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:01.484603 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:39:01.484603 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:39:01.484603 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d is not attached to volume 0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5 Aug 27 03:39:01.484603 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:01.484603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Returning 404 to user: Instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d is not attached to volume 0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5 {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:39:01.484603 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3ff84a40-9e84-41b7-b44e-3a1a0d2e45f2 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments/0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5" status: 404 len: 154 microversion: 2.1 time: 0.094622 Aug 27 03:39:01.484603 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3602/7020] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:39:01 2022] DELETE /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d/os-volume_attachments/0e8380e3-1fe2-4fb3-9be1-668ad6dc74d5 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:04.845143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4ce711bc-c1bf-4f05-8d1b-04052d59f0ec tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:04.845772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4ce711bc-c1bf-4f05-8d1b-04052d59f0ec tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:04.853650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ce711bc-c1bf-4f05-8d1b-04052d59f0ec tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:04.854195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ce711bc-c1bf-4f05-8d1b-04052d59f0ec tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:04.854763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ce711bc-c1bf-4f05-8d1b-04052d59f0ec tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:04.855391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ce711bc-c1bf-4f05-8d1b-04052d59f0ec tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:04.855868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ce711bc-c1bf-4f05-8d1b-04052d59f0ec tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:04.856318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4ce711bc-c1bf-4f05-8d1b-04052d59f0ec tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:04.884516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4ce711bc-c1bf-4f05-8d1b-04052d59f0ec tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:39:04.974846 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4ce711bc-c1bf-4f05-8d1b-04052d59f0ec tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 204 len: 0 microversion: 2.1 time: 0.133272 Aug 27 03:39:04.975476 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3419/7021] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:39:04 2022] DELETE /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:39:04.984917 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b2cba9b6-a7d8-4593-b84e-63864aa4ae01 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:04.985546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b2cba9b6-a7d8-4593-b84e-63864aa4ae01 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:04.993345 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2cba9b6-a7d8-4593-b84e-63864aa4ae01 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:04.993875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2cba9b6-a7d8-4593-b84e-63864aa4ae01 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:04.994328 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2cba9b6-a7d8-4593-b84e-63864aa4ae01 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:04.995043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2cba9b6-a7d8-4593-b84e-63864aa4ae01 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:04.995505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2cba9b6-a7d8-4593-b84e-63864aa4ae01 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:04.995941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2cba9b6-a7d8-4593-b84e-63864aa4ae01 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:05.369032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b2cba9b6-a7d8-4593-b84e-63864aa4ae01 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:05.376935 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b2cba9b6-a7d8-4593-b84e-63864aa4ae01 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1560 microversion: 2.1 time: 0.396325 Aug 27 03:39:05.377507 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3603/7022] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:04 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1560 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:06.400693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0474de83-f00e-406c-ae8b-8faeb7a977c9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:06.401423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0474de83-f00e-406c-ae8b-8faeb7a977c9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:06.407663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0474de83-f00e-406c-ae8b-8faeb7a977c9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:06.408156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0474de83-f00e-406c-ae8b-8faeb7a977c9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:06.408613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0474de83-f00e-406c-ae8b-8faeb7a977c9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:06.409321 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0474de83-f00e-406c-ae8b-8faeb7a977c9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:06.409825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0474de83-f00e-406c-ae8b-8faeb7a977c9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:06.410269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0474de83-f00e-406c-ae8b-8faeb7a977c9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:06.543672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0474de83-f00e-406c-ae8b-8faeb7a977c9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:06.551671 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0474de83-f00e-406c-ae8b-8faeb7a977c9 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1560 microversion: 2.1 time: 0.156203 Aug 27 03:39:06.552274 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3420/7023] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:06 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:39:07.152141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-5c2e5ce4-1bf9-4947-a9ba-9a295540355b req-11dc6638-66ad-41ae-8040-efc96a62f012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e07b07-f827-4aed-9fd9-9aff51eacf6d", "name": "network-vif-deleted", "tag": "53e4d1e1-c49b-49e2-be5c-b8ed1c816ef0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:07.164363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5c2e5ce4-1bf9-4947-a9ba-9a295540355b req-11dc6638-66ad-41ae-8040-efc96a62f012 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:07.164926 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5c2e5ce4-1bf9-4947-a9ba-9a295540355b req-11dc6638-66ad-41ae-8040-efc96a62f012 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:07.165440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-5c2e5ce4-1bf9-4947-a9ba-9a295540355b req-11dc6638-66ad-41ae-8040-efc96a62f012 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:07.179437 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-5c2e5ce4-1bf9-4947-a9ba-9a295540355b req-11dc6638-66ad-41ae-8040-efc96a62f012 service nova] Creating event network-vif-deleted:53e4d1e1-c49b-49e2-be5c-b8ed1c816ef0 for instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d on n-h1-852084-5 Aug 27 03:39:07.185281 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-5c2e5ce4-1bf9-4947-a9ba-9a295540355b req-11dc6638-66ad-41ae-8040-efc96a62f012 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036830 Aug 27 03:39:07.186577 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3604/7024] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:07.572495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:07.573130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:07.580191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:07.580627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:07.581080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:07.581841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:07.582346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:07.583430 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:07.618716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:07.619210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:07.619664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:07.620132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lazy-loading 'fault' on Instance uuid d7e07b07-f827-4aed-9fd9-9aff51eacf6d {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:39:07.666386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:07.674283 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7cf04fb6-e77d-4194-97f4-d864b5e65757 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 200 len: 1352 microversion: 2.1 time: 0.105711 Aug 27 03:39:07.674866 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3421/7025] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:07 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:08.697410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:08.698108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: d7e07b07-f827-4aed-9fd9-9aff51eacf6d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:08.704344 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:08.704828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:08.705267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:08.705991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:08.706450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:08.706878 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:08.720570 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] HTTP exception thrown: Instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d could not be found. Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Request method failure captured: Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d HTTP/1.1 Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZGPcqzERaHrzDj1iLy76BUgNUcb1o3XPppFazvpgxH7qpvr6R6D7Lh9plFRFbhAYKr7UHq_cGU6UznbGlZaQpogGCI6k01CU1sn-PYjpdFxcAXHmjPP812op0hjf2RYjfj8bWdjAaNP7ah7036dQ9OKXZhq_G-S9iynGvvnZJ3xQLU Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}] Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: de985326903a48f39209053431d18855 Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d could not be found. Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd7e07b07-f827-4aed-9fd9-9aff51eacf6d'} Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d could not be found. Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d could not be found. Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:08.722253 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:08.726920 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:08.726920 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:08.726920 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:08.726920 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:39:08.726920 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:39:08.726920 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d could not be found. Aug 27 03:39:08.726920 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:08.726920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Returning 404 to user: Instance d7e07b07-f827-4aed-9fd9-9aff51eacf6d could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:39:08.726920 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-52e2d122-c155-4557-a00a-108d9d4c2405 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d" status: 404 len: 111 microversion: 2.1 time: 0.032101 Aug 27 03:39:08.726920 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3605/7026] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:08 2022] GET /compute/v2.1/servers/d7e07b07-f827-4aed-9fd9-9aff51eacf6d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:08.733305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8625e07e-c2ff-4c7b-ac70-074b242137dd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '.version_select at 0x7f4d2e708430>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:08.753938 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8625e07e-c2ff-4c7b-ac70-074b242137dd tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-366147693" status: 202 len: 0 microversion: 2.1 time: 0.024441 Aug 27 03:39:08.754519 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3422/7027] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 03:39:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-366147693 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:08.771665 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4aacb601-e86f-46a9-b70c-9543c7baf9b3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Action: 'create', calling method: .version_select at 0x7f4d2a6e19d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-729131760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5x1PvkuUD+ppWRAzxs4fGe5/ayl/r4NGnNPU07BZ3pMBx2GFa8KF1SEFNL7hacB70A5/ZGzPbfKzSWQvF1WSNmG/+xpy4j09X3ADcT3lc2+5tkWHDjxjrBOVThka8k8w=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:08.787734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4aacb601-e86f-46a9-b70c-9543c7baf9b3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:39:08.795551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-4aacb601-e86f-46a9-b70c-9543c7baf9b3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for user de985326903a48f39209053431d18855 and project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:39:08.819110 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4aacb601-e86f-46a9-b70c-9543c7baf9b3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051350 Aug 27 03:39:08.819727 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3606/7028] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:39:08 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:08.869201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1662069988", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-729131760", "networks": [{"uuid": "bf9312f5-bb22-45ea-ad72-364d0c813341"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:08.922747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] validate_networks() for [('bf9312f5-bb22-45ea-ad72-364d0c813341', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:39:09.593707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:39:09.594154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:39:09.594647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:39:09.595127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:39:09.595588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:39:09.604541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:09.605041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:09.605502 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:09.606291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:09.606765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:09.607211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:09.623827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:39:09.629193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Getting quotas for user de985326903a48f39209053431d18855 and project 4fa7e44a1e5b472ab7d1654f4327ab3a. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:39:09.642130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:39:09.644421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:39:09.691123 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-50a5f54b-db29-4973-a5ba-f4d080b4437b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825912 Aug 27 03:39:09.692492 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3423/7029] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:39:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:39:09.704235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b8c7cca9-1065-4b4e-b8d4-ef7dc7a1c94c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:09.704908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b8c7cca9-1065-4b4e-b8d4-ef7dc7a1c94c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:09.760217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b8c7cca9-1065-4b4e-b8d4-ef7dc7a1c94c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:09.767197 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b8c7cca9-1065-4b4e-b8d4-ef7dc7a1c94c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1262 microversion: 2.1 time: 0.067728 Aug 27 03:39:09.767770 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3607/7030] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:09 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:10.791619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bfd18ee4-2441-4f29-8eed-a2c80e83ae76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:10.792401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bfd18ee4-2441-4f29-8eed-a2c80e83ae76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:10.802262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee4-2441-4f29-8eed-a2c80e83ae76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:10.802910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee4-2441-4f29-8eed-a2c80e83ae76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:10.803505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee4-2441-4f29-8eed-a2c80e83ae76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:10.804376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee4-2441-4f29-8eed-a2c80e83ae76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:10.805088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee4-2441-4f29-8eed-a2c80e83ae76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:10.805626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bfd18ee4-2441-4f29-8eed-a2c80e83ae76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:10.880377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bfd18ee4-2441-4f29-8eed-a2c80e83ae76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:10.888546 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bfd18ee4-2441-4f29-8eed-a2c80e83ae76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1332 microversion: 2.1 time: 0.104302 Aug 27 03:39:10.889132 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3424/7031] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:10 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:11.911155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-12c9bb37-33f7-482d-8358-7d7aa3ecc51e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:11.911907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-12c9bb37-33f7-482d-8358-7d7aa3ecc51e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:11.919895 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c9bb37-33f7-482d-8358-7d7aa3ecc51e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.920396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c9bb37-33f7-482d-8358-7d7aa3ecc51e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.920844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c9bb37-33f7-482d-8358-7d7aa3ecc51e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:11.921552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c9bb37-33f7-482d-8358-7d7aa3ecc51e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:11.922042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c9bb37-33f7-482d-8358-7d7aa3ecc51e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:11.922607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12c9bb37-33f7-482d-8358-7d7aa3ecc51e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:12.078760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-53ba73b1-32a3-4e49-958e-4b9d8b7f9f30 req-4549fee1-6f26-4745-b491-f97a3e883e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38e571e3-ccaa-4ef5-9e19-76afef1f900f", "tag": "d19d3491-b05b-4a31-af72-34d6642a04a3"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:12.091052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-53ba73b1-32a3-4e49-958e-4b9d8b7f9f30 req-4549fee1-6f26-4745-b491-f97a3e883e0d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:12.091808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-53ba73b1-32a3-4e49-958e-4b9d8b7f9f30 req-4549fee1-6f26-4745-b491-f97a3e883e0d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:12.092409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-53ba73b1-32a3-4e49-958e-4b9d8b7f9f30 req-4549fee1-6f26-4745-b491-f97a3e883e0d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:12.107089 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-53ba73b1-32a3-4e49-958e-4b9d8b7f9f30 req-4549fee1-6f26-4745-b491-f97a3e883e0d service nova] Creating event network-changed:d19d3491-b05b-4a31-af72-34d6642a04a3 for instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f on n-h2-852084-5 Aug 27 03:39:12.114665 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-53ba73b1-32a3-4e49-958e-4b9d8b7f9f30 req-4549fee1-6f26-4745-b491-f97a3e883e0d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038756 Aug 27 03:39:12.115912 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3425/7032] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:39:12.170790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-12c9bb37-33f7-482d-8358-7d7aa3ecc51e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:12.178522 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-12c9bb37-33f7-482d-8358-7d7aa3ecc51e tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1362 microversion: 2.1 time: 0.271964 Aug 27 03:39:12.179127 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3608/7033] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:11 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:13.201007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1728c284-b1b3-4503-8230-cde23f8b471c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:13.201780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1728c284-b1b3-4503-8230-cde23f8b471c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:13.208147 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1728c284-b1b3-4503-8230-cde23f8b471c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:13.208641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1728c284-b1b3-4503-8230-cde23f8b471c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:13.209097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1728c284-b1b3-4503-8230-cde23f8b471c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:13.209841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1728c284-b1b3-4503-8230-cde23f8b471c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:13.210315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1728c284-b1b3-4503-8230-cde23f8b471c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:13.210757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1728c284-b1b3-4503-8230-cde23f8b471c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:13.343514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1728c284-b1b3-4503-8230-cde23f8b471c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:13.352319 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1728c284-b1b3-4503-8230-cde23f8b471c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1362 microversion: 2.1 time: 0.156373 Aug 27 03:39:13.352954 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3426/7034] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:13 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:14.373582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-14cb8c7a-0b0e-4a3b-b747-9049ec3c184d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:14.374233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-14cb8c7a-0b0e-4a3b-b747-9049ec3c184d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:14.382163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14cb8c7a-0b0e-4a3b-b747-9049ec3c184d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:14.382654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14cb8c7a-0b0e-4a3b-b747-9049ec3c184d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:14.383098 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14cb8c7a-0b0e-4a3b-b747-9049ec3c184d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:14.383802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14cb8c7a-0b0e-4a3b-b747-9049ec3c184d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:14.384263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14cb8c7a-0b0e-4a3b-b747-9049ec3c184d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:14.384696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-14cb8c7a-0b0e-4a3b-b747-9049ec3c184d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:14.513537 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-14cb8c7a-0b0e-4a3b-b747-9049ec3c184d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:14.521335 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-14cb8c7a-0b0e-4a3b-b747-9049ec3c184d tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1362 microversion: 2.1 time: 0.151722 Aug 27 03:39:14.522076 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3609/7035] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:14 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:15.542488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf5663a1-a0ba-41e8-9b27-47bc54d3760b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:15.543121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf5663a1-a0ba-41e8-9b27-47bc54d3760b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:15.550538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5663a1-a0ba-41e8-9b27-47bc54d3760b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:15.551035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5663a1-a0ba-41e8-9b27-47bc54d3760b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:15.551488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5663a1-a0ba-41e8-9b27-47bc54d3760b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:15.552192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5663a1-a0ba-41e8-9b27-47bc54d3760b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:15.552655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5663a1-a0ba-41e8-9b27-47bc54d3760b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:15.553092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf5663a1-a0ba-41e8-9b27-47bc54d3760b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:15.687657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf5663a1-a0ba-41e8-9b27-47bc54d3760b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:15.699923 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf5663a1-a0ba-41e8-9b27-47bc54d3760b tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1362 microversion: 2.1 time: 0.161351 Aug 27 03:39:15.700785 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3427/7036] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:15 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:16.722295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-033bdac8-fc34-4790-888a-95ca19a37e15 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:16.722968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-033bdac8-fc34-4790-888a-95ca19a37e15 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:16.730898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033bdac8-fc34-4790-888a-95ca19a37e15 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:16.731391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033bdac8-fc34-4790-888a-95ca19a37e15 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:16.731847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033bdac8-fc34-4790-888a-95ca19a37e15 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:16.732556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033bdac8-fc34-4790-888a-95ca19a37e15 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:16.733019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033bdac8-fc34-4790-888a-95ca19a37e15 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:16.733457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-033bdac8-fc34-4790-888a-95ca19a37e15 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:16.866290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-033bdac8-fc34-4790-888a-95ca19a37e15 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:16.874059 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-033bdac8-fc34-4790-888a-95ca19a37e15 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1362 microversion: 2.1 time: 0.155676 Aug 27 03:39:16.874637 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3610/7037] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:16 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:17.894705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c21ec018-dfc3-4eef-ae9d-0644e03b8139 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:17.895339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c21ec018-dfc3-4eef-ae9d-0644e03b8139 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:17.902434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21ec018-dfc3-4eef-ae9d-0644e03b8139 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:17.902949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21ec018-dfc3-4eef-ae9d-0644e03b8139 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:17.903409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21ec018-dfc3-4eef-ae9d-0644e03b8139 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:17.904122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21ec018-dfc3-4eef-ae9d-0644e03b8139 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:17.904596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21ec018-dfc3-4eef-ae9d-0644e03b8139 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:17.905044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c21ec018-dfc3-4eef-ae9d-0644e03b8139 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:18.033984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c21ec018-dfc3-4eef-ae9d-0644e03b8139 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:18.042512 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c21ec018-dfc3-4eef-ae9d-0644e03b8139 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1362 microversion: 2.1 time: 0.151700 Aug 27 03:39:18.043104 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3428/7038] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:17 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:18.238632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-a93ddb3c-0cbb-4cbc-9dd8-734c45879fa8 req-7f86e3a6-fde9-442f-8fcb-c095f22bcd42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e571e3-ccaa-4ef5-9e19-76afef1f900f", "name": "network-vif-plugged", "status": "completed", "tag": "d19d3491-b05b-4a31-af72-34d6642a04a3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:18.249455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a93ddb3c-0cbb-4cbc-9dd8-734c45879fa8 req-7f86e3a6-fde9-442f-8fcb-c095f22bcd42 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:18.250013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a93ddb3c-0cbb-4cbc-9dd8-734c45879fa8 req-7f86e3a6-fde9-442f-8fcb-c095f22bcd42 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:18.250455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-a93ddb3c-0cbb-4cbc-9dd8-734c45879fa8 req-7f86e3a6-fde9-442f-8fcb-c095f22bcd42 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:18.262073 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-a93ddb3c-0cbb-4cbc-9dd8-734c45879fa8 req-7f86e3a6-fde9-442f-8fcb-c095f22bcd42 service nova] Creating event network-vif-plugged:d19d3491-b05b-4a31-af72-34d6642a04a3 for instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f on n-h2-852084-5 Aug 27 03:39:18.267069 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-a93ddb3c-0cbb-4cbc-9dd8-734c45879fa8 req-7f86e3a6-fde9-442f-8fcb-c095f22bcd42 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032243 Aug 27 03:39:18.267819 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3611/7039] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:19.063531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-83f776e7-229d-4d9b-85d4-650446755687 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:19.064168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-83f776e7-229d-4d9b-85d4-650446755687 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:19.071817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83f776e7-229d-4d9b-85d4-650446755687 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:19.072320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83f776e7-229d-4d9b-85d4-650446755687 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:19.072775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83f776e7-229d-4d9b-85d4-650446755687 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:19.073488 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83f776e7-229d-4d9b-85d4-650446755687 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:19.073989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83f776e7-229d-4d9b-85d4-650446755687 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:19.074434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83f776e7-229d-4d9b-85d4-650446755687 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:19.214133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-83f776e7-229d-4d9b-85d4-650446755687 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:19.222687 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-83f776e7-229d-4d9b-85d4-650446755687 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1362 microversion: 2.1 time: 0.163109 Aug 27 03:39:19.223819 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3429/7040] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:19 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:20.242998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:20.248177 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c28632c-5722-4f12-8364-6421fa65d882 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:20.248903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4c28632c-5722-4f12-8364-6421fa65d882 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:20.256300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c28632c-5722-4f12-8364-6421fa65d882 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:20.256788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c28632c-5722-4f12-8364-6421fa65d882 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:20.257235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c28632c-5722-4f12-8364-6421fa65d882 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:20.257980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c28632c-5722-4f12-8364-6421fa65d882 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:20.258446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c28632c-5722-4f12-8364-6421fa65d882 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:20.258876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c28632c-5722-4f12-8364-6421fa65d882 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:20.408605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4c28632c-5722-4f12-8364-6421fa65d882 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:20.416457 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4c28632c-5722-4f12-8364-6421fa65d882 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1555 microversion: 2.1 time: 0.175299 Aug 27 03:39:20.417042 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3612/7041] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:20 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:20.437913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d0ea3c01-7f3d-4329-b924-88e047059747 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:20.438549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d0ea3c01-7f3d-4329-b924-88e047059747 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:20.440611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:20.441320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:20.449635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0ea3c01-7f3d-4329-b924-88e047059747 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:20.450166 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0ea3c01-7f3d-4329-b924-88e047059747 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:20.450618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0ea3c01-7f3d-4329-b924-88e047059747 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:20.451338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0ea3c01-7f3d-4329-b924-88e047059747 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:20.451812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0ea3c01-7f3d-4329-b924-88e047059747 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:20.452259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d0ea3c01-7f3d-4329-b924-88e047059747 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:20.583831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d0ea3c01-7f3d-4329-b924-88e047059747 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:20.591967 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d0ea3c01-7f3d-4329-b924-88e047059747 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1555 microversion: 2.1 time: 0.158103 Aug 27 03:39:20.592549 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3430/7042] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:20 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:22.079699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6b71cb14-c5e5-4e96-9925-64f6036cb3cb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "553a1b63-47cb-4e81-8b19-1ad0d2af6a21"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:22.082096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6b71cb14-c5e5-4e96-9925-64f6036cb3cb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:22.089228 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b71cb14-c5e5-4e96-9925-64f6036cb3cb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:22.089742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b71cb14-c5e5-4e96-9925-64f6036cb3cb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:22.090188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b71cb14-c5e5-4e96-9925-64f6036cb3cb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:22.091165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b71cb14-c5e5-4e96-9925-64f6036cb3cb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:22.091624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b71cb14-c5e5-4e96-9925-64f6036cb3cb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:22.092056 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6b71cb14-c5e5-4e96-9925-64f6036cb3cb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:22.500630 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6b71cb14-c5e5-4e96-9925-64f6036cb3cb tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "POST /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424911 Aug 27 03:39:22.501471 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3613/7043] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:39:22 2022] POST /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:33.268287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a3d41ba8-aace-4b7d-ba26-e87c66cef860 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:33.268894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a3d41ba8-aace-4b7d-ba26-e87c66cef860 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:33.272259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:33.273085 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:33.280953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d41ba8-aace-4b7d-ba26-e87c66cef860 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:33.281496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d41ba8-aace-4b7d-ba26-e87c66cef860 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:33.281989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d41ba8-aace-4b7d-ba26-e87c66cef860 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:33.282855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d41ba8-aace-4b7d-ba26-e87c66cef860 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:33.283196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d41ba8-aace-4b7d-ba26-e87c66cef860 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:33.283647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a3d41ba8-aace-4b7d-ba26-e87c66cef860 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:33.379069 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-a3d41ba8-aace-4b7d-ba26-e87c66cef860 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lazy-loading 'services' on Instance uuid 38e571e3-ccaa-4ef5-9e19-76afef1f900f {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:39:33.461418 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a3d41ba8-aace-4b7d-ba26-e87c66cef860 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments/553a1b63-47cb-4e81-8b19-1ad0d2af6a21" status: 202 len: 0 microversion: 2.1 time: 0.197292 Aug 27 03:39:33.462057 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3431/7044] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:39:33 2022] DELETE /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments/553a1b63-47cb-4e81-8b19-1ad0d2af6a21 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:39:33.471638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d989d628-1d90-44a9-b108-33812706ed64 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:33.474231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d989d628-1d90-44a9-b108-33812706ed64 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:33.477206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:33.477965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:39:33.486040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d989d628-1d90-44a9-b108-33812706ed64 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:33.486547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d989d628-1d90-44a9-b108-33812706ed64 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:33.487005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d989d628-1d90-44a9-b108-33812706ed64 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:33.487734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d989d628-1d90-44a9-b108-33812706ed64 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:33.488201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d989d628-1d90-44a9-b108-33812706ed64 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:33.488697 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d989d628-1d90-44a9-b108-33812706ed64 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:33.532032 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d989d628-1d90-44a9-b108-33812706ed64 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064838 Aug 27 03:39:33.532646 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3614/7045] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:39:33 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:39:34.548874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-26fb69df-1436-44a9-ab1c-40fb9a96492a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:34.551363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26fb69df-1436-44a9-ab1c-40fb9a96492a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:34.559335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26fb69df-1436-44a9-ab1c-40fb9a96492a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:34.559810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26fb69df-1436-44a9-ab1c-40fb9a96492a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:34.560266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26fb69df-1436-44a9-ab1c-40fb9a96492a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:34.561001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26fb69df-1436-44a9-ab1c-40fb9a96492a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:34.561472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26fb69df-1436-44a9-ab1c-40fb9a96492a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:34.561958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26fb69df-1436-44a9-ab1c-40fb9a96492a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:34.594719 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-26fb69df-1436-44a9-ab1c-40fb9a96492a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050388 Aug 27 03:39:34.595314 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3432/7046] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:39:34 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:35.607754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c44c053f-2f60-4c1f-a752-67bfb1c30af3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:35.610072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c44c053f-2f60-4c1f-a752-67bfb1c30af3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:35.619009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44c053f-2f60-4c1f-a752-67bfb1c30af3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:35.619509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44c053f-2f60-4c1f-a752-67bfb1c30af3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:35.619958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44c053f-2f60-4c1f-a752-67bfb1c30af3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:35.620693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44c053f-2f60-4c1f-a752-67bfb1c30af3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:35.621160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44c053f-2f60-4c1f-a752-67bfb1c30af3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:35.621604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c44c053f-2f60-4c1f-a752-67bfb1c30af3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:35.656170 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c44c053f-2f60-4c1f-a752-67bfb1c30af3 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052280 Aug 27 03:39:35.656689 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3615/7047] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:39:35 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:39:36.668919 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5cdaaaf2-51fe-4056-a2f0-744462ac4ffc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:36.671149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5cdaaaf2-51fe-4056-a2f0-744462ac4ffc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:36.677892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdaaaf2-51fe-4056-a2f0-744462ac4ffc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:36.678406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdaaaf2-51fe-4056-a2f0-744462ac4ffc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:36.678849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdaaaf2-51fe-4056-a2f0-744462ac4ffc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:36.679571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdaaaf2-51fe-4056-a2f0-744462ac4ffc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:36.680030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdaaaf2-51fe-4056-a2f0-744462ac4ffc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:36.680474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5cdaaaf2-51fe-4056-a2f0-744462ac4ffc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:36.713394 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5cdaaaf2-51fe-4056-a2f0-744462ac4ffc tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048630 Aug 27 03:39:36.713930 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3433/7048] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:39:36 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:37.727036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6c796f5b-a2e0-4905-b1c7-dd19c40e155a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:37.729271 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6c796f5b-a2e0-4905-b1c7-dd19c40e155a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:37.736532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c796f5b-a2e0-4905-b1c7-dd19c40e155a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:37.737024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c796f5b-a2e0-4905-b1c7-dd19c40e155a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:37.737471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c796f5b-a2e0-4905-b1c7-dd19c40e155a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:37.738230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c796f5b-a2e0-4905-b1c7-dd19c40e155a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:37.738773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c796f5b-a2e0-4905-b1c7-dd19c40e155a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:37.739212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c796f5b-a2e0-4905-b1c7-dd19c40e155a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:37.773376 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6c796f5b-a2e0-4905-b1c7-dd19c40e155a tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051162 Aug 27 03:39:37.774002 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3616/7049] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:39:37 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:38.786546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5b27e9ee-281f-483f-805a-3d7fd0525505 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:38.788704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5b27e9ee-281f-483f-805a-3d7fd0525505 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:38.795821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b27e9ee-281f-483f-805a-3d7fd0525505 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:38.796330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b27e9ee-281f-483f-805a-3d7fd0525505 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:38.796791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b27e9ee-281f-483f-805a-3d7fd0525505 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:38.797512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b27e9ee-281f-483f-805a-3d7fd0525505 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:38.798028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b27e9ee-281f-483f-805a-3d7fd0525505 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:38.798478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5b27e9ee-281f-483f-805a-3d7fd0525505 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:38.829159 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5b27e9ee-281f-483f-805a-3d7fd0525505 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047316 Aug 27 03:39:38.829757 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3434/7050] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:39:38 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:39:38.840764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:38.841300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:38.852954 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:38.853557 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:38.854331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:38.855176 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:38.855643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:38.856080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:38.939072 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] HTTP exception thrown: Instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f is not attached to volume 553a1b63-47cb-4e81-8b19-1ad0d2af6a21 Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Request method failure captured: Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: request: DELETE /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments/553a1b63-47cb-4e81-8b19-1ad0d2af6a21 HTTP/1.1 Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZGPcqzERaHrzDj1iLy76BUgNUcb1o3XPppFazvpgxH7qpvr6R6D7Lh9plFRFbhAYKr7UHq_cGU6UznbGlZaQpogGCI6k01CU1sn-PYjpdFxcAXHmjPP812op0hjf2RYjfj8bWdjAaNP7ah7036dQ9OKXZhq_G-S9iynGvvnZJ3xQLU Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}] Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: de985326903a48f39209053431d18855 Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f is not attached to volume 553a1b63-47cb-4e81-8b19-1ad0d2af6a21 Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'server_id': '38e571e3-ccaa-4ef5-9e19-76afef1f900f', 'id': '553a1b63-47cb-4e81-8b19-1ad0d2af6a21'} Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 553a1b63-47cb-4e81-8b19-1ad0d2af6a21. Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f is not attached to volume 553a1b63-47cb-4e81-8b19-1ad0d2af6a21 Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:38.940789 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:38.945232 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:39:38.945232 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:39:38.945232 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f is not attached to volume 553a1b63-47cb-4e81-8b19-1ad0d2af6a21 Aug 27 03:39:38.945232 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:38.945232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Returning 404 to user: Instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f is not attached to volume 553a1b63-47cb-4e81-8b19-1ad0d2af6a21 {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:39:38.945232 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-371df0b2-9eb0-4267-90be-8b19a715ea26 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments/553a1b63-47cb-4e81-8b19-1ad0d2af6a21" status: 404 len: 154 microversion: 2.1 time: 0.105975 Aug 27 03:39:38.945232 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3617/7051] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:39:38 2022] DELETE /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f/os-volume_attachments/553a1b63-47cb-4e81-8b19-1ad0d2af6a21 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:42.293324 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-98557a0d-76cc-47fd-b009-eb1ca2430c76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:42.293867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-98557a0d-76cc-47fd-b009-eb1ca2430c76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:42.300750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98557a0d-76cc-47fd-b009-eb1ca2430c76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:42.301849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98557a0d-76cc-47fd-b009-eb1ca2430c76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:42.302301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98557a0d-76cc-47fd-b009-eb1ca2430c76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:42.303013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98557a0d-76cc-47fd-b009-eb1ca2430c76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:42.303476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98557a0d-76cc-47fd-b009-eb1ca2430c76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:42.303913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98557a0d-76cc-47fd-b009-eb1ca2430c76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:42.334608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-98557a0d-76cc-47fd-b009-eb1ca2430c76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:39:42.423844 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-98557a0d-76cc-47fd-b009-eb1ca2430c76 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 204 len: 0 microversion: 2.1 time: 0.133914 Aug 27 03:39:42.424493 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3435/7052] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:39:42 2022] DELETE /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:39:42.433505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f545ff49-f1c1-4a49-a72b-1dc8196797c5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:42.434246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f545ff49-f1c1-4a49-a72b-1dc8196797c5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:42.442157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f545ff49-f1c1-4a49-a72b-1dc8196797c5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:42.442762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f545ff49-f1c1-4a49-a72b-1dc8196797c5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:42.443317 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f545ff49-f1c1-4a49-a72b-1dc8196797c5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:42.444123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f545ff49-f1c1-4a49-a72b-1dc8196797c5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:42.444659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f545ff49-f1c1-4a49-a72b-1dc8196797c5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:42.445164 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f545ff49-f1c1-4a49-a72b-1dc8196797c5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:42.620736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f545ff49-f1c1-4a49-a72b-1dc8196797c5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:42.630138 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f545ff49-f1c1-4a49-a72b-1dc8196797c5 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1561 microversion: 2.1 time: 0.200587 Aug 27 03:39:42.631020 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3618/7053] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:42 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1561 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:43.653096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fc64e678-e277-43e2-8784-1cb3fba8f83c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:43.653759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fc64e678-e277-43e2-8784-1cb3fba8f83c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:43.661416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc64e678-e277-43e2-8784-1cb3fba8f83c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:43.661941 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc64e678-e277-43e2-8784-1cb3fba8f83c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:43.662399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc64e678-e277-43e2-8784-1cb3fba8f83c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:43.663108 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc64e678-e277-43e2-8784-1cb3fba8f83c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:43.663579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc64e678-e277-43e2-8784-1cb3fba8f83c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:43.664022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fc64e678-e277-43e2-8784-1cb3fba8f83c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:43.801631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fc64e678-e277-43e2-8784-1cb3fba8f83c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:43.809765 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fc64e678-e277-43e2-8784-1cb3fba8f83c tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1561 microversion: 2.1 time: 0.160987 Aug 27 03:39:43.810287 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3436/7054] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:43 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:44.601256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-90a69a99-e38a-49f5-afa1-8456c317dcff req-537c3109-6d8f-4116-b316-73bbb9208fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38e571e3-ccaa-4ef5-9e19-76afef1f900f", "name": "network-vif-deleted", "tag": "d19d3491-b05b-4a31-af72-34d6642a04a3"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:39:44.614541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-90a69a99-e38a-49f5-afa1-8456c317dcff req-537c3109-6d8f-4116-b316-73bbb9208fa9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:44.615163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-90a69a99-e38a-49f5-afa1-8456c317dcff req-537c3109-6d8f-4116-b316-73bbb9208fa9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:44.616395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-90a69a99-e38a-49f5-afa1-8456c317dcff req-537c3109-6d8f-4116-b316-73bbb9208fa9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:44.631404 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-90a69a99-e38a-49f5-afa1-8456c317dcff req-537c3109-6d8f-4116-b316-73bbb9208fa9 service nova] Creating event network-vif-deleted:d19d3491-b05b-4a31-af72-34d6642a04a3 for instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f on n-h2-852084-5 Aug 27 03:39:44.637357 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-90a69a99-e38a-49f5-afa1-8456c317dcff req-537c3109-6d8f-4116-b316-73bbb9208fa9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040334 Aug 27 03:39:44.638609 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3619/7055] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:39:44.832335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:44.833034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:44.840906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:44.841409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:44.841900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:44.842628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:44.843089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:44.843529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:44.876760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:44.877250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:44.877725 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:44.878195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lazy-loading 'fault' on Instance uuid 38e571e3-ccaa-4ef5-9e19-76afef1f900f {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:39:44.923690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de985326903a48f39209053431d18855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa7e44a1e5b472ab7d1654f4327ab3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:39:44.932565 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-163bf114-74b2-4d7b-9ee4-754c59d94857 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 200 len: 1352 microversion: 2.1 time: 0.104928 Aug 27 03:39:44.935662 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3437/7056] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:44 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:39:45.956363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:45.957081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] [instance: 38e571e3-ccaa-4ef5-9e19-76afef1f900f] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:39:45.963605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:45.964096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:45.964541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:45.965536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:39:45.966041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:39:45.966477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:39:45.980184 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] HTTP exception thrown: Instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f could not be found. Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Request method failure captured: Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f HTTP/1.1 Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZGPcqzERaHrzDj1iLy76BUgNUcb1o3XPppFazvpgxH7qpvr6R6D7Lh9plFRFbhAYKr7UHq_cGU6UznbGlZaQpogGCI6k01CU1sn-PYjpdFxcAXHmjPP812op0hjf2RYjfj8bWdjAaNP7ah7036dQ9OKXZhq_G-S9iynGvvnZJ3xQLU Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/4fa7e44a1e5b472ab7d1654f4327ab3a"}]}] Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 4fa7e44a1e5b472ab7d1654f4327ab3a Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-943597925 Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: de985326903a48f39209053431d18855 Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestEncryptedCinderVolumes-943597925-project Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f could not be found. Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '38e571e3-ccaa-4ef5-9e19-76afef1f900f'} Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f could not be found. Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f could not be found. Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:39:45.981912 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:45.986032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:39:45.986032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:39:45.986032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:39:45.986032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:39:45.986032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:39:45.986032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f could not be found. Aug 27 03:39:45.986032 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:39:45.986032 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Returning 404 to user: Instance 38e571e3-ccaa-4ef5-9e19-76afef1f900f could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:39:45.986032 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5384a717-2a73-440c-b885-351b6ad5b0c7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f" status: 404 len: 111 microversion: 2.1 time: 0.032255 Aug 27 03:39:45.986032 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3620/7057] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:39:45 2022] GET /compute/v2.1/servers/38e571e3-ccaa-4ef5-9e19-76afef1f900f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:39:45.992976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-779c95e3-bd33-433b-9e63-8e9b4937e0b7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] Calling method '.version_select at 0x7f4d297c4310>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:39:46.013524 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-779c95e3-bd33-433b-9e63-8e9b4937e0b7 tempest-TestEncryptedCinderVolumes-943597925 tempest-TestEncryptedCinderVolumes-943597925-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-729131760" status: 202 len: 0 microversion: 2.1 time: 0.024975 Aug 27 03:39:46.014139 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3438/7058] 10.222.0.99 () {58 vars in 1275 bytes} [Sat Aug 27 03:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-729131760 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:13.399563 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-82e513d2-1222-47dc-baf0-9a017b6158e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'create', calling method: .version_select at 0x7f4d2948de50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-133261259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbfIlbuHPa88S2PbWE011mZoa2vBcvJw+8mCykH/+L52bOx+qvoKyg0ijquHaQRnOKe+K0KqaodlFlFmOSYORxseQjrvXm4hemS+J67xrwcWFOJA929M2PR+3cZE5mkXA=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:13.405251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=14 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:13.405969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=34 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:13.418535 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-82e513d2-1222-47dc-baf0-9a017b6158e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Getting quotas for project 1aff73dc8b0c494798062c2b92dc8ec5. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:40:13.423750 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-82e513d2-1222-47dc-baf0-9a017b6158e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Getting quotas for user 2f93163091014ae282245f274e02ab55 and project 1aff73dc8b0c494798062c2b92dc8ec5. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:40:13.448894 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-82e513d2-1222-47dc-baf0-9a017b6158e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053452 Aug 27 03:40:13.449499 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3621/7059] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:40:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:13.499348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:13.500160 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:13.505144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-319104486", "imageRef": "234c175a-aa7a-4345-aa06-2797fb6e0f94", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-133261259", "networks": [{"uuid": "2708e65f-1c69-4ce2-bd9d-c14caba737cf"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:13.560449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] validate_networks() for [('2708e65f-1c69-4ce2-bd9d-c14caba737cf', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:40:13.931130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:40:13.931579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:40:13.932076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:40:13.932508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:40:13.932943 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:40:13.942841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:13.943338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:13.943861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:13.944549 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:13.945019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:13.945490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:13.962705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Getting quotas for project 1aff73dc8b0c494798062c2b92dc8ec5. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:40:13.968211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Getting quotas for user 2f93163091014ae282245f274e02ab55 and project 1aff73dc8b0c494798062c2b92dc8ec5. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:40:13.980848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:40:13.983136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='234c175a-aa7a-4345-aa06-2797fb6e0f94',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:40:14.030900 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-15aed997-b896-466d-a5cf-482bfbffd82c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533719 Aug 27 03:40:14.031548 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3439/7060] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:40:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:40:14.042425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-16feb9f3-8a63-4994-89cc-60b41b4eb234 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:14.043041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-16feb9f3-8a63-4994-89cc-60b41b4eb234 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:14.102700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-16feb9f3-8a63-4994-89cc-60b41b4eb234 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:14.109965 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-16feb9f3-8a63-4994-89cc-60b41b4eb234 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1257 microversion: 2.1 time: 0.071416 Aug 27 03:40:14.110779 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3622/7061] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:14 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:15.131649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-03521c6d-a87d-4701-bef7-913ebe17a8dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:15.133064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-03521c6d-a87d-4701-bef7-913ebe17a8dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:15.139290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03521c6d-a87d-4701-bef7-913ebe17a8dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:15.139780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03521c6d-a87d-4701-bef7-913ebe17a8dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:15.140229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03521c6d-a87d-4701-bef7-913ebe17a8dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:15.140953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03521c6d-a87d-4701-bef7-913ebe17a8dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:15.141424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03521c6d-a87d-4701-bef7-913ebe17a8dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:15.141900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-03521c6d-a87d-4701-bef7-913ebe17a8dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:15.208071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-03521c6d-a87d-4701-bef7-913ebe17a8dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:15.217690 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-03521c6d-a87d-4701-bef7-913ebe17a8dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1309 microversion: 2.1 time: 0.090811 Aug 27 03:40:15.218759 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3440/7062] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:15 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:40:16.240220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-392e8c52-02c1-4801-afac-545a039e8bcb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:16.240853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-392e8c52-02c1-4801-afac-545a039e8bcb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:16.259831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-392e8c52-02c1-4801-afac-545a039e8bcb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:16.260956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-392e8c52-02c1-4801-afac-545a039e8bcb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:16.261635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-392e8c52-02c1-4801-afac-545a039e8bcb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:16.262757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-392e8c52-02c1-4801-afac-545a039e8bcb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:16.263545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-392e8c52-02c1-4801-afac-545a039e8bcb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:16.264213 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-392e8c52-02c1-4801-afac-545a039e8bcb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:16.422000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-392e8c52-02c1-4801-afac-545a039e8bcb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:16.430644 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-392e8c52-02c1-4801-afac-545a039e8bcb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.194317 Aug 27 03:40:16.431261 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3623/7063] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:16 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:17.452965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c8792e25-03ea-440a-bd9b-12bdedcfcf0a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:17.453606 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c8792e25-03ea-440a-bd9b-12bdedcfcf0a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:17.460757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8792e25-03ea-440a-bd9b-12bdedcfcf0a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:17.461270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8792e25-03ea-440a-bd9b-12bdedcfcf0a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:17.461758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8792e25-03ea-440a-bd9b-12bdedcfcf0a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:17.462489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8792e25-03ea-440a-bd9b-12bdedcfcf0a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:17.463067 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8792e25-03ea-440a-bd9b-12bdedcfcf0a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:17.463513 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8792e25-03ea-440a-bd9b-12bdedcfcf0a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:17.805596 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c8792e25-03ea-440a-bd9b-12bdedcfcf0a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:17.814011 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c8792e25-03ea-440a-bd9b-12bdedcfcf0a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.364870 Aug 27 03:40:17.814798 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3441/7064] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:17 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:18.835088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3e62043d-0993-485f-8f04-64d89c627d0d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:18.835615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3e62043d-0993-485f-8f04-64d89c627d0d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:18.843018 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e62043d-0993-485f-8f04-64d89c627d0d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:18.843508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e62043d-0993-485f-8f04-64d89c627d0d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:18.843959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e62043d-0993-485f-8f04-64d89c627d0d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:18.844824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e62043d-0993-485f-8f04-64d89c627d0d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:18.845296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e62043d-0993-485f-8f04-64d89c627d0d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:18.845875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e62043d-0993-485f-8f04-64d89c627d0d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:19.044048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3e62043d-0993-485f-8f04-64d89c627d0d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:19.053199 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3e62043d-0993-485f-8f04-64d89c627d0d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.222116 Aug 27 03:40:19.053816 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3624/7065] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:18 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:20.074467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-639324c1-dd80-4610-a70e-04194feb7e12 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:20.075143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-639324c1-dd80-4610-a70e-04194feb7e12 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:20.082171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639324c1-dd80-4610-a70e-04194feb7e12 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:20.082678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639324c1-dd80-4610-a70e-04194feb7e12 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:20.083136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639324c1-dd80-4610-a70e-04194feb7e12 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:20.083865 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639324c1-dd80-4610-a70e-04194feb7e12 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:20.084337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639324c1-dd80-4610-a70e-04194feb7e12 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:20.084785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-639324c1-dd80-4610-a70e-04194feb7e12 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:20.229018 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-639324c1-dd80-4610-a70e-04194feb7e12 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:20.238683 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-639324c1-dd80-4610-a70e-04194feb7e12 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.167831 Aug 27 03:40:20.240277 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3442/7066] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:20 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:21.261074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a7e2ec0c-998e-4860-a7df-1629afdc0fd1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:21.261800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a7e2ec0c-998e-4860-a7df-1629afdc0fd1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:21.269282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7e2ec0c-998e-4860-a7df-1629afdc0fd1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:21.269938 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7e2ec0c-998e-4860-a7df-1629afdc0fd1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:21.270391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7e2ec0c-998e-4860-a7df-1629afdc0fd1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:21.271114 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7e2ec0c-998e-4860-a7df-1629afdc0fd1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:21.271580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7e2ec0c-998e-4860-a7df-1629afdc0fd1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:21.272015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a7e2ec0c-998e-4860-a7df-1629afdc0fd1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:21.458971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a7e2ec0c-998e-4860-a7df-1629afdc0fd1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:21.467532 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a7e2ec0c-998e-4860-a7df-1629afdc0fd1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.210280 Aug 27 03:40:21.469712 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3625/7067] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:21 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:22.489296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b5cd5ddb-bd4f-4d37-99f3-2f484cef0e60 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:22.490252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b5cd5ddb-bd4f-4d37-99f3-2f484cef0e60 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:22.497313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5cd5ddb-bd4f-4d37-99f3-2f484cef0e60 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:22.497866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5cd5ddb-bd4f-4d37-99f3-2f484cef0e60 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:22.498377 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5cd5ddb-bd4f-4d37-99f3-2f484cef0e60 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:22.500153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5cd5ddb-bd4f-4d37-99f3-2f484cef0e60 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:22.500153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5cd5ddb-bd4f-4d37-99f3-2f484cef0e60 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:22.500345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5cd5ddb-bd4f-4d37-99f3-2f484cef0e60 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:22.658743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b5cd5ddb-bd4f-4d37-99f3-2f484cef0e60 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:22.671658 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b5cd5ddb-bd4f-4d37-99f3-2f484cef0e60 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.187018 Aug 27 03:40:22.672569 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3443/7068] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:22 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:23.694479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-03f1a399-d30e-482d-9d26-0801f3f21bf1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:23.695135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-03f1a399-d30e-482d-9d26-0801f3f21bf1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:23.702311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03f1a399-d30e-482d-9d26-0801f3f21bf1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:23.702805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03f1a399-d30e-482d-9d26-0801f3f21bf1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:23.703259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03f1a399-d30e-482d-9d26-0801f3f21bf1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:23.703963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03f1a399-d30e-482d-9d26-0801f3f21bf1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:23.704424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03f1a399-d30e-482d-9d26-0801f3f21bf1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:23.704858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-03f1a399-d30e-482d-9d26-0801f3f21bf1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:23.845509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-03f1a399-d30e-482d-9d26-0801f3f21bf1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:23.855053 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-03f1a399-d30e-482d-9d26-0801f3f21bf1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.164640 Aug 27 03:40:23.855636 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3626/7069] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:23 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:24.682649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-fa278ff7-f2dd-410d-ad33-7dd7c65e0271 req-53b55144-4a20-46d0-a2c8-18368fa2c4fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abf04af-7489-41b2-8576-dc7e5759df8e", "tag": "330b1033-47da-4b0e-a155-9a8675c1c800"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:24.690565 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:24.692013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:24.697890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fa278ff7-f2dd-410d-ad33-7dd7c65e0271 req-53b55144-4a20-46d0-a2c8-18368fa2c4fa service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:24.698398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fa278ff7-f2dd-410d-ad33-7dd7c65e0271 req-53b55144-4a20-46d0-a2c8-18368fa2c4fa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:24.698863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-fa278ff7-f2dd-410d-ad33-7dd7c65e0271 req-53b55144-4a20-46d0-a2c8-18368fa2c4fa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:24.711627 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-fa278ff7-f2dd-410d-ad33-7dd7c65e0271 req-53b55144-4a20-46d0-a2c8-18368fa2c4fa service nova] Creating event network-changed:330b1033-47da-4b0e-a155-9a8675c1c800 for instance 2abf04af-7489-41b2-8576-dc7e5759df8e on n-h1-852084-5 Aug 27 03:40:24.716983 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-fa278ff7-f2dd-410d-ad33-7dd7c65e0271 req-53b55144-4a20-46d0-a2c8-18368fa2c4fa service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038706 Aug 27 03:40:24.717949 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3444/7070] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:24.877239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-877843c2-6d09-4555-bc54-2d36af705bb3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:24.877627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-877843c2-6d09-4555-bc54-2d36af705bb3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:24.880339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:24.887643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877843c2-6d09-4555-bc54-2d36af705bb3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:24.888388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877843c2-6d09-4555-bc54-2d36af705bb3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:24.888827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877843c2-6d09-4555-bc54-2d36af705bb3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:24.889528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877843c2-6d09-4555-bc54-2d36af705bb3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:24.890021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877843c2-6d09-4555-bc54-2d36af705bb3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:24.890446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-877843c2-6d09-4555-bc54-2d36af705bb3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:25.033256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-877843c2-6d09-4555-bc54-2d36af705bb3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:25.042183 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-877843c2-6d09-4555-bc54-2d36af705bb3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.169517 Aug 27 03:40:25.042810 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3627/7071] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:24 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:26.066218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-868465d9-e0e6-4050-ba66-c9edfd959625 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:26.066899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-868465d9-e0e6-4050-ba66-c9edfd959625 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:26.073102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-868465d9-e0e6-4050-ba66-c9edfd959625 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:26.073632 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-868465d9-e0e6-4050-ba66-c9edfd959625 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:26.074077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-868465d9-e0e6-4050-ba66-c9edfd959625 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:26.074789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-868465d9-e0e6-4050-ba66-c9edfd959625 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:26.075255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-868465d9-e0e6-4050-ba66-c9edfd959625 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:26.075697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-868465d9-e0e6-4050-ba66-c9edfd959625 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:26.211714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-868465d9-e0e6-4050-ba66-c9edfd959625 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:26.220211 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-868465d9-e0e6-4050-ba66-c9edfd959625 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.159343 Aug 27 03:40:26.221004 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3445/7072] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:26 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:27.241882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2db246db-9da0-4f1e-b112-3efd1400203f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:27.242532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2db246db-9da0-4f1e-b112-3efd1400203f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:27.249210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2db246db-9da0-4f1e-b112-3efd1400203f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:27.249734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2db246db-9da0-4f1e-b112-3efd1400203f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:27.250182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2db246db-9da0-4f1e-b112-3efd1400203f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:27.250939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2db246db-9da0-4f1e-b112-3efd1400203f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:27.251453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2db246db-9da0-4f1e-b112-3efd1400203f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:27.251934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2db246db-9da0-4f1e-b112-3efd1400203f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:27.400922 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2db246db-9da0-4f1e-b112-3efd1400203f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:27.408929 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2db246db-9da0-4f1e-b112-3efd1400203f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.171662 Aug 27 03:40:27.409513 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3628/7073] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:27 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:28.431699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-02f1f76a-f7f1-44d5-997d-0fe95e1df304 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:28.432514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-02f1f76a-f7f1-44d5-997d-0fe95e1df304 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:28.439655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f1f76a-f7f1-44d5-997d-0fe95e1df304 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:28.440161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f1f76a-f7f1-44d5-997d-0fe95e1df304 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:28.440625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f1f76a-f7f1-44d5-997d-0fe95e1df304 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:28.441911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f1f76a-f7f1-44d5-997d-0fe95e1df304 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:28.442428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f1f76a-f7f1-44d5-997d-0fe95e1df304 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:28.442881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-02f1f76a-f7f1-44d5-997d-0fe95e1df304 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:28.572832 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-02f1f76a-f7f1-44d5-997d-0fe95e1df304 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:28.580688 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-02f1f76a-f7f1-44d5-997d-0fe95e1df304 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.153870 Aug 27 03:40:28.581264 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3446/7074] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:28 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:29.603380 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11bd7f34-8468-482f-b91f-81c1b98cd924 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:29.604041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-11bd7f34-8468-482f-b91f-81c1b98cd924 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:29.611025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11bd7f34-8468-482f-b91f-81c1b98cd924 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:29.611511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11bd7f34-8468-482f-b91f-81c1b98cd924 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:29.611958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11bd7f34-8468-482f-b91f-81c1b98cd924 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:29.612659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11bd7f34-8468-482f-b91f-81c1b98cd924 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:29.613201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11bd7f34-8468-482f-b91f-81c1b98cd924 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:29.613735 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11bd7f34-8468-482f-b91f-81c1b98cd924 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:29.754370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-11bd7f34-8468-482f-b91f-81c1b98cd924 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:29.763933 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11bd7f34-8468-482f-b91f-81c1b98cd924 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.164154 Aug 27 03:40:29.764799 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3629/7075] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:29 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:29.898662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-f6ef93f5-df60-492c-97bc-396f9d59a530 req-7dc8c7bf-e130-45e2-96a6-ea3ece58911f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abf04af-7489-41b2-8576-dc7e5759df8e", "name": "network-vif-plugged", "status": "completed", "tag": "330b1033-47da-4b0e-a155-9a8675c1c800"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:29.909332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f6ef93f5-df60-492c-97bc-396f9d59a530 req-7dc8c7bf-e130-45e2-96a6-ea3ece58911f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:29.910080 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f6ef93f5-df60-492c-97bc-396f9d59a530 req-7dc8c7bf-e130-45e2-96a6-ea3ece58911f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:29.910530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f6ef93f5-df60-492c-97bc-396f9d59a530 req-7dc8c7bf-e130-45e2-96a6-ea3ece58911f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:29.922758 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-f6ef93f5-df60-492c-97bc-396f9d59a530 req-7dc8c7bf-e130-45e2-96a6-ea3ece58911f service nova] Creating event network-vif-plugged:330b1033-47da-4b0e-a155-9a8675c1c800 for instance 2abf04af-7489-41b2-8576-dc7e5759df8e on n-h1-852084-5 Aug 27 03:40:29.927889 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-f6ef93f5-df60-492c-97bc-396f9d59a530 req-7dc8c7bf-e130-45e2-96a6-ea3ece58911f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033827 Aug 27 03:40:29.928499 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3447/7076] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:30.787441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-68236983-4dcb-42a0-a4d6-8adc3a061cb1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:30.787996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-68236983-4dcb-42a0-a4d6-8adc3a061cb1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:30.795756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68236983-4dcb-42a0-a4d6-8adc3a061cb1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:30.796242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68236983-4dcb-42a0-a4d6-8adc3a061cb1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:30.796687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68236983-4dcb-42a0-a4d6-8adc3a061cb1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:30.797396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68236983-4dcb-42a0-a4d6-8adc3a061cb1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:30.797886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68236983-4dcb-42a0-a4d6-8adc3a061cb1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:30.798318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68236983-4dcb-42a0-a4d6-8adc3a061cb1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:30.934308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-68236983-4dcb-42a0-a4d6-8adc3a061cb1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:30.942477 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-68236983-4dcb-42a0-a4d6-8adc3a061cb1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1357 microversion: 2.1 time: 0.159651 Aug 27 03:40:30.943060 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3630/7077] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:30 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:31.965621 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-719ace06-24e3-4863-9169-c977f6fb0074 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:31.966375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-719ace06-24e3-4863-9169-c977f6fb0074 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:31.973552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-719ace06-24e3-4863-9169-c977f6fb0074 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:31.974081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-719ace06-24e3-4863-9169-c977f6fb0074 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:31.974541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-719ace06-24e3-4863-9169-c977f6fb0074 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:31.975256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-719ace06-24e3-4863-9169-c977f6fb0074 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:31.975876 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-719ace06-24e3-4863-9169-c977f6fb0074 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:31.976362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-719ace06-24e3-4863-9169-c977f6fb0074 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:32.114048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-719ace06-24e3-4863-9169-c977f6fb0074 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:32.122356 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-719ace06-24e3-4863-9169-c977f6fb0074 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1548 microversion: 2.1 time: 0.162597 Aug 27 03:40:32.122933 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3448/7078] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:31 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:32.142530 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8b04267f-d4d8-474c-8b74-9c16dce90706 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:32.143152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8b04267f-d4d8-474c-8b74-9c16dce90706 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:32.150334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b04267f-d4d8-474c-8b74-9c16dce90706 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:32.150823 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b04267f-d4d8-474c-8b74-9c16dce90706 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:32.151285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b04267f-d4d8-474c-8b74-9c16dce90706 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:32.151967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b04267f-d4d8-474c-8b74-9c16dce90706 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:32.152430 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b04267f-d4d8-474c-8b74-9c16dce90706 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:32.152898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b04267f-d4d8-474c-8b74-9c16dce90706 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:32.287084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8b04267f-d4d8-474c-8b74-9c16dce90706 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:32.295836 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8b04267f-d4d8-474c-8b74-9c16dce90706 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1548 microversion: 2.1 time: 0.157242 Aug 27 03:40:32.296582 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3631/7079] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:32 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:32.317760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-90f72228-23b1-463b-8c36-53d4efa8ddf6 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:32.322872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-90f72228-23b1-463b-8c36-53d4efa8ddf6 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:32.323825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-90f72228-23b1-463b-8c36-53d4efa8ddf6 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Searching by: {'deleted': False, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:40:32.329582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f72228-23b1-463b-8c36-53d4efa8ddf6 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:32.330121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f72228-23b1-463b-8c36-53d4efa8ddf6 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:32.330599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f72228-23b1-463b-8c36-53d4efa8ddf6 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:32.331361 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f72228-23b1-463b-8c36-53d4efa8ddf6 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:32.331972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f72228-23b1-463b-8c36-53d4efa8ddf6 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:32.332419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-90f72228-23b1-463b-8c36-53d4efa8ddf6 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:32.364815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-90f72228-23b1-463b-8c36-53d4efa8ddf6 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:40:32.397387 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-90f72228-23b1-463b-8c36-53d4efa8ddf6 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.083928 Aug 27 03:40:32.398267 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3449/7080] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 03:40:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:32.411285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-80e66d43-2e97-4f4f-bc18-1616a1d4f86b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:32.412109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-80e66d43-2e97-4f4f-bc18-1616a1d4f86b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:32.418887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e66d43-2e97-4f4f-bc18-1616a1d4f86b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:32.419417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e66d43-2e97-4f4f-bc18-1616a1d4f86b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:32.419860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e66d43-2e97-4f4f-bc18-1616a1d4f86b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:32.420591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e66d43-2e97-4f4f-bc18-1616a1d4f86b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:32.421082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e66d43-2e97-4f4f-bc18-1616a1d4f86b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:32.421542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-80e66d43-2e97-4f4f-bc18-1616a1d4f86b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:32.562225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-80e66d43-2e97-4f4f-bc18-1616a1d4f86b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:32.570969 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-80e66d43-2e97-4f4f-bc18-1616a1d4f86b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1548 microversion: 2.1 time: 0.164675 Aug 27 03:40:32.571547 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3632/7081] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:32 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:34.155436 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-59a21e8b-714d-43f1-b844-e1a713cb8131 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a27b7cfd-7434-4cb1-b41c-c5010872dba9"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:34.158084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-59a21e8b-714d-43f1-b844-e1a713cb8131 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:34.165828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59a21e8b-714d-43f1-b844-e1a713cb8131 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:34.166315 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59a21e8b-714d-43f1-b844-e1a713cb8131 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:34.166763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59a21e8b-714d-43f1-b844-e1a713cb8131 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:34.167471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59a21e8b-714d-43f1-b844-e1a713cb8131 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:34.167935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59a21e8b-714d-43f1-b844-e1a713cb8131 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:34.168370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-59a21e8b-714d-43f1-b844-e1a713cb8131 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:34.439602 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-59a21e8b-714d-43f1-b844-e1a713cb8131 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288301 Aug 27 03:40:34.440252 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3450/7082] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:40:34 2022] POST /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:40:47.476625 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-287e774e-15c9-4089-a8a0-ca15f0e29d9a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:47.477256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-287e774e-15c9-4089-a8a0-ca15f0e29d9a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:47.480894 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:47.481564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=60 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:47.488081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-287e774e-15c9-4089-a8a0-ca15f0e29d9a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:47.488574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-287e774e-15c9-4089-a8a0-ca15f0e29d9a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:47.489019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-287e774e-15c9-4089-a8a0-ca15f0e29d9a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:47.489755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-287e774e-15c9-4089-a8a0-ca15f0e29d9a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:47.490219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-287e774e-15c9-4089-a8a0-ca15f0e29d9a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:47.490653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-287e774e-15c9-4089-a8a0-ca15f0e29d9a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:47.623370 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-287e774e-15c9-4089-a8a0-ca15f0e29d9a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:47.631754 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-287e774e-15c9-4089-a8a0-ca15f0e29d9a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1594 microversion: 2.1 time: 0.158995 Aug 27 03:40:47.632345 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3633/7083] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:47 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:40:49.288151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-eaa87a8d-8a18-494d-8107-8a3999809cc3 req-b383510f-49e5-4181-a9b7-003ea065e4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abf04af-7489-41b2-8576-dc7e5759df8e", "tag": "330b1033-47da-4b0e-a155-9a8675c1c800"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:49.301811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:49.301811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:49.301811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:40:49.309820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-eaa87a8d-8a18-494d-8107-8a3999809cc3 req-b383510f-49e5-4181-a9b7-003ea065e4c4 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:49.310573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-eaa87a8d-8a18-494d-8107-8a3999809cc3 req-b383510f-49e5-4181-a9b7-003ea065e4c4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:49.311105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-eaa87a8d-8a18-494d-8107-8a3999809cc3 req-b383510f-49e5-4181-a9b7-003ea065e4c4 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:49.324787 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-eaa87a8d-8a18-494d-8107-8a3999809cc3 req-b383510f-49e5-4181-a9b7-003ea065e4c4 service nova] Creating event network-changed:330b1033-47da-4b0e-a155-9a8675c1c800 for instance 2abf04af-7489-41b2-8576-dc7e5759df8e on n-h1-852084-5 Aug 27 03:40:49.331255 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-eaa87a8d-8a18-494d-8107-8a3999809cc3 req-b383510f-49e5-4181-a9b7-003ea065e4c4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047289 Aug 27 03:40:49.331879 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3451/7084] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:50.403547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4204aad6-e5b7-4d46-b024-d139f7cc216d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-88782014"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:50.404076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4204aad6-e5b7-4d46-b024-d139f7cc216d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:50.411036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4204aad6-e5b7-4d46-b024-d139f7cc216d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:50.411525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4204aad6-e5b7-4d46-b024-d139f7cc216d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:50.411970 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4204aad6-e5b7-4d46-b024-d139f7cc216d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:50.412690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4204aad6-e5b7-4d46-b024-d139f7cc216d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:50.413136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4204aad6-e5b7-4d46-b024-d139f7cc216d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:50.413568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4204aad6-e5b7-4d46-b024-d139f7cc216d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:50.547686 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.network.security_group_api [None req-4204aad6-e5b7-4d46-b024-d139f7cc216d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Adding security group ddfc871c-1ede-460f-a01a-2a7a4d10397d to port 330b1033-47da-4b0e-a155-9a8675c1c800 Aug 27 03:40:50.858571 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4204aad6-e5b7-4d46-b024-d139f7cc216d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/action" status: 202 len: 0 microversion: 2.1 time: 0.458879 Aug 27 03:40:50.859204 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3634/7085] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:40:50 2022] POST /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:40:50.870587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a4a3210-7a3b-4d0b-93cd-abf1a7e51c04 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:40:50.871310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a4a3210-7a3b-4d0b-93cd-abf1a7e51c04 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:40:50.878589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-12873550-a38d-4b5f-b6c3-9c7da0f4e612 req-a39171a5-a3ec-4f4a-be1b-bb82c4b6020d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abf04af-7489-41b2-8576-dc7e5759df8e", "tag": "330b1033-47da-4b0e-a155-9a8675c1c800"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:40:50.888733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4a3210-7a3b-4d0b-93cd-abf1a7e51c04 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:50.889384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4a3210-7a3b-4d0b-93cd-abf1a7e51c04 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:50.889875 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4a3210-7a3b-4d0b-93cd-abf1a7e51c04 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:50.890604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4a3210-7a3b-4d0b-93cd-abf1a7e51c04 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:50.891071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4a3210-7a3b-4d0b-93cd-abf1a7e51c04 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:50.891507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a4a3210-7a3b-4d0b-93cd-abf1a7e51c04 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:50.901473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-12873550-a38d-4b5f-b6c3-9c7da0f4e612 req-a39171a5-a3ec-4f4a-be1b-bb82c4b6020d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:40:50.901973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-12873550-a38d-4b5f-b6c3-9c7da0f4e612 req-a39171a5-a3ec-4f4a-be1b-bb82c4b6020d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:40:50.902662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-12873550-a38d-4b5f-b6c3-9c7da0f4e612 req-a39171a5-a3ec-4f4a-be1b-bb82c4b6020d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:40:50.915490 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-12873550-a38d-4b5f-b6c3-9c7da0f4e612 req-a39171a5-a3ec-4f4a-be1b-bb82c4b6020d service nova] Creating event network-changed:330b1033-47da-4b0e-a155-9a8675c1c800 for instance 2abf04af-7489-41b2-8576-dc7e5759df8e on n-h1-852084-5 Aug 27 03:40:50.921171 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-12873550-a38d-4b5f-b6c3-9c7da0f4e612 req-a39171a5-a3ec-4f4a-be1b-bb82c4b6020d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046142 Aug 27 03:40:50.922305 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3635/7086] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:40:51.133613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a4a3210-7a3b-4d0b-93cd-abf1a7e51c04 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:40:51.142930 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a4a3210-7a3b-4d0b-93cd-abf1a7e51c04 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1757 microversion: 2.1 time: 0.278910 Aug 27 03:40:51.154158 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3452/7087] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:40:50 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1757 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:28.529362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:28.530158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=12 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:28.531581 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:42:28.531760 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 03:42:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/action (ip 10.222.0.99) !!! Aug 27 03:42:28.538578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dd2de8db-4bbf-4228-afe2-475c60291243 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:42:28.540896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dd2de8db-4bbf-4228-afe2-475c60291243 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:28.549546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2de8db-4bbf-4228-afe2-475c60291243 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:28.550054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2de8db-4bbf-4228-afe2-475c60291243 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:28.550491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2de8db-4bbf-4228-afe2-475c60291243 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:28.551191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2de8db-4bbf-4228-afe2-475c60291243 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:28.551641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2de8db-4bbf-4228-afe2-475c60291243 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:28.552070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dd2de8db-4bbf-4228-afe2-475c60291243 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:28.631717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dd2de8db-4bbf-4228-afe2-475c60291243 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/action" status: 202 len: 0 microversion: 2.1 time: 0.104911 Aug 27 03:42:28.632534 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3636/7088] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:42:28 2022] POST /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:42:28.638798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:28.639710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:42:28.643753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d1f4c14-23ba-491d-b782-c8ba0bf80a38 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:28.644386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4d1f4c14-23ba-491d-b782-c8ba0bf80a38 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:28.651655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d1f4c14-23ba-491d-b782-c8ba0bf80a38 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:28.652163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d1f4c14-23ba-491d-b782-c8ba0bf80a38 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:28.652654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d1f4c14-23ba-491d-b782-c8ba0bf80a38 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:28.653378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d1f4c14-23ba-491d-b782-c8ba0bf80a38 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:28.653873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d1f4c14-23ba-491d-b782-c8ba0bf80a38 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:28.654317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d1f4c14-23ba-491d-b782-c8ba0bf80a38 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:28.885207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4d1f4c14-23ba-491d-b782-c8ba0bf80a38 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:28.893790 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4d1f4c14-23ba-491d-b782-c8ba0bf80a38 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1759 microversion: 2.1 time: 0.256954 Aug 27 03:42:28.894290 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3453/7089] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:28 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1759 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:42:29.916887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a623260d-1716-4182-a243-b25296a40712 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:42:29.917600 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a623260d-1716-4182-a243-b25296a40712 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:42:29.924717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a623260d-1716-4182-a243-b25296a40712 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:29.925206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a623260d-1716-4182-a243-b25296a40712 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:29.925646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a623260d-1716-4182-a243-b25296a40712 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:29.926382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a623260d-1716-4182-a243-b25296a40712 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:42:29.926840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a623260d-1716-4182-a243-b25296a40712 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:42:29.927264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a623260d-1716-4182-a243-b25296a40712 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:42:30.084368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a623260d-1716-4182-a243-b25296a40712 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:42:30.093787 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a623260d-1716-4182-a243-b25296a40712 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1757 microversion: 2.1 time: 0.182001 Aug 27 03:42:30.094369 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3637/7090] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:42:29 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:42.979629 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:43:42.980776 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:43:42.981707 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 03:43:42.981849 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/action (ip 10.222.0.99) !!! Aug 27 03:43:42.982864 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:43:42.982996 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/action (ip 10.222.0.99) !!! Aug 27 03:43:42.983918 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:43:42.984063 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/action (ip 10.222.0.99) !!! Aug 27 03:43:42.984993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:42.985735 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:42.991208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-52f50f85-13bc-4062-9e7c-8daccabfaa26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-88782014"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:42.991768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-52f50f85-13bc-4062-9e7c-8daccabfaa26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:43.006762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f50f85-13bc-4062-9e7c-8daccabfaa26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:43.007266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f50f85-13bc-4062-9e7c-8daccabfaa26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:43.007723 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f50f85-13bc-4062-9e7c-8daccabfaa26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:43.008448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f50f85-13bc-4062-9e7c-8daccabfaa26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:43.008923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f50f85-13bc-4062-9e7c-8daccabfaa26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:43.009371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-52f50f85-13bc-4062-9e7c-8daccabfaa26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:43.137338 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.network.security_group_api [None req-52f50f85-13bc-4062-9e7c-8daccabfaa26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Removing security group ddfc871c-1ede-460f-a01a-2a7a4d10397d from port 330b1033-47da-4b0e-a155-9a8675c1c800 Aug 27 03:43:43.443960 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-52f50f85-13bc-4062-9e7c-8daccabfaa26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/action" status: 202 len: 0 microversion: 2.1 time: 0.466027 Aug 27 03:43:43.444634 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3454/7091] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:43:42 2022] POST /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:43:43.451525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:43.452291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:43:43.524797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-ccb0fb3e-471e-4ed4-9abc-5b62a50eb099 req-f0658b46-06d2-4580-8114-b6a941711b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abf04af-7489-41b2-8576-dc7e5759df8e", "tag": "330b1033-47da-4b0e-a155-9a8675c1c800"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:43.536882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ccb0fb3e-471e-4ed4-9abc-5b62a50eb099 req-f0658b46-06d2-4580-8114-b6a941711b8a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:43.537394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ccb0fb3e-471e-4ed4-9abc-5b62a50eb099 req-f0658b46-06d2-4580-8114-b6a941711b8a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:43.537946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-ccb0fb3e-471e-4ed4-9abc-5b62a50eb099 req-f0658b46-06d2-4580-8114-b6a941711b8a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:43.553017 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-ccb0fb3e-471e-4ed4-9abc-5b62a50eb099 req-f0658b46-06d2-4580-8114-b6a941711b8a service nova] Creating event network-changed:330b1033-47da-4b0e-a155-9a8675c1c800 for instance 2abf04af-7489-41b2-8576-dc7e5759df8e on n-h1-852084-5 Aug 27 03:43:43.559409 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-ccb0fb3e-471e-4ed4-9abc-5b62a50eb099 req-f0658b46-06d2-4580-8114-b6a941711b8a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109939 Aug 27 03:43:43.568429 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3638/7092] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:44.906524 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 53082. Aug 27 03:43:44.911532 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 53078. Aug 27 03:43:44.940523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-864584dd-ffe3-499b-b984-736433f280dc tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:44.941243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-864584dd-ffe3-499b-b984-736433f280dc tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:44.948966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864584dd-ffe3-499b-b984-736433f280dc tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:44.949648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864584dd-ffe3-499b-b984-736433f280dc tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:44.950210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864584dd-ffe3-499b-b984-736433f280dc tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:44.951009 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864584dd-ffe3-499b-b984-736433f280dc tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:44.951560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864584dd-ffe3-499b-b984-736433f280dc tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:44.952082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-864584dd-ffe3-499b-b984-736433f280dc tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:44.967629 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8c593112-3fa1-4c1c-b857-c234c2103d7b req-3ebbca93-2094-4864-b0d6-1cd4a01ff393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abf04af-7489-41b2-8576-dc7e5759df8e", "tag": "330b1033-47da-4b0e-a155-9a8675c1c800"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:44.986693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8c593112-3fa1-4c1c-b857-c234c2103d7b req-3ebbca93-2094-4864-b0d6-1cd4a01ff393 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:44.987167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8c593112-3fa1-4c1c-b857-c234c2103d7b req-3ebbca93-2094-4864-b0d6-1cd4a01ff393 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:44.987802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8c593112-3fa1-4c1c-b857-c234c2103d7b req-3ebbca93-2094-4864-b0d6-1cd4a01ff393 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:44.999413 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8c593112-3fa1-4c1c-b857-c234c2103d7b req-3ebbca93-2094-4864-b0d6-1cd4a01ff393 service nova] Creating event network-changed:330b1033-47da-4b0e-a155-9a8675c1c800 for instance 2abf04af-7489-41b2-8576-dc7e5759df8e on n-h1-852084-5 Aug 27 03:43:45.005505 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8c593112-3fa1-4c1c-b857-c234c2103d7b req-3ebbca93-2094-4864-b0d6-1cd4a01ff393 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118543 Aug 27 03:43:45.006235 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3455/7093] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:45.069403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-864584dd-ffe3-499b-b984-736433f280dc tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lazy-loading 'services' on Instance uuid 2abf04af-7489-41b2-8576-dc7e5759df8e {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:43:45.154064 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-864584dd-ffe3-499b-b984-736433f280dc tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "DELETE /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments/a27b7cfd-7434-4cb1-b41c-c5010872dba9" status: 202 len: 0 microversion: 2.1 time: 0.217552 Aug 27 03:43:45.158235 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3639/7094] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:43:44 2022] DELETE /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments/a27b7cfd-7434-4cb1-b41c-c5010872dba9 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:43:45.165469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-11c90bfb-8fd7-4b16-823c-9b0c66905f26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:45.168263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-11c90bfb-8fd7-4b16-823c-9b0c66905f26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:45.179942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11c90bfb-8fd7-4b16-823c-9b0c66905f26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:45.180747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11c90bfb-8fd7-4b16-823c-9b0c66905f26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:45.181209 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11c90bfb-8fd7-4b16-823c-9b0c66905f26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:45.182653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11c90bfb-8fd7-4b16-823c-9b0c66905f26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:45.183313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11c90bfb-8fd7-4b16-823c-9b0c66905f26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:45.184257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-11c90bfb-8fd7-4b16-823c-9b0c66905f26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:45.225148 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-11c90bfb-8fd7-4b16-823c-9b0c66905f26 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065100 Aug 27 03:43:45.225753 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3456/7095] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:43:45 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:46.240183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5157ecb2-e9fc-4a5a-bb29-11aca64a521f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:46.242429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5157ecb2-e9fc-4a5a-bb29-11aca64a521f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:46.249130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5157ecb2-e9fc-4a5a-bb29-11aca64a521f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:46.249623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5157ecb2-e9fc-4a5a-bb29-11aca64a521f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:46.250093 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5157ecb2-e9fc-4a5a-bb29-11aca64a521f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:46.250839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5157ecb2-e9fc-4a5a-bb29-11aca64a521f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:46.251252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5157ecb2-e9fc-4a5a-bb29-11aca64a521f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:46.251679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5157ecb2-e9fc-4a5a-bb29-11aca64a521f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:46.282901 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5157ecb2-e9fc-4a5a-bb29-11aca64a521f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048889 Aug 27 03:43:46.283478 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3640/7096] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:43:46 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:47.296437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7d30164-f369-45b2-802d-d4a140fe9564 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:47.298812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7d30164-f369-45b2-802d-d4a140fe9564 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:47.306924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d30164-f369-45b2-802d-d4a140fe9564 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:47.307431 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d30164-f369-45b2-802d-d4a140fe9564 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:47.307890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d30164-f369-45b2-802d-d4a140fe9564 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:47.308622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d30164-f369-45b2-802d-d4a140fe9564 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:47.309101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d30164-f369-45b2-802d-d4a140fe9564 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:47.309558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7d30164-f369-45b2-802d-d4a140fe9564 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:47.342976 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7d30164-f369-45b2-802d-d4a140fe9564 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050899 Aug 27 03:43:47.343576 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3457/7097] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:43:47 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:48.355867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6d530084-643a-48f3-8c8c-135392355bbb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:48.358241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6d530084-643a-48f3-8c8c-135392355bbb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:48.366225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d530084-643a-48f3-8c8c-135392355bbb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:48.366880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d530084-643a-48f3-8c8c-135392355bbb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:48.367334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d530084-643a-48f3-8c8c-135392355bbb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:48.368063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d530084-643a-48f3-8c8c-135392355bbb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:48.368559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d530084-643a-48f3-8c8c-135392355bbb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:48.368987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6d530084-643a-48f3-8c8c-135392355bbb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:48.404553 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6d530084-643a-48f3-8c8c-135392355bbb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052874 Aug 27 03:43:48.405143 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3641/7098] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:43:48 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:49.417478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5ada55c7-86f5-40c6-a9da-7b0ea6b27915 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:49.419769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5ada55c7-86f5-40c6-a9da-7b0ea6b27915 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:49.427476 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ada55c7-86f5-40c6-a9da-7b0ea6b27915 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:49.427996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ada55c7-86f5-40c6-a9da-7b0ea6b27915 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:49.428835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ada55c7-86f5-40c6-a9da-7b0ea6b27915 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:49.429651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ada55c7-86f5-40c6-a9da-7b0ea6b27915 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:49.430151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ada55c7-86f5-40c6-a9da-7b0ea6b27915 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:49.430600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5ada55c7-86f5-40c6-a9da-7b0ea6b27915 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:49.464713 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5ada55c7-86f5-40c6-a9da-7b0ea6b27915 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051049 Aug 27 03:43:49.465206 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3458/7099] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:43:49 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:50.477115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-003d71c6-9404-4c44-8620-d3c2e9610df8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:50.479332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-003d71c6-9404-4c44-8620-d3c2e9610df8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:50.486378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-003d71c6-9404-4c44-8620-d3c2e9610df8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:50.486871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-003d71c6-9404-4c44-8620-d3c2e9610df8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:50.487321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-003d71c6-9404-4c44-8620-d3c2e9610df8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:50.488523 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-003d71c6-9404-4c44-8620-d3c2e9610df8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:50.488989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-003d71c6-9404-4c44-8620-d3c2e9610df8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:50.489423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-003d71c6-9404-4c44-8620-d3c2e9610df8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:50.519265 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-003d71c6-9404-4c44-8620-d3c2e9610df8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046234 Aug 27 03:43:50.519844 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3642/7100] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:43:50 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:43:50.530527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:50.531070 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:50.538404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:50.538900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:50.539386 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:50.540096 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:50.540567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:50.541009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:50.619215 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] HTTP exception thrown: Instance 2abf04af-7489-41b2-8576-dc7e5759df8e is not attached to volume a27b7cfd-7434-4cb1-b41c-c5010872dba9 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Request method failure captured: Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments/a27b7cfd-7434-4cb1-b41c-c5010872dba9 HTTP/1.1 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZIOd-x7tgjdJJ6V6t36WN0ThXp9UaEElkkn-nd8itSzeeuU1nLf40_r-Ax266Uz_nh93nKLC5qLnpV4uWWU8PeGjNkKNqz8MGmESKSqbdaEo2bwA_5_EFkx7Jx2tiMaCXq9YFx-etcdRxVf02KYnfPaXwPYmLYwn3byrFmMmEHL4NI Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 1aff73dc8b0c494798062c2b92dc8ec5 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1aff73dc8b0c494798062c2b92dc8ec5"}]}] Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 1aff73dc8b0c494798062c2b92dc8ec5 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestMinimumBasicScenario-90992889-project Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 2f93163091014ae282245f274e02ab55 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestMinimumBasicScenario-90992889-project Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 2abf04af-7489-41b2-8576-dc7e5759df8e is not attached to volume a27b7cfd-7434-4cb1-b41c-c5010872dba9 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': '2abf04af-7489-41b2-8576-dc7e5759df8e', 'id': 'a27b7cfd-7434-4cb1-b41c-c5010872dba9'} Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a27b7cfd-7434-4cb1-b41c-c5010872dba9. Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abf04af-7489-41b2-8576-dc7e5759df8e is not attached to volume a27b7cfd-7434-4cb1-b41c-c5010872dba9 Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:50.621182 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:50.626292 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:50.626292 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:50.626292 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abf04af-7489-41b2-8576-dc7e5759df8e is not attached to volume a27b7cfd-7434-4cb1-b41c-c5010872dba9 Aug 27 03:43:50.626292 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:43:50.626292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Returning 404 to user: Instance 2abf04af-7489-41b2-8576-dc7e5759df8e is not attached to volume a27b7cfd-7434-4cb1-b41c-c5010872dba9 {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:50.626292 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-79574b5e-aab2-4a63-ad95-219b58c4ee8a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "DELETE /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments/a27b7cfd-7434-4cb1-b41c-c5010872dba9" status: 404 len: 154 microversion: 2.1 time: 0.096274 Aug 27 03:43:50.626292 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3459/7101] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:43:50 2022] DELETE /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e/os-volume_attachments/a27b7cfd-7434-4cb1-b41c-c5010872dba9 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:43:53.870099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-817cfbdd-6a87-418d-886e-13d4998a5187 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:53.870640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-817cfbdd-6a87-418d-886e-13d4998a5187 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:53.877607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-817cfbdd-6a87-418d-886e-13d4998a5187 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:53.878118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-817cfbdd-6a87-418d-886e-13d4998a5187 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:53.878592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-817cfbdd-6a87-418d-886e-13d4998a5187 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:53.879284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-817cfbdd-6a87-418d-886e-13d4998a5187 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:53.879741 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-817cfbdd-6a87-418d-886e-13d4998a5187 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:53.880168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-817cfbdd-6a87-418d-886e-13d4998a5187 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:53.908861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-817cfbdd-6a87-418d-886e-13d4998a5187 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:43:53.988889 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-817cfbdd-6a87-418d-886e-13d4998a5187 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "DELETE /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 204 len: 0 microversion: 2.1 time: 0.122362 Aug 27 03:43:53.990196 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3643/7102] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:43:53 2022] DELETE /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:43:53.999984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b652cb80-5ad1-4d82-b2dd-bc92d223c1e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:54.000652 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b652cb80-5ad1-4d82-b2dd-bc92d223c1e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:54.009447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b652cb80-5ad1-4d82-b2dd-bc92d223c1e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.009995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b652cb80-5ad1-4d82-b2dd-bc92d223c1e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.010454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b652cb80-5ad1-4d82-b2dd-bc92d223c1e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.011181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b652cb80-5ad1-4d82-b2dd-bc92d223c1e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:54.011672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b652cb80-5ad1-4d82-b2dd-bc92d223c1e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:54.012119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b652cb80-5ad1-4d82-b2dd-bc92d223c1e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:54.151934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b652cb80-5ad1-4d82-b2dd-bc92d223c1e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:54.160516 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b652cb80-5ad1-4d82-b2dd-bc92d223c1e5 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1554 microversion: 2.1 time: 0.164336 Aug 27 03:43:54.161742 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3460/7103] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:53 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:55.183719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-51e1b0c6-c5e5-4d22-b303-fee3bb6ffaab tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:55.184434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-51e1b0c6-c5e5-4d22-b303-fee3bb6ffaab tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:55.191364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51e1b0c6-c5e5-4d22-b303-fee3bb6ffaab tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:55.191853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51e1b0c6-c5e5-4d22-b303-fee3bb6ffaab tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:55.192298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51e1b0c6-c5e5-4d22-b303-fee3bb6ffaab tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:55.192996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51e1b0c6-c5e5-4d22-b303-fee3bb6ffaab tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:55.193459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51e1b0c6-c5e5-4d22-b303-fee3bb6ffaab tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:55.193919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-51e1b0c6-c5e5-4d22-b303-fee3bb6ffaab tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:55.342301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-51e1b0c6-c5e5-4d22-b303-fee3bb6ffaab tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:55.351160 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-51e1b0c6-c5e5-4d22-b303-fee3bb6ffaab tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1554 microversion: 2.1 time: 0.171816 Aug 27 03:43:55.351763 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3644/7104] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:55 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:56.176509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-71326229-e9e0-4d5f-ba77-8164cd076884 req-c1dbd7cd-9044-4455-86cc-178068bda9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abf04af-7489-41b2-8576-dc7e5759df8e", "name": "network-vif-deleted", "tag": "330b1033-47da-4b0e-a155-9a8675c1c800"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:43:56.187396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-71326229-e9e0-4d5f-ba77-8164cd076884 req-c1dbd7cd-9044-4455-86cc-178068bda9e9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:56.187900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-71326229-e9e0-4d5f-ba77-8164cd076884 req-c1dbd7cd-9044-4455-86cc-178068bda9e9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:56.188351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-71326229-e9e0-4d5f-ba77-8164cd076884 req-c1dbd7cd-9044-4455-86cc-178068bda9e9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:56.201598 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-71326229-e9e0-4d5f-ba77-8164cd076884 req-c1dbd7cd-9044-4455-86cc-178068bda9e9 service nova] Creating event network-vif-deleted:330b1033-47da-4b0e-a155-9a8675c1c800 for instance 2abf04af-7489-41b2-8576-dc7e5759df8e on n-h1-852084-5 Aug 27 03:43:56.206848 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-71326229-e9e0-4d5f-ba77-8164cd076884 req-c1dbd7cd-9044-4455-86cc-178068bda9e9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034851 Aug 27 03:43:56.207452 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3461/7105] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:43:56.373403 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:56.374060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:56.381151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:56.381582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:56.382054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:56.382754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:56.384418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:56.385044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:56.417247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:56.417763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:56.418199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:56.418649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lazy-loading 'fault' on Instance uuid 2abf04af-7489-41b2-8576-dc7e5759df8e {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:43:56.465035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:43:56.473201 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2e1165ba-920a-4230-8785-028fe19da64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 200 len: 1347 microversion: 2.1 time: 0.104029 Aug 27 03:43:56.473815 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3645/7106] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:56 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 1347 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:43:57.496126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:57.496853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 2abf04af-7489-41b2-8576-dc7e5759df8e] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:43:57.503089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:57.504081 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:57.504539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:57.505248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:43:57.505843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:43:57.506295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:43:57.520445 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] HTTP exception thrown: Instance 2abf04af-7489-41b2-8576-dc7e5759df8e could not be found. Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Request method failure captured: Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e HTTP/1.1 Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZIOd-x7tgjdJJ6V6t36WN0ThXp9UaEElkkn-nd8itSzeeuU1nLf40_r-Ax266Uz_nh93nKLC5qLnpV4uWWU8PeGjNkKNqz8MGmESKSqbdaEo2bwA_5_EFkx7Jx2tiMaCXq9YFx-etcdRxVf02KYnfPaXwPYmLYwn3byrFmMmEHL4NI Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 1aff73dc8b0c494798062c2b92dc8ec5 Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1aff73dc8b0c494798062c2b92dc8ec5"}]}] Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 1aff73dc8b0c494798062c2b92dc8ec5 Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestMinimumBasicScenario-90992889-project Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 2f93163091014ae282245f274e02ab55 Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestMinimumBasicScenario-90992889-project Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 2abf04af-7489-41b2-8576-dc7e5759df8e could not be found. Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '2abf04af-7489-41b2-8576-dc7e5759df8e'} Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2abf04af-7489-41b2-8576-dc7e5759df8e could not be found. Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2abf04af-7489-41b2-8576-dc7e5759df8e could not be found. Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:43:57.522252 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:43:57.527101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:43:57.527101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:43:57.527101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:43:57.527101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:43:57.527101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:43:57.527101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2abf04af-7489-41b2-8576-dc7e5759df8e could not be found. Aug 27 03:43:57.527101 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:43:57.527101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Returning 404 to user: Instance 2abf04af-7489-41b2-8576-dc7e5759df8e could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:43:57.527101 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c7809c6-02fa-4322-95a4-8c7c390f80f4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e" status: 404 len: 111 microversion: 2.1 time: 0.032758 Aug 27 03:43:57.527101 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3462/7107] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:43:57 2022] GET /compute/v2.1/servers/2abf04af-7489-41b2-8576-dc7e5759df8e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:43:57.532548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-912fe44d-1517-4b7c-8dc5-0189fe7b7037 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '.version_select at 0x7f4d293a7940>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:43:57.552834 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-912fe44d-1517-4b7c-8dc5-0189fe7b7037 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-133261259" status: 202 len: 0 microversion: 2.1 time: 0.024144 Aug 27 03:43:57.553422 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3646/7108] 10.222.0.99 () {58 vars in 1269 bytes} [Sat Aug 27 03:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-133261259 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:44:06.527423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8cee8372-b351-4712-b1ba-ee7195ccf6d0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'create', calling method: .version_select at 0x7f4d29e67af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1854181971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVzyp+HmCowZvOI8+mH9XUGtKCSKT/j2VaqZZDTMFLCK9VA6vnPbCtq6vetH+KRAAu4g1bNFReqZwY1eA7UsK7UG9rr64J2Rx2gm9gjEPG6ZIYAkfbQyxKMS8LGke1iuw=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:06.545985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-8cee8372-b351-4712-b1ba-ee7195ccf6d0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Getting quotas for project 1aff73dc8b0c494798062c2b92dc8ec5. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:44:06.552234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-8cee8372-b351-4712-b1ba-ee7195ccf6d0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Getting quotas for user 2f93163091014ae282245f274e02ab55 and project 1aff73dc8b0c494798062c2b92dc8ec5. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:44:06.583270 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8cee8372-b351-4712-b1ba-ee7195ccf6d0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059759 Aug 27 03:44:06.583876 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3463/7109] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:44:06 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:06.641376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:06.646551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1534177328", "imageRef": "03a5a6e4-542a-4d97-b8af-1f9675307ba3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1854181971", "networks": [{"uuid": "2708e65f-1c69-4ce2-bd9d-c14caba737cf"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:06.720097 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] validate_networks() for [('2708e65f-1c69-4ce2-bd9d-c14caba737cf', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:44:07.177939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:44:07.178367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:44:07.178853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:44:07.179266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:44:07.179722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:44:07.188770 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:07.189259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:07.189718 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:07.190989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:07.191445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:07.191872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:07.211044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Getting quotas for project 1aff73dc8b0c494798062c2b92dc8ec5. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:44:07.216813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Getting quotas for user 2f93163091014ae282245f274e02ab55 and project 1aff73dc8b0c494798062c2b92dc8ec5. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:44:07.229937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:44:07.232206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='03a5a6e4-542a-4d97-b8af-1f9675307ba3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:44:07.283125 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9f9bcee0-902b-4219-a8fd-b28bbf97101c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643553 Aug 27 03:44:07.283812 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3647/7110] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:44:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:44:07.295848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-43ba9f49-65ef-4014-af9d-dea4dc413b56 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:07.296477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-43ba9f49-65ef-4014-af9d-dea4dc413b56 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:07.354340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-43ba9f49-65ef-4014-af9d-dea4dc413b56 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:07.361504 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-43ba9f49-65ef-4014-af9d-dea4dc413b56 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1259 microversion: 2.1 time: 0.069932 Aug 27 03:44:07.362130 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3464/7111] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:07 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:08.383447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70c55590-ebae-46bd-865a-08adabe75e34 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:08.384873 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-70c55590-ebae-46bd-865a-08adabe75e34 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:08.394662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70c55590-ebae-46bd-865a-08adabe75e34 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:08.395240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70c55590-ebae-46bd-865a-08adabe75e34 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:08.395684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70c55590-ebae-46bd-865a-08adabe75e34 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:08.396967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70c55590-ebae-46bd-865a-08adabe75e34 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:08.397704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70c55590-ebae-46bd-865a-08adabe75e34 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:08.398513 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70c55590-ebae-46bd-865a-08adabe75e34 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:08.517574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-70c55590-ebae-46bd-865a-08adabe75e34 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:08.526461 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70c55590-ebae-46bd-865a-08adabe75e34 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1329 microversion: 2.1 time: 0.147159 Aug 27 03:44:08.527071 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3648/7112] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:08 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1329 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:44:09.560394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a34f2828-54fd-421a-8506-cb47ab43d9da tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:09.561247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a34f2828-54fd-421a-8506-cb47ab43d9da tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:09.563522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=40 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:09.591748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a34f2828-54fd-421a-8506-cb47ab43d9da tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:09.592651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a34f2828-54fd-421a-8506-cb47ab43d9da tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:09.593460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a34f2828-54fd-421a-8506-cb47ab43d9da tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:09.607687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a34f2828-54fd-421a-8506-cb47ab43d9da tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:09.608859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a34f2828-54fd-421a-8506-cb47ab43d9da tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:09.609690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a34f2828-54fd-421a-8506-cb47ab43d9da tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:09.792759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a34f2828-54fd-421a-8506-cb47ab43d9da tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:09.802371 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a34f2828-54fd-421a-8506-cb47ab43d9da tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.245886 Aug 27 03:44:09.802973 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3465/7113] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:09 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:10.824512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0f91cc7f-7346-4e6c-af45-8ab5011d12f3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:10.825138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0f91cc7f-7346-4e6c-af45-8ab5011d12f3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:10.833203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f91cc7f-7346-4e6c-af45-8ab5011d12f3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:10.833722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f91cc7f-7346-4e6c-af45-8ab5011d12f3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:10.834173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f91cc7f-7346-4e6c-af45-8ab5011d12f3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:10.834893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f91cc7f-7346-4e6c-af45-8ab5011d12f3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:10.835363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f91cc7f-7346-4e6c-af45-8ab5011d12f3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:10.835803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0f91cc7f-7346-4e6c-af45-8ab5011d12f3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:11.000833 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0f91cc7f-7346-4e6c-af45-8ab5011d12f3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:11.011928 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0f91cc7f-7346-4e6c-af45-8ab5011d12f3 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.191233 Aug 27 03:44:11.012479 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3649/7114] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:10 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:12.032745 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e086820-3440-416b-aa1f-56e75bbf1dda tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:12.033433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e086820-3440-416b-aa1f-56e75bbf1dda tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:12.045716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e086820-3440-416b-aa1f-56e75bbf1dda tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:12.046505 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e086820-3440-416b-aa1f-56e75bbf1dda tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:12.046951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e086820-3440-416b-aa1f-56e75bbf1dda tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:12.047888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e086820-3440-416b-aa1f-56e75bbf1dda tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:12.048518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e086820-3440-416b-aa1f-56e75bbf1dda tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:12.048971 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e086820-3440-416b-aa1f-56e75bbf1dda tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:12.223741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6e086820-3440-416b-aa1f-56e75bbf1dda tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:12.232473 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e086820-3440-416b-aa1f-56e75bbf1dda tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.203653 Aug 27 03:44:12.234365 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3466/7115] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:12 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:13.254034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3c4ed0e5-4100-4f8f-a1e3-2d9bb03db3e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:13.254661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3c4ed0e5-4100-4f8f-a1e3-2d9bb03db3e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:13.262564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c4ed0e5-4100-4f8f-a1e3-2d9bb03db3e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:13.263597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c4ed0e5-4100-4f8f-a1e3-2d9bb03db3e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:13.264413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c4ed0e5-4100-4f8f-a1e3-2d9bb03db3e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:13.265405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c4ed0e5-4100-4f8f-a1e3-2d9bb03db3e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:13.266210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c4ed0e5-4100-4f8f-a1e3-2d9bb03db3e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:13.267226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3c4ed0e5-4100-4f8f-a1e3-2d9bb03db3e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:13.456959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3c4ed0e5-4100-4f8f-a1e3-2d9bb03db3e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:13.465685 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3c4ed0e5-4100-4f8f-a1e3-2d9bb03db3e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.215607 Aug 27 03:44:13.466288 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3650/7116] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:13 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:14.493824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f23a46dd-a596-4506-aadf-24eda605b866 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:14.494858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f23a46dd-a596-4506-aadf-24eda605b866 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:14.506658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:14.509467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f23a46dd-a596-4506-aadf-24eda605b866 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:14.510391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f23a46dd-a596-4506-aadf-24eda605b866 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:14.511196 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f23a46dd-a596-4506-aadf-24eda605b866 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:14.512432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f23a46dd-a596-4506-aadf-24eda605b866 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:14.513274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f23a46dd-a596-4506-aadf-24eda605b866 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:14.514306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f23a46dd-a596-4506-aadf-24eda605b866 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:14.686165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f23a46dd-a596-4506-aadf-24eda605b866 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:14.696718 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f23a46dd-a596-4506-aadf-24eda605b866 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.210265 Aug 27 03:44:14.706995 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3467/7117] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:14 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:15.720859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-575eabe1-41e8-4c79-9e54-32996017bafa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:15.722144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-575eabe1-41e8-4c79-9e54-32996017bafa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:15.724918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:15.730646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-575eabe1-41e8-4c79-9e54-32996017bafa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:15.731142 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-575eabe1-41e8-4c79-9e54-32996017bafa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:15.731589 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-575eabe1-41e8-4c79-9e54-32996017bafa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:15.732305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-575eabe1-41e8-4c79-9e54-32996017bafa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:15.732767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-575eabe1-41e8-4c79-9e54-32996017bafa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:15.733209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-575eabe1-41e8-4c79-9e54-32996017bafa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:15.881561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-575eabe1-41e8-4c79-9e54-32996017bafa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:15.890241 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-575eabe1-41e8-4c79-9e54-32996017bafa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.173493 Aug 27 03:44:15.890838 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3651/7118] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:15 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:44:16.900429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d417937f-d70a-4942-a61d-67e92aa4c114 req-121b74fb-865e-4922-a048-9d2366f2153d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6caf8c55-2143-4782-b658-22b9a2aec189", "tag": "8c82bb9f-ffcf-4587-b0b3-ab271327dc45"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:16.913841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d92964f6-d307-4e75-86a7-0bf1a447f37d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:16.915145 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d92964f6-d307-4e75-86a7-0bf1a447f37d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:16.927351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d92964f6-d307-4e75-86a7-0bf1a447f37d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:16.927612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d417937f-d70a-4942-a61d-67e92aa4c114 req-121b74fb-865e-4922-a048-9d2366f2153d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:16.927864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d92964f6-d307-4e75-86a7-0bf1a447f37d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:16.927986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d417937f-d70a-4942-a61d-67e92aa4c114 req-121b74fb-865e-4922-a048-9d2366f2153d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:16.928382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d92964f6-d307-4e75-86a7-0bf1a447f37d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:16.928620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d417937f-d70a-4942-a61d-67e92aa4c114 req-121b74fb-865e-4922-a048-9d2366f2153d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:16.929298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d92964f6-d307-4e75-86a7-0bf1a447f37d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:16.929800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d92964f6-d307-4e75-86a7-0bf1a447f37d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:16.930238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d92964f6-d307-4e75-86a7-0bf1a447f37d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:16.942252 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d417937f-d70a-4942-a61d-67e92aa4c114 req-121b74fb-865e-4922-a048-9d2366f2153d service nova] Creating event network-changed:8c82bb9f-ffcf-4587-b0b3-ab271327dc45 for instance 6caf8c55-2143-4782-b658-22b9a2aec189 on n-h2-852084-5 Aug 27 03:44:16.949309 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d417937f-d70a-4942-a61d-67e92aa4c114 req-121b74fb-865e-4922-a048-9d2366f2153d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052777 Aug 27 03:44:16.950629 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3468/7119] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:17.200457 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:17.218326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d92964f6-d307-4e75-86a7-0bf1a447f37d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:17.225095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:17.228110 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d92964f6-d307-4e75-86a7-0bf1a447f37d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.320011 Aug 27 03:44:17.228772 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3652/7120] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:16 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:18.251113 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7cee8889-6a87-4cd1-b06b-4816fad89d4f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:18.252068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7cee8889-6a87-4cd1-b06b-4816fad89d4f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:18.254798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:18.261497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cee8889-6a87-4cd1-b06b-4816fad89d4f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:18.261956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cee8889-6a87-4cd1-b06b-4816fad89d4f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:18.262418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cee8889-6a87-4cd1-b06b-4816fad89d4f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:18.263146 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cee8889-6a87-4cd1-b06b-4816fad89d4f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:18.263630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cee8889-6a87-4cd1-b06b-4816fad89d4f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:18.264084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7cee8889-6a87-4cd1-b06b-4816fad89d4f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:18.411816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7cee8889-6a87-4cd1-b06b-4816fad89d4f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:18.421105 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7cee8889-6a87-4cd1-b06b-4816fad89d4f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.174649 Aug 27 03:44:18.421926 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3469/7121] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:18 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:19.444280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a283efd9-167d-4d30-987a-8a9b3a7908c9 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:19.444950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a283efd9-167d-4d30-987a-8a9b3a7908c9 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:19.453320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a283efd9-167d-4d30-987a-8a9b3a7908c9 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:19.453847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a283efd9-167d-4d30-987a-8a9b3a7908c9 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:19.454299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a283efd9-167d-4d30-987a-8a9b3a7908c9 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:19.455030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a283efd9-167d-4d30-987a-8a9b3a7908c9 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:19.455511 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a283efd9-167d-4d30-987a-8a9b3a7908c9 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:19.455948 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a283efd9-167d-4d30-987a-8a9b3a7908c9 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:19.613904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a283efd9-167d-4d30-987a-8a9b3a7908c9 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:19.622434 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a283efd9-167d-4d30-987a-8a9b3a7908c9 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.182913 Aug 27 03:44:19.623168 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3653/7122] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:19 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:20.644750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-8001b191-0c13-430c-9ea4-55a51db14031 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:20.645416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-8001b191-0c13-430c-9ea4-55a51db14031 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:20.653551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8001b191-0c13-430c-9ea4-55a51db14031 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:20.654097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8001b191-0c13-430c-9ea4-55a51db14031 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:20.654578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8001b191-0c13-430c-9ea4-55a51db14031 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:20.655327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8001b191-0c13-430c-9ea4-55a51db14031 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:20.655803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8001b191-0c13-430c-9ea4-55a51db14031 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:20.656249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-8001b191-0c13-430c-9ea4-55a51db14031 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:20.805524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-8001b191-0c13-430c-9ea4-55a51db14031 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:20.814041 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-8001b191-0c13-430c-9ea4-55a51db14031 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.173654 Aug 27 03:44:20.814650 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3470/7123] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:20 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:21.767620 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-673d2528-0050-436f-8307-36437f24f353 req-1442d6d4-852c-4171-a538-4a566e5bf092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caf8c55-2143-4782-b658-22b9a2aec189", "name": "network-vif-plugged", "status": "completed", "tag": "8c82bb9f-ffcf-4587-b0b3-ab271327dc45"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:21.791129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-673d2528-0050-436f-8307-36437f24f353 req-1442d6d4-852c-4171-a538-4a566e5bf092 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:21.792005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-673d2528-0050-436f-8307-36437f24f353 req-1442d6d4-852c-4171-a538-4a566e5bf092 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:21.792449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-673d2528-0050-436f-8307-36437f24f353 req-1442d6d4-852c-4171-a538-4a566e5bf092 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:21.806340 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-673d2528-0050-436f-8307-36437f24f353 req-1442d6d4-852c-4171-a538-4a566e5bf092 service nova] Creating event network-vif-plugged:8c82bb9f-ffcf-4587-b0b3-ab271327dc45 for instance 6caf8c55-2143-4782-b658-22b9a2aec189 on n-h2-852084-5 Aug 27 03:44:21.811790 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-673d2528-0050-436f-8307-36437f24f353 req-1442d6d4-852c-4171-a538-4a566e5bf092 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128450 Aug 27 03:44:21.812523 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3654/7124] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:21.836618 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-98471731-9373-449b-9f79-fbfd0ee9aacd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:21.837338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-98471731-9373-449b-9f79-fbfd0ee9aacd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:21.844909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98471731-9373-449b-9f79-fbfd0ee9aacd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:21.845428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98471731-9373-449b-9f79-fbfd0ee9aacd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:21.845910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98471731-9373-449b-9f79-fbfd0ee9aacd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:21.847264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98471731-9373-449b-9f79-fbfd0ee9aacd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:21.847740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98471731-9373-449b-9f79-fbfd0ee9aacd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:21.848186 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98471731-9373-449b-9f79-fbfd0ee9aacd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:22.004551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-98471731-9373-449b-9f79-fbfd0ee9aacd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:22.017592 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-98471731-9373-449b-9f79-fbfd0ee9aacd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.184412 Aug 27 03:44:22.019163 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3471/7125] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:21 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:44:23.053975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94759b2a-14db-4cb4-b3c1-38c09405c10a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:23.054867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-94759b2a-14db-4cb4-b3c1-38c09405c10a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:23.062815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94759b2a-14db-4cb4-b3c1-38c09405c10a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:23.063451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94759b2a-14db-4cb4-b3c1-38c09405c10a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:23.063960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94759b2a-14db-4cb4-b3c1-38c09405c10a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:23.064774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94759b2a-14db-4cb4-b3c1-38c09405c10a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:23.065267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94759b2a-14db-4cb4-b3c1-38c09405c10a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:23.065793 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94759b2a-14db-4cb4-b3c1-38c09405c10a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:23.226173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-94759b2a-14db-4cb4-b3c1-38c09405c10a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:23.234420 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-94759b2a-14db-4cb4-b3c1-38c09405c10a tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1359 microversion: 2.1 time: 0.186549 Aug 27 03:44:23.235022 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3655/7126] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:23 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:24.257343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-670f31a9-4102-4d49-b6ba-352b6e2439b4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:24.260301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-670f31a9-4102-4d49-b6ba-352b6e2439b4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:24.268163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-670f31a9-4102-4d49-b6ba-352b6e2439b4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.268717 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-670f31a9-4102-4d49-b6ba-352b6e2439b4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.269457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-670f31a9-4102-4d49-b6ba-352b6e2439b4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.270411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-670f31a9-4102-4d49-b6ba-352b6e2439b4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.270888 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-670f31a9-4102-4d49-b6ba-352b6e2439b4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.271340 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-670f31a9-4102-4d49-b6ba-352b6e2439b4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.433230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-670f31a9-4102-4d49-b6ba-352b6e2439b4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:24.442174 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-670f31a9-4102-4d49-b6ba-352b6e2439b4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1549 microversion: 2.1 time: 0.189637 Aug 27 03:44:24.442796 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3472/7127] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:24 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1549 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:44:24.463467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ad604c9a-405f-4deb-9a12-6c9155dd647f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:24.464099 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ad604c9a-405f-4deb-9a12-6c9155dd647f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:24.472680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad604c9a-405f-4deb-9a12-6c9155dd647f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.473187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad604c9a-405f-4deb-9a12-6c9155dd647f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.473644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad604c9a-405f-4deb-9a12-6c9155dd647f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.474427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad604c9a-405f-4deb-9a12-6c9155dd647f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.474912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad604c9a-405f-4deb-9a12-6c9155dd647f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.475348 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ad604c9a-405f-4deb-9a12-6c9155dd647f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.635010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ad604c9a-405f-4deb-9a12-6c9155dd647f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:24.644543 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ad604c9a-405f-4deb-9a12-6c9155dd647f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1549 microversion: 2.1 time: 0.185275 Aug 27 03:44:24.645178 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3656/7128] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:24 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1549 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:24.666998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2df90c9a-1c4a-4126-9cf9-0a5a7d8dd69d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:24.672112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2df90c9a-1c4a-4126-9cf9-0a5a7d8dd69d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:24.672901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2df90c9a-1c4a-4126-9cf9-0a5a7d8dd69d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Searching by: {'deleted': False, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5'} {{(pid=122487) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 27 03:44:24.678842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2df90c9a-1c4a-4126-9cf9-0a5a7d8dd69d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.679331 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2df90c9a-1c4a-4126-9cf9-0a5a7d8dd69d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.679808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2df90c9a-1c4a-4126-9cf9-0a5a7d8dd69d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.680548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2df90c9a-1c4a-4126-9cf9-0a5a7d8dd69d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.681015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2df90c9a-1c4a-4126-9cf9-0a5a7d8dd69d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.681446 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2df90c9a-1c4a-4126-9cf9-0a5a7d8dd69d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.709009 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.multi_cell_list [None req-2df90c9a-1c4a-4126-9cf9-0a5a7d8dd69d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122487) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 27 03:44:24.742063 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2df90c9a-1c4a-4126-9cf9-0a5a7d8dd69d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.079318 Aug 27 03:44:24.742806 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3473/7129] 10.222.0.99 () {58 vars in 1125 bytes} [Sat Aug 27 03:44:24 2022] GET /compute/v2.1/servers => generated 343 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:24.755381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-944dc493-ae77-4435-aff1-134537e4c819 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:24.756071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-944dc493-ae77-4435-aff1-134537e4c819 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:24.763336 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-944dc493-ae77-4435-aff1-134537e4c819 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.763832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-944dc493-ae77-4435-aff1-134537e4c819 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.764275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-944dc493-ae77-4435-aff1-134537e4c819 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.765006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-944dc493-ae77-4435-aff1-134537e4c819 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:24.765465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-944dc493-ae77-4435-aff1-134537e4c819 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:24.765935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-944dc493-ae77-4435-aff1-134537e4c819 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:24.919288 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-944dc493-ae77-4435-aff1-134537e4c819 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:24.927504 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-944dc493-ae77-4435-aff1-134537e4c819 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1549 microversion: 2.1 time: 0.176614 Aug 27 03:44:24.928122 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3657/7130] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:24 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:26.574673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-33289f6c-e18e-4da7-aec3-cbaa684457f8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89cb0a79-d524-445a-9c1b-95a8b4fcedf2"}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:26.577202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-33289f6c-e18e-4da7-aec3-cbaa684457f8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:26.585662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33289f6c-e18e-4da7-aec3-cbaa684457f8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:26.586276 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33289f6c-e18e-4da7-aec3-cbaa684457f8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:26.586780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33289f6c-e18e-4da7-aec3-cbaa684457f8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:26.587555 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33289f6c-e18e-4da7-aec3-cbaa684457f8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:26.588084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33289f6c-e18e-4da7-aec3-cbaa684457f8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:26.588859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-33289f6c-e18e-4da7-aec3-cbaa684457f8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:26.881530 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-33289f6c-e18e-4da7-aec3-cbaa684457f8 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310880 Aug 27 03:44:26.882184 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3474/7131] 10.222.0.99 () {60 vars in 1323 bytes} [Sat Aug 27 03:44:26 2022] POST /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:44:38.751247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5ce6c5a7-fe8a-4e0d-a8ba-e6de6c4b0c0f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:38.751858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5ce6c5a7-fe8a-4e0d-a8ba-e6de6c4b0c0f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:38.754138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=13 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:38.754973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=58 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:38.761194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ce6c5a7-fe8a-4e0d-a8ba-e6de6c4b0c0f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:38.761711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ce6c5a7-fe8a-4e0d-a8ba-e6de6c4b0c0f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:38.762165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ce6c5a7-fe8a-4e0d-a8ba-e6de6c4b0c0f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:38.762987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ce6c5a7-fe8a-4e0d-a8ba-e6de6c4b0c0f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:38.763341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ce6c5a7-fe8a-4e0d-a8ba-e6de6c4b0c0f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:38.763780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5ce6c5a7-fe8a-4e0d-a8ba-e6de6c4b0c0f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:38.905493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5ce6c5a7-fe8a-4e0d-a8ba-e6de6c4b0c0f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:38.915210 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5ce6c5a7-fe8a-4e0d-a8ba-e6de6c4b0c0f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1595 microversion: 2.1 time: 0.168107 Aug 27 03:44:38.915723 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3658/7132] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:38 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1595 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:40.973481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:40.974594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=15 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:40.975477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:40.980482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-259d86ef-ce55-4117-9aa1-37c915f5c3af req-656d07c8-4bd5-4099-ad96-c8e528ffea27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6caf8c55-2143-4782-b658-22b9a2aec189", "tag": "8c82bb9f-ffcf-4587-b0b3-ab271327dc45"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:40.994279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-259d86ef-ce55-4117-9aa1-37c915f5c3af req-656d07c8-4bd5-4099-ad96-c8e528ffea27 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:40.994764 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-259d86ef-ce55-4117-9aa1-37c915f5c3af req-656d07c8-4bd5-4099-ad96-c8e528ffea27 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:40.995460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-259d86ef-ce55-4117-9aa1-37c915f5c3af req-656d07c8-4bd5-4099-ad96-c8e528ffea27 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:41.009961 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-259d86ef-ce55-4117-9aa1-37c915f5c3af req-656d07c8-4bd5-4099-ad96-c8e528ffea27 service nova] Creating event network-changed:8c82bb9f-ffcf-4587-b0b3-ab271327dc45 for instance 6caf8c55-2143-4782-b658-22b9a2aec189 on n-h2-852084-5 Aug 27 03:44:41.016959 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-259d86ef-ce55-4117-9aa1-37c915f5c3af req-656d07c8-4bd5-4099-ad96-c8e528ffea27 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047809 Aug 27 03:44:41.018104 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3475/7133] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:42.327734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a899475f-381a-4ae9-8cc7-58e420d045c4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1291321748"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:42.328493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a899475f-381a-4ae9-8cc7-58e420d045c4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:42.336900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a899475f-381a-4ae9-8cc7-58e420d045c4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:42.337452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a899475f-381a-4ae9-8cc7-58e420d045c4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:42.337933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a899475f-381a-4ae9-8cc7-58e420d045c4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:42.338722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a899475f-381a-4ae9-8cc7-58e420d045c4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:42.339211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a899475f-381a-4ae9-8cc7-58e420d045c4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:42.340141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a899475f-381a-4ae9-8cc7-58e420d045c4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:42.489321 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.network.security_group_api [None req-a899475f-381a-4ae9-8cc7-58e420d045c4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Adding security group c1bbdbf7-51cf-4e07-9540-832bac1b7937 to port 8c82bb9f-ffcf-4587-b0b3-ab271327dc45 Aug 27 03:44:43.061011 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a899475f-381a-4ae9-8cc7-58e420d045c4 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/action" status: 202 len: 0 microversion: 2.1 time: 0.736775 Aug 27 03:44:43.067787 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3659/7134] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:44:42 2022] POST /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:44:43.074955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6bde0b8b-536f-47ad-8e60-8d813aa1fedf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:43.075747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6bde0b8b-536f-47ad-8e60-8d813aa1fedf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:43.086671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-35be1517-0f71-4ad0-8e75-fbd14eb84e86 req-440ec940-a331-4d33-b865-24b852dcd49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6caf8c55-2143-4782-b658-22b9a2aec189", "tag": "8c82bb9f-ffcf-4587-b0b3-ab271327dc45"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:43.093432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bde0b8b-536f-47ad-8e60-8d813aa1fedf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:43.094003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bde0b8b-536f-47ad-8e60-8d813aa1fedf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:43.094463 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bde0b8b-536f-47ad-8e60-8d813aa1fedf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:43.095198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bde0b8b-536f-47ad-8e60-8d813aa1fedf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:43.096153 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bde0b8b-536f-47ad-8e60-8d813aa1fedf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:43.098100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6bde0b8b-536f-47ad-8e60-8d813aa1fedf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:43.105483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-35be1517-0f71-4ad0-8e75-fbd14eb84e86 req-440ec940-a331-4d33-b865-24b852dcd49a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:43.106803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-35be1517-0f71-4ad0-8e75-fbd14eb84e86 req-440ec940-a331-4d33-b865-24b852dcd49a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:43.108087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-35be1517-0f71-4ad0-8e75-fbd14eb84e86 req-440ec940-a331-4d33-b865-24b852dcd49a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:43.124543 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-35be1517-0f71-4ad0-8e75-fbd14eb84e86 req-440ec940-a331-4d33-b865-24b852dcd49a service nova] Creating event network-changed:8c82bb9f-ffcf-4587-b0b3-ab271327dc45 for instance 6caf8c55-2143-4782-b658-22b9a2aec189 on n-h2-852084-5 Aug 27 03:44:43.129963 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-35be1517-0f71-4ad0-8e75-fbd14eb84e86 req-440ec940-a331-4d33-b865-24b852dcd49a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046892 Aug 27 03:44:43.133608 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3660/7135] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:44:43.276031 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6bde0b8b-536f-47ad-8e60-8d813aa1fedf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:43.285680 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6bde0b8b-536f-47ad-8e60-8d813aa1fedf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1761 microversion: 2.1 time: 0.215984 Aug 27 03:44:43.286288 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3476/7136] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:43 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1761 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:57.295110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:57.295867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=12 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:57.300612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-22e2d915-230e-41c2-bb38-0928419c2f92 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:44:57.302992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-22e2d915-230e-41c2-bb38-0928419c2f92 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:57.310136 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e2d915-230e-41c2-bb38-0928419c2f92 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:57.310631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e2d915-230e-41c2-bb38-0928419c2f92 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:57.311078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e2d915-230e-41c2-bb38-0928419c2f92 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:57.311787 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e2d915-230e-41c2-bb38-0928419c2f92 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:57.312253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e2d915-230e-41c2-bb38-0928419c2f92 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:57.312711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-22e2d915-230e-41c2-bb38-0928419c2f92 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:57.389422 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-22e2d915-230e-41c2-bb38-0928419c2f92 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/action" status: 202 len: 0 microversion: 2.1 time: 0.096211 Aug 27 03:44:57.390494 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3661/7137] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:44:57 2022] POST /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:44:57.400104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cd9fed5b-06f2-4326-b5a9-16af0f33c48b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:57.400730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cd9fed5b-06f2-4326-b5a9-16af0f33c48b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:57.403644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:57.404547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=8 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:44:57.410566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd9fed5b-06f2-4326-b5a9-16af0f33c48b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:57.411048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd9fed5b-06f2-4326-b5a9-16af0f33c48b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:57.411538 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd9fed5b-06f2-4326-b5a9-16af0f33c48b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:57.412292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd9fed5b-06f2-4326-b5a9-16af0f33c48b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:57.412748 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd9fed5b-06f2-4326-b5a9-16af0f33c48b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:57.413185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd9fed5b-06f2-4326-b5a9-16af0f33c48b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:57.562707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cd9fed5b-06f2-4326-b5a9-16af0f33c48b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:57.571732 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cd9fed5b-06f2-4326-b5a9-16af0f33c48b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1753 microversion: 2.1 time: 0.176167 Aug 27 03:44:57.572316 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3477/7138] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:57 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:58.597139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8514e3d1-18d2-4242-9a03-43171ed148dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:58.597785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8514e3d1-18d2-4242-9a03-43171ed148dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:58.604065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8514e3d1-18d2-4242-9a03-43171ed148dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:58.604545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8514e3d1-18d2-4242-9a03-43171ed148dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:58.604979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8514e3d1-18d2-4242-9a03-43171ed148dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:58.605684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8514e3d1-18d2-4242-9a03-43171ed148dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:58.606138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8514e3d1-18d2-4242-9a03-43171ed148dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:58.606564 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8514e3d1-18d2-4242-9a03-43171ed148dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:58.753028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8514e3d1-18d2-4242-9a03-43171ed148dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:58.762088 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8514e3d1-18d2-4242-9a03-43171ed148dd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1758 microversion: 2.1 time: 0.170702 Aug 27 03:44:58.762676 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3662/7139] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:58 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:44:59.785220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-97c48a32-c2d1-433d-90d9-81523df3892b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:44:59.785959 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-97c48a32-c2d1-433d-90d9-81523df3892b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:44:59.793220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c48a32-c2d1-433d-90d9-81523df3892b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:59.793742 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c48a32-c2d1-433d-90d9-81523df3892b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:59.794198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c48a32-c2d1-433d-90d9-81523df3892b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:59.794909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c48a32-c2d1-433d-90d9-81523df3892b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:44:59.795374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c48a32-c2d1-433d-90d9-81523df3892b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:44:59.795808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-97c48a32-c2d1-433d-90d9-81523df3892b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:44:59.947870 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-97c48a32-c2d1-433d-90d9-81523df3892b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:44:59.957416 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-97c48a32-c2d1-433d-90d9-81523df3892b tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1758 microversion: 2.1 time: 0.176779 Aug 27 03:44:59.958024 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3478/7140] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:44:59 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:00.979050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21745abe-6034-43b4-ba6f-309a0172db9d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:00.979711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21745abe-6034-43b4-ba6f-309a0172db9d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:00.987874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21745abe-6034-43b4-ba6f-309a0172db9d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:00.988382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21745abe-6034-43b4-ba6f-309a0172db9d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:00.988832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21745abe-6034-43b4-ba6f-309a0172db9d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:00.989594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21745abe-6034-43b4-ba6f-309a0172db9d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:00.990094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21745abe-6034-43b4-ba6f-309a0172db9d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:00.990532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21745abe-6034-43b4-ba6f-309a0172db9d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:01.144481 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-21745abe-6034-43b4-ba6f-309a0172db9d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:01.152895 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21745abe-6034-43b4-ba6f-309a0172db9d tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1758 microversion: 2.1 time: 0.177969 Aug 27 03:45:01.153471 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3663/7141] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:00 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:45:02.175168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ee8fc7d-c300-44af-bbb0-736e361f814e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:02.175787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0ee8fc7d-c300-44af-bbb0-736e361f814e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:02.182737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ee8fc7d-c300-44af-bbb0-736e361f814e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:02.183222 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ee8fc7d-c300-44af-bbb0-736e361f814e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:02.183666 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ee8fc7d-c300-44af-bbb0-736e361f814e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:02.184362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ee8fc7d-c300-44af-bbb0-736e361f814e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:02.184823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ee8fc7d-c300-44af-bbb0-736e361f814e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:02.185260 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ee8fc7d-c300-44af-bbb0-736e361f814e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:02.331193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0ee8fc7d-c300-44af-bbb0-736e361f814e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:02.340087 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0ee8fc7d-c300-44af-bbb0-736e361f814e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1758 microversion: 2.1 time: 0.169374 Aug 27 03:45:02.340673 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3479/7142] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:02 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:03.361803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-afabc29c-ec4a-4e6d-a4ef-ab642205a1b1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:03.362546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-afabc29c-ec4a-4e6d-a4ef-ab642205a1b1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:03.369409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afabc29c-ec4a-4e6d-a4ef-ab642205a1b1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:03.369923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afabc29c-ec4a-4e6d-a4ef-ab642205a1b1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:03.370363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afabc29c-ec4a-4e6d-a4ef-ab642205a1b1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:03.371057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afabc29c-ec4a-4e6d-a4ef-ab642205a1b1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:03.371512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afabc29c-ec4a-4e6d-a4ef-ab642205a1b1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:03.371937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-afabc29c-ec4a-4e6d-a4ef-ab642205a1b1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:03.517640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-afabc29c-ec4a-4e6d-a4ef-ab642205a1b1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:03.526551 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-afabc29c-ec4a-4e6d-a4ef-ab642205a1b1 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1758 microversion: 2.1 time: 0.168901 Aug 27 03:45:03.527141 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3664/7143] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:03 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:04.595030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2d1b40a5-4ccd-4715-aafd-9fea9a622975 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:04.595651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2d1b40a5-4ccd-4715-aafd-9fea9a622975 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:04.602262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d1b40a5-4ccd-4715-aafd-9fea9a622975 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:04.602749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d1b40a5-4ccd-4715-aafd-9fea9a622975 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:04.603195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d1b40a5-4ccd-4715-aafd-9fea9a622975 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:04.603889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d1b40a5-4ccd-4715-aafd-9fea9a622975 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:04.604351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d1b40a5-4ccd-4715-aafd-9fea9a622975 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:04.604783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d1b40a5-4ccd-4715-aafd-9fea9a622975 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:04.744558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2d1b40a5-4ccd-4715-aafd-9fea9a622975 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:04.753485 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2d1b40a5-4ccd-4715-aafd-9fea9a622975 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1758 microversion: 2.1 time: 0.209451 Aug 27 03:45:04.754092 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3480/7144] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:04 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1758 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:05.774858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a6315deb-cce5-451f-b086-41ef834fbeaa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:05.775467 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a6315deb-cce5-451f-b086-41ef834fbeaa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:05.782381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6315deb-cce5-451f-b086-41ef834fbeaa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:05.782862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6315deb-cce5-451f-b086-41ef834fbeaa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:05.783301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6315deb-cce5-451f-b086-41ef834fbeaa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:05.784497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6315deb-cce5-451f-b086-41ef834fbeaa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:05.784946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6315deb-cce5-451f-b086-41ef834fbeaa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:05.785368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a6315deb-cce5-451f-b086-41ef834fbeaa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:05.934447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a6315deb-cce5-451f-b086-41ef834fbeaa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:05.942938 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a6315deb-cce5-451f-b086-41ef834fbeaa tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1758 microversion: 2.1 time: 0.171999 Aug 27 03:45:05.943515 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3665/7145] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:05 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:06.964826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f0ebbe1b-9a6b-4110-ae9e-c111e40f27bd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:06.965455 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f0ebbe1b-9a6b-4110-ae9e-c111e40f27bd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:06.972882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0ebbe1b-9a6b-4110-ae9e-c111e40f27bd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:06.973383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0ebbe1b-9a6b-4110-ae9e-c111e40f27bd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:06.973881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0ebbe1b-9a6b-4110-ae9e-c111e40f27bd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:06.974602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0ebbe1b-9a6b-4110-ae9e-c111e40f27bd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:06.975074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0ebbe1b-9a6b-4110-ae9e-c111e40f27bd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:06.975521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0ebbe1b-9a6b-4110-ae9e-c111e40f27bd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:07.120979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f0ebbe1b-9a6b-4110-ae9e-c111e40f27bd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:07.129451 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f0ebbe1b-9a6b-4110-ae9e-c111e40f27bd tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1758 microversion: 2.1 time: 0.168925 Aug 27 03:45:07.130060 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3481/7146] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:06 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:08.149865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8a32ccaa-8956-4880-8951-9e4b071fcc6e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:08.150500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8a32ccaa-8956-4880-8951-9e4b071fcc6e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:08.159436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a32ccaa-8956-4880-8951-9e4b071fcc6e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:08.159968 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a32ccaa-8956-4880-8951-9e4b071fcc6e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:08.160504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a32ccaa-8956-4880-8951-9e4b071fcc6e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:08.162390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a32ccaa-8956-4880-8951-9e4b071fcc6e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:08.163031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a32ccaa-8956-4880-8951-9e4b071fcc6e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:08.163497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a32ccaa-8956-4880-8951-9e4b071fcc6e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:08.311964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8a32ccaa-8956-4880-8951-9e4b071fcc6e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:08.321183 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8a32ccaa-8956-4880-8951-9e4b071fcc6e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1758 microversion: 2.1 time: 0.175218 Aug 27 03:45:08.321812 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3666/7147] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:08 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:09.342944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fb95f2a9-bda4-41ff-8f5c-365cc1907317 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:09.343611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fb95f2a9-bda4-41ff-8f5c-365cc1907317 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:09.350674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb95f2a9-bda4-41ff-8f5c-365cc1907317 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:09.351177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb95f2a9-bda4-41ff-8f5c-365cc1907317 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:09.351636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb95f2a9-bda4-41ff-8f5c-365cc1907317 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:09.352343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb95f2a9-bda4-41ff-8f5c-365cc1907317 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:09.352815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb95f2a9-bda4-41ff-8f5c-365cc1907317 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:09.353259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-fb95f2a9-bda4-41ff-8f5c-365cc1907317 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:09.496493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fb95f2a9-bda4-41ff-8f5c-365cc1907317 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:09.505505 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fb95f2a9-bda4-41ff-8f5c-365cc1907317 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1761 microversion: 2.1 time: 0.166867 Aug 27 03:45:09.506050 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3482/7148] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:09 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1761 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:41.791451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c1e78ee0-a613-4568-8ffd-a570580d7523 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1291321748"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:41.792080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c1e78ee0-a613-4568-8ffd-a570580d7523 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:41.794251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=12 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:41.794885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:41.801124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1e78ee0-a613-4568-8ffd-a570580d7523 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:41.801613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1e78ee0-a613-4568-8ffd-a570580d7523 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:41.802075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1e78ee0-a613-4568-8ffd-a570580d7523 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:41.802783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1e78ee0-a613-4568-8ffd-a570580d7523 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:41.803241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1e78ee0-a613-4568-8ffd-a570580d7523 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:41.803673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1e78ee0-a613-4568-8ffd-a570580d7523 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:41.982652 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.network.security_group_api [None req-c1e78ee0-a613-4568-8ffd-a570580d7523 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Removing security group c1bbdbf7-51cf-4e07-9540-832bac1b7937 from port 8c82bb9f-ffcf-4587-b0b3-ab271327dc45 Aug 27 03:45:42.290944 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c1e78ee0-a613-4568-8ffd-a570580d7523 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "POST /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/action" status: 202 len: 0 microversion: 2.1 time: 0.502722 Aug 27 03:45:42.290944 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3667/7149] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:45:41 2022] POST /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:45:42.301439 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ab93bb65-cef2-44e0-bb94-54e96e508616 req-e72f86d5-60c2-4b8f-a7d2-47200234411f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6caf8c55-2143-4782-b658-22b9a2aec189", "tag": "8c82bb9f-ffcf-4587-b0b3-ab271327dc45"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:42.308977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=12 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:42.309636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=36 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:45:42.328600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ab93bb65-cef2-44e0-bb94-54e96e508616 req-e72f86d5-60c2-4b8f-a7d2-47200234411f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:42.329094 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ab93bb65-cef2-44e0-bb94-54e96e508616 req-e72f86d5-60c2-4b8f-a7d2-47200234411f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:42.329457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ab93bb65-cef2-44e0-bb94-54e96e508616 req-e72f86d5-60c2-4b8f-a7d2-47200234411f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:42.348447 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ab93bb65-cef2-44e0-bb94-54e96e508616 req-e72f86d5-60c2-4b8f-a7d2-47200234411f service nova] Creating event network-changed:8c82bb9f-ffcf-4587-b0b3-ab271327dc45 for instance 6caf8c55-2143-4782-b658-22b9a2aec189 on n-h2-852084-5 Aug 27 03:45:42.365446 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ab93bb65-cef2-44e0-bb94-54e96e508616 req-e72f86d5-60c2-4b8f-a7d2-47200234411f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068282 Aug 27 03:45:42.366309 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3483/7150] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:43.351522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f2638eb8-d66a-4bc1-ba1c-be6f0cba5fdf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:43.352283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f2638eb8-d66a-4bc1-ba1c-be6f0cba5fdf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:43.354019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-07ee03fb-4ecc-4c8e-baa5-7efb3ce8f141 req-7577739a-0804-4d9c-af31-b774823c759f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6caf8c55-2143-4782-b658-22b9a2aec189", "tag": "8c82bb9f-ffcf-4587-b0b3-ab271327dc45"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:43.358931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2638eb8-d66a-4bc1-ba1c-be6f0cba5fdf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:43.359540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2638eb8-d66a-4bc1-ba1c-be6f0cba5fdf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:43.360078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2638eb8-d66a-4bc1-ba1c-be6f0cba5fdf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:43.360906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2638eb8-d66a-4bc1-ba1c-be6f0cba5fdf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:43.361458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2638eb8-d66a-4bc1-ba1c-be6f0cba5fdf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:43.362137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f2638eb8-d66a-4bc1-ba1c-be6f0cba5fdf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:43.365002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-07ee03fb-4ecc-4c8e-baa5-7efb3ce8f141 req-7577739a-0804-4d9c-af31-b774823c759f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:43.365711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-07ee03fb-4ecc-4c8e-baa5-7efb3ce8f141 req-7577739a-0804-4d9c-af31-b774823c759f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:43.366341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-07ee03fb-4ecc-4c8e-baa5-7efb3ce8f141 req-7577739a-0804-4d9c-af31-b774823c759f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:43.378145 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-07ee03fb-4ecc-4c8e-baa5-7efb3ce8f141 req-7577739a-0804-4d9c-af31-b774823c759f service nova] Creating event network-changed:8c82bb9f-ffcf-4587-b0b3-ab271327dc45 for instance 6caf8c55-2143-4782-b658-22b9a2aec189 on n-h2-852084-5 Aug 27 03:45:43.384228 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-07ee03fb-4ecc-4c8e-baa5-7efb3ce8f141 req-7577739a-0804-4d9c-af31-b774823c759f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035236 Aug 27 03:45:43.384842 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3484/7151] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:43.470119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-f2638eb8-d66a-4bc1-ba1c-be6f0cba5fdf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lazy-loading 'services' on Instance uuid 6caf8c55-2143-4782-b658-22b9a2aec189 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:45:43.549559 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f2638eb8-d66a-4bc1-ba1c-be6f0cba5fdf tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments/89cb0a79-d524-445a-9c1b-95a8b4fcedf2" status: 202 len: 0 microversion: 2.1 time: 0.203017 Aug 27 03:45:43.554122 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3668/7152] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:45:43 2022] DELETE /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments/89cb0a79-d524-445a-9c1b-95a8b4fcedf2 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:45:43.560397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-75132d1b-2a89-4d8c-803e-aa12ba4fd36f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:43.562766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-75132d1b-2a89-4d8c-803e-aa12ba4fd36f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:43.569924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75132d1b-2a89-4d8c-803e-aa12ba4fd36f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:43.570613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75132d1b-2a89-4d8c-803e-aa12ba4fd36f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:43.571014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75132d1b-2a89-4d8c-803e-aa12ba4fd36f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:43.571780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75132d1b-2a89-4d8c-803e-aa12ba4fd36f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:43.572301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75132d1b-2a89-4d8c-803e-aa12ba4fd36f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:43.572978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75132d1b-2a89-4d8c-803e-aa12ba4fd36f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:43.606977 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-75132d1b-2a89-4d8c-803e-aa12ba4fd36f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051454 Aug 27 03:45:43.607566 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3485/7153] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:43 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:44.622756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b2ff4df7-2bbd-4e03-8919-d01f0f9bc374 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:44.625826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b2ff4df7-2bbd-4e03-8919-d01f0f9bc374 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:44.633022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff4df7-2bbd-4e03-8919-d01f0f9bc374 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:44.633624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff4df7-2bbd-4e03-8919-d01f0f9bc374 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:44.634167 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff4df7-2bbd-4e03-8919-d01f0f9bc374 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:44.634964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff4df7-2bbd-4e03-8919-d01f0f9bc374 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:44.635508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff4df7-2bbd-4e03-8919-d01f0f9bc374 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:44.636015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b2ff4df7-2bbd-4e03-8919-d01f0f9bc374 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:44.669105 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b2ff4df7-2bbd-4e03-8919-d01f0f9bc374 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051709 Aug 27 03:45:44.669702 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3669/7154] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:44 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:45:45.683097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9d7d72b3-ad2a-4fdf-b66c-e224cb32e50c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:45.684999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9d7d72b3-ad2a-4fdf-b66c-e224cb32e50c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:45.691243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d7d72b3-ad2a-4fdf-b66c-e224cb32e50c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:45.691753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d7d72b3-ad2a-4fdf-b66c-e224cb32e50c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:45.692211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d7d72b3-ad2a-4fdf-b66c-e224cb32e50c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:45.692944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d7d72b3-ad2a-4fdf-b66c-e224cb32e50c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:45.693419 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d7d72b3-ad2a-4fdf-b66c-e224cb32e50c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:45.693966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9d7d72b3-ad2a-4fdf-b66c-e224cb32e50c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:45.729284 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9d7d72b3-ad2a-4fdf-b66c-e224cb32e50c tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050861 Aug 27 03:45:45.729883 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3486/7155] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:45 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:46.742314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4442e44b-7289-411c-aa9c-e2cbe3efd49e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:46.744453 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4442e44b-7289-411c-aa9c-e2cbe3efd49e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:46.751471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4442e44b-7289-411c-aa9c-e2cbe3efd49e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:46.751963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4442e44b-7289-411c-aa9c-e2cbe3efd49e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:46.752407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4442e44b-7289-411c-aa9c-e2cbe3efd49e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:46.753110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4442e44b-7289-411c-aa9c-e2cbe3efd49e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:46.753630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4442e44b-7289-411c-aa9c-e2cbe3efd49e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:46.754089 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4442e44b-7289-411c-aa9c-e2cbe3efd49e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:46.788264 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4442e44b-7289-411c-aa9c-e2cbe3efd49e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050709 Aug 27 03:45:46.788851 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3670/7156] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:46 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:47.801914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6e5d2d3b-ccba-4b8d-8b25-67b0c7131f10 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:47.804142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6e5d2d3b-ccba-4b8d-8b25-67b0c7131f10 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:47.811089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e5d2d3b-ccba-4b8d-8b25-67b0c7131f10 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:47.811588 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e5d2d3b-ccba-4b8d-8b25-67b0c7131f10 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:47.812047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e5d2d3b-ccba-4b8d-8b25-67b0c7131f10 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:47.812885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e5d2d3b-ccba-4b8d-8b25-67b0c7131f10 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:47.813348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e5d2d3b-ccba-4b8d-8b25-67b0c7131f10 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:47.813810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6e5d2d3b-ccba-4b8d-8b25-67b0c7131f10 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:47.844679 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6e5d2d3b-ccba-4b8d-8b25-67b0c7131f10 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047430 Aug 27 03:45:47.845442 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3487/7157] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:47 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:48.856522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ccb1897f-73e0-40d2-b01b-8150fafd6bca tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:48.858693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ccb1897f-73e0-40d2-b01b-8150fafd6bca tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:48.865624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ccb1897f-73e0-40d2-b01b-8150fafd6bca tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:48.866144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ccb1897f-73e0-40d2-b01b-8150fafd6bca tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:48.866583 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ccb1897f-73e0-40d2-b01b-8150fafd6bca tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:48.867277 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ccb1897f-73e0-40d2-b01b-8150fafd6bca tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:48.867738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ccb1897f-73e0-40d2-b01b-8150fafd6bca tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:48.868168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ccb1897f-73e0-40d2-b01b-8150fafd6bca tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:48.897959 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ccb1897f-73e0-40d2-b01b-8150fafd6bca tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045500 Aug 27 03:45:48.898528 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3671/7158] 10.222.0.99 () {58 vars in 1302 bytes} [Sat Aug 27 03:45:48 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 03:45:48.908992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:48.909516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:48.916473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:48.916982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:48.917447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:48.918191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:48.918671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:48.919120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:49.110030 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] HTTP exception thrown: Instance 6caf8c55-2143-4782-b658-22b9a2aec189 is not attached to volume 89cb0a79-d524-445a-9c1b-95a8b4fcedf2 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Request method failure captured: Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: request: DELETE /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments/89cb0a79-d524-445a-9c1b-95a8b4fcedf2 HTTP/1.1 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZIOd-x7tgjdJJ6V6t36WN0ThXp9UaEElkkn-nd8itSzeeuU1nLf40_r-Ax266Uz_nh93nKLC5qLnpV4uWWU8PeGjNkKNqz8MGmESKSqbdaEo2bwA_5_EFkx7Jx2tiMaCXq9YFx-etcdRxVf02KYnfPaXwPYmLYwn3byrFmMmEHL4NI Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 1aff73dc8b0c494798062c2b92dc8ec5 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1aff73dc8b0c494798062c2b92dc8ec5"}]}] Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 1aff73dc8b0c494798062c2b92dc8ec5 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestMinimumBasicScenario-90992889-project Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 2f93163091014ae282245f274e02ab55 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestMinimumBasicScenario-90992889-project Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 6caf8c55-2143-4782-b658-22b9a2aec189 is not attached to volume 89cb0a79-d524-445a-9c1b-95a8b4fcedf2 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'server_id': '6caf8c55-2143-4782-b658-22b9a2aec189', 'id': '89cb0a79-d524-445a-9c1b-95a8b4fcedf2'} Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 89cb0a79-d524-445a-9c1b-95a8b4fcedf2. Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6caf8c55-2143-4782-b658-22b9a2aec189 is not attached to volume 89cb0a79-d524-445a-9c1b-95a8b4fcedf2 Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:45:49.111619 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:45:49.116392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:45:49.116392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:45:49.116392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6caf8c55-2143-4782-b658-22b9a2aec189 is not attached to volume 89cb0a79-d524-445a-9c1b-95a8b4fcedf2 Aug 27 03:45:49.116392 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:45:49.116392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Returning 404 to user: Instance 6caf8c55-2143-4782-b658-22b9a2aec189 is not attached to volume 89cb0a79-d524-445a-9c1b-95a8b4fcedf2 {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:45:49.116392 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4b8bf621-2184-443f-b2e2-02acbcbb3de0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments/89cb0a79-d524-445a-9c1b-95a8b4fcedf2" status: 404 len: 154 microversion: 2.1 time: 0.208208 Aug 27 03:45:49.116392 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3488/7159] 10.222.0.99 () {58 vars in 1416 bytes} [Sat Aug 27 03:45:48 2022] DELETE /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189/os-volume_attachments/89cb0a79-d524-445a-9c1b-95a8b4fcedf2 => generated 154 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:45:52.365047 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-232a98cd-0b55-418f-868a-e388391319e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:52.365644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-232a98cd-0b55-418f-868a-e388391319e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:52.374226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232a98cd-0b55-418f-868a-e388391319e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:52.374799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232a98cd-0b55-418f-868a-e388391319e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:52.375312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232a98cd-0b55-418f-868a-e388391319e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:52.376118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232a98cd-0b55-418f-868a-e388391319e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:52.376670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232a98cd-0b55-418f-868a-e388391319e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:52.377173 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-232a98cd-0b55-418f-868a-e388391319e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:52.404459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-232a98cd-0b55-418f-868a-e388391319e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:45:52.485939 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-232a98cd-0b55-418f-868a-e388391319e0 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 204 len: 0 microversion: 2.1 time: 0.124855 Aug 27 03:45:52.491123 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3672/7160] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:45:52 2022] DELETE /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:45:52.496252 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ac6605ab-357d-41f0-a0b2-aa4a70ba3292 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:52.497000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ac6605ab-357d-41f0-a0b2-aa4a70ba3292 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:52.506603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac6605ab-357d-41f0-a0b2-aa4a70ba3292 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:52.507236 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac6605ab-357d-41f0-a0b2-aa4a70ba3292 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:52.507766 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac6605ab-357d-41f0-a0b2-aa4a70ba3292 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:52.508642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac6605ab-357d-41f0-a0b2-aa4a70ba3292 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:52.509121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac6605ab-357d-41f0-a0b2-aa4a70ba3292 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:52.509569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ac6605ab-357d-41f0-a0b2-aa4a70ba3292 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:52.646770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ac6605ab-357d-41f0-a0b2-aa4a70ba3292 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:52.655143 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ac6605ab-357d-41f0-a0b2-aa4a70ba3292 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1555 microversion: 2.1 time: 0.163190 Aug 27 03:45:52.655736 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3489/7161] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:52 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:53.676603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c513367e-da0f-4b2c-a8fd-33e12760c151 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:53.677320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c513367e-da0f-4b2c-a8fd-33e12760c151 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:53.684450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c513367e-da0f-4b2c-a8fd-33e12760c151 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:53.684940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c513367e-da0f-4b2c-a8fd-33e12760c151 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:53.685394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c513367e-da0f-4b2c-a8fd-33e12760c151 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:53.686135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c513367e-da0f-4b2c-a8fd-33e12760c151 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:53.686599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c513367e-da0f-4b2c-a8fd-33e12760c151 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:53.687034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c513367e-da0f-4b2c-a8fd-33e12760c151 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:53.821587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c513367e-da0f-4b2c-a8fd-33e12760c151 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:53.829721 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c513367e-da0f-4b2c-a8fd-33e12760c151 tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1555 microversion: 2.1 time: 0.157440 Aug 27 03:45:53.830306 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3673/7162] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:53 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:54.651413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-20d27519-4ff1-4a4a-a9b0-567c439ea8fb req-f4a7e28c-fc33-4438-b366-49efd7337e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caf8c55-2143-4782-b658-22b9a2aec189", "name": "network-vif-deleted", "tag": "8c82bb9f-ffcf-4587-b0b3-ab271327dc45"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:45:54.667835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-20d27519-4ff1-4a4a-a9b0-567c439ea8fb req-f4a7e28c-fc33-4438-b366-49efd7337e38 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:54.668343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-20d27519-4ff1-4a4a-a9b0-567c439ea8fb req-f4a7e28c-fc33-4438-b366-49efd7337e38 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:54.668802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-20d27519-4ff1-4a4a-a9b0-567c439ea8fb req-f4a7e28c-fc33-4438-b366-49efd7337e38 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:54.682614 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-20d27519-4ff1-4a4a-a9b0-567c439ea8fb req-f4a7e28c-fc33-4438-b366-49efd7337e38 service nova] Creating event network-vif-deleted:8c82bb9f-ffcf-4587-b0b3-ab271327dc45 for instance 6caf8c55-2143-4782-b658-22b9a2aec189 on n-h2-852084-5 Aug 27 03:45:54.688532 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-20d27519-4ff1-4a4a-a9b0-567c439ea8fb req-f4a7e28c-fc33-4438-b366-49efd7337e38 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041020 Aug 27 03:45:54.689194 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3490/7163] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:45:54.850944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:54.851552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:54.858815 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:54.859304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:54.859747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:54.860452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:54.860915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:54.861351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:54.894253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:54.894737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:54.895182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:54.895639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lazy-loading 'fault' on Instance uuid 6caf8c55-2143-4782-b658-22b9a2aec189 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:45:54.944817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f93163091014ae282245f274e02ab55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aff73dc8b0c494798062c2b92dc8ec5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:45:54.952578 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ead82915-5880-40bc-b7b0-0c8cb69b950e tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 200 len: 1349 microversion: 2.1 time: 0.106140 Aug 27 03:45:54.953167 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3674/7164] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:54 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 1349 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:45:55.975468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:55.976191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] [instance: 6caf8c55-2143-4782-b658-22b9a2aec189] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:45:55.983444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:55.983948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:55.984426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:55.985126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:45:55.985601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:45:55.986075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:45:55.999415 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] HTTP exception thrown: Instance 6caf8c55-2143-4782-b658-22b9a2aec189 could not be found. Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Request method failure captured: Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 HTTP/1.1 Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZIOd-x7tgjdJJ6V6t36WN0ThXp9UaEElkkn-nd8itSzeeuU1nLf40_r-Ax266Uz_nh93nKLC5qLnpV4uWWU8PeGjNkKNqz8MGmESKSqbdaEo2bwA_5_EFkx7Jx2tiMaCXq9YFx-etcdRxVf02KYnfPaXwPYmLYwn3byrFmMmEHL4NI Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 1aff73dc8b0c494798062c2b92dc8ec5 Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1aff73dc8b0c494798062c2b92dc8ec5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1aff73dc8b0c494798062c2b92dc8ec5"}]}] Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 1aff73dc8b0c494798062c2b92dc8ec5 Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestMinimumBasicScenario-90992889 Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestMinimumBasicScenario-90992889-project Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 2f93163091014ae282245f274e02ab55 Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestMinimumBasicScenario-90992889-project Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 6caf8c55-2143-4782-b658-22b9a2aec189 could not be found. Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '6caf8c55-2143-4782-b658-22b9a2aec189'} Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6caf8c55-2143-4782-b658-22b9a2aec189 could not be found. Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6caf8c55-2143-4782-b658-22b9a2aec189 could not be found. Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:45:56.001055 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:45:56.005916 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:45:56.005916 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:45:56.005916 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:45:56.005916 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:45:56.005916 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:45:56.005916 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6caf8c55-2143-4782-b658-22b9a2aec189 could not be found. Aug 27 03:45:56.005916 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:45:56.005916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Returning 404 to user: Instance 6caf8c55-2143-4782-b658-22b9a2aec189 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:45:56.005916 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-62050526-0b0f-497d-8aaf-51cfd1714bdb tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189" status: 404 len: 111 microversion: 2.1 time: 0.031922 Aug 27 03:45:56.005916 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3491/7165] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:45:55 2022] GET /compute/v2.1/servers/6caf8c55-2143-4782-b658-22b9a2aec189 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:45:56.011484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-684e4ab0-2393-447d-8c46-8da5c5f4c64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] Calling method '.version_select at 0x7f4d28d1f9d0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:45:56.033174 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-684e4ab0-2393-447d-8c46-8da5c5f4c64f tempest-TestMinimumBasicScenario-90992889 tempest-TestMinimumBasicScenario-90992889-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1854181971" status: 202 len: 0 microversion: 2.1 time: 0.025537 Aug 27 03:45:56.033774 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3675/7166] 10.222.0.99 () {58 vars in 1272 bytes} [Sat Aug 27 03:45:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1854181971 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:46:05.465244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-546f37b4-8834-44c3-ae80-5fabb52660bd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'create', calling method: .version_select at 0x7f4d29d69550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2044144472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9ERR3dMwZee+YBSJP86tO6tZbDZwVHeAWWxn/PU8+XPjFSrO4sC2LKL67M3VaTzO1AvXO5ye6+l/XLPKq7KvMnc+Zhe553yzM1kb6qyvOEOuR0I1NrI5nuZygEwhk7gg=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:05.481624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-546f37b4-8834-44c3-ae80-5fabb52660bd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for project 57b6a3a135de4feb8541658376863195. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:46:05.486787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-546f37b4-8834-44c3-ae80-5fabb52660bd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for user b7d61a4dd7b64c65b9743f9f3b0d3aad and project 57b6a3a135de4feb8541658376863195. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:46:05.512627 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-546f37b4-8834-44c3-ae80-5fabb52660bd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.219921 Aug 27 03:46:05.513277 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3492/7167] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:46:05 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:11.440829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:11.441593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:11.446045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1543530243", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "c3a7c21a-9322-48fd-ab16-c3173253a459"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2044144472", "security_groups": [{"name": "tempest-secgroup-smoke-1663425522"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:11.599037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] validate_networks() for [('c3a7c21a-9322-48fd-ab16-c3173253a459', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:46:12.078506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:46:12.079627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:46:12.080356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:46:12.080979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:46:12.081515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:46:12.091649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:12.092230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:12.092899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:12.093761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:12.094305 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:12.094813 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:12.115310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for project 57b6a3a135de4feb8541658376863195. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:46:12.121081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for user b7d61a4dd7b64c65b9743f9f3b0d3aad and project 57b6a3a135de4feb8541658376863195. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:46:12.137822 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:46:12.140412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:46:12.192471 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb22dfd5-23bb-450c-85c2-eb34559eeb90 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753710 Aug 27 03:46:12.193878 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3676/7168] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:46:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:46:12.201088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=38 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:12.206948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4b3d921e-d09a-4b07-b5bb-257c60f708e6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:12.208357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4b3d921e-d09a-4b07-b5bb-257c60f708e6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:12.279821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4b3d921e-d09a-4b07-b5bb-257c60f708e6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:12.289439 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4b3d921e-d09a-4b07-b5bb-257c60f708e6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1267 microversion: 2.1 time: 0.089078 Aug 27 03:46:12.290547 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3493/7169] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:12 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:13.314227 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bc5051e5-f588-43b0-b5ef-f1b9a0ec65d3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:13.315029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bc5051e5-f588-43b0-b5ef-f1b9a0ec65d3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:13.324911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc5051e5-f588-43b0-b5ef-f1b9a0ec65d3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:13.325411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc5051e5-f588-43b0-b5ef-f1b9a0ec65d3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:13.325984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc5051e5-f588-43b0-b5ef-f1b9a0ec65d3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:13.337897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc5051e5-f588-43b0-b5ef-f1b9a0ec65d3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:13.338552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc5051e5-f588-43b0-b5ef-f1b9a0ec65d3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:13.339303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bc5051e5-f588-43b0-b5ef-f1b9a0ec65d3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:13.487112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bc5051e5-f588-43b0-b5ef-f1b9a0ec65d3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:13.510445 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bc5051e5-f588-43b0-b5ef-f1b9a0ec65d3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1319 microversion: 2.1 time: 0.186524 Aug 27 03:46:13.511750 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3677/7170] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:13 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:14.532751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-140a8ec0-107c-40f9-aa80-d116806032ce tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:14.533411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-140a8ec0-107c-40f9-aa80-d116806032ce tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:14.536821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:14.542391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-140a8ec0-107c-40f9-aa80-d116806032ce tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:14.542896 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-140a8ec0-107c-40f9-aa80-d116806032ce tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:14.543348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-140a8ec0-107c-40f9-aa80-d116806032ce tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:14.544097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-140a8ec0-107c-40f9-aa80-d116806032ce tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:14.544558 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-140a8ec0-107c-40f9-aa80-d116806032ce tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:14.544997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-140a8ec0-107c-40f9-aa80-d116806032ce tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:14.682523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-140a8ec0-107c-40f9-aa80-d116806032ce tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:14.692358 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-140a8ec0-107c-40f9-aa80-d116806032ce tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1393 microversion: 2.1 time: 0.162863 Aug 27 03:46:14.692959 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3494/7171] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:14 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:14.919323 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4c2f744d-5515-4664-bc8e-1b984918654f req-cb1f4f45-6ed8-4b53-8f93-a142edbdd88b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04bd8cac-1995-48a6-8968-f139c67d93ba", "tag": "8ade9e20-cdcb-4bc0-bb34-c7bc14e20bd0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:14.930395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4c2f744d-5515-4664-bc8e-1b984918654f req-cb1f4f45-6ed8-4b53-8f93-a142edbdd88b service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:14.931134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4c2f744d-5515-4664-bc8e-1b984918654f req-cb1f4f45-6ed8-4b53-8f93-a142edbdd88b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:14.931582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4c2f744d-5515-4664-bc8e-1b984918654f req-cb1f4f45-6ed8-4b53-8f93-a142edbdd88b service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:14.944413 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4c2f744d-5515-4664-bc8e-1b984918654f req-cb1f4f45-6ed8-4b53-8f93-a142edbdd88b service nova] Creating event network-changed:8ade9e20-cdcb-4bc0-bb34-c7bc14e20bd0 for instance 04bd8cac-1995-48a6-8968-f139c67d93ba on n-h2-852084-5 Aug 27 03:46:14.948973 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4c2f744d-5515-4664-bc8e-1b984918654f req-cb1f4f45-6ed8-4b53-8f93-a142edbdd88b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033739 Aug 27 03:46:14.949613 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3678/7172] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:15.714981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e6064dd6-03bf-4216-aedb-84e431edd92a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:15.715616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e6064dd6-03bf-4216-aedb-84e431edd92a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:15.722284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6064dd6-03bf-4216-aedb-84e431edd92a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:15.722791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6064dd6-03bf-4216-aedb-84e431edd92a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:15.723250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6064dd6-03bf-4216-aedb-84e431edd92a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:15.723966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6064dd6-03bf-4216-aedb-84e431edd92a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:15.724466 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6064dd6-03bf-4216-aedb-84e431edd92a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:15.724911 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e6064dd6-03bf-4216-aedb-84e431edd92a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:15.855975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e6064dd6-03bf-4216-aedb-84e431edd92a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:15.864423 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e6064dd6-03bf-4216-aedb-84e431edd92a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1393 microversion: 2.1 time: 0.153809 Aug 27 03:46:15.865010 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3495/7173] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:15 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:16.889313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4c3080dc-28d3-401e-81c7-76061dee8d1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:16.890095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4c3080dc-28d3-401e-81c7-76061dee8d1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:16.896877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3080dc-28d3-401e-81c7-76061dee8d1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:16.897395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3080dc-28d3-401e-81c7-76061dee8d1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:16.897864 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3080dc-28d3-401e-81c7-76061dee8d1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:16.898575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3080dc-28d3-401e-81c7-76061dee8d1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:16.899030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3080dc-28d3-401e-81c7-76061dee8d1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:16.899458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4c3080dc-28d3-401e-81c7-76061dee8d1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:17.053444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4c3080dc-28d3-401e-81c7-76061dee8d1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:17.061302 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4c3080dc-28d3-401e-81c7-76061dee8d1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1393 microversion: 2.1 time: 0.179102 Aug 27 03:46:17.061915 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3679/7174] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:16 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:18.082201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dabd9452-2b32-4914-9107-b43d964e2586 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:18.082843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dabd9452-2b32-4914-9107-b43d964e2586 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:18.090425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dabd9452-2b32-4914-9107-b43d964e2586 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.090964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dabd9452-2b32-4914-9107-b43d964e2586 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.091425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dabd9452-2b32-4914-9107-b43d964e2586 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.092179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dabd9452-2b32-4914-9107-b43d964e2586 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:18.092675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dabd9452-2b32-4914-9107-b43d964e2586 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:18.093316 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dabd9452-2b32-4914-9107-b43d964e2586 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:18.237803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dabd9452-2b32-4914-9107-b43d964e2586 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:18.245691 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dabd9452-2b32-4914-9107-b43d964e2586 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1393 microversion: 2.1 time: 0.167415 Aug 27 03:46:18.246279 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3496/7175] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:18 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:19.266900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ec67fcf3-316f-4095-abd8-ab029572e229 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:19.267521 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ec67fcf3-316f-4095-abd8-ab029572e229 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:19.274626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec67fcf3-316f-4095-abd8-ab029572e229 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.275109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec67fcf3-316f-4095-abd8-ab029572e229 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.275548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec67fcf3-316f-4095-abd8-ab029572e229 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.276246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec67fcf3-316f-4095-abd8-ab029572e229 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:19.276704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec67fcf3-316f-4095-abd8-ab029572e229 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:19.277133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ec67fcf3-316f-4095-abd8-ab029572e229 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:19.409209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ec67fcf3-316f-4095-abd8-ab029572e229 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:19.417473 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ec67fcf3-316f-4095-abd8-ab029572e229 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1393 microversion: 2.1 time: 0.154520 Aug 27 03:46:19.418083 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3680/7176] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:19 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:20.431867 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-64bc0d08-dbbd-4e02-a076-fc4eff5487d6 req-af62051f-8894-4c75-bcba-88b4528de062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bd8cac-1995-48a6-8968-f139c67d93ba", "name": "network-vif-plugged", "status": "completed", "tag": "8ade9e20-cdcb-4bc0-bb34-c7bc14e20bd0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:20.439426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3925d30e-851d-4a45-981d-e477edc9eac2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:20.440055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3925d30e-851d-4a45-981d-e477edc9eac2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:20.444525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-64bc0d08-dbbd-4e02-a076-fc4eff5487d6 req-af62051f-8894-4c75-bcba-88b4528de062 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:20.445015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-64bc0d08-dbbd-4e02-a076-fc4eff5487d6 req-af62051f-8894-4c75-bcba-88b4528de062 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:20.446637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-64bc0d08-dbbd-4e02-a076-fc4eff5487d6 req-af62051f-8894-4c75-bcba-88b4528de062 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:20.448575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3925d30e-851d-4a45-981d-e477edc9eac2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:20.449039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3925d30e-851d-4a45-981d-e477edc9eac2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:20.449470 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3925d30e-851d-4a45-981d-e477edc9eac2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:20.450606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3925d30e-851d-4a45-981d-e477edc9eac2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:20.451225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3925d30e-851d-4a45-981d-e477edc9eac2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:20.451805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3925d30e-851d-4a45-981d-e477edc9eac2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:20.461988 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-64bc0d08-dbbd-4e02-a076-fc4eff5487d6 req-af62051f-8894-4c75-bcba-88b4528de062 service nova] Creating event network-vif-plugged:8ade9e20-cdcb-4bc0-bb34-c7bc14e20bd0 for instance 04bd8cac-1995-48a6-8968-f139c67d93ba on n-h2-852084-5 Aug 27 03:46:20.467648 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-64bc0d08-dbbd-4e02-a076-fc4eff5487d6 req-af62051f-8894-4c75-bcba-88b4528de062 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039410 Aug 27 03:46:20.469042 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3497/7177] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:20.660826 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3925d30e-851d-4a45-981d-e477edc9eac2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:20.669522 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3925d30e-851d-4a45-981d-e477edc9eac2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1393 microversion: 2.1 time: 0.234605 Aug 27 03:46:20.670149 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3681/7178] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:20 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1393 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:21.695000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-85853d0b-6634-4238-b656-316268b711b7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:21.695698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-85853d0b-6634-4238-b656-316268b711b7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:21.702298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85853d0b-6634-4238-b656-316268b711b7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:21.702799 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85853d0b-6634-4238-b656-316268b711b7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:21.703246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85853d0b-6634-4238-b656-316268b711b7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:21.703954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85853d0b-6634-4238-b656-316268b711b7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:21.704420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85853d0b-6634-4238-b656-316268b711b7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:21.704857 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-85853d0b-6634-4238-b656-316268b711b7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:21.848537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-85853d0b-6634-4238-b656-316268b711b7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:21.856377 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-85853d0b-6634-4238-b656-316268b711b7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1565 microversion: 2.1 time: 0.168671 Aug 27 03:46:21.856954 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3498/7179] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:21 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:21.877613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1a88752f-b97d-436e-a746-5fb2da922195 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:21.878285 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1a88752f-b97d-436e-a746-5fb2da922195 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:21.886561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a88752f-b97d-436e-a746-5fb2da922195 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:21.887045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a88752f-b97d-436e-a746-5fb2da922195 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:21.887607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a88752f-b97d-436e-a746-5fb2da922195 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:21.888211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a88752f-b97d-436e-a746-5fb2da922195 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:21.888681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a88752f-b97d-436e-a746-5fb2da922195 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:21.889117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a88752f-b97d-436e-a746-5fb2da922195 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:22.027772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1a88752f-b97d-436e-a746-5fb2da922195 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:22.035822 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1a88752f-b97d-436e-a746-5fb2da922195 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1565 microversion: 2.1 time: 0.162285 Aug 27 03:46:22.036409 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3682/7180] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:21 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:23.702574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-00bb4616-0d32-44c9-8c4a-7a30d167bdc1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:23.703435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-00bb4616-0d32-44c9-8c4a-7a30d167bdc1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:23.705157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-997e661f-aaff-4d4c-b439-053a58cc8559 req-16d93d1c-4098-4b45-b0db-8b41b89713de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04bd8cac-1995-48a6-8968-f139c67d93ba", "tag": "8ade9e20-cdcb-4bc0-bb34-c7bc14e20bd0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:23.705599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:23.711905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:23.712660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:23.713815 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb4616-0d32-44c9-8c4a-7a30d167bdc1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.714635 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb4616-0d32-44c9-8c4a-7a30d167bdc1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.715308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb4616-0d32-44c9-8c4a-7a30d167bdc1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.716378 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb4616-0d32-44c9-8c4a-7a30d167bdc1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.716879 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb4616-0d32-44c9-8c4a-7a30d167bdc1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.717617 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00bb4616-0d32-44c9-8c4a-7a30d167bdc1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.720316 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-997e661f-aaff-4d4c-b439-053a58cc8559 req-16d93d1c-4098-4b45-b0db-8b41b89713de service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:23.721043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-997e661f-aaff-4d4c-b439-053a58cc8559 req-16d93d1c-4098-4b45-b0db-8b41b89713de service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:23.721553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-997e661f-aaff-4d4c-b439-053a58cc8559 req-16d93d1c-4098-4b45-b0db-8b41b89713de service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:23.733905 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-997e661f-aaff-4d4c-b439-053a58cc8559 req-16d93d1c-4098-4b45-b0db-8b41b89713de service nova] Creating event network-changed:8ade9e20-cdcb-4bc0-bb34-c7bc14e20bd0 for instance 04bd8cac-1995-48a6-8968-f139c67d93ba on n-h2-852084-5 Aug 27 03:46:23.739740 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-997e661f-aaff-4d4c-b439-053a58cc8559 req-16d93d1c-4098-4b45-b0db-8b41b89713de service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039371 Aug 27 03:46:23.740634 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3683/7181] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:46:23.864132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-00bb4616-0d32-44c9-8c4a-7a30d167bdc1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:23.873159 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-00bb4616-0d32-44c9-8c4a-7a30d167bdc1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1565 microversion: 2.1 time: 0.175154 Aug 27 03:46:23.886644 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3499/7182] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:23 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:46:47.122024 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:47.122821 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=36 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:47.127166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2c4fded5-6879-46cb-b983-1f025f530618 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:47.129482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2c4fded5-6879-46cb-b983-1f025f530618 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:47.137763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4fded5-6879-46cb-b983-1f025f530618 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:47.138243 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4fded5-6879-46cb-b983-1f025f530618 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:47.138691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4fded5-6879-46cb-b983-1f025f530618 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:47.139404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4fded5-6879-46cb-b983-1f025f530618 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:47.139858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4fded5-6879-46cb-b983-1f025f530618 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:47.140283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2c4fded5-6879-46cb-b983-1f025f530618 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:47.205546 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2c4fded5-6879-46cb-b983-1f025f530618 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba/action" status: 200 len: 24566 microversion: 2.1 time: 0.085267 Aug 27 03:46:47.206250 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3684/7183] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:46:47 2022] POST /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba/action => generated 24566 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:46:58.313758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0fbc172d-320f-46ca-a138-f0e40198f2cf tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:46:58.314369 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0fbc172d-320f-46ca-a138-f0e40198f2cf tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:58.316643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=11 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:58.317422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=32 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:58.323892 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fbc172d-320f-46ca-a138-f0e40198f2cf tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:58.324404 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fbc172d-320f-46ca-a138-f0e40198f2cf tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:58.324866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fbc172d-320f-46ca-a138-f0e40198f2cf tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:58.325601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fbc172d-320f-46ca-a138-f0e40198f2cf tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:58.326106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fbc172d-320f-46ca-a138-f0e40198f2cf tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:58.326551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0fbc172d-320f-46ca-a138-f0e40198f2cf tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:58.420001 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0fbc172d-320f-46ca-a138-f0e40198f2cf tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba/action" status: 202 len: 0 microversion: 2.1 time: 0.109646 Aug 27 03:46:58.421171 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3500/7184] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:46:58 2022] POST /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:46:58.431766 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-06135bb3-0800-40f1-a768-4c2f6b36330f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:58.432959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-06135bb3-0800-40f1-a768-4c2f6b36330f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:58.436057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:58.436744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:46:58.445434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06135bb3-0800-40f1-a768-4c2f6b36330f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:58.446133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06135bb3-0800-40f1-a768-4c2f6b36330f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:58.446791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06135bb3-0800-40f1-a768-4c2f6b36330f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:58.447776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06135bb3-0800-40f1-a768-4c2f6b36330f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:58.448435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06135bb3-0800-40f1-a768-4c2f6b36330f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:58.449050 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-06135bb3-0800-40f1-a768-4c2f6b36330f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:58.606287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-06135bb3-0800-40f1-a768-4c2f6b36330f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:58.616258 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-06135bb3-0800-40f1-a768-4c2f6b36330f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1688 microversion: 2.1 time: 0.190006 Aug 27 03:46:58.616865 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3685/7185] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:58 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:46:59.640119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cb8e4dba-4e2b-4e1f-9c5d-326e8181351a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:46:59.640929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cb8e4dba-4e2b-4e1f-9c5d-326e8181351a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:46:59.649522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb8e4dba-4e2b-4e1f-9c5d-326e8181351a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:59.650052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb8e4dba-4e2b-4e1f-9c5d-326e8181351a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:59.650489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb8e4dba-4e2b-4e1f-9c5d-326e8181351a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:59.651258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb8e4dba-4e2b-4e1f-9c5d-326e8181351a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:46:59.651730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb8e4dba-4e2b-4e1f-9c5d-326e8181351a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:46:59.652169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb8e4dba-4e2b-4e1f-9c5d-326e8181351a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:46:59.796382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb8e4dba-4e2b-4e1f-9c5d-326e8181351a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:46:59.806473 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cb8e4dba-4e2b-4e1f-9c5d-326e8181351a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1668 microversion: 2.1 time: 0.171098 Aug 27 03:46:59.807076 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3501/7186] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:46:59 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:00.912072 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-66d229c7-80bf-4f30-b694-30c8d72445b6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:00.915577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-66d229c7-80bf-4f30-b694-30c8d72445b6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:00.928074 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d229c7-80bf-4f30-b694-30c8d72445b6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:00.929479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d229c7-80bf-4f30-b694-30c8d72445b6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:00.930353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d229c7-80bf-4f30-b694-30c8d72445b6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:00.931670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d229c7-80bf-4f30-b694-30c8d72445b6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:00.932486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d229c7-80bf-4f30-b694-30c8d72445b6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:00.932965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-66d229c7-80bf-4f30-b694-30c8d72445b6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:01.011548 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-66d229c7-80bf-4f30-b694-30c8d72445b6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba/action" status: 200 len: 32634 microversion: 2.1 time: 0.105643 Aug 27 03:47:01.012480 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3686/7187] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:47:00 2022] POST /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba/action => generated 32634 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:47:01.025794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1e9d857a-c126-46b8-ab5e-3b17303f0611 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:01.026433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1e9d857a-c126-46b8-ab5e-3b17303f0611 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:01.034304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e9d857a-c126-46b8-ab5e-3b17303f0611 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:01.034906 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e9d857a-c126-46b8-ab5e-3b17303f0611 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:01.035427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e9d857a-c126-46b8-ab5e-3b17303f0611 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:01.036258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e9d857a-c126-46b8-ab5e-3b17303f0611 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:01.036775 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e9d857a-c126-46b8-ab5e-3b17303f0611 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:01.037263 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1e9d857a-c126-46b8-ab5e-3b17303f0611 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:01.132437 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1e9d857a-c126-46b8-ab5e-3b17303f0611 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba/action" status: 202 len: 0 microversion: 2.1 time: 0.111208 Aug 27 03:47:01.133091 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3502/7188] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:47:01 2022] POST /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:47:01.144414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9fa5d414-edc1-4831-bc9b-daa752e73bbb tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:01.145383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9fa5d414-edc1-4831-bc9b-daa752e73bbb tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:01.153049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa5d414-edc1-4831-bc9b-daa752e73bbb tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:01.153555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa5d414-edc1-4831-bc9b-daa752e73bbb tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:01.154034 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa5d414-edc1-4831-bc9b-daa752e73bbb tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:01.154811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa5d414-edc1-4831-bc9b-daa752e73bbb tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:01.155279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa5d414-edc1-4831-bc9b-daa752e73bbb tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:01.155858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9fa5d414-edc1-4831-bc9b-daa752e73bbb tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:01.328648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9fa5d414-edc1-4831-bc9b-daa752e73bbb tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:01.339185 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9fa5d414-edc1-4831-bc9b-daa752e73bbb tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1675 microversion: 2.1 time: 0.198505 Aug 27 03:47:01.339918 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3687/7189] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:01 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:02.364136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cf41c679-cdac-4756-8cba-29e43fc1f183 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:02.364863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cf41c679-cdac-4756-8cba-29e43fc1f183 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:02.372045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf41c679-cdac-4756-8cba-29e43fc1f183 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:02.372551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf41c679-cdac-4756-8cba-29e43fc1f183 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:02.373010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf41c679-cdac-4756-8cba-29e43fc1f183 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:02.373769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf41c679-cdac-4756-8cba-29e43fc1f183 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:02.374275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf41c679-cdac-4756-8cba-29e43fc1f183 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:02.374718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cf41c679-cdac-4756-8cba-29e43fc1f183 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:02.829619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cf41c679-cdac-4756-8cba-29e43fc1f183 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:02.837838 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cf41c679-cdac-4756-8cba-29e43fc1f183 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1683 microversion: 2.1 time: 0.478820 Aug 27 03:47:02.838430 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3503/7190] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:02 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1683 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:02.937236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-182f24f6-94f7-4962-8178-8a42011bb900 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:02.941268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-182f24f6-94f7-4962-8178-8a42011bb900 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:02.950610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-182f24f6-94f7-4962-8178-8a42011bb900 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:02.951116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-182f24f6-94f7-4962-8178-8a42011bb900 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:02.951568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-182f24f6-94f7-4962-8178-8a42011bb900 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:02.952290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-182f24f6-94f7-4962-8178-8a42011bb900 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:02.952808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-182f24f6-94f7-4962-8178-8a42011bb900 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:02.953267 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-182f24f6-94f7-4962-8178-8a42011bb900 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:03.011888 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-182f24f6-94f7-4962-8178-8a42011bb900 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba/action" status: 200 len: 38411 microversion: 2.1 time: 0.079580 Aug 27 03:47:03.012878 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3688/7191] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:47:02 2022] POST /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba/action => generated 38411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:47:04.299516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-7ade0c95-346d-47b4-948b-885fc2add7a7 req-e9ef9a71-a167-4794-a802-f0c88d996d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04bd8cac-1995-48a6-8968-f139c67d93ba", "tag": "8ade9e20-cdcb-4bc0-bb34-c7bc14e20bd0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:04.301574 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-75b5e700-785a-4cd0-bce6-cef8e731ad1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:04.302715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-75b5e700-785a-4cd0-bce6-cef8e731ad1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:04.310981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75b5e700-785a-4cd0-bce6-cef8e731ad1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:04.311600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75b5e700-785a-4cd0-bce6-cef8e731ad1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:04.312013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7ade0c95-346d-47b4-948b-885fc2add7a7 req-e9ef9a71-a167-4794-a802-f0c88d996d65 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:04.312133 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75b5e700-785a-4cd0-bce6-cef8e731ad1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:04.312575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7ade0c95-346d-47b4-948b-885fc2add7a7 req-e9ef9a71-a167-4794-a802-f0c88d996d65 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:04.312773 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75b5e700-785a-4cd0-bce6-cef8e731ad1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:04.313427 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75b5e700-785a-4cd0-bce6-cef8e731ad1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:04.313560 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-7ade0c95-346d-47b4-948b-885fc2add7a7 req-e9ef9a71-a167-4794-a802-f0c88d996d65 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:04.313930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75b5e700-785a-4cd0-bce6-cef8e731ad1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:04.326736 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-7ade0c95-346d-47b4-948b-885fc2add7a7 req-e9ef9a71-a167-4794-a802-f0c88d996d65 service nova] Creating event network-changed:8ade9e20-cdcb-4bc0-bb34-c7bc14e20bd0 for instance 04bd8cac-1995-48a6-8968-f139c67d93ba on n-h2-852084-5 Aug 27 03:47:04.332160 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-7ade0c95-346d-47b4-948b-885fc2add7a7 req-e9ef9a71-a167-4794-a802-f0c88d996d65 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036761 Aug 27 03:47:04.333790 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3689/7192] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:04.344767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-75b5e700-785a-4cd0-bce6-cef8e731ad1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:47:04.442528 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-75b5e700-785a-4cd0-bce6-cef8e731ad1b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "DELETE /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 204 len: 0 microversion: 2.1 time: 0.149219 Aug 27 03:47:04.443570 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3504/7193] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:47:04 2022] DELETE /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:47:04.454007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1452d4be-5690-4239-8b59-7e23b4edcd97 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:04.454916 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1452d4be-5690-4239-8b59-7e23b4edcd97 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:04.462577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1452d4be-5690-4239-8b59-7e23b4edcd97 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:04.463410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1452d4be-5690-4239-8b59-7e23b4edcd97 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:04.464427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1452d4be-5690-4239-8b59-7e23b4edcd97 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:04.465184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1452d4be-5690-4239-8b59-7e23b4edcd97 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:04.465919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1452d4be-5690-4239-8b59-7e23b4edcd97 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:04.466428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1452d4be-5690-4239-8b59-7e23b4edcd97 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:04.624298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1452d4be-5690-4239-8b59-7e23b4edcd97 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:04.633366 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1452d4be-5690-4239-8b59-7e23b4edcd97 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1689 microversion: 2.1 time: 0.184855 Aug 27 03:47:04.633824 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3690/7194] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:04 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:05.656944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c6d8f18b-64b7-4eba-be09-8e5c181d00a3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:05.657590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c6d8f18b-64b7-4eba-be09-8e5c181d00a3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:05.665360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d8f18b-64b7-4eba-be09-8e5c181d00a3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:05.665910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d8f18b-64b7-4eba-be09-8e5c181d00a3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:05.666373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d8f18b-64b7-4eba-be09-8e5c181d00a3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:05.667100 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d8f18b-64b7-4eba-be09-8e5c181d00a3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:05.667579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d8f18b-64b7-4eba-be09-8e5c181d00a3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:05.668034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c6d8f18b-64b7-4eba-be09-8e5c181d00a3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:05.806345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c6d8f18b-64b7-4eba-be09-8e5c181d00a3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:05.814504 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c6d8f18b-64b7-4eba-be09-8e5c181d00a3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1689 microversion: 2.1 time: 0.162004 Aug 27 03:47:05.815087 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3505/7195] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:05 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:06.505899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2215549e-57b9-4f05-8a87-7a26efb8c7c0 req-a54dcda5-1c06-4851-a69d-e98c80fbb90d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bd8cac-1995-48a6-8968-f139c67d93ba", "name": "network-vif-deleted", "tag": "8ade9e20-cdcb-4bc0-bb34-c7bc14e20bd0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:06.520556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2215549e-57b9-4f05-8a87-7a26efb8c7c0 req-a54dcda5-1c06-4851-a69d-e98c80fbb90d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:06.521051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2215549e-57b9-4f05-8a87-7a26efb8c7c0 req-a54dcda5-1c06-4851-a69d-e98c80fbb90d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:06.521497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2215549e-57b9-4f05-8a87-7a26efb8c7c0 req-a54dcda5-1c06-4851-a69d-e98c80fbb90d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:06.533862 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2215549e-57b9-4f05-8a87-7a26efb8c7c0 req-a54dcda5-1c06-4851-a69d-e98c80fbb90d service nova] Creating event network-vif-deleted:8ade9e20-cdcb-4bc0-bb34-c7bc14e20bd0 for instance 04bd8cac-1995-48a6-8968-f139c67d93ba on n-h2-852084-5 Aug 27 03:47:06.540037 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2215549e-57b9-4f05-8a87-7a26efb8c7c0 req-a54dcda5-1c06-4851-a69d-e98c80fbb90d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038074 Aug 27 03:47:06.540690 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3691/7196] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:06.837889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:06.838913 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:06.846025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:06.846598 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:06.847064 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:06.847806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:06.848282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:06.848734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:06.907396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:06.908292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:06.909274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:06.909962 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lazy-loading 'fault' on Instance uuid 04bd8cac-1995-48a6-8968-f139c67d93ba {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:47:06.968740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:06.976921 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-878aaa35-19cb-4c66-9167-1ac91d7064c8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 200 len: 1357 microversion: 2.1 time: 0.143479 Aug 27 03:47:06.977892 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3506/7197] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:06 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:08.002023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:08.002744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 04bd8cac-1995-48a6-8968-f139c67d93ba] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:08.009949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:08.010505 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:08.010957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:08.011678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:08.012205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:08.012646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:08.027927 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] HTTP exception thrown: Instance 04bd8cac-1995-48a6-8968-f139c67d93ba could not be found. Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Request method failure captured: Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba HTTP/1.1 Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZN8cUgbiN4jgbPGTVOnhXBTDRmGKc9TyWokgNVlUuhNsxgycX61xbACtrSelhVLFuDHDnMZajNNVM_Hr6ZS6h8ad21L06WPxjymJt8L-tJGxk5LXZkiJxOpgJBiULt4nkeFJydoyPTZwXXBxmeCLfLrgQwO_5KT--2T1aZJG-NqXWw Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 57b6a3a135de4feb8541658376863195 Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_57b6a3a135de4feb8541658376863195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/57b6a3a135de4feb8541658376863195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/57b6a3a135de4feb8541658376863195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/57b6a3a135de4feb8541658376863195"}]}] Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 57b6a3a135de4feb8541658376863195 Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestNetworkAdvancedServerOps-1128889267-project Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b7d61a4dd7b64c65b9743f9f3b0d3aad Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1128889267-project Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 04bd8cac-1995-48a6-8968-f139c67d93ba could not be found. Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '04bd8cac-1995-48a6-8968-f139c67d93ba'} Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04bd8cac-1995-48a6-8968-f139c67d93ba could not be found. Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04bd8cac-1995-48a6-8968-f139c67d93ba could not be found. Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:47:08.029629 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:47:08.037205 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:47:08.037205 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:47:08.037205 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:47:08.037205 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:47:08.037205 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:47:08.037205 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:47:08.037205 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04bd8cac-1995-48a6-8968-f139c67d93ba could not be found. Aug 27 03:47:08.037205 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:47:08.037205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Returning 404 to user: Instance 04bd8cac-1995-48a6-8968-f139c67d93ba could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:47:08.037205 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-57094def-c156-45f1-9c4d-78f2244bc98f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba" status: 404 len: 111 microversion: 2.1 time: 0.034452 Aug 27 03:47:08.037205 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3692/7198] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:07 2022] GET /compute/v2.1/servers/04bd8cac-1995-48a6-8968-f139c67d93ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:47:11.091372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b1a12ed6-da1c-4505-b143-294151dc21aa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '.version_select at 0x7f4d29ddd160>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:11.112838 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b1a12ed6-da1c-4505-b143-294151dc21aa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2044144472" status: 202 len: 0 microversion: 2.1 time: 0.025845 Aug 27 03:47:11.113432 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3507/7199] 10.222.0.99 () {58 vars in 1284 bytes} [Sat Aug 27 03:47:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2044144472 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:47:11.138637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1462e430-0805-4a32-a161-73a6b59f998c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'create', calling method: .version_select at 0x7f4d2acb7e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-242094537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMPqVngdVg3H7B998lvPDeJ7JaagSTvDHJXZPhzvQ8/dosJHuqxqICDEmngfuEZVFpru65HNdlleW++fNAeP3R5H7RWT4cIpCW/ei8GasQYXDPzt2O+S6D3IINJ34fq0g=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:11.155548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-1462e430-0805-4a32-a161-73a6b59f998c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for project 57b6a3a135de4feb8541658376863195. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:47:11.161676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-1462e430-0805-4a32-a161-73a6b59f998c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for user b7d61a4dd7b64c65b9743f9f3b0d3aad and project 57b6a3a135de4feb8541658376863195. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:47:11.186225 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1462e430-0805-4a32-a161-73a6b59f998c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051561 Aug 27 03:47:11.186863 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3693/7200] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:47:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:16.832130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1634620953", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "12a0434d-af70-4109-99a1-84895fd7611f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-242094537", "security_groups": [{"name": "tempest-secgroup-smoke-1656968926"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:16.971020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] validate_networks() for [('12a0434d-af70-4109-99a1-84895fd7611f', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:47:16.978410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:17.535398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:47:17.535842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:47:17.536337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:47:17.536768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:47:17.537204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:47:17.547295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:17.548290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:17.548757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:17.549736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:17.550228 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:17.550675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:17.571338 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for project 57b6a3a135de4feb8541658376863195. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:47:17.577164 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for user b7d61a4dd7b64c65b9743f9f3b0d3aad and project 57b6a3a135de4feb8541658376863195. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:47:17.590803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:47:17.593231 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:47:17.648224 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [dc5eddf9-d794-45b8-be24-3a550ddb0c54] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:47:18.657621 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [dc5eddf9-d794-45b8-be24-3a550ddb0c54] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 53844. Aug 27 03:47:18.662096 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b9069fea-f85d-425c-ba3b-ace3f680ff91 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.835366 Aug 27 03:47:18.663264 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3508/7201] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:47:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:47:18.672303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=32 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:18.677186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-550547de-5e64-45d9-81e0-7c4e9479fbac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:18.677836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-550547de-5e64-45d9-81e0-7c4e9479fbac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:18.747637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-550547de-5e64-45d9-81e0-7c4e9479fbac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:18.759010 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-550547de-5e64-45d9-81e0-7c4e9479fbac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1266 microversion: 2.1 time: 0.088231 Aug 27 03:47:18.762448 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3694/7202] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:18 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:19.782619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65cde87d-5f5e-4f92-95ae-90e4bbbc97ca tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:19.783346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65cde87d-5f5e-4f92-95ae-90e4bbbc97ca tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:19.792620 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65cde87d-5f5e-4f92-95ae-90e4bbbc97ca tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:19.793047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65cde87d-5f5e-4f92-95ae-90e4bbbc97ca tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:19.793518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65cde87d-5f5e-4f92-95ae-90e4bbbc97ca tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:19.794309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65cde87d-5f5e-4f92-95ae-90e4bbbc97ca tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:19.794791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65cde87d-5f5e-4f92-95ae-90e4bbbc97ca tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:19.795247 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65cde87d-5f5e-4f92-95ae-90e4bbbc97ca tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:19.892675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-65cde87d-5f5e-4f92-95ae-90e4bbbc97ca tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:19.908665 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65cde87d-5f5e-4f92-95ae-90e4bbbc97ca tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1318 microversion: 2.1 time: 0.130097 Aug 27 03:47:19.909363 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3509/7203] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:19 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1318 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:20.931701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e0ce4898-7dc8-490c-b627-601b3ff83a66 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:20.932397 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e0ce4898-7dc8-490c-b627-601b3ff83a66 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:20.940509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0ce4898-7dc8-490c-b627-601b3ff83a66 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:20.941011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0ce4898-7dc8-490c-b627-601b3ff83a66 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:20.941452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0ce4898-7dc8-490c-b627-601b3ff83a66 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:20.942385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0ce4898-7dc8-490c-b627-601b3ff83a66 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:20.942853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0ce4898-7dc8-490c-b627-601b3ff83a66 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:20.943296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e0ce4898-7dc8-490c-b627-601b3ff83a66 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:21.085143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e0ce4898-7dc8-490c-b627-601b3ff83a66 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:21.093919 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e0ce4898-7dc8-490c-b627-601b3ff83a66 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1392 microversion: 2.1 time: 0.166662 Aug 27 03:47:21.094516 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3695/7204] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:20 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:21.315269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-01b3631f-8f59-403b-946e-4b2eaedd7e01 req-1c0e0f7a-6ff6-4d6f-91a4-c15f833b9b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cad4b3e-0787-42ac-86ee-49b83422317d", "tag": "74649c15-5a21-4c1e-a9a0-72d7d934f64a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:21.329882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-01b3631f-8f59-403b-946e-4b2eaedd7e01 req-1c0e0f7a-6ff6-4d6f-91a4-c15f833b9b90 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:21.330387 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-01b3631f-8f59-403b-946e-4b2eaedd7e01 req-1c0e0f7a-6ff6-4d6f-91a4-c15f833b9b90 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:21.330841 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-01b3631f-8f59-403b-946e-4b2eaedd7e01 req-1c0e0f7a-6ff6-4d6f-91a4-c15f833b9b90 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:21.348679 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-01b3631f-8f59-403b-946e-4b2eaedd7e01 req-1c0e0f7a-6ff6-4d6f-91a4-c15f833b9b90 service nova] Creating event network-changed:74649c15-5a21-4c1e-a9a0-72d7d934f64a for instance 7cad4b3e-0787-42ac-86ee-49b83422317d on n-h2-852084-5 Aug 27 03:47:21.359949 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-01b3631f-8f59-403b-946e-4b2eaedd7e01 req-1c0e0f7a-6ff6-4d6f-91a4-c15f833b9b90 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059696 Aug 27 03:47:21.361015 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3510/7205] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:22.115284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bcf16c40-1f2f-45e5-8257-deeb221a9b53 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:22.115897 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bcf16c40-1f2f-45e5-8257-deeb221a9b53 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:22.123088 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf16c40-1f2f-45e5-8257-deeb221a9b53 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:22.123567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf16c40-1f2f-45e5-8257-deeb221a9b53 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:22.124005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf16c40-1f2f-45e5-8257-deeb221a9b53 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:22.124700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf16c40-1f2f-45e5-8257-deeb221a9b53 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:22.125155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf16c40-1f2f-45e5-8257-deeb221a9b53 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:22.125582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bcf16c40-1f2f-45e5-8257-deeb221a9b53 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:22.261925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bcf16c40-1f2f-45e5-8257-deeb221a9b53 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:22.270314 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bcf16c40-1f2f-45e5-8257-deeb221a9b53 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1392 microversion: 2.1 time: 0.158900 Aug 27 03:47:22.270916 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3696/7206] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:22 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:23.294590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a2be590f-c701-4a22-9d74-e99455265e5c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:23.295224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a2be590f-c701-4a22-9d74-e99455265e5c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:23.302005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2be590f-c701-4a22-9d74-e99455265e5c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:23.302518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2be590f-c701-4a22-9d74-e99455265e5c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:23.303034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2be590f-c701-4a22-9d74-e99455265e5c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:23.303796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2be590f-c701-4a22-9d74-e99455265e5c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:23.304273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2be590f-c701-4a22-9d74-e99455265e5c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:23.304722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-a2be590f-c701-4a22-9d74-e99455265e5c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:23.732238 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a2be590f-c701-4a22-9d74-e99455265e5c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:23.740185 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a2be590f-c701-4a22-9d74-e99455265e5c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1392 microversion: 2.1 time: 0.451377 Aug 27 03:47:23.740763 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3511/7207] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:23 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1392 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:24.760643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7ac2e553-a615-4f2e-a051-46ce51964463 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:24.761268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7ac2e553-a615-4f2e-a051-46ce51964463 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:24.768565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ac2e553-a615-4f2e-a051-46ce51964463 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:24.769273 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ac2e553-a615-4f2e-a051-46ce51964463 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:24.769859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ac2e553-a615-4f2e-a051-46ce51964463 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:24.770865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ac2e553-a615-4f2e-a051-46ce51964463 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:24.771502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ac2e553-a615-4f2e-a051-46ce51964463 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:24.771949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7ac2e553-a615-4f2e-a051-46ce51964463 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:24.913806 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7ac2e553-a615-4f2e-a051-46ce51964463 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:24.922016 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7ac2e553-a615-4f2e-a051-46ce51964463 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1392 microversion: 2.1 time: 0.165304 Aug 27 03:47:24.922615 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3697/7208] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:24 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:25.943114 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b6907668-d156-4ed4-8f13-1f843a5f4b09 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:25.943751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b6907668-d156-4ed4-8f13-1f843a5f4b09 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:25.950687 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6907668-d156-4ed4-8f13-1f843a5f4b09 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:25.951190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6907668-d156-4ed4-8f13-1f843a5f4b09 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:25.951647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6907668-d156-4ed4-8f13-1f843a5f4b09 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:25.952389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6907668-d156-4ed4-8f13-1f843a5f4b09 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:25.952862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6907668-d156-4ed4-8f13-1f843a5f4b09 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:25.953308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b6907668-d156-4ed4-8f13-1f843a5f4b09 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:26.087417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b6907668-d156-4ed4-8f13-1f843a5f4b09 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:26.095506 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b6907668-d156-4ed4-8f13-1f843a5f4b09 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1392 microversion: 2.1 time: 0.156371 Aug 27 03:47:26.096083 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3512/7209] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:25 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:26.722984 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-69f24d31-13f8-4320-a649-3970648b15c7 req-e5e04fe2-b677-48bb-af3a-c77e421c3743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cad4b3e-0787-42ac-86ee-49b83422317d", "name": "network-vif-plugged", "status": "completed", "tag": "74649c15-5a21-4c1e-a9a0-72d7d934f64a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:26.734036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-69f24d31-13f8-4320-a649-3970648b15c7 req-e5e04fe2-b677-48bb-af3a-c77e421c3743 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:26.734532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-69f24d31-13f8-4320-a649-3970648b15c7 req-e5e04fe2-b677-48bb-af3a-c77e421c3743 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:26.734979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-69f24d31-13f8-4320-a649-3970648b15c7 req-e5e04fe2-b677-48bb-af3a-c77e421c3743 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:26.747303 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-69f24d31-13f8-4320-a649-3970648b15c7 req-e5e04fe2-b677-48bb-af3a-c77e421c3743 service nova] Creating event network-vif-plugged:74649c15-5a21-4c1e-a9a0-72d7d934f64a for instance 7cad4b3e-0787-42ac-86ee-49b83422317d on n-h2-852084-5 Aug 27 03:47:26.752646 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-69f24d31-13f8-4320-a649-3970648b15c7 req-e5e04fe2-b677-48bb-af3a-c77e421c3743 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033602 Aug 27 03:47:26.753447 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3698/7210] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:27.116806 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bb559e0d-b3b4-4890-abc5-8e247d8a6a4a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:27.117537 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bb559e0d-b3b4-4890-abc5-8e247d8a6a4a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:27.125240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb559e0d-b3b4-4890-abc5-8e247d8a6a4a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:27.125893 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb559e0d-b3b4-4890-abc5-8e247d8a6a4a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:27.126353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb559e0d-b3b4-4890-abc5-8e247d8a6a4a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:27.127086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb559e0d-b3b4-4890-abc5-8e247d8a6a4a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:27.127554 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb559e0d-b3b4-4890-abc5-8e247d8a6a4a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:27.128000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bb559e0d-b3b4-4890-abc5-8e247d8a6a4a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:27.268343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bb559e0d-b3b4-4890-abc5-8e247d8a6a4a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:27.277077 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bb559e0d-b3b4-4890-abc5-8e247d8a6a4a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1392 microversion: 2.1 time: 0.164475 Aug 27 03:47:27.277686 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3513/7211] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:27 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:28.299465 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c7758e28-74d8-47b2-b1ca-dd98a9d17e3b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:28.300392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c7758e28-74d8-47b2-b1ca-dd98a9d17e3b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:28.307551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7758e28-74d8-47b2-b1ca-dd98a9d17e3b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:28.308041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7758e28-74d8-47b2-b1ca-dd98a9d17e3b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:28.308487 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7758e28-74d8-47b2-b1ca-dd98a9d17e3b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:28.309192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7758e28-74d8-47b2-b1ca-dd98a9d17e3b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:28.309649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7758e28-74d8-47b2-b1ca-dd98a9d17e3b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:28.310134 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c7758e28-74d8-47b2-b1ca-dd98a9d17e3b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:28.450468 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c7758e28-74d8-47b2-b1ca-dd98a9d17e3b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:28.458571 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c7758e28-74d8-47b2-b1ca-dd98a9d17e3b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1563 microversion: 2.1 time: 0.164269 Aug 27 03:47:28.459153 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3699/7212] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:28 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:28.479948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-696efcd4-e23a-4495-8489-e7bcc3fc203b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:28.480580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-696efcd4-e23a-4495-8489-e7bcc3fc203b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:28.482609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:28.483299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:28.485037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:28.492104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-696efcd4-e23a-4495-8489-e7bcc3fc203b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:28.492619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-696efcd4-e23a-4495-8489-e7bcc3fc203b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:28.493072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-696efcd4-e23a-4495-8489-e7bcc3fc203b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:28.493791 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-696efcd4-e23a-4495-8489-e7bcc3fc203b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:28.494301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-696efcd4-e23a-4495-8489-e7bcc3fc203b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:28.494757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-696efcd4-e23a-4495-8489-e7bcc3fc203b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:28.627826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-696efcd4-e23a-4495-8489-e7bcc3fc203b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:28.635819 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-696efcd4-e23a-4495-8489-e7bcc3fc203b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1563 microversion: 2.1 time: 0.160190 Aug 27 03:47:28.636668 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3514/7213] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:28 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:30.531343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1f5b88d3-e591-4db6-90e2-9ef3c9f2fd0e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:47:30.531965 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1f5b88d3-e591-4db6-90e2-9ef3c9f2fd0e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:30.534077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:30.540594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-598b5bc1-aeba-410e-92d9-489463d80ffe req-8d1b600d-81d1-4374-880f-eefcd97c756c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cad4b3e-0787-42ac-86ee-49b83422317d", "tag": "74649c15-5a21-4c1e-a9a0-72d7d934f64a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:30.547692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:30.555827 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5b88d3-e591-4db6-90e2-9ef3c9f2fd0e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:30.556078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-598b5bc1-aeba-410e-92d9-489463d80ffe req-8d1b600d-81d1-4374-880f-eefcd97c756c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:30.556318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5b88d3-e591-4db6-90e2-9ef3c9f2fd0e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:30.556493 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-598b5bc1-aeba-410e-92d9-489463d80ffe req-8d1b600d-81d1-4374-880f-eefcd97c756c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:30.556898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-598b5bc1-aeba-410e-92d9-489463d80ffe req-8d1b600d-81d1-4374-880f-eefcd97c756c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:30.557504 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5b88d3-e591-4db6-90e2-9ef3c9f2fd0e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:30.558881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5b88d3-e591-4db6-90e2-9ef3c9f2fd0e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:30.559363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5b88d3-e591-4db6-90e2-9ef3c9f2fd0e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:30.559791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1f5b88d3-e591-4db6-90e2-9ef3c9f2fd0e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:30.572641 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-598b5bc1-aeba-410e-92d9-489463d80ffe req-8d1b600d-81d1-4374-880f-eefcd97c756c service nova] Creating event network-changed:74649c15-5a21-4c1e-a9a0-72d7d934f64a for instance 7cad4b3e-0787-42ac-86ee-49b83422317d on n-h2-852084-5 Aug 27 03:47:30.577876 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-598b5bc1-aeba-410e-92d9-489463d80ffe req-8d1b600d-81d1-4374-880f-eefcd97c756c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041706 Aug 27 03:47:30.578892 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3515/7214] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:47:30.708416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1f5b88d3-e591-4db6-90e2-9ef3c9f2fd0e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:47:30.717071 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1f5b88d3-e591-4db6-90e2-9ef3c9f2fd0e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1563 microversion: 2.1 time: 0.189818 Aug 27 03:47:30.717712 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3700/7215] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:47:30 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:47:53.977169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:53.977974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=36 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:47:53.982165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4e3cbab8-03cf-461d-95f0-edb90d984e68 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:47:53.984429 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4e3cbab8-03cf-461d-95f0-edb90d984e68 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:47:53.991328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e3cbab8-03cf-461d-95f0-edb90d984e68 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:53.991817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e3cbab8-03cf-461d-95f0-edb90d984e68 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:53.992287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e3cbab8-03cf-461d-95f0-edb90d984e68 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:53.992983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e3cbab8-03cf-461d-95f0-edb90d984e68 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:47:53.993452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e3cbab8-03cf-461d-95f0-edb90d984e68 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:47:53.993918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4e3cbab8-03cf-461d-95f0-edb90d984e68 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:47:54.043722 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4e3cbab8-03cf-461d-95f0-edb90d984e68 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d/action" status: 200 len: 24557 microversion: 2.1 time: 0.068974 Aug 27 03:47:54.044518 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3516/7216] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:47:53 2022] POST /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d/action => generated 24557 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:48:00.388753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8d48fd0b-3642-4927-9ce8-bd6fb3f7c937 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:00.391085 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8d48fd0b-3642-4927-9ce8-bd6fb3f7c937 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:00.394204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:00.394876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=32 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:00.401650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d48fd0b-3642-4927-9ce8-bd6fb3f7c937 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:00.402175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d48fd0b-3642-4927-9ce8-bd6fb3f7c937 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:00.402638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d48fd0b-3642-4927-9ce8-bd6fb3f7c937 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:00.403342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d48fd0b-3642-4927-9ce8-bd6fb3f7c937 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:00.403802 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d48fd0b-3642-4927-9ce8-bd6fb3f7c937 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:00.404235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8d48fd0b-3642-4927-9ce8-bd6fb3f7c937 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:00.479508 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8d48fd0b-3642-4927-9ce8-bd6fb3f7c937 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d/action" status: 202 len: 0 microversion: 2.1 time: 0.094637 Aug 27 03:48:00.480206 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3701/7217] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:48:00 2022] POST /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:48:00.489266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d072f9a5-808a-4cab-8835-00b6f34502d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:00.490028 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d072f9a5-808a-4cab-8835-00b6f34502d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:00.498376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d072f9a5-808a-4cab-8835-00b6f34502d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:00.498852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d072f9a5-808a-4cab-8835-00b6f34502d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:00.499345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d072f9a5-808a-4cab-8835-00b6f34502d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:00.500039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d072f9a5-808a-4cab-8835-00b6f34502d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:00.500503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d072f9a5-808a-4cab-8835-00b6f34502d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:00.500947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d072f9a5-808a-4cab-8835-00b6f34502d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:00.725088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d072f9a5-808a-4cab-8835-00b6f34502d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:00.733510 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d072f9a5-808a-4cab-8835-00b6f34502d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1674 microversion: 2.1 time: 0.248595 Aug 27 03:48:00.734186 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3517/7218] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:00 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1674 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:01.758201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d48d33ec-ac34-495b-a3f5-761ac556b638 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:01.758955 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d48d33ec-ac34-495b-a3f5-761ac556b638 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:01.765469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48d33ec-ac34-495b-a3f5-761ac556b638 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:01.765996 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48d33ec-ac34-495b-a3f5-761ac556b638 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:01.766449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48d33ec-ac34-495b-a3f5-761ac556b638 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:01.767263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48d33ec-ac34-495b-a3f5-761ac556b638 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:01.767621 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48d33ec-ac34-495b-a3f5-761ac556b638 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:01.768135 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d48d33ec-ac34-495b-a3f5-761ac556b638 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:01.917576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d48d33ec-ac34-495b-a3f5-761ac556b638 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:01.925579 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d48d33ec-ac34-495b-a3f5-761ac556b638 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1679 microversion: 2.1 time: 0.174366 Aug 27 03:48:01.926180 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3702/7219] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:01 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:02.947807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-87c4bade-ac65-4425-9533-e6178b441691 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:02.948440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-87c4bade-ac65-4425-9533-e6178b441691 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:02.955350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87c4bade-ac65-4425-9533-e6178b441691 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:02.955921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87c4bade-ac65-4425-9533-e6178b441691 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:02.956374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87c4bade-ac65-4425-9533-e6178b441691 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:02.957076 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87c4bade-ac65-4425-9533-e6178b441691 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:02.957546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87c4bade-ac65-4425-9533-e6178b441691 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:02.958015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-87c4bade-ac65-4425-9533-e6178b441691 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:03.090213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-87c4bade-ac65-4425-9533-e6178b441691 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:03.098130 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-87c4bade-ac65-4425-9533-e6178b441691 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1679 microversion: 2.1 time: 0.154810 Aug 27 03:48:03.098703 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3518/7220] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:02 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:04.120238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2b75769a-1100-42d2-9e3b-03dba921a261 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:04.120935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2b75769a-1100-42d2-9e3b-03dba921a261 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:04.128049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b75769a-1100-42d2-9e3b-03dba921a261 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:04.128540 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b75769a-1100-42d2-9e3b-03dba921a261 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:04.128989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b75769a-1100-42d2-9e3b-03dba921a261 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:04.129723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b75769a-1100-42d2-9e3b-03dba921a261 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:04.130198 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b75769a-1100-42d2-9e3b-03dba921a261 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:04.130635 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b75769a-1100-42d2-9e3b-03dba921a261 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:04.267131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2b75769a-1100-42d2-9e3b-03dba921a261 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:04.275766 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2b75769a-1100-42d2-9e3b-03dba921a261 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1679 microversion: 2.1 time: 0.159490 Aug 27 03:48:04.276344 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3703/7221] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:04 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:05.297205 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f0e482d8-9d43-42ab-a795-2db52d360c50 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:05.297872 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f0e482d8-9d43-42ab-a795-2db52d360c50 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:05.305002 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0e482d8-9d43-42ab-a795-2db52d360c50 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:05.305514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0e482d8-9d43-42ab-a795-2db52d360c50 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:05.306017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0e482d8-9d43-42ab-a795-2db52d360c50 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:05.306744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0e482d8-9d43-42ab-a795-2db52d360c50 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:05.307223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0e482d8-9d43-42ab-a795-2db52d360c50 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:05.307671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f0e482d8-9d43-42ab-a795-2db52d360c50 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:05.445713 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f0e482d8-9d43-42ab-a795-2db52d360c50 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:05.453621 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f0e482d8-9d43-42ab-a795-2db52d360c50 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1679 microversion: 2.1 time: 0.160452 Aug 27 03:48:05.454268 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3519/7222] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:05 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:06.476416 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0640c089-634c-49a6-b171-07ee29d8111a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:06.477031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0640c089-634c-49a6-b171-07ee29d8111a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:06.483911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0640c089-634c-49a6-b171-07ee29d8111a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:06.484389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0640c089-634c-49a6-b171-07ee29d8111a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:06.484829 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0640c089-634c-49a6-b171-07ee29d8111a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:06.485524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0640c089-634c-49a6-b171-07ee29d8111a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:06.486008 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0640c089-634c-49a6-b171-07ee29d8111a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:06.486437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0640c089-634c-49a6-b171-07ee29d8111a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:06.622903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0640c089-634c-49a6-b171-07ee29d8111a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:06.630788 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0640c089-634c-49a6-b171-07ee29d8111a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1679 microversion: 2.1 time: 0.158742 Aug 27 03:48:06.631370 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3704/7223] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:06 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:07.652341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-56b86e7e-12e3-4073-b075-38fbe7dd6dad tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:07.652967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-56b86e7e-12e3-4073-b075-38fbe7dd6dad tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:07.659882 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b86e7e-12e3-4073-b075-38fbe7dd6dad tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:07.660373 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b86e7e-12e3-4073-b075-38fbe7dd6dad tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:07.660821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b86e7e-12e3-4073-b075-38fbe7dd6dad tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:07.661519 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b86e7e-12e3-4073-b075-38fbe7dd6dad tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:07.662015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b86e7e-12e3-4073-b075-38fbe7dd6dad tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:07.662454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-56b86e7e-12e3-4073-b075-38fbe7dd6dad tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:07.795755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-56b86e7e-12e3-4073-b075-38fbe7dd6dad tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:07.803561 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-56b86e7e-12e3-4073-b075-38fbe7dd6dad tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1679 microversion: 2.1 time: 0.155211 Aug 27 03:48:07.804134 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3520/7224] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:07 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:08.826778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-733579a2-ce2b-4e05-b0eb-a73edf373381 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:08.827720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-733579a2-ce2b-4e05-b0eb-a73edf373381 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:08.834451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733579a2-ce2b-4e05-b0eb-a73edf373381 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:08.834939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733579a2-ce2b-4e05-b0eb-a73edf373381 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:08.835383 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733579a2-ce2b-4e05-b0eb-a73edf373381 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:08.836082 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733579a2-ce2b-4e05-b0eb-a73edf373381 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:08.836550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733579a2-ce2b-4e05-b0eb-a73edf373381 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:08.837551 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-733579a2-ce2b-4e05-b0eb-a73edf373381 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:08.973555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-733579a2-ce2b-4e05-b0eb-a73edf373381 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:08.981347 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-733579a2-ce2b-4e05-b0eb-a73edf373381 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1679 microversion: 2.1 time: 0.158684 Aug 27 03:48:08.981961 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3705/7225] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:08 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:48:10.003294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-be3d2d3a-75b4-4703-81ac-627415c020ba tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:10.003926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-be3d2d3a-75b4-4703-81ac-627415c020ba tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:10.010859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be3d2d3a-75b4-4703-81ac-627415c020ba tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:10.011359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be3d2d3a-75b4-4703-81ac-627415c020ba tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:10.011814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be3d2d3a-75b4-4703-81ac-627415c020ba tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:10.012521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be3d2d3a-75b4-4703-81ac-627415c020ba tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:10.012989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be3d2d3a-75b4-4703-81ac-627415c020ba tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:10.013433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be3d2d3a-75b4-4703-81ac-627415c020ba tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:10.146852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-be3d2d3a-75b4-4703-81ac-627415c020ba tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:10.155813 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-be3d2d3a-75b4-4703-81ac-627415c020ba tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1679 microversion: 2.1 time: 0.156394 Aug 27 03:48:10.156513 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3521/7226] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:09 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:11.178160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2aa9a4fc-bf42-4f3d-b591-6912da511797 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:11.178782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2aa9a4fc-bf42-4f3d-b591-6912da511797 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:11.185913 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa9a4fc-bf42-4f3d-b591-6912da511797 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:11.186402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa9a4fc-bf42-4f3d-b591-6912da511797 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:11.186843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa9a4fc-bf42-4f3d-b591-6912da511797 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:11.187545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa9a4fc-bf42-4f3d-b591-6912da511797 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:11.188006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa9a4fc-bf42-4f3d-b591-6912da511797 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:11.188438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2aa9a4fc-bf42-4f3d-b591-6912da511797 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:11.325151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2aa9a4fc-bf42-4f3d-b591-6912da511797 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:11.333204 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2aa9a4fc-bf42-4f3d-b591-6912da511797 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1679 microversion: 2.1 time: 0.158952 Aug 27 03:48:11.333899 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3706/7227] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:11 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:12.358660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-be02b919-0cca-4ca3-83d5-e1cf683fa112 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:12.359234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-be02b919-0cca-4ca3-83d5-e1cf683fa112 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:12.366264 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be02b919-0cca-4ca3-83d5-e1cf683fa112 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:12.366758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be02b919-0cca-4ca3-83d5-e1cf683fa112 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:12.367204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be02b919-0cca-4ca3-83d5-e1cf683fa112 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:12.367988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be02b919-0cca-4ca3-83d5-e1cf683fa112 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:12.368976 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be02b919-0cca-4ca3-83d5-e1cf683fa112 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:12.369415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-be02b919-0cca-4ca3-83d5-e1cf683fa112 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:12.513350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-be02b919-0cca-4ca3-83d5-e1cf683fa112 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:12.521124 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-be02b919-0cca-4ca3-83d5-e1cf683fa112 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1682 microversion: 2.1 time: 0.166465 Aug 27 03:48:12.521741 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3522/7228] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:12 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:36.708256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a0bc5708-aebd-4a2b-b278-a985c97e461e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:36.710824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a0bc5708-aebd-4a2b-b278-a985c97e461e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:36.713584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=12 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:36.714610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:36.722112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0bc5708-aebd-4a2b-b278-a985c97e461e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:36.722614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0bc5708-aebd-4a2b-b278-a985c97e461e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:36.723062 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0bc5708-aebd-4a2b-b278-a985c97e461e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:36.723774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0bc5708-aebd-4a2b-b278-a985c97e461e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:36.724248 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0bc5708-aebd-4a2b-b278-a985c97e461e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:36.724671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a0bc5708-aebd-4a2b-b278-a985c97e461e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:36.786226 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a0bc5708-aebd-4a2b-b278-a985c97e461e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d/action" status: 200 len: 69090 microversion: 2.1 time: 0.081883 Aug 27 03:48:36.787247 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3707/7229] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:48:36 2022] POST /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d/action => generated 69090 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:48:43.795796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-36b5f6cf-a91f-4367-96d4-b250d3e8bcfe tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:43.796383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-36b5f6cf-a91f-4367-96d4-b250d3e8bcfe tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:43.799448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=14 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:43.800420 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=40 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:43.805887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36b5f6cf-a91f-4367-96d4-b250d3e8bcfe tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:43.806613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36b5f6cf-a91f-4367-96d4-b250d3e8bcfe tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:43.807457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36b5f6cf-a91f-4367-96d4-b250d3e8bcfe tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:43.808208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36b5f6cf-a91f-4367-96d4-b250d3e8bcfe tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:43.808756 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36b5f6cf-a91f-4367-96d4-b250d3e8bcfe tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:43.809135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-36b5f6cf-a91f-4367-96d4-b250d3e8bcfe tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:43.838935 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-36b5f6cf-a91f-4367-96d4-b250d3e8bcfe tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:48:43.912447 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-905ac117-4b3c-44bf-8594-1ea44733a5be req-fed69059-5a0e-4287-b9e9-555e8b8c341a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cad4b3e-0787-42ac-86ee-49b83422317d", "tag": "74649c15-5a21-4c1e-a9a0-72d7d934f64a"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:43.925763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-905ac117-4b3c-44bf-8594-1ea44733a5be req-fed69059-5a0e-4287-b9e9-555e8b8c341a service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:43.926186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-905ac117-4b3c-44bf-8594-1ea44733a5be req-fed69059-5a0e-4287-b9e9-555e8b8c341a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:43.926925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-905ac117-4b3c-44bf-8594-1ea44733a5be req-fed69059-5a0e-4287-b9e9-555e8b8c341a service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:43.927888 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-36b5f6cf-a91f-4367-96d4-b250d3e8bcfe tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 204 len: 0 microversion: 2.1 time: 0.135897 Aug 27 03:48:43.929365 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3523/7230] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:48:43 2022] DELETE /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:48:43.940222 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-905ac117-4b3c-44bf-8594-1ea44733a5be req-fed69059-5a0e-4287-b9e9-555e8b8c341a service nova] Creating event network-changed:74649c15-5a21-4c1e-a9a0-72d7d934f64a for instance 7cad4b3e-0787-42ac-86ee-49b83422317d on n-h2-852084-5 Aug 27 03:48:43.941539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ed24b27d-02bd-4790-96c8-fa8357cfefa7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:43.942447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ed24b27d-02bd-4790-96c8-fa8357cfefa7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:43.945506 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-905ac117-4b3c-44bf-8594-1ea44733a5be req-fed69059-5a0e-4287-b9e9-555e8b8c341a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151200 Aug 27 03:48:43.946626 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3708/7231] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:43.950370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed24b27d-02bd-4790-96c8-fa8357cfefa7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:43.950887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed24b27d-02bd-4790-96c8-fa8357cfefa7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:43.951346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed24b27d-02bd-4790-96c8-fa8357cfefa7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:43.952082 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed24b27d-02bd-4790-96c8-fa8357cfefa7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:43.952556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed24b27d-02bd-4790-96c8-fa8357cfefa7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:43.953003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ed24b27d-02bd-4790-96c8-fa8357cfefa7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:44.086207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ed24b27d-02bd-4790-96c8-fa8357cfefa7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:44.095110 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ed24b27d-02bd-4790-96c8-fa8357cfefa7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1688 microversion: 2.1 time: 0.160840 Aug 27 03:48:44.095695 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3524/7232] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:43 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:45.118425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da728d17-fa4e-46a2-81d0-1d5e53a8044c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:45.119581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-da728d17-fa4e-46a2-81d0-1d5e53a8044c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:45.125931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da728d17-fa4e-46a2-81d0-1d5e53a8044c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:45.126427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da728d17-fa4e-46a2-81d0-1d5e53a8044c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:45.126875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da728d17-fa4e-46a2-81d0-1d5e53a8044c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:45.127577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da728d17-fa4e-46a2-81d0-1d5e53a8044c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:45.128042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da728d17-fa4e-46a2-81d0-1d5e53a8044c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:45.128478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da728d17-fa4e-46a2-81d0-1d5e53a8044c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:45.264732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-da728d17-fa4e-46a2-81d0-1d5e53a8044c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:45.273256 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-da728d17-fa4e-46a2-81d0-1d5e53a8044c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1688 microversion: 2.1 time: 0.160094 Aug 27 03:48:45.273871 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3709/7233] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:45 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:46.047864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-3c57a40d-8685-41e1-b36c-f7dbbabe12ef req-55f8d9b7-e289-4ab6-9546-7078420d9ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cad4b3e-0787-42ac-86ee-49b83422317d", "name": "network-vif-deleted", "tag": "74649c15-5a21-4c1e-a9a0-72d7d934f64a"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:46.057353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3c57a40d-8685-41e1-b36c-f7dbbabe12ef req-55f8d9b7-e289-4ab6-9546-7078420d9ede service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:46.057889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3c57a40d-8685-41e1-b36c-f7dbbabe12ef req-55f8d9b7-e289-4ab6-9546-7078420d9ede service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:46.058341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-3c57a40d-8685-41e1-b36c-f7dbbabe12ef req-55f8d9b7-e289-4ab6-9546-7078420d9ede service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:46.070262 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-3c57a40d-8685-41e1-b36c-f7dbbabe12ef req-55f8d9b7-e289-4ab6-9546-7078420d9ede service nova] Creating event network-vif-deleted:74649c15-5a21-4c1e-a9a0-72d7d934f64a for instance 7cad4b3e-0787-42ac-86ee-49b83422317d on n-h2-852084-5 Aug 27 03:48:46.076251 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-3c57a40d-8685-41e1-b36c-f7dbbabe12ef req-55f8d9b7-e289-4ab6-9546-7078420d9ede service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094210 Aug 27 03:48:46.076895 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3525/7234] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:46.294779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:46.295952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:46.303451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:46.303942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:46.304388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:46.305100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:46.305561 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:46.306022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:46.352506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:46.353353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:46.353803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:46.354269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lazy-loading 'fault' on Instance uuid 7cad4b3e-0787-42ac-86ee-49b83422317d {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:48:46.398966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:46.408907 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8a57c7c2-83e4-4297-93f8-fa03891c61e1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 200 len: 1356 microversion: 2.1 time: 0.117941 Aug 27 03:48:46.409513 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3710/7235] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:46 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 1356 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:47.432144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:47.432881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 7cad4b3e-0787-42ac-86ee-49b83422317d] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:47.439165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:47.439664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:47.440148 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:47.440856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:47.441325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:47.441802 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:47.455050 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] HTTP exception thrown: Instance 7cad4b3e-0787-42ac-86ee-49b83422317d could not be found. Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Request method failure captured: Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d HTTP/1.1 Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZN8cUgbiN4jgbPGTVOnhXBTDRmGKc9TyWokgNVlUuhNsxgycX61xbACtrSelhVLFuDHDnMZajNNVM_Hr6ZS6h8ad21L06WPxjymJt8L-tJGxk5LXZkiJxOpgJBiULt4nkeFJydoyPTZwXXBxmeCLfLrgQwO_5KT--2T1aZJG-NqXWw Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 57b6a3a135de4feb8541658376863195 Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_57b6a3a135de4feb8541658376863195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/57b6a3a135de4feb8541658376863195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/57b6a3a135de4feb8541658376863195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/57b6a3a135de4feb8541658376863195"}]}] Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 57b6a3a135de4feb8541658376863195 Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestNetworkAdvancedServerOps-1128889267-project Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b7d61a4dd7b64c65b9743f9f3b0d3aad Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1128889267-project Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 7cad4b3e-0787-42ac-86ee-49b83422317d could not be found. Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '7cad4b3e-0787-42ac-86ee-49b83422317d'} Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cad4b3e-0787-42ac-86ee-49b83422317d could not be found. Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cad4b3e-0787-42ac-86ee-49b83422317d could not be found. Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:48:47.456686 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:48:47.461471 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:48:47.461471 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:48:47.461471 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:48:47.461471 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:48:47.461471 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:48:47.461471 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:48:47.461471 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cad4b3e-0787-42ac-86ee-49b83422317d could not be found. Aug 27 03:48:47.461471 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:48:47.461471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Returning 404 to user: Instance 7cad4b3e-0787-42ac-86ee-49b83422317d could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:48:47.461471 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-96864338-0459-4848-bdd7-10200d2b77fc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d" status: 404 len: 111 microversion: 2.1 time: 0.031217 Aug 27 03:48:47.461471 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3526/7236] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:47 2022] GET /compute/v2.1/servers/7cad4b3e-0787-42ac-86ee-49b83422317d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:48:50.546165 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9aa472f6-cd59-4da0-a119-678b62bfa75f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '.version_select at 0x7f4d298e8e50>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:50.566793 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9aa472f6-cd59-4da0-a119-678b62bfa75f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-242094537" status: 202 len: 0 microversion: 2.1 time: 0.024471 Aug 27 03:48:50.567385 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3711/7237] 10.222.0.99 () {58 vars in 1281 bytes} [Sat Aug 27 03:48:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-242094537 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:48:50.595568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9d1d7397-af81-4bf2-884a-2a8267e23e1c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'create', calling method: .version_select at 0x7f4d29c19ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1996718700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNr+7z0PMaIAGcaGSdXI568O0Q0I4thcYPykAT4llWv/VNUohlwhc4ADZXjrousOu1o6WuB2iTVtZiN3Bv3UhyeJF4QerBMl2VuAPvcdfK24OvgFsGEjN1MkuO+CZNgzFg=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:50.611953 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-9d1d7397-af81-4bf2-884a-2a8267e23e1c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for project 57b6a3a135de4feb8541658376863195. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:48:50.618130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-9d1d7397-af81-4bf2-884a-2a8267e23e1c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for user b7d61a4dd7b64c65b9743f9f3b0d3aad and project 57b6a3a135de4feb8541658376863195. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:48:50.643190 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9d1d7397-af81-4bf2-884a-2a8267e23e1c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051675 Aug 27 03:48:50.643787 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3527/7238] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:48:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:48:56.796188 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=20 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:56.801172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2065553647", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "4428fb07-4ae7-4920-9be3-67de39369a5f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1996718700", "security_groups": [{"name": "tempest-secgroup-smoke-1123039779"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:48:56.928937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] validate_networks() for [('4428fb07-4ae7-4920-9be3-67de39369a5f', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:48:57.390473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:48:57.390939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:48:57.391463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:48:57.391882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:48:57.392333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:48:57.402672 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:57.403163 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:57.403606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:57.404338 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:57.404791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:57.405236 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:57.426087 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for project 57b6a3a135de4feb8541658376863195. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:48:57.433520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for user b7d61a4dd7b64c65b9743f9f3b0d3aad and project 57b6a3a135de4feb8541658376863195. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:48:57.449939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:48:57.452721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:48:57.502989 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [8b6afc38-b31e-4e9f-bc91-aae46f71aee6] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:48:58.511991 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [8b6afc38-b31e-4e9f-bc91-aae46f71aee6] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 54032. Aug 27 03:48:58.516591 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5a66304e-8b0e-40a7-80c9-202afdc8fcf4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.721944 Aug 27 03:48:58.517293 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3712/7239] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:48:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:48:58.528798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ab5c1850-6e83-4a2b-a7c4-5655b3a9d083 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:58.529601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ab5c1850-6e83-4a2b-a7c4-5655b3a9d083 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:58.532978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:48:58.600370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ab5c1850-6e83-4a2b-a7c4-5655b3a9d083 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:58.609469 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ab5c1850-6e83-4a2b-a7c4-5655b3a9d083 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1267 microversion: 2.1 time: 0.085058 Aug 27 03:48:58.610099 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3528/7240] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:58 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:48:59.631650 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1a990a5e-df15-4a7c-bd07-df8910987bd6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:48:59.632386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1a990a5e-df15-4a7c-bd07-df8910987bd6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:48:59.648941 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a990a5e-df15-4a7c-bd07-df8910987bd6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:59.649747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a990a5e-df15-4a7c-bd07-df8910987bd6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:59.650238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a990a5e-df15-4a7c-bd07-df8910987bd6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:59.650964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a990a5e-df15-4a7c-bd07-df8910987bd6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:48:59.651595 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a990a5e-df15-4a7c-bd07-df8910987bd6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:48:59.652254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1a990a5e-df15-4a7c-bd07-df8910987bd6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:48:59.726929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1a990a5e-df15-4a7c-bd07-df8910987bd6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:48:59.739553 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1a990a5e-df15-4a7c-bd07-df8910987bd6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1337 microversion: 2.1 time: 0.112601 Aug 27 03:48:59.740291 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3713/7241] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:48:59 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1337 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:00.762346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0a2502c1-258f-4ddc-ba1e-842e14f30c71 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:00.763035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0a2502c1-258f-4ddc-ba1e-842e14f30c71 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:00.770908 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a2502c1-258f-4ddc-ba1e-842e14f30c71 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:00.771465 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a2502c1-258f-4ddc-ba1e-842e14f30c71 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:00.771921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a2502c1-258f-4ddc-ba1e-842e14f30c71 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:00.772839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a2502c1-258f-4ddc-ba1e-842e14f30c71 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:00.773306 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a2502c1-258f-4ddc-ba1e-842e14f30c71 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:00.773770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a2502c1-258f-4ddc-ba1e-842e14f30c71 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:00.989728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0a2502c1-258f-4ddc-ba1e-842e14f30c71 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:00.998189 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0a2502c1-258f-4ddc-ba1e-842e14f30c71 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1393 microversion: 2.1 time: 0.240415 Aug 27 03:49:00.998787 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3529/7242] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:00 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1393 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:01.039568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-f7062769-c2d5-47f7-9aff-178d8cfa3ec3 req-2c39e599-493c-4040-9fe7-52b727d99888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55191f7-cceb-4ef3-ac2f-efced9a51532", "tag": "9e52c005-d4f6-4ceb-90da-fdce03799848"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:49:01.058420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f7062769-c2d5-47f7-9aff-178d8cfa3ec3 req-2c39e599-493c-4040-9fe7-52b727d99888 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:01.059108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f7062769-c2d5-47f7-9aff-178d8cfa3ec3 req-2c39e599-493c-4040-9fe7-52b727d99888 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:01.059790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-f7062769-c2d5-47f7-9aff-178d8cfa3ec3 req-2c39e599-493c-4040-9fe7-52b727d99888 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:01.073537 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-f7062769-c2d5-47f7-9aff-178d8cfa3ec3 req-2c39e599-493c-4040-9fe7-52b727d99888 service nova] Creating event network-changed:9e52c005-d4f6-4ceb-90da-fdce03799848 for instance e55191f7-cceb-4ef3-ac2f-efced9a51532 on n-h2-852084-5 Aug 27 03:49:01.079981 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-f7062769-c2d5-47f7-9aff-178d8cfa3ec3 req-2c39e599-493c-4040-9fe7-52b727d99888 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044118 Aug 27 03:49:01.080789 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3714/7243] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:02.019037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ce420f69-3f2c-4e27-8dac-a71f842f1445 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:02.019656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ce420f69-3f2c-4e27-8dac-a71f842f1445 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:02.027192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce420f69-3f2c-4e27-8dac-a71f842f1445 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:02.027685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce420f69-3f2c-4e27-8dac-a71f842f1445 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:02.028136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce420f69-3f2c-4e27-8dac-a71f842f1445 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:02.028831 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce420f69-3f2c-4e27-8dac-a71f842f1445 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:02.029295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce420f69-3f2c-4e27-8dac-a71f842f1445 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:02.029761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ce420f69-3f2c-4e27-8dac-a71f842f1445 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:02.164900 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ce420f69-3f2c-4e27-8dac-a71f842f1445 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:02.172700 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ce420f69-3f2c-4e27-8dac-a71f842f1445 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1393 microversion: 2.1 time: 0.157564 Aug 27 03:49:02.173276 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3530/7244] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:02 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:03.194630 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-028a4575-b07a-4a11-9bac-6f9760df7afd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:03.195586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-028a4575-b07a-4a11-9bac-6f9760df7afd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:03.202885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-028a4575-b07a-4a11-9bac-6f9760df7afd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:03.203469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-028a4575-b07a-4a11-9bac-6f9760df7afd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:03.203923 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-028a4575-b07a-4a11-9bac-6f9760df7afd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:03.204641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-028a4575-b07a-4a11-9bac-6f9760df7afd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:03.205109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-028a4575-b07a-4a11-9bac-6f9760df7afd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:03.205604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-028a4575-b07a-4a11-9bac-6f9760df7afd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:03.345238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-028a4575-b07a-4a11-9bac-6f9760df7afd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:03.353158 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-028a4575-b07a-4a11-9bac-6f9760df7afd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1393 microversion: 2.1 time: 0.162816 Aug 27 03:49:03.353753 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3715/7245] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:03 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:04.374958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0ec1dbd7-0531-47cb-90d6-b130d7ac5979 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:04.375497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0ec1dbd7-0531-47cb-90d6-b130d7ac5979 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:04.383393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ec1dbd7-0531-47cb-90d6-b130d7ac5979 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:04.383904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ec1dbd7-0531-47cb-90d6-b130d7ac5979 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:04.384396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ec1dbd7-0531-47cb-90d6-b130d7ac5979 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:04.385125 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ec1dbd7-0531-47cb-90d6-b130d7ac5979 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:04.385600 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ec1dbd7-0531-47cb-90d6-b130d7ac5979 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:04.386083 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0ec1dbd7-0531-47cb-90d6-b130d7ac5979 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:04.527412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0ec1dbd7-0531-47cb-90d6-b130d7ac5979 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:04.535388 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0ec1dbd7-0531-47cb-90d6-b130d7ac5979 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1393 microversion: 2.1 time: 0.164510 Aug 27 03:49:04.535972 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3531/7246] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:04 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:49:05.340618 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-3c3367e4-dbb4-4479-80f6-ee007e3743ba req-cadeed10-ab65-4f07-b2c3-085e71f17ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55191f7-cceb-4ef3-ac2f-efced9a51532", "name": "network-vif-plugged", "status": "completed", "tag": "9e52c005-d4f6-4ceb-90da-fdce03799848"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:49:05.352362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c3367e4-dbb4-4479-80f6-ee007e3743ba req-cadeed10-ab65-4f07-b2c3-085e71f17ec1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:05.352773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c3367e4-dbb4-4479-80f6-ee007e3743ba req-cadeed10-ab65-4f07-b2c3-085e71f17ec1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:05.353259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-3c3367e4-dbb4-4479-80f6-ee007e3743ba req-cadeed10-ab65-4f07-b2c3-085e71f17ec1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:05.365851 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-3c3367e4-dbb4-4479-80f6-ee007e3743ba req-cadeed10-ab65-4f07-b2c3-085e71f17ec1 service nova] Creating event network-vif-plugged:9e52c005-d4f6-4ceb-90da-fdce03799848 for instance e55191f7-cceb-4ef3-ac2f-efced9a51532 on n-h2-852084-5 Aug 27 03:49:05.371582 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-3c3367e4-dbb4-4479-80f6-ee007e3743ba req-cadeed10-ab65-4f07-b2c3-085e71f17ec1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034978 Aug 27 03:49:05.372456 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3716/7247] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:05.557694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-24d120d4-a1a1-4394-b12b-3548360fb16a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:05.558348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-24d120d4-a1a1-4394-b12b-3548360fb16a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:05.565567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d120d4-a1a1-4394-b12b-3548360fb16a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:05.566105 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d120d4-a1a1-4394-b12b-3548360fb16a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:05.566563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d120d4-a1a1-4394-b12b-3548360fb16a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:05.567325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d120d4-a1a1-4394-b12b-3548360fb16a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:05.567798 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d120d4-a1a1-4394-b12b-3548360fb16a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:05.568241 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-24d120d4-a1a1-4394-b12b-3548360fb16a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:05.707767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-24d120d4-a1a1-4394-b12b-3548360fb16a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:05.716104 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-24d120d4-a1a1-4394-b12b-3548360fb16a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1393 microversion: 2.1 time: 0.163368 Aug 27 03:49:05.716687 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3532/7248] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:05 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:06.738469 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9876b83d-6df9-4ef3-962d-ff799d74369b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:06.739231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9876b83d-6df9-4ef3-962d-ff799d74369b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:06.741276 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:06.749339 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9876b83d-6df9-4ef3-962d-ff799d74369b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:06.749867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9876b83d-6df9-4ef3-962d-ff799d74369b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:06.750319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9876b83d-6df9-4ef3-962d-ff799d74369b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:06.751066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9876b83d-6df9-4ef3-962d-ff799d74369b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:06.751525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9876b83d-6df9-4ef3-962d-ff799d74369b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:06.751957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9876b83d-6df9-4ef3-962d-ff799d74369b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:06.896918 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9876b83d-6df9-4ef3-962d-ff799d74369b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:06.904962 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9876b83d-6df9-4ef3-962d-ff799d74369b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1564 microversion: 2.1 time: 0.171834 Aug 27 03:49:06.905546 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3717/7249] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:06 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:06.925477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2a20139a-980f-4ad1-bc96-541f8274e711 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:06.926130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2a20139a-980f-4ad1-bc96-541f8274e711 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:06.933586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20139a-980f-4ad1-bc96-541f8274e711 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:06.934115 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20139a-980f-4ad1-bc96-541f8274e711 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:06.934571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20139a-980f-4ad1-bc96-541f8274e711 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:06.935281 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20139a-980f-4ad1-bc96-541f8274e711 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:06.935749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20139a-980f-4ad1-bc96-541f8274e711 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:06.936188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2a20139a-980f-4ad1-bc96-541f8274e711 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:07.071516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2a20139a-980f-4ad1-bc96-541f8274e711 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:07.079526 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2a20139a-980f-4ad1-bc96-541f8274e711 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1564 microversion: 2.1 time: 0.157947 Aug 27 03:49:07.080098 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3533/7250] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:06 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:49:08.667246 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d055dbd3-9706-4948-b2c5-7837378d2333 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:08.668252 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d055dbd3-9706-4948-b2c5-7837378d2333 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:08.672339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-88bd892f-e1ba-4f62-9909-e073f49743d8 req-2b9224bb-89fe-46a5-a9c8-ad6f34984aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55191f7-cceb-4ef3-ac2f-efced9a51532", "tag": "9e52c005-d4f6-4ceb-90da-fdce03799848"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:49:08.674287 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:08.675303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:08.678352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d055dbd3-9706-4948-b2c5-7837378d2333 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:08.679330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d055dbd3-9706-4948-b2c5-7837378d2333 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:08.679754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:08.682013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d055dbd3-9706-4948-b2c5-7837378d2333 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:08.682880 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d055dbd3-9706-4948-b2c5-7837378d2333 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:08.683599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d055dbd3-9706-4948-b2c5-7837378d2333 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:08.684283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d055dbd3-9706-4948-b2c5-7837378d2333 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:08.684849 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-88bd892f-e1ba-4f62-9909-e073f49743d8 req-2b9224bb-89fe-46a5-a9c8-ad6f34984aa6 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:08.685530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-88bd892f-e1ba-4f62-9909-e073f49743d8 req-2b9224bb-89fe-46a5-a9c8-ad6f34984aa6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:08.686006 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-88bd892f-e1ba-4f62-9909-e073f49743d8 req-2b9224bb-89fe-46a5-a9c8-ad6f34984aa6 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:08.699713 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-88bd892f-e1ba-4f62-9909-e073f49743d8 req-2b9224bb-89fe-46a5-a9c8-ad6f34984aa6 service nova] Creating event network-changed:9e52c005-d4f6-4ceb-90da-fdce03799848 for instance e55191f7-cceb-4ef3-ac2f-efced9a51532 on n-h2-852084-5 Aug 27 03:49:08.705176 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-88bd892f-e1ba-4f62-9909-e073f49743d8 req-2b9224bb-89fe-46a5-a9c8-ad6f34984aa6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039059 Aug 27 03:49:08.706121 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3534/7251] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:49:08.831472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d055dbd3-9706-4948-b2c5-7837378d2333 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:08.842477 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d055dbd3-9706-4948-b2c5-7837378d2333 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1564 microversion: 2.1 time: 0.179083 Aug 27 03:49:08.843284 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3718/7252] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:08 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:32.095822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:32.096810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=32 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:32.102384 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-98975ca4-7fed-4907-8e95-9843302eb992 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:49:32.105223 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-98975ca4-7fed-4907-8e95-9843302eb992 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:32.113602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98975ca4-7fed-4907-8e95-9843302eb992 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:32.114144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98975ca4-7fed-4907-8e95-9843302eb992 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:32.114607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98975ca4-7fed-4907-8e95-9843302eb992 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:32.115334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98975ca4-7fed-4907-8e95-9843302eb992 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:32.115813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98975ca4-7fed-4907-8e95-9843302eb992 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:32.116262 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-98975ca4-7fed-4907-8e95-9843302eb992 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:32.171028 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-98975ca4-7fed-4907-8e95-9843302eb992 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532/action" status: 200 len: 24573 microversion: 2.1 time: 0.078301 Aug 27 03:49:32.171698 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3535/7253] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:49:32 2022] POST /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532/action => generated 24573 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:49:43.232503 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:49:43.234896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:43.237079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:43.237966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=30 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:43.245506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:43.246738 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:43.247184 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:43.247904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:43.248367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:43.248804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:43.348909 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:43.356304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Old instance type m1.heat2, new instance type m1.heat {{(pid=122488) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 27 03:49:43.363351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:49:43.363780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:49:43.364262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:49:43.364680 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:49:43.365100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:49:43.431252 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2bf561c-2efe-44c4-a178-8e4ef3e36b96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532/action" status: 202 len: 0 microversion: 2.1 time: 0.203565 Aug 27 03:49:43.431885 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3719/7254] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:49:43 2022] POST /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:49:43.443661 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7b5cdafb-133b-4ec3-9d33-895ea20dfdb6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:43.444974 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7b5cdafb-133b-4ec3-9d33-895ea20dfdb6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:43.450119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:43.451259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:49:43.464442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5cdafb-133b-4ec3-9d33-895ea20dfdb6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:43.465987 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5cdafb-133b-4ec3-9d33-895ea20dfdb6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:43.466732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5cdafb-133b-4ec3-9d33-895ea20dfdb6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:43.467983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5cdafb-133b-4ec3-9d33-895ea20dfdb6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:43.468839 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5cdafb-133b-4ec3-9d33-895ea20dfdb6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:43.469644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7b5cdafb-133b-4ec3-9d33-895ea20dfdb6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:43.635033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7b5cdafb-133b-4ec3-9d33-895ea20dfdb6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:43.643821 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7b5cdafb-133b-4ec3-9d33-895ea20dfdb6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1692 microversion: 2.1 time: 0.206739 Aug 27 03:49:43.644428 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3536/7255] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:43 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1692 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:44.666667 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-28a33bbc-bc39-4c33-8fc0-a4473256932f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:44.667283 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-28a33bbc-bc39-4c33-8fc0-a4473256932f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:44.674522 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28a33bbc-bc39-4c33-8fc0-a4473256932f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:44.675025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28a33bbc-bc39-4c33-8fc0-a4473256932f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:44.675502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28a33bbc-bc39-4c33-8fc0-a4473256932f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:44.676212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28a33bbc-bc39-4c33-8fc0-a4473256932f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:44.676681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28a33bbc-bc39-4c33-8fc0-a4473256932f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:44.677151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-28a33bbc-bc39-4c33-8fc0-a4473256932f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:44.827343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-28a33bbc-bc39-4c33-8fc0-a4473256932f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:44.835193 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-28a33bbc-bc39-4c33-8fc0-a4473256932f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1692 microversion: 2.1 time: 0.173585 Aug 27 03:49:44.835783 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3720/7256] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:44 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:49:45.858787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05d713a7-38a1-4266-bc83-e3892628ceaa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:45.859456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-05d713a7-38a1-4266-bc83-e3892628ceaa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:45.866527 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05d713a7-38a1-4266-bc83-e3892628ceaa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:45.867072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05d713a7-38a1-4266-bc83-e3892628ceaa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:45.867567 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05d713a7-38a1-4266-bc83-e3892628ceaa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:45.868309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05d713a7-38a1-4266-bc83-e3892628ceaa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:45.868814 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05d713a7-38a1-4266-bc83-e3892628ceaa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:45.869271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05d713a7-38a1-4266-bc83-e3892628ceaa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:46.015628 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-05d713a7-38a1-4266-bc83-e3892628ceaa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:46.024003 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-05d713a7-38a1-4266-bc83-e3892628ceaa tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.170284 Aug 27 03:49:46.024634 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3537/7257] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:45 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:47.046765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9acada8b-6b5a-472d-a2ba-399b193b0188 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:47.047407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9acada8b-6b5a-472d-a2ba-399b193b0188 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:47.054626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9acada8b-6b5a-472d-a2ba-399b193b0188 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:47.055109 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9acada8b-6b5a-472d-a2ba-399b193b0188 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:47.055585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9acada8b-6b5a-472d-a2ba-399b193b0188 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:47.056303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9acada8b-6b5a-472d-a2ba-399b193b0188 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:47.056772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9acada8b-6b5a-472d-a2ba-399b193b0188 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:47.057212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9acada8b-6b5a-472d-a2ba-399b193b0188 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:47.199887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9acada8b-6b5a-472d-a2ba-399b193b0188 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:47.208367 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9acada8b-6b5a-472d-a2ba-399b193b0188 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.165497 Aug 27 03:49:47.208974 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3721/7258] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:47 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:48.229614 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c1b5f56d-9fae-47eb-97a4-0e437b05912d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:48.230312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c1b5f56d-9fae-47eb-97a4-0e437b05912d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:48.238507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1b5f56d-9fae-47eb-97a4-0e437b05912d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:48.239019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1b5f56d-9fae-47eb-97a4-0e437b05912d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:48.239578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1b5f56d-9fae-47eb-97a4-0e437b05912d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:48.240326 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1b5f56d-9fae-47eb-97a4-0e437b05912d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:48.240812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1b5f56d-9fae-47eb-97a4-0e437b05912d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:48.241266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c1b5f56d-9fae-47eb-97a4-0e437b05912d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:48.407955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c1b5f56d-9fae-47eb-97a4-0e437b05912d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:48.422955 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c1b5f56d-9fae-47eb-97a4-0e437b05912d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.197165 Aug 27 03:49:48.423684 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3538/7259] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:48 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:49:49.445264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-39f33c85-72cb-41dd-9b87-c2c47ae9da98 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:49.445908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-39f33c85-72cb-41dd-9b87-c2c47ae9da98 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:49.453515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f33c85-72cb-41dd-9b87-c2c47ae9da98 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:49.454057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f33c85-72cb-41dd-9b87-c2c47ae9da98 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:49.454509 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f33c85-72cb-41dd-9b87-c2c47ae9da98 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:49.455229 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f33c85-72cb-41dd-9b87-c2c47ae9da98 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:49.455694 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f33c85-72cb-41dd-9b87-c2c47ae9da98 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:49.456129 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-39f33c85-72cb-41dd-9b87-c2c47ae9da98 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:49.593884 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-39f33c85-72cb-41dd-9b87-c2c47ae9da98 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:49.602055 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-39f33c85-72cb-41dd-9b87-c2c47ae9da98 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.160641 Aug 27 03:49:49.602655 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3722/7260] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:49 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:50.623644 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-18eaaafc-34ff-40cf-95b9-e644e20b43d1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:50.624210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-18eaaafc-34ff-40cf-95b9-e644e20b43d1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:50.632491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18eaaafc-34ff-40cf-95b9-e644e20b43d1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:50.633043 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18eaaafc-34ff-40cf-95b9-e644e20b43d1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:50.633498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18eaaafc-34ff-40cf-95b9-e644e20b43d1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:50.634257 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18eaaafc-34ff-40cf-95b9-e644e20b43d1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:50.634734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18eaaafc-34ff-40cf-95b9-e644e20b43d1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:50.635175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-18eaaafc-34ff-40cf-95b9-e644e20b43d1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:50.780654 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-18eaaafc-34ff-40cf-95b9-e644e20b43d1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:50.789100 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-18eaaafc-34ff-40cf-95b9-e644e20b43d1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.169531 Aug 27 03:49:50.789712 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3539/7261] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:50 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:51.813298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bffba611-a3a9-4046-aadc-155ba0e3c08b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:51.814092 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bffba611-a3a9-4046-aadc-155ba0e3c08b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:51.821786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffba611-a3a9-4046-aadc-155ba0e3c08b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:51.822284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffba611-a3a9-4046-aadc-155ba0e3c08b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:51.822734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffba611-a3a9-4046-aadc-155ba0e3c08b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:51.823450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffba611-a3a9-4046-aadc-155ba0e3c08b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:51.824531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffba611-a3a9-4046-aadc-155ba0e3c08b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:51.824971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bffba611-a3a9-4046-aadc-155ba0e3c08b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:51.971759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bffba611-a3a9-4046-aadc-155ba0e3c08b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:51.980662 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bffba611-a3a9-4046-aadc-155ba0e3c08b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.172337 Aug 27 03:49:51.981483 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3723/7262] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:51 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:53.002311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aa8d7a82-4289-47ed-a1ae-513565eb8a08 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:53.003140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aa8d7a82-4289-47ed-a1ae-513565eb8a08 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:53.010023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8d7a82-4289-47ed-a1ae-513565eb8a08 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:53.010532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8d7a82-4289-47ed-a1ae-513565eb8a08 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:53.010997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8d7a82-4289-47ed-a1ae-513565eb8a08 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:53.012240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8d7a82-4289-47ed-a1ae-513565eb8a08 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:53.012715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8d7a82-4289-47ed-a1ae-513565eb8a08 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:53.013165 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa8d7a82-4289-47ed-a1ae-513565eb8a08 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:53.156330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-aa8d7a82-4289-47ed-a1ae-513565eb8a08 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:53.164303 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aa8d7a82-4289-47ed-a1ae-513565eb8a08 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.166055 Aug 27 03:49:53.165131 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3540/7263] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:52 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:54.185028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3227f53c-be57-497e-a075-81b782b162ac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:54.185701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3227f53c-be57-497e-a075-81b782b162ac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:54.192844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3227f53c-be57-497e-a075-81b782b162ac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:54.193335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3227f53c-be57-497e-a075-81b782b162ac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:54.193816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3227f53c-be57-497e-a075-81b782b162ac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:54.194526 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3227f53c-be57-497e-a075-81b782b162ac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:54.194989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3227f53c-be57-497e-a075-81b782b162ac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:54.195422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3227f53c-be57-497e-a075-81b782b162ac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:54.339350 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3227f53c-be57-497e-a075-81b782b162ac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:54.348076 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3227f53c-be57-497e-a075-81b782b162ac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.166996 Aug 27 03:49:54.348649 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3724/7264] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:54 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:55.370077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2f14f919-9c3b-41c4-83ce-02e93dc89efc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:55.370696 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2f14f919-9c3b-41c4-83ce-02e93dc89efc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:55.377749 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f14f919-9c3b-41c4-83ce-02e93dc89efc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:55.378239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f14f919-9c3b-41c4-83ce-02e93dc89efc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:55.378686 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f14f919-9c3b-41c4-83ce-02e93dc89efc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:55.379391 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f14f919-9c3b-41c4-83ce-02e93dc89efc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:55.379854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f14f919-9c3b-41c4-83ce-02e93dc89efc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:55.380290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2f14f919-9c3b-41c4-83ce-02e93dc89efc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:55.514213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2f14f919-9c3b-41c4-83ce-02e93dc89efc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:55.522651 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2f14f919-9c3b-41c4-83ce-02e93dc89efc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.156525 Aug 27 03:49:55.523235 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3541/7265] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:55 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:56.545100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5de63d09-7689-44be-95f1-c8e3d139c2f8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:56.545743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5de63d09-7689-44be-95f1-c8e3d139c2f8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:56.552269 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de63d09-7689-44be-95f1-c8e3d139c2f8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:56.552764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de63d09-7689-44be-95f1-c8e3d139c2f8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:56.553216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de63d09-7689-44be-95f1-c8e3d139c2f8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:56.553949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de63d09-7689-44be-95f1-c8e3d139c2f8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:56.554419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de63d09-7689-44be-95f1-c8e3d139c2f8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:56.554858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5de63d09-7689-44be-95f1-c8e3d139c2f8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:56.691809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5de63d09-7689-44be-95f1-c8e3d139c2f8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:56.700320 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5de63d09-7689-44be-95f1-c8e3d139c2f8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.159610 Aug 27 03:49:56.700928 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3725/7266] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:56 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:57.722143 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6c92829b-9331-4770-81d1-4ffdc3f13dd5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:57.722704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6c92829b-9331-4770-81d1-4ffdc3f13dd5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:57.729797 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c92829b-9331-4770-81d1-4ffdc3f13dd5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:57.730304 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c92829b-9331-4770-81d1-4ffdc3f13dd5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:57.730761 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c92829b-9331-4770-81d1-4ffdc3f13dd5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:57.731477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c92829b-9331-4770-81d1-4ffdc3f13dd5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:57.731946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c92829b-9331-4770-81d1-4ffdc3f13dd5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:57.732394 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6c92829b-9331-4770-81d1-4ffdc3f13dd5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:57.868731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6c92829b-9331-4770-81d1-4ffdc3f13dd5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:57.877484 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6c92829b-9331-4770-81d1-4ffdc3f13dd5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.159344 Aug 27 03:49:57.878109 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3542/7267] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:57 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:49:58.899582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-12f8b740-6153-448e-bac3-e864a657cac1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:49:58.900205 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-12f8b740-6153-448e-bac3-e864a657cac1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:49:58.907803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f8b740-6153-448e-bac3-e864a657cac1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:58.908333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f8b740-6153-448e-bac3-e864a657cac1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:58.908784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f8b740-6153-448e-bac3-e864a657cac1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:58.909491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f8b740-6153-448e-bac3-e864a657cac1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:49:58.909992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f8b740-6153-448e-bac3-e864a657cac1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:49:58.910433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-12f8b740-6153-448e-bac3-e864a657cac1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:49:59.049400 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-12f8b740-6153-448e-bac3-e864a657cac1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:49:59.057411 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-12f8b740-6153-448e-bac3-e864a657cac1 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.161740 Aug 27 03:49:59.058536 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3726/7268] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:49:58 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:00.080357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f992a126-5d1f-430f-b9a6-e799fc86e28a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:00.080990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f992a126-5d1f-430f-b9a6-e799fc86e28a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:00.087999 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f992a126-5d1f-430f-b9a6-e799fc86e28a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:00.088492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f992a126-5d1f-430f-b9a6-e799fc86e28a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:00.088952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f992a126-5d1f-430f-b9a6-e799fc86e28a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:00.090442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f992a126-5d1f-430f-b9a6-e799fc86e28a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:00.090915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f992a126-5d1f-430f-b9a6-e799fc86e28a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:00.091362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f992a126-5d1f-430f-b9a6-e799fc86e28a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:00.237191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f992a126-5d1f-430f-b9a6-e799fc86e28a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:00.245274 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f992a126-5d1f-430f-b9a6-e799fc86e28a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.168840 Aug 27 03:50:00.245935 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3543/7269] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:00 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:01.266789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3e8c4221-3e8a-4fc1-992a-994594a3322b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:01.267451 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3e8c4221-3e8a-4fc1-992a-994594a3322b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:01.274502 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e8c4221-3e8a-4fc1-992a-994594a3322b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:01.274998 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e8c4221-3e8a-4fc1-992a-994594a3322b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:01.275450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e8c4221-3e8a-4fc1-992a-994594a3322b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:01.276155 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e8c4221-3e8a-4fc1-992a-994594a3322b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:01.276622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e8c4221-3e8a-4fc1-992a-994594a3322b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:01.277554 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3e8c4221-3e8a-4fc1-992a-994594a3322b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:01.411705 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-3e8c4221-3e8a-4fc1-992a-994594a3322b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:01.420319 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3e8c4221-3e8a-4fc1-992a-994594a3322b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.157357 Aug 27 03:50:01.420931 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3727/7270] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:01 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:02.441746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cacc9f66-68c2-406c-b8da-1b37bfd01e12 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:02.442406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cacc9f66-68c2-406c-b8da-1b37bfd01e12 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:02.449524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cacc9f66-68c2-406c-b8da-1b37bfd01e12 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:02.450056 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cacc9f66-68c2-406c-b8da-1b37bfd01e12 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:02.450507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cacc9f66-68c2-406c-b8da-1b37bfd01e12 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:02.451246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cacc9f66-68c2-406c-b8da-1b37bfd01e12 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:02.451715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cacc9f66-68c2-406c-b8da-1b37bfd01e12 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:02.452154 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cacc9f66-68c2-406c-b8da-1b37bfd01e12 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:02.597460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cacc9f66-68c2-406c-b8da-1b37bfd01e12 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:02.607609 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cacc9f66-68c2-406c-b8da-1b37bfd01e12 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1697 microversion: 2.1 time: 0.169690 Aug 27 03:50:02.608207 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3544/7271] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:02 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:03.103952 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-0fc43a41-3934-489e-bbfc-37931ea9c76f req-a562866f-8b8a-48e4-9877-6326c03f94d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55191f7-cceb-4ef3-ac2f-efced9a51532", "name": "network-vif-unplugged", "status": "completed", "tag": "9e52c005-d4f6-4ceb-90da-fdce03799848"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:03.115151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0fc43a41-3934-489e-bbfc-37931ea9c76f req-a562866f-8b8a-48e4-9877-6326c03f94d0 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:03.115653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0fc43a41-3934-489e-bbfc-37931ea9c76f req-a562866f-8b8a-48e4-9877-6326c03f94d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:03.116203 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-0fc43a41-3934-489e-bbfc-37931ea9c76f req-a562866f-8b8a-48e4-9877-6326c03f94d0 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:03.129204 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-0fc43a41-3934-489e-bbfc-37931ea9c76f req-a562866f-8b8a-48e4-9877-6326c03f94d0 service nova] Creating event network-vif-unplugged:9e52c005-d4f6-4ceb-90da-fdce03799848 for instance e55191f7-cceb-4ef3-ac2f-efced9a51532 on n-h1-852084-5 Aug 27 03:50:03.134850 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [req-0fc43a41-3934-489e-bbfc-37931ea9c76f req-a562866f-8b8a-48e4-9877-6326c03f94d0 service nova] Instance e55191f7-cceb-4ef3-ac2f-efced9a51532 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122488) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:50:03.146124 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-0fc43a41-3934-489e-bbfc-37931ea9c76f req-a562866f-8b8a-48e4-9877-6326c03f94d0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045983 Aug 27 03:50:03.146931 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3728/7272] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:03.630393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-72f7b481-63e9-41bc-9fb2-f77e9c533fc3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:03.631010 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-72f7b481-63e9-41bc-9fb2-f77e9c533fc3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:03.638556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f7b481-63e9-41bc-9fb2-f77e9c533fc3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:03.639050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f7b481-63e9-41bc-9fb2-f77e9c533fc3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:03.639506 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f7b481-63e9-41bc-9fb2-f77e9c533fc3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:03.640206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f7b481-63e9-41bc-9fb2-f77e9c533fc3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:03.640674 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f7b481-63e9-41bc-9fb2-f77e9c533fc3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:03.641110 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-72f7b481-63e9-41bc-9fb2-f77e9c533fc3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:03.775507 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-72f7b481-63e9-41bc-9fb2-f77e9c533fc3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:03.783287 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-72f7b481-63e9-41bc-9fb2-f77e9c533fc3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1696 microversion: 2.1 time: 0.156845 Aug 27 03:50:03.783859 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3545/7273] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:03 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:04.806792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-70b6d4a8-1648-45ce-8ab3-666f4f0145a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:04.807508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-70b6d4a8-1648-45ce-8ab3-666f4f0145a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:04.814512 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b6d4a8-1648-45ce-8ab3-666f4f0145a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:04.815006 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b6d4a8-1648-45ce-8ab3-666f4f0145a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:04.815463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b6d4a8-1648-45ce-8ab3-666f4f0145a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:04.816170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b6d4a8-1648-45ce-8ab3-666f4f0145a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:04.816639 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b6d4a8-1648-45ce-8ab3-666f4f0145a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:04.817081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-70b6d4a8-1648-45ce-8ab3-666f4f0145a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:04.958654 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-70b6d4a8-1648-45ce-8ab3-666f4f0145a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:04.966793 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-70b6d4a8-1648-45ce-8ab3-666f4f0145a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1694 microversion: 2.1 time: 0.165412 Aug 27 03:50:04.967375 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3729/7274] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:04 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:05.161579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-595f5171-bb89-455e-9677-94ba7ba4cedd req-895a34a1-2fda-4847-8e79-6ae76d8e5776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55191f7-cceb-4ef3-ac2f-efced9a51532", "tag": "9e52c005-d4f6-4ceb-90da-fdce03799848"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:05.172511 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-595f5171-bb89-455e-9677-94ba7ba4cedd req-895a34a1-2fda-4847-8e79-6ae76d8e5776 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:05.173007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-595f5171-bb89-455e-9677-94ba7ba4cedd req-895a34a1-2fda-4847-8e79-6ae76d8e5776 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:05.173490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-595f5171-bb89-455e-9677-94ba7ba4cedd req-895a34a1-2fda-4847-8e79-6ae76d8e5776 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:05.185152 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-595f5171-bb89-455e-9677-94ba7ba4cedd req-895a34a1-2fda-4847-8e79-6ae76d8e5776 service nova] Creating event network-changed:9e52c005-d4f6-4ceb-90da-fdce03799848 for instance e55191f7-cceb-4ef3-ac2f-efced9a51532 on n-h1-852084-5 Aug 27 03:50:05.190498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [req-595f5171-bb89-455e-9677-94ba7ba4cedd req-895a34a1-2fda-4847-8e79-6ae76d8e5776 service nova] Instance e55191f7-cceb-4ef3-ac2f-efced9a51532 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-5', 'n-h2-852084-5'} {{(pid=122487) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 27 03:50:05.201339 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-595f5171-bb89-455e-9677-94ba7ba4cedd req-895a34a1-2fda-4847-8e79-6ae76d8e5776 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043509 Aug 27 03:50:05.201986 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3546/7275] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:05.990491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b82850eb-b4a5-400d-b861-1dd56cec859c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:05.991500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b82850eb-b4a5-400d-b861-1dd56cec859c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:06.000758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82850eb-b4a5-400d-b861-1dd56cec859c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:06.001489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82850eb-b4a5-400d-b861-1dd56cec859c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:06.002189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82850eb-b4a5-400d-b861-1dd56cec859c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:06.003279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82850eb-b4a5-400d-b861-1dd56cec859c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:06.004055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82850eb-b4a5-400d-b861-1dd56cec859c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:06.004606 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b82850eb-b4a5-400d-b861-1dd56cec859c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:06.143942 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b82850eb-b4a5-400d-b861-1dd56cec859c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:06.151831 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b82850eb-b4a5-400d-b861-1dd56cec859c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1694 microversion: 2.1 time: 0.167249 Aug 27 03:50:06.152910 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3730/7276] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:05 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:07.175669 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5605b347-b33f-446e-994d-4fc7f85be732 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:07.176406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5605b347-b33f-446e-994d-4fc7f85be732 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:07.182762 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5605b347-b33f-446e-994d-4fc7f85be732 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:07.183259 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5605b347-b33f-446e-994d-4fc7f85be732 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:07.183714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5605b347-b33f-446e-994d-4fc7f85be732 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:07.184955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5605b347-b33f-446e-994d-4fc7f85be732 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:07.185424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5605b347-b33f-446e-994d-4fc7f85be732 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:07.185907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5605b347-b33f-446e-994d-4fc7f85be732 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:07.323461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5605b347-b33f-446e-994d-4fc7f85be732 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:07.331640 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5605b347-b33f-446e-994d-4fc7f85be732 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1691 microversion: 2.1 time: 0.161190 Aug 27 03:50:07.332215 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3547/7277] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:07 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:07.353174 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-329b4e57-05c8-42b4-8e12-ed3a9834faac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:07.353810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-329b4e57-05c8-42b4-8e12-ed3a9834faac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:07.362045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-329b4e57-05c8-42b4-8e12-ed3a9834faac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:07.362575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-329b4e57-05c8-42b4-8e12-ed3a9834faac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:07.363059 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-329b4e57-05c8-42b4-8e12-ed3a9834faac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:07.363839 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-329b4e57-05c8-42b4-8e12-ed3a9834faac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:07.364326 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-329b4e57-05c8-42b4-8e12-ed3a9834faac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:07.364791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-329b4e57-05c8-42b4-8e12-ed3a9834faac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:07.426279 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-329b4e57-05c8-42b4-8e12-ed3a9834faac tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532/action" status: 204 len: 0 microversion: 2.1 time: 0.076982 Aug 27 03:50:07.426900 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3731/7278] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:50:07 2022] POST /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:50:07.435225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3df41e58-4b95-4818-8868-f1c12bd890c5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:07.435861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3df41e58-4b95-4818-8868-f1c12bd890c5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:07.441986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3df41e58-4b95-4818-8868-f1c12bd890c5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:07.442524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3df41e58-4b95-4818-8868-f1c12bd890c5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:07.443066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3df41e58-4b95-4818-8868-f1c12bd890c5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:07.443898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3df41e58-4b95-4818-8868-f1c12bd890c5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:07.444484 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3df41e58-4b95-4818-8868-f1c12bd890c5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:07.444956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3df41e58-4b95-4818-8868-f1c12bd890c5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:07.659843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3df41e58-4b95-4818-8868-f1c12bd890c5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:07.667967 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3df41e58-4b95-4818-8868-f1c12bd890c5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1691 microversion: 2.1 time: 0.236747 Aug 27 03:50:07.668562 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3548/7279] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:07 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:07.688698 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9bcd57a0-5ab3-49e7-b79e-295e722c3d32 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:07.689335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9bcd57a0-5ab3-49e7-b79e-295e722c3d32 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:07.695779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bcd57a0-5ab3-49e7-b79e-295e722c3d32 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:07.696279 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bcd57a0-5ab3-49e7-b79e-295e722c3d32 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:07.696731 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bcd57a0-5ab3-49e7-b79e-295e722c3d32 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:07.697452 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bcd57a0-5ab3-49e7-b79e-295e722c3d32 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:07.697971 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bcd57a0-5ab3-49e7-b79e-295e722c3d32 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:07.698646 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9bcd57a0-5ab3-49e7-b79e-295e722c3d32 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:07.842044 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9bcd57a0-5ab3-49e7-b79e-295e722c3d32 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:07.850224 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9bcd57a0-5ab3-49e7-b79e-295e722c3d32 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1691 microversion: 2.1 time: 0.165845 Aug 27 03:50:07.850824 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3732/7280] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:07 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:08.873530 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e34b0d97-0c47-4695-9d60-8b0fc47eb05d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:08.874348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e34b0d97-0c47-4695-9d60-8b0fc47eb05d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:08.883471 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e34b0d97-0c47-4695-9d60-8b0fc47eb05d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:08.884199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e34b0d97-0c47-4695-9d60-8b0fc47eb05d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:08.884660 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e34b0d97-0c47-4695-9d60-8b0fc47eb05d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:08.885580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e34b0d97-0c47-4695-9d60-8b0fc47eb05d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:08.886090 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e34b0d97-0c47-4695-9d60-8b0fc47eb05d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:08.886678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e34b0d97-0c47-4695-9d60-8b0fc47eb05d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:09.034548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e34b0d97-0c47-4695-9d60-8b0fc47eb05d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:09.042376 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e34b0d97-0c47-4695-9d60-8b0fc47eb05d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1683 microversion: 2.1 time: 0.173869 Aug 27 03:50:09.042949 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3549/7281] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:08 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:10.153927 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-127e7c1c-248f-420d-86dd-5b5776e29f4f req-ffee8a23-2624-4673-a6bf-7d33d014ce21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55191f7-cceb-4ef3-ac2f-efced9a51532", "name": "network-vif-plugged", "status": "completed", "tag": "9e52c005-d4f6-4ceb-90da-fdce03799848"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:10.164334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-127e7c1c-248f-420d-86dd-5b5776e29f4f req-ffee8a23-2624-4673-a6bf-7d33d014ce21 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:10.164807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-127e7c1c-248f-420d-86dd-5b5776e29f4f req-ffee8a23-2624-4673-a6bf-7d33d014ce21 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:10.165245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-127e7c1c-248f-420d-86dd-5b5776e29f4f req-ffee8a23-2624-4673-a6bf-7d33d014ce21 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:10.176651 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-127e7c1c-248f-420d-86dd-5b5776e29f4f req-ffee8a23-2624-4673-a6bf-7d33d014ce21 service nova] Creating event network-vif-plugged:9e52c005-d4f6-4ceb-90da-fdce03799848 for instance e55191f7-cceb-4ef3-ac2f-efced9a51532 on n-h1-852084-5 Aug 27 03:50:10.181964 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-127e7c1c-248f-420d-86dd-5b5776e29f4f req-ffee8a23-2624-4673-a6bf-7d33d014ce21 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092073 Aug 27 03:50:10.182527 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3733/7282] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:31.226944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3e85fab6-2f0d-4fdd-9473-31b124022b7e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:31.229221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3e85fab6-2f0d-4fdd-9473-31b124022b7e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:31.231445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=28 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:31.232157 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=82 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:31.238491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85fab6-2f0d-4fdd-9473-31b124022b7e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:31.238989 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85fab6-2f0d-4fdd-9473-31b124022b7e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:31.239435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85fab6-2f0d-4fdd-9473-31b124022b7e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:31.240235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85fab6-2f0d-4fdd-9473-31b124022b7e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:31.240704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85fab6-2f0d-4fdd-9473-31b124022b7e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:31.241145 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3e85fab6-2f0d-4fdd-9473-31b124022b7e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:31.311094 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3e85fab6-2f0d-4fdd-9473-31b124022b7e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532/action" status: 200 len: 24580 microversion: 2.1 time: 0.088254 Aug 27 03:50:31.312436 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3550/7283] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:50:31 2022] POST /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532/action => generated 24580 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:50:38.749596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=34 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:38.750669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:38.755052 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e2391c42-a1b2-4513-bedc-a79cadb41ab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:38.755556 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e00f33d6-d89c-4f87-896e-0646e7e42c7c req-bc085409-6237-46e6-8b2e-abcb04b86bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55191f7-cceb-4ef3-ac2f-efced9a51532", "tag": "9e52c005-d4f6-4ceb-90da-fdce03799848"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:38.755979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2391c42-a1b2-4513-bedc-a79cadb41ab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:38.763613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2391c42-a1b2-4513-bedc-a79cadb41ab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:38.764101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2391c42-a1b2-4513-bedc-a79cadb41ab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:38.764541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2391c42-a1b2-4513-bedc-a79cadb41ab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:38.765242 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2391c42-a1b2-4513-bedc-a79cadb41ab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:38.765720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2391c42-a1b2-4513-bedc-a79cadb41ab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:38.766152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e2391c42-a1b2-4513-bedc-a79cadb41ab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:38.777988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e00f33d6-d89c-4f87-896e-0646e7e42c7c req-bc085409-6237-46e6-8b2e-abcb04b86bc9 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:38.778833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e00f33d6-d89c-4f87-896e-0646e7e42c7c req-bc085409-6237-46e6-8b2e-abcb04b86bc9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:38.779490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e00f33d6-d89c-4f87-896e-0646e7e42c7c req-bc085409-6237-46e6-8b2e-abcb04b86bc9 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:38.792671 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e00f33d6-d89c-4f87-896e-0646e7e42c7c req-bc085409-6237-46e6-8b2e-abcb04b86bc9 service nova] Creating event network-changed:9e52c005-d4f6-4ceb-90da-fdce03799848 for instance e55191f7-cceb-4ef3-ac2f-efced9a51532 on n-h1-852084-5 Aug 27 03:50:38.797259 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e2391c42-a1b2-4513-bedc-a79cadb41ab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:50:38.798755 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e00f33d6-d89c-4f87-896e-0646e7e42c7c req-bc085409-6237-46e6-8b2e-abcb04b86bc9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047627 Aug 27 03:50:38.799566 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3551/7284] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:50:38.893957 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e2391c42-a1b2-4513-bedc-a79cadb41ab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 204 len: 0 microversion: 2.1 time: 0.146111 Aug 27 03:50:38.894997 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3734/7285] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:50:38 2022] DELETE /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:50:38.903785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-13d7709c-e7e8-4dcf-9f53-b55562ffc7c9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:38.904792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-13d7709c-e7e8-4dcf-9f53-b55562ffc7c9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:38.913936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13d7709c-e7e8-4dcf-9f53-b55562ffc7c9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:38.914457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13d7709c-e7e8-4dcf-9f53-b55562ffc7c9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:38.914924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13d7709c-e7e8-4dcf-9f53-b55562ffc7c9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:38.915657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13d7709c-e7e8-4dcf-9f53-b55562ffc7c9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:38.916278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13d7709c-e7e8-4dcf-9f53-b55562ffc7c9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:38.916979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-13d7709c-e7e8-4dcf-9f53-b55562ffc7c9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:39.075792 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-13d7709c-e7e8-4dcf-9f53-b55562ffc7c9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:39.084530 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-13d7709c-e7e8-4dcf-9f53-b55562ffc7c9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1689 microversion: 2.1 time: 0.185013 Aug 27 03:50:39.085112 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3552/7286] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:38 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:40.108127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-94bd84e6-26a9-4dc6-98d4-a23955b214d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:40.109368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-94bd84e6-26a9-4dc6-98d4-a23955b214d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:40.116249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bd84e6-26a9-4dc6-98d4-a23955b214d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:40.116742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bd84e6-26a9-4dc6-98d4-a23955b214d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:40.117190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bd84e6-26a9-4dc6-98d4-a23955b214d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:40.117932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bd84e6-26a9-4dc6-98d4-a23955b214d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:40.118399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bd84e6-26a9-4dc6-98d4-a23955b214d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:40.118836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-94bd84e6-26a9-4dc6-98d4-a23955b214d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:40.259543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-94bd84e6-26a9-4dc6-98d4-a23955b214d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:40.268733 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-94bd84e6-26a9-4dc6-98d4-a23955b214d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1689 microversion: 2.1 time: 0.164947 Aug 27 03:50:40.269562 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3735/7287] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:40 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:40.873424 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-50208db9-ef74-4044-9c49-306f1be24ab8 req-f29c0b09-0876-4844-b508-0e5c1c966100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55191f7-cceb-4ef3-ac2f-efced9a51532", "name": "network-vif-deleted", "tag": "9e52c005-d4f6-4ceb-90da-fdce03799848"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:40.884582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-50208db9-ef74-4044-9c49-306f1be24ab8 req-f29c0b09-0876-4844-b508-0e5c1c966100 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:40.885078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-50208db9-ef74-4044-9c49-306f1be24ab8 req-f29c0b09-0876-4844-b508-0e5c1c966100 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:40.885521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-50208db9-ef74-4044-9c49-306f1be24ab8 req-f29c0b09-0876-4844-b508-0e5c1c966100 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:40.897051 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-50208db9-ef74-4044-9c49-306f1be24ab8 req-f29c0b09-0876-4844-b508-0e5c1c966100 service nova] Creating event network-vif-deleted:9e52c005-d4f6-4ceb-90da-fdce03799848 for instance e55191f7-cceb-4ef3-ac2f-efced9a51532 on n-h1-852084-5 Aug 27 03:50:40.902377 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-50208db9-ef74-4044-9c49-306f1be24ab8 req-f29c0b09-0876-4844-b508-0e5c1c966100 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032578 Aug 27 03:50:40.902991 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3553/7288] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:41.290060 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:41.290696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:41.298740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:41.299247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:41.299699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:41.300461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:41.300930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:41.301364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:41.335103 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:41.335700 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:41.336245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:41.336932 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lazy-loading 'fault' on Instance uuid e55191f7-cceb-4ef3-ac2f-efced9a51532 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:50:41.380892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:41.389240 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6e1b8c61-9c87-4861-84e1-abd9f29ddef7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 200 len: 1357 microversion: 2.1 time: 0.102961 Aug 27 03:50:41.389641 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3736/7289] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:41 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:42.412422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:42.413134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: e55191f7-cceb-4ef3-ac2f-efced9a51532] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:42.419434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:42.419922 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:42.420370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:42.421066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:42.422122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:42.422562 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:42.435987 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] HTTP exception thrown: Instance e55191f7-cceb-4ef3-ac2f-efced9a51532 could not be found. Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Request method failure captured: Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 HTTP/1.1 Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZN8cUgbiN4jgbPGTVOnhXBTDRmGKc9TyWokgNVlUuhNsxgycX61xbACtrSelhVLFuDHDnMZajNNVM_Hr6ZS6h8ad21L06WPxjymJt8L-tJGxk5LXZkiJxOpgJBiULt4nkeFJydoyPTZwXXBxmeCLfLrgQwO_5KT--2T1aZJG-NqXWw Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 57b6a3a135de4feb8541658376863195 Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_57b6a3a135de4feb8541658376863195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/57b6a3a135de4feb8541658376863195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/57b6a3a135de4feb8541658376863195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/57b6a3a135de4feb8541658376863195"}]}] Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 57b6a3a135de4feb8541658376863195 Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestNetworkAdvancedServerOps-1128889267-project Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: b7d61a4dd7b64c65b9743f9f3b0d3aad Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1128889267-project Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance e55191f7-cceb-4ef3-ac2f-efced9a51532 could not be found. Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': 'e55191f7-cceb-4ef3-ac2f-efced9a51532'} Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55191f7-cceb-4ef3-ac2f-efced9a51532 could not be found. Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55191f7-cceb-4ef3-ac2f-efced9a51532 could not be found. Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:50:42.438286 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:50:42.443330 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:50:42.443330 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:50:42.443330 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:50:42.443330 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:50:42.443330 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:50:42.443330 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:50:42.443330 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55191f7-cceb-4ef3-ac2f-efced9a51532 could not be found. Aug 27 03:50:42.443330 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:50:42.443330 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Returning 404 to user: Instance e55191f7-cceb-4ef3-ac2f-efced9a51532 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:50:42.443330 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3af65a40-9111-4627-80b3-4084e3d53965 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532" status: 404 len: 111 microversion: 2.1 time: 0.032857 Aug 27 03:50:42.443330 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3554/7290] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:42 2022] GET /compute/v2.1/servers/e55191f7-cceb-4ef3-ac2f-efced9a51532 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:50:45.759322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-83f10cd3-40f6-4f9f-ae9a-11e936c500f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '.version_select at 0x7f4d2e803b80>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:45.791867 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-83f10cd3-40f6-4f9f-ae9a-11e936c500f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1996718700" status: 202 len: 0 microversion: 2.1 time: 0.037723 Aug 27 03:50:45.792543 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3737/7291] 10.222.0.99 () {58 vars in 1284 bytes} [Sat Aug 27 03:50:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1996718700 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:50:45.819443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-67eb2b0c-4380-41ee-881d-52791b537176 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'create', calling method: .version_select at 0x7f4d294a1790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1769555429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIenfholkYJqXEld4bwjeNROj7CLb607Fk4C2UHKr550VqqhHDnhVmot8/fZ5J/S+0EEckbZyfMVLNPfBxQi0ZZjKB+GmPtkXPOqob24WOX4DbJxQsFe1POFf1xwiXsH2Q=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:45.838406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-67eb2b0c-4380-41ee-881d-52791b537176 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for project 57b6a3a135de4feb8541658376863195. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:50:45.844854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-67eb2b0c-4380-41ee-881d-52791b537176 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for user b7d61a4dd7b64c65b9743f9f3b0d3aad and project 57b6a3a135de4feb8541658376863195. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:50:45.868170 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-67eb2b0c-4380-41ee-881d-52791b537176 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053249 Aug 27 03:50:45.868769 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3555/7292] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:50:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:51.517076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:51.522755 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-246937664", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "9214c37b-07f6-4588-8523-b083cbeb6ec3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1769555429", "security_groups": [{"name": "tempest-secgroup-smoke-2095319552"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:51.808776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] validate_networks() for [('9214c37b-07f6-4588-8523-b083cbeb6ec3', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:50:52.192763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:50:52.193201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:50:52.193708 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:50:52.194137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:50:52.194605 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:50:52.204477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:52.204974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:52.205478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:52.206390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:52.206860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:52.207299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:52.226108 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for project 57b6a3a135de4feb8541658376863195. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:50:52.231577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for user b7d61a4dd7b64c65b9743f9f3b0d3aad and project 57b6a3a135de4feb8541658376863195. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:50:52.244440 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:50:52.246840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:50:52.301317 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d4dc671d-a415-4ec8-811a-dbcc3df9c4a5 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.781561 Aug 27 03:50:52.301317 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3738/7293] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:50:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:50:52.309646 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-a486da78-fee4-46d2-9c69-9709b47cd2b4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:52.318405 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-a486da78-fee4-46d2-9c69-9709b47cd2b4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:52.427864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=16 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:50:52.463396 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-a486da78-fee4-46d2-9c69-9709b47cd2b4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:52.472933 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-a486da78-fee4-46d2-9c69-9709b47cd2b4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1266 microversion: 2.1 time: 0.167900 Aug 27 03:50:52.474076 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3556/7294] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:52 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:53.495043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-21ae2a1d-06b6-40de-bcca-7cf2dab78dea tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:53.495679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-21ae2a1d-06b6-40de-bcca-7cf2dab78dea tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:53.511668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ae2a1d-06b6-40de-bcca-7cf2dab78dea tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:53.513820 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ae2a1d-06b6-40de-bcca-7cf2dab78dea tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:53.514444 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ae2a1d-06b6-40de-bcca-7cf2dab78dea tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:53.515851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ae2a1d-06b6-40de-bcca-7cf2dab78dea tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:53.516322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ae2a1d-06b6-40de-bcca-7cf2dab78dea tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:53.516753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-21ae2a1d-06b6-40de-bcca-7cf2dab78dea tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:53.627126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-21ae2a1d-06b6-40de-bcca-7cf2dab78dea tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:53.637361 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-21ae2a1d-06b6-40de-bcca-7cf2dab78dea tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1336 microversion: 2.1 time: 0.147197 Aug 27 03:50:53.639538 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3739/7295] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:53 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1336 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:54.666793 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-00a824da-a754-4309-912e-c7c99a8d446e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:54.667475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-00a824da-a754-4309-912e-c7c99a8d446e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:54.676142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00a824da-a754-4309-912e-c7c99a8d446e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:54.676650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00a824da-a754-4309-912e-c7c99a8d446e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:54.677099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00a824da-a754-4309-912e-c7c99a8d446e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:54.677861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00a824da-a754-4309-912e-c7c99a8d446e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:54.678328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00a824da-a754-4309-912e-c7c99a8d446e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:54.678767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-00a824da-a754-4309-912e-c7c99a8d446e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:54.926564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-00a824da-a754-4309-912e-c7c99a8d446e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:54.934717 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-00a824da-a754-4309-912e-c7c99a8d446e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1392 microversion: 2.1 time: 0.272354 Aug 27 03:50:54.935281 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3557/7296] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:54 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1392 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:54.966081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-92efb907-dc8d-4f0f-a4ec-9160ab7e83d8 req-9c039499-90fa-4fbf-9137-bef4fcdc83ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a", "tag": "dfe95d63-3dd4-4663-9da2-efafbbc313d0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:54.980310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-92efb907-dc8d-4f0f-a4ec-9160ab7e83d8 req-9c039499-90fa-4fbf-9137-bef4fcdc83ba service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:54.980901 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-92efb907-dc8d-4f0f-a4ec-9160ab7e83d8 req-9c039499-90fa-4fbf-9137-bef4fcdc83ba service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:54.981579 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-92efb907-dc8d-4f0f-a4ec-9160ab7e83d8 req-9c039499-90fa-4fbf-9137-bef4fcdc83ba service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:54.994694 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-92efb907-dc8d-4f0f-a4ec-9160ab7e83d8 req-9c039499-90fa-4fbf-9137-bef4fcdc83ba service nova] Creating event network-changed:dfe95d63-3dd4-4663-9da2-efafbbc313d0 for instance d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a on n-h2-852084-5 Aug 27 03:50:54.999858 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-92efb907-dc8d-4f0f-a4ec-9160ab7e83d8 req-9c039499-90fa-4fbf-9137-bef4fcdc83ba service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038149 Aug 27 03:50:55.000472 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3740/7297] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:50:55.956495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e47e2783-0102-452c-965c-748a514f347f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:55.957126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e47e2783-0102-452c-965c-748a514f347f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:55.964087 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e47e2783-0102-452c-965c-748a514f347f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:55.964587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e47e2783-0102-452c-965c-748a514f347f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:55.965848 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e47e2783-0102-452c-965c-748a514f347f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:55.966042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e47e2783-0102-452c-965c-748a514f347f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:55.966539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e47e2783-0102-452c-965c-748a514f347f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:55.966981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e47e2783-0102-452c-965c-748a514f347f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:56.097720 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e47e2783-0102-452c-965c-748a514f347f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:56.105473 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e47e2783-0102-452c-965c-748a514f347f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1392 microversion: 2.1 time: 0.152901 Aug 27 03:50:56.106077 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3558/7298] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:55 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:57.127688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-15d24d06-e137-4842-83d4-e9b6515b482b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:57.128541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-15d24d06-e137-4842-83d4-e9b6515b482b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:57.137168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15d24d06-e137-4842-83d4-e9b6515b482b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:57.137659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15d24d06-e137-4842-83d4-e9b6515b482b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:57.138153 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15d24d06-e137-4842-83d4-e9b6515b482b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:57.138865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15d24d06-e137-4842-83d4-e9b6515b482b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:57.139322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15d24d06-e137-4842-83d4-e9b6515b482b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:57.140318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-15d24d06-e137-4842-83d4-e9b6515b482b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:57.272471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-15d24d06-e137-4842-83d4-e9b6515b482b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:57.280248 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-15d24d06-e137-4842-83d4-e9b6515b482b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1392 microversion: 2.1 time: 0.157266 Aug 27 03:50:57.281355 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3741/7299] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:57 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:58.302230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b360af5c-2d1a-485f-94f3-03fdf9e8f8de tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:58.303065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b360af5c-2d1a-485f-94f3-03fdf9e8f8de tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:58.310495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b360af5c-2d1a-485f-94f3-03fdf9e8f8de tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:58.311077 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b360af5c-2d1a-485f-94f3-03fdf9e8f8de tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:58.311649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b360af5c-2d1a-485f-94f3-03fdf9e8f8de tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:58.312464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b360af5c-2d1a-485f-94f3-03fdf9e8f8de tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:58.312998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b360af5c-2d1a-485f-94f3-03fdf9e8f8de tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:58.313474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b360af5c-2d1a-485f-94f3-03fdf9e8f8de tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:58.458473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b360af5c-2d1a-485f-94f3-03fdf9e8f8de tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:58.466710 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b360af5c-2d1a-485f-94f3-03fdf9e8f8de tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1392 microversion: 2.1 time: 0.168525 Aug 27 03:50:58.467297 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3559/7300] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:58 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:59.489488 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0a553213-26f2-46fe-97d4-5115b17c29d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:50:59.490180 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0a553213-26f2-46fe-97d4-5115b17c29d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:50:59.497128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a553213-26f2-46fe-97d4-5115b17c29d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:59.497644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a553213-26f2-46fe-97d4-5115b17c29d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:59.498122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a553213-26f2-46fe-97d4-5115b17c29d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:59.498830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a553213-26f2-46fe-97d4-5115b17c29d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:59.499906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a553213-26f2-46fe-97d4-5115b17c29d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:59.500342 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0a553213-26f2-46fe-97d4-5115b17c29d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:59.639414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0a553213-26f2-46fe-97d4-5115b17c29d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:50:59.647382 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0a553213-26f2-46fe-97d4-5115b17c29d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1392 microversion: 2.1 time: 0.161973 Aug 27 03:50:59.647967 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3742/7301] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:50:59 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:50:59.730494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e6b25105-e0e1-4fb3-849a-1fa7ded90386 req-a788b6d4-55fb-4c57-8fad-89c8de7c99be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a", "name": "network-vif-plugged", "status": "completed", "tag": "dfe95d63-3dd4-4663-9da2-efafbbc313d0"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:50:59.742234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e6b25105-e0e1-4fb3-849a-1fa7ded90386 req-a788b6d4-55fb-4c57-8fad-89c8de7c99be service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:50:59.742985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e6b25105-e0e1-4fb3-849a-1fa7ded90386 req-a788b6d4-55fb-4c57-8fad-89c8de7c99be service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:50:59.743441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e6b25105-e0e1-4fb3-849a-1fa7ded90386 req-a788b6d4-55fb-4c57-8fad-89c8de7c99be service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:50:59.754690 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e6b25105-e0e1-4fb3-849a-1fa7ded90386 req-a788b6d4-55fb-4c57-8fad-89c8de7c99be service nova] Creating event network-vif-plugged:dfe95d63-3dd4-4663-9da2-efafbbc313d0 for instance d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a on n-h2-852084-5 Aug 27 03:50:59.759843 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e6b25105-e0e1-4fb3-849a-1fa7ded90386 req-a788b6d4-55fb-4c57-8fad-89c8de7c99be service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033170 Aug 27 03:50:59.760641 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3560/7302] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:00.668604 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-1976b277-35bd-4eed-a618-45e5e80d6689 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:00.669232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-1976b277-35bd-4eed-a618-45e5e80d6689 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:00.676983 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1976b277-35bd-4eed-a618-45e5e80d6689 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:00.677420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1976b277-35bd-4eed-a618-45e5e80d6689 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:00.677906 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1976b277-35bd-4eed-a618-45e5e80d6689 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:00.678611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1976b277-35bd-4eed-a618-45e5e80d6689 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:00.679078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1976b277-35bd-4eed-a618-45e5e80d6689 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:00.679517 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-1976b277-35bd-4eed-a618-45e5e80d6689 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:00.817919 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-1976b277-35bd-4eed-a618-45e5e80d6689 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:00.828192 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-1976b277-35bd-4eed-a618-45e5e80d6689 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1392 microversion: 2.1 time: 0.163615 Aug 27 03:51:00.828779 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3743/7303] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:00 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:01.849012 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c8406ffb-1e2e-457c-a9db-6ef595f781fd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:01.849755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c8406ffb-1e2e-457c-a9db-6ef595f781fd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:01.852544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:01.859211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8406ffb-1e2e-457c-a9db-6ef595f781fd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:01.859705 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8406ffb-1e2e-457c-a9db-6ef595f781fd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:01.860177 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8406ffb-1e2e-457c-a9db-6ef595f781fd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:01.860868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8406ffb-1e2e-457c-a9db-6ef595f781fd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:01.861335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8406ffb-1e2e-457c-a9db-6ef595f781fd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:01.861796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c8406ffb-1e2e-457c-a9db-6ef595f781fd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:01.995126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c8406ffb-1e2e-457c-a9db-6ef595f781fd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:02.002971 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c8406ffb-1e2e-457c-a9db-6ef595f781fd tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1564 microversion: 2.1 time: 0.158214 Aug 27 03:51:02.003547 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3561/7304] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:01 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:02.023179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fdb2325d-4e82-4e34-a3ae-057b3f36cc8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:02.023898 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fdb2325d-4e82-4e34-a3ae-057b3f36cc8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:02.031368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdb2325d-4e82-4e34-a3ae-057b3f36cc8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:02.031858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdb2325d-4e82-4e34-a3ae-057b3f36cc8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:02.032310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdb2325d-4e82-4e34-a3ae-057b3f36cc8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:02.033014 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdb2325d-4e82-4e34-a3ae-057b3f36cc8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:02.033484 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdb2325d-4e82-4e34-a3ae-057b3f36cc8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:02.033943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fdb2325d-4e82-4e34-a3ae-057b3f36cc8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:02.179408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fdb2325d-4e82-4e34-a3ae-057b3f36cc8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:02.188089 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fdb2325d-4e82-4e34-a3ae-057b3f36cc8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1564 microversion: 2.1 time: 0.168823 Aug 27 03:51:02.188701 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3744/7305] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:02 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:03.808564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-048e109e-0a98-4479-b6a6-676dd3eeea8e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:03.809206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-048e109e-0a98-4479-b6a6-676dd3eeea8e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:03.810556 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-289f8899-bc0c-49f5-be8a-305cbb453101 req-15418b44-9d93-4cc1-a3e7-f3c99b8bcc65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a", "tag": "dfe95d63-3dd4-4663-9da2-efafbbc313d0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:03.812572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:03.816527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:03.817193 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:03.819946 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-048e109e-0a98-4479-b6a6-676dd3eeea8e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:03.820944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-048e109e-0a98-4479-b6a6-676dd3eeea8e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:03.822216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-048e109e-0a98-4479-b6a6-676dd3eeea8e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:03.822940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-048e109e-0a98-4479-b6a6-676dd3eeea8e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:03.823813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-048e109e-0a98-4479-b6a6-676dd3eeea8e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:03.824482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-048e109e-0a98-4479-b6a6-676dd3eeea8e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:03.825648 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-289f8899-bc0c-49f5-be8a-305cbb453101 req-15418b44-9d93-4cc1-a3e7-f3c99b8bcc65 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:03.826123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-289f8899-bc0c-49f5-be8a-305cbb453101 req-15418b44-9d93-4cc1-a3e7-f3c99b8bcc65 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:03.826591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-289f8899-bc0c-49f5-be8a-305cbb453101 req-15418b44-9d93-4cc1-a3e7-f3c99b8bcc65 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:03.840202 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-289f8899-bc0c-49f5-be8a-305cbb453101 req-15418b44-9d93-4cc1-a3e7-f3c99b8bcc65 service nova] Creating event network-changed:dfe95d63-3dd4-4663-9da2-efafbbc313d0 for instance d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a on n-h2-852084-5 Aug 27 03:51:03.845733 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-289f8899-bc0c-49f5-be8a-305cbb453101 req-15418b44-9d93-4cc1-a3e7-f3c99b8bcc65 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039011 Aug 27 03:51:03.846418 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3745/7306] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:51:04.058203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-048e109e-0a98-4479-b6a6-676dd3eeea8e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:04.066632 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-048e109e-0a98-4479-b6a6-676dd3eeea8e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1564 microversion: 2.1 time: 0.262215 Aug 27 03:51:04.067523 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3562/7307] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:03 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1564 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:25.393899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:25.394722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=36 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:25.400239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-210b2cf6-d5d7-41cf-be45-6104683d1593 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:25.402607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-210b2cf6-d5d7-41cf-be45-6104683d1593 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:25.410896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210b2cf6-d5d7-41cf-be45-6104683d1593 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:25.411382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210b2cf6-d5d7-41cf-be45-6104683d1593 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:25.411831 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210b2cf6-d5d7-41cf-be45-6104683d1593 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:25.412569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210b2cf6-d5d7-41cf-be45-6104683d1593 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:25.413028 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210b2cf6-d5d7-41cf-be45-6104683d1593 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:25.413459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-210b2cf6-d5d7-41cf-be45-6104683d1593 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:25.474438 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-210b2cf6-d5d7-41cf-be45-6104683d1593 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a/action" status: 200 len: 24583 microversion: 2.1 time: 0.082061 Aug 27 03:51:25.475129 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3746/7308] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:51:25 2022] POST /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a/action => generated 24583 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:51:36.516612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b3081a51-6d4c-4b65-9ead-0edb9008b4f9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:36.519352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:36.520179 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=32 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:36.527180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3081a51-6d4c-4b65-9ead-0edb9008b4f9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:36.527733 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3081a51-6d4c-4b65-9ead-0edb9008b4f9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:36.528193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b3081a51-6d4c-4b65-9ead-0edb9008b4f9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:36.550828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b3081a51-6d4c-4b65-9ead-0edb9008b4f9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Going to try to stop instance {{(pid=122487) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 27 03:51:36.593564 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b3081a51-6d4c-4b65-9ead-0edb9008b4f9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a/action" status: 202 len: 0 microversion: 2.1 time: 0.080843 Aug 27 03:51:36.594211 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3563/7309] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:51:36 2022] POST /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:51:36.603268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e18ac118-2f84-4ad9-8695-312f30895fc8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:36.603989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e18ac118-2f84-4ad9-8695-312f30895fc8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:36.606593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:36.607254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=4 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:51:36.613067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e18ac118-2f84-4ad9-8695-312f30895fc8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:36.613562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e18ac118-2f84-4ad9-8695-312f30895fc8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:36.614655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e18ac118-2f84-4ad9-8695-312f30895fc8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:36.615391 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e18ac118-2f84-4ad9-8695-312f30895fc8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:36.615859 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e18ac118-2f84-4ad9-8695-312f30895fc8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:36.616300 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e18ac118-2f84-4ad9-8695-312f30895fc8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:36.753333 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e18ac118-2f84-4ad9-8695-312f30895fc8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:36.761869 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e18ac118-2f84-4ad9-8695-312f30895fc8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.162998 Aug 27 03:51:36.762453 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3747/7310] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:36 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:37.784794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cb295812-7c46-4b3c-842a-d0e0918fcae8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:37.785422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cb295812-7c46-4b3c-842a-d0e0918fcae8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:37.792182 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb295812-7c46-4b3c-842a-d0e0918fcae8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:37.792681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb295812-7c46-4b3c-842a-d0e0918fcae8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:37.793138 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb295812-7c46-4b3c-842a-d0e0918fcae8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:37.793874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb295812-7c46-4b3c-842a-d0e0918fcae8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:37.794343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb295812-7c46-4b3c-842a-d0e0918fcae8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:37.794782 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cb295812-7c46-4b3c-842a-d0e0918fcae8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:37.931912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cb295812-7c46-4b3c-842a-d0e0918fcae8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:37.939865 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cb295812-7c46-4b3c-842a-d0e0918fcae8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.160396 Aug 27 03:51:37.940439 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3564/7311] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:37 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:38.960964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2ad5e13b-c3fa-42d9-bbbe-bb9c96f45d48 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:38.961584 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2ad5e13b-c3fa-42d9-bbbe-bb9c96f45d48 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:38.968835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ad5e13b-c3fa-42d9-bbbe-bb9c96f45d48 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:38.969337 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ad5e13b-c3fa-42d9-bbbe-bb9c96f45d48 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:38.969801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ad5e13b-c3fa-42d9-bbbe-bb9c96f45d48 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:38.970500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ad5e13b-c3fa-42d9-bbbe-bb9c96f45d48 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:38.970960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ad5e13b-c3fa-42d9-bbbe-bb9c96f45d48 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:38.971801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2ad5e13b-c3fa-42d9-bbbe-bb9c96f45d48 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:39.105744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2ad5e13b-c3fa-42d9-bbbe-bb9c96f45d48 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:39.113652 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2ad5e13b-c3fa-42d9-bbbe-bb9c96f45d48 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.157119 Aug 27 03:51:39.114257 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3748/7312] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:38 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:40.135212 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dedfbff4-da81-4ff0-b702-8cec272440a4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:40.135860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dedfbff4-da81-4ff0-b702-8cec272440a4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:40.143863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dedfbff4-da81-4ff0-b702-8cec272440a4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:40.145173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dedfbff4-da81-4ff0-b702-8cec272440a4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:40.145659 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dedfbff4-da81-4ff0-b702-8cec272440a4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:40.146412 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dedfbff4-da81-4ff0-b702-8cec272440a4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:40.146891 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dedfbff4-da81-4ff0-b702-8cec272440a4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:40.147325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dedfbff4-da81-4ff0-b702-8cec272440a4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:40.361910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dedfbff4-da81-4ff0-b702-8cec272440a4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:40.371600 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dedfbff4-da81-4ff0-b702-8cec272440a4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.240304 Aug 27 03:51:40.372190 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3565/7313] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:40 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:41.392494 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-97c69fe7-0f47-4810-b55b-0e886da88c51 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:41.393125 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-97c69fe7-0f47-4810-b55b-0e886da88c51 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:41.400112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97c69fe7-0f47-4810-b55b-0e886da88c51 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:41.400608 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97c69fe7-0f47-4810-b55b-0e886da88c51 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:41.401058 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97c69fe7-0f47-4810-b55b-0e886da88c51 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:41.401801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97c69fe7-0f47-4810-b55b-0e886da88c51 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:41.402272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97c69fe7-0f47-4810-b55b-0e886da88c51 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:41.402707 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-97c69fe7-0f47-4810-b55b-0e886da88c51 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:41.816291 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-97c69fe7-0f47-4810-b55b-0e886da88c51 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:41.824850 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-97c69fe7-0f47-4810-b55b-0e886da88c51 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.436018 Aug 27 03:51:41.825321 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3749/7314] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:41 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:42.847920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-37c1ec02-ffe5-448b-889d-a2a77f0136d6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:42.848552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-37c1ec02-ffe5-448b-889d-a2a77f0136d6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:42.856301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37c1ec02-ffe5-448b-889d-a2a77f0136d6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:42.856808 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37c1ec02-ffe5-448b-889d-a2a77f0136d6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:42.857272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37c1ec02-ffe5-448b-889d-a2a77f0136d6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:42.858022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37c1ec02-ffe5-448b-889d-a2a77f0136d6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:42.858496 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37c1ec02-ffe5-448b-889d-a2a77f0136d6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:42.858945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-37c1ec02-ffe5-448b-889d-a2a77f0136d6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:43.002266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-37c1ec02-ffe5-448b-889d-a2a77f0136d6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:43.011451 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-37c1ec02-ffe5-448b-889d-a2a77f0136d6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.167980 Aug 27 03:51:43.012022 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3566/7315] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:42 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:44.033101 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aec2dd71-3d69-409b-a165-c1a970221498 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:44.033807 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aec2dd71-3d69-409b-a165-c1a970221498 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:44.041216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aec2dd71-3d69-409b-a165-c1a970221498 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:44.041730 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aec2dd71-3d69-409b-a165-c1a970221498 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:44.042175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aec2dd71-3d69-409b-a165-c1a970221498 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:44.042876 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aec2dd71-3d69-409b-a165-c1a970221498 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:44.043357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aec2dd71-3d69-409b-a165-c1a970221498 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:44.043789 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aec2dd71-3d69-409b-a165-c1a970221498 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:44.177019 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aec2dd71-3d69-409b-a165-c1a970221498 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:44.184945 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aec2dd71-3d69-409b-a165-c1a970221498 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.156046 Aug 27 03:51:44.185532 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3750/7316] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:44 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:45.206739 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2d980603-d614-42a5-8a8b-9157f45fa475 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:45.207370 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2d980603-d614-42a5-8a8b-9157f45fa475 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:45.213804 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d980603-d614-42a5-8a8b-9157f45fa475 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:45.214193 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d980603-d614-42a5-8a8b-9157f45fa475 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:45.214647 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d980603-d614-42a5-8a8b-9157f45fa475 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:45.215357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d980603-d614-42a5-8a8b-9157f45fa475 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:45.215830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d980603-d614-42a5-8a8b-9157f45fa475 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:45.216532 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d980603-d614-42a5-8a8b-9157f45fa475 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:45.347972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2d980603-d614-42a5-8a8b-9157f45fa475 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:45.356699 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2d980603-d614-42a5-8a8b-9157f45fa475 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.154083 Aug 27 03:51:45.357281 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3567/7317] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:45 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:46.379067 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-300414f3-7fbd-4f0e-85b3-ccedb181e5c4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:46.379610 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-300414f3-7fbd-4f0e-85b3-ccedb181e5c4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:46.386773 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-300414f3-7fbd-4f0e-85b3-ccedb181e5c4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:46.387266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-300414f3-7fbd-4f0e-85b3-ccedb181e5c4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:46.387717 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-300414f3-7fbd-4f0e-85b3-ccedb181e5c4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:46.388433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-300414f3-7fbd-4f0e-85b3-ccedb181e5c4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:46.388887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-300414f3-7fbd-4f0e-85b3-ccedb181e5c4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:46.389351 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-300414f3-7fbd-4f0e-85b3-ccedb181e5c4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:46.527742 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-300414f3-7fbd-4f0e-85b3-ccedb181e5c4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:46.535532 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-300414f3-7fbd-4f0e-85b3-ccedb181e5c4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.160527 Aug 27 03:51:46.536124 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3751/7318] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:46 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:47.557914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1566c23c-de6f-41f7-a11a-5a8ae674f91c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:47.558454 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1566c23c-de6f-41f7-a11a-5a8ae674f91c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:47.565371 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1566c23c-de6f-41f7-a11a-5a8ae674f91c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:47.565898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1566c23c-de6f-41f7-a11a-5a8ae674f91c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:47.566352 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1566c23c-de6f-41f7-a11a-5a8ae674f91c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:47.567051 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1566c23c-de6f-41f7-a11a-5a8ae674f91c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:47.567520 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1566c23c-de6f-41f7-a11a-5a8ae674f91c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:47.567958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1566c23c-de6f-41f7-a11a-5a8ae674f91c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:47.701277 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1566c23c-de6f-41f7-a11a-5a8ae674f91c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:47.709213 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1566c23c-de6f-41f7-a11a-5a8ae674f91c tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.155405 Aug 27 03:51:47.709881 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3568/7319] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:47 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:48.731679 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7cea04c7-06ba-4e92-bd47-bfe82c18b4b3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:48.732299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7cea04c7-06ba-4e92-bd47-bfe82c18b4b3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:48.739553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cea04c7-06ba-4e92-bd47-bfe82c18b4b3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:48.740049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cea04c7-06ba-4e92-bd47-bfe82c18b4b3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:48.740498 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cea04c7-06ba-4e92-bd47-bfe82c18b4b3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:48.741202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cea04c7-06ba-4e92-bd47-bfe82c18b4b3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:48.742209 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cea04c7-06ba-4e92-bd47-bfe82c18b4b3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:48.742644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7cea04c7-06ba-4e92-bd47-bfe82c18b4b3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:48.877527 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7cea04c7-06ba-4e92-bd47-bfe82c18b4b3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:48.886173 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7cea04c7-06ba-4e92-bd47-bfe82c18b4b3 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.158452 Aug 27 03:51:48.886765 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3752/7320] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:48 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:49.908533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-50c1f0c0-1af5-477c-8078-ca50b805f44e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:49.909195 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-50c1f0c0-1af5-477c-8078-ca50b805f44e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:49.916213 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50c1f0c0-1af5-477c-8078-ca50b805f44e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:49.916714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50c1f0c0-1af5-477c-8078-ca50b805f44e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:49.917199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50c1f0c0-1af5-477c-8078-ca50b805f44e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:49.917938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50c1f0c0-1af5-477c-8078-ca50b805f44e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:49.918411 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50c1f0c0-1af5-477c-8078-ca50b805f44e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:49.918850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-50c1f0c0-1af5-477c-8078-ca50b805f44e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:50.054625 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-50c1f0c0-1af5-477c-8078-ca50b805f44e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:50.062519 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-50c1f0c0-1af5-477c-8078-ca50b805f44e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.157964 Aug 27 03:51:50.063116 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3569/7321] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:49 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:51.084422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-88ac54cc-5696-4fa9-b4a9-42d4fec252d4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:51.084973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-88ac54cc-5696-4fa9-b4a9-42d4fec252d4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:51.092116 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88ac54cc-5696-4fa9-b4a9-42d4fec252d4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:51.092597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88ac54cc-5696-4fa9-b4a9-42d4fec252d4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:51.093036 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88ac54cc-5696-4fa9-b4a9-42d4fec252d4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:51.093756 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88ac54cc-5696-4fa9-b4a9-42d4fec252d4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:51.094215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88ac54cc-5696-4fa9-b4a9-42d4fec252d4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:51.094640 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-88ac54cc-5696-4fa9-b4a9-42d4fec252d4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:51.230168 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-88ac54cc-5696-4fa9-b4a9-42d4fec252d4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:51.238170 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-88ac54cc-5696-4fa9-b4a9-42d4fec252d4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1692 microversion: 2.1 time: 0.157830 Aug 27 03:51:51.238749 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3753/7322] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:51 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:52.260198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f1518bde-d1e1-4fe0-a9d2-b17414aa1d05 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:52.260826 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f1518bde-d1e1-4fe0-a9d2-b17414aa1d05 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:52.267840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1518bde-d1e1-4fe0-a9d2-b17414aa1d05 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:52.268341 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1518bde-d1e1-4fe0-a9d2-b17414aa1d05 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:52.268796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1518bde-d1e1-4fe0-a9d2-b17414aa1d05 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:52.269509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1518bde-d1e1-4fe0-a9d2-b17414aa1d05 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:52.270022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1518bde-d1e1-4fe0-a9d2-b17414aa1d05 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:52.270469 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f1518bde-d1e1-4fe0-a9d2-b17414aa1d05 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:52.403249 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f1518bde-d1e1-4fe0-a9d2-b17414aa1d05 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:52.411347 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f1518bde-d1e1-4fe0-a9d2-b17414aa1d05 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1669 microversion: 2.1 time: 0.155647 Aug 27 03:51:52.411925 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3570/7323] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:52 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:53.516219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f8f69b47-8cd6-4343-a102-0c3920ab426d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:53.518506 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f8f69b47-8cd6-4343-a102-0c3920ab426d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:53.525981 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8f69b47-8cd6-4343-a102-0c3920ab426d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:53.526480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8f69b47-8cd6-4343-a102-0c3920ab426d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:53.526935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8f69b47-8cd6-4343-a102-0c3920ab426d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:53.527660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8f69b47-8cd6-4343-a102-0c3920ab426d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:53.528127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8f69b47-8cd6-4343-a102-0c3920ab426d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:53.528569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f8f69b47-8cd6-4343-a102-0c3920ab426d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:53.581993 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f8f69b47-8cd6-4343-a102-0c3920ab426d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a/action" status: 200 len: 38394 microversion: 2.1 time: 0.069679 Aug 27 03:51:53.582661 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3754/7324] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:51:53 2022] POST /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a/action => generated 38394 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:51:53.595159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ba4bd0e6-9ddd-43e4-bbdd-46f726a24338 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:51:53.602796 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba4bd0e6-9ddd-43e4-bbdd-46f726a24338 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:53.603278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba4bd0e6-9ddd-43e4-bbdd-46f726a24338 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:53.603732 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ba4bd0e6-9ddd-43e4-bbdd-46f726a24338 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:53.626406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ba4bd0e6-9ddd-43e4-bbdd-46f726a24338 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Going to try to start instance {{(pid=122487) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 27 03:51:53.668840 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ba4bd0e6-9ddd-43e4-bbdd-46f726a24338 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a/action" status: 202 len: 0 microversion: 2.1 time: 0.077690 Aug 27 03:51:53.669446 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3571/7325] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:51:53 2022] POST /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:51:53.678284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-efaeaa4b-583d-4324-bacf-1b1f67929fc6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:53.679671 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-efaeaa4b-583d-4324-bacf-1b1f67929fc6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:53.687266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efaeaa4b-583d-4324-bacf-1b1f67929fc6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:53.687861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efaeaa4b-583d-4324-bacf-1b1f67929fc6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:53.688315 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efaeaa4b-583d-4324-bacf-1b1f67929fc6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:53.689029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efaeaa4b-583d-4324-bacf-1b1f67929fc6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:53.689507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efaeaa4b-583d-4324-bacf-1b1f67929fc6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:53.689967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-efaeaa4b-583d-4324-bacf-1b1f67929fc6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:53.826232 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-efaeaa4b-583d-4324-bacf-1b1f67929fc6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:53.834620 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-efaeaa4b-583d-4324-bacf-1b1f67929fc6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1678 microversion: 2.1 time: 0.160612 Aug 27 03:51:53.835414 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3755/7326] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:53 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:51:54.858180 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e29057a1-3ece-41d8-8217-1a7da4a77521 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:51:54.858828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e29057a1-3ece-41d8-8217-1a7da4a77521 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:51:54.865126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e29057a1-3ece-41d8-8217-1a7da4a77521 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:54.866079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e29057a1-3ece-41d8-8217-1a7da4a77521 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:54.866079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e29057a1-3ece-41d8-8217-1a7da4a77521 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:54.867295 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e29057a1-3ece-41d8-8217-1a7da4a77521 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:51:54.867753 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e29057a1-3ece-41d8-8217-1a7da4a77521 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:51:54.868188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e29057a1-3ece-41d8-8217-1a7da4a77521 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:51:55.010407 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e29057a1-3ece-41d8-8217-1a7da4a77521 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:51:55.018220 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e29057a1-3ece-41d8-8217-1a7da4a77521 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1682 microversion: 2.1 time: 0.165377 Aug 27 03:51:55.018787 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3572/7327] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:51:54 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:19.204758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f9d67366-fbc5-46e3-a0d1-5c1b4b5e2050 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:19.207080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f9d67366-fbc5-46e3-a0d1-5c1b4b5e2050 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:19.209753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=18 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:19.210413 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=52 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:19.217433 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9d67366-fbc5-46e3-a0d1-5c1b4b5e2050 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:19.217960 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9d67366-fbc5-46e3-a0d1-5c1b4b5e2050 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:19.218417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9d67366-fbc5-46e3-a0d1-5c1b4b5e2050 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:19.219130 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9d67366-fbc5-46e3-a0d1-5c1b4b5e2050 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:19.219598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9d67366-fbc5-46e3-a0d1-5c1b4b5e2050 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:19.220041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f9d67366-fbc5-46e3-a0d1-5c1b4b5e2050 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:19.284519 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f9d67366-fbc5-46e3-a0d1-5c1b4b5e2050 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a/action" status: 200 len: 62953 microversion: 2.1 time: 0.083730 Aug 27 03:52:19.285187 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3756/7328] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:52:19 2022] POST /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a/action => generated 62953 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:52:26.474637 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3059f085-aea0-4cd9-9528-8283e7f8dab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:26.475296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3059f085-aea0-4cd9-9528-8283e7f8dab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:26.477510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-d4829c95-8b4c-42f3-be06-326864760fbf req-1c266026-84b9-40d1-b513-b95fe92ad647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a", "tag": "dfe95d63-3dd4-4663-9da2-efafbbc313d0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:26.477947 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=20 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:26.478734 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:26.480114 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:52:26.481054 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:52:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a (ip 10.222.0.99) !!! Aug 27 03:52:26.487357 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3059f085-aea0-4cd9-9528-8283e7f8dab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:26.487858 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3059f085-aea0-4cd9-9528-8283e7f8dab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:26.488309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3059f085-aea0-4cd9-9528-8283e7f8dab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:26.489235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3059f085-aea0-4cd9-9528-8283e7f8dab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:26.489567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d4829c95-8b4c-42f3-be06-326864760fbf req-1c266026-84b9-40d1-b513-b95fe92ad647 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:26.489714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3059f085-aea0-4cd9-9528-8283e7f8dab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:26.490095 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d4829c95-8b4c-42f3-be06-326864760fbf req-1c266026-84b9-40d1-b513-b95fe92ad647 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:26.490215 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3059f085-aea0-4cd9-9528-8283e7f8dab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:26.490544 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-d4829c95-8b4c-42f3-be06-326864760fbf req-1c266026-84b9-40d1-b513-b95fe92ad647 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:26.503687 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-d4829c95-8b4c-42f3-be06-326864760fbf req-1c266026-84b9-40d1-b513-b95fe92ad647 service nova] Creating event network-changed:dfe95d63-3dd4-4663-9da2-efafbbc313d0 for instance d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a on n-h2-852084-5 Aug 27 03:52:26.509045 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-d4829c95-8b4c-42f3-be06-326864760fbf req-1c266026-84b9-40d1-b513-b95fe92ad647 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035581 Aug 27 03:52:26.510458 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3757/7329] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:26.521500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3059f085-aea0-4cd9-9528-8283e7f8dab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:52:26.612088 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3059f085-aea0-4cd9-9528-8283e7f8dab8 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 204 len: 0 microversion: 2.1 time: 0.141222 Aug 27 03:52:26.616202 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3573/7330] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:52:26 2022] DELETE /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:52:26.625386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-69463618-3f6d-4934-a96a-1f0c5b549c96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:26.626525 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-69463618-3f6d-4934-a96a-1f0c5b549c96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:26.635090 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69463618-3f6d-4934-a96a-1f0c5b549c96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:26.635845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69463618-3f6d-4934-a96a-1f0c5b549c96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:26.636508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69463618-3f6d-4934-a96a-1f0c5b549c96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:26.637545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69463618-3f6d-4934-a96a-1f0c5b549c96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:26.638414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69463618-3f6d-4934-a96a-1f0c5b549c96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:26.638966 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-69463618-3f6d-4934-a96a-1f0c5b549c96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:26.784144 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-69463618-3f6d-4934-a96a-1f0c5b549c96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:26.792148 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-69463618-3f6d-4934-a96a-1f0c5b549c96 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1688 microversion: 2.1 time: 0.173661 Aug 27 03:52:26.793449 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3758/7331] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:26 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:27.815750 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-543ae8a6-f10e-45c9-b2ef-3d85a544723f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:27.816372 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-543ae8a6-f10e-45c9-b2ef-3d85a544723f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:27.823354 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-543ae8a6-f10e-45c9-b2ef-3d85a544723f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:27.823846 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-543ae8a6-f10e-45c9-b2ef-3d85a544723f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:27.824901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-543ae8a6-f10e-45c9-b2ef-3d85a544723f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:27.825607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-543ae8a6-f10e-45c9-b2ef-3d85a544723f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:27.826101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-543ae8a6-f10e-45c9-b2ef-3d85a544723f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:27.826539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-543ae8a6-f10e-45c9-b2ef-3d85a544723f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:27.998643 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-543ae8a6-f10e-45c9-b2ef-3d85a544723f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:28.006637 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-543ae8a6-f10e-45c9-b2ef-3d85a544723f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1688 microversion: 2.1 time: 0.195219 Aug 27 03:52:28.007221 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3574/7332] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:27 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:28.725491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-61bb21c2-a3e9-42ba-aeba-00c25ec5d5d4 req-28e94afa-3393-4988-abce-4767edfd78f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a", "name": "network-vif-deleted", "tag": "dfe95d63-3dd4-4663-9da2-efafbbc313d0"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:28.735809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-61bb21c2-a3e9-42ba-aeba-00c25ec5d5d4 req-28e94afa-3393-4988-abce-4767edfd78f7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:28.736304 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-61bb21c2-a3e9-42ba-aeba-00c25ec5d5d4 req-28e94afa-3393-4988-abce-4767edfd78f7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:28.736743 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-61bb21c2-a3e9-42ba-aeba-00c25ec5d5d4 req-28e94afa-3393-4988-abce-4767edfd78f7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:28.751499 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-61bb21c2-a3e9-42ba-aeba-00c25ec5d5d4 req-28e94afa-3393-4988-abce-4767edfd78f7 service nova] Creating event network-vif-deleted:dfe95d63-3dd4-4663-9da2-efafbbc313d0 for instance d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a on n-h2-852084-5 Aug 27 03:52:28.756356 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-61bb21c2-a3e9-42ba-aeba-00c25ec5d5d4 req-28e94afa-3393-4988-abce-4767edfd78f7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035442 Aug 27 03:52:28.757044 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3759/7333] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:29.028681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:29.029348 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:29.036413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:29.036924 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:29.037379 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:29.038132 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:29.038602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:29.039065 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:29.073533 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:29.074736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:29.075206 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:29.075681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lazy-loading 'fault' on Instance uuid d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:52:29.117462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:29.128255 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ec4bcb80-726a-423c-acd1-81653e80883a tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 200 len: 1356 microversion: 2.1 time: 0.103598 Aug 27 03:52:29.128857 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3575/7334] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:29 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:30.153607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:30.154360 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:30.160689 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:30.161179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:30.161629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:30.162359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:30.162824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:30.163258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:30.176985 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] HTTP exception thrown: Instance d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a could not be found. Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Request method failure captured: Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a HTTP/1.1 Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZN8cUgbiN4jgbPGTVOnhXBTDRmGKc9TyWokgNVlUuhNsxgycX61xbACtrSelhVLFuDHDnMZajNNVM_Hr6ZS6h8ad21L06WPxjymJt8L-tJGxk5LXZkiJxOpgJBiULt4nkeFJydoyPTZwXXBxmeCLfLrgQwO_5KT--2T1aZJG-NqXWw Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 57b6a3a135de4feb8541658376863195 Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_57b6a3a135de4feb8541658376863195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/57b6a3a135de4feb8541658376863195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/57b6a3a135de4feb8541658376863195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/57b6a3a135de4feb8541658376863195"}]}] Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 57b6a3a135de4feb8541658376863195 Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestNetworkAdvancedServerOps-1128889267-project Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b7d61a4dd7b64c65b9743f9f3b0d3aad Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1128889267-project Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a could not be found. Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': 'd40bd293-c4a0-41fe-b8a1-d73e7ec8e43a'} Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a could not be found. Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a could not be found. Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:52:30.178666 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:52:30.183726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:52:30.183726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:52:30.183726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:52:30.183726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:52:30.183726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:52:30.183726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:52:30.183726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a could not be found. Aug 27 03:52:30.183726 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:52:30.183726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Returning 404 to user: Instance d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:52:30.183726 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-79bbc9a5-cb1a-41f3-be4c-c08315ac9cf6 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a" status: 404 len: 111 microversion: 2.1 time: 0.032428 Aug 27 03:52:30.183726 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3760/7335] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:30 2022] GET /compute/v2.1/servers/d40bd293-c4a0-41fe-b8a1-d73e7ec8e43a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:52:33.487930 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e39bb5f2-21f6-4729-8ae4-28a7a2f45e39 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '.version_select at 0x7f4d2aed7430>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:33.515857 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e39bb5f2-21f6-4729-8ae4-28a7a2f45e39 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1769555429" status: 202 len: 0 microversion: 2.1 time: 0.033397 Aug 27 03:52:33.516654 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3576/7336] 10.222.0.99 () {58 vars in 1284 bytes} [Sat Aug 27 03:52:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1769555429 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:52:33.550763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0a5f8b3a-797b-40d5-ba1d-0cde5bd637e2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'create', calling method: .version_select at 0x7f4d29a4a8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1140406824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML8tpZnIwwdR/0R6h/kuiz4LOT0/O+01daq6pDs2KjOTGeWSVi9KWAXe1sW9UGq8g3vPyveme6zPLut69qNkiPK2pBFGtHCUUOu6EKxMtgFjhlGUpZZCJNIk5okDhHwPw=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:33.568516 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-0a5f8b3a-797b-40d5-ba1d-0cde5bd637e2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for project 57b6a3a135de4feb8541658376863195. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:52:33.574931 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-0a5f8b3a-797b-40d5-ba1d-0cde5bd637e2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for user b7d61a4dd7b64c65b9743f9f3b0d3aad and project 57b6a3a135de4feb8541658376863195. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:52:33.600743 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0a5f8b3a-797b-40d5-ba1d-0cde5bd637e2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053906 Aug 27 03:52:33.605733 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3761/7337] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:52:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:39.335474 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:39.340655 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-744182202", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "networks": [{"uuid": "48d7c8ed-92f2-44c2-bfba-db113d9d5194"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1140406824", "security_groups": [{"name": "tempest-secgroup-smoke-1898925188"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:39.466479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] validate_networks() for [('48d7c8ed-92f2-44c2-bfba-db113d9d5194', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:52:40.005984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:52:40.006426 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:52:40.007173 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:52:40.008609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:52:40.009120 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:52:40.020485 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:40.021001 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:40.021460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:40.022244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:40.022719 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:40.023167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:40.059771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for project 57b6a3a135de4feb8541658376863195. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:52:40.069868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Getting quotas for user b7d61a4dd7b64c65b9743f9f3b0d3aad and project 57b6a3a135de4feb8541658376863195. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:52:40.085578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:52:40.088112 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:52:40.152263 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da5d0e7b-4800-43ac-8a7f-c52e30cad0d9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818461 Aug 27 03:52:40.153402 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3577/7338] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:52:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:52:40.165237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9bc241d8-8b4d-4b20-9872-9c917feb9de4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:40.166048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9bc241d8-8b4d-4b20-9872-9c917feb9de4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:40.169078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=16 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:40.266262 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9bc241d8-8b4d-4b20-9872-9c917feb9de4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:40.274867 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9bc241d8-8b4d-4b20-9872-9c917feb9de4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1266 microversion: 2.1 time: 0.114443 Aug 27 03:52:40.287457 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3762/7339] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:40 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:41.304594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e551e651-02c9-46a6-9311-9f898748089e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:41.305936 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e551e651-02c9-46a6-9311-9f898748089e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:41.314540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e551e651-02c9-46a6-9311-9f898748089e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:41.315140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e551e651-02c9-46a6-9311-9f898748089e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:41.315741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e551e651-02c9-46a6-9311-9f898748089e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:41.316636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e551e651-02c9-46a6-9311-9f898748089e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:41.317208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e551e651-02c9-46a6-9311-9f898748089e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:41.317759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e551e651-02c9-46a6-9311-9f898748089e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:41.392948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e551e651-02c9-46a6-9311-9f898748089e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:41.406915 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e551e651-02c9-46a6-9311-9f898748089e tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1326 microversion: 2.1 time: 0.114863 Aug 27 03:52:41.408217 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3578/7340] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:41 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:42.429084 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f4d7985c-ccd3-435e-b87f-fc2d7a7b9401 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:42.430312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f4d7985c-ccd3-435e-b87f-fc2d7a7b9401 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:42.440414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4d7985c-ccd3-435e-b87f-fc2d7a7b9401 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:42.440903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4d7985c-ccd3-435e-b87f-fc2d7a7b9401 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:42.441354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4d7985c-ccd3-435e-b87f-fc2d7a7b9401 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:42.442117 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4d7985c-ccd3-435e-b87f-fc2d7a7b9401 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:42.442582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4d7985c-ccd3-435e-b87f-fc2d7a7b9401 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:42.443157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f4d7985c-ccd3-435e-b87f-fc2d7a7b9401 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:42.971223 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f4d7985c-ccd3-435e-b87f-fc2d7a7b9401 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:42.979197 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f4d7985c-ccd3-435e-b87f-fc2d7a7b9401 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1392 microversion: 2.1 time: 0.554500 Aug 27 03:52:42.979782 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3763/7341] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:42 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1392 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:43.267760 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-a8923dcc-d8cb-4f99-9a29-0f4962f7876a req-332512b5-d399-4177-bf4e-a18130fb08e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c22511-7fe1-423e-98b3-a54927f438f8", "tag": "dc7ab4c2-137f-4d37-aeb1-0b8b615187f6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:43.284823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a8923dcc-d8cb-4f99-9a29-0f4962f7876a req-332512b5-d399-4177-bf4e-a18130fb08e2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:43.285320 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a8923dcc-d8cb-4f99-9a29-0f4962f7876a req-332512b5-d399-4177-bf4e-a18130fb08e2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:43.286033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-a8923dcc-d8cb-4f99-9a29-0f4962f7876a req-332512b5-d399-4177-bf4e-a18130fb08e2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:43.302788 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-a8923dcc-d8cb-4f99-9a29-0f4962f7876a req-332512b5-d399-4177-bf4e-a18130fb08e2 service nova] Creating event network-changed:dc7ab4c2-137f-4d37-aeb1-0b8b615187f6 for instance 00c22511-7fe1-423e-98b3-a54927f438f8 on n-h2-852084-5 Aug 27 03:52:43.308222 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-a8923dcc-d8cb-4f99-9a29-0f4962f7876a req-332512b5-d399-4177-bf4e-a18130fb08e2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045742 Aug 27 03:52:43.309130 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3579/7342] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:52:44.001311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-37f099de-e912-4c6f-9d84-e00e52036dab tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:44.002073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-37f099de-e912-4c6f-9d84-e00e52036dab tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:44.008978 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f099de-e912-4c6f-9d84-e00e52036dab tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:44.009473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f099de-e912-4c6f-9d84-e00e52036dab tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:44.009962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f099de-e912-4c6f-9d84-e00e52036dab tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:44.010676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f099de-e912-4c6f-9d84-e00e52036dab tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:44.011695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f099de-e912-4c6f-9d84-e00e52036dab tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:44.012169 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-37f099de-e912-4c6f-9d84-e00e52036dab tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:44.146218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-37f099de-e912-4c6f-9d84-e00e52036dab tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:44.154046 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-37f099de-e912-4c6f-9d84-e00e52036dab tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1392 microversion: 2.1 time: 0.156718 Aug 27 03:52:44.154631 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3764/7343] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:43 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:45.176190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7c073ee-80fe-4a83-b562-e34f484526d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:45.176902 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7c073ee-80fe-4a83-b562-e34f484526d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:45.183710 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c073ee-80fe-4a83-b562-e34f484526d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:45.184208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c073ee-80fe-4a83-b562-e34f484526d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:45.184706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c073ee-80fe-4a83-b562-e34f484526d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:45.185359 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c073ee-80fe-4a83-b562-e34f484526d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:45.185854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c073ee-80fe-4a83-b562-e34f484526d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:45.186294 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7c073ee-80fe-4a83-b562-e34f484526d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:45.324071 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7c073ee-80fe-4a83-b562-e34f484526d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:45.332231 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7c073ee-80fe-4a83-b562-e34f484526d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1392 microversion: 2.1 time: 0.160361 Aug 27 03:52:45.332822 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3580/7344] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:45 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:46.356045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-61715484-be4a-48de-8e3b-8e60cef3c258 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:46.356651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-61715484-be4a-48de-8e3b-8e60cef3c258 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:46.363580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61715484-be4a-48de-8e3b-8e60cef3c258 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:46.364070 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61715484-be4a-48de-8e3b-8e60cef3c258 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:46.364518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61715484-be4a-48de-8e3b-8e60cef3c258 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:46.365224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61715484-be4a-48de-8e3b-8e60cef3c258 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:46.365780 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61715484-be4a-48de-8e3b-8e60cef3c258 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:46.366220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-61715484-be4a-48de-8e3b-8e60cef3c258 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:46.502233 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-61715484-be4a-48de-8e3b-8e60cef3c258 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:46.509965 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-61715484-be4a-48de-8e3b-8e60cef3c258 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1392 microversion: 2.1 time: 0.158499 Aug 27 03:52:46.510558 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3765/7345] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:46 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:47.530706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3f07bae1-e400-4eec-a35f-b28c6e663aa0 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:47.531343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3f07bae1-e400-4eec-a35f-b28c6e663aa0 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:47.538284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f07bae1-e400-4eec-a35f-b28c6e663aa0 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:47.538784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f07bae1-e400-4eec-a35f-b28c6e663aa0 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:47.539271 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f07bae1-e400-4eec-a35f-b28c6e663aa0 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:47.539979 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f07bae1-e400-4eec-a35f-b28c6e663aa0 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:47.540447 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f07bae1-e400-4eec-a35f-b28c6e663aa0 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:47.540921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3f07bae1-e400-4eec-a35f-b28c6e663aa0 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:47.676744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3f07bae1-e400-4eec-a35f-b28c6e663aa0 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:47.685092 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3f07bae1-e400-4eec-a35f-b28c6e663aa0 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1392 microversion: 2.1 time: 0.158328 Aug 27 03:52:47.685698 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3581/7346] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:47 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:48.705023 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fbbcc522-784b-46ad-af44-0ec369c7bd44 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:48.705636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fbbcc522-784b-46ad-af44-0ec369c7bd44 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:48.712538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbbcc522-784b-46ad-af44-0ec369c7bd44 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:48.713021 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbbcc522-784b-46ad-af44-0ec369c7bd44 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:48.713460 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbbcc522-784b-46ad-af44-0ec369c7bd44 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:48.714724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbbcc522-784b-46ad-af44-0ec369c7bd44 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:48.715183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbbcc522-784b-46ad-af44-0ec369c7bd44 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:48.715614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fbbcc522-784b-46ad-af44-0ec369c7bd44 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:48.847721 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fbbcc522-784b-46ad-af44-0ec369c7bd44 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:48.856167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fbbcc522-784b-46ad-af44-0ec369c7bd44 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1392 microversion: 2.1 time: 0.155085 Aug 27 03:52:48.856760 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3766/7347] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:48 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:49.877765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b1d265e6-cf63-4635-97c1-0b8e79e00cbc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:49.878403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b1d265e6-cf63-4635-97c1-0b8e79e00cbc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:49.885296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1d265e6-cf63-4635-97c1-0b8e79e00cbc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:49.885842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1d265e6-cf63-4635-97c1-0b8e79e00cbc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:49.886302 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1d265e6-cf63-4635-97c1-0b8e79e00cbc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:49.887015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1d265e6-cf63-4635-97c1-0b8e79e00cbc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:49.887489 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1d265e6-cf63-4635-97c1-0b8e79e00cbc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:49.887958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b1d265e6-cf63-4635-97c1-0b8e79e00cbc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:50.019917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b1d265e6-cf63-4635-97c1-0b8e79e00cbc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:50.028224 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b1d265e6-cf63-4635-97c1-0b8e79e00cbc tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1392 microversion: 2.1 time: 0.154475 Aug 27 03:52:50.028803 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3582/7348] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:49 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:50.209814 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c3725429-1d94-4577-8737-39e301e65964 req-38efab20-f3bb-4579-b8b3-0a8334a30aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c22511-7fe1-423e-98b3-a54927f438f8", "name": "network-vif-plugged", "status": "completed", "tag": "dc7ab4c2-137f-4d37-aeb1-0b8b615187f6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:50.219396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:50.228611 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c3725429-1d94-4577-8737-39e301e65964 req-38efab20-f3bb-4579-b8b3-0a8334a30aff service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:50.229692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c3725429-1d94-4577-8737-39e301e65964 req-38efab20-f3bb-4579-b8b3-0a8334a30aff service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:50.231170 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c3725429-1d94-4577-8737-39e301e65964 req-38efab20-f3bb-4579-b8b3-0a8334a30aff service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:50.255114 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c3725429-1d94-4577-8737-39e301e65964 req-38efab20-f3bb-4579-b8b3-0a8334a30aff service nova] Creating event network-vif-plugged:dc7ab4c2-137f-4d37-aeb1-0b8b615187f6 for instance 00c22511-7fe1-423e-98b3-a54927f438f8 on n-h2-852084-5 Aug 27 03:52:50.264082 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c3725429-1d94-4577-8737-39e301e65964 req-38efab20-f3bb-4579-b8b3-0a8334a30aff service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058167 Aug 27 03:52:50.265173 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3767/7349] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:51.048363 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dca7ba41-cf67-4046-8ebb-dfa0a8634d63 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:51.049000 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dca7ba41-cf67-4046-8ebb-dfa0a8634d63 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:51.051050 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:51.051741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:51.058995 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dca7ba41-cf67-4046-8ebb-dfa0a8634d63 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:51.059501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dca7ba41-cf67-4046-8ebb-dfa0a8634d63 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:51.059958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dca7ba41-cf67-4046-8ebb-dfa0a8634d63 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:51.060678 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dca7ba41-cf67-4046-8ebb-dfa0a8634d63 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:51.061152 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dca7ba41-cf67-4046-8ebb-dfa0a8634d63 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:51.061602 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dca7ba41-cf67-4046-8ebb-dfa0a8634d63 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:51.206445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dca7ba41-cf67-4046-8ebb-dfa0a8634d63 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:51.214272 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dca7ba41-cf67-4046-8ebb-dfa0a8634d63 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1392 microversion: 2.1 time: 0.169801 Aug 27 03:52:51.217825 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3583/7350] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:51 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:52.232296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:52:52.237597 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d8ca8d3c-ce0b-4753-8d1d-32c36a5ac687 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:52.238358 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d8ca8d3c-ce0b-4753-8d1d-32c36a5ac687 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:52.245063 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8ca8d3c-ce0b-4753-8d1d-32c36a5ac687 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:52.246075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8ca8d3c-ce0b-4753-8d1d-32c36a5ac687 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:52.246545 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8ca8d3c-ce0b-4753-8d1d-32c36a5ac687 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:52.247251 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8ca8d3c-ce0b-4753-8d1d-32c36a5ac687 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:52.247715 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8ca8d3c-ce0b-4753-8d1d-32c36a5ac687 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:52.248159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d8ca8d3c-ce0b-4753-8d1d-32c36a5ac687 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:52.390575 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d8ca8d3c-ce0b-4753-8d1d-32c36a5ac687 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:52.398819 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d8ca8d3c-ce0b-4753-8d1d-32c36a5ac687 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1565 microversion: 2.1 time: 0.167479 Aug 27 03:52:52.399449 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3768/7351] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:52 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:52.418988 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-42f1836e-2a4a-40b2-92c5-85b416d2ec84 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:52.419627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-42f1836e-2a4a-40b2-92c5-85b416d2ec84 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:52.426503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42f1836e-2a4a-40b2-92c5-85b416d2ec84 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:52.427004 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42f1836e-2a4a-40b2-92c5-85b416d2ec84 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:52.427464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42f1836e-2a4a-40b2-92c5-85b416d2ec84 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:52.428169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42f1836e-2a4a-40b2-92c5-85b416d2ec84 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:52.428641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42f1836e-2a4a-40b2-92c5-85b416d2ec84 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:52.429086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-42f1836e-2a4a-40b2-92c5-85b416d2ec84 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:52.561901 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-42f1836e-2a4a-40b2-92c5-85b416d2ec84 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:52.569829 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-42f1836e-2a4a-40b2-92c5-85b416d2ec84 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1565 microversion: 2.1 time: 0.154689 Aug 27 03:52:52.570405 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3584/7352] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:52 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:52:54.164671 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-87ab080d-8403-4242-80b2-7361e8dbeb7e req-2cb78c18-b4e3-44eb-a1f1-042c835f3a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c22511-7fe1-423e-98b3-a54927f438f8", "tag": "dc7ab4c2-137f-4d37-aeb1-0b8b615187f6"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:52:54.171803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-9ace3737-ae9e-4551-8b2f-4b594cbe6274 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:52:54.172437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-9ace3737-ae9e-4551-8b2f-4b594cbe6274 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:52:54.179792 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ace3737-ae9e-4551-8b2f-4b594cbe6274 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:54.180428 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ace3737-ae9e-4551-8b2f-4b594cbe6274 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:54.180871 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ace3737-ae9e-4551-8b2f-4b594cbe6274 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:54.181612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ace3737-ae9e-4551-8b2f-4b594cbe6274 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:54.182220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ace3737-ae9e-4551-8b2f-4b594cbe6274 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:54.182366 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-87ab080d-8403-4242-80b2-7361e8dbeb7e req-2cb78c18-b4e3-44eb-a1f1-042c835f3a1f service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:52:54.182591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-9ace3737-ae9e-4551-8b2f-4b594cbe6274 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:54.182759 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-87ab080d-8403-4242-80b2-7361e8dbeb7e req-2cb78c18-b4e3-44eb-a1f1-042c835f3a1f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:52:54.184380 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-87ab080d-8403-4242-80b2-7361e8dbeb7e req-2cb78c18-b4e3-44eb-a1f1-042c835f3a1f service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:52:54.196944 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-87ab080d-8403-4242-80b2-7361e8dbeb7e req-2cb78c18-b4e3-44eb-a1f1-042c835f3a1f service nova] Creating event network-changed:dc7ab4c2-137f-4d37-aeb1-0b8b615187f6 for instance 00c22511-7fe1-423e-98b3-a54927f438f8 on n-h2-852084-5 Aug 27 03:52:54.202229 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-87ab080d-8403-4242-80b2-7361e8dbeb7e req-2cb78c18-b4e3-44eb-a1f1-042c835f3a1f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041129 Aug 27 03:52:54.202912 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3585/7353] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:52:54.422405 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-9ace3737-ae9e-4551-8b2f-4b594cbe6274 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:52:54.431375 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-9ace3737-ae9e-4551-8b2f-4b594cbe6274 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1565 microversion: 2.1 time: 0.273755 Aug 27 03:52:54.432450 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3769/7354] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:52:54 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1565 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:15.682441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:15.683127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=42 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:15.687497 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2354a8a3-82e4-4b30-a97e-1bd1c078d8e9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:15.689915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2354a8a3-82e4-4b30-a97e-1bd1c078d8e9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:15.698037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2354a8a3-82e4-4b30-a97e-1bd1c078d8e9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:15.698536 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2354a8a3-82e4-4b30-a97e-1bd1c078d8e9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:15.698990 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2354a8a3-82e4-4b30-a97e-1bd1c078d8e9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:15.699699 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2354a8a3-82e4-4b30-a97e-1bd1c078d8e9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:15.700167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2354a8a3-82e4-4b30-a97e-1bd1c078d8e9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:15.700607 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2354a8a3-82e4-4b30-a97e-1bd1c078d8e9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:15.757483 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2354a8a3-82e4-4b30-a97e-1bd1c078d8e9 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8/action" status: 200 len: 24568 microversion: 2.1 time: 0.076995 Aug 27 03:53:15.758166 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3586/7355] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:53:15 2022] POST /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8/action => generated 24568 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:53:26.787366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fc099f39-8f80-4b07-9861-4a180dad4c2b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:26.787939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fc099f39-8f80-4b07-9861-4a180dad4c2b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:26.790078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=5 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:26.790724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=38 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:26.791922 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:53:26.792073 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 03:53:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8/action (ip 10.222.0.99) !!! Aug 27 03:53:26.799475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc099f39-8f80-4b07-9861-4a180dad4c2b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:26.799967 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc099f39-8f80-4b07-9861-4a180dad4c2b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:26.800407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc099f39-8f80-4b07-9861-4a180dad4c2b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:26.801216 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc099f39-8f80-4b07-9861-4a180dad4c2b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:26.801568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc099f39-8f80-4b07-9861-4a180dad4c2b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:26.802022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fc099f39-8f80-4b07-9861-4a180dad4c2b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:26.827543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-fc099f39-8f80-4b07-9861-4a180dad4c2b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lazy-loading 'flavor' on Instance uuid 00c22511-7fe1-423e-98b3-a54927f438f8 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:53:26.894728 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fc099f39-8f80-4b07-9861-4a180dad4c2b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8/action" status: 202 len: 0 microversion: 2.1 time: 0.111379 Aug 27 03:53:26.895351 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3770/7356] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:53:26 2022] POST /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:53:26.904253 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-733454eb-47b9-4323-ae71-ce241b7430f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:26.904970 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-733454eb-47b9-4323-ae71-ce241b7430f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:26.908022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:26.909111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:26.915284 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-733454eb-47b9-4323-ae71-ce241b7430f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:26.915770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-733454eb-47b9-4323-ae71-ce241b7430f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:26.916218 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-733454eb-47b9-4323-ae71-ce241b7430f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:26.917037 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-733454eb-47b9-4323-ae71-ce241b7430f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:26.917543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-733454eb-47b9-4323-ae71-ce241b7430f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:26.917982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-733454eb-47b9-4323-ae71-ce241b7430f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:27.054967 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-733454eb-47b9-4323-ae71-ce241b7430f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:27.063658 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-733454eb-47b9-4323-ae71-ce241b7430f4 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1691 microversion: 2.1 time: 0.163592 Aug 27 03:53:27.064427 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3587/7357] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:26 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:28.090207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-02ae4d6c-6ef1-4fbe-87d4-04e2aeda4c22 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:28.091555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-02ae4d6c-6ef1-4fbe-87d4-04e2aeda4c22 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:28.098194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ae4d6c-6ef1-4fbe-87d4-04e2aeda4c22 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:28.098688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ae4d6c-6ef1-4fbe-87d4-04e2aeda4c22 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:28.099133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ae4d6c-6ef1-4fbe-87d4-04e2aeda4c22 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:28.099840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ae4d6c-6ef1-4fbe-87d4-04e2aeda4c22 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:28.100302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ae4d6c-6ef1-4fbe-87d4-04e2aeda4c22 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:28.100744 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-02ae4d6c-6ef1-4fbe-87d4-04e2aeda4c22 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:28.247675 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-02ae4d6c-6ef1-4fbe-87d4-04e2aeda4c22 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:28.255897 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-02ae4d6c-6ef1-4fbe-87d4-04e2aeda4c22 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1674 microversion: 2.1 time: 0.170960 Aug 27 03:53:28.256505 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3771/7358] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:28 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:29.355339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e03eb68c-f71a-4437-bb67-38dfb12db01b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:29.357546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e03eb68c-f71a-4437-bb67-38dfb12db01b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:29.365449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e03eb68c-f71a-4437-bb67-38dfb12db01b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:29.365977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e03eb68c-f71a-4437-bb67-38dfb12db01b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:29.366438 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e03eb68c-f71a-4437-bb67-38dfb12db01b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:29.367149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e03eb68c-f71a-4437-bb67-38dfb12db01b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:29.367624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e03eb68c-f71a-4437-bb67-38dfb12db01b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:29.368068 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e03eb68c-f71a-4437-bb67-38dfb12db01b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:29.419027 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e03eb68c-f71a-4437-bb67-38dfb12db01b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8/action" status: 200 len: 38388 microversion: 2.1 time: 0.068230 Aug 27 03:53:29.419671 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3588/7359] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:53:29 2022] POST /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8/action => generated 38388 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:53:29.431550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f246ef24-59fe-45b1-9a73-13b050614196 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:29.432162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f246ef24-59fe-45b1-9a73-13b050614196 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:29.439055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f246ef24-59fe-45b1-9a73-13b050614196 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:29.439539 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f246ef24-59fe-45b1-9a73-13b050614196 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:29.439980 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f246ef24-59fe-45b1-9a73-13b050614196 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:29.440673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f246ef24-59fe-45b1-9a73-13b050614196 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:29.441131 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f246ef24-59fe-45b1-9a73-13b050614196 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:29.441559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f246ef24-59fe-45b1-9a73-13b050614196 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:29.516495 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f246ef24-59fe-45b1-9a73-13b050614196 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8/action" status: 202 len: 0 microversion: 2.1 time: 0.088578 Aug 27 03:53:29.517879 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3772/7360] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:53:29 2022] POST /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:53:29.527992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ea610f75-c1a9-416b-8d6f-86c4ddc76e75 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:29.528731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ea610f75-c1a9-416b-8d6f-86c4ddc76e75 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:29.538282 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea610f75-c1a9-416b-8d6f-86c4ddc76e75 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:29.538863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea610f75-c1a9-416b-8d6f-86c4ddc76e75 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:29.539325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea610f75-c1a9-416b-8d6f-86c4ddc76e75 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:29.540088 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea610f75-c1a9-416b-8d6f-86c4ddc76e75 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:29.540564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea610f75-c1a9-416b-8d6f-86c4ddc76e75 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:29.541014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ea610f75-c1a9-416b-8d6f-86c4ddc76e75 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:29.682144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ea610f75-c1a9-416b-8d6f-86c4ddc76e75 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:29.690037 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ea610f75-c1a9-416b-8d6f-86c4ddc76e75 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1680 microversion: 2.1 time: 0.167766 Aug 27 03:53:29.690629 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3589/7361] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:29 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:30.713977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f289d18f-d0f4-49bf-bf22-04397410db0f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:30.714645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f289d18f-d0f4-49bf-bf22-04397410db0f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:30.722073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f289d18f-d0f4-49bf-bf22-04397410db0f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:30.722565 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f289d18f-d0f4-49bf-bf22-04397410db0f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:30.723015 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f289d18f-d0f4-49bf-bf22-04397410db0f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:30.723726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f289d18f-d0f4-49bf-bf22-04397410db0f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:30.724194 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f289d18f-d0f4-49bf-bf22-04397410db0f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:30.724633 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f289d18f-d0f4-49bf-bf22-04397410db0f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:30.866860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f289d18f-d0f4-49bf-bf22-04397410db0f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:30.875026 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f289d18f-d0f4-49bf-bf22-04397410db0f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1680 microversion: 2.1 time: 0.166055 Aug 27 03:53:30.875619 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3773/7362] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:30 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:31.897062 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-29497fae-7483-41aa-bda2-3d1377cd1ea2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:31.897737 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-29497fae-7483-41aa-bda2-3d1377cd1ea2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:31.904822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29497fae-7483-41aa-bda2-3d1377cd1ea2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:31.905332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29497fae-7483-41aa-bda2-3d1377cd1ea2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:31.905825 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29497fae-7483-41aa-bda2-3d1377cd1ea2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:31.906547 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29497fae-7483-41aa-bda2-3d1377cd1ea2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:31.907023 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29497fae-7483-41aa-bda2-3d1377cd1ea2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:31.907472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-29497fae-7483-41aa-bda2-3d1377cd1ea2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:32.042631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-29497fae-7483-41aa-bda2-3d1377cd1ea2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:32.050629 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-29497fae-7483-41aa-bda2-3d1377cd1ea2 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1683 microversion: 2.1 time: 0.157485 Aug 27 03:53:32.051211 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3590/7363] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:31 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:32.143669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5179d391-9e65-4450-b31f-00da1532db3d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:32.145939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5179d391-9e65-4450-b31f-00da1532db3d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:32.153385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5179d391-9e65-4450-b31f-00da1532db3d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:32.153841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5179d391-9e65-4450-b31f-00da1532db3d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:32.154290 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5179d391-9e65-4450-b31f-00da1532db3d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:32.154999 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5179d391-9e65-4450-b31f-00da1532db3d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:32.155463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5179d391-9e65-4450-b31f-00da1532db3d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:32.155924 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5179d391-9e65-4450-b31f-00da1532db3d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:32.200633 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5179d391-9e65-4450-b31f-00da1532db3d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "POST /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8/action" status: 200 len: 38388 microversion: 2.1 time: 0.060638 Aug 27 03:53:32.201288 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3774/7364] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:53:32 2022] POST /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8/action => generated 38388 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:53:33.186667 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-de8e0c25-bd6d-4605-89ad-fddfbfc1e87f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:33.187197 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de8e0c25-bd6d-4605-89ad-fddfbfc1e87f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:33.189192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-77fdc9fb-d9ee-4e48-920f-490c0ce8ad97 req-f7544b9c-8842-45c4-b690-65c91ff9511d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c22511-7fe1-423e-98b3-a54927f438f8", "tag": "dc7ab4c2-137f-4d37-aeb1-0b8b615187f6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:33.194456 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de8e0c25-bd6d-4605-89ad-fddfbfc1e87f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:33.195376 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de8e0c25-bd6d-4605-89ad-fddfbfc1e87f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:33.195991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de8e0c25-bd6d-4605-89ad-fddfbfc1e87f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:33.196731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de8e0c25-bd6d-4605-89ad-fddfbfc1e87f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:33.197207 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de8e0c25-bd6d-4605-89ad-fddfbfc1e87f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:33.198508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-de8e0c25-bd6d-4605-89ad-fddfbfc1e87f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:33.202253 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-77fdc9fb-d9ee-4e48-920f-490c0ce8ad97 req-f7544b9c-8842-45c4-b690-65c91ff9511d service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:33.202995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-77fdc9fb-d9ee-4e48-920f-490c0ce8ad97 req-f7544b9c-8842-45c4-b690-65c91ff9511d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:33.203438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-77fdc9fb-d9ee-4e48-920f-490c0ce8ad97 req-f7544b9c-8842-45c4-b690-65c91ff9511d service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:33.217544 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-77fdc9fb-d9ee-4e48-920f-490c0ce8ad97 req-f7544b9c-8842-45c4-b690-65c91ff9511d service nova] Creating event network-changed:dc7ab4c2-137f-4d37-aeb1-0b8b615187f6 for instance 00c22511-7fe1-423e-98b3-a54927f438f8 on n-h2-852084-5 Aug 27 03:53:33.222928 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-77fdc9fb-d9ee-4e48-920f-490c0ce8ad97 req-f7544b9c-8842-45c4-b690-65c91ff9511d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037755 Aug 27 03:53:33.223819 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3775/7365] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:33.226343 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-de8e0c25-bd6d-4605-89ad-fddfbfc1e87f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:53:33.313782 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-de8e0c25-bd6d-4605-89ad-fddfbfc1e87f tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "DELETE /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 204 len: 0 microversion: 2.1 time: 0.130973 Aug 27 03:53:33.315392 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3591/7366] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:53:33 2022] DELETE /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:53:33.325799 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b85df286-3272-4ca3-af3a-2eb814acd4d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:33.327329 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b85df286-3272-4ca3-af3a-2eb814acd4d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:33.334736 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b85df286-3272-4ca3-af3a-2eb814acd4d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:33.335643 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b85df286-3272-4ca3-af3a-2eb814acd4d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:33.336466 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b85df286-3272-4ca3-af3a-2eb814acd4d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:33.337797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b85df286-3272-4ca3-af3a-2eb814acd4d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:33.338500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b85df286-3272-4ca3-af3a-2eb814acd4d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:33.339151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b85df286-3272-4ca3-af3a-2eb814acd4d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:33.501890 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b85df286-3272-4ca3-af3a-2eb814acd4d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:33.510886 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b85df286-3272-4ca3-af3a-2eb814acd4d7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1689 microversion: 2.1 time: 0.190258 Aug 27 03:53:33.518489 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3776/7367] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:33 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:34.533449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-aa7a9bf1-d09e-4af6-bfa0-afd1770218f7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:34.534136 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-aa7a9bf1-d09e-4af6-bfa0-afd1770218f7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:34.540996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa7a9bf1-d09e-4af6-bfa0-afd1770218f7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:34.542134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa7a9bf1-d09e-4af6-bfa0-afd1770218f7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:34.542586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa7a9bf1-d09e-4af6-bfa0-afd1770218f7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:34.543309 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa7a9bf1-d09e-4af6-bfa0-afd1770218f7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:34.543780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa7a9bf1-d09e-4af6-bfa0-afd1770218f7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:34.544219 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-aa7a9bf1-d09e-4af6-bfa0-afd1770218f7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:34.688932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-aa7a9bf1-d09e-4af6-bfa0-afd1770218f7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:34.697962 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-aa7a9bf1-d09e-4af6-bfa0-afd1770218f7 tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1689 microversion: 2.1 time: 0.168215 Aug 27 03:53:34.698816 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3592/7368] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:34 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:35.385737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-4a8cfa20-42a7-4999-b348-23953eb68f70 req-6d087e8f-ab6d-47c8-bea9-7ed3d35de3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c22511-7fe1-423e-98b3-a54927f438f8", "name": "network-vif-deleted", "tag": "dc7ab4c2-137f-4d37-aeb1-0b8b615187f6"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:35.395758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4a8cfa20-42a7-4999-b348-23953eb68f70 req-6d087e8f-ab6d-47c8-bea9-7ed3d35de3a8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:35.396249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4a8cfa20-42a7-4999-b348-23953eb68f70 req-6d087e8f-ab6d-47c8-bea9-7ed3d35de3a8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:35.396687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-4a8cfa20-42a7-4999-b348-23953eb68f70 req-6d087e8f-ab6d-47c8-bea9-7ed3d35de3a8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:35.408542 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-4a8cfa20-42a7-4999-b348-23953eb68f70 req-6d087e8f-ab6d-47c8-bea9-7ed3d35de3a8 service nova] Creating event network-vif-deleted:dc7ab4c2-137f-4d37-aeb1-0b8b615187f6 for instance 00c22511-7fe1-423e-98b3-a54927f438f8 on n-h2-852084-5 Aug 27 03:53:35.413369 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-4a8cfa20-42a7-4999-b348-23953eb68f70 req-6d087e8f-ab6d-47c8-bea9-7ed3d35de3a8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031732 Aug 27 03:53:35.414009 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3777/7369] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:35.719776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:35.720415 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:35.727810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:35.728325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:35.729514 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:35.730345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:35.730952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:35.731406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:35.766863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:35.767292 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:35.767751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:35.768310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.objects.instance [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lazy-loading 'fault' on Instance uuid 00c22511-7fe1-423e-98b3-a54927f438f8 {{(pid=122487) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:53:35.816948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7d61a4dd7b64c65b9743f9f3b0d3aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6a3a135de4feb8541658376863195', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:35.825643 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-6aa54bed-0943-4be8-8e94-1252ae75952b tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 200 len: 1356 microversion: 2.1 time: 0.109945 Aug 27 03:53:35.826418 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3593/7370] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:35 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:36.849915 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:36.850546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] [instance: 00c22511-7fe1-423e-98b3-a54927f438f8] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:36.857278 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:36.857794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:36.858296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:36.859001 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:36.859456 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:36.859888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:36.874008 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.wsgi [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] HTTP exception thrown: Instance 00c22511-7fe1-423e-98b3-a54927f438f8 could not be found. Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Request method failure captured: Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: request: GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 HTTP/1.1 Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: Accept: application/json Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: Accept-Encoding: identity Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: Connection: close Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: Content-Length: 0 Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: Content-Type: application/json Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: Host: 10.222.0.99 Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: Openstack-System-Scope: None Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: User-Agent: python-urllib3/1.26.11 Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Auth-Token: gAAAAABjCZN8cUgbiN4jgbPGTVOnhXBTDRmGKc9TyWokgNVlUuhNsxgycX61xbACtrSelhVLFuDHDnMZajNNVM_Hr6ZS6h8ad21L06WPxjymJt8L-tJGxk5LXZkiJxOpgJBiULt4nkeFJydoyPTZwXXBxmeCLfLrgQwO_5KT--2T1aZJG-NqXWw Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Id: None Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Domain-Name: None Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Identity-Status: Confirmed Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Is-Admin-Project: True Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Id: default Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Domain-Name: Default Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Id: 57b6a3a135de4feb8541658376863195 Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Role: member,reader Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Roles: member,reader Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_57b6a3a135de4feb8541658376863195"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/57b6a3a135de4feb8541658376863195"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/57b6a3a135de4feb8541658376863195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/57b6a3a135de4feb8541658376863195"}]}] Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Id: 57b6a3a135de4feb8541658376863195 Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1128889267 Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-User: tempest-TestNetworkAdvancedServerOps-1128889267-project Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Id: default Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-User-Domain-Name: Default Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-User-Id: b7d61a4dd7b64c65b9743f9f3b0d3aad Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1128889267-project Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: method: > Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: exception: Instance 00c22511-7fe1-423e-98b3-a54927f438f8 could not be found. Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: action_args: {'id': '00c22511-7fe1-423e-98b3-a54927f438f8'} Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c22511-7fe1-423e-98b3-a54927f438f8 could not be found. Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c22511-7fe1-423e-98b3-a54927f438f8 could not be found. Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:53:36.875647 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:53:36.880493 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:53:36.880493 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:53:36.880493 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:53:36.880493 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:53:36.880493 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:53:36.880493 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:53:36.880493 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c22511-7fe1-423e-98b3-a54927f438f8 could not be found. Aug 27 03:53:36.880493 n-d-852084-5 devstack@n-api.service[122488]: ERROR nova.api.openstack.wsgi Aug 27 03:53:36.880493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Returning 404 to user: Instance 00c22511-7fe1-423e-98b3-a54927f438f8 could not be found. {{(pid=122488) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:53:36.880493 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-622074e0-6c5d-4eb6-92dd-31a1cea6bd8d tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8" status: 404 len: 111 microversion: 2.1 time: 0.032516 Aug 27 03:53:36.880493 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3778/7371] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:36 2022] GET /compute/v2.1/servers/00c22511-7fe1-423e-98b3-a54927f438f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:53:40.235230 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-706d249b-3f5d-4990-bdd1-cec0df3861df tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] Calling method '.version_select at 0x7f4d29e07a60>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:40.256748 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-706d249b-3f5d-4990-bdd1-cec0df3861df tempest-TestNetworkAdvancedServerOps-1128889267 tempest-TestNetworkAdvancedServerOps-1128889267-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1140406824" status: 202 len: 0 microversion: 2.1 time: 0.025298 Aug 27 03:53:40.257384 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3594/7372] 10.222.0.99 () {58 vars in 1284 bytes} [Sat Aug 27 03:53:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1140406824 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:53:51.444928 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=18 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:51.445900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:51.700270 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab500329-cae1-49e8-b1f6-210a4d28d12b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Action: 'create', calling method: .version_select at 0x7f4d2a270dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1874809448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+i4lXYDXN+1L/OKb4gmLFVsW9aqnNnzjufLP5sRPnsDYqxU0DbETa/ZiMMqSDPBBJOs+o3Lw8vp1phBLB+6XsutqTyPd2eq+HWCMOyFKafzQ+7yv2LKfT+R4vZc/UOMg=="}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:51.728013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-ab500329-cae1-49e8-b1f6-210a4d28d12b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Getting quotas for project 121b03bce5744ea9aded67cc1c5c277b. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:53:51.735123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-ab500329-cae1-49e8-b1f6-210a4d28d12b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Getting quotas for user 0f30e9b469854f43a1f4ae22ae8fe4e9 and project 121b03bce5744ea9aded67cc1c5c277b. Resources: {'key_pairs'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:53:51.764456 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab500329-cae1-49e8-b1f6-210a4d28d12b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.326587 Aug 27 03:53:51.765473 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3779/7373] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:53:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:53.056850 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:53.057778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:53:53.062747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-805908894", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1874809448", "security_groups": [{"name": "tempest-secgroup-smoke-1602219552"}], "networks": [{"uuid": "0230878e-d753-49b1-b5df-bed24a3be224"}]}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:53.176736 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.network.neutron [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] validate_networks() for [('0230878e-d753-49b1-b5df-bed24a3be224', None, None, None, None, None)] {{(pid=122487) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:53:53.570349 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Flavor limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:53:53.571117 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Image limits 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:53:53.571772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Flavor pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:53:53.572479 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Image pref 0:0:0 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:53:53.572985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.virt.hardware [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122487) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:53:53.583650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:53.584931 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:53.585564 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:53.586522 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:53.587176 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:53.587785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:53.610175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Getting quotas for project 121b03bce5744ea9aded67cc1c5c277b. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:53:53.614244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Getting quotas for user 0f30e9b469854f43a1f4ae22ae8fe4e9 and project 121b03bce5744ea9aded67cc1c5c277b. Resources: {'cores', 'ram', 'instances'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:53:53.627921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Going to run 1 instances... {{(pid=122487) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:53:53.630492 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122487) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:53:53.677751 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-729e13f0-e1b2-4443-a857-97025b49cb74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.622739 Aug 27 03:53:53.678710 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3595/7374] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:53:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:53:53.690069 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bce8f69b-6c58-42cb-bc24-a2968da2ac10 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:53.690699 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bce8f69b-6c58-42cb-bc24-a2968da2ac10 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:53.760162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bce8f69b-6c58-42cb-bc24-a2968da2ac10 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:53.767567 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bce8f69b-6c58-42cb-bc24-a2968da2ac10 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1246 microversion: 2.1 time: 0.081825 Aug 27 03:53:53.768161 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3780/7375] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:53 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:54.789638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7f1bac7f-7b0d-404f-a28a-8c1bb2189d4e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:54.790335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7f1bac7f-7b0d-404f-a28a-8c1bb2189d4e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:54.798255 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f1bac7f-7b0d-404f-a28a-8c1bb2189d4e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:54.798784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f1bac7f-7b0d-404f-a28a-8c1bb2189d4e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:54.799216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f1bac7f-7b0d-404f-a28a-8c1bb2189d4e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:54.799983 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f1bac7f-7b0d-404f-a28a-8c1bb2189d4e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:54.800464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f1bac7f-7b0d-404f-a28a-8c1bb2189d4e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:54.800907 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7f1bac7f-7b0d-404f-a28a-8c1bb2189d4e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:54.906142 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7f1bac7f-7b0d-404f-a28a-8c1bb2189d4e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:54.916924 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7f1bac7f-7b0d-404f-a28a-8c1bb2189d4e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1298 microversion: 2.1 time: 0.132056 Aug 27 03:53:54.928354 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3596/7376] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:54 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1298 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:55.939798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-71593366-8ff8-46db-bf49-3c05d46640da tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:55.939798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-71593366-8ff8-46db-bf49-3c05d46640da tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:55.948559 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71593366-8ff8-46db-bf49-3c05d46640da tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:55.949057 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71593366-8ff8-46db-bf49-3c05d46640da tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:55.949510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71593366-8ff8-46db-bf49-3c05d46640da tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:55.950260 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71593366-8ff8-46db-bf49-3c05d46640da tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:55.950837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71593366-8ff8-46db-bf49-3c05d46640da tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:55.951284 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-71593366-8ff8-46db-bf49-3c05d46640da tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:56.099886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-71593366-8ff8-46db-bf49-3c05d46640da tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:56.107687 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-71593366-8ff8-46db-bf49-3c05d46640da tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1372 microversion: 2.1 time: 0.172550 Aug 27 03:53:56.108257 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3781/7377] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:55 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:53:56.341650 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-99e3cea3-732c-4fdd-9c82-7b7390120cef req-801cd863-027c-4828-b34a-b23e4555aa5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f41d62a-f6a8-4071-8f44-7dee03a2775b", "tag": "ccbdf8b4-e281-4f21-abc7-33c2caf66dd7"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:53:56.352545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99e3cea3-732c-4fdd-9c82-7b7390120cef req-801cd863-027c-4828-b34a-b23e4555aa5c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:56.353608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99e3cea3-732c-4fdd-9c82-7b7390120cef req-801cd863-027c-4828-b34a-b23e4555aa5c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:56.354092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-99e3cea3-732c-4fdd-9c82-7b7390120cef req-801cd863-027c-4828-b34a-b23e4555aa5c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:56.366026 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-99e3cea3-732c-4fdd-9c82-7b7390120cef req-801cd863-027c-4828-b34a-b23e4555aa5c service nova] Creating event network-changed:ccbdf8b4-e281-4f21-abc7-33c2caf66dd7 for instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b on n-h2-852084-5 Aug 27 03:53:56.372135 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-99e3cea3-732c-4fdd-9c82-7b7390120cef req-801cd863-027c-4828-b34a-b23e4555aa5c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103660 Aug 27 03:53:56.372962 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3597/7378] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:53:57.128845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-59306848-c0c3-424d-9009-0505d6db420d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:57.129473 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-59306848-c0c3-424d-9009-0505d6db420d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:57.136434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59306848-c0c3-424d-9009-0505d6db420d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:57.137025 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59306848-c0c3-424d-9009-0505d6db420d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:57.137378 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59306848-c0c3-424d-9009-0505d6db420d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:57.138110 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59306848-c0c3-424d-9009-0505d6db420d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:57.138573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59306848-c0c3-424d-9009-0505d6db420d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:57.139010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-59306848-c0c3-424d-9009-0505d6db420d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:57.276785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-59306848-c0c3-424d-9009-0505d6db420d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:57.284658 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-59306848-c0c3-424d-9009-0505d6db420d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1372 microversion: 2.1 time: 0.159804 Aug 27 03:53:57.285250 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3782/7379] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:57 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:58.307058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-75d1adb2-fee3-445c-93bf-e03375fe5143 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:58.307698 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-75d1adb2-fee3-445c-93bf-e03375fe5143 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:58.313982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75d1adb2-fee3-445c-93bf-e03375fe5143 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:58.314478 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75d1adb2-fee3-445c-93bf-e03375fe5143 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:58.314926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75d1adb2-fee3-445c-93bf-e03375fe5143 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:58.315636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75d1adb2-fee3-445c-93bf-e03375fe5143 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:58.316103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75d1adb2-fee3-445c-93bf-e03375fe5143 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:58.316546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-75d1adb2-fee3-445c-93bf-e03375fe5143 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:58.450780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-75d1adb2-fee3-445c-93bf-e03375fe5143 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:58.465534 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-75d1adb2-fee3-445c-93bf-e03375fe5143 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1372 microversion: 2.1 time: 0.163767 Aug 27 03:53:58.466326 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3598/7380] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:58 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:53:59.487782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fd143964-5949-4088-80e0-30fd2947d37d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:53:59.488392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fd143964-5949-4088-80e0-30fd2947d37d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:53:59.496299 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd143964-5949-4088-80e0-30fd2947d37d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:59.496775 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd143964-5949-4088-80e0-30fd2947d37d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:59.497218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd143964-5949-4088-80e0-30fd2947d37d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:59.497949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd143964-5949-4088-80e0-30fd2947d37d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:53:59.498409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd143964-5949-4088-80e0-30fd2947d37d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:53:59.498840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fd143964-5949-4088-80e0-30fd2947d37d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:53:59.635800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fd143964-5949-4088-80e0-30fd2947d37d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:53:59.643644 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fd143964-5949-4088-80e0-30fd2947d37d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1372 microversion: 2.1 time: 0.160667 Aug 27 03:53:59.644262 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3783/7381] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:53:59 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:00.664770 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-14a7864c-495f-4af9-be01-5a62332e4ed6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:00.665389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-14a7864c-495f-4af9-be01-5a62332e4ed6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:00.672353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14a7864c-495f-4af9-be01-5a62332e4ed6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:00.672856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14a7864c-495f-4af9-be01-5a62332e4ed6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:00.673318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14a7864c-495f-4af9-be01-5a62332e4ed6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:00.674073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14a7864c-495f-4af9-be01-5a62332e4ed6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:00.674546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14a7864c-495f-4af9-be01-5a62332e4ed6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:00.674993 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-14a7864c-495f-4af9-be01-5a62332e4ed6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:00.816676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-14a7864c-495f-4af9-be01-5a62332e4ed6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:00.826262 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-14a7864c-495f-4af9-be01-5a62332e4ed6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1372 microversion: 2.1 time: 0.165348 Aug 27 03:54:00.827080 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3599/7382] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:00 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:01.848688 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-546f29d9-f93b-4bab-bd58-70a81b95a5a2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:01.849239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-546f29d9-f93b-4bab-bd58-70a81b95a5a2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:01.856282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-546f29d9-f93b-4bab-bd58-70a81b95a5a2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:01.856774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-546f29d9-f93b-4bab-bd58-70a81b95a5a2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:01.857222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-546f29d9-f93b-4bab-bd58-70a81b95a5a2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:01.857958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-546f29d9-f93b-4bab-bd58-70a81b95a5a2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:01.858421 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-546f29d9-f93b-4bab-bd58-70a81b95a5a2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:01.858858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-546f29d9-f93b-4bab-bd58-70a81b95a5a2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:01.995591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-546f29d9-f93b-4bab-bd58-70a81b95a5a2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:02.005301 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-546f29d9-f93b-4bab-bd58-70a81b95a5a2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1372 microversion: 2.1 time: 0.160315 Aug 27 03:54:02.006416 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3784/7383] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:01 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:02.632388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-1669ce06-49b3-4423-bcdc-afd39f51871e req-16c06b21-74e5-482e-a988-e4f5f27381b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f41d62a-f6a8-4071-8f44-7dee03a2775b", "name": "network-vif-plugged", "status": "completed", "tag": "ccbdf8b4-e281-4f21-abc7-33c2caf66dd7"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:02.645042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1669ce06-49b3-4423-bcdc-afd39f51871e req-16c06b21-74e5-482e-a988-e4f5f27381b8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:02.645546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1669ce06-49b3-4423-bcdc-afd39f51871e req-16c06b21-74e5-482e-a988-e4f5f27381b8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:02.646013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-1669ce06-49b3-4423-bcdc-afd39f51871e req-16c06b21-74e5-482e-a988-e4f5f27381b8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:02.661807 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-1669ce06-49b3-4423-bcdc-afd39f51871e req-16c06b21-74e5-482e-a988-e4f5f27381b8 service nova] Creating event network-vif-plugged:ccbdf8b4-e281-4f21-abc7-33c2caf66dd7 for instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b on n-h2-852084-5 Aug 27 03:54:02.667438 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-1669ce06-49b3-4423-bcdc-afd39f51871e req-16c06b21-74e5-482e-a988-e4f5f27381b8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039060 Aug 27 03:54:02.668054 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3600/7384] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:03.027711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-84a09058-3de4-4882-a907-2d5e669edcac tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:03.028240 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-84a09058-3de4-4882-a907-2d5e669edcac tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:03.035368 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84a09058-3de4-4882-a907-2d5e669edcac tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:03.035866 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84a09058-3de4-4882-a907-2d5e669edcac tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:03.036309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84a09058-3de4-4882-a907-2d5e669edcac tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:03.037081 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84a09058-3de4-4882-a907-2d5e669edcac tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:03.037548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84a09058-3de4-4882-a907-2d5e669edcac tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:03.038013 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-84a09058-3de4-4882-a907-2d5e669edcac tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:03.174331 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-84a09058-3de4-4882-a907-2d5e669edcac tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:03.182160 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-84a09058-3de4-4882-a907-2d5e669edcac tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1372 microversion: 2.1 time: 0.158978 Aug 27 03:54:03.182736 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3785/7385] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:03 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:04.201022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:04.201860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:04.207390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-63952ea6-9b4e-48e3-9dad-e73e85801101 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:04.208130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-63952ea6-9b4e-48e3-9dad-e73e85801101 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:04.215385 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63952ea6-9b4e-48e3-9dad-e73e85801101 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:04.215743 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63952ea6-9b4e-48e3-9dad-e73e85801101 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:04.216398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63952ea6-9b4e-48e3-9dad-e73e85801101 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:04.217150 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63952ea6-9b4e-48e3-9dad-e73e85801101 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:04.217899 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63952ea6-9b4e-48e3-9dad-e73e85801101 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:04.218335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-63952ea6-9b4e-48e3-9dad-e73e85801101 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:04.360776 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-63952ea6-9b4e-48e3-9dad-e73e85801101 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:04.368747 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-63952ea6-9b4e-48e3-9dad-e73e85801101 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1556 microversion: 2.1 time: 0.168872 Aug 27 03:54:04.369360 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3601/7386] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:04 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:04.388891 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5890f3ca-a49e-4a1b-913c-832d92a79f74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:04.390029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5890f3ca-a49e-4a1b-913c-832d92a79f74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:54:04.391426 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:54:04.397601 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5890f3ca-a49e-4a1b-913c-832d92a79f74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:04.398126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5890f3ca-a49e-4a1b-913c-832d92a79f74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:04.398572 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5890f3ca-a49e-4a1b-913c-832d92a79f74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:04.399282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5890f3ca-a49e-4a1b-913c-832d92a79f74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:04.400231 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5890f3ca-a49e-4a1b-913c-832d92a79f74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:04.400875 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5890f3ca-a49e-4a1b-913c-832d92a79f74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:04.531241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5890f3ca-a49e-4a1b-913c-832d92a79f74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:54:04.539132 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5890f3ca-a49e-4a1b-913c-832d92a79f74 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1556 microversion: 2.1 time: 0.154066 Aug 27 03:54:04.539684 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3786/7387] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:54:04 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:54:06.532423 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-4d4e79ed-e01b-4b7b-9dfe-3984361f2ce2 req-92edccba-22c1-4c96-83ca-e16e13092ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f41d62a-f6a8-4071-8f44-7dee03a2775b", "tag": "ccbdf8b4-e281-4f21-abc7-33c2caf66dd7"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:54:06.543700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4d4e79ed-e01b-4b7b-9dfe-3984361f2ce2 req-92edccba-22c1-4c96-83ca-e16e13092ce8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:54:06.544274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4d4e79ed-e01b-4b7b-9dfe-3984361f2ce2 req-92edccba-22c1-4c96-83ca-e16e13092ce8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:54:06.544785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-4d4e79ed-e01b-4b7b-9dfe-3984361f2ce2 req-92edccba-22c1-4c96-83ca-e16e13092ce8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:54:06.556815 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-4d4e79ed-e01b-4b7b-9dfe-3984361f2ce2 req-92edccba-22c1-4c96-83ca-e16e13092ce8 service nova] Creating event network-changed:ccbdf8b4-e281-4f21-abc7-33c2caf66dd7 for instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b on n-h2-852084-5 Aug 27 03:54:06.561869 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-4d4e79ed-e01b-4b7b-9dfe-3984361f2ce2 req-92edccba-22c1-4c96-83ca-e16e13092ce8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033301 Aug 27 03:54:06.562477 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3602/7388] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:01.791008 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2a984f1-fecc-4493-b1c3-f7a871d4cd60] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:56:01.791854 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dce2f75-e4fe-43f3-8eba-2057b586517f] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 03:56:01.792375 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:01.793189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=36 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:01.794940 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 03:56:01.795196 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 03:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b/action (ip 10.222.0.99) !!! Aug 27 03:56:01.800207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eb4eca0c-a62e-40d2-8ba4-cabb0af3fa1d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:01.800753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eb4eca0c-a62e-40d2-8ba4-cabb0af3fa1d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:01.812038 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4eca0c-a62e-40d2-8ba4-cabb0af3fa1d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:01.812528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4eca0c-a62e-40d2-8ba4-cabb0af3fa1d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:01.812977 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4eca0c-a62e-40d2-8ba4-cabb0af3fa1d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:01.814224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4eca0c-a62e-40d2-8ba4-cabb0af3fa1d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:01.814693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4eca0c-a62e-40d2-8ba4-cabb0af3fa1d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:01.815127 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eb4eca0c-a62e-40d2-8ba4-cabb0af3fa1d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:01.839266 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-eb4eca0c-a62e-40d2-8ba4-cabb0af3fa1d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lazy-loading 'flavor' on Instance uuid 1f41d62a-f6a8-4071-8f44-7dee03a2775b {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 03:56:02.121549 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eb4eca0c-a62e-40d2-8ba4-cabb0af3fa1d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "POST /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b/action" status: 202 len: 0 microversion: 2.1 time: 0.332420 Aug 27 03:56:02.122232 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3787/7389] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:56:01 2022] POST /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:56:02.129490 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:56:02.130361 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:56:02.130982 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:02.131966 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=32 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:02.133483 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 03:56:02.133746 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 03:56:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b (ip 10.222.0.99) !!! Aug 27 03:56:02.140512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f9cc4fe7-9411-4a8f-b9ff-8638c41355ba tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:02.141243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f9cc4fe7-9411-4a8f-b9ff-8638c41355ba tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:02.152122 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9cc4fe7-9411-4a8f-b9ff-8638c41355ba tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:02.152636 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9cc4fe7-9411-4a8f-b9ff-8638c41355ba tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:02.153075 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9cc4fe7-9411-4a8f-b9ff-8638c41355ba tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:02.153823 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9cc4fe7-9411-4a8f-b9ff-8638c41355ba tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:02.154296 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9cc4fe7-9411-4a8f-b9ff-8638c41355ba tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:02.154740 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f9cc4fe7-9411-4a8f-b9ff-8638c41355ba tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:02.356755 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f9cc4fe7-9411-4a8f-b9ff-8638c41355ba tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:02.364627 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f9cc4fe7-9411-4a8f-b9ff-8638c41355ba tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1681 microversion: 2.1 time: 0.237655 Aug 27 03:56:02.365136 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3603/7390] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:02 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1681 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:03.390853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b0b44b3b-1f55-4459-8c75-0dc324a3417b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:03.391655 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b0b44b3b-1f55-4459-8c75-0dc324a3417b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:03.401438 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0b44b3b-1f55-4459-8c75-0dc324a3417b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:03.402295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0b44b3b-1f55-4459-8c75-0dc324a3417b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:03.403035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0b44b3b-1f55-4459-8c75-0dc324a3417b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:03.404181 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0b44b3b-1f55-4459-8c75-0dc324a3417b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:03.404882 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0b44b3b-1f55-4459-8c75-0dc324a3417b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:03.405454 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b0b44b3b-1f55-4459-8c75-0dc324a3417b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:03.414077 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2a984f1-fecc-4493-b1c3-f7a871d4cd60] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 54824. Aug 27 03:56:03.414804 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dce2f75-e4fe-43f3-8eba-2057b586517f] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 54826. Aug 27 03:56:03.558757 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b0b44b3b-1f55-4459-8c75-0dc324a3417b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:03.567469 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b0b44b3b-1f55-4459-8c75-0dc324a3417b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1681 microversion: 2.1 time: 0.185054 Aug 27 03:56:03.568069 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3788/7391] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:03 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:04.588612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-eb3298e0-f54d-437c-b8d6-adab55b7ffa5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:04.589245 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-eb3298e0-f54d-437c-b8d6-adab55b7ffa5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:04.598905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3298e0-f54d-437c-b8d6-adab55b7ffa5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:04.599410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3298e0-f54d-437c-b8d6-adab55b7ffa5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:04.599864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3298e0-f54d-437c-b8d6-adab55b7ffa5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:04.600577 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3298e0-f54d-437c-b8d6-adab55b7ffa5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:04.601047 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3298e0-f54d-437c-b8d6-adab55b7ffa5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:04.601487 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-eb3298e0-f54d-437c-b8d6-adab55b7ffa5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:04.609052 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 54832. Aug 27 03:56:04.609805 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 54834. Aug 27 03:56:04.741973 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-eb3298e0-f54d-437c-b8d6-adab55b7ffa5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:04.749818 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-eb3298e0-f54d-437c-b8d6-adab55b7ffa5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1681 microversion: 2.1 time: 0.165171 Aug 27 03:56:04.750398 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3604/7392] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:04 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:05.771256 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cfb91361-7080-4b8d-b9e8-6b2322ce506f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:05.771797 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cfb91361-7080-4b8d-b9e8-6b2322ce506f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:05.778695 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfb91361-7080-4b8d-b9e8-6b2322ce506f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:05.779341 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfb91361-7080-4b8d-b9e8-6b2322ce506f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:05.779784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfb91361-7080-4b8d-b9e8-6b2322ce506f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:05.780486 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfb91361-7080-4b8d-b9e8-6b2322ce506f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:05.780936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfb91361-7080-4b8d-b9e8-6b2322ce506f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:05.781362 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cfb91361-7080-4b8d-b9e8-6b2322ce506f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:05.918482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cfb91361-7080-4b8d-b9e8-6b2322ce506f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:05.926359 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cfb91361-7080-4b8d-b9e8-6b2322ce506f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1681 microversion: 2.1 time: 0.159166 Aug 27 03:56:05.926949 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3789/7393] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:05 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:06.947903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-65f71708-ccf1-4ad6-9dad-6e8ed30dc018 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:06.948543 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-65f71708-ccf1-4ad6-9dad-6e8ed30dc018 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:06.955871 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f71708-ccf1-4ad6-9dad-6e8ed30dc018 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:06.956374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f71708-ccf1-4ad6-9dad-6e8ed30dc018 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:06.956833 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f71708-ccf1-4ad6-9dad-6e8ed30dc018 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:06.957544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f71708-ccf1-4ad6-9dad-6e8ed30dc018 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:06.958055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f71708-ccf1-4ad6-9dad-6e8ed30dc018 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:06.958501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-65f71708-ccf1-4ad6-9dad-6e8ed30dc018 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:07.091244 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-65f71708-ccf1-4ad6-9dad-6e8ed30dc018 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:07.099890 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-65f71708-ccf1-4ad6-9dad-6e8ed30dc018 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1681 microversion: 2.1 time: 0.155960 Aug 27 03:56:07.100470 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3605/7394] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:06 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:08.121745 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-eca21fb6-4e05-42d0-8270-b5df6186ba27 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:08.122369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-eca21fb6-4e05-42d0-8270-b5df6186ba27 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:08.129937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eca21fb6-4e05-42d0-8270-b5df6186ba27 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:08.130429 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eca21fb6-4e05-42d0-8270-b5df6186ba27 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:08.130874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eca21fb6-4e05-42d0-8270-b5df6186ba27 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:08.131574 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eca21fb6-4e05-42d0-8270-b5df6186ba27 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:08.132031 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eca21fb6-4e05-42d0-8270-b5df6186ba27 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:08.132459 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-eca21fb6-4e05-42d0-8270-b5df6186ba27 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:08.269947 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-eca21fb6-4e05-42d0-8270-b5df6186ba27 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:08.278119 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-eca21fb6-4e05-42d0-8270-b5df6186ba27 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1681 microversion: 2.1 time: 0.160259 Aug 27 03:56:08.278715 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3790/7395] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:08 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:09.300544 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7bc4546b-bad7-4e68-9620-b502e4ca4db0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:09.301174 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7bc4546b-bad7-4e68-9620-b502e4ca4db0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:09.308240 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bc4546b-bad7-4e68-9620-b502e4ca4db0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:09.308744 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bc4546b-bad7-4e68-9620-b502e4ca4db0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:09.309202 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bc4546b-bad7-4e68-9620-b502e4ca4db0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:09.309972 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bc4546b-bad7-4e68-9620-b502e4ca4db0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:09.310444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bc4546b-bad7-4e68-9620-b502e4ca4db0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:09.310890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7bc4546b-bad7-4e68-9620-b502e4ca4db0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:09.445786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7bc4546b-bad7-4e68-9620-b502e4ca4db0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:09.453582 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7bc4546b-bad7-4e68-9620-b502e4ca4db0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1681 microversion: 2.1 time: 0.157598 Aug 27 03:56:09.454191 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3606/7396] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:09 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:10.476436 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6ee7e707-1f96-4b67-837d-c8defc091d4c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:10.477053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6ee7e707-1f96-4b67-837d-c8defc091d4c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:10.483987 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee7e707-1f96-4b67-837d-c8defc091d4c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:10.484472 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee7e707-1f96-4b67-837d-c8defc091d4c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:10.484911 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee7e707-1f96-4b67-837d-c8defc091d4c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:10.485607 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee7e707-1f96-4b67-837d-c8defc091d4c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:10.486122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee7e707-1f96-4b67-837d-c8defc091d4c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:10.486552 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6ee7e707-1f96-4b67-837d-c8defc091d4c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:10.619483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6ee7e707-1f96-4b67-837d-c8defc091d4c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:10.627977 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6ee7e707-1f96-4b67-837d-c8defc091d4c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1681 microversion: 2.1 time: 0.155432 Aug 27 03:56:10.628555 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3791/7397] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:10 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:11.648432 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3041dd43-bff9-458c-9f85-13dc982484fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:11.648964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3041dd43-bff9-458c-9f85-13dc982484fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:11.655840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3041dd43-bff9-458c-9f85-13dc982484fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:11.656337 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3041dd43-bff9-458c-9f85-13dc982484fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:11.656786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3041dd43-bff9-458c-9f85-13dc982484fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:11.657593 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3041dd43-bff9-458c-9f85-13dc982484fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:11.657981 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3041dd43-bff9-458c-9f85-13dc982484fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:11.658417 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3041dd43-bff9-458c-9f85-13dc982484fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:11.799528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3041dd43-bff9-458c-9f85-13dc982484fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:11.807430 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3041dd43-bff9-458c-9f85-13dc982484fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1681 microversion: 2.1 time: 0.162992 Aug 27 03:56:11.808006 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3607/7398] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:11 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:12.828562 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-106c9a70-8e83-48b1-8387-a62ffc4a2578 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:12.829423 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-106c9a70-8e83-48b1-8387-a62ffc4a2578 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:12.836124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-106c9a70-8e83-48b1-8387-a62ffc4a2578 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:12.836612 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-106c9a70-8e83-48b1-8387-a62ffc4a2578 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:12.837053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-106c9a70-8e83-48b1-8387-a62ffc4a2578 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:12.837779 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-106c9a70-8e83-48b1-8387-a62ffc4a2578 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:12.838239 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-106c9a70-8e83-48b1-8387-a62ffc4a2578 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:12.838673 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-106c9a70-8e83-48b1-8387-a62ffc4a2578 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:12.976393 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-106c9a70-8e83-48b1-8387-a62ffc4a2578 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:12.984230 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-106c9a70-8e83-48b1-8387-a62ffc4a2578 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1702 microversion: 2.1 time: 0.159694 Aug 27 03:56:12.984807 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3792/7399] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:12 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:14.006383 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-5a31070e-98cc-4590-8d3d-3e058a32edd3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:14.007040 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-5a31070e-98cc-4590-8d3d-3e058a32edd3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:14.014116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31070e-98cc-4590-8d3d-3e058a32edd3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:14.014619 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31070e-98cc-4590-8d3d-3e058a32edd3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:14.015078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31070e-98cc-4590-8d3d-3e058a32edd3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:14.015789 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31070e-98cc-4590-8d3d-3e058a32edd3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:14.016258 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31070e-98cc-4590-8d3d-3e058a32edd3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:14.016704 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-5a31070e-98cc-4590-8d3d-3e058a32edd3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:14.147996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-5a31070e-98cc-4590-8d3d-3e058a32edd3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:14.155713 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-5a31070e-98cc-4590-8d3d-3e058a32edd3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1702 microversion: 2.1 time: 0.153375 Aug 27 03:56:14.156282 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3608/7400] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:14 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1702 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:15.178096 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-87c1adfa-0482-4401-8569-1be57414132f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:15.178729 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-87c1adfa-0482-4401-8569-1be57414132f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:15.185427 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87c1adfa-0482-4401-8569-1be57414132f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:15.186186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87c1adfa-0482-4401-8569-1be57414132f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:15.186801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87c1adfa-0482-4401-8569-1be57414132f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:15.187687 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87c1adfa-0482-4401-8569-1be57414132f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:15.188312 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87c1adfa-0482-4401-8569-1be57414132f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:15.188737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-87c1adfa-0482-4401-8569-1be57414132f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:15.372946 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-87c1adfa-0482-4401-8569-1be57414132f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:15.382354 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-87c1adfa-0482-4401-8569-1be57414132f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1697 microversion: 2.1 time: 0.208924 Aug 27 03:56:15.383637 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3793/7401] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:15 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1697 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:16.404581 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-835dad11-f3df-474a-8aed-f1fba3428c15 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:16.405442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-835dad11-f3df-474a-8aed-f1fba3428c15 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:16.413503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-835dad11-f3df-474a-8aed-f1fba3428c15 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:16.414151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-835dad11-f3df-474a-8aed-f1fba3428c15 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:16.414682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-835dad11-f3df-474a-8aed-f1fba3428c15 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:16.415518 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-835dad11-f3df-474a-8aed-f1fba3428c15 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:16.416059 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-835dad11-f3df-474a-8aed-f1fba3428c15 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:16.416573 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-835dad11-f3df-474a-8aed-f1fba3428c15 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:16.566360 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-835dad11-f3df-474a-8aed-f1fba3428c15 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:16.577723 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-835dad11-f3df-474a-8aed-f1fba3428c15 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1697 microversion: 2.1 time: 0.176983 Aug 27 03:56:16.592021 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3609/7402] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:16 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:17.348500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-88d0f59d-54ac-4ebc-834a-50f037de83d9 req-9021241e-579a-4a37-89a1-5c9aa7bc41c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f41d62a-f6a8-4071-8f44-7dee03a2775b", "name": "network-vif-plugged", "status": "completed", "tag": "ccbdf8b4-e281-4f21-abc7-33c2caf66dd7"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:17.359784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-88d0f59d-54ac-4ebc-834a-50f037de83d9 req-9021241e-579a-4a37-89a1-5c9aa7bc41c1 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:17.360533 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-88d0f59d-54ac-4ebc-834a-50f037de83d9 req-9021241e-579a-4a37-89a1-5c9aa7bc41c1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:17.361616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-88d0f59d-54ac-4ebc-834a-50f037de83d9 req-9021241e-579a-4a37-89a1-5c9aa7bc41c1 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:17.378939 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-88d0f59d-54ac-4ebc-834a-50f037de83d9 req-9021241e-579a-4a37-89a1-5c9aa7bc41c1 service nova] Creating event network-vif-plugged:ccbdf8b4-e281-4f21-abc7-33c2caf66dd7 for instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b on n-h2-852084-5 Aug 27 03:56:17.392927 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-88d0f59d-54ac-4ebc-834a-50f037de83d9 req-9021241e-579a-4a37-89a1-5c9aa7bc41c1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119016 Aug 27 03:56:17.394130 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3794/7403] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:17.612657 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7aa5f167-fb55-44b6-aaf1-560f1061cdbc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:17.613233 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7aa5f167-fb55-44b6-aaf1-560f1061cdbc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:17.620724 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aa5f167-fb55-44b6-aaf1-560f1061cdbc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:17.621229 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aa5f167-fb55-44b6-aaf1-560f1061cdbc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:17.621709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aa5f167-fb55-44b6-aaf1-560f1061cdbc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:17.622433 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aa5f167-fb55-44b6-aaf1-560f1061cdbc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:17.622904 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aa5f167-fb55-44b6-aaf1-560f1061cdbc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:17.623350 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7aa5f167-fb55-44b6-aaf1-560f1061cdbc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:17.777098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7aa5f167-fb55-44b6-aaf1-560f1061cdbc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:17.785853 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7aa5f167-fb55-44b6-aaf1-560f1061cdbc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1697 microversion: 2.1 time: 0.185493 Aug 27 03:56:17.801162 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3610/7404] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:17 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:18.809628 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-174c7471-30d9-4945-88c2-f5f539260c02 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:18.811076 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-174c7471-30d9-4945-88c2-f5f539260c02 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:18.818613 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-174c7471-30d9-4945-88c2-f5f539260c02 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:18.819217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-174c7471-30d9-4945-88c2-f5f539260c02 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:18.819740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-174c7471-30d9-4945-88c2-f5f539260c02 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:18.820461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-174c7471-30d9-4945-88c2-f5f539260c02 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:18.820925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-174c7471-30d9-4945-88c2-f5f539260c02 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:18.821363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-174c7471-30d9-4945-88c2-f5f539260c02 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:18.964754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-174c7471-30d9-4945-88c2-f5f539260c02 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:18.977172 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-174c7471-30d9-4945-88c2-f5f539260c02 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1697 microversion: 2.1 time: 0.172893 Aug 27 03:56:18.978559 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3795/7405] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:18 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:20.007198 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9e732a5b-42e6-4b2f-b48b-e4b380024dfc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:20.008025 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9e732a5b-42e6-4b2f-b48b-e4b380024dfc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:20.015578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e732a5b-42e6-4b2f-b48b-e4b380024dfc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:20.016126 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e732a5b-42e6-4b2f-b48b-e4b380024dfc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:20.016586 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e732a5b-42e6-4b2f-b48b-e4b380024dfc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:20.017898 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e732a5b-42e6-4b2f-b48b-e4b380024dfc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:20.018375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e732a5b-42e6-4b2f-b48b-e4b380024dfc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:20.018817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9e732a5b-42e6-4b2f-b48b-e4b380024dfc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:20.179448 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9e732a5b-42e6-4b2f-b48b-e4b380024dfc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:20.192677 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9e732a5b-42e6-4b2f-b48b-e4b380024dfc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1697 microversion: 2.1 time: 0.189925 Aug 27 03:56:20.193285 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3611/7406] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:20 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:21.216896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-763fc6fb-9060-423a-8c12-c1fcdc8201d4 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:21.218379 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-763fc6fb-9060-423a-8c12-c1fcdc8201d4 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:21.229573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-763fc6fb-9060-423a-8c12-c1fcdc8201d4 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:21.230104 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-763fc6fb-9060-423a-8c12-c1fcdc8201d4 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:21.230543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-763fc6fb-9060-423a-8c12-c1fcdc8201d4 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:21.231255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-763fc6fb-9060-423a-8c12-c1fcdc8201d4 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:21.231842 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-763fc6fb-9060-423a-8c12-c1fcdc8201d4 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:21.232306 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-763fc6fb-9060-423a-8c12-c1fcdc8201d4 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:21.397041 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-763fc6fb-9060-423a-8c12-c1fcdc8201d4 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:21.405383 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-763fc6fb-9060-423a-8c12-c1fcdc8201d4 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1697 microversion: 2.1 time: 0.192645 Aug 27 03:56:21.409747 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3796/7407] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:21 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:22.429078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-62ab9fca-08b1-48bb-87a1-f30fe7788830 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:22.430548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-62ab9fca-08b1-48bb-87a1-f30fe7788830 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:22.438098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62ab9fca-08b1-48bb-87a1-f30fe7788830 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:22.438977 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62ab9fca-08b1-48bb-87a1-f30fe7788830 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:22.439681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62ab9fca-08b1-48bb-87a1-f30fe7788830 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:22.440651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62ab9fca-08b1-48bb-87a1-f30fe7788830 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:22.441398 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62ab9fca-08b1-48bb-87a1-f30fe7788830 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:22.441944 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-62ab9fca-08b1-48bb-87a1-f30fe7788830 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:22.591611 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-62ab9fca-08b1-48bb-87a1-f30fe7788830 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:22.600722 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-62ab9fca-08b1-48bb-87a1-f30fe7788830 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1697 microversion: 2.1 time: 0.175358 Aug 27 03:56:22.613696 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3612/7408] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:22 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:23.623596 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95cf065c-f727-4a80-b70e-48527e879a6a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:23.624195 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-95cf065c-f727-4a80-b70e-48527e879a6a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:23.632122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95cf065c-f727-4a80-b70e-48527e879a6a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:23.632740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95cf065c-f727-4a80-b70e-48527e879a6a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:23.633268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95cf065c-f727-4a80-b70e-48527e879a6a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:23.634055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95cf065c-f727-4a80-b70e-48527e879a6a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:23.634538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95cf065c-f727-4a80-b70e-48527e879a6a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:23.634959 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95cf065c-f727-4a80-b70e-48527e879a6a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:23.775458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-95cf065c-f727-4a80-b70e-48527e879a6a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:23.783421 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-95cf065c-f727-4a80-b70e-48527e879a6a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1697 microversion: 2.1 time: 0.163971 Aug 27 03:56:23.784020 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3797/7409] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:23 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:24.804539 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-83e28b13-62d5-4ce6-b281-12a54e7ecead tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:24.805079 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-83e28b13-62d5-4ce6-b281-12a54e7ecead tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:24.812393 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83e28b13-62d5-4ce6-b281-12a54e7ecead tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:24.812894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83e28b13-62d5-4ce6-b281-12a54e7ecead tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:24.813399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83e28b13-62d5-4ce6-b281-12a54e7ecead tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:24.814684 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83e28b13-62d5-4ce6-b281-12a54e7ecead tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:24.815158 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83e28b13-62d5-4ce6-b281-12a54e7ecead tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:24.815601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-83e28b13-62d5-4ce6-b281-12a54e7ecead tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:24.957027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-83e28b13-62d5-4ce6-b281-12a54e7ecead tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:24.964965 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-83e28b13-62d5-4ce6-b281-12a54e7ecead tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1679 microversion: 2.1 time: 0.164464 Aug 27 03:56:24.965583 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3613/7410] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:24 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:25.986784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7734cb38-ce86-4e22-bdf2-a99ca6456191 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:25.987412 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7734cb38-ce86-4e22-bdf2-a99ca6456191 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:25.994549 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7734cb38-ce86-4e22-bdf2-a99ca6456191 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:25.995045 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7734cb38-ce86-4e22-bdf2-a99ca6456191 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:25.995580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7734cb38-ce86-4e22-bdf2-a99ca6456191 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:25.996401 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7734cb38-ce86-4e22-bdf2-a99ca6456191 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:25.996865 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7734cb38-ce86-4e22-bdf2-a99ca6456191 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:25.997302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7734cb38-ce86-4e22-bdf2-a99ca6456191 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:26.130274 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7734cb38-ce86-4e22-bdf2-a99ca6456191 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:26.137987 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7734cb38-ce86-4e22-bdf2-a99ca6456191 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1679 microversion: 2.1 time: 0.155146 Aug 27 03:56:26.138578 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3798/7411] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:25 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:27.160915 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a7fe93f-dc08-4b53-8a6e-4d66e2900a12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:27.161542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1a7fe93f-dc08-4b53-8a6e-4d66e2900a12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:27.168718 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a7fe93f-dc08-4b53-8a6e-4d66e2900a12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:27.169221 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a7fe93f-dc08-4b53-8a6e-4d66e2900a12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:27.169689 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a7fe93f-dc08-4b53-8a6e-4d66e2900a12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:27.170442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a7fe93f-dc08-4b53-8a6e-4d66e2900a12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:27.170886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a7fe93f-dc08-4b53-8a6e-4d66e2900a12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:27.171329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a7fe93f-dc08-4b53-8a6e-4d66e2900a12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:27.304590 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1a7fe93f-dc08-4b53-8a6e-4d66e2900a12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:27.312650 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1a7fe93f-dc08-4b53-8a6e-4d66e2900a12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1622 microversion: 2.1 time: 0.156145 Aug 27 03:56:27.313234 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3614/7412] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:27 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1622 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:27.333957 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:27.334599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:27.342264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:27.342759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:27.343461 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:27.344175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:27.344641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:27.345746 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:27.437319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122488) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 03:56:27.502835 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [8b6afc38-b31e-4e9f-bc91-aae46f71aee6] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:56:28.509470 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [8b6afc38-b31e-4e9f-bc91-aae46f71aee6] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 54932. Aug 27 03:56:28.513110 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-723cae6a-0fb8-4bac-a34d-5666e5ae80c7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "POST /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b/action" status: 202 len: 0 microversion: 2.1 time: 1.184054 Aug 27 03:56:28.513768 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3799/7413] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 03:56:27 2022] POST /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b/action => generated 0 bytes in 1185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:56:28.522729 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-067a4441-8325-455a-bcdc-7f226f93e4d7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:28.523365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-067a4441-8325-455a-bcdc-7f226f93e4d7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:28.530313 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-067a4441-8325-455a-bcdc-7f226f93e4d7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:28.530827 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-067a4441-8325-455a-bcdc-7f226f93e4d7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:28.531272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-067a4441-8325-455a-bcdc-7f226f93e4d7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:28.532214 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-067a4441-8325-455a-bcdc-7f226f93e4d7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:28.532910 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-067a4441-8325-455a-bcdc-7f226f93e4d7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:28.533435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-067a4441-8325-455a-bcdc-7f226f93e4d7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:28.672220 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-067a4441-8325-455a-bcdc-7f226f93e4d7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:28.681130 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-067a4441-8325-455a-bcdc-7f226f93e4d7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1630 microversion: 2.1 time: 0.162412 Aug 27 03:56:28.681728 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3615/7414] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:28 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1630 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:29.258692 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-e12158e0-92c6-4bd2-8526-cc00b1614e24 req-1fb86148-b926-4962-8db2-db8e83171527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f41d62a-f6a8-4071-8f44-7dee03a2775b", "name": "network-vif-unplugged", "status": "completed", "tag": "ccbdf8b4-e281-4f21-abc7-33c2caf66dd7"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:29.270852 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e12158e0-92c6-4bd2-8526-cc00b1614e24 req-1fb86148-b926-4962-8db2-db8e83171527 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:29.271598 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e12158e0-92c6-4bd2-8526-cc00b1614e24 req-1fb86148-b926-4962-8db2-db8e83171527 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:29.272026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-e12158e0-92c6-4bd2-8526-cc00b1614e24 req-1fb86148-b926-4962-8db2-db8e83171527 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:29.283810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.compute.server_external_events [req-e12158e0-92c6-4bd2-8526-cc00b1614e24 req-1fb86148-b926-4962-8db2-db8e83171527 service nova] Unable to find a host for instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b. Dropping event network-vif-unplugged {{(pid=122488) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 03:56:29.285020 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-e12158e0-92c6-4bd2-8526-cc00b1614e24 req-1fb86148-b926-4962-8db2-db8e83171527 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030406 Aug 27 03:56:29.286187 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3800/7415] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 27 03:56:29.702921 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7e9adab3-5c7d-4200-8807-84a5d7b68b6d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:29.703552 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7e9adab3-5c7d-4200-8807-84a5d7b68b6d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:29.710443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e9adab3-5c7d-4200-8807-84a5d7b68b6d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:29.710942 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e9adab3-5c7d-4200-8807-84a5d7b68b6d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:29.711395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e9adab3-5c7d-4200-8807-84a5d7b68b6d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:29.712103 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e9adab3-5c7d-4200-8807-84a5d7b68b6d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:29.712571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e9adab3-5c7d-4200-8807-84a5d7b68b6d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:29.713020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7e9adab3-5c7d-4200-8807-84a5d7b68b6d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:29.913948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7e9adab3-5c7d-4200-8807-84a5d7b68b6d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:29.921658 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7e9adab3-5c7d-4200-8807-84a5d7b68b6d tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.222636 Aug 27 03:56:29.922266 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3616/7416] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:29 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:30.942992 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0d15dfd5-00bb-454b-ba3f-542b897ae0fe tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:30.943711 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0d15dfd5-00bb-454b-ba3f-542b897ae0fe tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:30.950879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d15dfd5-00bb-454b-ba3f-542b897ae0fe tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:30.951371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d15dfd5-00bb-454b-ba3f-542b897ae0fe tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:30.952011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d15dfd5-00bb-454b-ba3f-542b897ae0fe tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:30.952893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d15dfd5-00bb-454b-ba3f-542b897ae0fe tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:30.953352 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d15dfd5-00bb-454b-ba3f-542b897ae0fe tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:30.953810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0d15dfd5-00bb-454b-ba3f-542b897ae0fe tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:31.099664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0d15dfd5-00bb-454b-ba3f-542b897ae0fe tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:31.103912 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:31.111489 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0d15dfd5-00bb-454b-ba3f-542b897ae0fe tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.172281 Aug 27 03:56:31.122090 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3801/7417] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:30 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:32.133868 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c0a521b-60e1-4068-96d6-c7f57a08e1c0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:32.134542 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c0a521b-60e1-4068-96d6-c7f57a08e1c0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:32.142969 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c0a521b-60e1-4068-96d6-c7f57a08e1c0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:32.143498 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c0a521b-60e1-4068-96d6-c7f57a08e1c0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:32.143958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c0a521b-60e1-4068-96d6-c7f57a08e1c0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:32.144706 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c0a521b-60e1-4068-96d6-c7f57a08e1c0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:32.145400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c0a521b-60e1-4068-96d6-c7f57a08e1c0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:32.145880 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c0a521b-60e1-4068-96d6-c7f57a08e1c0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:32.150572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=86 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:32.308964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2c0a521b-60e1-4068-96d6-c7f57a08e1c0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:32.318896 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c0a521b-60e1-4068-96d6-c7f57a08e1c0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.189004 Aug 27 03:56:32.319574 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3617/7418] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:32 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:33.343653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2fc8be29-bdf1-450b-83fc-e9402578cb60 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:33.344437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2fc8be29-bdf1-450b-83fc-e9402578cb60 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:33.347893 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:33.354994 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fc8be29-bdf1-450b-83fc-e9402578cb60 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:33.355585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fc8be29-bdf1-450b-83fc-e9402578cb60 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:33.356040 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fc8be29-bdf1-450b-83fc-e9402578cb60 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:33.356788 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fc8be29-bdf1-450b-83fc-e9402578cb60 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:33.357222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fc8be29-bdf1-450b-83fc-e9402578cb60 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:33.357657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2fc8be29-bdf1-450b-83fc-e9402578cb60 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:33.518656 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2fc8be29-bdf1-450b-83fc-e9402578cb60 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:33.527467 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2fc8be29-bdf1-450b-83fc-e9402578cb60 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.188576 Aug 27 03:56:33.529273 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3802/7419] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:33 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:34.550317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c9ead3a7-6206-4309-8dcb-cd00ff499cc7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:34.550948 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c9ead3a7-6206-4309-8dcb-cd00ff499cc7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:34.553800 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=31 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:56:34.560778 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ead3a7-6206-4309-8dcb-cd00ff499cc7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:34.561319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ead3a7-6206-4309-8dcb-cd00ff499cc7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:34.561828 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ead3a7-6206-4309-8dcb-cd00ff499cc7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:34.562570 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ead3a7-6206-4309-8dcb-cd00ff499cc7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:34.563099 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ead3a7-6206-4309-8dcb-cd00ff499cc7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:34.564042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c9ead3a7-6206-4309-8dcb-cd00ff499cc7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:34.714587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c9ead3a7-6206-4309-8dcb-cd00ff499cc7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:34.723482 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c9ead3a7-6206-4309-8dcb-cd00ff499cc7 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.177152 Aug 27 03:56:34.724328 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3618/7420] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:34 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:35.747764 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2d570c15-07c2-4264-87db-e84b6d115799 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:35.748462 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2d570c15-07c2-4264-87db-e84b6d115799 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:35.757722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d570c15-07c2-4264-87db-e84b6d115799 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:35.758218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d570c15-07c2-4264-87db-e84b6d115799 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:35.758657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d570c15-07c2-4264-87db-e84b6d115799 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:35.759369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d570c15-07c2-4264-87db-e84b6d115799 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:35.759824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d570c15-07c2-4264-87db-e84b6d115799 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:35.760249 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2d570c15-07c2-4264-87db-e84b6d115799 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:35.933425 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-2d570c15-07c2-4264-87db-e84b6d115799 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:35.943048 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2d570c15-07c2-4264-87db-e84b6d115799 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.199775 Aug 27 03:56:35.943844 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3803/7421] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:35 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:36.965311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3c4286f5-171a-41d1-bddb-223b3a685a45 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:36.966091 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3c4286f5-171a-41d1-bddb-223b3a685a45 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:36.974227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4286f5-171a-41d1-bddb-223b3a685a45 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:36.974747 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4286f5-171a-41d1-bddb-223b3a685a45 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:36.975392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4286f5-171a-41d1-bddb-223b3a685a45 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:36.976134 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4286f5-171a-41d1-bddb-223b3a685a45 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:36.976855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4286f5-171a-41d1-bddb-223b3a685a45 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:36.977274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3c4286f5-171a-41d1-bddb-223b3a685a45 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:37.132642 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3c4286f5-171a-41d1-bddb-223b3a685a45 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:37.140918 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3c4286f5-171a-41d1-bddb-223b3a685a45 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.180191 Aug 27 03:56:37.145921 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3619/7422] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:36 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:38.161989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-cb1aa24b-8485-4a76-977c-04b7970ce0c2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:38.162728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-cb1aa24b-8485-4a76-977c-04b7970ce0c2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:38.170577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1aa24b-8485-4a76-977c-04b7970ce0c2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.171208 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1aa24b-8485-4a76-977c-04b7970ce0c2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.171661 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1aa24b-8485-4a76-977c-04b7970ce0c2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:38.172377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1aa24b-8485-4a76-977c-04b7970ce0c2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:38.172888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1aa24b-8485-4a76-977c-04b7970ce0c2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:38.173327 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-cb1aa24b-8485-4a76-977c-04b7970ce0c2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:38.325399 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-cb1aa24b-8485-4a76-977c-04b7970ce0c2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:38.333509 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-cb1aa24b-8485-4a76-977c-04b7970ce0c2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.175487 Aug 27 03:56:38.334164 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3804/7423] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:38 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:39.356528 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-26b01ce1-adbe-4b66-b679-48da1d04d751 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:39.357227 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26b01ce1-adbe-4b66-b679-48da1d04d751 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:39.364413 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26b01ce1-adbe-4b66-b679-48da1d04d751 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:39.364916 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26b01ce1-adbe-4b66-b679-48da1d04d751 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:39.365375 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26b01ce1-adbe-4b66-b679-48da1d04d751 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:39.366121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26b01ce1-adbe-4b66-b679-48da1d04d751 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:39.366599 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26b01ce1-adbe-4b66-b679-48da1d04d751 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:39.367078 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26b01ce1-adbe-4b66-b679-48da1d04d751 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:39.504106 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-26b01ce1-adbe-4b66-b679-48da1d04d751 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:39.512124 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-26b01ce1-adbe-4b66-b679-48da1d04d751 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.159624 Aug 27 03:56:39.512713 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3620/7424] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:39 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:40.534558 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-558bb015-6691-47fc-a7a6-c10c7501bf7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:40.535183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-558bb015-6691-47fc-a7a6-c10c7501bf7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:40.542187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-558bb015-6691-47fc-a7a6-c10c7501bf7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.542664 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-558bb015-6691-47fc-a7a6-c10c7501bf7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.543100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-558bb015-6691-47fc-a7a6-c10c7501bf7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.543796 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-558bb015-6691-47fc-a7a6-c10c7501bf7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:40.544245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-558bb015-6691-47fc-a7a6-c10c7501bf7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:40.544677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-558bb015-6691-47fc-a7a6-c10c7501bf7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:40.679555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-558bb015-6691-47fc-a7a6-c10c7501bf7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:40.687394 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-558bb015-6691-47fc-a7a6-c10c7501bf7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.157413 Aug 27 03:56:40.687973 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3805/7425] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:40 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:41.709458 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cd445fee-1f85-45ab-bcce-450dd703ee48 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:41.710346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cd445fee-1f85-45ab-bcce-450dd703ee48 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:41.718428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd445fee-1f85-45ab-bcce-450dd703ee48 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:41.719250 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd445fee-1f85-45ab-bcce-450dd703ee48 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:41.719714 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd445fee-1f85-45ab-bcce-450dd703ee48 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:41.720443 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd445fee-1f85-45ab-bcce-450dd703ee48 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:41.721200 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd445fee-1f85-45ab-bcce-450dd703ee48 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:41.721767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cd445fee-1f85-45ab-bcce-450dd703ee48 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:41.861017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cd445fee-1f85-45ab-bcce-450dd703ee48 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:41.868809 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cd445fee-1f85-45ab-bcce-450dd703ee48 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.164142 Aug 27 03:56:41.869391 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3621/7426] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:41 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:42.890515 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-db336ac9-3670-4a39-b12d-33f8b9742969 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:42.891264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-db336ac9-3670-4a39-b12d-33f8b9742969 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:42.898225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db336ac9-3670-4a39-b12d-33f8b9742969 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:42.898720 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db336ac9-3670-4a39-b12d-33f8b9742969 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:42.899162 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db336ac9-3670-4a39-b12d-33f8b9742969 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:42.899858 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db336ac9-3670-4a39-b12d-33f8b9742969 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:42.900318 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db336ac9-3670-4a39-b12d-33f8b9742969 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:42.900747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db336ac9-3670-4a39-b12d-33f8b9742969 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:43.036106 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-db336ac9-3670-4a39-b12d-33f8b9742969 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:43.044051 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-db336ac9-3670-4a39-b12d-33f8b9742969 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.157438 Aug 27 03:56:43.044639 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3806/7427] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:42 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:43.354905 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-8d16b2a4-9e2e-47fa-9708-445b4a3b4650 req-86382611-c501-471f-a47d-94d4faf9e82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f41d62a-f6a8-4071-8f44-7dee03a2775b", "name": "network-vif-plugged", "status": "completed", "tag": "ccbdf8b4-e281-4f21-abc7-33c2caf66dd7"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:43.366949 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8d16b2a4-9e2e-47fa-9708-445b4a3b4650 req-86382611-c501-471f-a47d-94d4faf9e82e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:43.367464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8d16b2a4-9e2e-47fa-9708-445b4a3b4650 req-86382611-c501-471f-a47d-94d4faf9e82e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:43.368342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-8d16b2a4-9e2e-47fa-9708-445b4a3b4650 req-86382611-c501-471f-a47d-94d4faf9e82e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:43.380482 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-8d16b2a4-9e2e-47fa-9708-445b4a3b4650 req-86382611-c501-471f-a47d-94d4faf9e82e service nova] Creating event network-vif-plugged:ccbdf8b4-e281-4f21-abc7-33c2caf66dd7 for instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b on n-h2-852084-5 Aug 27 03:56:43.384106 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [req-8d16b2a4-9e2e-47fa-9708-445b4a3b4650 req-86382611-c501-471f-a47d-94d4faf9e82e service nova] [6f39c558-4c8b-4454-92db-905e04da491a] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 03:56:44.065148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1af0e82-1daf-4666-8197-d6ce16fdfa75 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:44.065776 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a1af0e82-1daf-4666-8197-d6ce16fdfa75 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:44.072837 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1af0e82-1daf-4666-8197-d6ce16fdfa75 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:44.073330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1af0e82-1daf-4666-8197-d6ce16fdfa75 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:44.073801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1af0e82-1daf-4666-8197-d6ce16fdfa75 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:44.074510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1af0e82-1daf-4666-8197-d6ce16fdfa75 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:44.074975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1af0e82-1daf-4666-8197-d6ce16fdfa75 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:44.075411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1af0e82-1daf-4666-8197-d6ce16fdfa75 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:44.211189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a1af0e82-1daf-4666-8197-d6ce16fdfa75 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:44.219389 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a1af0e82-1daf-4666-8197-d6ce16fdfa75 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.158801 Aug 27 03:56:44.219970 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3807/7428] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:44 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:44.392809 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [req-8d16b2a4-9e2e-47fa-9708-445b4a3b4650 req-86382611-c501-471f-a47d-94d4faf9e82e service nova] [6f39c558-4c8b-4454-92db-905e04da491a] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 55012. Aug 27 03:56:44.396330 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-8d16b2a4-9e2e-47fa-9708-445b4a3b4650 req-86382611-c501-471f-a47d-94d4faf9e82e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.045348 Aug 27 03:56:44.396944 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3622/7429] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:45.241212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-0e281125-39ad-4273-844e-88e7308d81f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:45.241791 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-0e281125-39ad-4273-844e-88e7308d81f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:45.248728 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e281125-39ad-4273-844e-88e7308d81f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:45.249217 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e281125-39ad-4273-844e-88e7308d81f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:45.249677 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e281125-39ad-4273-844e-88e7308d81f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:45.250387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e281125-39ad-4273-844e-88e7308d81f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:45.250881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e281125-39ad-4273-844e-88e7308d81f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:45.251310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-0e281125-39ad-4273-844e-88e7308d81f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:45.387543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-0e281125-39ad-4273-844e-88e7308d81f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:45.396036 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-0e281125-39ad-4273-844e-88e7308d81f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.158841 Aug 27 03:56:45.396620 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3808/7430] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:45 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:46.419464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d61b85a8-970a-4219-9272-0e316021bc7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:46.420185 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-d61b85a8-970a-4219-9272-0e316021bc7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:46.426535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d61b85a8-970a-4219-9272-0e316021bc7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:46.427030 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d61b85a8-970a-4219-9272-0e316021bc7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:46.427482 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d61b85a8-970a-4219-9272-0e316021bc7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:46.428192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d61b85a8-970a-4219-9272-0e316021bc7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:46.428664 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d61b85a8-970a-4219-9272-0e316021bc7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:46.429098 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-d61b85a8-970a-4219-9272-0e316021bc7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:46.600622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-d61b85a8-970a-4219-9272-0e316021bc7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:46.608618 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d61b85a8-970a-4219-9272-0e316021bc7b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1688 microversion: 2.1 time: 0.194460 Aug 27 03:56:46.609445 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3623/7431] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:46 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:47.632094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7a5e1267-3771-45a6-8da6-3aed8bdc1500 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:47.632706 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7a5e1267-3771-45a6-8da6-3aed8bdc1500 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:56:47.638896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a5e1267-3771-45a6-8da6-3aed8bdc1500 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:47.639385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a5e1267-3771-45a6-8da6-3aed8bdc1500 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:47.639877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a5e1267-3771-45a6-8da6-3aed8bdc1500 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:47.640528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a5e1267-3771-45a6-8da6-3aed8bdc1500 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:56:47.640988 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a5e1267-3771-45a6-8da6-3aed8bdc1500 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:56:47.641420 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7a5e1267-3771-45a6-8da6-3aed8bdc1500 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:56:47.778357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7a5e1267-3771-45a6-8da6-3aed8bdc1500 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:56:47.787108 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7a5e1267-3771-45a6-8da6-3aed8bdc1500 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1675 microversion: 2.1 time: 0.161355 Aug 27 03:56:47.787828 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3809/7432] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:56:47 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:57.770807 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=11 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:57.772298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=36 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:57.777637 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c4f013cf-b6d4-48eb-b31c-227e8a8ee6a3 req-862ed2d8-0a28-4938-9fea-5725f4570b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f41d62a-f6a8-4071-8f44-7dee03a2775b", "tag": "ccbdf8b4-e281-4f21-abc7-33c2caf66dd7"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:57.778291 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b58dc3df-60ba-4106-a29e-8ebb08e1d63b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:57.779058 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b58dc3df-60ba-4106-a29e-8ebb08e1d63b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:57.786885 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b58dc3df-60ba-4106-a29e-8ebb08e1d63b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:57.787392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b58dc3df-60ba-4106-a29e-8ebb08e1d63b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:57.787520 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=15 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:57.787840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b58dc3df-60ba-4106-a29e-8ebb08e1d63b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:57.788704 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=48 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:57:57.789445 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b58dc3df-60ba-4106-a29e-8ebb08e1d63b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:57.789958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b58dc3df-60ba-4106-a29e-8ebb08e1d63b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:57.790400 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b58dc3df-60ba-4106-a29e-8ebb08e1d63b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:57.792201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c4f013cf-b6d4-48eb-b31c-227e8a8ee6a3 req-862ed2d8-0a28-4938-9fea-5725f4570b38 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:57.792690 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c4f013cf-b6d4-48eb-b31c-227e8a8ee6a3 req-862ed2d8-0a28-4938-9fea-5725f4570b38 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:57.793816 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c4f013cf-b6d4-48eb-b31c-227e8a8ee6a3 req-862ed2d8-0a28-4938-9fea-5725f4570b38 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:57.806917 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c4f013cf-b6d4-48eb-b31c-227e8a8ee6a3 req-862ed2d8-0a28-4938-9fea-5725f4570b38 service nova] Creating event network-changed:ccbdf8b4-e281-4f21-abc7-33c2caf66dd7 for instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b on n-h2-852084-5 Aug 27 03:57:57.812952 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c4f013cf-b6d4-48eb-b31c-227e8a8ee6a3 req-862ed2d8-0a28-4938-9fea-5725f4570b38 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040901 Aug 27 03:57:57.814198 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3810/7433] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:57:57.818840 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b58dc3df-60ba-4106-a29e-8ebb08e1d63b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 03:57:57.927372 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b58dc3df-60ba-4106-a29e-8ebb08e1d63b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 204 len: 0 microversion: 2.1 time: 0.158828 Aug 27 03:57:57.928904 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3624/7434] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 03:57:57 2022] DELETE /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 03:57:57.939187 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-29637b25-9ad4-41f1-a2b7-6306ee150d01 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:57.940112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-29637b25-9ad4-41f1-a2b7-6306ee150d01 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:57.948016 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29637b25-9ad4-41f1-a2b7-6306ee150d01 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:57.948872 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29637b25-9ad4-41f1-a2b7-6306ee150d01 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:57.949995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29637b25-9ad4-41f1-a2b7-6306ee150d01 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:57.951002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29637b25-9ad4-41f1-a2b7-6306ee150d01 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:57.952235 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29637b25-9ad4-41f1-a2b7-6306ee150d01 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:57.952886 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-29637b25-9ad4-41f1-a2b7-6306ee150d01 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:58.095463 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-29637b25-9ad4-41f1-a2b7-6306ee150d01 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:58.104314 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-29637b25-9ad4-41f1-a2b7-6306ee150d01 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1681 microversion: 2.1 time: 0.170380 Aug 27 03:57:58.104924 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3811/7435] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:57 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:59.126754 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-06bb87d7-2d10-42b9-ad0b-1d49b4069894 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:59.127580 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-06bb87d7-2d10-42b9-ad0b-1d49b4069894 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:57:59.134997 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06bb87d7-2d10-42b9-ad0b-1d49b4069894 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:59.135716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06bb87d7-2d10-42b9-ad0b-1d49b4069894 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:59.136172 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06bb87d7-2d10-42b9-ad0b-1d49b4069894 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:59.137767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06bb87d7-2d10-42b9-ad0b-1d49b4069894 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:59.137767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06bb87d7-2d10-42b9-ad0b-1d49b4069894 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:59.138007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-06bb87d7-2d10-42b9-ad0b-1d49b4069894 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:59.390920 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-06bb87d7-2d10-42b9-ad0b-1d49b4069894 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:57:59.401604 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-06bb87d7-2d10-42b9-ad0b-1d49b4069894 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 200 len: 1681 microversion: 2.1 time: 0.279063 Aug 27 03:57:59.402555 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3625/7436] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:57:59 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:59.792929 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-c992a2ea-7888-4010-a7e4-509903d11e9e req-390fc867-4733-4a2d-a587-b3107878feff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f41d62a-f6a8-4071-8f44-7dee03a2775b", "name": "network-vif-deleted", "tag": "ccbdf8b4-e281-4f21-abc7-33c2caf66dd7"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:59.802972 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c992a2ea-7888-4010-a7e4-509903d11e9e req-390fc867-4733-4a2d-a587-b3107878feff service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:57:59.803471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c992a2ea-7888-4010-a7e4-509903d11e9e req-390fc867-4733-4a2d-a587-b3107878feff service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:57:59.803907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-c992a2ea-7888-4010-a7e4-509903d11e9e req-390fc867-4733-4a2d-a587-b3107878feff service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:57:59.815914 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-c992a2ea-7888-4010-a7e4-509903d11e9e req-390fc867-4733-4a2d-a587-b3107878feff service nova] Creating event network-vif-deleted:ccbdf8b4-e281-4f21-abc7-33c2caf66dd7 for instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b on n-h2-852084-5 Aug 27 03:57:59.821413 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-c992a2ea-7888-4010-a7e4-509903d11e9e req-390fc867-4733-4a2d-a587-b3107878feff service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091948 Aug 27 03:57:59.822085 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3812/7437] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:58:00.424089 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:00.424631 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 1f41d62a-f6a8-4071-8f44-7dee03a2775b] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:00.431569 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:00.432073 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:00.432540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:00.433254 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:00.433752 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:00.434199 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:00.448153 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] HTTP exception thrown: Instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b could not be found. Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Request method failure captured: Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b HTTP/1.1 Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZVKUe8yBa7VI_oyBLtWV1rAFHogBtf9Rj1gIuKxxIm_7fTWmNuNiPnAKREI6qewM9K4d_NV5afgCYLdqPvB9INUD1mjQ-G8xaVDR5Ho9qBvbRjoDH1bx4ThXpxbeOU_OD4xnIiDZCdCUo2jOiHns-80kg70KfQWsx0wfkNCB_Cdjnc Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 121b03bce5744ea9aded67cc1c5c277b Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestShelveInstance-166240906 Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_121b03bce5744ea9aded67cc1c5c277b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/121b03bce5744ea9aded67cc1c5c277b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/121b03bce5744ea9aded67cc1c5c277b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/121b03bce5744ea9aded67cc1c5c277b"}]}] Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestShelveInstance-166240906 Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 121b03bce5744ea9aded67cc1c5c277b Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestShelveInstance-166240906 Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestShelveInstance-166240906-project Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0f30e9b469854f43a1f4ae22ae8fe4e9 Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestShelveInstance-166240906-project Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b could not be found. Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '1f41d62a-f6a8-4071-8f44-7dee03a2775b'} Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b could not be found. Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b could not be found. Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 03:58:00.449862 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:58:00.455074 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 03:58:00.455074 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 03:58:00.455074 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 03:58:00.455074 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 03:58:00.455074 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 03:58:00.455074 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b could not be found. Aug 27 03:58:00.455074 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 03:58:00.455074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Returning 404 to user: Instance 1f41d62a-f6a8-4071-8f44-7dee03a2775b could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 03:58:00.455074 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2193caf1-243d-4ca1-b40d-2265cc5be7c6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b" status: 404 len: 111 microversion: 2.1 time: 0.031457 Aug 27 03:58:00.455074 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3626/7438] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:00 2022] GET /compute/v2.1/servers/1f41d62a-f6a8-4071-8f44-7dee03a2775b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 03:58:00.615272 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4f601090-2bd7-4486-86c5-bea09af6c9d8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '.version_select at 0x7f4d2920c280>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:00.643756 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4f601090-2bd7-4486-86c5-bea09af6c9d8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1874809448" status: 202 len: 0 microversion: 2.1 time: 0.032788 Aug 27 03:58:00.644718 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3813/7439] 10.222.0.99 () {58 vars in 1254 bytes} [Sat Aug 27 03:58:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1874809448 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 03:58:00.663707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-d0293f63-907a-4b58-aad4-1fdaf81d9da1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Action: 'create', calling method: .version_select at 0x7f4d29c08af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-229985174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhpKUifl7UCGV2TuVFy6BBUX+D4sYQv2od7UtkECKJyCmQR3nPsyT2PY42TmboecAZynNAAYt1tBXC1o0vWNHa8HWi2ICTrDXchx0daCVmhmR0sFsomOtXkao1pijO+AA=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:00.679929 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-d0293f63-907a-4b58-aad4-1fdaf81d9da1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Getting quotas for project 121b03bce5744ea9aded67cc1c5c277b. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:58:00.685015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-d0293f63-907a-4b58-aad4-1fdaf81d9da1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Getting quotas for user 0f30e9b469854f43a1f4ae22ae8fe4e9 and project 121b03bce5744ea9aded67cc1c5c277b. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:58:00.713253 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-d0293f63-907a-4b58-aad4-1fdaf81d9da1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.054009 Aug 27 03:58:00.714099 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3627/7440] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 03:58:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:16.902185 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=10 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:16.902950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:16.907411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-936743282", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-229985174", "security_groups": [{"name": "tempest-secgroup-smoke-49905092"}], "networks": [{"uuid": "0230878e-d753-49b1-b5df-bed24a3be224"}], "block_device_mapping_v2": [{"uuid": "ad9376c7-89db-41fe-8a61-5d84d5d65001", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:17.027627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] validate_networks() for [('0230878e-d753-49b1-b5df-bed24a3be224', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 03:58:17.408830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 03:58:17.409296 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 03:58:17.409851 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 03:58:17.410298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 03:58:17.410727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 03:58:17.419808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:17.420295 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:17.420732 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:17.421471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:17.421963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:17.422394 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:17.439801 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Getting quotas for project 121b03bce5744ea9aded67cc1c5c277b. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 03:58:17.445061 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Getting quotas for user 0f30e9b469854f43a1f4ae22ae8fe4e9 and project 121b03bce5744ea9aded67cc1c5c277b. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 03:58:17.502914 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 03:58:17.505206 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ad9376c7-89db-41fe-8a61-5d84d5d65001',volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 03:58:17.636574 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d52e93b2-3a96-4409-baf5-40421c4541e8 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.736218 Aug 27 03:58:17.637567 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3814/7441] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 03:58:16 2022] POST /compute/v2.1/servers => generated 404 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 03:58:17.646571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:17.647416 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=4 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:17.648234 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:17.652854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-50c1ae09-4258-480e-aa2d-7978ce4a8b76 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:17.653578 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-50c1ae09-4258-480e-aa2d-7978ce4a8b76 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:17.714656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-50c1ae09-4258-480e-aa2d-7978ce4a8b76 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:17.721837 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-50c1ae09-4258-480e-aa2d-7978ce4a8b76 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1087 microversion: 2.1 time: 0.077327 Aug 27 03:58:17.722601 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3628/7442] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:17 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1087 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:58:18.745790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c1525cba-398c-4e51-ab3d-c69deb431a0f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:18.745790 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c1525cba-398c-4e51-ab3d-c69deb431a0f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:18.754573 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1525cba-398c-4e51-ab3d-c69deb431a0f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:18.754939 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1525cba-398c-4e51-ab3d-c69deb431a0f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:18.755404 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1525cba-398c-4e51-ab3d-c69deb431a0f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:18.756247 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1525cba-398c-4e51-ab3d-c69deb431a0f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:18.756800 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1525cba-398c-4e51-ab3d-c69deb431a0f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:18.757307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c1525cba-398c-4e51-ab3d-c69deb431a0f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:18.850307 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c1525cba-398c-4e51-ab3d-c69deb431a0f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:18.859119 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c1525cba-398c-4e51-ab3d-c69deb431a0f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1193 microversion: 2.1 time: 0.120179 Aug 27 03:58:18.859924 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3815/7443] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:18 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1193 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:58:19.880785 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-624cc0f9-14ca-4519-8207-714a3d73f7eb tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:19.881810 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-624cc0f9-14ca-4519-8207-714a3d73f7eb tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:19.889190 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-624cc0f9-14ca-4519-8207-714a3d73f7eb tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:19.889863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-624cc0f9-14ca-4519-8207-714a3d73f7eb tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:19.890437 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-624cc0f9-14ca-4519-8207-714a3d73f7eb tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:19.891428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-624cc0f9-14ca-4519-8207-714a3d73f7eb tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:19.892278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-624cc0f9-14ca-4519-8207-714a3d73f7eb tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:19.892945 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-624cc0f9-14ca-4519-8207-714a3d73f7eb tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:20.053060 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-624cc0f9-14ca-4519-8207-714a3d73f7eb tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:20.063021 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-624cc0f9-14ca-4519-8207-714a3d73f7eb tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1269 microversion: 2.1 time: 0.186095 Aug 27 03:58:20.063859 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3629/7444] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:19 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1269 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:20.268930 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-b3d01084-1e74-435d-83a9-5738e176829b req-5b5499f8-28bf-4a68-9acd-2bfdd6ee0ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d608bcc-bdc7-4367-b660-2bb0e6e47655", "tag": "5d23dd7f-fefd-4bec-92b6-126154c9dd62"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:20.281956 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b3d01084-1e74-435d-83a9-5738e176829b req-5b5499f8-28bf-4a68-9acd-2bfdd6ee0ab7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:20.282861 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b3d01084-1e74-435d-83a9-5738e176829b req-5b5499f8-28bf-4a68-9acd-2bfdd6ee0ab7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:20.283616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-b3d01084-1e74-435d-83a9-5738e176829b req-5b5499f8-28bf-4a68-9acd-2bfdd6ee0ab7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:20.315303 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-b3d01084-1e74-435d-83a9-5738e176829b req-5b5499f8-28bf-4a68-9acd-2bfdd6ee0ab7 service nova] Creating event network-changed:5d23dd7f-fefd-4bec-92b6-126154c9dd62 for instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 on n-h1-852084-5 Aug 27 03:58:20.323925 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-b3d01084-1e74-435d-83a9-5738e176829b req-5b5499f8-28bf-4a68-9acd-2bfdd6ee0ab7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058918 Aug 27 03:58:20.325635 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3816/7445] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:58:21.084927 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-bd92aa01-3678-4865-affc-14850fdfa193 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:21.085616 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-bd92aa01-3678-4865-affc-14850fdfa193 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:21.094418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd92aa01-3678-4865-affc-14850fdfa193 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:21.095097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd92aa01-3678-4865-affc-14850fdfa193 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:21.095566 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd92aa01-3678-4865-affc-14850fdfa193 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:21.096422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd92aa01-3678-4865-affc-14850fdfa193 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:21.096860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd92aa01-3678-4865-affc-14850fdfa193 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:21.097312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-bd92aa01-3678-4865-affc-14850fdfa193 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:21.241052 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-bd92aa01-3678-4865-affc-14850fdfa193 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:21.250321 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-bd92aa01-3678-4865-affc-14850fdfa193 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1269 microversion: 2.1 time: 0.169802 Aug 27 03:58:21.251094 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3630/7446] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:21 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:22.273710 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ddcf516d-6b4c-4161-b3f0-b153ab51d04c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:22.275387 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ddcf516d-6b4c-4161-b3f0-b153ab51d04c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:22.281997 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddcf516d-6b4c-4161-b3f0-b153ab51d04c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:22.282632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddcf516d-6b4c-4161-b3f0-b153ab51d04c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:22.283150 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddcf516d-6b4c-4161-b3f0-b153ab51d04c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:22.283975 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddcf516d-6b4c-4161-b3f0-b153ab51d04c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:22.284524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddcf516d-6b4c-4161-b3f0-b153ab51d04c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:22.285157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ddcf516d-6b4c-4161-b3f0-b153ab51d04c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:22.434874 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ddcf516d-6b4c-4161-b3f0-b153ab51d04c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:22.443673 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ddcf516d-6b4c-4161-b3f0-b153ab51d04c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1269 microversion: 2.1 time: 0.175135 Aug 27 03:58:22.444299 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3817/7447] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:22 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1269 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:23.465192 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b12563c0-753e-400d-910c-4eb1f82f6fe0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:23.465855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b12563c0-753e-400d-910c-4eb1f82f6fe0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:23.473272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b12563c0-753e-400d-910c-4eb1f82f6fe0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:23.473811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b12563c0-753e-400d-910c-4eb1f82f6fe0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:23.474274 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b12563c0-753e-400d-910c-4eb1f82f6fe0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:23.475020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b12563c0-753e-400d-910c-4eb1f82f6fe0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:23.475491 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b12563c0-753e-400d-910c-4eb1f82f6fe0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:23.475934 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b12563c0-753e-400d-910c-4eb1f82f6fe0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:23.621204 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b12563c0-753e-400d-910c-4eb1f82f6fe0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:23.629802 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b12563c0-753e-400d-910c-4eb1f82f6fe0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1269 microversion: 2.1 time: 0.168523 Aug 27 03:58:23.630420 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3631/7448] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:23 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:24.650868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4622a184-5af6-4736-9b38-82b6a7498e40 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:24.651431 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4622a184-5af6-4736-9b38-82b6a7498e40 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:24.658541 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4622a184-5af6-4736-9b38-82b6a7498e40 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:24.659064 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4622a184-5af6-4736-9b38-82b6a7498e40 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:24.659538 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4622a184-5af6-4736-9b38-82b6a7498e40 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:24.660281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4622a184-5af6-4736-9b38-82b6a7498e40 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:24.660747 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4622a184-5af6-4736-9b38-82b6a7498e40 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:24.661210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4622a184-5af6-4736-9b38-82b6a7498e40 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:24.802037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4622a184-5af6-4736-9b38-82b6a7498e40 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:24.809958 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4622a184-5af6-4736-9b38-82b6a7498e40 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1257 microversion: 2.1 time: 0.163105 Aug 27 03:58:24.810545 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3818/7449] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:24 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1257 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:25.830651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-709db754-1d4d-4a39-bf9d-506f5b9ca1d5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:25.831319 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-709db754-1d4d-4a39-bf9d-506f5b9ca1d5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:25.838389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-709db754-1d4d-4a39-bf9d-506f5b9ca1d5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:25.838881 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-709db754-1d4d-4a39-bf9d-506f5b9ca1d5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:25.839327 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-709db754-1d4d-4a39-bf9d-506f5b9ca1d5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:25.840034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-709db754-1d4d-4a39-bf9d-506f5b9ca1d5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:25.840494 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-709db754-1d4d-4a39-bf9d-506f5b9ca1d5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:25.840932 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-709db754-1d4d-4a39-bf9d-506f5b9ca1d5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:25.976312 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-709db754-1d4d-4a39-bf9d-506f5b9ca1d5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:25.986011 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-709db754-1d4d-4a39-bf9d-506f5b9ca1d5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1257 microversion: 2.1 time: 0.159528 Aug 27 03:58:25.986597 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3632/7450] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:25 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:27.007892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d9c13de0-2e25-44d1-9b61-4e1ca99999d9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:27.008510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d9c13de0-2e25-44d1-9b61-4e1ca99999d9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:27.016212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9c13de0-2e25-44d1-9b61-4e1ca99999d9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:27.016701 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9c13de0-2e25-44d1-9b61-4e1ca99999d9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:27.017148 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9c13de0-2e25-44d1-9b61-4e1ca99999d9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:27.017896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9c13de0-2e25-44d1-9b61-4e1ca99999d9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:27.018353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9c13de0-2e25-44d1-9b61-4e1ca99999d9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:27.018784 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d9c13de0-2e25-44d1-9b61-4e1ca99999d9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:27.163991 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d9c13de0-2e25-44d1-9b61-4e1ca99999d9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:27.173172 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d9c13de0-2e25-44d1-9b61-4e1ca99999d9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1257 microversion: 2.1 time: 0.169147 Aug 27 03:58:27.173814 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3819/7451] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:27 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1257 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:28.195041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0049a897-ee1c-4496-a902-7a402b534ed5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:28.196508 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0049a897-ee1c-4496-a902-7a402b534ed5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:28.200167 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:28.205830 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0049a897-ee1c-4496-a902-7a402b534ed5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:28.206336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0049a897-ee1c-4496-a902-7a402b534ed5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:28.206794 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0049a897-ee1c-4496-a902-7a402b534ed5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:28.207545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0049a897-ee1c-4496-a902-7a402b534ed5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:28.208016 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0049a897-ee1c-4496-a902-7a402b534ed5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:28.208461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0049a897-ee1c-4496-a902-7a402b534ed5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:28.349535 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0049a897-ee1c-4496-a902-7a402b534ed5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:28.358321 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0049a897-ee1c-4496-a902-7a402b534ed5 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1257 microversion: 2.1 time: 0.167205 Aug 27 03:58:28.358918 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3633/7452] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:28 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1257 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:29.379678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5375e385-86bd-4116-b827-d3f415f1f188 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:29.380298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5375e385-86bd-4116-b827-d3f415f1f188 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:29.382332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:29.383010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 03:58:29.389905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5375e385-86bd-4116-b827-d3f415f1f188 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:29.390402 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5375e385-86bd-4116-b827-d3f415f1f188 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:29.391183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5375e385-86bd-4116-b827-d3f415f1f188 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:29.391548 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5375e385-86bd-4116-b827-d3f415f1f188 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:29.392010 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5375e385-86bd-4116-b827-d3f415f1f188 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:29.392441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5375e385-86bd-4116-b827-d3f415f1f188 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:29.524566 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5375e385-86bd-4116-b827-d3f415f1f188 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:29.532984 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5375e385-86bd-4116-b827-d3f415f1f188 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1257 microversion: 2.1 time: 0.157256 Aug 27 03:58:29.533562 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3820/7453] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:29 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:30.554803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7ca0defc-215c-4a27-84c6-2b46e9e15fe3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:30.555541 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7ca0defc-215c-4a27-84c6-2b46e9e15fe3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:30.563201 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ca0defc-215c-4a27-84c6-2b46e9e15fe3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:30.563688 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ca0defc-215c-4a27-84c6-2b46e9e15fe3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:30.564135 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ca0defc-215c-4a27-84c6-2b46e9e15fe3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:30.564838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ca0defc-215c-4a27-84c6-2b46e9e15fe3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:30.565301 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ca0defc-215c-4a27-84c6-2b46e9e15fe3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:30.565768 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7ca0defc-215c-4a27-84c6-2b46e9e15fe3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:30.701353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7ca0defc-215c-4a27-84c6-2b46e9e15fe3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:30.709488 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7ca0defc-215c-4a27-84c6-2b46e9e15fe3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1257 microversion: 2.1 time: 0.158557 Aug 27 03:58:30.710329 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3634/7454] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:30 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1257 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:31.730555 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-da847189-2540-4c71-acde-34b2047985fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:31.731210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-da847189-2540-4c71-acde-34b2047985fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:31.738100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da847189-2540-4c71-acde-34b2047985fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:31.738588 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da847189-2540-4c71-acde-34b2047985fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:31.739055 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da847189-2540-4c71-acde-34b2047985fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:31.739758 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da847189-2540-4c71-acde-34b2047985fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:31.740222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da847189-2540-4c71-acde-34b2047985fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:31.740652 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-da847189-2540-4c71-acde-34b2047985fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:31.873500 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-da847189-2540-4c71-acde-34b2047985fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:31.882599 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-da847189-2540-4c71-acde-34b2047985fd tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1257 microversion: 2.1 time: 0.156146 Aug 27 03:58:31.883194 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3821/7455] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:31 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:32.904365 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9925ef92-56c3-4ef5-b044-708c1ed94350 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:32.905036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9925ef92-56c3-4ef5-b044-708c1ed94350 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:32.912156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9925ef92-56c3-4ef5-b044-708c1ed94350 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:32.912658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9925ef92-56c3-4ef5-b044-708c1ed94350 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:32.913109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9925ef92-56c3-4ef5-b044-708c1ed94350 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:32.913856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9925ef92-56c3-4ef5-b044-708c1ed94350 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:32.914332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9925ef92-56c3-4ef5-b044-708c1ed94350 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:32.914771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9925ef92-56c3-4ef5-b044-708c1ed94350 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:33.058355 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9925ef92-56c3-4ef5-b044-708c1ed94350 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:33.066310 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9925ef92-56c3-4ef5-b044-708c1ed94350 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1257 microversion: 2.1 time: 0.166423 Aug 27 03:58:33.066904 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3635/7456] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:32 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1257 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:34.088043 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4feb1e6f-7f65-4950-9181-4d7bb522ed7e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:34.089139 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4feb1e6f-7f65-4950-9181-4d7bb522ed7e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:34.095904 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feb1e6f-7f65-4950-9181-4d7bb522ed7e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:34.096396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feb1e6f-7f65-4950-9181-4d7bb522ed7e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:34.096844 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feb1e6f-7f65-4950-9181-4d7bb522ed7e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:34.097553 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feb1e6f-7f65-4950-9181-4d7bb522ed7e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:34.098039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feb1e6f-7f65-4950-9181-4d7bb522ed7e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:34.098478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4feb1e6f-7f65-4950-9181-4d7bb522ed7e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:34.233244 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4feb1e6f-7f65-4950-9181-4d7bb522ed7e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:34.241167 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4feb1e6f-7f65-4950-9181-4d7bb522ed7e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1257 microversion: 2.1 time: 0.157149 Aug 27 03:58:34.241779 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3822/7457] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:34 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:34.566188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-01a5cefa-bdff-4143-83bf-aee8fa1c5c27 req-0d492c6a-1995-4361-9b99-45ece014762c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d608bcc-bdc7-4367-b660-2bb0e6e47655", "name": "network-vif-plugged", "status": "completed", "tag": "5d23dd7f-fefd-4bec-92b6-126154c9dd62"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:34.577509 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-01a5cefa-bdff-4143-83bf-aee8fa1c5c27 req-0d492c6a-1995-4361-9b99-45ece014762c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:34.578039 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-01a5cefa-bdff-4143-83bf-aee8fa1c5c27 req-0d492c6a-1995-4361-9b99-45ece014762c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:34.578481 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-01a5cefa-bdff-4143-83bf-aee8fa1c5c27 req-0d492c6a-1995-4361-9b99-45ece014762c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:34.590011 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-01a5cefa-bdff-4143-83bf-aee8fa1c5c27 req-0d492c6a-1995-4361-9b99-45ece014762c service nova] Creating event network-vif-plugged:5d23dd7f-fefd-4bec-92b6-126154c9dd62 for instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 on n-h1-852084-5 Aug 27 03:58:34.595373 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-01a5cefa-bdff-4143-83bf-aee8fa1c5c27 req-0d492c6a-1995-4361-9b99-45ece014762c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032985 Aug 27 03:58:34.596060 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3636/7458] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:58:35.262175 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab6a853d-6d92-45fc-b1d3-78de3078c7b1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:35.262804 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ab6a853d-6d92-45fc-b1d3-78de3078c7b1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:35.269896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab6a853d-6d92-45fc-b1d3-78de3078c7b1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:35.270390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab6a853d-6d92-45fc-b1d3-78de3078c7b1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:35.270841 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab6a853d-6d92-45fc-b1d3-78de3078c7b1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:35.271547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab6a853d-6d92-45fc-b1d3-78de3078c7b1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:35.272054 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab6a853d-6d92-45fc-b1d3-78de3078c7b1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:35.272497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab6a853d-6d92-45fc-b1d3-78de3078c7b1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:35.414615 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ab6a853d-6d92-45fc-b1d3-78de3078c7b1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:35.423240 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab6a853d-6d92-45fc-b1d3-78de3078c7b1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1257 microversion: 2.1 time: 0.165195 Aug 27 03:58:35.423830 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3823/7459] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:35 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:36.446225 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-26c89e8c-b62c-4f63-bae1-fc51de05e72c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:36.446863 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-26c89e8c-b62c-4f63-bae1-fc51de05e72c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:36.453289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26c89e8c-b62c-4f63-bae1-fc51de05e72c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:36.453822 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26c89e8c-b62c-4f63-bae1-fc51de05e72c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:36.454311 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26c89e8c-b62c-4f63-bae1-fc51de05e72c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:36.455022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26c89e8c-b62c-4f63-bae1-fc51de05e72c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:36.455495 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26c89e8c-b62c-4f63-bae1-fc51de05e72c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:36.455938 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-26c89e8c-b62c-4f63-bae1-fc51de05e72c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:36.594007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-26c89e8c-b62c-4f63-bae1-fc51de05e72c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:36.601881 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-26c89e8c-b62c-4f63-bae1-fc51de05e72c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1442 microversion: 2.1 time: 0.161144 Aug 27 03:58:36.602455 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3637/7460] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:36 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:36.623786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b1232b13-7a4b-4491-b2aa-ece2aa790c41 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:58:36.624408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b1232b13-7a4b-4491-b2aa-ece2aa790c41 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 03:58:36.631408 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1232b13-7a4b-4491-b2aa-ece2aa790c41 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:36.631899 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1232b13-7a4b-4491-b2aa-ece2aa790c41 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:36.632349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1232b13-7a4b-4491-b2aa-ece2aa790c41 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:36.633053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1232b13-7a4b-4491-b2aa-ece2aa790c41 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:36.633524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1232b13-7a4b-4491-b2aa-ece2aa790c41 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:36.633979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b1232b13-7a4b-4491-b2aa-ece2aa790c41 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:36.773812 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b1232b13-7a4b-4491-b2aa-ece2aa790c41 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 03:58:36.782261 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b1232b13-7a4b-4491-b2aa-ece2aa790c41 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1442 microversion: 2.1 time: 0.163135 Aug 27 03:58:36.783080 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3824/7461] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 03:58:36 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1442 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:58:38.688965 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c2766831-7fc3-42b8-a491-73a5422be2fc req-3e3fe59e-9478-4b00-bf32-b02fdc64fddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d608bcc-bdc7-4367-b660-2bb0e6e47655", "tag": "5d23dd7f-fefd-4bec-92b6-126154c9dd62"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:58:38.700525 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c2766831-7fc3-42b8-a491-73a5422be2fc req-3e3fe59e-9478-4b00-bf32-b02fdc64fddf service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 03:58:38.701014 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c2766831-7fc3-42b8-a491-73a5422be2fc req-3e3fe59e-9478-4b00-bf32-b02fdc64fddf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 03:58:38.701459 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c2766831-7fc3-42b8-a491-73a5422be2fc req-3e3fe59e-9478-4b00-bf32-b02fdc64fddf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 03:58:38.713316 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c2766831-7fc3-42b8-a491-73a5422be2fc req-3e3fe59e-9478-4b00-bf32-b02fdc64fddf service nova] Creating event network-changed:5d23dd7f-fefd-4bec-92b6-126154c9dd62 for instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 on n-h1-852084-5 Aug 27 03:58:38.719719 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c2766831-7fc3-42b8-a491-73a5422be2fc req-3e3fe59e-9478-4b00-bf32-b02fdc64fddf service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034480 Aug 27 03:58:38.720494 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3638/7462] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 03:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:00:33.874317 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2a984f1-fecc-4493-b1c3-f7a871d4cd60] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:00:33.875186 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dce2f75-e4fe-43f3-8eba-2057b586517f] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:00:33.875782 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:33.876507 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=58 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:33.877689 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 04:00:33.877854 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 04:00:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655/action (ip 10.222.0.99) !!! Aug 27 04:00:33.878931 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 04:00:33.879070 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 04:00:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655/action (ip 10.222.0.99) !!! Aug 27 04:00:33.948071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6fc0369a-d4e4-4caf-85d5-4aba2c9252e6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:33.948623 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6fc0369a-d4e4-4caf-85d5-4aba2c9252e6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:33.955132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fc0369a-d4e4-4caf-85d5-4aba2c9252e6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:33.955619 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fc0369a-d4e4-4caf-85d5-4aba2c9252e6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:33.956066 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fc0369a-d4e4-4caf-85d5-4aba2c9252e6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:33.956767 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fc0369a-d4e4-4caf-85d5-4aba2c9252e6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:33.957237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fc0369a-d4e4-4caf-85d5-4aba2c9252e6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:33.957691 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6fc0369a-d4e4-4caf-85d5-4aba2c9252e6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:33.981763 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-6fc0369a-d4e4-4caf-85d5-4aba2c9252e6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lazy-loading 'flavor' on Instance uuid 5d608bcc-bdc7-4367-b660-2bb0e6e47655 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:00:34.055351 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6fc0369a-d4e4-4caf-85d5-4aba2c9252e6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "POST /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655/action" status: 202 len: 0 microversion: 2.1 time: 0.182749 Aug 27 04:00:34.057746 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3825/7463] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 04:00:33 2022] POST /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:00:34.062769 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:00:34.063794 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:00:34.064641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=24 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:34.065534 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=52 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:00:34.066944 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:00:34.067091 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 04:00:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 (ip 10.222.0.99) !!! Aug 27 04:00:34.068264 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 27 04:00:34.068407 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 04:00:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 (ip 10.222.0.99) !!! Aug 27 04:00:34.078925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-c2866a10-52ff-48b1-befd-fba9565272cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:34.080285 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-c2866a10-52ff-48b1-befd-fba9565272cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:34.098130 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2866a10-52ff-48b1-befd-fba9565272cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:34.098767 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2866a10-52ff-48b1-befd-fba9565272cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:34.099859 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2866a10-52ff-48b1-befd-fba9565272cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:34.100639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2866a10-52ff-48b1-befd-fba9565272cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:34.101163 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2866a10-52ff-48b1-befd-fba9565272cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:34.101658 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-c2866a10-52ff-48b1-befd-fba9565272cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:34.236399 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-c2866a10-52ff-48b1-befd-fba9565272cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:34.244809 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-c2866a10-52ff-48b1-befd-fba9565272cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.184039 Aug 27 04:00:34.245460 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3639/7464] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:34 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:35.267471 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6873768a-aab4-48f5-bd52-dafdb22a1c53 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:35.268311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6873768a-aab4-48f5-bd52-dafdb22a1c53 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:35.281122 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6873768a-aab4-48f5-bd52-dafdb22a1c53 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:35.281614 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6873768a-aab4-48f5-bd52-dafdb22a1c53 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:35.282126 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6873768a-aab4-48f5-bd52-dafdb22a1c53 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:35.282843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6873768a-aab4-48f5-bd52-dafdb22a1c53 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:35.283311 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6873768a-aab4-48f5-bd52-dafdb22a1c53 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:35.283748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6873768a-aab4-48f5-bd52-dafdb22a1c53 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:35.291717 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dce2f75-e4fe-43f3-8eba-2057b586517f] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 55358. Aug 27 04:00:35.295249 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2a984f1-fecc-4493-b1c3-f7a871d4cd60] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 55356. Aug 27 04:00:35.426386 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6873768a-aab4-48f5-bd52-dafdb22a1c53 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:35.434484 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6873768a-aab4-48f5-bd52-dafdb22a1c53 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.171345 Aug 27 04:00:35.435074 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3826/7465] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:35 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:36.455397 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e64ebb94-f249-45d1-a95b-e99be38bd062 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:36.455951 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e64ebb94-f249-45d1-a95b-e99be38bd062 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:36.465318 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e64ebb94-f249-45d1-a95b-e99be38bd062 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:36.465855 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e64ebb94-f249-45d1-a95b-e99be38bd062 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:36.466314 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e64ebb94-f249-45d1-a95b-e99be38bd062 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:36.467036 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e64ebb94-f249-45d1-a95b-e99be38bd062 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:36.467512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e64ebb94-f249-45d1-a95b-e99be38bd062 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:36.467955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e64ebb94-f249-45d1-a95b-e99be38bd062 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:36.472429 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 55362. Aug 27 04:00:36.479703 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 55364. Aug 27 04:00:36.617048 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e64ebb94-f249-45d1-a95b-e99be38bd062 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:36.624903 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e64ebb94-f249-45d1-a95b-e99be38bd062 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.173504 Aug 27 04:00:36.625490 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3640/7466] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:36 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:37.648714 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ce9abd3c-f419-423a-aca1-7dd1ff30416f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:37.649264 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ce9abd3c-f419-423a-aca1-7dd1ff30416f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:37.656226 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce9abd3c-f419-423a-aca1-7dd1ff30416f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:37.656719 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce9abd3c-f419-423a-aca1-7dd1ff30416f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:37.657159 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce9abd3c-f419-423a-aca1-7dd1ff30416f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:37.657903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce9abd3c-f419-423a-aca1-7dd1ff30416f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:37.658369 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce9abd3c-f419-423a-aca1-7dd1ff30416f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:37.658809 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ce9abd3c-f419-423a-aca1-7dd1ff30416f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:37.789949 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ce9abd3c-f419-423a-aca1-7dd1ff30416f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:37.798758 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ce9abd3c-f419-423a-aca1-7dd1ff30416f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.154229 Aug 27 04:00:37.799337 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3827/7467] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:37 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:38.820608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2d3fc03a-0691-4861-b159-c53eec69e9e3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:38.821273 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2d3fc03a-0691-4861-b159-c53eec69e9e3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:38.828270 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d3fc03a-0691-4861-b159-c53eec69e9e3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:38.828777 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d3fc03a-0691-4861-b159-c53eec69e9e3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:38.829235 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d3fc03a-0691-4861-b159-c53eec69e9e3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:38.830005 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d3fc03a-0691-4861-b159-c53eec69e9e3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:38.830480 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d3fc03a-0691-4861-b159-c53eec69e9e3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:38.830926 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2d3fc03a-0691-4861-b159-c53eec69e9e3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:38.966731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-2d3fc03a-0691-4861-b159-c53eec69e9e3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:38.975237 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2d3fc03a-0691-4861-b159-c53eec69e9e3 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.158639 Aug 27 04:00:38.975829 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3641/7468] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:38 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:39.996599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-75a41799-8f02-4a28-89d3-386a9339ac29 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:39.997157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-75a41799-8f02-4a28-89d3-386a9339ac29 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:40.004483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75a41799-8f02-4a28-89d3-386a9339ac29 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:40.005005 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75a41799-8f02-4a28-89d3-386a9339ac29 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:40.005445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75a41799-8f02-4a28-89d3-386a9339ac29 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:40.006201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75a41799-8f02-4a28-89d3-386a9339ac29 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:40.006653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75a41799-8f02-4a28-89d3-386a9339ac29 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:40.007078 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-75a41799-8f02-4a28-89d3-386a9339ac29 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:40.152224 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-75a41799-8f02-4a28-89d3-386a9339ac29 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:40.160488 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-75a41799-8f02-4a28-89d3-386a9339ac29 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.167880 Aug 27 04:00:40.161093 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3828/7469] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:39 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:41.182653 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-817a60b9-100b-4e21-8c7e-88eb3fbfa440 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:41.183286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-817a60b9-100b-4e21-8c7e-88eb3fbfa440 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:41.190307 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817a60b9-100b-4e21-8c7e-88eb3fbfa440 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:41.190852 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817a60b9-100b-4e21-8c7e-88eb3fbfa440 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:41.191266 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817a60b9-100b-4e21-8c7e-88eb3fbfa440 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:41.191985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817a60b9-100b-4e21-8c7e-88eb3fbfa440 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:41.192461 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817a60b9-100b-4e21-8c7e-88eb3fbfa440 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:41.192912 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-817a60b9-100b-4e21-8c7e-88eb3fbfa440 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:41.328918 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-817a60b9-100b-4e21-8c7e-88eb3fbfa440 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:41.340007 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-817a60b9-100b-4e21-8c7e-88eb3fbfa440 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.161265 Aug 27 04:00:41.340613 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3642/7470] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:41 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:42.362616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-f80f164d-9f66-47a2-b0fa-941d83f7e7a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:42.363215 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-f80f164d-9f66-47a2-b0fa-941d83f7e7a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:42.370754 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f80f164d-9f66-47a2-b0fa-941d83f7e7a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:42.371257 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f80f164d-9f66-47a2-b0fa-941d83f7e7a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:42.371696 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f80f164d-9f66-47a2-b0fa-941d83f7e7a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:42.372382 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f80f164d-9f66-47a2-b0fa-941d83f7e7a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:42.372832 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f80f164d-9f66-47a2-b0fa-941d83f7e7a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:42.373258 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-f80f164d-9f66-47a2-b0fa-941d83f7e7a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:42.509877 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-f80f164d-9f66-47a2-b0fa-941d83f7e7a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:42.517822 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-f80f164d-9f66-47a2-b0fa-941d83f7e7a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.159125 Aug 27 04:00:42.518408 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3829/7471] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:42 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:43.539325 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-7815a9c0-c762-45ef-a3a7-05c70ec12689 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:43.539964 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-7815a9c0-c762-45ef-a3a7-05c70ec12689 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:43.547144 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7815a9c0-c762-45ef-a3a7-05c70ec12689 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:43.547649 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7815a9c0-c762-45ef-a3a7-05c70ec12689 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:43.548104 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7815a9c0-c762-45ef-a3a7-05c70ec12689 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:43.548816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7815a9c0-c762-45ef-a3a7-05c70ec12689 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:43.549287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7815a9c0-c762-45ef-a3a7-05c70ec12689 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:43.549771 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-7815a9c0-c762-45ef-a3a7-05c70ec12689 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:43.685516 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-7815a9c0-c762-45ef-a3a7-05c70ec12689 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:43.693939 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-7815a9c0-c762-45ef-a3a7-05c70ec12689 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.158524 Aug 27 04:00:43.694508 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3643/7472] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:43 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:00:44.715684 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-34a5407c-5975-4b9d-98e7-0ff194853ad2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:44.716546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-34a5407c-5975-4b9d-98e7-0ff194853ad2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:44.724381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34a5407c-5975-4b9d-98e7-0ff194853ad2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:44.724881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34a5407c-5975-4b9d-98e7-0ff194853ad2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:44.725653 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34a5407c-5975-4b9d-98e7-0ff194853ad2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:44.726419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34a5407c-5975-4b9d-98e7-0ff194853ad2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:44.727002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34a5407c-5975-4b9d-98e7-0ff194853ad2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:44.727437 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-34a5407c-5975-4b9d-98e7-0ff194853ad2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:44.939201 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-34a5407c-5975-4b9d-98e7-0ff194853ad2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:44.948009 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-34a5407c-5975-4b9d-98e7-0ff194853ad2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.235918 Aug 27 04:00:44.948613 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3830/7473] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:44 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:45.981140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b688b5fb-f807-45ec-9c95-97367d80a45a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:45.981940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b688b5fb-f807-45ec-9c95-97367d80a45a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:45.988975 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b688b5fb-f807-45ec-9c95-97367d80a45a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:45.989392 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b688b5fb-f807-45ec-9c95-97367d80a45a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:45.989887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b688b5fb-f807-45ec-9c95-97367d80a45a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:45.990638 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b688b5fb-f807-45ec-9c95-97367d80a45a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:45.991119 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b688b5fb-f807-45ec-9c95-97367d80a45a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:45.991563 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b688b5fb-f807-45ec-9c95-97367d80a45a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:46.122786 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b688b5fb-f807-45ec-9c95-97367d80a45a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:46.131127 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b688b5fb-f807-45ec-9c95-97367d80a45a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.153964 Aug 27 04:00:46.131710 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3644/7474] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:45 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:47.154385 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-47455d7f-f9d6-4e16-b751-0d6c579b3859 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:47.155011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-47455d7f-f9d6-4e16-b751-0d6c579b3859 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:47.162137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47455d7f-f9d6-4e16-b751-0d6c579b3859 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:47.162631 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47455d7f-f9d6-4e16-b751-0d6c579b3859 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:47.163080 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47455d7f-f9d6-4e16-b751-0d6c579b3859 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:47.163794 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47455d7f-f9d6-4e16-b751-0d6c579b3859 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:47.164292 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47455d7f-f9d6-4e16-b751-0d6c579b3859 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:47.164726 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-47455d7f-f9d6-4e16-b751-0d6c579b3859 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:47.303308 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-47455d7f-f9d6-4e16-b751-0d6c579b3859 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:47.311744 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-47455d7f-f9d6-4e16-b751-0d6c579b3859 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.161238 Aug 27 04:00:47.312468 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3831/7475] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:47 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:48.335662 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-9ec98074-c40e-403c-94ce-9af4af82a804 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:48.336408 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-9ec98074-c40e-403c-94ce-9af4af82a804 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:48.344656 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ec98074-c40e-403c-94ce-9af4af82a804 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:48.345159 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ec98074-c40e-403c-94ce-9af4af82a804 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:48.345601 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ec98074-c40e-403c-94ce-9af4af82a804 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:48.346342 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ec98074-c40e-403c-94ce-9af4af82a804 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:48.346805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ec98074-c40e-403c-94ce-9af4af82a804 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:48.347239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-9ec98074-c40e-403c-94ce-9af4af82a804 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:48.488278 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-9ec98074-c40e-403c-94ce-9af4af82a804 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:48.496225 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-9ec98074-c40e-403c-94ce-9af4af82a804 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1568 microversion: 2.1 time: 0.165899 Aug 27 04:00:48.496807 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3645/7476] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:48 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:48.517230 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5c2492d7-97b8-4109-b02f-8938bbb950d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:48.517903 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5c2492d7-97b8-4109-b02f-8938bbb950d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:48.525867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c2492d7-97b8-4109-b02f-8938bbb950d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:48.526364 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c2492d7-97b8-4109-b02f-8938bbb950d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:48.526803 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c2492d7-97b8-4109-b02f-8938bbb950d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:48.527514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c2492d7-97b8-4109-b02f-8938bbb950d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:48.527974 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c2492d7-97b8-4109-b02f-8938bbb950d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:48.528407 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5c2492d7-97b8-4109-b02f-8938bbb950d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:48.557389 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5c2492d7-97b8-4109-b02f-8938bbb950d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122488) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 27 04:00:48.624097 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5c2492d7-97b8-4109-b02f-8938bbb950d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "POST /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655/action" status: 202 len: 0 microversion: 2.1 time: 0.110756 Aug 27 04:00:48.624714 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3832/7477] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 04:00:48 2022] POST /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:00:48.633608 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f85c84c1-8e8d-40b0-86f3-b269148bd2d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:48.634175 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f85c84c1-8e8d-40b0-86f3-b269148bd2d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:48.640208 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85c84c1-8e8d-40b0-86f3-b269148bd2d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:48.640711 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85c84c1-8e8d-40b0-86f3-b269148bd2d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:48.641171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85c84c1-8e8d-40b0-86f3-b269148bd2d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:48.642008 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85c84c1-8e8d-40b0-86f3-b269148bd2d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:48.642390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85c84c1-8e8d-40b0-86f3-b269148bd2d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:48.642834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f85c84c1-8e8d-40b0-86f3-b269148bd2d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:48.801741 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f85c84c1-8e8d-40b0-86f3-b269148bd2d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:48.811391 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f85c84c1-8e8d-40b0-86f3-b269148bd2d2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1576 microversion: 2.1 time: 0.182341 Aug 27 04:00:48.811995 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3646/7478] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:48 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:48.971683 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-edc92c28-60a5-4ede-803e-38a121390cf4 req-169c7aee-a4c7-46a6-94a5-22ad27057f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d608bcc-bdc7-4367-b660-2bb0e6e47655", "name": "network-vif-unplugged", "status": "completed", "tag": "5d23dd7f-fefd-4bec-92b6-126154c9dd62"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:48.982682 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-edc92c28-60a5-4ede-803e-38a121390cf4 req-169c7aee-a4c7-46a6-94a5-22ad27057f54 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:48.983722 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-edc92c28-60a5-4ede-803e-38a121390cf4 req-169c7aee-a4c7-46a6-94a5-22ad27057f54 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:48.984282 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-edc92c28-60a5-4ede-803e-38a121390cf4 req-169c7aee-a4c7-46a6-94a5-22ad27057f54 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:48.998542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.compute.server_external_events [req-edc92c28-60a5-4ede-803e-38a121390cf4 req-169c7aee-a4c7-46a6-94a5-22ad27057f54 service nova] Unable to find a host for instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655. Dropping event network-vif-unplugged {{(pid=122488) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 27 04:00:48.999453 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-edc92c28-60a5-4ede-803e-38a121390cf4 req-169c7aee-a4c7-46a6-94a5-22ad27057f54 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033235 Aug 27 04:00:49.000058 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3833/7479] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 27 04:00:49.833886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f92fc4e6-339f-45c7-a1af-a74b514136a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:49.834512 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f92fc4e6-339f-45c7-a1af-a74b514136a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:49.841462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f92fc4e6-339f-45c7-a1af-a74b514136a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:49.841992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f92fc4e6-339f-45c7-a1af-a74b514136a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:49.842440 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f92fc4e6-339f-45c7-a1af-a74b514136a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:49.843151 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f92fc4e6-339f-45c7-a1af-a74b514136a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:49.843613 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f92fc4e6-339f-45c7-a1af-a74b514136a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:49.844305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f92fc4e6-339f-45c7-a1af-a74b514136a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:49.984787 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f92fc4e6-339f-45c7-a1af-a74b514136a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:49.993023 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f92fc4e6-339f-45c7-a1af-a74b514136a9 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1518 microversion: 2.1 time: 0.163679 Aug 27 04:00:49.993528 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3647/7480] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:49 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:51.015245 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-005d9c51-e2ee-4b7e-a9c0-a691985ae3b2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:51.015778 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-005d9c51-e2ee-4b7e-a9c0-a691985ae3b2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:51.023320 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-005d9c51-e2ee-4b7e-a9c0-a691985ae3b2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:51.023824 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-005d9c51-e2ee-4b7e-a9c0-a691985ae3b2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:51.024263 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-005d9c51-e2ee-4b7e-a9c0-a691985ae3b2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:51.024962 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-005d9c51-e2ee-4b7e-a9c0-a691985ae3b2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:51.025415 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-005d9c51-e2ee-4b7e-a9c0-a691985ae3b2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:51.025881 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-005d9c51-e2ee-4b7e-a9c0-a691985ae3b2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:51.158158 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-005d9c51-e2ee-4b7e-a9c0-a691985ae3b2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:51.166591 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-005d9c51-e2ee-4b7e-a9c0-a691985ae3b2 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1518 microversion: 2.1 time: 0.155389 Aug 27 04:00:51.167174 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3834/7481] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:51 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:52.187914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ab71df05-7732-42d7-91be-5ec25a16bcaf tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:52.188682 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ab71df05-7732-42d7-91be-5ec25a16bcaf tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:52.197322 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab71df05-7732-42d7-91be-5ec25a16bcaf tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:52.197861 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab71df05-7732-42d7-91be-5ec25a16bcaf tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:52.198317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab71df05-7732-42d7-91be-5ec25a16bcaf tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:52.199072 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab71df05-7732-42d7-91be-5ec25a16bcaf tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:52.199546 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab71df05-7732-42d7-91be-5ec25a16bcaf tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:52.199985 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ab71df05-7732-42d7-91be-5ec25a16bcaf tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:52.346818 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ab71df05-7732-42d7-91be-5ec25a16bcaf tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:52.355159 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ab71df05-7732-42d7-91be-5ec25a16bcaf tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1518 microversion: 2.1 time: 0.171156 Aug 27 04:00:52.355756 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3648/7482] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:52 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:53.376723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-e36c04e8-8a28-488c-9c0f-9ba7fa38b530 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:53.377268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-e36c04e8-8a28-488c-9c0f-9ba7fa38b530 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:53.384303 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c04e8-8a28-488c-9c0f-9ba7fa38b530 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:53.384785 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c04e8-8a28-488c-9c0f-9ba7fa38b530 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:53.385222 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c04e8-8a28-488c-9c0f-9ba7fa38b530 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:53.385953 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c04e8-8a28-488c-9c0f-9ba7fa38b530 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:53.386410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c04e8-8a28-488c-9c0f-9ba7fa38b530 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:53.386836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-e36c04e8-8a28-488c-9c0f-9ba7fa38b530 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:53.524896 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-e36c04e8-8a28-488c-9c0f-9ba7fa38b530 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:53.532769 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-e36c04e8-8a28-488c-9c0f-9ba7fa38b530 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1518 microversion: 2.1 time: 0.160001 Aug 27 04:00:53.533377 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3835/7483] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:53 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:54.555027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-1a29f525-29ed-439a-a556-e6a6d119933c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:54.555812 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-1a29f525-29ed-439a-a556-e6a6d119933c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:54.562728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a29f525-29ed-439a-a556-e6a6d119933c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:54.563224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a29f525-29ed-439a-a556-e6a6d119933c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:54.563681 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a29f525-29ed-439a-a556-e6a6d119933c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:54.564422 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a29f525-29ed-439a-a556-e6a6d119933c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:54.564889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a29f525-29ed-439a-a556-e6a6d119933c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:54.565328 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-1a29f525-29ed-439a-a556-e6a6d119933c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:54.709156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-1a29f525-29ed-439a-a556-e6a6d119933c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:54.717053 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-1a29f525-29ed-439a-a556-e6a6d119933c tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.166441 Aug 27 04:00:54.717631 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3649/7484] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:54 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:55.371314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-8770c249-824c-41ad-8b96-1f2810fd7b1f req-495b4cb6-df83-478e-aef3-52b8f24e1d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d608bcc-bdc7-4367-b660-2bb0e6e47655", "tag": "5d23dd7f-fefd-4bec-92b6-126154c9dd62"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:00:55.382713 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8770c249-824c-41ad-8b96-1f2810fd7b1f req-495b4cb6-df83-478e-aef3-52b8f24e1d72 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:55.383200 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8770c249-824c-41ad-8b96-1f2810fd7b1f req-495b4cb6-df83-478e-aef3-52b8f24e1d72 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:55.383649 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8770c249-824c-41ad-8b96-1f2810fd7b1f req-495b4cb6-df83-478e-aef3-52b8f24e1d72 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:55.396502 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-8770c249-824c-41ad-8b96-1f2810fd7b1f req-495b4cb6-df83-478e-aef3-52b8f24e1d72 service nova] Creating event network-changed:5d23dd7f-fefd-4bec-92b6-126154c9dd62 for instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 on n-h2-852084-5 Aug 27 04:00:55.402398 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-8770c249-824c-41ad-8b96-1f2810fd7b1f req-495b4cb6-df83-478e-aef3-52b8f24e1d72 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034446 Aug 27 04:00:55.403025 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3836/7485] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:00:55.739856 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-b5242d8c-3415-4951-be22-94dfda01a419 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:55.741140 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-b5242d8c-3415-4951-be22-94dfda01a419 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:55.748298 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5242d8c-3415-4951-be22-94dfda01a419 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:55.748811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5242d8c-3415-4951-be22-94dfda01a419 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:55.749269 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5242d8c-3415-4951-be22-94dfda01a419 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:55.750024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5242d8c-3415-4951-be22-94dfda01a419 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:55.750503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5242d8c-3415-4951-be22-94dfda01a419 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:55.750955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-b5242d8c-3415-4951-be22-94dfda01a419 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:55.888523 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-b5242d8c-3415-4951-be22-94dfda01a419 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:55.896971 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-b5242d8c-3415-4951-be22-94dfda01a419 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.161530 Aug 27 04:00:55.897563 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3650/7486] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:55 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:56.919359 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-4907a6f0-5c7c-4119-8389-814fcdb06085 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:56.920077 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-4907a6f0-5c7c-4119-8389-814fcdb06085 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:56.927867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4907a6f0-5c7c-4119-8389-814fcdb06085 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:56.928363 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4907a6f0-5c7c-4119-8389-814fcdb06085 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:56.928811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4907a6f0-5c7c-4119-8389-814fcdb06085 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:56.929518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4907a6f0-5c7c-4119-8389-814fcdb06085 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:56.930011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4907a6f0-5c7c-4119-8389-814fcdb06085 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:56.930450 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-4907a6f0-5c7c-4119-8389-814fcdb06085 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:57.065836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-4907a6f0-5c7c-4119-8389-814fcdb06085 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:57.074717 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-4907a6f0-5c7c-4119-8389-814fcdb06085 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.159640 Aug 27 04:00:57.075303 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3837/7487] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:56 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:58.096470 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-da8ba621-7be6-47f0-b386-5bd0003f1d9a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:58.097013 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-da8ba621-7be6-47f0-b386-5bd0003f1d9a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:58.104279 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da8ba621-7be6-47f0-b386-5bd0003f1d9a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:58.104783 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da8ba621-7be6-47f0-b386-5bd0003f1d9a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:58.105239 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da8ba621-7be6-47f0-b386-5bd0003f1d9a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:58.105984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da8ba621-7be6-47f0-b386-5bd0003f1d9a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:58.106462 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da8ba621-7be6-47f0-b386-5bd0003f1d9a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:58.106909 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-da8ba621-7be6-47f0-b386-5bd0003f1d9a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:58.247726 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-da8ba621-7be6-47f0-b386-5bd0003f1d9a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:58.256357 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-da8ba621-7be6-47f0-b386-5bd0003f1d9a tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.164115 Aug 27 04:00:58.256960 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3651/7488] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:58 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:00:59.277905 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b5c8084a-22dc-4bb9-808e-fc46312a0992 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:00:59.278519 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b5c8084a-22dc-4bb9-808e-fc46312a0992 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:00:59.285422 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5c8084a-22dc-4bb9-808e-fc46312a0992 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:59.285944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5c8084a-22dc-4bb9-808e-fc46312a0992 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:59.286989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5c8084a-22dc-4bb9-808e-fc46312a0992 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:59.287685 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5c8084a-22dc-4bb9-808e-fc46312a0992 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:00:59.288141 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5c8084a-22dc-4bb9-808e-fc46312a0992 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:00:59.288576 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b5c8084a-22dc-4bb9-808e-fc46312a0992 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:00:59.421241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b5c8084a-22dc-4bb9-808e-fc46312a0992 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:00:59.429143 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b5c8084a-22dc-4bb9-808e-fc46312a0992 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.155204 Aug 27 04:00:59.429729 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3838/7489] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:00:59 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:01:00.450127 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-f7ef5457-f92f-4f85-b38f-75ef9a23e832 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:00.450772 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-f7ef5457-f92f-4f85-b38f-75ef9a23e832 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:00.457707 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef5457-f92f-4f85-b38f-75ef9a23e832 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:00.458246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef5457-f92f-4f85-b38f-75ef9a23e832 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:00.458700 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef5457-f92f-4f85-b38f-75ef9a23e832 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:00.459401 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef5457-f92f-4f85-b38f-75ef9a23e832 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:00.459866 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef5457-f92f-4f85-b38f-75ef9a23e832 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:00.460303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-f7ef5457-f92f-4f85-b38f-75ef9a23e832 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:00.600673 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-f7ef5457-f92f-4f85-b38f-75ef9a23e832 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:00.608674 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-f7ef5457-f92f-4f85-b38f-75ef9a23e832 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.162359 Aug 27 04:01:00.609194 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3652/7490] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:00 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:01.629753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8b61352d-c94b-41c0-ac8c-97f7fa8fa2d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:01.630990 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8b61352d-c94b-41c0-ac8c-97f7fa8fa2d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:01.638214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b61352d-c94b-41c0-ac8c-97f7fa8fa2d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:01.638723 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b61352d-c94b-41c0-ac8c-97f7fa8fa2d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:01.639219 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b61352d-c94b-41c0-ac8c-97f7fa8fa2d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:01.639867 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b61352d-c94b-41c0-ac8c-97f7fa8fa2d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:01.640321 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b61352d-c94b-41c0-ac8c-97f7fa8fa2d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:01.640753 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8b61352d-c94b-41c0-ac8c-97f7fa8fa2d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:02.099577 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8b61352d-c94b-41c0-ac8c-97f7fa8fa2d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:02.103192 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:02.108657 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8b61352d-c94b-41c0-ac8c-97f7fa8fa2d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.482842 Aug 27 04:01:02.109243 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3839/7491] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:01 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:03.130835 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cc151f95-8125-4b92-aa7e-a0372a259270 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:03.131503 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cc151f95-8125-4b92-aa7e-a0372a259270 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:03.138418 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc151f95-8125-4b92-aa7e-a0372a259270 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:03.138923 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc151f95-8125-4b92-aa7e-a0372a259270 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:03.139381 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc151f95-8125-4b92-aa7e-a0372a259270 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:03.140097 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc151f95-8125-4b92-aa7e-a0372a259270 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:03.140572 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc151f95-8125-4b92-aa7e-a0372a259270 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:03.141017 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc151f95-8125-4b92-aa7e-a0372a259270 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:03.322958 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cc151f95-8125-4b92-aa7e-a0372a259270 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:03.330872 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cc151f95-8125-4b92-aa7e-a0372a259270 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.204078 Aug 27 04:01:03.331448 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3653/7492] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:03 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:04.352995 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-481f6327-cf44-484a-9a8e-b8a5f242b705 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:04.353528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-481f6327-cf44-484a-9a8e-b8a5f242b705 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:04.356863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:04.363417 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-481f6327-cf44-484a-9a8e-b8a5f242b705 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:04.363907 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-481f6327-cf44-484a-9a8e-b8a5f242b705 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:04.364354 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-481f6327-cf44-484a-9a8e-b8a5f242b705 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:04.365065 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-481f6327-cf44-484a-9a8e-b8a5f242b705 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:04.365531 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-481f6327-cf44-484a-9a8e-b8a5f242b705 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:04.365989 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-481f6327-cf44-484a-9a8e-b8a5f242b705 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:04.498477 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-481f6327-cf44-484a-9a8e-b8a5f242b705 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:04.506430 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-481f6327-cf44-484a-9a8e-b8a5f242b705 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.157451 Aug 27 04:01:04.507024 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3840/7493] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:04 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:05.528137 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-84f49b77-ff54-4877-8118-a0001896a7fc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:05.528765 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-84f49b77-ff54-4877-8118-a0001896a7fc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:05.531449 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=31 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:05.537612 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84f49b77-ff54-4877-8118-a0001896a7fc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:05.538305 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84f49b77-ff54-4877-8118-a0001896a7fc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:05.538820 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84f49b77-ff54-4877-8118-a0001896a7fc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:05.539731 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84f49b77-ff54-4877-8118-a0001896a7fc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:05.540299 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84f49b77-ff54-4877-8118-a0001896a7fc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:05.540780 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-84f49b77-ff54-4877-8118-a0001896a7fc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:05.543715 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=91 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:01:05.675763 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-84f49b77-ff54-4877-8118-a0001896a7fc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:05.684316 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-84f49b77-ff54-4877-8118-a0001896a7fc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.160061 Aug 27 04:01:05.684895 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3654/7494] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:05 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:06.705727 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-7fd7e499-782d-40e9-866f-32aa55a0c0f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:06.706353 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-7fd7e499-782d-40e9-866f-32aa55a0c0f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:06.713599 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fd7e499-782d-40e9-866f-32aa55a0c0f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:06.714120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fd7e499-782d-40e9-866f-32aa55a0c0f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:06.714568 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fd7e499-782d-40e9-866f-32aa55a0c0f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:06.715281 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fd7e499-782d-40e9-866f-32aa55a0c0f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:06.715748 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fd7e499-782d-40e9-866f-32aa55a0c0f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:06.716179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-7fd7e499-782d-40e9-866f-32aa55a0c0f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:06.849659 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-7fd7e499-782d-40e9-866f-32aa55a0c0f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:06.857490 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-7fd7e499-782d-40e9-866f-32aa55a0c0f0 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.155724 Aug 27 04:01:06.858111 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3841/7495] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:06 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:06.877390 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-aa28b9d8-27e8-4c9a-b837-ad3b18297664 req-73cee060-928c-4e5b-bd58-3defcc953af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d608bcc-bdc7-4367-b660-2bb0e6e47655", "name": "network-vif-plugged", "status": "completed", "tag": "5d23dd7f-fefd-4bec-92b6-126154c9dd62"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:01:06.888575 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-aa28b9d8-27e8-4c9a-b837-ad3b18297664 req-73cee060-928c-4e5b-bd58-3defcc953af8 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:06.889074 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-aa28b9d8-27e8-4c9a-b837-ad3b18297664 req-73cee060-928c-4e5b-bd58-3defcc953af8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:06.889521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-aa28b9d8-27e8-4c9a-b837-ad3b18297664 req-73cee060-928c-4e5b-bd58-3defcc953af8 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:06.900885 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-aa28b9d8-27e8-4c9a-b837-ad3b18297664 req-73cee060-928c-4e5b-bd58-3defcc953af8 service nova] Creating event network-vif-plugged:5d23dd7f-fefd-4bec-92b6-126154c9dd62 for instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 on n-h2-852084-5 Aug 27 04:01:06.904394 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [req-aa28b9d8-27e8-4c9a-b837-ad3b18297664 req-73cee060-928c-4e5b-bd58-3defcc953af8 service nova] [6f39c558-4c8b-4454-92db-905e04da491a] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:01:07.881626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-531091a2-7376-4723-a85d-e482981335cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:07.882275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-531091a2-7376-4723-a85d-e482981335cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:07.889179 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-531091a2-7376-4723-a85d-e482981335cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:07.889681 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-531091a2-7376-4723-a85d-e482981335cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:07.890182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-531091a2-7376-4723-a85d-e482981335cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:07.890870 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-531091a2-7376-4723-a85d-e482981335cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:07.891330 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-531091a2-7376-4723-a85d-e482981335cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:07.891761 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-531091a2-7376-4723-a85d-e482981335cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:07.913155 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [req-aa28b9d8-27e8-4c9a-b837-ad3b18297664 req-73cee060-928c-4e5b-bd58-3defcc953af8 service nova] [6f39c558-4c8b-4454-92db-905e04da491a] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 55446. Aug 27 04:01:07.917260 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-aa28b9d8-27e8-4c9a-b837-ad3b18297664 req-73cee060-928c-4e5b-bd58-3defcc953af8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.043939 Aug 27 04:01:07.918268 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3655/7496] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:08.045166 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-531091a2-7376-4723-a85d-e482981335cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:08.054461 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-531091a2-7376-4723-a85d-e482981335cc tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.177116 Aug 27 04:01:08.055073 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3842/7497] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:07 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:09.078034 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-88fffc15-d6fa-42cf-911b-3c04cd3591d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:09.078758 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-88fffc15-d6fa-42cf-911b-3c04cd3591d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:09.087019 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88fffc15-d6fa-42cf-911b-3c04cd3591d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:09.087531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88fffc15-d6fa-42cf-911b-3c04cd3591d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:09.087992 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88fffc15-d6fa-42cf-911b-3c04cd3591d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:09.088712 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88fffc15-d6fa-42cf-911b-3c04cd3591d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:09.089184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88fffc15-d6fa-42cf-911b-3c04cd3591d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:09.089630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-88fffc15-d6fa-42cf-911b-3c04cd3591d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:09.235289 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-88fffc15-d6fa-42cf-911b-3c04cd3591d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:09.243579 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-88fffc15-d6fa-42cf-911b-3c04cd3591d6 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1574 microversion: 2.1 time: 0.170614 Aug 27 04:01:09.244521 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3656/7498] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:09 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:01:10.266211 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-165d5e14-d9f7-46ea-8f0f-0639b9b9a42e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:10.266834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-165d5e14-d9f7-46ea-8f0f-0639b9b9a42e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:01:10.273958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-165d5e14-d9f7-46ea-8f0f-0639b9b9a42e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:10.274445 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-165d5e14-d9f7-46ea-8f0f-0639b9b9a42e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:10.274887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-165d5e14-d9f7-46ea-8f0f-0639b9b9a42e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:10.275592 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-165d5e14-d9f7-46ea-8f0f-0639b9b9a42e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:01:10.276049 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-165d5e14-d9f7-46ea-8f0f-0639b9b9a42e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:01:10.276479 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-165d5e14-d9f7-46ea-8f0f-0639b9b9a42e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:01:10.415964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-165d5e14-d9f7-46ea-8f0f-0639b9b9a42e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:01:10.423863 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-165d5e14-d9f7-46ea-8f0f-0639b9b9a42e tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1561 microversion: 2.1 time: 0.161693 Aug 27 04:01:10.424445 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3843/7499] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:01:10 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:27.074526 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-73aa1740-20ce-4517-9dd4-21a38c25afa1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:27.075685 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-73aa1740-20ce-4517-9dd4-21a38c25afa1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:27.078157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=7 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:27.078568 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=5 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:27.079302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=24 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:27.079434 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=13 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:27.085996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73aa1740-20ce-4517-9dd4-21a38c25afa1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:27.086603 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73aa1740-20ce-4517-9dd4-21a38c25afa1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:27.087086 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73aa1740-20ce-4517-9dd4-21a38c25afa1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:27.087884 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73aa1740-20ce-4517-9dd4-21a38c25afa1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:27.088730 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73aa1740-20ce-4517-9dd4-21a38c25afa1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:27.089224 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-73aa1740-20ce-4517-9dd4-21a38c25afa1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:27.119626 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-73aa1740-20ce-4517-9dd4-21a38c25afa1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Going to try to terminate instance {{(pid=122487) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:02:27.141124 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2b085074-13e0-4f7d-81f3-467b8be91524 req-93adfd4a-163b-4297-ab70-be5dc9d86591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d608bcc-bdc7-4367-b660-2bb0e6e47655", "tag": "5d23dd7f-fefd-4bec-92b6-126154c9dd62"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:27.153332 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b085074-13e0-4f7d-81f3-467b8be91524 req-93adfd4a-163b-4297-ab70-be5dc9d86591 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:27.153937 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b085074-13e0-4f7d-81f3-467b8be91524 req-93adfd4a-163b-4297-ab70-be5dc9d86591 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:27.154434 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2b085074-13e0-4f7d-81f3-467b8be91524 req-93adfd4a-163b-4297-ab70-be5dc9d86591 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:27.167149 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2b085074-13e0-4f7d-81f3-467b8be91524 req-93adfd4a-163b-4297-ab70-be5dc9d86591 service nova] Creating event network-changed:5d23dd7f-fefd-4bec-92b6-126154c9dd62 for instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 on n-h2-852084-5 Aug 27 04:02:27.173078 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2b085074-13e0-4f7d-81f3-467b8be91524 req-93adfd4a-163b-4297-ab70-be5dc9d86591 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101261 Aug 27 04:02:27.174090 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3844/7500] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:02:27.214954 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-73aa1740-20ce-4517-9dd4-21a38c25afa1 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 204 len: 0 microversion: 2.1 time: 0.145162 Aug 27 04:02:27.217422 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3657/7501] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 04:02:27 2022] DELETE /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:02:27.227411 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-6c403fda-f35b-433e-96ea-291ad681ae16 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:27.228255 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-6c403fda-f35b-433e-96ea-291ad681ae16 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:27.237805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c403fda-f35b-433e-96ea-291ad681ae16 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:27.238409 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c403fda-f35b-433e-96ea-291ad681ae16 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:27.239073 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c403fda-f35b-433e-96ea-291ad681ae16 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:27.240035 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c403fda-f35b-433e-96ea-291ad681ae16 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:27.240497 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c403fda-f35b-433e-96ea-291ad681ae16 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:27.241094 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-6c403fda-f35b-433e-96ea-291ad681ae16 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:27.388591 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-6c403fda-f35b-433e-96ea-291ad681ae16 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:27.398907 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-6c403fda-f35b-433e-96ea-291ad681ae16 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.176136 Aug 27 04:02:27.399508 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3845/7502] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:27 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:02:28.420524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-30cd0ab3-4e47-4331-960d-c71829202930 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:28.421353 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-30cd0ab3-4e47-4331-960d-c71829202930 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:28.428486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30cd0ab3-4e47-4331-960d-c71829202930 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:28.428984 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30cd0ab3-4e47-4331-960d-c71829202930 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:28.429435 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30cd0ab3-4e47-4331-960d-c71829202930 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:28.430171 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30cd0ab3-4e47-4331-960d-c71829202930 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:28.430641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30cd0ab3-4e47-4331-960d-c71829202930 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:28.431084 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-30cd0ab3-4e47-4331-960d-c71829202930 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:28.563917 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-30cd0ab3-4e47-4331-960d-c71829202930 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:28.571615 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-30cd0ab3-4e47-4331-960d-c71829202930 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1567 microversion: 2.1 time: 0.155384 Aug 27 04:02:28.572191 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3658/7503] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:28 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:29.216398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-2a414cae-403d-40ca-8ef4-9ff7aab07f4f req-d3274072-a1f9-45e9-a490-b4c472c80fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d608bcc-bdc7-4367-b660-2bb0e6e47655", "name": "network-vif-deleted", "tag": "5d23dd7f-fefd-4bec-92b6-126154c9dd62"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:29.227478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2a414cae-403d-40ca-8ef4-9ff7aab07f4f req-d3274072-a1f9-45e9-a490-b4c472c80fb3 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:29.227964 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2a414cae-403d-40ca-8ef4-9ff7aab07f4f req-d3274072-a1f9-45e9-a490-b4c472c80fb3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:29.228410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-2a414cae-403d-40ca-8ef4-9ff7aab07f4f req-d3274072-a1f9-45e9-a490-b4c472c80fb3 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:29.239986 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-2a414cae-403d-40ca-8ef4-9ff7aab07f4f req-d3274072-a1f9-45e9-a490-b4c472c80fb3 service nova] Creating event network-vif-deleted:5d23dd7f-fefd-4bec-92b6-126154c9dd62 for instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 on n-h2-852084-5 Aug 27 04:02:29.244946 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-2a414cae-403d-40ca-8ef4-9ff7aab07f4f req-d3274072-a1f9-45e9-a490-b4c472c80fb3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032425 Aug 27 04:02:29.245491 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3846/7504] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:02:29.592587 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-28b33d51-91bb-4654-8bfd-ff967918923b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:29.593216 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-28b33d51-91bb-4654-8bfd-ff967918923b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:29.601020 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28b33d51-91bb-4654-8bfd-ff967918923b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:29.601531 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28b33d51-91bb-4654-8bfd-ff967918923b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:29.602035 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28b33d51-91bb-4654-8bfd-ff967918923b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:29.602769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28b33d51-91bb-4654-8bfd-ff967918923b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:29.603243 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28b33d51-91bb-4654-8bfd-ff967918923b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:29.604027 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-28b33d51-91bb-4654-8bfd-ff967918923b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:29.675697 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-28b33d51-91bb-4654-8bfd-ff967918923b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:29.683616 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-28b33d51-91bb-4654-8bfd-ff967918923b tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1218 microversion: 2.1 time: 0.094911 Aug 27 04:02:29.684743 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3659/7505] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:29 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:30.707079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d071a1b3-8c55-4fce-9961-d37cdbd3ee57 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:30.707762 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d071a1b3-8c55-4fce-9961-d37cdbd3ee57 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:30.714030 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d071a1b3-8c55-4fce-9961-d37cdbd3ee57 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:30.714528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d071a1b3-8c55-4fce-9961-d37cdbd3ee57 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:30.714969 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d071a1b3-8c55-4fce-9961-d37cdbd3ee57 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:30.715668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d071a1b3-8c55-4fce-9961-d37cdbd3ee57 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:30.716123 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d071a1b3-8c55-4fce-9961-d37cdbd3ee57 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:30.716546 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d071a1b3-8c55-4fce-9961-d37cdbd3ee57 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:30.784662 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d071a1b3-8c55-4fce-9961-d37cdbd3ee57 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:30.792845 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d071a1b3-8c55-4fce-9961-d37cdbd3ee57 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1218 microversion: 2.1 time: 0.090979 Aug 27 04:02:30.793776 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3847/7506] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:30 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:31.813978 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-dbc769aa-3d15-436a-a62b-2eaf88ca4d85 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:31.814630 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-dbc769aa-3d15-436a-a62b-2eaf88ca4d85 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:31.821425 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbc769aa-3d15-436a-a62b-2eaf88ca4d85 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:31.821950 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbc769aa-3d15-436a-a62b-2eaf88ca4d85 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:31.822395 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbc769aa-3d15-436a-a62b-2eaf88ca4d85 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:31.823092 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbc769aa-3d15-436a-a62b-2eaf88ca4d85 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:31.823551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbc769aa-3d15-436a-a62b-2eaf88ca4d85 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:31.823986 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-dbc769aa-3d15-436a-a62b-2eaf88ca4d85 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:31.885842 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-dbc769aa-3d15-436a-a62b-2eaf88ca4d85 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:31.893740 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-dbc769aa-3d15-436a-a62b-2eaf88ca4d85 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1218 microversion: 2.1 time: 0.083781 Aug 27 04:02:31.894312 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3660/7507] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:31 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:32.915037 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-11a85201-be57-440c-89cc-ba255bd6fe12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:32.915657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-11a85201-be57-440c-89cc-ba255bd6fe12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:32.922783 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a85201-be57-440c-89cc-ba255bd6fe12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:32.923275 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a85201-be57-440c-89cc-ba255bd6fe12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:32.923716 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a85201-be57-440c-89cc-ba255bd6fe12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:32.924424 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a85201-be57-440c-89cc-ba255bd6fe12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:32.924885 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a85201-be57-440c-89cc-ba255bd6fe12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:32.925319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-11a85201-be57-440c-89cc-ba255bd6fe12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:32.988234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-11a85201-be57-440c-89cc-ba255bd6fe12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f30e9b469854f43a1f4ae22ae8fe4e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121b03bce5744ea9aded67cc1c5c277b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:32.996700 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-11a85201-be57-440c-89cc-ba255bd6fe12 tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 200 len: 1218 microversion: 2.1 time: 0.085160 Aug 27 04:02:32.997287 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3848/7508] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:32 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:34.018022 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:34.018571 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] [instance: 5d608bcc-bdc7-4367-b660-2bb0e6e47655] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:34.025472 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:34.026007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:34.026473 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:34.027191 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:34.027672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:34.028121 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:34.041617 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] HTTP exception thrown: Instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 could not be found. Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Request method failure captured: Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 HTTP/1.1 Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZVKUe8yBa7VI_oyBLtWV1rAFHogBtf9Rj1gIuKxxIm_7fTWmNuNiPnAKREI6qewM9K4d_NV5afgCYLdqPvB9INUD1mjQ-G8xaVDR5Ho9qBvbRjoDH1bx4ThXpxbeOU_OD4xnIiDZCdCUo2jOiHns-80kg70KfQWsx0wfkNCB_Cdjnc Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 121b03bce5744ea9aded67cc1c5c277b Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestShelveInstance-166240906 Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_121b03bce5744ea9aded67cc1c5c277b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/121b03bce5744ea9aded67cc1c5c277b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/121b03bce5744ea9aded67cc1c5c277b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/121b03bce5744ea9aded67cc1c5c277b"}]}] Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestShelveInstance-166240906 Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 121b03bce5744ea9aded67cc1c5c277b Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestShelveInstance-166240906 Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestShelveInstance-166240906-project Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: 0f30e9b469854f43a1f4ae22ae8fe4e9 Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestShelveInstance-166240906-project Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 could not be found. Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '5d608bcc-bdc7-4367-b660-2bb0e6e47655'} Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 could not be found. Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 could not be found. Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:02:34.043854 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:02:34.048409 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:02:34.048409 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:02:34.048409 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:02:34.048409 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:02:34.048409 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:02:34.048409 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 could not be found. Aug 27 04:02:34.048409 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:02:34.048409 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Returning 404 to user: Instance 5d608bcc-bdc7-4367-b660-2bb0e6e47655 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:02:34.048409 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2c2c2ca0-54d3-4e69-bba9-d422787460de tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655" status: 404 len: 111 microversion: 2.1 time: 0.031409 Aug 27 04:02:34.048409 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3661/7509] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:34 2022] GET /compute/v2.1/servers/5d608bcc-bdc7-4367-b660-2bb0e6e47655 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:02:34.228220 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-276488ac-a204-4e93-be8c-c417ee40f37f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] Calling method '.version_select at 0x7f4d294bd3a0>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:34.256832 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-276488ac-a204-4e93-be8c-c417ee40f37f tempest-TestShelveInstance-166240906 tempest-TestShelveInstance-166240906-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-229985174" status: 202 len: 0 microversion: 2.1 time: 0.032722 Aug 27 04:02:34.257575 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3849/7510] 10.222.0.99 () {58 vars in 1251 bytes} [Sat Aug 27 04:02:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-229985174 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:02:51.710155 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:51.710914 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:51.911604 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3c7b5ce0-a2f0-4cb0-a243-d6962ba81003 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Action: 'create', calling method: .version_select at 0x7f4d29ab8670>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1710461830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDrrPxtuTmiFVSnpMw+V2jJqp0ds31+rBYb9PDHbXia7JV9+Sf05v/8C7sOr6YIJisHgcwVbYBbg8RRYl2qvMbJSfbSWyAMEuQZ21I6gyAj2c/EijHRWNrUdsp7Y8g5Fg=="}} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:51.929441 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-3c7b5ce0-a2f0-4cb0-a243-d6962ba81003 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Getting quotas for project 191c30ef589040a58c314da57810285e. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:02:51.935388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.quota [None req-3c7b5ce0-a2f0-4cb0-a243-d6962ba81003 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Getting quotas for user d81a574e4c4f4f8b920f68192c80c0b2 and project 191c30ef589040a58c314da57810285e. Resources: {'key_pairs'} {{(pid=122487) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:02:51.971509 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3c7b5ce0-a2f0-4cb0-a243-d6962ba81003 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.266644 Aug 27 04:02:51.972111 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3662/7511] 10.222.0.99 () {60 vars in 1159 bytes} [Sat Aug 27 04:02:51 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:02:52.961241 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=22 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:52.962118 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:02:52.967657 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2103067029", "imageRef": "6230fa40-aadc-49b6-823d-ddde81ab4f89", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1710461830", "security_groups": [{"name": "tempest-secgroup-smoke-619625504"}], "networks": [{"uuid": "29125594-47e1-44e5-92f9-8c7b9471c854"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:53.075578 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] validate_networks() for [('29125594-47e1-44e5-92f9-8c7b9471c854', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:02:53.560638 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:02:53.561100 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:02:53.561580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:02:53.562022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:02:53.562441 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:02:53.572000 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:53.572491 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:53.572933 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:53.574186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:53.574651 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:53.575079 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:53.596585 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Getting quotas for project 191c30ef589040a58c314da57810285e. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:02:53.601986 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Getting quotas for user d81a574e4c4f4f8b920f68192c80c0b2 and project 191c30ef589040a58c314da57810285e. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:02:53.614524 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:02:53.616840 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6230fa40-aadc-49b6-823d-ddde81ab4f89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:02:53.664708 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3d7c706a-776a-4c65-bca9-da205b37f64a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.705190 Aug 27 04:02:53.665655 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3850/7512] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 04:02:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:02:53.676579 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-45ffa805-ecef-44ba-a824-1cfdbf7048d9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:53.677475 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-45ffa805-ecef-44ba-a824-1cfdbf7048d9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:53.753545 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-45ffa805-ecef-44ba-a824-1cfdbf7048d9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:53.764135 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-45ffa805-ecef-44ba-a824-1cfdbf7048d9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1249 microversion: 2.1 time: 0.090756 Aug 27 04:02:53.764735 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3663/7513] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:53 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:54.785547 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-db739363-2273-4707-a606-e412fdd3b993 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:54.786210 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-db739363-2273-4707-a606-e412fdd3b993 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:54.792712 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db739363-2273-4707-a606-e412fdd3b993 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:54.793212 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db739363-2273-4707-a606-e412fdd3b993 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:54.793660 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db739363-2273-4707-a606-e412fdd3b993 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:54.794483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db739363-2273-4707-a606-e412fdd3b993 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:54.794951 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db739363-2273-4707-a606-e412fdd3b993 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:54.795388 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-db739363-2273-4707-a606-e412fdd3b993 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:54.865011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-db739363-2273-4707-a606-e412fdd3b993 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:54.874018 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-db739363-2273-4707-a606-e412fdd3b993 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1301 microversion: 2.1 time: 0.093229 Aug 27 04:02:54.874544 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3851/7514] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:54 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:55.903937 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-3a8e07e4-d507-4ad9-83a5-c36f6cd39af8 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:55.904582 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-3a8e07e4-d507-4ad9-83a5-c36f6cd39af8 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:55.911639 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8e07e4-d507-4ad9-83a5-c36f6cd39af8 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:55.912149 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8e07e4-d507-4ad9-83a5-c36f6cd39af8 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:55.912610 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8e07e4-d507-4ad9-83a5-c36f6cd39af8 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:55.913332 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8e07e4-d507-4ad9-83a5-c36f6cd39af8 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:55.914057 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8e07e4-d507-4ad9-83a5-c36f6cd39af8 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:55.914510 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-3a8e07e4-d507-4ad9-83a5-c36f6cd39af8 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:56.133339 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-3a8e07e4-d507-4ad9-83a5-c36f6cd39af8 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:56.142626 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-3a8e07e4-d507-4ad9-83a5-c36f6cd39af8 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1374 microversion: 2.1 time: 0.249109 Aug 27 04:02:56.145809 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3664/7515] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:55 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1374 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:56.389238 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [req-8e98f755-48d6-42b3-8973-c42c70d3ea81 req-7462d9c9-4e3f-4cdb-b8d7-4eb9c313af02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403d874f-f492-4385-9357-0cfb921280ef", "tag": "e611ef6b-18b8-432b-b099-d713b62b2ebb"}]} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:02:56.404478 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8e98f755-48d6-42b3-8973-c42c70d3ea81 req-7462d9c9-4e3f-4cdb-b8d7-4eb9c313af02 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:56.404963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8e98f755-48d6-42b3-8973-c42c70d3ea81 req-7462d9c9-4e3f-4cdb-b8d7-4eb9c313af02 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:56.405398 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [req-8e98f755-48d6-42b3-8973-c42c70d3ea81 req-7462d9c9-4e3f-4cdb-b8d7-4eb9c313af02 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:56.416873 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.compute.server_external_events [req-8e98f755-48d6-42b3-8973-c42c70d3ea81 req-7462d9c9-4e3f-4cdb-b8d7-4eb9c313af02 service nova] Creating event network-changed:e611ef6b-18b8-432b-b099-d713b62b2ebb for instance 403d874f-f492-4385-9357-0cfb921280ef on n-h2-852084-5 Aug 27 04:02:56.423522 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [req-8e98f755-48d6-42b3-8973-c42c70d3ea81 req-7462d9c9-4e3f-4cdb-b8d7-4eb9c313af02 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041500 Aug 27 04:02:56.424536 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3852/7516] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:02:57.164406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-41059941-1041-4a82-ae70-463589454e67 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:57.165038 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-41059941-1041-4a82-ae70-463589454e67 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:57.172500 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41059941-1041-4a82-ae70-463589454e67 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:57.172996 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41059941-1041-4a82-ae70-463589454e67 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:57.173452 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41059941-1041-4a82-ae70-463589454e67 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:57.174188 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41059941-1041-4a82-ae70-463589454e67 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:57.174663 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41059941-1041-4a82-ae70-463589454e67 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:57.175109 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-41059941-1041-4a82-ae70-463589454e67 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:57.307003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-41059941-1041-4a82-ae70-463589454e67 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:57.315484 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-41059941-1041-4a82-ae70-463589454e67 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1374 microversion: 2.1 time: 0.154994 Aug 27 04:02:57.316058 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3665/7517] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:57 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:58.336324 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a1a21014-91e3-4afa-b829-6c1149d598c1 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:58.336944 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a1a21014-91e3-4afa-b829-6c1149d598c1 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:58.344670 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1a21014-91e3-4afa-b829-6c1149d598c1 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:58.345152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1a21014-91e3-4afa-b829-6c1149d598c1 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:58.345587 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1a21014-91e3-4afa-b829-6c1149d598c1 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:58.346313 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1a21014-91e3-4afa-b829-6c1149d598c1 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:58.346765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1a21014-91e3-4afa-b829-6c1149d598c1 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:58.347190 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a1a21014-91e3-4afa-b829-6c1149d598c1 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:58.486377 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a1a21014-91e3-4afa-b829-6c1149d598c1 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:58.494025 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a1a21014-91e3-4afa-b829-6c1149d598c1 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1374 microversion: 2.1 time: 0.162037 Aug 27 04:02:58.494599 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3853/7518] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:58 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:02:59.515751 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-cc537165-623f-4a58-bdb5-9e08e72a67c3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:02:59.516382 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-cc537165-623f-4a58-bdb5-9e08e72a67c3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:02:59.523203 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc537165-623f-4a58-bdb5-9e08e72a67c3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:59.523703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc537165-623f-4a58-bdb5-9e08e72a67c3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:59.524161 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc537165-623f-4a58-bdb5-9e08e72a67c3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:59.524874 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc537165-623f-4a58-bdb5-9e08e72a67c3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:02:59.525346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc537165-623f-4a58-bdb5-9e08e72a67c3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:02:59.525821 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-cc537165-623f-4a58-bdb5-9e08e72a67c3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:02:59.657829 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-cc537165-623f-4a58-bdb5-9e08e72a67c3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:02:59.665501 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-cc537165-623f-4a58-bdb5-9e08e72a67c3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1374 microversion: 2.1 time: 0.154238 Aug 27 04:02:59.666118 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3666/7519] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:02:59 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:00.686464 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-a81a9ad6-ff1b-4233-a0a0-128992f8bcdd tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:00.687091 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-a81a9ad6-ff1b-4233-a0a0-128992f8bcdd tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:00.695356 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a81a9ad6-ff1b-4233-a0a0-128992f8bcdd tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:00.696225 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a81a9ad6-ff1b-4233-a0a0-128992f8bcdd tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:00.697007 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a81a9ad6-ff1b-4233-a0a0-128992f8bcdd tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:00.698310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a81a9ad6-ff1b-4233-a0a0-128992f8bcdd tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:00.699128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a81a9ad6-ff1b-4233-a0a0-128992f8bcdd tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:00.699887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-a81a9ad6-ff1b-4233-a0a0-128992f8bcdd tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:00.836128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-a81a9ad6-ff1b-4233-a0a0-128992f8bcdd tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:00.844785 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-a81a9ad6-ff1b-4233-a0a0-128992f8bcdd tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1374 microversion: 2.1 time: 0.162310 Aug 27 04:03:00.845364 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3854/7520] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:00 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:01.601335 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-f25e271e-1d95-4099-aa8c-9966d259b366 req-7a87b567-f708-4372-8ca0-57d2b2c8d1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403d874f-f492-4385-9357-0cfb921280ef", "name": "network-vif-plugged", "status": "completed", "tag": "e611ef6b-18b8-432b-b099-d713b62b2ebb"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:01.612517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f25e271e-1d95-4099-aa8c-9966d259b366 req-7a87b567-f708-4372-8ca0-57d2b2c8d1c2 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:01.613003 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f25e271e-1d95-4099-aa8c-9966d259b366 req-7a87b567-f708-4372-8ca0-57d2b2c8d1c2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:01.613442 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-f25e271e-1d95-4099-aa8c-9966d259b366 req-7a87b567-f708-4372-8ca0-57d2b2c8d1c2 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:01.627384 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-f25e271e-1d95-4099-aa8c-9966d259b366 req-7a87b567-f708-4372-8ca0-57d2b2c8d1c2 service nova] Creating event network-vif-plugged:e611ef6b-18b8-432b-b099-d713b62b2ebb for instance 403d874f-f492-4385-9357-0cfb921280ef on n-h2-852084-5 Aug 27 04:03:01.632675 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-f25e271e-1d95-4099-aa8c-9966d259b366 req-7a87b567-f708-4372-8ca0-57d2b2c8d1c2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092965 Aug 27 04:03:01.633287 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3667/7521] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:03:01.865811 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-dc49783e-a45a-40d7-b1fe-0af920ac24af tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:01.866455 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-dc49783e-a45a-40d7-b1fe-0af920ac24af tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:01.873888 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc49783e-a45a-40d7-b1fe-0af920ac24af tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:01.874376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc49783e-a45a-40d7-b1fe-0af920ac24af tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:01.874810 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc49783e-a45a-40d7-b1fe-0af920ac24af tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:01.875493 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc49783e-a45a-40d7-b1fe-0af920ac24af tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:01.875943 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc49783e-a45a-40d7-b1fe-0af920ac24af tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:01.876367 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-dc49783e-a45a-40d7-b1fe-0af920ac24af tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:02.008349 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-dc49783e-a45a-40d7-b1fe-0af920ac24af tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:02.016662 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-dc49783e-a45a-40d7-b1fe-0af920ac24af tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1374 microversion: 2.1 time: 0.155069 Aug 27 04:03:02.017236 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3855/7522] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:01 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:03.039317 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0a5f0733-9614-40aa-8267-aa1768d2f218 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:03.040041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0a5f0733-9614-40aa-8267-aa1768d2f218 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:03.047873 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a5f0733-9614-40aa-8267-aa1768d2f218 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:03.048374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a5f0733-9614-40aa-8267-aa1768d2f218 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:03.048834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a5f0733-9614-40aa-8267-aa1768d2f218 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:03.049540 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a5f0733-9614-40aa-8267-aa1768d2f218 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:03.050044 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a5f0733-9614-40aa-8267-aa1768d2f218 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:03.050490 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a5f0733-9614-40aa-8267-aa1768d2f218 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:03.180824 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0a5f0733-9614-40aa-8267-aa1768d2f218 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:03.188565 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0a5f0733-9614-40aa-8267-aa1768d2f218 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1559 microversion: 2.1 time: 0.153581 Aug 27 04:03:03.189141 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3668/7523] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:03 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:03.208920 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-82d23b0f-217f-4958-a1e4-dcb2d12dc642 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:03.209536 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-82d23b0f-217f-4958-a1e4-dcb2d12dc642 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:03:03.216940 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82d23b0f-217f-4958-a1e4-dcb2d12dc642 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:03.217418 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82d23b0f-217f-4958-a1e4-dcb2d12dc642 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:03.217892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82d23b0f-217f-4958-a1e4-dcb2d12dc642 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:03.218582 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82d23b0f-217f-4958-a1e4-dcb2d12dc642 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:03.219309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82d23b0f-217f-4958-a1e4-dcb2d12dc642 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:03.219734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-82d23b0f-217f-4958-a1e4-dcb2d12dc642 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:03.352335 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-82d23b0f-217f-4958-a1e4-dcb2d12dc642 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:03.360200 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-82d23b0f-217f-4958-a1e4-dcb2d12dc642 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1559 microversion: 2.1 time: 0.155117 Aug 27 04:03:03.360777 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3856/7524] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:03:03 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:04.980838 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=6 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:03:05.035024 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-025a72ac-2ce4-451b-8017-7608a951dec8 req-995befb6-79f4-4c58-abbf-53fd298a174c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403d874f-f492-4385-9357-0cfb921280ef", "tag": "e611ef6b-18b8-432b-b099-d713b62b2ebb"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:05.044521 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-025a72ac-2ce4-451b-8017-7608a951dec8 req-995befb6-79f4-4c58-abbf-53fd298a174c service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:03:05.045015 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-025a72ac-2ce4-451b-8017-7608a951dec8 req-995befb6-79f4-4c58-abbf-53fd298a174c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:03:05.045460 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-025a72ac-2ce4-451b-8017-7608a951dec8 req-995befb6-79f4-4c58-abbf-53fd298a174c service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:03:05.057102 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-025a72ac-2ce4-451b-8017-7608a951dec8 req-995befb6-79f4-4c58-abbf-53fd298a174c service nova] Creating event network-changed:e611ef6b-18b8-432b-b099-d713b62b2ebb for instance 403d874f-f492-4385-9357-0cfb921280ef on n-h2-852084-5 Aug 27 04:03:05.062932 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-025a72ac-2ce4-451b-8017-7608a951dec8 req-995befb6-79f4-4c58-abbf-53fd298a174c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086578 Aug 27 04:03:05.063539 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3669/7525] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:57.642084 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2a984f1-fecc-4493-b1c3-f7a871d4cd60] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:04:57.643175 n-d-852084-5 devstack@n-api.service[122488]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dce2f75-e4fe-43f3-8eba-2057b586517f] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:04:57.643542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:57.644298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:57.645048 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:57.645838 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=34 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:04:57.650845 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-68ad8e9c-a852-4010-b6e3-5d94159e0675 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-980405337"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:57.653156 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-68ad8e9c-a852-4010-b6e3-5d94159e0675 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:04:57.661483 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68ad8e9c-a852-4010-b6e3-5d94159e0675 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:57.662002 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68ad8e9c-a852-4010-b6e3-5d94159e0675 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:57.662449 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68ad8e9c-a852-4010-b6e3-5d94159e0675 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:57.663152 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68ad8e9c-a852-4010-b6e3-5d94159e0675 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:04:57.663616 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68ad8e9c-a852-4010-b6e3-5d94159e0675 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:04:57.664051 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68ad8e9c-a852-4010-b6e3-5d94159e0675 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:04:57.857604 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-68ad8e9c-a852-4010-b6e3-5d94159e0675 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "POST /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef/action" status: 202 len: 0 microversion: 2.1 time: 0.217294 Aug 27 04:04:57.858301 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3857/7526] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 04:04:57 2022] POST /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:05:04.161694 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:05:04.162753 n-d-852084-5 devstack@n-api.service[122487]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:05:04.163403 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:04.164287 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=28 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:04.165524 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:05:04.165711 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 04:05:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.99) !!! Aug 27 04:05:04.186887 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-c6f25af0-8a14-4156-b882-3b2a2eeab2ce req-670f3a4d-8c30-4e31-a8a0-11c8971ad3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403d874f-f492-4385-9357-0cfb921280ef", "name": "network-vif-plugged", "status": "completed", "tag": "e611ef6b-18b8-432b-b099-d713b62b2ebb"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:04.200548 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c6f25af0-8a14-4156-b882-3b2a2eeab2ce req-670f3a4d-8c30-4e31-a8a0-11c8971ad3aa service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:04.201055 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c6f25af0-8a14-4156-b882-3b2a2eeab2ce req-670f3a4d-8c30-4e31-a8a0-11c8971ad3aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:04.201517 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-c6f25af0-8a14-4156-b882-3b2a2eeab2ce req-670f3a4d-8c30-4e31-a8a0-11c8971ad3aa service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:04.217400 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-c6f25af0-8a14-4156-b882-3b2a2eeab2ce req-670f3a4d-8c30-4e31-a8a0-11c8971ad3aa service nova] Creating event network-vif-plugged:e611ef6b-18b8-432b-b099-d713b62b2ebb for instance 403d874f-f492-4385-9357-0cfb921280ef on n-h2-852084-5 Aug 27 04:05:04.227487 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-c6f25af0-8a14-4156-b882-3b2a2eeab2ce req-670f3a4d-8c30-4e31-a8a0-11c8971ad3aa service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065975 Aug 27 04:05:04.228504 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3670/7527] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:05:11.400480 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:11.401314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:11.406112 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2052946564", "imageRef": "5441b598-21ab-4d07-98e8-1355fb8fb630", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1710461830", "security_groups": [{"name": "tempest-secgroup-smoke-619625504"}], "networks": [{"uuid": "29125594-47e1-44e5-92f9-8c7b9471c854"}]}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:11.431520 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2a984f1-fecc-4493-b1c3-f7a871d4cd60] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 55854. Aug 27 04:05:11.435568 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dce2f75-e4fe-43f3-8eba-2057b586517f] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 55856. Aug 27 04:05:11.523186 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.network.neutron [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] validate_networks() for [('29125594-47e1-44e5-92f9-8c7b9471c854', None, None, None, None, None)] {{(pid=122488) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 27 04:05:11.892482 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Flavor limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:05:11.892936 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Image limits 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:05:11.893443 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Flavor pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:05:11.893887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Image pref 0:0:0 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:05:11.894301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.virt.hardware [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122488) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:05:11.903191 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:11.903669 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:11.904137 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:11.904863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:11.905319 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:11.905772 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:11.922182 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Getting quotas for project 191c30ef589040a58c314da57810285e. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 27 04:05:11.927887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.quota [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Getting quotas for user d81a574e4c4f4f8b920f68192c80c0b2 and project 191c30ef589040a58c314da57810285e. Resources: {'cores', 'ram', 'instances'} {{(pid=122488) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 27 04:05:11.940624 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Going to run 1 instances... {{(pid=122488) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 27 04:05:11.943105 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5441b598-21ab-4d07-98e8-1355fb8fb630',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122488) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 27 04:05:11.988863 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-3144ac8b-957e-4ac5-b3eb-49a5075c8bb9 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.591917 Aug 27 04:05:11.989450 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3858/7528] 10.222.0.99 () {60 vars in 1147 bytes} [Sat Aug 27 04:05:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:05:12.002956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-fecd1531-861e-4d62-ba3d-be55d1a76de0 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:12.003890 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-fecd1531-861e-4d62-ba3d-be55d1a76de0 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:12.016329 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [e243818c-9303-4ce0-a352-b37990fce469] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 55872. Aug 27 04:05:12.023959 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] [f99600cc-051b-4739-8480-ea5d3361d80f] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 55870. Aug 27 04:05:12.081210 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-fecd1531-861e-4d62-ba3d-be55d1a76de0 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:12.088712 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-fecd1531-861e-4d62-ba3d-be55d1a76de0 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1249 microversion: 2.1 time: 0.092019 Aug 27 04:05:12.089298 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3671/7529] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:11 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:13.111879 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-17d9cbf0-cba7-4239-82b6-3a2c6eba654a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:13.112410 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-17d9cbf0-cba7-4239-82b6-3a2c6eba654a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:13.120693 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d9cbf0-cba7-4239-82b6-3a2c6eba654a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:13.121197 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d9cbf0-cba7-4239-82b6-3a2c6eba654a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:13.121644 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d9cbf0-cba7-4239-82b6-3a2c6eba654a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:13.122543 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d9cbf0-cba7-4239-82b6-3a2c6eba654a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:13.123508 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d9cbf0-cba7-4239-82b6-3a2c6eba654a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:13.124132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-17d9cbf0-cba7-4239-82b6-3a2c6eba654a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:13.202647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-17d9cbf0-cba7-4239-82b6-3a2c6eba654a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:13.210689 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-17d9cbf0-cba7-4239-82b6-3a2c6eba654a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1319 microversion: 2.1 time: 0.104720 Aug 27 04:05:13.211272 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3859/7530] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:13 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1319 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:14.235053 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ab2308c2-67ab-4681-8ca6-b12674a18800 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:14.236066 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-6e4f1540-815e-4f1d-883b-78dec64e7f65 req-7342e7fd-e5b0-4bff-83a4-e897cd0000ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403d874f-f492-4385-9357-0cfb921280ef", "name": "network-vif-unplugged", "status": "completed", "tag": "e611ef6b-18b8-432b-b099-d713b62b2ebb"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:14.240011 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ab2308c2-67ab-4681-8ca6-b12674a18800 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:14.250892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2308c2-67ab-4681-8ca6-b12674a18800 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:14.251384 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2308c2-67ab-4681-8ca6-b12674a18800 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:14.251828 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2308c2-67ab-4681-8ca6-b12674a18800 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:14.254627 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2308c2-67ab-4681-8ca6-b12674a18800 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:14.255432 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2308c2-67ab-4681-8ca6-b12674a18800 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:14.256143 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ab2308c2-67ab-4681-8ca6-b12674a18800 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:14.260889 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:14.265980 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6e4f1540-815e-4f1d-883b-78dec64e7f65 req-7342e7fd-e5b0-4bff-83a4-e897cd0000ee service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:14.266703 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6e4f1540-815e-4f1d-883b-78dec64e7f65 req-7342e7fd-e5b0-4bff-83a4-e897cd0000ee service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:14.267853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-6e4f1540-815e-4f1d-883b-78dec64e7f65 req-7342e7fd-e5b0-4bff-83a4-e897cd0000ee service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:14.280762 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-6e4f1540-815e-4f1d-883b-78dec64e7f65 req-7342e7fd-e5b0-4bff-83a4-e897cd0000ee service nova] Creating event network-vif-unplugged:e611ef6b-18b8-432b-b099-d713b62b2ebb for instance 403d874f-f492-4385-9357-0cfb921280ef on n-h2-852084-5 Aug 27 04:05:14.287784 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-6e4f1540-815e-4f1d-883b-78dec64e7f65 req-7342e7fd-e5b0-4bff-83a4-e897cd0000ee service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064369 Aug 27 04:05:14.288959 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3672/7531] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:14.439734 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ab2308c2-67ab-4681-8ca6-b12674a18800 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:14.448023 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ab2308c2-67ab-4681-8ca6-b12674a18800 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1374 microversion: 2.1 time: 0.219470 Aug 27 04:05:14.448855 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3860/7532] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:14 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1374 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:15.471843 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0164589b-fa84-4a53-a314-ad7cff9ea1b4 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:15.472690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0164589b-fa84-4a53-a314-ad7cff9ea1b4 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:15.479594 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0164589b-fa84-4a53-a314-ad7cff9ea1b4 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:15.480101 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0164589b-fa84-4a53-a314-ad7cff9ea1b4 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:15.480553 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0164589b-fa84-4a53-a314-ad7cff9ea1b4 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:15.481272 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0164589b-fa84-4a53-a314-ad7cff9ea1b4 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:15.482211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0164589b-fa84-4a53-a314-ad7cff9ea1b4 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:15.482211 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0164589b-fa84-4a53-a314-ad7cff9ea1b4 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:15.633784 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0164589b-fa84-4a53-a314-ad7cff9ea1b4 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:15.642875 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0164589b-fa84-4a53-a314-ad7cff9ea1b4 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1374 microversion: 2.1 time: 0.175833 Aug 27 04:05:15.644025 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3673/7533] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:15 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:16.664958 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-bb6fb82a-18b6-47c5-934e-c9a32b4af936 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:16.665594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-bb6fb82a-18b6-47c5-934e-c9a32b4af936 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:16.672629 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb6fb82a-18b6-47c5-934e-c9a32b4af936 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:16.673128 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb6fb82a-18b6-47c5-934e-c9a32b4af936 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:16.673647 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb6fb82a-18b6-47c5-934e-c9a32b4af936 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:16.674395 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb6fb82a-18b6-47c5-934e-c9a32b4af936 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:16.674860 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb6fb82a-18b6-47c5-934e-c9a32b4af936 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:16.675301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-bb6fb82a-18b6-47c5-934e-c9a32b4af936 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:16.844310 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-bb6fb82a-18b6-47c5-934e-c9a32b4af936 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:16.852524 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-bb6fb82a-18b6-47c5-934e-c9a32b4af936 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1374 microversion: 2.1 time: 0.191476 Aug 27 04:05:16.853508 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3861/7534] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:16 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1374 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:17.873957 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-4d9fddf4-678b-494f-9fae-9ca3e9c78caa tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:17.874728 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-4d9fddf4-678b-494f-9fae-9ca3e9c78caa tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:17.882275 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d9fddf4-678b-494f-9fae-9ca3e9c78caa tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:17.882925 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d9fddf4-678b-494f-9fae-9ca3e9c78caa tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:17.883956 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d9fddf4-678b-494f-9fae-9ca3e9c78caa tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:17.884421 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d9fddf4-678b-494f-9fae-9ca3e9c78caa tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:17.884903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d9fddf4-678b-494f-9fae-9ca3e9c78caa tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:17.885356 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-4d9fddf4-678b-494f-9fae-9ca3e9c78caa tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:18.032675 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-4d9fddf4-678b-494f-9fae-9ca3e9c78caa tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:18.041064 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-4d9fddf4-678b-494f-9fae-9ca3e9c78caa tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1374 microversion: 2.1 time: 0.171106 Aug 27 04:05:18.055135 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3674/7535] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:17 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:19.062550 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-8f776803-9489-4bbc-9f5d-2aa5fd47b842 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:19.063322 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-8f776803-9489-4bbc-9f5d-2aa5fd47b842 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:19.081853 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f776803-9489-4bbc-9f5d-2aa5fd47b842 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:19.082390 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f776803-9489-4bbc-9f5d-2aa5fd47b842 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:19.082863 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f776803-9489-4bbc-9f5d-2aa5fd47b842 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:19.083602 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f776803-9489-4bbc-9f5d-2aa5fd47b842 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:19.084086 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f776803-9489-4bbc-9f5d-2aa5fd47b842 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:19.084514 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-8f776803-9489-4bbc-9f5d-2aa5fd47b842 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:19.247518 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-8f776803-9489-4bbc-9f5d-2aa5fd47b842 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:19.255531 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-8f776803-9489-4bbc-9f5d-2aa5fd47b842 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1374 microversion: 2.1 time: 0.196796 Aug 27 04:05:19.256125 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3862/7536] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:19 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:20.276694 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0528b46f-6002-4c86-8fbf-ab421a2a4acc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:20.278139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0528b46f-6002-4c86-8fbf-ab421a2a4acc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:20.293310 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0528b46f-6002-4c86-8fbf-ab421a2a4acc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:20.293940 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0528b46f-6002-4c86-8fbf-ab421a2a4acc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:20.294467 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0528b46f-6002-4c86-8fbf-ab421a2a4acc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:20.295453 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0528b46f-6002-4c86-8fbf-ab421a2a4acc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:20.295998 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0528b46f-6002-4c86-8fbf-ab421a2a4acc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:20.296683 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0528b46f-6002-4c86-8fbf-ab421a2a4acc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:20.447994 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0528b46f-6002-4c86-8fbf-ab421a2a4acc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:20.456510 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0528b46f-6002-4c86-8fbf-ab421a2a4acc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1374 microversion: 2.1 time: 0.184036 Aug 27 04:05:20.457118 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3675/7537] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:20 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:21.479343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-fb6d2648-8215-4d91-8a64-281acb721643 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:21.480138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-fb6d2648-8215-4d91-8a64-281acb721643 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:21.486900 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6d2648-8215-4d91-8a64-281acb721643 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:21.487392 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6d2648-8215-4d91-8a64-281acb721643 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:21.487847 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6d2648-8215-4d91-8a64-281acb721643 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:21.488632 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6d2648-8215-4d91-8a64-281acb721643 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:21.489147 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6d2648-8215-4d91-8a64-281acb721643 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:21.489581 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-fb6d2648-8215-4d91-8a64-281acb721643 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:21.913532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:21.934724 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell0:SELECT=6 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:22.010268 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-fb6d2648-8215-4d91-8a64-281acb721643 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:22.019402 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-fb6d2648-8215-4d91-8a64-281acb721643 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1374 microversion: 2.1 time: 0.543887 Aug 27 04:05:22.031581 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3863/7538] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:21 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1374 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:22.245248 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-ac3295d8-cae9-4f7c-ae3a-58d86b76896e req-f6866013-a51a-4929-a0de-341e271ec7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173743a5-d0dd-4ef4-b10d-0a6660765e96", "tag": "43bbe5c1-ec2e-40f4-b45c-8b75021e046c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:22.258811 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell0:SELECT=2 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:05:22.262181 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ac3295d8-cae9-4f7c-ae3a-58d86b76896e req-f6866013-a51a-4929-a0de-341e271ec7eb service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:22.262805 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ac3295d8-cae9-4f7c-ae3a-58d86b76896e req-f6866013-a51a-4929-a0de-341e271ec7eb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:22.263333 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-ac3295d8-cae9-4f7c-ae3a-58d86b76896e req-f6866013-a51a-4929-a0de-341e271ec7eb service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:22.277796 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-ac3295d8-cae9-4f7c-ae3a-58d86b76896e req-f6866013-a51a-4929-a0de-341e271ec7eb service nova] Creating event network-changed:43bbe5c1-ec2e-40f4-b45c-8b75021e046c for instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 on n-h1-852084-5 Aug 27 04:05:22.284574 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-ac3295d8-cae9-4f7c-ae3a-58d86b76896e req-f6866013-a51a-4929-a0de-341e271ec7eb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044595 Aug 27 04:05:22.286368 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3676/7539] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:23.040603 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-606ffd8a-2b7b-4ed3-b005-713ae99cf7dc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:23.041234 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-606ffd8a-2b7b-4ed3-b005-713ae99cf7dc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:23.048950 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-606ffd8a-2b7b-4ed3-b005-713ae99cf7dc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:23.049489 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-606ffd8a-2b7b-4ed3-b005-713ae99cf7dc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:23.049961 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-606ffd8a-2b7b-4ed3-b005-713ae99cf7dc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:23.050668 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-606ffd8a-2b7b-4ed3-b005-713ae99cf7dc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:23.051132 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-606ffd8a-2b7b-4ed3-b005-713ae99cf7dc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:23.051567 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-606ffd8a-2b7b-4ed3-b005-713ae99cf7dc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:23.186357 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-606ffd8a-2b7b-4ed3-b005-713ae99cf7dc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:23.194138 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-606ffd8a-2b7b-4ed3-b005-713ae99cf7dc tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1374 microversion: 2.1 time: 0.157470 Aug 27 04:05:23.194719 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3864/7540] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:23 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:24.216168 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-ffbed950-7e56-4de9-82dc-acc611a9ad41 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:24.216878 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-ffbed950-7e56-4de9-82dc-acc611a9ad41 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:24.224676 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbed950-7e56-4de9-82dc-acc611a9ad41 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:24.225169 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbed950-7e56-4de9-82dc-acc611a9ad41 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:24.225624 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbed950-7e56-4de9-82dc-acc611a9ad41 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:24.226344 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbed950-7e56-4de9-82dc-acc611a9ad41 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:24.226809 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbed950-7e56-4de9-82dc-acc611a9ad41 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:24.227246 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-ffbed950-7e56-4de9-82dc-acc611a9ad41 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:24.365651 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-ffbed950-7e56-4de9-82dc-acc611a9ad41 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:24.373459 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-ffbed950-7e56-4de9-82dc-acc611a9ad41 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1374 microversion: 2.1 time: 0.161562 Aug 27 04:05:24.374059 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3677/7541] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:24 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:25.398925 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-c63ba0da-e24e-4e65-9066-bb674eb57284 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:25.399580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-c63ba0da-e24e-4e65-9066-bb674eb57284 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:25.406542 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63ba0da-e24e-4e65-9066-bb674eb57284 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:25.407029 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63ba0da-e24e-4e65-9066-bb674eb57284 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:25.407475 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63ba0da-e24e-4e65-9066-bb674eb57284 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:25.408172 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63ba0da-e24e-4e65-9066-bb674eb57284 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:25.408636 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63ba0da-e24e-4e65-9066-bb674eb57284 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:25.409068 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-c63ba0da-e24e-4e65-9066-bb674eb57284 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:25.544774 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-c63ba0da-e24e-4e65-9066-bb674eb57284 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:25.553327 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-c63ba0da-e24e-4e65-9066-bb674eb57284 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1374 microversion: 2.1 time: 0.158373 Aug 27 04:05:25.553945 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3865/7542] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:25 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:26.420444 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-7cb60a74-e37f-4dd1-8e45-e44126ddcc3f req-777726ad-9822-4a35-bad8-e4eb5a1ec67e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173743a5-d0dd-4ef4-b10d-0a6660765e96", "name": "network-vif-plugged", "status": "completed", "tag": "43bbe5c1-ec2e-40f4-b45c-8b75021e046c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:26.431045 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7cb60a74-e37f-4dd1-8e45-e44126ddcc3f req-777726ad-9822-4a35-bad8-e4eb5a1ec67e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:26.432329 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7cb60a74-e37f-4dd1-8e45-e44126ddcc3f req-777726ad-9822-4a35-bad8-e4eb5a1ec67e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:26.432853 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-7cb60a74-e37f-4dd1-8e45-e44126ddcc3f req-777726ad-9822-4a35-bad8-e4eb5a1ec67e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:26.444486 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-7cb60a74-e37f-4dd1-8e45-e44126ddcc3f req-777726ad-9822-4a35-bad8-e4eb5a1ec67e service nova] Creating event network-vif-plugged:43bbe5c1-ec2e-40f4-b45c-8b75021e046c for instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 on n-h1-852084-5 Aug 27 04:05:26.449385 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-7cb60a74-e37f-4dd1-8e45-e44126ddcc3f req-777726ad-9822-4a35-bad8-e4eb5a1ec67e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033001 Aug 27 04:05:26.450015 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3678/7543] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:05:26.574808 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-68134c0e-db3c-4777-a5a2-0ae2cf4c5151 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:26.575381 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-68134c0e-db3c-4777-a5a2-0ae2cf4c5151 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:26.583071 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68134c0e-db3c-4777-a5a2-0ae2cf4c5151 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:26.583569 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68134c0e-db3c-4777-a5a2-0ae2cf4c5151 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:26.584022 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68134c0e-db3c-4777-a5a2-0ae2cf4c5151 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:26.584737 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68134c0e-db3c-4777-a5a2-0ae2cf4c5151 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:26.585202 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68134c0e-db3c-4777-a5a2-0ae2cf4c5151 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:26.585641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-68134c0e-db3c-4777-a5a2-0ae2cf4c5151 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:26.725834 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-68134c0e-db3c-4777-a5a2-0ae2cf4c5151 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:26.733538 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-68134c0e-db3c-4777-a5a2-0ae2cf4c5151 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1374 microversion: 2.1 time: 0.162828 Aug 27 04:05:26.734149 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3866/7544] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:26 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:27.755388 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-e05ce4be-c57a-47b6-a2c1-81c281e2d226 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:27.756716 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-e05ce4be-c57a-47b6-a2c1-81c281e2d226 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:27.763860 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e05ce4be-c57a-47b6-a2c1-81c281e2d226 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:27.764362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e05ce4be-c57a-47b6-a2c1-81c281e2d226 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:27.764817 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e05ce4be-c57a-47b6-a2c1-81c281e2d226 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:27.765529 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e05ce4be-c57a-47b6-a2c1-81c281e2d226 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:27.766021 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e05ce4be-c57a-47b6-a2c1-81c281e2d226 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:27.766464 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-e05ce4be-c57a-47b6-a2c1-81c281e2d226 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:27.900952 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-e05ce4be-c57a-47b6-a2c1-81c281e2d226 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:27.909473 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-e05ce4be-c57a-47b6-a2c1-81c281e2d226 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1559 microversion: 2.1 time: 0.158864 Aug 27 04:05:27.910075 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3679/7545] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:27 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:27.929586 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-d82e88fe-c2ed-486a-bcd9-026a2af09d38 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:27.930254 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-d82e88fe-c2ed-486a-bcd9-026a2af09d38 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:05:27.937160 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d82e88fe-c2ed-486a-bcd9-026a2af09d38 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:27.937645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d82e88fe-c2ed-486a-bcd9-026a2af09d38 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:27.938119 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d82e88fe-c2ed-486a-bcd9-026a2af09d38 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:27.938846 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d82e88fe-c2ed-486a-bcd9-026a2af09d38 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:27.939309 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d82e88fe-c2ed-486a-bcd9-026a2af09d38 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:27.939740 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-d82e88fe-c2ed-486a-bcd9-026a2af09d38 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:28.070376 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-d82e88fe-c2ed-486a-bcd9-026a2af09d38 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:28.078214 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-d82e88fe-c2ed-486a-bcd9-026a2af09d38 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1559 microversion: 2.1 time: 0.152543 Aug 27 04:05:28.078793 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3867/7546] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:05:27 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:29.660283 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d1dafd94-e309-4a9b-92a3-c6542116dddb req-6628313b-0700-47b6-8be3-3dde95aa3729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173743a5-d0dd-4ef4-b10d-0a6660765e96", "tag": "43bbe5c1-ec2e-40f4-b45c-8b75021e046c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:29.670389 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d1dafd94-e309-4a9b-92a3-c6542116dddb req-6628313b-0700-47b6-8be3-3dde95aa3729 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:05:29.670894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d1dafd94-e309-4a9b-92a3-c6542116dddb req-6628313b-0700-47b6-8be3-3dde95aa3729 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:05:29.671346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d1dafd94-e309-4a9b-92a3-c6542116dddb req-6628313b-0700-47b6-8be3-3dde95aa3729 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:05:29.683210 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d1dafd94-e309-4a9b-92a3-c6542116dddb req-6628313b-0700-47b6-8be3-3dde95aa3729 service nova] Creating event network-changed:43bbe5c1-ec2e-40f4-b45c-8b75021e046c for instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 on n-h1-852084-5 Aug 27 04:05:29.688115 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d1dafd94-e309-4a9b-92a3-c6542116dddb req-6628313b-0700-47b6-8be3-3dde95aa3729 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032210 Aug 27 04:05:29.689327 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3680/7547] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:06:57.640302 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:57.641115 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=56 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:06:57.642657 n-d-852084-5 devstack@n-api.service[122488]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:06:57.643414 n-d-852084-5 devstack@n-api.service[122488]: Sat Aug 27 04:06:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96/action (ip 10.222.0.99) !!! Aug 27 04:06:57.648120 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-95d3ce60-f17f-409e-97fc-60ef86ee7042 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-778111703"}} {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:57.650590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-95d3ce60-f17f-409e-97fc-60ef86ee7042 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:06:57.660042 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95d3ce60-f17f-409e-97fc-60ef86ee7042 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:57.660532 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95d3ce60-f17f-409e-97fc-60ef86ee7042 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:57.660979 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95d3ce60-f17f-409e-97fc-60ef86ee7042 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:57.661759 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95d3ce60-f17f-409e-97fc-60ef86ee7042 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:06:57.662157 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95d3ce60-f17f-409e-97fc-60ef86ee7042 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:06:57.662593 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-95d3ce60-f17f-409e-97fc-60ef86ee7042 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:06:58.036402 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-95d3ce60-f17f-409e-97fc-60ef86ee7042 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "POST /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96/action" status: 202 len: 0 microversion: 2.1 time: 0.397894 Aug 27 04:06:58.037055 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3868/7548] 10.222.0.99 () {60 vars in 1278 bytes} [Sat Aug 27 04:06:57 2022] POST /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 27 04:07:04.860256 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_api:SELECT=24 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:04.863468 n-d-852084-5 devstack@n-api.service[122487]: DEBUG dbcounter [-] [122487] Writing DB stats nova_cell1:SELECT=38 {{(pid=122487) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:04.867615 n-d-852084-5 devstack@n-api.service[122487]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:07:04.868158 n-d-852084-5 devstack@n-api.service[122487]: Sat Aug 27 04:07:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.99) !!! Aug 27 04:07:04.885954 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-85e9c927-0694-4bb9-8f0c-5e20cd398f5f req-d82e38e0-3ce4-464a-b191-c7903188db38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173743a5-d0dd-4ef4-b10d-0a6660765e96", "name": "network-vif-plugged", "status": "completed", "tag": "43bbe5c1-ec2e-40f4-b45c-8b75021e046c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:04.913286 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-85e9c927-0694-4bb9-8f0c-5e20cd398f5f req-d82e38e0-3ce4-464a-b191-c7903188db38 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:04.914170 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-85e9c927-0694-4bb9-8f0c-5e20cd398f5f req-d82e38e0-3ce4-464a-b191-c7903188db38 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:04.914738 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-85e9c927-0694-4bb9-8f0c-5e20cd398f5f req-d82e38e0-3ce4-464a-b191-c7903188db38 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:04.932742 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-85e9c927-0694-4bb9-8f0c-5e20cd398f5f req-d82e38e0-3ce4-464a-b191-c7903188db38 service nova] Creating event network-vif-plugged:43bbe5c1-ec2e-40f4-b45c-8b75021e046c for instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 on n-h1-852084-5 Aug 27 04:07:04.938711 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-85e9c927-0694-4bb9-8f0c-5e20cd398f5f req-d82e38e0-3ce4-464a-b191-c7903188db38 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080179 Aug 27 04:07:04.941591 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3681/7549] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:07:11.916133 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_api:SELECT=2 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:11.917626 n-d-852084-5 devstack@n-api.service[122488]: DEBUG dbcounter [-] [122488] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 04:07:11.921116 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-315cae5b-f00b-415f-9cb1-96861b04e6c5 req-89da1ce6-d86a-4db6-bb83-6553ef945148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173743a5-d0dd-4ef4-b10d-0a6660765e96", "tag": "43bbe5c1-ec2e-40f4-b45c-8b75021e046c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:11.922798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-55a887dd-e013-4807-80f1-f81db4617ee3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:11.923435 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-55a887dd-e013-4807-80f1-f81db4617ee3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:11.931111 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-315cae5b-f00b-415f-9cb1-96861b04e6c5 req-89da1ce6-d86a-4db6-bb83-6553ef945148 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:11.931325 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55a887dd-e013-4807-80f1-f81db4617ee3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:11.931672 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-315cae5b-f00b-415f-9cb1-96861b04e6c5 req-89da1ce6-d86a-4db6-bb83-6553ef945148 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:11.931798 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55a887dd-e013-4807-80f1-f81db4617ee3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:11.932183 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55a887dd-e013-4807-80f1-f81db4617ee3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:11.932346 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-315cae5b-f00b-415f-9cb1-96861b04e6c5 req-89da1ce6-d86a-4db6-bb83-6553ef945148 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:11.933214 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55a887dd-e013-4807-80f1-f81db4617ee3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:11.934075 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55a887dd-e013-4807-80f1-f81db4617ee3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:11.934963 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-55a887dd-e013-4807-80f1-f81db4617ee3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:11.943875 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-315cae5b-f00b-415f-9cb1-96861b04e6c5 req-89da1ce6-d86a-4db6-bb83-6553ef945148 service nova] Creating event network-changed:43bbe5c1-ec2e-40f4-b45c-8b75021e046c for instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 on n-h1-852084-5 Aug 27 04:07:11.949627 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-315cae5b-f00b-415f-9cb1-96861b04e6c5 req-89da1ce6-d86a-4db6-bb83-6553ef945148 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034027 Aug 27 04:07:11.950276 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3682/7550] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:11.966892 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-55a887dd-e013-4807-80f1-f81db4617ee3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:07:12.057607 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-55a887dd-e013-4807-80f1-f81db4617ee3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "DELETE /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 204 len: 0 microversion: 2.1 time: 0.143536 Aug 27 04:07:12.058044 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3869/7551] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 04:07:11 2022] DELETE /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:07:12.068334 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-71ee9c02-60f0-4d48-9ca3-a14f81489a44 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:12.069093 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-71ee9c02-60f0-4d48-9ca3-a14f81489a44 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:12.076501 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ee9c02-60f0-4d48-9ca3-a14f81489a44 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:12.077156 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ee9c02-60f0-4d48-9ca3-a14f81489a44 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:12.077622 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ee9c02-60f0-4d48-9ca3-a14f81489a44 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:12.078374 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ee9c02-60f0-4d48-9ca3-a14f81489a44 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:12.078854 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ee9c02-60f0-4d48-9ca3-a14f81489a44 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:12.079303 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-71ee9c02-60f0-4d48-9ca3-a14f81489a44 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:12.284757 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-71ee9c02-60f0-4d48-9ca3-a14f81489a44 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:12.292691 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-71ee9c02-60f0-4d48-9ca3-a14f81489a44 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1683 microversion: 2.1 time: 0.230164 Aug 27 04:07:12.293268 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3683/7552] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:12 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1683 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:13.315835 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-b8ddc9cf-a050-46c3-be6c-e0d37df34f55 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:13.316458 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-b8ddc9cf-a050-46c3-be6c-e0d37df34f55 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:13.323280 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8ddc9cf-a050-46c3-be6c-e0d37df34f55 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:13.323765 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8ddc9cf-a050-46c3-be6c-e0d37df34f55 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:13.324199 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8ddc9cf-a050-46c3-be6c-e0d37df34f55 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:13.324887 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8ddc9cf-a050-46c3-be6c-e0d37df34f55 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:13.325340 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8ddc9cf-a050-46c3-be6c-e0d37df34f55 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:13.325795 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-b8ddc9cf-a050-46c3-be6c-e0d37df34f55 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:13.511571 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-b8ddc9cf-a050-46c3-be6c-e0d37df34f55 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:13.521050 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-b8ddc9cf-a050-46c3-be6c-e0d37df34f55 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1683 microversion: 2.1 time: 0.209573 Aug 27 04:07:13.521628 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3870/7553] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:13 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1683 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:14.172041 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-e4b86977-67c8-4318-bc3d-dd682de9958f req-6c5cc3bf-c8fa-4021-92e2-a3874bd520cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173743a5-d0dd-4ef4-b10d-0a6660765e96", "name": "network-vif-deleted", "tag": "43bbe5c1-ec2e-40f4-b45c-8b75021e046c"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:14.184834 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e4b86977-67c8-4318-bc3d-dd682de9958f req-6c5cc3bf-c8fa-4021-92e2-a3874bd520cf service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:14.186102 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e4b86977-67c8-4318-bc3d-dd682de9958f req-6c5cc3bf-c8fa-4021-92e2-a3874bd520cf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:14.186886 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-e4b86977-67c8-4318-bc3d-dd682de9958f req-6c5cc3bf-c8fa-4021-92e2-a3874bd520cf service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:14.204089 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-e4b86977-67c8-4318-bc3d-dd682de9958f req-6c5cc3bf-c8fa-4021-92e2-a3874bd520cf service nova] Creating event network-vif-deleted:43bbe5c1-ec2e-40f4-b45c-8b75021e046c for instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 on n-h1-852084-5 Aug 27 04:07:14.209907 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-e4b86977-67c8-4318-bc3d-dd682de9958f req-6c5cc3bf-c8fa-4021-92e2-a3874bd520cf service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041601 Aug 27 04:07:14.210546 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3684/7554] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:14.542298 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:14.542934 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:14.550836 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:14.551334 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:14.551786 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:14.552510 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:14.552973 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:14.553414 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:14.588138 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:14.588580 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:14.589026 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:14.589590 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lazy-loading 'fault' on Instance uuid 173743a5-d0dd-4ef4-b10d-0a6660765e96 {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:07:14.637189 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:14.645164 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-5373f579-29b9-4672-8a3b-5e827e9f7f59 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 200 len: 1339 microversion: 2.1 time: 0.106995 Aug 27 04:07:14.645766 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3871/7555] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:14 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 1339 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:15.667033 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:15.667693 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 173743a5-d0dd-4ef4-b10d-0a6660765e96] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:15.674803 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:15.675308 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:15.675769 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:15.676477 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:15.676955 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:15.677406 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:15.691101 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] HTTP exception thrown: Instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 could not be found. Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Request method failure captured: Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 HTTP/1.1 Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZdmeJMZgQXiJloaOrKg3SM6Atc0ZxqLL-dh3HYL9nf3vnkRMz1pwE_RVc1HkTtdOi7AwnNP9Ec8frX6QKlKvzg2DCIs_mLGrpj0O4f1AFy7NmbfSM9aPTGV_t6G6vdusfF8hxvpGVOnvI8vDCzC4SP_TWVkcAnWjB5XaWFnyDIehQ0 Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 191c30ef589040a58c314da57810285e Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestSnapshotPattern-1453110337 Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_191c30ef589040a58c314da57810285e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/191c30ef589040a58c314da57810285e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/191c30ef589040a58c314da57810285e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/191c30ef589040a58c314da57810285e"}]}] Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestSnapshotPattern-1453110337 Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 191c30ef589040a58c314da57810285e Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestSnapshotPattern-1453110337 Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestSnapshotPattern-1453110337-project Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d81a574e4c4f4f8b920f68192c80c0b2 Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestSnapshotPattern-1453110337-project Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 could not be found. Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '173743a5-d0dd-4ef4-b10d-0a6660765e96'} Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 could not be found. Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 could not be found. Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:07:15.692709 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:07:15.698457 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:15.698457 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:07:15.698457 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:07:15.698457 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:07:15.698457 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:07:15.698457 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 could not be found. Aug 27 04:07:15.698457 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:07:15.698457 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Returning 404 to user: Instance 173743a5-d0dd-4ef4-b10d-0a6660765e96 could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:07:15.698457 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-05fb47e8-97db-4cc2-869b-0cbb146b1160 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96" status: 404 len: 111 microversion: 2.1 time: 0.031538 Aug 27 04:07:15.698457 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3685/7556] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:15 2022] GET /compute/v2.1/servers/173743a5-d0dd-4ef4-b10d-0a6660765e96 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:07:17.030622 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-2b0f8812-18ef-47e7-b94a-ed5e938332fe tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:17.031676 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2b0f8812-18ef-47e7-b94a-ed5e938332fe tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:17.032486 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-d616428f-fa3e-4b75-b738-33bf03460580 req-3ac6f25a-ac77-478b-8905-7f289689a49e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403d874f-f492-4385-9357-0cfb921280ef", "tag": "e611ef6b-18b8-432b-b099-d713b62b2ebb"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:17.039725 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b0f8812-18ef-47e7-b94a-ed5e938332fe tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:17.040218 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b0f8812-18ef-47e7-b94a-ed5e938332fe tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:17.040678 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b0f8812-18ef-47e7-b94a-ed5e938332fe tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:17.041371 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b0f8812-18ef-47e7-b94a-ed5e938332fe tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:17.041862 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b0f8812-18ef-47e7-b94a-ed5e938332fe tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:17.042419 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-2b0f8812-18ef-47e7-b94a-ed5e938332fe tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:17.044627 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d616428f-fa3e-4b75-b738-33bf03460580 req-3ac6f25a-ac77-478b-8905-7f289689a49e service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:17.045345 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d616428f-fa3e-4b75-b738-33bf03460580 req-3ac6f25a-ac77-478b-8905-7f289689a49e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:17.045894 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-d616428f-fa3e-4b75-b738-33bf03460580 req-3ac6f25a-ac77-478b-8905-7f289689a49e service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:17.057376 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-d616428f-fa3e-4b75-b738-33bf03460580 req-3ac6f25a-ac77-478b-8905-7f289689a49e service nova] Creating event network-changed:e611ef6b-18b8-432b-b099-d713b62b2ebb for instance 403d874f-f492-4385-9357-0cfb921280ef on n-h2-852084-5 Aug 27 04:07:17.063096 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-d616428f-fa3e-4b75-b738-33bf03460580 req-3ac6f25a-ac77-478b-8905-7f289689a49e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034394 Aug 27 04:07:17.064466 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3686/7557] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:17.069817 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-2b0f8812-18ef-47e7-b94a-ed5e938332fe tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Going to try to terminate instance {{(pid=122488) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 27 04:07:17.157206 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-2b0f8812-18ef-47e7-b94a-ed5e938332fe tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "DELETE /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 204 len: 0 microversion: 2.1 time: 0.130208 Aug 27 04:07:17.158821 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3872/7558] 10.222.0.99 () {58 vars in 1239 bytes} [Sat Aug 27 04:07:17 2022] DELETE /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:07:17.170184 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-0a7f1608-6a50-40d5-bfe5-1c05e1bea320 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:17.170903 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-0a7f1608-6a50-40d5-bfe5-1c05e1bea320 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:17.177864 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a7f1608-6a50-40d5-bfe5-1c05e1bea320 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:17.178362 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a7f1608-6a50-40d5-bfe5-1c05e1bea320 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:17.178813 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a7f1608-6a50-40d5-bfe5-1c05e1bea320 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:17.179524 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a7f1608-6a50-40d5-bfe5-1c05e1bea320 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:17.179991 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a7f1608-6a50-40d5-bfe5-1c05e1bea320 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:17.180428 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-0a7f1608-6a50-40d5-bfe5-1c05e1bea320 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:17.336351 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.policy [None req-0a7f1608-6a50-40d5-bfe5-1c05e1bea320 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122487) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:17.344673 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-0a7f1608-6a50-40d5-bfe5-1c05e1bea320 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1683 microversion: 2.1 time: 0.180198 Aug 27 04:07:17.345300 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3687/7559] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:17 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:18.368204 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-ba55bdba-e082-407c-8cdb-18822d91457a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:18.369039 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-ba55bdba-e082-407c-8cdb-18822d91457a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:18.375830 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba55bdba-e082-407c-8cdb-18822d91457a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:18.376314 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba55bdba-e082-407c-8cdb-18822d91457a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:18.376751 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba55bdba-e082-407c-8cdb-18822d91457a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:18.377446 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba55bdba-e082-407c-8cdb-18822d91457a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:18.377935 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba55bdba-e082-407c-8cdb-18822d91457a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:18.378366 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-ba55bdba-e082-407c-8cdb-18822d91457a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:18.512868 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-ba55bdba-e082-407c-8cdb-18822d91457a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:18.520739 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-ba55bdba-e082-407c-8cdb-18822d91457a tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1683 microversion: 2.1 time: 0.157152 Aug 27 04:07:18.521316 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3873/7560] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:18 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:19.198746 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [req-258444ca-5708-4a24-94df-dfe05ad53db4 req-ff0d367a-d19a-493e-8809-a94172b19aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403d874f-f492-4385-9357-0cfb921280ef", "name": "network-vif-deleted", "tag": "e611ef6b-18b8-432b-b099-d713b62b2ebb"}]} {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:19.210290 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-258444ca-5708-4a24-94df-dfe05ad53db4 req-ff0d367a-d19a-493e-8809-a94172b19aa7 service nova] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:19.210690 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-258444ca-5708-4a24-94df-dfe05ad53db4 req-ff0d367a-d19a-493e-8809-a94172b19aa7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:19.211139 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [req-258444ca-5708-4a24-94df-dfe05ad53db4 req-ff0d367a-d19a-493e-8809-a94172b19aa7 service nova] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:19.223129 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.compute.server_external_events [req-258444ca-5708-4a24-94df-dfe05ad53db4 req-ff0d367a-d19a-493e-8809-a94172b19aa7 service nova] Creating event network-vif-deleted:e611ef6b-18b8-432b-b099-d713b62b2ebb for instance 403d874f-f492-4385-9357-0cfb921280ef on n-h2-852084-5 Aug 27 04:07:19.227913 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [req-258444ca-5708-4a24-94df-dfe05ad53db4 req-ff0d367a-d19a-493e-8809-a94172b19aa7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033177 Aug 27 04:07:19.228688 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3688/7561] 10.222.0.99 () {64 vars in 1317 bytes} [Sat Aug 27 04:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:19.542908 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:19.543528 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.compute.api [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122488) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:19.556645 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:19.557151 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:19.557594 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:19.558343 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:19.558805 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:19.559237 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:19.593617 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:19.594396 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:19.594843 n-d-852084-5 devstack@n-api.service[122488]: DEBUG oslo_concurrency.lockutils [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122488) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:19.595301 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.objects.instance [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lazy-loading 'fault' on Instance uuid 403d874f-f492-4385-9357-0cfb921280ef {{(pid=122488) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 27 04:07:19.641641 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.policy [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81a574e4c4f4f8b920f68192c80c0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191c30ef589040a58c314da57810285e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122488) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:19.649789 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-aa55b3fe-d571-4ff1-a0c0-00b9831af34f tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 200 len: 1339 microversion: 2.1 time: 0.110850 Aug 27 04:07:19.650376 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3874/7562] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:19 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 1339 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:20.673609 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '>' {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:20.674336 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.compute.api [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] [instance: 403d874f-f492-4385-9357-0cfb921280ef] Fetching instance by UUID {{(pid=122487) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 27 04:07:20.682042 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:20.682551 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:20.683007 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:20.683722 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Acquiring lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 27 04:07:20.684194 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 27 04:07:20.684641 n-d-852084-5 devstack@n-api.service[122487]: DEBUG oslo_concurrency.lockutils [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Lock "8ef2b9ff-883a-43ea-9ea9-638fb5ee225c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122487) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 27 04:07:20.698131 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.wsgi [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] HTTP exception thrown: Instance 403d874f-f492-4385-9357-0cfb921280ef could not be found. Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Request method failure captured: Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: request: GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef HTTP/1.1 Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: Accept: application/json Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: Accept-Encoding: identity Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: Connection: close Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: Content-Length: 0 Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: Content-Type: application/json Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: Host: 10.222.0.99 Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: Openstack-System-Scope: None Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: User-Agent: python-urllib3/1.26.11 Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Auth-Token: gAAAAABjCZdmeJMZgQXiJloaOrKg3SM6Atc0ZxqLL-dh3HYL9nf3vnkRMz1pwE_RVc1HkTtdOi7AwnNP9Ec8frX6QKlKvzg2DCIs_mLGrpj0O4f1AFy7NmbfSM9aPTGV_t6G6vdusfF8hxvpGVOnvI8vDCzC4SP_TWVkcAnWjB5XaWFnyDIehQ0 Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Id: None Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Domain-Name: None Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Identity-Status: Confirmed Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Is-Admin-Project: True Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Id: default Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Domain-Name: Default Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Id: 191c30ef589040a58c314da57810285e Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Project-Name: tempest-TestSnapshotPattern-1453110337 Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Role: member,reader Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Roles: member,reader Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_191c30ef589040a58c314da57810285e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/191c30ef589040a58c314da57810285e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/191c30ef589040a58c314da57810285e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/191c30ef589040a58c314da57810285e"}]}] Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant: tempest-TestSnapshotPattern-1453110337 Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Id: 191c30ef589040a58c314da57810285e Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-Tenant-Name: tempest-TestSnapshotPattern-1453110337 Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-User: tempest-TestSnapshotPattern-1453110337-project Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Id: default Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-User-Domain-Name: Default Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-User-Id: d81a574e4c4f4f8b920f68192c80c0b2 Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: X-User-Name: tempest-TestSnapshotPattern-1453110337-project Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: method: > Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: exception: Instance 403d874f-f492-4385-9357-0cfb921280ef could not be found. Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: action_args: {'id': '403d874f-f492-4385-9357-0cfb921280ef'} Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: {{(pid=122487) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403d874f-f492-4385-9357-0cfb921280ef could not be found. Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403d874f-f492-4385-9357-0cfb921280ef could not be found. Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 27 04:07:20.699816 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:07:20.705410 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 27 04:07:20.705410 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 27 04:07:20.705410 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 27 04:07:20.705410 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 27 04:07:20.705410 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 27 04:07:20.705410 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403d874f-f492-4385-9357-0cfb921280ef could not be found. Aug 27 04:07:20.705410 n-d-852084-5 devstack@n-api.service[122487]: ERROR nova.api.openstack.wsgi Aug 27 04:07:20.705410 n-d-852084-5 devstack@n-api.service[122487]: DEBUG nova.api.openstack.wsgi [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Returning 404 to user: Instance 403d874f-f492-4385-9357-0cfb921280ef could not be found. {{(pid=122487) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 27 04:07:20.705410 n-d-852084-5 devstack@n-api.service[122487]: INFO nova.api.openstack.requestlog [None req-2548d919-cfad-4bb8-9672-7f701ed94e7d tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef" status: 404 len: 111 microversion: 2.1 time: 0.033211 Aug 27 04:07:20.705410 n-d-852084-5 devstack@n-api.service[122487]: [pid: 122487|app: 0|req: 3689/7563] 10.222.0.99 () {58 vars in 1236 bytes} [Sat Aug 27 04:07:20 2022] GET /compute/v2.1/servers/403d874f-f492-4385-9357-0cfb921280ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:07:20.872207 n-d-852084-5 devstack@n-api.service[122488]: DEBUG nova.api.openstack.wsgi [None req-483a3dd0-be70-4897-8d9e-051aabfd92e3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] Calling method '.version_select at 0x7f4d2928a790>' {{(pid=122488) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:20.903661 n-d-852084-5 devstack@n-api.service[122488]: INFO nova.api.openstack.requestlog [None req-483a3dd0-be70-4897-8d9e-051aabfd92e3 tempest-TestSnapshotPattern-1453110337 tempest-TestSnapshotPattern-1453110337-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1710461830" status: 202 len: 0 microversion: 2.1 time: 0.035199 Aug 27 04:07:20.909402 n-d-852084-5 devstack@n-api.service[122488]: [pid: 122488|app: 0|req: 3875/7564] 10.222.0.99 () {58 vars in 1257 bytes} [Sat Aug 27 04:07:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1710461830 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)